-- Logs begin at Tue 2022-10-11 03:17:23 UTC, end at Tue 2022-10-11 06:15:59 UTC. -- Oct 11 03:59:46.601961 n-d-860892-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 03:59:46.610588 n-d-860892-1 devstack@n-api.service[105118]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 03:59:46.612581 n-d-860892-1 devstack@n-api.service[105118]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 03:59:46 2022] *** Oct 11 03:59:46.612581 n-d-860892-1 devstack@n-api.service[105118]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 03:59:46.612581 n-d-860892-1 devstack@n-api.service[105118]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 03:59:46.612581 n-d-860892-1 devstack@n-api.service[105118]: nodename: n-d-860892-1 Oct 11 03:59:46.612581 n-d-860892-1 devstack@n-api.service[105118]: machine: x86_64 Oct 11 03:59:46.612581 n-d-860892-1 devstack@n-api.service[105118]: clock source: unix Oct 11 03:59:46.612581 n-d-860892-1 devstack@n-api.service[105118]: pcre jit disabled Oct 11 03:59:46.612581 n-d-860892-1 devstack@n-api.service[105118]: detected number of CPU cores: 4 Oct 11 03:59:46.612581 n-d-860892-1 devstack@n-api.service[105118]: current working directory: / Oct 11 03:59:46.612581 n-d-860892-1 devstack@n-api.service[105118]: detected binary path: /usr/bin/uwsgi-core Oct 11 03:59:46.613212 n-d-860892-1 devstack@n-api.service[105118]: your processes number limit is 47680 Oct 11 03:59:46.613212 n-d-860892-1 devstack@n-api.service[105118]: your memory page size is 4096 bytes Oct 11 03:59:46.613212 n-d-860892-1 devstack@n-api.service[105118]: detected max file descriptor number: 2048 Oct 11 03:59:46.613212 n-d-860892-1 devstack@n-api.service[105118]: lock engine: pthread robust mutexes Oct 11 03:59:46.613212 n-d-860892-1 devstack@n-api.service[105118]: thunder lock: enabled Oct 11 03:59:46.613212 n-d-860892-1 devstack@n-api.service[105118]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 03:59:46.613212 n-d-860892-1 devstack@n-api.service[105118]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 03:59:46.652616 n-d-860892-1 devstack@n-api.service[105118]: Python main interpreter initialized at 0x56214dcf99c0 Oct 11 03:59:46.652616 n-d-860892-1 devstack@n-api.service[105118]: python threads support enabled Oct 11 03:59:46.652616 n-d-860892-1 devstack@n-api.service[105118]: your server socket listen backlog is limited to 100 connections Oct 11 03:59:46.652616 n-d-860892-1 devstack@n-api.service[105118]: your mercy for graceful operations on workers is 90 seconds Oct 11 03:59:46.652971 n-d-860892-1 devstack@n-api.service[105118]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 03:59:46.653046 n-d-860892-1 devstack@n-api.service[105118]: *** Operational MODE: preforking *** Oct 11 03:59:46.653298 n-d-860892-1 devstack@n-api.service[105118]: *** uWSGI is running in multiple interpreter mode *** Oct 11 03:59:46.653298 n-d-860892-1 devstack@n-api.service[105118]: spawned uWSGI master process (pid: 105118) Oct 11 03:59:46.653492 n-d-860892-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 11 03:59:46.654666 n-d-860892-1 devstack@n-api.service[105118]: spawned uWSGI worker 1 (pid: 105119, cores: 1) Oct 11 03:59:46.654666 n-d-860892-1 devstack@n-api.service[105118]: spawned uWSGI worker 2 (pid: 105120, cores: 1) Oct 11 03:59:46.654666 n-d-860892-1 devstack@n-api.service[105118]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 03:59:47.306644 n-d-860892-1 devstack@n-api.service[105119]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 03:59:47.307261 n-d-860892-1 devstack@n-api.service[105120]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 03:59:48.381507 n-d-860892-1 devstack@n-api.service[105119]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 03:59:48.381507 n-d-860892-1 devstack@n-api.service[105119]: from cryptography.utils import int_from_bytes Oct 11 03:59:48.382132 n-d-860892-1 devstack@n-api.service[105119]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 03:59:48.382132 n-d-860892-1 devstack@n-api.service[105119]: from cryptography.utils import int_from_bytes Oct 11 03:59:48.382958 n-d-860892-1 devstack@n-api.service[105120]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 03:59:48.382958 n-d-860892-1 devstack@n-api.service[105120]: from cryptography.utils import int_from_bytes Oct 11 03:59:48.383389 n-d-860892-1 devstack@n-api.service[105120]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 03:59:48.383389 n-d-860892-1 devstack@n-api.service[105120]: from cryptography.utils import int_from_bytes Oct 11 03:59:50.838062 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 03:59:50.838629 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 03:59:50.838850 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 03:59:50.839069 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 03:59:50.839420 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 03:59:50.839510 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 03:59:50.839604 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 03:59:50.839811 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.839904 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 03:59:50.840130 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.840224 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 03:59:50.840422 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 03:59:50.840521 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.840746 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.840854 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.841071 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.841171 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.841376 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.841469 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.841686 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.841772 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.841997 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.842098 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.842345 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.842446 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.842602 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.842739 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.842910 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.843008 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.843226 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860892-1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.843321 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.843530 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.843623 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.843830 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.843929 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.844133 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.844218 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860892-1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.844443 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.844534 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.844746 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.844897 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.845060 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.845203 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.845358 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.845469 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.845665 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.845846 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.845999 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.846285 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.846386 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.846591 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.846808 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.846914 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.847121 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.847226 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.847431 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.847553 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.847724 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.847846 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.848062 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.848150 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.848373 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.848473 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.848680 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.848767 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.848983 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.849071 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.849290 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.849422 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860892-1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.850163 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.850280 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.850486 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.850587 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.850815 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.850914 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860892-1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.851183 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.851286 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.851494 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.851587 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.851804 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.851905 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.852120 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.852219 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.852436 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.852523 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.852741 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.852875 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.853076 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.853172 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.853391 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.853495 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.853702 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.853794 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.854012 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.854102 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.854333 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.854434 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.854636 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.854723 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.854942 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.855028 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.855255 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.855378 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.855552 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.855648 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.855845 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.855932 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.856089 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.856188 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.856390 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.856484 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.856701 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.856793 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.856971 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.857092 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.857278 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.857373 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.857546 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.857640 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.857790 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.857908 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.858099 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.858209 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.858436 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.858539 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.858698 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.858792 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.859014 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.859102 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.859313 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.859408 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.859613 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.859700 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.859911 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.859997 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.860210 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.860322 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.860510 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.860597 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.860810 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.860896 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.861128 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.861231 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.861416 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.861510 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.861720 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.861807 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.862022 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.862108 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.862357 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.862461 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.862677 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.862763 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.862984 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.863075 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.863288 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.863381 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.863620 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.863708 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.863917 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.864004 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.864223 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.864322 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.864534 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.864620 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.864855 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.864956 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.865183 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.865273 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.865484 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.865592 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.865787 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.865878 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.866094 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.866216 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.866429 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.866526 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.866728 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.866815 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.866974 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.867062 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.867272 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.867371 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.867572 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.867663 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.867884 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.867976 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.868185 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.868280 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.868485 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.868834 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.869049 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.869135 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.869343 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.869432 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.869645 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.869742 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.869945 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.870044 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.870268 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.870386 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.870572 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.870667 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.870875 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.870961 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.871175 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.871262 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.871476 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.871561 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.871775 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.871859 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.872076 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.872171 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.872373 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.872464 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.872674 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.872765 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.872976 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.873070 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.873277 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.873374 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.873577 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.873672 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.873876 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.873969 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.874176 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.874305 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.874503 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.874602 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.874808 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.874896 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.875107 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.875245 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.875422 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.875560 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.875721 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.875816 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.876021 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.876109 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.876332 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.876431 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.876632 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.876727 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.876932 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.877017 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.877243 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.877411 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.877539 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.877632 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.877840 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.877935 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.878150 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.878271 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.878475 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.878572 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.878774 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.878862 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.879074 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.879171 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.879377 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.879464 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.879676 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.879762 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.879975 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.880069 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.880271 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.880363 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.880571 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.880661 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.880888 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.880982 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.881189 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.881274 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.881495 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.881587 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.881794 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.881881 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.882095 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.882180 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.882421 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.882522 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.882736 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.882824 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.883040 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.883131 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.883348 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.883434 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.883670 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 03:59:50.883758 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.884001 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.884093 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.884327 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.884423 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.884655 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.884749 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.884968 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.885052 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.885274 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.885368 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.885586 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.885672 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.885905 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.885999 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.886238 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.886341 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.886547 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.886633 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.886855 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.886950 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.887164 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.887254 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.887473 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.887558 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.887784 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.887891 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.888097 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.888204 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.888410 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.888497 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.888721 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.888807 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.889027 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.889122 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.889341 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.889427 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.889655 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.889741 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.889964 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.890054 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.890302 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.890392 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.890625 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.890726 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.890943 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.891032 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.891252 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.891339 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.891568 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.891653 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.891883 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.891978 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.892189 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.892278 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.892494 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.892591 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.892798 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.892892 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.893135 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.893247 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.893441 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.893541 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.893747 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.893842 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.894059 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.894148 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.894389 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.894492 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.894705 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.894792 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.895018 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.895111 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.895324 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.895420 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.895631 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.895767 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.895936 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.896023 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.896758 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.896866 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.897089 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.897178 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.897397 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.897491 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.897706 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.897832 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.898014 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.898101 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.898340 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.898432 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.898662 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.898751 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.898958 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.899045 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.899263 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.899349 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.899565 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.899653 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.899863 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.899951 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.900160 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.900247 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.900457 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.900546 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.900757 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.900851 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.901053 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.901148 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.901354 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.901447 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.901662 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.901749 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.901962 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.902057 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.902302 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.902390 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.902604 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.902708 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.902907 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.903002 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.903212 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.903298 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.903515 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.903602 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.903813 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.903912 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.904120 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.904206 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.904422 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.904509 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.904721 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.904808 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.905029 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.905115 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.905335 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.905421 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.905654 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.905744 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.905952 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.906039 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.906278 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.906423 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.906576 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.906715 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.906872 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.907029 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.907175 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.907309 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.907456 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.907601 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.907760 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.907851 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.908062 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.908213 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.908370 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.908507 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.908673 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.908824 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.908960 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.909103 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.909288 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.909426 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.909600 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.909736 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.909896 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.910046 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.910230 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.910380 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.910555 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.910697 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.910846 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.910993 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.911131 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.911267 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.911435 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.911573 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.911718 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.911885 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.912573 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.912710 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.912876 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.913011 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.913162 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.913297 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.913463 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.913595 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.913759 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.913899 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.914059 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.914233 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.914385 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.914530 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.914684 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.914833 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.915002 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.915136 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.915309 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.915439 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.915609 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.915741 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.915902 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.916064 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.916234 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.916378 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.916522 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.916668 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.916824 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.916968 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.917159 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.917307 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.917486 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.917632 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.917799 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.917936 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.918115 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.918274 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.918447 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.918591 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.918759 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.918905 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.919065 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.919213 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.919360 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.919495 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.919663 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.919796 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.919968 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.920112 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.920282 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.920424 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.920587 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.920720 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.920899 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.921034 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.921205 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.921346 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.921520 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.921657 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.921838 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.921971 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.922145 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.922309 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.922490 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.922629 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.922801 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.922947 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.923120 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.923269 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.923410 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.923553 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.923722 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.923867 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.924049 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.924185 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.924356 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.924495 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.924665 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.924824 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.924970 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.925106 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.925251 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.925386 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.925557 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.925703 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.925861 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.925999 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.926170 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.926377 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.926510 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.926651 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.926790 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.926939 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.927077 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.927241 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.927384 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.927541 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.927683 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.927827 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.927996 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.928148 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.928297 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.928436 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.928580 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.928729 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.928900 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.929049 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.929264 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.929407 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.929545 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.929682 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.929813 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.929897 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.930113 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.930251 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.930441 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.930542 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.930747 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.930850 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.931053 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.931140 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.931354 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.931441 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.931653 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.931750 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.931955 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.932049 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.932260 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.932346 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.932562 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.932656 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.932865 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.932953 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.933167 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.933271 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.933471 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.933566 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.933769 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.933855 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.934068 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.934153 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.934387 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.934483 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.934693 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.934780 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.934998 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.935085 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.935304 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.935399 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.935616 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.935703 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.935929 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.936015 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.936228 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.936368 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.936526 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.936659 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.936841 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.936986 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.937138 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.937276 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.937419 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.937562 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.937700 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.937836 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.938004 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.938138 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.938352 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.938495 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.938659 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.938829 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.938977 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.939109 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.939246 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.939381 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.939559 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.939705 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.939870 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.939989 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.940180 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.940270 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.940486 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.940583 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.940791 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.940878 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.941102 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.941195 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.941409 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.941507 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.941712 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.941798 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.942020 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.942112 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.942350 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.942440 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.942657 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.942752 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.942961 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.943045 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.943304 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.943391 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.943608 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.943693 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.943916 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.944001 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.944220 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.944305 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.944519 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.944603 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.944823 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.944908 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.945133 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.945224 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.945438 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.945692 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.945791 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.946024 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.946111 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.946364 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.946625 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.946723 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.946955 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.947055 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.947305 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.947401 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.947628 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.947714 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.947972 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.948066 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.948293 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.948391 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.948593 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.948680 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.948901 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.948986 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.949201 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.949294 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.949500 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.949592 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.949807 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.949906 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.950110 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.950254 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.950431 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.950518 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.950733 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.950818 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.951037 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.951132 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.951336 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.951422 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.951637 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.951731 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.951936 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.952039 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.952233 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.952319 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.952534 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.952617 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.952831 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.952919 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.953131 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.953215 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.953426 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.953511 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.953733 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.953825 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.954034 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.954118 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.954356 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.954444 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.954656 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.954751 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.954954 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.955040 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.955259 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.955349 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.955564 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.955659 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.955868 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.955954 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.956204 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.956301 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.956508 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.956621 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.956832 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.956929 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.957128 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.957224 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.957447 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.957540 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.957746 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.957832 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.958045 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.958143 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.958370 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.958497 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.958676 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.959330 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.959478 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.959616 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.959782 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.959921 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.960089 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.960226 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.960382 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.960479 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.960685 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.960772 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.960987 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.961110 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.961285 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.961373 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.961587 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.961676 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.961885 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.961971 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.962207 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.962298 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.962510 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.962607 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.962809 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.962897 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.963106 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.963195 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.963410 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.963498 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.963709 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.963807 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.964005 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.964091 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.964308 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.964404 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.964606 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.964707 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.964905 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.964992 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.965200 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.965291 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.965497 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.965595 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.965798 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.965887 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.966096 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.966208 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.966421 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.966576 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.966718 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.966806 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.967025 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.967114 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.967328 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.967416 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.967625 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.967711 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.967922 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.968011 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.968224 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.968335 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.968521 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.968611 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.968819 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.968906 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.969121 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.969208 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.969421 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.969507 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.969724 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.969818 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.970018 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.970127 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.970347 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.970494 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.970647 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.970749 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.970945 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.971032 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.971241 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.971326 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.971543 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.971636 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.971837 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.971921 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.972135 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.972227 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.972430 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.972523 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.972728 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.972814 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.973024 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.973108 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.973323 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.973415 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.973624 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.973705 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.973921 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.974014 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.974234 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.974324 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.975089 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.975195 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.975407 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.975491 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.975710 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.975805 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.976013 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.976100 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.976350 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.976441 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.976653 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.976750 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.976964 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.977114 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.977266 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.977404 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.977550 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.977693 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.977858 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.977998 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.978156 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.978322 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.978486 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.978573 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.978790 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.978885 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.979094 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.979191 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.979392 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.979479 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.979688 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.979776 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.979996 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.980098 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.980300 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.980425 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.980601 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.980688 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.980915 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.981059 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.981223 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.981311 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.981533 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.981621 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.981829 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.981918 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.982134 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.982258 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.982463 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.982559 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.982763 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.982852 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.983067 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.983194 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.983370 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.983457 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.983672 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.983803 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.983975 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.984061 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.984280 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.984366 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.984582 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.984676 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.984885 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.984973 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.985185 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.985272 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.985488 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.985583 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.985793 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.985878 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.986089 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.986219 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.986418 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.986505 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.986719 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.986804 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.987019 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.987163 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.987322 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.987410 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.987622 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.987709 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.987924 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.988018 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.988240 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.988349 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.988524 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.988646 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.988834 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.989129 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.989217 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.989440 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.989556 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.989745 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.989868 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.990075 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.990223 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.990406 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.990546 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.990719 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.990818 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.991027 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.991112 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.991327 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.991420 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.991713 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.991807 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.992015 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.992101 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.992326 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.992432 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.992632 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.992727 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.992932 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.993037 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.993228 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.993346 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.993796 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.993919 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.994119 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.994243 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.994485 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.994582 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.994785 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.994872 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.995084 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.995170 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.995400 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.995485 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.995699 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.995785 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.996013 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.996096 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.996316 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.996410 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.996633 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.996718 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.997009 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.997122 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.997340 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.997436 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.997644 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.997729 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.997999 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.998083 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.998339 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.998467 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.998659 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.998791 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.998982 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.999068 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.999281 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.999366 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.999589 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.999682 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.999894 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:50.999981 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.000202 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.000286 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.000510 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.000642 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.000817 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.000901 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.001124 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.001219 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.001425 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.001520 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.001734 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.001819 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.002038 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.002123 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.002366 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.002454 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.002687 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.002844 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.002995 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.003080 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.003315 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.003404 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.003701 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.003785 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.004020 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.004113 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.004334 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.004420 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.004635 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.004718 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.004936 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.005030 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.005243 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.005338 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.005545 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.006177 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.006402 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.006505 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.006715 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.006800 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.007016 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.007120 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.007322 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.007423 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.007623 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.007715 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.007924 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.008010 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.008224 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.008319 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.008523 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.008610 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.008822 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.008907 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.009125 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.009220 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.009442 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.009528 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.009749 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.009847 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.010067 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.010155 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.010404 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.010492 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.010705 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.010788 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.011021 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.011108 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.011323 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.011407 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.011622 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.011706 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.011921 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.012009 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.012220 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.012313 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.012521 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.012614 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.012824 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.012910 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.013147 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.013238 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.013458 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.013551 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.013776 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.013862 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.014079 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.014163 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.014433 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.014530 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.014747 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.014832 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.015057 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.015148 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.015362 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.015457 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.015676 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.015763 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.015990 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.016075 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.016294 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.016379 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.016595 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.016688 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.016901 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.016987 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.017203 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.017300 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.017499 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.017600 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.017797 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.017885 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.018097 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.018223 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.018423 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.018520 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.018728 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.018815 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.019027 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.019120 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.019329 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.019416 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.019628 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.019723 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.019946 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.020040 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.020248 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.020333 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.020548 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.020641 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.020848 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.020943 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.021147 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.021795 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.021988 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.022131 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.022329 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.022430 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.022674 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.022762 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.022983 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.023078 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.023312 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.023399 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.023624 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.023711 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.023939 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.024026 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.024255 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.024351 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.024566 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.024653 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.024877 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.024971 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.025185 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.025270 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.025495 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.025587 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.025800 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.025887 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.026110 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.026307 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.026445 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.026531 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.026756 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.026842 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.027064 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.027270 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.027391 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.027597 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.027884 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.027972 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.028203 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.028289 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.028510 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.028606 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.028819 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.028904 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.029127 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.029219 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.029435 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.029598 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.029742 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.029829 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.030048 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.030134 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.030376 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.030473 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.030686 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.030770 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.030994 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.031079 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.031312 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.031398 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.031627 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.031711 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.031938 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.032021 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.032248 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.032344 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.032557 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.032643 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.032864 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.032959 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.033220 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.033344 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.033476 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.033604 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.033799 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.033894 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.034106 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.034227 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.034441 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.034530 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.034749 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.034837 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.035057 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.035143 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.035362 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.035462 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.035671 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.035757 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.035976 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.036060 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.036285 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.036369 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.036589 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.036678 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.036919 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.037009 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.037225 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.037337 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.037537 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.037634 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.037846 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.037941 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.038165 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.038326 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.038496 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.038584 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.038807 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.038895 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.039115 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.039215 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.039428 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.039625 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.039748 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.039935 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.040262 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.040349 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.040574 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.040659 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.040892 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.040980 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.041201 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.041303 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.041510 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.041596 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.041820 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.041905 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.042121 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.042226 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.042456 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.042542 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.042761 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.042847 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.043060 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.043147 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.043355 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.043440 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.043661 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.043755 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.043964 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.044049 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.044263 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.044358 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.044575 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.044669 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.044876 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.044961 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.045191 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.045396 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.045482 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.045731 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.046015 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.046102 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.046375 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.046464 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.046692 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.046789 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.047000 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.047085 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.047302 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.047395 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.047619 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.047717 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.047919 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.048015 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.048217 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.048304 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.048531 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.048616 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.048835 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.048921 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.049130 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.049215 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.049429 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.049517 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.049734 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.049820 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.050034 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.050119 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.050352 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.050440 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.050658 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.050744 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.050959 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.051056 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.051268 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.051357 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.051563 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.051661 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.051862 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.051961 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.052161 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.052247 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.052479 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.052616 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.052783 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.052877 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.053080 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.053167 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.053380 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.053466 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.053677 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.053771 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.053976 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.054060 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.054303 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.054392 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.054615 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.054709 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.054916 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.055003 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.055221 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.055313 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.055521 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.055608 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.055829 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.055915 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.056139 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.056225 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.056461 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.056555 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.056759 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.056845 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.057058 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.057144 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.057363 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.057449 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.057669 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.057790 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.057983 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.058097 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.058309 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.058409 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.058616 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.058727 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.058927 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.059037 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.059237 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.059335 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.059585 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.059766 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.059902 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.060093 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.060407 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.060493 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.060734 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.060821 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.061073 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.061219 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.061351 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.061438 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.061651 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.061744 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.061950 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.062045 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.062290 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.062380 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.062645 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.062742 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.062896 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.062983 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.063199 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.063284 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.063504 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.063590 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.063811 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.063897 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.064113 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.064198 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.064417 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.064510 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.064720 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.064812 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.065024 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.065110 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.065326 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.065487 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.065629 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.065717 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.065933 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.066018 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.066255 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.066358 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.066561 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.066646 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.066866 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.066950 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.067170 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.067256 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.067481 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.067567 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.067802 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.067910 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.068619 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.068730 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.068935 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.069033 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.069241 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.069339 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.069544 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.069650 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.069847 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.069945 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.070150 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.070268 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.070483 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.070582 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.070791 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.070887 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.071102 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.071214 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.071403 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.071500 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.071722 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.072027 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.072130 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.072348 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.072664 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.072756 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.072982 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.073078 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.073285 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.073386 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.073604 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.073700 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.073912 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.074007 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.074235 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.074328 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.074555 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.074646 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.074862 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.074950 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.075179 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.075267 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.075491 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.075580 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.075819 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.075908 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.076137 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.076230 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.076442 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.076531 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.076744 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.076840 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.077042 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.077132 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.077346 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.077434 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.077647 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.077747 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.077952 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.078039 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.078270 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.078362 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.078571 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.078673 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.078878 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.078967 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.079178 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.079265 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.079476 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.079565 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.079774 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.079862 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.080074 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.080161 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.080375 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.080463 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.080672 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.080761 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.080970 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.081058 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.081269 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.081358 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.081563 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.081660 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.081859 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.081954 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.082155 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.082264 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.082477 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.082565 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.082776 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.082872 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.083078 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.083189 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.083377 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.083467 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.083673 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.084305 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.084518 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.084606 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.084817 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.084905 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.085120 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.085217 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.085453 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.085547 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.085768 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.085856 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.086075 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.086178 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.086421 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.086510 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.086728 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.086816 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.087047 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.087136 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.087357 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.087445 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.087669 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.087765 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.087975 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.088160 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.088270 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.088348 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.088586 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.088685 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.088890 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.088985 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.089195 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.089286 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.089499 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.089586 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.089802 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.089891 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.090107 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.090318 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.090442 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.090545 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.090752 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.090840 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.091077 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.091164 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.091394 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.091495 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.091698 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.091797 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.092009 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.092096 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.092318 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.092414 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.092625 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.092720 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.092934 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.093020 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.093241 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.093329 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.093545 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.093633 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.093847 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.093936 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.094153 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.094263 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.094481 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.094576 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.094790 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.094881 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.095095 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.095186 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.095400 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.095488 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.095705 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.095800 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.096012 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.096099 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.096320 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.096407 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.096633 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.096733 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.096943 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.097030 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.097262 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.097349 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.097568 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.097663 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.097893 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.097988 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.098228 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.098326 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.098568 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.098670 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.098879 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.098967 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.099189 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.099276 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.099522 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.099614 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.099821 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.099909 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.100064 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105119) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 03:59:51.100192 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.100450 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 03:59:51.100693 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105120) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 03:59:51.252133 n-d-860892-1 devstack@n-api.service[105119]: INFO dbcounter [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Registered counter for database nova_api Oct 11 03:59:51.252932 n-d-860892-1 devstack@n-api.service[105120]: INFO dbcounter [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Registered counter for database nova_api Oct 11 03:59:51.273817 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_db.sqlalchemy.engines [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 03:59:51.275847 n-d-860892-1 devstack@n-api.service[105120]: DEBUG oslo_db.sqlalchemy.engines [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 03:59:51.280364 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writer thread running {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 03:59:51.282264 n-d-860892-1 devstack@n-api.service[105120]: DEBUG dbcounter [-] [105120] Writer thread running {{(pid=105120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 03:59:51.336118 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.context [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f919055-bb4c-4077-93f0-960b402ab88d(cell1) {{(pid=105119) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 03:59:51.338041 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.context [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f919055-bb4c-4077-93f0-960b402ab88d(cell1) {{(pid=105120) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 03:59:51.339992 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 03:59:51.340412 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 03:59:51.341898 n-d-860892-1 devstack@n-api.service[105120]: DEBUG oslo_concurrency.lockutils [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 03:59:51.341991 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 03:59:51.342408 n-d-860892-1 devstack@n-api.service[105120]: DEBUG oslo_concurrency.lockutils [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 03:59:51.342714 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 03:59:51.343157 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 03:59:51.343999 n-d-860892-1 devstack@n-api.service[105120]: DEBUG oslo_concurrency.lockutils [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 03:59:51.344723 n-d-860892-1 devstack@n-api.service[105120]: DEBUG oslo_concurrency.lockutils [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 03:59:51.345127 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 03:59:51.345229 n-d-860892-1 devstack@n-api.service[105120]: DEBUG oslo_concurrency.lockutils [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 03:59:51.347105 n-d-860892-1 devstack@n-api.service[105119]: INFO dbcounter [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Registered counter for database nova_cell0 Oct 11 03:59:51.347202 n-d-860892-1 devstack@n-api.service[105120]: DEBUG oslo_concurrency.lockutils [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105120) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 03:59:51.349118 n-d-860892-1 devstack@n-api.service[105120]: INFO dbcounter [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Registered counter for database nova_cell0 Oct 11 03:59:51.351083 n-d-860892-1 devstack@n-api.service[105119]: INFO dbcounter [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Registered counter for database nova_cell1 Oct 11 03:59:51.353109 n-d-860892-1 devstack@n-api.service[105120]: INFO dbcounter [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Registered counter for database nova_cell1 Oct 11 03:59:51.358515 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_db.sqlalchemy.engines [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 03:59:51.360354 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_db.sqlalchemy.engines [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 03:59:51.361934 n-d-860892-1 devstack@n-api.service[105120]: DEBUG oslo_db.sqlalchemy.engines [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 03:59:51.364129 n-d-860892-1 devstack@n-api.service[105120]: DEBUG oslo_db.sqlalchemy.engines [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 03:59:51.365683 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writer thread running {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 03:59:51.370431 n-d-860892-1 devstack@n-api.service[105120]: DEBUG dbcounter [-] [105120] Writer thread running {{(pid=105120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 03:59:51.372708 n-d-860892-1 devstack@n-api.service[105120]: DEBUG dbcounter [-] [105120] Writer thread running {{(pid=105120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 03:59:51.502567 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writer thread running {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 03:59:51.513293 n-d-860892-1 devstack@n-api.service[105119]: INFO dbcounter [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Registered counter for database nova_cell0 Oct 11 03:59:51.518844 n-d-860892-1 devstack@n-api.service[105120]: INFO dbcounter [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Registered counter for database nova_cell0 Oct 11 03:59:51.522226 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_db.sqlalchemy.engines [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105119) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 03:59:51.527002 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writer thread running {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 03:59:51.527755 n-d-860892-1 devstack@n-api.service[105120]: DEBUG oslo_db.sqlalchemy.engines [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105120) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 03:59:51.532132 n-d-860892-1 devstack@n-api.service[105120]: DEBUG dbcounter [-] [105120] Writer thread running {{(pid=105120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 03:59:51.937791 n-d-860892-1 devstack@n-api.service[105119]: WARNING keystonemiddleware.auth_token [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 03:59:51.945509 n-d-860892-1 devstack@n-api.service[105119]: WARNING keystonemiddleware.auth_token [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 03:59:51.964717 n-d-860892-1 devstack@n-api.service[105120]: WARNING keystonemiddleware.auth_token [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 03:59:51.972000 n-d-860892-1 devstack@n-api.service[105120]: WARNING keystonemiddleware.auth_token [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 03:59:52.286001 n-d-860892-1 devstack@n-api.service[105119]: WARNING keystonemiddleware.auth_token [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 03:59:52.292471 n-d-860892-1 devstack@n-api.service[105119]: WARNING keystonemiddleware.auth_token [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 03:59:52.298569 n-d-860892-1 devstack@n-api.service[105119]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56214dcf99c0 pid: 105119 (default app) Oct 11 03:59:52.300615 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 03:59:52.301793 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 Oct 11 03:59:52.302217 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Tue Oct 11 03:59:52 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 03:59:52.313369 n-d-860892-1 devstack@n-api.service[105120]: WARNING keystonemiddleware.auth_token [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 03:59:52.319391 n-d-860892-1 devstack@n-api.service[105120]: WARNING keystonemiddleware.auth_token [None req-c5744a63-74bf-472d-a2ac-a4a2b189c338 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 03:59:52.324644 n-d-860892-1 devstack@n-api.service[105120]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56214dcf99c0 pid: 105120 (default app) Oct 11 04:01:16.563000 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:16.564632 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002094 Oct 11 04:01:16.565036 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:16.578545 n-d-860892-1 devstack@n-api.service[105120]: DEBUG dbcounter [-] [105120] Writing DB stats nova_api:SELECT=3 {{(pid=105120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:01:16.579458 n-d-860892-1 devstack@n-api.service[105120]: DEBUG dbcounter [-] [105120] Writing DB stats nova_cell1:SELECT=3 {{(pid=105120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:01:16.580361 n-d-860892-1 devstack@n-api.service[105120]: DEBUG dbcounter [-] [105120] Writing DB stats nova_cell0:SELECT=3 {{(pid=105120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:01:16.583311 n-d-860892-1 devstack@n-api.service[105120]: DEBUG dbcounter [-] [105120] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:01:17.426158 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-dabdbb97-a1b0-40cc-9dec-56fc0ae2b24e admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:17.459236 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-dabdbb97-a1b0-40cc-9dec-56fc0ae2b24e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.886415 Oct 11 04:01:17.459895 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 11 04:01:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:01:20.084065 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:20.085072 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-999b94f8-822e-48ef-a8a0-d714f89a5fe7 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Oct 11 04:01:20.085617 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:20.528700 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-50483b64-ff0a-4391-877b-692e0316c801 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "name": "cirros256", "swap": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "c1"}} {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:20.703061 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-50483b64-ff0a-4391-877b-692e0316c801 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.611409 Oct 11 04:01:20.703639 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 11 04:01:20 2022] POST /compute/v2.1/flavors => generated 407 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:01:20.718440 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writing DB stats nova_api:SELECT=3 {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:01:20.719241 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writing DB stats nova_cell0:SELECT=3 {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:01:20.721134 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writing DB stats nova_cell1:SELECT=3 {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:01:20.721878 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:01:20.928471 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-37982160-8394-4242-8379-720d1842f3a7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:21.083949 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-37982160-8394-4242-8379-720d1842f3a7 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.370727 Oct 11 04:01:21.084854 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 11 04:01:20 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:01:23.699320 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-50483b64-ff0a-4391-877b-692e0316c801 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:23.700341 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-50483b64-ff0a-4391-877b-692e0316c801 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 11 04:01:23.700905 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:24.505668 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-c330ad01-1269-454e-a573-5bacda662437 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "vcpus": 1, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "swap": 0, "ram": 512, "os-flavor-access:is_public": true}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:24.665537 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-c330ad01-1269-454e-a573-5bacda662437 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.957718 Oct 11 04:01:24.666374 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 11 04:01:23 2022] POST /compute/v2.1/flavors => generated 404 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:01:24.679515 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-cb8faf25-514e-4a2c-b9b3-19d219063e55 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:24.821899 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-cb8faf25-514e-4a2c-b9b3-19d219063e55 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.146880 Oct 11 04:01:24.823493 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 11 04:01:24 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:01:27.694153 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-c330ad01-1269-454e-a573-5bacda662437 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:27.695325 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-c330ad01-1269-454e-a573-5bacda662437 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001633 Oct 11 04:01:27.695990 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:28.179237 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-5c5df31f-522e-4682-8a08-e47941683774 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "ram": 1024, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "name": "ds1G", "disk": 10}} {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:28.247994 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-5c5df31f-522e-4682-8a08-e47941683774 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.545621 Oct 11 04:01:28.248549 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 11 04:01:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:01:28.260639 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-bb70c66d-f636-4111-8756-281450a0b801 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:28.356245 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-bb70c66d-f636-4111-8756-281450a0b801 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.099170 Oct 11 04:01:28.356860 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 11 04:01:28 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:01:30.983266 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-5c5df31f-522e-4682-8a08-e47941683774 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:30.984196 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-5c5df31f-522e-4682-8a08-e47941683774 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Oct 11 04:01:30.984612 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:31.449649 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-67e547e7-6967-4001-898e-6c2a2507342a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "id": "d3", "swap": 0, "name": "ds2G", "rxtx_factor": 1.0}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:31.527207 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-67e547e7-6967-4001-898e-6c2a2507342a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.536091 Oct 11 04:01:31.527852 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 11 04:01:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:01:31.540698 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-e15389ec-4681-4ce2-b42d-5648cec4ae18 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:31.640713 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-e15389ec-4681-4ce2-b42d-5648cec4ae18 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103716 Oct 11 04:01:31.641631 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 11 04:01:31 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:01:34.343340 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-67e547e7-6967-4001-898e-6c2a2507342a admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:34.344360 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-67e547e7-6967-4001-898e-6c2a2507342a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 11 04:01:34.344760 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:34.800147 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-be7770ed-abcf-4d4d-a0f3-d2e7c5210ec8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "os-flavor-access:is_public": true, "name": "ds4G", "ram": 4096, "rxtx_factor": 1.0, "id": "d4"}} {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:34.879518 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-be7770ed-abcf-4d4d-a0f3-d2e7c5210ec8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.527933 Oct 11 04:01:34.880840 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 11 04:01:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:01:34.895565 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-fb3c7e2d-6b6b-4b6a-83cc-7d6b87b4f63f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:34.978602 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-fb3c7e2d-6b6b-4b6a-83cc-7d6b87b4f63f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089661 Oct 11 04:01:34.979858 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Tue Oct 11 04:01:34 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:01:37.750610 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-be7770ed-abcf-4d4d-a0f3-d2e7c5210ec8 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:37.751664 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-be7770ed-abcf-4d4d-a0f3-d2e7c5210ec8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001554 Oct 11 04:01:37.752078 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:38.178659 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-2e03e710-6762-4177-a9eb-54374839ee04 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:38.209731 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-2e03e710-6762-4177-a9eb-54374839ee04 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.450095 Oct 11 04:01:38.210464 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 11 04:01:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:01:40.860738 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-be7770ed-abcf-4d4d-a0f3-d2e7c5210ec8 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:40.861824 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-be7770ed-abcf-4d4d-a0f3-d2e7c5210ec8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001571 Oct 11 04:01:40.862330 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:41.268292 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-3e08107b-84a3-47f6-a946-1e069edbb00c admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.tiny", "os-flavor-access:is_public": true, "ram": 512, "disk": 1, "vcpus": 1, "id": "1"}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:41.375913 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-3e08107b-84a3-47f6-a946-1e069edbb00c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.506998 Oct 11 04:01:41.376649 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 11 04:01:40 2022] POST /compute/v2.1/flavors => generated 402 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:01:41.390155 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-22da5ccc-9af5-42f6-8921-c352abe4b45e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:41.531307 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-22da5ccc-9af5-42f6-8921-c352abe4b45e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.144780 Oct 11 04:01:41.532091 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 11 04:01:41 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:01:44.095547 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-3e08107b-84a3-47f6-a946-1e069edbb00c admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:44.096478 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-3e08107b-84a3-47f6-a946-1e069edbb00c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 11 04:01:44.097522 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:44.486913 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-ab5713f4-f71f-4539-9cb1-f8ef5ead0ead admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "ram": 2048, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 20, "id": "2", "swap": 0, "rxtx_factor": 1.0}} {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:44.565019 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-ab5713f4-f71f-4539-9cb1-f8ef5ead0ead admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.461478 Oct 11 04:01:44.565577 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 11 04:01:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:01:44.577651 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-61329028-ade5-40db-995d-63ed5a7be27d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:44.660161 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-61329028-ade5-40db-995d-63ed5a7be27d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086010 Oct 11 04:01:44.660804 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 11 04:01:44 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:01:47.237804 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-ab5713f4-f71f-4539-9cb1-f8ef5ead0ead admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:47.238771 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-ab5713f4-f71f-4539-9cb1-f8ef5ead0ead admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Oct 11 04:01:47.239169 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:47.611710 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-c3cb2b88-d7c4-486a-8c89-3dccbec50c77 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 40, "id": "3", "ram": 4096, "name": "m1.medium", "vcpus": 2, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:47.727290 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-c3cb2b88-d7c4-486a-8c89-3dccbec50c77 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.481847 Oct 11 04:01:47.727854 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 11 04:01:47 2022] POST /compute/v2.1/flavors => generated 406 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:01:47.740867 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-657cd436-d4a1-4232-81d8-f1390532c645 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:47.746997 n-d-860892-1 devstack@n-api.service[105120]: DEBUG dbcounter [-] [105120] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:01:47.842094 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-657cd436-d4a1-4232-81d8-f1390532c645 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105470 Oct 11 04:01:47.842946 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 11 04:01:47 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:01:50.507575 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-c3cb2b88-d7c4-486a-8c89-3dccbec50c77 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:50.508933 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-c3cb2b88-d7c4-486a-8c89-3dccbec50c77 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Oct 11 04:01:50.509357 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:50.949015 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-22f4f734-be27-4ce2-813d-ca4bedb3a035 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.large", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "ram": 8192, "swap": 0}} {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:51.039393 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-22f4f734-be27-4ce2-813d-ca4bedb3a035 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.522056 Oct 11 04:01:51.040218 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 11 04:01:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:01:51.053144 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-0d36b29a-2f15-4fb1-97d7-415c871aa048 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:51.057958 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:01:51.140206 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-0d36b29a-2f15-4fb1-97d7-415c871aa048 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091121 Oct 11 04:01:51.141187 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 11 04:01:51 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:01:53.754248 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-22f4f734-be27-4ce2-813d-ca4bedb3a035 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:01:53.755863 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-22f4f734-be27-4ce2-813d-ca4bedb3a035 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002079 Oct 11 04:01:53.761105 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:01:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:01:54.247957 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-04674dc8-55e4-4523-b2d5-b8affc3d52ac admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "ram": 16384, "disk": 160, "rxtx_factor": 1.0, "id": "5", "vcpus": 8}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:54.324500 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-04674dc8-55e4-4523-b2d5-b8affc3d52ac admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.560211 Oct 11 04:01:54.325240 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Tue Oct 11 04:01:53 2022] POST /compute/v2.1/flavors => generated 408 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:01:54.337163 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-72e28ce4-5cbb-482a-9175-285748f583de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:01:54.430543 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-72e28ce4-5cbb-482a-9175-285748f583de admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097065 Oct 11 04:01:54.431360 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Tue Oct 11 04:01:54 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:02:15.195301 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-04674dc8-55e4-4523-b2d5-b8affc3d52ac admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:15.195730 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-04674dc8-55e4-4523-b2d5-b8affc3d52ac admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 11 04:02:15.196077 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:02:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:02:15.207535 n-d-860892-1 devstack@n-api.service[105120]: DEBUG dbcounter [-] [105120] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:02:15.587257 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-9b4f8573-5ffb-49ad-aef9-da6bddf833fd admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:15.605119 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-9b4f8573-5ffb-49ad-aef9-da6bddf833fd admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.402919 Oct 11 04:02:15.605650 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 11 04:02:15 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:02:16.892274 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-04674dc8-55e4-4523-b2d5-b8affc3d52ac admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:16.893287 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-04674dc8-55e4-4523-b2d5-b8affc3d52ac admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 11 04:02:16.893683 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 11 04:02:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:02:17.414564 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-ae154aea-486e-4154-b4bf-dfaf4d1cdf85 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:17.419934 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.wsgi [None req-ae154aea-486e-4154-b4bf-dfaf4d1cdf85 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-ae154aea-486e-4154-b4bf-dfaf4d1cdf85 admin admin] Request method failure captured: Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: Accept: application/json Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: Accept-Encoding: gzip, deflate Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: Connection: keep-alive Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: Content-Length: 0 Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: Host: 10.222.0.26 Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: Openstack-Api-Version: compute 2.92 Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: Openstack-System-Scope: None Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: User-Agent: python-novaclient Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Auth-Token: gAAAAABjROrIPFRhoCpiQ3sRixhT7SRdiAQJU0LdOVrrFwqNtq3cx6JgimPzkuwJiLJitGuAIxfryF31kOyZvwBDhkmrEXdElKCQeVfZ7qTbUCxQ97B_2tRnam8_Aq1tsWPS15MFg4_IayjnXzuR63lYflORNEITg0T2ZGxdwHOAsEun8vncLlw Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Domain-Id: None Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Domain-Name: None Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Identity-Status: Confirmed Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Is-Admin-Project: True Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Domain-Id: default Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Domain-Name: Default Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Name: admin Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Role: reader,admin,member Oct 11 04:02:17.423170 n-d-860892-1 devstack@n-api.service[105120]: X-Roles: reader,admin,member Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02709b182c3943a48d5e2869e05263d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}] Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: X-Tenant: admin Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: X-Tenant-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: X-Tenant-Name: admin Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: X-User: admin Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: X-User-Domain-Id: default Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: X-User-Domain-Name: Default Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: X-User-Id: 4348d2e2cfad414484d23274d4e52302 Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: X-User-Name: admin Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: method: > Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: exception: Flavor 42 could not be found. Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: action_args: {'id': '42'} Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:02:17.427449 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:17.428506 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:17.430124 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-ae154aea-486e-4154-b4bf-dfaf4d1cdf85 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:02:17.431532 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-ae154aea-486e-4154-b4bf-dfaf4d1cdf85 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.384589 Oct 11 04:02:17.431532 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 11 04:02:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 386 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:02:17.434626 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-9dc6554a-599a-41ef-ab5d-05b2fa89c585 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:17.438747 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:02:17.458393 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-9dc6554a-599a-41ef-ab5d-05b2fa89c585 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027298 Oct 11 04:02:17.458936 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 11 04:02:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:02:17.474115 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-c4a95d94-858d-431a-a457-2c9db7cd6587 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:17.495673 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-c4a95d94-858d-431a-a457-2c9db7cd6587 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026017 Oct 11 04:02:17.496192 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 11 04:02:17 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:02:17.506225 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-41b5ac8e-6bd7-4711-9e40-176062b56e71 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:17.511936 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.wsgi [None req-41b5ac8e-6bd7-4711-9e40-176062b56e71 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-41b5ac8e-6bd7-4711-9e40-176062b56e71 admin admin] Request method failure captured: Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: Accept: application/json Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: Accept-Encoding: gzip, deflate Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: Connection: keep-alive Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: Content-Length: 0 Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: Host: 10.222.0.26 Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: Openstack-Api-Version: compute 2.92 Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: Openstack-System-Scope: None Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: User-Agent: python-novaclient Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Auth-Token: gAAAAABjROrIPFRhoCpiQ3sRixhT7SRdiAQJU0LdOVrrFwqNtq3cx6JgimPzkuwJiLJitGuAIxfryF31kOyZvwBDhkmrEXdElKCQeVfZ7qTbUCxQ97B_2tRnam8_Aq1tsWPS15MFg4_IayjnXzuR63lYflORNEITg0T2ZGxdwHOAsEun8vncLlw Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Domain-Id: None Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Domain-Name: None Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Identity-Status: Confirmed Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Is-Admin-Project: True Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Domain-Id: default Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Domain-Name: Default Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Name: admin Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Role: reader,admin,member Oct 11 04:02:17.515241 n-d-860892-1 devstack@n-api.service[105119]: X-Roles: reader,admin,member Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02709b182c3943a48d5e2869e05263d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}] Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: X-Tenant: admin Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: X-Tenant-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: X-Tenant-Name: admin Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: X-User: admin Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: X-User-Domain-Id: default Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: X-User-Domain-Name: Default Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: X-User-Id: 4348d2e2cfad414484d23274d4e52302 Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: X-User-Name: admin Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: method: > Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: exception: Flavor 42 could not be found. Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: action_args: {'id': '42'} Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:02:17.516773 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:17.525116 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:17.526396 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-41b5ac8e-6bd7-4711-9e40-176062b56e71 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:02:17.527616 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-41b5ac8e-6bd7-4711-9e40-176062b56e71 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014513 Oct 11 04:02:17.527616 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 11 04:02:17 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:02:18.724477 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-c4a95d94-858d-431a-a457-2c9db7cd6587 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:18.725480 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-c4a95d94-858d-431a-a457-2c9db7cd6587 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 11 04:02:18.725869 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 11 04:02:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:02:19.243689 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-19fc9c3b-0d43-40ba-82ee-e1c8b909f1f6 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:19.248863 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.wsgi [None req-19fc9c3b-0d43-40ba-82ee-e1c8b909f1f6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-19fc9c3b-0d43-40ba-82ee-e1c8b909f1f6 admin admin] Request method failure captured: Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: Accept: application/json Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: Accept-Encoding: gzip, deflate Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: Connection: keep-alive Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: Content-Length: 0 Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: Host: 10.222.0.26 Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: Openstack-Api-Version: compute 2.92 Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: Openstack-System-Scope: None Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: User-Agent: python-novaclient Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Auth-Token: gAAAAABjROrKpIGcPAyBv-J60RU3rp6ilGtLU_fiuZEzHDPW2BmjqyCKTlka4XasFA3llYrqCkTfrTYEEvBXIRq0TMXiZ2XGxAGyuffz9mbj98baBOk6utTgRoZ0HCX0h3AD210dAfybR4vUPd2rb-utqiiMLfhWkV_eY5nCUwbCR3fnhaabJfo Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Domain-Id: None Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Domain-Name: None Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Identity-Status: Confirmed Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Is-Admin-Project: True Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Domain-Id: default Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Domain-Name: Default Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Name: admin Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Role: reader,admin,member Oct 11 04:02:19.250405 n-d-860892-1 devstack@n-api.service[105119]: X-Roles: reader,admin,member Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02709b182c3943a48d5e2869e05263d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}] Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: X-Tenant: admin Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: X-Tenant-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: X-Tenant-Name: admin Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: X-User: admin Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: X-User-Domain-Id: default Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: X-User-Domain-Name: Default Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: X-User-Id: 4348d2e2cfad414484d23274d4e52302 Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: X-User-Name: admin Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: method: > Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: exception: Flavor 84 could not be found. Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: action_args: {'id': '84'} Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:02:19.252553 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:19.253543 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:19.255031 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-19fc9c3b-0d43-40ba-82ee-e1c8b909f1f6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:02:19.256477 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-19fc9c3b-0d43-40ba-82ee-e1c8b909f1f6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388928 Oct 11 04:02:19.256477 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 11 04:02:18 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 11 04:02:19.262980 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-021776fd-3ffd-415b-94f9-1b9353392061 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:19.278029 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-021776fd-3ffd-415b-94f9-1b9353392061 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019102 Oct 11 04:02:19.278584 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 11 04:02:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:02:19.288249 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-9569ee42-52c1-4852-a872-94f39ba17d0e admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:19.304377 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-9569ee42-52c1-4852-a872-94f39ba17d0e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019700 Oct 11 04:02:19.304895 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 11 04:02:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:02:19.313816 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-93af3624-e4ba-4560-8480-a0bb35a3647b admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:19.319359 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.wsgi [None req-93af3624-e4ba-4560-8480-a0bb35a3647b admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-93af3624-e4ba-4560-8480-a0bb35a3647b admin admin] Request method failure captured: Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: Accept: application/json Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: Accept-Encoding: gzip, deflate Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: Connection: keep-alive Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: Content-Length: 0 Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: Host: 10.222.0.26 Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: Openstack-Api-Version: compute 2.92 Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: Openstack-System-Scope: None Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: User-Agent: python-novaclient Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Auth-Token: gAAAAABjROrKpIGcPAyBv-J60RU3rp6ilGtLU_fiuZEzHDPW2BmjqyCKTlka4XasFA3llYrqCkTfrTYEEvBXIRq0TMXiZ2XGxAGyuffz9mbj98baBOk6utTgRoZ0HCX0h3AD210dAfybR4vUPd2rb-utqiiMLfhWkV_eY5nCUwbCR3fnhaabJfo Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Domain-Id: None Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Domain-Name: None Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Identity-Status: Confirmed Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Is-Admin-Project: True Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Domain-Id: default Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Domain-Name: Default Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Name: admin Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Role: reader,admin,member Oct 11 04:02:19.320854 n-d-860892-1 devstack@n-api.service[105120]: X-Roles: reader,admin,member Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02709b182c3943a48d5e2869e05263d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}] Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: X-Tenant: admin Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: X-Tenant-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: X-Tenant-Name: admin Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: X-User: admin Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: X-User-Domain-Id: default Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: X-User-Domain-Name: Default Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: X-User-Id: 4348d2e2cfad414484d23274d4e52302 Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: X-User-Name: admin Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: method: > Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: exception: Flavor 84 could not be found. Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: action_args: {'id': '84'} Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:02:19.322444 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:19.323430 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:19.324734 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-93af3624-e4ba-4560-8480-a0bb35a3647b admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:02:19.326030 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-93af3624-e4ba-4560-8480-a0bb35a3647b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011869 Oct 11 04:02:19.326030 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 11 04:02:19 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:02:20.533960 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-9569ee42-52c1-4852-a872-94f39ba17d0e admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:20.535001 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-9569ee42-52c1-4852-a872-94f39ba17d0e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002122 Oct 11 04:02:20.535390 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 11 04:02:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:02:21.049307 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-e088043e-5437-45e1-83f4-b6a3f3c168b0 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:21.055061 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.wsgi [None req-e088043e-5437-45e1-83f4-b6a3f3c168b0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-e088043e-5437-45e1-83f4-b6a3f3c168b0 admin admin] Request method failure captured: Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: Accept: application/json Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: Accept-Encoding: gzip, deflate Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: Connection: keep-alive Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: Content-Length: 0 Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: Host: 10.222.0.26 Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: Openstack-Api-Version: compute 2.92 Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: Openstack-System-Scope: None Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: User-Agent: python-novaclient Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Auth-Token: gAAAAABjROrMXRZ8ay1zssGiWZLK-HaoECtxviiSa-wz_eNSfB4xKYjCxyDGEzGI3M7XxWpOaRl5mcQDSTsCXFeBY3ajZ3EaGw3pQDNY7_2-VbsR0h_UGQBW6fOuIryeiHc-wehdXxh921TdQKyniIGfYlEu3cNaUMptAQLtOu95a7yT7MgQs4M Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Domain-Id: None Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Domain-Name: None Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Identity-Status: Confirmed Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Is-Admin-Project: True Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Domain-Id: default Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Domain-Name: Default Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Project-Name: admin Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Role: reader,admin,member Oct 11 04:02:21.056555 n-d-860892-1 devstack@n-api.service[105120]: X-Roles: reader,admin,member Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02709b182c3943a48d5e2869e05263d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}] Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: X-Tenant: admin Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: X-Tenant-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: X-Tenant-Name: admin Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: X-User: admin Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: X-User-Domain-Id: default Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: X-User-Domain-Name: Default Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: X-User-Id: 4348d2e2cfad414484d23274d4e52302 Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: X-User-Name: admin Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: method: > Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: exception: Flavor 451 could not be found. Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: action_args: {'id': '451'} Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:02:21.058018 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:21.059036 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: ERROR nova.api.openstack.wsgi Oct 11 04:02:21.060348 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-e088043e-5437-45e1-83f4-b6a3f3c168b0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105120) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:02:21.061570 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-e088043e-5437-45e1-83f4-b6a3f3c168b0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.385833 Oct 11 04:02:21.061570 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 11 04:02:20 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:02:21.067687 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-96ef3cc3-24b4-4625-bbbc-03e3acdec9ce admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:21.082753 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-96ef3cc3-24b4-4625-bbbc-03e3acdec9ce admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018641 Oct 11 04:02:21.083270 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 11 04:02:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:02:21.092285 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:21.107555 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018660 Oct 11 04:02:21.108077 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Tue Oct 11 04:02:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:02:21.117278 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-9a267eae-eb7b-496f-b822-5faf56bacd60 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:21.122329 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.wsgi [None req-9a267eae-eb7b-496f-b822-5faf56bacd60 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-9a267eae-eb7b-496f-b822-5faf56bacd60 admin admin] Request method failure captured: Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: Accept: application/json Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: Accept-Encoding: gzip, deflate Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: Connection: keep-alive Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: Content-Length: 0 Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: Host: 10.222.0.26 Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: Openstack-Api-Version: compute 2.92 Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: Openstack-System-Scope: None Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: User-Agent: python-novaclient Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Auth-Token: gAAAAABjROrMXRZ8ay1zssGiWZLK-HaoECtxviiSa-wz_eNSfB4xKYjCxyDGEzGI3M7XxWpOaRl5mcQDSTsCXFeBY3ajZ3EaGw3pQDNY7_2-VbsR0h_UGQBW6fOuIryeiHc-wehdXxh921TdQKyniIGfYlEu3cNaUMptAQLtOu95a7yT7MgQs4M Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Domain-Id: None Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Domain-Name: None Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Identity-Status: Confirmed Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Is-Admin-Project: True Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Openstack-Nova-Api-Version: 2.92 Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Domain-Id: default Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Domain-Name: Default Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Project-Name: admin Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Role: reader,admin,member Oct 11 04:02:21.123818 n-d-860892-1 devstack@n-api.service[105119]: X-Roles: reader,admin,member Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_02709b182c3943a48d5e2869e05263d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/02709b182c3943a48d5e2869e05263d7"}]}] Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: X-Tenant: admin Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: X-Tenant-Id: 02709b182c3943a48d5e2869e05263d7 Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: X-Tenant-Name: admin Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: X-User: admin Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: X-User-Domain-Id: default Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: X-User-Domain-Name: Default Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: X-User-Id: 4348d2e2cfad414484d23274d4e52302 Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: X-User-Name: admin Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: method: > Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: exception: Flavor 451 could not be found. Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: action_args: {'id': '451'} Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:02:21.125352 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:21.126369 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: ERROR nova.api.openstack.wsgi Oct 11 04:02:21.128128 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-9a267eae-eb7b-496f-b822-5faf56bacd60 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105119) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:02:21.129374 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-9a267eae-eb7b-496f-b822-5faf56bacd60 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011340 Oct 11 04:02:21.129374 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 11 04:02:21 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 11 04:02:22.317918 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:22.318978 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Oct 11 04:02:22.319371 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 11 04:02:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:02:22.837814 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-cda352e8-0088-41e3-80bd-a23f507d5197 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:02:22.930159 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-cda352e8-0088-41e3-80bd-a23f507d5197 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.470463 Oct 11 04:02:22.930720 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 11 04:02:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:02:24.141095 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:24.142107 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 11 04:02:24.142547 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 11 04:02:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:02:24.655166 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-570c80c4-5f25-4aec-98ff-3c51d1d1e7e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:02:24.731667 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-570c80c4-5f25-4aec-98ff-3c51d1d1e7e4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.452691 Oct 11 04:02:24.732211 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 11 04:02:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:02:25.937494 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:25.938570 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Oct 11 04:02:25.938958 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 11 04:02:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:02:26.457924 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-f87bccec-f553-45c8-9944-5dad227abe7a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:02:26.526712 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-f87bccec-f553-45c8-9944-5dad227abe7a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.445972 Oct 11 04:02:26.527260 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 11 04:02:26 2022] POST /compute/v2.1/flavors => generated 407 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:02:27.734715 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:27.735773 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Oct 11 04:02:27.736169 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 11 04:02:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:02:28.254128 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-03a6f0a2-bfae-4ca5-b284-aab05d8d15b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:02:28.337670 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-03a6f0a2-bfae-4ca5-b284-aab05d8d15b3 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.464353 Oct 11 04:02:28.338227 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Tue Oct 11 04:02:27 2022] POST /compute/v2.1/flavors => generated 409 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:02:29.540656 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:29.541682 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 11 04:02:29.542060 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 11 04:02:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:02:30.053118 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-7d14fa3e-0df6-401b-9423-dcd821db76c6 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:02:30.072854 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-7d14fa3e-0df6-401b-9423-dcd821db76c6 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.395669 Oct 11 04:02:30.073383 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Tue Oct 11 04:02:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:03:26.136055 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:03:26.137096 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-28b0e14e-bb88-46e0-9f63-cc2a0766f2ee admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Oct 11 04:03:26.137511 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Tue Oct 11 04:03:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:03:26.148671 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:03:26.523562 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-34970b9d-e005-4272-9f69-b889c36acf64 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:03:26.544046 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-34970b9d-e005-4272-9f69-b889c36acf64 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.399951 Oct 11 04:03:26.544574 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 11 04:03:26 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:03:26.565447 n-d-860892-1 devstack@n-api.service[105120]: DEBUG dbcounter [-] [105120] Writing DB stats nova_api:SELECT=14 {{(pid=105120) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:03:26.569230 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-68e055c2-d658-4630-bb5c-ecfbbf160add admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:03:26.576421 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-68e055c2-d658-4630-bb5c-ecfbbf160add admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012382 Oct 11 04:03:26.576938 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Tue Oct 11 04:03:26 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:03:26.589182 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-5b85ebcf-360b-4ea5-93ce-81990daae23c admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:03:26.596370 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-5b85ebcf-360b-4ea5-93ce-81990daae23c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010799 Oct 11 04:03:26.596875 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Tue Oct 11 04:03:26 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:03:26.608281 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-69355a0e-566e-4962-bd50-5501a57855b8 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:03:26.615269 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-69355a0e-566e-4962-bd50-5501a57855b8 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010550 Oct 11 04:03:26.615777 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Tue Oct 11 04:03:26 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:03:26.627678 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-4a1e8102-30d6-4f1e-815b-37a506c463d7 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:03:26.634777 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-4a1e8102-30d6-4f1e-815b-37a506c463d7 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011398 Oct 11 04:03:26.635321 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Tue Oct 11 04:03:26 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:08:55.901748 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-69355a0e-566e-4962-bd50-5501a57855b8 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:08:55.902825 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-69355a0e-566e-4962-bd50-5501a57855b8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Oct 11 04:08:55.903222 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 11 04:08:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:08:56.045723 n-d-860892-1 devstack@n-api.service[105119]: DEBUG dbcounter [-] [105119] Writing DB stats nova_api:SELECT=6 {{(pid=105119) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:08:56.186979 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-fa7cdc12-6dd5-4043-9019-8e3ca012d5c8 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:08:56.191652 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-fa7cdc12-6dd5-4043-9019-8e3ca012d5c8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:08:56.192127 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-fa7cdc12-6dd5-4043-9019-8e3ca012d5c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:08:56.192552 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-fa7cdc12-6dd5-4043-9019-8e3ca012d5c8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:08:56.193253 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-fa7cdc12-6dd5-4043-9019-8e3ca012d5c8 admin admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:08:56.193697 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-fa7cdc12-6dd5-4043-9019-8e3ca012d5c8 admin admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:08:56.194108 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-fa7cdc12-6dd5-4043-9019-8e3ca012d5c8 admin admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:08:56.232459 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-fa7cdc12-6dd5-4043-9019-8e3ca012d5c8 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.187830 Oct 11 04:08:56.233022 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 11 04:08:56 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:08:57.288231 n-d-860892-1 devstack@n-api.service[105120]: DEBUG nova.api.openstack.wsgi [None req-69355a0e-566e-4962-bd50-5501a57855b8 admin admin] Calling method '>' {{(pid=105120) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:08:57.289234 n-d-860892-1 devstack@n-api.service[105120]: INFO nova.api.openstack.requestlog [None req-69355a0e-566e-4962-bd50-5501a57855b8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Oct 11 04:08:57.289624 n-d-860892-1 devstack@n-api.service[105120]: [pid: 105120|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Tue Oct 11 04:08:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:08:57.478351 n-d-860892-1 devstack@n-api.service[105119]: DEBUG nova.api.openstack.wsgi [None req-3f001ee3-3ecb-48a4-88d1-c1e4a482d649 admin admin] Calling method '>' {{(pid=105119) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:08:57.481771 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-3f001ee3-3ecb-48a4-88d1-c1e4a482d649 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:08:57.482259 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-3f001ee3-3ecb-48a4-88d1-c1e4a482d649 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:08:57.482683 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-3f001ee3-3ecb-48a4-88d1-c1e4a482d649 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:08:57.483382 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-3f001ee3-3ecb-48a4-88d1-c1e4a482d649 admin admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:08:57.483831 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-3f001ee3-3ecb-48a4-88d1-c1e4a482d649 admin admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:08:57.484240 n-d-860892-1 devstack@n-api.service[105119]: DEBUG oslo_concurrency.lockutils [None req-3f001ee3-3ecb-48a4-88d1-c1e4a482d649 admin admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105119) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:08:57.507202 n-d-860892-1 devstack@n-api.service[105119]: INFO nova.api.openstack.requestlog [None req-3f001ee3-3ecb-48a4-88d1-c1e4a482d649 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.92 time: 0.079752 Oct 11 04:08:57.507684 n-d-860892-1 devstack@n-api.service[105119]: [pid: 105119|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 11 04:08:57 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:09:41.120767 n-d-860892-1 devstack@n-api.service[105118]: Tue Oct 11 04:09:41 2022 - graceful shutdown triggered... Oct 11 04:09:41.121300 n-d-860892-1 devstack@n-api.service[105119]: Gracefully killing worker 1 (pid: 105119)... Oct 11 04:09:41.120864 n-d-860892-1 systemd[1]: Stopping Devstack devstack@n-api.service... Oct 11 04:09:41.122153 n-d-860892-1 devstack@n-api.service[105120]: Gracefully killing worker 2 (pid: 105120)... Oct 11 04:09:42.121888 n-d-860892-1 devstack@n-api.service[105118]: worker 1 buried after 1 seconds Oct 11 04:09:42.121888 n-d-860892-1 devstack@n-api.service[105118]: worker 2 buried after 1 seconds Oct 11 04:09:42.122526 n-d-860892-1 devstack@n-api.service[105118]: goodbye to uWSGI. Oct 11 04:09:42.123522 n-d-860892-1 systemd[1]: devstack@n-api.service: Succeeded. Oct 11 04:09:42.124091 n-d-860892-1 systemd[1]: Stopped Devstack devstack@n-api.service. Oct 11 04:09:42.127431 n-d-860892-1 systemd[1]: Starting Devstack devstack@n-api.service... Oct 11 04:09:42.140837 n-d-860892-1 devstack@n-api.service[120986]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 11 04:09:42.157950 n-d-860892-1 devstack@n-api.service[120986]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Oct 11 04:09:42 2022] *** Oct 11 04:09:42.157950 n-d-860892-1 devstack@n-api.service[120986]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 11 04:09:42.157950 n-d-860892-1 devstack@n-api.service[120986]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 11 04:09:42.157950 n-d-860892-1 devstack@n-api.service[120986]: nodename: n-d-860892-1 Oct 11 04:09:42.157950 n-d-860892-1 devstack@n-api.service[120986]: machine: x86_64 Oct 11 04:09:42.157950 n-d-860892-1 devstack@n-api.service[120986]: clock source: unix Oct 11 04:09:42.157950 n-d-860892-1 devstack@n-api.service[120986]: pcre jit disabled Oct 11 04:09:42.157950 n-d-860892-1 devstack@n-api.service[120986]: detected number of CPU cores: 4 Oct 11 04:09:42.157950 n-d-860892-1 devstack@n-api.service[120986]: current working directory: / Oct 11 04:09:42.157950 n-d-860892-1 devstack@n-api.service[120986]: detected binary path: /usr/bin/uwsgi-core Oct 11 04:09:42.158796 n-d-860892-1 devstack@n-api.service[120986]: your processes number limit is 47680 Oct 11 04:09:42.158796 n-d-860892-1 devstack@n-api.service[120986]: your memory page size is 4096 bytes Oct 11 04:09:42.158796 n-d-860892-1 devstack@n-api.service[120986]: detected max file descriptor number: 2048 Oct 11 04:09:42.158796 n-d-860892-1 devstack@n-api.service[120986]: lock engine: pthread robust mutexes Oct 11 04:09:42.158796 n-d-860892-1 devstack@n-api.service[120986]: thunder lock: enabled Oct 11 04:09:42.158796 n-d-860892-1 devstack@n-api.service[120986]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 11 04:09:42.158796 n-d-860892-1 devstack@n-api.service[120986]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 11 04:09:42.198377 n-d-860892-1 devstack@n-api.service[120986]: Python main interpreter initialized at 0x55ab4a9b89c0 Oct 11 04:09:42.198377 n-d-860892-1 devstack@n-api.service[120986]: python threads support enabled Oct 11 04:09:42.198377 n-d-860892-1 devstack@n-api.service[120986]: your server socket listen backlog is limited to 100 connections Oct 11 04:09:42.198377 n-d-860892-1 devstack@n-api.service[120986]: your mercy for graceful operations on workers is 90 seconds Oct 11 04:09:42.198820 n-d-860892-1 devstack@n-api.service[120986]: mapped 403077 bytes (393 KB) for 2 cores Oct 11 04:09:42.198820 n-d-860892-1 devstack@n-api.service[120986]: *** Operational MODE: preforking *** Oct 11 04:09:42.199107 n-d-860892-1 devstack@n-api.service[120986]: *** uWSGI is running in multiple interpreter mode *** Oct 11 04:09:42.199107 n-d-860892-1 devstack@n-api.service[120986]: spawned uWSGI master process (pid: 120986) Oct 11 04:09:42.202774 n-d-860892-1 devstack@n-api.service[120986]: spawned uWSGI worker 1 (pid: 120993, cores: 1) Oct 11 04:09:42.202774 n-d-860892-1 devstack@n-api.service[120986]: spawned uWSGI worker 2 (pid: 120994, cores: 1) Oct 11 04:09:42.202774 n-d-860892-1 devstack@n-api.service[120986]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 11 04:09:42.199320 n-d-860892-1 systemd[1]: Started Devstack devstack@n-api.service. Oct 11 04:09:42.855108 n-d-860892-1 devstack@n-api.service[120993]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 04:09:42.862202 n-d-860892-1 devstack@n-api.service[120994]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 11 04:09:44.010215 n-d-860892-1 devstack@n-api.service[120993]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 04:09:44.010215 n-d-860892-1 devstack@n-api.service[120993]: from cryptography.utils import int_from_bytes Oct 11 04:09:44.011179 n-d-860892-1 devstack@n-api.service[120993]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 04:09:44.011179 n-d-860892-1 devstack@n-api.service[120993]: from cryptography.utils import int_from_bytes Oct 11 04:09:44.035888 n-d-860892-1 devstack@n-api.service[120994]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 04:09:44.035888 n-d-860892-1 devstack@n-api.service[120994]: from cryptography.utils import int_from_bytes Oct 11 04:09:44.036531 n-d-860892-1 devstack@n-api.service[120994]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 11 04:09:44.036531 n-d-860892-1 devstack@n-api.service[120994]: from cryptography.utils import int_from_bytes Oct 11 04:09:46.478172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 04:09:46.478172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 04:09:46.478172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 04:09:46.478172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 04:09:46.478172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 04:09:46.478172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.478172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.478172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.479299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.479299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.479299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.479299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.479299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.479647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.479647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.480141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.480389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860892-1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.480710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.481034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.481334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.481656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.481960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.482306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.482627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.483129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.483818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.484144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.484535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.484885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.485200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.486271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.486609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.486910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.487231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.487718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.488121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860892-1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.488611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.489073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.489575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.489983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.490325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.490635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.491107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.491617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.491922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.492248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.492572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.492892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.493213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.493515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.493828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.494137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.494484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.494793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.495171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.495337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.495821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.496142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.496644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.496973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.497227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.497478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.497797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.498116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.498452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.498759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.499073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.499369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.499715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.499982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.500287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.500593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.500905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.501868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.502217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.502529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.502849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.503256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.503521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.503829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.504157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.504474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.504789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.505105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.505426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.505735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.506108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 11 04:09:46.506606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.506727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 11 04:09:46.506825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.506905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.506976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 11 04:09:46.507240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.507351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 11 04:09:46.507536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 11 04:09:46.507642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.507830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.507937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.508085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.508240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.508391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.508560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.508731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.508879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.509013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.509210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.509322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.509519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.509626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.509839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.509949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.510159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.510289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.510521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.510614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.510778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.510884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.511092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.511178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.511427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.511530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] console_host = n-d-860892-1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.511730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.511855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.512043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.512154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.512346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.512517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.512661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.512841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.512971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.513119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.513248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.513377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.513553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.513685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.513854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.514161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.514349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.514506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.514655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.514874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.515012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.515165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.515288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.515427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.515564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.515734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.515853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.516050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.516173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.516356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.516472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.516688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.516827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.516998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.517125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.517307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.517437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.517707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] host = n-d-860892-1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.517827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.518027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.518161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.518476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.518632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.518772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.518893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.519029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.519165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.519340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.519474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.519611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.519753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.519883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.520019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.520165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.520332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.520473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.520641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.520816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.520956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.521099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.521268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.521426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.522225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.522376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.522512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.522650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.522650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.522915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.522915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.523184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.523352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.523487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.523709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.523851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.523981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.524128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.524259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.524395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.524532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.524689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.524689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.524953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.525084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.525220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.525358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.525495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.525635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.525778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.525914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.526053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.526183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.527898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.528049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.528185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.528325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.528465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.528603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.528748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.528917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.529057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.529194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.529326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.529456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.529699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.529847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.529985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.530124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.530282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.530414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.530549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.530689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.530817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.530951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.531078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.531205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.531341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.531341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.531628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.531762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.531899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.532037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.532176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.532326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.532469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.532599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.532735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.532735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.532995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.532995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.533245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.533387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.533518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.533518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.533783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.533913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.534047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.534047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.534337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.534512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.534645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.534645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.534895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.535031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.535180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.535347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.535478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.535629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.535770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.535908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.536050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.536186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.536315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.536450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.536579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.536708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.536846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.536975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.537100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.537235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.537364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.537500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.537637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.537766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.537894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.538023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.538158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.538309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.538451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.538588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.539274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.539401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.539530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.539673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.539806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.539945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.540083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.540223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.540353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.540495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.540625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.540760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.540899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.541028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.541166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.541295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.541425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.541561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.541697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.541837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.541977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.542107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.542277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.542429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.542598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.542819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.542960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.543091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.543220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.543360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.543499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.543630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.543786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.543916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.544054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.544183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.544321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.544450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.544588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.544728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.544858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.545055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.545197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.545335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.545465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.545602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.545747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.545877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.546019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.546206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.546339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.546468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.546608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.546747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.546747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.547000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.547174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.547314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.547453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.547595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.547733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.547862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.548538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.548670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.548798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.548936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.549075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.549206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.549334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.549462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.549598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.549740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.549869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.550005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.550142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.550328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.550471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.550663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.550804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.550942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.551078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.551204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.551326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 11 04:09:46.551437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.551546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.551690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.551850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.551974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.551974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.552199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.552317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.552429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.552549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.552694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.552854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.552966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.553251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.553534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.553665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.553825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.553945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.554123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.554263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.554454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.558265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.558415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.558561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.558704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.558836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.558977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.559114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.559257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.559395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.559533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.559664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.559783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.559935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.560100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.560233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.560362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.560491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.560627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.560767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.560925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.560925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.561178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.561317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.561447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.561585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.561722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.561863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.561993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.562158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.562158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.562432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.562563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.562693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.562830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.562967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.563104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.563243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.563458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.563657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.564293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.564424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.564562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.564699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.564836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.565018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.565157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.565300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.565531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.565673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.565803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.565803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.566092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.566276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.566421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.566552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.566687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.566825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.566974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.567375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.567522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.567696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.567827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.567994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.568139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.568343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.568483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.568621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.568760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.568889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.569025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.569164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.569305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.569460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.569590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.569726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.569862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.569998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.570110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.570280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.570448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.570578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.570706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.570844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.570980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.571109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.571246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.571383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.571546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.571688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.571819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.571946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.572074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.572201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.572339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.572499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.572629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.572772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.572909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.573046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.573189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.573328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.573480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.573697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.573819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.573940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.574131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.574268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.574400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.574579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.574711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.574839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.574839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.575108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.575248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.575403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.575549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.575832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.575966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.576103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.576244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.576365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.576489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.576627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.576627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.576903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.577032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.577174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.577416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.577565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.577565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.577872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.578042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.578172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.578361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.578502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.578640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.578769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.578897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.579068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.579231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.579371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.579501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.579640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.579760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.579876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.580000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.580148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.580269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.580379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.580487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.580608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.580733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.580853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.580979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.581089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.581206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.581322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.581446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.581446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.581650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.581766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.581766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.581993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.582104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.582263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.587021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.587342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.587599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.587812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.587965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.588122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.588268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.588452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.588602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.588760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.588905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.589057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.589212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.589396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.589556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.589736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.589883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.590025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.590170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.590338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.590509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.590663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.590807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.590958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.591102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.591254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.591442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.591603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.591603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.591876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.592029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.592224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.592382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.592560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.592715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.592859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.593000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.593141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.593299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.593494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.593656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.593832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.594062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.594245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.594398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.594551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.594551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.594868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.595019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.595170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.595321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.595471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.595656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.595829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.596126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.596277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.596422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.596602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.596761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.596915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.597066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.597217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.597369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.597528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.597795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.597993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.598161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.598372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.598517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.598659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.598814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.598959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.599109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.599253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.599395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.599546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.599742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.599899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.600043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.600203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.600363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.600363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.600694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.600843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.600987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.601128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.601278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.601434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.601588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.601740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.601885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.602037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.602203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.602371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.602517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.602517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.602811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.602811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.603094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.603245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.603396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.603547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.603689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.603881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.604101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.604356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.604513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.604664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.604852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.605008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.605166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.605317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.605317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.605317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.605723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.605866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.606118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.606466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.606614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.606756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.606910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.607064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.607220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.607364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.607506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.607649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.607649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.608114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.608301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.608461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.608618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.608770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.608953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.609108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.609260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.609403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.609554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.609697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.609847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.610036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.610208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.610367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.611077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.611227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.611382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.611540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.611691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.611843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.611995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.612139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.612291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.612443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.612594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.612738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.612918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.613117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.613454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.613602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.613745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.613897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.614049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.614245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.614529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.614689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.614834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.614978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.615121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.615308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.615478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.615623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.615766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.615917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.616061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.616213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.616357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.616642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.616800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.616945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.617088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.617240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.617419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.617587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.617740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.617883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.618206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.618373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.618520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.618520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.618794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.618943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.619087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.619245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.619430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.619590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.619734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.619876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.620203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.620361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.620515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.620666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.620818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.621021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.621210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.621367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.621519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.621672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.621672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.621955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.622114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.622339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.622339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.622623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.622623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.622904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.622904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.623199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.623419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.623570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.623714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.623876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.624027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.624170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.624321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.624481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.624725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.624883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.625035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.625187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.625187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.625514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.625670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.625829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.625985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.626694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.626966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.627126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.627269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.627269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.627533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.627653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.627783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.627904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.628024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.628156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.628410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.628530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.628656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.628769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.628888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.629046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.629167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.629286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.629408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.629520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.629675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.629793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.629904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.630014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.630135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.630267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.630383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.630503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.630623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.630790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.630790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.630790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.631441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.631556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.631703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.631831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.631954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.632067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.632188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.632300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.632419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.632539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.632673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.632999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.633169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.633324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.633477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.633642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.633990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.634150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.634150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.634514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.634674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.634952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.635102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.635257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.635402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.635545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.635545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.635872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.635872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.636149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.636320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.636465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.636662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.636813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.637135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.637291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.637443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.637587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.637740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.637885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.638036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.638396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.638682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.638952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.639116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.639269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.639421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.639584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.639735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.639937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.640103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.640256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.640407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.640557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.640557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.640557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.641014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.641014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.641014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.641014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.641014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.641014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.641014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.642069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.642069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.642069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.642069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.642069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.642069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.642069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.642069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.643227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.643387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.643538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.643696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.643855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.644049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.644213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.644608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.644857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.645146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.645306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.645465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.645631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.645792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.645944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.646094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.646272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.646437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.646597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.646758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.646908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.647058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.647359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.647532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.647684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.647835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.647835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.648169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.648169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.648532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.648532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.648961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.649127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.649378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.649541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.649724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.649879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.650029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.650029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.650349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.650517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.650682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.650834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.650986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.651329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.651491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.651491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.651809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.651969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.652127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.652284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.652513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.652667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.652825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.652985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.653187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.653342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.653506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.653666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.653825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.653983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.654135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.654371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.654536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.654695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.654854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.655005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.655175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.655453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.655618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.655771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.655935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.656101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.656294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.656494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.656651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.656801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.656951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.657100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.657259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.657594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.657761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.657914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.658064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.658064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.658403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.658628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.658628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.658628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.658628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.658628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.658628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.658628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.658628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.659901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.660014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.660014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.660326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.660326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.660326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.660326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.660787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.660907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.661030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.661157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.661279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.661393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.661534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.661661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.661785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.661905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.662017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.662137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.662137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.662390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.667304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.667304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.668186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.668373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.669002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.669184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.669432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.669785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.669988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.670150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.670344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.670506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.670659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.670825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.670825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.671172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.671328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.671500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.671653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.671812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.671980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.672184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.672386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.672386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.672386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.672386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.672386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.672386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.672386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.672386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.674783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.674783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.675206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.675367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.675520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.675678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.675830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.675994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.676148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.676307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.676460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.676651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.676817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.676978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.677141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.677292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.677451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.677603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.677603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.678040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.678226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.678337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.678427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.678512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.678818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.678918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.679005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.679101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.679189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.679282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.679379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.679486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.679573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.679659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.679753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.679849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.679937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.680023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.680116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.680203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.680295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.680390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.680510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.680605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.680708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.680708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.680873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.680970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.681057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.681142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.681142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.681142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.681374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.681468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.681562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.681648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.681733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.681830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.681926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.682020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.682113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.682377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.682528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.682652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.682779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.682918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.683014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.683101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.683186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.683281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.683368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.683448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.683448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.683843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.683951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.684049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.684143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.684236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.684321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.684414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.684500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.684595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.684779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.684779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.684779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.685194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.685291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.685457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.685605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.685738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.685878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.686018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.686162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.686322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.686462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.686602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.686741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.686871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.686975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.687884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.688463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.688463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.688463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.688463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.689311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.689412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.689507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.689507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.689674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.689760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.689845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.690082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.690299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.696126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.696856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.697441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.697598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.697734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.697866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.697996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.698135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.698318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.698469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.698609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.698752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.698884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.699015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.699154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.699295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.699427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.699568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.699699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.699828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.699828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.700098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.700322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.700458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.700588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.700726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.700873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.701007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.701173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.701308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.701446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.701577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.701723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.701863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.702001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.702140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.702302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.702447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.702588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.702835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.702978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.703110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.703240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.703379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.703558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.703700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.703833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.703983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.704214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.704214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.704478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.704608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.704739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.704739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.705008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.705221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.705548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.705693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.705825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.705956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.706086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.706336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.706480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.706620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.706759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.706898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.707029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.707169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.707300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.707430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.707561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.707698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.707839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.707839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.708094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.708214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.708343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.708479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.708625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.708757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.708886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.709016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.709145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.709281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.709421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.709421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.709672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.709810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.709948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.710079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.710235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.710472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.710620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.710753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.710882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.711027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.711158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.711287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.711423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.711589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.711723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.711871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.712010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.712142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.712294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.712432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.712563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.712702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.712849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.713060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.713201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.713340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.713478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.713651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.713799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.713799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.714055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.714323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.714477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.714617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.714749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.714879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.715017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.715156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.715380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.715673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.715810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.715950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.716089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.716229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.716369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.716501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.716631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.716631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.716890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.717032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.717164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.717164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.717408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.717537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.717656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.717866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.718002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.718139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.718300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.718441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.718572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.718711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.718850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.718989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.719129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.719259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.719397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.719542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.719704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.719862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.719995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.720134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.720274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.720407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.720639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.720782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.720913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.721049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.721191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.721323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.721454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.721582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.721741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.721873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.721873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.722162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.722325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.722457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.722595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.722722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.722843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.722965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.723095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.723303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.723439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.723579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.723734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.723877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.724008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.724146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.724278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.724505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.724651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.724792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.724924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.725053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.725197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.725350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.725555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.725841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.725987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.726119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.726296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.726442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.726581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.726713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.726851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.726989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.727130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.727269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.727400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.727538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.728294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.728294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.728572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.728708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.728846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.728846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.728846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.729234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.729234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.729234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.729234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.729234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.729234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.730058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.730058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.730058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.730058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.730058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.730058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.730058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.730058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.731100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.731229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.731459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.731459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.731755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.731893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.732032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.732163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.732302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.732446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.732578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.732708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.732846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.733007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.733143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.733306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.733536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.733678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.733819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.733951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.733951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.734237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.734382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.734535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.734741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.734876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.735017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.735157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.735289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.736194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.736334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.736455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.736597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.736729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.736859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.737014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.737132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.737244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.737390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.737522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.737652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.737781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.737941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.738100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.738291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.738291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.738556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.738685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.738822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.738971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.739104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.739233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.739362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.739499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.739629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.739629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.739893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.740051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.740165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.740284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.740407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.740527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.740657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.740657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.740911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.741039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.741172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.741291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.741447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.741673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.741801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.741922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.742082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.742256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.742391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.742544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.742680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.742812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.742957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.743215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.743360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.743596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.743741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.743916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.744120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.744264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.744452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.744600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.744759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.744972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.745116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.745255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.745387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.745517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.745670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.745922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.746088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.746466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.746597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.746716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.746864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.747003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.747134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.747263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.747394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.747524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.747663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.747801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.747932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.748071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.748202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.748332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.748528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.748664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.748844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.748988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.749119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120993) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 04:09:46.749249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.749464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.749771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.750078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.750421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.750736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.751082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.751432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.751750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.752099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.752421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.752967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.753295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.753618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.753952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.754321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.754632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.754996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.755252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.755578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.756147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.756527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.756764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.757077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.757391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.757706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.758017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.758354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.758884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.759041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.759307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.759620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.760029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.760242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.760560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.760904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.761231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.761549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.761867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.762197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.762518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.762831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.763146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.763458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.763778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.764113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.764430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.764744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.765179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.765495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.765822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.766142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.766617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.767332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.768469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.768819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.769126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.769448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.769786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.770133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.772295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.772295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.772295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.772785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.772785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.773133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.773426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.773749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.774075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.775445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.775772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.776157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.776540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.776902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.777106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.777429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.777743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.778059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.778394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.778720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.779021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.779331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.779647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.779957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.780267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.780575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.780883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.781191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.781527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.781865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.782202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.782594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.782911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.783239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.783553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.783877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.784209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.784517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.784830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.785168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.785483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.785802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.786119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.786478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.786904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.787104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.787438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.788431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.788431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.788757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.788940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.789121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.789448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.789765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.790099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.790441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.790757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.791074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.791392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.791708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.792027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.792342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.792686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.792966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.793285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.793614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.793942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.794284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.794617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.794942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.795289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.795611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.795959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.796286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.796606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.796954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.797238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 11 04:09:46.797464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120994) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 11 04:09:46.818221 n-d-860892-1 devstack@n-api.service[120993]: INFO dbcounter [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Registered counter for database nova_api Oct 11 04:09:46.844253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_db.sqlalchemy.engines [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 04:09:46.854837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writer thread running {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 04:09:46.868157 n-d-860892-1 devstack@n-api.service[120994]: INFO dbcounter [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Registered counter for database nova_api Oct 11 04:09:46.890143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_db.sqlalchemy.engines [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 04:09:46.897352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writer thread running {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 04:09:46.921996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.context [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f919055-bb4c-4077-93f0-960b402ab88d(cell1) {{(pid=120993) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 04:09:46.927702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:09:46.928493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:09:46.931320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:09:46.932451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:09:46.933144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:09:46.935628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:09:46.939935 n-d-860892-1 devstack@n-api.service[120993]: INFO dbcounter [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Registered counter for database nova_cell0 Oct 11 04:09:46.943712 n-d-860892-1 devstack@n-api.service[120993]: INFO dbcounter [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Registered counter for database nova_cell1 Oct 11 04:09:46.953502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_db.sqlalchemy.engines [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 04:09:46.961639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_db.sqlalchemy.engines [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 04:09:46.962552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writer thread running {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 04:09:46.963559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.context [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f919055-bb4c-4077-93f0-960b402ab88d(cell1) {{(pid=120994) load_cells /opt/stack/nova/nova/context.py:464}} Oct 11 04:09:46.968193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:09:46.968844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:09:46.971309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:09:46.971748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:09:46.972364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:09:46.974649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:09:46.976999 n-d-860892-1 devstack@n-api.service[120994]: INFO dbcounter [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Registered counter for database nova_cell0 Oct 11 04:09:46.981473 n-d-860892-1 devstack@n-api.service[120994]: INFO dbcounter [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Registered counter for database nova_cell1 Oct 11 04:09:46.991610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_db.sqlalchemy.engines [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 04:09:46.996857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_db.sqlalchemy.engines [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 04:09:47.002374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writer thread running {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 04:09:47.002921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writer thread running {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 04:09:47.117582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writer thread running {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 04:09:47.135429 n-d-860892-1 devstack@n-api.service[120993]: INFO dbcounter [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Registered counter for database nova_cell0 Oct 11 04:09:47.143625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_db.sqlalchemy.engines [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120993) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 04:09:47.148622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writer thread running {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 04:09:47.157356 n-d-860892-1 devstack@n-api.service[120994]: INFO dbcounter [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Registered counter for database nova_cell0 Oct 11 04:09:47.164278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_db.sqlalchemy.engines [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120994) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 11 04:09:47.169233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writer thread running {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 11 04:09:47.478865 n-d-860892-1 devstack@n-api.service[120993]: WARNING keystonemiddleware.auth_token [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 04:09:47.486206 n-d-860892-1 devstack@n-api.service[120993]: WARNING keystonemiddleware.auth_token [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 04:09:47.508507 n-d-860892-1 devstack@n-api.service[120994]: WARNING keystonemiddleware.auth_token [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 04:09:47.515875 n-d-860892-1 devstack@n-api.service[120994]: WARNING keystonemiddleware.auth_token [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 04:09:47.829596 n-d-860892-1 devstack@n-api.service[120993]: WARNING keystonemiddleware.auth_token [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 04:09:47.835651 n-d-860892-1 devstack@n-api.service[120993]: WARNING keystonemiddleware.auth_token [None req-16345c36-7d8f-475e-81d5-2d10e022a966 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 04:09:47.841134 n-d-860892-1 devstack@n-api.service[120993]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab4a9b89c0 pid: 120993 (default app) Oct 11 04:09:47.858584 n-d-860892-1 devstack@n-api.service[120994]: WARNING keystonemiddleware.auth_token [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 11 04:09:47.865212 n-d-860892-1 devstack@n-api.service[120994]: WARNING keystonemiddleware.auth_token [None req-d7a0806f-c551-47fc-9bd5-79fa3c4deb81 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 11 04:09:47.870533 n-d-860892-1 devstack@n-api.service[120994]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55ab4a9b89c0 pid: 120994 (default app) Oct 11 04:10:29.196492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:29.197598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:29.198932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:29.200547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:30.033732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:30.034707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:30.035644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:30.036580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:30.647930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b97b042c-c4fc-45b7-bde0-6e9c90757342 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-907107413", "ram": 512, "vcpus": 1, "disk": 10, "id": 1740150321, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:30.768531 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b97b042c-c4fc-45b7-bde0-6e9c90757342 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 415 microversion: 2.1 time: 1.581621 Oct 11 04:10:30.770113 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:10:29 2022] POST /compute/v2.1/flavors => generated 415 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:31.064701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Calling method '.version_select at 0x7fda1b81fee0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:31.079357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f919055-bb4c-4077-93f0-960b402ab88d(cell1) {{(pid=120993) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 11 04:10:31.080310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:31.080927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:31.084085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:31.121118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:31.121855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:31.122454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:31.136953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:31.137493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:31.137933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:31.144301 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-254da51c-3b9d-46d5-bd98-210856b74891 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1423 microversion: 2.41 time: 0.372909 Oct 11 04:10:31.145045 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2/2] 10.222.0.26 () {60 vars in 1208 bytes} [Tue Oct 11 04:10:30 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1423 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:10:31.281423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-716b2cf8-cbb3-4e8e-9eff-64c34e82e8df tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1002486581", "id": 688812479, "os-flavor-access:is_public": "False"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:31.285872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5b51667-c7c7-4add-a9dc-b0a68a2c69fd tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_flavor-1648397299", "ram": 512, "vcpus": 1, "disk": 10, "id": 1627166642, "swap": 1024, "rxtx_factor": 1, "OS-FLV-EXT-DATA:ephemeral": 10}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:31.378674 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c5b51667-c7c7-4add-a9dc-b0a68a2c69fd tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 416 microversion: 2.1 time: 0.232243 Oct 11 04:10:31.379286 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3/3] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:10:31 2022] POST /compute/v2.1/flavors => generated 416 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:31.389212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8bd00d1a-e810-4db8-9276-83cd36a9dc29 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:31.417740 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-716b2cf8-cbb3-4e8e-9eff-64c34e82e8df tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 428 microversion: 2.1 time: 1.391406 Oct 11 04:10:31.418815 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1/4] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:10:30 2022] POST /compute/v2.1/flavors => generated 428 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:10:31.472986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-557152371", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:31.503229 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8bd00d1a-e810-4db8-9276-83cd36a9dc29 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1740150321/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.122568 Oct 11 04:10:31.504145 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4/5] 10.222.0.26 () {60 vars in 1224 bytes} [Tue Oct 11 04:10:31 2022] POST /compute/v2.1/flavors/1740150321/os-extra_specs => generated 66 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:31.588771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b0f256d4-fa85-498f-919c-081c33270e72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '.version_select at 0x7fda1b6a41f0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:31.590871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f256d4-fa85-498f-919c-081c33270e72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:31.591062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f256d4-fa85-498f-919c-081c33270e72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:31.591496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f256d4-fa85-498f-919c-081c33270e72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:31.615883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f256d4-fa85-498f-919c-081c33270e72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:31.616525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f256d4-fa85-498f-919c-081c33270e72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:31.617129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f256d4-fa85-498f-919c-081c33270e72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:31.628395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f256d4-fa85-498f-919c-081c33270e72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:31.628871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f256d4-fa85-498f-919c-081c33270e72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:31.629465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f256d4-fa85-498f-919c-081c33270e72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:31.637290 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b0f256d4-fa85-498f-919c-081c33270e72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1503 microversion: 2.1 time: 0.131494 Oct 11 04:10:31.637838 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 5/6] 10.222.0.26 () {58 vars in 1167 bytes} [Tue Oct 11 04:10:31 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1503 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:31.700761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-299f82cd-8b3c-4b14-8dfc-301c7421123c tempest-FlavorsV255TestJSON-334709334 tempest-FlavorsV255TestJSON-334709334-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV255TestJSON-flavor-2116929015", "id": 1274586729, "os-flavor-access:is_public": "True"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:31.788877 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-299f82cd-8b3c-4b14-8dfc-301c7421123c tempest-FlavorsV255TestJSON-334709334 tempest-FlavorsV255TestJSON-334709334-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 449 microversion: 2.55 time: 0.150004 Oct 11 04:10:31.789482 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 6/7] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:10:31 2022] POST /compute/v2.1/flavors => generated 449 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:10:31.794263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cbee334a-6499-4ca1-9673-5871dbbd2dc3 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-984966066"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:31.798366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-cbee334a-6499-4ca1-9673-5871dbbd2dc3 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Generated uuid d6f6886c-ae2f-4dac-9a12-78f21ccc6fa5 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:10:31.844314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:10:31.960927 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cbee334a-6499-4ca1-9673-5871dbbd2dc3 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.41 time: 0.170270 Oct 11 04:10:31.962338 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 7/8] 10.222.0.26 () {62 vars in 1205 bytes} [Tue Oct 11 04:10:31 2022] POST /compute/v2.1/os-aggregates => generated 245 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:10:32.071261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-160cc5cc-df82-4c0a-86a0-a50d6cd35d90 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:32.091009 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-160cc5cc-df82-4c0a-86a0-a50d6cd35d90 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] HTTP exception thrown: Flavor 1627166642 has no extra specs with key hw:cpu_thread_policy. Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-160cc5cc-df82-4c0a-86a0-a50d6cd35d90 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Request method failure captured: Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/flavors/1627166642/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROyzP2Si5uxiyvKEQ-hIE6JAYrTxFIEfcEp_T2hGPxaneTw3INpICtVVdKFDehKXN0yE9oZ8LvyvcCNBA06M28rTQrZeV7KnI3KA7YUkaLCwTKzf51PkbFZ5NOZ6PADShTZyCaLni2hsMZ_aNVVvH1RGkMNS14e4i20ZuI9pP6ybBc4 Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ab52d315f41c464a9b8bbd8c160b6491 Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:10:32.094118 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:10:32.095682 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab52d315f41c464a9b8bbd8c160b6491"}]}] Oct 11 04:10:32.095682 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:32.095682 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ab52d315f41c464a9b8bbd8c160b6491 Oct 11 04:10:32.095682 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:32.095682 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project Oct 11 04:10:32.095682 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:10:32.095682 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:10:32.095682 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 46abd46793104974983458df2576f9f8 Oct 11 04:10:32.095682 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project Oct 11 04:10:32.095682 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:10:32.095682 n-d-860892-1 devstack@n-api.service[120993]: exception: Flavor 1627166642 has no extra specs with key hw:cpu_thread_policy. Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'flavor_id': '1627166642', 'id': 'hw:cpu_thread_policy'} Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 115, in show Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return {id: flavor.extra_specs[id]} Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 120, in show Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1627166642 has no extra specs with key hw:cpu_thread_policy. Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:32.096203 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:32.097185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:32.097185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:32.097185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:32.097185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:10:32.097185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:10:32.097185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1627166642 has no extra specs with key hw:cpu_thread_policy. Oct 11 04:10:32.097185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:32.099055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-160cc5cc-df82-4c0a-86a0-a50d6cd35d90 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Returning 404 to user: Flavor 1627166642 has no extra specs with key hw:cpu_thread_policy. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:32.106901 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-160cc5cc-df82-4c0a-86a0-a50d6cd35d90 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] 10.222.0.26 "GET /compute/v2.1/flavors/1627166642/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.136565 Oct 11 04:10:32.106901 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 8/9] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:10:31 2022] GET /compute/v2.1/flavors/1627166642/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:32.107594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-17d544a5-440d-4a2a-9a53-0c434b1c2e31 tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "ce484c5351204419941b4267fd0118bf"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:32.235912 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-17d544a5-440d-4a2a-9a53-0c434b1c2e31 tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/688812479/action" status: 200 len: 96 microversion: 2.1 time: 0.133530 Oct 11 04:10:32.237156 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 9/10] 10.222.0.26 () {60 vars in 1197 bytes} [Tue Oct 11 04:10:32 2022] POST /compute/v2.1/flavors/688812479/action => generated 96 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:32.357781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-03f3f48d-1a0b-4041-951c-e7ff69a18954 tempest-FlavorsExtraSpecsTestJSON-222952015 tempest-FlavorsExtraSpecsTestJSON-222952015-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:32.368577 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-03f3f48d-1a0b-4041-951c-e7ff69a18954 tempest-FlavorsExtraSpecsTestJSON-222952015 tempest-FlavorsExtraSpecsTestJSON-222952015-project] 10.222.0.26 "GET /compute/v2.1/flavors/1740150321/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.130035 Oct 11 04:10:32.369118 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 10/11] 10.222.0.26 () {58 vars in 1203 bytes} [Tue Oct 11 04:10:32 2022] GET /compute/v2.1/flavors/1740150321/os-extra_specs => generated 66 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:32.399335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:10:32.399819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:10:32.401445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:10:32.401445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:10:32.401445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:10:32.416082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:32.416649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:32.417149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:32.418015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:32.418841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:32.419292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:32.450018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Getting quotas for project f0bed16885ed4cb2b32330891efb3424. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:10:32.457821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Getting quotas for user 66b61fab456b48188ef790d8d5dcb4b5 and project f0bed16885ed4cb2b32330891efb3424. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:10:32.472986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:10:32.476272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:10:32.579812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6d2bac71-7eb3-4b2c-9e7d-8baaf18d5470 tempest-FlavorsV255TestJSON-865094506 tempest-FlavorsV255TestJSON-865094506-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:32.590249 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6d2bac71-7eb3-4b2c-9e7d-8baaf18d5470 tempest-FlavorsV255TestJSON-865094506 tempest-FlavorsV255TestJSON-865094506-project] 10.222.0.26 "GET /compute/v2.1/flavors/1274586729" status: 200 len: 449 microversion: 2.55 time: 0.219840 Oct 11 04:10:32.610362 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 11/12] 10.222.0.26 () {60 vars in 1199 bytes} [Tue Oct 11 04:10:32 2022] GET /compute/v2.1/flavors/1274586729 => generated 449 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:10:32.616937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9c918b4e-81b1-4ff6-b582-2139b4afd24c tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-928335440"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:32.649152 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c819f123-94d6-42f3-b1da-51b34ad28de8 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.229053 Oct 11 04:10:32.651924 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2/13] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:10:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 1233 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:10:32.660110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04a34708-c539-4bb6-b71e-e075ba021068 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:32.666061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-04a34708-c539-4bb6-b71e-e075ba021068 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Policy check for os_compute_api:os-flavor-extra-specs:create failed with credentials {'is_admin': False, 'user_id': '46abd46793104974983458df2576f9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab52d315f41c464a9b8bbd8c160b6491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04a34708-c539-4bb6-b71e-e075ba021068 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Request method failure captured: Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/flavors/1627166642/os-extra_specs HTTP/1.1 Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 66 Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROyzP2Si5uxiyvKEQ-hIE6JAYrTxFIEfcEp_T2hGPxaneTw3INpICtVVdKFDehKXN0yE9oZ8LvyvcCNBA06M28rTQrZeV7KnI3KA7YUkaLCwTKzf51PkbFZ5NOZ6PADShTZyCaLni2hsMZ_aNVVvH1RGkMNS14e4i20ZuI9pP6ybBc4 Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ab52d315f41c464a9b8bbd8c160b6491 Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:10:32.681575 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab52d315f41c464a9b8bbd8c160b6491"}]}] Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ab52d315f41c464a9b8bbd8c160b6491 Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 46abd46793104974983458df2576f9f8 Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} Oct 11 04:10:32.682652 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'flavor_id': '1627166642', 'body': {'extra_specs': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}}} Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 73, in create Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'create', target={}) Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:32.683207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. Oct 11 04:10:32.685625 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:32.686719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04a34708-c539-4bb6-b71e-e075ba021068 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:create to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:32.687898 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04a34708-c539-4bb6-b71e-e075ba021068 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] 10.222.0.26 "POST /compute/v2.1/flavors/1627166642/os-extra_specs" status: 403 len: 124 microversion: 2.1 time: 0.034770 Oct 11 04:10:32.690624 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3/14] 10.222.0.26 () {60 vars in 1224 bytes} [Tue Oct 11 04:10:32 2022] POST /compute/v2.1/flavors/1627166642/os-extra_specs => generated 124 bytes in 38 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:32.835563 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9c918b4e-81b1-4ff6-b582-2139b4afd24c tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.223744 Oct 11 04:10:32.838033 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 12/15] 10.222.0.26 () {62 vars in 1210 bytes} [Tue Oct 11 04:10:32 2022] PUT /compute/v2.1/os-aggregates/1 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:10:32.849081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3770b488-69c6-4ec9-a8ce-8a62f45279fd tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:32.905360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-50db6eae-6bee-45f6-ba3f-ad542775a6ce tempest-FlavorsAccessTestJSON-921858989 tempest-FlavorsAccessTestJSON-921858989-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:32.911630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3770b488-69c6-4ec9-a8ce-8a62f45279fd tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1740150321/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.072175 Oct 11 04:10:32.912312 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 13/16] 10.222.0.26 () {60 vars in 1224 bytes} [Tue Oct 11 04:10:32 2022] POST /compute/v2.1/flavors/1740150321/os-extra_specs => generated 66 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:32.924338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-671ea8fc-7d41-4714-89ec-534419888d58 tempest-FlavorsV255TestJSON-334709334 tempest-FlavorsV255TestJSON-334709334-project-admin] Action: 'update', calling method: .version_select at 0x7fda1bbda5e0>, body: {"flavor": {"description": "new"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:32.978942 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-50db6eae-6bee-45f6-ba3f-ad542775a6ce tempest-FlavorsAccessTestJSON-921858989 tempest-FlavorsAccessTestJSON-921858989-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6638 microversion: 2.1 time: 0.286030 Oct 11 04:10:32.980371 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4/17] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:10:32 2022] GET /compute/v2.1/flavors/detail => generated 6638 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:32.996408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d9a464c-03df-42f6-9b25-bfbea80b9577 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:32.996969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d9a464c-03df-42f6-9b25-bfbea80b9577 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:33.057134 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-671ea8fc-7d41-4714-89ec-534419888d58 tempest-FlavorsV255TestJSON-334709334 tempest-FlavorsV255TestJSON-334709334-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1274586729" status: 200 len: 450 microversion: 2.55 time: 0.143815 Oct 11 04:10:33.057994 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 14/18] 10.222.0.26 () {62 vars in 1219 bytes} [Tue Oct 11 04:10:32 2022] PUT /compute/v2.1/flavors/1274586729 => generated 450 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:10:33.062337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bb92d650-a096-4db0-90dc-a29688c4bc21 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:33.124818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d9a464c-03df-42f6-9b25-bfbea80b9577 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:33.144140 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d9a464c-03df-42f6-9b25-bfbea80b9577 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1219 microversion: 2.1 time: 0.160650 Oct 11 04:10:33.146704 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 5/19] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:32 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1219 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:33.150389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f381d05-5f45-417f-bdd1-bdd2cdbb8814 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:33.183489 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f381d05-5f45-417f-bdd1-bdd2cdbb8814 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/1" status: 200 len: 298 microversion: 2.41 time: 0.033876 Oct 11 04:10:33.183489 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 6/20] 10.222.0.26 () {60 vars in 1190 bytes} [Tue Oct 11 04:10:33 2022] GET /compute/v2.1/os-aggregates/1 => generated 298 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:10:33.186399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a3633d5e-90b6-47c8-bc81-45d1cff7039e tempest-FlavorsExtraSpecsTestJSON-222952015 tempest-FlavorsExtraSpecsTestJSON-222952015-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:33.197966 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a3633d5e-90b6-47c8-bc81-45d1cff7039e tempest-FlavorsExtraSpecsTestJSON-222952015 tempest-FlavorsExtraSpecsTestJSON-222952015-project] 10.222.0.26 "GET /compute/v2.1/flavors/1740150321/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.015504 Oct 11 04:10:33.200215 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 7/21] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:10:33 2022] GET /compute/v2.1/flavors/1740150321/os-extra_specs/hw:numa_nodes => generated 22 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:33.211296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7ee97eb9-0b08-4847-96b2-74c62a1119d9 tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "ce484c5351204419941b4267fd0118bf"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:33.246280 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bb92d650-a096-4db0-90dc-a29688c4bc21 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1627166642/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.187080 Oct 11 04:10:33.247070 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 15/22] 10.222.0.26 () {60 vars in 1224 bytes} [Tue Oct 11 04:10:33 2022] POST /compute/v2.1/flavors/1627166642/os-extra_specs => generated 66 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:33.252871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-11b93798-a430-4f12-b63f-baf8e3bb2105 tempest-FlavorsV255TestJSON-865094506 tempest-FlavorsV255TestJSON-865094506-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:33.295939 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-11b93798-a430-4f12-b63f-baf8e3bb2105 tempest-FlavorsV255TestJSON-865094506 tempest-FlavorsV255TestJSON-865094506-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6578 microversion: 2.55 time: 0.047607 Oct 11 04:10:33.308697 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 16/23] 10.222.0.26 () {60 vars in 1187 bytes} [Tue Oct 11 04:10:33 2022] GET /compute/v2.1/flavors/detail => generated 6578 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:10:33.314428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-70ff39c2-f47c-4477-aec9-f18338e3ade5 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:33.326531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70ff39c2-f47c-4477-aec9-f18338e3ade5 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:33.327024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70ff39c2-f47c-4477-aec9-f18338e3ade5 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:33.327457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70ff39c2-f47c-4477-aec9-f18338e3ade5 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:33.371110 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7ee97eb9-0b08-4847-96b2-74c62a1119d9 tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/688812479/action" status: 200 len: 21 microversion: 2.1 time: 0.163954 Oct 11 04:10:33.372179 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 8/24] 10.222.0.26 () {60 vars in 1197 bytes} [Tue Oct 11 04:10:33 2022] POST /compute/v2.1/flavors/688812479/action => generated 21 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:33.384362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-16a88884-bc59-4441-b213-806a855d2569 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:33.420158 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-16a88884-bc59-4441-b213-806a855d2569 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1740150321/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.046693 Oct 11 04:10:33.421915 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 9/25] 10.222.0.26 () {60 vars in 1224 bytes} [Tue Oct 11 04:10:33 2022] POST /compute/v2.1/flavors/1740150321/os-extra_specs => generated 66 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:33.431082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a351e08c-b18e-44df-9487-c1ac9e65769e tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:33.432956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a351e08c-b18e-44df-9487-c1ac9e65769e tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Policy check for os_compute_api:os-flavor-extra-specs:delete failed with credentials {'is_admin': False, 'user_id': '46abd46793104974983458df2576f9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab52d315f41c464a9b8bbd8c160b6491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a351e08c-b18e-44df-9487-c1ac9e65769e tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Request method failure captured: Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROyzP2Si5uxiyvKEQ-hIE6JAYrTxFIEfcEp_T2hGPxaneTw3INpICtVVdKFDehKXN0yE9oZ8LvyvcCNBA06M28rTQrZeV7KnI3KA7YUkaLCwTKzf51PkbFZ5NOZ6PADShTZyCaLni2hsMZ_aNVVvH1RGkMNS14e4i20ZuI9pP6ybBc4 Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ab52d315f41c464a9b8bbd8c160b6491 Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:10:33.436025 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:10:33.437368 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab52d315f41c464a9b8bbd8c160b6491"}]}] Oct 11 04:10:33.437368 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:33.437368 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ab52d315f41c464a9b8bbd8c160b6491 Oct 11 04:10:33.437368 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:33.437368 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project Oct 11 04:10:33.437368 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:33.437368 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:33.437368 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 46abd46793104974983458df2576f9f8 Oct 11 04:10:33.437368 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project Oct 11 04:10:33.437368 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:10:33.437368 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'flavor_id': '1627166642', 'id': 'hw:numa_nodes'} Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 129, in delete Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'delete', target={}) Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:33.438727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. Oct 11 04:10:33.439974 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:33.442901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a351e08c-b18e-44df-9487-c1ac9e65769e tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:delete to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:33.443893 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a351e08c-b18e-44df-9487-c1ac9e65769e tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] 10.222.0.26 "DELETE /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.020635 Oct 11 04:10:33.450877 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 10/26] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:10:33 2022] DELETE /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes => generated 124 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:33.457620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7744d62c-0148-496d-9419-5a2d420438c4 tempest-FlavorsV255TestJSON-865094506 tempest-FlavorsV255TestJSON-865094506-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:33.496726 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7744d62c-0148-496d-9419-5a2d420438c4 tempest-FlavorsV255TestJSON-865094506 tempest-FlavorsV255TestJSON-865094506-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3662 microversion: 2.55 time: 0.043420 Oct 11 04:10:33.509803 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 11/27] 10.222.0.26 () {60 vars in 1166 bytes} [Tue Oct 11 04:10:33 2022] GET /compute/v2.1/flavors => generated 3662 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:10:33.514170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-53cf2b86-2584-4790-860b-c075ea0865e4 tempest-FlavorsAccessTestJSON-921858989 tempest-FlavorsAccessTestJSON-921858989-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:33.546283 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-53cf2b86-2584-4790-860b-c075ea0865e4 tempest-FlavorsAccessTestJSON-921858989 tempest-FlavorsAccessTestJSON-921858989-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6220 microversion: 2.1 time: 0.045683 Oct 11 04:10:33.562631 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 12/28] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:10:33 2022] GET /compute/v2.1/flavors/detail => generated 6220 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:33.569403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-07d9467f-f357-47b3-9a10-98d9cd76481e tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:33.581049 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-07d9467f-f357-47b3-9a10-98d9cd76481e tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1740150321/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.017211 Oct 11 04:10:33.582611 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 13/29] 10.222.0.26 () {58 vars in 1203 bytes} [Tue Oct 11 04:10:33 2022] GET /compute/v2.1/flavors/1740150321/os-extra_specs => generated 66 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:33.592379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31b073cb-60d9-4fb7-83d6-d3f8f1e9425e tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:33.625046 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31b073cb-60d9-4fb7-83d6-d3f8f1e9425e tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1627166642/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.040387 Oct 11 04:10:33.631504 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 14/30] 10.222.0.26 () {60 vars in 1224 bytes} [Tue Oct 11 04:10:33 2022] POST /compute/v2.1/flavors/1627166642/os-extra_specs => generated 66 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:33.637132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80a857ea-f839-480f-b445-b4ca40d5376c tempest-FlavorsV255TestJSON-334709334 tempest-FlavorsV255TestJSON-334709334-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:33.714579 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-70ff39c2-f47c-4477-aec9-f18338e3ade5 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 313 microversion: 2.41 time: 0.404523 Oct 11 04:10:33.723733 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 17/31] 10.222.0.26 () {62 vars in 1232 bytes} [Tue Oct 11 04:10:33 2022] POST /compute/v2.1/os-aggregates/1/action => generated 313 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:10:33.729471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0a454385-9669-46d0-a75f-67c98a94672a tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:33.754911 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-80a857ea-f839-480f-b445-b4ca40d5376c tempest-FlavorsV255TestJSON-334709334 tempest-FlavorsV255TestJSON-334709334-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1274586729" status: 202 len: 0 microversion: 2.55 time: 0.121976 Oct 11 04:10:33.755734 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 15/32] 10.222.0.26 () {60 vars in 1202 bytes} [Tue Oct 11 04:10:33 2022] DELETE /compute/v2.1/flavors/1274586729 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:10:33.755840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=10,nova_api:SAVEPOINT=6,nova_api:RELEASE=6,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:33.760479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2831428-95c4-4f18-a0e5-87cb28e8a740 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "2"} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:33.806531 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0a454385-9669-46d0-a75f-67c98a94672a tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/688812479" status: 202 len: 0 microversion: 2.1 time: 0.081143 Oct 11 04:10:33.807039 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 18/33] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:10:33 2022] DELETE /compute/v2.1/flavors/688812479 => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:10:33.811883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16d1e72d-4cce-4ab9-9e40-6405b8631fd0 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1"} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:33.815354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-16d1e72d-4cce-4ab9-9e40-6405b8631fd0 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Policy check for os_compute_api:os-flavor-extra-specs:update failed with credentials {'is_admin': False, 'user_id': '46abd46793104974983458df2576f9f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ab52d315f41c464a9b8bbd8c160b6491', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16d1e72d-4cce-4ab9-9e40-6405b8631fd0 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Request method failure captured: Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: request: PUT /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 22 Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROyzP2Si5uxiyvKEQ-hIE6JAYrTxFIEfcEp_T2hGPxaneTw3INpICtVVdKFDehKXN0yE9oZ8LvyvcCNBA06M28rTQrZeV7KnI3KA7YUkaLCwTKzf51PkbFZ5NOZ6PADShTZyCaLni2hsMZ_aNVVvH1RGkMNS14e4i20ZuI9pP6ybBc4 Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ab52d315f41c464a9b8bbd8c160b6491 Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:10:33.818772 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab52d315f41c464a9b8bbd8c160b6491"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ab52d315f41c464a9b8bbd8c160b6491"}]}] Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ab52d315f41c464a9b8bbd8c160b6491 Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 46abd46793104974983458df2576f9f8 Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: {"hw:numa_nodes": "1"} Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:10:33.820053 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'flavor_id': '1627166642', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1'}} Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 91, in update Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(fes_policies.POLICY_ROOT % 'update', target={}) Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:33.820851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. Oct 11 04:10:33.821789 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:33.824822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16d1e72d-4cce-4ab9-9e40-6405b8631fd0 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-extra-specs:update to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:33.825928 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-16d1e72d-4cce-4ab9-9e40-6405b8631fd0 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020 tempest-FlavorsExtraSpecsNegativeTestJSON-1085541020-project] 10.222.0.26 "PUT /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes" status: 403 len: 124 microversion: 2.1 time: 0.017738 Oct 11 04:10:33.832064 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 19/34] 10.222.0.26 () {60 vars in 1265 bytes} [Tue Oct 11 04:10:33 2022] PUT /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes => generated 124 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:33.832495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9cb265e5-e5f0-4d62-a993-c9f3409441c0 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:33.845586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cb265e5-e5f0-4d62-a993-c9f3409441c0 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:33.846816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cb265e5-e5f0-4d62-a993-c9f3409441c0 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:33.847457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cb265e5-e5f0-4d62-a993-c9f3409441c0 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:33.880215 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2831428-95c4-4f18-a0e5-87cb28e8a740 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1740150321/os-extra_specs/hw:numa_nodes" status: 200 len: 22 microversion: 2.1 time: 0.123601 Oct 11 04:10:33.881414 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 16/35] 10.222.0.26 () {60 vars in 1265 bytes} [Tue Oct 11 04:10:33 2022] PUT /compute/v2.1/flavors/1740150321/os-extra_specs/hw:numa_nodes => generated 22 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:33.888951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-62b7c163-0219-468c-8cca-da3b64753701 tempest-FlavorsV255TestJSON-334709334 tempest-FlavorsV255TestJSON-334709334-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:33.946229 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-62b7c163-0219-468c-8cca-da3b64753701 tempest-FlavorsV255TestJSON-334709334 tempest-FlavorsV255TestJSON-334709334-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6138 microversion: 2.55 time: 0.063126 Oct 11 04:10:33.962230 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 17/36] 10.222.0.26 () {60 vars in 1187 bytes} [Tue Oct 11 04:10:33 2022] GET /compute/v2.1/flavors/detail => generated 6138 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:10:33.973127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9e7adc3-c66b-4ecb-b3ab-b074138c84af tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:33.996242 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e9e7adc3-c66b-4ecb-b3ab-b074138c84af tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5802 microversion: 2.1 time: 0.032637 Oct 11 04:10:33.997193 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 18/37] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:10:33 2022] GET /compute/v2.1/flavors/detail => generated 5802 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:34.001766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dec386b0-61cb-4a06-83dc-5775c0fa83d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.009298 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-dec386b0-61cb-4a06-83dc-5775c0fa83d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] HTTP exception thrown: Flavor 1627166642 has no extra specs with key hw:cpu_thread_policy. Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dec386b0-61cb-4a06-83dc-5775c0fa83d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Request method failure captured: Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/flavors/1627166642/os-extra_specs/hw:cpu_thread_policy HTTP/1.1 Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROy2ifUltl-L-Xx6Gva5jbzT08aGC3Iajs8rKwnbr9ffqd-g7J6Sz3Gg9fNoQTuqzK_QYuOhWsctFe4zDYPV4c64cao0WnnrQVKqm-CS5wZ1W2KJ-MLux0nlEGuj50eqBrlX_AHPrQD0dObDtaGcm8ZDLxQm5Hg5nNY9CnkGEKy1inU Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ca491f03cdf048b58f0ab1c5f8d822d6 Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:10:34.010550 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:10:34.011957 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ca491f03cdf048b58f0ab1c5f8d822d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ca491f03cdf048b58f0ab1c5f8d822d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca491f03cdf048b58f0ab1c5f8d822d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca491f03cdf048b58f0ab1c5f8d822d6"}]}] Oct 11 04:10:34.011957 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 Oct 11 04:10:34.011957 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ca491f03cdf048b58f0ab1c5f8d822d6 Oct 11 04:10:34.011957 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 Oct 11 04:10:34.011957 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin Oct 11 04:10:34.011957 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:34.011957 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:34.011957 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 9ef629f81dbc42a894830f6ff1c7f9d8 Oct 11 04:10:34.011957 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin Oct 11 04:10:34.011957 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:10:34.011957 n-d-860892-1 devstack@n-api.service[120994]: exception: Flavor 1627166642 has no extra specs with key hw:cpu_thread_policy. Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'flavor_id': '1627166642', 'id': 'hw:cpu_thread_policy'} Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 132, in delete Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi del flavor.extra_specs[id] Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi KeyError: 'hw:cpu_thread_policy' Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 141, in delete Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 1627166642 has no extra specs with key hw:cpu_thread_policy. Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:34.012662 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.013926 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:34.013926 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:34.013926 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:34.013926 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:10:34.013926 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:10:34.013926 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 1627166642 has no extra specs with key hw:cpu_thread_policy. Oct 11 04:10:34.013926 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.013926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dec386b0-61cb-4a06-83dc-5775c0fa83d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Returning 404 to user: Flavor 1627166642 has no extra specs with key hw:cpu_thread_policy. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:34.014582 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dec386b0-61cb-4a06-83dc-5775c0fa83d7 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1627166642/os-extra_specs/hw:cpu_thread_policy" status: 404 len: 113 microversion: 2.1 time: 0.016277 Oct 11 04:10:34.015138 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 19/38] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:10:33 2022] DELETE /compute/v2.1/flavors/1627166642/os-extra_specs/hw:cpu_thread_policy => generated 113 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:34.020302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a9d9abd-d810-4584-a616-df28855297ee tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.031642 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2a9d9abd-d810-4584-a616-df28855297ee tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1740150321/os-extra_specs" status: 200 len: 66 microversion: 2.1 time: 0.015435 Oct 11 04:10:34.033306 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 20/39] 10.222.0.26 () {58 vars in 1203 bytes} [Tue Oct 11 04:10:34 2022] GET /compute/v2.1/flavors/1740150321/os-extra_specs => generated 66 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:34.037972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d6071596-ee29-4b14-a59a-9a0fc32d9b75 tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessTestJSON-flavor-1185905965", "id": 1326581283, "os-flavor-access:is_public": "False"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:34.104393 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d6071596-ee29-4b14-a59a-9a0fc32d9b75 tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 431 microversion: 2.1 time: 0.070446 Oct 11 04:10:34.105165 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:10:34 2022] POST /compute/v2.1/flavors => generated 431 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:34.116684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-451167d9-da50-4ccf-9dbd-89517750d261 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Action: 'update', calling method: >, body: {"hw:cpu_policy": "shared"} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:34.121198 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-451167d9-da50-4ccf-9dbd-89517750d261 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] HTTP exception thrown: Request body and URI mismatch Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-451167d9-da50-4ccf-9dbd-89517750d261 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Request method failure captured: Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 27 Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROy2ifUltl-L-Xx6Gva5jbzT08aGC3Iajs8rKwnbr9ffqd-g7J6Sz3Gg9fNoQTuqzK_QYuOhWsctFe4zDYPV4c64cao0WnnrQVKqm-CS5wZ1W2KJ-MLux0nlEGuj50eqBrlX_AHPrQD0dObDtaGcm8ZDLxQm5Hg5nNY9CnkGEKy1inU Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ca491f03cdf048b58f0ab1c5f8d822d6 Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:10:34.125461 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ca491f03cdf048b58f0ab1c5f8d822d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ca491f03cdf048b58f0ab1c5f8d822d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca491f03cdf048b58f0ab1c5f8d822d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca491f03cdf048b58f0ab1c5f8d822d6"}]}] Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ca491f03cdf048b58f0ab1c5f8d822d6 Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 9ef629f81dbc42a894830f6ff1c7f9d8 Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: {"hw:cpu_policy": "shared"} Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:10:34.127458 n-d-860892-1 devstack@n-api.service[120994]: exception: Request body and URI mismatch Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'flavor_id': '1627166642', 'id': 'hw:numa_nodes', 'body': {'hw:cpu_policy': 'shared'}} Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors_extraspecs.py", line 96, in update Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=expl) Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Request body and URI mismatch Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:34.128207 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:34.129938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:10:34.129938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:10:34.129938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Request body and URI mismatch Oct 11 04:10:34.129938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.130284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-451167d9-da50-4ccf-9dbd-89517750d261 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Returning 400 to user: Request body and URI mismatch {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:34.131255 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-451167d9-da50-4ccf-9dbd-89517750d261 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes" status: 400 len: 73 microversion: 2.1 time: 0.025063 Oct 11 04:10:34.133043 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9cb265e5-e5f0-4d62-a993-c9f3409441c0 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/1/action" status: 200 len: 298 microversion: 2.41 time: 0.297487 Oct 11 04:10:34.134180 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 22/41] 10.222.0.26 () {60 vars in 1265 bytes} [Tue Oct 11 04:10:34 2022] PUT /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes => generated 73 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:10:34.143645 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 20/42] 10.222.0.26 () {62 vars in 1232 bytes} [Tue Oct 11 04:10:33 2022] POST /compute/v2.1/os-aggregates/1/action => generated 298 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:10:34.146681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-630ca90a-8d40-4943-8afd-7d9fe6aeba07 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.148836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-197f0ecd-50cc-4d43-b6dc-66a7b82a654b tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.182266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=5,nova_api:DELETE=5,nova_api:SAVEPOINT=7,nova_api:RELEASE=7,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:34.184428 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-197f0ecd-50cc-4d43-b6dc-66a7b82a654b tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1326581283/os-flavor-access" status: 200 len: 21 microversion: 2.1 time: 0.038923 Oct 11 04:10:34.190505 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 21/43] 10.222.0.26 () {58 vars in 1209 bytes} [Tue Oct 11 04:10:34 2022] GET /compute/v2.1/flavors/1326581283/os-flavor-access => generated 21 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:34.195194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-33457e5d-a28a-4a95-98d5-1c14bb07d9f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Action: 'update', calling method: >, body: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-33457e5d-a28a-4a95-98d5-1c14bb07d9f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Request method failure captured: Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: request: PUT /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes HTTP/1.1 Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 49 Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROy2ifUltl-L-Xx6Gva5jbzT08aGC3Iajs8rKwnbr9ffqd-g7J6Sz3Gg9fNoQTuqzK_QYuOhWsctFe4zDYPV4c64cao0WnnrQVKqm-CS5wZ1W2KJ-MLux0nlEGuj50eqBrlX_AHPrQD0dObDtaGcm8ZDLxQm5Hg5nNY9CnkGEKy1inU Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ca491f03cdf048b58f0ab1c5f8d822d6 Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:10:34.200470 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ca491f03cdf048b58f0ab1c5f8d822d6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ca491f03cdf048b58f0ab1c5f8d822d6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca491f03cdf048b58f0ab1c5f8d822d6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca491f03cdf048b58f0ab1c5f8d822d6"}]}] Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ca491f03cdf048b58f0ab1c5f8d822d6 Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 9ef629f81dbc42a894830f6ff1c7f9d8 Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: {"hw:numa_nodes": "1", "hw:cpu_policy": "shared"} Oct 11 04:10:34.201702 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: exception: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'flavor_id': '1627166642', 'id': 'hw:numa_nodes', 'body': {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'}} Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'maxProperties' in schema: Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'maxProperties': 1, Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'minProperties': 1, Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': ['string', Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'number']}}, Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance: Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'hw:cpu_policy': 'shared', 'hw:numa_nodes': '1'} Oct 11 04:10:34.202457 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.203552 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:34.205287 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:34.205287 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:34.205287 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:10:34.205287 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:10:34.205287 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties Oct 11 04:10:34.205287 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:34.206700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-33457e5d-a28a-4a95-98d5-1c14bb07d9f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Returning 400 to user: {'hw:numa_nodes': '1', 'hw:cpu_policy': 'shared'} has too many properties {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:34.207701 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-33457e5d-a28a-4a95-98d5-1c14bb07d9f1 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes" status: 400 len: 117 microversion: 2.1 time: 0.021756 Oct 11 04:10:34.208628 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 22/44] 10.222.0.26 () {60 vars in 1265 bytes} [Tue Oct 11 04:10:34 2022] PUT /compute/v2.1/flavors/1627166642/os-extra_specs/hw:numa_nodes => generated 117 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:10:34.214811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2fa3197f-f0b7-4af4-a064-815ca02c36e2 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.257339 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-630ca90a-8d40-4943-8afd-7d9fe6aeba07 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1740150321/os-extra_specs/hw:numa_nodes" status: 200 len: 0 microversion: 2.1 time: 0.121664 Oct 11 04:10:34.258430 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 23/45] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:10:34 2022] DELETE /compute/v2.1/flavors/1740150321/os-extra_specs/hw:numa_nodes => generated 0 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:10:34.262959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bedf39d5-6b0e-4532-88dd-7f2ae6130615 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.263573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bedf39d5-6b0e-4532-88dd-7f2ae6130615 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:34.329952 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2fa3197f-f0b7-4af4-a064-815ca02c36e2 tempest-AggregatesAdminTestV241-1737010900 tempest-AggregatesAdminTestV241-1737010900-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/1" status: 200 len: 0 microversion: 2.41 time: 0.114064 Oct 11 04:10:34.329952 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 11 04:10:34 2022] DELETE /compute/v2.1/os-aggregates/1 => generated 0 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:34.343228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bedf39d5-6b0e-4532-88dd-7f2ae6130615 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:34.352866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9925fe13-78e4-4174-b88c-635c21408244 tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.355615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bedf39d5-6b0e-4532-88dd-7f2ae6130615 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1219 microversion: 2.1 time: 0.096405 Oct 11 04:10:34.356198 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 24/47] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:34 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:34.376018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b95ea088-fcbf-40db-96c9-2df447bf5aa1 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.482051 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b95ea088-fcbf-40db-96c9-2df447bf5aa1 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1627166642" status: 202 len: 0 microversion: 2.1 time: 0.119933 Oct 11 04:10:34.493797 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9925fe13-78e4-4174-b88c-635c21408244 tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1326581283" status: 202 len: 0 microversion: 2.1 time: 0.161586 Oct 11 04:10:34.493890 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:10:34 2022] DELETE /compute/v2.1/flavors/1627166642 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:10:34.494688 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 24/49] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:10:34 2022] DELETE /compute/v2.1/flavors/1326581283 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:10:34.505528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca2f0c59-eb2c-4622-a4d2-4c9d4be479c7 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-1695294120", "name": "tempest-test_aggregate-112777377"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:34.508105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-67d9e976-4c15-4726-9eb8-3493bf3ae257 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.556130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-ca2f0c59-eb2c-4622-a4d2-4c9d4be479c7 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Generated uuid ee6c57f7-d378-4133-990b-726bb5035412 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:10:34.605976 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-67d9e976-4c15-4726-9eb8-3493bf3ae257 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1740150321/os-extra_specs/hw:cpu_policy" status: 200 len: 0 microversion: 2.1 time: 0.110714 Oct 11 04:10:34.606909 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 26/50] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:10:34 2022] DELETE /compute/v2.1/flavors/1740150321/os-extra_specs/hw:cpu_policy => generated 0 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:10:34.616853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e26c5d11-a847-47ab-ae77-927d6d6de587 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.655470 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e26c5d11-a847-47ab-ae77-927d6d6de587 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083 tempest-FlavorsExtraSpecsNegativeTestJSON-1740143083-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.046944 Oct 11 04:10:34.656793 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 27/51] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:10:34 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:34.661915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-850be7a5-8da0-4008-ac7b-2c0eaf7e0c7e tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.688408 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-850be7a5-8da0-4008-ac7b-2c0eaf7e0c7e tempest-FlavorsAccessTestJSON-1869939866 tempest-FlavorsAccessTestJSON-1869939866-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5396 microversion: 2.1 time: 0.030124 Oct 11 04:10:34.691607 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ca2f0c59-eb2c-4622-a4d2-4c9d4be479c7 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.195507 Oct 11 04:10:34.692292 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 25/52] 10.222.0.26 () {60 vars in 1165 bytes} [Tue Oct 11 04:10:34 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:34.693052 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 28/53] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:10:34 2022] GET /compute/v2.1/flavors/detail => generated 5396 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:34.706623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb95d6e6-6062-457c-883f-ad7918c3e469 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.713033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2c887e4-09d7-44ac-ade5-22253517a18c tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.726688 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb95d6e6-6062-457c-883f-ad7918c3e469 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1740150321/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.033184 Oct 11 04:10:34.730224 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 26/54] 10.222.0.26 () {58 vars in 1203 bytes} [Tue Oct 11 04:10:34 2022] GET /compute/v2.1/flavors/1740150321/os-extra_specs => generated 19 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:34.745596 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2c887e4-09d7-44ac-ade5-22253517a18c tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 302 microversion: 2.1 time: 0.041533 Oct 11 04:10:34.747551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-36d51c68-a7e6-4326-a95b-133ec06d6c6e tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:34.767511 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 29/55] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:10:34 2022] GET /compute/v2.1/os-aggregates => generated 302 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:34.774975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f50872a7-524e-4221-bdc6-ce72efb65aaf tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860892-1"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:34.843540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50872a7-524e-4221-bdc6-ce72efb65aaf tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:34.844033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50872a7-524e-4221-bdc6-ce72efb65aaf tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:34.850437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50872a7-524e-4221-bdc6-ce72efb65aaf tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:34.897075 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-36d51c68-a7e6-4326-a95b-133ec06d6c6e tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1740150321" status: 202 len: 0 microversion: 2.1 time: 0.156006 Oct 11 04:10:34.899664 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 27/56] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:10:34 2022] DELETE /compute/v2.1/flavors/1740150321 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:10:34.909080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a29e07c1-1743-4568-b18c-508af28be212 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:35.001641 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a29e07c1-1743-4568-b18c-508af28be212 tempest-FlavorsExtraSpecsTestJSON-1231326362 tempest-FlavorsExtraSpecsTestJSON-1231326362-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.098085 Oct 11 04:10:35.013873 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 28/57] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:10:34 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:35.388147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dfdd263c-d79e-46dd-bd80-fe5dc44a5d1b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:35.388147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dfdd263c-d79e-46dd-bd80-fe5dc44a5d1b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:35.404327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfdd263c-d79e-46dd-bd80-fe5dc44a5d1b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:35.404938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfdd263c-d79e-46dd-bd80-fe5dc44a5d1b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:35.405481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfdd263c-d79e-46dd-bd80-fe5dc44a5d1b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:35.406376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfdd263c-d79e-46dd-bd80-fe5dc44a5d1b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:35.408081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfdd263c-d79e-46dd-bd80-fe5dc44a5d1b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:35.408626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfdd263c-d79e-46dd-bd80-fe5dc44a5d1b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:37.116277 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f50872a7-524e-4221-bdc6-ce72efb65aaf tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 314 microversion: 2.1 time: 2.344886 Oct 11 04:10:37.118344 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 30/58] 10.222.0.26 () {60 vars in 1191 bytes} [Tue Oct 11 04:10:34 2022] POST /compute/v2.1/os-aggregates/2/action => generated 314 bytes in 2350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:37.285385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dfdd263c-d79e-46dd-bd80-fe5dc44a5d1b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:37.305211 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dfdd263c-d79e-46dd-bd80-fe5dc44a5d1b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1215 microversion: 2.1 time: 1.925297 Oct 11 04:10:37.305826 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 29/59] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:35 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1215 bytes in 1927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:38.329977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b7412d59-ca74-4d09-ab97-7a63a24dd854 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:38.334363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b7412d59-ca74-4d09-ab97-7a63a24dd854 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:38.346247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7412d59-ca74-4d09-ab97-7a63a24dd854 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:38.346830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7412d59-ca74-4d09-ab97-7a63a24dd854 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:38.347345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7412d59-ca74-4d09-ab97-7a63a24dd854 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:38.348117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7412d59-ca74-4d09-ab97-7a63a24dd854 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:38.348652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7412d59-ca74-4d09-ab97-7a63a24dd854 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:38.349144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7412d59-ca74-4d09-ab97-7a63a24dd854 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:38.482044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b7412d59-ca74-4d09-ab97-7a63a24dd854 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:38.497220 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b7412d59-ca74-4d09-ab97-7a63a24dd854 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1299 microversion: 2.1 time: 0.170476 Oct 11 04:10:38.498669 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 30/60] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:38 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1299 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:39.193216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AggregatesAdminTestJSON-server-1219273451", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "availability_zone": "tempest-test_az-1695294120"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:39.208900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:39.210128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:39.210659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:39.211832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:39.212387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:39.213870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:39.296943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:10:39.524822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4d9b755a-65cb-4fe0-9b4d-c1d009951d4b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:39.525437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4d9b755a-65cb-4fe0-9b4d-c1d009951d4b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:39.533906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d9b755a-65cb-4fe0-9b4d-c1d009951d4b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:39.535308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d9b755a-65cb-4fe0-9b4d-c1d009951d4b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:39.535756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d9b755a-65cb-4fe0-9b4d-c1d009951d4b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:39.536468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d9b755a-65cb-4fe0-9b4d-c1d009951d4b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:39.536979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d9b755a-65cb-4fe0-9b4d-c1d009951d4b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:39.537336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d9b755a-65cb-4fe0-9b4d-c1d009951d4b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:39.610927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:10:39.611432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:10:39.612038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:10:39.612448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:10:39.613187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:10:39.630323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:39.632338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:39.635736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:39.636715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:39.639560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:39.640797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:39.671923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Getting quotas for project 3aacdd09e90e4e0f8f76986dc3c91e10. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:10:39.685522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Getting quotas for user a81b54be42b74a948b0340177ca9f7bc and project 3aacdd09e90e4e0f8f76986dc3c91e10. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:10:39.707282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:10:39.710148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:10:39.825350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4d9b755a-65cb-4fe0-9b4d-c1d009951d4b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:39.834048 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4d9b755a-65cb-4fe0-9b4d-c1d009951d4b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.312991 Oct 11 04:10:39.834835 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 31/61] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:39 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:10:39.862467 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab5a3efc-d2b0-46c8-8019-cebbb18c4045 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.943079 Oct 11 04:10:39.863138 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 31/62] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:10:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1945 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:10:39.875516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9bb0ff36-caa9-463f-b4cc-90b6d23941a4 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:39.879953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9bb0ff36-caa9-463f-b4cc-90b6d23941a4 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:39.989287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9bb0ff36-caa9-463f-b4cc-90b6d23941a4 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:40.004051 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9bb0ff36-caa9-463f-b4cc-90b6d23941a4 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1243 microversion: 2.1 time: 0.132578 Oct 11 04:10:40.006652 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 32/63] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:39 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1243 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:40.860362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d99c5365-e8dc-4891-afa3-0cb8c75db1e2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:40.871327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d99c5365-e8dc-4891-afa3-0cb8c75db1e2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:40.892352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d99c5365-e8dc-4891-afa3-0cb8c75db1e2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:40.898881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d99c5365-e8dc-4891-afa3-0cb8c75db1e2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:40.902773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d99c5365-e8dc-4891-afa3-0cb8c75db1e2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:40.906574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d99c5365-e8dc-4891-afa3-0cb8c75db1e2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:40.909322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d99c5365-e8dc-4891-afa3-0cb8c75db1e2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:40.913560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d99c5365-e8dc-4891-afa3-0cb8c75db1e2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:41.027706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-af6b9e28-41af-4bda-9aa3-52d456698bbb tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:41.028454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-af6b9e28-41af-4bda-9aa3-52d456698bbb tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:41.181021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-af6b9e28-41af-4bda-9aa3-52d456698bbb tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:41.187652 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-af6b9e28-41af-4bda-9aa3-52d456698bbb tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1243 microversion: 2.1 time: 0.164190 Oct 11 04:10:41.190931 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 33/64] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:41 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1243 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:41.527108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d99c5365-e8dc-4891-afa3-0cb8c75db1e2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:41.541892 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d99c5365-e8dc-4891-afa3-0cb8c75db1e2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.688357 Oct 11 04:10:41.543027 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 32/65] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:40 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:42.215224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b28636a0-d6f6-41ff-98c3-82bc27ff7d10 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:42.215846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b28636a0-d6f6-41ff-98c3-82bc27ff7d10 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:42.238104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b28636a0-d6f6-41ff-98c3-82bc27ff7d10 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:42.238653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b28636a0-d6f6-41ff-98c3-82bc27ff7d10 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:42.239197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b28636a0-d6f6-41ff-98c3-82bc27ff7d10 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:42.239796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b28636a0-d6f6-41ff-98c3-82bc27ff7d10 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:42.247065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b28636a0-d6f6-41ff-98c3-82bc27ff7d10 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:42.247707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b28636a0-d6f6-41ff-98c3-82bc27ff7d10 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:42.394172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b28636a0-d6f6-41ff-98c3-82bc27ff7d10 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:42.419171 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b28636a0-d6f6-41ff-98c3-82bc27ff7d10 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1243 microversion: 2.1 time: 0.206576 Oct 11 04:10:42.432513 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 34/66] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:42 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1243 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:42.566342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d7287b78-5252-4501-8639-0c766aed4443 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:42.566991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d7287b78-5252-4501-8639-0c766aed4443 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:42.577472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7287b78-5252-4501-8639-0c766aed4443 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:42.578794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7287b78-5252-4501-8639-0c766aed4443 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:42.581401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7287b78-5252-4501-8639-0c766aed4443 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:42.583486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7287b78-5252-4501-8639-0c766aed4443 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:42.586620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7287b78-5252-4501-8639-0c766aed4443 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:42.587301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7287b78-5252-4501-8639-0c766aed4443 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:42.863789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d7287b78-5252-4501-8639-0c766aed4443 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:42.874780 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d7287b78-5252-4501-8639-0c766aed4443 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.313406 Oct 11 04:10:42.886908 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 33/67] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:42 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:43.446280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8b7f1150-0224-44e5-ae66-0aeb78501c5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:43.447486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8b7f1150-0224-44e5-ae66-0aeb78501c5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:43.457941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b7f1150-0224-44e5-ae66-0aeb78501c5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:43.459412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b7f1150-0224-44e5-ae66-0aeb78501c5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:43.460670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b7f1150-0224-44e5-ae66-0aeb78501c5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:43.462090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b7f1150-0224-44e5-ae66-0aeb78501c5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:43.462583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b7f1150-0224-44e5-ae66-0aeb78501c5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:43.463575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b7f1150-0224-44e5-ae66-0aeb78501c5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:43.618057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8b7f1150-0224-44e5-ae66-0aeb78501c5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:43.626414 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8b7f1150-0224-44e5-ae66-0aeb78501c5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1243 microversion: 2.1 time: 0.185197 Oct 11 04:10:43.630059 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 35/68] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:43 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1243 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:43.903723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90ae49d4-c645-426a-846f-e62e90f7d482 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:43.904459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90ae49d4-c645-426a-846f-e62e90f7d482 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:43.912341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90ae49d4-c645-426a-846f-e62e90f7d482 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:43.913018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90ae49d4-c645-426a-846f-e62e90f7d482 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:43.913620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90ae49d4-c645-426a-846f-e62e90f7d482 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:43.914504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90ae49d4-c645-426a-846f-e62e90f7d482 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:43.915146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90ae49d4-c645-426a-846f-e62e90f7d482 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:43.915744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90ae49d4-c645-426a-846f-e62e90f7d482 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:44.108073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90ae49d4-c645-426a-846f-e62e90f7d482 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:44.135114 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90ae49d4-c645-426a-846f-e62e90f7d482 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.219087 Oct 11 04:10:44.135355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d0ea3534-58ef-4c36-8888-19fbf7403ae0 req-e70da6c9-24a7-48e7-a76a-0a436eea1008 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2b18dcce-1cfa-415c-9f84-3606760a55aa", "tag": "ea239d09-e9de-4b7e-809f-3a511d3dfc72"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:44.142614 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 36/69] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:43 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:44.151153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d0ea3534-58ef-4c36-8888-19fbf7403ae0 req-e70da6c9-24a7-48e7-a76a-0a436eea1008 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:44.151153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d0ea3534-58ef-4c36-8888-19fbf7403ae0 req-e70da6c9-24a7-48e7-a76a-0a436eea1008 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:44.151153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d0ea3534-58ef-4c36-8888-19fbf7403ae0 req-e70da6c9-24a7-48e7-a76a-0a436eea1008 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:44.186890 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d0ea3534-58ef-4c36-8888-19fbf7403ae0 req-e70da6c9-24a7-48e7-a76a-0a436eea1008 service nova] Creating event network-changed:ea239d09-e9de-4b7e-809f-3a511d3dfc72 for instance 2b18dcce-1cfa-415c-9f84-3606760a55aa on n-h2-860892-1 Oct 11 04:10:44.187433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d0ea3534-58ef-4c36-8888-19fbf7403ae0 req-e70da6c9-24a7-48e7-a76a-0a436eea1008 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:10:44.187828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d0ea3534-58ef-4c36-8888-19fbf7403ae0 req-e70da6c9-24a7-48e7-a76a-0a436eea1008 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:10:44.189025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3a321bf-77b4-4f2d-ba36-ab3bb4a0c035 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:44.189629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3a321bf-77b4-4f2d-ba36-ab3bb4a0c035 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:44.190067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3a321bf-77b4-4f2d-ba36-ab3bb4a0c035 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:44.190803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3a321bf-77b4-4f2d-ba36-ab3bb4a0c035 None None] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:44.191251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3a321bf-77b4-4f2d-ba36-ab3bb4a0c035 None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:44.191675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3a321bf-77b4-4f2d-ba36-ab3bb4a0c035 None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:44.202751 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.rpcapi [None req-b3a321bf-77b4-4f2d-ba36-ab3bb4a0c035 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 04:10:44.203408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3a321bf-77b4-4f2d-ba36-ab3bb4a0c035 None None] Releasing lock "compute-rpcapi-router" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:10:44.225706 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b3a321bf-77b4-4f2d-ba36-ab3bb4a0c035 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.658968 Oct 11 04:10:44.225706 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 34/70] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:44.665506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d052c3b-5323-4499-9005-6e63370c5a39 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:44.667168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7d052c3b-5323-4499-9005-6e63370c5a39 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:44.685525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d052c3b-5323-4499-9005-6e63370c5a39 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:44.686064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d052c3b-5323-4499-9005-6e63370c5a39 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:44.691110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d052c3b-5323-4499-9005-6e63370c5a39 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:44.691906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d052c3b-5323-4499-9005-6e63370c5a39 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:44.692374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d052c3b-5323-4499-9005-6e63370c5a39 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:44.692809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d052c3b-5323-4499-9005-6e63370c5a39 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:44.856228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d052c3b-5323-4499-9005-6e63370c5a39 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:44.868774 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d052c3b-5323-4499-9005-6e63370c5a39 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1243 microversion: 2.1 time: 0.209460 Oct 11 04:10:44.879244 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 37/71] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:44 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1243 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:45.143561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-64b39cd1-a03a-4420-b231-381ac487f80b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:45.145221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-64b39cd1-a03a-4420-b231-381ac487f80b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:45.176282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64b39cd1-a03a-4420-b231-381ac487f80b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:45.177134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64b39cd1-a03a-4420-b231-381ac487f80b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:45.178619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64b39cd1-a03a-4420-b231-381ac487f80b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:45.179860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64b39cd1-a03a-4420-b231-381ac487f80b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:45.180596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64b39cd1-a03a-4420-b231-381ac487f80b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:45.181235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64b39cd1-a03a-4420-b231-381ac487f80b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:45.743875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-64b39cd1-a03a-4420-b231-381ac487f80b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:45.755394 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-64b39cd1-a03a-4420-b231-381ac487f80b tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.617125 Oct 11 04:10:45.757422 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 35/72] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:45 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:45.895070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb8dfe26-424f-4404-964f-076968824f3d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:45.895679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cb8dfe26-424f-4404-964f-076968824f3d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:45.905802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8dfe26-424f-4404-964f-076968824f3d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:45.907757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8dfe26-424f-4404-964f-076968824f3d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:45.908925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8dfe26-424f-4404-964f-076968824f3d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:45.911417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8dfe26-424f-4404-964f-076968824f3d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:45.912052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8dfe26-424f-4404-964f-076968824f3d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:45.913165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8dfe26-424f-4404-964f-076968824f3d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:46.054136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb8dfe26-424f-4404-964f-076968824f3d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:46.071040 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cb8dfe26-424f-4404-964f-076968824f3d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1243 microversion: 2.1 time: 0.181663 Oct 11 04:10:46.083852 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 38/73] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:45 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1243 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:46.780648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3335f035-84df-49c7-b874-c4152ab9a36c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:46.782440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3335f035-84df-49c7-b874-c4152ab9a36c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:46.795485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3335f035-84df-49c7-b874-c4152ab9a36c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:46.805325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3335f035-84df-49c7-b874-c4152ab9a36c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:46.805690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3335f035-84df-49c7-b874-c4152ab9a36c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:46.806879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3335f035-84df-49c7-b874-c4152ab9a36c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:46.808277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3335f035-84df-49c7-b874-c4152ab9a36c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:46.809559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3335f035-84df-49c7-b874-c4152ab9a36c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:47.109202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-010d676e-4688-40e4-ab6b-47d71cd95b41 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:47.110436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-010d676e-4688-40e4-ab6b-47d71cd95b41 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:47.125754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-010d676e-4688-40e4-ab6b-47d71cd95b41 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:47.129404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-010d676e-4688-40e4-ab6b-47d71cd95b41 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:47.135788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-010d676e-4688-40e4-ab6b-47d71cd95b41 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:47.137870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-010d676e-4688-40e4-ab6b-47d71cd95b41 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:47.139486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-010d676e-4688-40e4-ab6b-47d71cd95b41 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:47.141799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-010d676e-4688-40e4-ab6b-47d71cd95b41 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:47.420667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-010d676e-4688-40e4-ab6b-47d71cd95b41 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:47.443035 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-010d676e-4688-40e4-ab6b-47d71cd95b41 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1243 microversion: 2.1 time: 0.341822 Oct 11 04:10:47.466285 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 39/74] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:47 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1243 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:47.484781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3335f035-84df-49c7-b874-c4152ab9a36c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:47.493558 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3335f035-84df-49c7-b874-c4152ab9a36c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.718149 Oct 11 04:10:47.494158 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 36/75] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:46 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:48.473602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5c1ee5e-79a7-4ea2-b852-81605702dbac tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:48.474324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c5c1ee5e-79a7-4ea2-b852-81605702dbac tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:48.502520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c1ee5e-79a7-4ea2-b852-81605702dbac tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:48.516930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49dfae68-fba0-412f-80df-ca00ff43d7b3 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:48.521022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-49dfae68-fba0-412f-80df-ca00ff43d7b3 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:48.531323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c1ee5e-79a7-4ea2-b852-81605702dbac tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:48.532536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c1ee5e-79a7-4ea2-b852-81605702dbac tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:48.534859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49dfae68-fba0-412f-80df-ca00ff43d7b3 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:48.536977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c1ee5e-79a7-4ea2-b852-81605702dbac tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:48.539128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c1ee5e-79a7-4ea2-b852-81605702dbac tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:48.539810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49dfae68-fba0-412f-80df-ca00ff43d7b3 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:48.540484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c1ee5e-79a7-4ea2-b852-81605702dbac tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:48.541399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49dfae68-fba0-412f-80df-ca00ff43d7b3 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:48.548060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49dfae68-fba0-412f-80df-ca00ff43d7b3 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:48.548060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49dfae68-fba0-412f-80df-ca00ff43d7b3 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:48.548060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49dfae68-fba0-412f-80df-ca00ff43d7b3 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:48.765137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c5c1ee5e-79a7-4ea2-b852-81605702dbac tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:48.776364 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c5c1ee5e-79a7-4ea2-b852-81605702dbac tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1291 microversion: 2.1 time: 0.308707 Oct 11 04:10:48.785772 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 40/76] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:48 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1291 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:49.023169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-49dfae68-fba0-412f-80df-ca00ff43d7b3 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:49.032920 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-49dfae68-fba0-412f-80df-ca00ff43d7b3 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.519778 Oct 11 04:10:49.036052 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 37/77] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:48 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:10:49.814755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f2873f02-03ae-4827-80c5-de35d2b8bb6f tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:49.816086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f2873f02-03ae-4827-80c5-de35d2b8bb6f tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:49.828106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=16 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:49.831405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2873f02-03ae-4827-80c5-de35d2b8bb6f tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:49.836682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2873f02-03ae-4827-80c5-de35d2b8bb6f tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:49.836682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2873f02-03ae-4827-80c5-de35d2b8bb6f tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:49.836682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2873f02-03ae-4827-80c5-de35d2b8bb6f tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:49.836682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2873f02-03ae-4827-80c5-de35d2b8bb6f tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:49.837382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2873f02-03ae-4827-80c5-de35d2b8bb6f tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:50.021190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2873f02-03ae-4827-80c5-de35d2b8bb6f tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:50.029890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a796946-84e4-4659-9c44-04c8e84204e3 tempest-FlavorsV261TestJSON-1544018358 tempest-FlavorsV261TestJSON-1544018358-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsV261TestJSON-flavor-295403572", "id": 1301859754, "os-flavor-access:is_public": "True"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:50.059834 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f2873f02-03ae-4827-80c5-de35d2b8bb6f tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1297 microversion: 2.1 time: 0.245585 Oct 11 04:10:50.061544 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 38/78] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:49 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1297 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:50.077014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:50.077969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:50.102828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:50.103649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:50.105272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:50.107546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:50.108937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:50.110255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:50.151951 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9a796946-84e4-4659-9c44-04c8e84204e3 tempest-FlavorsV261TestJSON-1544018358 tempest-FlavorsV261TestJSON-1544018358-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 467 microversion: 2.61 time: 0.564136 Oct 11 04:10:50.155277 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 41/79] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:10:49 2022] POST /compute/v2.1/flavors => generated 467 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:10:50.869244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-412bcd86-21bd-4622-a2f9-9803355137c7 tempest-FlavorsV261TestJSON-1999436739 tempest-FlavorsV261TestJSON-1999436739-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:50.884938 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-412bcd86-21bd-4622-a2f9-9803355137c7 tempest-FlavorsV261TestJSON-1999436739 tempest-FlavorsV261TestJSON-1999436739-project] 10.222.0.26 "GET /compute/v2.1/flavors/1301859754" status: 200 len: 467 microversion: 2.61 time: 0.719376 Oct 11 04:10:50.892429 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 42/80] 10.222.0.26 () {60 vars in 1199 bytes} [Tue Oct 11 04:10:50 2022] GET /compute/v2.1/flavors/1301859754 => generated 467 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:10:50.960564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:50.968552 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.903897 Oct 11 04:10:50.974499 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 39/81] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:50 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:50.988341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:50.990939 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0c336548-2450-416c-943d-73886137fc86 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.011076 Oct 11 04:10:50.995204 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 40/82] 10.222.0.26 () {56 vars in 886 bytes} [Tue Oct 11 04:10:50 2022] GET /compute/ => generated 377 bytes in 16 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 04:10:51.142448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1fad6d5b-ca25-481e-8cb7-97b82c7f9b19 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Calling method '.version_select at 0x7fda1ab5b820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:51.147183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad6d5b-ca25-481e-8cb7-97b82c7f9b19 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:51.151166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad6d5b-ca25-481e-8cb7-97b82c7f9b19 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:51.152538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad6d5b-ca25-481e-8cb7-97b82c7f9b19 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:51.159954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad6d5b-ca25-481e-8cb7-97b82c7f9b19 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:51.164976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad6d5b-ca25-481e-8cb7-97b82c7f9b19 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:51.167459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad6d5b-ca25-481e-8cb7-97b82c7f9b19 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:51.206106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:51.265437 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1fad6d5b-ca25-481e-8cb7-97b82c7f9b19 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 398 microversion: 2.1 time: 0.371460 Oct 11 04:10:51.272939 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 43/83] 10.222.0.26 () {58 vars in 1128 bytes} [Tue Oct 11 04:10:50 2022] GET /compute/v2.1/os-hosts => generated 398 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:51.278861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a563364a-e53a-480c-8fa8-a289a6311a5e tempest-FlavorsV261TestJSON-1544018358 tempest-FlavorsV261TestJSON-1544018358-project-admin] Action: 'update', calling method: , body: {"flavor": {"description": "new"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:51.421830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a563364a-e53a-480c-8fa8-a289a6311a5e tempest-FlavorsV261TestJSON-1544018358 tempest-FlavorsV261TestJSON-1544018358-project-admin] 10.222.0.26 "PUT /compute/v2.1/flavors/1301859754" status: 200 len: 468 microversion: 2.61 time: 0.147020 Oct 11 04:10:51.445621 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 44/84] 10.222.0.26 () {62 vars in 1219 bytes} [Tue Oct 11 04:10:51 2022] PUT /compute/v2.1/flavors/1301859754 => generated 468 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:10:51.464744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a0825de2-ff6f-401d-bf85-f0bce1f44821 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:51.467569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a0825de2-ff6f-401d-bf85-f0bce1f44821 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:51.493047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0825de2-ff6f-401d-bf85-f0bce1f44821 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:51.493544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0825de2-ff6f-401d-bf85-f0bce1f44821 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:51.493983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0825de2-ff6f-401d-bf85-f0bce1f44821 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:51.494740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0825de2-ff6f-401d-bf85-f0bce1f44821 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:51.495194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0825de2-ff6f-401d-bf85-f0bce1f44821 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:51.500144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0825de2-ff6f-401d-bf85-f0bce1f44821 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:51.657388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a0825de2-ff6f-401d-bf85-f0bce1f44821 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:51.685752 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a0825de2-ff6f-401d-bf85-f0bce1f44821 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1297 microversion: 2.1 time: 0.236128 Oct 11 04:10:51.700913 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 45/85] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:51 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1297 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:52.061698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-068bda83-86e8-4f5a-b983-d34df2bcb613 tempest-InstanceUsageAuditLogNegativeTestJSON-826739721 tempest-InstanceUsageAuditLogNegativeTestJSON-826739721-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.065799 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-068bda83-86e8-4f5a-b983-d34df2bcb613 tempest-InstanceUsageAuditLogNegativeTestJSON-826739721 tempest-InstanceUsageAuditLogNegativeTestJSON-826739721-project-admin] HTTP exception thrown: Invalid timestamp for date invalid_time Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-068bda83-86e8-4f5a-b983-d34df2bcb613 tempest-InstanceUsageAuditLogNegativeTestJSON-826739721 tempest-InstanceUsageAuditLogNegativeTestJSON-826739721-project-admin] Request method failure captured: Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-instance_usage_audit_log/invalid_time HTTP/1.1 Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzK-J_-0SLU6sDQezUBUYYC2ddpJmVEHFfTx9svwPhCrrq8werYP34yyLV_iLk7-sR_F9l7kwWSNTGPw2NOXmjpVOEeDho7XS7FWXImCq1cLd4pUKvDXJ2gyxK3rmKnmLYPMA2hXGP9QxLb5lIm9zvgl1BA4ZxBTvsZKfieB_GzqfE Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 68fcb9de6c5049e2943a367152839249 Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-826739721 Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:10:52.077617 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:10:52.079227 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/68fcb9de6c5049e2943a367152839249"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_68fcb9de6c5049e2943a367152839249"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68fcb9de6c5049e2943a367152839249"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/68fcb9de6c5049e2943a367152839249"}]}] Oct 11 04:10:52.079227 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-826739721 Oct 11 04:10:52.079227 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 68fcb9de6c5049e2943a367152839249 Oct 11 04:10:52.079227 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-826739721 Oct 11 04:10:52.079227 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-826739721-project-admin Oct 11 04:10:52.079227 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:52.079227 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:52.079227 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5577d24db507400b9a886df69fd8282b Oct 11 04:10:52.079227 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-826739721-project-admin Oct 11 04:10:52.079227 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:10:52.079227 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid timestamp for date invalid_time Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'invalid_time'} Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 51, in show Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi before_date = datetime.datetime.strptime(str(id), Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 568, in _strptime_datetime Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi tt, fraction, gmtoff_fraction = _strptime(data_string, format) Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/_strptime.py", line 349, in _strptime Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise ValueError("time data %r does not match format %r" % Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ValueError: time data 'invalid_time' does not match format '%Y-%m-%d %H:%M:%S' Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:52.079816 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 55, in show Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=msg) Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid timestamp for date invalid_time Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid timestamp for date invalid_time Oct 11 04:10:52.080826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.083071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-068bda83-86e8-4f5a-b983-d34df2bcb613 tempest-InstanceUsageAuditLogNegativeTestJSON-826739721 tempest-InstanceUsageAuditLogNegativeTestJSON-826739721-project-admin] Returning 400 to user: Invalid timestamp for date invalid_time {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:52.088170 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-068bda83-86e8-4f5a-b983-d34df2bcb613 tempest-InstanceUsageAuditLogNegativeTestJSON-826739721 tempest-InstanceUsageAuditLogNegativeTestJSON-826739721-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/invalid_time" status: 400 len: 83 microversion: 2.1 time: 1.091279 Oct 11 04:10:52.089041 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 41/86] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Oct 11 04:10:50 2022] GET /compute/v2.1/os-instance_usage_audit_log/invalid_time => generated 83 bytes in 1093 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:10:52.096815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f050a65b-54f3-4b74-96ed-93cecf6edd34 tempest-FlavorsV261TestJSON-1999436739 tempest-FlavorsV261TestJSON-1999436739-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.142558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d1a5c517-3d7b-4cdf-8696-2ba9ffa4dd97 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Calling method '.version_select at 0x7fda1ab8af70>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.148433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d1a5c517-3d7b-4cdf-8696-2ba9ffa4dd97 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Policy check for os_compute_api:os-hosts:list failed with credentials {'is_admin': False, 'user_id': '59be7363858b4e16ae901ff12eeac3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bbc8db9f084981a29645e004b0a458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d1a5c517-3d7b-4cdf-8696-2ba9ffa4dd97 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Request method failure captured: Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-hosts HTTP/1.1 Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzF_Vk8lGyJQP59kcYD3dLN20xu7uK4tHIIBrXHVCMOLme1ogDXY29Xe-ozQ6HN4PqoRFYb1jjE_-I6axfU9Uos-H0jot32OVpZMpBpRyHWAhrqOLAuB1wx28y9ukDDTdOVAFrdHIAk8PPgKRgHwoGwZctZycVvqoSBEuO1rAvEL2w Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:10:52.153051 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86bbc8db9f084981a29645e004b0a458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}] Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 59be7363858b4e16ae901ff12eeac3ed Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: action_args: {} Oct 11 04:10:52.154487 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 74, in index Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'list', Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:52.155296 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:list to be performed. Oct 11 04:10:52.156984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.163805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d1a5c517-3d7b-4cdf-8696-2ba9ffa4dd97 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:list to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:52.167178 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d1a5c517-3d7b-4cdf-8696-2ba9ffa4dd97 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 403 len: 109 microversion: 2.1 time: 0.464034 Oct 11 04:10:52.169156 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 46/87] 10.222.0.26 () {58 vars in 1128 bytes} [Tue Oct 11 04:10:51 2022] GET /compute/v2.1/os-hosts => generated 109 bytes in 467 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:52.200872 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f050a65b-54f3-4b74-96ed-93cecf6edd34 tempest-FlavorsV261TestJSON-1999436739 tempest-FlavorsV261TestJSON-1999436739-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6249 microversion: 2.61 time: 0.110505 Oct 11 04:10:52.203862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3d65a550-5b9d-4acb-b01b-d27cd75e8218 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.204471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3d65a550-5b9d-4acb-b01b-d27cd75e8218 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:52.210713 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 42/88] 10.222.0.26 () {60 vars in 1187 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/flavors/detail => generated 6249 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:10:52.223326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d65a550-5b9d-4acb-b01b-d27cd75e8218 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:52.230944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d65a550-5b9d-4acb-b01b-d27cd75e8218 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:52.232020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d65a550-5b9d-4acb-b01b-d27cd75e8218 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:52.241329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d65a550-5b9d-4acb-b01b-d27cd75e8218 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:52.242008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d65a550-5b9d-4acb-b01b-d27cd75e8218 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:52.242616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d65a550-5b9d-4acb-b01b-d27cd75e8218 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:52.284679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=10,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:52.449974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-492a676f-f687-4ad2-b275-2eb33d09954b tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.450767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d65a550-5b9d-4acb-b01b-d27cd75e8218 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-492a676f-f687-4ad2-b275-2eb33d09954b tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project] Policy check for os_compute_api:os-instance-usage-audit-log:list failed with credentials {'is_admin': False, 'user_id': '9d58ee4d075942969bb9e15b88e632a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c56a95fb044258bc78cafdeaaa711a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-492a676f-f687-4ad2-b275-2eb33d09954b tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project] Request method failure captured: Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-instance_usage_audit_log HTTP/1.1 Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzGzZAasuFhgZSlI-z78vvgKj9iI5NioSpkFjUVTpIKs6tU5O2E5g_vwhBcLS7NSG8xRJwcw0_NOwbWvhxtBZ51UIWM9SYiXbfHOGlnEii7gCaDo6bBJ1aD8qcKDNfzgugN2SlLDcwge9DKIxDFSo9PDXQ1kc5-vRdHdb20J0dUxP4 Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: a1c56a95fb044258bc78cafdeaaa711a Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:10:52.450959 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:10:52.452503 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a1c56a95fb044258bc78cafdeaaa711a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a1c56a95fb044258bc78cafdeaaa711a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1c56a95fb044258bc78cafdeaaa711a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1c56a95fb044258bc78cafdeaaa711a"}]}] Oct 11 04:10:52.452503 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 Oct 11 04:10:52.452503 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: a1c56a95fb044258bc78cafdeaaa711a Oct 11 04:10:52.452503 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 Oct 11 04:10:52.452503 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project Oct 11 04:10:52.452503 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:52.452503 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:52.452503 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 9d58ee4d075942969bb9e15b88e632a9 Oct 11 04:10:52.452503 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project Oct 11 04:10:52.452503 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: action_args: {} Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 38, in index Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:52.453228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. Oct 11 04:10:52.455087 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.456773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-492a676f-f687-4ad2-b275-2eb33d09954b tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:list to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:52.456773 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-492a676f-f687-4ad2-b275-2eb33d09954b tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 403 len: 128 microversion: 2.1 time: 0.229014 Oct 11 04:10:52.456773 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 43/89] 10.222.0.26 () {58 vars in 1185 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 128 bytes in 230 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:52.457000 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3d65a550-5b9d-4acb-b01b-d27cd75e8218 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.276585 Oct 11 04:10:52.457000 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 47/90] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:52.462021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bdf5db1-d326-42f3-91cd-ca9d8109eba9 tempest-FlavorsV261TestJSON-1999436739 tempest-FlavorsV261TestJSON-1999436739-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.490451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9478f77a-d36c-426a-aa46-7bbb7bc2f7c7 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Calling method '.version_select at 0x7fda1ab61160>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.492765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9478f77a-d36c-426a-aa46-7bbb7bc2f7c7 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Policy check for os_compute_api:os-hosts:reboot failed with credentials {'is_admin': False, 'user_id': '59be7363858b4e16ae901ff12eeac3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bbc8db9f084981a29645e004b0a458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9478f77a-d36c-426a-aa46-7bbb7bc2f7c7 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Request method failure captured: Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-hosts/n-d-860892-1/reboot HTTP/1.1 Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzF_Vk8lGyJQP59kcYD3dLN20xu7uK4tHIIBrXHVCMOLme1ogDXY29Xe-ozQ6HN4PqoRFYb1jjE_-I6axfU9Uos-H0jot32OVpZMpBpRyHWAhrqOLAuB1wx28y9ukDDTdOVAFrdHIAk8PPgKRgHwoGwZctZycVvqoSBEuO1rAvEL2w Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:10:52.495013 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86bbc8db9f084981a29645e004b0a458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}] Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 59be7363858b4e16ae901ff12eeac3ed Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'n-d-860892-1'} Oct 11 04:10:52.496134 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 203, in reboot Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'reboot', Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:52.496938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. Oct 11 04:10:52.497980 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.502231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9478f77a-d36c-426a-aa46-7bbb7bc2f7c7 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:reboot to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:52.503567 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9478f77a-d36c-426a-aa46-7bbb7bc2f7c7 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-860892-1/reboot" status: 403 len: 111 microversion: 2.1 time: 0.019800 Oct 11 04:10:52.504324 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 44/91] 10.222.0.26 () {58 vars in 1188 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/os-hosts/n-d-860892-1/reboot => generated 111 bytes in 62 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:52.530005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56737411-8dd4-4a3f-9a34-0c8304b1f1bf tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.544542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-56737411-8dd4-4a3f-9a34-0c8304b1f1bf tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project] Policy check for os_compute_api:os-instance-usage-audit-log:show failed with credentials {'is_admin': False, 'user_id': '9d58ee4d075942969bb9e15b88e632a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1c56a95fb044258bc78cafdeaaa711a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56737411-8dd4-4a3f-9a34-0c8304b1f1bf tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project] Request method failure captured: Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2004:10:52 HTTP/1.1 Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzGzZAasuFhgZSlI-z78vvgKj9iI5NioSpkFjUVTpIKs6tU5O2E5g_vwhBcLS7NSG8xRJwcw0_NOwbWvhxtBZ51UIWM9SYiXbfHOGlnEii7gCaDo6bBJ1aD8qcKDNfzgugN2SlLDcwge9DKIxDFSo9PDXQ1kc5-vRdHdb20J0dUxP4 Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: a1c56a95fb044258bc78cafdeaaa711a Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:10:52.546267 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:10:52.547891 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a1c56a95fb044258bc78cafdeaaa711a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a1c56a95fb044258bc78cafdeaaa711a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1c56a95fb044258bc78cafdeaaa711a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a1c56a95fb044258bc78cafdeaaa711a"}]}] Oct 11 04:10:52.547891 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 Oct 11 04:10:52.547891 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: a1c56a95fb044258bc78cafdeaaa711a Oct 11 04:10:52.547891 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 Oct 11 04:10:52.547891 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project Oct 11 04:10:52.547891 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:52.547891 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:52.547891 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 9d58ee4d075942969bb9e15b88e632a9 Oct 11 04:10:52.547891 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project Oct 11 04:10:52.547891 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '2022-10-11 04:10:52'} Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_usage_audit_log.py", line 45, in show Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(iual_policies.BASE_POLICY_NAME % 'show', target={}) Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:52.548884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. Oct 11 04:10:52.549957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.552070 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0bdf5db1-d326-42f3-91cd-ca9d8109eba9 tempest-FlavorsV261TestJSON-1999436739 tempest-FlavorsV261TestJSON-1999436739-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 3156 microversion: 2.61 time: 0.096988 Oct 11 04:10:52.563075 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 48/92] 10.222.0.26 () {60 vars in 1166 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/flavors => generated 3156 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:10:52.568726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56737411-8dd4-4a3f-9a34-0c8304b1f1bf tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-instance-usage-audit-log:show to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:52.569616 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-56737411-8dd4-4a3f-9a34-0c8304b1f1bf tempest-InstanceUsageAuditLogNegativeTestJSON-385483797 tempest-InstanceUsageAuditLogNegativeTestJSON-385483797-project] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11 04:10:52" status: 403 len: 128 microversion: 2.1 time: 0.064165 Oct 11 04:10:52.570176 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 45/93] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2004%3A10%3A52 => generated 128 bytes in 65 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:52.573963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f4f4b47-1f69-43f0-afd4-a8afac514827 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Calling method '.version_select at 0x7fda1ab8aee0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.596859 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-9f4f4b47-1f69-43f0-afd4-a8afac514827 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f4f4b47-1f69-43f0-afd4-a8afac514827 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Request method failure captured: Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot HTTP/1.1 Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzKnGYBHWYLnXo6yu7vRfDLi-zdi_2WtTsE_RqFZQ6O_L9n5LPEre4PW42rek0DSC56zkwKubGIYGounXriQU_rcieYK_pw45pH4si56qXFg7Xx3MD62SL0TNLGiUI3fAhmeVeg1SXu7dRgM3n3RBF9vPmZW9Frjuti6dS44Xz9VUc Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:10:52.612755 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}] Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7a81f656110046faaf24c969e5a6b367 Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'nonexistent_hostname'} Oct 11 04:10:52.614230 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:10:52.615116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 205, in reboot Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="reboot") Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 04:10:52.616366 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:10:52.617553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:52.617553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.617553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.617553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.617553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.617553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.617553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.617553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:10:52.617553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:10:52.617553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:52.617553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.621045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f4f4b47-1f69-43f0-afd4-a8afac514827 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:52.621917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d1b71ede-53c2-4e91-af4a-6a1bfabc41c4 tempest-FlavorsV261TestJSON-1544018358 tempest-FlavorsV261TestJSON-1544018358-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.622604 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9f4f4b47-1f69-43f0-afd4-a8afac514827 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot" status: 404 len: 99 microversion: 2.1 time: 0.067843 Oct 11 04:10:52.629960 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 49/94] 10.222.0.26 () {58 vars in 1212 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/reboot => generated 99 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:10:52.644493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8512a34-e168-4395-9bc1-c3e2b326a274 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Calling method '.version_select at 0x7fda1aa0c280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.658628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a8512a34-e168-4395-9bc1-c3e2b326a274 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Policy check for os_compute_api:os-hosts:show failed with credentials {'is_admin': False, 'user_id': '59be7363858b4e16ae901ff12eeac3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bbc8db9f084981a29645e004b0a458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8512a34-e168-4395-9bc1-c3e2b326a274 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Request method failure captured: Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-hosts/n-d-860892-1 HTTP/1.1 Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzF_Vk8lGyJQP59kcYD3dLN20xu7uK4tHIIBrXHVCMOLme1ogDXY29Xe-ozQ6HN4PqoRFYb1jjE_-I6axfU9Uos-H0jot32OVpZMpBpRyHWAhrqOLAuB1wx28y9ukDDTdOVAFrdHIAk8PPgKRgHwoGwZctZycVvqoSBEuO1rAvEL2w Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:10:52.668188 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86bbc8db9f084981a29645e004b0a458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}] Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 59be7363858b4e16ae901ff12eeac3ed Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'n-d-860892-1'} Oct 11 04:10:52.669584 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 270, in show Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'show', Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:52.670407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:show to be performed. Oct 11 04:10:52.671506 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.675020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8512a34-e168-4395-9bc1-c3e2b326a274 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:show to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:52.690598 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a8512a34-e168-4395-9bc1-c3e2b326a274 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-860892-1" status: 403 len: 109 microversion: 2.1 time: 0.045415 Oct 11 04:10:52.690598 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 50/95] 10.222.0.26 () {58 vars in 1167 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/os-hosts/n-d-860892-1 => generated 109 bytes in 51 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:52.698923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41039097-e28a-461b-8e54-c4423599bb94 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Calling method '.version_select at 0x7fda1aabfdc0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.716308 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-41039097-e28a-461b-8e54-c4423599bb94 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41039097-e28a-461b-8e54-c4423599bb94 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Request method failure captured: Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzKnGYBHWYLnXo6yu7vRfDLi-zdi_2WtTsE_RqFZQ6O_L9n5LPEre4PW42rek0DSC56zkwKubGIYGounXriQU_rcieYK_pw45pH4si56qXFg7Xx3MD62SL0TNLGiUI3fAhmeVeg1SXu7dRgM3n3RBF9vPmZW9Frjuti6dS44Xz9VUc Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:10:52.725299 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}] Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7a81f656110046faaf24c969e5a6b367 Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'nonexistent_hostname'} Oct 11 04:10:52.726727 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 274, in show Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.727472 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 282, in show Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:52.728524 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.733490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41039097-e28a-461b-8e54-c4423599bb94 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:52.738608 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41039097-e28a-461b-8e54-c4423599bb94 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.044263 Oct 11 04:10:52.743543 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 51/96] 10.222.0.26 () {58 vars in 1191 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:10:52.754274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8d08e40a-8fe6-4857-bf2a-655d9595869d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.759907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8d08e40a-8fe6-4857-bf2a-655d9595869d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:52.774964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d08e40a-8fe6-4857-bf2a-655d9595869d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:52.789392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d08e40a-8fe6-4857-bf2a-655d9595869d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:52.800103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d08e40a-8fe6-4857-bf2a-655d9595869d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:52.800103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d08e40a-8fe6-4857-bf2a-655d9595869d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:52.800103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d08e40a-8fe6-4857-bf2a-655d9595869d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:52.800103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d08e40a-8fe6-4857-bf2a-655d9595869d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:52.892615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d1b71ede-53c2-4e91-af4a-6a1bfabc41c4 tempest-FlavorsV261TestJSON-1544018358 tempest-FlavorsV261TestJSON-1544018358-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1301859754" status: 202 len: 0 microversion: 2.61 time: 0.314087 Oct 11 04:10:52.897859 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 46/97] 10.222.0.26 () {60 vars in 1202 bytes} [Tue Oct 11 04:10:52 2022] DELETE /compute/v2.1/flavors/1301859754 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:10:52.903007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de15dfb0-dc4f-45e7-9f13-469639c142e3 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Calling method '.version_select at 0x7fda1ad83b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.905220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-de15dfb0-dc4f-45e7-9f13-469639c142e3 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Policy check for os_compute_api:os-hosts:shutdown failed with credentials {'is_admin': False, 'user_id': '59be7363858b4e16ae901ff12eeac3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bbc8db9f084981a29645e004b0a458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de15dfb0-dc4f-45e7-9f13-469639c142e3 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Request method failure captured: Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-hosts/n-d-860892-1/shutdown HTTP/1.1 Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzF_Vk8lGyJQP59kcYD3dLN20xu7uK4tHIIBrXHVCMOLme1ogDXY29Xe-ozQ6HN4PqoRFYb1jjE_-I6axfU9Uos-H0jot32OVpZMpBpRyHWAhrqOLAuB1wx28y9ukDDTdOVAFrdHIAk8PPgKRgHwoGwZctZycVvqoSBEuO1rAvEL2w Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:10:52.908920 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86bbc8db9f084981a29645e004b0a458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}] Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 59be7363858b4e16ae901ff12eeac3ed Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'n-d-860892-1'} Oct 11 04:10:52.910350 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 195, in shutdown Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'shutdown', Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:52.911023 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. Oct 11 04:10:52.911944 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:52.917970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de15dfb0-dc4f-45e7-9f13-469639c142e3 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:shutdown to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:52.918972 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-de15dfb0-dc4f-45e7-9f13-469639c142e3 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-860892-1/shutdown" status: 403 len: 113 microversion: 2.1 time: 0.019884 Oct 11 04:10:52.921600 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 47/98] 10.222.0.26 () {58 vars in 1194 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/os-hosts/n-d-860892-1/shutdown => generated 113 bytes in 26 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:52.938217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae97ee3f-d3fa-4083-9f05-02301455a2f6 tempest-FlavorsV261TestJSON-1544018358 tempest-FlavorsV261TestJSON-1544018358-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:52.980513 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae97ee3f-d3fa-4083-9f05-02301455a2f6 tempest-FlavorsV261TestJSON-1544018358 tempest-FlavorsV261TestJSON-1544018358-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5791 microversion: 2.61 time: 0.056056 Oct 11 04:10:52.982815 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 48/99] 10.222.0.26 () {60 vars in 1187 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/flavors/detail => generated 5791 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:10:53.012668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8308fa48-1128-4e7a-8b5a-b36f56fdd813 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Calling method '.version_select at 0x7fda1ac50820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:53.045188 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-8308fa48-1128-4e7a-8b5a-b36f56fdd813 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8308fa48-1128-4e7a-8b5a-b36f56fdd813 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Request method failure captured: Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown HTTP/1.1 Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzKnGYBHWYLnXo6yu7vRfDLi-zdi_2WtTsE_RqFZQ6O_L9n5LPEre4PW42rek0DSC56zkwKubGIYGounXriQU_rcieYK_pw45pH4si56qXFg7Xx3MD62SL0TNLGiUI3fAhmeVeg1SXu7dRgM3n3RBF9vPmZW9Frjuti6dS44Xz9VUc Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:10:53.064063 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}] Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7a81f656110046faaf24c969e5a6b367 Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'nonexistent_hostname'} Oct 11 04:10:53.065629 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:10:53.066289 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 197, in shutdown Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="shutdown") Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 04:10:53.067400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8308fa48-1128-4e7a-8b5a-b36f56fdd813 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:53.068916 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8308fa48-1128-4e7a-8b5a-b36f56fdd813 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown" status: 404 len: 99 microversion: 2.1 time: 0.081054 Oct 11 04:10:53.072422 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 49/100] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/shutdown => generated 99 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:10:53.087000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d1933b8-30c0-46e3-95f7-d410ecc1c934 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Calling method '.version_select at 0x7fda1aa288b0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:53.090626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d1933b8-30c0-46e3-95f7-d410ecc1c934 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Policy check for os_compute_api:os-hosts:start failed with credentials {'is_admin': False, 'user_id': '59be7363858b4e16ae901ff12eeac3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bbc8db9f084981a29645e004b0a458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d1933b8-30c0-46e3-95f7-d410ecc1c934 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Request method failure captured: Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-hosts/n-d-860892-1/startup HTTP/1.1 Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzF_Vk8lGyJQP59kcYD3dLN20xu7uK4tHIIBrXHVCMOLme1ogDXY29Xe-ozQ6HN4PqoRFYb1jjE_-I6axfU9Uos-H0jot32OVpZMpBpRyHWAhrqOLAuB1wx28y9ukDDTdOVAFrdHIAk8PPgKRgHwoGwZctZycVvqoSBEuO1rAvEL2w Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:10:53.098263 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86bbc8db9f084981a29645e004b0a458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}] Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 59be7363858b4e16ae901ff12eeac3ed Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'n-d-860892-1'} Oct 11 04:10:53.099941 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 187, in startup Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'start', Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:53.100853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:start to be performed. Oct 11 04:10:53.102097 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.107570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d1933b8-30c0-46e3-95f7-d410ecc1c934 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:start to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:53.111019 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d1933b8-30c0-46e3-95f7-d410ecc1c934 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-d-860892-1/startup" status: 403 len: 110 microversion: 2.1 time: 0.033930 Oct 11 04:10:53.111019 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 50/101] 10.222.0.26 () {58 vars in 1191 bytes} [Tue Oct 11 04:10:53 2022] GET /compute/v2.1/os-hosts/n-d-860892-1/startup => generated 110 bytes in 36 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:53.121529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cc665db-3093-493f-957c-c111073f2187 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Calling method '.version_select at 0x7fda1aa28310>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:53.133913 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-2cc665db-3093-493f-957c-c111073f2187 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cc665db-3093-493f-957c-c111073f2187 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Request method failure captured: Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-hosts/nonexistent_hostname/startup HTTP/1.1 Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzKnGYBHWYLnXo6yu7vRfDLi-zdi_2WtTsE_RqFZQ6O_L9n5LPEre4PW42rek0DSC56zkwKubGIYGounXriQU_rcieYK_pw45pH4si56qXFg7Xx3MD62SL0TNLGiUI3fAhmeVeg1SXu7dRgM3n3RBF9vPmZW9Frjuti6dS44Xz9VUc Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:10:53.137014 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}] Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7a81f656110046faaf24c969e5a6b367 Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'nonexistent_hostname'} Oct 11 04:10:53.148002 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 174, in _host_power_action Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = self.api.host_power_action(context, host_name, action) Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:10:53.148810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 189, in startup Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._host_power_action(req, host_name=id, action="startup") Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 178, in _host_power_action Oct 11 04:10:53.151612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cc665db-3093-493f-957c-c111073f2187 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2cc665db-3093-493f-957c-c111073f2187 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/nonexistent_hostname/startup" status: 404 len: 99 microversion: 2.1 time: 0.022559 Oct 11 04:10:53.154337 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 51/102] 10.222.0.26 () {58 vars in 1215 bytes} [Tue Oct 11 04:10:53 2022] GET /compute/v2.1/os-hosts/nonexistent_hostname/startup => generated 99 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:10:53.162835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2681070-8582-4fb8-bf53-69e872c76394 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Action: 'update', calling method: .version_select at 0x7fda1aa28b80>, body: {"status": "enable", "maintenance_mode": "invalid"} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2681070-8582-4fb8-bf53-69e872c76394 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Request method failure captured: Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/os-hosts/n-d-860892-1 HTTP/1.1 Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 51 Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzKnGYBHWYLnXo6yu7vRfDLi-zdi_2WtTsE_RqFZQ6O_L9n5LPEre4PW42rek0DSC56zkwKubGIYGounXriQU_rcieYK_pw45pH4si56qXFg7Xx3MD62SL0TNLGiUI3fAhmeVeg1SXu7dRgM3n3RBF9vPmZW9Frjuti6dS44Xz9VUc Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:10:53.171845 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}] Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7a81f656110046faaf24c969e5a6b367 Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: {"status": "enable", "maintenance_mode": "invalid"} Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:10:53.173609 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'n-d-860892-1', 'body': {'status': 'enable', 'maintenance_mode': 'invalid'}} Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['maintenance_mode']: Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance: Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.174366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.176823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.179225 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.179225 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:10:53.179225 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:10:53.179225 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 04:10:53.179225 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.179225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2681070-8582-4fb8-bf53-69e872c76394 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Returning 400 to user: Invalid input for field/attribute maintenance_mode. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:53.179225 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2681070-8582-4fb8-bf53-69e872c76394 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-860892-1" status: 400 len: 199 microversion: 2.1 time: 0.016003 Oct 11 04:10:53.180483 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 52/103] 10.222.0.26 () {60 vars in 1187 bytes} [Tue Oct 11 04:10:53 2022] PUT /compute/v2.1/os-hosts/n-d-860892-1 => generated 199 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:10:53.185090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d4da7db-77b3-4229-a53a-adbf3a60e1b8 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Action: 'update', calling method: .version_select at 0x7fda1aac9940>, body: {"status": "invalid", "maintenance_mode": "enable"} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d4da7db-77b3-4229-a53a-adbf3a60e1b8 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Request method failure captured: Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/os-hosts/n-d-860892-1 HTTP/1.1 Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 51 Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzKnGYBHWYLnXo6yu7vRfDLi-zdi_2WtTsE_RqFZQ6O_L9n5LPEre4PW42rek0DSC56zkwKubGIYGounXriQU_rcieYK_pw45pH4si56qXFg7Xx3MD62SL0TNLGiUI3fAhmeVeg1SXu7dRgM3n3RBF9vPmZW9Frjuti6dS44Xz9VUc Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:10:53.190444 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}] Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7a81f656110046faaf24c969e5a6b367 Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: {"status": "invalid", "maintenance_mode": "enable"} Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:10:53.193107 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'n-d-860892-1', 'body': {'status': 'invalid', 'maintenance_mode': 'enable'}} Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['status']: Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance: Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.193778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.195030 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.195939 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.195939 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:10:53.195939 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:10:53.195939 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] Oct 11 04:10:53.195939 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.195939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d4da7db-77b3-4229-a53a-adbf3a60e1b8 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: invalid. 'invalid' is not one of ['enable', 'disable', 'Enable', 'Disable', 'ENABLE', 'DISABLE'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:53.196262 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4d4da7db-77b3-4229-a53a-adbf3a60e1b8 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-860892-1" status: 400 len: 189 microversion: 2.1 time: 0.010570 Oct 11 04:10:53.197133 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 53/104] 10.222.0.26 () {60 vars in 1187 bytes} [Tue Oct 11 04:10:53 2022] PUT /compute/v2.1/os-hosts/n-d-860892-1 => generated 189 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:10:53.210058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a0f93f81-69a2-45cb-9da4-5864caba4af6 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Action: 'update', calling method: .version_select at 0x7fda1aa28940>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a0f93f81-69a2-45cb-9da4-5864caba4af6 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Policy check for os_compute_api:os-hosts:update failed with credentials {'is_admin': False, 'user_id': '59be7363858b4e16ae901ff12eeac3ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bbc8db9f084981a29645e004b0a458', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a0f93f81-69a2-45cb-9da4-5864caba4af6 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Request method failure captured: Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/os-hosts/n-d-860892-1 HTTP/1.1 Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 50 Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzF_Vk8lGyJQP59kcYD3dLN20xu7uK4tHIIBrXHVCMOLme1ogDXY29Xe-ozQ6HN4PqoRFYb1jjE_-I6axfU9Uos-H0jot32OVpZMpBpRyHWAhrqOLAuB1wx28y9ukDDTdOVAFrdHIAk8PPgKRgHwoGwZctZycVvqoSBEuO1rAvEL2w Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:10:53.217409 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86bbc8db9f084981a29645e004b0a458"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86bbc8db9f084981a29645e004b0a458"}]}] Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 86bbc8db9f084981a29645e004b0a458 Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-504745303 Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 59be7363858b4e16ae901ff12eeac3ed Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HostsAdminNegativeTestJSON-504745303-project Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: {"status": "enable", "maintenance_mode": "enable"} Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 04:10:53.218644 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'n-d-860892-1', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 112, in update Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(hosts_policies.POLICY_NAME % 'update', Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:53.219421 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hosts:update to be performed. Oct 11 04:10:53.222099 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.223655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a0f93f81-69a2-45cb-9da4-5864caba4af6 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hosts:update to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:53.223655 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a0f93f81-69a2-45cb-9da4-5864caba4af6 tempest-HostsAdminNegativeTestJSON-504745303 tempest-HostsAdminNegativeTestJSON-504745303-project] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-860892-1" status: 403 len: 111 microversion: 2.1 time: 0.014479 Oct 11 04:10:53.223655 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 54/105] 10.222.0.26 () {60 vars in 1187 bytes} [Tue Oct 11 04:10:53 2022] PUT /compute/v2.1/os-hosts/n-d-860892-1 => generated 111 bytes in 16 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:10:53.228196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1f700f0-97a5-48fb-9282-df8b47918028 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Action: 'update', calling method: .version_select at 0x7fda1aa32700>, body: {"status": null, "maintenance_mode": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1f700f0-97a5-48fb-9282-df8b47918028 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Request method failure captured: Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/os-hosts/n-d-860892-1 HTTP/1.1 Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 42 Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzKnGYBHWYLnXo6yu7vRfDLi-zdi_2WtTsE_RqFZQ6O_L9n5LPEre4PW42rek0DSC56zkwKubGIYGounXriQU_rcieYK_pw45pH4si56qXFg7Xx3MD62SL0TNLGiUI3fAhmeVeg1SXu7dRgM3n3RBF9vPmZW9Frjuti6dS44Xz9VUc Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:10:53.236618 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}] Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7a81f656110046faaf24c969e5a6b367 Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: {"status": null, "maintenance_mode": null} Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 04:10:53.243178 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'n-d-860892-1', 'body': {'status': None, 'maintenance_mode': None}} Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: None is not of type 'string' Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['status']: Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'enum': ['enable', Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'disable', Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'Enable', Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'Disable', Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'ENABLE', Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'DISABLE'], Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance: Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi None Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.245274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.247209 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.249631 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:10:53.249631 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:10:53.249631 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute status. Value: None. None is not of type 'string' Oct 11 04:10:53.249631 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.249631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1f700f0-97a5-48fb-9282-df8b47918028 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Returning 400 to user: Invalid input for field/attribute status. Value: None. None is not of type 'string' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:53.249631 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b1f700f0-97a5-48fb-9282-df8b47918028 tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/n-d-860892-1" status: 400 len: 127 microversion: 2.1 time: 0.013454 Oct 11 04:10:53.249631 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 55/106] 10.222.0.26 () {60 vars in 1187 bytes} [Tue Oct 11 04:10:53 2022] PUT /compute/v2.1/os-hosts/n-d-860892-1 => generated 127 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:10:53.254278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d819bd01-2ba2-422f-b285-11464196defa tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Action: 'update', calling method: .version_select at 0x7fda1aa28550>, body: {"status": "enable", "maintenance_mode": "enable"} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:53.259950 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.hosts [None req-d819bd01-2ba2-422f-b285-11464196defa tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Enabling host nonexistent_hostname. Oct 11 04:10:53.262937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=7,nova_api:INSERT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:53.285851 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d819bd01-2ba2-422f-b285-11464196defa tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] HTTP exception thrown: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d819bd01-2ba2-422f-b285-11464196defa tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Request method failure captured: Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/os-hosts/nonexistent_hostname HTTP/1.1 Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 50 Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzKnGYBHWYLnXo6yu7vRfDLi-zdi_2WtTsE_RqFZQ6O_L9n5LPEre4PW42rek0DSC56zkwKubGIYGounXriQU_rcieYK_pw45pH4si56qXFg7Xx3MD62SL0TNLGiUI3fAhmeVeg1SXu7dRgM3n3RBF9vPmZW9Frjuti6dS44Xz9VUc Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:10:53.290240 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b0a9071f37e41439b564c2cde749df5"}]}] Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 2b0a9071f37e41439b564c2cde749df5 Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HostsAdminNegativeTestJSON-1532224125 Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7a81f656110046faaf24c969e5a6b367 Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HostsAdminNegativeTestJSON-1532224125-project-admin Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: {"status": "enable", "maintenance_mode": "enable"} Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: exception: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.291708 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'nonexistent_hostname', 'body': {'status': 'enable', 'maintenance_mode': 'enable'}} Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 159, in _set_enabled_status Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = self.api.set_host_enabled(context, host_name, enabled) Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5990, in targeted Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host) Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 04:10:53.292428 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:10:53.294252 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 124, in update Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result['status'] = self._set_enabled_status(context, id, status) Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hosts.py", line 163, in _set_enabled_status Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Host 'nonexistent_hostname' is not mapped to any cell Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:53.296147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d819bd01-2ba2-422f-b285-11464196defa tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] Returning 404 to user: Host 'nonexistent_hostname' is not mapped to any cell {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:53.297692 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d819bd01-2ba2-422f-b285-11464196defa tempest-HostsAdminNegativeTestJSON-1532224125 tempest-HostsAdminNegativeTestJSON-1532224125-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-hosts/nonexistent_hostname" status: 404 len: 99 microversion: 2.1 time: 0.044488 Oct 11 04:10:53.297692 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 56/107] 10.222.0.26 () {60 vars in 1211 bytes} [Tue Oct 11 04:10:53 2022] PUT /compute/v2.1/os-hosts/nonexistent_hostname => generated 99 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:10:53.322069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8d08e40a-8fe6-4857-bf2a-655d9595869d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:53.325628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:53.334347 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8d08e40a-8fe6-4857-bf2a-655d9595869d tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1339 microversion: 2.1 time: 0.593598 Oct 11 04:10:53.347476 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 52/108] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:52 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1339 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:53.476587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7185372e-adae-43d7-97e1-dd1beb31b700 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:53.477203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7185372e-adae-43d7-97e1-dd1beb31b700 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:53.483860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7185372e-adae-43d7-97e1-dd1beb31b700 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:53.484285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7185372e-adae-43d7-97e1-dd1beb31b700 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:53.485381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7185372e-adae-43d7-97e1-dd1beb31b700 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:53.486081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7185372e-adae-43d7-97e1-dd1beb31b700 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:53.486565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7185372e-adae-43d7-97e1-dd1beb31b700 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:53.487160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7185372e-adae-43d7-97e1-dd1beb31b700 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:53.729411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7185372e-adae-43d7-97e1-dd1beb31b700 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:53.740436 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7185372e-adae-43d7-97e1-dd1beb31b700 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.268047 Oct 11 04:10:53.740937 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 53/109] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:53 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:53.955519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a3f44618-0dc1-4618-81c6-f46413a370b1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:53.965354 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a3f44618-0dc1-4618-81c6-f46413a370b1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.501430 Oct 11 04:10:53.966530 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 57/110] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:10:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:54.045834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b9690d70-b1d7-4e0a-8ba4-d33fcc4b127d req-b6cbfbd4-d883-468a-b7ff-6c28955bad4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57379b24-c543-4dbc-84f9-0e1a11e2b20f", "tag": "471fca83-47be-452f-976c-d972af6446c2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:54.071125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b9690d70-b1d7-4e0a-8ba4-d33fcc4b127d req-b6cbfbd4-d883-468a-b7ff-6c28955bad4f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:54.071765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b9690d70-b1d7-4e0a-8ba4-d33fcc4b127d req-b6cbfbd4-d883-468a-b7ff-6c28955bad4f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:54.072034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b9690d70-b1d7-4e0a-8ba4-d33fcc4b127d req-b6cbfbd4-d883-468a-b7ff-6c28955bad4f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:54.092196 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b9690d70-b1d7-4e0a-8ba4-d33fcc4b127d req-b6cbfbd4-d883-468a-b7ff-6c28955bad4f service nova] Creating event network-changed:471fca83-47be-452f-976c-d972af6446c2 for instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f on n-h2-860892-1 Oct 11 04:10:54.102207 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b9690d70-b1d7-4e0a-8ba4-d33fcc4b127d req-b6cbfbd4-d883-468a-b7ff-6c28955bad4f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059735 Oct 11 04:10:54.103049 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 58/111] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:10:54.356413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:10:54.362317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e2670f6-8a2f-4a5c-a03a-87bb54b0a752 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:54.363078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e2670f6-8a2f-4a5c-a03a-87bb54b0a752 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:54.373447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2670f6-8a2f-4a5c-a03a-87bb54b0a752 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:54.373921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2670f6-8a2f-4a5c-a03a-87bb54b0a752 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:54.374372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2670f6-8a2f-4a5c-a03a-87bb54b0a752 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:54.375369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2670f6-8a2f-4a5c-a03a-87bb54b0a752 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:54.376151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2670f6-8a2f-4a5c-a03a-87bb54b0a752 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:54.376732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2670f6-8a2f-4a5c-a03a-87bb54b0a752 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:54.596893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dc0af66b-b756-4985-91a5-871a2ca0f24c tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_1-2146445810", "id": 1151262366, "OS-FLV-EXT-DATA:ephemeral": 1, "os-flavor-access:is_public": "True"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:54.693048 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dc0af66b-b756-4985-91a5-871a2ca0f24c tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 425 microversion: 2.1 time: 0.716446 Oct 11 04:10:54.694225 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 54/112] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:10:53 2022] POST /compute/v2.1/flavors => generated 425 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:54.705651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e2670f6-8a2f-4a5c-a03a-87bb54b0a752 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:54.706452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f0cacf08-9bfa-484c-8e65-7b204fa282fd tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:54.714549 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f0cacf08-9bfa-484c-8e65-7b204fa282fd tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.012348 Oct 11 04:10:54.715805 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 55/113] 10.222.0.26 () {58 vars in 1182 bytes} [Tue Oct 11 04:10:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 04:10:54.724669 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e2670f6-8a2f-4a5c-a03a-87bb54b0a752 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1339 microversion: 2.1 time: 0.369100 Oct 11 04:10:54.725504 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 59/114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:54 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1339 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:10:54.727713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-454d469a-2dde-46db-8089-cc20d3b9cc88 tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "vcpus": 1, "disk": 1, "name": "tempest-flavor_with_ephemeral_0-488031434", "id": 54296184, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": "True"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:54.764860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b09ad000-3e55-4935-aaec-154b8125bd39 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:54.766832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b09ad000-3e55-4935-aaec-154b8125bd39 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:54.774549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b09ad000-3e55-4935-aaec-154b8125bd39 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:54.775697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b09ad000-3e55-4935-aaec-154b8125bd39 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:54.776487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b09ad000-3e55-4935-aaec-154b8125bd39 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:54.777446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b09ad000-3e55-4935-aaec-154b8125bd39 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:54.778069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b09ad000-3e55-4935-aaec-154b8125bd39 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:54.778744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b09ad000-3e55-4935-aaec-154b8125bd39 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:54.838143 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-454d469a-2dde-46db-8089-cc20d3b9cc88 tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 418 microversion: 2.1 time: 0.114984 Oct 11 04:10:54.847004 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 56/115] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:10:54 2022] POST /compute/v2.1/flavors => generated 418 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:10:54.855439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4cd16c36-0351-43a1-9156-d376704922ff tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:54.863562 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4cd16c36-0351-43a1-9156-d376704922ff tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.015178 Oct 11 04:10:54.873126 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 57/116] 10.222.0.26 () {58 vars in 1182 bytes} [Tue Oct 11 04:10:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:10:54.881339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b316c6f-5e5f-4e7b-96dd-0d1502d043cc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Action: 'create', calling method: .version_select at 0x7fda1aa12550>, body: {"keypair": {"name": "tempest-keypair-2042032906", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4rMcNd3KYMhErCKrB74wK2tZf4SgzW+TTUGHj5utlhBzCajmvRPCjEHExQxmIKuPu6VZSRZxZHbhOAzFKltl26gWmBF5uaiqRFfac4n3csXasV2OJ+fYnuP41gmYHcvw=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:54.942786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-9b316c6f-5e5f-4e7b-96dd-0d1502d043cc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Getting quotas for project 49ed194cff9c4482a96dff268602479a. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:10:54.960346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-9b316c6f-5e5f-4e7b-96dd-0d1502d043cc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Getting quotas for user 28240e25179b447781e0e351c659c065 and project 49ed194cff9c4482a96dff268602479a. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:10:55.018778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b09ad000-3e55-4935-aaec-154b8125bd39 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:55.029362 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b09ad000-3e55-4935-aaec-154b8125bd39 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.269936 Oct 11 04:10:55.029934 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 60/117] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:54 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:10:55.122224 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b316c6f-5e5f-4e7b-96dd-0d1502d043cc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.247411 Oct 11 04:10:55.122984 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 58/118] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:10:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:10:55.752107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bd0d34db-ce31-4f5a-a5c5-b7bc9e002ba0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:55.752107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bd0d34db-ce31-4f5a-a5c5-b7bc9e002ba0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:55.765296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0d34db-ce31-4f5a-a5c5-b7bc9e002ba0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:55.765951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0d34db-ce31-4f5a-a5c5-b7bc9e002ba0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:55.766674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0d34db-ce31-4f5a-a5c5-b7bc9e002ba0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:55.767418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0d34db-ce31-4f5a-a5c5-b7bc9e002ba0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:55.767878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0d34db-ce31-4f5a-a5c5-b7bc9e002ba0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:55.768311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0d34db-ce31-4f5a-a5c5-b7bc9e002ba0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:56.053024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aed2606e-dedb-4652-b923-254bc67a30fb tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:56.053391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aed2606e-dedb-4652-b923-254bc67a30fb tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:56.066111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aed2606e-dedb-4652-b923-254bc67a30fb tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:56.066708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aed2606e-dedb-4652-b923-254bc67a30fb tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:56.067375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aed2606e-dedb-4652-b923-254bc67a30fb tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:56.068330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aed2606e-dedb-4652-b923-254bc67a30fb tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:56.068783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aed2606e-dedb-4652-b923-254bc67a30fb tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:56.069419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aed2606e-dedb-4652-b923-254bc67a30fb tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:56.078019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bd0d34db-ce31-4f5a-a5c5-b7bc9e002ba0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:56.087875 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bd0d34db-ce31-4f5a-a5c5-b7bc9e002ba0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1339 microversion: 2.1 time: 0.342656 Oct 11 04:10:56.105288 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 61/119] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:55 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1339 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:56.360449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aed2606e-dedb-4652-b923-254bc67a30fb tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:56.369786 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aed2606e-dedb-4652-b923-254bc67a30fb tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.320747 Oct 11 04:10:56.370592 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 59/120] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:56 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:10:57.113049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-01f05b3c-ce6c-4031-93fb-c1a9bd1be919 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:57.113915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-01f05b3c-ce6c-4031-93fb-c1a9bd1be919 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:57.120368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f05b3c-ce6c-4031-93fb-c1a9bd1be919 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:57.121034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f05b3c-ce6c-4031-93fb-c1a9bd1be919 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:57.121767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f05b3c-ce6c-4031-93fb-c1a9bd1be919 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:57.122494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f05b3c-ce6c-4031-93fb-c1a9bd1be919 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:57.123091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f05b3c-ce6c-4031-93fb-c1a9bd1be919 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:57.123692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f05b3c-ce6c-4031-93fb-c1a9bd1be919 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:57.395719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7c14d9be-6672-4d60-872d-57c33e3b0039 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:57.395719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7c14d9be-6672-4d60-872d-57c33e3b0039 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:57.408703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c14d9be-6672-4d60-872d-57c33e3b0039 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:57.409285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c14d9be-6672-4d60-872d-57c33e3b0039 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:57.415036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c14d9be-6672-4d60-872d-57c33e3b0039 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:57.415727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c14d9be-6672-4d60-872d-57c33e3b0039 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:57.416283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c14d9be-6672-4d60-872d-57c33e3b0039 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:57.416622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c14d9be-6672-4d60-872d-57c33e3b0039 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:57.517823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-01f05b3c-ce6c-4031-93fb-c1a9bd1be919 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:57.527663 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-01f05b3c-ce6c-4031-93fb-c1a9bd1be919 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1339 microversion: 2.1 time: 0.419115 Oct 11 04:10:57.528263 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 62/121] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:57 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1339 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:57.757086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7c14d9be-6672-4d60-872d-57c33e3b0039 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:57.768059 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7c14d9be-6672-4d60-872d-57c33e3b0039 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.378447 Oct 11 04:10:57.769418 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 60/122] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:57 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:10:58.227288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1bb2d578-c8b3-4b89-a3b3-23988122acc0 tempest-AZAdminNegativeTestJSON-1782239370 tempest-AZAdminNegativeTestJSON-1782239370-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:58.228842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1bb2d578-c8b3-4b89-a3b3-23988122acc0 tempest-AZAdminNegativeTestJSON-1782239370 tempest-AZAdminNegativeTestJSON-1782239370-project] Policy check for os_compute_api:os-availability-zone:detail failed with credentials {'is_admin': False, 'user_id': '8ba22092fb924d569b25cb8d1d48eecd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '372daab0393f4512a94f6cc8d6ac623d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1bb2d578-c8b3-4b89-a3b3-23988122acc0 tempest-AZAdminNegativeTestJSON-1782239370 tempest-AZAdminNegativeTestJSON-1782239370-project] Request method failure captured: Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-availability-zone/detail HTTP/1.1 Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzOp1DIMJc63NxUCmc6Em5_kMcuRO42s-fh2mtZbUwUfQno29aL88pM8Iac-LGNJ_UkDCwK1_wtH5cDoE76gBTnawBcW3pNmxx3cdIL0MJ-7JU71qFR95Hntf-_LmMfb3RkgePa6BeoDIw50mHtD7GzINAnx9v9fc8O3DaLzdBS5QM Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 372daab0393f4512a94f6cc8d6ac623d Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AZAdminNegativeTestJSON-1782239370 Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:10:58.230750 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/372daab0393f4512a94f6cc8d6ac623d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_372daab0393f4512a94f6cc8d6ac623d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/372daab0393f4512a94f6cc8d6ac623d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/372daab0393f4512a94f6cc8d6ac623d"}]}] Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AZAdminNegativeTestJSON-1782239370 Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 372daab0393f4512a94f6cc8d6ac623d Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AZAdminNegativeTestJSON-1782239370 Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AZAdminNegativeTestJSON-1782239370-project Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 8ba22092fb924d569b25cb8d1d48eecd Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AZAdminNegativeTestJSON-1782239370-project Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 04:10:58.232071 n-d-860892-1 devstack@n-api.service[120994]: action_args: {} Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/availability_zone.py", line 117, in detail Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(az_policies.POLICY_ROOT % 'detail', target={}) Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:10:58.232807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:10:58.233737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1bb2d578-c8b3-4b89-a3b3-23988122acc0 tempest-AZAdminNegativeTestJSON-1782239370 tempest-AZAdminNegativeTestJSON-1782239370-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-availability-zone:detail to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:10:58.235315 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1bb2d578-c8b3-4b89-a3b3-23988122acc0 tempest-AZAdminNegativeTestJSON-1782239370 tempest-AZAdminNegativeTestJSON-1782239370-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 403 len: 123 microversion: 2.1 time: 0.218771 Oct 11 04:10:58.235315 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 63/123] 10.222.0.26 () {58 vars in 1185 bytes} [Tue Oct 11 04:10:58 2022] GET /compute/v2.1/os-availability-zone/detail => generated 123 bytes in 220 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:10:58.553706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f8955e9-ff92-400a-831d-76f86ff8322e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:58.556324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5f8955e9-ff92-400a-831d-76f86ff8322e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:58.579616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f8955e9-ff92-400a-831d-76f86ff8322e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:58.580114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f8955e9-ff92-400a-831d-76f86ff8322e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:58.580706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f8955e9-ff92-400a-831d-76f86ff8322e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:58.581628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f8955e9-ff92-400a-831d-76f86ff8322e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:58.586641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f8955e9-ff92-400a-831d-76f86ff8322e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:58.588045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f8955e9-ff92-400a-831d-76f86ff8322e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:58.801761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-627e0db1-6054-4c17-ba8d-8da0082f1944 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:58.803045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-627e0db1-6054-4c17-ba8d-8da0082f1944 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:58.808434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5f8955e9-ff92-400a-831d-76f86ff8322e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:58.814388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-627e0db1-6054-4c17-ba8d-8da0082f1944 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:58.815258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-627e0db1-6054-4c17-ba8d-8da0082f1944 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:58.816373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-627e0db1-6054-4c17-ba8d-8da0082f1944 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:58.817476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-627e0db1-6054-4c17-ba8d-8da0082f1944 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:58.818023 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5f8955e9-ff92-400a-831d-76f86ff8322e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1339 microversion: 2.1 time: 0.268631 Oct 11 04:10:58.818357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-627e0db1-6054-4c17-ba8d-8da0082f1944 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:58.819133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-627e0db1-6054-4c17-ba8d-8da0082f1944 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:58.820304 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 61/124] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:58 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1339 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:10:59.006109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-627e0db1-6054-4c17-ba8d-8da0082f1944 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:10:59.014061 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-627e0db1-6054-4c17-ba8d-8da0082f1944 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.217088 Oct 11 04:10:59.015115 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 64/125] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:58 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:10:59.377485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-1917170035", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "54296184", "adminPass": "***", "networks": [{"uuid": "4edb5971-f6e7-4813-8c41-2b84d65bce36"}], "security_groups": [{"name": "tempest-securitygroup--167793482"}], "key_name": "tempest-keypair-2042032906", "user_data": "}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:10:59.568112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] validate_networks() for [('4edb5971-f6e7-4813-8c41-2b84d65bce36', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:10:59.848421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0f416808-cca7-453e-aaf0-dddd570dac71 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:10:59.849753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0f416808-cca7-453e-aaf0-dddd570dac71 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:10:59.856504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f416808-cca7-453e-aaf0-dddd570dac71 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:59.857217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f416808-cca7-453e-aaf0-dddd570dac71 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:59.857859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f416808-cca7-453e-aaf0-dddd570dac71 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:10:59.858834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f416808-cca7-453e-aaf0-dddd570dac71 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:10:59.860173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f416808-cca7-453e-aaf0-dddd570dac71 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:10:59.860872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f416808-cca7-453e-aaf0-dddd570dac71 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:00.060512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0f416808-cca7-453e-aaf0-dddd570dac71 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:00.074138 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0f416808-cca7-453e-aaf0-dddd570dac71 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1339 microversion: 2.1 time: 0.227191 Oct 11 04:11:00.088699 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 65/126] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:10:59 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1339 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:00.095028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-383338e5-7ab0-4db1-8cda-ce3422e54c28 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:00.095844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-383338e5-7ab0-4db1-8cda-ce3422e54c28 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:00.103029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383338e5-7ab0-4db1-8cda-ce3422e54c28 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:00.103724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383338e5-7ab0-4db1-8cda-ce3422e54c28 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:00.104312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383338e5-7ab0-4db1-8cda-ce3422e54c28 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:00.105616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383338e5-7ab0-4db1-8cda-ce3422e54c28 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:00.106766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383338e5-7ab0-4db1-8cda-ce3422e54c28 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:00.107207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383338e5-7ab0-4db1-8cda-ce3422e54c28 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:00.285281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-383338e5-7ab0-4db1-8cda-ce3422e54c28 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:00.287465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:00.293702 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-383338e5-7ab0-4db1-8cda-ce3422e54c28 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.204576 Oct 11 04:11:00.294396 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 66/127] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:00 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:00.802746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:11:00.803495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:11:00.804323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:11:00.804859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:11:00.805376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:11:00.828731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:00.832342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:00.832342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:00.832342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:00.832610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:00.832610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:00.857874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Getting quotas for project 49ed194cff9c4482a96dff268602479a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:00.863613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Getting quotas for user 28240e25179b447781e0e351c659c065 and project 49ed194cff9c4482a96dff268602479a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:00.875818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:11:00.878864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:11:01.009085 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-862db68d-e422-4399-a869-b969b2738f99 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.636611 Oct 11 04:11:01.010528 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 62/128] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:10:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1639 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:11:01.023714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c557353b-0229-4ad7-b39a-1ad22c30a7aa tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:01.026216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c557353b-0229-4ad7-b39a-1ad22c30a7aa tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:01.098761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00dcdb0b-9021-437e-aea5-5865b159fc4a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:01.099378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00dcdb0b-9021-437e-aea5-5865b159fc4a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:01.106852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00dcdb0b-9021-437e-aea5-5865b159fc4a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:01.109071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00dcdb0b-9021-437e-aea5-5865b159fc4a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:01.109071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00dcdb0b-9021-437e-aea5-5865b159fc4a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:01.109071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00dcdb0b-9021-437e-aea5-5865b159fc4a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:01.110210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00dcdb0b-9021-437e-aea5-5865b159fc4a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:01.110720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00dcdb0b-9021-437e-aea5-5865b159fc4a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:01.161920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c557353b-0229-4ad7-b39a-1ad22c30a7aa tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:01.170691 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c557353b-0229-4ad7-b39a-1ad22c30a7aa tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1261 microversion: 2.1 time: 0.152661 Oct 11 04:11:01.186809 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 67/129] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:01 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:01.265690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-00dcdb0b-9021-437e-aea5-5865b159fc4a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:01.274284 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00dcdb0b-9021-437e-aea5-5865b159fc4a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1339 microversion: 2.1 time: 0.180517 Oct 11 04:11:01.274913 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 63/130] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:01 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1339 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:01.318317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-265d16b2-6ea5-40b0-9782-7876ab8c0036 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:01.318928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-265d16b2-6ea5-40b0-9782-7876ab8c0036 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:01.326924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265d16b2-6ea5-40b0-9782-7876ab8c0036 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:01.327622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265d16b2-6ea5-40b0-9782-7876ab8c0036 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:01.328335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265d16b2-6ea5-40b0-9782-7876ab8c0036 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:01.329031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265d16b2-6ea5-40b0-9782-7876ab8c0036 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:01.329487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265d16b2-6ea5-40b0-9782-7876ab8c0036 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:01.329910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265d16b2-6ea5-40b0-9782-7876ab8c0036 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:01.484964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-265d16b2-6ea5-40b0-9782-7876ab8c0036 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:01.493810 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-265d16b2-6ea5-40b0-9782-7876ab8c0036 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.180777 Oct 11 04:11:01.494697 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 64/131] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:01 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:01.888988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-29c6c533-e412-4f81-8055-c13d780e2320 req-a9b71919-5670-4929-8aba-26ab9dfd207e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b18dcce-1cfa-415c-9f84-3606760a55aa", "name": "network-vif-plugged", "status": "completed", "tag": "ea239d09-e9de-4b7e-809f-3a511d3dfc72"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:01.900444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-29c6c533-e412-4f81-8055-c13d780e2320 req-a9b71919-5670-4929-8aba-26ab9dfd207e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:01.901240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-29c6c533-e412-4f81-8055-c13d780e2320 req-a9b71919-5670-4929-8aba-26ab9dfd207e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:01.901901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-29c6c533-e412-4f81-8055-c13d780e2320 req-a9b71919-5670-4929-8aba-26ab9dfd207e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:01.922533 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-29c6c533-e412-4f81-8055-c13d780e2320 req-a9b71919-5670-4929-8aba-26ab9dfd207e service nova] Creating event network-vif-plugged:ea239d09-e9de-4b7e-809f-3a511d3dfc72 for instance 2b18dcce-1cfa-415c-9f84-3606760a55aa on n-h2-860892-1 Oct 11 04:11:01.930232 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-29c6c533-e412-4f81-8055-c13d780e2320 req-a9b71919-5670-4929-8aba-26ab9dfd207e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.635264 Oct 11 04:11:01.935930 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 68/132] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:02.197335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5b067689-4aed-4899-8fce-e68de78c120c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:02.198786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5b067689-4aed-4899-8fce-e68de78c120c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:02.260580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5b067689-4aed-4899-8fce-e68de78c120c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:02.268651 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5b067689-4aed-4899-8fce-e68de78c120c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1261 microversion: 2.1 time: 0.075758 Oct 11 04:11:02.285667 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 65/133] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:02 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1261 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:02.298142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2379f1a1-49e1-4b65-bd24-c5053ce57e5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:02.298865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2379f1a1-49e1-4b65-bd24-c5053ce57e5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:02.305585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2379f1a1-49e1-4b65-bd24-c5053ce57e5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:02.306063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2379f1a1-49e1-4b65-bd24-c5053ce57e5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:02.306536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2379f1a1-49e1-4b65-bd24-c5053ce57e5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:02.307399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2379f1a1-49e1-4b65-bd24-c5053ce57e5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:02.307854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2379f1a1-49e1-4b65-bd24-c5053ce57e5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:02.308282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2379f1a1-49e1-4b65-bd24-c5053ce57e5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:02.520252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3bb3440f-b7b8-42e6-8874-82c2e9db44ff tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:02.521053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3bb3440f-b7b8-42e6-8874-82c2e9db44ff tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:02.547509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb3440f-b7b8-42e6-8874-82c2e9db44ff tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:02.548379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb3440f-b7b8-42e6-8874-82c2e9db44ff tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:02.549967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb3440f-b7b8-42e6-8874-82c2e9db44ff tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:02.552506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb3440f-b7b8-42e6-8874-82c2e9db44ff tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:02.553219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb3440f-b7b8-42e6-8874-82c2e9db44ff tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:02.554182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb3440f-b7b8-42e6-8874-82c2e9db44ff tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:02.559477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2379f1a1-49e1-4b65-bd24-c5053ce57e5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:02.571187 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2379f1a1-49e1-4b65-bd24-c5053ce57e5a tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1339 microversion: 2.1 time: 0.274290 Oct 11 04:11:02.573418 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 69/134] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:02 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1339 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:02.797243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3bb3440f-b7b8-42e6-8874-82c2e9db44ff tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:02.826983 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3bb3440f-b7b8-42e6-8874-82c2e9db44ff tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.297402 Oct 11 04:11:02.827626 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 66/135] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:02 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:03.112867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Calling method '.version_select at 0x7fda1ad83940>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:03.127327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),7f919055-bb4c-4077-93f0-960b402ab88d(cell1) {{(pid=120994) load_cells /opt/stack/nova/nova/compute/api.py:319}} Oct 11 04:11:03.128065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.128555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.128973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.146995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.147481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.148137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.186606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.187271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.191612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.198415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.198901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.199337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.219428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.219915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.220478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.222052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-000c0e7a-3a14-4310-a1ae-a0e8c2fcd67d tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Action: 'create', calling method: .version_select at 0x7fda1aa2dd30>, body: {"keypair": {"name": "tempest-keypair-2022730462", "type": "ssh", "user_id": "c743f65ea30946a88c1eb56a1a162a63", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBu2azfjViiBo96Hh+HGTuNwYiSs0i0/zsZymVBLSrTVCWMTo99XztDPMsHxiGHBda2Ug5qlzATrh4rfsGVWh/F4QMqa6FC5tUphWYw+lQzzzwz5CPKH3MTmfPs485NroQ=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:03.226779 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-65e67998-826c-4757-b028-fbccd0fad137 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail?with_servers=True" status: 200 len: 1836 microversion: 2.53 time: 0.651479 Oct 11 04:11:03.227683 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 70/136] 10.222.0.26 () {60 vars in 1243 bytes} [Tue Oct 11 04:11:02 2022] GET /compute/v2.1/os-hypervisors/detail?with_servers=True => generated 1836 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:11:03.238009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-000c0e7a-3a14-4310-a1ae-a0e8c2fcd67d tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Getting quotas for project 7aa643c23ad64732b6836179da8b6064. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:03.242046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-000c0e7a-3a14-4310-a1ae-a0e8c2fcd67d tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Getting quotas for user fc278be1cb324ab980250593ac18195b and project 7aa643c23ad64732b6836179da8b6064. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:03.245146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Calling method '.version_select at 0x7fda1a9d35e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:03.249215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.249696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.250900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.266290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.271502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.271502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.288691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.289270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.289714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.300517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.301536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.301536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.321053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.321661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.322103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.328735 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-86388d0e-261f-4065-9494-4215c6c74d84 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors?with_servers=True" status: 200 len: 528 microversion: 2.53 time: 0.086948 Oct 11 04:11:03.329312 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 71/137] 10.222.0.26 () {60 vars in 1222 bytes} [Tue Oct 11 04:11:03 2022] GET /compute/v2.1/os-hypervisors?with_servers=True => generated 528 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:11:03.340989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7487da28-071b-493c-aeb1-440e2740604c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:03.341531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7487da28-071b-493c-aeb1-440e2740604c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:03.344850 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-000c0e7a-3a14-4310-a1ae-a0e8c2fcd67d tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.10 time: 0.249173 Oct 11 04:11:03.345913 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 67/138] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 11 04:11:03 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 251 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 04:11:03.347516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7487da28-071b-493c-aeb1-440e2740604c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.352043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7487da28-071b-493c-aeb1-440e2740604c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.352043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7487da28-071b-493c-aeb1-440e2740604c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.352043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7487da28-071b-493c-aeb1-440e2740604c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.352347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7487da28-071b-493c-aeb1-440e2740604c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.352347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7487da28-071b-493c-aeb1-440e2740604c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.352529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57e6c8fb-588f-4c6e-a2a3-f3a1dfaefb28 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Calling method '.version_select at 0x7fda1aa3d550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:03.355729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57e6c8fb-588f-4c6e-a2a3-f3a1dfaefb28 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.356222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57e6c8fb-588f-4c6e-a2a3-f3a1dfaefb28 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.356655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57e6c8fb-588f-4c6e-a2a3-f3a1dfaefb28 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.378216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57e6c8fb-588f-4c6e-a2a3-f3a1dfaefb28 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.378984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57e6c8fb-588f-4c6e-a2a3-f3a1dfaefb28 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.379638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57e6c8fb-588f-4c6e-a2a3-f3a1dfaefb28 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.387986 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-57e6c8fb-588f-4c6e-a2a3-f3a1dfaefb28 tempest-HypervisorAdminV253TestBase-868739755 tempest-HypervisorAdminV253TestBase-868739755-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/35297d3b-ab90-48e7-a0de-f57c54ebd16f" status: 200 len: 792 microversion: 2.53 time: 0.040732 Oct 11 04:11:03.389064 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 68/139] 10.222.0.26 () {60 vars in 1298 bytes} [Tue Oct 11 04:11:03 2022] GET /compute/v2.1/os-hypervisors/35297d3b-ab90-48e7-a0de-f57c54ebd16f => generated 792 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:11:03.396203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16314777-7553-44ff-8a99-7ba70abd2cb7 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Action: 'create', calling method: .version_select at 0x7fda1a9b73a0>, body: {"keypair": {"name": "tempest-keypair-227933745", "type": "ssh", "user_id": "c743f65ea30946a88c1eb56a1a162a63", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbiwjJbfjnLr7PxOHCPcuHxQ1bvCl3scLkGAp2qQNuaJGLHYnwczvGa/o2qIaiU3y56ti3fmko8Hz9edLgwFm6RiMJpJSGu/eoAnp1Cv3dqCM+bYXYUpXv6RNSnrZHNXQ=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:03.416375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-16314777-7553-44ff-8a99-7ba70abd2cb7 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Getting quotas for project 7aa643c23ad64732b6836179da8b6064. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:03.422578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-16314777-7553-44ff-8a99-7ba70abd2cb7 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Getting quotas for user fc278be1cb324ab980250593ac18195b and project 7aa643c23ad64732b6836179da8b6064. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:03.427043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:03.437116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7487da28-071b-493c-aeb1-440e2740604c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:03.445515 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7487da28-071b-493c-aeb1-440e2740604c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1313 microversion: 2.1 time: 0.108161 Oct 11 04:11:03.446615 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 72/140] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:03 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1313 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:03.520255 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-16314777-7553-44ff-8a99-7ba70abd2cb7 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.10 time: 0.116607 Oct 11 04:11:03.528624 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 69/141] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 11 04:11:03 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 138 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 04:11:03.532602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f201f2f4-8088-4e02-b2e1-677598728740 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Calling method '.version_select at 0x7fda1aac9280>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:03.545922 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f201f2f4-8088-4e02-b2e1-677598728740 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-2022730462?user_id=c743f65ea30946a88c1eb56a1a162a63" status: 200 len: 512 microversion: 2.10 time: 0.017873 Oct 11 04:11:03.546550 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 73/142] 10.222.0.26 () {60 vars in 1340 bytes} [Tue Oct 11 04:11:03 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2022730462?user_id=c743f65ea30946a88c1eb56a1a162a63 => generated 512 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:11:03.561348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9fc36082-c6d3-4ae6-a23b-02b6fec3d8a7 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Action: 'create', calling method: .version_select at 0x7fda1a9c9af0>, body: {"keypair": {"name": "tempest-KeyPairsV210TestJSON-keypair-563571585", "type": "ssh", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyznONj+f359NJ1cAo5LMii01/mpIx69BJ31B8LE3DBsgJgSlTV7eXevUUO9B3i+Lu1aVoTJLXfwGXYXEV1DWNFmj3rwMzvs0K3NyjzZaNMnPbZMe3t1f7O5roH8uNl+w=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:03.577988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-9fc36082-c6d3-4ae6-a23b-02b6fec3d8a7 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Getting quotas for project 7aa643c23ad64732b6836179da8b6064. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:03.581953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-9fc36082-c6d3-4ae6-a23b-02b6fec3d8a7 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Getting quotas for user fc278be1cb324ab980250593ac18195b and project 7aa643c23ad64732b6836179da8b6064. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:03.604040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-08b9dc24-b2e3-4e2b-a903-6932d2de0848 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:03.605579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-08b9dc24-b2e3-4e2b-a903-6932d2de0848 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:03.624481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08b9dc24-b2e3-4e2b-a903-6932d2de0848 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.625149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08b9dc24-b2e3-4e2b-a903-6932d2de0848 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.625634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08b9dc24-b2e3-4e2b-a903-6932d2de0848 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.627243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08b9dc24-b2e3-4e2b-a903-6932d2de0848 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.627903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08b9dc24-b2e3-4e2b-a903-6932d2de0848 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.629746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08b9dc24-b2e3-4e2b-a903-6932d2de0848 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.648134 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9fc36082-c6d3-4ae6-a23b-02b6fec3d8a7 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.10 time: 0.090618 Oct 11 04:11:03.648733 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 70/143] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 11 04:11:03 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 92 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 04:11:03.663774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2418098e-4a50-4c3c-a61e-b605444c092a tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Calling method '.version_select at 0x7fda1aa0c790>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:03.668116 n-d-860892-1 devstack@n-api.service[120993]: WARNING oslo_db.sqlalchemy.utils [None req-2418098e-4a50-4c3c-a61e-b605444c092a tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 04:11:03.682445 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2418098e-4a50-4c3c-a61e-b605444c092a tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] 10.222.0.26 "GET /compute/v2.1/os-keypairs?user_id=c743f65ea30946a88c1eb56a1a162a63" status: 200 len: 725 microversion: 2.10 time: 0.022512 Oct 11 04:11:03.690051 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 71/144] 10.222.0.26 () {60 vars in 1259 bytes} [Tue Oct 11 04:11:03 2022] GET /compute/v2.1/os-keypairs?user_id=c743f65ea30946a88c1eb56a1a162a63 => generated 725 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:11:03.695167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f115aff5-4bc3-466a-8d33-95708c60592f tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Calling method '.version_select at 0x7fda1a9c6550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:03.785065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-08b9dc24-b2e3-4e2b-a903-6932d2de0848 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:03.793694 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-08b9dc24-b2e3-4e2b-a903-6932d2de0848 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1339 microversion: 2.1 time: 0.200656 Oct 11 04:11:03.801224 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 74/145] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:03 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1339 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:03.830159 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f115aff5-4bc3-466a-8d33-95708c60592f tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-563571585" status: 204 len: 0 microversion: 2.10 time: 0.138706 Oct 11 04:11:03.834268 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 72/146] 10.222.0.26 () {60 vars in 1322 bytes} [Tue Oct 11 04:11:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV210TestJSON-keypair-563571585 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:11:03.839339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc85f63e-0701-4af3-9dd8-885f9ef769f6 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Calling method '.version_select at 0x7fda1ad18b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:03.850859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f9faa2ce-d889-4cac-8570-e251e28334cd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:03.851526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f9faa2ce-d889-4cac-8570-e251e28334cd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:03.858049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9faa2ce-d889-4cac-8570-e251e28334cd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.858510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9faa2ce-d889-4cac-8570-e251e28334cd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.859074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9faa2ce-d889-4cac-8570-e251e28334cd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.860357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9faa2ce-d889-4cac-8570-e251e28334cd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:03.860850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9faa2ce-d889-4cac-8570-e251e28334cd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:03.861357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9faa2ce-d889-4cac-8570-e251e28334cd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:03.933462 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bc85f63e-0701-4af3-9dd8-885f9ef769f6 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-227933745?user_id=c743f65ea30946a88c1eb56a1a162a63" status: 204 len: 0 microversion: 2.10 time: 0.097932 Oct 11 04:11:03.938791 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 75/147] 10.222.0.26 () {60 vars in 1340 bytes} [Tue Oct 11 04:11:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-227933745?user_id=c743f65ea30946a88c1eb56a1a162a63 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 04:11:03.944658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fc411390-1c9d-4d4f-bed5-76c50d5237a5 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] Calling method '.version_select at 0x7fda1a9d3940>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:04.053491 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fc411390-1c9d-4d4f-bed5-76c50d5237a5 tempest-KeyPairsV210TestJSON-1291540024 tempest-KeyPairsV210TestJSON-1291540024-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022730462?user_id=c743f65ea30946a88c1eb56a1a162a63" status: 204 len: 0 microversion: 2.10 time: 0.113258 Oct 11 04:11:04.054686 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 76/148] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:11:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022730462?user_id=c743f65ea30946a88c1eb56a1a162a63 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:11:04.061451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-337a5eaf-b1eb-4b77-a51f-d5e0d5ddb31e req-d5e3ecdc-df94-42fd-b148-b4f9fcf8a21f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57379b24-c543-4dbc-84f9-0e1a11e2b20f", "name": "network-vif-plugged", "status": "completed", "tag": "471fca83-47be-452f-976c-d972af6446c2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:04.072783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-337a5eaf-b1eb-4b77-a51f-d5e0d5ddb31e req-d5e3ecdc-df94-42fd-b148-b4f9fcf8a21f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:04.073468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-337a5eaf-b1eb-4b77-a51f-d5e0d5ddb31e req-d5e3ecdc-df94-42fd-b148-b4f9fcf8a21f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:04.074082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-337a5eaf-b1eb-4b77-a51f-d5e0d5ddb31e req-d5e3ecdc-df94-42fd-b148-b4f9fcf8a21f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:04.086432 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-337a5eaf-b1eb-4b77-a51f-d5e0d5ddb31e req-d5e3ecdc-df94-42fd-b148-b4f9fcf8a21f service nova] Creating event network-vif-plugged:471fca83-47be-452f-976c-d972af6446c2 for instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f on n-h2-860892-1 Oct 11 04:11:04.091890 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-337a5eaf-b1eb-4b77-a51f-d5e0d5ddb31e req-d5e3ecdc-df94-42fd-b148-b4f9fcf8a21f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035746 Oct 11 04:11:04.092704 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 77/149] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:04.096771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f9faa2ce-d889-4cac-8570-e251e28334cd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:04.111336 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f9faa2ce-d889-4cac-8570-e251e28334cd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1341 microversion: 2.1 time: 0.261801 Oct 11 04:11:04.111336 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 73/150] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:03 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1341 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:04.477154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7fb41bb7-a08f-469f-9105-93fd1a707336 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:04.479522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7fb41bb7-a08f-469f-9105-93fd1a707336 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:04.503148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fb41bb7-a08f-469f-9105-93fd1a707336 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:04.504959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fb41bb7-a08f-469f-9105-93fd1a707336 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:04.505857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fb41bb7-a08f-469f-9105-93fd1a707336 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:04.507180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fb41bb7-a08f-469f-9105-93fd1a707336 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:04.509026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fb41bb7-a08f-469f-9105-93fd1a707336 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:04.509687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fb41bb7-a08f-469f-9105-93fd1a707336 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:04.596783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9bdc86a4-415f-42f5-bc72-28fdc910dccb tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Calling method '.version_select at 0x7fda1a9c2af0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:04.603425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bdc86a4-415f-42f5-bc72-28fdc910dccb tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:04.605654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bdc86a4-415f-42f5-bc72-28fdc910dccb tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:04.606090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bdc86a4-415f-42f5-bc72-28fdc910dccb tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:04.637862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bdc86a4-415f-42f5-bc72-28fdc910dccb tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:04.638639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bdc86a4-415f-42f5-bc72-28fdc910dccb tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:04.639312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bdc86a4-415f-42f5-bc72-28fdc910dccb tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:04.661611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7fb41bb7-a08f-469f-9105-93fd1a707336 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:04.668950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bdc86a4-415f-42f5-bc72-28fdc910dccb tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:04.669786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bdc86a4-415f-42f5-bc72-28fdc910dccb tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:04.671019 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7fb41bb7-a08f-469f-9105-93fd1a707336 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1319 microversion: 2.1 time: 0.197975 Oct 11 04:11:04.671177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bdc86a4-415f-42f5-bc72-28fdc910dccb tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:04.675361 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 74/151] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:04 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:04.694948 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9bdc86a4-415f-42f5-bc72-28fdc910dccb tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.496582 Oct 11 04:11:04.696450 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 78/152] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:04 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:05.062169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12a3e550-d452-4221-bd94-cf71df6177a3 tempest-HypervisorAdminNegativeUnderV252Test-1848864575 tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project] Calling method '.version_select at 0x7fda1a9b7550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:05.065510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-12a3e550-d452-4221-bd94-cf71df6177a3 tempest-HypervisorAdminNegativeUnderV252Test-1848864575 tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project] Policy check for os_compute_api:os-hypervisors:search failed with credentials {'is_admin': False, 'user_id': 'f67240093e94481cbd671bfe2d1cf0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd080cf9589d14cef8890420194a13796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12a3e550-d452-4221-bd94-cf71df6177a3 tempest-HypervisorAdminNegativeUnderV252Test-1848864575 tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project] Request method failure captured: Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-hypervisors/n-h2-860892-1/search HTTP/1.1 Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzVdgV8ED8qaGIya9CjEe7aKM7YAFPscu8GLRD0-8zfUf8xtR2ccIpn6A90HhuzKGxkU1CPZIhfMODoMHt9nL8RDb3Gzve82fN_E7BgwjKEZvOxRv5jhpdR_2eveMP5tdjhd5a6x_MDy_gk0q7UR1Y2wljvnJaIAxMkOWXhbwoanB4 Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d080cf9589d14cef8890420194a13796 Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848864575 Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:05.069450 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d080cf9589d14cef8890420194a13796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d080cf9589d14cef8890420194a13796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d080cf9589d14cef8890420194a13796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d080cf9589d14cef8890420194a13796"}]}] Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1848864575 Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d080cf9589d14cef8890420194a13796 Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848864575 Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: f67240093e94481cbd671bfe2d1cf0b9 Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 04:11:05.070731 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'n-h2-860892-1'} Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 439, in search Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'search', target={}) Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:05.071456 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. Oct 11 04:11:05.072505 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:05.073466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12a3e550-d452-4221-bd94-cf71df6177a3 tempest-HypervisorAdminNegativeUnderV252Test-1848864575 tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:search to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:05.073466 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-12a3e550-d452-4221-bd94-cf71df6177a3 tempest-HypervisorAdminNegativeUnderV252Test-1848864575 tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h2-860892-1/search" status: 403 len: 117 microversion: 2.1 time: 0.347839 Oct 11 04:11:05.073466 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 75/153] 10.222.0.26 () {58 vars in 1209 bytes} [Tue Oct 11 04:11:04 2022] GET /compute/v2.1/os-hypervisors/n-h2-860892-1/search => generated 117 bytes in 349 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:05.085579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3623702d-307a-4632-af60-eec5980e852e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:05.088035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3623702d-307a-4632-af60-eec5980e852e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:05.136042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3623702d-307a-4632-af60-eec5980e852e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.136694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3623702d-307a-4632-af60-eec5980e852e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.137139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3623702d-307a-4632-af60-eec5980e852e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.137873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3623702d-307a-4632-af60-eec5980e852e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.138355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3623702d-307a-4632-af60-eec5980e852e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.138774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3623702d-307a-4632-af60-eec5980e852e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.296605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-1782232120", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:05.355629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:11:05.372765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3623702d-307a-4632-af60-eec5980e852e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:05.382362 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3623702d-307a-4632-af60-eec5980e852e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1339 microversion: 2.1 time: 0.309509 Oct 11 04:11:05.383272 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 76/154] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:05 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1339 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:05.389977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12dad391-6163-4658-aa41-afe460934b2b tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Calling method '.version_select at 0x7fda1a9c6280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:05.392853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12dad391-6163-4658-aa41-afe460934b2b tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.393566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12dad391-6163-4658-aa41-afe460934b2b tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.394220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12dad391-6163-4658-aa41-afe460934b2b tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.405744 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-12dad391-6163-4658-aa41-afe460934b2b tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] HTTP exception thrown: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12dad391-6163-4658-aa41-afe460934b2b tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Request method failure captured: Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search HTTP/1.1 Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzYSZmccsPuoMFJnBoOOWi-iqeOLfvtAGutNEf_mvJ33r_5lnMGAVnIPc-UPgQ6KTQL9N9-ac7KojTO99cQOB-1tsyTEYcfuJdfGVI75Vvxi0YTBJWfFTG8V8klt7lxTwWEk8PlFrfN4DGwP6jTqUsh-LkLCT-9aksA1LpZW1s-OCw Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: e42b7e6cd6c04d9c8f7c0df1686e2b15 Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1405857404 Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:11:05.408043 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e42b7e6cd6c04d9c8f7c0df1686e2b15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e42b7e6cd6c04d9c8f7c0df1686e2b15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e42b7e6cd6c04d9c8f7c0df1686e2b15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e42b7e6cd6c04d9c8f7c0df1686e2b15"}]}] Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1405857404 Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: e42b7e6cd6c04d9c8f7c0df1686e2b15 Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1405857404 Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: da814c06b625470dbbbad3ca750b4f18 Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: exception: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 04:11:05.409250 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'nonexistent_hypervisor_name'} Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 443, in search Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:05.409924 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:05.411015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:05.411015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:05.411015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:05.411015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching 'nonexistent_hypervisor_name' could be found. Oct 11 04:11:05.411015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:05.411015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12dad391-6163-4658-aa41-afe460934b2b tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Returning 404 to user: No hypervisor matching 'nonexistent_hypervisor_name' could be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:05.411015 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-12dad391-6163-4658-aa41-afe460934b2b tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search" status: 404 len: 114 microversion: 2.1 time: 0.025313 Oct 11 04:11:05.411015 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 77/155] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:11:05 2022] GET /compute/v2.1/os-hypervisors/nonexistent_hypervisor_name/search => generated 114 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:05.416673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4d66a25d-5fb7-4135-b61c-1852b752318d tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:05.417289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4d66a25d-5fb7-4135-b61c-1852b752318d tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:05.423815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d66a25d-5fb7-4135-b61c-1852b752318d tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.424324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d66a25d-5fb7-4135-b61c-1852b752318d tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.424768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d66a25d-5fb7-4135-b61c-1852b752318d tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.425596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d66a25d-5fb7-4135-b61c-1852b752318d tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.426079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d66a25d-5fb7-4135-b61c-1852b752318d tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.426600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d66a25d-5fb7-4135-b61c-1852b752318d tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.658303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:11:05.658969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:11:05.661388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:11:05.661388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:11:05.661388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:11:05.685778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.686297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.687262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.688449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.690562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.690999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.696596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4d66a25d-5fb7-4135-b61c-1852b752318d tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:05.705282 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4d66a25d-5fb7-4135-b61c-1852b752318d tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1491 microversion: 2.1 time: 0.293886 Oct 11 04:11:05.706074 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 78/156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:05 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1491 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:05.711409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:05.716107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ba336853-2bfd-41f2-af00-d6e3ce5c8eb4 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Calling method '.version_select at 0x7fda1aa0c790>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:05.718108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba336853-2bfd-41f2-af00-d6e3ce5c8eb4 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.719350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba336853-2bfd-41f2-af00-d6e3ce5c8eb4 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.720242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba336853-2bfd-41f2-af00-d6e3ce5c8eb4 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.724590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for user a1df373e8ec14e2a84f0b8a62e0b884a and project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:05.736611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba336853-2bfd-41f2-af00-d6e3ce5c8eb4 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.737104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:11:05.737445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba336853-2bfd-41f2-af00-d6e3ce5c8eb4 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.738026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba336853-2bfd-41f2-af00-d6e3ce5c8eb4 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.739555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:11:05.748539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba336853-2bfd-41f2-af00-d6e3ce5c8eb4 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.749003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba336853-2bfd-41f2-af00-d6e3ce5c8eb4 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.749426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba336853-2bfd-41f2-af00-d6e3ce5c8eb4 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.755424 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ba336853-2bfd-41f2-af00-d6e3ce5c8eb4 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.048131 Oct 11 04:11:05.756081 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 79/157] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:05 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:05.760779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62bdb243-b275-48d0-994a-a370a91a767f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:05.761371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-62bdb243-b275-48d0-994a-a370a91a767f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:05.767307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62bdb243-b275-48d0-994a-a370a91a767f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.767777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62bdb243-b275-48d0-994a-a370a91a767f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.768200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62bdb243-b275-48d0-994a-a370a91a767f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.768872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62bdb243-b275-48d0-994a-a370a91a767f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:05.769724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62bdb243-b275-48d0-994a-a370a91a767f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:05.770329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62bdb243-b275-48d0-994a-a370a91a767f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:05.929908 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d81d9841-919c-4299-b246-c066ad522b5d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.187277 Oct 11 04:11:05.933237 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 79/158] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:11:05.980224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62bdb243-b275-48d0-994a-a370a91a767f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:05.989088 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-62bdb243-b275-48d0-994a-a370a91a767f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.231992 Oct 11 04:11:06.005188 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 80/159] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:05 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:06.012120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a09672fc-753c-420f-9ece-b8cdd722b7cd tempest-HypervisorAdminNegativeUnderV252Test-1848864575 tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project] Calling method '.version_select at 0x7fda1a95d1f0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:06.014457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a09672fc-753c-420f-9ece-b8cdd722b7cd tempest-HypervisorAdminNegativeUnderV252Test-1848864575 tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project] Policy check for os_compute_api:os-hypervisors:servers failed with credentials {'is_admin': False, 'user_id': 'f67240093e94481cbd671bfe2d1cf0b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd080cf9589d14cef8890420194a13796', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a09672fc-753c-420f-9ece-b8cdd722b7cd tempest-HypervisorAdminNegativeUnderV252Test-1848864575 tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project] Request method failure captured: Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-hypervisors/1/servers HTTP/1.1 Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzVdgV8ED8qaGIya9CjEe7aKM7YAFPscu8GLRD0-8zfUf8xtR2ccIpn6A90HhuzKGxkU1CPZIhfMODoMHt9nL8RDb3Gzve82fN_E7BgwjKEZvOxRv5jhpdR_2eveMP5tdjhd5a6x_MDy_gk0q7UR1Y2wljvnJaIAxMkOWXhbwoanB4 Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d080cf9589d14cef8890420194a13796 Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848864575 Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:06.018607 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d080cf9589d14cef8890420194a13796"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d080cf9589d14cef8890420194a13796"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d080cf9589d14cef8890420194a13796"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d080cf9589d14cef8890420194a13796"}]}] Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1848864575 Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d080cf9589d14cef8890420194a13796 Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848864575 Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: f67240093e94481cbd671bfe2d1cf0b9 Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 04:11:06.019926 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1'} Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 478, in servers Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'servers', target={}) Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:06.020787 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. Oct 11 04:11:06.021851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:06.027747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a09672fc-753c-420f-9ece-b8cdd722b7cd tempest-HypervisorAdminNegativeUnderV252Test-1848864575 tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:servers to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:06.027747 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a09672fc-753c-420f-9ece-b8cdd722b7cd tempest-HypervisorAdminNegativeUnderV252Test-1848864575 tempest-HypervisorAdminNegativeUnderV252Test-1848864575-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/servers" status: 403 len: 118 microversion: 2.1 time: 0.017697 Oct 11 04:11:06.027747 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 81/160] 10.222.0.26 () {58 vars in 1176 bytes} [Tue Oct 11 04:11:06 2022] GET /compute/v2.1/os-hypervisors/1/servers => generated 118 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:06.032329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75e9a98a-b0e6-435c-bddc-71eee9ae0559 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:06.033143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-75e9a98a-b0e6-435c-bddc-71eee9ae0559 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:06.097283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75e9a98a-b0e6-435c-bddc-71eee9ae0559 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:06.107967 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-75e9a98a-b0e6-435c-bddc-71eee9ae0559 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1213 microversion: 2.1 time: 0.080770 Oct 11 04:11:06.107967 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 82/161] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:06 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:06.113580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dbaa238c-10f5-4b72-b420-c12623ef8e14 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Calling method '.version_select at 0x7fda1aa3d700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:06.115304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbaa238c-10f5-4b72-b420-c12623ef8e14 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:06.115933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbaa238c-10f5-4b72-b420-c12623ef8e14 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:06.116535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbaa238c-10f5-4b72-b420-c12623ef8e14 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:06.124405 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-dbaa238c-10f5-4b72-b420-c12623ef8e14 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] HTTP exception thrown: No hypervisor matching '29f83bda-9005-4046-8808-a7819e6d9743' could be found. Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dbaa238c-10f5-4b72-b420-c12623ef8e14 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Request method failure captured: Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-hypervisors/29f83bda-9005-4046-8808-a7819e6d9743/servers HTTP/1.1 Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzYSZmccsPuoMFJnBoOOWi-iqeOLfvtAGutNEf_mvJ33r_5lnMGAVnIPc-UPgQ6KTQL9N9-ac7KojTO99cQOB-1tsyTEYcfuJdfGVI75Vvxi0YTBJWfFTG8V8klt7lxTwWEk8PlFrfN4DGwP6jTqUsh-LkLCT-9aksA1LpZW1s-OCw Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: e42b7e6cd6c04d9c8f7c0df1686e2b15 Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-HypervisorAdminNegativeUnderV252Test-1405857404 Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:11:06.126912 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e42b7e6cd6c04d9c8f7c0df1686e2b15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e42b7e6cd6c04d9c8f7c0df1686e2b15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e42b7e6cd6c04d9c8f7c0df1686e2b15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e42b7e6cd6c04d9c8f7c0df1686e2b15"}]}] Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-HypervisorAdminNegativeUnderV252Test-1405857404 Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: e42b7e6cd6c04d9c8f7c0df1686e2b15 Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-HypervisorAdminNegativeUnderV252Test-1405857404 Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: da814c06b625470dbbbad3ca750b4f18 Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: exception: No hypervisor matching '29f83bda-9005-4046-8808-a7819e6d9743' could be found. Oct 11 04:11:06.128337 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '29f83bda-9005-4046-8808-a7819e6d9743'} Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 482, in servers Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi compute_nodes = self._get_compute_nodes_by_name_pattern(context, id) Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 139, in _get_compute_nodes_by_name_pattern Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: No hypervisor matching '29f83bda-9005-4046-8808-a7819e6d9743' could be found. Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:06.129050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:06.130418 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:06.130418 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:06.130418 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:06.130418 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:06.130418 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: No hypervisor matching '29f83bda-9005-4046-8808-a7819e6d9743' could be found. Oct 11 04:11:06.130418 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:06.130418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dbaa238c-10f5-4b72-b420-c12623ef8e14 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] Returning 404 to user: No hypervisor matching '29f83bda-9005-4046-8808-a7819e6d9743' could be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:06.130418 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dbaa238c-10f5-4b72-b420-c12623ef8e14 tempest-HypervisorAdminNegativeUnderV252Test-1405857404 tempest-HypervisorAdminNegativeUnderV252Test-1405857404-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/29f83bda-9005-4046-8808-a7819e6d9743/servers" status: 404 len: 123 microversion: 2.1 time: 0.019421 Oct 11 04:11:06.130418 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 83/162] 10.222.0.26 () {58 vars in 1281 bytes} [Tue Oct 11 04:11:06 2022] GET /compute/v2.1/os-hypervisors/29f83bda-9005-4046-8808-a7819e6d9743/servers => generated 123 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:06.284503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9475cbdf-abd4-4007-bbb1-04595f072850 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:06.284994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9475cbdf-abd4-4007-bbb1-04595f072850 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:06.291438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9475cbdf-abd4-4007-bbb1-04595f072850 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:06.291910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9475cbdf-abd4-4007-bbb1-04595f072850 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:06.292337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9475cbdf-abd4-4007-bbb1-04595f072850 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:06.293008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9475cbdf-abd4-4007-bbb1-04595f072850 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:06.293452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9475cbdf-abd4-4007-bbb1-04595f072850 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:06.293863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9475cbdf-abd4-4007-bbb1-04595f072850 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:06.369301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9475cbdf-abd4-4007-bbb1-04595f072850 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:11:06.408968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-def5f809-1051-4421-ab0f-38186e57bcae tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:06.409569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-def5f809-1051-4421-ab0f-38186e57bcae tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:06.417445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def5f809-1051-4421-ab0f-38186e57bcae tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:06.417924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def5f809-1051-4421-ab0f-38186e57bcae tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:06.418383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def5f809-1051-4421-ab0f-38186e57bcae tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:06.419450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def5f809-1051-4421-ab0f-38186e57bcae tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:06.419589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def5f809-1051-4421-ab0f-38186e57bcae tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:06.419906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def5f809-1051-4421-ab0f-38186e57bcae tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:06.598719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-def5f809-1051-4421-ab0f-38186e57bcae tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:06.608154 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-def5f809-1051-4421-ab0f-38186e57bcae tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1488 microversion: 2.1 time: 0.203447 Oct 11 04:11:06.609286 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 84/163] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:06 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1488 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:06.635398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c3cb1cc9-8476-4887-a121-7a13be383fd0 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:06.636085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c3cb1cc9-8476-4887-a121-7a13be383fd0 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:06.642655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c3cb1cc9-8476-4887-a121-7a13be383fd0 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:06.643362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c3cb1cc9-8476-4887-a121-7a13be383fd0 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:06.643944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c3cb1cc9-8476-4887-a121-7a13be383fd0 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:06.644823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c3cb1cc9-8476-4887-a121-7a13be383fd0 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:06.645884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c3cb1cc9-8476-4887-a121-7a13be383fd0 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:06.646497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c3cb1cc9-8476-4887-a121-7a13be383fd0 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:06.789533 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9475cbdf-abd4-4007-bbb1-04595f072850 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 204 len: 0 microversion: 2.1 time: 0.854728 Oct 11 04:11:06.790165 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 80/164] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:11:05 2022] DELETE /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 0 bytes in 856 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:11:06.799144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b1661c7-eaad-453f-9000-b552715fb69e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:06.800046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b1661c7-eaad-453f-9000-b552715fb69e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:06.806836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1661c7-eaad-453f-9000-b552715fb69e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:06.807325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1661c7-eaad-453f-9000-b552715fb69e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:06.807913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1661c7-eaad-453f-9000-b552715fb69e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:06.808612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1661c7-eaad-453f-9000-b552715fb69e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:06.809055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1661c7-eaad-453f-9000-b552715fb69e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:06.809486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1661c7-eaad-453f-9000-b552715fb69e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:07.011689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b1661c7-eaad-453f-9000-b552715fb69e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:07.022476 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b1661c7-eaad-453f-9000-b552715fb69e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1497 microversion: 2.1 time: 0.227943 Oct 11 04:11:07.038576 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 81/165] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:06 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1497 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:07.045050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b37afc7f-ac9f-412d-b1da-b7d4006c3a6b tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:07.045659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b37afc7f-ac9f-412d-b1da-b7d4006c3a6b tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:07.048281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:07.054013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37afc7f-ac9f-412d-b1da-b7d4006c3a6b tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:07.054600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37afc7f-ac9f-412d-b1da-b7d4006c3a6b tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:07.055026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37afc7f-ac9f-412d-b1da-b7d4006c3a6b tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:07.055706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37afc7f-ac9f-412d-b1da-b7d4006c3a6b tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:07.056146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37afc7f-ac9f-412d-b1da-b7d4006c3a6b tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:07.056555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37afc7f-ac9f-412d-b1da-b7d4006c3a6b tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:07.165358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:07.165980 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c3cb1cc9-8476-4887-a121-7a13be383fd0 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1639 microversion: 2.1 time: 0.534667 Oct 11 04:11:07.181880 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 85/166] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:06 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1639 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:07.181880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f241c43-ce1f-46e5-8efb-cd50e8304c5c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:07.181880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3f241c43-ce1f-46e5-8efb-cd50e8304c5c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:07.221293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b37afc7f-ac9f-412d-b1da-b7d4006c3a6b tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:07.232782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3f241c43-ce1f-46e5-8efb-cd50e8304c5c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:07.239527 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b37afc7f-ac9f-412d-b1da-b7d4006c3a6b tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.199595 Oct 11 04:11:07.240362 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 82/167] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:07 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:07.245636 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3f241c43-ce1f-46e5-8efb-cd50e8304c5c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1213 microversion: 2.1 time: 0.077948 Oct 11 04:11:07.248096 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 86/168] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:07 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1213 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:07.262283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-051fbe15-01ae-4fda-80ff-b9e598a76ac3 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:07.263316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-051fbe15-01ae-4fda-80ff-b9e598a76ac3 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:07.271643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-051fbe15-01ae-4fda-80ff-b9e598a76ac3 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:07.272118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-051fbe15-01ae-4fda-80ff-b9e598a76ac3 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:07.272653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-051fbe15-01ae-4fda-80ff-b9e598a76ac3 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:07.273404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-051fbe15-01ae-4fda-80ff-b9e598a76ac3 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:07.273846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-051fbe15-01ae-4fda-80ff-b9e598a76ac3 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:07.274355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-051fbe15-01ae-4fda-80ff-b9e598a76ac3 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:07.304245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-051fbe15-01ae-4fda-80ff-b9e598a76ac3 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:11:07.464549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:07.617992 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-051fbe15-01ae-4fda-80ff-b9e598a76ac3 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 204 len: 0 microversion: 2.1 time: 0.376083 Oct 11 04:11:07.618671 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 83/169] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:11:07 2022] DELETE /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 0 bytes in 378 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:11:07.635504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c04c0ef3-2d19-48b6-b015-b885e327490e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:07.636459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c04c0ef3-2d19-48b6-b015-b885e327490e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:07.648783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c04c0ef3-2d19-48b6-b015-b885e327490e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:07.652606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c04c0ef3-2d19-48b6-b015-b885e327490e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:07.661523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c04c0ef3-2d19-48b6-b015-b885e327490e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:07.661523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c04c0ef3-2d19-48b6-b015-b885e327490e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:07.661523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c04c0ef3-2d19-48b6-b015-b885e327490e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:07.661523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c04c0ef3-2d19-48b6-b015-b885e327490e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:07.824624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9a20f6b-d7aa-43d8-a76b-48a4d36206fb tempest-FlavorMetadataValidation-1683888313 tempest-FlavorMetadataValidation-1683888313-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_validate_metadata_-1962306355", "id": 1458304010, "os-flavor-access:is_public": "True"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:07.868304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c04c0ef3-2d19-48b6-b015-b885e327490e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:07.877331 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c04c0ef3-2d19-48b6-b015-b885e327490e tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1494 microversion: 2.1 time: 0.253920 Oct 11 04:11:07.878214 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 84/170] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:07 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1494 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:07.946696 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9a20f6b-d7aa-43d8-a76b-48a4d36206fb tempest-FlavorMetadataValidation-1683888313 tempest-FlavorMetadataValidation-1683888313-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 471 microversion: 2.86 time: 0.349260 Oct 11 04:11:07.959514 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 87/171] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:11:07 2022] POST /compute/v2.1/flavors => generated 471 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:11:07.962810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3e4e99e1-ad7e-4f2a-ae9e-ac04b74b6804 tempest-FlavorMetadataValidation-1683888313 tempest-FlavorMetadataValidation-1683888313-project-admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw:cpu_policy": "shared", "foo:bar": "baz"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:08.052488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f7a0a69-07ac-4f86-91b6-80f8dab19d88 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:08.054043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9f7a0a69-07ac-4f86-91b6-80f8dab19d88 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:08.065659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f7a0a69-07ac-4f86-91b6-80f8dab19d88 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:08.068783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f7a0a69-07ac-4f86-91b6-80f8dab19d88 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:08.069239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f7a0a69-07ac-4f86-91b6-80f8dab19d88 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:08.071175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f7a0a69-07ac-4f86-91b6-80f8dab19d88 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:08.071631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f7a0a69-07ac-4f86-91b6-80f8dab19d88 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:08.072927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f7a0a69-07ac-4f86-91b6-80f8dab19d88 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:08.239355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9f7a0a69-07ac-4f86-91b6-80f8dab19d88 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:08.249137 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9f7a0a69-07ac-4f86-91b6-80f8dab19d88 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1497 microversion: 2.1 time: 0.202208 Oct 11 04:11:08.249826 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 88/172] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:08 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:08.267455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b208bd6-5cd1-4d76-94ec-d360bfb394d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:08.268063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b208bd6-5cd1-4d76-94ec-d360bfb394d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:08.274495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b208bd6-5cd1-4d76-94ec-d360bfb394d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:08.277002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b208bd6-5cd1-4d76-94ec-d360bfb394d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:08.277002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b208bd6-5cd1-4d76-94ec-d360bfb394d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:08.277002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b208bd6-5cd1-4d76-94ec-d360bfb394d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:08.277258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b208bd6-5cd1-4d76-94ec-d360bfb394d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:08.277258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b208bd6-5cd1-4d76-94ec-d360bfb394d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:08.288950 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3e4e99e1-ad7e-4f2a-ae9e-ac04b74b6804 tempest-FlavorMetadataValidation-1683888313 tempest-FlavorMetadataValidation-1683888313-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1458304010/os-extra_specs" status: 200 len: 62 microversion: 2.86 time: 0.330359 Oct 11 04:11:08.295544 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 85/173] 10.222.0.26 () {62 vars in 1265 bytes} [Tue Oct 11 04:11:07 2022] POST /compute/v2.1/flavors/1458304010/os-extra_specs => generated 62 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:08.311826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3930e10a-16a4-479e-bc83-50776741f9a3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:08.313146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3930e10a-16a4-479e-bc83-50776741f9a3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:08.321720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3930e10a-16a4-479e-bc83-50776741f9a3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:08.322336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3930e10a-16a4-479e-bc83-50776741f9a3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:08.322654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3930e10a-16a4-479e-bc83-50776741f9a3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:08.326566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3930e10a-16a4-479e-bc83-50776741f9a3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:08.327235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3930e10a-16a4-479e-bc83-50776741f9a3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:08.330952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3930e10a-16a4-479e-bc83-50776741f9a3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:08.418682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3930e10a-16a4-479e-bc83-50776741f9a3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:08.426890 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3930e10a-16a4-479e-bc83-50776741f9a3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1217 microversion: 2.1 time: 0.129208 Oct 11 04:11:08.427472 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 86/174] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:08 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1217 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:08.434760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b208bd6-5cd1-4d76-94ec-d360bfb394d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:08.442677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bbc52103-ccc7-46a9-8ff5-9d2b6ce11b04 tempest-FlavorMetadataValidation-1683888313 tempest-FlavorMetadataValidation-1683888313-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:08.443119 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b208bd6-5cd1-4d76-94ec-d360bfb394d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.180177 Oct 11 04:11:08.446684 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 89/175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:08 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:08.532677 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bbc52103-ccc7-46a9-8ff5-9d2b6ce11b04 tempest-FlavorMetadataValidation-1683888313 tempest-FlavorMetadataValidation-1683888313-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1458304010" status: 202 len: 0 microversion: 2.86 time: 0.104032 Oct 11 04:11:08.533323 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 87/176] 10.222.0.26 () {60 vars in 1202 bytes} [Tue Oct 11 04:11:08 2022] DELETE /compute/v2.1/flavors/1458304010 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:11:08.542605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2e2eb7f4-d1f2-4bf8-9a97-913cbc00d4a7 tempest-FlavorMetadataValidation-1683888313 tempest-FlavorMetadataValidation-1683888313-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:08.564975 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2e2eb7f4-d1f2-4bf8-9a97-913cbc00d4a7 tempest-FlavorMetadataValidation-1683888313 tempest-FlavorMetadataValidation-1683888313-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6678 microversion: 2.86 time: 0.026078 Oct 11 04:11:08.565538 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 90/177] 10.222.0.26 () {60 vars in 1187 bytes} [Tue Oct 11 04:11:08 2022] GET /compute/v2.1/flavors/detail => generated 6678 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:11:08.906773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9c63afbc-356b-45b3-a771-c35547e482f9 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:08.907485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9c63afbc-356b-45b3-a771-c35547e482f9 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:08.915327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c63afbc-356b-45b3-a771-c35547e482f9 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:08.917772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c63afbc-356b-45b3-a771-c35547e482f9 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:08.917772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c63afbc-356b-45b3-a771-c35547e482f9 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:08.917772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c63afbc-356b-45b3-a771-c35547e482f9 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:08.917772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c63afbc-356b-45b3-a771-c35547e482f9 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:08.918105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c63afbc-356b-45b3-a771-c35547e482f9 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:09.056218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9c63afbc-356b-45b3-a771-c35547e482f9 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:09.065484 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9c63afbc-356b-45b3-a771-c35547e482f9 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1494 microversion: 2.1 time: 0.163538 Oct 11 04:11:09.066061 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 88/178] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:08 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1494 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:09.274245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b8f5216e-ccaf-4ece-8bfa-9fcf4e9281b7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:09.275433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b8f5216e-ccaf-4ece-8bfa-9fcf4e9281b7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:09.282788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f5216e-ccaf-4ece-8bfa-9fcf4e9281b7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:09.283280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f5216e-ccaf-4ece-8bfa-9fcf4e9281b7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:09.283769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f5216e-ccaf-4ece-8bfa-9fcf4e9281b7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:09.284595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f5216e-ccaf-4ece-8bfa-9fcf4e9281b7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:09.285499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f5216e-ccaf-4ece-8bfa-9fcf4e9281b7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:09.286037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f5216e-ccaf-4ece-8bfa-9fcf4e9281b7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:09.451403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b906a60-ef8c-41fe-a4e5-7001751c2a02 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:09.452038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b906a60-ef8c-41fe-a4e5-7001751c2a02 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:09.460684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b906a60-ef8c-41fe-a4e5-7001751c2a02 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:09.461713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b906a60-ef8c-41fe-a4e5-7001751c2a02 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:09.462656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b906a60-ef8c-41fe-a4e5-7001751c2a02 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:09.463754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b906a60-ef8c-41fe-a4e5-7001751c2a02 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:09.464358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b906a60-ef8c-41fe-a4e5-7001751c2a02 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:09.464968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b906a60-ef8c-41fe-a4e5-7001751c2a02 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:09.795136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9b906a60-ef8c-41fe-a4e5-7001751c2a02 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:09.816791 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b906a60-ef8c-41fe-a4e5-7001751c2a02 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1217 microversion: 2.1 time: 0.364120 Oct 11 04:11:09.819753 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 89/179] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:09 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1217 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:09.828935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c0fd778-5488-4da8-aa9c-bfcc4f1b65fd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:09.829736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2c0fd778-5488-4da8-aa9c-bfcc4f1b65fd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:09.840228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c0fd778-5488-4da8-aa9c-bfcc4f1b65fd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:09.840757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c0fd778-5488-4da8-aa9c-bfcc4f1b65fd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:09.841193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c0fd778-5488-4da8-aa9c-bfcc4f1b65fd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:09.841876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c0fd778-5488-4da8-aa9c-bfcc4f1b65fd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:09.842348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c0fd778-5488-4da8-aa9c-bfcc4f1b65fd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:09.842795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c0fd778-5488-4da8-aa9c-bfcc4f1b65fd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:09.856286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b8f5216e-ccaf-4ece-8bfa-9fcf4e9281b7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:09.867738 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b8f5216e-ccaf-4ece-8bfa-9fcf4e9281b7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1497 microversion: 2.1 time: 0.598285 Oct 11 04:11:09.869196 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 91/180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:09 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1497 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:10.024986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2c0fd778-5488-4da8-aa9c-bfcc4f1b65fd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:10.036351 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c0fd778-5488-4da8-aa9c-bfcc4f1b65fd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.215048 Oct 11 04:11:10.036660 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 90/181] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:09 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:10.089713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-768aa05b-a623-4080-b5ff-7318c92a0138 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:10.090626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-768aa05b-a623-4080-b5ff-7318c92a0138 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:10.097686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768aa05b-a623-4080-b5ff-7318c92a0138 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:10.098178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768aa05b-a623-4080-b5ff-7318c92a0138 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:10.098676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768aa05b-a623-4080-b5ff-7318c92a0138 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:10.099369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768aa05b-a623-4080-b5ff-7318c92a0138 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:10.099818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768aa05b-a623-4080-b5ff-7318c92a0138 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:10.100271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768aa05b-a623-4080-b5ff-7318c92a0138 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:10.576337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-768aa05b-a623-4080-b5ff-7318c92a0138 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:10.587917 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-768aa05b-a623-4080-b5ff-7318c92a0138 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1494 microversion: 2.1 time: 0.500551 Oct 11 04:11:10.590710 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 92/182] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:10 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1494 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:10.625477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-cafaa545-41b4-4c0f-bea9-a5b26e812116 req-ce2f08cc-0c88-4d6f-94af-a656183b56e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2b18dcce-1cfa-415c-9f84-3606760a55aa", "name": "network-vif-deleted", "tag": "ea239d09-e9de-4b7e-809f-3a511d3dfc72"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:10.636155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cafaa545-41b4-4c0f-bea9-a5b26e812116 req-ce2f08cc-0c88-4d6f-94af-a656183b56e7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:10.636638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cafaa545-41b4-4c0f-bea9-a5b26e812116 req-ce2f08cc-0c88-4d6f-94af-a656183b56e7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:10.637401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cafaa545-41b4-4c0f-bea9-a5b26e812116 req-ce2f08cc-0c88-4d6f-94af-a656183b56e7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:10.660198 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-cafaa545-41b4-4c0f-bea9-a5b26e812116 req-ce2f08cc-0c88-4d6f-94af-a656183b56e7 service nova] Creating event network-vif-deleted:ea239d09-e9de-4b7e-809f-3a511d3dfc72 for instance 2b18dcce-1cfa-415c-9f84-3606760a55aa on n-h2-860892-1 Oct 11 04:11:10.665409 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-cafaa545-41b4-4c0f-bea9-a5b26e812116 req-ce2f08cc-0c88-4d6f-94af-a656183b56e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044093 Oct 11 04:11:10.679659 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 91/183] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:10.846372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-306b3403-fcb8-43b7-9fcd-c667161cb321 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:10.851571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-306b3403-fcb8-43b7-9fcd-c667161cb321 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:10.852142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:10.858869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306b3403-fcb8-43b7-9fcd-c667161cb321 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:10.859406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306b3403-fcb8-43b7-9fcd-c667161cb321 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:10.859877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306b3403-fcb8-43b7-9fcd-c667161cb321 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:10.860677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306b3403-fcb8-43b7-9fcd-c667161cb321 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:10.861140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306b3403-fcb8-43b7-9fcd-c667161cb321 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:10.861562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306b3403-fcb8-43b7-9fcd-c667161cb321 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:10.953982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-306b3403-fcb8-43b7-9fcd-c667161cb321 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:10.961959 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-306b3403-fcb8-43b7-9fcd-c667161cb321 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1217 microversion: 2.1 time: 0.120065 Oct 11 04:11:10.962644 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 92/184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:10 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1217 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:10.975472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc6f8208-524e-4a4e-bfcf-c43be204eb19 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:10.975472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cc6f8208-524e-4a4e-bfcf-c43be204eb19 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:10.980803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f8208-524e-4a4e-bfcf-c43be204eb19 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:10.981542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f8208-524e-4a4e-bfcf-c43be204eb19 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:10.981976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f8208-524e-4a4e-bfcf-c43be204eb19 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:10.982699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f8208-524e-4a4e-bfcf-c43be204eb19 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:10.983151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f8208-524e-4a4e-bfcf-c43be204eb19 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:10.983572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f8208-524e-4a4e-bfcf-c43be204eb19 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:11.082895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cc6f8208-524e-4a4e-bfcf-c43be204eb19 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:11.091139 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc6f8208-524e-4a4e-bfcf-c43be204eb19 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 200 len: 1326 microversion: 2.1 time: 0.127437 Oct 11 04:11:11.091711 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 93/185] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:10 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 1326 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:11.098671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b39529a1-6928-4b34-bc80-220361c2033c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:11.103875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b39529a1-6928-4b34-bc80-220361c2033c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:11.105855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b39529a1-6928-4b34-bc80-220361c2033c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:11.106373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b39529a1-6928-4b34-bc80-220361c2033c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:11.106806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b39529a1-6928-4b34-bc80-220361c2033c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:11.107494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b39529a1-6928-4b34-bc80-220361c2033c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:11.107951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b39529a1-6928-4b34-bc80-220361c2033c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:11.108371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b39529a1-6928-4b34-bc80-220361c2033c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:11.285248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b39529a1-6928-4b34-bc80-220361c2033c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:11.292922 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b39529a1-6928-4b34-bc80-220361c2033c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.199864 Oct 11 04:11:11.293492 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 94/186] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:11 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:11.326554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1623814809", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:11.387125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:11:11.597513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:11:11.598093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:11:11.598754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:11:11.599297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:11:11.599705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:11:11.618556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:11.618556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:11.621783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:11.622561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:11.622996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:11.623460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:11.623695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:11.624098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:11.624256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:11.624742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:11.624898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:11.626917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:11.627611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:11.628077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:11.648035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Getting quotas for project a4899da03227442dbf61760169d18d99. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:11.652460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Getting quotas for user 5ac55ad87edb45f3b79c1aa66a929c1f and project a4899da03227442dbf61760169d18d99. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:11.661445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:11.662133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:11.662806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:11.663406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lazy-loading 'fault' on Instance uuid 57379b24-c543-4dbc-84f9-0e1a11e2b20f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:11:11.664559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:11:11.675340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:11:11.724415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a81b54be42b74a948b0340177ca9f7bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3aacdd09e90e4e0f8f76986dc3c91e10', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:11.733815 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae9d7eb2-6580-4f83-877c-9db9a34f56c0 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 200 len: 1329 microversion: 2.1 time: 0.123168 Oct 11 04:11:11.735152 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 95/187] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:11 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 1329 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:11.886697 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-234a60bb-cf8f-4568-be2a-613e9d69bb00 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.072578 Oct 11 04:11:11.888097 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 93/188] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:11:11.899396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a44d81d-5930-4708-96b9-9402ffab0d6d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:11.900213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9a44d81d-5930-4708-96b9-9402ffab0d6d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:12.047289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9a44d81d-5930-4708-96b9-9402ffab0d6d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:12.056520 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9a44d81d-5930-4708-96b9-9402ffab0d6d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1219 microversion: 2.1 time: 0.160833 Oct 11 04:11:12.070720 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 94/189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:11 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1219 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:12.080095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f5644dc-3edd-4f23-9fdf-c25475f063f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:12.080748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f5644dc-3edd-4f23-9fdf-c25475f063f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:12.087815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f5644dc-3edd-4f23-9fdf-c25475f063f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.088306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f5644dc-3edd-4f23-9fdf-c25475f063f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.088733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f5644dc-3edd-4f23-9fdf-c25475f063f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.089449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f5644dc-3edd-4f23-9fdf-c25475f063f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.089939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f5644dc-3edd-4f23-9fdf-c25475f063f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.090397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f5644dc-3edd-4f23-9fdf-c25475f063f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.229004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0f5644dc-3edd-4f23-9fdf-c25475f063f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:12.247161 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f5644dc-3edd-4f23-9fdf-c25475f063f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1217 microversion: 2.1 time: 0.175283 Oct 11 04:11:12.258637 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 95/190] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:12 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:12.263524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:12.264729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:12.272674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.273223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.273652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.274439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.274890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.275365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.285732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-225b484e-0cfe-4f61-ac1c-a412d077b1b4 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:12.299166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-225b484e-0cfe-4f61-ac1c-a412d077b1b4 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.299863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-225b484e-0cfe-4f61-ac1c-a412d077b1b4 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.300760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-225b484e-0cfe-4f61-ac1c-a412d077b1b4 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.304087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-225b484e-0cfe-4f61-ac1c-a412d077b1b4 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.304964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-225b484e-0cfe-4f61-ac1c-a412d077b1b4 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.306508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-225b484e-0cfe-4f61-ac1c-a412d077b1b4 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.331147 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] HTTP exception thrown: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Request method failure captured: Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa HTTP/1.1 Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROyzAE60n_vtdUscpLrBn2ICMPKYMV00QOrB3Q_8OoqfuZWLCO9d6pmQ-EMv3sw_ebTcJWpG0W--GWRHH-TfebQ1Fpq3GgiQBo71Y_bo7dmY1aoL9CfSJO8r9_I_zbs4oOUQfWkczXPQ5IZLb5IbHClJNT5Kcli56DbAwTWr28Wo3BQ Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:12.332941 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}] Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 66b61fab456b48188ef790d8d5dcb4b5 Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:12.334127 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '2b18dcce-1cfa-415c-9f84-3606760a55aa'} Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:12.335255 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:12.336594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:12.339252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Returning 404 to user: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:12.340498 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2304c871-4f60-4fa3-a402-f000a4f810ca tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 404 len: 111 microversion: 2.1 time: 0.080777 Oct 11 04:11:12.341219 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 96/191] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:12 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:12.347769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3aa36f15-6808-4273-8a84-9a5e5dd5b07a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:12.348552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3aa36f15-6808-4273-8a84-9a5e5dd5b07a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:12.356048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3aa36f15-6808-4273-8a84-9a5e5dd5b07a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.356752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3aa36f15-6808-4273-8a84-9a5e5dd5b07a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.357344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3aa36f15-6808-4273-8a84-9a5e5dd5b07a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.358796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3aa36f15-6808-4273-8a84-9a5e5dd5b07a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.367924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3aa36f15-6808-4273-8a84-9a5e5dd5b07a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.371771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3aa36f15-6808-4273-8a84-9a5e5dd5b07a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.423143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-225b484e-0cfe-4f61-ac1c-a412d077b1b4 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.556623 Oct 11 04:11:12.430318 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 96/192] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:11:11 2022] GET /compute/v2.1/os-services => generated 966 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:12.436818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c99933dc-c3cc-4f61-89c2-3c451eae04a2 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:12.444563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c99933dc-c3cc-4f61-89c2-3c451eae04a2 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.445338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c99933dc-c3cc-4f61-89c2-3c451eae04a2 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.446474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c99933dc-c3cc-4f61-89c2-3c451eae04a2 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.447960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c99933dc-c3cc-4f61-89c2-3c451eae04a2 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.448799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c99933dc-c3cc-4f61-89c2-3c451eae04a2 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.449680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c99933dc-c3cc-4f61-89c2-3c451eae04a2 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.479609 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c99933dc-c3cc-4f61-89c2-3c451eae04a2 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.046698 Oct 11 04:11:12.480569 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 97/193] 10.222.0.26 () {58 vars in 1170 bytes} [Tue Oct 11 04:11:12 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 966 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:12.486166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersAdminTestJSON-server-638150093", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:12.584434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:11:12.666628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3aa36f15-6808-4273-8a84-9a5e5dd5b07a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:12.674858 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3aa36f15-6808-4273-8a84-9a5e5dd5b07a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.332304 Oct 11 04:11:12.675423 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 97/194] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:12 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:12.690879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a0b95494-e776-4df8-9504-d6277b20f066 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:12.695150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0b95494-e776-4df8-9504-d6277b20f066 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.695827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0b95494-e776-4df8-9504-d6277b20f066 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.696727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0b95494-e776-4df8-9504-d6277b20f066 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.697634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0b95494-e776-4df8-9504-d6277b20f066 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.699613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0b95494-e776-4df8-9504-d6277b20f066 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.700199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0b95494-e776-4df8-9504-d6277b20f066 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.737495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:12.755012 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a0b95494-e776-4df8-9504-d6277b20f066 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.078540 Oct 11 04:11:12.755615 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 98/195] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:11:12 2022] GET /compute/v2.1/os-services => generated 966 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:12.767876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-752297f0-7b01-485d-9b40-4344bdc68d1a req-d7505a70-0e05-4d57-845b-97347535cd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57379b24-c543-4dbc-84f9-0e1a11e2b20f", "name": "network-vif-deleted", "tag": "471fca83-47be-452f-976c-d972af6446c2"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:12.779978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-752297f0-7b01-485d-9b40-4344bdc68d1a req-d7505a70-0e05-4d57-845b-97347535cd67 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.780448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-752297f0-7b01-485d-9b40-4344bdc68d1a req-d7505a70-0e05-4d57-845b-97347535cd67 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.781085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-752297f0-7b01-485d-9b40-4344bdc68d1a req-d7505a70-0e05-4d57-845b-97347535cd67 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.803052 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-752297f0-7b01-485d-9b40-4344bdc68d1a req-d7505a70-0e05-4d57-845b-97347535cd67 service nova] Creating event network-vif-deleted:471fca83-47be-452f-976c-d972af6446c2 for instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f on n-h2-860892-1 Oct 11 04:11:12.804337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-752297f0-7b01-485d-9b40-4344bdc68d1a req-d7505a70-0e05-4d57-845b-97347535cd67 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:11:12.804913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-752297f0-7b01-485d-9b40-4344bdc68d1a req-d7505a70-0e05-4d57-845b-97347535cd67 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:11:12.806130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f379661-7407-4b56-a705-812dd2cee3ee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.806754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f379661-7407-4b56-a705-812dd2cee3ee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.807314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f379661-7407-4b56-a705-812dd2cee3ee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.808636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f379661-7407-4b56-a705-812dd2cee3ee None None] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.809261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f379661-7407-4b56-a705-812dd2cee3ee None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.822341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f379661-7407-4b56-a705-812dd2cee3ee None None] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.836170 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.compute.rpcapi [None req-6f379661-7407-4b56-a705-812dd2cee3ee None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 11 04:11:12.837013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f379661-7407-4b56-a705-812dd2cee3ee None None] Releasing lock "compute-rpcapi-router" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:11:12.861364 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6f379661-7407-4b56-a705-812dd2cee3ee None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096972 Oct 11 04:11:12.862843 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 99/196] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:12.871654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:12.872599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:12.892321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:11:12.893507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:11:12.893985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:11:12.894414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:11:12.894943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:11:12.900827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.901374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.901741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.902464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.903062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.903443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.905532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.906395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.910801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.910801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.910801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.910801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.932159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Getting quotas for project f0bed16885ed4cb2b32330891efb3424. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:12.933452 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] HTTP exception thrown: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Request method failure captured: Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f HTTP/1.1 Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROyznrTJV__JIlwvf8tB2hd0vSrmfaw0ReVcwYKhVDulQg51zBWZw4yI0FhL3dNznTg8auzu-5clpiFblrV7yyIAQPN6mP_QxYRktvob7FEQEJai_gPD_9vkhCDls_lT5iRF6r9v2AX-sjCMzBOUEf1PSlc5n-53tGaNgYmLDFZr2zU Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 3aacdd09e90e4e0f8f76986dc3c91e10 Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminTestJSON-1197376464 Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:12.935410 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3aacdd09e90e4e0f8f76986dc3c91e10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3aacdd09e90e4e0f8f76986dc3c91e10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3aacdd09e90e4e0f8f76986dc3c91e10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3aacdd09e90e4e0f8f76986dc3c91e10"}]}] Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminTestJSON-1197376464 Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 3aacdd09e90e4e0f8f76986dc3c91e10 Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1197376464 Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminTestJSON-1197376464-project Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a81b54be42b74a948b0340177ca9f7bc Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminTestJSON-1197376464-project Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:12.942573 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '57379b24-c543-4dbc-84f9-0e1a11e2b20f'} Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:12.943477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:12.944751 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:12.945910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Getting quotas for user 66b61fab456b48188ef790d8d5dcb4b5 and project f0bed16885ed4cb2b32330891efb3424. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:12.945998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Returning 404 to user: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:12.945998 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e8b4990a-387f-41f9-a09a-927a7547f39b tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 404 len: 111 microversion: 2.1 time: 0.071439 Oct 11 04:11:12.945998 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 100/197] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:12 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:12.949391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:11:12.950910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a4ea6cb3-b2c6-4b2f-84c1-8fa4504ce854 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:12.952561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:11:12.955526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4ea6cb3-b2c6-4b2f-84c1-8fa4504ce854 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.956176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4ea6cb3-b2c6-4b2f-84c1-8fa4504ce854 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.956773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4ea6cb3-b2c6-4b2f-84c1-8fa4504ce854 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.957638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4ea6cb3-b2c6-4b2f-84c1-8fa4504ce854 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:12.958241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4ea6cb3-b2c6-4b2f-84c1-8fa4504ce854 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:12.958963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4ea6cb3-b2c6-4b2f-84c1-8fa4504ce854 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:12.985534 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a4ea6cb3-b2c6-4b2f-84c1-8fa4504ce854 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-860892-1&binary=xxx" status: 200 len: 16 microversion: 2.1 time: 0.038248 Oct 11 04:11:12.986126 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 101/198] 10.222.0.26 () {58 vars in 1194 bytes} [Tue Oct 11 04:11:12 2022] GET /compute/v2.1/os-services?host=n-d-860892-1&binary=xxx => generated 16 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:11:12.990724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e1bd3896-ae5b-4e14-b062-05b78ac0e25e tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:13.001756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1bd3896-ae5b-4e14-b062-05b78ac0e25e tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:13.002294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1bd3896-ae5b-4e14-b062-05b78ac0e25e tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:13.002727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1bd3896-ae5b-4e14-b062-05b78ac0e25e tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:13.089659 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ccf34fba-e49a-4fc1-b7c7-b2d138f6550e tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.607673 Oct 11 04:11:13.097553 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 98/199] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:11:13.103036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca0e6c65-a863-414f-9caa-452977bf6e34 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:13.108167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca0e6c65-a863-414f-9caa-452977bf6e34 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:13.108645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca0e6c65-a863-414f-9caa-452977bf6e34 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:13.116813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca0e6c65-a863-414f-9caa-452977bf6e34 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:13.116813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca0e6c65-a863-414f-9caa-452977bf6e34 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:13.116813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca0e6c65-a863-414f-9caa-452977bf6e34 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:13.116813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca0e6c65-a863-414f-9caa-452977bf6e34 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:13.143189 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ca0e6c65-a863-414f-9caa-452977bf6e34 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 966 microversion: 2.1 time: 0.044250 Oct 11 04:11:13.144424 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 99/200] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:11:13 2022] GET /compute/v2.1/os-services => generated 966 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:13.149441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d4cd742-118a-4db0-a7fe-3ce1a1b2020d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:13.150226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d4cd742-118a-4db0-a7fe-3ce1a1b2020d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:13.210299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d4cd742-118a-4db0-a7fe-3ce1a1b2020d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:13.220006 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d4cd742-118a-4db0-a7fe-3ce1a1b2020d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1219 microversion: 2.1 time: 0.074230 Oct 11 04:11:13.251786 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 100/201] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:13 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1219 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:13.274329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-14af9240-735c-4fa2-925e-23c32ba65a74 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:13.275931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-14af9240-735c-4fa2-925e-23c32ba65a74 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:13.362411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-14af9240-735c-4fa2-925e-23c32ba65a74 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:13.367080 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e1bd3896-ae5b-4e14-b062-05b78ac0e25e tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/2/action" status: 200 len: 299 microversion: 2.1 time: 0.379612 Oct 11 04:11:13.374659 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 102/202] 10.222.0.26 () {60 vars in 1191 bytes} [Tue Oct 11 04:11:12 2022] POST /compute/v2.1/os-aggregates/2/action => generated 299 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:13.374744 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-14af9240-735c-4fa2-925e-23c32ba65a74 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1219 microversion: 2.1 time: 0.114036 Oct 11 04:11:13.376568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-33c7a8e3-1ec1-43e1-bd5d-a0cfa00e4322 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:13.380970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33c7a8e3-1ec1-43e1-bd5d-a0cfa00e4322 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:13.381451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33c7a8e3-1ec1-43e1-bd5d-a0cfa00e4322 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:13.381901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33c7a8e3-1ec1-43e1-bd5d-a0cfa00e4322 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:13.383102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33c7a8e3-1ec1-43e1-bd5d-a0cfa00e4322 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:13.384019 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 101/203] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:13 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1219 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:13.384551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33c7a8e3-1ec1-43e1-bd5d-a0cfa00e4322 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:13.385185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33c7a8e3-1ec1-43e1-bd5d-a0cfa00e4322 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:13.391540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de704410-9708-445d-9472-0cbb299d149c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:13.392220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-de704410-9708-445d-9472-0cbb299d149c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:13.399715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de704410-9708-445d-9472-0cbb299d149c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:13.400229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de704410-9708-445d-9472-0cbb299d149c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:13.400664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de704410-9708-445d-9472-0cbb299d149c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:13.401350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de704410-9708-445d-9472-0cbb299d149c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:13.401798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de704410-9708-445d-9472-0cbb299d149c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:13.402241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de704410-9708-445d-9472-0cbb299d149c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:13.489276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-de704410-9708-445d-9472-0cbb299d149c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:13.516813 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-de704410-9708-445d-9472-0cbb299d149c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1265 microversion: 2.1 time: 0.125658 Oct 11 04:11:13.518420 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 102/204] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:13 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1265 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:13.534117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7f7b9f28-6b9e-4965-b812-9e60c4b91855 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:13.617599 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-33c7a8e3-1ec1-43e1-bd5d-a0cfa00e4322 tempest-ServicesAdminNegativeTestJSON-799014495 tempest-ServicesAdminNegativeTestJSON-799014495-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.1 time: 0.247610 Oct 11 04:11:13.618413 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 103/205] 10.222.0.26 () {58 vars in 1198 bytes} [Tue Oct 11 04:11:13 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:11:13.730533 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7f7b9f28-6b9e-4965-b812-9e60c4b91855 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/2" status: 200 len: 0 microversion: 2.1 time: 0.209342 Oct 11 04:11:13.731134 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 103/206] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:13 2022] DELETE /compute/v2.1/os-aggregates/2 => generated 0 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:13.741430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b28831e0-1d57-43a7-8348-671e6b9441de tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:13.744458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b28831e0-1d57-43a7-8348-671e6b9441de tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:13.763713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b28831e0-1d57-43a7-8348-671e6b9441de tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:13.766370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b28831e0-1d57-43a7-8348-671e6b9441de tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:13.767352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b28831e0-1d57-43a7-8348-671e6b9441de tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:13.768680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b28831e0-1d57-43a7-8348-671e6b9441de tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:13.773522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b28831e0-1d57-43a7-8348-671e6b9441de tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:13.774323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b28831e0-1d57-43a7-8348-671e6b9441de tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:13.988598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a0472278-f7d6-42dc-87ec-227d012080b7 tempest-ServicesAdminNegativeTestJSON-1588599737 tempest-ServicesAdminNegativeTestJSON-1588599737-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:13.992431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a0472278-f7d6-42dc-87ec-227d012080b7 tempest-ServicesAdminNegativeTestJSON-1588599737 tempest-ServicesAdminNegativeTestJSON-1588599737-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '3e7f6dd0ff8f43319fd0c284b0e40e44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3613da3b15984dd6a64138dfa62be213', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a0472278-f7d6-42dc-87ec-227d012080b7 tempest-ServicesAdminNegativeTestJSON-1588599737 tempest-ServicesAdminNegativeTestJSON-1588599737-project] Request method failure captured: Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzeCE0AOWyyPQb8bjR9rWzEK4TAxjzXctL2g1UNXWJQgzjdUpTbsquevqC4yhTYwPyKypoQr7EebEFrWjTgRggKBDvfBcGGrT4Lo1vNgb2P_UxwJI8yekDdAGOm0xeHYe_orXGt0HV_cOdZL_bRiHVBYjcx3nGgKTDJvf-sF7lxMLc Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 3613da3b15984dd6a64138dfa62be213 Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServicesAdminNegativeTestJSON-1588599737 Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:14.000561 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3613da3b15984dd6a64138dfa62be213"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3613da3b15984dd6a64138dfa62be213"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3613da3b15984dd6a64138dfa62be213"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3613da3b15984dd6a64138dfa62be213"}]}] Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServicesAdminNegativeTestJSON-1588599737 Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 3613da3b15984dd6a64138dfa62be213 Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServicesAdminNegativeTestJSON-1588599737 Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServicesAdminNegativeTestJSON-1588599737-project Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 3e7f6dd0ff8f43319fd0c284b0e40e44 Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServicesAdminNegativeTestJSON-1588599737-project Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 04:11:14.001906 n-d-860892-1 devstack@n-api.service[120993]: action_args: {} Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:11:14.002774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 04:11:14.004746 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:14.006486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a0472278-f7d6-42dc-87ec-227d012080b7 tempest-ServicesAdminNegativeTestJSON-1588599737 tempest-ServicesAdminNegativeTestJSON-1588599737-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:14.006486 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a0472278-f7d6-42dc-87ec-227d012080b7 tempest-ServicesAdminNegativeTestJSON-1588599737 tempest-ServicesAdminNegativeTestJSON-1588599737-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.1 time: 0.374302 Oct 11 04:11:14.008835 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 104/207] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:11:13 2022] GET /compute/v2.1/os-services => generated 112 bytes in 382 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:14.014070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-721d6699-9557-4ad9-a6ec-f02a0bc6efeb tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1345128011"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:14.023127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-721d6699-9557-4ad9-a6ec-f02a0bc6efeb tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Generated uuid 68e72d80-fad7-4cf4-acbf-b7150b95c485 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:14.166373 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-721d6699-9557-4ad9-a6ec-f02a0bc6efeb tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.155828 Oct 11 04:11:14.166951 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 105/208] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:14 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:14.179820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e0a04d3d-4d68-4f61-98c1-c02c846e5f10 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:14.200374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0a04d3d-4d68-4f61-98c1-c02c846e5f10 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:14.202338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0a04d3d-4d68-4f61-98c1-c02c846e5f10 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:14.204902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0a04d3d-4d68-4f61-98c1-c02c846e5f10 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:14.214524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b28831e0-1d57-43a7-8348-671e6b9441de tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:14.228069 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b28831e0-1d57-43a7-8348-671e6b9441de tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.495859 Oct 11 04:11:14.228658 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 104/209] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:13 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:14.262600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-29e8aa27-514b-441d-a15b-93b4be85a92f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:14.263252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-29e8aa27-514b-441d-a15b-93b4be85a92f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:14.273674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29e8aa27-514b-441d-a15b-93b4be85a92f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:14.274171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29e8aa27-514b-441d-a15b-93b4be85a92f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:14.274685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29e8aa27-514b-441d-a15b-93b4be85a92f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:14.275392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29e8aa27-514b-441d-a15b-93b4be85a92f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:14.275843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29e8aa27-514b-441d-a15b-93b4be85a92f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:14.276263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29e8aa27-514b-441d-a15b-93b4be85a92f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:14.370740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-29e8aa27-514b-441d-a15b-93b4be85a92f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:14.404482 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-29e8aa27-514b-441d-a15b-93b4be85a92f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1237 microversion: 2.1 time: 0.150038 Oct 11 04:11:14.405082 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 105/210] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:14 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1237 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:14.417470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9dba1c57-003d-4c1b-9869-ce4cf2b69812 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:14.421375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9dba1c57-003d-4c1b-9869-ce4cf2b69812 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:14.427331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:SAVEPOINT=2,nova_api:INSERT=5,nova_api:RELEASE=2,nova_api:DELETE=5 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:14.565368 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e0a04d3d-4d68-4f61-98c1-c02c846e5f10 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 242 microversion: 2.1 time: 0.390978 Oct 11 04:11:14.565946 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 106/211] 10.222.0.26 () {60 vars in 1191 bytes} [Tue Oct 11 04:11:14 2022] POST /compute/v2.1/os-aggregates/3/action => generated 242 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:14.570653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-326be60b-400e-46e9-bfe4-3c99a10d2e27 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:14.571262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-326be60b-400e-46e9-bfe4-3c99a10d2e27 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:14.589924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-326be60b-400e-46e9-bfe4-3c99a10d2e27 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:14.590440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-326be60b-400e-46e9-bfe4-3c99a10d2e27 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:14.594025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-326be60b-400e-46e9-bfe4-3c99a10d2e27 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:14.601358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-326be60b-400e-46e9-bfe4-3c99a10d2e27 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:14.601358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-326be60b-400e-46e9-bfe4-3c99a10d2e27 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:14.601358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-326be60b-400e-46e9-bfe4-3c99a10d2e27 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:14.630891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9dba1c57-003d-4c1b-9869-ce4cf2b69812 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:14.638738 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9dba1c57-003d-4c1b-9869-ce4cf2b69812 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1219 microversion: 2.1 time: 0.230004 Oct 11 04:11:14.647612 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 106/212] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:14 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1219 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:14.664705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fa91a047-ab12-4d23-a1d2-fbc6223ab611 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:14.698547 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fa91a047-ab12-4d23-a1d2-fbc6223ab611 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/3" status: 200 len: 242 microversion: 2.1 time: 0.049500 Oct 11 04:11:14.702649 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 107/213] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:11:14 2022] GET /compute/v2.1/os-aggregates/3 => generated 242 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:14.728619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-29751739-b019-4efc-82f6-d685ec858a93 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860892-1"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:14.751853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29751739-b019-4efc-82f6-d685ec858a93 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:14.752580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29751739-b019-4efc-82f6-d685ec858a93 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:14.753247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29751739-b019-4efc-82f6-d685ec858a93 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:14.799279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-326be60b-400e-46e9-bfe4-3c99a10d2e27 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:14.809402 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-326be60b-400e-46e9-bfe4-3c99a10d2e27 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1271 microversion: 2.1 time: 0.242194 Oct 11 04:11:14.810427 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 107/214] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:14 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1271 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:14.910549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-b4830f1e-fcd1-4e68-ae3d-7ec3b043b3ff req-a18b55f2-3c2d-4274-bc85-2ef476b6d593 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a2d8cb-5666-44f2-b773-bc4305262557", "tag": "7b731ed1-208b-42f4-befd-6f133da74aff"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:14.920112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b4830f1e-fcd1-4e68-ae3d-7ec3b043b3ff req-a18b55f2-3c2d-4274-bc85-2ef476b6d593 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:14.920772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b4830f1e-fcd1-4e68-ae3d-7ec3b043b3ff req-a18b55f2-3c2d-4274-bc85-2ef476b6d593 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:14.921361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b4830f1e-fcd1-4e68-ae3d-7ec3b043b3ff req-a18b55f2-3c2d-4274-bc85-2ef476b6d593 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:14.934112 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-b4830f1e-fcd1-4e68-ae3d-7ec3b043b3ff req-a18b55f2-3c2d-4274-bc85-2ef476b6d593 service nova] Creating event network-changed:7b731ed1-208b-42f4-befd-6f133da74aff for instance e3a2d8cb-5666-44f2-b773-bc4305262557 on n-h1-860892-1 Oct 11 04:11:14.938941 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-b4830f1e-fcd1-4e68-ae3d-7ec3b043b3ff req-a18b55f2-3c2d-4274-bc85-2ef476b6d593 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033081 Oct 11 04:11:14.939530 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 108/215] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:15.109579 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-29751739-b019-4efc-82f6-d685ec858a93 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/3/action" status: 200 len: 227 microversion: 2.1 time: 0.398315 Oct 11 04:11:15.116369 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 108/216] 10.222.0.26 () {60 vars in 1191 bytes} [Tue Oct 11 04:11:14 2022] POST /compute/v2.1/os-aggregates/3/action => generated 227 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:15.128261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-36d633e4-0d71-4c3e-b95c-954ff9bcb9bb tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:15.234565 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-36d633e4-0d71-4c3e-b95c-954ff9bcb9bb tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/3" status: 200 len: 0 microversion: 2.1 time: 0.110815 Oct 11 04:11:15.235513 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 109/217] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:15 2022] DELETE /compute/v2.1/os-aggregates/3 => generated 0 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:15.250586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0319c596-aed8-479c-b157-ebbf15d26075 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1469825996"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:15.258920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.aggregate [None req-0319c596-aed8-479c-b157-ebbf15d26075 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Generated uuid 862db9e0-1232-44ad-9bec-50c552b7355e for aggregate {{(pid=120994) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:15.267930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d42f753-64df-45fd-b172-b5e3e4658b4c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:15.268671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0d42f753-64df-45fd-b172-b5e3e4658b4c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:15.293486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d42f753-64df-45fd-b172-b5e3e4658b4c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:15.295244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d42f753-64df-45fd-b172-b5e3e4658b4c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:15.302632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d42f753-64df-45fd-b172-b5e3e4658b4c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:15.308956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d42f753-64df-45fd-b172-b5e3e4658b4c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:15.310857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d42f753-64df-45fd-b172-b5e3e4658b4c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:15.313292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d42f753-64df-45fd-b172-b5e3e4658b4c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:15.438327 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0319c596-aed8-479c-b157-ebbf15d26075 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.193564 Oct 11 04:11:15.441359 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 109/218] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:15 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:15.447713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a289eeb-4ff0-4b64-91ca-16ffe2052443 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:15.448675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a289eeb-4ff0-4b64-91ca-16ffe2052443 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:15.456266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a289eeb-4ff0-4b64-91ca-16ffe2052443 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:15.457049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a289eeb-4ff0-4b64-91ca-16ffe2052443 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:15.457691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a289eeb-4ff0-4b64-91ca-16ffe2052443 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:15.458725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a289eeb-4ff0-4b64-91ca-16ffe2052443 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:15.459378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a289eeb-4ff0-4b64-91ca-16ffe2052443 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:15.459966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a289eeb-4ff0-4b64-91ca-16ffe2052443 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:15.534173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3a289eeb-4ff0-4b64-91ca-16ffe2052443 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:15.542579 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a289eeb-4ff0-4b64-91ca-16ffe2052443 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1289 microversion: 2.1 time: 0.099767 Oct 11 04:11:15.543197 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 110/219] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:15 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:15.739407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c97234c9-f225-47fe-a536-982eeeca38e0 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Calling method '.version_select at 0x7fda1a80d3a0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:15.741384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97234c9-f225-47fe-a536-982eeeca38e0 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:15.741874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97234c9-f225-47fe-a536-982eeeca38e0 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:15.742343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97234c9-f225-47fe-a536-982eeeca38e0 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:15.759733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97234c9-f225-47fe-a536-982eeeca38e0 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:15.760230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97234c9-f225-47fe-a536-982eeeca38e0 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:15.760658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97234c9-f225-47fe-a536-982eeeca38e0 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:15.764383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:15.773985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97234c9-f225-47fe-a536-982eeeca38e0 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:15.774757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97234c9-f225-47fe-a536-982eeeca38e0 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:15.775342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97234c9-f225-47fe-a536-982eeeca38e0 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:15.783334 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c97234c9-f225-47fe-a536-982eeeca38e0 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.28 time: 0.238771 Oct 11 04:11:15.784184 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 111/220] 10.222.0.26 () {60 vars in 1187 bytes} [Tue Oct 11 04:11:15 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:11:15.795458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b4e65d0-28ab-4bcc-b044-0f3b44e82900 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860892-1"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:15.806408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b4e65d0-28ab-4bcc-b044-0f3b44e82900 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:15.806895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b4e65d0-28ab-4bcc-b044-0f3b44e82900 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:15.807325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b4e65d0-28ab-4bcc-b044-0f3b44e82900 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:16.058559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0d42f753-64df-45fd-b172-b5e3e4658b4c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:16.070003 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0d42f753-64df-45fd-b172-b5e3e4658b4c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.816784 Oct 11 04:11:16.070629 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 110/221] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:15 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:16.095908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ea44dbae-9e3f-489a-9a2f-372abac11ac5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:16.096744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ea44dbae-9e3f-489a-9a2f-372abac11ac5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:16.102903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea44dbae-9e3f-489a-9a2f-372abac11ac5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:16.103382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea44dbae-9e3f-489a-9a2f-372abac11ac5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:16.103811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea44dbae-9e3f-489a-9a2f-372abac11ac5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:16.104491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea44dbae-9e3f-489a-9a2f-372abac11ac5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:16.104971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea44dbae-9e3f-489a-9a2f-372abac11ac5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:16.105532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea44dbae-9e3f-489a-9a2f-372abac11ac5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:16.166646 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b4e65d0-28ab-4bcc-b044-0f3b44e82900 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 242 microversion: 2.1 time: 0.373966 Oct 11 04:11:16.174694 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 112/222] 10.222.0.26 () {60 vars in 1191 bytes} [Tue Oct 11 04:11:15 2022] POST /compute/v2.1/os-aggregates/4/action => generated 242 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:16.179327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2eec44d0-ab4b-472e-95fb-caa9ad0cfbe8 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Calling method '.version_select at 0x7fda1a80d9d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:16.181044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eec44d0-ab4b-472e-95fb-caa9ad0cfbe8 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:16.181523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eec44d0-ab4b-472e-95fb-caa9ad0cfbe8 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:16.181955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eec44d0-ab4b-472e-95fb-caa9ad0cfbe8 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:16.205317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eec44d0-ab4b-472e-95fb-caa9ad0cfbe8 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:16.206269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eec44d0-ab4b-472e-95fb-caa9ad0cfbe8 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:16.207439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eec44d0-ab4b-472e-95fb-caa9ad0cfbe8 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:16.212924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea44dbae-9e3f-489a-9a2f-372abac11ac5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:16.213428 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2eec44d0-ab4b-472e-95fb-caa9ad0cfbe8 tempest-HypervisorAdminV228Test-1203902157 tempest-HypervisorAdminV228Test-1203902157-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 718 microversion: 2.28 time: 0.044914 Oct 11 04:11:16.214036 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 113/223] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 11 04:11:16 2022] GET /compute/v2.1/os-hypervisors/1 => generated 718 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:11:16.221536 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ea44dbae-9e3f-489a-9a2f-372abac11ac5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1271 microversion: 2.1 time: 0.146788 Oct 11 04:11:16.231567 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 111/224] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:16 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1271 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:16.249103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0f5b38f4-73a9-4abc-8a60-b475d35267ea tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:16.250162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4d5b2e30-f053-4131-93fd-508ef77b9e47 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:16.251656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0f5b38f4-73a9-4abc-8a60-b475d35267ea tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:16.263548 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4d5b2e30-f053-4131-93fd-508ef77b9e47 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 245 microversion: 2.1 time: 0.032622 Oct 11 04:11:16.272659 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 112/225] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:11:16 2022] GET /compute/v2.1/os-aggregates => generated 245 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:16.274041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5b38f4-73a9-4abc-8a60-b475d35267ea tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:16.274570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5b38f4-73a9-4abc-8a60-b475d35267ea tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:16.275006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5b38f4-73a9-4abc-8a60-b475d35267ea tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:16.275717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5b38f4-73a9-4abc-8a60-b475d35267ea tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:16.276298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5b38f4-73a9-4abc-8a60-b475d35267ea tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:16.276813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5b38f4-73a9-4abc-8a60-b475d35267ea tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:16.279207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-01949e84-5d06-4363-8b7e-a745b8160776 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:16.311047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01949e84-5d06-4363-8b7e-a745b8160776 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:16.311669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01949e84-5d06-4363-8b7e-a745b8160776 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:16.314407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01949e84-5d06-4363-8b7e-a745b8160776 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:16.730828 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-01949e84-5d06-4363-8b7e-a745b8160776 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/4/action" status: 200 len: 227 microversion: 2.1 time: 0.456679 Oct 11 04:11:16.738743 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 113/226] 10.222.0.26 () {60 vars in 1191 bytes} [Tue Oct 11 04:11:16 2022] POST /compute/v2.1/os-aggregates/4/action => generated 227 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:16.745388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a368547a-e4ac-4b47-a1d3-d3095ada7486 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:16.746001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a368547a-e4ac-4b47-a1d3-d3095ada7486 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:16.753428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a368547a-e4ac-4b47-a1d3-d3095ada7486 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:16.754276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a368547a-e4ac-4b47-a1d3-d3095ada7486 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:16.755411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a368547a-e4ac-4b47-a1d3-d3095ada7486 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:16.756330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a368547a-e4ac-4b47-a1d3-d3095ada7486 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:16.757015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a368547a-e4ac-4b47-a1d3-d3095ada7486 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:16.757645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a368547a-e4ac-4b47-a1d3-d3095ada7486 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:16.772980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0f5b38f4-73a9-4abc-8a60-b475d35267ea tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:16.777485 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0f5b38f4-73a9-4abc-8a60-b475d35267ea tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.541466 Oct 11 04:11:16.804705 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 114/227] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:16 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:16.814550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27aa18c3-defd-4709-b255-bd92849f1e55 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:16.937229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a368547a-e4ac-4b47-a1d3-d3095ada7486 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:16.952315 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-27aa18c3-defd-4709-b255-bd92849f1e55 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/4" status: 200 len: 0 microversion: 2.1 time: 0.146173 Oct 11 04:11:16.953300 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 115/228] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:16 2022] DELETE /compute/v2.1/os-aggregates/4 => generated 0 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:16.967392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1fb46ae3-f1c7-4fcd-a5f1-61c0a5fc7363 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1097846332"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:16.972073 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a368547a-e4ac-4b47-a1d3-d3095ada7486 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1277 microversion: 2.1 time: 0.231711 Oct 11 04:11:16.972341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.aggregate [None req-1fb46ae3-f1c7-4fcd-a5f1-61c0a5fc7363 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Generated uuid dfce2bed-4cb0-4090-b945-6080374bc69f for aggregate {{(pid=120994) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:16.993731 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 114/229] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:16 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1277 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:17.085518 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1fb46ae3-f1c7-4fcd-a5f1-61c0a5fc7363 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.122662 Oct 11 04:11:17.086588 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 116/230] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:16 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:17.101823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4a1b8948-3eb3-410c-86f1-fa560bf2da77 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:17.102532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4a1b8948-3eb3-410c-86f1-fa560bf2da77 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:17.109277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a1b8948-3eb3-410c-86f1-fa560bf2da77 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:17.110699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a1b8948-3eb3-410c-86f1-fa560bf2da77 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:17.111341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a1b8948-3eb3-410c-86f1-fa560bf2da77 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:17.112359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a1b8948-3eb3-410c-86f1-fa560bf2da77 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:17.113237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a1b8948-3eb3-410c-86f1-fa560bf2da77 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:17.113859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a1b8948-3eb3-410c-86f1-fa560bf2da77 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:17.120520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d7db4664-64f8-4a41-ae84-2bb91d4ea5fe tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860892-1"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:17.149711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7db4664-64f8-4a41-ae84-2bb91d4ea5fe tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:17.150225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7db4664-64f8-4a41-ae84-2bb91d4ea5fe tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:17.150675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7db4664-64f8-4a41-ae84-2bb91d4ea5fe tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:17.470832 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d7db4664-64f8-4a41-ae84-2bb91d4ea5fe tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 242 microversion: 2.1 time: 0.365570 Oct 11 04:11:17.472015 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 117/231] 10.222.0.26 () {60 vars in 1191 bytes} [Tue Oct 11 04:11:17 2022] POST /compute/v2.1/os-aggregates/5/action => generated 242 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:17.480970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7c117a54-b565-4cd2-9e0f-3e6aa9a4c3bc tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:17.482150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7c117a54-b565-4cd2-9e0f-3e6aa9a4c3bc tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:17.491243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c117a54-b565-4cd2-9e0f-3e6aa9a4c3bc tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:17.491875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c117a54-b565-4cd2-9e0f-3e6aa9a4c3bc tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:17.492476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c117a54-b565-4cd2-9e0f-3e6aa9a4c3bc tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:17.493532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c117a54-b565-4cd2-9e0f-3e6aa9a4c3bc tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:17.494114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c117a54-b565-4cd2-9e0f-3e6aa9a4c3bc tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:17.494567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c117a54-b565-4cd2-9e0f-3e6aa9a4c3bc tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:17.576032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4a1b8948-3eb3-410c-86f1-fa560bf2da77 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:17.584276 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4a1b8948-3eb3-410c-86f1-fa560bf2da77 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.487680 Oct 11 04:11:17.594993 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 115/232] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:17 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:17.611883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c436b3da-4f85-45db-b4be-7183b34d2bb4 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:17.625715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c436b3da-4f85-45db-b4be-7183b34d2bb4 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:17.626523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c436b3da-4f85-45db-b4be-7183b34d2bb4 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:17.627895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c436b3da-4f85-45db-b4be-7183b34d2bb4 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:17.646373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7c117a54-b565-4cd2-9e0f-3e6aa9a4c3bc tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:17.653445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:17.684800 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7c117a54-b565-4cd2-9e0f-3e6aa9a4c3bc tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1277 microversion: 2.1 time: 0.210196 Oct 11 04:11:17.685782 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 118/233] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:17 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1277 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:17.808266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c31cefc8-0125-40ee-b8d2-cbe9c8a1954b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:17.808902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c31cefc8-0125-40ee-b8d2-cbe9c8a1954b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:17.830329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c31cefc8-0125-40ee-b8d2-cbe9c8a1954b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:17.830823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c31cefc8-0125-40ee-b8d2-cbe9c8a1954b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:17.833723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c31cefc8-0125-40ee-b8d2-cbe9c8a1954b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:17.834507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c31cefc8-0125-40ee-b8d2-cbe9c8a1954b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:17.835732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c31cefc8-0125-40ee-b8d2-cbe9c8a1954b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:17.836174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c31cefc8-0125-40ee-b8d2-cbe9c8a1954b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:18.080401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c31cefc8-0125-40ee-b8d2-cbe9c8a1954b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:18.090091 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c31cefc8-0125-40ee-b8d2-cbe9c8a1954b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.286593 Oct 11 04:11:18.091236 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 119/234] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:17 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:18.115791 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c436b3da-4f85-45db-b4be-7183b34d2bb4 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/5/action" status: 200 len: 227 microversion: 2.1 time: 0.529334 Oct 11 04:11:18.116495 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 116/235] 10.222.0.26 () {60 vars in 1191 bytes} [Tue Oct 11 04:11:17 2022] POST /compute/v2.1/os-aggregates/5/action => generated 227 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:18.128746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3bcd8ca0-d9b7-4af5-a951-0843fd84fc09 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:18.129624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3bcd8ca0-d9b7-4af5-a951-0843fd84fc09 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:18.133988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6f25d1ba-cb19-43d7-8723-7aa444478479 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:18.142402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcd8ca0-d9b7-4af5-a951-0843fd84fc09 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:18.143236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcd8ca0-d9b7-4af5-a951-0843fd84fc09 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:18.144109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcd8ca0-d9b7-4af5-a951-0843fd84fc09 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:18.145055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcd8ca0-d9b7-4af5-a951-0843fd84fc09 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:18.146472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcd8ca0-d9b7-4af5-a951-0843fd84fc09 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:18.147099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcd8ca0-d9b7-4af5-a951-0843fd84fc09 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:18.232972 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6f25d1ba-cb19-43d7-8723-7aa444478479 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/5" status: 200 len: 0 microversion: 2.1 time: 0.103883 Oct 11 04:11:18.234741 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 117/236] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:18 2022] DELETE /compute/v2.1/os-aggregates/5 => generated 0 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 11 04:11:18.246601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-da6b4515-d528-4d04-a089-d1d31d210338 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1188776799"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:18.247582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3bcd8ca0-d9b7-4af5-a951-0843fd84fc09 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:18.251706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-da6b4515-d528-4d04-a089-d1d31d210338 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Generated uuid 2882e02b-e6f4-4806-97a3-31b56a77cc36 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:18.260062 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3bcd8ca0-d9b7-4af5-a951-0843fd84fc09 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1277 microversion: 2.1 time: 0.167265 Oct 11 04:11:18.260825 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 120/237] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:18 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1277 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:18.358473 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-da6b4515-d528-4d04-a089-d1d31d210338 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.118080 Oct 11 04:11:18.359763 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 118/238] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:18 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:18.375407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-289af10b-b74c-49f9-b6df-188f949713d5 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:18.466974 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-289af10b-b74c-49f9-b6df-188f949713d5 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/6" status: 200 len: 0 microversion: 2.1 time: 0.098447 Oct 11 04:11:18.468190 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 121/239] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:18 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 0 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:18.477353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8be15d0-c56d-4a0e-8d6e-295d2feebded tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:18.489272 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f8be15d0-c56d-4a0e-8d6e-295d2feebded tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8be15d0-c56d-4a0e-8d6e-295d2feebded tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Request method failure captured: Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROy22TSQ2p1RcM6nso9C7_hFN9qG1iS2q_raaP1sdNX2Ab75frcdLj8WGQ6cjBWD34blrv-YXLlWZmGwRLbNGudozle5wcaNsg_cZ24Z1ndXozLbHJ1ZKWVB3yVU10kePXx7bTbUPmtFG7Y3cnW0ZYUszBjWZxlqW8_o1KiuBCQBQ0o Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: e3de57a2453143eb902c7b8ae3f72413 Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:11:18.491628 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3de57a2453143eb902c7b8ae3f72413"}]}] Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: e3de57a2453143eb902c7b8ae3f72413 Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminTestJSON-1030326826-project-admin Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 4b5abfae0e7e4ba6ae34d8b0678ab0ee Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminTestJSON-1030326826-project-admin Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: exception: Aggregate 6 could not be found. Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '6'} Oct 11 04:11:18.492798 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:18.493504 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 11 04:11:18.494576 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:18.495549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8be15d0-c56d-4a0e-8d6e-295d2feebded tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:18.495549 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f8be15d0-c56d-4a0e-8d6e-295d2feebded tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.020249 Oct 11 04:11:18.495549 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 119/240] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:11:18 2022] GET /compute/v2.1/os-aggregates/6 => generated 77 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:11:18.502486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff4c8c21-498d-426b-81ed-1240c1892808 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:18.523595 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ff4c8c21-498d-426b-81ed-1240c1892808 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] HTTP exception thrown: Aggregate 6 could not be found. Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff4c8c21-498d-426b-81ed-1240c1892808 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Request method failure captured: Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-aggregates/6 HTTP/1.1 Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROy22TSQ2p1RcM6nso9C7_hFN9qG1iS2q_raaP1sdNX2Ab75frcdLj8WGQ6cjBWD34blrv-YXLlWZmGwRLbNGudozle5wcaNsg_cZ24Z1ndXozLbHJ1ZKWVB3yVU10kePXx7bTbUPmtFG7Y3cnW0ZYUszBjWZxlqW8_o1KiuBCQBQ0o Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: e3de57a2453143eb902c7b8ae3f72413 Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:11:18.526218 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3de57a2453143eb902c7b8ae3f72413"}]}] Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: e3de57a2453143eb902c7b8ae3f72413 Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AggregatesAdminTestJSON-1030326826-project-admin Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 4b5abfae0e7e4ba6ae34d8b0678ab0ee Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AggregatesAdminTestJSON-1030326826-project-admin Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: exception: Aggregate 6 could not be found. Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '6'} Oct 11 04:11:18.527447 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:11:18.528779 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 6 could not be found. Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 6 could not be found. Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:18.529953 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:18.531977 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:18.531977 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:18.531977 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:18.531977 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 6 could not be found. Oct 11 04:11:18.531977 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:18.541226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff4c8c21-498d-426b-81ed-1240c1892808 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Returning 404 to user: Aggregate 6 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:18.541226 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff4c8c21-498d-426b-81ed-1240c1892808 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/6" status: 404 len: 77 microversion: 2.1 time: 0.040008 Oct 11 04:11:18.543794 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 122/241] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:18 2022] DELETE /compute/v2.1/os-aggregates/6 => generated 77 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:11:18.557933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2c505c0e-d9aa-4718-92c5-53b83848366d tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"availability_zone": "tempest-test_az-335273428", "name": "tempest-test_aggregate-1758831625"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:18.561895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-2c505c0e-d9aa-4718-92c5-53b83848366d tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Generated uuid ac00e2c6-51d4-4dd1-81c7-6d866f6d2222 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:18.607119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e4253f5f-634a-4fa2-8e92-64086ce15d62 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:18.608082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e4253f5f-634a-4fa2-8e92-64086ce15d62 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:18.619825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4253f5f-634a-4fa2-8e92-64086ce15d62 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:18.621596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4253f5f-634a-4fa2-8e92-64086ce15d62 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:18.622359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4253f5f-634a-4fa2-8e92-64086ce15d62 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:18.623216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4253f5f-634a-4fa2-8e92-64086ce15d62 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:18.624202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4253f5f-634a-4fa2-8e92-64086ce15d62 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:18.627199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4253f5f-634a-4fa2-8e92-64086ce15d62 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:18.687821 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2c505c0e-d9aa-4718-92c5-53b83848366d tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 221 microversion: 2.1 time: 0.142510 Oct 11 04:11:18.694625 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 120/242] 10.222.0.26 () {60 vars in 1165 bytes} [Tue Oct 11 04:11:18 2022] POST /compute/v2.1/os-aggregates => generated 221 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:18.708707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eac3c1de-303d-4403-86a7-ddfef6a8f950 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:18.831762 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eac3c1de-303d-4403-86a7-ddfef6a8f950 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/7" status: 200 len: 0 microversion: 2.1 time: 0.129759 Oct 11 04:11:18.834004 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 121/243] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:18 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 0 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 11 04:11:18.841584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e63fb6a8-b843-4b30-9099-2bb8bb40e9ae tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:18.849247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e63fb6a8-b843-4b30-9099-2bb8bb40e9ae tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:18.873781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e63fb6a8-b843-4b30-9099-2bb8bb40e9ae tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:18.878363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e63fb6a8-b843-4b30-9099-2bb8bb40e9ae tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:18.880241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e63fb6a8-b843-4b30-9099-2bb8bb40e9ae tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:18.885056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e63fb6a8-b843-4b30-9099-2bb8bb40e9ae tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:18.885821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e63fb6a8-b843-4b30-9099-2bb8bb40e9ae tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:18.886653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e63fb6a8-b843-4b30-9099-2bb8bb40e9ae tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:19.263098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e63fb6a8-b843-4b30-9099-2bb8bb40e9ae tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:19.274738 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e63fb6a8-b843-4b30-9099-2bb8bb40e9ae tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1277 microversion: 2.1 time: 0.439166 Oct 11 04:11:19.276627 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 122/244] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:18 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1277 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:19.285865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a88cc9c-29bb-48bf-b8f9-f408078c7aba tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:19.294019 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-9a88cc9c-29bb-48bf-b8f9-f408078c7aba tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a88cc9c-29bb-48bf-b8f9-f408078c7aba tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Request method failure captured: Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROy22TSQ2p1RcM6nso9C7_hFN9qG1iS2q_raaP1sdNX2Ab75frcdLj8WGQ6cjBWD34blrv-YXLlWZmGwRLbNGudozle5wcaNsg_cZ24Z1ndXozLbHJ1ZKWVB3yVU10kePXx7bTbUPmtFG7Y3cnW0ZYUszBjWZxlqW8_o1KiuBCQBQ0o Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: e3de57a2453143eb902c7b8ae3f72413 Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:11:19.296030 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3de57a2453143eb902c7b8ae3f72413"}]}] Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: e3de57a2453143eb902c7b8ae3f72413 Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminTestJSON-1030326826-project-admin Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 4b5abfae0e7e4ba6ae34d8b0678ab0ee Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminTestJSON-1030326826-project-admin Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: exception: Aggregate 7 could not be found. Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '7'} Oct 11 04:11:19.297317 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:19.298000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 11 04:11:19.299046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:19.303988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a88cc9c-29bb-48bf-b8f9-f408078c7aba tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:19.307674 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9a88cc9c-29bb-48bf-b8f9-f408078c7aba tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.024784 Oct 11 04:11:19.307674 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 123/245] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:11:19 2022] GET /compute/v2.1/os-aggregates/7 => generated 77 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:11:19.307848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e4253f5f-634a-4fa2-8e92-64086ce15d62 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:19.313691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6e64cd71-050e-474b-baa7-30af35a850d4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:19.314707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6e64cd71-050e-474b-baa7-30af35a850d4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:19.318229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=5 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:19.321147 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e4253f5f-634a-4fa2-8e92-64086ce15d62 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.717700 Oct 11 04:11:19.323890 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 123/246] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:18 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:19.330556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e64cd71-050e-474b-baa7-30af35a850d4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:19.331487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e64cd71-050e-474b-baa7-30af35a850d4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:19.332204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e64cd71-050e-474b-baa7-30af35a850d4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:19.333648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e64cd71-050e-474b-baa7-30af35a850d4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:19.333760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6dc3f77b-4a57-43aa-939c-ec37be09b840 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:19.335372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e64cd71-050e-474b-baa7-30af35a850d4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:19.337533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e64cd71-050e-474b-baa7-30af35a850d4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:19.340609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6dc3f77b-4a57-43aa-939c-ec37be09b840 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:19.357461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc3f77b-4a57-43aa-939c-ec37be09b840 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:19.360799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc3f77b-4a57-43aa-939c-ec37be09b840 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:19.360799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc3f77b-4a57-43aa-939c-ec37be09b840 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:19.360799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc3f77b-4a57-43aa-939c-ec37be09b840 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:19.360799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc3f77b-4a57-43aa-939c-ec37be09b840 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:19.372575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc3f77b-4a57-43aa-939c-ec37be09b840 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:19.777657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6dc3f77b-4a57-43aa-939c-ec37be09b840 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:19.790363 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6dc3f77b-4a57-43aa-939c-ec37be09b840 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1319 microversion: 2.1 time: 0.462939 Oct 11 04:11:19.791207 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 124/247] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:19 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1319 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:19.815228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92bad152-38d1-446e-943e-6cd27e36ddb6 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:19.840155 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-92bad152-38d1-446e-943e-6cd27e36ddb6 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] HTTP exception thrown: Aggregate 7 could not be found. Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92bad152-38d1-446e-943e-6cd27e36ddb6 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Request method failure captured: Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-aggregates/7 HTTP/1.1 Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROy22TSQ2p1RcM6nso9C7_hFN9qG1iS2q_raaP1sdNX2Ab75frcdLj8WGQ6cjBWD34blrv-YXLlWZmGwRLbNGudozle5wcaNsg_cZ24Z1ndXozLbHJ1ZKWVB3yVU10kePXx7bTbUPmtFG7Y3cnW0ZYUszBjWZxlqW8_o1KiuBCQBQ0o Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: e3de57a2453143eb902c7b8ae3f72413 Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:11:19.844648 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3de57a2453143eb902c7b8ae3f72413"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e3de57a2453143eb902c7b8ae3f72413"}]}] Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: e3de57a2453143eb902c7b8ae3f72413 Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1030326826 Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AggregatesAdminTestJSON-1030326826-project-admin Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 4b5abfae0e7e4ba6ae34d8b0678ab0ee Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AggregatesAdminTestJSON-1030326826-project-admin Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: exception: Aggregate 7 could not be found. Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '7'} Oct 11 04:11:19.846124 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:11:19.846961 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate 7 could not be found. Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate 7 could not be found. Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:19.848163 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:19.849337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:19.849337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:19.849337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:19.849337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 7 could not be found. Oct 11 04:11:19.849337 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:19.854439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92bad152-38d1-446e-943e-6cd27e36ddb6 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Returning 404 to user: Aggregate 7 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:19.854439 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-92bad152-38d1-446e-943e-6cd27e36ddb6 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/7" status: 404 len: 77 microversion: 2.1 time: 0.059911 Oct 11 04:11:19.854439 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 125/248] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:19 2022] DELETE /compute/v2.1/os-aggregates/7 => generated 77 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:11:19.866531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9656cdf1-da79-445e-ae2b-3202970b61c2 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-953851500"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:19.871990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.aggregate [None req-9656cdf1-da79-445e-ae2b-3202970b61c2 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Generated uuid c5bbbfc6-1192-474c-8eb5-5ae290e9b790 for aggregate {{(pid=120994) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:20.007062 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9656cdf1-da79-445e-ae2b-3202970b61c2 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 197 microversion: 2.1 time: 0.145803 Oct 11 04:11:20.009011 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 126/249] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:19 2022] POST /compute/v2.1/os-aggregates => generated 197 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:20.020831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dac8897e-4e55-424d-8e99-0d1519524f31 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:20.035281 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dac8897e-4e55-424d-8e99-0d1519524f31 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 226 microversion: 2.1 time: 0.018429 Oct 11 04:11:20.038178 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 127/250] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:11:20 2022] GET /compute/v2.1/os-aggregates/8 => generated 226 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:20.050470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-649f3293-fa84-4020-81d7-5881da651ae4 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"key": "value"}}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:20.192601 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-649f3293-fa84-4020-81d7-5881da651ae4 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/8/action" status: 200 len: 264 microversion: 2.1 time: 0.146557 Oct 11 04:11:20.193218 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 128/251] 10.222.0.26 () {60 vars in 1191 bytes} [Tue Oct 11 04:11:20 2022] POST /compute/v2.1/os-aggregates/8/action => generated 264 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:20.204651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eea26ecc-eb83-4a47-b5ff-f7c1333406da tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:20.224394 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eea26ecc-eb83-4a47-b5ff-f7c1333406da tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/8" status: 200 len: 240 microversion: 2.1 time: 0.022238 Oct 11 04:11:20.228910 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 129/252] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:11:20 2022] GET /compute/v2.1/os-aggregates/8 => generated 240 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:20.252251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-521f5dee-0fde-4e8e-92be-1df6aea36fc7 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:20.308144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6e64cd71-050e-474b-baa7-30af35a850d4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:20.323600 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6e64cd71-050e-474b-baa7-30af35a850d4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 1.014403 Oct 11 04:11:20.328538 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 124/253] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:19 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 1022 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:20.338331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bc96e84a-dc19-4902-b860-264669e4a8a0 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:20.341753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bc96e84a-dc19-4902-b860-264669e4a8a0 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:20.356235 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-521f5dee-0fde-4e8e-92be-1df6aea36fc7 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/8" status: 200 len: 0 microversion: 2.1 time: 0.108753 Oct 11 04:11:20.359125 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 130/254] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:20 2022] DELETE /compute/v2.1/os-aggregates/8 => generated 0 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:20.359711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc96e84a-dc19-4902-b860-264669e4a8a0 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:20.361063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc96e84a-dc19-4902-b860-264669e4a8a0 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:20.361732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc96e84a-dc19-4902-b860-264669e4a8a0 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:20.362755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc96e84a-dc19-4902-b860-264669e4a8a0 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:20.365110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b11a31a-7be7-467e-9224-426eec11697e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:20.365723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc96e84a-dc19-4902-b860-264669e4a8a0 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:20.365905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b11a31a-7be7-467e-9224-426eec11697e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:20.366327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc96e84a-dc19-4902-b860-264669e4a8a0 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:20.379129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b11a31a-7be7-467e-9224-426eec11697e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:20.379619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b11a31a-7be7-467e-9224-426eec11697e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:20.380041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b11a31a-7be7-467e-9224-426eec11697e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:20.383413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b11a31a-7be7-467e-9224-426eec11697e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:20.386839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b11a31a-7be7-467e-9224-426eec11697e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:20.387526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b11a31a-7be7-467e-9224-426eec11697e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:20.628657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b11a31a-7be7-467e-9224-426eec11697e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:20.645888 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b11a31a-7be7-467e-9224-426eec11697e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.287267 Oct 11 04:11:20.646483 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 131/255] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:20 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:20.664805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d831c6bf-9a2b-47c5-92c9-6997fd7ee458 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-165008620", "availability_zone": "tempest-test_az-373100469"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:20.705429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.aggregate [None req-d831c6bf-9a2b-47c5-92c9-6997fd7ee458 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Generated uuid 4d7b906c-3d86-46b1-961c-eb6afc1ad32c for aggregate {{(pid=120994) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:20.724676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=7,nova_api:INSERT=7 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:20.833716 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d831c6bf-9a2b-47c5-92c9-6997fd7ee458 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 220 microversion: 2.1 time: 0.186188 Oct 11 04:11:20.834951 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 132/256] 10.222.0.26 () {60 vars in 1165 bytes} [Tue Oct 11 04:11:20 2022] POST /compute/v2.1/os-aggregates => generated 220 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:20.845403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49d67b21-b001-42d8-93a4-7d2d618bcd28 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:20.846322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-49d67b21-b001-42d8-93a4-7d2d618bcd28 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:20.855109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49d67b21-b001-42d8-93a4-7d2d618bcd28 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:20.858221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49d67b21-b001-42d8-93a4-7d2d618bcd28 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:20.863621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49d67b21-b001-42d8-93a4-7d2d618bcd28 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:20.864628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49d67b21-b001-42d8-93a4-7d2d618bcd28 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:20.865244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49d67b21-b001-42d8-93a4-7d2d618bcd28 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:20.866399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49d67b21-b001-42d8-93a4-7d2d618bcd28 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:21.041941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bc96e84a-dc19-4902-b860-264669e4a8a0 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:21.057087 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bc96e84a-dc19-4902-b860-264669e4a8a0 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1319 microversion: 2.1 time: 0.719900 Oct 11 04:11:21.058036 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 125/257] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:20 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1319 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:21.079957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-181e548c-4fdd-451c-9d0d-818ca3d3e8dd tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-165008620_new", "availability_zone": "tempest-test_az-373100469_new"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:21.182097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181e548c-4fdd-451c-9d0d-818ca3d3e8dd tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:21.182652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181e548c-4fdd-451c-9d0d-818ca3d3e8dd tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:21.183086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181e548c-4fdd-451c-9d0d-818ca3d3e8dd tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:21.284259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-49d67b21-b001-42d8-93a4-7d2d618bcd28 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:21.296722 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-49d67b21-b001-42d8-93a4-7d2d618bcd28 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1319 microversion: 2.1 time: 0.460390 Oct 11 04:11:21.297424 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 133/258] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:20 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1319 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:21.309894 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-181e548c-4fdd-451c-9d0d-818ca3d3e8dd tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/9" status: 200 len: 333 microversion: 2.1 time: 0.248647 Oct 11 04:11:21.319520 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 126/259] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:11:21 2022] PUT /compute/v2.1/os-aggregates/9 => generated 333 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:21.322955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92753ed6-0253-4635-9b2c-c1508ab70ea1 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:21.331840 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-92753ed6-0253-4635-9b2c-c1508ab70ea1 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 336 microversion: 2.1 time: 0.012581 Oct 11 04:11:21.334324 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 134/260] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:11:21 2022] GET /compute/v2.1/os-aggregates => generated 336 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:21.356970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-14e98eaf-c125-4c39-8ac5-cd3e0424ea41 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:21.356970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-14e98eaf-c125-4c39-8ac5-cd3e0424ea41 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:21.362538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4c697df2-c2e2-4ac2-89fe-ea276eea5a72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:21.363016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14e98eaf-c125-4c39-8ac5-cd3e0424ea41 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:21.363299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14e98eaf-c125-4c39-8ac5-cd3e0424ea41 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:21.364199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14e98eaf-c125-4c39-8ac5-cd3e0424ea41 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:21.365240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14e98eaf-c125-4c39-8ac5-cd3e0424ea41 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:21.365860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14e98eaf-c125-4c39-8ac5-cd3e0424ea41 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:21.366374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14e98eaf-c125-4c39-8ac5-cd3e0424ea41 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:21.461744 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4c697df2-c2e2-4ac2-89fe-ea276eea5a72 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/9" status: 200 len: 0 microversion: 2.1 time: 0.102942 Oct 11 04:11:21.466953 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 135/261] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:21 2022] DELETE /compute/v2.1/os-aggregates/9 => generated 0 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 355 bytes (2 switches on core 0) Oct 11 04:11:21.471742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b3253e4a-663a-40e6-a116-7c13bfa7081b tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1765956845"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:21.475443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.aggregate [None req-b3253e4a-663a-40e6-a116-7c13bfa7081b tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Generated uuid e3f1f4e8-e552-4ac1-829d-230740973852 for aggregate {{(pid=120994) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:21.585171 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b3253e4a-663a-40e6-a116-7c13bfa7081b tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.116733 Oct 11 04:11:21.595117 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 136/262] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:21 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:21.605307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-010c53f9-18b2-495b-bcf1-b61c753f5a92 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:21.623284 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-010c53f9-18b2-495b-bcf1-b61c753f5a92 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 231 microversion: 2.1 time: 0.026598 Oct 11 04:11:21.643416 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 137/263] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:11:21 2022] GET /compute/v2.1/os-aggregates => generated 231 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:21.654231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-84f470de-96d0-4a3c-961c-a0b08708ad62 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:21.820911 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-84f470de-96d0-4a3c-961c-a0b08708ad62 tempest-AggregatesAdminTestJSON-1030326826 tempest-AggregatesAdminTestJSON-1030326826-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/10" status: 200 len: 0 microversion: 2.1 time: 0.175625 Oct 11 04:11:21.827694 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 138/264] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:21 2022] DELETE /compute/v2.1/os-aggregates/10 => generated 0 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:21.835309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-53bb545b-d623-4956-87c7-38feae6515d6 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:21.836213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-53bb545b-d623-4956-87c7-38feae6515d6 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:21.846569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53bb545b-d623-4956-87c7-38feae6515d6 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:21.847657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53bb545b-d623-4956-87c7-38feae6515d6 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:21.848398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53bb545b-d623-4956-87c7-38feae6515d6 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:21.851104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53bb545b-d623-4956-87c7-38feae6515d6 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:21.851104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53bb545b-d623-4956-87c7-38feae6515d6 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:21.851104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53bb545b-d623-4956-87c7-38feae6515d6 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:21.970806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-14e98eaf-c125-4c39-8ac5-cd3e0424ea41 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:21.989325 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-14e98eaf-c125-4c39-8ac5-cd3e0424ea41 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.643659 Oct 11 04:11:21.990271 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 127/265] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:21 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:21.999226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:22.000668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:22.019528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:22.019986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:22.021369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:22.028391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:22.029123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:22.029757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:22.055854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=36 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:22.057869 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] HTTP exception thrown: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Request method failure captured: Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f HTTP/1.1 Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROyznrTJV__JIlwvf8tB2hd0vSrmfaw0ReVcwYKhVDulQg51zBWZw4yI0FhL3dNznTg8auzu-5clpiFblrV7yyIAQPN6mP_QxYRktvob7FEQEJai_gPD_9vkhCDls_lT5iRF6r9v2AX-sjCMzBOUEf1PSlc5n-53tGaNgYmLDFZr2zU Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 3aacdd09e90e4e0f8f76986dc3c91e10 Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminTestJSON-1197376464 Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:22.059823 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3aacdd09e90e4e0f8f76986dc3c91e10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3aacdd09e90e4e0f8f76986dc3c91e10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3aacdd09e90e4e0f8f76986dc3c91e10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3aacdd09e90e4e0f8f76986dc3c91e10"}]}] Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminTestJSON-1197376464 Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 3aacdd09e90e4e0f8f76986dc3c91e10 Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1197376464 Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminTestJSON-1197376464-project Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a81b54be42b74a948b0340177ca9f7bc Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminTestJSON-1197376464-project Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:22.061210 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '57379b24-c543-4dbc-84f9-0e1a11e2b20f'} Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:22.062015 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:22.063307 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:22.065487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Returning 404 to user: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:22.066658 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b910e837-523f-4305-b005-1abb51365f98 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "DELETE /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 404 len: 111 microversion: 2.1 time: 0.075418 Oct 11 04:11:22.067370 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 128/266] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:11:21 2022] DELETE /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:22.076364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-1fd9818b-788a-48bb-b65d-a093a418c45c req-f97578dd-9ea2-4280-935a-164aa0a4f220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a2d8cb-5666-44f2-b773-bc4305262557", "name": "network-vif-plugged", "status": "completed", "tag": "7b731ed1-208b-42f4-befd-6f133da74aff"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:22.087032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1fd9818b-788a-48bb-b65d-a093a418c45c req-f97578dd-9ea2-4280-935a-164aa0a4f220 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:22.087696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1fd9818b-788a-48bb-b65d-a093a418c45c req-f97578dd-9ea2-4280-935a-164aa0a4f220 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:22.088126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1fd9818b-788a-48bb-b65d-a093a418c45c req-f97578dd-9ea2-4280-935a-164aa0a4f220 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:22.101587 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-1fd9818b-788a-48bb-b65d-a093a418c45c req-f97578dd-9ea2-4280-935a-164aa0a4f220 service nova] Creating event network-vif-plugged:7b731ed1-208b-42f4-befd-6f133da74aff for instance e3a2d8cb-5666-44f2-b773-bc4305262557 on n-h1-860892-1 Oct 11 04:11:22.107035 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-1fd9818b-788a-48bb-b65d-a093a418c45c req-f97578dd-9ea2-4280-935a-164aa0a4f220 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038204 Oct 11 04:11:22.111501 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 129/267] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:22.117963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:22.118698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] [instance: 57379b24-c543-4dbc-84f9-0e1a11e2b20f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:22.126324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:22.126996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:22.127441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:22.128151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:22.128647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:22.129238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:22.157276 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] HTTP exception thrown: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Request method failure captured: Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f HTTP/1.1 Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROyznrTJV__JIlwvf8tB2hd0vSrmfaw0ReVcwYKhVDulQg51zBWZw4yI0FhL3dNznTg8auzu-5clpiFblrV7yyIAQPN6mP_QxYRktvob7FEQEJai_gPD_9vkhCDls_lT5iRF6r9v2AX-sjCMzBOUEf1PSlc5n-53tGaNgYmLDFZr2zU Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 3aacdd09e90e4e0f8f76986dc3c91e10 Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminTestJSON-1197376464 Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:22.164026 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3aacdd09e90e4e0f8f76986dc3c91e10"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3aacdd09e90e4e0f8f76986dc3c91e10"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3aacdd09e90e4e0f8f76986dc3c91e10"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3aacdd09e90e4e0f8f76986dc3c91e10"}]}] Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminTestJSON-1197376464 Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 3aacdd09e90e4e0f8f76986dc3c91e10 Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminTestJSON-1197376464 Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminTestJSON-1197376464-project Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a81b54be42b74a948b0340177ca9f7bc Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminTestJSON-1197376464-project Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:22.165414 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '57379b24-c543-4dbc-84f9-0e1a11e2b20f'} Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:22.166231 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. Oct 11 04:11:22.167513 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:22.168630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] Returning 404 to user: Instance 57379b24-c543-4dbc-84f9-0e1a11e2b20f could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:22.168630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c3695ca-237e-45f8-9ce1-ff45c19b6b42 tempest-AggregatesAdminTestJSON-1197376464 tempest-AggregatesAdminTestJSON-1197376464-project] 10.222.0.26 "GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f" status: 404 len: 111 microversion: 2.1 time: 0.054981 Oct 11 04:11:22.169918 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 130/268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:22 2022] GET /compute/v2.1/servers/57379b24-c543-4dbc-84f9-0e1a11e2b20f => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:22.179140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bf7d4b29-8055-43cb-ad1b-5540fad4e330 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:22.179757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bf7d4b29-8055-43cb-ad1b-5540fad4e330 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:22.191275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b29-8055-43cb-ad1b-5540fad4e330 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:22.191995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b29-8055-43cb-ad1b-5540fad4e330 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:22.193150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b29-8055-43cb-ad1b-5540fad4e330 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:22.194289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b29-8055-43cb-ad1b-5540fad4e330 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:22.194750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b29-8055-43cb-ad1b-5540fad4e330 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:22.195224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf7d4b29-8055-43cb-ad1b-5540fad4e330 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:22.607338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf7d4b29-8055-43cb-ad1b-5540fad4e330 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:22.617821 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bf7d4b29-8055-43cb-ad1b-5540fad4e330 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1319 microversion: 2.1 time: 0.442198 Oct 11 04:11:22.630669 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 131/269] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:22 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:22.642896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-08cf4663-96fa-42ef-bb76-4c5fab779c65 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:22.644007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-08cf4663-96fa-42ef-bb76-4c5fab779c65 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:22.651016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08cf4663-96fa-42ef-bb76-4c5fab779c65 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:22.652410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08cf4663-96fa-42ef-bb76-4c5fab779c65 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:22.653130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08cf4663-96fa-42ef-bb76-4c5fab779c65 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:22.658487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08cf4663-96fa-42ef-bb76-4c5fab779c65 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:22.658487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08cf4663-96fa-42ef-bb76-4c5fab779c65 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:22.658487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08cf4663-96fa-42ef-bb76-4c5fab779c65 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:22.681004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-53bb545b-d623-4956-87c7-38feae6515d6 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:22.694655 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-53bb545b-d623-4956-87c7-38feae6515d6 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.864611 Oct 11 04:11:22.701761 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 139/270] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:21 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:22.707537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-baf69b83-5baf-4349-8cd5-2c8e924673d7 req-9b43debe-f09c-4697-90a2-4d96e6a14004 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fb89fb-a3af-4372-a794-e1583259b555", "tag": "fe0d100a-b7c1-4434-9679-422de267ee5e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:22.731482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-baf69b83-5baf-4349-8cd5-2c8e924673d7 req-9b43debe-f09c-4697-90a2-4d96e6a14004 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:22.732104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-baf69b83-5baf-4349-8cd5-2c8e924673d7 req-9b43debe-f09c-4697-90a2-4d96e6a14004 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:22.732729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-baf69b83-5baf-4349-8cd5-2c8e924673d7 req-9b43debe-f09c-4697-90a2-4d96e6a14004 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:22.761892 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-baf69b83-5baf-4349-8cd5-2c8e924673d7 req-9b43debe-f09c-4697-90a2-4d96e6a14004 service nova] Creating event network-changed:fe0d100a-b7c1-4434-9679-422de267ee5e for instance 22fb89fb-a3af-4372-a794-e1583259b555 on n-h1-860892-1 Oct 11 04:11:22.776077 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-baf69b83-5baf-4349-8cd5-2c8e924673d7 req-9b43debe-f09c-4697-90a2-4d96e6a14004 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071531 Oct 11 04:11:22.776993 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 140/271] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:23.018358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dbaa5138-b6e2-413f-8f1e-615ac79292a4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:23.019064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dbaa5138-b6e2-413f-8f1e-615ac79292a4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:23.027999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbaa5138-b6e2-413f-8f1e-615ac79292a4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:23.028495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbaa5138-b6e2-413f-8f1e-615ac79292a4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:23.037227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbaa5138-b6e2-413f-8f1e-615ac79292a4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:23.038256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbaa5138-b6e2-413f-8f1e-615ac79292a4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:23.041158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbaa5138-b6e2-413f-8f1e-615ac79292a4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:23.045339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbaa5138-b6e2-413f-8f1e-615ac79292a4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:23.133995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=10 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:23.293492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dbaa5138-b6e2-413f-8f1e-615ac79292a4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:23.295828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-08cf4663-96fa-42ef-bb76-4c5fab779c65 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:23.307225 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-08cf4663-96fa-42ef-bb76-4c5fab779c65 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1319 microversion: 2.1 time: 0.674882 Oct 11 04:11:23.329145 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dbaa5138-b6e2-413f-8f1e-615ac79292a4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.308948 Oct 11 04:11:23.337632 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 141/273] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:23 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:23.337808 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 132/273] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:22 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1319 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:23.646166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-96c8b17d-25dd-4d6d-80d2-e239107259fd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:23.646879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-96c8b17d-25dd-4d6d-80d2-e239107259fd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:23.662807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96c8b17d-25dd-4d6d-80d2-e239107259fd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:23.665710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96c8b17d-25dd-4d6d-80d2-e239107259fd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:23.666041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96c8b17d-25dd-4d6d-80d2-e239107259fd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:23.668857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96c8b17d-25dd-4d6d-80d2-e239107259fd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:23.670257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96c8b17d-25dd-4d6d-80d2-e239107259fd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:23.670901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96c8b17d-25dd-4d6d-80d2-e239107259fd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:23.722692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6943007-ca8c-43b1-b1ab-6081448902ed tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:23.723870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f6943007-ca8c-43b1-b1ab-6081448902ed tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:23.729985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=10 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:23.742883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6943007-ca8c-43b1-b1ab-6081448902ed tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:23.743385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6943007-ca8c-43b1-b1ab-6081448902ed tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:23.743818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6943007-ca8c-43b1-b1ab-6081448902ed tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:23.744522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6943007-ca8c-43b1-b1ab-6081448902ed tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:23.751600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6943007-ca8c-43b1-b1ab-6081448902ed tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:23.752094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6943007-ca8c-43b1-b1ab-6081448902ed tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:24.361826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-96c8b17d-25dd-4d6d-80d2-e239107259fd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:24.361826 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-96c8b17d-25dd-4d6d-80d2-e239107259fd tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1319 microversion: 2.1 time: 0.412466 Oct 11 04:11:24.361826 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 142/274] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:23 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1319 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:24.362487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f6943007-ca8c-43b1-b1ab-6081448902ed tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:24.362487 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f6943007-ca8c-43b1-b1ab-6081448902ed tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.614929 Oct 11 04:11:24.362487 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 133/275] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:23 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:24.362487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a26d8e10-2bce-4323-a3cd-eb354e90eaec tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:24.363665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a26d8e10-2bce-4323-a3cd-eb354e90eaec tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:24.363665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a26d8e10-2bce-4323-a3cd-eb354e90eaec tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:24.363665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a26d8e10-2bce-4323-a3cd-eb354e90eaec tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:24.363665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a26d8e10-2bce-4323-a3cd-eb354e90eaec tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:24.363935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a26d8e10-2bce-4323-a3cd-eb354e90eaec tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:24.363935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a26d8e10-2bce-4323-a3cd-eb354e90eaec tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:24.363935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a26d8e10-2bce-4323-a3cd-eb354e90eaec tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:24.639965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=20 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:24.872165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a26d8e10-2bce-4323-a3cd-eb354e90eaec tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:24.879218 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a26d8e10-2bce-4323-a3cd-eb354e90eaec tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1319 microversion: 2.1 time: 0.543338 Oct 11 04:11:24.880118 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 134/276] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:24 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1319 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:24.885232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9c158f59-c161-4cbf-b49b-af19c90d3a25 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:24.885838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9c158f59-c161-4cbf-b49b-af19c90d3a25 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:24.894520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c158f59-c161-4cbf-b49b-af19c90d3a25 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:24.895059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c158f59-c161-4cbf-b49b-af19c90d3a25 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:24.895565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c158f59-c161-4cbf-b49b-af19c90d3a25 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:24.897807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c158f59-c161-4cbf-b49b-af19c90d3a25 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:24.898335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c158f59-c161-4cbf-b49b-af19c90d3a25 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:24.898770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c158f59-c161-4cbf-b49b-af19c90d3a25 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:25.117038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationNegativeTestJSON-server-200823552", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "2e802a11-7516-4fd9-9555-e418218d18bb"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:25.239274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] validate_networks() for [('2e802a11-7516-4fd9-9555-e418218d18bb', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:11:25.279686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9c158f59-c161-4cbf-b49b-af19c90d3a25 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:25.289655 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9c158f59-c161-4cbf-b49b-af19c90d3a25 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.408480 Oct 11 04:11:25.290570 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 135/277] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:24 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:25.309579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-50971dbf-5423-4f41-9a20-d27ebc786ec6 req-6f007f5f-6977-4b8c-b016-da904cdc95a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d4c47a-c1d1-4481-b151-a43194e08f7f", "tag": "e779dffe-9789-4f6d-9b68-6cd98f3d9c98"}, {"name": "network-changed", "server_uuid": "c0a8d846-d0db-4641-80ce-8ed3e5e04d12", "tag": "ab6df6f4-1334-42fb-8aa1-62a66c1e80a9"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:25.324171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-50971dbf-5423-4f41-9a20-d27ebc786ec6 req-6f007f5f-6977-4b8c-b016-da904cdc95a2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:25.325339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-50971dbf-5423-4f41-9a20-d27ebc786ec6 req-6f007f5f-6977-4b8c-b016-da904cdc95a2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:25.326197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-50971dbf-5423-4f41-9a20-d27ebc786ec6 req-6f007f5f-6977-4b8c-b016-da904cdc95a2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:25.341113 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-50971dbf-5423-4f41-9a20-d27ebc786ec6 req-6f007f5f-6977-4b8c-b016-da904cdc95a2 service nova] Creating event network-changed:e779dffe-9789-4f6d-9b68-6cd98f3d9c98 for instance 32d4c47a-c1d1-4481-b151-a43194e08f7f on n-h2-860892-1 Oct 11 04:11:25.341884 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-50971dbf-5423-4f41-9a20-d27ebc786ec6 req-6f007f5f-6977-4b8c-b016-da904cdc95a2 service nova] Creating event network-changed:ab6df6f4-1334-42fb-8aa1-62a66c1e80a9 for instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 on n-h2-860892-1 Oct 11 04:11:25.350940 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-50971dbf-5423-4f41-9a20-d27ebc786ec6 req-6f007f5f-6977-4b8c-b016-da904cdc95a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.058914 Oct 11 04:11:25.352153 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 136/278] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:25.379728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-14dca9dc-e8d7-4459-87ce-7316bba4bdc2 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:25.380715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-14dca9dc-e8d7-4459-87ce-7316bba4bdc2 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:25.396898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dca9dc-e8d7-4459-87ce-7316bba4bdc2 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:25.396898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dca9dc-e8d7-4459-87ce-7316bba4bdc2 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:25.396898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dca9dc-e8d7-4459-87ce-7316bba4bdc2 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:25.396898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dca9dc-e8d7-4459-87ce-7316bba4bdc2 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:25.397199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dca9dc-e8d7-4459-87ce-7316bba4bdc2 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:25.397199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dca9dc-e8d7-4459-87ce-7316bba4bdc2 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:25.653836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-14dca9dc-e8d7-4459-87ce-7316bba4bdc2 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:25.671793 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-14dca9dc-e8d7-4459-87ce-7316bba4bdc2 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1386 microversion: 2.1 time: 0.297215 Oct 11 04:11:25.688558 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 137/279] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:25 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1386 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:25.694927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b62c3031-585d-4f54-a730-60fb476d87be tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:25.701674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b62c3031-585d-4f54-a730-60fb476d87be tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:25.703454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b62c3031-585d-4f54-a730-60fb476d87be tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:25.704173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b62c3031-585d-4f54-a730-60fb476d87be tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:25.704817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b62c3031-585d-4f54-a730-60fb476d87be tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:25.705783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b62c3031-585d-4f54-a730-60fb476d87be tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:25.706571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b62c3031-585d-4f54-a730-60fb476d87be tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:25.707218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b62c3031-585d-4f54-a730-60fb476d87be tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:25.880104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b62c3031-585d-4f54-a730-60fb476d87be tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:25.889481 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b62c3031-585d-4f54-a730-60fb476d87be tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1319 microversion: 2.1 time: 0.198426 Oct 11 04:11:25.891534 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 138/280] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:25 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:26.069275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-764b9c01-a543-4a37-a605-95f1ac8e457c tempest-InstanceUsageAuditLogTestJSON-1502366792 tempest-InstanceUsageAuditLogTestJSON-1502366792-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:26.091462 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-764b9c01-a543-4a37-a605-95f1ac8e457c tempest-InstanceUsageAuditLogTestJSON-1502366792 tempest-InstanceUsageAuditLogTestJSON-1502366792-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11 04:11:25" status: 200 len: 318 microversion: 2.1 time: 0.198747 Oct 11 04:11:26.098371 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 139/281] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:11:25 2022] GET /compute/v2.1/os-instance_usage_audit_log/2022-10-11%2004%3A11%3A25 => generated 318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:26.103287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-af15aaa3-03f0-437c-ac7e-00da111c097d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:26.103900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-af15aaa3-03f0-437c-ac7e-00da111c097d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:26.110218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15aaa3-03f0-437c-ac7e-00da111c097d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:26.110744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15aaa3-03f0-437c-ac7e-00da111c097d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:26.111198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15aaa3-03f0-437c-ac7e-00da111c097d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:26.112090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15aaa3-03f0-437c-ac7e-00da111c097d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:26.112550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15aaa3-03f0-437c-ac7e-00da111c097d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:26.113008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15aaa3-03f0-437c-ac7e-00da111c097d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:26.371347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-af15aaa3-03f0-437c-ac7e-00da111c097d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:26.384562 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-af15aaa3-03f0-437c-ac7e-00da111c097d tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1319 microversion: 2.1 time: 0.291202 Oct 11 04:11:26.385748 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 140/282] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:26 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1319 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:26.414439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8065b23e-40dd-4b12-9be4-3d01cac9088d tempest-InstanceUsageAuditLogTestJSON-1502366792 tempest-InstanceUsageAuditLogTestJSON-1502366792-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:26.433068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8065b23e-40dd-4b12-9be4-3d01cac9088d tempest-InstanceUsageAuditLogTestJSON-1502366792 tempest-InstanceUsageAuditLogTestJSON-1502366792-project-admin] 10.222.0.26 "GET /compute/v2.1/os-instance_usage_audit_log" status: 200 len: 319 microversion: 2.1 time: 0.045992 Oct 11 04:11:26.433859 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 141/283] 10.222.0.26 () {58 vars in 1185 bytes} [Tue Oct 11 04:11:26 2022] GET /compute/v2.1/os-instance_usage_audit_log => generated 319 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:26.439671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-34bf2f42-9e97-4ce8-845f-8e04792e33d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:26.440585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-34bf2f42-9e97-4ce8-845f-8e04792e33d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:26.461383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34bf2f42-9e97-4ce8-845f-8e04792e33d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:26.463738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34bf2f42-9e97-4ce8-845f-8e04792e33d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:26.464964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34bf2f42-9e97-4ce8-845f-8e04792e33d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:26.465766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34bf2f42-9e97-4ce8-845f-8e04792e33d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:26.466634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34bf2f42-9e97-4ce8-845f-8e04792e33d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:26.467372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34bf2f42-9e97-4ce8-845f-8e04792e33d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:26.588715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:11:26.588715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:11:26.588715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:11:26.589254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:11:26.589428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:11:26.600648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:26.601483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:26.602236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:26.603349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:26.604163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:26.605016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:26.626974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Getting quotas for project 958f9ef6f9ec4cd6895b9b1569bce0d7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:26.631893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Getting quotas for user 0bc868b9a97a4e0faea48318c6a4855f and project 958f9ef6f9ec4cd6895b9b1569bce0d7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:26.664814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:11:26.667399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:11:26.667562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-34bf2f42-9e97-4ce8-845f-8e04792e33d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:26.676098 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-34bf2f42-9e97-4ce8-845f-8e04792e33d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.240863 Oct 11 04:11:26.676665 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 142/284] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:26 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:26.695611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-72a26b8b-388a-4d9d-91e5-0f0d544f8f18 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:26.696231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-72a26b8b-388a-4d9d-91e5-0f0d544f8f18 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:26.703662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72a26b8b-388a-4d9d-91e5-0f0d544f8f18 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:26.704158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72a26b8b-388a-4d9d-91e5-0f0d544f8f18 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:26.704588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72a26b8b-388a-4d9d-91e5-0f0d544f8f18 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:26.705668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72a26b8b-388a-4d9d-91e5-0f0d544f8f18 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:26.706386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72a26b8b-388a-4d9d-91e5-0f0d544f8f18 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:26.706967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72a26b8b-388a-4d9d-91e5-0f0d544f8f18 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:26.910480 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-db818f51-f3c9-410e-8bda-28f5be4215c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.854996 Oct 11 04:11:26.913477 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 143/285] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:11:26.940771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-72a26b8b-388a-4d9d-91e5-0f0d544f8f18 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:26.948829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a469a774-82ed-438e-a479-2c4f7275df76 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:26.953672 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-72a26b8b-388a-4d9d-91e5-0f0d544f8f18 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1585 microversion: 2.1 time: 0.261868 Oct 11 04:11:26.954047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a469a774-82ed-438e-a479-2c4f7275df76 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:26.954275 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 143/286] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:26 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1585 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:26.969075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e817f29d-a2f8-4a9f-abbd-91cc47b5e0f9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:26.969505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a469a774-82ed-438e-a479-2c4f7275df76 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:26.970139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a469a774-82ed-438e-a479-2c4f7275df76 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:26.970909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a469a774-82ed-438e-a479-2c4f7275df76 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:26.971793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a469a774-82ed-438e-a479-2c4f7275df76 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:26.972567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e817f29d-a2f8-4a9f-abbd-91cc47b5e0f9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:26.973085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a469a774-82ed-438e-a479-2c4f7275df76 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:26.973519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a469a774-82ed-438e-a479-2c4f7275df76 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:27.060319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e817f29d-a2f8-4a9f-abbd-91cc47b5e0f9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:27.075022 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e817f29d-a2f8-4a9f-abbd-91cc47b5e0f9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1231 microversion: 2.1 time: 0.115445 Oct 11 04:11:27.085180 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 144/287] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:26 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1231 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:27.085180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ebc5058-e62b-49d5-9818-89f590db648f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:27.086637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ebc5058-e62b-49d5-9818-89f590db648f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:27.108853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ebc5058-e62b-49d5-9818-89f590db648f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:27.114573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ebc5058-e62b-49d5-9818-89f590db648f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:27.114573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ebc5058-e62b-49d5-9818-89f590db648f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:27.114573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ebc5058-e62b-49d5-9818-89f590db648f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:27.115501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ebc5058-e62b-49d5-9818-89f590db648f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:27.115997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ebc5058-e62b-49d5-9818-89f590db648f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:27.479512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a469a774-82ed-438e-a479-2c4f7275df76 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:27.492662 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a469a774-82ed-438e-a479-2c4f7275df76 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1319 microversion: 2.1 time: 0.574197 Oct 11 04:11:27.497926 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 144/288] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:26 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1319 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:27.538555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ffed67e9-c69d-491b-8f1b-90b09a4debe3 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:27.540030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ffed67e9-c69d-491b-8f1b-90b09a4debe3 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:27.576257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffed67e9-c69d-491b-8f1b-90b09a4debe3 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:27.586861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffed67e9-c69d-491b-8f1b-90b09a4debe3 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:27.587408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffed67e9-c69d-491b-8f1b-90b09a4debe3 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:27.588159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffed67e9-c69d-491b-8f1b-90b09a4debe3 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:27.591018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffed67e9-c69d-491b-8f1b-90b09a4debe3 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:27.591589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffed67e9-c69d-491b-8f1b-90b09a4debe3 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:27.706040 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ebc5058-e62b-49d5-9818-89f590db648f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.628138 Oct 11 04:11:27.715206 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 145/289] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:11:27 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557/os-interface => generated 285 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:27.719392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5947cb88-75c4-43bb-b145-7e774059d560 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:27.720038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5947cb88-75c4-43bb-b145-7e774059d560 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:27.727658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5947cb88-75c4-43bb-b145-7e774059d560 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:27.728365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5947cb88-75c4-43bb-b145-7e774059d560 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:27.728975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5947cb88-75c4-43bb-b145-7e774059d560 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:27.729883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5947cb88-75c4-43bb-b145-7e774059d560 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:27.730555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5947cb88-75c4-43bb-b145-7e774059d560 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:27.731336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5947cb88-75c4-43bb-b145-7e774059d560 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:27.738302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:28.318834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ffed67e9-c69d-491b-8f1b-90b09a4debe3 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:28.332316 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ffed67e9-c69d-491b-8f1b-90b09a4debe3 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1319 microversion: 2.1 time: 0.830324 Oct 11 04:11:28.333362 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 145/290] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:27 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1319 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:28.346318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1189b247-36c5-4f8f-a903-5a54a65ed9eb tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:28.347290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1189b247-36c5-4f8f-a903-5a54a65ed9eb tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:28.540220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5947cb88-75c4-43bb-b145-7e774059d560 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:28.549767 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5947cb88-75c4-43bb-b145-7e774059d560 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.841873 Oct 11 04:11:28.573391 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 146/291] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:27 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:28.579058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b27fab4-0e7e-41b3-99f2-24a922e0f67c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:28.580523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b27fab4-0e7e-41b3-99f2-24a922e0f67c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:28.597380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b27fab4-0e7e-41b3-99f2-24a922e0f67c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:28.597890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b27fab4-0e7e-41b3-99f2-24a922e0f67c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:28.598315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b27fab4-0e7e-41b3-99f2-24a922e0f67c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:28.601050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b27fab4-0e7e-41b3-99f2-24a922e0f67c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:28.604113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b27fab4-0e7e-41b3-99f2-24a922e0f67c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:28.604735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b27fab4-0e7e-41b3-99f2-24a922e0f67c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:28.658082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1189b247-36c5-4f8f-a903-5a54a65ed9eb tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:28.672889 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1189b247-36c5-4f8f-a903-5a54a65ed9eb tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1231 microversion: 2.1 time: 0.338174 Oct 11 04:11:28.674961 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 146/292] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:28 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1231 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:29.038597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b27fab4-0e7e-41b3-99f2-24a922e0f67c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:29.047202 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b27fab4-0e7e-41b3-99f2-24a922e0f67c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1319 microversion: 2.1 time: 0.472378 Oct 11 04:11:29.055119 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 147/293] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:28 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1319 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:29.352777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-001915c8-ee95-4d45-a13c-8200c4ef12f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:29.353528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-001915c8-ee95-4d45-a13c-8200c4ef12f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:29.370553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-001915c8-ee95-4d45-a13c-8200c4ef12f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:29.371376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-001915c8-ee95-4d45-a13c-8200c4ef12f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:29.372298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-001915c8-ee95-4d45-a13c-8200c4ef12f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:29.373103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-001915c8-ee95-4d45-a13c-8200c4ef12f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:29.373621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-001915c8-ee95-4d45-a13c-8200c4ef12f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:29.375413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-001915c8-ee95-4d45-a13c-8200c4ef12f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:29.427808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:29.580860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6140634e-f0cd-458a-af68-108bf076850d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:29.581613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6140634e-f0cd-458a-af68-108bf076850d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:29.588583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6140634e-f0cd-458a-af68-108bf076850d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:29.589495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6140634e-f0cd-458a-af68-108bf076850d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:29.590159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6140634e-f0cd-458a-af68-108bf076850d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:29.591227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6140634e-f0cd-458a-af68-108bf076850d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:29.591931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6140634e-f0cd-458a-af68-108bf076850d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:29.592786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6140634e-f0cd-458a-af68-108bf076850d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:29.807435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-001915c8-ee95-4d45-a13c-8200c4ef12f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:29.819127 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-001915c8-ee95-4d45-a13c-8200c4ef12f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1319 microversion: 2.1 time: 0.468431 Oct 11 04:11:29.839666 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 147/294] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:29 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1319 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:30.004848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6140634e-f0cd-458a-af68-108bf076850d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:30.020632 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6140634e-f0cd-458a-af68-108bf076850d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.443498 Oct 11 04:11:30.021799 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 148/295] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:29 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:30.027027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-baea6c8d-abf0-4f7a-8b41-9c0b9d2a0c0f tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:30.032493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-baea6c8d-abf0-4f7a-8b41-9c0b9d2a0c0f tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:30.041187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baea6c8d-abf0-4f7a-8b41-9c0b9d2a0c0f tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:30.043853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baea6c8d-abf0-4f7a-8b41-9c0b9d2a0c0f tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:30.044566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baea6c8d-abf0-4f7a-8b41-9c0b9d2a0c0f tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:30.045501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baea6c8d-abf0-4f7a-8b41-9c0b9d2a0c0f tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:30.050517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baea6c8d-abf0-4f7a-8b41-9c0b9d2a0c0f tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:30.051164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baea6c8d-abf0-4f7a-8b41-9c0b9d2a0c0f tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:30.096600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-996f6bff-73cc-4658-8779-3d178ca55ed1 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:30.100506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-996f6bff-73cc-4658-8779-3d178ca55ed1 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:30.102824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-996f6bff-73cc-4658-8779-3d178ca55ed1 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:30.103452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-996f6bff-73cc-4658-8779-3d178ca55ed1 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:30.105635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-996f6bff-73cc-4658-8779-3d178ca55ed1 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:30.108456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-996f6bff-73cc-4658-8779-3d178ca55ed1 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:30.109817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-996f6bff-73cc-4658-8779-3d178ca55ed1 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:30.165698 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-996f6bff-73cc-4658-8779-3d178ca55ed1 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.324828 Oct 11 04:11:30.168372 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 148/296] 10.222.0.26 () {58 vars in 1176 bytes} [Tue Oct 11 04:11:29 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:30.173960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bcaf5796-6fab-44e6-86c6-168800497984 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:30.175933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-baea6c8d-abf0-4f7a-8b41-9c0b9d2a0c0f tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:30.181846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bcaf5796-6fab-44e6-86c6-168800497984 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:30.185557 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-baea6c8d-abf0-4f7a-8b41-9c0b9d2a0c0f tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1283 microversion: 2.1 time: 0.162327 Oct 11 04:11:30.198379 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 149/297] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:30 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1283 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:30.199407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcaf5796-6fab-44e6-86c6-168800497984 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:30.200780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcaf5796-6fab-44e6-86c6-168800497984 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:30.202674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcaf5796-6fab-44e6-86c6-168800497984 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:30.203588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcaf5796-6fab-44e6-86c6-168800497984 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:30.204214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcaf5796-6fab-44e6-86c6-168800497984 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:30.204834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcaf5796-6fab-44e6-86c6-168800497984 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:30.213035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-93d95ac8-d1a6-4679-8293-9ee923b47cf1 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-362823068"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:30.232405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-93d95ac8-d1a6-4679-8293-9ee923b47cf1 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Generated uuid 389e9cc3-7ff0-4e6d-9d19-d8335d580133 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:30.343542 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-93d95ac8-d1a6-4679-8293-9ee923b47cf1 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.142566 Oct 11 04:11:30.352476 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 150/298] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:30 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:30.364655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ee74de3-751a-426a-b1af-b783da0c8330 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:30.384457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ee74de3-751a-426a-b1af-b783da0c8330 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:30.385195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ee74de3-751a-426a-b1af-b783da0c8330 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:30.385999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ee74de3-751a-426a-b1af-b783da0c8330 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:30.663374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bcaf5796-6fab-44e6-86c6-168800497984 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:30.673886 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bcaf5796-6fab-44e6-86c6-168800497984 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1319 microversion: 2.1 time: 0.504032 Oct 11 04:11:30.678641 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 149/299] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:30 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1319 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:30.854656 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ee74de3-751a-426a-b1af-b783da0c8330 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 242 microversion: 2.1 time: 0.497689 Oct 11 04:11:30.855161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bdbbc253-0d45-4f26-8819-d1fd6b8fb3d4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:30.855747 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 151/300] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:11:30 2022] POST /compute/v2.1/os-aggregates/11/action => generated 242 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:30.857796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bdbbc253-0d45-4f26-8819-d1fd6b8fb3d4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:30.867438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-96488bcc-051f-4f33-b256-ba6db66bf06d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:30.881504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96488bcc-051f-4f33-b256-ba6db66bf06d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:30.882100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96488bcc-051f-4f33-b256-ba6db66bf06d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:30.882697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96488bcc-051f-4f33-b256-ba6db66bf06d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:30.893426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdbbc253-0d45-4f26-8819-d1fd6b8fb3d4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:30.893922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdbbc253-0d45-4f26-8819-d1fd6b8fb3d4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:30.894401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdbbc253-0d45-4f26-8819-d1fd6b8fb3d4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:30.895126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdbbc253-0d45-4f26-8819-d1fd6b8fb3d4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:30.897507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdbbc253-0d45-4f26-8819-d1fd6b8fb3d4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:30.897986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdbbc253-0d45-4f26-8819-d1fd6b8fb3d4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:30.981628 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-96488bcc-051f-4f33-b256-ba6db66bf06d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] HTTP exception thrown: Aggregate 11 already has host n-h2-860892-1. Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-96488bcc-051f-4f33-b256-ba6db66bf06d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Request method failure captured: Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/os-aggregates/11/action HTTP/1.1 Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 39 Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzxrllOzvF3440YIYpeJvvoE8k5CSjh_ata4lQZZ5Va_Z-rWfLU2t0UO0IpnzOAltX-Qw8imgmpjaEOGNvh2ZoJ8xA-U0ypr1rLHI_MbBXopk838wTCqm65-oKmnwDM5djOBWwIdVUmGv4a0Y2Edz7_yWnuRt-kmROHdcrlReUfMQQ Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:11:31.012605 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}] Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a5ef7cabb87d48e08486958f680e188e Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: {"add_host": {"host": "n-h2-860892-1"}} Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:31.022415 n-d-860892-1 devstack@n-api.service[120993]: exception: Aggregate 11 already has host n-h2-860892-1. Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '11', 'body': {'add_host': {'host': 'n-h2-860892-1'}}} Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result.read() Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 04:11:31.023340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry 'n-h2-860892-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 73, in _host_add_to_db Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi host_ref.save(context.session) Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 04:11:31.024643 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 04:11:31.026095 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 04:11:31.027372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result.read() Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'n-h2-860892-1-11' for key 'aggregate_hosts.uniq_aggregate_hosts0host0aggregate_id'") Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO aggregate_hosts (created_at, updated_at, host, aggregate_id) VALUES (%(created_at)s, %(updated_at)s, %(host)s, %(aggregate_id)s)] Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 4, 11, 30, 920558), 'updated_at': None, 'host': 'n-h2-860892-1', 'aggregate_id': 11}] Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:31.028630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6641, in add_host_to_aggregate Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi aggregate.add_host(host_name) Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 395, in add_host Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _host_add_to_db(self._context, self.id, host) Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 76, in _host_add_to_db Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.AggregateHostExists(host=host, Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.AggregateHostExists: Aggregate 11 already has host n-h2-860892-1. Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:31.029744 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 187, in _add_host Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate 11 already has host n-h2-860892-1. Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:31.032318 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:31.033730 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate 11 already has host n-h2-860892-1. Oct 11 04:11:31.033730 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:31.033730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-96488bcc-051f-4f33-b256-ba6db66bf06d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Returning 409 to user: Aggregate 11 already has host n-h2-860892-1. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:31.033730 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-96488bcc-051f-4f33-b256-ba6db66bf06d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 409 len: 96 microversion: 2.1 time: 0.153105 Oct 11 04:11:31.033730 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 152/301] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:11:30 2022] POST /compute/v2.1/os-aggregates/11/action => generated 96 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 377 bytes (2 switches on core 0) Oct 11 04:11:31.041714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-129dd224-8d28-4536-bce5-2e2635b79aed tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:31.059823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-129dd224-8d28-4536-bce5-2e2635b79aed tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:31.061183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-129dd224-8d28-4536-bce5-2e2635b79aed tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:31.062487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-129dd224-8d28-4536-bce5-2e2635b79aed tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:31.359808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bdbbc253-0d45-4f26-8819-d1fd6b8fb3d4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:31.372817 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bdbbc253-0d45-4f26-8819-d1fd6b8fb3d4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1319 microversion: 2.1 time: 0.530517 Oct 11 04:11:31.373583 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 150/302] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:30 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1319 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:31.398357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-298eed49-7c68-4cda-bf0f-79510f741e43 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:31.398357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-298eed49-7c68-4cda-bf0f-79510f741e43 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:31.401587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-298eed49-7c68-4cda-bf0f-79510f741e43 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:31.402285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-298eed49-7c68-4cda-bf0f-79510f741e43 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:31.402889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-298eed49-7c68-4cda-bf0f-79510f741e43 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:31.403761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-298eed49-7c68-4cda-bf0f-79510f741e43 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:31.404360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-298eed49-7c68-4cda-bf0f-79510f741e43 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:31.404934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-298eed49-7c68-4cda-bf0f-79510f741e43 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:31.470201 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-129dd224-8d28-4536-bce5-2e2635b79aed tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/11/action" status: 200 len: 227 microversion: 2.1 time: 0.440069 Oct 11 04:11:31.477341 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 153/303] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:11:31 2022] POST /compute/v2.1/os-aggregates/11/action => generated 227 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:31.482537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f33fdd0-8f97-4692-8dd0-d625e231f70a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:31.488426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f33fdd0-8f97-4692-8dd0-d625e231f70a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:31.506531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f33fdd0-8f97-4692-8dd0-d625e231f70a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:31.507371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f33fdd0-8f97-4692-8dd0-d625e231f70a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:31.519807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f33fdd0-8f97-4692-8dd0-d625e231f70a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:31.523350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f33fdd0-8f97-4692-8dd0-d625e231f70a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:31.524116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f33fdd0-8f97-4692-8dd0-d625e231f70a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:31.525011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f33fdd0-8f97-4692-8dd0-d625e231f70a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:31.688151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f33fdd0-8f97-4692-8dd0-d625e231f70a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:31.700545 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f33fdd0-8f97-4692-8dd0-d625e231f70a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1289 microversion: 2.1 time: 0.221618 Oct 11 04:11:31.701374 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 154/304] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:31 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1289 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:31.727023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-1bd55727-ed7d-4a8f-98d5-b933c0135670 req-f131d5cc-fbde-4f19-9e19-0d17edad26a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d4c47a-c1d1-4481-b151-a43194e08f7f", "name": "network-vif-plugged", "status": "completed", "tag": "e779dffe-9789-4f6d-9b68-6cd98f3d9c98"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:31.744013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1bd55727-ed7d-4a8f-98d5-b933c0135670 req-f131d5cc-fbde-4f19-9e19-0d17edad26a8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:31.744724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1bd55727-ed7d-4a8f-98d5-b933c0135670 req-f131d5cc-fbde-4f19-9e19-0d17edad26a8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:31.745855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1bd55727-ed7d-4a8f-98d5-b933c0135670 req-f131d5cc-fbde-4f19-9e19-0d17edad26a8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:31.760999 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-1bd55727-ed7d-4a8f-98d5-b933c0135670 req-f131d5cc-fbde-4f19-9e19-0d17edad26a8 service nova] Creating event network-vif-plugged:e779dffe-9789-4f6d-9b68-6cd98f3d9c98 for instance 32d4c47a-c1d1-4481-b151-a43194e08f7f on n-h2-860892-1 Oct 11 04:11:31.767369 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-1bd55727-ed7d-4a8f-98d5-b933c0135670 req-f131d5cc-fbde-4f19-9e19-0d17edad26a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052231 Oct 11 04:11:31.768527 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 155/305] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:31.774097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46ee16f4-ebea-4f41-8209-43f5754753ad tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:31.817073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-298eed49-7c68-4cda-bf0f-79510f741e43 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:31.833885 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-298eed49-7c68-4cda-bf0f-79510f741e43 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.437288 Oct 11 04:11:31.833885 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 151/306] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:31 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:31.851119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d057dbe-e7b9-4299-a2e6-1b66fee37a27 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:31.853262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d057dbe-e7b9-4299-a2e6-1b66fee37a27 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:31.858413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d057dbe-e7b9-4299-a2e6-1b66fee37a27 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:31.859602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d057dbe-e7b9-4299-a2e6-1b66fee37a27 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:31.860195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d057dbe-e7b9-4299-a2e6-1b66fee37a27 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:31.861261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d057dbe-e7b9-4299-a2e6-1b66fee37a27 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:31.861867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d057dbe-e7b9-4299-a2e6-1b66fee37a27 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:31.862548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d057dbe-e7b9-4299-a2e6-1b66fee37a27 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:31.917889 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-46ee16f4-ebea-4f41-8209-43f5754753ad tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/11" status: 200 len: 0 microversion: 2.1 time: 0.147650 Oct 11 04:11:31.918653 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 156/307] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:31 2022] DELETE /compute/v2.1/os-aggregates/11 => generated 0 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:31.932559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fed76fa7-3369-420c-94ad-963ece1353f2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:31.937573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fed76fa7-3369-420c-94ad-963ece1353f2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:31.950172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:31.957549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fed76fa7-3369-420c-94ad-963ece1353f2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:31.958754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fed76fa7-3369-420c-94ad-963ece1353f2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:31.960251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fed76fa7-3369-420c-94ad-963ece1353f2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:31.961835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fed76fa7-3369-420c-94ad-963ece1353f2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:31.962415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fed76fa7-3369-420c-94ad-963ece1353f2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:31.968349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fed76fa7-3369-420c-94ad-963ece1353f2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:32.128063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d057dbe-e7b9-4299-a2e6-1b66fee37a27 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:32.141470 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d057dbe-e7b9-4299-a2e6-1b66fee37a27 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 200 len: 1585 microversion: 2.1 time: 0.296666 Oct 11 04:11:32.142129 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 152/308] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:31 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 1585 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:32.159423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-002a4617-087a-4378-986b-f1f63723a3c8 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-553794573"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:32.159423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.aggregate [None req-002a4617-087a-4378-986b-f1f63723a3c8 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Generated uuid 88c7f586-737c-4642-b760-17f7efede29b for aggregate {{(pid=120994) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:32.285955 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-002a4617-087a-4378-986b-f1f63723a3c8 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.141619 Oct 11 04:11:32.287824 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 153/309] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:32 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:32.409960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-0264160d-8dee-47c1-9b5f-ca5f0a40b9bb req-4408bed5-0d65-4406-947a-b3a2a35d40c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a2d8cb-5666-44f2-b773-bc4305262557", "tag": "7b731ed1-208b-42f4-befd-6f133da74aff"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:32.437677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0264160d-8dee-47c1-9b5f-ca5f0a40b9bb req-4408bed5-0d65-4406-947a-b3a2a35d40c3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:32.437677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0264160d-8dee-47c1-9b5f-ca5f0a40b9bb req-4408bed5-0d65-4406-947a-b3a2a35d40c3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:32.437677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0264160d-8dee-47c1-9b5f-ca5f0a40b9bb req-4408bed5-0d65-4406-947a-b3a2a35d40c3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:32.460671 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-0264160d-8dee-47c1-9b5f-ca5f0a40b9bb req-4408bed5-0d65-4406-947a-b3a2a35d40c3 service nova] Creating event network-changed:7b731ed1-208b-42f4-befd-6f133da74aff for instance e3a2d8cb-5666-44f2-b773-bc4305262557 on n-h1-860892-1 Oct 11 04:11:32.467084 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-0264160d-8dee-47c1-9b5f-ca5f0a40b9bb req-4408bed5-0d65-4406-947a-b3a2a35d40c3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.177771 Oct 11 04:11:32.468754 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 154/310] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:32.501694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fed76fa7-3369-420c-94ad-963ece1353f2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:32.515857 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fed76fa7-3369-420c-94ad-963ece1353f2 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1319 microversion: 2.1 time: 0.588967 Oct 11 04:11:32.516461 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 157/311] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:31 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1319 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:32.530244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8c712c8-b6a7-4cb9-9b14-522d5862385f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:32.539597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a8c712c8-b6a7-4cb9-9b14-522d5862385f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:32.543461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8c712c8-b6a7-4cb9-9b14-522d5862385f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:32.544214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8c712c8-b6a7-4cb9-9b14-522d5862385f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:32.544826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8c712c8-b6a7-4cb9-9b14-522d5862385f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:32.547606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8c712c8-b6a7-4cb9-9b14-522d5862385f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:32.548184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8c712c8-b6a7-4cb9-9b14-522d5862385f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:32.548604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8c712c8-b6a7-4cb9-9b14-522d5862385f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:32.719445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a4a4be14-0a87-43eb-a36e-ef05b5d934c7 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860892-1"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:32.723638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a4a4be14-0a87-43eb-a36e-ef05b5d934c7 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Policy check for os_compute_api:os-aggregates:add_host failed with credentials {'is_admin': False, 'user_id': 'd2a4fddd3d8143b6add3dd1fa4cb7906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458687d5074f48c7a5c0c0be8ef963ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a4a4be14-0a87-43eb-a36e-ef05b5d934c7 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Request method failure captured: Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-aggregates/12/action HTTP/1.1 Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 39 Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzwNJd_T8LFYpwmmZsev3PVRaFmgkGjTNzI6XLCgPjO0LrEZendKWBmrnp-QgmTONMxu0VM-9bmO4E01NNHxYhqVw7SFb8xF_OVh_Bm2fq6s0FQJFuLsAaeazQ0tjTopThCPyTF0_jio8wiLVbfgF0CLl2mFCeEaghObhMf-v2fSEU Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:11:32.727837 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}] Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: d2a4fddd3d8143b6add3dd1fa4cb7906 Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: {"add_host": {"host": "n-h2-860892-1"}} Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:11:32.732538 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '12', 'body': {'add_host': {'host': 'n-h2-860892-1'}}} Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 172, in _add_host Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'add_host', target={}) Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:32.733316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. Oct 11 04:11:32.735681 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:32.739414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a4a4be14-0a87-43eb-a36e-ef05b5d934c7 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:add_host to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:32.739414 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a4a4be14-0a87-43eb-a36e-ef05b5d934c7 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/12/action" status: 403 len: 118 microversion: 2.1 time: 0.256985 Oct 11 04:11:32.739414 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 155/312] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:11:32 2022] POST /compute/v2.1/os-aggregates/12/action => generated 118 bytes in 263 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:32.739414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fbb8f9b0-a34e-4b40-bcab-53ae2c129f4b tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:32.739414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fbb8f9b0-a34e-4b40-bcab-53ae2c129f4b tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:32.751754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb8f9b0-a34e-4b40-bcab-53ae2c129f4b tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:32.752301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb8f9b0-a34e-4b40-bcab-53ae2c129f4b tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:32.753429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb8f9b0-a34e-4b40-bcab-53ae2c129f4b tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:32.754156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb8f9b0-a34e-4b40-bcab-53ae2c129f4b tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:32.754681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb8f9b0-a34e-4b40-bcab-53ae2c129f4b tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:32.755165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb8f9b0-a34e-4b40-bcab-53ae2c129f4b tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:33.216425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fbb8f9b0-a34e-4b40-bcab-53ae2c129f4b tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:33.227758 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fbb8f9b0-a34e-4b40-bcab-53ae2c129f4b tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1331 microversion: 2.1 time: 0.493515 Oct 11 04:11:33.228366 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 156/313] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:32 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1331 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:33.241993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8a466cc7-d52c-434d-abfa-9b0b995bb305 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:33.380823 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8a466cc7-d52c-434d-abfa-9b0b995bb305 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/12" status: 200 len: 0 microversion: 2.1 time: 0.141132 Oct 11 04:11:33.383002 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 157/314] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:33 2022] DELETE /compute/v2.1/os-aggregates/12 => generated 0 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:33.399635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e7340b9c-538e-4f20-b1ac-e639d0b96c8e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:33.404632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e7340b9c-538e-4f20-b1ac-e639d0b96c8e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:33.424252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7340b9c-538e-4f20-b1ac-e639d0b96c8e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:33.428622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7340b9c-538e-4f20-b1ac-e639d0b96c8e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:33.431111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7340b9c-538e-4f20-b1ac-e639d0b96c8e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:33.432587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7340b9c-538e-4f20-b1ac-e639d0b96c8e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:33.433837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7340b9c-538e-4f20-b1ac-e639d0b96c8e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:33.434734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7340b9c-538e-4f20-b1ac-e639d0b96c8e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:33.491400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a8c712c8-b6a7-4cb9-9b14-522d5862385f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:33.500815 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a8c712c8-b6a7-4cb9-9b14-522d5862385f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1319 microversion: 2.1 time: 0.983287 Oct 11 04:11:33.522423 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 158/315] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:32 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1319 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:33.537927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cad0e48a-72e6-4f22-9e9d-33f4c94af0da tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1449329120"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:33.541843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-cad0e48a-72e6-4f22-9e9d-33f4c94af0da tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Generated uuid 01b9ebd2-ca14-47a4-867a-e5a097bb2ef5 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:33.672145 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cad0e48a-72e6-4f22-9e9d-33f4c94af0da tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.147463 Oct 11 04:11:33.672805 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 159/316] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:33 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:33.690034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ccacb05e-6ad7-4d7c-b591-43f7f26455fe tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:33.690924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ccacb05e-6ad7-4d7c-b591-43f7f26455fe tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:33.704552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccacb05e-6ad7-4d7c-b591-43f7f26455fe tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:33.705049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccacb05e-6ad7-4d7c-b591-43f7f26455fe tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:33.705577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccacb05e-6ad7-4d7c-b591-43f7f26455fe tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:33.706693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccacb05e-6ad7-4d7c-b591-43f7f26455fe tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:33.707145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccacb05e-6ad7-4d7c-b591-43f7f26455fe tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:33.707582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccacb05e-6ad7-4d7c-b591-43f7f26455fe tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:33.910631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7340b9c-538e-4f20-b1ac-e639d0b96c8e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:33.925183 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e7340b9c-538e-4f20-b1ac-e639d0b96c8e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.535793 Oct 11 04:11:33.925183 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 158/317] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:33 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:33.928853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2779fe47-d9df-4970-a27d-b154e12a6957 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "tempest-nonexist_host-601037839"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:33.945632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2779fe47-d9df-4970-a27d-b154e12a6957 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:33.946776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2779fe47-d9df-4970-a27d-b154e12a6957 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:33.947434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2779fe47-d9df-4970-a27d-b154e12a6957 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:33.958397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2779fe47-d9df-4970-a27d-b154e12a6957 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:33.959099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2779fe47-d9df-4970-a27d-b154e12a6957 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:33.960014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2779fe47-d9df-4970-a27d-b154e12a6957 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:33.970883 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-2779fe47-d9df-4970-a27d-b154e12a6957 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] HTTP exception thrown: Compute host tempest-nonexist_host-601037839 could not be found. Oct 11 04:11:33.972207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ccacb05e-6ad7-4d7c-b591-43f7f26455fe tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2779fe47-d9df-4970-a27d-b154e12a6957 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Request method failure captured: Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-aggregates/13/action HTTP/1.1 Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 57 Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzxrllOzvF3440YIYpeJvvoE8k5CSjh_ata4lQZZ5Va_Z-rWfLU2t0UO0IpnzOAltX-Qw8imgmpjaEOGNvh2ZoJ8xA-U0ypr1rLHI_MbBXopk838wTCqm65-oKmnwDM5djOBWwIdVUmGv4a0Y2Edz7_yWnuRt-kmROHdcrlReUfMQQ Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:11:33.973530 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}] Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a5ef7cabb87d48e08486958f680e188e Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: {"add_host": {"host": "tempest-nonexist_host-601037839"}} Oct 11 04:11:33.974981 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: exception: Compute host tempest-nonexist_host-601037839 could not be found. Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '13', 'body': {'add_host': {'host': 'tempest-nonexist_host-601037839'}}} Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'tempest-nonexist_host-601037839' is not mapped to any cell Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:33.975659 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 180, in _add_host Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi aggregate = self.api.add_host_to_aggregate(context, id, host) Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6621, in add_host_to_aggregate Oct 11 04:11:33.976852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi service = _get_service_in_cell_by_host(context, host_name) Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-nonexist_host-601037839 could not be found. Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 184, in _add_host Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Compute host tempest-nonexist_host-601037839 could not be found. Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:33.977891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:33.979634 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:33.979634 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:33.979634 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:33.979634 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:33.979634 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:33.979634 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-nonexist_host-601037839 could not be found. Oct 11 04:11:33.979634 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:33.980510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2779fe47-d9df-4970-a27d-b154e12a6957 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Returning 404 to user: Compute host tempest-nonexist_host-601037839 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:33.980691 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2779fe47-d9df-4970-a27d-b154e12a6957 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/13/action" status: 404 len: 110 microversion: 2.1 time: 0.057133 Oct 11 04:11:33.981450 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 159/318] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:11:33 2022] POST /compute/v2.1/os-aggregates/13/action => generated 110 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:33.982484 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ccacb05e-6ad7-4d7c-b591-43f7f26455fe tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1319 microversion: 2.1 time: 0.308700 Oct 11 04:11:33.997620 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 160/319] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:33 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1319 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:33.997777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-40493f13-eee8-4d15-a1ef-8a50345c1157 req-68f5feff-fb0d-43a7-9285-5e3078d4f87f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a8d846-d0db-4641-80ce-8ed3e5e04d12", "name": "network-vif-plugged", "status": "completed", "tag": "ab6df6f4-1334-42fb-8aa1-62a66c1e80a9"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:34.004906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=6,nova_api:DELETE=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:34.009706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-40493f13-eee8-4d15-a1ef-8a50345c1157 req-68f5feff-fb0d-43a7-9285-5e3078d4f87f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:34.010280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-40493f13-eee8-4d15-a1ef-8a50345c1157 req-68f5feff-fb0d-43a7-9285-5e3078d4f87f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:34.010717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-40493f13-eee8-4d15-a1ef-8a50345c1157 req-68f5feff-fb0d-43a7-9285-5e3078d4f87f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:34.010842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07bd5b3e-23f8-4fd0-a7ec-a5ac1f1f620d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:34.022834 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-40493f13-eee8-4d15-a1ef-8a50345c1157 req-68f5feff-fb0d-43a7-9285-5e3078d4f87f service nova] Creating event network-vif-plugged:ab6df6f4-1334-42fb-8aa1-62a66c1e80a9 for instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 on n-h2-860892-1 Oct 11 04:11:34.029021 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-40493f13-eee8-4d15-a1ef-8a50345c1157 req-68f5feff-fb0d-43a7-9285-5e3078d4f87f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037159 Oct 11 04:11:34.030100 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 160/320] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:34.131238 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-07bd5b3e-23f8-4fd0-a7ec-a5ac1f1f620d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/13" status: 200 len: 0 microversion: 2.1 time: 0.132204 Oct 11 04:11:34.134169 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 161/321] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:33 2022] DELETE /compute/v2.1/os-aggregates/13 => generated 0 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:34.145529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c66b466-b143-49de-ba14-156f236cac8d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c66b466-b143-49de-ba14-156f236cac8d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Request method failure captured: Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 283 Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzxrllOzvF3440YIYpeJvvoE8k5CSjh_ata4lQZZ5Va_Z-rWfLU2t0UO0IpnzOAltX-Qw8imgmpjaEOGNvh2ZoJ8xA-U0ypr1rLHI_MbBXopk838wTCqm65-oKmnwDM5djOBWwIdVUmGv4a0Y2Edz7_yWnuRt-kmROHdcrlReUfMQQ Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:11:34.150119 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:11:34.154566 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}] Oct 11 04:11:34.154566 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.154566 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:34.154566 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.154566 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:34.154566 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:11:34.154566 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:11:34.154566 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a5ef7cabb87d48e08486958f680e188e Oct 11 04:11:34.154566 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:34.154566 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:11:34.155266 n-d-860892-1 devstack@n-api.service[120994]: {"aggregate": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 04:11:34.155266 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:11:34.155266 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:11:34.155266 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'aggregate': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 04:11:34.155266 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:34.155266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.155266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:11:34.155266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:11:34.155266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:11:34.155266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['aggregate']['properties']['name']: Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:34.156426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.157413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.158474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:11:34.158474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:11:34.158474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:11:34.158474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.158474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c66b466-b143-49de-ba14-156f236cac8d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:34.158807 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c66b466-b143-49de-ba14-156f236cac8d tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 619 microversion: 2.1 time: 0.011486 Oct 11 04:11:34.158807 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 161/322] 10.222.0.26 () {60 vars in 1165 bytes} [Tue Oct 11 04:11:34 2022] POST /compute/v2.1/os-aggregates => generated 619 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:11:34.164820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57501533-07fd-484b-986e-8e681db7063c tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": ""}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57501533-07fd-484b-986e-8e681db7063c tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Request method failure captured: Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 27 Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzxrllOzvF3440YIYpeJvvoE8k5CSjh_ata4lQZZ5Va_Z-rWfLU2t0UO0IpnzOAltX-Qw8imgmpjaEOGNvh2ZoJ8xA-U0ypr1rLHI_MbBXopk838wTCqm65-oKmnwDM5djOBWwIdVUmGv4a0Y2Edz7_yWnuRt-kmROHdcrlReUfMQQ Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:11:34.168880 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}] Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a5ef7cabb87d48e08486958f680e188e Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: {"aggregate": {"name": ""}} Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:34.170368 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'aggregate': {'name': ''}}} Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['aggregate']['properties']['name']: Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['aggregate']: Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi '' Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:34.171153 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:11:34.172407 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.176468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57501533-07fd-484b-986e-8e681db7063c tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:34.176468 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-57501533-07fd-484b-986e-8e681db7063c tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 400 len: 108 microversion: 2.1 time: 0.013219 Oct 11 04:11:34.176468 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 162/323] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:34 2022] POST /compute/v2.1/os-aggregates => generated 108 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:11:34.187691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea8a6b5e-b2ee-4acc-99fb-0cc735c25f88 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1537114884"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:34.196181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ea8a6b5e-b2ee-4acc-99fb-0cc735c25f88 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Policy check for os_compute_api:os-aggregates:create failed with credentials {'is_admin': False, 'user_id': 'd2a4fddd3d8143b6add3dd1fa4cb7906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458687d5074f48c7a5c0c0be8ef963ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea8a6b5e-b2ee-4acc-99fb-0cc735c25f88 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Request method failure captured: Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 60 Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzwNJd_T8LFYpwmmZsev3PVRaFmgkGjTNzI6XLCgPjO0LrEZendKWBmrnp-QgmTONMxu0VM-9bmO4E01NNHxYhqVw7SFb8xF_OVh_Bm2fq6s0FQJFuLsAaeazQ0tjTopThCPyTF0_jio8wiLVbfgF0CLl2mFCeEaghObhMf-v2fSEU Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:11:34.198543 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}] Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: d2a4fddd3d8143b6add3dd1fa4cb7906 Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: {"aggregate": {"name": "tempest-test_aggregate-1537114884"}} Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:11:34.200871 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-1537114884'}}} Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 70, in create Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'create', target={}) Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:11:34.201727 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:11:34.203325 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. Oct 11 04:11:34.205322 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.205322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea8a6b5e-b2ee-4acc-99fb-0cc735c25f88 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:create to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:34.205322 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea8a6b5e-b2ee-4acc-99fb-0cc735c25f88 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 403 len: 116 microversion: 2.1 time: 0.016849 Oct 11 04:11:34.209437 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 162/324] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:34 2022] POST /compute/v2.1/os-aggregates => generated 116 bytes in 27 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:34.220475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e6183fd-7ead-4d62-94ce-b700cd343f2f tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2083376908"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:34.225273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-9e6183fd-7ead-4d62-94ce-b700cd343f2f tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Generated uuid 83d8bf65-9082-4255-adbc-f4ef2d4c89aa for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:34.252897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0feb8cf-a431-403a-b08d-a574f572a2c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:34.253640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c0feb8cf-a431-403a-b08d-a574f572a2c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:34.263043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0feb8cf-a431-403a-b08d-a574f572a2c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:34.263539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0feb8cf-a431-403a-b08d-a574f572a2c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:34.267783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0feb8cf-a431-403a-b08d-a574f572a2c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:34.270732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0feb8cf-a431-403a-b08d-a574f572a2c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:34.271463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0feb8cf-a431-403a-b08d-a574f572a2c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:34.274475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0feb8cf-a431-403a-b08d-a574f572a2c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:34.324943 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9e6183fd-7ead-4d62-94ce-b700cd343f2f tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.117052 Oct 11 04:11:34.328270 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 163/325] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:34.354183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f96d9af8-0fd1-47a1-b93c-95f064db1cca tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-2083376908"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:34.363103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-f96d9af8-0fd1-47a1-b93c-95f064db1cca tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Generated uuid 58cfe52c-08f2-4071-a0e7-40f655a75355 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:34.376974 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f96d9af8-0fd1-47a1-b93c-95f064db1cca tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] HTTP exception thrown: Aggregate tempest-test_aggregate-2083376908 already exists. Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f96d9af8-0fd1-47a1-b93c-95f064db1cca tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Request method failure captured: Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 60 Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzxrllOzvF3440YIYpeJvvoE8k5CSjh_ata4lQZZ5Va_Z-rWfLU2t0UO0IpnzOAltX-Qw8imgmpjaEOGNvh2ZoJ8xA-U0ypr1rLHI_MbBXopk838wTCqm65-oKmnwDM5djOBWwIdVUmGv4a0Y2Edz7_yWnuRt-kmROHdcrlReUfMQQ Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:11:34.390260 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}] Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a5ef7cabb87d48e08486958f680e188e Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: {"aggregate": {"name": "tempest-test_aggregate-2083376908"}} Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:34.391474 n-d-860892-1 devstack@n-api.service[120993]: exception: Aggregate tempest-test_aggregate-2083376908 already exists. Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'aggregate': {'name': 'tempest-test_aggregate-2083376908'}}} Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 78, in create Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi aggregate = self.api.create_aggregate(context, name, avail_zone) Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6458, in create_aggregate Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi aggregate.create() Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 310, in create Oct 11 04:11:34.392187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_create_in_db(self._context, updates, Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 175, in _aggregate_create_in_db Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.AggregateNameExists(aggregate_name=values['name']) Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNameExists: Aggregate tempest-test_aggregate-2083376908 already exists. Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:34.393237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 80, in create Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPConflict(explanation=e.format_message()) Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Aggregate tempest-test_aggregate-2083376908 already exists. Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate tempest-test_aggregate-2083376908 already exists. Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f96d9af8-0fd1-47a1-b93c-95f064db1cca tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Returning 409 to user: Aggregate tempest-test_aggregate-2083376908 already exists. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:34.394335 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f96d9af8-0fd1-47a1-b93c-95f064db1cca tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 409 len: 111 microversion: 2.1 time: 0.055469 Oct 11 04:11:34.395302 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 164/326] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:34 2022] POST /compute/v2.1/os-aggregates => generated 111 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 11 04:11:34.403244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-01bd4693-3f79-41a7-8c60-49ff94cb1079 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:34.486449 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-01bd4693-3f79-41a7-8c60-49ff94cb1079 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/14" status: 200 len: 0 microversion: 2.1 time: 0.087651 Oct 11 04:11:34.488091 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 165/327] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:34 2022] DELETE /compute/v2.1/os-aggregates/14 => generated 0 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:34.503140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3de422d3-18c4-4943-9caa-a6f858d04345 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-331623816"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:34.532142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-3de422d3-18c4-4943-9caa-a6f858d04345 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Generated uuid 766469bf-c6ad-4845-be49-bce796766413 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:34.555532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0feb8cf-a431-403a-b08d-a574f572a2c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:34.565615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c0feb8cf-a431-403a-b08d-a574f572a2c5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1331 microversion: 2.1 time: 0.316933 Oct 11 04:11:34.573638 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 163/328] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:34 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1331 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:34.589384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e5e43c7-1d83-4925-91f3-1dd69942cfa0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:34.589384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e5e43c7-1d83-4925-91f3-1dd69942cfa0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:34.599976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5e43c7-1d83-4925-91f3-1dd69942cfa0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:34.600709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5e43c7-1d83-4925-91f3-1dd69942cfa0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:34.601325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5e43c7-1d83-4925-91f3-1dd69942cfa0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:34.602448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5e43c7-1d83-4925-91f3-1dd69942cfa0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:34.603078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5e43c7-1d83-4925-91f3-1dd69942cfa0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:34.603906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5e43c7-1d83-4925-91f3-1dd69942cfa0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:34.653447 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3de422d3-18c4-4943-9caa-a6f858d04345 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.159501 Oct 11 04:11:34.654053 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 166/329] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:34 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:34.669066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bcb4d71f-57d0-4f61-970b-35cccf04b6c2 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:34.678719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bcb4d71f-57d0-4f61-970b-35cccf04b6c2 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Policy check for os_compute_api:os-aggregates:delete failed with credentials {'is_admin': False, 'user_id': 'd2a4fddd3d8143b6add3dd1fa4cb7906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458687d5074f48c7a5c0c0be8ef963ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bcb4d71f-57d0-4f61-970b-35cccf04b6c2 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Request method failure captured: Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-aggregates/15 HTTP/1.1 Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzwNJd_T8LFYpwmmZsev3PVRaFmgkGjTNzI6XLCgPjO0LrEZendKWBmrnp-QgmTONMxu0VM-9bmO4E01NNHxYhqVw7SFb8xF_OVh_Bm2fq6s0FQJFuLsAaeazQ0tjTopThCPyTF0_jio8wiLVbfgF0CLl2mFCeEaghObhMf-v2fSEU Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:34.699732 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}] Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: d2a4fddd3d8143b6add3dd1fa4cb7906 Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 04:11:34.704847 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '15'} Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 147, in delete Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'delete', target={}) Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:34.705543 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.706611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bcb4d71f-57d0-4f61-970b-35cccf04b6c2 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:delete to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:34.709781 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bcb4d71f-57d0-4f61-970b-35cccf04b6c2 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/15" status: 403 len: 116 microversion: 2.1 time: 0.047391 Oct 11 04:11:34.716514 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 167/330] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:34 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 116 bytes in 55 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:34.732861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6e310b26-cc76-4741-8d06-fbe5f2fbafcb tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:34.844404 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6e310b26-cc76-4741-8d06-fbe5f2fbafcb tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/15" status: 200 len: 0 microversion: 2.1 time: 0.126240 Oct 11 04:11:34.845181 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 168/331] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:34 2022] DELETE /compute/v2.1/os-aggregates/15 => generated 0 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:34.859499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8986d03d-791e-4adf-8e8f-d11166b0d9eb tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:34.904615 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-8986d03d-791e-4adf-8e8f-d11166b0d9eb tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8986d03d-791e-4adf-8e8f-d11166b0d9eb tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Request method failure captured: Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzxrllOzvF3440YIYpeJvvoE8k5CSjh_ata4lQZZ5Va_Z-rWfLU2t0UO0IpnzOAltX-Qw8imgmpjaEOGNvh2ZoJ8xA-U0ypr1rLHI_MbBXopk838wTCqm65-oKmnwDM5djOBWwIdVUmGv4a0Y2Edz7_yWnuRt-kmROHdcrlReUfMQQ Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:11:34.913097 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}] Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a5ef7cabb87d48e08486958f680e188e Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: exception: Aggregate -1 could not be found. Oct 11 04:11:34.914589 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '-1'} Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 155, in delete Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.api.delete_aggregate(context, id) Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6517, in delete_aggregate Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi aggregate = objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 04:11:34.915272 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 157, in delete Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.916517 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:34.917696 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:34.917696 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:34.917696 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:34.917696 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:34.917696 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 11 04:11:34.917696 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:34.917696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8986d03d-791e-4adf-8e8f-d11166b0d9eb tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:34.917696 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8986d03d-791e-4adf-8e8f-d11166b0d9eb tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.060116 Oct 11 04:11:34.917696 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 169/332] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:34 2022] DELETE /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:11:34.932045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fa0a7a57-c7d0-4afa-a33d-fa499f9811bb tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-1254819492"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:34.951196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-fa0a7a57-c7d0-4afa-a33d-fa499f9811bb tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Generated uuid 66d43a79-b89c-42bd-ae24-681ed6e49e05 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:34.985980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e5e43c7-1d83-4925-91f3-1dd69942cfa0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:34.998753 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e5e43c7-1d83-4925-91f3-1dd69942cfa0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1468 microversion: 2.1 time: 0.422530 Oct 11 04:11:35.001664 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 164/333] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:34 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1468 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:35.013460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-949870b6-8dde-4f8a-9e74-ce9fa115f31c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:35.015182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-949870b6-8dde-4f8a-9e74-ce9fa115f31c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:35.038629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-949870b6-8dde-4f8a-9e74-ce9fa115f31c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:35.041849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-949870b6-8dde-4f8a-9e74-ce9fa115f31c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:35.044840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-949870b6-8dde-4f8a-9e74-ce9fa115f31c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:35.047728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-949870b6-8dde-4f8a-9e74-ce9fa115f31c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:35.049249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-949870b6-8dde-4f8a-9e74-ce9fa115f31c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:35.050294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-949870b6-8dde-4f8a-9e74-ce9fa115f31c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:35.065884 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fa0a7a57-c7d0-4afa-a33d-fa499f9811bb tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 199 microversion: 2.1 time: 0.139848 Oct 11 04:11:35.066584 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 170/334] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:34 2022] POST /compute/v2.1/os-aggregates => generated 199 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:35.078517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cc749008-b42e-48c0-a578-7e960ba0b578 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:35.079371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cc749008-b42e-48c0-a578-7e960ba0b578 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:35.093713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc749008-b42e-48c0-a578-7e960ba0b578 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:35.098925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc749008-b42e-48c0-a578-7e960ba0b578 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:35.103000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc749008-b42e-48c0-a578-7e960ba0b578 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:35.103000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc749008-b42e-48c0-a578-7e960ba0b578 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:35.103000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc749008-b42e-48c0-a578-7e960ba0b578 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:35.103000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc749008-b42e-48c0-a578-7e960ba0b578 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:35.240257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-949870b6-8dde-4f8a-9e74-ce9fa115f31c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:35.248194 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-949870b6-8dde-4f8a-9e74-ce9fa115f31c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.243613 Oct 11 04:11:35.249142 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 165/335] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:35 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:35.395615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cc749008-b42e-48c0-a578-7e960ba0b578 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:35.406107 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cc749008-b42e-48c0-a578-7e960ba0b578 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1319 microversion: 2.1 time: 0.335920 Oct 11 04:11:35.407175 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 171/336] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:35 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1319 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:35.419597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c79c559-3734-4f7e-af7e-f143d83eb8f8 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:35.422037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1c79c559-3734-4f7e-af7e-f143d83eb8f8 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Policy check for os_compute_api:os-aggregates:show failed with credentials {'is_admin': False, 'user_id': 'd2a4fddd3d8143b6add3dd1fa4cb7906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458687d5074f48c7a5c0c0be8ef963ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c79c559-3734-4f7e-af7e-f143d83eb8f8 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Request method failure captured: Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-aggregates/16 HTTP/1.1 Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzwNJd_T8LFYpwmmZsev3PVRaFmgkGjTNzI6XLCgPjO0LrEZendKWBmrnp-QgmTONMxu0VM-9bmO4E01NNHxYhqVw7SFb8xF_OVh_Bm2fq6s0FQJFuLsAaeazQ0tjTopThCPyTF0_jio8wiLVbfgF0CLl2mFCeEaghObhMf-v2fSEU Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:35.428332 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}] Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: d2a4fddd3d8143b6add3dd1fa4cb7906 Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 04:11:35.429564 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '16'} Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 100, in show Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'show', target={}) Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:35.430300 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.431615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c79c559-3734-4f7e-af7e-f143d83eb8f8 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:show to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:35.436210 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c79c559-3734-4f7e-af7e-f143d83eb8f8 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates/16" status: 403 len: 114 microversion: 2.1 time: 0.023771 Oct 11 04:11:35.436210 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 172/337] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:35 2022] GET /compute/v2.1/os-aggregates/16 => generated 114 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:35.440934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-18be2fbf-fde7-472d-a28d-df61c7e46816 req-ae11df81-ced1-4bcf-96f5-57c4039820df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8728557c-7590-4694-ae89-ca4194b8e209", "tag": "6f15cb93-8f8a-423e-93c9-163696b0d2fc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:35.454231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-18be2fbf-fde7-472d-a28d-df61c7e46816 req-ae11df81-ced1-4bcf-96f5-57c4039820df service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:35.454991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-18be2fbf-fde7-472d-a28d-df61c7e46816 req-ae11df81-ced1-4bcf-96f5-57c4039820df service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:35.456070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-18be2fbf-fde7-472d-a28d-df61c7e46816 req-ae11df81-ced1-4bcf-96f5-57c4039820df service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:35.468884 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-18be2fbf-fde7-472d-a28d-df61c7e46816 req-ae11df81-ced1-4bcf-96f5-57c4039820df service nova] Creating event network-changed:6f15cb93-8f8a-423e-93c9-163696b0d2fc for instance 8728557c-7590-4694-ae89-ca4194b8e209 on n-h2-860892-1 Oct 11 04:11:35.480774 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-18be2fbf-fde7-472d-a28d-df61c7e46816 req-ae11df81-ced1-4bcf-96f5-57c4039820df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041407 Oct 11 04:11:35.480774 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 173/338] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:35.486268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7b2ddd02-dd3a-4a5e-9abc-9d6d54f7a1ad tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:35.573283 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7b2ddd02-dd3a-4a5e-9abc-9d6d54f7a1ad tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/16" status: 200 len: 0 microversion: 2.1 time: 0.092449 Oct 11 04:11:35.575047 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 174/339] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:35 2022] DELETE /compute/v2.1/os-aggregates/16 => generated 0 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:35.584511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f9cf3e86-1d1e-49db-8f08-0e3a338a2c7f tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:35.600144 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f9cf3e86-1d1e-49db-8f08-0e3a338a2c7f tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] HTTP exception thrown: Aggregate -1 could not be found. Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f9cf3e86-1d1e-49db-8f08-0e3a338a2c7f tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Request method failure captured: Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-aggregates/-1 HTTP/1.1 Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzxrllOzvF3440YIYpeJvvoE8k5CSjh_ata4lQZZ5Va_Z-rWfLU2t0UO0IpnzOAltX-Qw8imgmpjaEOGNvh2ZoJ8xA-U0ypr1rLHI_MbBXopk838wTCqm65-oKmnwDM5djOBWwIdVUmGv4a0Y2Edz7_yWnuRt-kmROHdcrlReUfMQQ Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:11:35.601927 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}] Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a5ef7cabb87d48e08486958f680e188e Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: exception: Aggregate -1 could not be found. Oct 11 04:11:35.603274 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '-1'} Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 108, in show Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi aggregate = self.api.get_aggregate(context, id) Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6464, in get_aggregate Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return objects.Aggregate.get_by_id(context, aggregate_id) Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 274, in get_by_id Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_aggregate = _aggregate_get_from_db(context, aggregate_id) Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/aggregate.py", line 45, in _aggregate_get_from_db Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.AggregateNotFound(aggregate_id=aggregate_id) Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.AggregateNotFound: Aggregate -1 could not be found. Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:35.604162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 110, in show Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Aggregate -1 could not be found. Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Aggregate -1 could not be found. Oct 11 04:11:35.605805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.609311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f9cf3e86-1d1e-49db-8f08-0e3a338a2c7f tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Returning 404 to user: Aggregate -1 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:35.610677 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f9cf3e86-1d1e-49db-8f08-0e3a338a2c7f tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/-1" status: 404 len: 78 microversion: 2.1 time: 0.029608 Oct 11 04:11:35.611730 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 175/340] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:35 2022] GET /compute/v2.1/os-aggregates/-1 => generated 78 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:11:35.616779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dcc94515-981e-43f1-822d-ed5796533601 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:35.617746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dcc94515-981e-43f1-822d-ed5796533601 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:35.626867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcc94515-981e-43f1-822d-ed5796533601 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:35.627692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcc94515-981e-43f1-822d-ed5796533601 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:35.628727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcc94515-981e-43f1-822d-ed5796533601 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:35.629685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcc94515-981e-43f1-822d-ed5796533601 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:35.630412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcc94515-981e-43f1-822d-ed5796533601 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:35.631054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcc94515-981e-43f1-822d-ed5796533601 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:35.710161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "tempest-host-1129644166", "block_migration": true, "disk_over_commit": false}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:35.712842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:35.724182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:35.725976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:35.727362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:35.730003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:35.730740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:35.732043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:35.863033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lazy-loading 'flavor' on Instance uuid 32d4c47a-c1d1-4481-b151-a43194e08f7f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:11:35.891892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dcc94515-981e-43f1-822d-ed5796533601 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:35.901914 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dcc94515-981e-43f1-822d-ed5796533601 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1331 microversion: 2.1 time: 0.288871 Oct 11 04:11:35.920230 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 176/341] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:35 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1331 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:35.926507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52b86f89-937c-4d3d-b95c-485c8fa1bf98 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:35.928197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-52b86f89-937c-4d3d-b95c-485c8fa1bf98 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Policy check for os_compute_api:os-aggregates:index failed with credentials {'is_admin': False, 'user_id': 'd2a4fddd3d8143b6add3dd1fa4cb7906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458687d5074f48c7a5c0c0be8ef963ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:35.929172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Going to try to live migrate instance to tempest-host-1129644166 {{(pid=120994) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52b86f89-937c-4d3d-b95c-485c8fa1bf98 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Request method failure captured: Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-aggregates HTTP/1.1 Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzwNJd_T8LFYpwmmZsev3PVRaFmgkGjTNzI6XLCgPjO0LrEZendKWBmrnp-QgmTONMxu0VM-9bmO4E01NNHxYhqVw7SFb8xF_OVh_Bm2fq6s0FQJFuLsAaeazQ0tjTopThCPyTF0_jio8wiLVbfgF0CLl2mFCeEaghObhMf-v2fSEU Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:35.930859 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}] Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: d2a4fddd3d8143b6add3dd1fa4cb7906 Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 04:11:35.932331 n-d-860892-1 devstack@n-api.service[120993]: action_args: {} Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 55, in index Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'index', target={}) Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:35.933041 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. Oct 11 04:11:35.934256 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.937116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52b86f89-937c-4d3d-b95c-485c8fa1bf98 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:index to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:35.938100 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-52b86f89-937c-4d3d-b95c-485c8fa1bf98 tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 403 len: 115 microversion: 2.1 time: 0.016855 Oct 11 04:11:35.939574 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 177/342] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:11:35 2022] GET /compute/v2.1/os-aggregates => generated 115 bytes in 19 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:35.949109 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] HTTP exception thrown: Compute host tempest-host-1129644166 could not be found. Oct 11 04:11:35.951509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b134e288-510c-4fa2-90d6-68989b8ca52e tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-120731674"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Request method failure captured: Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f/action HTTP/1.1 Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 107 Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzejsKr7J-lgUoytZvbs5Hcus0uXIv9K8v3ihZ3GjEBuwXBIXEfTmd7fr7QGdfVZWt_PbLEWZJJkpbVi0J-Y4W_USI08Wpsb4BMsIq-pBZ9b8kYG-PJUKlEljYjDDA8DODkts3hxjaj01TfaSuuy8qMc1YZSG5XeCKxZtNPeOxrgRE Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: a9352f260bfd4e99b28cbd4daa79073e Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-LiveMigrationNegativeTest-674451504 Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:11:35.953782 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9352f260bfd4e99b28cbd4daa79073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9352f260bfd4e99b28cbd4daa79073e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9352f260bfd4e99b28cbd4daa79073e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9352f260bfd4e99b28cbd4daa79073e"}]}] Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-LiveMigrationNegativeTest-674451504 Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: a9352f260bfd4e99b28cbd4daa79073e Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-674451504 Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-LiveMigrationNegativeTest-674451504-project-admin Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 595e53a922cf4e44bcd8d1eada82a1af Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-LiveMigrationNegativeTest-674451504-project-admin Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: {"os-migrateLive": {"host": "tempest-host-1129644166", "block_migration": true, "disk_over_commit": false}} Oct 11 04:11:35.955291 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: exception: Compute host tempest-host-1129644166 could not be found. Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '32d4c47a-c1d1-4481-b151-a43194e08f7f', 'body': {'os-migrateLive': {'host': 'tempest-host-1129644166', 'block_migration': True, 'disk_over_commit': False}}} Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:11:35.956152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5488, in live_migrate Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nodes = objects.ComputeNodeList.get_all_by_host(context, host_name) Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 476, in get_all_by_host Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_computes = cls._db_compute_node_get_all_by_host(context, host, Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 179, in wrapper Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/compute_node.py", line 472, in _db_compute_node_get_all_by_host Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return db.compute_node_get_all_by_host(context, host) Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 241, in wrapper Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(context, *args, **kwargs) Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/main/api.py", line 740, in compute_node_get_all_by_host Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host) Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host tempest-host-1129644166 could not be found. Oct 11 04:11:35.957382 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 150, in _migrate_live Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Compute host tempest-host-1129644166 could not be found. Oct 11 04:11:35.965075 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Compute host tempest-host-1129644166 could not be found. Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Returning 400 to user: Compute host tempest-host-1129644166 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-74eb268f-7c32-438d-bb42-59399ba7cb77 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f/action" status: 400 len: 100 microversion: 2.1 time: 0.705031 Oct 11 04:11:35.966406 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 166/343] 10.222.0.26 () {60 vars in 1279 bytes} [Tue Oct 11 04:11:35 2022] POST /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f/action => generated 100 bytes in 706 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:11:35.967177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-b134e288-510c-4fa2-90d6-68989b8ca52e tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Generated uuid 07f79375-1631-4968-977c-cd24980a9bc7 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:35.972383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1456da65-fde9-4796-8702-9fe08033874a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:35.974161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1456da65-fde9-4796-8702-9fe08033874a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:35.986797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1456da65-fde9-4796-8702-9fe08033874a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:35.989445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1456da65-fde9-4796-8702-9fe08033874a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:35.991759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1456da65-fde9-4796-8702-9fe08033874a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:35.992505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1456da65-fde9-4796-8702-9fe08033874a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:35.992975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1456da65-fde9-4796-8702-9fe08033874a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:35.994122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1456da65-fde9-4796-8702-9fe08033874a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:36.073835 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b134e288-510c-4fa2-90d6-68989b8ca52e tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.127973 Oct 11 04:11:36.074498 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 178/344] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:35 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:36.089071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-be765de3-0dac-4f66-b628-42df260c6a05 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:36.110441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be765de3-0dac-4f66-b628-42df260c6a05 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:36.112911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be765de3-0dac-4f66-b628-42df260c6a05 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:36.124609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be765de3-0dac-4f66-b628-42df260c6a05 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:36.224218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1456da65-fde9-4796-8702-9fe08033874a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:36.242595 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1456da65-fde9-4796-8702-9fe08033874a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1468 microversion: 2.1 time: 0.275408 Oct 11 04:11:36.250823 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 167/345] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:35 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:36.251855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7e6561f2-32e6-4842-8989-4f632a57496c req-dc54eaca-3ee5-4738-a694-c61ad70a00ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fb89fb-a3af-4372-a794-e1583259b555", "name": "network-vif-plugged", "status": "completed", "tag": "fe0d100a-b7c1-4434-9679-422de267ee5e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:36.286213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7e6561f2-32e6-4842-8989-4f632a57496c req-dc54eaca-3ee5-4738-a694-c61ad70a00ab service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:36.301477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7e6561f2-32e6-4842-8989-4f632a57496c req-dc54eaca-3ee5-4738-a694-c61ad70a00ab service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:36.302113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7e6561f2-32e6-4842-8989-4f632a57496c req-dc54eaca-3ee5-4738-a694-c61ad70a00ab service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:36.327982 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7e6561f2-32e6-4842-8989-4f632a57496c req-dc54eaca-3ee5-4738-a694-c61ad70a00ab service nova] Creating event network-vif-plugged:fe0d100a-b7c1-4434-9679-422de267ee5e for instance 22fb89fb-a3af-4372-a794-e1583259b555 on n-h1-860892-1 Oct 11 04:11:36.341176 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7e6561f2-32e6-4842-8989-4f632a57496c req-dc54eaca-3ee5-4738-a694-c61ad70a00ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093312 Oct 11 04:11:36.343240 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 168/346] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:36.379545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40da91bf-2ce9-4ff4-952d-6f32d850b4ac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:36.380242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-40da91bf-2ce9-4ff4-952d-6f32d850b4ac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:36.404436 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-be765de3-0dac-4f66-b628-42df260c6a05 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 242 microversion: 2.1 time: 0.321541 Oct 11 04:11:36.415506 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 179/347] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:11:36 2022] POST /compute/v2.1/os-aggregates/17/action => generated 242 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:36.415775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40da91bf-2ce9-4ff4-952d-6f32d850b4ac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:36.416530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40da91bf-2ce9-4ff4-952d-6f32d850b4ac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:36.417369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40da91bf-2ce9-4ff4-952d-6f32d850b4ac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:36.418149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5707df0-12b9-409e-bae9-5237cf9d5fde tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:36.418922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40da91bf-2ce9-4ff4-952d-6f32d850b4ac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:36.419394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40da91bf-2ce9-4ff4-952d-6f32d850b4ac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:36.419842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40da91bf-2ce9-4ff4-952d-6f32d850b4ac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:36.421647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c5707df0-12b9-409e-bae9-5237cf9d5fde tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Policy check for os_compute_api:os-aggregates:remove_host failed with credentials {'is_admin': False, 'user_id': 'd2a4fddd3d8143b6add3dd1fa4cb7906', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '458687d5074f48c7a5c0c0be8ef963ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5707df0-12b9-409e-bae9-5237cf9d5fde tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Request method failure captured: Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/os-aggregates/17/action HTTP/1.1 Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 42 Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzwNJd_T8LFYpwmmZsev3PVRaFmgkGjTNzI6XLCgPjO0LrEZendKWBmrnp-QgmTONMxu0VM-9bmO4E01NNHxYhqVw7SFb8xF_OVh_Bm2fq6s0FQJFuLsAaeazQ0tjTopThCPyTF0_jio8wiLVbfgF0CLl2mFCeEaghObhMf-v2fSEU Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:36.424522 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/458687d5074f48c7a5c0c0be8ef963ee"}]}] Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 458687d5074f48c7a5c0c0be8ef963ee Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-300619031 Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: d2a4fddd3d8143b6add3dd1fa4cb7906 Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-300619031-project Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: {"remove_host": {"host": "n-h2-860892-1"}} Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:36.425929 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '17', 'body': {'remove_host': {'host': 'n-h2-860892-1'}}} Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 201, in _remove_host Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(aggr_policies.POLICY_ROOT % 'remove_host', target={}) Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:36.428246 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. Oct 11 04:11:36.429385 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:36.431778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5707df0-12b9-409e-bae9-5237cf9d5fde tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-aggregates:remove_host to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:36.433352 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c5707df0-12b9-409e-bae9-5237cf9d5fde tempest-AggregatesAdminNegativeTestJSON-300619031 tempest-AggregatesAdminNegativeTestJSON-300619031-project] 10.222.0.26 "POST /compute/v2.1/os-aggregates/17/action" status: 403 len: 121 microversion: 2.1 time: 0.019574 Oct 11 04:11:36.434376 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 180/348] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:11:36 2022] POST /compute/v2.1/os-aggregates/17/action => generated 121 bytes in 21 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:36.444268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7fa499ba-f3dd-4831-ac34-d1d1b72f1270 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:36.445088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7fa499ba-f3dd-4831-ac34-d1d1b72f1270 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:36.457392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fa499ba-f3dd-4831-ac34-d1d1b72f1270 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:36.458305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fa499ba-f3dd-4831-ac34-d1d1b72f1270 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:36.458919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fa499ba-f3dd-4831-ac34-d1d1b72f1270 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:36.459895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fa499ba-f3dd-4831-ac34-d1d1b72f1270 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:36.460539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fa499ba-f3dd-4831-ac34-d1d1b72f1270 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:36.461103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7fa499ba-f3dd-4831-ac34-d1d1b72f1270 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:36.678347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40da91bf-2ce9-4ff4-952d-6f32d850b4ac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:36.679038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7fa499ba-f3dd-4831-ac34-d1d1b72f1270 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:36.697679 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7fa499ba-f3dd-4831-ac34-d1d1b72f1270 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1467 microversion: 2.1 time: 0.253157 Oct 11 04:11:36.697826 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40da91bf-2ce9-4ff4-952d-6f32d850b4ac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.344188 Oct 11 04:11:36.697926 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 181/349] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:36 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1467 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:36.698001 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 169/350] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:36 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:36.698080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationNegativeTest-server-1426223370", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:36.708745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cd0c81a6-6bcd-4b22-8093-ac093b5983f9 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860892-1"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:36.721985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd0c81a6-6bcd-4b22-8093-ac093b5983f9 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:36.723704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd0c81a6-6bcd-4b22-8093-ac093b5983f9 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:36.724146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd0c81a6-6bcd-4b22-8093-ac093b5983f9 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:36.756285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:11:37.013225 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cd0c81a6-6bcd-4b22-8093-ac093b5983f9 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/17/action" status: 200 len: 227 microversion: 2.1 time: 0.320923 Oct 11 04:11:37.014171 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 170/351] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:11:36 2022] POST /compute/v2.1/os-aggregates/17/action => generated 227 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:37.029317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:11:37.029747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:11:37.030785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:11:37.031394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:11:37.031809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:11:37.042429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:37.043964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:37.044602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:37.045547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:37.046677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:37.047176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:37.066712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Getting quotas for project a4899da03227442dbf61760169d18d99. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:37.071101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Getting quotas for user 5ac55ad87edb45f3b79c1aa66a929c1f and project a4899da03227442dbf61760169d18d99. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:37.085313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:11:37.088054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:11:37.272731 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-42f7aee4-c031-44d7-b773-e68a2ddedb34 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582319 Oct 11 04:11:37.273024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0140cf90-de2f-4ed2-bb6b-6bfb505fde5c tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Action: 'update', calling method: .version_select at 0x7fda1a76b040>, body: {"quota_set": {"ram": "5120"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:37.273901 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 182/352] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:11:37.278699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4c456c7a-bd8c-4455-9c40-c6525d8bbc39 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:37.287032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4c456c7a-bd8c-4455-9c40-c6525d8bbc39 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:37.300231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c456c7a-bd8c-4455-9c40-c6525d8bbc39 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:37.303979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c456c7a-bd8c-4455-9c40-c6525d8bbc39 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:37.306378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c456c7a-bd8c-4455-9c40-c6525d8bbc39 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:37.316745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c456c7a-bd8c-4455-9c40-c6525d8bbc39 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:37.319987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c456c7a-bd8c-4455-9c40-c6525d8bbc39 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:37.320683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c456c7a-bd8c-4455-9c40-c6525d8bbc39 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:37.370158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0140cf90-de2f-4ed2-bb6b-6bfb505fde5c tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:37.370723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0140cf90-de2f-4ed2-bb6b-6bfb505fde5c tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:37.371303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0140cf90-de2f-4ed2-bb6b-6bfb505fde5c tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:37.372337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0140cf90-de2f-4ed2-bb6b-6bfb505fde5c tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:37.373364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0140cf90-de2f-4ed2-bb6b-6bfb505fde5c tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:37.374008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0140cf90-de2f-4ed2-bb6b-6bfb505fde5c tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:37.680062 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0140cf90-de2f-4ed2-bb6b-6bfb505fde5c tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/2d018fb004274dc89c5fedd2f6276a33" status: 200 len: 240 microversion: 2.36 time: 0.664336 Oct 11 04:11:37.680687 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 171/353] 10.222.0.26 () {62 vars in 1303 bytes} [Tue Oct 11 04:11:37 2022] PUT /compute/v2.1/os-quota-sets/2d018fb004274dc89c5fedd2f6276a33 => generated 240 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:11:37.685457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc46eb21-ff13-4748-bba8-6539c0cc59e5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:37.686362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cc46eb21-ff13-4748-bba8-6539c0cc59e5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:37.693473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc46eb21-ff13-4748-bba8-6539c0cc59e5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:37.694152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc46eb21-ff13-4748-bba8-6539c0cc59e5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:37.694623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc46eb21-ff13-4748-bba8-6539c0cc59e5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:37.695324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc46eb21-ff13-4748-bba8-6539c0cc59e5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:37.696502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc46eb21-ff13-4748-bba8-6539c0cc59e5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:37.696838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc46eb21-ff13-4748-bba8-6539c0cc59e5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:37.948586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cc46eb21-ff13-4748-bba8-6539c0cc59e5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:37.957985 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc46eb21-ff13-4748-bba8-6539c0cc59e5 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1331 microversion: 2.1 time: 0.275909 Oct 11 04:11:37.963950 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4c456c7a-bd8c-4455-9c40-c6525d8bbc39 tempest-DeleteServersAdminTestJSON-1851646723 tempest-DeleteServersAdminTestJSON-1851646723-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12/action" status: 202 len: 0 microversion: 2.1 time: 0.684739 Oct 11 04:11:37.963950 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 183/354] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:11:37 2022] POST /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12/action => generated 0 bytes in 686 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:37.967182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f064d6f0-c80b-48a6-af24-b9e0db0a07a0 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:37.975538 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 172/355] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:37 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1331 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:37.981512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1f8e5933-f9a6-47ed-bcf7-862b637ee1ee tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:37.982392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1f8e5933-f9a6-47ed-bcf7-862b637ee1ee tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:38.039359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1f8e5933-f9a6-47ed-bcf7-862b637ee1ee tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:38.046470 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1f8e5933-f9a6-47ed-bcf7-862b637ee1ee tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1219 microversion: 2.1 time: 0.069535 Oct 11 04:11:38.047040 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 173/356] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:37 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1219 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:38.051290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-63d0d071-3dae-4a08-8d89-a40fb984a2f7 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Calling method '.version_select at 0x7fda1a76be50>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:38.082345 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f064d6f0-c80b-48a6-af24-b9e0db0a07a0 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/17" status: 200 len: 0 microversion: 2.1 time: 0.120505 Oct 11 04:11:38.083011 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 184/357] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:37 2022] DELETE /compute/v2.1/os-aggregates/17 => generated 0 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:38.092546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-604d6ce2-0def-43c7-940c-d2d5f95281be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:38.098746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-604d6ce2-0def-43c7-940c-d2d5f95281be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:38.105072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604d6ce2-0def-43c7-940c-d2d5f95281be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.105494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604d6ce2-0def-43c7-940c-d2d5f95281be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.106258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604d6ce2-0def-43c7-940c-d2d5f95281be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.106847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604d6ce2-0def-43c7-940c-d2d5f95281be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.107302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604d6ce2-0def-43c7-940c-d2d5f95281be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.107725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604d6ce2-0def-43c7-940c-d2d5f95281be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.122162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:38.123859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63d0d071-3dae-4a08-8d89-a40fb984a2f7 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.124344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63d0d071-3dae-4a08-8d89-a40fb984a2f7 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.124968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63d0d071-3dae-4a08-8d89-a40fb984a2f7 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.125854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63d0d071-3dae-4a08-8d89-a40fb984a2f7 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.128486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63d0d071-3dae-4a08-8d89-a40fb984a2f7 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.135542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63d0d071-3dae-4a08-8d89-a40fb984a2f7 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.136731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:38.148416 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-63d0d071-3dae-4a08-8d89-a40fb984a2f7 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/2d018fb004274dc89c5fedd2f6276a33/detail" status: 200 len: 672 microversion: 2.36 time: 0.100364 Oct 11 04:11:38.149755 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 174/358] 10.222.0.26 () {60 vars in 1304 bytes} [Tue Oct 11 04:11:38 2022] GET /compute/v2.1/os-quota-sets/2d018fb004274dc89c5fedd2f6276a33/detail => generated 672 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:11:38.159365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:38.164522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:38.169176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.183207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.184065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.185189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.186129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.187310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.245680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.246378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.246888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.247569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lazy-loading 'fault' on Instance uuid c0a8d846-d0db-4641-80ce-8ed3e5e04d12 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:11:38.292504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-604d6ce2-0def-43c7-940c-d2d5f95281be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:38.304127 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-604d6ce2-0def-43c7-940c-d2d5f95281be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1313 microversion: 2.1 time: 0.215048 Oct 11 04:11:38.306761 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 185/359] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:38 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1313 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:38.329274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-106eac03-fcbd-47c9-aa08-50ba7ead42f7 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-test_aggregate-643807600"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:38.336541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.aggregate [None req-106eac03-fcbd-47c9-aa08-50ba7ead42f7 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Generated uuid 8f236090-00c7-48ba-8198-0d57aab0d0e0 for aggregate {{(pid=120993) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:11:38.350809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=10,nova_api:DELETE=10 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:38.388129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:38.396943 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d479c928-9b8e-4a95-bb58-259187921d56 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1450 microversion: 2.1 time: 0.245795 Oct 11 04:11:38.397564 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 175/360] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:38 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1450 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:38.420044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c4cab851-423d-461a-8fb7-5726e53ab375 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:38.420953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c4cab851-423d-461a-8fb7-5726e53ab375 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:38.428214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4cab851-423d-461a-8fb7-5726e53ab375 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.428930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4cab851-423d-461a-8fb7-5726e53ab375 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.429549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4cab851-423d-461a-8fb7-5726e53ab375 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.430655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4cab851-423d-461a-8fb7-5726e53ab375 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.431260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4cab851-423d-461a-8fb7-5726e53ab375 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.431837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4cab851-423d-461a-8fb7-5726e53ab375 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.443826 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-106eac03-fcbd-47c9-aa08-50ba7ead42f7 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 198 microversion: 2.1 time: 0.129146 Oct 11 04:11:38.450537 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 186/361] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:11:38 2022] POST /compute/v2.1/os-aggregates => generated 198 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:38.458243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "nonexist_host"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:38.473189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c4cab851-423d-461a-8fb7-5726e53ab375 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:11:38.486270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.486769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.487207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.512264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.513038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.513640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.528714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.compute.aggregates [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Failed to remove host nonexist_host from aggregate 18. Error: Compute host nonexist_host could not be found.: nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 11 04:11:38.531169 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] HTTP exception thrown: Cannot remove host nonexist_host in aggregate 18 Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Request method failure captured: Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/os-aggregates/18/action HTTP/1.1 Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 42 Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzxrllOzvF3440YIYpeJvvoE8k5CSjh_ata4lQZZ5Va_Z-rWfLU2t0UO0IpnzOAltX-Qw8imgmpjaEOGNvh2ZoJ8xA-U0ypr1rLHI_MbBXopk838wTCqm65-oKmnwDM5djOBWwIdVUmGv4a0Y2Edz7_yWnuRt-kmROHdcrlReUfMQQ Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:11:38.533067 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d2ae2e70223248a9929165b4f0d42d2a"}]}] Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d2ae2e70223248a9929165b4f0d42d2a Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447 Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a5ef7cabb87d48e08486958f680e188e Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: {"remove_host": {"host": "nonexist_host"}} Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:38.534382 n-d-860892-1 devstack@n-api.service[120993]: exception: Cannot remove host nonexist_host in aggregate 18 Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '18', 'body': {'remove_host': {'host': 'nonexist_host'}}} Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5999, in _get_service_in_cell_by_host Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi mapping = objects.HostMapping.get_by_host(context, host_name) Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 105, in get_by_host Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_host_from_db(context, host) Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/host_mapping.py", line 100, in _get_by_host_from_db Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.HostMappingNotFound(name=host) Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.HostMappingNotFound: Host 'nonexist_host' is not mapped to any cell Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6005, in _get_service_in_cell_by_host Oct 11 04:11:38.535247 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi service = _find_service_in_cell(context, service_host=host_name) Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 209, in _remove_host Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi aggregate = self.api.remove_host_from_aggregate(context, id, host) Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6683, in remove_host_from_aggregate Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _get_service_in_cell_by_host(context, host_name) Oct 11 04:11:38.537018 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6007, in _get_service_in_cell_by_host Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ComputeHostNotFound(host=host_name) Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ComputeHostNotFound: Compute host nonexist_host could not be found. Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/aggregates.py", line 217, in _remove_host Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Cannot remove host nonexist_host in aggregate 18 Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:38.541980 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:38.544860 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:38.544860 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:38.544860 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:38.544860 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:38.544860 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot remove host nonexist_host in aggregate 18 Oct 11 04:11:38.544860 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:38.544860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Returning 404 to user: Cannot remove host nonexist_host in aggregate 18 {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:38.544860 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bac70e44-e7fb-4fac-af28-3571b600bf27 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/18/action" status: 404 len: 94 microversion: 2.1 time: 0.082563 Oct 11 04:11:38.546575 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 187/362] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:11:38 2022] POST /compute/v2.1/os-aggregates/18/action => generated 94 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:11:38.552115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Action: 'update', calling method: .version_select at 0x7fda1a573d30>, body: {"quota_set": {"ram": "2048"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:38.647864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.649402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.649838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.650771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.651060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.651476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.715730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.716211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.716637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.717355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.719319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.719971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.932027 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c4cab851-423d-461a-8fb7-5726e53ab375 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 204 len: 0 microversion: 2.1 time: 0.515871 Oct 11 04:11:38.932651 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 176/363] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:11:38 2022] DELETE /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:11:38.942017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5f6c62b7-5ba8-4cdc-9f4c-9659afb8c4e8 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:38.952112 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c4eadb0a-fd1d-4cc8-8798-87dd74d09fc2 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/2d018fb004274dc89c5fedd2f6276a33?user_id=28dd69170759480980a5df6f1c3be05f" status: 200 len: 240 microversion: 2.36 time: 0.405407 Oct 11 04:11:38.956624 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 188/364] 10.222.0.26 () {62 vars in 1384 bytes} [Tue Oct 11 04:11:38 2022] PUT /compute/v2.1/os-quota-sets/2d018fb004274dc89c5fedd2f6276a33?user_id=28dd69170759480980a5df6f1c3be05f => generated 240 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:11:38.961780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:38.962452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:38.968473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.969078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.969405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:38.970087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:38.970553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:38.970969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:39.018963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:39.018963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:39.018963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:39.018963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lazy-loading 'fault' on Instance uuid c0a8d846-d0db-4641-80ce-8ed3e5e04d12 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:11:39.096018 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5f6c62b7-5ba8-4cdc-9f4c-9659afb8c4e8 tempest-AggregatesAdminNegativeTestJSON-2135704447 tempest-AggregatesAdminNegativeTestJSON-2135704447-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/18" status: 200 len: 0 microversion: 2.1 time: 0.156832 Oct 11 04:11:39.098555 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 177/365] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:38 2022] DELETE /compute/v2.1/os-aggregates/18 => generated 0 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:11:39.111676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eeae8d16-94ef-4c43-ad88-341d275882d1 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] Calling method '.version_select at 0x7fda1a80d790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:39.272122 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eeae8d16-94ef-4c43-ad88-341d275882d1 tempest-QuotasAdminTestV236-2069509165 tempest-QuotasAdminTestV236-2069509165-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/2d018fb004274dc89c5fedd2f6276a33?user_id=28dd69170759480980a5df6f1c3be05f" status: 200 len: 282 microversion: 2.36 time: 0.171625 Oct 11 04:11:39.273671 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 178/366] 10.222.0.26 () {60 vars in 1364 bytes} [Tue Oct 11 04:11:39 2022] GET /compute/v2.1/os-quota-sets/2d018fb004274dc89c5fedd2f6276a33?user_id=28dd69170759480980a5df6f1c3be05f => generated 282 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:11:39.281381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:39.291787 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fa0e7980-4ac0-4228-887a-415495e20de7 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1456 microversion: 2.1 time: 0.334076 Oct 11 04:11:39.310380 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 189/367] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:38 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1456 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:39.310845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-87cd5c50-ed79-44f2-8d69-1bcbd87d6013 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:39.311115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-17f1f193-db7a-4765-8443-0cad9f2d537b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:39.311115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-17f1f193-db7a-4765-8443-0cad9f2d537b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:39.311295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-87cd5c50-ed79-44f2-8d69-1bcbd87d6013 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:39.311295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87cd5c50-ed79-44f2-8d69-1bcbd87d6013 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:39.311295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87cd5c50-ed79-44f2-8d69-1bcbd87d6013 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:39.311546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87cd5c50-ed79-44f2-8d69-1bcbd87d6013 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:39.312606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87cd5c50-ed79-44f2-8d69-1bcbd87d6013 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:39.313098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87cd5c50-ed79-44f2-8d69-1bcbd87d6013 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:39.313700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87cd5c50-ed79-44f2-8d69-1bcbd87d6013 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:39.325754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f1f193-db7a-4765-8443-0cad9f2d537b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:39.326292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f1f193-db7a-4765-8443-0cad9f2d537b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:39.326729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f1f193-db7a-4765-8443-0cad9f2d537b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:39.327604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f1f193-db7a-4765-8443-0cad9f2d537b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:39.328123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f1f193-db7a-4765-8443-0cad9f2d537b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:39.328972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f1f193-db7a-4765-8443-0cad9f2d537b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:39.421957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-17f1f193-db7a-4765-8443-0cad9f2d537b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:39.430707 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-17f1f193-db7a-4765-8443-0cad9f2d537b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1271 microversion: 2.1 time: 0.133849 Oct 11 04:11:39.431517 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 190/368] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:39 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1271 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:39.442443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b02e6df9-b09b-40d6-b751-70cb30fc9997 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:39.444362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b02e6df9-b09b-40d6-b751-70cb30fc9997 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:39.463342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b02e6df9-b09b-40d6-b751-70cb30fc9997 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:39.464173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b02e6df9-b09b-40d6-b751-70cb30fc9997 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:39.464903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b02e6df9-b09b-40d6-b751-70cb30fc9997 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:39.465809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b02e6df9-b09b-40d6-b751-70cb30fc9997 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:39.466448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b02e6df9-b09b-40d6-b751-70cb30fc9997 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:39.467026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b02e6df9-b09b-40d6-b751-70cb30fc9997 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:39.515601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-87cd5c50-ed79-44f2-8d69-1bcbd87d6013 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:39.530597 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-87cd5c50-ed79-44f2-8d69-1bcbd87d6013 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1331 microversion: 2.1 time: 0.255355 Oct 11 04:11:39.534948 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 179/369] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:39 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1331 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:39.756142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b02e6df9-b09b-40d6-b751-70cb30fc9997 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:39.802598 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b02e6df9-b09b-40d6-b751-70cb30fc9997 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1463 microversion: 2.1 time: 0.362442 Oct 11 04:11:39.806067 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 191/370] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:39 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1463 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:40.212123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0e35d9f6-e0b8-4600-9979-8a2a241175d8 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:40.213431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0e35d9f6-e0b8-4600-9979-8a2a241175d8 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:40.221511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e35d9f6-e0b8-4600-9979-8a2a241175d8 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:40.222163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e35d9f6-e0b8-4600-9979-8a2a241175d8 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:40.222790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e35d9f6-e0b8-4600-9979-8a2a241175d8 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:40.223647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e35d9f6-e0b8-4600-9979-8a2a241175d8 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:40.224240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e35d9f6-e0b8-4600-9979-8a2a241175d8 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:40.225412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e35d9f6-e0b8-4600-9979-8a2a241175d8 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:40.329385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:40.330640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:40.337679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:40.338466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:40.339056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:40.339922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:40.340530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:40.341098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:40.387908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:40.388718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:40.389200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:40.389779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lazy-loading 'fault' on Instance uuid c0a8d846-d0db-4641-80ce-8ed3e5e04d12 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:11:40.741551 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0e35d9f6-e0b8-4600-9979-8a2a241175d8 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1614 microversion: 2.1 time: 0.918163 Oct 11 04:11:40.744501 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 180/371] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:39 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1614 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:40.749393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a042bbe-45c7-49f2-ba7e-6e390498b589 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:40.757430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a042bbe-45c7-49f2-ba7e-6e390498b589 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:40.769924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a042bbe-45c7-49f2-ba7e-6e390498b589 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:40.770453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a042bbe-45c7-49f2-ba7e-6e390498b589 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:40.770909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a042bbe-45c7-49f2-ba7e-6e390498b589 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:40.779133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a042bbe-45c7-49f2-ba7e-6e390498b589 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:40.779625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a042bbe-45c7-49f2-ba7e-6e390498b589 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:40.780067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a042bbe-45c7-49f2-ba7e-6e390498b589 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:40.889393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a042bbe-45c7-49f2-ba7e-6e390498b589 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:40.903139 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a042bbe-45c7-49f2-ba7e-6e390498b589 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1277 microversion: 2.1 time: 0.155079 Oct 11 04:11:40.904257 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 181/372] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:40 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:40.912803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ebd40f43-a908-423b-995e-75bf46ed3ab9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:40.913556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ebd40f43-a908-423b-995e-75bf46ed3ab9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:40.930315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebd40f43-a908-423b-995e-75bf46ed3ab9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:40.930315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebd40f43-a908-423b-995e-75bf46ed3ab9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:40.932537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebd40f43-a908-423b-995e-75bf46ed3ab9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:40.933739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebd40f43-a908-423b-995e-75bf46ed3ab9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:40.934351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebd40f43-a908-423b-995e-75bf46ed3ab9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:40.935537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebd40f43-a908-423b-995e-75bf46ed3ab9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:41.216311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ebd40f43-a908-423b-995e-75bf46ed3ab9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:41.225076 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ebd40f43-a908-423b-995e-75bf46ed3ab9 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1331 microversion: 2.1 time: 0.318529 Oct 11 04:11:41.226094 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 182/373] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:40 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1331 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:41.232356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:41.233283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:41.241916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:41.242741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:41.243330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:41.244253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:41.244708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:41.245136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:41.265136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:41.273246 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-28870cfe-98bc-4d7d-a5b2-7a53f9769db9 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1456 microversion: 2.1 time: 0.949880 Oct 11 04:11:41.274387 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 192/374] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:40 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1456 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:41.351081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4733b24a80eb4fe7ae779f43b0c83f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfdccb0c6a84bbf8dd51c4d8b2cf590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:41.351081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] flavor_id is None. Assuming migration. {{(pid=120994) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 04:11:41.351081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120994) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 04:11:41.771775 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e78ad30e-07dc-4293-b751-1056c4c579c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555/action" status: 202 len: 0 microversion: 2.1 time: 0.541258 Oct 11 04:11:41.773060 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 183/375] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:11:41 2022] POST /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:41.780762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-18f508c5-5a7e-443a-8384-98a429a1ea1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:41.781376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-18f508c5-5a7e-443a-8384-98a429a1ea1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:41.798108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f508c5-5a7e-443a-8384-98a429a1ea1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:41.800667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f508c5-5a7e-443a-8384-98a429a1ea1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:41.801157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f508c5-5a7e-443a-8384-98a429a1ea1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:41.801908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f508c5-5a7e-443a-8384-98a429a1ea1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:41.802409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f508c5-5a7e-443a-8384-98a429a1ea1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:41.802839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f508c5-5a7e-443a-8384-98a429a1ea1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:41.934579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2b4ac95-bcec-497a-899a-880df56d0d37 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:41.935476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b2b4ac95-bcec-497a-899a-880df56d0d37 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:41.944345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac95-bcec-497a-899a-880df56d0d37 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:41.945092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac95-bcec-497a-899a-880df56d0d37 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:41.945701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac95-bcec-497a-899a-880df56d0d37 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:41.946625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac95-bcec-497a-899a-880df56d0d37 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:41.947292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac95-bcec-497a-899a-880df56d0d37 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:41.947873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2b4ac95-bcec-497a-899a-880df56d0d37 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:42.023946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b2b4ac95-bcec-497a-899a-880df56d0d37 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:42.038966 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2b4ac95-bcec-497a-899a-880df56d0d37 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1277 microversion: 2.1 time: 0.108901 Oct 11 04:11:42.039720 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 184/376] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:41 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1277 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:42.207750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18f508c5-5a7e-443a-8384-98a429a1ea1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:42.223119 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-18f508c5-5a7e-443a-8384-98a429a1ea1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1472 microversion: 2.1 time: 0.445022 Oct 11 04:11:42.229512 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 193/377] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:41 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1472 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:42.251459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e5180fb-4cc9-4360-af85-f7800b09c53e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:42.258818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e5180fb-4cc9-4360-af85-f7800b09c53e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:42.307433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:42.309681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:42.309882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5180fb-4cc9-4360-af85-f7800b09c53e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:42.310567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5180fb-4cc9-4360-af85-f7800b09c53e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:42.333996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5180fb-4cc9-4360-af85-f7800b09c53e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:42.340098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5180fb-4cc9-4360-af85-f7800b09c53e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:42.343934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5180fb-4cc9-4360-af85-f7800b09c53e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:42.345333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e5180fb-4cc9-4360-af85-f7800b09c53e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:42.357056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:42.363273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:42.363273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:42.363273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:42.363273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:42.363630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:42.447130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:42.447732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:42.448232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:42.448938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lazy-loading 'fault' on Instance uuid c0a8d846-d0db-4641-80ce-8ed3e5e04d12 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:11:42.613846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66b61fab456b48188ef790d8d5dcb4b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f0bed16885ed4cb2b32330891efb3424', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:42.613954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e5180fb-4cc9-4360-af85-f7800b09c53e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:42.622565 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e5180fb-4cc9-4360-af85-f7800b09c53e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1331 microversion: 2.1 time: 0.376656 Oct 11 04:11:42.623204 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 185/378] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:42 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1331 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:42.623405 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-169246a1-4b78-4ed2-9483-8e19a191e491 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 200 len: 1414 microversion: 2.1 time: 0.330528 Oct 11 04:11:42.630073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b765c9ae-2c0d-4c0e-b7e5-500aab7e54cf req-0d7dc834-dd60-47c1-b735-6c5589b31883 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0a8d846-d0db-4641-80ce-8ed3e5e04d12", "name": "network-vif-deleted", "tag": "ab6df6f4-1334-42fb-8aa1-62a66c1e80a9"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:42.644656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b765c9ae-2c0d-4c0e-b7e5-500aab7e54cf req-0d7dc834-dd60-47c1-b735-6c5589b31883 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:42.645745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b765c9ae-2c0d-4c0e-b7e5-500aab7e54cf req-0d7dc834-dd60-47c1-b735-6c5589b31883 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:42.646434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b765c9ae-2c0d-4c0e-b7e5-500aab7e54cf req-0d7dc834-dd60-47c1-b735-6c5589b31883 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:42.648153 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 194/379] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:42 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 1414 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:42.661908 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b765c9ae-2c0d-4c0e-b7e5-500aab7e54cf req-0d7dc834-dd60-47c1-b735-6c5589b31883 service nova] Creating event network-vif-deleted:ab6df6f4-1334-42fb-8aa1-62a66c1e80a9 for instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 on n-h2-860892-1 Oct 11 04:11:42.668159 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b765c9ae-2c0d-4c0e-b7e5-500aab7e54cf req-0d7dc834-dd60-47c1-b735-6c5589b31883 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042634 Oct 11 04:11:42.669071 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 186/380] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:43.064208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29e5e99c-74a2-4be7-be7b-1d7fdd9ca8b2 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:43.065999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-29e5e99c-74a2-4be7-be7b-1d7fdd9ca8b2 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:43.087695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e5e99c-74a2-4be7-be7b-1d7fdd9ca8b2 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:43.088380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e5e99c-74a2-4be7-be7b-1d7fdd9ca8b2 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:43.090531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e5e99c-74a2-4be7-be7b-1d7fdd9ca8b2 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:43.094624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e5e99c-74a2-4be7-be7b-1d7fdd9ca8b2 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:43.095313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e5e99c-74a2-4be7-be7b-1d7fdd9ca8b2 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:43.095750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e5e99c-74a2-4be7-be7b-1d7fdd9ca8b2 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:43.247968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-17aad0fb-8074-46d0-92aa-982cf4746552 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:43.248578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-17aad0fb-8074-46d0-92aa-982cf4746552 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:43.259137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17aad0fb-8074-46d0-92aa-982cf4746552 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:43.264373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17aad0fb-8074-46d0-92aa-982cf4746552 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:43.264373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17aad0fb-8074-46d0-92aa-982cf4746552 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:43.264373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17aad0fb-8074-46d0-92aa-982cf4746552 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:43.264373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17aad0fb-8074-46d0-92aa-982cf4746552 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:43.265114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17aad0fb-8074-46d0-92aa-982cf4746552 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:43.785526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-17aad0fb-8074-46d0-92aa-982cf4746552 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:43.793952 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-17aad0fb-8074-46d0-92aa-982cf4746552 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1472 microversion: 2.1 time: 0.550696 Oct 11 04:11:43.811975 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 187/381] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:43 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1472 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:43.826740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5e9178bd-7183-4306-9cbc-a7cdc917031d req-13d016de-62e2-4b4d-bb88-4cb26f055c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8728557c-7590-4694-ae89-ca4194b8e209", "name": "network-vif-plugged", "status": "completed", "tag": "6f15cb93-8f8a-423e-93c9-163696b0d2fc"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:43.836880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5e9178bd-7183-4306-9cbc-a7cdc917031d req-13d016de-62e2-4b4d-bb88-4cb26f055c6b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:43.837355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5e9178bd-7183-4306-9cbc-a7cdc917031d req-13d016de-62e2-4b4d-bb88-4cb26f055c6b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:43.837780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5e9178bd-7183-4306-9cbc-a7cdc917031d req-13d016de-62e2-4b4d-bb88-4cb26f055c6b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:43.849394 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5e9178bd-7183-4306-9cbc-a7cdc917031d req-13d016de-62e2-4b4d-bb88-4cb26f055c6b service nova] Creating event network-vif-plugged:6f15cb93-8f8a-423e-93c9-163696b0d2fc for instance 8728557c-7590-4694-ae89-ca4194b8e209 on n-h2-860892-1 Oct 11 04:11:43.856866 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5e9178bd-7183-4306-9cbc-a7cdc917031d req-13d016de-62e2-4b4d-bb88-4cb26f055c6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041844 Oct 11 04:11:43.857278 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 188/382] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:43.876723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8be7b8c6-15b0-4035-8834-456c92a67809 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:43.884354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8be7b8c6-15b0-4035-8834-456c92a67809 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:43.892736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8be7b8c6-15b0-4035-8834-456c92a67809 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:43.899525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8be7b8c6-15b0-4035-8834-456c92a67809 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:43.901037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8be7b8c6-15b0-4035-8834-456c92a67809 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:43.902308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8be7b8c6-15b0-4035-8834-456c92a67809 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:43.902975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8be7b8c6-15b0-4035-8834-456c92a67809 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:43.903619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8be7b8c6-15b0-4035-8834-456c92a67809 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.170856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8be7b8c6-15b0-4035-8834-456c92a67809 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:44.196522 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8be7b8c6-15b0-4035-8834-456c92a67809 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1331 microversion: 2.1 time: 0.336943 Oct 11 04:11:44.197682 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 189/383] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:43 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1331 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:44.210100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:44.211462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:44.221676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=3,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:44.224784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.226585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.232291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.232291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.232291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.232291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.268996 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] HTTP exception thrown: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Request method failure captured: Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 HTTP/1.1 Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROyzAE60n_vtdUscpLrBn2ICMPKYMV00QOrB3Q_8OoqfuZWLCO9d6pmQ-EMv3sw_ebTcJWpG0W--GWRHH-TfebQ1Fpq3GgiQBo71Y_bo7dmY1aoL9CfSJO8r9_I_zbs4oOUQfWkczXPQ5IZLb5IbHClJNT5Kcli56DbAwTWr28Wo3BQ Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:11:44.271569 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}] Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 66b61fab456b48188ef790d8d5dcb4b5 Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.272897 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'c0a8d846-d0db-4641-80ce-8ed3e5e04d12'} Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:44.273805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.276052 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.277022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Returning 404 to user: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:44.277022 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-17ee3970-2e72-4256-b76c-f19bd61617b6 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 404 len: 111 microversion: 2.1 time: 0.074205 Oct 11 04:11:44.278531 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 190/384] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:44 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:44.290685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-29e5e99c-74a2-4be7-be7b-1d7fdd9ca8b2 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:44.299167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:44.299647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:44.307234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.307718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.308220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.308885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.309335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.309750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.312728 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-29e5e99c-74a2-4be7-be7b-1d7fdd9ca8b2 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1319 microversion: 2.1 time: 1.252040 Oct 11 04:11:44.312728 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 195/385] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:43 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1319 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:44.349662 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] HTTP exception thrown: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Request method failure captured: Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 HTTP/1.1 Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROyzAE60n_vtdUscpLrBn2ICMPKYMV00QOrB3Q_8OoqfuZWLCO9d6pmQ-EMv3sw_ebTcJWpG0W--GWRHH-TfebQ1Fpq3GgiQBo71Y_bo7dmY1aoL9CfSJO8r9_I_zbs4oOUQfWkczXPQ5IZLb5IbHClJNT5Kcli56DbAwTWr28Wo3BQ Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:11:44.351360 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}] Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 66b61fab456b48188ef790d8d5dcb4b5 Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.352602 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'c0a8d846-d0db-4641-80ce-8ed3e5e04d12'} Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:44.353266 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.354913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.357238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Returning 404 to user: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:44.357238 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40695b60-c447-409d-a37d-3208bfbaa122 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 404 len: 111 microversion: 2.1 time: 0.064377 Oct 11 04:11:44.357238 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 191/386] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:11:44 2022] DELETE /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:44.362073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:44.362775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: c0a8d846-d0db-4641-80ce-8ed3e5e04d12] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:44.371587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.372088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.372533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.373247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.380937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.381792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.415131 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] HTTP exception thrown: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Request method failure captured: Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 HTTP/1.1 Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROyzAE60n_vtdUscpLrBn2ICMPKYMV00QOrB3Q_8OoqfuZWLCO9d6pmQ-EMv3sw_ebTcJWpG0W--GWRHH-TfebQ1Fpq3GgiQBo71Y_bo7dmY1aoL9CfSJO8r9_I_zbs4oOUQfWkczXPQ5IZLb5IbHClJNT5Kcli56DbAwTWr28Wo3BQ Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:44.419924 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}] Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 66b61fab456b48188ef790d8d5dcb4b5 Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.421096 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'c0a8d846-d0db-4641-80ce-8ed3e5e04d12'} Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:44.421754 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. Oct 11 04:11:44.423531 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.425604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Returning 404 to user: Instance c0a8d846-d0db-4641-80ce-8ed3e5e04d12 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:44.425604 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d7776779-e67d-443d-9585-b4133f51a79c tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12" status: 404 len: 111 microversion: 2.1 time: 0.064066 Oct 11 04:11:44.425604 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 196/387] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:44 2022] GET /compute/v2.1/servers/c0a8d846-d0db-4641-80ce-8ed3e5e04d12 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:44.431957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:44.434774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:44.443185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.443691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.444204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.444917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.445373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.445799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.463936 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] HTTP exception thrown: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Request method failure captured: Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa HTTP/1.1 Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROyzAE60n_vtdUscpLrBn2ICMPKYMV00QOrB3Q_8OoqfuZWLCO9d6pmQ-EMv3sw_ebTcJWpG0W--GWRHH-TfebQ1Fpq3GgiQBo71Y_bo7dmY1aoL9CfSJO8r9_I_zbs4oOUQfWkczXPQ5IZLb5IbHClJNT5Kcli56DbAwTWr28Wo3BQ Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:11:44.465780 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}] Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 66b61fab456b48188ef790d8d5dcb4b5 Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:44.467289 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '2b18dcce-1cfa-415c-9f84-3606760a55aa'} Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:44.468070 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:44.469483 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.472502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Returning 404 to user: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:44.473594 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48264e6c-9a17-4953-851a-bcf1acd53dd5 tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 404 len: 111 microversion: 2.1 time: 0.046427 Oct 11 04:11:44.477981 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 192/388] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:11:44 2022] DELETE /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:44.483479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:44.486452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] [instance: 2b18dcce-1cfa-415c-9f84-3606760a55aa] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:44.490940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.492047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.492645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.493521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.494034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.494695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.537622 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] HTTP exception thrown: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Request method failure captured: Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa HTTP/1.1 Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROyzAE60n_vtdUscpLrBn2ICMPKYMV00QOrB3Q_8OoqfuZWLCO9d6pmQ-EMv3sw_ebTcJWpG0W--GWRHH-TfebQ1Fpq3GgiQBo71Y_bo7dmY1aoL9CfSJO8r9_I_zbs4oOUQfWkczXPQ5IZLb5IbHClJNT5Kcli56DbAwTWr28Wo3BQ Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:44.539624 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f0bed16885ed4cb2b32330891efb3424"}]}] Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f0bed16885ed4cb2b32330891efb3424 Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersAdminTestJSON-238204289 Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 66b61fab456b48188ef790d8d5dcb4b5 Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersAdminTestJSON-238204289-project Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:44.540927 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '2b18dcce-1cfa-415c-9f84-3606760a55aa'} Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:44.541720 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. Oct 11 04:11:44.542950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:44.547251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] Returning 404 to user: Instance 2b18dcce-1cfa-415c-9f84-3606760a55aa could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:44.548561 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-519803e2-e4c7-47fb-a838-a772e544bedf tempest-DeleteServersAdminTestJSON-238204289 tempest-DeleteServersAdminTestJSON-238204289-project] 10.222.0.26 "GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa" status: 404 len: 111 microversion: 2.1 time: 0.069835 Oct 11 04:11:44.549642 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 197/389] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:44 2022] GET /compute/v2.1/servers/2b18dcce-1cfa-415c-9f84-3606760a55aa => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:11:44.817894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8dd72bfe-89a6-485c-a7fb-e779c83d27be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:44.819625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8dd72bfe-89a6-485c-a7fb-e779c83d27be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:44.834622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd72bfe-89a6-485c-a7fb-e779c83d27be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.835789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd72bfe-89a6-485c-a7fb-e779c83d27be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.836242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd72bfe-89a6-485c-a7fb-e779c83d27be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.839975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd72bfe-89a6-485c-a7fb-e779c83d27be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:44.840800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd72bfe-89a6-485c-a7fb-e779c83d27be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:44.841655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd72bfe-89a6-485c-a7fb-e779c83d27be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:44.847700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:45.028499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8dd72bfe-89a6-485c-a7fb-e779c83d27be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:45.039777 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8dd72bfe-89a6-485c-a7fb-e779c83d27be tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1472 microversion: 2.1 time: 0.224251 Oct 11 04:11:45.040701 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 193/390] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:44 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1472 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:45.224145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-398d1dcd-3494-49d1-9711-e05a22e87fde tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:45.224980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-398d1dcd-3494-49d1-9711-e05a22e87fde tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:45.239032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-398d1dcd-3494-49d1-9711-e05a22e87fde tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:45.246640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-398d1dcd-3494-49d1-9711-e05a22e87fde tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:45.246640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-398d1dcd-3494-49d1-9711-e05a22e87fde tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:45.246640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-398d1dcd-3494-49d1-9711-e05a22e87fde tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:45.246979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-398d1dcd-3494-49d1-9711-e05a22e87fde tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:45.246979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-398d1dcd-3494-49d1-9711-e05a22e87fde tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:45.335693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-279f9541-430c-4f86-a712-7536bf1af34a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:45.336748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-279f9541-430c-4f86-a712-7536bf1af34a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:45.346955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-279f9541-430c-4f86-a712-7536bf1af34a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:45.347495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-279f9541-430c-4f86-a712-7536bf1af34a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:45.347931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-279f9541-430c-4f86-a712-7536bf1af34a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:45.348708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-279f9541-430c-4f86-a712-7536bf1af34a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:45.349094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-279f9541-430c-4f86-a712-7536bf1af34a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:45.349648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-279f9541-430c-4f86-a712-7536bf1af34a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:45.665818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-279f9541-430c-4f86-a712-7536bf1af34a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:45.685356 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-279f9541-430c-4f86-a712-7536bf1af34a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1319 microversion: 2.1 time: 0.351977 Oct 11 04:11:45.697440 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 194/391] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:45 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1319 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:45.714058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-398d1dcd-3494-49d1-9711-e05a22e87fde tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:45.734486 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-398d1dcd-3494-49d1-9711-e05a22e87fde tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1331 microversion: 2.1 time: 0.515511 Oct 11 04:11:45.749092 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 198/392] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:45 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1331 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:45.888669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2821ce78-6876-4743-96af-7714ec7a3a5e req-217d2d21-5a8e-479b-920b-607800ec214e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd31a352-f84d-4092-94dc-061ef90957b1", "tag": "da7e4898-175c-4ff7-b077-0b6a6a8bd621"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:45.906055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2821ce78-6876-4743-96af-7714ec7a3a5e req-217d2d21-5a8e-479b-920b-607800ec214e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:45.912177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2821ce78-6876-4743-96af-7714ec7a3a5e req-217d2d21-5a8e-479b-920b-607800ec214e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:45.912630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2821ce78-6876-4743-96af-7714ec7a3a5e req-217d2d21-5a8e-479b-920b-607800ec214e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:45.951516 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2821ce78-6876-4743-96af-7714ec7a3a5e req-217d2d21-5a8e-479b-920b-607800ec214e service nova] Creating event network-changed:da7e4898-175c-4ff7-b077-0b6a6a8bd621 for instance bd31a352-f84d-4092-94dc-061ef90957b1 on n-h1-860892-1 Oct 11 04:11:45.956799 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2821ce78-6876-4743-96af-7714ec7a3a5e req-217d2d21-5a8e-479b-920b-607800ec214e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071692 Oct 11 04:11:45.957705 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 195/393] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:46.063295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4515667c-303c-4bce-9919-a634cb154b2a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:46.063903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4515667c-303c-4bce-9919-a634cb154b2a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:46.080833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4515667c-303c-4bce-9919-a634cb154b2a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:46.082788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4515667c-303c-4bce-9919-a634cb154b2a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:46.083491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4515667c-303c-4bce-9919-a634cb154b2a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:46.086074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4515667c-303c-4bce-9919-a634cb154b2a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:46.086959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4515667c-303c-4bce-9919-a634cb154b2a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:46.087999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4515667c-303c-4bce-9919-a634cb154b2a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:46.625605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4515667c-303c-4bce-9919-a634cb154b2a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:46.634957 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4515667c-303c-4bce-9919-a634cb154b2a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1472 microversion: 2.1 time: 0.573904 Oct 11 04:11:46.634957 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 199/394] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:46 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1472 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:46.714960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5ecfea4-cf02-4901-96e8-00a49b7413fb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:46.716324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5ecfea4-cf02-4901-96e8-00a49b7413fb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:46.726931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5ecfea4-cf02-4901-96e8-00a49b7413fb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:46.727996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5ecfea4-cf02-4901-96e8-00a49b7413fb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:46.729247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5ecfea4-cf02-4901-96e8-00a49b7413fb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:46.730898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5ecfea4-cf02-4901-96e8-00a49b7413fb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:46.733279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5ecfea4-cf02-4901-96e8-00a49b7413fb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:46.735071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5ecfea4-cf02-4901-96e8-00a49b7413fb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:46.763141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cf75224-9030-405b-9d09-994bb0d714ec tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:46.764660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2cf75224-9030-405b-9d09-994bb0d714ec tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:46.779228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cf75224-9030-405b-9d09-994bb0d714ec tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:46.781265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cf75224-9030-405b-9d09-994bb0d714ec tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:46.783742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cf75224-9030-405b-9d09-994bb0d714ec tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:46.786703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cf75224-9030-405b-9d09-994bb0d714ec tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:46.790457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cf75224-9030-405b-9d09-994bb0d714ec tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:46.795525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cf75224-9030-405b-9d09-994bb0d714ec tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:47.133834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5ecfea4-cf02-4901-96e8-00a49b7413fb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:47.150013 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5ecfea4-cf02-4901-96e8-00a49b7413fb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1319 microversion: 2.1 time: 0.441775 Oct 11 04:11:47.150013 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 196/395] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:46 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1319 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:47.498309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c55e9c41-4584-44c4-a591-6983548056cf tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:47.500950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c55e9c41-4584-44c4-a591-6983548056cf tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:47.501754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c55e9c41-4584-44c4-a591-6983548056cf tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:47.502541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c55e9c41-4584-44c4-a591-6983548056cf tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:47.503531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c55e9c41-4584-44c4-a591-6983548056cf tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:47.504213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c55e9c41-4584-44c4-a591-6983548056cf tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:47.505215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c55e9c41-4584-44c4-a591-6983548056cf tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:47.538980 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c55e9c41-4584-44c4-a591-6983548056cf tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.388571 Oct 11 04:11:47.539890 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 197/396] 10.222.0.26 () {58 vars in 1164 bytes} [Tue Oct 11 04:11:47 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:11:47.607753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d924b2d-64a3-499e-ad6c-c3324d50c9e9 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Action: 'create', calling method: .version_select at 0x7fda1a623af0>, body: {"keypair": {"name": "tempest-keypair-2053487570", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHBcl4KQH2/D1Am/jD1jBiYQqBK8TwN0OhzrT5KpmlbNYAHZuVHFiUcorTaRe6F5DWN1/Veq7WVZdooRz6ZT0QDUQ2Mz1eSYXwAUctdryPYaGPbL3L99zE0U5Ng3GKY7JQ=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:47.634911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2d924b2d-64a3-499e-ad6c-c3324d50c9e9 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:47.641002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2d924b2d-64a3-499e-ad6c-c3324d50c9e9 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for user 74cf419157d34384bfeba9eae8f1ef8f and project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:47.740651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2cf75224-9030-405b-9d09-994bb0d714ec tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:47.748984 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2cf75224-9030-405b-9d09-994bb0d714ec tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1534 microversion: 2.1 time: 0.990472 Oct 11 04:11:47.749554 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 200/397] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:46 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1534 bytes in 992 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:47.758894 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d924b2d-64a3-499e-ad6c-c3324d50c9e9 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.214739 Oct 11 04:11:47.758894 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 198/398] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:11:47 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:47.761893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fd0df356-0ada-4035-ace2-06ee2f9bad51 tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:47.769918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0df356-0ada-4035-ace2-06ee2f9bad51 tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:47.770533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0df356-0ada-4035-ace2-06ee2f9bad51 tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:47.770871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0df356-0ada-4035-ace2-06ee2f9bad51 tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:47.771600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0df356-0ada-4035-ace2-06ee2f9bad51 tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:47.772053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0df356-0ada-4035-ace2-06ee2f9bad51 tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:47.772473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0df356-0ada-4035-ace2-06ee2f9bad51 tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:47.773845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e14aac2b-1c52-4da7-98f7-8b736a4bab53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:47.774631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e14aac2b-1c52-4da7-98f7-8b736a4bab53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:47.784567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e14aac2b-1c52-4da7-98f7-8b736a4bab53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:47.785057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e14aac2b-1c52-4da7-98f7-8b736a4bab53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:47.786740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e14aac2b-1c52-4da7-98f7-8b736a4bab53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:47.787767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e14aac2b-1c52-4da7-98f7-8b736a4bab53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:47.788554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e14aac2b-1c52-4da7-98f7-8b736a4bab53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:47.789195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e14aac2b-1c52-4da7-98f7-8b736a4bab53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:47.827627 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fd0df356-0ada-4035-ace2-06ee2f9bad51 tempest-AZAdminV2TestJSON-2096925744 tempest-AZAdminV2TestJSON-2096925744-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.073906 Oct 11 04:11:47.828270 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 201/399] 10.222.0.26 () {58 vars in 1185 bytes} [Tue Oct 11 04:11:47 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:47.861395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f28f1d1-a4c9-4659-9c82-863255f21787 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Calling method '.version_select at 0x7fda1a50cdc0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:47.870812 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5f28f1d1-a4c9-4659-9c82-863255f21787 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-2053487570" status: 200 len: 497 microversion: 2.1 time: 0.041494 Oct 11 04:11:47.871990 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 202/400] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:11:47 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2053487570 => generated 497 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:47.888118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ec8403a3-be7d-4fe7-a65b-a52839679e00 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Action: 'create', calling method: .version_select at 0x7fda1a573160>, body: {"pool": "99809ad0-6d54-41b3-974c-c4cb964f66c2"} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:48.012552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e14aac2b-1c52-4da7-98f7-8b736a4bab53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:48.021546 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e14aac2b-1c52-4da7-98f7-8b736a4bab53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1472 microversion: 2.1 time: 0.261116 Oct 11 04:11:48.022121 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 199/401] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:47 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1472 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:48.027188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c07426ad-4258-4ca5-9698-fb9135187f19 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Calling method '.version_select at 0x7fda1a5ed280>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:48.138565 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c07426ad-4258-4ca5-9698-fb9135187f19 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053487570" status: 202 len: 0 microversion: 2.1 time: 0.115149 Oct 11 04:11:48.139088 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 200/402] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2053487570 => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:48.150725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bcdc61d8-9cb8-4e2c-8fc4-ec14c7878f1d tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Action: 'create', calling method: .version_select at 0x7fda1a4d2c10>, body: {"keypair": {"name": "tempest-keypair-1217924337", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOlXGwY3Kxg7gmkUsu6+OGrKXisHljSatZELgL8qY7EOZsX22cIM2HrdFzl/SfSeaJlPHNXSAC7TMAFONCoObe80LQFz5fcqBDv/S1UNjdLU71jHaZIFF7Hak+1wGAcCKQ=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:48.166622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-bcdc61d8-9cb8-4e2c-8fc4-ec14c7878f1d tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:48.170421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-bcdc61d8-9cb8-4e2c-8fc4-ec14c7878f1d tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for user 74cf419157d34384bfeba9eae8f1ef8f and project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:48.259967 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bcdc61d8-9cb8-4e2c-8fc4-ec14c7878f1d tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112822 Oct 11 04:11:48.266713 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 201/403] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:11:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:48.271696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f972fcf-b7cd-4c0d-a532-6c79cb0d99ab tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:48.272499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f972fcf-b7cd-4c0d-a532-6c79cb0d99ab tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:48.280841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f972fcf-b7cd-4c0d-a532-6c79cb0d99ab tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:48.282178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f972fcf-b7cd-4c0d-a532-6c79cb0d99ab tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:48.282793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f972fcf-b7cd-4c0d-a532-6c79cb0d99ab tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:48.283708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f972fcf-b7cd-4c0d-a532-6c79cb0d99ab tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:48.284307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f972fcf-b7cd-4c0d-a532-6c79cb0d99ab tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:48.284931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f972fcf-b7cd-4c0d-a532-6c79cb0d99ab tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:48.503392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f972fcf-b7cd-4c0d-a532-6c79cb0d99ab tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:48.529302 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f972fcf-b7cd-4c0d-a532-6c79cb0d99ab tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1319 microversion: 2.1 time: 0.261200 Oct 11 04:11:48.549956 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 202/404] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:48 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1319 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:48.555889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1ed3bc99-fab0-4c80-b42e-d9450d629c89 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Calling method '.version_select at 0x7fda1a678dc0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:48.681671 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1ed3bc99-fab0-4c80-b42e-d9450d629c89 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217924337" status: 202 len: 0 microversion: 2.1 time: 0.129887 Oct 11 04:11:48.686626 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 203/405] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1217924337 => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:48.692366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-52c3d14b-c298-4882-82b5-82a471a72d59 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Action: 'create', calling method: .version_select at 0x7fda1a4f48b0>, body: {"keypair": {"name": "tempest-keypair-128840153", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:48.709888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-52c3d14b-c298-4882-82b5-82a471a72d59 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:48.716420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-52c3d14b-c298-4882-82b5-82a471a72d59 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for user 74cf419157d34384bfeba9eae8f1ef8f and project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:48.835966 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-52c3d14b-c298-4882-82b5-82a471a72d59 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 573 microversion: 2.1 time: 0.148003 Oct 11 04:11:48.843355 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 204/406] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:11:48 2022] POST /compute/v2.1/os-keypairs => generated 573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:48.850885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e2aeb9d6-162f-401e-97c1-0b262208b39a tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Calling method '.version_select at 0x7fda1a5ed430>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:48.927388 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e2aeb9d6-162f-401e-97c1-0b262208b39a tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-128840153" status: 202 len: 0 microversion: 2.1 time: 0.082250 Oct 11 04:11:48.934861 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 205/407] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:11:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-128840153 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:48.940198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-362d8e48-80ef-4034-81d4-d0f82c0a72e3 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Action: 'create', calling method: .version_select at 0x7fda1a4d2a60>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-1163292852", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVzlMcRrpwOYD3ysBu+RA0NWEuD/OcX0JE0M9Fsyju5+O9IpLjIzJ32ImrlJXVQFVc5RrhM08DLtO22b6s3quqmDLIewbAm3ZwOJmrIRG0o8p8rYvKqSJz+1FZSgWnQOw=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:48.945516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=28 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:48.974912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-362d8e48-80ef-4034-81d4-d0f82c0a72e3 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:48.993617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-362d8e48-80ef-4034-81d4-d0f82c0a72e3 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for user 74cf419157d34384bfeba9eae8f1ef8f and project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:49.100115 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-362d8e48-80ef-4034-81d4-d0f82c0a72e3 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.163855 Oct 11 04:11:49.101067 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 206/408] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:11:48 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:49.114991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a84bcab-1002-4884-8ccb-e09646988ad7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:49.121694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a84bcab-1002-4884-8ccb-e09646988ad7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:49.134832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a84bcab-1002-4884-8ccb-e09646988ad7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:49.138973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a84bcab-1002-4884-8ccb-e09646988ad7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:49.139788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a84bcab-1002-4884-8ccb-e09646988ad7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:49.141729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a84bcab-1002-4884-8ccb-e09646988ad7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:49.142350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a84bcab-1002-4884-8ccb-e09646988ad7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:49.143001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a84bcab-1002-4884-8ccb-e09646988ad7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:49.505430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3a84bcab-1002-4884-8ccb-e09646988ad7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:49.515516 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a84bcab-1002-4884-8ccb-e09646988ad7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1472 microversion: 2.1 time: 0.404305 Oct 11 04:11:49.539826 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 207/409] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:49 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1472 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:49.541941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d698b7a9-7be5-497a-b431-01e60c6adbba tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Action: 'create', calling method: .version_select at 0x7fda1a4f4700>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-646660142", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPava9cyczJenKELzhEysAkPC4BxXyJ1S6EAf3bAx7qe4aZXBA9001lpge8biftDgIpkTb3mm94OOa6t42sEnQE+/ypktZNSkz3EIEYVnLIaKJZMQvrnVrVsoaCEqtjaHA=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:49.560250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d698b7a9-7be5-497a-b431-01e60c6adbba tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:49.566477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d698b7a9-7be5-497a-b431-01e60c6adbba tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for user 74cf419157d34384bfeba9eae8f1ef8f and project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:49.676243 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d698b7a9-7be5-497a-b431-01e60c6adbba tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.139832 Oct 11 04:11:49.686809 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 208/410] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:11:49 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:49.695691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40ad0bfb-5453-4116-b4e6-61b681dad7be tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:49.696331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-40ad0bfb-5453-4116-b4e6-61b681dad7be tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:49.709605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ad0bfb-5453-4116-b4e6-61b681dad7be tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:49.709972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ad0bfb-5453-4116-b4e6-61b681dad7be tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:49.710432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ad0bfb-5453-4116-b4e6-61b681dad7be tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:49.716996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ad0bfb-5453-4116-b4e6-61b681dad7be tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:49.717962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ad0bfb-5453-4116-b4e6-61b681dad7be tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:49.720401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ad0bfb-5453-4116-b4e6-61b681dad7be tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:49.983657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40ad0bfb-5453-4116-b4e6-61b681dad7be tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:49.993196 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40ad0bfb-5453-4116-b4e6-61b681dad7be tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1319 microversion: 2.1 time: 0.305201 Oct 11 04:11:50.009872 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 209/411] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:49 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:50.009872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48b954dc-e982-4914-be76-bfdf734e87f0 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Action: 'create', calling method: .version_select at 0x7fda1a4f4040>, body: {"keypair": {"name": "tempest-KeyPairsV2TestJSON-keypair-203611410", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGQpLJYnm0z2vhyviAKfKVjDQGTP6JjMxcfKhs8cqL94pc7mUuZqUkWJXlglfnOAR7O1j189/hISR9RMYVv9JvJcDNqHIh97mcDOkg4lsAXN8glXlqGbB7nxdsxgm0FgWA=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:50.023079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:50.037966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-48b954dc-e982-4914-be76-bfdf734e87f0 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:11:50.043784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-48b954dc-e982-4914-be76-bfdf734e87f0 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Getting quotas for user 74cf419157d34384bfeba9eae8f1ef8f and project 026ba49276dd496aa1c87a5acf0b9dc3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:11:50.189375 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48b954dc-e982-4914-be76-bfdf734e87f0 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.188069 Oct 11 04:11:50.196488 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 210/412] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:11:49 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:50.213487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f785da4-7173-4c88-917a-d2c4b44fc533 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Calling method '.version_select at 0x7fda1a4ae1f0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:50.224017 n-d-860892-1 devstack@n-api.service[120994]: WARNING oslo_db.sqlalchemy.utils [None req-9f785da4-7173-4c88-917a-d2c4b44fc533 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 04:11:50.239274 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f785da4-7173-4c88-917a-d2c4b44fc533 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1092 microversion: 2.1 time: 0.040281 Oct 11 04:11:50.242973 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 211/413] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:11:50 2022] GET /compute/v2.1/os-keypairs => generated 1092 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:50.253752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30a33b05-4018-4436-98a2-1880b18653f0 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Calling method '.version_select at 0x7fda1a4d2430>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:50.385078 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30a33b05-4018-4436-98a2-1880b18653f0 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-203611410" status: 202 len: 0 microversion: 2.1 time: 0.136433 Oct 11 04:11:50.385677 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 212/414] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:11:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-203611410 => generated 0 bytes in 139 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:11:50.437759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-54b6eb2d-dee0-401a-ba12-dc2e4bdab648 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Calling method '.version_select at 0x7fda1a4ae790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:50.533091 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-54b6eb2d-dee0-401a-ba12-dc2e4bdab648 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-646660142" status: 202 len: 0 microversion: 2.1 time: 0.128034 Oct 11 04:11:50.537947 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 213/415] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:11:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-646660142 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:50.553546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4f31f2fa-e4ee-48f6-9d75-91133fe84980 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] Calling method '.version_select at 0x7fda1a6230d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:50.688995 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4f31f2fa-e4ee-48f6-9d75-91133fe84980 tempest-KeyPairsV2TestJSON-562182075 tempest-KeyPairsV2TestJSON-562182075-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1163292852" status: 202 len: 0 microversion: 2.1 time: 0.149446 Oct 11 04:11:50.691830 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 214/416] 10.222.0.26 () {58 vars in 1278 bytes} [Tue Oct 11 04:11:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV2TestJSON-keypair-1163292852 => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:50.704975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-07d316b8-5d70-4d8d-a000-40c9afa7a387 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:50.705839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-07d316b8-5d70-4d8d-a000-40c9afa7a387 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:50.754555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d316b8-5d70-4d8d-a000-40c9afa7a387 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:50.758596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d316b8-5d70-4d8d-a000-40c9afa7a387 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:50.760441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d316b8-5d70-4d8d-a000-40c9afa7a387 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:50.761839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d316b8-5d70-4d8d-a000-40c9afa7a387 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:50.766422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d316b8-5d70-4d8d-a000-40c9afa7a387 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:50.770014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d316b8-5d70-4d8d-a000-40c9afa7a387 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:51.015087 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ec8403a3-be7d-4fe7-a65b-a52839679e00 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 140 microversion: 2.1 time: 3.141542 Oct 11 04:11:51.022432 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 203/417] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:11:47 2022] POST /compute/v2.1/os-floating-ips => generated 140 bytes in 3149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:51.029773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b6f4927a-2d23-437a-9dab-dae666663b75 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:51.031735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b6f4927a-2d23-437a-9dab-dae666663b75 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:51.040818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6f4927a-2d23-437a-9dab-dae666663b75 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:51.041471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6f4927a-2d23-437a-9dab-dae666663b75 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:51.042047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6f4927a-2d23-437a-9dab-dae666663b75 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:51.043048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6f4927a-2d23-437a-9dab-dae666663b75 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:51.044307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6f4927a-2d23-437a-9dab-dae666663b75 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:51.044801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6f4927a-2d23-437a-9dab-dae666663b75 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:51.097373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-07d316b8-5d70-4d8d-a000-40c9afa7a387 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:51.108154 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-07d316b8-5d70-4d8d-a000-40c9afa7a387 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1472 microversion: 2.1 time: 0.413643 Oct 11 04:11:51.108734 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 215/418] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:50 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1472 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:51.575254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b6f4927a-2d23-437a-9dab-dae666663b75 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:51.596985 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b6f4927a-2d23-437a-9dab-dae666663b75 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1319 microversion: 2.1 time: 0.573370 Oct 11 04:11:51.609036 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 204/419] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:51 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1319 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:51.634339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Action: 'action', calling method: .version_select at 0x7fda1c0313a0>, body: {"addFloatingIp": {"address": "172.25.6.2"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:51.653340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:51.677577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:51.680007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:51.684634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:51.685784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:51.690477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:51.696580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:51.916235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-573ba60b-c9ba-4ad9-8048-ef70bd5a739f tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": "1024", "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1107905251", "id": 2085833878, "os-flavor-access:is_public": "True"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:51.916789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:11:51.917200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquired lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:11:52.067563 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-573ba60b-c9ba-4ad9-8048-ef70bd5a739f tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 430 microversion: 2.1 time: 0.953411 Oct 11 04:11:52.078742 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 216/420] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:51 2022] POST /compute/v2.1/flavors => generated 430 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:52.084283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c736e162-0653-497c-b129-916bfabc2b71 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:52.232341 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c736e162-0653-497c-b129-916bfabc2b71 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/2085833878" status: 202 len: 0 microversion: 2.1 time: 0.152151 Oct 11 04:11:52.238110 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 217/421] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:11:52 2022] DELETE /compute/v2.1/flavors/2085833878 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:52.247230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7788e29b-f6f9-4b0f-98c9-ca7a230b9b4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:52.258098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7788e29b-f6f9-4b0f-98c9-ca7a230b9b4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:52.292170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7788e29b-f6f9-4b0f-98c9-ca7a230b9b4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:52.292909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7788e29b-f6f9-4b0f-98c9-ca7a230b9b4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:52.294536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7788e29b-f6f9-4b0f-98c9-ca7a230b9b4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:52.301372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7788e29b-f6f9-4b0f-98c9-ca7a230b9b4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:52.311177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7788e29b-f6f9-4b0f-98c9-ca7a230b9b4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:52.312970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7788e29b-f6f9-4b0f-98c9-ca7a230b9b4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:52.753112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7788e29b-f6f9-4b0f-98c9-ca7a230b9b4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:52.793843 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7788e29b-f6f9-4b0f-98c9-ca7a230b9b4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1477 microversion: 2.1 time: 0.551686 Oct 11 04:11:52.807382 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 218/422] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:52 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1477 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:52.820132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-beb07348-3721-4b19-b16a-3c5ef08c2c1a tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:52.848385 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-beb07348-3721-4b19-b16a-3c5ef08c2c1a tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.039225 Oct 11 04:11:52.858282 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 219/423] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:52 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:52.871845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ad79619f-22ef-48d7-ba01-71ecfceb5636 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:52.872453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ad79619f-22ef-48d7-ba01-71ecfceb5636 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:52.889969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad79619f-22ef-48d7-ba01-71ecfceb5636 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:52.894576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad79619f-22ef-48d7-ba01-71ecfceb5636 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:52.895484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad79619f-22ef-48d7-ba01-71ecfceb5636 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:52.896364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad79619f-22ef-48d7-ba01-71ecfceb5636 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:52.897111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad79619f-22ef-48d7-ba01-71ecfceb5636 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:52.897956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad79619f-22ef-48d7-ba01-71ecfceb5636 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:53.275096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ad79619f-22ef-48d7-ba01-71ecfceb5636 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:53.317929 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ad79619f-22ef-48d7-ba01-71ecfceb5636 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1319 microversion: 2.1 time: 0.446202 Oct 11 04:11:53.319429 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 220/424] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:52 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:53.327477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef021f9c-4d91-4727-9516-53c824aa7d2e tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-136826803", "id": 125176533, "swap": 1024, "rxtx_factor": 2, "OS-FLV-EXT-DATA:ephemeral": 10, "os-flavor-access:is_public": "True"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:53.463291 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef021f9c-4d91-4727-9516-53c824aa7d2e tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.142270 Oct 11 04:11:53.464390 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 221/425] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:53 2022] POST /compute/v2.1/flavors => generated 413 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:53.482540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-644f94b4-464d-40c8-8614-87883e5447c4 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:53.548080 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-644f94b4-464d-40c8-8614-87883e5447c4 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.071259 Oct 11 04:11:53.548735 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 222/426] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:53 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:53.583354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c496de9-6273-4acf-9d4a-e8f9984ffb11 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:53.663154 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c496de9-6273-4acf-9d4a-e8f9984ffb11 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/125176533" status: 202 len: 0 microversion: 2.1 time: 0.083573 Oct 11 04:11:53.668711 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 223/427] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:11:53 2022] DELETE /compute/v2.1/flavors/125176533 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:53.683430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-20acd453-e93e-4584-8a8a-dba56f91f38f tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:53.731450 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-20acd453-e93e-4584-8a8a-dba56f91f38f tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.060291 Oct 11 04:11:53.741113 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 224/428] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:53 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:53.760525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30656366-4a98-4c6a-b06f-519ef7bb84dd tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1356940774", "id": 25990966, "os-flavor-access:is_public": "True"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:53.860421 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30656366-4a98-4c6a-b06f-519ef7bb84dd tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 423 microversion: 2.1 time: 0.098569 Oct 11 04:11:53.860421 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 225/429] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:53 2022] POST /compute/v2.1/flavors => generated 423 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:11:53.860421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-75f7bb84-e06f-4a4a-9359-307f2139bd58 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:53.860421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-75f7bb84-e06f-4a4a-9359-307f2139bd58 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:53.867096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75f7bb84-e06f-4a4a-9359-307f2139bd58 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:53.867096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75f7bb84-e06f-4a4a-9359-307f2139bd58 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:53.867573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75f7bb84-e06f-4a4a-9359-307f2139bd58 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:53.868655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75f7bb84-e06f-4a4a-9359-307f2139bd58 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:53.868655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75f7bb84-e06f-4a4a-9359-307f2139bd58 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:53.868930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75f7bb84-e06f-4a4a-9359-307f2139bd58 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:54.116854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-75f7bb84-e06f-4a4a-9359-307f2139bd58 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:54.127473 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-75f7bb84-e06f-4a4a-9359-307f2139bd58 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1477 microversion: 2.1 time: 0.272436 Oct 11 04:11:54.141159 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 226/430] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:53 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1477 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:54.162137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb183bdd-27f0-4127-850a-1ca2bc762c54 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:54.292666 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb183bdd-27f0-4127-850a-1ca2bc762c54 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/25990966" status: 202 len: 0 microversion: 2.1 time: 0.149145 Oct 11 04:11:54.300121 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 227/431] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:11:54 2022] DELETE /compute/v2.1/flavors/25990966 => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:54.306588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-00e795cd-00bd-4b07-a4f1-3ce014863379 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:54.337003 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-00e795cd-00bd-4b07-a4f1-3ce014863379 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.036573 Oct 11 04:11:54.343354 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 228/432] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:54 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:54.352683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-06cafb26-7542-4a0b-b93d-2df145b5541c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:54.362807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-06cafb26-7542-4a0b-b93d-2df145b5541c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:54.380759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cafb26-7542-4a0b-b93d-2df145b5541c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:54.380759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cafb26-7542-4a0b-b93d-2df145b5541c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:54.380759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cafb26-7542-4a0b-b93d-2df145b5541c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:54.382598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cafb26-7542-4a0b-b93d-2df145b5541c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:54.383926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cafb26-7542-4a0b-b93d-2df145b5541c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:54.385716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cafb26-7542-4a0b-b93d-2df145b5541c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:54.564585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-06cafb26-7542-4a0b-b93d-2df145b5541c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:54.575050 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-06cafb26-7542-4a0b-b93d-2df145b5541c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1319 microversion: 2.1 time: 0.228875 Oct 11 04:11:54.586710 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 229/433] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:54 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:54.591514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f94f23dc-c135-46fd-bca6-753d3cd17109 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-2029697072", "id": null, "os-flavor-access:is_public": "True"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:54.688188 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f94f23dc-c135-46fd-bca6-753d3cd17109 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 507 microversion: 2.1 time: 0.096785 Oct 11 04:11:54.689191 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 230/434] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:54 2022] POST /compute/v2.1/flavors => generated 507 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:54.705362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d1290bc2-3abc-4ee7-9f39-3fbc150dc8c3 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:54.817515 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d1290bc2-3abc-4ee7-9f39-3fbc150dc8c3 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/0433aab3-869e-477b-9f35-6114b57d1939" status: 202 len: 0 microversion: 2.1 time: 0.117263 Oct 11 04:11:54.818327 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 231/435] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:11:54 2022] DELETE /compute/v2.1/flavors/0433aab3-869e-477b-9f35-6114b57d1939 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:11:54.830248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8670cf5b-6ca0-4352-9201-85a21198ef09 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:54.868964 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8670cf5b-6ca0-4352-9201-85a21198ef09 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.045663 Oct 11 04:11:54.874739 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 232/436] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:54 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:11:54.898181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3f857262-1321-486a-92f6-21a368c16afb tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-939124554", "id": "662eac1c-3de2-43c7-b984-75475b076aea", "os-flavor-access:is_public": "True"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:54.966303 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3f857262-1321-486a-92f6-21a368c16afb tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 506 microversion: 2.1 time: 0.072143 Oct 11 04:11:54.974097 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 233/437] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:54 2022] POST /compute/v2.1/flavors => generated 506 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:54.981141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-88449ac5-9cf9-4397-bbd0-7adc52a872d8 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:55.074012 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-88449ac5-9cf9-4397-bbd0-7adc52a872d8 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/662eac1c-3de2-43c7-b984-75475b076aea" status: 202 len: 0 microversion: 2.1 time: 0.098301 Oct 11 04:11:55.077538 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 234/438] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:11:54 2022] DELETE /compute/v2.1/flavors/662eac1c-3de2-43c7-b984-75475b076aea => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:11:55.083222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3f70cc44-cde3-4066-9914-bd8eb94c5ded tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:55.139889 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3f70cc44-cde3-4066-9914-bd8eb94c5ded tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.060492 Oct 11 04:11:55.148454 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 235/439] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:55 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:55.172303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce0e656b-ee10-4c15-8b34-546c4a2be1d0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:55.177937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Building network info cache for instance {{(pid=120993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 04:11:55.183154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce0e656b-ee10-4c15-8b34-546c4a2be1d0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:55.194799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=6,nova_api:DELETE=18 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:55.203246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0e656b-ee10-4c15-8b34-546c4a2be1d0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:55.204513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0e656b-ee10-4c15-8b34-546c4a2be1d0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:55.205727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0e656b-ee10-4c15-8b34-546c4a2be1d0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:55.210400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0e656b-ee10-4c15-8b34-546c4a2be1d0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:55.221550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0e656b-ee10-4c15-8b34-546c4a2be1d0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:55.222859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0e656b-ee10-4c15-8b34-546c4a2be1d0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:55.481398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce0e656b-ee10-4c15-8b34-546c4a2be1d0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:55.501902 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce0e656b-ee10-4c15-8b34-546c4a2be1d0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1477 microversion: 2.1 time: 0.338706 Oct 11 04:11:55.512338 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 236/440] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:55 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1477 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:55.520688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b90cde04-cd0b-43bd-91cc-27075e0be01f tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1796576027", "id": 1895176321, "os-flavor-access:is_public": "True"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:55.640828 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b90cde04-cd0b-43bd-91cc-27075e0be01f tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.123136 Oct 11 04:11:55.642067 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 237/441] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:55 2022] POST /compute/v2.1/flavors => generated 414 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:55.653976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-24a87f7d-b8f1-46a1-b553-a752bed7ed30 req-39adbb23-fc4c-48d8-b5c0-ab126fb4fd40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8728557c-7590-4694-ae89-ca4194b8e209", "tag": "6f15cb93-8f8a-423e-93c9-163696b0d2fc"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:55.680342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-24a87f7d-b8f1-46a1-b553-a752bed7ed30 req-39adbb23-fc4c-48d8-b5c0-ab126fb4fd40 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:55.681120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-24a87f7d-b8f1-46a1-b553-a752bed7ed30 req-39adbb23-fc4c-48d8-b5c0-ab126fb4fd40 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:55.681723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-24a87f7d-b8f1-46a1-b553-a752bed7ed30 req-39adbb23-fc4c-48d8-b5c0-ab126fb4fd40 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:55.707096 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-24a87f7d-b8f1-46a1-b553-a752bed7ed30 req-39adbb23-fc4c-48d8-b5c0-ab126fb4fd40 service nova] Creating event network-changed:6f15cb93-8f8a-423e-93c9-163696b0d2fc for instance 8728557c-7590-4694-ae89-ca4194b8e209 on n-h2-860892-1 Oct 11 04:11:55.712979 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-24a87f7d-b8f1-46a1-b553-a752bed7ed30 req-39adbb23-fc4c-48d8-b5c0-ab126fb4fd40 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069531 Oct 11 04:11:55.714358 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 238/442] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:56.004434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-57b401ab-d6ca-42f8-b446-239162d79db9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Calling method '.version_select at 0x7fda1a4aedc0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:56.006027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57b401ab-d6ca-42f8-b446-239162d79db9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:56.006736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57b401ab-d6ca-42f8-b446-239162d79db9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:56.007167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57b401ab-d6ca-42f8-b446-239162d79db9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:56.042462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57b401ab-d6ca-42f8-b446-239162d79db9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:56.042939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57b401ab-d6ca-42f8-b446-239162d79db9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:56.043659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57b401ab-d6ca-42f8-b446-239162d79db9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:56.072449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57b401ab-d6ca-42f8-b446-239162d79db9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:56.073502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57b401ab-d6ca-42f8-b446-239162d79db9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:56.076561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57b401ab-d6ca-42f8-b446-239162d79db9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:56.110018 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-57b401ab-d6ca-42f8-b446-239162d79db9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.387920 Oct 11 04:11:56.114033 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 239/443] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:55 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:56.123335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-917e4ee9-ad51-4936-8144-8f33c6434ea8 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:56.139874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-917e4ee9-ad51-4936-8144-8f33c6434ea8 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:56.147839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917e4ee9-ad51-4936-8144-8f33c6434ea8 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:56.148633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917e4ee9-ad51-4936-8144-8f33c6434ea8 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:56.149293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917e4ee9-ad51-4936-8144-8f33c6434ea8 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:56.154729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917e4ee9-ad51-4936-8144-8f33c6434ea8 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:56.155161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Updating instance_info_cache with network_info: [{"id": "6f15cb93-8f8a-423e-93c9-163696b0d2fc", "address": "fa:16:3e:bb:3b:d1", "network": {"id": "2e802a11-7516-4fd9-9555-e418218d18bb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-199260235-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "958f9ef6f9ec4cd6895b9b1569bce0d7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6f15cb93-8f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:11:56.156399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917e4ee9-ad51-4936-8144-8f33c6434ea8 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:56.157454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917e4ee9-ad51-4936-8144-8f33c6434ea8 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:56.183218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:56.256493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Releasing lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:11:56.257673 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b1b8057b-01a4-4220-8075-96edf261bdc4 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action" status: 202 len: 0 microversion: 2.1 time: 4.646509 Oct 11 04:11:56.259093 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 205/444] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:11:51 2022] POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action => generated 0 bytes in 4648 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 04:11:56.266277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0a4c7fb7-7e0d-487f-90cf-730b2416fab1 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:56.279740 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0a4c7fb7-7e0d-487f-90cf-730b2416fab1 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/1895176321" status: 200 len: 414 microversion: 2.1 time: 0.019328 Oct 11 04:11:56.290588 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 206/445] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:11:56 2022] GET /compute/v2.1/flavors/1895176321 => generated 414 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:56.310953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c610c656-8edb-4e60-8024-c93d88625503 req-9882a7d7-e98c-42a8-b9fb-dd6d556854b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd31a352-f84d-4092-94dc-061ef90957b1", "name": "network-vif-plugged", "status": "completed", "tag": "da7e4898-175c-4ff7-b077-0b6a6a8bd621"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:56.332109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c610c656-8edb-4e60-8024-c93d88625503 req-9882a7d7-e98c-42a8-b9fb-dd6d556854b8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:56.335217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c610c656-8edb-4e60-8024-c93d88625503 req-9882a7d7-e98c-42a8-b9fb-dd6d556854b8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:56.342789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c610c656-8edb-4e60-8024-c93d88625503 req-9882a7d7-e98c-42a8-b9fb-dd6d556854b8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:56.361705 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c610c656-8edb-4e60-8024-c93d88625503 req-9882a7d7-e98c-42a8-b9fb-dd6d556854b8 service nova] Creating event network-vif-plugged:da7e4898-175c-4ff7-b077-0b6a6a8bd621 for instance bd31a352-f84d-4092-94dc-061ef90957b1 on n-h1-860892-1 Oct 11 04:11:56.382238 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c610c656-8edb-4e60-8024-c93d88625503 req-9882a7d7-e98c-42a8-b9fb-dd6d556854b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081179 Oct 11 04:11:56.385700 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 207/446] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:56.417439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e544747d-8b8d-48bb-9e28-929f67db7a24 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Calling method '.version_select at 0x7fda1a50c3a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:56.430018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e544747d-8b8d-48bb-9e28-929f67db7a24 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:56.431413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e544747d-8b8d-48bb-9e28-929f67db7a24 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:56.433759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e544747d-8b8d-48bb-9e28-929f67db7a24 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:56.440101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-917e4ee9-ad51-4936-8144-8f33c6434ea8 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:56.448709 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-917e4ee9-ad51-4936-8144-8f33c6434ea8 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1319 microversion: 2.1 time: 0.333291 Oct 11 04:11:56.465013 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 240/447] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:56 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1319 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:56.484807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d1112ddc-a21e-4283-9d43-63662560c02a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Action: 'create', calling method: .version_select at 0x7fda1a4f4310>, body: {"pool": "99809ad0-6d54-41b3-974c-c4cb964f66c2"} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:56.490020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e544747d-8b8d-48bb-9e28-929f67db7a24 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:56.490725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e544747d-8b8d-48bb-9e28-929f67db7a24 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:56.491455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e544747d-8b8d-48bb-9e28-929f67db7a24 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:56.547902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e544747d-8b8d-48bb-9e28-929f67db7a24 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:56.548428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e544747d-8b8d-48bb-9e28-929f67db7a24 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:56.548902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e544747d-8b8d-48bb-9e28-929f67db7a24 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:56.557315 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e544747d-8b8d-48bb-9e28-929f67db7a24 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 200 len: 1505 microversion: 2.1 time: 0.168396 Oct 11 04:11:56.557905 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 208/448] 10.222.0.26 () {58 vars in 1167 bytes} [Tue Oct 11 04:11:56 2022] GET /compute/v2.1/os-hypervisors/detail => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:56.733068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d9e0505-9135-400b-b4d3-b2e90b8a9065 tempest-FlavorsAdminTestJSON-1518253381 tempest-FlavorsAdminTestJSON-1518253381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:56.759713 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d9e0505-9135-400b-b4d3-b2e90b8a9065 tempest-FlavorsAdminTestJSON-1518253381 tempest-FlavorsAdminTestJSON-1518253381-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6218 microversion: 2.1 time: 0.197537 Oct 11 04:11:56.761184 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 209/449] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:56 2022] GET /compute/v2.1/flavors/detail => generated 6218 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:56.766554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8821412b-2023-488e-8b76-fe2e8c97a4db tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:56.767527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8821412b-2023-488e-8b76-fe2e8c97a4db tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:56.774423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8821412b-2023-488e-8b76-fe2e8c97a4db tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:56.775179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8821412b-2023-488e-8b76-fe2e8c97a4db tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:56.775778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8821412b-2023-488e-8b76-fe2e8c97a4db tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:56.781492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8821412b-2023-488e-8b76-fe2e8c97a4db tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:56.781492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8821412b-2023-488e-8b76-fe2e8c97a4db tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:56.781492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8821412b-2023-488e-8b76-fe2e8c97a4db tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:56.995913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8821412b-2023-488e-8b76-fe2e8c97a4db tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:57.005283 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8821412b-2023-488e-8b76-fe2e8c97a4db tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1477 microversion: 2.1 time: 0.242833 Oct 11 04:11:57.012843 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 210/450] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:56 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1477 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:57.026227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-80fe66d5-98e8-43f0-8ccd-452505fe60ba tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Calling method '.version_select at 0x7fda1a4d5670>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:57.030025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80fe66d5-98e8-43f0-8ccd-452505fe60ba tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.032338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80fe66d5-98e8-43f0-8ccd-452505fe60ba tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.034134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80fe66d5-98e8-43f0-8ccd-452505fe60ba tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.070383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80fe66d5-98e8-43f0-8ccd-452505fe60ba tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.071264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80fe66d5-98e8-43f0-8ccd-452505fe60ba tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.071928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80fe66d5-98e8-43f0-8ccd-452505fe60ba tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.089567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80fe66d5-98e8-43f0-8ccd-452505fe60ba tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.090467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80fe66d5-98e8-43f0-8ccd-452505fe60ba tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.091101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80fe66d5-98e8-43f0-8ccd-452505fe60ba tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.099357 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-80fe66d5-98e8-43f0-8ccd-452505fe60ba tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.084916 Oct 11 04:11:57.100310 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 211/451] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:57.109254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6eb035e2-2eb8-47f5-b82f-764e3a7c248b tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:57.239176 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6eb035e2-2eb8-47f5-b82f-764e3a7c248b tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1895176321" status: 202 len: 0 microversion: 2.1 time: 0.137404 Oct 11 04:11:57.243137 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 212/452] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:11:57 2022] DELETE /compute/v2.1/flavors/1895176321 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:57.247710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c79b26b7-7918-4c6c-8823-186270146a5f tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Calling method '.version_select at 0x7fda1a4d5820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:57.250063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79b26b7-7918-4c6c-8823-186270146a5f tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.250565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79b26b7-7918-4c6c-8823-186270146a5f tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.250993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79b26b7-7918-4c6c-8823-186270146a5f tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.278261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79b26b7-7918-4c6c-8823-186270146a5f tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.279049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79b26b7-7918-4c6c-8823-186270146a5f tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.279712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79b26b7-7918-4c6c-8823-186270146a5f tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.287947 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c79b26b7-7918-4c6c-8823-186270146a5f tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.043720 Oct 11 04:11:57.288539 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 213/453] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:57.293242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a971080b-3bc9-4ed8-95a2-696f17a34684 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:57.314580 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a971080b-3bc9-4ed8-95a2-696f17a34684 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.024699 Oct 11 04:11:57.315534 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 214/454] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:57 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:57.320087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b55dab2d-b432-4485-a37c-8af69694f778 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Calling method '.version_select at 0x7fda1a532670>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:57.321952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b55dab2d-b432-4485-a37c-8af69694f778 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.322606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b55dab2d-b432-4485-a37c-8af69694f778 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.324794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b55dab2d-b432-4485-a37c-8af69694f778 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.351182 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b55dab2d-b432-4485-a37c-8af69694f778 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 200 len: 263 microversion: 2.1 time: 0.034333 Oct 11 04:11:57.351861 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 215/455] 10.222.0.26 () {58 vars in 1179 bytes} [Tue Oct 11 04:11:57 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 263 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:57.359800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9c0fc459-3e54-49ae-8865-ad015a2227cd tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAdminTestJSON-flavor-1435698925", "id": 772346435, "os-flavor-access:is_public": "False"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:57.451491 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9c0fc459-3e54-49ae-8865-ad015a2227cd tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 427 microversion: 2.1 time: 0.095932 Oct 11 04:11:57.452187 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 216/456] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:57 2022] POST /compute/v2.1/flavors => generated 427 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:57.457517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41635626-eef8-41c5-aa7c-6d63ecab8ac7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Calling method '.version_select at 0x7fda1a50c550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:57.459713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41635626-eef8-41c5-aa7c-6d63ecab8ac7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.461453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41635626-eef8-41c5-aa7c-6d63ecab8ac7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.462083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41635626-eef8-41c5-aa7c-6d63ecab8ac7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.486330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=2,nova_api:DELETE=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:57.490773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41635626-eef8-41c5-aa7c-6d63ecab8ac7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.491449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41635626-eef8-41c5-aa7c-6d63ecab8ac7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.492039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41635626-eef8-41c5-aa7c-6d63ecab8ac7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.504345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41635626-eef8-41c5-aa7c-6d63ecab8ac7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.504829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41635626-eef8-41c5-aa7c-6d63ecab8ac7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.505259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41635626-eef8-41c5-aa7c-6d63ecab8ac7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.518624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=12 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:57.525547 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41635626-eef8-41c5-aa7c-6d63ecab8ac7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.071373 Oct 11 04:11:57.526146 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 217/457] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:57 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:57.532648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f67370f-4845-42ae-b406-2df468f302be tempest-FlavorsAdminTestJSON-1518253381 tempest-FlavorsAdminTestJSON-1518253381-project] Action: 'create', calling method: >, body: {"server": {"name": "test", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "772346435"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:57.544026 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-8f67370f-4845-42ae-b406-2df468f302be tempest-FlavorsAdminTestJSON-1518253381 tempest-FlavorsAdminTestJSON-1518253381-project] HTTP exception thrown: Flavor 772346435 could not be found. Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f67370f-4845-42ae-b406-2df468f302be tempest-FlavorsAdminTestJSON-1518253381 tempest-FlavorsAdminTestJSON-1518253381-project] Request method failure captured: Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 106 Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO0FqJZdLQNG3Ehe15WQdd8puWAzqmm5CiBRwOdJXcsOVf8_q5ixqcTP8TS60CzBO5Jx5ZZeC4ZBO96Ja-9p2kgJ8qi0z6S0Cp7EMAJB-9jxFvSFUs6STNJcXJblNoInOyC0yZ5IGj7Cbwf0dCf1E-KH1aZyLXbmFwqy3ApIql5-LHk Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d280a33a58414e31a74a45fbc312e9d0 Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FlavorsAdminTestJSON-1518253381 Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:11:57.548892 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d280a33a58414e31a74a45fbc312e9d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d280a33a58414e31a74a45fbc312e9d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d280a33a58414e31a74a45fbc312e9d0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d280a33a58414e31a74a45fbc312e9d0"}]}] Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FlavorsAdminTestJSON-1518253381 Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d280a33a58414e31a74a45fbc312e9d0 Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FlavorsAdminTestJSON-1518253381 Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FlavorsAdminTestJSON-1518253381-project Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 335c15b9ca4d4203b69c2ad39839ff37 Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FlavorsAdminTestJSON-1518253381-project Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "test", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "772346435"}} Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:11:57.550430 n-d-860892-1 devstack@n-api.service[120993]: exception: Flavor 772346435 could not be found. Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'test', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '772346435'}}} Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 772346435 could not be found. Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:57.551308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 772346435 could not be found. Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:11:57.552687 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:11:57.554118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:11:57.554118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:11:57.554118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:11:57.554118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 772346435 could not be found. Oct 11 04:11:57.554118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:11:57.555594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f67370f-4845-42ae-b406-2df468f302be tempest-FlavorsAdminTestJSON-1518253381 tempest-FlavorsAdminTestJSON-1518253381-project] Returning 400 to user: Flavor 772346435 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:11:57.556759 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f67370f-4845-42ae-b406-2df468f302be tempest-FlavorsAdminTestJSON-1518253381 tempest-FlavorsAdminTestJSON-1518253381-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 80 microversion: 2.1 time: 0.029262 Oct 11 04:11:57.558026 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 218/458] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:57 2022] POST /compute/v2.1/servers => generated 80 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:11:57.568110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-afb16942-8f2e-402c-8a77-5fd41157a9f4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:57.568110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-afb16942-8f2e-402c-8a77-5fd41157a9f4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:57.572067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afb16942-8f2e-402c-8a77-5fd41157a9f4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.572551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afb16942-8f2e-402c-8a77-5fd41157a9f4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.573105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afb16942-8f2e-402c-8a77-5fd41157a9f4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.573903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afb16942-8f2e-402c-8a77-5fd41157a9f4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.574711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afb16942-8f2e-402c-8a77-5fd41157a9f4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.575574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afb16942-8f2e-402c-8a77-5fd41157a9f4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.747749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-afb16942-8f2e-402c-8a77-5fd41157a9f4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:57.771796 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-afb16942-8f2e-402c-8a77-5fd41157a9f4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1319 microversion: 2.1 time: 0.212364 Oct 11 04:11:57.783282 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 219/459] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:57 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:57.820863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6fa73255-f39c-4a9a-89fe-d24b9ca528de tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Calling method '.version_select at 0x7fda1a4d5ee0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:57.824513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa73255-f39c-4a9a-89fe-d24b9ca528de tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.825256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa73255-f39c-4a9a-89fe-d24b9ca528de tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.825798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa73255-f39c-4a9a-89fe-d24b9ca528de tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.829056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=11 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:57.840997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa73255-f39c-4a9a-89fe-d24b9ca528de tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:57.841581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa73255-f39c-4a9a-89fe-d24b9ca528de tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:57.842633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa73255-f39c-4a9a-89fe-d24b9ca528de tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:57.849644 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6fa73255-f39c-4a9a-89fe-d24b9ca528de tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 200 len: 758 microversion: 2.1 time: 0.064092 Oct 11 04:11:57.857415 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 220/460] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:57 2022] GET /compute/v2.1/os-hypervisors/1 => generated 758 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:57.860895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cba01bb5-0890-41e7-b392-c03baff41971 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:58.001009 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cba01bb5-0890-41e7-b392-c03baff41971 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/772346435" status: 202 len: 0 microversion: 2.1 time: 0.145345 Oct 11 04:11:58.003261 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 221/461] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:11:57 2022] DELETE /compute/v2.1/flavors/772346435 => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:58.010960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8d3b753c-8d0b-4acc-bb2c-a94f1ddb59d9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Calling method '.version_select at 0x7fda1a50c700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:58.013873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d3b753c-8d0b-4acc-bb2c-a94f1ddb59d9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:58.015820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d3b753c-8d0b-4acc-bb2c-a94f1ddb59d9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:58.016449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d3b753c-8d0b-4acc-bb2c-a94f1ddb59d9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:58.034841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d3b753c-8d0b-4acc-bb2c-a94f1ddb59d9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:58.036812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d3b753c-8d0b-4acc-bb2c-a94f1ddb59d9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:58.038021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d3b753c-8d0b-4acc-bb2c-a94f1ddb59d9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:58.053577 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8d3b753c-8d0b-4acc-bb2c-a94f1ddb59d9 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/2" status: 200 len: 758 microversion: 2.1 time: 0.048789 Oct 11 04:11:58.054987 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 222/462] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:11:58 2022] GET /compute/v2.1/os-hypervisors/2 => generated 758 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:58.061464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3a723e35-49ec-4063-a6a2-d15c7d71bb9c tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:58.126037 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3a723e35-49ec-4063-a6a2-d15c7d71bb9c tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.067836 Oct 11 04:11:58.146627 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 223/463] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:11:58 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:58.165629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-372c156d-d073-4bef-90cd-266463d41d56 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:58.170305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-372c156d-d073-4bef-90cd-266463d41d56 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:58.185882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c156d-d073-4bef-90cd-266463d41d56 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:58.188321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c156d-d073-4bef-90cd-266463d41d56 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:58.191508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c156d-d073-4bef-90cd-266463d41d56 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:58.192438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c156d-d073-4bef-90cd-266463d41d56 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:58.193027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c156d-d073-4bef-90cd-266463d41d56 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:58.195401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c156d-d073-4bef-90cd-266463d41d56 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:58.499529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-372c156d-d073-4bef-90cd-266463d41d56 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:58.529528 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-372c156d-d073-4bef-90cd-266463d41d56 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1477 microversion: 2.1 time: 0.383406 Oct 11 04:11:58.535477 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 224/464] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:58 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1477 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:58.545897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-af530a7e-ef8e-499e-9c9f-59505716bdf7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Calling method '.version_select at 0x7fda1a5323a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:58.552200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af530a7e-ef8e-499e-9c9f-59505716bdf7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:58.556180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af530a7e-ef8e-499e-9c9f-59505716bdf7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:58.556885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af530a7e-ef8e-499e-9c9f-59505716bdf7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:58.588551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af530a7e-ef8e-499e-9c9f-59505716bdf7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:58.589085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af530a7e-ef8e-499e-9c9f-59505716bdf7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:58.589520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af530a7e-ef8e-499e-9c9f-59505716bdf7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:58.601713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af530a7e-ef8e-499e-9c9f-59505716bdf7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:58.602208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af530a7e-ef8e-499e-9c9f-59505716bdf7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:58.602675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af530a7e-ef8e-499e-9c9f-59505716bdf7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:58.647511 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-af530a7e-ef8e-499e-9c9f-59505716bdf7 tempest-HypervisorAdminTestJSON-1021403278 tempest-HypervisorAdminTestJSON-1021403278-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 200 len: 175 microversion: 2.1 time: 0.110368 Oct 11 04:11:58.654327 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 225/465] 10.222.0.26 () {58 vars in 1173 bytes} [Tue Oct 11 04:11:58 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 175 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:58.657300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3be4fe9c-dde5-4401-9cec-16754c52588f tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-428237835", "id": 468003558, "os-flavor-access:is_public": "False"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:58.743296 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3be4fe9c-dde5-4401-9cec-16754c52588f tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 411 microversion: 2.1 time: 0.093141 Oct 11 04:11:58.744113 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 226/466] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:58 2022] POST /compute/v2.1/flavors => generated 411 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:58.764551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8126ce15-f2ba-45ac-97ce-645a7b81945e tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-2025240179", "id": 1568402047, "os-flavor-access:is_public": "True"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:58.861904 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8126ce15-f2ba-45ac-97ce-645a7b81945e tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 414 microversion: 2.1 time: 0.104336 Oct 11 04:11:58.869523 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 227/467] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:11:58 2022] POST /compute/v2.1/flavors => generated 414 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:58.875949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f480c71b-3289-4f28-ac3a-d3e3da27d39f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:58.876911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f480c71b-3289-4f28-ac3a-d3e3da27d39f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:58.889727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f480c71b-3289-4f28-ac3a-d3e3da27d39f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:58.890892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f480c71b-3289-4f28-ac3a-d3e3da27d39f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:58.891325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f480c71b-3289-4f28-ac3a-d3e3da27d39f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:58.892020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f480c71b-3289-4f28-ac3a-d3e3da27d39f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:58.892464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f480c71b-3289-4f28-ac3a-d3e3da27d39f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:58.892878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f480c71b-3289-4f28-ac3a-d3e3da27d39f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:59.246399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f480c71b-3289-4f28-ac3a-d3e3da27d39f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:11:59.257929 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f480c71b-3289-4f28-ac3a-d3e3da27d39f tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1469 microversion: 2.1 time: 0.392553 Oct 11 04:11:59.259295 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 228/468] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:58 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1469 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:11:59.266606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-afa16a1f-3fcd-45c6-aec1-cdb981f8bda6 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:59.290299 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d1112ddc-a21e-4283-9d43-63662560c02a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.808324 Oct 11 04:11:59.298707 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 241/469] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:11:56 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2832 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:59.332159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8c60e4b8-667e-4001-853c-a7ef2eebb08d tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:59.333818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8c60e4b8-667e-4001-853c-a7ef2eebb08d tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:59.334272 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-afa16a1f-3fcd-45c6-aec1-cdb981f8bda6 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=f" status: 200 len: 414 microversion: 2.1 time: 0.073402 Oct 11 04:11:59.334857 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 229/470] 10.222.0.26 () {58 vars in 1169 bytes} [Tue Oct 11 04:11:59 2022] GET /compute/v2.1/flavors/detail?is_public=f => generated 414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:59.353145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.120"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:11:59.353901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c60e4b8-667e-4001-853c-a7ef2eebb08d tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:59.354938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c60e4b8-667e-4001-853c-a7ef2eebb08d tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:59.355680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c60e4b8-667e-4001-853c-a7ef2eebb08d tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:59.355801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:59.357777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c60e4b8-667e-4001-853c-a7ef2eebb08d tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:59.359099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c60e4b8-667e-4001-853c-a7ef2eebb08d tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:59.360478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c60e4b8-667e-4001-853c-a7ef2eebb08d tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:59.362510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:59.363187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:59.364474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:59.364474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:59.364756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:59.365679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:59.400514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:11:59.400958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquired lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:11:59.428663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-8c60e4b8-667e-4001-853c-a7ef2eebb08d tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lazy-loading 'flavor' on Instance uuid bd31a352-f84d-4092-94dc-061ef90957b1 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:11:59.431382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:11:59.758401 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8c60e4b8-667e-4001-853c-a7ef2eebb08d tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1/action" status: 202 len: 0 microversion: 2.1 time: 0.431280 Oct 11 04:11:59.763353 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 242/471] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:11:59 2022] POST /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:11:59.771517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1df66b94-d71c-4c11-a7fa-c54005a26dba tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:59.798325 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1df66b94-d71c-4c11-a7fa-c54005a26dba tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=false" status: 200 len: 414 microversion: 2.1 time: 0.031440 Oct 11 04:11:59.807843 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 243/472] 10.222.0.26 () {58 vars in 1177 bytes} [Tue Oct 11 04:11:59 2022] GET /compute/v2.1/flavors/detail?is_public=false => generated 414 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:11:59.813883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b5975bb-d41a-42f4-8d58-f006b170c430 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:11:59.814956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b5975bb-d41a-42f4-8d58-f006b170c430 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:11:59.826540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b5975bb-d41a-42f4-8d58-f006b170c430 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:59.827364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b5975bb-d41a-42f4-8d58-f006b170c430 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:59.828693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b5975bb-d41a-42f4-8d58-f006b170c430 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:11:59.829856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b5975bb-d41a-42f4-8d58-f006b170c430 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:11:59.830510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b5975bb-d41a-42f4-8d58-f006b170c430 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:11:59.831237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b5975bb-d41a-42f4-8d58-f006b170c430 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:00.004574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9b5975bb-d41a-42f4-8d58-f006b170c430 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:00.013093 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b5975bb-d41a-42f4-8d58-f006b170c430 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1477 microversion: 2.1 time: 0.203756 Oct 11 04:12:00.023746 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 244/473] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:11:59 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1477 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:00.036282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-73901bab-208e-486e-82e5-141b32b792c0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.037191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-73901bab-208e-486e-82e5-141b32b792c0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:00.047724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73901bab-208e-486e-82e5-141b32b792c0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:00.048446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73901bab-208e-486e-82e5-141b32b792c0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:00.049230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73901bab-208e-486e-82e5-141b32b792c0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:00.050306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73901bab-208e-486e-82e5-141b32b792c0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:00.050967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73901bab-208e-486e-82e5-141b32b792c0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:00.051533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73901bab-208e-486e-82e5-141b32b792c0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:00.079642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=48 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:00.170640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Error message: {"NeutronError": {"type": "FloatingIPPortAlreadyAssociated", "message": "Cannot associate floating IP 172.25.6.120 (db0487f1-90f2-47d1-b1e0-b2cda92a807b) with port 6f15cb93-8f8a-423e-93c9-163696b0d2fc using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 99809ad0-6d54-41b3-974c-c4cb964f66c2.", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:12:00.173728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Releasing lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:12:00.181066 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] HTTP exception thrown: Cannot associate floating IP 172.25.6.120 (db0487f1-90f2-47d1-b1e0-b2cda92a807b) with port 6f15cb93-8f8a-423e-93c9-163696b0d2fc using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 99809ad0-6d54-41b3-974c-c4cb964f66c2. Oct 11 04:12:00.181066 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-b5a935e8-79a2-4603-aed1-aa0bc86c3a5a'] Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Request method failure captured: Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action HTTP/1.1 Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 46 Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzrGSaZ_AuzDLYc_Uo9qet26abKb4g3nELRcKzgSMZixl1XV5TVEdoLot2LxEEi4KMwRZUO-Rkig12NgQAMm0UYTt541WqworE1a6sNNG7qJuqkbnRlYyrp81CQZyEm6WFAJK9HNqrUFDn8deS3X_WN4cxt-zDaNJzYnGvXqpb6iAg Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 958f9ef6f9ec4cd6895b9b1569bce0d7 Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:12:00.204578 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}] Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 958f9ef6f9ec4cd6895b9b1569bce0d7 Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 0bc868b9a97a4e0faea48318c6a4855f Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: {"addFloatingIp": {"address": "172.25.6.120"}} Oct 11 04:12:00.205793 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: exception: Cannot associate floating IP 172.25.6.120 (db0487f1-90f2-47d1-b1e0-b2cda92a807b) with port 6f15cb93-8f8a-423e-93c9-163696b0d2fc using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 99809ad0-6d54-41b3-974c-c4cb964f66c2. Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-b5a935e8-79a2-4603-aed1-aa0bc86c3a5a'] Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '8728557c-7590-4694-ae89-ca4194b8e209', 'body': {'addFloatingIp': {'address': '172.25.6.120'}}} Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2703, in associate_floating_ip Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi client.update_floatingip(fip['id'], {'floatingip': param}) Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1016, in update_floatingip Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._update_resource(self.floatingip_path % (floatingip), Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 2548, in _update_resource Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.put(path, **kwargs) Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:00.206530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 365, in put Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("PUT", action, body=body, Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:12:00.207448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Cannot associate floating IP 172.25.6.120 (db0487f1-90f2-47d1-b1e0-b2cda92a807b) with port 6f15cb93-8f8a-423e-93c9-163696b0d2fc using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 99809ad0-6d54-41b3-974c-c4cb964f66c2. Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5a935e8-79a2-4603-aed1-aa0bc86c3a5a'] Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2705, in associate_floating_ip Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpAssociateFailed(str(e)) Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpAssociateFailed: Cannot associate floating IP 172.25.6.120 (db0487f1-90f2-47d1-b1e0-b2cda92a807b) with port 6f15cb93-8f8a-423e-93c9-163696b0d2fc using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 99809ad0-6d54-41b3-974c-c4cb964f66c2. Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5a935e8-79a2-4603-aed1-aa0bc86c3a5a'] Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:00.209110 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 246, in _add_floating_ip Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Cannot associate floating IP 172.25.6.120 (db0487f1-90f2-47d1-b1e0-b2cda92a807b) with port 6f15cb93-8f8a-423e-93c9-163696b0d2fc using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 99809ad0-6d54-41b3-974c-c4cb964f66c2. Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5a935e8-79a2-4603-aed1-aa0bc86c3a5a'] Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:00.211422 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:00.213340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:00.213340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:00.213340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:00.213340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:00.213340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:00.213340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:00.213340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot associate floating IP 172.25.6.120 (db0487f1-90f2-47d1-b1e0-b2cda92a807b) with port 6f15cb93-8f8a-423e-93c9-163696b0d2fc using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 99809ad0-6d54-41b3-974c-c4cb964f66c2. Oct 11 04:12:00.213340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b5a935e8-79a2-4603-aed1-aa0bc86c3a5a'] Oct 11 04:12:00.213340 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:00.213340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Returning 400 to user: Cannot associate floating IP 172.25.6.120 (db0487f1-90f2-47d1-b1e0-b2cda92a807b) with port 6f15cb93-8f8a-423e-93c9-163696b0d2fc using fixed IP 172.20.0.3, as that fixed IP already has a floating IP on external network 99809ad0-6d54-41b3-974c-c4cb964f66c2. Oct 11 04:12:00.213340 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-b5a935e8-79a2-4603-aed1-aa0bc86c3a5a'] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:00.215426 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e866e783-97c5-49e3-ae9a-4bbf2588d55e tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action" status: 400 len: 381 microversion: 2.1 time: 0.877792 Oct 11 04:12:00.222561 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 230/474] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:11:59 2022] POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action => generated 381 bytes in 883 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:12:00.234611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9147e5b0-8e80-40e2-9415-74f17f04f812 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.260981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-73901bab-208e-486e-82e5-141b32b792c0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:00.265190 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9147e5b0-8e80-40e2-9415-74f17f04f812 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=no" status: 200 len: 414 microversion: 2.1 time: 0.044831 Oct 11 04:12:00.271230 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 231/475] 10.222.0.26 () {58 vars in 1171 bytes} [Tue Oct 11 04:12:00 2022] GET /compute/v2.1/flavors/detail?is_public=no => generated 414 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:00.275473 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-73901bab-208e-486e-82e5-141b32b792c0 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1477 microversion: 2.1 time: 0.250491 Oct 11 04:12:00.284146 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 245/476] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:00 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1477 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:00.287387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-af48a179-41dd-4f7e-9f3d-6e774bb20d64 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '.version_select at 0x7fda1a383a60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.289440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2052138b-7656-42c8-b0a2-b65b305fc50c tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.315470 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2052138b-7656-42c8-b0a2-b65b305fc50c tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=0" status: 200 len: 414 microversion: 2.1 time: 0.028076 Oct 11 04:12:00.315470 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 246/477] 10.222.0.26 () {58 vars in 1169 bytes} [Tue Oct 11 04:12:00 2022] GET /compute/v2.1/flavors/detail?is_public=0 => generated 414 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:00.339417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-073ac4c6-0290-4e9d-a92b-c70b22266340 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.377157 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-073ac4c6-0290-4e9d-a92b-c70b22266340 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=t" status: 200 len: 6218 microversion: 2.1 time: 0.041275 Oct 11 04:12:00.378479 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 247/478] 10.222.0.26 () {58 vars in 1169 bytes} [Tue Oct 11 04:12:00 2022] GET /compute/v2.1/flavors/detail?is_public=t => generated 6218 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:00.410451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d548efe9-40df-4ea6-b249-611d448042e3 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.441273 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d548efe9-40df-4ea6-b249-611d448042e3 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=true" status: 200 len: 6218 microversion: 2.1 time: 0.036266 Oct 11 04:12:00.444539 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 248/479] 10.222.0.26 () {58 vars in 1175 bytes} [Tue Oct 11 04:12:00 2022] GET /compute/v2.1/flavors/detail?is_public=true => generated 6218 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:00.466709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-08bf8b46-0350-4a1f-9c2f-ae8d0e77fb22 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.499641 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-08bf8b46-0350-4a1f-9c2f-ae8d0e77fb22 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=yes" status: 200 len: 6218 microversion: 2.1 time: 0.036995 Oct 11 04:12:00.511822 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 249/480] 10.222.0.26 () {58 vars in 1173 bytes} [Tue Oct 11 04:12:00 2022] GET /compute/v2.1/flavors/detail?is_public=yes => generated 6218 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:00.523326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b463f4c-abc3-4124-a9bd-c026bb4c5d92 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.556975 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b463f4c-abc3-4124-a9bd-c026bb4c5d92 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=1" status: 200 len: 6218 microversion: 2.1 time: 0.036495 Oct 11 04:12:00.575145 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 250/481] 10.222.0.26 () {58 vars in 1169 bytes} [Tue Oct 11 04:12:00 2022] GET /compute/v2.1/flavors/detail?is_public=1 => generated 6218 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:12:00.595108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a2344b5-0f29-4d38-a828-0681adbb2f69 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.725769 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2a2344b5-0f29-4d38-a828-0681adbb2f69 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1568402047" status: 202 len: 0 microversion: 2.1 time: 0.135050 Oct 11 04:12:00.734114 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 251/482] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:12:00 2022] DELETE /compute/v2.1/flavors/1568402047 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:12:00.740258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1ced717-db3b-4cbe-8bb4-44359cab4acf tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.800126 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b1ced717-db3b-4cbe-8bb4-44359cab4acf tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.064039 Oct 11 04:12:00.811535 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 252/483] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:12:00 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:00.823185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0efcde5b-6945-4112-a883-5c4392cfa9ef tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.926426 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0efcde5b-6945-4112-a883-5c4392cfa9ef tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/468003558" status: 202 len: 0 microversion: 2.1 time: 0.107695 Oct 11 04:12:00.928941 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 253/484] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:12:00 2022] DELETE /compute/v2.1/flavors/468003558 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:12:00.935754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-42e0a08d-b3d6-4c04-9d7e-a9a656930f1b tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:00.986871 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-42e0a08d-b3d6-4c04-9d7e-a9a656930f1b tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.054550 Oct 11 04:12:00.988273 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 254/485] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:12:00 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:01.014125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6ece8e86-52f4-4b38-9c4f-9237e21a6c22 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-1238500926", "id": 851543147, "os-flavor-access:is_public": "False"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:01.114314 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6ece8e86-52f4-4b38-9c4f-9237e21a6c22 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 412 microversion: 2.1 time: 0.105725 Oct 11 04:12:01.125889 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 255/486] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:12:01 2022] POST /compute/v2.1/flavors => generated 412 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:01.146874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2bb30048-5459-4118-9f7a-a66f7a30f8aa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:01.173755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2bb30048-5459-4118-9f7a-a66f7a30f8aa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:01.188706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bb30048-5459-4118-9f7a-a66f7a30f8aa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:01.189305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bb30048-5459-4118-9f7a-a66f7a30f8aa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:01.189730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bb30048-5459-4118-9f7a-a66f7a30f8aa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:01.190564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bb30048-5459-4118-9f7a-a66f7a30f8aa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:01.191057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bb30048-5459-4118-9f7a-a66f7a30f8aa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:01.191551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bb30048-5459-4118-9f7a-a66f7a30f8aa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:01.461172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2bb30048-5459-4118-9f7a-a66f7a30f8aa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:01.470911 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2bb30048-5459-4118-9f7a-a66f7a30f8aa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1477 microversion: 2.1 time: 0.342804 Oct 11 04:12:01.471918 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 256/487] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:01 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1477 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:01.476826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-67891461-3ce7-403d-b684-d9c96f2e34f1 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:01.500497 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-67891461-3ce7-403d-b684-d9c96f2e34f1 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.027167 Oct 11 04:12:01.505872 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 257/488] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:12:01 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:01.526599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ddd1a9e1-f7b4-48b3-a3d4-2c8e6008545a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:01.527231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ddd1a9e1-f7b4-48b3-a3d4-2c8e6008545a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:01.548432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddd1a9e1-f7b4-48b3-a3d4-2c8e6008545a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:01.549233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddd1a9e1-f7b4-48b3-a3d4-2c8e6008545a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:01.549363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddd1a9e1-f7b4-48b3-a3d4-2c8e6008545a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:01.550050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddd1a9e1-f7b4-48b3-a3d4-2c8e6008545a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:01.550766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddd1a9e1-f7b4-48b3-a3d4-2c8e6008545a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:01.556103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddd1a9e1-f7b4-48b3-a3d4-2c8e6008545a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:01.768162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ddd1a9e1-f7b4-48b3-a3d4-2c8e6008545a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:01.777185 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ddd1a9e1-f7b4-48b3-a3d4-2c8e6008545a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1460 microversion: 2.1 time: 0.270154 Oct 11 04:12:01.778380 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 258/489] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:01 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1460 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:01.786095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38081aaf-2c3d-41e3-9ee7-5fef9d6df96e tempest-FlavorsAdminTestJSON-1518253381 tempest-FlavorsAdminTestJSON-1518253381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:01.813005 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-38081aaf-2c3d-41e3-9ee7-5fef9d6df96e tempest-FlavorsAdminTestJSON-1518253381 tempest-FlavorsAdminTestJSON-1518253381-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.032990 Oct 11 04:12:01.814282 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 259/490] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:12:01 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:01.820046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9be1eb1d-b903-4158-b17c-c7286c8d5126 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:01.820660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9be1eb1d-b903-4158-b17c-c7286c8d5126 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:01.843830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be1eb1d-b903-4158-b17c-c7286c8d5126 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:01.844318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be1eb1d-b903-4158-b17c-c7286c8d5126 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:01.844816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be1eb1d-b903-4158-b17c-c7286c8d5126 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:01.845732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be1eb1d-b903-4158-b17c-c7286c8d5126 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:01.847042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be1eb1d-b903-4158-b17c-c7286c8d5126 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:01.847489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be1eb1d-b903-4158-b17c-c7286c8d5126 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:02.282633 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-af48a179-41dd-4f7e-9f3d-6e774bb20d64 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/db0487f1-90f2-47d1-b1e0-b2cda92a807b" status: 202 len: 0 microversion: 2.1 time: 1.989311 Oct 11 04:12:02.282633 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 232/491] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:12:00 2022] DELETE /compute/v2.1/os-floating-ips/db0487f1-90f2-47d1-b1e0-b2cda92a807b => generated 0 bytes in 2002 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:12:02.306921 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9be1eb1d-b903-4158-b17c-c7286c8d5126 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1611 microversion: 2.1 time: 0.491196 Oct 11 04:12:02.309944 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 260/492] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:01 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1611 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:02.313672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e4fe0a97-304e-4a1f-a461-d97b82961837 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:02.335693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Action: 'action', calling method: .version_select at 0x7fda1c455940>, body: {"removeFloatingIp": {"address": "172.25.6.2"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:02.463628 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e4fe0a97-304e-4a1f-a461-d97b82961837 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/851543147" status: 202 len: 0 microversion: 2.1 time: 0.188294 Oct 11 04:12:02.468729 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 233/493] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:12:02 2022] DELETE /compute/v2.1/flavors/851543147 => generated 0 bytes in 194 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:12:02.473284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bd201e02-e516-4d5b-bea7-672d7761386e tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:02.477426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd201e02-e516-4d5b-bea7-672d7761386e tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:02.477862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd201e02-e516-4d5b-bea7-672d7761386e tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:02.478836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd201e02-e516-4d5b-bea7-672d7761386e tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:02.479751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd201e02-e516-4d5b-bea7-672d7761386e tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:02.480374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd201e02-e516-4d5b-bea7-672d7761386e tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:02.480976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd201e02-e516-4d5b-bea7-672d7761386e tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:02.509221 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bd201e02-e516-4d5b-bea7-672d7761386e tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.039217 Oct 11 04:12:02.510093 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 234/494] 10.222.0.26 () {58 vars in 1176 bytes} [Tue Oct 11 04:12:02 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:02.514645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-94a9436d-9c2e-4e75-9249-53981b5fca81 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:02.519617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:02.525747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:02.526257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:02.526699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:02.527401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:02.527946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:02.528432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:02.563938 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-94a9436d-9c2e-4e75-9249-53981b5fca81 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.052539 Oct 11 04:12:02.568354 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 235/495] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:12:02 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:02.586436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-af57fb99-efa5-4475-8a49-91fd2829079c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:02.587326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-af57fb99-efa5-4475-8a49-91fd2829079c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:02.605015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af57fb99-efa5-4475-8a49-91fd2829079c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:02.605842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af57fb99-efa5-4475-8a49-91fd2829079c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:02.606952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af57fb99-efa5-4475-8a49-91fd2829079c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:02.608769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af57fb99-efa5-4475-8a49-91fd2829079c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:02.609765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af57fb99-efa5-4475-8a49-91fd2829079c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:02.612891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af57fb99-efa5-4475-8a49-91fd2829079c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:02.914295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-af57fb99-efa5-4475-8a49-91fd2829079c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:02.928300 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-af57fb99-efa5-4475-8a49-91fd2829079c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1477 microversion: 2.1 time: 0.358550 Oct 11 04:12:02.929338 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 236/496] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:02 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1477 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:02.935017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860892-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:02.939475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:02.947530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:02.948356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:02.948982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:02.949919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:02.950552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:02.951118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:03.082173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Lazy-loading 'flavor' on Instance uuid bd31a352-f84d-4092-94dc-061ef90957b1 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:12:03.178488 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] HTTP exception thrown: Cannot 'os-migrateLive' instance bd31a352-f84d-4092-94dc-061ef90957b1 while it is in vm_state suspended Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Request method failure captured: Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1/action HTTP/1.1 Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 97 Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzejsKr7J-lgUoytZvbs5Hcus0uXIv9K8v3ihZ3GjEBuwXBIXEfTmd7fr7QGdfVZWt_PbLEWZJJkpbVi0J-Y4W_USI08Wpsb4BMsIq-pBZ9b8kYG-PJUKlEljYjDDA8DODkts3hxjaj01TfaSuuy8qMc1YZSG5XeCKxZtNPeOxrgRE Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: a9352f260bfd4e99b28cbd4daa79073e Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-LiveMigrationNegativeTest-674451504 Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:12:03.181897 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a9352f260bfd4e99b28cbd4daa79073e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a9352f260bfd4e99b28cbd4daa79073e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9352f260bfd4e99b28cbd4daa79073e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a9352f260bfd4e99b28cbd4daa79073e"}]}] Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-LiveMigrationNegativeTest-674451504 Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: a9352f260bfd4e99b28cbd4daa79073e Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-674451504 Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-LiveMigrationNegativeTest-674451504-project-admin Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 595e53a922cf4e44bcd8d1eada82a1af Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-LiveMigrationNegativeTest-674451504-project-admin Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: {"os-migrateLive": {"host": "n-h2-860892-1", "block_migration": true, "disk_over_commit": false}} Oct 11 04:12:03.183479 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: exception: Cannot 'os-migrateLive' instance bd31a352-f84d-4092-94dc-061ef90957b1 while it is in vm_state suspended Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'bd31a352-f84d-4092-94dc-061ef90957b1', 'body': {'os-migrateLive': {'host': 'n-h2-860892-1', 'block_migration': True, 'disk_over_commit': False}}} Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 123, in _migrate_live Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.compute_api.live_migrate(context, instance, block_migration, Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 04:12:03.184288 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance bd31a352-f84d-4092-94dc-061ef90957b1 in vm_state suspended. Cannot live_migrate while the instance is in this state. Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:12:03.185475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 152, in _migrate_live Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'os-migrateLive' instance bd31a352-f84d-4092-94dc-061ef90957b1 while it is in vm_state suspended Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'os-migrateLive' instance bd31a352-f84d-4092-94dc-061ef90957b1 while it is in vm_state suspended Oct 11 04:12:03.194619 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:03.195696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] Returning 409 to user: Cannot 'os-migrateLive' instance bd31a352-f84d-4092-94dc-061ef90957b1 while it is in vm_state suspended {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:03.195696 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff04940c-6bb7-47c0-a8c0-881a79566550 tempest-LiveMigrationNegativeTest-674451504 tempest-LiveMigrationNegativeTest-674451504-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1/action" status: 409 len: 155 microversion: 2.1 time: 0.257517 Oct 11 04:12:03.195696 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 237/497] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:12:02 2022] POST /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1/action => generated 155 bytes in 259 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:12:03.195696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b850c423-0d20-409f-813c-b15ba4a0dcfd tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-test_flavor_-364670538", "id": 1123542907, "os-flavor-access:is_public": "True"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:03.302799 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b850c423-0d20-409f-813c-b15ba4a0dcfd tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 413 microversion: 2.1 time: 0.112794 Oct 11 04:12:03.304030 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 238/498] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:12:03 2022] POST /compute/v2.1/flavors => generated 413 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:03.314422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c7183e20-bb3b-4070-84ef-12cc74e9062c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:03.317836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c7183e20-bb3b-4070-84ef-12cc74e9062c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:03.341217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7183e20-bb3b-4070-84ef-12cc74e9062c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:03.342171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7183e20-bb3b-4070-84ef-12cc74e9062c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:03.348662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7183e20-bb3b-4070-84ef-12cc74e9062c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:03.348662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7183e20-bb3b-4070-84ef-12cc74e9062c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:03.348662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7183e20-bb3b-4070-84ef-12cc74e9062c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:03.348662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7183e20-bb3b-4070-84ef-12cc74e9062c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:03.419803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c7183e20-bb3b-4070-84ef-12cc74e9062c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:12:03.503931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:12:03.504796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquired lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:12:03.822057 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c7183e20-bb3b-4070-84ef-12cc74e9062c tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 204 len: 0 microversion: 2.1 time: 0.516587 Oct 11 04:12:03.823008 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 239/499] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:12:03 2022] DELETE /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:12:03.828649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d6a814ae-5a9b-40df-b07d-cbca8ce7bd5c tempest-FlavorsAdminTestJSON-1518253381 tempest-FlavorsAdminTestJSON-1518253381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:03.861114 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d6a814ae-5a9b-40df-b07d-cbca8ce7bd5c tempest-FlavorsAdminTestJSON-1518253381 tempest-FlavorsAdminTestJSON-1518253381-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 6217 microversion: 2.1 time: 0.036524 Oct 11 04:12:03.868989 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 240/500] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:12:03 2022] GET /compute/v2.1/flavors/detail => generated 6217 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:03.868989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd0c5aaa-0151-4f8e-ac6d-eedf69c1d2f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:03.868989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd0c5aaa-0151-4f8e-ac6d-eedf69c1d2f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:03.875281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd0c5aaa-0151-4f8e-ac6d-eedf69c1d2f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:03.876038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd0c5aaa-0151-4f8e-ac6d-eedf69c1d2f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:03.876770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd0c5aaa-0151-4f8e-ac6d-eedf69c1d2f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:03.877685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd0c5aaa-0151-4f8e-ac6d-eedf69c1d2f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:03.878371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd0c5aaa-0151-4f8e-ac6d-eedf69c1d2f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:03.879004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd0c5aaa-0151-4f8e-ac6d-eedf69c1d2f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:03.910976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:RELEASE=1,nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:04.120957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd0c5aaa-0151-4f8e-ac6d-eedf69c1d2f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:04.152071 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd0c5aaa-0151-4f8e-ac6d-eedf69c1d2f9 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1466 microversion: 2.1 time: 0.288810 Oct 11 04:12:04.153463 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 241/501] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:03 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1466 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:04.161850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5d221e3f-07e1-4bec-a615-0194e2a1d884 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:04.271188 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5d221e3f-07e1-4bec-a615-0194e2a1d884 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1123542907" status: 202 len: 0 microversion: 2.1 time: 0.113959 Oct 11 04:12:04.273373 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 242/502] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:12:04 2022] DELETE /compute/v2.1/flavors/1123542907 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:12:04.279553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-409386f0-b211-4920-841b-b4034fc640ef tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:04.280285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-409386f0-b211-4920-841b-b4034fc640ef tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:04.315228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-409386f0-b211-4920-841b-b4034fc640ef tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:04.315889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-409386f0-b211-4920-841b-b4034fc640ef tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:04.323892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-409386f0-b211-4920-841b-b4034fc640ef tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:04.328085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-409386f0-b211-4920-841b-b4034fc640ef tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:04.328085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-409386f0-b211-4920-841b-b4034fc640ef tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:04.328085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-409386f0-b211-4920-841b-b4034fc640ef tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:04.634969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-409386f0-b211-4920-841b-b4034fc640ef tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:04.653004 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-409386f0-b211-4920-841b-b4034fc640ef tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1477 microversion: 2.1 time: 0.378258 Oct 11 04:12:04.656264 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 243/503] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:04 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1477 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:04.679250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ab5c800e-a3c0-4c35-a3ae-6edb48787ff1 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:04.739262 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ab5c800e-a3c0-4c35-a3ae-6edb48787ff1 tempest-FlavorsAdminTestJSON-665812250 tempest-FlavorsAdminTestJSON-665812250-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.070756 Oct 11 04:12:04.745278 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 244/504] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:12:04 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:05.177637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3c56bd3b-a368-49e7-a7e1-a2a7653225c5 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:05.178103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3c56bd3b-a368-49e7-a7e1-a2a7653225c5 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:05.191741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c56bd3b-a368-49e7-a7e1-a2a7653225c5 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:05.193631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c56bd3b-a368-49e7-a7e1-a2a7653225c5 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:05.194418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c56bd3b-a368-49e7-a7e1-a2a7653225c5 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:05.195821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c56bd3b-a368-49e7-a7e1-a2a7653225c5 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:05.203582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c56bd3b-a368-49e7-a7e1-a2a7653225c5 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:05.203582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c56bd3b-a368-49e7-a7e1-a2a7653225c5 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:05.203903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Building network info cache for instance {{(pid=120994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 04:12:05.585385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3c56bd3b-a368-49e7-a7e1-a2a7653225c5 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:05.591860 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3c56bd3b-a368-49e7-a7e1-a2a7653225c5 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1466 microversion: 2.1 time: 0.418273 Oct 11 04:12:05.592439 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 245/505] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:05 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1466 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:05.614053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f8def07c-fedf-4f3c-8700-847bdcdc0311 req-099fac2f-c8ec-41b1-abee-52d738600a18 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8728557c-7590-4694-ae89-ca4194b8e209", "tag": "6f15cb93-8f8a-423e-93c9-163696b0d2fc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:05.677910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f8def07c-fedf-4f3c-8700-847bdcdc0311 req-099fac2f-c8ec-41b1-abee-52d738600a18 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:05.684750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f8def07c-fedf-4f3c-8700-847bdcdc0311 req-099fac2f-c8ec-41b1-abee-52d738600a18 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:05.687968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f8def07c-fedf-4f3c-8700-847bdcdc0311 req-099fac2f-c8ec-41b1-abee-52d738600a18 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:05.730970 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f8def07c-fedf-4f3c-8700-847bdcdc0311 req-099fac2f-c8ec-41b1-abee-52d738600a18 service nova] Creating event network-changed:6f15cb93-8f8a-423e-93c9-163696b0d2fc for instance 8728557c-7590-4694-ae89-ca4194b8e209 on n-h2-860892-1 Oct 11 04:12:05.758639 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f8def07c-fedf-4f3c-8700-847bdcdc0311 req-099fac2f-c8ec-41b1-abee-52d738600a18 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160464 Oct 11 04:12:05.758639 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 246/506] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:05.783838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f5e178f2-c8b0-45aa-9300-09a0ae53b39e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:05.787217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f5e178f2-c8b0-45aa-9300-09a0ae53b39e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:05.815570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5e178f2-c8b0-45aa-9300-09a0ae53b39e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:05.815570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5e178f2-c8b0-45aa-9300-09a0ae53b39e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:05.815956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5e178f2-c8b0-45aa-9300-09a0ae53b39e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:05.826095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5e178f2-c8b0-45aa-9300-09a0ae53b39e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:05.829272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5e178f2-c8b0-45aa-9300-09a0ae53b39e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:05.831124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5e178f2-c8b0-45aa-9300-09a0ae53b39e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:06.283655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5e178f2-c8b0-45aa-9300-09a0ae53b39e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:06.298906 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f5e178f2-c8b0-45aa-9300-09a0ae53b39e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1477 microversion: 2.1 time: 0.536878 Oct 11 04:12:06.320662 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 247/507] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:05 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1477 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:06.791380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7e678c5-2003-47aa-b614-21e738065416 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Calling method '.version_select at 0x7fda1a26c8b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:06.793738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a7e678c5-2003-47aa-b614-21e738065416 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Policy check for os_compute_api:os-hypervisors:list-detail failed with credentials {'is_admin': False, 'user_id': '283b29614d2d430b9f64c36497203c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cecd3efdae34907bd08fd6c64f1673e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7e678c5-2003-47aa-b614-21e738065416 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Request method failure captured: Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-hypervisors/detail HTTP/1.1 Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO0UJccfp1yeYAOU0vOVFuTixU4H8z0ysemNLaaRVQ32q-bKt0OCrnwCdSRQIUOegYdN4ErFaN7Jg-IxNy9f31-W9YuzCAgXHg1yza5mHSX5ZV8IJ-VO_E8cGDO2mGZyF7u_J1yCN20aAq0A8OxZdTRE7XtFJwsd9_Pup-1yQipk_X4 Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9cecd3efdae34907bd08fd6c64f1673e Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:12:06.801466 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cecd3efdae34907bd08fd6c64f1673e"}]}] Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9cecd3efdae34907bd08fd6c64f1673e Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-HypervisorAdminNegativeTestJSON-511732219-project Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 283b29614d2d430b9f64c36497203c5d Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-511732219-project Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: action_args: {} Oct 11 04:12:06.802998 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 285, in detail Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._detail(req) Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 289, in _detail Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list-detail', target={}) Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:12:06.803940 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. Oct 11 04:12:06.805267 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:06.806568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7e678c5-2003-47aa-b614-21e738065416 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list-detail to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:06.806568 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a7e678c5-2003-47aa-b614-21e738065416 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/detail" status: 403 len: 122 microversion: 2.1 time: 0.474949 Oct 11 04:12:06.806568 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 248/508] 10.222.0.26 () {58 vars in 1167 bytes} [Tue Oct 11 04:12:06 2022] GET /compute/v2.1/os-hypervisors/detail => generated 122 bytes in 476 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:12:06.833364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-792382cb-d350-4387-badb-ba2fd84aea49 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:06.834019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-792382cb-d350-4387-badb-ba2fd84aea49 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:06.868670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-792382cb-d350-4387-badb-ba2fd84aea49 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:06.869199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-792382cb-d350-4387-badb-ba2fd84aea49 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:06.869644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-792382cb-d350-4387-badb-ba2fd84aea49 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:06.870403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-792382cb-d350-4387-badb-ba2fd84aea49 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:06.870919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-792382cb-d350-4387-badb-ba2fd84aea49 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:06.871340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-792382cb-d350-4387-badb-ba2fd84aea49 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:07.466608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Updating instance_info_cache with network_info: [{"id": "6f15cb93-8f8a-423e-93c9-163696b0d2fc", "address": "fa:16:3e:bb:3b:d1", "network": {"id": "2e802a11-7516-4fd9-9555-e418218d18bb", "bridge": null, "label": "tempest-FloatingIPsAssociationNegativeTestJSON-199260235-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "958f9ef6f9ec4cd6895b9b1569bce0d7", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap6f15cb93-8f", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:12:07.531034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-792382cb-d350-4387-badb-ba2fd84aea49 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:07.541476 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-792382cb-d350-4387-badb-ba2fd84aea49 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1466 microversion: 2.1 time: 0.731884 Oct 11 04:12:07.542977 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 249/509] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:06 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1466 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:07.554226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca5c140c-3fa8-41f8-9aab-0311ffe83855 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Calling method '.version_select at 0x7fda1a27daf0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:07.557180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ca5c140c-3fa8-41f8-9aab-0311ffe83855 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Policy check for os_compute_api:os-hypervisors:list failed with credentials {'is_admin': False, 'user_id': '283b29614d2d430b9f64c36497203c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cecd3efdae34907bd08fd6c64f1673e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca5c140c-3fa8-41f8-9aab-0311ffe83855 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Request method failure captured: Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-hypervisors HTTP/1.1 Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO0UJccfp1yeYAOU0vOVFuTixU4H8z0ysemNLaaRVQ32q-bKt0OCrnwCdSRQIUOegYdN4ErFaN7Jg-IxNy9f31-W9YuzCAgXHg1yza5mHSX5ZV8IJ-VO_E8cGDO2mGZyF7u_J1yCN20aAq0A8OxZdTRE7XtFJwsd9_Pup-1yQipk_X4 Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9cecd3efdae34907bd08fd6c64f1673e Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:12:07.563300 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cecd3efdae34907bd08fd6c64f1673e"}]}] Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9cecd3efdae34907bd08fd6c64f1673e Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-HypervisorAdminNegativeTestJSON-511732219-project Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 283b29614d2d430b9f64c36497203c5d Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-511732219-project Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: action_args: {} Oct 11 04:12:07.564599 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 253, in index Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 257, in _index Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:12:07.565431 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. Oct 11 04:12:07.566483 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:07.567515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca5c140c-3fa8-41f8-9aab-0311ffe83855 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:list to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:07.570843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Releasing lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:12:07.571795 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b64dd2ad-f7d9-4f42-af06-a71ef8ad81aa tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action" status: 202 len: 0 microversion: 2.1 time: 5.259865 Oct 11 04:12:07.573042 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 261/510] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:12:02 2022] POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action => generated 0 bytes in 5262 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 04:12:07.578641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b866d5e3-c4eb-4445-945c-9c5a87183e6e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:07.580577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b866d5e3-c4eb-4445-945c-9c5a87183e6e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:07.584602 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ca5c140c-3fa8-41f8-9aab-0311ffe83855 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 403 len: 115 microversion: 2.1 time: 0.040145 Oct 11 04:12:07.587694 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 250/511] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:12:07 2022] GET /compute/v2.1/os-hypervisors => generated 115 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:12:07.606174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-771f81f3-dfac-4764-b029-2064cd1b4fef tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '.version_select at 0x7fda1a3160d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:07.607281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b866d5e3-c4eb-4445-945c-9c5a87183e6e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:07.609536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b866d5e3-c4eb-4445-945c-9c5a87183e6e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:07.613234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b866d5e3-c4eb-4445-945c-9c5a87183e6e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:07.614102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b866d5e3-c4eb-4445-945c-9c5a87183e6e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:07.617478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b866d5e3-c4eb-4445-945c-9c5a87183e6e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:07.621327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b866d5e3-c4eb-4445-945c-9c5a87183e6e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:08.347488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b866d5e3-c4eb-4445-945c-9c5a87183e6e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:08.375212 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b866d5e3-c4eb-4445-945c-9c5a87183e6e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1477 microversion: 2.1 time: 0.801055 Oct 11 04:12:08.383406 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 262/512] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:07 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1477 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:08.393540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-858d0aa7-6bd2-4be8-b2cc-d1dd4fd47527 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Calling method '.version_select at 0x7fda1a4ae8b0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:08.400079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-858d0aa7-6bd2-4be8-b2cc-d1dd4fd47527 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Policy check for os_compute_api:os-hypervisors:statistics failed with credentials {'is_admin': False, 'user_id': '283b29614d2d430b9f64c36497203c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cecd3efdae34907bd08fd6c64f1673e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-858d0aa7-6bd2-4be8-b2cc-d1dd4fd47527 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Request method failure captured: Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-hypervisors/statistics HTTP/1.1 Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO0UJccfp1yeYAOU0vOVFuTixU4H8z0ysemNLaaRVQ32q-bKt0OCrnwCdSRQIUOegYdN4ErFaN7Jg-IxNy9f31-W9YuzCAgXHg1yza5mHSX5ZV8IJ-VO_E8cGDO2mGZyF7u_J1yCN20aAq0A8OxZdTRE7XtFJwsd9_Pup-1yQipk_X4 Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9cecd3efdae34907bd08fd6c64f1673e Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:12:08.422492 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cecd3efdae34907bd08fd6c64f1673e"}]}] Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9cecd3efdae34907bd08fd6c64f1673e Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HypervisorAdminNegativeTestJSON-511732219-project Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 283b29614d2d430b9f64c36497203c5d Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-511732219-project Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: action_args: {} Oct 11 04:12:08.425544 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 521, in statistics Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'statistics', target={}) Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:12:08.426434 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. Oct 11 04:12:08.427481 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:08.428394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-858d0aa7-6bd2-4be8-b2cc-d1dd4fd47527 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:statistics to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:08.428394 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-858d0aa7-6bd2-4be8-b2cc-d1dd4fd47527 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/statistics" status: 403 len: 121 microversion: 2.1 time: 0.040987 Oct 11 04:12:08.430485 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 263/513] 10.222.0.26 () {58 vars in 1179 bytes} [Tue Oct 11 04:12:08 2022] GET /compute/v2.1/os-hypervisors/statistics => generated 121 bytes in 44 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:12:08.933089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-20004ef0-043d-4ca6-b62e-a903e4763d38 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Calling method '.version_select at 0x7fda1a4aea60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:08.935589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20004ef0-043d-4ca6-b62e-a903e4763d38 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:08.936301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20004ef0-043d-4ca6-b62e-a903e4763d38 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:08.936911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20004ef0-043d-4ca6-b62e-a903e4763d38 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:08.965223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20004ef0-043d-4ca6-b62e-a903e4763d38 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:08.971967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20004ef0-043d-4ca6-b62e-a903e4763d38 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:08.972602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20004ef0-043d-4ca6-b62e-a903e4763d38 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:08.992998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20004ef0-043d-4ca6-b62e-a903e4763d38 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:08.998262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20004ef0-043d-4ca6-b62e-a903e4763d38 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:08.999011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20004ef0-043d-4ca6-b62e-a903e4763d38 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:09.011369 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-20004ef0-043d-4ca6-b62e-a903e4763d38 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.576669 Oct 11 04:12:09.015172 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 264/514] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:12:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:09.023104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a85faaa1-ee3d-46ab-9e75-49b452096465 req-353d9c61-346d-4b7c-828b-fea6c6a13711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd31a352-f84d-4092-94dc-061ef90957b1", "name": "network-vif-deleted", "tag": "da7e4898-175c-4ff7-b077-0b6a6a8bd621"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:09.032916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a85faaa1-ee3d-46ab-9e75-49b452096465 req-353d9c61-346d-4b7c-828b-fea6c6a13711 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:09.033728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a85faaa1-ee3d-46ab-9e75-49b452096465 req-353d9c61-346d-4b7c-828b-fea6c6a13711 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:09.034422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a85faaa1-ee3d-46ab-9e75-49b452096465 req-353d9c61-346d-4b7c-828b-fea6c6a13711 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:09.046391 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a85faaa1-ee3d-46ab-9e75-49b452096465 req-353d9c61-346d-4b7c-828b-fea6c6a13711 service nova] Creating event network-vif-deleted:da7e4898-175c-4ff7-b077-0b6a6a8bd621 for instance bd31a352-f84d-4092-94dc-061ef90957b1 on n-h1-860892-1 Oct 11 04:12:09.061043 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a85faaa1-ee3d-46ab-9e75-49b452096465 req-353d9c61-346d-4b7c-828b-fea6c6a13711 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044264 Oct 11 04:12:09.062074 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 265/515] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:09.067319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:09.068264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:09.078646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:09.079544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:09.080799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:09.081758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:09.082471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:09.083777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:09.127071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:09.127893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:09.128519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:09.129277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lazy-loading 'fault' on Instance uuid bd31a352-f84d-4092-94dc-061ef90957b1 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:12:09.227184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:09.240738 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7c9d0742-b53e-43b7-b7bb-5e9e6dea6b62 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 200 len: 1309 microversion: 2.1 time: 0.177228 Oct 11 04:12:09.241546 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 266/516] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:09 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 1309 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:09.465131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d4d8343-0cce-4574-a5a7-8fa3778362f6 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Calling method '.version_select at 0x7fda1a4f4a60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:09.506070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG neutronclient.v2_0.client [None req-1d4d8343-0cce-4574-a5a7-8fa3778362f6 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0db7f7a3-ba99-487f-98fc-232629155628 does not exist", "detail": ""}} {{(pid=120994) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:12:09.506869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.security_group_api [None req-1d4d8343-0cce-4574-a5a7-8fa3778362f6 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Neutron security group 0db7f7a3-ba99-487f-98fc-232629155628 not found {{(pid=120994) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:12:09.509011 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-1d4d8343-0cce-4574-a5a7-8fa3778362f6 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] HTTP exception thrown: Security group 0db7f7a3-ba99-487f-98fc-232629155628 does not exist Oct 11 04:12:09.509011 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-4204b522-cdbc-456d-a341-dc7c4e4506b3'] Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d4d8343-0cce-4574-a5a7-8fa3778362f6 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Request method failure captured: Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-security-groups/0db7f7a3-ba99-487f-98fc-232629155628 HTTP/1.1 Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO0YSfIO0EdNhFMqYcKLJyBSV09xeW6SE6eLnEfOpafxp9a3rneFrYsFAL2PdJCaU8_cfw3IjOtRHQB43ZsSVpH8-vb9n_-O-8CkF9XuVcAio2wNjFByUETqc9JNU7v63xgsabK7K_vwK5gwghnklOW_IgRxIRCqHer2MqVQUK9WtMk Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f251db376c25418e8b0d3c4a38f9bf0d Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:12:09.536371 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f251db376c25418e8b0d3c4a38f9bf0d"}]}] Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f251db376c25418e8b0d3c4a38f9bf0d Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupsNegativeTestJSON-1467751348-project Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5e3b08028ce04aa0add2a6619e658f3a Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348-project Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: exception: Security group 0db7f7a3-ba99-487f-98fc-232629155628 does not exist Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-4204b522-cdbc-456d-a341-dc7c4e4506b3'] Oct 11 04:12:09.541401 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '0db7f7a3-ba99-487f-98fc-232629155628'} Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:09.542398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0db7f7a3-ba99-487f-98fc-232629155628 does not exist Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4204b522-cdbc-456d-a341-dc7c4e4506b3'] Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:12:09.543472 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0db7f7a3-ba99-487f-98fc-232629155628 does not exist Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4204b522-cdbc-456d-a341-dc7c4e4506b3'] Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0db7f7a3-ba99-487f-98fc-232629155628 does not exist Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4204b522-cdbc-456d-a341-dc7c4e4506b3'] Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.544426 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.545684 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:09.545684 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:09.545684 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:09.545684 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:09.545684 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0db7f7a3-ba99-487f-98fc-232629155628 does not exist Oct 11 04:12:09.545684 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4204b522-cdbc-456d-a341-dc7c4e4506b3'] Oct 11 04:12:09.545684 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.545684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d4d8343-0cce-4574-a5a7-8fa3778362f6 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Returning 404 to user: Security group 0db7f7a3-ba99-487f-98fc-232629155628 does not exist Oct 11 04:12:09.545684 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-4204b522-cdbc-456d-a341-dc7c4e4506b3'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:09.545684 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d4d8343-0cce-4574-a5a7-8fa3778362f6 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/0db7f7a3-ba99-487f-98fc-232629155628" status: 404 len: 194 microversion: 2.1 time: 0.295563 Oct 11 04:12:09.548865 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 267/517] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:12:09 2022] DELETE /compute/v2.1/os-security-groups/0db7f7a3-ba99-487f-98fc-232629155628 => generated 194 bytes in 304 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:12:09.570584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ec86374-4f6e-410a-bdeb-c9841d471522 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Calling method '.version_select at 0x7fda1a3095e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:09.575677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0ec86374-4f6e-410a-bdeb-c9841d471522 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Policy check for os_compute_api:os-hypervisors:uptime failed with credentials {'is_admin': False, 'user_id': '283b29614d2d430b9f64c36497203c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cecd3efdae34907bd08fd6c64f1673e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ec86374-4f6e-410a-bdeb-c9841d471522 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Request method failure captured: Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-hypervisors/1/uptime HTTP/1.1 Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO0UJccfp1yeYAOU0vOVFuTixU4H8z0ysemNLaaRVQ32q-bKt0OCrnwCdSRQIUOegYdN4ErFaN7Jg-IxNy9f31-W9YuzCAgXHg1yza5mHSX5ZV8IJ-VO_E8cGDO2mGZyF7u_J1yCN20aAq0A8OxZdTRE7XtFJwsd9_Pup-1yQipk_X4 Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9cecd3efdae34907bd08fd6c64f1673e Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:12:09.583418 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cecd3efdae34907bd08fd6c64f1673e"}]}] Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9cecd3efdae34907bd08fd6c64f1673e Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HypervisorAdminNegativeTestJSON-511732219-project Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 283b29614d2d430b9f64c36497203c5d Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-511732219-project Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1'} Oct 11 04:12:09.587488 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 387, in uptime Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'uptime', target={}) Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:12:09.588396 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. Oct 11 04:12:09.589624 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.591356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ec86374-4f6e-410a-bdeb-c9841d471522 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:uptime to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:09.591356 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0ec86374-4f6e-410a-bdeb-c9841d471522 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1/uptime" status: 403 len: 117 microversion: 2.1 time: 0.034918 Oct 11 04:12:09.595355 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 268/518] 10.222.0.26 () {58 vars in 1173 bytes} [Tue Oct 11 04:12:09 2022] GET /compute/v2.1/os-hypervisors/1/uptime => generated 117 bytes in 46 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:12:09.620828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-07489caa-d0ed-449a-b440-a458d0ced658 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:09.621520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-07489caa-d0ed-449a-b440-a458d0ced658 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:09.639002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07489caa-d0ed-449a-b440-a458d0ced658 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:09.640130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07489caa-d0ed-449a-b440-a458d0ced658 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:09.646955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07489caa-d0ed-449a-b440-a458d0ced658 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:09.648823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07489caa-d0ed-449a-b440-a458d0ced658 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:09.652051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07489caa-d0ed-449a-b440-a458d0ced658 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:09.653563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07489caa-d0ed-449a-b440-a458d0ced658 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:09.862170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-07489caa-d0ed-449a-b440-a458d0ced658 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:09.873005 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-07489caa-d0ed-449a-b440-a458d0ced658 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1476 microversion: 2.1 time: 0.275481 Oct 11 04:12:09.874095 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 269/519] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:09 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1476 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:09.889010 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-771f81f3-dfac-4764-b029-2064cd1b4fef tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/46ce46b8-a68c-48b7-a3b6-cd6e132c0c53" status: 202 len: 0 microversion: 2.1 time: 2.296397 Oct 11 04:12:09.890900 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 251/520] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:12:07 2022] DELETE /compute/v2.1/os-floating-ips/46ce46b8-a68c-48b7-a3b6-cd6e132c0c53 => generated 0 bytes in 2303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:12:09.896842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16e55f36-f136-4d86-8e2d-5e682663e46b tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Calling method '.version_select at 0x7fda1a266820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:09.906361 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-16e55f36-f136-4d86-8e2d-5e682663e46b tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] HTTP exception thrown: Hypervisor with ID '6bcd59e6-fcc4-4f2b-83a7-4451541d7b4d' could not be found. Oct 11 04:12:09.906496 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c73dd0c8-d5be-48d8-9566-87a93bd7d3ab tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/" status: 404 len: 112 microversion: - time: 0.007854 Oct 11 04:12:09.906496 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 270/521] 10.222.0.26 () {58 vars in 1164 bytes} [Tue Oct 11 04:12:09 2022] DELETE /compute/v2.1/os-security-groups/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 04:12:09.912413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d76ba178-6576-446e-83c7-40925a6cf887 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Action: 'action', calling method: .version_select at 0x7fda1c455a60>, body: {"addFloatingIp": {"address": ""}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d76ba178-6576-446e-83c7-40925a6cf887 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Request method failure captured: Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action HTTP/1.1 Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 34 Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzrGSaZ_AuzDLYc_Uo9qet26abKb4g3nELRcKzgSMZixl1XV5TVEdoLot2LxEEi4KMwRZUO-Rkig12NgQAMm0UYTt541WqworE1a6sNNG7qJuqkbnRlYyrp81CQZyEm6WFAJK9HNqrUFDn8deS3X_WN4cxt-zDaNJzYnGvXqpb6iAg Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 958f9ef6f9ec4cd6895b9b1569bce0d7 Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:12:09.917786 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}] Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 958f9ef6f9ec4cd6895b9b1569bce0d7 Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0bc868b9a97a4e0faea48318c6a4855f Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: {"addFloatingIp": {"address": ""}} Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:12:09.919333 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '8728557c-7590-4694-ae89-ca4194b8e209', 'body': {'addFloatingIp': {'address': ''}}} Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is not valid under any of the given schemas Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['addFloatingIp']['properties']['address']: Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'ipv4'}, {'format': 'ipv6'}], 'type': 'string'} Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['addFloatingIp']: Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi '' Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:09.920272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:12:09.922220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:12:09.923521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas Oct 11 04:12:09.923521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16e55f36-f136-4d86-8e2d-5e682663e46b tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Request method failure captured: Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-hypervisors/6bcd59e6-fcc4-4f2b-83a7-4451541d7b4d/uptime HTTP/1.1 Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO0VD1IZFvw09cHPYQ6dnpLpGHjGQNc4PkYmGyS_CpdgfTFb5oaa5SJO8oep3U9AiXKrVFOCFoGaAyFlzSMcchX5TjYTnHguAP2NteT6Vg2oHbwllcKhEPrS7BBChDPP3hCWa4f1pvh1SE5QX-l8j-vUgX5Hm4-Y3N6R4HVgLuUgWyE Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9f68b50879d84f7bbfe72260ab46bec9 Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-112523218 Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:12:09.923663 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f68b50879d84f7bbfe72260ab46bec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f68b50879d84f7bbfe72260ab46bec9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f68b50879d84f7bbfe72260ab46bec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f68b50879d84f7bbfe72260ab46bec9"}]}] Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-112523218 Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9f68b50879d84f7bbfe72260ab46bec9 Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-112523218 Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 89ee1f5038704bc8baa2869a01d24f42 Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: exception: Hypervisor with ID '6bcd59e6-fcc4-4f2b-83a7-4451541d7b4d' could not be found. Oct 11 04:12:09.925025 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '6bcd59e6-fcc4-4f2b-83a7-4451541d7b4d'} Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '6bcd59e6-fcc4-4f2b-83a7-4451541d7b4d' Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 11 04:12:09.925848 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 389, in uptime Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '6bcd59e6-fcc4-4f2b-83a7-4451541d7b4d' could not be found. Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:09.927381 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.931986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:09.931986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:09.931986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:09.931986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:09.931986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:09.931986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '6bcd59e6-fcc4-4f2b-83a7-4451541d7b4d' could not be found. Oct 11 04:12:09.931986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:09.931986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16e55f36-f136-4d86-8e2d-5e682663e46b tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Returning 404 to user: Hypervisor with ID '6bcd59e6-fcc4-4f2b-83a7-4451541d7b4d' could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:09.931986 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-16e55f36-f136-4d86-8e2d-5e682663e46b tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/6bcd59e6-fcc4-4f2b-83a7-4451541d7b4d/uptime" status: 404 len: 123 microversion: 2.1 time: 0.031187 Oct 11 04:12:09.931986 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 252/522] 10.222.0.26 () {58 vars in 1278 bytes} [Tue Oct 11 04:12:09 2022] GET /compute/v2.1/os-hypervisors/6bcd59e6-fcc4-4f2b-83a7-4451541d7b4d/uptime => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:12:09.935774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d76ba178-6576-446e-83c7-40925a6cf887 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Returning 400 to user: Invalid input for field/attribute address. Value: . '' is not valid under any of the given schemas {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:09.935774 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d76ba178-6576-446e-83c7-40925a6cf887 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action" status: 400 len: 142 microversion: 2.1 time: 0.028031 Oct 11 04:12:09.935774 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 271/523] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:12:09 2022] POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action => generated 142 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:12:09.936430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7fc90ed6-d0ad-4e46-a05b-7b55bdfd1b00 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Calling method '.version_select at 0x7fda1a27d8b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:09.936521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aefdde99-4ed2-4a18-9235-218b53abbb08 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Calling method '.version_select at 0x7fda1a315af0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:09.938044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aefdde99-4ed2-4a18-9235-218b53abbb08 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:09.938848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aefdde99-4ed2-4a18-9235-218b53abbb08 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:09.939380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aefdde99-4ed2-4a18-9235-218b53abbb08 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:09.961176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aefdde99-4ed2-4a18-9235-218b53abbb08 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:09.961800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aefdde99-4ed2-4a18-9235-218b53abbb08 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:09.962481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aefdde99-4ed2-4a18-9235-218b53abbb08 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:09.975787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aefdde99-4ed2-4a18-9235-218b53abbb08 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:09.976571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aefdde99-4ed2-4a18-9235-218b53abbb08 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:09.977003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aefdde99-4ed2-4a18-9235-218b53abbb08 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:09.983617 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aefdde99-4ed2-4a18-9235-218b53abbb08 tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.052393 Oct 11 04:12:09.984232 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 272/524] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:12:09 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:09.989129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "0.0.0.0"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:09.992584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:09.998115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:09.998768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:09.999265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:10.000120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:10.000785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:10.001281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:10.031341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:12:10.032168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquired lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:12:10.331290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Releasing lock "refresh_cache-8728557c-7590-4694-ae89-ca4194b8e209" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:12:10.331858 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] HTTP exception thrown: floating IP not found Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Request method failure captured: Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action HTTP/1.1 Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 41 Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzrGSaZ_AuzDLYc_Uo9qet26abKb4g3nELRcKzgSMZixl1XV5TVEdoLot2LxEEi4KMwRZUO-Rkig12NgQAMm0UYTt541WqworE1a6sNNG7qJuqkbnRlYyrp81CQZyEm6WFAJK9HNqrUFDn8deS3X_WN4cxt-zDaNJzYnGvXqpb6iAg Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 958f9ef6f9ec4cd6895b9b1569bce0d7 Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:12:10.334866 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}] Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 958f9ef6f9ec4cd6895b9b1569bce0d7 Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0bc868b9a97a4e0faea48318c6a4855f Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: {"addFloatingIp": {"address": "0.0.0.0"}} Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:12:10.336061 n-d-860892-1 devstack@n-api.service[120994]: exception: floating IP not found Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '8728557c-7590-4694-ae89-ca4194b8e209', 'body': {'addFloatingIp': {'address': '0.0.0.0'}}} Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 239, in _add_floating_ip Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.network_api.associate_floating_ip(context, instance, Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 165, in wrapper Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = f(self, context, *args, **kwargs) Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2699, in associate_floating_ip Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, floating_address) Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:10.337196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 252, in _add_floating_ip Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: floating IP not found Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: floating IP not found Oct 11 04:12:10.338364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.343086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Returning 404 to user: floating IP not found {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:10.343086 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e301de0e-92a2-4e37-a33e-bb2aa195dd40 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action" status: 404 len: 67 microversion: 2.1 time: 0.351374 Oct 11 04:12:10.343086 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 273/525] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:12:09 2022] POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action => generated 67 bytes in 353 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:12:10.350750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8ad274f-2878-476b-8dba-893cf6750b30 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Calling method '.version_select at 0x7fda1a678040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:10.360355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e8ad274f-2878-476b-8dba-893cf6750b30 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Policy check for os_compute_api:os-hypervisors:show failed with credentials {'is_admin': False, 'user_id': '283b29614d2d430b9f64c36497203c5d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cecd3efdae34907bd08fd6c64f1673e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8ad274f-2878-476b-8dba-893cf6750b30 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Request method failure captured: Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-hypervisors/1 HTTP/1.1 Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO0UJccfp1yeYAOU0vOVFuTixU4H8z0ysemNLaaRVQ32q-bKt0OCrnwCdSRQIUOegYdN4ErFaN7Jg-IxNy9f31-W9YuzCAgXHg1yza5mHSX5ZV8IJ-VO_E8cGDO2mGZyF7u_J1yCN20aAq0A8OxZdTRE7XtFJwsd9_Pup-1yQipk_X4 Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9cecd3efdae34907bd08fd6c64f1673e Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:12:10.362010 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cecd3efdae34907bd08fd6c64f1673e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9cecd3efdae34907bd08fd6c64f1673e"}]}] Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9cecd3efdae34907bd08fd6c64f1673e Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-511732219 Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HypervisorAdminNegativeTestJSON-511732219-project Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 283b29614d2d430b9f64c36497203c5d Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-511732219-project Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1'} Oct 11 04:12:10.363431 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 341, in _show Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(hv_policies.BASE_POLICY_NAME % 'show', target={}) Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:12:10.364274 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. Oct 11 04:12:10.365489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.367497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8ad274f-2878-476b-8dba-893cf6750b30 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-hypervisors:show to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:10.367497 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e8ad274f-2878-476b-8dba-893cf6750b30 tempest-HypervisorAdminNegativeTestJSON-511732219 tempest-HypervisorAdminNegativeTestJSON-511732219-project] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/1" status: 403 len: 115 microversion: 2.1 time: 0.023947 Oct 11 04:12:10.367497 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 274/526] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:12:10 2022] GET /compute/v2.1/os-hypervisors/1 => generated 115 bytes in 25 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:12:10.384429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:10.391928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: bd31a352-f84d-4092-94dc-061ef90957b1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:10.411893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:10.412694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:10.413288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:10.414360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:10.415945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:10.417527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:10.441928 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] HTTP exception thrown: Instance bd31a352-f84d-4092-94dc-061ef90957b1 could not be found. Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Request method failure captured: Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 HTTP/1.1 Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzd_4UliV_EcUXRZYeSWyKSxY8p6E_vgQKF8oRn-VvB9JaM77OznDCUT3JcliAt9HCk1J_oHcQbFzCl0B8aUGo7aSV0j2XfVgvrj5T1qoK8ljSp5mcPJHAhloM15gD0eOqdqz9YUMr3bEcHMbq-1JYMzZb7ERIaoJVIwCHmk6_6XIo Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: a4899da03227442dbf61760169d18d99 Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-LiveMigrationNegativeTest-908708659 Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:12:10.443923 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4899da03227442dbf61760169d18d99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4899da03227442dbf61760169d18d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4899da03227442dbf61760169d18d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4899da03227442dbf61760169d18d99"}]}] Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-LiveMigrationNegativeTest-908708659 Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: a4899da03227442dbf61760169d18d99 Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-908708659 Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-LiveMigrationNegativeTest-908708659-project Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5ac55ad87edb45f3b79c1aa66a929c1f Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-LiveMigrationNegativeTest-908708659-project Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance bd31a352-f84d-4092-94dc-061ef90957b1 could not be found. Oct 11 04:12:10.445367 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'bd31a352-f84d-4092-94dc-061ef90957b1'} Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd31a352-f84d-4092-94dc-061ef90957b1 could not be found. Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:10.446229 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd31a352-f84d-4092-94dc-061ef90957b1 could not be found. Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd31a352-f84d-4092-94dc-061ef90957b1 could not be found. Oct 11 04:12:10.447432 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.453169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Returning 404 to user: Instance bd31a352-f84d-4092-94dc-061ef90957b1 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:10.454540 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-19988807-cce3-4ad8-bad8-1b93339f01a4 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1" status: 404 len: 111 microversion: 2.1 time: 0.077923 Oct 11 04:12:10.459216 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 275/527] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:10 2022] GET /compute/v2.1/servers/bd31a352-f84d-4092-94dc-061ef90957b1 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:12:10.482377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-456453b8-248f-47ed-8923-025859b1dbaf tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "0.0.0.0"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:10.525288 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-456453b8-248f-47ed-8923-025859b1dbaf tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] HTTP exception thrown: Floating IP not found for address 0.0.0.0. Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-456453b8-248f-47ed-8923-025859b1dbaf tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Request method failure captured: Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action HTTP/1.1 Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 44 Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzrGSaZ_AuzDLYc_Uo9qet26abKb4g3nELRcKzgSMZixl1XV5TVEdoLot2LxEEi4KMwRZUO-Rkig12NgQAMm0UYTt541WqworE1a6sNNG7qJuqkbnRlYyrp81CQZyEm6WFAJK9HNqrUFDn8deS3X_WN4cxt-zDaNJzYnGvXqpb6iAg Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 958f9ef6f9ec4cd6895b9b1569bce0d7 Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:12:10.527103 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}] Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 958f9ef6f9ec4cd6895b9b1569bce0d7 Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0bc868b9a97a4e0faea48318c6a4855f Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: {"removeFloatingIp": {"address": "0.0.0.0"}} Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:12:10.528477 n-d-860892-1 devstack@n-api.service[120994]: exception: Floating IP not found for address 0.0.0.0. Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '8728557c-7590-4694-ae89-ca4194b8e209', 'body': {'removeFloatingIp': {'address': '0.0.0.0'}}} Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 58, in get_instance_by_floating_ip_addr Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.network_api.get_instance_id_by_floating_address( Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2927, in get_instance_id_by_floating_address Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi fip = self._get_floating_ip_by_address(client, address) Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 3011, in _get_floating_ip_by_address Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFoundForAddress(address=address) Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFoundForAddress: Floating IP not found for address 0.0.0.0. Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:10.529305 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 277, in _remove_floating_ip Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = get_instance_by_floating_ip_addr(self, context, address) Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 61, in get_instance_by_floating_ip_addr Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=ex.format_message()) Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for address 0.0.0.0. Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for address 0.0.0.0. Oct 11 04:12:10.531431 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.534182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-456453b8-248f-47ed-8923-025859b1dbaf tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Returning 404 to user: Floating IP not found for address 0.0.0.0. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:10.535336 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-456453b8-248f-47ed-8923-025859b1dbaf tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action" status: 404 len: 88 microversion: 2.1 time: 0.073146 Oct 11 04:12:10.542519 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 276/528] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:12:10 2022] POST /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209/action => generated 88 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:12:10.542780 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7fc90ed6-d0ad-4e46-a05b-7b55bdfd1b00 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 707 microversion: 2.1 time: 0.611946 Oct 11 04:12:10.542864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-26e798fc-d859-4d83-8bd8-fa9603d690cf tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Calling method '.version_select at 0x7fda1a309c10>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:10.542864 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-26e798fc-d859-4d83-8bd8-fa9603d690cf tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] HTTP exception thrown: Hypervisor with ID '11300de4-f17f-4f4b-8db1-1eba4758ba0e' could not be found. Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-26e798fc-d859-4d83-8bd8-fa9603d690cf tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Request method failure captured: Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-hypervisors/11300de4-f17f-4f4b-8db1-1eba4758ba0e HTTP/1.1 Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO0VD1IZFvw09cHPYQ6dnpLpGHjGQNc4PkYmGyS_CpdgfTFb5oaa5SJO8oep3U9AiXKrVFOCFoGaAyFlzSMcchX5TjYTnHguAP2NteT6Vg2oHbwllcKhEPrS7BBChDPP3hCWa4f1pvh1SE5QX-l8j-vUgX5Hm4-Y3N6R4HVgLuUgWyE Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9f68b50879d84f7bbfe72260ab46bec9 Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-HypervisorAdminNegativeTestJSON-112523218 Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:12:10.546345 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9f68b50879d84f7bbfe72260ab46bec9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9f68b50879d84f7bbfe72260ab46bec9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f68b50879d84f7bbfe72260ab46bec9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9f68b50879d84f7bbfe72260ab46bec9"}]}] Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-HypervisorAdminNegativeTestJSON-112523218 Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9f68b50879d84f7bbfe72260ab46bec9 Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-HypervisorAdminNegativeTestJSON-112523218 Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 89ee1f5038704bc8baa2869a01d24f42 Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: exception: Hypervisor with ID '11300de4-f17f-4f4b-8db1-1eba4758ba0e' could not be found. Oct 11 04:12:10.547764 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '11300de4-f17f-4f4b-8db1-1eba4758ba0e'} Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 501, in validate_integer Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi value = int(str(value)) Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ValueError: invalid literal for int() with base 10: '11300de4-f17f-4f4b-8db1-1eba4758ba0e' Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 614, in validate_integer Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return strutils.validate_integer(value, name, min_value, max_value) Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/strutils.py", line 505, in validate_integer Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise ValueError(msg) Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ValueError: id must be an integer Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 313, in _validate_id Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi utils.validate_integer(hypervisor_id, 'id') Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/utils.py", line 616, in validate_integer Oct 11 04:12:10.548558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InvalidInput(reason=str(e)) Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: id must be an integer Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 337, in show Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 343, in _show Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._validate_id(req, id) Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/hypervisors.py", line 317, in _validate_id Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 04:12:10.549988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Hypervisor with ID '11300de4-f17f-4f4b-8db1-1eba4758ba0e' could not be found. Oct 11 04:12:10.551268 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.551268 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:10.551268 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.551268 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:10.551268 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:10.551268 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:10.551268 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:10.551268 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:10.551268 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Hypervisor with ID '11300de4-f17f-4f4b-8db1-1eba4758ba0e' could not be found. Oct 11 04:12:10.551268 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:10.551942 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 253/529] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:12:09 2022] GET /compute/v2.1/os-security-groups => generated 707 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:10.557018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-26e798fc-d859-4d83-8bd8-fa9603d690cf tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] Returning 404 to user: Hypervisor with ID '11300de4-f17f-4f4b-8db1-1eba4758ba0e' could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:10.561793 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-26e798fc-d859-4d83-8bd8-fa9603d690cf tempest-HypervisorAdminNegativeTestJSON-112523218 tempest-HypervisorAdminNegativeTestJSON-112523218-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/11300de4-f17f-4f4b-8db1-1eba4758ba0e" status: 404 len: 123 microversion: 2.1 time: 0.024359 Oct 11 04:12:10.569669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6252de58-a6e2-451f-b784-17b4c9920b1b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:10.570861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6252de58-a6e2-451f-b784-17b4c9920b1b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:10.571629 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 277/530] 10.222.0.26 () {58 vars in 1257 bytes} [Tue Oct 11 04:12:10 2022] GET /compute/v2.1/os-hypervisors/11300de4-f17f-4f4b-8db1-1eba4758ba0e => generated 123 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:12:10.586856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-50f95454-99f3-4c67-ab11-eaf628d92a65 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:10.589843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50f95454-99f3-4c67-ab11-eaf628d92a65 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:10.615721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6252de58-a6e2-451f-b784-17b4c9920b1b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:10.616439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6252de58-a6e2-451f-b784-17b4c9920b1b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:10.617028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6252de58-a6e2-451f-b784-17b4c9920b1b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:10.618233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6252de58-a6e2-451f-b784-17b4c9920b1b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:10.618838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6252de58-a6e2-451f-b784-17b4c9920b1b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:10.620127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6252de58-a6e2-451f-b784-17b4c9920b1b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:10.640549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50f95454-99f3-4c67-ab11-eaf628d92a65 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:10.642950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50f95454-99f3-4c67-ab11-eaf628d92a65 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:10.643404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50f95454-99f3-4c67-ab11-eaf628d92a65 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:10.648721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50f95454-99f3-4c67-ab11-eaf628d92a65 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:10.651744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50f95454-99f3-4c67-ab11-eaf628d92a65 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:10.652371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50f95454-99f3-4c67-ab11-eaf628d92a65 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:10.689500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6252de58-a6e2-451f-b784-17b4c9920b1b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:12:10.692278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50f95454-99f3-4c67-ab11-eaf628d92a65 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:12:10.710493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:11.304971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=9,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:11.394178 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-50f95454-99f3-4c67-ab11-eaf628d92a65 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 204 len: 0 microversion: 2.1 time: 0.810912 Oct 11 04:12:11.395224 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6252de58-a6e2-451f-b784-17b4c9920b1b tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "DELETE /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 204 len: 0 microversion: 2.1 time: 0.843868 Oct 11 04:12:11.396917 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 278/532] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:12:10 2022] DELETE /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 0 bytes in 824 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:12:11.399741 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 254/532] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:12:10 2022] DELETE /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 0 bytes in 846 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:12:11.404902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-044eda8e-52e7-417b-b761-aaca4d306760 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Calling method '.version_select at 0x7fda1a309dc0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:11.406271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-53d7f918-93dc-4ce8-b276-585cea752019 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:11.407127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-53d7f918-93dc-4ce8-b276-585cea752019 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:11.421231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d7f918-93dc-4ce8-b276-585cea752019 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:11.425393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d7f918-93dc-4ce8-b276-585cea752019 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:11.425990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d7f918-93dc-4ce8-b276-585cea752019 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:11.426779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d7f918-93dc-4ce8-b276-585cea752019 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:11.427460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d7f918-93dc-4ce8-b276-585cea752019 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:11.431784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d7f918-93dc-4ce8-b276-585cea752019 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:11.698145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG neutronclient.v2_0.client [None req-044eda8e-52e7-417b-b761-aaca4d306760 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Error message: {"NeutronError": {"type": "SecurityGroupCannotRemoveDefault", "message": "Insufficient rights for removing default security group.", "detail": ""}} {{(pid=120994) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:12:11.699260 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-044eda8e-52e7-417b-b761-aaca4d306760 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] HTTP exception thrown: Insufficient rights for removing default security group. Oct 11 04:12:11.699260 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-00c93212-9d99-4595-9dd9-8b155f6588c7'] Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-044eda8e-52e7-417b-b761-aaca4d306760 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Request method failure captured: Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-security-groups/e0d23d09-fb15-4b34-b5b3-67c54cc04173 HTTP/1.1 Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO0YSfIO0EdNhFMqYcKLJyBSV09xeW6SE6eLnEfOpafxp9a3rneFrYsFAL2PdJCaU8_cfw3IjOtRHQB43ZsSVpH8-vb9n_-O-8CkF9XuVcAio2wNjFByUETqc9JNU7v63xgsabK7K_vwK5gwghnklOW_IgRxIRCqHer2MqVQUK9WtMk Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f251db376c25418e8b0d3c4a38f9bf0d Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:12:11.703109 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f251db376c25418e8b0d3c4a38f9bf0d"}]}] Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f251db376c25418e8b0d3c4a38f9bf0d Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupsNegativeTestJSON-1467751348-project Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5e3b08028ce04aa0add2a6619e658f3a Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348-project Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: exception: Insufficient rights for removing default security group. Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-00c93212-9d99-4595-9dd9-8b155f6588c7'] Oct 11 04:12:11.704529 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e0d23d09-fb15-4b34-b5b3-67c54cc04173'} Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:11.705326 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Insufficient rights for removing default security group. Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00c93212-9d99-4595-9dd9-8b155f6588c7'] Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Insufficient rights for removing default security group. Oct 11 04:12:11.706537 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00c93212-9d99-4595-9dd9-8b155f6588c7'] Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Insufficient rights for removing default security group. Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00c93212-9d99-4595-9dd9-8b155f6588c7'] Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:11.707759 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:11.710736 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:11.710736 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:11.710736 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:11.710736 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Insufficient rights for removing default security group. Oct 11 04:12:11.710736 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-00c93212-9d99-4595-9dd9-8b155f6588c7'] Oct 11 04:12:11.710736 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:12:11.712766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-044eda8e-52e7-417b-b761-aaca4d306760 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Returning 400 to user: Insufficient rights for removing default security group. Oct 11 04:12:11.712766 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-00c93212-9d99-4595-9dd9-8b155f6588c7'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:11.720589 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-044eda8e-52e7-417b-b761-aaca4d306760 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/e0d23d09-fb15-4b34-b5b3-67c54cc04173" status: 400 len: 182 microversion: 2.1 time: 0.322375 Oct 11 04:12:11.724186 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 279/533] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:12:11 2022] DELETE /compute/v2.1/os-security-groups/e0d23d09-fb15-4b34-b5b3-67c54cc04173 => generated 182 bytes in 324 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:12:11.729605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-66f93745-fc05-4d4f-b5d3-58095a4044bc req-84074fdc-9e67-4331-ba15-84da27bb6c9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fb89fb-a3af-4372-a794-e1583259b555", "name": "network-vif-unplugged", "status": "completed", "tag": "fe0d100a-b7c1-4434-9679-422de267ee5e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:11.743926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-66f93745-fc05-4d4f-b5d3-58095a4044bc req-84074fdc-9e67-4331-ba15-84da27bb6c9c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:11.745278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-66f93745-fc05-4d4f-b5d3-58095a4044bc req-84074fdc-9e67-4331-ba15-84da27bb6c9c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:11.747088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-66f93745-fc05-4d4f-b5d3-58095a4044bc req-84074fdc-9e67-4331-ba15-84da27bb6c9c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:11.761025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53d7f918-93dc-4ce8-b276-585cea752019 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:11.766502 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-66f93745-fc05-4d4f-b5d3-58095a4044bc req-84074fdc-9e67-4331-ba15-84da27bb6c9c service nova] Creating event network-vif-unplugged:fe0d100a-b7c1-4434-9679-422de267ee5e for instance 22fb89fb-a3af-4372-a794-e1583259b555 on n-h2-860892-1 Oct 11 04:12:11.769886 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-53d7f918-93dc-4ce8-b276-585cea752019 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1476 microversion: 2.1 time: 0.368561 Oct 11 04:12:11.778270 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 255/534] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:11 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1476 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:11.783104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2d4f24f2-b397-4184-853b-5b517db61d50 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:11.795998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-66f93745-fc05-4d4f-b5d3-58095a4044bc req-84074fdc-9e67-4331-ba15-84da27bb6c9c service nova] Instance 22fb89fb-a3af-4372-a794-e1583259b555 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:12:11.799754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2d4f24f2-b397-4184-853b-5b517db61d50 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:11.828827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4f24f2-b397-4184-853b-5b517db61d50 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:11.829559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4f24f2-b397-4184-853b-5b517db61d50 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:11.830175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4f24f2-b397-4184-853b-5b517db61d50 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:11.831076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4f24f2-b397-4184-853b-5b517db61d50 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:11.831684 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-66f93745-fc05-4d4f-b5d3-58095a4044bc req-84074fdc-9e67-4331-ba15-84da27bb6c9c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.108105 Oct 11 04:12:11.831811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4f24f2-b397-4184-853b-5b517db61d50 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:11.832363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4f24f2-b397-4184-853b-5b517db61d50 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:11.833722 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 280/535] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:11.848905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48dcd460-0d23-41c2-b292-f77eeeb4a67a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:11.850357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-48dcd460-0d23-41c2-b292-f77eeeb4a67a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:11.868646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48dcd460-0d23-41c2-b292-f77eeeb4a67a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:11.869148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48dcd460-0d23-41c2-b292-f77eeeb4a67a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:11.869578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48dcd460-0d23-41c2-b292-f77eeeb4a67a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:11.870322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48dcd460-0d23-41c2-b292-f77eeeb4a67a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:11.870776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48dcd460-0d23-41c2-b292-f77eeeb4a67a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:11.871199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48dcd460-0d23-41c2-b292-f77eeeb4a67a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:12.085837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2d4f24f2-b397-4184-853b-5b517db61d50 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:12.105543 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2d4f24f2-b397-4184-853b-5b517db61d50 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1474 microversion: 2.1 time: 0.326131 Oct 11 04:12:12.106436 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 256/536] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:11 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1474 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:12.112704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b535e329-a54f-4d01-9e7b-163c4bffc5c1 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Calling method '.version_select at 0x7fda1a2421f0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:12.144439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-b535e329-a54f-4d01-9e7b-163c4bffc5c1 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 149e6c9a-95f1-4101-9b8a-1e6899a18e49 does not exist", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:12:12.146504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.security_group_api [None req-b535e329-a54f-4d01-9e7b-163c4bffc5c1 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Neutron security group 149e6c9a-95f1-4101-9b8a-1e6899a18e49 not found {{(pid=120993) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:12:12.147301 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-b535e329-a54f-4d01-9e7b-163c4bffc5c1 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] HTTP exception thrown: Security group 149e6c9a-95f1-4101-9b8a-1e6899a18e49 does not exist Oct 11 04:12:12.147301 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-97b15303-8cd3-433b-8261-8bd1573b2173'] Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b535e329-a54f-4d01-9e7b-163c4bffc5c1 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Request method failure captured: Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-security-groups/149e6c9a-95f1-4101-9b8a-1e6899a18e49 HTTP/1.1 Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO0YSfIO0EdNhFMqYcKLJyBSV09xeW6SE6eLnEfOpafxp9a3rneFrYsFAL2PdJCaU8_cfw3IjOtRHQB43ZsSVpH8-vb9n_-O-8CkF9XuVcAio2wNjFByUETqc9JNU7v63xgsabK7K_vwK5gwghnklOW_IgRxIRCqHer2MqVQUK9WtMk Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f251db376c25418e8b0d3c4a38f9bf0d Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:12:12.150112 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f251db376c25418e8b0d3c4a38f9bf0d"}]}] Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f251db376c25418e8b0d3c4a38f9bf0d Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsNegativeTestJSON-1467751348-project Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5e3b08028ce04aa0add2a6619e658f3a Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348-project Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: exception: Security group 149e6c9a-95f1-4101-9b8a-1e6899a18e49 does not exist Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-97b15303-8cd3-433b-8261-8bd1573b2173'] Oct 11 04:12:12.151678 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '149e6c9a-95f1-4101-9b8a-1e6899a18e49'} Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:12.152604 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 149e6c9a-95f1-4101-9b8a-1e6899a18e49 does not exist Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97b15303-8cd3-433b-8261-8bd1573b2173'] Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:12:12.153956 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 149e6c9a-95f1-4101-9b8a-1e6899a18e49 does not exist Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97b15303-8cd3-433b-8261-8bd1573b2173'] Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 149e6c9a-95f1-4101-9b8a-1e6899a18e49 does not exist Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97b15303-8cd3-433b-8261-8bd1573b2173'] Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.160051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:12.161618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:12.161618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:12.161618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:12.161618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:12.161618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 149e6c9a-95f1-4101-9b8a-1e6899a18e49 does not exist Oct 11 04:12:12.161618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-97b15303-8cd3-433b-8261-8bd1573b2173'] Oct 11 04:12:12.161618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.162115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48dcd460-0d23-41c2-b292-f77eeeb4a67a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:12.162333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b535e329-a54f-4d01-9e7b-163c4bffc5c1 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Returning 404 to user: Security group 149e6c9a-95f1-4101-9b8a-1e6899a18e49 does not exist Oct 11 04:12:12.162333 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-97b15303-8cd3-433b-8261-8bd1573b2173'] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:12.162333 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b535e329-a54f-4d01-9e7b-163c4bffc5c1 tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/149e6c9a-95f1-4101-9b8a-1e6899a18e49" status: 404 len: 194 microversion: 2.1 time: 0.050208 Oct 11 04:12:12.162333 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 257/537] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:12:12 2022] GET /compute/v2.1/os-security-groups/149e6c9a-95f1-4101-9b8a-1e6899a18e49 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:12:12.170079 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48dcd460-0d23-41c2-b292-f77eeeb4a67a tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1540 microversion: 2.1 time: 0.331995 Oct 11 04:12:12.173351 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 281/538] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:11 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1540 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:12.205038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00b8eb2b-fedf-49d5-a10f-b81f270abafb tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Action: 'update', calling method: .version_select at 0x7fda1a224d30>, body: {"security_group": {"name": "tempest-sg-1638920763", "description": "tempest-description-469145716"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:12.235338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-00b8eb2b-fedf-49d5-a10f-b81f270abafb tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 0092f764-0527-4f08-bb84-52fe7bd3879f does not exist", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:12:12.235933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.security_group_api [None req-00b8eb2b-fedf-49d5-a10f-b81f270abafb tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Neutron security group 0092f764-0527-4f08-bb84-52fe7bd3879f not found {{(pid=120993) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:12:12.236985 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-00b8eb2b-fedf-49d5-a10f-b81f270abafb tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] HTTP exception thrown: Security group 0092f764-0527-4f08-bb84-52fe7bd3879f does not exist Oct 11 04:12:12.236985 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-fb39cea8-dcfd-4222-adc2-d8dbdba47277'] Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00b8eb2b-fedf-49d5-a10f-b81f270abafb tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Request method failure captured: Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: request: PUT /compute/v2.1/os-security-groups/0092f764-0527-4f08-bb84-52fe7bd3879f HTTP/1.1 Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 101 Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO0YSfIO0EdNhFMqYcKLJyBSV09xeW6SE6eLnEfOpafxp9a3rneFrYsFAL2PdJCaU8_cfw3IjOtRHQB43ZsSVpH8-vb9n_-O-8CkF9XuVcAio2wNjFByUETqc9JNU7v63xgsabK7K_vwK5gwghnklOW_IgRxIRCqHer2MqVQUK9WtMk Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f251db376c25418e8b0d3c4a38f9bf0d Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:12:12.239379 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f251db376c25418e8b0d3c4a38f9bf0d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f251db376c25418e8b0d3c4a38f9bf0d"}]}] Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f251db376c25418e8b0d3c4a38f9bf0d Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348 Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsNegativeTestJSON-1467751348-project Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5e3b08028ce04aa0add2a6619e658f3a Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsNegativeTestJSON-1467751348-project Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: {"security_group": {"name": "tempest-sg-1638920763", "description": "tempest-description-469145716"}} Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:12:12.240806 n-d-860892-1 devstack@n-api.service[120993]: exception: Security group 0092f764-0527-4f08-bb84-52fe7bd3879f does not exist Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-fb39cea8-dcfd-4222-adc2-d8dbdba47277'] Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '0092f764-0527-4f08-bb84-52fe7bd3879f', 'body': {'security_group': {'name': 'tempest-sg-1638920763', 'description': 'tempest-description-469145716'}}} Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:12:12.241625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 0092f764-0527-4f08-bb84-52fe7bd3879f does not exist Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb39cea8-dcfd-4222-adc2-d8dbdba47277'] Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 246, in update Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:12:12.242672 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 0092f764-0527-4f08-bb84-52fe7bd3879f does not exist Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb39cea8-dcfd-4222-adc2-d8dbdba47277'] Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 248, in update Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 0092f764-0527-4f08-bb84-52fe7bd3879f does not exist Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb39cea8-dcfd-4222-adc2-d8dbdba47277'] Oct 11 04:12:12.243923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 0092f764-0527-4f08-bb84-52fe7bd3879f does not exist Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-fb39cea8-dcfd-4222-adc2-d8dbdba47277'] Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00b8eb2b-fedf-49d5-a10f-b81f270abafb tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] Returning 404 to user: Security group 0092f764-0527-4f08-bb84-52fe7bd3879f does not exist Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-fb39cea8-dcfd-4222-adc2-d8dbdba47277'] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:12.245102 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00b8eb2b-fedf-49d5-a10f-b81f270abafb tempest-SecurityGroupsNegativeTestJSON-1467751348 tempest-SecurityGroupsNegativeTestJSON-1467751348-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/0092f764-0527-4f08-bb84-52fe7bd3879f" status: 404 len: 194 microversion: 2.1 time: 0.041662 Oct 11 04:12:12.245922 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 258/539] 10.222.0.26 () {60 vars in 1290 bytes} [Tue Oct 11 04:12:12 2022] PUT /compute/v2.1/os-security-groups/0092f764-0527-4f08-bb84-52fe7bd3879f => generated 194 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:12:12.800517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8b50a9b8-7aa6-4a69-a359-c2880b1bc4f8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:12.801123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8b50a9b8-7aa6-4a69-a359-c2880b1bc4f8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:12.810611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=2,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:12.823499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b50a9b8-7aa6-4a69-a359-c2880b1bc4f8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:12.825364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b50a9b8-7aa6-4a69-a359-c2880b1bc4f8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:12.827441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b50a9b8-7aa6-4a69-a359-c2880b1bc4f8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:12.831231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b50a9b8-7aa6-4a69-a359-c2880b1bc4f8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:12.832602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b50a9b8-7aa6-4a69-a359-c2880b1bc4f8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:12.848640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b50a9b8-7aa6-4a69-a359-c2880b1bc4f8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.125757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:13.136667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8b50a9b8-7aa6-4a69-a359-c2880b1bc4f8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:13.147728 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8b50a9b8-7aa6-4a69-a359-c2880b1bc4f8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1476 microversion: 2.1 time: 0.351644 Oct 11 04:12:13.162255 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 282/540] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:12 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1476 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:13.171751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b3db72bc-121b-4801-9618-cbd01a45e4b1 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:13.172355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b3db72bc-121b-4801-9618-cbd01a45e4b1 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:13.194332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3db72bc-121b-4801-9618-cbd01a45e4b1 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.194827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3db72bc-121b-4801-9618-cbd01a45e4b1 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.195266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3db72bc-121b-4801-9618-cbd01a45e4b1 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.195966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3db72bc-121b-4801-9618-cbd01a45e4b1 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.196420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3db72bc-121b-4801-9618-cbd01a45e4b1 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.196837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3db72bc-121b-4801-9618-cbd01a45e4b1 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.490181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b3db72bc-121b-4801-9618-cbd01a45e4b1 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:13.497904 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b3db72bc-121b-4801-9618-cbd01a45e4b1 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1474 microversion: 2.1 time: 0.334256 Oct 11 04:12:13.499031 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 283/541] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:13 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1474 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:13.525279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d74e8ae2-c4f3-435f-9838-cfd8367daa60 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:13.530118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d74e8ae2-c4f3-435f-9838-cfd8367daa60 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:13.542774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d74e8ae2-c4f3-435f-9838-cfd8367daa60 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.543267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d74e8ae2-c4f3-435f-9838-cfd8367daa60 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.543700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d74e8ae2-c4f3-435f-9838-cfd8367daa60 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.544579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d74e8ae2-c4f3-435f-9838-cfd8367daa60 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.549509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d74e8ae2-c4f3-435f-9838-cfd8367daa60 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.550455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d74e8ae2-c4f3-435f-9838-cfd8367daa60 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.564050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a43b6e8a-6079-492a-94b3-42649bf13905 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Calling method '.version_select at 0x7fda1a242700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:13.566633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a43b6e8a-6079-492a-94b3-42649bf13905 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.568093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a43b6e8a-6079-492a-94b3-42649bf13905 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.568736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a43b6e8a-6079-492a-94b3-42649bf13905 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.571350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a43b6e8a-6079-492a-94b3-42649bf13905 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.571863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a43b6e8a-6079-492a-94b3-42649bf13905 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.572283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a43b6e8a-6079-492a-94b3-42649bf13905 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.626783 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a43b6e8a-6079-492a-94b3-42649bf13905 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.501162 Oct 11 04:12:13.634936 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 259/542] 10.222.0.26 () {58 vars in 1128 bytes} [Tue Oct 11 04:12:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:12:13.645503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2d952e6e-9b4d-4299-946c-5c1240e13442 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Calling method '.version_select at 0x7fda1a27de50>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:13.652997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d952e6e-9b4d-4299-946c-5c1240e13442 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.655397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d952e6e-9b4d-4299-946c-5c1240e13442 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.655910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d952e6e-9b4d-4299-946c-5c1240e13442 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.656783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d952e6e-9b4d-4299-946c-5c1240e13442 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.657247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d952e6e-9b4d-4299-946c-5c1240e13442 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.659026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d952e6e-9b4d-4299-946c-5c1240e13442 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.692442 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2d952e6e-9b4d-4299-946c-5c1240e13442 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=" status: 200 len: 376 microversion: 2.1 time: 0.055537 Oct 11 04:12:13.693351 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 260/543] 10.222.0.26 () {58 vars in 1139 bytes} [Tue Oct 11 04:12:13 2022] GET /compute/v2.1/os-hosts?zone= => generated 376 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:13.708498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e6e9e60-3b63-4042-af28-0663ac01821f tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Calling method '.version_select at 0x7fda1a2664c0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:13.713878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e6e9e60-3b63-4042-af28-0663ac01821f tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.715336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e6e9e60-3b63-4042-af28-0663ac01821f tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.717178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e6e9e60-3b63-4042-af28-0663ac01821f tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.718607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e6e9e60-3b63-4042-af28-0663ac01821f tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.719219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e6e9e60-3b63-4042-af28-0663ac01821f tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.719795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e6e9e60-3b63-4042-af28-0663ac01821f tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.759971 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4e6e9e60-3b63-4042-af28-0663ac01821f tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=xxx" status: 200 len: 13 microversion: 2.1 time: 0.057355 Oct 11 04:12:13.761400 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 261/544] 10.222.0.26 () {58 vars in 1145 bytes} [Tue Oct 11 04:12:13 2022] GET /compute/v2.1/os-hosts?zone=xxx => generated 13 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:13.773056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-91c17511-f0d8-49b8-987c-3d39e485c141 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Calling method '.version_select at 0x7fda1a242af0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:13.777262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91c17511-f0d8-49b8-987c-3d39e485c141 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.777912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91c17511-f0d8-49b8-987c-3d39e485c141 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.778549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91c17511-f0d8-49b8-987c-3d39e485c141 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.781466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91c17511-f0d8-49b8-987c-3d39e485c141 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.783175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91c17511-f0d8-49b8-987c-3d39e485c141 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.785092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91c17511-f0d8-49b8-987c-3d39e485c141 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.824765 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-91c17511-f0d8-49b8-987c-3d39e485c141 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.055266 Oct 11 04:12:13.826372 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 262/545] 10.222.0.26 () {58 vars in 1128 bytes} [Tue Oct 11 04:12:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:13.839063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-373ddc2d-216e-4650-a891-baa3221001a0 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Calling method '.version_select at 0x7fda1a5f0280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:13.852336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-373ddc2d-216e-4650-a891-baa3221001a0 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.853088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-373ddc2d-216e-4650-a891-baa3221001a0 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.853542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-373ddc2d-216e-4650-a891-baa3221001a0 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.855989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d74e8ae2-c4f3-435f-9838-cfd8367daa60 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:13.856466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-373ddc2d-216e-4650-a891-baa3221001a0 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.858408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-373ddc2d-216e-4650-a891-baa3221001a0 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.859354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-373ddc2d-216e-4650-a891-baa3221001a0 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.869473 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d74e8ae2-c4f3-435f-9838-cfd8367daa60 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1540 microversion: 2.1 time: 0.361871 Oct 11 04:12:13.876638 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 284/546] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:13 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1540 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:13.924329 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-373ddc2d-216e-4650-a891-baa3221001a0 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts?zone=internal" status: 200 len: 236 microversion: 2.1 time: 0.090994 Oct 11 04:12:13.933614 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 263/547] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:12:13 2022] GET /compute/v2.1/os-hosts?zone=internal => generated 236 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:12:13.937221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fa79796f-bb36-47eb-ad41-478e1f3cbb90 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Calling method '.version_select at 0x7fda1a31d820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:13.942765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa79796f-bb36-47eb-ad41-478e1f3cbb90 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.943622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa79796f-bb36-47eb-ad41-478e1f3cbb90 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.944231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa79796f-bb36-47eb-ad41-478e1f3cbb90 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.945741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa79796f-bb36-47eb-ad41-478e1f3cbb90 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:13.946437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa79796f-bb36-47eb-ad41-478e1f3cbb90 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:13.947322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa79796f-bb36-47eb-ad41-478e1f3cbb90 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:13.986446 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fa79796f-bb36-47eb-ad41-478e1f3cbb90 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts" status: 200 len: 376 microversion: 2.1 time: 0.053143 Oct 11 04:12:13.997486 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 285/548] 10.222.0.26 () {58 vars in 1128 bytes} [Tue Oct 11 04:12:13 2022] GET /compute/v2.1/os-hosts => generated 376 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:12:14.001909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a8c66ae-45a0-43dd-bb38-7cb80b32ce8e tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Calling method '.version_select at 0x7fda1a5f0160>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:14.010097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a8c66ae-45a0-43dd-bb38-7cb80b32ce8e tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:14.010623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a8c66ae-45a0-43dd-bb38-7cb80b32ce8e tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:14.011057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a8c66ae-45a0-43dd-bb38-7cb80b32ce8e tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:14.028209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a8c66ae-45a0-43dd-bb38-7cb80b32ce8e tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:14.028683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a8c66ae-45a0-43dd-bb38-7cb80b32ce8e tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:14.029141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a8c66ae-45a0-43dd-bb38-7cb80b32ce8e tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:14.073311 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7a8c66ae-45a0-43dd-bb38-7cb80b32ce8e tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-h2-860892-1" status: 200 len: 729 microversion: 2.1 time: 0.074700 Oct 11 04:12:14.074533 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 264/549] 10.222.0.26 () {58 vars in 1170 bytes} [Tue Oct 11 04:12:13 2022] GET /compute/v2.1/os-hosts/n-h2-860892-1 => generated 729 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:12:14.084846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1902644b-1b11-4359-b642-6115791b6958 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Calling method '.version_select at 0x7fda1a6784c0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:14.087690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-acbfdce6-44b6-4a47-a683-cc6126c5a854 req-b2cc3b61-8f25-4eaa-89e1-fe24e2fffd50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "22fb89fb-a3af-4372-a794-e1583259b555", "tag": "fe0d100a-b7c1-4434-9679-422de267ee5e"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:14.095063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1902644b-1b11-4359-b642-6115791b6958 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:14.095765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1902644b-1b11-4359-b642-6115791b6958 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:14.099149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-acbfdce6-44b6-4a47-a683-cc6126c5a854 req-b2cc3b61-8f25-4eaa-89e1-fe24e2fffd50 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:14.099744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-acbfdce6-44b6-4a47-a683-cc6126c5a854 req-b2cc3b61-8f25-4eaa-89e1-fe24e2fffd50 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:14.100273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-acbfdce6-44b6-4a47-a683-cc6126c5a854 req-b2cc3b61-8f25-4eaa-89e1-fe24e2fffd50 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:14.100519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1902644b-1b11-4359-b642-6115791b6958 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:14.115619 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-acbfdce6-44b6-4a47-a683-cc6126c5a854 req-b2cc3b61-8f25-4eaa-89e1-fe24e2fffd50 service nova] Creating event network-changed:fe0d100a-b7c1-4434-9679-422de267ee5e for instance 22fb89fb-a3af-4372-a794-e1583259b555 on n-h2-860892-1 Oct 11 04:12:14.131884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-acbfdce6-44b6-4a47-a683-cc6126c5a854 req-b2cc3b61-8f25-4eaa-89e1-fe24e2fffd50 service nova] Instance 22fb89fb-a3af-4372-a794-e1583259b555 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:12:14.133266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1902644b-1b11-4359-b642-6115791b6958 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:14.133909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1902644b-1b11-4359-b642-6115791b6958 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:14.134636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1902644b-1b11-4359-b642-6115791b6958 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:14.147446 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-acbfdce6-44b6-4a47-a683-cc6126c5a854 req-b2cc3b61-8f25-4eaa-89e1-fe24e2fffd50 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064680 Oct 11 04:12:14.148502 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 265/550] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:14.157631 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1902644b-1b11-4359-b642-6115791b6958 tempest-HostsAdminTestJSON-1031155945 tempest-HostsAdminTestJSON-1031155945-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hosts/n-h1-860892-1" status: 200 len: 467 microversion: 2.1 time: 0.076541 Oct 11 04:12:14.158708 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 286/551] 10.222.0.26 () {58 vars in 1170 bytes} [Tue Oct 11 04:12:14 2022] GET /compute/v2.1/os-hosts/n-h1-860892-1 => generated 467 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:14.172155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68ddafb4-b868-47ef-a9de-a8455aaaab8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:14.172865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68ddafb4-b868-47ef-a9de-a8455aaaab8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:14.182423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68ddafb4-b868-47ef-a9de-a8455aaaab8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:14.182927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68ddafb4-b868-47ef-a9de-a8455aaaab8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:14.183361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68ddafb4-b868-47ef-a9de-a8455aaaab8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:14.187789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68ddafb4-b868-47ef-a9de-a8455aaaab8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:14.188331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68ddafb4-b868-47ef-a9de-a8455aaaab8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:14.188776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68ddafb4-b868-47ef-a9de-a8455aaaab8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:14.528855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82d4f8cb-7a05-421a-8ed5-8f2b0668f3cb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:14.529511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82d4f8cb-7a05-421a-8ed5-8f2b0668f3cb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:14.546388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82d4f8cb-7a05-421a-8ed5-8f2b0668f3cb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:14.547245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82d4f8cb-7a05-421a-8ed5-8f2b0668f3cb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:14.549062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82d4f8cb-7a05-421a-8ed5-8f2b0668f3cb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:14.551346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82d4f8cb-7a05-421a-8ed5-8f2b0668f3cb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:14.551995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82d4f8cb-7a05-421a-8ed5-8f2b0668f3cb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:14.561251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82d4f8cb-7a05-421a-8ed5-8f2b0668f3cb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:14.788483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82d4f8cb-7a05-421a-8ed5-8f2b0668f3cb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:14.800747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68ddafb4-b868-47ef-a9de-a8455aaaab8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:14.804120 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82d4f8cb-7a05-421a-8ed5-8f2b0668f3cb tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1432 microversion: 2.1 time: 0.281871 Oct 11 04:12:14.807396 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 287/552] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:14 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1432 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:14.809668 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68ddafb4-b868-47ef-a9de-a8455aaaab8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1476 microversion: 2.1 time: 0.642277 Oct 11 04:12:14.815075 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 266/553] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:14 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1476 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:14.906486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ba61848f-5d29-4bad-9cfc-8e20ca4859f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:14.908123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ba61848f-5d29-4bad-9cfc-8e20ca4859f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:14.923997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba61848f-5d29-4bad-9cfc-8e20ca4859f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:14.925030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba61848f-5d29-4bad-9cfc-8e20ca4859f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:14.925776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba61848f-5d29-4bad-9cfc-8e20ca4859f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:14.926705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba61848f-5d29-4bad-9cfc-8e20ca4859f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:14.927771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba61848f-5d29-4bad-9cfc-8e20ca4859f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:14.931324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba61848f-5d29-4bad-9cfc-8e20ca4859f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:15.213483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-91599ec2-ca24-43e8-8629-3eebb16dcce4 req-8e3c431d-da42-457f-9cfc-c401e23116a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d4c47a-c1d1-4481-b151-a43194e08f7f", "name": "network-vif-deleted", "tag": "e779dffe-9789-4f6d-9b68-6cd98f3d9c98"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:15.231681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-91599ec2-ca24-43e8-8629-3eebb16dcce4 req-8e3c431d-da42-457f-9cfc-c401e23116a0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:15.232458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-91599ec2-ca24-43e8-8629-3eebb16dcce4 req-8e3c431d-da42-457f-9cfc-c401e23116a0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:15.233080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-91599ec2-ca24-43e8-8629-3eebb16dcce4 req-8e3c431d-da42-457f-9cfc-c401e23116a0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:15.253751 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-91599ec2-ca24-43e8-8629-3eebb16dcce4 req-8e3c431d-da42-457f-9cfc-c401e23116a0 service nova] Creating event network-vif-deleted:e779dffe-9789-4f6d-9b68-6cd98f3d9c98 for instance 32d4c47a-c1d1-4481-b151-a43194e08f7f on n-h2-860892-1 Oct 11 04:12:15.266068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-91599ec2-ca24-43e8-8629-3eebb16dcce4 req-8e3c431d-da42-457f-9cfc-c401e23116a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056795 Oct 11 04:12:15.270944 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 267/554] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:12:15.322638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ba61848f-5d29-4bad-9cfc-8e20ca4859f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:15.337640 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ba61848f-5d29-4bad-9cfc-8e20ca4859f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1540 microversion: 2.1 time: 0.438403 Oct 11 04:12:15.343230 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 288/555] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:14 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1540 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:15.831528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:15.832219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:15.849405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d4d03b5-4749-460f-943b-30c2969c8755 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:15.850059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d4d03b5-4749-460f-943b-30c2969c8755 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:15.851385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:15.852061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:15.852675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:15.853569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:15.854793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:15.855375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:15.856542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d4d03b5-4749-460f-943b-30c2969c8755 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:15.857030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d4d03b5-4749-460f-943b-30c2969c8755 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:15.857463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d4d03b5-4749-460f-943b-30c2969c8755 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:15.866267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d4d03b5-4749-460f-943b-30c2969c8755 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:15.866757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d4d03b5-4749-460f-943b-30c2969c8755 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:15.867196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d4d03b5-4749-460f-943b-30c2969c8755 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:15.914796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:15.916872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:15.916872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:15.916872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lazy-loading 'fault' on Instance uuid 32d4c47a-c1d1-4481-b151-a43194e08f7f {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:12:16.079870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d4d03b5-4749-460f-943b-30c2969c8755 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:16.089083 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d4d03b5-4749-460f-943b-30c2969c8755 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1476 microversion: 2.1 time: 0.243631 Oct 11 04:12:16.093872 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 289/556] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:15 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1476 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:16.193456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ac55ad87edb45f3b79c1aa66a929c1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4899da03227442dbf61760169d18d99', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:16.213658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5697115c-25e3-4def-894c-ee3f735478d9 req-56b4612c-1198-4ee1-b79b-c4e4a9342d16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8728557c-7590-4694-ae89-ca4194b8e209", "name": "network-vif-deleted", "tag": "6f15cb93-8f8a-423e-93c9-163696b0d2fc"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:16.219533 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1bc2edf1-ed40-472a-83d1-35e2c477e01a tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 200 len: 1309 microversion: 2.1 time: 0.392414 Oct 11 04:12:16.244352 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 268/557] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:15 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 1309 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:16.245517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5697115c-25e3-4def-894c-ee3f735478d9 req-56b4612c-1198-4ee1-b79b-c4e4a9342d16 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:16.246008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5697115c-25e3-4def-894c-ee3f735478d9 req-56b4612c-1198-4ee1-b79b-c4e4a9342d16 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:16.249266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5697115c-25e3-4def-894c-ee3f735478d9 req-56b4612c-1198-4ee1-b79b-c4e4a9342d16 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:16.272520 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5697115c-25e3-4def-894c-ee3f735478d9 req-56b4612c-1198-4ee1-b79b-c4e4a9342d16 service nova] Creating event network-vif-deleted:6f15cb93-8f8a-423e-93c9-163696b0d2fc for instance 8728557c-7590-4694-ae89-ca4194b8e209 on n-h2-860892-1 Oct 11 04:12:16.288686 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5697115c-25e3-4def-894c-ee3f735478d9 req-56b4612c-1198-4ee1-b79b-c4e4a9342d16 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080251 Oct 11 04:12:16.289299 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 290/558] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:12:16.364642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e92034cc-cbe5-4180-a8bc-619c789284b6 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:16.365383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e92034cc-cbe5-4180-a8bc-619c789284b6 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:16.384406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e92034cc-cbe5-4180-a8bc-619c789284b6 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:16.386336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e92034cc-cbe5-4180-a8bc-619c789284b6 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:16.389679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e92034cc-cbe5-4180-a8bc-619c789284b6 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:16.391297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e92034cc-cbe5-4180-a8bc-619c789284b6 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:16.407794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e92034cc-cbe5-4180-a8bc-619c789284b6 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:16.409197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e92034cc-cbe5-4180-a8bc-619c789284b6 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:17.052529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e92034cc-cbe5-4180-a8bc-619c789284b6 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:17.055010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:17.067365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e92034cc-cbe5-4180-a8bc-619c789284b6 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1316 microversion: 2.1 time: 0.708180 Oct 11 04:12:17.078602 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 269/559] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:16 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1316 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:17.120785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-463416aa-31ef-4691-8109-f1681c68f091 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:17.122135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-463416aa-31ef-4691-8109-f1681c68f091 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:17.150136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463416aa-31ef-4691-8109-f1681c68f091 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:17.150709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463416aa-31ef-4691-8109-f1681c68f091 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:17.151162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463416aa-31ef-4691-8109-f1681c68f091 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:17.151888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463416aa-31ef-4691-8109-f1681c68f091 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:17.152345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463416aa-31ef-4691-8109-f1681c68f091 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:17.152768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463416aa-31ef-4691-8109-f1681c68f091 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:17.245753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:17.246429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] [instance: 32d4c47a-c1d1-4481-b151-a43194e08f7f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:17.257370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:17.259492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:17.259951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:17.261902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:17.263924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:17.266556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:17.301724 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] HTTP exception thrown: Instance 32d4c47a-c1d1-4481-b151-a43194e08f7f could not be found. Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Request method failure captured: Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f HTTP/1.1 Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzd_4UliV_EcUXRZYeSWyKSxY8p6E_vgQKF8oRn-VvB9JaM77OznDCUT3JcliAt9HCk1J_oHcQbFzCl0B8aUGo7aSV0j2XfVgvrj5T1qoK8ljSp5mcPJHAhloM15gD0eOqdqz9YUMr3bEcHMbq-1JYMzZb7ERIaoJVIwCHmk6_6XIo Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: a4899da03227442dbf61760169d18d99 Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-LiveMigrationNegativeTest-908708659 Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:12:17.303713 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a4899da03227442dbf61760169d18d99"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a4899da03227442dbf61760169d18d99"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4899da03227442dbf61760169d18d99"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a4899da03227442dbf61760169d18d99"}]}] Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-LiveMigrationNegativeTest-908708659 Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: a4899da03227442dbf61760169d18d99 Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-LiveMigrationNegativeTest-908708659 Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-LiveMigrationNegativeTest-908708659-project Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5ac55ad87edb45f3b79c1aa66a929c1f Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-LiveMigrationNegativeTest-908708659-project Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 32d4c47a-c1d1-4481-b151-a43194e08f7f could not be found. Oct 11 04:12:17.304971 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '32d4c47a-c1d1-4481-b151-a43194e08f7f'} Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d4c47a-c1d1-4481-b151-a43194e08f7f could not be found. Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:17.305679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d4c47a-c1d1-4481-b151-a43194e08f7f could not be found. Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d4c47a-c1d1-4481-b151-a43194e08f7f could not be found. Oct 11 04:12:17.306815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:17.309678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] Returning 404 to user: Instance 32d4c47a-c1d1-4481-b151-a43194e08f7f could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:17.311247 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-55b32389-6279-4b6b-a8ec-3e736057d965 tempest-LiveMigrationNegativeTest-908708659 tempest-LiveMigrationNegativeTest-908708659-project] 10.222.0.26 "GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f" status: 404 len: 111 microversion: 2.1 time: 0.068807 Oct 11 04:12:17.313575 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 270/560] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:17 2022] GET /compute/v2.1/servers/32d4c47a-c1d1-4481-b151-a43194e08f7f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:12:17.884050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-463416aa-31ef-4691-8109-f1681c68f091 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:17.902076 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-463416aa-31ef-4691-8109-f1681c68f091 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1474 microversion: 2.1 time: 0.788564 Oct 11 04:12:17.934080 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 291/561] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:17 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1474 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:18.094621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:18.095621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:18.106614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:18.115822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:18.116276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:18.117024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:18.117478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:18.117904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:18.152338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:18.153146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:18.153812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:18.154566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lazy-loading 'fault' on Instance uuid 8728557c-7590-4694-ae89-ca4194b8e209 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:12:18.230312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0bc868b9a97a4e0faea48318c6a4855f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '958f9ef6f9ec4cd6895b9b1569bce0d7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:18.239749 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e8dc5c68-782a-4d68-8e91-5265f70971f1 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 200 len: 1321 microversion: 2.1 time: 0.152179 Oct 11 04:12:18.240413 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 271/562] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:18 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:18.929203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7f2b0479-2996-4876-b395-dc7978e86c83 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:18.930481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7f2b0479-2996-4876-b395-dc7978e86c83 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:18.939884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f2b0479-2996-4876-b395-dc7978e86c83 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:18.947534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f2b0479-2996-4876-b395-dc7978e86c83 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:18.947816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f2b0479-2996-4876-b395-dc7978e86c83 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:18.950678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f2b0479-2996-4876-b395-dc7978e86c83 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:18.955663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f2b0479-2996-4876-b395-dc7978e86c83 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:18.957684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f2b0479-2996-4876-b395-dc7978e86c83 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:19.268071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:19.268773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] [instance: 8728557c-7590-4694-ae89-ca4194b8e209] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:19.280543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:19.294615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:19.297072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:19.299969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:19.303026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:19.304221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:19.385211 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] HTTP exception thrown: Instance 8728557c-7590-4694-ae89-ca4194b8e209 could not be found. Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Request method failure captured: Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 HTTP/1.1 Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzrGSaZ_AuzDLYc_Uo9qet26abKb4g3nELRcKzgSMZixl1XV5TVEdoLot2LxEEi4KMwRZUO-Rkig12NgQAMm0UYTt541WqworE1a6sNNG7qJuqkbnRlYyrp81CQZyEm6WFAJK9HNqrUFDn8deS3X_WN4cxt-zDaNJzYnGvXqpb6iAg Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 958f9ef6f9ec4cd6895b9b1569bce0d7 Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:12:19.388172 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/958f9ef6f9ec4cd6895b9b1569bce0d7"}]}] Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 958f9ef6f9ec4cd6895b9b1569bce0d7 Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907 Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 0bc868b9a97a4e0faea48318c6a4855f Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 8728557c-7590-4694-ae89-ca4194b8e209 could not be found. Oct 11 04:12:19.390048 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '8728557c-7590-4694-ae89-ca4194b8e209'} Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8728557c-7590-4694-ae89-ca4194b8e209 could not be found. Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:19.396228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8728557c-7590-4694-ae89-ca4194b8e209 could not be found. Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8728557c-7590-4694-ae89-ca4194b8e209 could not be found. Oct 11 04:12:19.397382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:19.398474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] Returning 404 to user: Instance 8728557c-7590-4694-ae89-ca4194b8e209 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:19.398474 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6dc0d355-450e-4841-b8a2-c699ba89de92 tempest-FloatingIPsAssociationNegativeTestJSON-17930907 tempest-FloatingIPsAssociationNegativeTestJSON-17930907-project] 10.222.0.26 "GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209" status: 404 len: 111 microversion: 2.1 time: 0.130095 Oct 11 04:12:19.401859 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 272/563] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:19 2022] GET /compute/v2.1/servers/8728557c-7590-4694-ae89-ca4194b8e209 => generated 111 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:12:19.693100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7f2b0479-2996-4876-b395-dc7978e86c83 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:19.707949 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7f2b0479-2996-4876-b395-dc7978e86c83 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1471 microversion: 2.1 time: 0.781444 Oct 11 04:12:19.710901 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 292/564] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:18 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1471 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:19.735106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-db73959f-0c2e-48ce-8941-337851b39f0d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:19.736525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-db73959f-0c2e-48ce-8941-337851b39f0d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:19.750857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db73959f-0c2e-48ce-8941-337851b39f0d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:19.751614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db73959f-0c2e-48ce-8941-337851b39f0d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:19.752051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db73959f-0c2e-48ce-8941-337851b39f0d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:19.755335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db73959f-0c2e-48ce-8941-337851b39f0d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:19.755335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db73959f-0c2e-48ce-8941-337851b39f0d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:19.755335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db73959f-0c2e-48ce-8941-337851b39f0d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:20.077928 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-db73959f-0c2e-48ce-8941-337851b39f0d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "POST /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555/action" status: 204 len: 0 microversion: 2.1 time: 0.347165 Oct 11 04:12:20.081859 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 273/565] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:12:19 2022] POST /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555/action => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:12:20.089632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e458de6a-ab6d-49bf-be23-45829b20640e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:20.090341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e458de6a-ab6d-49bf-be23-45829b20640e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:20.104183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e458de6a-ab6d-49bf-be23-45829b20640e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:20.106717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e458de6a-ab6d-49bf-be23-45829b20640e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:20.107987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e458de6a-ab6d-49bf-be23-45829b20640e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:20.110518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e458de6a-ab6d-49bf-be23-45829b20640e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:20.113684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e458de6a-ab6d-49bf-be23-45829b20640e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:20.114158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e458de6a-ab6d-49bf-be23-45829b20640e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:20.856598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e458de6a-ab6d-49bf-be23-45829b20640e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:20.874747 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e458de6a-ab6d-49bf-be23-45829b20640e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1471 microversion: 2.1 time: 0.790724 Oct 11 04:12:20.875345 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 293/566] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:20 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1471 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:21.903301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d354ad40-31a0-45cf-b3d4-fd8487544264 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:21.905208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d354ad40-31a0-45cf-b3d4-fd8487544264 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:21.923442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d354ad40-31a0-45cf-b3d4-fd8487544264 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:21.924271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d354ad40-31a0-45cf-b3d4-fd8487544264 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:21.924877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d354ad40-31a0-45cf-b3d4-fd8487544264 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:21.925752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d354ad40-31a0-45cf-b3d4-fd8487544264 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:21.926437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d354ad40-31a0-45cf-b3d4-fd8487544264 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:21.927050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d354ad40-31a0-45cf-b3d4-fd8487544264 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:22.350025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d354ad40-31a0-45cf-b3d4-fd8487544264 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:22.367828 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d354ad40-31a0-45cf-b3d4-fd8487544264 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1471 microversion: 2.1 time: 0.468963 Oct 11 04:12:22.371492 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 274/567] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:21 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1471 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:23.397816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d10e71e4-4a96-442f-b7d8-6d8d378624e2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:23.398628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d10e71e4-4a96-442f-b7d8-6d8d378624e2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:23.412890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d10e71e4-4a96-442f-b7d8-6d8d378624e2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:23.413601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d10e71e4-4a96-442f-b7d8-6d8d378624e2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:23.414142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d10e71e4-4a96-442f-b7d8-6d8d378624e2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:23.415148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d10e71e4-4a96-442f-b7d8-6d8d378624e2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:23.415702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d10e71e4-4a96-442f-b7d8-6d8d378624e2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:23.416238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d10e71e4-4a96-442f-b7d8-6d8d378624e2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:23.965999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d10e71e4-4a96-442f-b7d8-6d8d378624e2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:23.974658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:23.992235 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d10e71e4-4a96-442f-b7d8-6d8d378624e2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1471 microversion: 2.1 time: 0.601774 Oct 11 04:12:23.995759 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 294/568] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:23 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1471 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:25.020531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-23592590-70dd-48cf-b1de-cbd15dca76df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:25.021136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-23592590-70dd-48cf-b1de-cbd15dca76df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:25.031311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=10 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:25.033349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23592590-70dd-48cf-b1de-cbd15dca76df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:25.040496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23592590-70dd-48cf-b1de-cbd15dca76df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:25.041308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23592590-70dd-48cf-b1de-cbd15dca76df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:25.042254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23592590-70dd-48cf-b1de-cbd15dca76df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:25.042883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23592590-70dd-48cf-b1de-cbd15dca76df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:25.046954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23592590-70dd-48cf-b1de-cbd15dca76df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:25.153754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4faec684-0bfd-442d-90a5-6114fdaa317c req-aa771b5b-4627-4faa-a756-46f4e1ce433e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fb89fb-a3af-4372-a794-e1583259b555", "name": "network-vif-plugged", "status": "completed", "tag": "fe0d100a-b7c1-4434-9679-422de267ee5e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:25.171433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4faec684-0bfd-442d-90a5-6114fdaa317c req-aa771b5b-4627-4faa-a756-46f4e1ce433e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:25.191271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4faec684-0bfd-442d-90a5-6114fdaa317c req-aa771b5b-4627-4faa-a756-46f4e1ce433e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:25.191515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4faec684-0bfd-442d-90a5-6114fdaa317c req-aa771b5b-4627-4faa-a756-46f4e1ce433e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:25.220989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4faec684-0bfd-442d-90a5-6114fdaa317c req-aa771b5b-4627-4faa-a756-46f4e1ce433e service nova] Creating event network-vif-plugged:fe0d100a-b7c1-4434-9679-422de267ee5e for instance 22fb89fb-a3af-4372-a794-e1583259b555 on n-h2-860892-1 Oct 11 04:12:25.233810 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4faec684-0bfd-442d-90a5-6114fdaa317c req-aa771b5b-4627-4faa-a756-46f4e1ce433e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083672 Oct 11 04:12:25.234772 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 295/569] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:12:25.687977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-23592590-70dd-48cf-b1de-cbd15dca76df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:25.687977 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-23592590-70dd-48cf-b1de-cbd15dca76df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1463 microversion: 2.1 time: 0.623770 Oct 11 04:12:25.687977 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 275/570] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:25 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1463 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:25.688233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c90fd3dd-007c-4669-9231-d17faab408c4 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:25.688233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c90fd3dd-007c-4669-9231-d17faab408c4 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:25.688233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c90fd3dd-007c-4669-9231-d17faab408c4 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:25.688233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c90fd3dd-007c-4669-9231-d17faab408c4 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:25.688513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c90fd3dd-007c-4669-9231-d17faab408c4 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:25.688513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c90fd3dd-007c-4669-9231-d17faab408c4 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:25.688513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c90fd3dd-007c-4669-9231-d17faab408c4 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:25.688513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c90fd3dd-007c-4669-9231-d17faab408c4 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:26.010320 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c90fd3dd-007c-4669-9231-d17faab408c4 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1614 microversion: 2.1 time: 0.343961 Oct 11 04:12:26.011393 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 296/571] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:25 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1614 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:26.042542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2009c1a4-dfb3-4a4d-a17a-533b5ed0915d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Calling method '.version_select at 0x7fda1a1b9a60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:26.047037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2009c1a4-dfb3-4a4d-a17a-533b5ed0915d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:26.047764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2009c1a4-dfb3-4a4d-a17a-533b5ed0915d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:26.048206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2009c1a4-dfb3-4a4d-a17a-533b5ed0915d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:26.062939 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2009c1a4-dfb3-4a4d-a17a-533b5ed0915d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 409 microversion: 2.1 time: 0.025329 Oct 11 04:12:26.063871 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 276/572] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:12:26 2022] GET /compute/v2.1/os-migrations => generated 409 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:26.653213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-90650765", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:26.817337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:12:27.675254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:12:27.675254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:12:27.680353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:12:27.680770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:12:27.681186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:12:27.701449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:27.702180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:27.702828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:27.703709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:27.704328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:27.704940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:27.762176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:27.772519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for user a1df373e8ec14e2a84f0b8a62e0b884a and project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:27.804655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:12:27.815188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:12:28.016276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ea91eba5-1893-449b-99cb-398af853cc7e tempest-SecurityGroupsTestAdminJSON-223212455 tempest-SecurityGroupsTestAdminJSON-223212455-project] Action: 'create', calling method: .version_select at 0x7fda1a266280>, body: {"security_group": {"name": "tempest-securitygroup-2079896369", "description": "tempest-description-827284838"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:28.021039 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6b6a8b30-3035-4dc4-b9d8-d41ddbfd3d87 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.371965 Oct 11 04:12:28.027984 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 297/573] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:12:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 1374 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:12:28.174393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c2ec7488-03cb-4ac3-a88e-e968e573f4f5 tempest-AZV2TestJSON-919896223 tempest-AZV2TestJSON-919896223-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:28.176217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2ec7488-03cb-4ac3-a88e-e968e573f4f5 tempest-AZV2TestJSON-919896223 tempest-AZV2TestJSON-919896223-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:28.176857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2ec7488-03cb-4ac3-a88e-e968e573f4f5 tempest-AZV2TestJSON-919896223 tempest-AZV2TestJSON-919896223-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:28.177453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2ec7488-03cb-4ac3-a88e-e968e573f4f5 tempest-AZV2TestJSON-919896223 tempest-AZV2TestJSON-919896223-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:28.178165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2ec7488-03cb-4ac3-a88e-e968e573f4f5 tempest-AZV2TestJSON-919896223 tempest-AZV2TestJSON-919896223-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:28.178855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2ec7488-03cb-4ac3-a88e-e968e573f4f5 tempest-AZV2TestJSON-919896223 tempest-AZV2TestJSON-919896223-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:28.179298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2ec7488-03cb-4ac3-a88e-e968e573f4f5 tempest-AZV2TestJSON-919896223 tempest-AZV2TestJSON-919896223-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:28.199076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:28.222492 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c2ec7488-03cb-4ac3-a88e-e968e573f4f5 tempest-AZV2TestJSON-919896223 tempest-AZV2TestJSON-919896223-project] 10.222.0.26 "GET /compute/v2.1/os-availability-zone" status: 200 len: 97 microversion: 2.1 time: 0.199320 Oct 11 04:12:28.223080 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 298/574] 10.222.0.26 () {58 vars in 1164 bytes} [Tue Oct 11 04:12:28 2022] GET /compute/v2.1/os-availability-zone => generated 97 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:28.244151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dddc3f0e-7108-4997-b560-0966cb0975df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:28.244569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dddc3f0e-7108-4997-b560-0966cb0975df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:28.399198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dddc3f0e-7108-4997-b560-0966cb0975df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:28.415249 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dddc3f0e-7108-4997-b560-0966cb0975df tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1211 microversion: 2.1 time: 0.178867 Oct 11 04:12:28.421877 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 299/575] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:28 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1211 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:28.868709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-23116d03-7892-44f7-9eb2-5b47eabad0da tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Action: 'create', calling method: .version_select at 0x7fda1a31df70>, body: {"keypair": {"name": "tempest-keypair-899887897", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF/IteJGqLW/V1JhtobjY3tPVjNeRftixrT3EowGSNKxMeH3JFu23AP8qsUWZk7uVEiLvipksxEbL3SEeo4ioj92aqEw8TZZpOt4IhI8vcxMpBT0cR5PQJbGOT+9nIvxhQ=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:28.896104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-23116d03-7892-44f7-9eb2-5b47eabad0da tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Getting quotas for project 65263374513549f0b6329862bd14f419. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:28.901900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-23116d03-7892-44f7-9eb2-5b47eabad0da tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Getting quotas for user 886899e459944df290afd3583310c873 and project 65263374513549f0b6329862bd14f419. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:29.038970 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-23116d03-7892-44f7-9eb2-5b47eabad0da tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.478756 Oct 11 04:12:29.047751 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 300/576] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:12:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:12:29.450132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ec27db1a-9dd0-488f-8caf-5fe2a80ba3a9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:29.451206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ec27db1a-9dd0-488f-8caf-5fe2a80ba3a9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:29.476206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec27db1a-9dd0-488f-8caf-5fe2a80ba3a9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:29.476776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec27db1a-9dd0-488f-8caf-5fe2a80ba3a9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:29.478878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec27db1a-9dd0-488f-8caf-5fe2a80ba3a9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:29.479741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec27db1a-9dd0-488f-8caf-5fe2a80ba3a9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:29.482626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec27db1a-9dd0-488f-8caf-5fe2a80ba3a9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:29.483089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec27db1a-9dd0-488f-8caf-5fe2a80ba3a9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:29.662541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ec27db1a-9dd0-488f-8caf-5fe2a80ba3a9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:29.670309 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ec27db1a-9dd0-488f-8caf-5fe2a80ba3a9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1215 microversion: 2.1 time: 0.228491 Oct 11 04:12:29.670935 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 301/577] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:29 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1215 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:12:30.045586 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ea91eba5-1893-449b-99cb-398af853cc7e tempest-SecurityGroupsTestAdminJSON-223212455 tempest-SecurityGroupsTestAdminJSON-223212455-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.564970 Oct 11 04:12:30.047099 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 277/578] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:12:27 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2568 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:12:30.065273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25e2d02d-fc02-4bed-9483-7e391bbe3a82 tempest-SecurityGroupsTestAdminJSON-223212455 tempest-SecurityGroupsTestAdminJSON-223212455-project] Action: 'create', calling method: .version_select at 0x7fda1a31daf0>, body: {"security_group": {"name": "tempest-securitygroup-19370899", "description": "tempest-description-1958668751"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:30.696287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b5b4006b-ba8f-431a-87f5-595200f2e817 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:30.697034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b5b4006b-ba8f-431a-87f5-595200f2e817 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:30.719790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b4006b-ba8f-431a-87f5-595200f2e817 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:30.720786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b4006b-ba8f-431a-87f5-595200f2e817 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:30.721558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b4006b-ba8f-431a-87f5-595200f2e817 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:30.722542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b4006b-ba8f-431a-87f5-595200f2e817 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:30.723246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b4006b-ba8f-431a-87f5-595200f2e817 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:30.725888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b4006b-ba8f-431a-87f5-595200f2e817 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:30.829380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b5b4006b-ba8f-431a-87f5-595200f2e817 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:30.844765 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b5b4006b-ba8f-431a-87f5-595200f2e817 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1263 microversion: 2.1 time: 0.152973 Oct 11 04:12:30.847211 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 278/579] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:30 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:31.105837 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-25e2d02d-fc02-4bed-9483-7e391bbe3a82 tempest-SecurityGroupsTestAdminJSON-223212455 tempest-SecurityGroupsTestAdminJSON-223212455-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.049047 Oct 11 04:12:31.115280 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 302/580] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:12:30 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:31.733862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c3f3d62-4b85-4b47-97e4-d0d3c94b2120 tempest-SecurityGroupsTestAdminJSON-2138340225 tempest-SecurityGroupsTestAdminJSON-2138340225-project-admin] Action: 'create', calling method: .version_select at 0x7fda1a1adc10>, body: {"security_group": {"name": "tempest-securitygroup-876083996", "description": "tempest-description-1163496320"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:31.871290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-575d9ee9-4a87-48cf-bac8-a029de175ce1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:31.871945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-575d9ee9-4a87-48cf-bac8-a029de175ce1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:31.889904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-575d9ee9-4a87-48cf-bac8-a029de175ce1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:31.890424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-575d9ee9-4a87-48cf-bac8-a029de175ce1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:31.890872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-575d9ee9-4a87-48cf-bac8-a029de175ce1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:31.891575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-575d9ee9-4a87-48cf-bac8-a029de175ce1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:31.892032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-575d9ee9-4a87-48cf-bac8-a029de175ce1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:31.892451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-575d9ee9-4a87-48cf-bac8-a029de175ce1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:32.143798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-575d9ee9-4a87-48cf-bac8-a029de175ce1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:32.156417 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-575d9ee9-4a87-48cf-bac8-a029de175ce1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1269 microversion: 2.1 time: 0.288840 Oct 11 04:12:32.160292 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 303/581] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:31 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1269 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:33.180035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-03bc5fa3-f922-4aeb-98a9-ce89fab54b2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:33.181442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-03bc5fa3-f922-4aeb-98a9-ce89fab54b2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:33.192650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03bc5fa3-f922-4aeb-98a9-ce89fab54b2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:33.195547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03bc5fa3-f922-4aeb-98a9-ce89fab54b2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:33.197807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03bc5fa3-f922-4aeb-98a9-ce89fab54b2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:33.199610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03bc5fa3-f922-4aeb-98a9-ce89fab54b2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:33.202742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03bc5fa3-f922-4aeb-98a9-ce89fab54b2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:33.203435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03bc5fa3-f922-4aeb-98a9-ce89fab54b2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:33.564239 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c3f3d62-4b85-4b47-97e4-d0d3c94b2120 tempest-SecurityGroupsTestAdminJSON-2138340225 tempest-SecurityGroupsTestAdminJSON-2138340225-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 220 microversion: 2.1 time: 2.447603 Oct 11 04:12:33.565050 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 279/582] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:12:31 2022] POST /compute/v2.1/os-security-groups => generated 220 bytes in 2450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:33.584269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ab0da67-b680-446a-b821-4f5a04dc15d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:33.584763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2ab0da67-b680-446a-b821-4f5a04dc15d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:33.604348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ab0da67-b680-446a-b821-4f5a04dc15d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:33.607781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ab0da67-b680-446a-b821-4f5a04dc15d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:33.607781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ab0da67-b680-446a-b821-4f5a04dc15d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:33.607781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ab0da67-b680-446a-b821-4f5a04dc15d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:33.608067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ab0da67-b680-446a-b821-4f5a04dc15d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:33.608482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ab0da67-b680-446a-b821-4f5a04dc15d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:33.646364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2ab0da67-b680-446a-b821-4f5a04dc15d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:12:34.019261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-03bc5fa3-f922-4aeb-98a9-ce89fab54b2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:34.034853 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-03bc5fa3-f922-4aeb-98a9-ce89fab54b2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1311 microversion: 2.1 time: 0.858707 Oct 11 04:12:34.035470 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 304/583] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:33 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1311 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:34.277828 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2ab0da67-b680-446a-b821-4f5a04dc15d1 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 204 len: 0 microversion: 2.1 time: 0.697120 Oct 11 04:12:34.287144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAaction247Test-server-1560194101", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": "none"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:34.288318 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 280/584] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:12:33 2022] DELETE /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 0 bytes in 713 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:12:34.294361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f9c5567-63be-42ee-99ce-0d988fc82612 tempest-SecurityGroupsTestAdminJSON-2138340225 tempest-SecurityGroupsTestAdminJSON-2138340225-project-admin] Action: 'create', calling method: .version_select at 0x7fda1a19c550>, body: {"security_group": {"name": "tempest-securitygroup-651779483", "description": "tempest-description-878722079"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:34.408872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:12:34.408872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:12:34.408872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:12:34.408872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:12:34.411314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:12:34.429157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:34.433607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:34.436558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:34.436558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:34.436558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:34.442338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:34.486334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Getting quotas for project dd9092d3a57643b2b3bec9333a7e2651. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:34.503787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Getting quotas for user 67193d9dadd94d82a19feaaaa15c27ac and project dd9092d3a57643b2b3bec9333a7e2651. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:34.525798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:12:34.531123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:12:34.708275 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-845594f1-c3be-425a-bd81-844342d8138b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.668441 Oct 11 04:12:34.709260 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 305/585] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:12:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 673 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:12:34.720545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersWithSpecificFlavorTestJSON-server-279144940", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "1151262366", "adminPass": "***", "networks": [{"uuid": "4edb5971-f6e7-4813-8c41-2b84d65bce36"}], "security_groups": [{"name": "tempest-securitygroup--167793482"}], "key_name": "tempest-keypair-2042032906", "user_data": "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:34.987560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] validate_networks() for [('4edb5971-f6e7-4813-8c41-2b84d65bce36', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:12:35.638843 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f9c5567-63be-42ee-99ce-0d988fc82612 tempest-SecurityGroupsTestAdminJSON-2138340225 tempest-SecurityGroupsTestAdminJSON-2138340225-project-admin] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 219 microversion: 2.1 time: 1.348978 Oct 11 04:12:35.640108 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 281/586] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:12:34 2022] POST /compute/v2.1/os-security-groups => generated 219 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:35.646036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c4f063ad-86c7-4e31-9b8a-5065fc67411b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:35.646999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c4f063ad-86c7-4e31-9b8a-5065fc67411b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:35.924747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c4f063ad-86c7-4e31-9b8a-5065fc67411b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:35.938373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c4f063ad-86c7-4e31-9b8a-5065fc67411b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:35.940047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c4f063ad-86c7-4e31-9b8a-5065fc67411b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:35.941106 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c4f063ad-86c7-4e31-9b8a-5065fc67411b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] 10.222.0.26 "GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09" status: 200 len: 1281 microversion: 2.47 time: 0.299812 Oct 11 04:12:35.941654 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 282/587] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:12:35 2022] GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09 => generated 1281 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:12:35.978495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-268fcc85-9fab-4025-8062-0dad79590e15 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:35.982292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-268fcc85-9fab-4025-8062-0dad79590e15 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:36.001980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268fcc85-9fab-4025-8062-0dad79590e15 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:36.004686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268fcc85-9fab-4025-8062-0dad79590e15 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:36.006498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268fcc85-9fab-4025-8062-0dad79590e15 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:36.008720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268fcc85-9fab-4025-8062-0dad79590e15 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:36.011781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268fcc85-9fab-4025-8062-0dad79590e15 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:36.012393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268fcc85-9fab-4025-8062-0dad79590e15 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:36.170012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:12:36.170012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:12:36.170012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:12:36.170012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:12:36.170012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:12:36.171538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:36.180672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:36.181319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:36.181973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:36.182996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:36.183694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:36.184220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:36.241055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Getting quotas for project 49ed194cff9c4482a96dff268602479a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:36.249658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Getting quotas for user 28240e25179b447781e0e351c659c065 and project 49ed194cff9c4482a96dff268602479a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:36.278548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:12:36.280981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=-1,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:12:36.529394 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-50c8e81e-abcb-42de-b2b8-d510b2a31f71 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.818636 Oct 11 04:12:36.537477 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 306/588] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:12:34 2022] POST /compute/v2.1/servers => generated 401 bytes in 1828 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:12:36.543796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3de98e81-8645-44a7-b909-6b543c609647 tempest-SecurityGroupsTestAdminJSON-2138340225 tempest-SecurityGroupsTestAdminJSON-2138340225-project-admin] Calling method '.version_select at 0x7fda1a31d670>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:36.674209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-268fcc85-9fab-4025-8062-0dad79590e15 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:36.688580 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-268fcc85-9fab-4025-8062-0dad79590e15 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1311 microversion: 2.1 time: 0.745849 Oct 11 04:12:36.692190 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 283/589] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:35 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1311 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:36.697896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-577721755", "imageRef": "4ee2cd19-5fd2-409b-a2f5-6ab23e1cd853", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "c7661ca0-c34f-4f4b-addf-8f23e1cfe20c"}], "security_groups": [{"name": "tempest-securitygroup--794950487"}], "key_name": "tempest-keypair-899887897", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:37.252246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] validate_networks() for [('c7661ca0-c34f-4f4b-addf-8f23e1cfe20c', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:12:38.843487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:12:38.844026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:12:38.844161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:12:38.845168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:12:38.846248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:12:38.863575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:38.864125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:38.864544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:38.868621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:38.881843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:38.882782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:38.935193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Getting quotas for project 65263374513549f0b6329862bd14f419. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:38.950957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Getting quotas for user 886899e459944df290afd3583310c873 and project 65263374513549f0b6329862bd14f419. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:39.004796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:12:39.007924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ee2cd19-5fd2-409b-a2f5-6ab23e1cd853',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:12:39.312326 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e17d9bcb-e185-41a3-84e1-4a46cca598ee tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.616920 Oct 11 04:12:39.314613 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 284/590] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:12:36 2022] POST /compute/v2.1/servers => generated 405 bytes in 2621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:12:39.345522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62e6dd32-2550-4b9e-b5b5-9a2d81e138eb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:39.346264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-62e6dd32-2550-4b9e-b5b5-9a2d81e138eb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:39.357251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e6dd32-2550-4b9e-b5b5-9a2d81e138eb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:39.357251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e6dd32-2550-4b9e-b5b5-9a2d81e138eb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:39.357251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e6dd32-2550-4b9e-b5b5-9a2d81e138eb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:39.357251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e6dd32-2550-4b9e-b5b5-9a2d81e138eb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:39.357680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e6dd32-2550-4b9e-b5b5-9a2d81e138eb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:39.357680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e6dd32-2550-4b9e-b5b5-9a2d81e138eb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:39.654883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62e6dd32-2550-4b9e-b5b5-9a2d81e138eb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:39.707776 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-62e6dd32-2550-4b9e-b5b5-9a2d81e138eb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1316 microversion: 2.1 time: 0.375643 Oct 11 04:12:39.707776 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 285/591] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:39 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1316 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:39.713314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:39.716602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:39.741541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:39.741541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:39.741541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:39.741541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:39.742780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:39.743415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:40.093363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:40.103283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:40.104709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:40.110847 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8a01698-393c-4dc4-a4e2-da61e8342ad1 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] 10.222.0.26 "GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09" status: 200 len: 1339 microversion: 2.47 time: 0.408666 Oct 11 04:12:40.111439 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 286/592] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:12:39 2022] GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09 => generated 1339 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:12:40.124153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-807559d8-55ef-4b2d-a8f6-de398947aca9 req-50e74b76-1cb1-4504-a17d-1c66dbc99527 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa356b6-3b84-4022-b47c-35239eaeb5c3", "tag": "c9c070fc-a59c-46ad-8b25-4293eab123bc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:40.153432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-807559d8-55ef-4b2d-a8f6-de398947aca9 req-50e74b76-1cb1-4504-a17d-1c66dbc99527 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:40.154176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-807559d8-55ef-4b2d-a8f6-de398947aca9 req-50e74b76-1cb1-4504-a17d-1c66dbc99527 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:40.159593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-807559d8-55ef-4b2d-a8f6-de398947aca9 req-50e74b76-1cb1-4504-a17d-1c66dbc99527 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:40.195830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-807559d8-55ef-4b2d-a8f6-de398947aca9 req-50e74b76-1cb1-4504-a17d-1c66dbc99527 service nova] Creating event network-changed:c9c070fc-a59c-46ad-8b25-4293eab123bc for instance afa356b6-3b84-4022-b47c-35239eaeb5c3 on n-h2-860892-1 Oct 11 04:12:40.203112 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-807559d8-55ef-4b2d-a8f6-de398947aca9 req-50e74b76-1cb1-4504-a17d-1c66dbc99527 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090296 Oct 11 04:12:40.203727 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 287/593] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:40.209393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bb651c51-0575-41bb-a2ae-15bad9f1b0e6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:40.216768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bb651c51-0575-41bb-a2ae-15bad9f1b0e6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:40.220799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:40.240124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb651c51-0575-41bb-a2ae-15bad9f1b0e6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:40.241614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb651c51-0575-41bb-a2ae-15bad9f1b0e6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:40.242259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb651c51-0575-41bb-a2ae-15bad9f1b0e6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:40.243198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb651c51-0575-41bb-a2ae-15bad9f1b0e6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:40.244481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb651c51-0575-41bb-a2ae-15bad9f1b0e6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:40.245075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb651c51-0575-41bb-a2ae-15bad9f1b0e6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:40.662154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb651c51-0575-41bb-a2ae-15bad9f1b0e6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:40.690546 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bb651c51-0575-41bb-a2ae-15bad9f1b0e6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1311 microversion: 2.1 time: 0.485486 Oct 11 04:12:40.696509 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3de98e81-8645-44a7-b909-6b543c609647 tempest-SecurityGroupsTestAdminJSON-2138340225 tempest-SecurityGroupsTestAdminJSON-2138340225-project-admin] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 10985 microversion: 2.1 time: 4.157610 Oct 11 04:12:40.697737 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 307/594] 10.222.0.26 () {58 vars in 1191 bytes} [Tue Oct 11 04:12:36 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 10985 bytes in 4160 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:12:40.703134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5b21d166-aee6-42b0-9cad-d41fee6a899e tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Calling method '.version_select at 0x7fda1a315820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:40.719605 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 288/595] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:40 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1311 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:40.745567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-540ad9ef-768e-43f2-85fc-c1494ec71931 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:40.747806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-540ad9ef-768e-43f2-85fc-c1494ec71931 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:40.783014 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5b21d166-aee6-42b0-9cad-d41fee6a899e tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9" status: 200 len: 637 microversion: 2.1 time: 0.081862 Oct 11 04:12:40.783014 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 308/596] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:12:40 2022] GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9 => generated 637 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:40.792308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f153627a-ee8a-4d5b-98f4-f5b3385ebe7e tempest-SecurityGroupsTestAdminJSON-223212455 tempest-SecurityGroupsTestAdminJSON-223212455-project] Calling method '.version_select at 0x7fda1a31dca0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:41.221980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-540ad9ef-768e-43f2-85fc-c1494ec71931 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:41.229731 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-540ad9ef-768e-43f2-85fc-c1494ec71931 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1244 microversion: 2.1 time: 0.502819 Oct 11 04:12:41.234932 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 289/597] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:40 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1244 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:41.240871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31cfd107-e0cb-496b-bc8f-713480141c0e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:41.249152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-31cfd107-e0cb-496b-bc8f-713480141c0e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:41.259759 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f153627a-ee8a-4d5b-98f4-f5b3385ebe7e tempest-SecurityGroupsTestAdminJSON-223212455 tempest-SecurityGroupsTestAdminJSON-223212455-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups?all_tenants=true" status: 200 len: 1110 microversion: 2.1 time: 0.476174 Oct 11 04:12:41.260883 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 309/598] 10.222.0.26 () {58 vars in 1191 bytes} [Tue Oct 11 04:12:40 2022] GET /compute/v2.1/os-security-groups?all_tenants=true => generated 1110 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:41.271180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6032542c-6676-4820-ac4d-865b49d687f9 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Action: 'update_all', calling method: .version_select at 0x7fda1a2f1dc0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:41.281564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31cfd107-e0cb-496b-bc8f-713480141c0e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:41.282095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31cfd107-e0cb-496b-bc8f-713480141c0e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:41.283115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31cfd107-e0cb-496b-bc8f-713480141c0e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:41.283856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31cfd107-e0cb-496b-bc8f-713480141c0e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:41.284315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31cfd107-e0cb-496b-bc8f-713480141c0e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:41.284759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31cfd107-e0cb-496b-bc8f-713480141c0e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:41.368034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6032542c-6676-4820-ac4d-865b49d687f9 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:41.374161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6032542c-6676-4820-ac4d-865b49d687f9 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for user 1f321a9fa37a426aab12428b2f9ecd90 and project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:41.459668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-31cfd107-e0cb-496b-bc8f-713480141c0e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:41.477672 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-31cfd107-e0cb-496b-bc8f-713480141c0e tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1316 microversion: 2.1 time: 0.238937 Oct 11 04:12:41.478075 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 290/599] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:41 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1316 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:41.484602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:41.485485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:41.494261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:41.495114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:41.496490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:41.497688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:41.498477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:41.499342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:41.543104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:41.625945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:41.635591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:41.642118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:41.643787 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d8e10d6-5fb5-473f-ba9d-71480a7cab91 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] 10.222.0.26 "GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09" status: 200 len: 1339 microversion: 2.47 time: 0.164415 Oct 11 04:12:41.644509 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 291/600] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:12:41 2022] GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09 => generated 1339 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:12:41.656860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fe414d1e-e088-4de1-86cd-4e562c4d334f tempest-SecurityGroupsTestAdminJSON-2138340225 tempest-SecurityGroupsTestAdminJSON-2138340225-project-admin] Calling method '.version_select at 0x7fda1a190790>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:42.026247 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6032542c-6676-4820-ac4d-865b49d687f9 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.763845 Oct 11 04:12:42.027416 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 310/601] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:12:41 2022] PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 61 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:42.033267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c1c3e147-5e07-4801-aebc-ddefe9a5ceac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:42.034324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c1c3e147-5e07-4801-aebc-ddefe9a5ceac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:42.040946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1c3e147-5e07-4801-aebc-ddefe9a5ceac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:42.041570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1c3e147-5e07-4801-aebc-ddefe9a5ceac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:42.042665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1c3e147-5e07-4801-aebc-ddefe9a5ceac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:42.043516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1c3e147-5e07-4801-aebc-ddefe9a5ceac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:42.044331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1c3e147-5e07-4801-aebc-ddefe9a5ceac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:42.044833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1c3e147-5e07-4801-aebc-ddefe9a5ceac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:42.111816 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fe414d1e-e088-4de1-86cd-4e562c4d334f tempest-SecurityGroupsTestAdminJSON-2138340225 tempest-SecurityGroupsTestAdminJSON-2138340225-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/4beccb39-fe9f-483a-a9d4-2d17291f43ee" status: 202 len: 0 microversion: 2.1 time: 0.460647 Oct 11 04:12:42.113033 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 292/602] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:12:41 2022] DELETE /compute/v2.1/os-security-groups/4beccb39-fe9f-483a-a9d4-2d17291f43ee => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:12:42.146511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-194a7a25-88f2-45e0-a0f8-fae22aa96db1 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Calling method '.version_select at 0x7fda1a26cd30>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:42.239034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c1c3e147-5e07-4801-aebc-ddefe9a5ceac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:42.248713 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c1c3e147-5e07-4801-aebc-ddefe9a5ceac tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1311 microversion: 2.1 time: 0.219196 Oct 11 04:12:42.249617 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 311/603] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:42 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1311 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:42.256393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0e279e57-71b0-4b97-a63c-eb28dcd75924 tempest-SecurityGroupsTestAdminJSON-2138340225 tempest-SecurityGroupsTestAdminJSON-2138340225-project-admin] Calling method '.version_select at 0x7fda1a678dc0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:42.754277 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0e279e57-71b0-4b97-a63c-eb28dcd75924 tempest-SecurityGroupsTestAdminJSON-2138340225 tempest-SecurityGroupsTestAdminJSON-2138340225-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c71b5436-67ff-46fd-b74e-31e093d54e2d" status: 202 len: 0 microversion: 2.1 time: 0.501337 Oct 11 04:12:42.755513 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 312/604] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:12:42 2022] DELETE /compute/v2.1/os-security-groups/c71b5436-67ff-46fd-b74e-31e093d54e2d => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:12:42.760529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-67bedab0-2fd8-47da-b888-78d01dec6b1a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:42.762916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-67bedab0-2fd8-47da-b888-78d01dec6b1a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:42.788083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67bedab0-2fd8-47da-b888-78d01dec6b1a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:42.788083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67bedab0-2fd8-47da-b888-78d01dec6b1a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:42.788083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67bedab0-2fd8-47da-b888-78d01dec6b1a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:42.788083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67bedab0-2fd8-47da-b888-78d01dec6b1a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:42.788631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67bedab0-2fd8-47da-b888-78d01dec6b1a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:42.788631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67bedab0-2fd8-47da-b888-78d01dec6b1a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:42.836593 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-194a7a25-88f2-45e0-a0f8-fae22aa96db1 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "DELETE /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata/os_version" status: 204 len: 0 microversion: 2.1 time: 0.722219 Oct 11 04:12:42.837888 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 293/605] 10.222.0.26 () {58 vars in 1296 bytes} [Tue Oct 11 04:12:42 2022] DELETE /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata/os_version => generated 0 bytes in 724 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:12:42.850441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-af3c8f4d-1de9-4192-89b9-b95020af4cb9 req-47c31aad-3445-4094-9048-0c98855b59a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a2d8cb-5666-44f2-b773-bc4305262557", "name": "network-vif-deleted", "tag": "7b731ed1-208b-42f4-befd-6f133da74aff"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:42.868924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af3c8f4d-1de9-4192-89b9-b95020af4cb9 req-47c31aad-3445-4094-9048-0c98855b59a8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:42.870985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af3c8f4d-1de9-4192-89b9-b95020af4cb9 req-47c31aad-3445-4094-9048-0c98855b59a8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:42.872841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af3c8f4d-1de9-4192-89b9-b95020af4cb9 req-47c31aad-3445-4094-9048-0c98855b59a8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:42.921934 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-af3c8f4d-1de9-4192-89b9-b95020af4cb9 req-47c31aad-3445-4094-9048-0c98855b59a8 service nova] Creating event network-vif-deleted:7b731ed1-208b-42f4-befd-6f133da74aff for instance e3a2d8cb-5666-44f2-b773-bc4305262557 on n-h1-860892-1 Oct 11 04:12:42.930848 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-af3c8f4d-1de9-4192-89b9-b95020af4cb9 req-47c31aad-3445-4094-9048-0c98855b59a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088208 Oct 11 04:12:42.931512 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 294/606] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:42.937910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1974399e-b4c2-4524-860f-508a7495dabb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:42.942686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1974399e-b4c2-4524-860f-508a7495dabb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:42.958013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1974399e-b4c2-4524-860f-508a7495dabb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:42.961770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1974399e-b4c2-4524-860f-508a7495dabb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:42.962277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1974399e-b4c2-4524-860f-508a7495dabb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:42.963026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1974399e-b4c2-4524-860f-508a7495dabb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:42.963491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1974399e-b4c2-4524-860f-508a7495dabb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:42.964173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1974399e-b4c2-4524-860f-508a7495dabb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:42.967015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-67bedab0-2fd8-47da-b888-78d01dec6b1a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:42.975379 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-67bedab0-2fd8-47da-b888-78d01dec6b1a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1240 microversion: 2.1 time: 0.218650 Oct 11 04:12:42.977824 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 313/607] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:42 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1240 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:42.982692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:42.994382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:43.006461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:43.006966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:43.007674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:43.008374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:43.008826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:43.009251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:43.129948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1974399e-b4c2-4524-860f-508a7495dabb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:43.143394 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1974399e-b4c2-4524-860f-508a7495dabb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1324 microversion: 2.1 time: 0.210464 Oct 11 04:12:43.144318 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 295/608] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:42 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1324 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:43.149009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b37d88e2-d19d-496a-b20c-5361dc218d98 tempest-SecurityGroupsTestAdminJSON-223212455 tempest-SecurityGroupsTestAdminJSON-223212455-project] Calling method '.version_select at 0x7fda1a1b9af0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:43.330854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:43.357067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:43.362228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:43.362228 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae6db7d2-dd1e-49c7-9656-2cb2764531da tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] 10.222.0.26 "GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09" status: 200 len: 1360 microversion: 2.47 time: 0.382408 Oct 11 04:12:43.363058 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 314/609] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:12:42 2022] GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09 => generated 1360 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:12:43.369525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a7781676-128c-4bd1-a910-ceef229785ac tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Calling method '.version_select at 0x7fda1a2e2160>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:43.434821 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a7781676-128c-4bd1-a910-ceef229785ac tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 37 microversion: 2.1 time: 0.070358 Oct 11 04:12:43.435792 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 315/610] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:12:43 2022] GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 37 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:43.447439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e7a7c3d5-84e8-402f-a4a8-3cde4bd3e6bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:43.448237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e7a7c3d5-84e8-402f-a4a8-3cde4bd3e6bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:43.456609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a7c3d5-84e8-402f-a4a8-3cde4bd3e6bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:43.457296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a7c3d5-84e8-402f-a4a8-3cde4bd3e6bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:43.457839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a7c3d5-84e8-402f-a4a8-3cde4bd3e6bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:43.458700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a7c3d5-84e8-402f-a4a8-3cde4bd3e6bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:43.459282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a7c3d5-84e8-402f-a4a8-3cde4bd3e6bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:43.459817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a7c3d5-84e8-402f-a4a8-3cde4bd3e6bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:43.664948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7a7c3d5-84e8-402f-a4a8-3cde4bd3e6bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:43.683619 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e7a7c3d5-84e8-402f-a4a8-3cde4bd3e6bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1311 microversion: 2.1 time: 0.236986 Oct 11 04:12:43.695780 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 316/611] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:43 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1311 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:43.711799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d1e3e57c-02a8-4f23-b223-e44b11d59d2f tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-1254190175"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:43.714455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d1e3e57c-02a8-4f23-b223-e44b11d59d2f tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:43.726006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e3e57c-02a8-4f23-b223-e44b11d59d2f tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:43.728802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e3e57c-02a8-4f23-b223-e44b11d59d2f tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:43.729519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e3e57c-02a8-4f23-b223-e44b11d59d2f tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:43.730237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e3e57c-02a8-4f23-b223-e44b11d59d2f tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:43.730726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e3e57c-02a8-4f23-b223-e44b11d59d2f tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:43.735058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e3e57c-02a8-4f23-b223-e44b11d59d2f tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:44.216388 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b37d88e2-d19d-496a-b20c-5361dc218d98 tempest-SecurityGroupsTestAdminJSON-223212455 tempest-SecurityGroupsTestAdminJSON-223212455-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/fb0ced35-b697-4f2e-bd93-7828a3241e3d" status: 202 len: 0 microversion: 2.1 time: 1.070896 Oct 11 04:12:44.218746 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 296/612] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:12:43 2022] DELETE /compute/v2.1/os-security-groups/fb0ced35-b697-4f2e-bd93-7828a3241e3d => generated 0 bytes in 1074 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:12:44.232225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cac68003-2813-4c0a-b5dc-8533793db7c6 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Action: 'update_all', calling method: .version_select at 0x7fda1a1adaf0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:44.363715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-cac68003-2813-4c0a-b5dc-8533793db7c6 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:44.403501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-cac68003-2813-4c0a-b5dc-8533793db7c6 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for user 1f321a9fa37a426aab12428b2f9ecd90 and project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:44.405074 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d1e3e57c-02a8-4f23-b223-e44b11d59d2f tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] 10.222.0.26 "POST /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09/action" status: 202 len: 52 microversion: 2.47 time: 0.705082 Oct 11 04:12:44.406322 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 317/613] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:12:43 2022] POST /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09/action => generated 52 bytes in 710 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Oct 11 04:12:44.423343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e317368e-a0d1-4186-80c7-3198420ec6f4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:44.424759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e317368e-a0d1-4186-80c7-3198420ec6f4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:44.437450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e317368e-a0d1-4186-80c7-3198420ec6f4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:44.438437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e317368e-a0d1-4186-80c7-3198420ec6f4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:44.442157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e317368e-a0d1-4186-80c7-3198420ec6f4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:44.443676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e317368e-a0d1-4186-80c7-3198420ec6f4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:44.446530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e317368e-a0d1-4186-80c7-3198420ec6f4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:44.447297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e317368e-a0d1-4186-80c7-3198420ec6f4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:44.605380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e317368e-a0d1-4186-80c7-3198420ec6f4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:44.614661 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e317368e-a0d1-4186-80c7-3198420ec6f4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1314 microversion: 2.1 time: 0.206854 Oct 11 04:12:44.633157 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 318/614] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:44 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:44.638033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d6746568-f09e-4e8f-a553-60f6f5a93202 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:44.655059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d6746568-f09e-4e8f-a553-60f6f5a93202 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:44.682550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6746568-f09e-4e8f-a553-60f6f5a93202 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:44.683116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6746568-f09e-4e8f-a553-60f6f5a93202 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:44.683565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6746568-f09e-4e8f-a553-60f6f5a93202 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:44.690959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6746568-f09e-4e8f-a553-60f6f5a93202 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:44.691444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6746568-f09e-4e8f-a553-60f6f5a93202 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:44.691885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6746568-f09e-4e8f-a553-60f6f5a93202 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:44.848843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d6746568-f09e-4e8f-a553-60f6f5a93202 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:44.862281 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d6746568-f09e-4e8f-a553-60f6f5a93202 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1322 microversion: 2.1 time: 0.227929 Oct 11 04:12:44.864844 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 319/615] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:44 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:44.873144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb29a8c5-c223-41b5-88c3-0f5150d21a11 tempest-SecurityGroupsTestAdminJSON-223212455 tempest-SecurityGroupsTestAdminJSON-223212455-project] Calling method '.version_select at 0x7fda1a2e2040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:44.976176 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cac68003-2813-4c0a-b5dc-8533793db7c6 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.756074 Oct 11 04:12:44.976921 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 297/616] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:12:44 2022] PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 61 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:44.981971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9bbe33b0-247e-4c4f-acc2-687c9c6ca77b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:44.982502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9bbe33b0-247e-4c4f-acc2-687c9c6ca77b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:44.990265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bbe33b0-247e-4c4f-acc2-687c9c6ca77b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:44.991295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bbe33b0-247e-4c4f-acc2-687c9c6ca77b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:44.992196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bbe33b0-247e-4c4f-acc2-687c9c6ca77b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:44.993233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bbe33b0-247e-4c4f-acc2-687c9c6ca77b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:44.994015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bbe33b0-247e-4c4f-acc2-687c9c6ca77b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:44.994956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bbe33b0-247e-4c4f-acc2-687c9c6ca77b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:45.025638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9bbe33b0-247e-4c4f-acc2-687c9c6ca77b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:12:45.302963 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb29a8c5-c223-41b5-88c3-0f5150d21a11 tempest-SecurityGroupsTestAdminJSON-223212455 tempest-SecurityGroupsTestAdminJSON-223212455-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/3e41966f-c30e-4165-b932-11c26317b51a" status: 202 len: 0 microversion: 2.1 time: 0.434750 Oct 11 04:12:45.305131 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 320/617] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:12:44 2022] DELETE /compute/v2.1/os-security-groups/3e41966f-c30e-4165-b932-11c26317b51a => generated 0 bytes in 437 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:12:45.313776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-75a6adc4-14a9-49d3-b396-3a5831de4a1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:45.314723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-75a6adc4-14a9-49d3-b396-3a5831de4a1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:45.329821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75a6adc4-14a9-49d3-b396-3a5831de4a1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:45.332719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75a6adc4-14a9-49d3-b396-3a5831de4a1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:45.333430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75a6adc4-14a9-49d3-b396-3a5831de4a1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:45.334619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75a6adc4-14a9-49d3-b396-3a5831de4a1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:45.335914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75a6adc4-14a9-49d3-b396-3a5831de4a1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:45.337835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75a6adc4-14a9-49d3-b396-3a5831de4a1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:45.483394 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9bbe33b0-247e-4c4f-acc2-687c9c6ca77b tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] 10.222.0.26 "DELETE /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09" status: 204 len: 0 microversion: 2.47 time: 0.505254 Oct 11 04:12:45.489021 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 298/618] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:12:44 2022] DELETE /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:12:45.497190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7fe0812a-9fcc-46aa-bf58-a5e90ab56096 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Calling method '.version_select at 0x7fda1a14f670>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:45.601460 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7fe0812a-9fcc-46aa-bf58-a5e90ab56096 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata/os_distro" status: 200 len: 33 microversion: 2.1 time: 0.110893 Oct 11 04:12:45.602314 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 299/619] 10.222.0.26 () {58 vars in 1290 bytes} [Tue Oct 11 04:12:45 2022] GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata/os_distro => generated 33 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:45.613481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:45.613481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:45.632538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:45.632713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:45.633104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:45.634756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:45.637109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:45.639132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:45.971118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-75a6adc4-14a9-49d3-b396-3a5831de4a1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:45.982240 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-75a6adc4-14a9-49d3-b396-3a5831de4a1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1311 microversion: 2.1 time: 0.675799 Oct 11 04:12:45.991052 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 321/620] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:45 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1311 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:46.001918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56f8f8de-1758-4797-8171-5c59048fec90 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Action: 'update_all', calling method: .version_select at 0x7fda1a50e670>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:46.093063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-56f8f8de-1758-4797-8171-5c59048fec90 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:46.102438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-56f8f8de-1758-4797-8171-5c59048fec90 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for user 1f321a9fa37a426aab12428b2f9ecd90 and project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:46.229373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:46.484341 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-56f8f8de-1758-4797-8171-5c59048fec90 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.491163 Oct 11 04:12:46.484866 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 322/621] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:12:45 2022] PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 61 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:46.491384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0480017b-94bc-4815-9d5f-4896d3fa545b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:46.492227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0480017b-94bc-4815-9d5f-4896d3fa545b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:46.521214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0480017b-94bc-4815-9d5f-4896d3fa545b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:46.523909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0480017b-94bc-4815-9d5f-4896d3fa545b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:46.525781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0480017b-94bc-4815-9d5f-4896d3fa545b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:46.526893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0480017b-94bc-4815-9d5f-4896d3fa545b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:46.535671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0480017b-94bc-4815-9d5f-4896d3fa545b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:46.536556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0480017b-94bc-4815-9d5f-4896d3fa545b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:46.604552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:46.624390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:46.632556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:46.640046 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-816e254f-97ea-4b0d-8f92-f9ee955ed3cc tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] 10.222.0.26 "GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09" status: 200 len: 1366 microversion: 2.47 time: 1.035009 Oct 11 04:12:46.643278 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 300/622] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:12:45 2022] GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09 => generated 1366 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:12:46.663772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-15c14f20-7e8e-4cdc-903c-9d8ace570e08 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:46.665788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-15c14f20-7e8e-4cdc-903c-9d8ace570e08 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:46.691512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15c14f20-7e8e-4cdc-903c-9d8ace570e08 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:46.692029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15c14f20-7e8e-4cdc-903c-9d8ace570e08 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:46.694092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15c14f20-7e8e-4cdc-903c-9d8ace570e08 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:46.696644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15c14f20-7e8e-4cdc-903c-9d8ace570e08 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:46.698340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15c14f20-7e8e-4cdc-903c-9d8ace570e08 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:46.698651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15c14f20-7e8e-4cdc-903c-9d8ace570e08 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:47.013488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0480017b-94bc-4815-9d5f-4896d3fa545b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:47.045816 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0480017b-94bc-4815-9d5f-4896d3fa545b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1302 microversion: 2.1 time: 0.557234 Oct 11 04:12:47.047947 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 323/623] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:46 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1302 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:47.063890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-51877a56-065a-4c80-a377-60fc6c9a7494 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Calling method '.version_select at 0x7fda1a3155e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:47.851428 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-51877a56-065a-4c80-a377-60fc6c9a7494 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.801196 Oct 11 04:12:47.852367 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 324/624] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:12:47 2022] GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 61 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:47.860427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-62fb4e57-4076-4788-8172-fe19845efb81 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:47.876575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-62fb4e57-4076-4788-8172-fe19845efb81 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:47.906440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62fb4e57-4076-4788-8172-fe19845efb81 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:47.910022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62fb4e57-4076-4788-8172-fe19845efb81 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:47.913435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62fb4e57-4076-4788-8172-fe19845efb81 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:47.914440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62fb4e57-4076-4788-8172-fe19845efb81 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:47.915084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62fb4e57-4076-4788-8172-fe19845efb81 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:47.916720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62fb4e57-4076-4788-8172-fe19845efb81 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:48.289551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-15c14f20-7e8e-4cdc-903c-9d8ace570e08 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:48.298943 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-15c14f20-7e8e-4cdc-903c-9d8ace570e08 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1389 microversion: 2.1 time: 1.653017 Oct 11 04:12:48.299544 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 301/625] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:46 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1389 bytes in 1654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:48.316495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:48.317398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:48.328623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:48.330713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:48.332023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:48.339277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:48.340147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:48.340801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:48.712189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:48.723786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:48.736209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:48.738230 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e8d5eb79-831d-4738-a605-9e21276de608 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] 10.222.0.26 "GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09" status: 200 len: 1366 microversion: 2.47 time: 0.431054 Oct 11 04:12:48.739499 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 302/626] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:12:48 2022] GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09 => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:12:48.776459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-411df5f5-b122-436e-9c57-768503518199 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Action: 'update_all', calling method: .version_select at 0x7fda1a19cee0>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:48.893202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:48.944692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-411df5f5-b122-436e-9c57-768503518199 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:48.965880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-411df5f5-b122-436e-9c57-768503518199 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for user 1f321a9fa37a426aab12428b2f9ecd90 and project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:49.214408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-62fb4e57-4076-4788-8172-fe19845efb81 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:49.237000 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-62fb4e57-4076-4788-8172-fe19845efb81 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1311 microversion: 2.1 time: 1.382831 Oct 11 04:12:49.244432 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 325/627] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:47 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1311 bytes in 1385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:49.258775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a26de98-511d-40c2-aab0-9b0630e10b9e tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:49.260089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a26de98-511d-40c2-aab0-9b0630e10b9e tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:49.281537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a26de98-511d-40c2-aab0-9b0630e10b9e tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:49.281537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a26de98-511d-40c2-aab0-9b0630e10b9e tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:49.283217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a26de98-511d-40c2-aab0-9b0630e10b9e tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:49.298456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a26de98-511d-40c2-aab0-9b0630e10b9e tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:49.300431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a26de98-511d-40c2-aab0-9b0630e10b9e tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:49.302801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a26de98-511d-40c2-aab0-9b0630e10b9e tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:49.432609 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-411df5f5-b122-436e-9c57-768503518199 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.685094 Oct 11 04:12:49.433898 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 303/628] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:12:48 2022] PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 61 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:49.442053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-02b817a8-2c67-4524-a8f1-60ab33b5da8c req-8ad26887-10ef-4620-a024-5610f5ccc5b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa356b6-3b84-4022-b47c-35239eaeb5c3", "name": "network-vif-plugged", "status": "completed", "tag": "c9c070fc-a59c-46ad-8b25-4293eab123bc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:49.481490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-02b817a8-2c67-4524-a8f1-60ab33b5da8c req-8ad26887-10ef-4620-a024-5610f5ccc5b9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:49.495030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-02b817a8-2c67-4524-a8f1-60ab33b5da8c req-8ad26887-10ef-4620-a024-5610f5ccc5b9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:49.505914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-02b817a8-2c67-4524-a8f1-60ab33b5da8c req-8ad26887-10ef-4620-a024-5610f5ccc5b9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:49.543755 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-02b817a8-2c67-4524-a8f1-60ab33b5da8c req-8ad26887-10ef-4620-a024-5610f5ccc5b9 service nova] Creating event network-vif-plugged:c9c070fc-a59c-46ad-8b25-4293eab123bc for instance afa356b6-3b84-4022-b47c-35239eaeb5c3 on n-h2-860892-1 Oct 11 04:12:49.564265 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-02b817a8-2c67-4524-a8f1-60ab33b5da8c req-8ad26887-10ef-4620-a024-5610f5ccc5b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.128742 Oct 11 04:12:49.568917 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 304/629] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:49.587374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e26ff82e-a284-4d38-9492-da9d280e1e3a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:49.588470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e26ff82e-a284-4d38-9492-da9d280e1e3a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:49.625704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e26ff82e-a284-4d38-9492-da9d280e1e3a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:49.627337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e26ff82e-a284-4d38-9492-da9d280e1e3a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:49.628329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e26ff82e-a284-4d38-9492-da9d280e1e3a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:49.630529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e26ff82e-a284-4d38-9492-da9d280e1e3a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:49.632524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e26ff82e-a284-4d38-9492-da9d280e1e3a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:49.633725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e26ff82e-a284-4d38-9492-da9d280e1e3a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:49.673366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a26de98-511d-40c2-aab0-9b0630e10b9e tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:49.682875 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a26de98-511d-40c2-aab0-9b0630e10b9e tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1302 microversion: 2.1 time: 0.438675 Oct 11 04:12:49.697274 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 326/630] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:49 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1302 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:49.705184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ffb04faf-43a5-4320-95c4-012a1922006e tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Action: 'update_all', calling method: .version_select at 0x7fda1a2694c0>, body: {"metadata": {"os_version": "value2", "architecture": "value3"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:49.816737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ffb04faf-43a5-4320-95c4-012a1922006e tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:49.827602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ffb04faf-43a5-4320-95c4-012a1922006e tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for user 1f321a9fa37a426aab12428b2f9ecd90 and project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:50.594819 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ffb04faf-43a5-4320-95c4-012a1922006e tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 64 microversion: 2.1 time: 0.906871 Oct 11 04:12:50.605163 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 327/631] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:12:49 2022] PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 64 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:50.605163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:50.605163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:50.658146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:50.660908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:50.661384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:50.662209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:50.662678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:50.672133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:50.748704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:50.864980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e26ff82e-a284-4d38-9492-da9d280e1e3a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:50.883007 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e26ff82e-a284-4d38-9492-da9d280e1e3a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1389 microversion: 2.1 time: 1.312492 Oct 11 04:12:50.888925 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 305/632] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:49 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1389 bytes in 1319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:50.910813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-158d2e9f-88aa-4210-8f67-d01c3cbaa27a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:50.919311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-158d2e9f-88aa-4210-8f67-d01c3cbaa27a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:50.942577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-158d2e9f-88aa-4210-8f67-d01c3cbaa27a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:50.946309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-158d2e9f-88aa-4210-8f67-d01c3cbaa27a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:50.947245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-158d2e9f-88aa-4210-8f67-d01c3cbaa27a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:50.959497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-158d2e9f-88aa-4210-8f67-d01c3cbaa27a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:50.961204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-158d2e9f-88aa-4210-8f67-d01c3cbaa27a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:50.965976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-158d2e9f-88aa-4210-8f67-d01c3cbaa27a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:51.099230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:51.119833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:51.123900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67193d9dadd94d82a19feaaaa15c27ac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dd9092d3a57643b2b3bec9333a7e2651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:51.133870 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a639879-09b2-4a85-a9dd-36108f6ce07d tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] 10.222.0.26 "GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09" status: 200 len: 1366 microversion: 2.47 time: 0.529785 Oct 11 04:12:51.135492 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 328/633] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:12:50 2022] GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09 => generated 1366 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:12:51.158586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c94d1c0-5366-4352-9fb8-9f9d9c7887ca tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Calling method '.version_select at 0x7fda1a269c10>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:51.259349 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6c94d1c0-5366-4352-9fb8-9f9d9c7887ca tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 64 microversion: 2.1 time: 0.120351 Oct 11 04:12:51.259997 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 329/634] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:12:51 2022] GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 64 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:51.276102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1dfeeacd-b259-4ba4-837b-2a3905341ac2 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:51.279540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1dfeeacd-b259-4ba4-837b-2a3905341ac2 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:51.296581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dfeeacd-b259-4ba4-837b-2a3905341ac2 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:51.301715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dfeeacd-b259-4ba4-837b-2a3905341ac2 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:51.303566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dfeeacd-b259-4ba4-837b-2a3905341ac2 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:51.305971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dfeeacd-b259-4ba4-837b-2a3905341ac2 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:51.312850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dfeeacd-b259-4ba4-837b-2a3905341ac2 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:51.313707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dfeeacd-b259-4ba4-837b-2a3905341ac2 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:52.038042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-158d2e9f-88aa-4210-8f67-d01c3cbaa27a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:52.048189 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-158d2e9f-88aa-4210-8f67-d01c3cbaa27a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1311 microversion: 2.1 time: 1.157819 Oct 11 04:12:52.049021 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 306/635] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:50 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1311 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:52.054072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b5c13984-bca6-4f3d-bf09-86433c8082ce tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Action: 'update_all', calling method: .version_select at 0x7fda1a19ce50>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:52.160550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-b5c13984-bca6-4f3d-bf09-86433c8082ce tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:52.177777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-b5c13984-bca6-4f3d-bf09-86433c8082ce tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for user 1f321a9fa37a426aab12428b2f9ecd90 and project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:52.883815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1dfeeacd-b259-4ba4-837b-2a3905341ac2 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:52.899789 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1dfeeacd-b259-4ba4-837b-2a3905341ac2 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1369 microversion: 2.1 time: 1.630414 Oct 11 04:12:52.903218 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 330/636] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:51 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1369 bytes in 1635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:52.918305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b675311-2770-47b3-ba78-ad4dfbe8b2b9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:52.921451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b675311-2770-47b3-ba78-ad4dfbe8b2b9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:52.950221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b675311-2770-47b3-ba78-ad4dfbe8b2b9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:52.951122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b675311-2770-47b3-ba78-ad4dfbe8b2b9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:52.955511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b675311-2770-47b3-ba78-ad4dfbe8b2b9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:52.956881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b675311-2770-47b3-ba78-ad4dfbe8b2b9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:52.957562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b675311-2770-47b3-ba78-ad4dfbe8b2b9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:52.962204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b675311-2770-47b3-ba78-ad4dfbe8b2b9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:53.009015 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b5c13984-bca6-4f3d-bf09-86433c8082ce tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 61 microversion: 2.1 time: 0.958750 Oct 11 04:12:53.009960 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 307/637] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:12:52 2022] PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 61 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:53.020416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:53.021043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] [instance: 324ab939-ea4d-474b-b06e-5511b3fa5f09] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:53.035327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:53.035858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:53.036303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:53.037041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:53.037497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:53.037971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:53.073869 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] HTTP exception thrown: Instance 324ab939-ea4d-474b-b06e-5511b3fa5f09 could not be found. Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Request method failure captured: Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09 HTTP/1.1 Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO0xDiivmS0e2W-ECDTZ68kw_nUs_vIartlu6x-RnsQ27HmSQvL3dTyricqflkOmy73K_2RPqn6uMA0qD-qi9f9EoRP5T__F5tasuNpael8Ydia12mayvoBxzA9Ws3f27XeCoAtE0dokhXJtKO0XPt4K-acch2_UYvdYCTSFdioqUAc Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: dd9092d3a57643b2b3bec9333a7e2651 Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAaction247Test-2051212055 Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:12:53.081203 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dd9092d3a57643b2b3bec9333a7e2651"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dd9092d3a57643b2b3bec9333a7e2651"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dd9092d3a57643b2b3bec9333a7e2651"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dd9092d3a57643b2b3bec9333a7e2651"}]}] Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAaction247Test-2051212055 Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: dd9092d3a57643b2b3bec9333a7e2651 Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAaction247Test-2051212055 Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAaction247Test-2051212055-project Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 67193d9dadd94d82a19feaaaa15c27ac Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAaction247Test-2051212055-project Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 324ab939-ea4d-474b-b06e-5511b3fa5f09 could not be found. Oct 11 04:12:53.082834 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '324ab939-ea4d-474b-b06e-5511b3fa5f09'} Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 324ab939-ea4d-474b-b06e-5511b3fa5f09 could not be found. Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:12:53.083586 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 324ab939-ea4d-474b-b06e-5511b3fa5f09 could not be found. Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 324ab939-ea4d-474b-b06e-5511b3fa5f09 could not be found. Oct 11 04:12:53.084819 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:12:53.085998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] Returning 404 to user: Instance 324ab939-ea4d-474b-b06e-5511b3fa5f09 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:12:53.088456 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f31fb0c-e4e9-4222-bf9f-89e6d0021979 tempest-ServersAaction247Test-2051212055 tempest-ServersAaction247Test-2051212055-project] 10.222.0.26 "GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09" status: 404 len: 111 microversion: 2.47 time: 0.076953 Oct 11 04:12:53.092175 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 308/638] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:12:53 2022] GET /compute/v2.1/servers/324ab939-ea4d-474b-b06e-5511b3fa5f09 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:12:53.103032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-56063408-f0cb-4563-9207-4ac37543706b req-43210d4d-bd67-478d-b998-b7e0c0a1d674 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02cb0576-4cd8-443a-a6f1-3191ea67e719", "tag": "3af4d53e-787c-4da0-bedf-ead9361a4a86"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:53.124084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-56063408-f0cb-4563-9207-4ac37543706b req-43210d4d-bd67-478d-b998-b7e0c0a1d674 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:53.126819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-56063408-f0cb-4563-9207-4ac37543706b req-43210d4d-bd67-478d-b998-b7e0c0a1d674 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:53.129102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-56063408-f0cb-4563-9207-4ac37543706b req-43210d4d-bd67-478d-b998-b7e0c0a1d674 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:53.157565 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-56063408-f0cb-4563-9207-4ac37543706b req-43210d4d-bd67-478d-b998-b7e0c0a1d674 service nova] Creating event network-changed:3af4d53e-787c-4da0-bedf-ead9361a4a86 for instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 on n-h1-860892-1 Oct 11 04:12:53.188327 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-56063408-f0cb-4563-9207-4ac37543706b req-43210d4d-bd67-478d-b998-b7e0c0a1d674 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094716 Oct 11 04:12:53.192340 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 309/639] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:53.198112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8a6be55e-fbaa-48e9-bb77-d6e8c2c34f6b tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Action: 'update', calling method: .version_select at 0x7fda1a102c10>, body: {"meta": {"os_version": "alt"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:53.322583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8a6be55e-fbaa-48e9-bb77-d6e8c2c34f6b tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:53.327605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8a6be55e-fbaa-48e9-bb77-d6e8c2c34f6b tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for user 1f321a9fa37a426aab12428b2f9ecd90 and project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:53.400448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b675311-2770-47b3-ba78-ad4dfbe8b2b9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:53.426448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b675311-2770-47b3-ba78-ad4dfbe8b2b9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1389 microversion: 2.1 time: 0.507648 Oct 11 04:12:53.426990 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 331/640] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:52 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1389 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:53.446003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43cac159-5479-46dd-bca2-bb73b8616bb9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:53.459374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-43cac159-5479-46dd-bca2-bb73b8616bb9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:53.477025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43cac159-5479-46dd-bca2-bb73b8616bb9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:53.477599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43cac159-5479-46dd-bca2-bb73b8616bb9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:53.478028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43cac159-5479-46dd-bca2-bb73b8616bb9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:53.478781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43cac159-5479-46dd-bca2-bb73b8616bb9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:53.479283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43cac159-5479-46dd-bca2-bb73b8616bb9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:53.479776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43cac159-5479-46dd-bca2-bb73b8616bb9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:54.097587 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8a6be55e-fbaa-48e9-bb77-d6e8c2c34f6b tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata/os_version" status: 200 len: 31 microversion: 2.1 time: 0.903688 Oct 11 04:12:54.100231 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 310/641] 10.222.0.26 () {60 vars in 1313 bytes} [Tue Oct 11 04:12:53 2022] PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata/os_version => generated 31 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:54.103830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e7d5dc1d-cb8a-48a4-8736-226c0a47972a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:54.104571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e7d5dc1d-cb8a-48a4-8736-226c0a47972a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:54.113513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d5dc1d-cb8a-48a4-8736-226c0a47972a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:54.114645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d5dc1d-cb8a-48a4-8736-226c0a47972a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:54.115827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d5dc1d-cb8a-48a4-8736-226c0a47972a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:54.123233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d5dc1d-cb8a-48a4-8736-226c0a47972a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:54.123233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d5dc1d-cb8a-48a4-8736-226c0a47972a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:54.123233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d5dc1d-cb8a-48a4-8736-226c0a47972a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:54.398955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-43cac159-5479-46dd-bca2-bb73b8616bb9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:54.448489 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-43cac159-5479-46dd-bca2-bb73b8616bb9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1461 microversion: 2.1 time: 1.016150 Oct 11 04:12:54.448489 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 332/642] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:53 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1461 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:54.478796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e93a143e-9ff0-4454-a2ee-c5df15920582 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Calling method '.version_select at 0x7fda1a2f1700>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:54.574291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e7d5dc1d-cb8a-48a4-8736-226c0a47972a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:54.575965 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e93a143e-9ff0-4454-a2ee-c5df15920582 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 58 microversion: 2.1 time: 0.129942 Oct 11 04:12:54.576928 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 333/643] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:12:54 2022] GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 58 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:54.587845 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e7d5dc1d-cb8a-48a4-8736-226c0a47972a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1369 microversion: 2.1 time: 0.488460 Oct 11 04:12:54.592173 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 311/644] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:54 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1369 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:54.600435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-300f2b86-bec2-4b14-93ef-73f4a2044dcc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:54.600656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:54.604104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:54.609406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-300f2b86-bec2-4b14-93ef-73f4a2044dcc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:54.624993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300f2b86-bec2-4b14-93ef-73f4a2044dcc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:54.625734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300f2b86-bec2-4b14-93ef-73f4a2044dcc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:54.626351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300f2b86-bec2-4b14-93ef-73f4a2044dcc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:54.627351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300f2b86-bec2-4b14-93ef-73f4a2044dcc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:54.627948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300f2b86-bec2-4b14-93ef-73f4a2044dcc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:54.628519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300f2b86-bec2-4b14-93ef-73f4a2044dcc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:54.634896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:54.638247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:54.652378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:54.652378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:54.652378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:54.652378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:54.914004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:54.919637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Old instance type m1.heat2, new instance type m1.heat {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 04:12:54.927873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:12:54.928295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:12:54.928818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:12:54.929231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:12:54.929633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:12:55.203157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-300f2b86-bec2-4b14-93ef-73f4a2044dcc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:55.233907 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-300f2b86-bec2-4b14-93ef-73f4a2044dcc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1389 microversion: 2.1 time: 0.655784 Oct 11 04:12:55.234964 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 334/645] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:54 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1389 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:55.246176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-83c4489d-5ef2-4b67-8c67-66da018c8ffa tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Action: 'update_all', calling method: .version_select at 0x7fda1a2e2940>, body: {"metadata": {"os_version": "value1", "os_distro": "value2"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:55.386546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=37 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:55.395566 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-71d76204-11fc-479a-80a2-6eeb4189c792 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "POST /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3/action" status: 202 len: 0 microversion: 2.1 time: 0.802028 Oct 11 04:12:55.407676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-83c4489d-5ef2-4b67-8c67-66da018c8ffa tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:55.410548 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 312/646] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:12:54 2022] POST /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3/action => generated 0 bytes in 817 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:12:55.423120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-acfc24d0-3c85-4c94-a8bf-f1e3dc70b1a3 req-bac9446f-f5f0-4195-9f05-8e9ad96ce63f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64baf484-344e-4c1d-861d-c1dff29896e0", "tag": "95c78ef0-fc25-4830-b08c-6f9ff2e60f95"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:55.425852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-83c4489d-5ef2-4b67-8c67-66da018c8ffa tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for user 1f321a9fa37a426aab12428b2f9ecd90 and project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:55.454103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-acfc24d0-3c85-4c94-a8bf-f1e3dc70b1a3 req-bac9446f-f5f0-4195-9f05-8e9ad96ce63f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:55.462009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-acfc24d0-3c85-4c94-a8bf-f1e3dc70b1a3 req-bac9446f-f5f0-4195-9f05-8e9ad96ce63f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:55.465244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-acfc24d0-3c85-4c94-a8bf-f1e3dc70b1a3 req-bac9446f-f5f0-4195-9f05-8e9ad96ce63f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:55.490671 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-acfc24d0-3c85-4c94-a8bf-f1e3dc70b1a3 req-bac9446f-f5f0-4195-9f05-8e9ad96ce63f service nova] Creating event network-changed:95c78ef0-fc25-4830-b08c-6f9ff2e60f95 for instance 64baf484-344e-4c1d-861d-c1dff29896e0 on n-h2-860892-1 Oct 11 04:12:55.500244 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-acfc24d0-3c85-4c94-a8bf-f1e3dc70b1a3 req-bac9446f-f5f0-4195-9f05-8e9ad96ce63f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088001 Oct 11 04:12:55.506042 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 313/647] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:12:55.518948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6c25a30-a18e-484a-9dd3-91c440fa562a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:55.520146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f6c25a30-a18e-484a-9dd3-91c440fa562a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:55.527434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6c25a30-a18e-484a-9dd3-91c440fa562a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:55.528279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6c25a30-a18e-484a-9dd3-91c440fa562a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:55.528902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6c25a30-a18e-484a-9dd3-91c440fa562a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:55.530840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6c25a30-a18e-484a-9dd3-91c440fa562a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:55.534125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6c25a30-a18e-484a-9dd3-91c440fa562a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:55.534860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6c25a30-a18e-484a-9dd3-91c440fa562a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:56.081767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f6c25a30-a18e-484a-9dd3-91c440fa562a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:56.120786 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f6c25a30-a18e-484a-9dd3-91c440fa562a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1470 microversion: 2.1 time: 0.612703 Oct 11 04:12:56.135115 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 314/648] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:55 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1470 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:56.145565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bade6596-27e5-4681-90e1-bb012091b94a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:56.171859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bade6596-27e5-4681-90e1-bb012091b94a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:56.191358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bade6596-27e5-4681-90e1-bb012091b94a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:56.191891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bade6596-27e5-4681-90e1-bb012091b94a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:56.192371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bade6596-27e5-4681-90e1-bb012091b94a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:56.193083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bade6596-27e5-4681-90e1-bb012091b94a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:56.193751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bade6596-27e5-4681-90e1-bb012091b94a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:56.194263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bade6596-27e5-4681-90e1-bb012091b94a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:56.280497 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-83c4489d-5ef2-4b67-8c67-66da018c8ffa tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 61 microversion: 2.1 time: 1.043807 Oct 11 04:12:56.281781 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 335/649] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:12:55 2022] PUT /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 61 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:56.287320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a2da436e-c702-4aa4-9447-0fb9d5d62fbb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:56.292868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a2da436e-c702-4aa4-9447-0fb9d5d62fbb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:56.302206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2da436e-c702-4aa4-9447-0fb9d5d62fbb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:56.307127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2da436e-c702-4aa4-9447-0fb9d5d62fbb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:56.307822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2da436e-c702-4aa4-9447-0fb9d5d62fbb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:56.309539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2da436e-c702-4aa4-9447-0fb9d5d62fbb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:56.310391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2da436e-c702-4aa4-9447-0fb9d5d62fbb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:56.312476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2da436e-c702-4aa4-9447-0fb9d5d62fbb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:56.536911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bade6596-27e5-4681-90e1-bb012091b94a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:56.552361 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bade6596-27e5-4681-90e1-bb012091b94a tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1369 microversion: 2.1 time: 0.412853 Oct 11 04:12:56.558595 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 315/650] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:56 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1369 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:56.569969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ae795ae-a6c8-4c5a-ab11-68274d088f21 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Action: 'create', calling method: .version_select at 0x7fda1a1ad8b0>, body: {"metadata": {"os_version": "alt1", "architecture": "value3"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:56.720643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-2ae795ae-a6c8-4c5a-ab11-68274d088f21 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:56.737438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-2ae795ae-a6c8-4c5a-ab11-68274d088f21 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Getting quotas for user 1f321a9fa37a426aab12428b2f9ecd90 and project f77758583a26489fb7cffaa7244b5dc7. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:57.640267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a2da436e-c702-4aa4-9447-0fb9d5d62fbb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:57.654631 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a2da436e-c702-4aa4-9447-0fb9d5d62fbb tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1389 microversion: 2.1 time: 1.371236 Oct 11 04:12:57.656261 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 336/651] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:56 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1389 bytes in 1374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:57.669424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5dcc8bca-9753-42a9-b3b1-20dceade1d30 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:57.670445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5dcc8bca-9753-42a9-b3b1-20dceade1d30 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:57.686527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5dcc8bca-9753-42a9-b3b1-20dceade1d30 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:57.687673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5dcc8bca-9753-42a9-b3b1-20dceade1d30 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:57.694766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5dcc8bca-9753-42a9-b3b1-20dceade1d30 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:57.695793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5dcc8bca-9753-42a9-b3b1-20dceade1d30 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:57.696283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5dcc8bca-9753-42a9-b3b1-20dceade1d30 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:57.696716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5dcc8bca-9753-42a9-b3b1-20dceade1d30 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:57.748940 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2ae795ae-a6c8-4c5a-ab11-68274d088f21 tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "POST /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 85 microversion: 2.1 time: 1.188910 Oct 11 04:12:57.749703 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 316/652] 10.222.0.26 () {60 vars in 1281 bytes} [Tue Oct 11 04:12:56 2022] POST /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 85 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:57.757822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7f79549d-30ea-410a-b1d7-8a09fb6d3191 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:57.758847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7f79549d-30ea-410a-b1d7-8a09fb6d3191 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:57.780855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f79549d-30ea-410a-b1d7-8a09fb6d3191 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:57.781358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f79549d-30ea-410a-b1d7-8a09fb6d3191 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:57.781805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f79549d-30ea-410a-b1d7-8a09fb6d3191 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:57.782556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f79549d-30ea-410a-b1d7-8a09fb6d3191 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:57.783054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f79549d-30ea-410a-b1d7-8a09fb6d3191 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:57.784494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f79549d-30ea-410a-b1d7-8a09fb6d3191 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:57.919221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:58.458908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7f79549d-30ea-410a-b1d7-8a09fb6d3191 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:58.458908 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7f79549d-30ea-410a-b1d7-8a09fb6d3191 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1369 microversion: 2.1 time: 0.648347 Oct 11 04:12:58.458908 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 317/653] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:57 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1369 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:58.546595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5dcc8bca-9753-42a9-b3b1-20dceade1d30 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:58.558033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1320455374", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:58.563879 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5dcc8bca-9753-42a9-b3b1-20dceade1d30 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1470 microversion: 2.1 time: 0.905822 Oct 11 04:12:58.566308 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 337/654] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:57 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1470 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:58.573266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d805ba6a-1659-45cb-8e4f-df615a5d7aba tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] Calling method '.version_select at 0x7fda1a309f70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:58.712084 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d805ba6a-1659-45cb-8e4f-df615a5d7aba tempest-ImagesMetadataTestJSON-1761689712 tempest-ImagesMetadataTestJSON-1761689712-project] 10.222.0.26 "GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata" status: 200 len: 85 microversion: 2.1 time: 0.144469 Oct 11 04:12:58.713202 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 338/655] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:12:58 2022] GET /compute/v2.1/images/028bc72d-2576-42c2-9986-21fc8dd221f9/metadata => generated 85 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:12:58.723840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-050db043-d22f-4ea9-9bee-78a4d137a4d5 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:58.725969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-050db043-d22f-4ea9-9bee-78a4d137a4d5 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:12:58.731277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:12:58.742206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-050db043-d22f-4ea9-9bee-78a4d137a4d5 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:58.743748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-050db043-d22f-4ea9-9bee-78a4d137a4d5 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:58.755196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-050db043-d22f-4ea9-9bee-78a4d137a4d5 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:58.757657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-050db043-d22f-4ea9-9bee-78a4d137a4d5 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:58.763678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-050db043-d22f-4ea9-9bee-78a4d137a4d5 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:58.767623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-050db043-d22f-4ea9-9bee-78a4d137a4d5 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:59.256564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-050db043-d22f-4ea9-9bee-78a4d137a4d5 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:12:59.269479 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-050db043-d22f-4ea9-9bee-78a4d137a4d5 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1389 microversion: 2.1 time: 0.554957 Oct 11 04:12:59.275264 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 339/656] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:58 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1389 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:12:59.559234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:12:59.559783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:12:59.560602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:12:59.561099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:12:59.561607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:12:59.588837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:59.590019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:59.591553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:59.592435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:12:59.596123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:12:59.596722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:12:59.671440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Getting quotas for project 3a6a41baf5e342e595051a329ba6ea18. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:12:59.675831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:12:59.677126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Getting quotas for user 748ffa73f06244f3a8f2b14f81f486e0 and project 3a6a41baf5e342e595051a329ba6ea18. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:12:59.709560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:12:59.719774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:12:59.773599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1498495747", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "89a2a2aa-9a7e-4acc-b86b-af482eea703c"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:12:59.978173 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8cdb4b49-7681-4bce-b443-7be03651ab7c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548352 Oct 11 04:12:59.980687 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 318/657] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:12:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1578 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:12:59.985753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fdcc9483-ad5c-4734-8f77-568949f1a1dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:12:59.986415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fdcc9483-ad5c-4734-8f77-568949f1a1dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:00.066125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdcc9483-ad5c-4734-8f77-568949f1a1dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:00.066882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdcc9483-ad5c-4734-8f77-568949f1a1dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:00.067347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdcc9483-ad5c-4734-8f77-568949f1a1dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:00.068105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdcc9483-ad5c-4734-8f77-568949f1a1dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:00.069898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdcc9483-ad5c-4734-8f77-568949f1a1dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:00.071532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdcc9483-ad5c-4734-8f77-568949f1a1dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:00.451140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fdcc9483-ad5c-4734-8f77-568949f1a1dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:00.467442 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fdcc9483-ad5c-4734-8f77-568949f1a1dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1369 microversion: 2.1 time: 0.484384 Oct 11 04:13:00.470550 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 319/658] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:12:59 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1369 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:00.485181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b5d3e1f3-d8a5-46d0-a3e9-643e1436cb6f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:00.485181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b5d3e1f3-d8a5-46d0-a3e9-643e1436cb6f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:00.536446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5d3e1f3-d8a5-46d0-a3e9-643e1436cb6f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:00.539687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5d3e1f3-d8a5-46d0-a3e9-643e1436cb6f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:00.542470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5d3e1f3-d8a5-46d0-a3e9-643e1436cb6f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:00.546370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5d3e1f3-d8a5-46d0-a3e9-643e1436cb6f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:00.546877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5d3e1f3-d8a5-46d0-a3e9-643e1436cb6f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:00.547310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5d3e1f3-d8a5-46d0-a3e9-643e1436cb6f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:00.743035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] validate_networks() for [('89a2a2aa-9a7e-4acc-b86b-af482eea703c', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:13:01.053470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b5d3e1f3-d8a5-46d0-a3e9-643e1436cb6f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:01.062153 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b5d3e1f3-d8a5-46d0-a3e9-643e1436cb6f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1470 microversion: 2.1 time: 0.588474 Oct 11 04:13:01.062757 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 320/659] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:00 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1470 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:01.071658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9639048-9b73-4a55-8713-5204d275d16a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:01.072936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e9639048-9b73-4a55-8713-5204d275d16a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:01.079652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9639048-9b73-4a55-8713-5204d275d16a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:01.080489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9639048-9b73-4a55-8713-5204d275d16a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:01.081103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9639048-9b73-4a55-8713-5204d275d16a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:01.081961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9639048-9b73-4a55-8713-5204d275d16a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:01.082735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9639048-9b73-4a55-8713-5204d275d16a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:01.083309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9639048-9b73-4a55-8713-5204d275d16a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:01.364437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9639048-9b73-4a55-8713-5204d275d16a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:01.383350 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9639048-9b73-4a55-8713-5204d275d16a tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1389 microversion: 2.1 time: 0.316506 Oct 11 04:13:01.383933 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 321/660] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:01 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1389 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:01.399115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-1291111705", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:01.498427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:13:01.990699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:13:01.991689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:13:01.992394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:13:01.993021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:13:01.993656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:13:02.012142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=37 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:02.015450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:02.016154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:02.020249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:02.022356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:02.023805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:02.030972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:02.055760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Getting quotas for project 3a6a41baf5e342e595051a329ba6ea18. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:13:02.060887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Getting quotas for user 748ffa73f06244f3a8f2b14f81f486e0 and project 3a6a41baf5e342e595051a329ba6ea18. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:13:02.085482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:13:02.088482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:13:02.249415 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-720d2f61-58cb-4a0c-b0a6-d6040a957774 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.864418 Oct 11 04:13:02.258472 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 322/661] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:13:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 874 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:13:02.265024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce5ac1ff-6e32-4d96-855b-34a9387aa3ba tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:02.266155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce5ac1ff-6e32-4d96-855b-34a9387aa3ba tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:02.290432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce5ac1ff-6e32-4d96-855b-34a9387aa3ba tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:02.291527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce5ac1ff-6e32-4d96-855b-34a9387aa3ba tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:02.292548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce5ac1ff-6e32-4d96-855b-34a9387aa3ba tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:02.293301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce5ac1ff-6e32-4d96-855b-34a9387aa3ba tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:02.293754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce5ac1ff-6e32-4d96-855b-34a9387aa3ba tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:02.294178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce5ac1ff-6e32-4d96-855b-34a9387aa3ba tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:02.405448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:13:02.410415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:13:02.410415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:13:02.410415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:13:02.410415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:13:02.429901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:02.433437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:02.447740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:02.456583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:02.457266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:02.461302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:02.531240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Getting quotas for project daa8ad03685c4b59b3274fc6407c9eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:13:02.543281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Getting quotas for user 917dab915f7d4303989abb47a33f47df and project daa8ad03685c4b59b3274fc6407c9eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:13:02.572266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:13:02.579130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:13:02.654687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce5ac1ff-6e32-4d96-855b-34a9387aa3ba tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:02.668902 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce5ac1ff-6e32-4d96-855b-34a9387aa3ba tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1369 microversion: 2.1 time: 0.408397 Oct 11 04:13:02.684502 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 323/662] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:02 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1369 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:02.684502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aa1a2916-bd8b-46be-b80e-d60b8c75d8b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:02.684502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aa1a2916-bd8b-46be-b80e-d60b8c75d8b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:02.692029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa1a2916-bd8b-46be-b80e-d60b8c75d8b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:02.692584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa1a2916-bd8b-46be-b80e-d60b8c75d8b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:02.693027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa1a2916-bd8b-46be-b80e-d60b8c75d8b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:02.693733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa1a2916-bd8b-46be-b80e-d60b8c75d8b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:02.694235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa1a2916-bd8b-46be-b80e-d60b8c75d8b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:02.697760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa1a2916-bd8b-46be-b80e-d60b8c75d8b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:02.813234 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-136dd2c4-1c4b-44d7-964a-62d9a42c445e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 3.462037 Oct 11 04:13:02.816380 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 340/663] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:12:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 3465 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:13:02.828262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b6591b91-e0d1-4f9c-bb26-dbe6354e799d req-20ef1d7b-de89-499d-8797-8ebef8af8d0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02cb0576-4cd8-443a-a6f1-3191ea67e719", "name": "network-vif-plugged", "status": "completed", "tag": "3af4d53e-787c-4da0-bedf-ead9361a4a86"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:02.840447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:02.843662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6591b91-e0d1-4f9c-bb26-dbe6354e799d req-20ef1d7b-de89-499d-8797-8ebef8af8d0f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:02.844466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6591b91-e0d1-4f9c-bb26-dbe6354e799d req-20ef1d7b-de89-499d-8797-8ebef8af8d0f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:02.845064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6591b91-e0d1-4f9c-bb26-dbe6354e799d req-20ef1d7b-de89-499d-8797-8ebef8af8d0f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:02.908065 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b6591b91-e0d1-4f9c-bb26-dbe6354e799d req-20ef1d7b-de89-499d-8797-8ebef8af8d0f service nova] Creating event network-vif-plugged:3af4d53e-787c-4da0-bedf-ead9361a4a86 for instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 on n-h1-860892-1 Oct 11 04:13:02.913705 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b6591b91-e0d1-4f9c-bb26-dbe6354e799d req-20ef1d7b-de89-499d-8797-8ebef8af8d0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096138 Oct 11 04:13:02.918917 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 341/664] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:02.942847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-55aa7990-3d28-45a4-afc5-75944820ed06 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:02.943936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-55aa7990-3d28-45a4-afc5-75944820ed06 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:03.304245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-55aa7990-3d28-45a4-afc5-75944820ed06 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:03.312850 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-55aa7990-3d28-45a4-afc5-75944820ed06 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1214 microversion: 2.1 time: 0.389491 Oct 11 04:13:03.314763 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 342/665] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:02 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1214 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:03.322490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-86f25e70-c35c-45c9-a447-c39e16f8d519 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:03.323119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-86f25e70-c35c-45c9-a447-c39e16f8d519 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:03.339737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f25e70-c35c-45c9-a447-c39e16f8d519 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:03.342173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f25e70-c35c-45c9-a447-c39e16f8d519 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:03.342892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f25e70-c35c-45c9-a447-c39e16f8d519 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:03.346302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f25e70-c35c-45c9-a447-c39e16f8d519 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:03.347119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f25e70-c35c-45c9-a447-c39e16f8d519 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:03.347699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f25e70-c35c-45c9-a447-c39e16f8d519 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:03.646854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-86f25e70-c35c-45c9-a447-c39e16f8d519 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:03.659443 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-86f25e70-c35c-45c9-a447-c39e16f8d519 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1389 microversion: 2.1 time: 0.343569 Oct 11 04:13:03.692522 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 343/666] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:03 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1389 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:03.697507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a5cbb4f-dc75-4b3e-b0ad-1e2a950fa84a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:03.698421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a5cbb4f-dc75-4b3e-b0ad-1e2a950fa84a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:03.946860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a5cbb4f-dc75-4b3e-b0ad-1e2a950fa84a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:03.958157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a5cbb4f-dc75-4b3e-b0ad-1e2a950fa84a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:03.973515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a5cbb4f-dc75-4b3e-b0ad-1e2a950fa84a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:03.986127 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a5cbb4f-dc75-4b3e-b0ad-1e2a950fa84a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1262 microversion: 2.25 time: 0.290397 Oct 11 04:13:03.987012 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 344/667] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:03 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1262 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:04.001351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40543536-4347-4136-bd23-43c2976dbba0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:04.012919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-40543536-4347-4136-bd23-43c2976dbba0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:04.037756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40543536-4347-4136-bd23-43c2976dbba0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:04.038485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40543536-4347-4136-bd23-43c2976dbba0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:04.039109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40543536-4347-4136-bd23-43c2976dbba0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:04.039973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40543536-4347-4136-bd23-43c2976dbba0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:04.040997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40543536-4347-4136-bd23-43c2976dbba0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:04.041583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40543536-4347-4136-bd23-43c2976dbba0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:04.168325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aa1a2916-bd8b-46be-b80e-d60b8c75d8b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:04.176054 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aa1a2916-bd8b-46be-b80e-d60b8c75d8b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1470 microversion: 2.1 time: 1.504923 Oct 11 04:13:04.190685 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 324/668] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:02 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1470 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:04.339408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-26111e27-a8ab-4df1-a305-56dd3f052074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:04.341027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-26111e27-a8ab-4df1-a305-56dd3f052074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:04.351495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26111e27-a8ab-4df1-a305-56dd3f052074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:04.352272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26111e27-a8ab-4df1-a305-56dd3f052074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:04.353163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26111e27-a8ab-4df1-a305-56dd3f052074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:04.354325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26111e27-a8ab-4df1-a305-56dd3f052074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:04.355083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26111e27-a8ab-4df1-a305-56dd3f052074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:04.356060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26111e27-a8ab-4df1-a305-56dd3f052074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:04.554089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-26111e27-a8ab-4df1-a305-56dd3f052074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:04.565334 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-26111e27-a8ab-4df1-a305-56dd3f052074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1218 microversion: 2.1 time: 0.231425 Oct 11 04:13:04.565510 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 325/669] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:04 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1218 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:04.687011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f31dd77-52fa-451b-bc9a-7fc60d295106 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:04.687987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2f31dd77-52fa-451b-bc9a-7fc60d295106 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:04.692490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40543536-4347-4136-bd23-43c2976dbba0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:04.709763 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40543536-4347-4136-bd23-43c2976dbba0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1369 microversion: 2.1 time: 0.718736 Oct 11 04:13:04.722827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f31dd77-52fa-451b-bc9a-7fc60d295106 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:04.725709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f31dd77-52fa-451b-bc9a-7fc60d295106 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:04.726381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f31dd77-52fa-451b-bc9a-7fc60d295106 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:04.727922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f31dd77-52fa-451b-bc9a-7fc60d295106 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:04.731684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f31dd77-52fa-451b-bc9a-7fc60d295106 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:04.732361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f31dd77-52fa-451b-bc9a-7fc60d295106 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:04.738717 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 345/670] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:03 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1369 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:05.016161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:05.016784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:05.032144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:05.035508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:05.036002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:05.038950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:05.041510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:05.041510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:05.171430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f31dd77-52fa-451b-bc9a-7fc60d295106 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:05.183270 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f31dd77-52fa-451b-bc9a-7fc60d295106 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1389 microversion: 2.1 time: 0.501790 Oct 11 04:13:05.183860 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 326/671] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:04 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1389 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:05.217252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-166af6bb-ec1b-46e3-a025-4eaa0f803930 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:05.217252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-166af6bb-ec1b-46e3-a025-4eaa0f803930 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:05.232249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-166af6bb-ec1b-46e3-a025-4eaa0f803930 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:05.232915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-166af6bb-ec1b-46e3-a025-4eaa0f803930 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:05.236701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-166af6bb-ec1b-46e3-a025-4eaa0f803930 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:05.237649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-166af6bb-ec1b-46e3-a025-4eaa0f803930 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:05.238303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-166af6bb-ec1b-46e3-a025-4eaa0f803930 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:05.238904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-166af6bb-ec1b-46e3-a025-4eaa0f803930 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:05.281309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:05.296077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:05.300212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:05.310498 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f7504d8d-2882-4e94-bc17-58a2d1758d51 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1266 microversion: 2.25 time: 0.292985 Oct 11 04:13:05.318285 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 346/672] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:05 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1266 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:05.599219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5085173f-e46d-47b1-ad80-8816f95f7d60 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:05.599961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5085173f-e46d-47b1-ad80-8816f95f7d60 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:05.632493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5085173f-e46d-47b1-ad80-8816f95f7d60 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:05.636350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5085173f-e46d-47b1-ad80-8816f95f7d60 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:05.641457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5085173f-e46d-47b1-ad80-8816f95f7d60 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:05.641457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5085173f-e46d-47b1-ad80-8816f95f7d60 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:05.641457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5085173f-e46d-47b1-ad80-8816f95f7d60 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:05.645003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5085173f-e46d-47b1-ad80-8816f95f7d60 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:05.656520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-166af6bb-ec1b-46e3-a025-4eaa0f803930 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:05.664740 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-166af6bb-ec1b-46e3-a025-4eaa0f803930 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.453228 Oct 11 04:13:05.673361 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 327/673] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:05 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:05.734633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-661480ae-db5e-4353-bc50-fc1ae9091b4f tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:05.735299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-661480ae-db5e-4353-bc50-fc1ae9091b4f tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:05.746582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-661480ae-db5e-4353-bc50-fc1ae9091b4f tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:05.747627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-661480ae-db5e-4353-bc50-fc1ae9091b4f tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:05.748227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-661480ae-db5e-4353-bc50-fc1ae9091b4f tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:05.749121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-661480ae-db5e-4353-bc50-fc1ae9091b4f tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:05.749587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-661480ae-db5e-4353-bc50-fc1ae9091b4f tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:05.750829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-661480ae-db5e-4353-bc50-fc1ae9091b4f tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:05.793150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5085173f-e46d-47b1-ad80-8816f95f7d60 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:05.804645 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5085173f-e46d-47b1-ad80-8816f95f7d60 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1266 microversion: 2.1 time: 0.218252 Oct 11 04:13:05.819903 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 347/674] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:05 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1266 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:06.103087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-661480ae-db5e-4353-bc50-fc1ae9091b4f tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:06.111643 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-661480ae-db5e-4353-bc50-fc1ae9091b4f tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1369 microversion: 2.1 time: 0.382291 Oct 11 04:13:06.117457 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 328/675] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:05 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1369 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:06.206176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ac322955-8b56-4568-8243-5b55c7ad345f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:06.206896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ac322955-8b56-4568-8243-5b55c7ad345f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:06.218506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac322955-8b56-4568-8243-5b55c7ad345f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:06.219199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac322955-8b56-4568-8243-5b55c7ad345f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:06.220072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac322955-8b56-4568-8243-5b55c7ad345f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:06.221011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac322955-8b56-4568-8243-5b55c7ad345f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:06.221864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac322955-8b56-4568-8243-5b55c7ad345f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:06.222652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac322955-8b56-4568-8243-5b55c7ad345f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:06.350525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c688814-affb-460c-9f2c-9643bee530b8 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Calling method '.version_select at 0x7fda1a309f70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:06.407547 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-6c688814-affb-460c-9f2c-9643bee530b8 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] HTTP exception thrown: Image not found. Oct 11 04:13:06.574433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ac322955-8b56-4568-8243-5b55c7ad345f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:06.589756 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ac322955-8b56-4568-8243-5b55c7ad345f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1587 microversion: 2.1 time: 0.387229 Oct 11 04:13:06.592673 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 329/676] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:06 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1587 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:06.602991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:06.604917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:06.623039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:06.624063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:06.624819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:06.625876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:06.626526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:06.627042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c688814-affb-460c-9f2c-9643bee530b8 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Request method failure captured: Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/images/457cde60-457a-4d88-862a-8a2ae73ff524/metadata/os_distro HTTP/1.1 Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO1R1857129L8j6y9GovUukC1pGEO8_dVzXLotvTfY1jZqy3GGDrryrTbB_Wjuw5kSt9NITJRoYQlFCYg36g2_Cm4tBASf9sBGzZIbqZi3_d0rAKhIfKUt84TS8qg6VLjB92fSQyqptPcMHraGAogHkrp7QQQwhSF1_q2xhzbMUmrK4 Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:13:06.694715 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d510701bc377498b998c497622ef5d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d510701bc377498b998c497622ef5d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}] Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0743071cd620410b98ad77bcedc83cac Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: exception: Image not found. Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'image_id': '457cde60-457a-4d88-862a-8a2ae73ff524', 'id': 'os_distro'} Oct 11 04:13:06.696124 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:06.697157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 457cde60-457a-4d88-862a-8a2ae73ff524 Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:06.773853 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 457cde60-457a-4d88-862a-8a2ae73ff524 could not be found. Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:13:06.775575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 125, in delete Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:13:06.777571 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.778714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:06.778815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c688814-affb-460c-9f2c-9643bee530b8 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Returning 404 to user: Image not found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:13:06.778815 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6c688814-affb-460c-9f2c-9643bee530b8 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] 10.222.0.26 "DELETE /compute/v2.1/images/457cde60-457a-4d88-862a-8a2ae73ff524/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.678860 Oct 11 04:13:06.778815 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 348/677] 10.222.0.26 () {58 vars in 1293 bytes} [Tue Oct 11 04:13:06 2022] DELETE /compute/v2.1/images/457cde60-457a-4d88-862a-8a2ae73ff524/metadata/os_distro => generated 62 bytes in 681 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 04:13:06.778815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1131902f-2338-4b18-9d86-1aefba80a61c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:06.778815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1131902f-2338-4b18-9d86-1aefba80a61c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:06.779209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:06.779209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:06.779209 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-efe4e25b-1063-41be-9c6d-429bcf5ee87d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1258 microversion: 2.25 time: 0.132494 Oct 11 04:13:06.779441 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 330/678] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:06 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1258 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:06.779521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1131902f-2338-4b18-9d86-1aefba80a61c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:06.779521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1131902f-2338-4b18-9d86-1aefba80a61c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:06.779521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1131902f-2338-4b18-9d86-1aefba80a61c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:06.779521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1131902f-2338-4b18-9d86-1aefba80a61c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:06.779799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1131902f-2338-4b18-9d86-1aefba80a61c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:06.779799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1131902f-2338-4b18-9d86-1aefba80a61c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:06.779950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fdbbcbb7-4124-4bbc-96a8-164bc850888a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:06.779950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fdbbcbb7-4124-4bbc-96a8-164bc850888a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:06.779950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbbcbb7-4124-4bbc-96a8-164bc850888a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:06.779950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbbcbb7-4124-4bbc-96a8-164bc850888a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:06.780217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbbcbb7-4124-4bbc-96a8-164bc850888a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:06.780217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbbcbb7-4124-4bbc-96a8-164bc850888a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:06.780217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbbcbb7-4124-4bbc-96a8-164bc850888a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:06.780217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbbcbb7-4124-4bbc-96a8-164bc850888a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:06.833020 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1131902f-2338-4b18-9d86-1aefba80a61c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116695 Oct 11 04:13:06.833617 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 349/679] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:13:06 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:06.838393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0fed5cb-dedc-4093-badf-11216c526ab3 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Calling method '.version_select at 0x7fda1a309790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:06.871383 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-c0fed5cb-dedc-4093-badf-11216c526ab3 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] HTTP exception thrown: Image not found. Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0fed5cb-dedc-4093-badf-11216c526ab3 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Request method failure captured: Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/images/d8e3118d-5eb3-4e23-9fdb-dd3f3416afa7/metadata/os_version HTTP/1.1 Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO1R1857129L8j6y9GovUukC1pGEO8_dVzXLotvTfY1jZqy3GGDrryrTbB_Wjuw5kSt9NITJRoYQlFCYg36g2_Cm4tBASf9sBGzZIbqZi3_d0rAKhIfKUt84TS8qg6VLjB92fSQyqptPcMHraGAogHkrp7QQQwhSF1_q2xhzbMUmrK4 Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:13:06.873465 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d510701bc377498b998c497622ef5d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d510701bc377498b998c497622ef5d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}] Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0743071cd620410b98ad77bcedc83cac Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: exception: Image not found. Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'image_id': 'd8e3118d-5eb3-4e23-9fdb-dd3f3416afa7', 'id': 'os_version'} Oct 11 04:13:06.874797 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:06.875569 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID d8e3118d-5eb3-4e23-9fdb-dd3f3416afa7 Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:06.876597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image d8e3118d-5eb3-4e23-9fdb-dd3f3416afa7 could not be found. Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:13:06.877723 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 58, in show Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.878971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0fed5cb-dedc-4093-badf-11216c526ab3 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Returning 404 to user: Image not found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:13:06.880411 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c0fed5cb-dedc-4093-badf-11216c526ab3 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] 10.222.0.26 "GET /compute/v2.1/images/d8e3118d-5eb3-4e23-9fdb-dd3f3416afa7/metadata/os_version" status: 404 len: 62 microversion: 2.1 time: 0.040035 Oct 11 04:13:06.880411 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 350/680] 10.222.0.26 () {58 vars in 1293 bytes} [Tue Oct 11 04:13:06 2022] GET /compute/v2.1/images/d8e3118d-5eb3-4e23-9fdb-dd3f3416afa7/metadata/os_version => generated 62 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:13:06.884721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fc1ad9d7-1145-4b5f-a35d-124e413a8855 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:06.888757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fc1ad9d7-1145-4b5f-a35d-124e413a8855 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:06.894021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1ad9d7-1145-4b5f-a35d-124e413a8855 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:06.894550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1ad9d7-1145-4b5f-a35d-124e413a8855 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:06.894991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1ad9d7-1145-4b5f-a35d-124e413a8855 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:06.895704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1ad9d7-1145-4b5f-a35d-124e413a8855 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:06.896159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1ad9d7-1145-4b5f-a35d-124e413a8855 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:06.896959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1ad9d7-1145-4b5f-a35d-124e413a8855 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:06.905112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fdbbcbb7-4124-4bbc-96a8-164bc850888a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:06.914133 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fdbbcbb7-4124-4bbc-96a8-164bc850888a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.185622 Oct 11 04:13:06.918236 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 331/681] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:06 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:06.919777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e130a91-f187-4ccd-84aa-85800ece3835 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Calling method '.version_select at 0x7fda19ff25e0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:06.945237 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-4e130a91-f187-4ccd-84aa-85800ece3835 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] HTTP exception thrown: Image not found. Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e130a91-f187-4ccd-84aa-85800ece3835 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Request method failure captured: Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/images/756f335b-358e-4f7d-b174-d47121635264/metadata HTTP/1.1 Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO1R1857129L8j6y9GovUukC1pGEO8_dVzXLotvTfY1jZqy3GGDrryrTbB_Wjuw5kSt9NITJRoYQlFCYg36g2_Cm4tBASf9sBGzZIbqZi3_d0rAKhIfKUt84TS8qg6VLjB92fSQyqptPcMHraGAogHkrp7QQQwhSF1_q2xhzbMUmrK4 Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:13:06.949659 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d510701bc377498b998c497622ef5d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d510701bc377498b998c497622ef5d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}] Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 0743071cd620410b98ad77bcedc83cac Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'image_id': '756f335b-358e-4f7d-b174-d47121635264'} Oct 11 04:13:06.951495 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:06.952371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 756f335b-358e-4f7d-b174-d47121635264 Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:06.953675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 756f335b-358e-4f7d-b174-d47121635264 could not be found. Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:13:06.955178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 51, in index Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi metadata = self._get_image(context, image_id)['properties'] Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.959204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e130a91-f187-4ccd-84aa-85800ece3835 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:13:06.960473 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4e130a91-f187-4ccd-84aa-85800ece3835 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] 10.222.0.26 "GET /compute/v2.1/images/756f335b-358e-4f7d-b174-d47121635264/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035539 Oct 11 04:13:06.960473 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 332/682] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:13:06 2022] GET /compute/v2.1/images/756f335b-358e-4f7d-b174-d47121635264/metadata => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:13:06.962947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e172e04b-1f2c-4e46-9390-b9eac5ac535e tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Action: 'update_all', calling method: .version_select at 0x7fda19f8d9d0>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:06.987722 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-e172e04b-1f2c-4e46-9390-b9eac5ac535e tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] HTTP exception thrown: Image not found. Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e172e04b-1f2c-4e46-9390-b9eac5ac535e tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Request method failure captured: Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: request: PUT /compute/v2.1/images/02ea02d8-a496-4bdc-8a3d-4de79ef754f7/metadata HTTP/1.1 Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 57 Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO1R1857129L8j6y9GovUukC1pGEO8_dVzXLotvTfY1jZqy3GGDrryrTbB_Wjuw5kSt9NITJRoYQlFCYg36g2_Cm4tBASf9sBGzZIbqZi3_d0rAKhIfKUt84TS8qg6VLjB92fSQyqptPcMHraGAogHkrp7QQQwhSF1_q2xhzbMUmrK4 Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:13:06.989848 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d510701bc377498b998c497622ef5d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d510701bc377498b998c497622ef5d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}] Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 0743071cd620410b98ad77bcedc83cac Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:13:06.991331 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'image_id': '02ea02d8-a496-4bdc-8a3d-4de79ef754f7', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:06.992227 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 02ea02d8-a496-4bdc-8a3d-4de79ef754f7 Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:06.993281 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 02ea02d8-a496-4bdc-8a3d-4de79ef754f7 could not be found. Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:13:06.994561 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 109, in update_all Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:13:06.995915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:06.997362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e172e04b-1f2c-4e46-9390-b9eac5ac535e tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:13:06.997362 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e172e04b-1f2c-4e46-9390-b9eac5ac535e tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] 10.222.0.26 "PUT /compute/v2.1/images/02ea02d8-a496-4bdc-8a3d-4de79ef754f7/metadata" status: 404 len: 62 microversion: 2.1 time: 0.035886 Oct 11 04:13:07.001355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 333/683] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:13:06 2022] PUT /compute/v2.1/images/02ea02d8-a496-4bdc-8a3d-4de79ef754f7/metadata => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 04:13:07.010165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-10450cfc-1acb-4439-a4a7-20e95d5fd20c tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Action: 'update', calling method: .version_select at 0x7fda19f8d040>, body: {"meta": {"os_distro": "alt"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:07.031646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fc1ad9d7-1145-4b5f-a35d-124e413a8855 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:07.044476 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-10450cfc-1acb-4439-a4a7-20e95d5fd20c tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] HTTP exception thrown: Image not found. Oct 11 04:13:07.045379 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fc1ad9d7-1145-4b5f-a35d-124e413a8855 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1266 microversion: 2.1 time: 0.168840 Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-10450cfc-1acb-4439-a4a7-20e95d5fd20c tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Request method failure captured: Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: request: PUT /compute/v2.1/images/ba80db19-31ed-4e9c-988c-0f98887f3712/metadata/os_distro HTTP/1.1 Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 30 Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO1R1857129L8j6y9GovUukC1pGEO8_dVzXLotvTfY1jZqy3GGDrryrTbB_Wjuw5kSt9NITJRoYQlFCYg36g2_Cm4tBASf9sBGzZIbqZi3_d0rAKhIfKUt84TS8qg6VLjB92fSQyqptPcMHraGAogHkrp7QQQwhSF1_q2xhzbMUmrK4 Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:13:07.052148 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d510701bc377498b998c497622ef5d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d510701bc377498b998c497622ef5d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}] Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 0743071cd620410b98ad77bcedc83cac Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: {"meta": {"os_distro": "alt"}} Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:13:07.053440 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'image_id': 'ba80db19-31ed-4e9c-988c-0f98887f3712', 'id': 'os_distro', 'body': {'meta': {'os_distro': 'alt'}}} Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:07.054285 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ba80db19-31ed-4e9c-988c-0f98887f3712 Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:07.055284 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ba80db19-31ed-4e9c-988c-0f98887f3712 could not be found. Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:13:07.056363 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 93, in update Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:13:07.057533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.059312 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 351/684] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:06 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:07.060150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-10450cfc-1acb-4439-a4a7-20e95d5fd20c tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:13:07.061045 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-10450cfc-1acb-4439-a4a7-20e95d5fd20c tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] 10.222.0.26 "PUT /compute/v2.1/images/ba80db19-31ed-4e9c-988c-0f98887f3712/metadata/os_distro" status: 404 len: 62 microversion: 2.1 time: 0.058212 Oct 11 04:13:07.061757 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 334/685] 10.222.0.26 () {60 vars in 1310 bytes} [Tue Oct 11 04:13:07 2022] PUT /compute/v2.1/images/ba80db19-31ed-4e9c-988c-0f98887f3712/metadata/os_distro => generated 62 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:13:07.072356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-acdb89e2-babf-4765-b4b5-31a092e3d785 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Action: 'create', calling method: .version_select at 0x7fda1a4f4a60>, body: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:07.098004 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-acdb89e2-babf-4765-b4b5-31a092e3d785 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] HTTP exception thrown: Image not found. Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-acdb89e2-babf-4765-b4b5-31a092e3d785 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Request method failure captured: Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/images/b4731e1e-7f79-43ce-a8eb-2146d8a9319a/metadata HTTP/1.1 Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 57 Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO1R1857129L8j6y9GovUukC1pGEO8_dVzXLotvTfY1jZqy3GGDrryrTbB_Wjuw5kSt9NITJRoYQlFCYg36g2_Cm4tBASf9sBGzZIbqZi3_d0rAKhIfKUt84TS8qg6VLjB92fSQyqptPcMHraGAogHkrp7QQQwhSF1_q2xhzbMUmrK4 Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:13:07.100304 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d510701bc377498b998c497622ef5d41"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d510701bc377498b998c497622ef5d41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d510701bc377498b998c497622ef5d41"}]}] Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d510701bc377498b998c497622ef5d41 Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325 Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0743071cd620410b98ad77bcedc83cac Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesMetadataNegativeTestJSON-1903811325-project Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: {"metadata": {"os_distro": "alt1", "os_version": "alt2"}} Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: exception: Image not found. Oct 11 04:13:07.101590 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'image_id': 'b4731e1e-7f79-43ce-a8eb-2146d8a9319a', 'body': {'metadata': {'os_distro': 'alt1', 'os_version': 'alt2'}}} Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:07.102456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b4731e1e-7f79-43ce-a8eb-2146d8a9319a Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 39, in _get_image Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.image_api.get(context, image_id) Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:07.103636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b4731e1e-7f79-43ce-a8eb-2146d8a9319a could not be found. Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:13:07.107287 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 69, in create Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi image = self._get_image(context, image_id) Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/image_metadata.py", line 44, in _get_image Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:13:07.108877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:13:07.112615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-acdb89e2-babf-4765-b4b5-31a092e3d785 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] Returning 404 to user: Image not found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:13:07.112615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-acdb89e2-babf-4765-b4b5-31a092e3d785 tempest-ImagesMetadataNegativeTestJSON-1903811325 tempest-ImagesMetadataNegativeTestJSON-1903811325-project] 10.222.0.26 "POST /compute/v2.1/images/b4731e1e-7f79-43ce-a8eb-2146d8a9319a/metadata" status: 404 len: 62 microversion: 2.1 time: 0.033362 Oct 11 04:13:07.112615 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 352/686] 10.222.0.26 () {60 vars in 1281 bytes} [Tue Oct 11 04:13:07 2022] POST /compute/v2.1/images/b4731e1e-7f79-43ce-a8eb-2146d8a9319a/metadata => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:13:07.143544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67788ffa-0c8b-4391-82f3-c00aebf8a4a7 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:07.144145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67788ffa-0c8b-4391-82f3-c00aebf8a4a7 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:07.167640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67788ffa-0c8b-4391-82f3-c00aebf8a4a7 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:07.171879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67788ffa-0c8b-4391-82f3-c00aebf8a4a7 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:07.172798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67788ffa-0c8b-4391-82f3-c00aebf8a4a7 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:07.175992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67788ffa-0c8b-4391-82f3-c00aebf8a4a7 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:07.176782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67788ffa-0c8b-4391-82f3-c00aebf8a4a7 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:07.179885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67788ffa-0c8b-4391-82f3-c00aebf8a4a7 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:07.530950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5504f870-4fc3-44e9-a4b5-95a011f4075c req-9d98d88c-44e8-4dd0-9803-26e597ef4e25 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64baf484-344e-4c1d-861d-c1dff29896e0", "name": "network-vif-plugged", "status": "completed", "tag": "95c78ef0-fc25-4830-b08c-6f9ff2e60f95"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:07.573400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5504f870-4fc3-44e9-a4b5-95a011f4075c req-9d98d88c-44e8-4dd0-9803-26e597ef4e25 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:07.573879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5504f870-4fc3-44e9-a4b5-95a011f4075c req-9d98d88c-44e8-4dd0-9803-26e597ef4e25 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:07.576625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5504f870-4fc3-44e9-a4b5-95a011f4075c req-9d98d88c-44e8-4dd0-9803-26e597ef4e25 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:07.630931 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5504f870-4fc3-44e9-a4b5-95a011f4075c req-9d98d88c-44e8-4dd0-9803-26e597ef4e25 service nova] Creating event network-vif-plugged:95c78ef0-fc25-4830-b08c-6f9ff2e60f95 for instance 64baf484-344e-4c1d-861d-c1dff29896e0 on n-h2-860892-1 Oct 11 04:13:07.654809 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5504f870-4fc3-44e9-a4b5-95a011f4075c req-9d98d88c-44e8-4dd0-9803-26e597ef4e25 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155082 Oct 11 04:13:07.661731 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 353/687] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:13:07.792222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:07.792927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:07.825442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:07.825935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:07.826406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:07.827111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:07.827564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:07.827985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:08.066019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:08.076610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-67788ffa-0c8b-4391-82f3-c00aebf8a4a7 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:08.078681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:08.086049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:08.087252 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9acca015-0f02-44e1-9995-6694595a9809 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1314 microversion: 2.25 time: 0.300269 Oct 11 04:13:08.097528 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 354/688] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:07 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:08.111333 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-67788ffa-0c8b-4391-82f3-c00aebf8a4a7 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1369 microversion: 2.1 time: 0.949113 Oct 11 04:13:08.111556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0f32827-bb47-47a7-89dd-b5b14fbe2ea1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:08.112042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c0f32827-bb47-47a7-89dd-b5b14fbe2ea1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:08.112730 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 335/689] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:07 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1369 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:08.117598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7dc48df-58d2-449c-a836-205d8558a9ca tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:08.118227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a7dc48df-58d2-449c-a836-205d8558a9ca tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:08.132496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7dc48df-58d2-449c-a836-205d8558a9ca tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:08.132990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7dc48df-58d2-449c-a836-205d8558a9ca tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:08.137199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7dc48df-58d2-449c-a836-205d8558a9ca tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:08.138557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7dc48df-58d2-449c-a836-205d8558a9ca tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:08.139181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7dc48df-58d2-449c-a836-205d8558a9ca tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:08.139758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7dc48df-58d2-449c-a836-205d8558a9ca tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:08.143974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f32827-bb47-47a7-89dd-b5b14fbe2ea1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:08.144442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f32827-bb47-47a7-89dd-b5b14fbe2ea1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:08.144878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f32827-bb47-47a7-89dd-b5b14fbe2ea1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:08.147268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f32827-bb47-47a7-89dd-b5b14fbe2ea1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:08.148366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f32827-bb47-47a7-89dd-b5b14fbe2ea1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:08.148962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f32827-bb47-47a7-89dd-b5b14fbe2ea1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:08.396149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a7dc48df-58d2-449c-a836-205d8558a9ca tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:08.412297 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a7dc48df-58d2-449c-a836-205d8558a9ca tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1284 microversion: 2.1 time: 0.298309 Oct 11 04:13:08.415336 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 336/690] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:08 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1284 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:08.794595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0f32827-bb47-47a7-89dd-b5b14fbe2ea1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:08.803130 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c0f32827-bb47-47a7-89dd-b5b14fbe2ea1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.704112 Oct 11 04:13:08.803739 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 355/691] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:08 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:09.119695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:09.120886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:09.127244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:09.128504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:09.129133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:09.130008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:09.130644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:09.131277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:09.140136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-09f0d3c7-08a3-4d8c-ac98-b9beefbcc571 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:09.141321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-09f0d3c7-08a3-4d8c-ac98-b9beefbcc571 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:09.159676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09f0d3c7-08a3-4d8c-ac98-b9beefbcc571 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:09.170317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09f0d3c7-08a3-4d8c-ac98-b9beefbcc571 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:09.170317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09f0d3c7-08a3-4d8c-ac98-b9beefbcc571 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:09.170317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09f0d3c7-08a3-4d8c-ac98-b9beefbcc571 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:09.170317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09f0d3c7-08a3-4d8c-ac98-b9beefbcc571 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:09.170681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09f0d3c7-08a3-4d8c-ac98-b9beefbcc571 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:09.237713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:09.359324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:09.375293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:09.377524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:09.379235 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b06c0d4-2bba-45b6-9671-d1e63bb155d3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1320 microversion: 2.25 time: 0.263783 Oct 11 04:13:09.380315 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 337/692] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:09 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1320 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:09.395798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-295208ec-5fe2-4793-a4c8-cd838e148903 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:09.396691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-295208ec-5fe2-4793-a4c8-cd838e148903 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:09.408102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295208ec-5fe2-4793-a4c8-cd838e148903 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:09.408597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295208ec-5fe2-4793-a4c8-cd838e148903 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:09.409034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295208ec-5fe2-4793-a4c8-cd838e148903 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:09.409889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295208ec-5fe2-4793-a4c8-cd838e148903 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:09.412545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295208ec-5fe2-4793-a4c8-cd838e148903 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:09.413501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295208ec-5fe2-4793-a4c8-cd838e148903 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:09.466483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:09.667877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-09f0d3c7-08a3-4d8c-ac98-b9beefbcc571 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:09.677728 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-09f0d3c7-08a3-4d8c-ac98-b9beefbcc571 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1369 microversion: 2.1 time: 0.541402 Oct 11 04:13:09.679279 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 356/693] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:09 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1369 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:09.685339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d1d73763-21a0-4ffd-8167-7df1586e7cae req-485dc1c7-6351-449b-b95b-8596358de8de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02cb0576-4cd8-443a-a6f1-3191ea67e719", "tag": "3af4d53e-787c-4da0-bedf-ead9361a4a86"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:09.699962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d1d73763-21a0-4ffd-8167-7df1586e7cae req-485dc1c7-6351-449b-b95b-8596358de8de service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:09.700572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d1d73763-21a0-4ffd-8167-7df1586e7cae req-485dc1c7-6351-449b-b95b-8596358de8de service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:09.702349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d1d73763-21a0-4ffd-8167-7df1586e7cae req-485dc1c7-6351-449b-b95b-8596358de8de service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:09.725264 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d1d73763-21a0-4ffd-8167-7df1586e7cae req-485dc1c7-6351-449b-b95b-8596358de8de service nova] Creating event network-changed:3af4d53e-787c-4da0-bedf-ead9361a4a86 for instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 on n-h1-860892-1 Oct 11 04:13:09.730398 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d1d73763-21a0-4ffd-8167-7df1586e7cae req-485dc1c7-6351-449b-b95b-8596358de8de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048515 Oct 11 04:13:09.731139 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 357/694] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:09.739317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-34298ab1-7eb4-4101-a20f-eeff9a1073a5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:09.740157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-34298ab1-7eb4-4101-a20f-eeff9a1073a5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:09.747039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34298ab1-7eb4-4101-a20f-eeff9a1073a5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:09.748977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34298ab1-7eb4-4101-a20f-eeff9a1073a5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:09.749510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34298ab1-7eb4-4101-a20f-eeff9a1073a5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:09.750744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34298ab1-7eb4-4101-a20f-eeff9a1073a5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:09.751400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34298ab1-7eb4-4101-a20f-eeff9a1073a5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:09.752034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34298ab1-7eb4-4101-a20f-eeff9a1073a5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:09.923132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-34298ab1-7eb4-4101-a20f-eeff9a1073a5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:09.946952 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-34298ab1-7eb4-4101-a20f-eeff9a1073a5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1272 microversion: 2.1 time: 0.214343 Oct 11 04:13:09.947539 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 358/695] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:09 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1272 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:09.954018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43f1e873-ba86-453b-a962-75044ad892ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:09.954862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-43f1e873-ba86-453b-a962-75044ad892ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:09.971027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-295208ec-5fe2-4793-a4c8-cd838e148903 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:09.973100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43f1e873-ba86-453b-a962-75044ad892ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:09.973973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43f1e873-ba86-453b-a962-75044ad892ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:09.974656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43f1e873-ba86-453b-a962-75044ad892ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:09.975747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43f1e873-ba86-453b-a962-75044ad892ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:09.978516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43f1e873-ba86-453b-a962-75044ad892ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:09.983321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43f1e873-ba86-453b-a962-75044ad892ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:10.002668 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-295208ec-5fe2-4793-a4c8-cd838e148903 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1587 microversion: 2.1 time: 0.621043 Oct 11 04:13:10.023740 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 338/696] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:09 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1587 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:10.409618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:10.409618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:10.419063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:10.419638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:10.419987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:10.420692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:10.421142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:10.424534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:10.507048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-43f1e873-ba86-453b-a962-75044ad892ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:10.516423 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-43f1e873-ba86-453b-a962-75044ad892ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.566956 Oct 11 04:13:10.531546 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 359/697] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:09 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:10.701577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cac0075b-1c01-41ef-a3d4-056533e2def4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:10.703125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cac0075b-1c01-41ef-a3d4-056533e2def4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:10.717495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac0075b-1c01-41ef-a3d4-056533e2def4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:10.717495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac0075b-1c01-41ef-a3d4-056533e2def4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:10.717495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac0075b-1c01-41ef-a3d4-056533e2def4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:10.717495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac0075b-1c01-41ef-a3d4-056533e2def4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:10.718306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac0075b-1c01-41ef-a3d4-056533e2def4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:10.718306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac0075b-1c01-41ef-a3d4-056533e2def4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:10.828215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:10.843070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:10.845908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:10.857536 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7b723b3b-c2bb-43d0-8317-e1f39ecf4a86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1320 microversion: 2.25 time: 0.444663 Oct 11 04:13:10.857536 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 339/698] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:10 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1320 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:10.976237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-910f60f2-bc27-4cc1-8cbe-a9307e46e018 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:10.978147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-910f60f2-bc27-4cc1-8cbe-a9307e46e018 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:10.989623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-910f60f2-bc27-4cc1-8cbe-a9307e46e018 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:10.990622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-910f60f2-bc27-4cc1-8cbe-a9307e46e018 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:10.991311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-910f60f2-bc27-4cc1-8cbe-a9307e46e018 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:10.992201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-910f60f2-bc27-4cc1-8cbe-a9307e46e018 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:10.992798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-910f60f2-bc27-4cc1-8cbe-a9307e46e018 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:10.993476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-910f60f2-bc27-4cc1-8cbe-a9307e46e018 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:11.090440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-910f60f2-bc27-4cc1-8cbe-a9307e46e018 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:11.099860 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-910f60f2-bc27-4cc1-8cbe-a9307e46e018 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1272 microversion: 2.1 time: 0.130247 Oct 11 04:13:11.100497 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 340/699] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:10 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1272 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:11.138736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cac0075b-1c01-41ef-a3d4-056533e2def4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:11.146546 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cac0075b-1c01-41ef-a3d4-056533e2def4 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1555 microversion: 2.1 time: 0.449433 Oct 11 04:13:11.147178 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 360/700] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:10 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1555 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:11.176992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df0d112d-3340-4c29-98cb-3e1e70a49151 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:11.177449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-df0d112d-3340-4c29-98cb-3e1e70a49151 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:11.184476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d112d-3340-4c29-98cb-3e1e70a49151 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:11.184968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d112d-3340-4c29-98cb-3e1e70a49151 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:11.185400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d112d-3340-4c29-98cb-3e1e70a49151 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:11.186302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d112d-3340-4c29-98cb-3e1e70a49151 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:11.186767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d112d-3340-4c29-98cb-3e1e70a49151 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:11.187187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d112d-3340-4c29-98cb-3e1e70a49151 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:11.426866 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df0d112d-3340-4c29-98cb-3e1e70a49151 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.253942 Oct 11 04:13:11.428504 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 341/701] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:13:11 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-interface => generated 284 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:11.541196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-51f99ac2-412e-483a-965c-1dcdd0b0b956 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:11.541838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-51f99ac2-412e-483a-965c-1dcdd0b0b956 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:11.548199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51f99ac2-412e-483a-965c-1dcdd0b0b956 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:11.548926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51f99ac2-412e-483a-965c-1dcdd0b0b956 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:11.549533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51f99ac2-412e-483a-965c-1dcdd0b0b956 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:11.550419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51f99ac2-412e-483a-965c-1dcdd0b0b956 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:11.551016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51f99ac2-412e-483a-965c-1dcdd0b0b956 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:11.552974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51f99ac2-412e-483a-965c-1dcdd0b0b956 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:11.889478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:11.890351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:11.911696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:11.913442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:11.916157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:11.917294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:11.917985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:11.919430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:11.929811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-51f99ac2-412e-483a-965c-1dcdd0b0b956 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:11.941202 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-51f99ac2-412e-483a-965c-1dcdd0b0b956 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.403800 Oct 11 04:13:11.943839 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 361/702] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:11 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:12.044333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:12.136677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d16bf43b-d594-4470-8977-de130855e5ee tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:12.137896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d16bf43b-d594-4470-8977-de130855e5ee tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:12.145179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d16bf43b-d594-4470-8977-de130855e5ee tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:12.145741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d16bf43b-d594-4470-8977-de130855e5ee tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:12.146283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d16bf43b-d594-4470-8977-de130855e5ee tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:12.147192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d16bf43b-d594-4470-8977-de130855e5ee tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:12.147828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d16bf43b-d594-4470-8977-de130855e5ee tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:12.148510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d16bf43b-d594-4470-8977-de130855e5ee tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:12.366720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d16bf43b-d594-4470-8977-de130855e5ee tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:12.375278 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d16bf43b-d594-4470-8977-de130855e5ee tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.242568 Oct 11 04:13:12.375857 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 362/703] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:12 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:12.499945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:12.533921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerTestJSON-server-17823650", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:12.612821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:13:12.643253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:12.661677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:12.663446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:12.664985 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-941a8100-ef22-4ca8-a1ce-06c59b4a36a8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.795874 Oct 11 04:13:12.667658 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 342/704] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:11 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:12.950575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:13:12.951141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:13:12.951793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:13:12.952720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:13:12.953884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:13:12.967681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:12.968948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:12.969671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:12.970750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:12.971447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:12.972093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:12.972538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bbee8997-eec1-44d9-99c3-918b3d6d3151 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:12.973343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bbee8997-eec1-44d9-99c3-918b3d6d3151 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:12.981776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbee8997-eec1-44d9-99c3-918b3d6d3151 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:12.982717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbee8997-eec1-44d9-99c3-918b3d6d3151 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:12.983600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbee8997-eec1-44d9-99c3-918b3d6d3151 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:12.984581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbee8997-eec1-44d9-99c3-918b3d6d3151 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:12.985214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbee8997-eec1-44d9-99c3-918b3d6d3151 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:12.985634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbee8997-eec1-44d9-99c3-918b3d6d3151 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:12.996395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Getting quotas for project d030baca29e8402896cdff2138cfcaab. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:13:13.003661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Getting quotas for user c3dfadbfcdca4f31b4a0e2d960298fa6 and project d030baca29e8402896cdff2138cfcaab. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:13:13.027577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:13:13.031054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:13:13.137637 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f6b930a-62ef-4080-b2ce-a7fc397a2790 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.760172 Oct 11 04:13:13.141952 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 363/705] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:13:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:13:13.157704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9cdee510-cf38-40ed-a3ac-31cf6d7fed8d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:13.158707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9cdee510-cf38-40ed-a3ac-31cf6d7fed8d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:13.278435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9cdee510-cf38-40ed-a3ac-31cf6d7fed8d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:13.286729 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9cdee510-cf38-40ed-a3ac-31cf6d7fed8d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1215 microversion: 2.1 time: 0.132873 Oct 11 04:13:13.301791 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 364/706] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:13 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1215 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:13.348400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=5 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:13.408474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e813d742-3eb6-4f8d-85bd-af9e4db4bf7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:13.409315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e813d742-3eb6-4f8d-85bd-af9e4db4bf7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:13.431079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e813d742-3eb6-4f8d-85bd-af9e4db4bf7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:13.434802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e813d742-3eb6-4f8d-85bd-af9e4db4bf7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:13.435367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e813d742-3eb6-4f8d-85bd-af9e4db4bf7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:13.436782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e813d742-3eb6-4f8d-85bd-af9e4db4bf7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:13.437358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e813d742-3eb6-4f8d-85bd-af9e4db4bf7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:13.445435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e813d742-3eb6-4f8d-85bd-af9e4db4bf7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:13.700099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e813d742-3eb6-4f8d-85bd-af9e4db4bf7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:13.713701 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e813d742-3eb6-4f8d-85bd-af9e4db4bf7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.318377 Oct 11 04:13:13.717115 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 365/707] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:13 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:13.721624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:13.722468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:13.734976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:13.735999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:13.736566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:13.737872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:13.738693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:13.739270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:13.793869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bbee8997-eec1-44d9-99c3-918b3d6d3151 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:13.805053 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bbee8997-eec1-44d9-99c3-918b3d6d3151 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.836995 Oct 11 04:13:13.820873 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 343/708] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:12 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:14.002481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:14.013265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:14.015350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:14.022378 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-971a45f5-dbca-418b-b28d-668fc8507123 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.299822 Oct 11 04:13:14.022378 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 366/709] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:13 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:14.314883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8828c0b8-c42c-4726-acb0-9a72d4a0986a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:14.315575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8828c0b8-c42c-4726-acb0-9a72d4a0986a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:14.415436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8828c0b8-c42c-4726-acb0-9a72d4a0986a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:14.422653 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8828c0b8-c42c-4726-acb0-9a72d4a0986a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1215 microversion: 2.1 time: 0.116926 Oct 11 04:13:14.436405 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 344/710] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:14 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1215 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:14.501215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c95f4d26-631c-42e6-8cce-ec56201315f5 req-bc38e29a-6a74-4e62-95c5-759b54e0fed6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97202407-f542-4189-9582-1f1dd698c594", "tag": "dc8db1bd-a8a8-4b23-8837-a7b82504853f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:14.514021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c95f4d26-631c-42e6-8cce-ec56201315f5 req-bc38e29a-6a74-4e62-95c5-759b54e0fed6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:14.515013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c95f4d26-631c-42e6-8cce-ec56201315f5 req-bc38e29a-6a74-4e62-95c5-759b54e0fed6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:14.515659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c95f4d26-631c-42e6-8cce-ec56201315f5 req-bc38e29a-6a74-4e62-95c5-759b54e0fed6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:14.541943 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c95f4d26-631c-42e6-8cce-ec56201315f5 req-bc38e29a-6a74-4e62-95c5-759b54e0fed6 service nova] Creating event network-changed:dc8db1bd-a8a8-4b23-8837-a7b82504853f for instance 97202407-f542-4189-9582-1f1dd698c594 on n-h1-860892-1 Oct 11 04:13:14.548567 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c95f4d26-631c-42e6-8cce-ec56201315f5 req-bc38e29a-6a74-4e62-95c5-759b54e0fed6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050819 Oct 11 04:13:14.549176 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 367/711] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:14.737404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4ee59a0-0c4f-4fdf-b2b2-06c53acbd722 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:14.738501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f4ee59a0-0c4f-4fdf-b2b2-06c53acbd722 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:14.744994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ee59a0-0c4f-4fdf-b2b2-06c53acbd722 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:14.745687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ee59a0-0c4f-4fdf-b2b2-06c53acbd722 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:14.746331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ee59a0-0c4f-4fdf-b2b2-06c53acbd722 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:14.753293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ee59a0-0c4f-4fdf-b2b2-06c53acbd722 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:14.753293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ee59a0-0c4f-4fdf-b2b2-06c53acbd722 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:14.753293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ee59a0-0c4f-4fdf-b2b2-06c53acbd722 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:14.829617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d9c3650-0038-4f7a-b9f1-489b934960a8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:14.830435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d9c3650-0038-4f7a-b9f1-489b934960a8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:14.841229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d9c3650-0038-4f7a-b9f1-489b934960a8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:14.844961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d9c3650-0038-4f7a-b9f1-489b934960a8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:14.844961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d9c3650-0038-4f7a-b9f1-489b934960a8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:14.844961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d9c3650-0038-4f7a-b9f1-489b934960a8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:14.844961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d9c3650-0038-4f7a-b9f1-489b934960a8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:14.845287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d9c3650-0038-4f7a-b9f1-489b934960a8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:15.109626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d9c3650-0038-4f7a-b9f1-489b934960a8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:15.118845 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d9c3650-0038-4f7a-b9f1-489b934960a8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.294180 Oct 11 04:13:15.122507 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 368/712] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:14 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:15.128453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:15.129254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:15.139301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:15.139301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:15.139301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:15.139301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:15.139672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:15.140420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:15.314116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:15.325019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:15.328174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:15.330027 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e2076a6f-b6ef-4139-a875-64ce6d6c6a8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.206154 Oct 11 04:13:15.331273 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 369/713] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:15 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:15.452994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-276cb60d-da41-4aae-afc3-75137f22853c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:15.453973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-276cb60d-da41-4aae-afc3-75137f22853c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:15.465000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-276cb60d-da41-4aae-afc3-75137f22853c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:15.467554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-276cb60d-da41-4aae-afc3-75137f22853c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:15.468174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-276cb60d-da41-4aae-afc3-75137f22853c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:15.470876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-276cb60d-da41-4aae-afc3-75137f22853c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:15.475036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-276cb60d-da41-4aae-afc3-75137f22853c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:15.475504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-276cb60d-da41-4aae-afc3-75137f22853c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:15.645454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-276cb60d-da41-4aae-afc3-75137f22853c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:15.658427 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-276cb60d-da41-4aae-afc3-75137f22853c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1267 microversion: 2.1 time: 0.209175 Oct 11 04:13:15.659587 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 370/714] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:15 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1267 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:15.776376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4ee59a0-0c4f-4fdf-b2b2-06c53acbd722 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:15.786163 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f4ee59a0-0c4f-4fdf-b2b2-06c53acbd722 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 1.052810 Oct 11 04:13:15.799403 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 345/715] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:14 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:16.147170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0db375ab-4bbf-47d0-8f8d-e0899f52a5c5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:16.147916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0db375ab-4bbf-47d0-8f8d-e0899f52a5c5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:16.157195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0db375ab-4bbf-47d0-8f8d-e0899f52a5c5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:16.159652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0db375ab-4bbf-47d0-8f8d-e0899f52a5c5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:16.160498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0db375ab-4bbf-47d0-8f8d-e0899f52a5c5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:16.161943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0db375ab-4bbf-47d0-8f8d-e0899f52a5c5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:16.166825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0db375ab-4bbf-47d0-8f8d-e0899f52a5c5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:16.167543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0db375ab-4bbf-47d0-8f8d-e0899f52a5c5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:16.356841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:16.357856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:16.364127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:16.371258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:16.372497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:16.372679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:16.373365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:16.374155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:16.880613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0db375ab-4bbf-47d0-8f8d-e0899f52a5c5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:16.899732 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0db375ab-4bbf-47d0-8f8d-e0899f52a5c5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.756810 Oct 11 04:13:16.907281 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 371/716] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:16 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:16.913266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-17bda786-4377-49d0-94fd-af58c2e41f41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:16.914284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-17bda786-4377-49d0-94fd-af58c2e41f41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:16.923226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17bda786-4377-49d0-94fd-af58c2e41f41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:16.924489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17bda786-4377-49d0-94fd-af58c2e41f41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:16.925508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17bda786-4377-49d0-94fd-af58c2e41f41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:16.926469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17bda786-4377-49d0-94fd-af58c2e41f41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:16.931649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17bda786-4377-49d0-94fd-af58c2e41f41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:16.932993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17bda786-4377-49d0-94fd-af58c2e41f41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:17.041384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-17bda786-4377-49d0-94fd-af58c2e41f41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:17.052517 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-17bda786-4377-49d0-94fd-af58c2e41f41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1285 microversion: 2.1 time: 0.143231 Oct 11 04:13:17.055688 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 372/717] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:16 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:17.060403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-ba8b253b-28c4-4155-ae60-4d875d087ea5 req-b147eaf9-3baf-40a4-a041-c2e596ef0741 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64baf484-344e-4c1d-861d-c1dff29896e0", "tag": "95c78ef0-fc25-4830-b08c-6f9ff2e60f95"}, {"name": "network-changed", "server_uuid": "721ec7b4-5d21-4da0-a478-d90bad272b94", "tag": "971a9abb-3c06-4885-970b-2a3b2e5b5ab8"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:17.073544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ba8b253b-28c4-4155-ae60-4d875d087ea5 req-b147eaf9-3baf-40a4-a041-c2e596ef0741 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:17.074409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ba8b253b-28c4-4155-ae60-4d875d087ea5 req-b147eaf9-3baf-40a4-a041-c2e596ef0741 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:17.075436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ba8b253b-28c4-4155-ae60-4d875d087ea5 req-b147eaf9-3baf-40a4-a041-c2e596ef0741 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:17.094460 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-ba8b253b-28c4-4155-ae60-4d875d087ea5 req-b147eaf9-3baf-40a4-a041-c2e596ef0741 service nova] Creating event network-changed:95c78ef0-fc25-4830-b08c-6f9ff2e60f95 for instance 64baf484-344e-4c1d-861d-c1dff29896e0 on n-h2-860892-1 Oct 11 04:13:17.095351 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-ba8b253b-28c4-4155-ae60-4d875d087ea5 req-b147eaf9-3baf-40a4-a041-c2e596ef0741 service nova] Creating event network-changed:971a9abb-3c06-4885-970b-2a3b2e5b5ab8 for instance 721ec7b4-5d21-4da0-a478-d90bad272b94 on n-h1-860892-1 Oct 11 04:13:17.104610 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-ba8b253b-28c4-4155-ae60-4d875d087ea5 req-b147eaf9-3baf-40a4-a041-c2e596ef0741 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.049136 Oct 11 04:13:17.105777 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 373/718] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:17.111574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea8738ee-a680-42a4-8a09-9636b3c9ed6d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:17.112851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea8738ee-a680-42a4-8a09-9636b3c9ed6d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:17.130092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8738ee-a680-42a4-8a09-9636b3c9ed6d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:17.130736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8738ee-a680-42a4-8a09-9636b3c9ed6d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:17.133083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8738ee-a680-42a4-8a09-9636b3c9ed6d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:17.133083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8738ee-a680-42a4-8a09-9636b3c9ed6d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:17.133083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8738ee-a680-42a4-8a09-9636b3c9ed6d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:17.133083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8738ee-a680-42a4-8a09-9636b3c9ed6d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:17.353566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:17.368886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:17.373071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:17.376775 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f69fe076-8582-4150-a828-58bc028a8853 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 1.024191 Oct 11 04:13:17.385562 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 346/719] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:16 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:17.404362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ea8738ee-a680-42a4-8a09-9636b3c9ed6d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:17.415495 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea8738ee-a680-42a4-8a09-9636b3c9ed6d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.307456 Oct 11 04:13:17.417030 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 374/720] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:17 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:17.924786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f51c7a2-689f-4e2c-b7e7-108c340991ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:17.925699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f51c7a2-689f-4e2c-b7e7-108c340991ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:17.934960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f51c7a2-689f-4e2c-b7e7-108c340991ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:17.937113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f51c7a2-689f-4e2c-b7e7-108c340991ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:17.940522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f51c7a2-689f-4e2c-b7e7-108c340991ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:17.941467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f51c7a2-689f-4e2c-b7e7-108c340991ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:17.941983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f51c7a2-689f-4e2c-b7e7-108c340991ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:17.942622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f51c7a2-689f-4e2c-b7e7-108c340991ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:18.086522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-45abc2b1-52b9-4f35-a33e-16b4c8a62631 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:18.087144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45abc2b1-52b9-4f35-a33e-16b4c8a62631 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:18.119957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45abc2b1-52b9-4f35-a33e-16b4c8a62631 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:18.120458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45abc2b1-52b9-4f35-a33e-16b4c8a62631 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:18.120898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45abc2b1-52b9-4f35-a33e-16b4c8a62631 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:18.121611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45abc2b1-52b9-4f35-a33e-16b4c8a62631 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:18.122062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45abc2b1-52b9-4f35-a33e-16b4c8a62631 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:18.122508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45abc2b1-52b9-4f35-a33e-16b4c8a62631 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:18.230247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45abc2b1-52b9-4f35-a33e-16b4c8a62631 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:18.238515 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-45abc2b1-52b9-4f35-a33e-16b4c8a62631 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1273 microversion: 2.1 time: 0.160824 Oct 11 04:13:18.239100 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 375/721] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:18 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1273 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:18.412664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:18.413545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:18.425670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:18.426668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:18.427267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:18.428160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:18.428847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:18.429679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:18.605855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:18.610409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:18.618365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:18.618365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:18.620240 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-746b93e0-80ee-4a57-899f-bbdfee004415 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.211887 Oct 11 04:13:18.635297 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 376/722] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:18 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:18.645283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-85bb918a-67cf-40e9-b1c0-0b0fe839116e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:18.645917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-85bb918a-67cf-40e9-b1c0-0b0fe839116e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:18.652725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bb918a-67cf-40e9-b1c0-0b0fe839116e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:18.653611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bb918a-67cf-40e9-b1c0-0b0fe839116e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:18.654053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bb918a-67cf-40e9-b1c0-0b0fe839116e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:18.655076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bb918a-67cf-40e9-b1c0-0b0fe839116e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:18.655949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bb918a-67cf-40e9-b1c0-0b0fe839116e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:18.656413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bb918a-67cf-40e9-b1c0-0b0fe839116e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:18.793552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f51c7a2-689f-4e2c-b7e7-108c340991ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:18.805124 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f51c7a2-689f-4e2c-b7e7-108c340991ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.883966 Oct 11 04:13:18.807330 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 347/723] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:17 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:18.835727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-85bb918a-67cf-40e9-b1c0-0b0fe839116e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:18.845479 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-85bb918a-67cf-40e9-b1c0-0b0fe839116e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.209006 Oct 11 04:13:18.846249 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 377/724] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:18 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:19.189430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e41b254c-6951-4c31-a135-02d417cd519d req-90664aa5-27ae-4a3c-8dbb-077e2eb25484 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63a565eb-1de8-4b6b-bd27-ba53e0d9a821", "tag": "4d8dc49c-bed9-4a3b-8d71-e5f1ed05cb39"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:19.200938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e41b254c-6951-4c31-a135-02d417cd519d req-90664aa5-27ae-4a3c-8dbb-077e2eb25484 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:19.201554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e41b254c-6951-4c31-a135-02d417cd519d req-90664aa5-27ae-4a3c-8dbb-077e2eb25484 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:19.202168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e41b254c-6951-4c31-a135-02d417cd519d req-90664aa5-27ae-4a3c-8dbb-077e2eb25484 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:19.216023 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e41b254c-6951-4c31-a135-02d417cd519d req-90664aa5-27ae-4a3c-8dbb-077e2eb25484 service nova] Creating event network-changed:4d8dc49c-bed9-4a3b-8d71-e5f1ed05cb39 for instance 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 on n-h1-860892-1 Oct 11 04:13:19.221617 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e41b254c-6951-4c31-a135-02d417cd519d req-90664aa5-27ae-4a3c-8dbb-077e2eb25484 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040103 Oct 11 04:13:19.222684 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 348/725] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:19.263353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82ae6d06-e1b5-46ac-9b08-5198bb49bd85 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:19.264304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82ae6d06-e1b5-46ac-9b08-5198bb49bd85 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:19.273585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82ae6d06-e1b5-46ac-9b08-5198bb49bd85 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:19.274114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82ae6d06-e1b5-46ac-9b08-5198bb49bd85 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:19.275008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82ae6d06-e1b5-46ac-9b08-5198bb49bd85 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:19.276312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82ae6d06-e1b5-46ac-9b08-5198bb49bd85 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:19.276815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82ae6d06-e1b5-46ac-9b08-5198bb49bd85 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:19.277229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82ae6d06-e1b5-46ac-9b08-5198bb49bd85 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:19.351491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82ae6d06-e1b5-46ac-9b08-5198bb49bd85 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:19.361964 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82ae6d06-e1b5-46ac-9b08-5198bb49bd85 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1273 microversion: 2.1 time: 0.103621 Oct 11 04:13:19.363269 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 378/726] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:19 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:19.653885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:19.655389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:19.670130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:19.670711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:19.671223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:19.672403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:19.672942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:19.673509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:19.829299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-28b08723-b62d-48c4-9378-539083bc0edd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:19.829914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-28b08723-b62d-48c4-9378-539083bc0edd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:19.835954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28b08723-b62d-48c4-9378-539083bc0edd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:19.836437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28b08723-b62d-48c4-9378-539083bc0edd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:19.836876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28b08723-b62d-48c4-9378-539083bc0edd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:19.837562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28b08723-b62d-48c4-9378-539083bc0edd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:19.838688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28b08723-b62d-48c4-9378-539083bc0edd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:19.839116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28b08723-b62d-48c4-9378-539083bc0edd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:19.988320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-28b08723-b62d-48c4-9378-539083bc0edd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:19.997852 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-28b08723-b62d-48c4-9378-539083bc0edd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.172483 Oct 11 04:13:20.011650 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 379/727] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:19 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:20.027888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f471b8d-2a15-459f-9b95-7ad472d1b074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:20.028523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f471b8d-2a15-459f-9b95-7ad472d1b074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:20.035719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f471b8d-2a15-459f-9b95-7ad472d1b074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:20.036208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f471b8d-2a15-459f-9b95-7ad472d1b074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:20.036637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f471b8d-2a15-459f-9b95-7ad472d1b074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:20.037372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f471b8d-2a15-459f-9b95-7ad472d1b074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:20.038265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f471b8d-2a15-459f-9b95-7ad472d1b074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:20.038732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f471b8d-2a15-459f-9b95-7ad472d1b074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:20.186895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2f471b8d-2a15-459f-9b95-7ad472d1b074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:20.192101 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f471b8d-2a15-459f-9b95-7ad472d1b074 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.179299 Oct 11 04:13:20.206410 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 380/728] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:20 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:20.251409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:20.260465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:20.261948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:20.263080 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ae328bb9-308c-4eca-ba8e-261f65a43d35 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.617654 Oct 11 04:13:20.263641 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 349/729] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:19 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:20.389592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1f05cd01-cfce-4c0b-a93b-49f41183c97a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:20.390467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1f05cd01-cfce-4c0b-a93b-49f41183c97a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:20.398804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f05cd01-cfce-4c0b-a93b-49f41183c97a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:20.400077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f05cd01-cfce-4c0b-a93b-49f41183c97a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:20.400705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f05cd01-cfce-4c0b-a93b-49f41183c97a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:20.401569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f05cd01-cfce-4c0b-a93b-49f41183c97a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:20.402178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f05cd01-cfce-4c0b-a93b-49f41183c97a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:20.402775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f05cd01-cfce-4c0b-a93b-49f41183c97a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:20.578716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1f05cd01-cfce-4c0b-a93b-49f41183c97a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:20.587062 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1f05cd01-cfce-4c0b-a93b-49f41183c97a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1315 microversion: 2.1 time: 0.203017 Oct 11 04:13:20.587855 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 381/730] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:20 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1315 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:21.025553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-89d33201-9d45-4036-b5ba-d794679c900c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:21.026533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-89d33201-9d45-4036-b5ba-d794679c900c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:21.032511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89d33201-9d45-4036-b5ba-d794679c900c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:21.034333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89d33201-9d45-4036-b5ba-d794679c900c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:21.035163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89d33201-9d45-4036-b5ba-d794679c900c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:21.035945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89d33201-9d45-4036-b5ba-d794679c900c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:21.037006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89d33201-9d45-4036-b5ba-d794679c900c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:21.037996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89d33201-9d45-4036-b5ba-d794679c900c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:21.215805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff9222aa-ea44-4ce0-a805-3b9845a7d626 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:21.219162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ff9222aa-ea44-4ce0-a805-3b9845a7d626 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:21.225355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9222aa-ea44-4ce0-a805-3b9845a7d626 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:21.226123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9222aa-ea44-4ce0-a805-3b9845a7d626 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:21.226761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9222aa-ea44-4ce0-a805-3b9845a7d626 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:21.227616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9222aa-ea44-4ce0-a805-3b9845a7d626 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:21.228293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9222aa-ea44-4ce0-a805-3b9845a7d626 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:21.228865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9222aa-ea44-4ce0-a805-3b9845a7d626 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:21.251511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-89d33201-9d45-4036-b5ba-d794679c900c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:21.267431 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-89d33201-9d45-4036-b5ba-d794679c900c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.246231 Oct 11 04:13:21.287967 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 350/731] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:21 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:21.293062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:21.293669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:21.309628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:21.310646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:21.311240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:21.312559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:21.313157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:21.313754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:21.411940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ff9222aa-ea44-4ce0-a805-3b9845a7d626 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:21.426282 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff9222aa-ea44-4ce0-a805-3b9845a7d626 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.208947 Oct 11 04:13:21.426282 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 382/732] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:21 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:21.531635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:21.539699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:21.541183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:21.543082 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-abb11923-14d2-4076-bcbc-9ec983bfac11 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.253273 Oct 11 04:13:21.543653 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 351/733] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:21 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:21.612502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e1ebc93f-58f8-4bb7-be84-08ab3335af41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:21.613624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e1ebc93f-58f8-4bb7-be84-08ab3335af41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:21.620773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1ebc93f-58f8-4bb7-be84-08ab3335af41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:21.621490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1ebc93f-58f8-4bb7-be84-08ab3335af41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:21.622086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1ebc93f-58f8-4bb7-be84-08ab3335af41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:21.623184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1ebc93f-58f8-4bb7-be84-08ab3335af41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:21.623806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1ebc93f-58f8-4bb7-be84-08ab3335af41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:21.624388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1ebc93f-58f8-4bb7-be84-08ab3335af41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:21.804068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e1ebc93f-58f8-4bb7-be84-08ab3335af41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:21.813234 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e1ebc93f-58f8-4bb7-be84-08ab3335af41 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1315 microversion: 2.1 time: 0.205037 Oct 11 04:13:21.818897 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 383/734] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:21 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:22.157857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSONUnderV235-server-715941159", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:22.231231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] validate_networks() for [('32d9ddcc-2b51-45b4-8901-27596af8e539', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:13:22.291920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6d374c7-63ca-4aef-8c62-dfef4bb4caa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:22.292652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6d374c7-63ca-4aef-8c62-dfef4bb4caa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:22.294866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:22.303296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6d374c7-63ca-4aef-8c62-dfef4bb4caa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:22.303925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6d374c7-63ca-4aef-8c62-dfef4bb4caa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:22.304766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6d374c7-63ca-4aef-8c62-dfef4bb4caa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:22.305521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6d374c7-63ca-4aef-8c62-dfef4bb4caa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:22.305974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6d374c7-63ca-4aef-8c62-dfef4bb4caa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:22.310128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6d374c7-63ca-4aef-8c62-dfef4bb4caa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:22.526965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6d374c7-63ca-4aef-8c62-dfef4bb4caa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:22.543845 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6d374c7-63ca-4aef-8c62-dfef4bb4caa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1475 microversion: 2.1 time: 0.256411 Oct 11 04:13:22.545375 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 384/735] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:22 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1475 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:22.552010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0103fdda-fe13-4396-be0a-04db46c4f274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:22.552803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0103fdda-fe13-4396-be0a-04db46c4f274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:22.559773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0103fdda-fe13-4396-be0a-04db46c4f274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:22.560486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0103fdda-fe13-4396-be0a-04db46c4f274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:22.561333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0103fdda-fe13-4396-be0a-04db46c4f274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:22.562217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0103fdda-fe13-4396-be0a-04db46c4f274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:22.562825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0103fdda-fe13-4396-be0a-04db46c4f274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:22.563401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0103fdda-fe13-4396-be0a-04db46c4f274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:22.760754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0103fdda-fe13-4396-be0a-04db46c4f274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:22.769973 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0103fdda-fe13-4396-be0a-04db46c4f274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.223124 Oct 11 04:13:22.770580 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 385/736] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:22 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:22.776042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:22.776674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:22.783814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:22.784743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:22.785341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:22.787104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:22.787775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:22.788393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:22.953335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:22.966709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:22.970231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:22.972057 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-61bd75d3-3e69-4e7f-9e6f-ceb19ff3862b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.200480 Oct 11 04:13:22.986050 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 386/737] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:22 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:22.986050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9225c75a-ac5a-4a3d-b41b-a4a5e05fe481 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:22.986050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9225c75a-ac5a-4a3d-b41b-a4a5e05fe481 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:22.986050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9225c75a-ac5a-4a3d-b41b-a4a5e05fe481 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:22.986548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9225c75a-ac5a-4a3d-b41b-a4a5e05fe481 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:22.986548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9225c75a-ac5a-4a3d-b41b-a4a5e05fe481 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:22.986998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9225c75a-ac5a-4a3d-b41b-a4a5e05fe481 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:22.987502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9225c75a-ac5a-4a3d-b41b-a4a5e05fe481 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:22.987933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9225c75a-ac5a-4a3d-b41b-a4a5e05fe481 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:23.015690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:23.074519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:13:23.077498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:13:23.077498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:13:23.077498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:13:23.077498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:13:23.085952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:23.086470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:23.087130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:23.088297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:23.088921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:23.089340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:23.114341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Getting quotas for project 8d36689c546841b191c6ae98991c8f4a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:13:23.119664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Getting quotas for user 5d740955dee145f4a79d6cd37d209ed4 and project 8d36689c546841b191c6ae98991c8f4a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:13:23.152225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:13:23.154882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:13:23.181303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:23.197985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9225c75a-ac5a-4a3d-b41b-a4a5e05fe481 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:23.206114 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9225c75a-ac5a-4a3d-b41b-a4a5e05fe481 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1315 microversion: 2.1 time: 0.232260 Oct 11 04:13:23.206719 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 387/738] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:22 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:23.211654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-29d31d5b-269c-424f-ada9-3890c86c5d7f req-29ff7b9d-02a8-4fad-99e2-9af0c4658a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1ce880-49a7-475d-9f7c-a04705d0d35c", "tag": "5ac5d34a-b5ac-44e2-a066-af84d17457a2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:23.221481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-29d31d5b-269c-424f-ada9-3890c86c5d7f req-29ff7b9d-02a8-4fad-99e2-9af0c4658a9c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:23.222642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-29d31d5b-269c-424f-ada9-3890c86c5d7f req-29ff7b9d-02a8-4fad-99e2-9af0c4658a9c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:23.223096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-29d31d5b-269c-424f-ada9-3890c86c5d7f req-29ff7b9d-02a8-4fad-99e2-9af0c4658a9c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:23.235669 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-29d31d5b-269c-424f-ada9-3890c86c5d7f req-29ff7b9d-02a8-4fad-99e2-9af0c4658a9c service nova] Creating event network-changed:5ac5d34a-b5ac-44e2-a066-af84d17457a2 for instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c on n-h2-860892-1 Oct 11 04:13:23.241411 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-29d31d5b-269c-424f-ada9-3890c86c5d7f req-29ff7b9d-02a8-4fad-99e2-9af0c4658a9c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033455 Oct 11 04:13:23.242285 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 388/739] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:23.299127 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8ae23770-f6b0-44a6-a57c-a8f9746aa918 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.327665 Oct 11 04:13:23.299776 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 352/740] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:13:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 1329 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:13:23.309049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=21 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:23.314061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49781d35-aeb0-40b8-9c6c-d5d97ca9e73f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:23.315570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-49781d35-aeb0-40b8-9c6c-d5d97ca9e73f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:23.376163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-49781d35-aeb0-40b8-9c6c-d5d97ca9e73f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:23.383830 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-49781d35-aeb0-40b8-9c6c-d5d97ca9e73f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1222 microversion: 2.1 time: 0.075762 Oct 11 04:13:23.385435 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 389/741] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:23 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1222 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:23.569791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e88855dd-0966-4d40-a79f-a6777c39cfd1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:23.570839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e88855dd-0966-4d40-a79f-a6777c39cfd1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:23.582862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e88855dd-0966-4d40-a79f-a6777c39cfd1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:23.583306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e88855dd-0966-4d40-a79f-a6777c39cfd1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:23.583923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e88855dd-0966-4d40-a79f-a6777c39cfd1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:23.584636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e88855dd-0966-4d40-a79f-a6777c39cfd1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:23.585258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e88855dd-0966-4d40-a79f-a6777c39cfd1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:23.585832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e88855dd-0966-4d40-a79f-a6777c39cfd1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:23.793895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c7cd2c69-5b5d-46e4-92f8-4da03998406f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:23.794899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c7cd2c69-5b5d-46e4-92f8-4da03998406f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:23.801349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cd2c69-5b5d-46e4-92f8-4da03998406f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:23.802173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cd2c69-5b5d-46e4-92f8-4da03998406f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:23.802848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cd2c69-5b5d-46e4-92f8-4da03998406f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:23.803780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cd2c69-5b5d-46e4-92f8-4da03998406f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:23.804438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cd2c69-5b5d-46e4-92f8-4da03998406f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:23.805161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cd2c69-5b5d-46e4-92f8-4da03998406f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:23.829950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e88855dd-0966-4d40-a79f-a6777c39cfd1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:23.840866 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e88855dd-0966-4d40-a79f-a6777c39cfd1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1474 microversion: 2.1 time: 0.275535 Oct 11 04:13:23.841916 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 353/742] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:23 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1474 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:23.999295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:23.999906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:24.010413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c7cd2c69-5b5d-46e4-92f8-4da03998406f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:24.019826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:24.019826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:24.019826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:24.019826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:24.020366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:24.020366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:24.021879 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c7cd2c69-5b5d-46e4-92f8-4da03998406f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.231793 Oct 11 04:13:24.022501 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 390/743] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:23 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:24.196117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:24.209188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:24.210780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:24.211958 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7778e83a-18e6-4043-ae47-c0b257df6505 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.216676 Oct 11 04:13:24.213152 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 354/744] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:23 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:24.232209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9a42ee3-0f43-4100-9cad-7dc7102b8f3d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:24.234313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e9a42ee3-0f43-4100-9cad-7dc7102b8f3d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:24.239681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9a42ee3-0f43-4100-9cad-7dc7102b8f3d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:24.240163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9a42ee3-0f43-4100-9cad-7dc7102b8f3d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:24.240855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9a42ee3-0f43-4100-9cad-7dc7102b8f3d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:24.241523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9a42ee3-0f43-4100-9cad-7dc7102b8f3d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:24.241866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9a42ee3-0f43-4100-9cad-7dc7102b8f3d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:24.242320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9a42ee3-0f43-4100-9cad-7dc7102b8f3d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:24.409866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9f65329-16c6-42a2-a83e-bebd7bc6e2e1 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:24.410615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9f65329-16c6-42a2-a83e-bebd7bc6e2e1 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:24.412978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e9a42ee3-0f43-4100-9cad-7dc7102b8f3d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:24.421904 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e9a42ee3-0f43-4100-9cad-7dc7102b8f3d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1315 microversion: 2.1 time: 0.194138 Oct 11 04:13:24.422836 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 391/745] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:24 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:24.466125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b9f65329-16c6-42a2-a83e-bebd7bc6e2e1 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:24.473261 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b9f65329-16c6-42a2-a83e-bebd7bc6e2e1 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1222 microversion: 2.1 time: 0.068144 Oct 11 04:13:24.473850 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 355/746] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:24 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1222 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:24.867980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8654cdd8-6fc2-411b-95ee-2b559c14a78f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:24.874821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8654cdd8-6fc2-411b-95ee-2b559c14a78f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:24.875138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8654cdd8-6fc2-411b-95ee-2b559c14a78f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:24.880152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8654cdd8-6fc2-411b-95ee-2b559c14a78f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:24.881099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8654cdd8-6fc2-411b-95ee-2b559c14a78f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:24.882281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8654cdd8-6fc2-411b-95ee-2b559c14a78f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:24.882902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8654cdd8-6fc2-411b-95ee-2b559c14a78f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:24.883492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8654cdd8-6fc2-411b-95ee-2b559c14a78f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:25.049914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef7fe6aa-f98f-4dac-ad20-5ff75116a0aa tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:25.050832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef7fe6aa-f98f-4dac-ad20-5ff75116a0aa tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:25.060017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7fe6aa-f98f-4dac-ad20-5ff75116a0aa tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:25.060730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7fe6aa-f98f-4dac-ad20-5ff75116a0aa tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:25.061354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7fe6aa-f98f-4dac-ad20-5ff75116a0aa tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:25.062073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7fe6aa-f98f-4dac-ad20-5ff75116a0aa tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:25.062217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8654cdd8-6fc2-411b-95ee-2b559c14a78f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:25.063467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7fe6aa-f98f-4dac-ad20-5ff75116a0aa tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:25.063914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7fe6aa-f98f-4dac-ad20-5ff75116a0aa tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:25.079419 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8654cdd8-6fc2-411b-95ee-2b559c14a78f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1474 microversion: 2.1 time: 0.210361 Oct 11 04:13:25.079419 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 392/747] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:24 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1474 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:25.241397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:25.242332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:25.252550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:25.254753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:25.256727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:25.259941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:25.260699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:25.274911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:25.288004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef7fe6aa-f98f-4dac-ad20-5ff75116a0aa tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:25.299942 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef7fe6aa-f98f-4dac-ad20-5ff75116a0aa tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.254693 Oct 11 04:13:25.301118 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 356/748] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:25 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:25.445384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b1a9e193-999d-4233-90d4-bf9e7e12a268 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:25.446138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b1a9e193-999d-4233-90d4-bf9e7e12a268 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:25.465635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1a9e193-999d-4233-90d4-bf9e7e12a268 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:25.466688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1a9e193-999d-4233-90d4-bf9e7e12a268 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:25.470718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1a9e193-999d-4233-90d4-bf9e7e12a268 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:25.472376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1a9e193-999d-4233-90d4-bf9e7e12a268 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:25.483182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1a9e193-999d-4233-90d4-bf9e7e12a268 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:25.483807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1a9e193-999d-4233-90d4-bf9e7e12a268 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:25.635812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:25.646502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:25.659535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:25.661416 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f20025de-92bc-446a-be4d-6fe08dae3626 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.424023 Oct 11 04:13:25.662337 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 393/749] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:25 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:25.672527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-ed61248a-6d5a-46bd-8e3c-889121411c26 req-00049469-05fd-42bc-b57a-76974d04b3e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa356b6-3b84-4022-b47c-35239eaeb5c3", "name": "network-vif-unplugged", "status": "completed", "tag": "c9c070fc-a59c-46ad-8b25-4293eab123bc"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:25.704942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ed61248a-6d5a-46bd-8e3c-889121411c26 req-00049469-05fd-42bc-b57a-76974d04b3e8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:25.705711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ed61248a-6d5a-46bd-8e3c-889121411c26 req-00049469-05fd-42bc-b57a-76974d04b3e8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:25.707655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ed61248a-6d5a-46bd-8e3c-889121411c26 req-00049469-05fd-42bc-b57a-76974d04b3e8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:25.738504 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-ed61248a-6d5a-46bd-8e3c-889121411c26 req-00049469-05fd-42bc-b57a-76974d04b3e8 service nova] Creating event network-vif-unplugged:c9c070fc-a59c-46ad-8b25-4293eab123bc for instance afa356b6-3b84-4022-b47c-35239eaeb5c3 on n-h1-860892-1 Oct 11 04:13:25.753021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-ed61248a-6d5a-46bd-8e3c-889121411c26 req-00049469-05fd-42bc-b57a-76974d04b3e8 service nova] Instance afa356b6-3b84-4022-b47c-35239eaeb5c3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:13:25.785938 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-ed61248a-6d5a-46bd-8e3c-889121411c26 req-00049469-05fd-42bc-b57a-76974d04b3e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122048 Oct 11 04:13:25.787131 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 394/750] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:25.818080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a28a38e7-8c71-43ab-8778-0060c2ccb07a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:25.822195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a28a38e7-8c71-43ab-8778-0060c2ccb07a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:25.840813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28a38e7-8c71-43ab-8778-0060c2ccb07a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:25.843048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28a38e7-8c71-43ab-8778-0060c2ccb07a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:25.843549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28a38e7-8c71-43ab-8778-0060c2ccb07a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:25.846053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28a38e7-8c71-43ab-8778-0060c2ccb07a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:25.847366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28a38e7-8c71-43ab-8778-0060c2ccb07a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:25.848131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28a38e7-8c71-43ab-8778-0060c2ccb07a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:25.875051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:25.934054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a28a38e7-8c71-43ab-8778-0060c2ccb07a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:25.942676 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a28a38e7-8c71-43ab-8778-0060c2ccb07a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1274 microversion: 2.1 time: 0.153915 Oct 11 04:13:25.944134 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 395/751] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:25 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1274 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:26.107181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-06cfbe95-9582-4554-b3bf-ffacd0f2299d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:26.109785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-06cfbe95-9582-4554-b3bf-ffacd0f2299d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:26.120616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cfbe95-9582-4554-b3bf-ffacd0f2299d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:26.126410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cfbe95-9582-4554-b3bf-ffacd0f2299d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:26.127048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cfbe95-9582-4554-b3bf-ffacd0f2299d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:26.127945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cfbe95-9582-4554-b3bf-ffacd0f2299d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:26.130456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cfbe95-9582-4554-b3bf-ffacd0f2299d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:26.133099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cfbe95-9582-4554-b3bf-ffacd0f2299d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:26.385521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-06cfbe95-9582-4554-b3bf-ffacd0f2299d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:26.397587 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-06cfbe95-9582-4554-b3bf-ffacd0f2299d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1474 microversion: 2.1 time: 0.300965 Oct 11 04:13:26.398792 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 396/752] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:26 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1474 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:26.405127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d7e99987-a30b-499b-9818-6cf22520a0da tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:26.405816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d7e99987-a30b-499b-9818-6cf22520a0da tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:26.415380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7e99987-a30b-499b-9818-6cf22520a0da tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:26.416040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7e99987-a30b-499b-9818-6cf22520a0da tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:26.416573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7e99987-a30b-499b-9818-6cf22520a0da tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:26.417345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7e99987-a30b-499b-9818-6cf22520a0da tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:26.417869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7e99987-a30b-499b-9818-6cf22520a0da tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:26.418539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7e99987-a30b-499b-9818-6cf22520a0da tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:26.464550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b1a9e193-999d-4233-90d4-bf9e7e12a268 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:26.484879 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b1a9e193-999d-4233-90d4-bf9e7e12a268 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1315 microversion: 2.1 time: 1.033216 Oct 11 04:13:26.484879 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 357/753] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:25 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1315 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:26.616319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d7e99987-a30b-499b-9818-6cf22520a0da tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:26.628390 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d7e99987-a30b-499b-9818-6cf22520a0da tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.228270 Oct 11 04:13:26.647650 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 397/754] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:26 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:26.693649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:26.694302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:26.701314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:26.701794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:26.702616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:26.703318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:26.703767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:26.704187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:26.966645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ad79352-f140-4424-8976-60cf5fc9e86d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:26.967259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5ad79352-f140-4424-8976-60cf5fc9e86d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:26.984203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ad79352-f140-4424-8976-60cf5fc9e86d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:26.986464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ad79352-f140-4424-8976-60cf5fc9e86d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:26.987067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ad79352-f140-4424-8976-60cf5fc9e86d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:26.987962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ad79352-f140-4424-8976-60cf5fc9e86d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:26.988586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ad79352-f140-4424-8976-60cf5fc9e86d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:26.989184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ad79352-f140-4424-8976-60cf5fc9e86d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:27.080550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5ad79352-f140-4424-8976-60cf5fc9e86d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:27.091226 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5ad79352-f140-4424-8976-60cf5fc9e86d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1292 microversion: 2.1 time: 0.128392 Oct 11 04:13:27.092335 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 398/755] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:26 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1292 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:27.255566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:27.268934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:27.281908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:27.284345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:27.287876 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35ec8870-ea7e-49d8-9e36-a50aab5d0901 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.597709 Oct 11 04:13:27.291163 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 358/756] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:26 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:27.422279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-422ce410-73f6-482c-a895-a1cec8ff0879 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:27.426522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-422ce410-73f6-482c-a895-a1cec8ff0879 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:27.429532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422ce410-73f6-482c-a895-a1cec8ff0879 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:27.430519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422ce410-73f6-482c-a895-a1cec8ff0879 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:27.431106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422ce410-73f6-482c-a895-a1cec8ff0879 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:27.431888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422ce410-73f6-482c-a895-a1cec8ff0879 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:27.432411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422ce410-73f6-482c-a895-a1cec8ff0879 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:27.432906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422ce410-73f6-482c-a895-a1cec8ff0879 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:27.503330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bc0ead8e-9301-49f1-8487-fb0faa2703fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:27.504652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bc0ead8e-9301-49f1-8487-fb0faa2703fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:27.514285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc0ead8e-9301-49f1-8487-fb0faa2703fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:27.515649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc0ead8e-9301-49f1-8487-fb0faa2703fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:27.516239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc0ead8e-9301-49f1-8487-fb0faa2703fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:27.517724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc0ead8e-9301-49f1-8487-fb0faa2703fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:27.518366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc0ead8e-9301-49f1-8487-fb0faa2703fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:27.519064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc0ead8e-9301-49f1-8487-fb0faa2703fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:27.722433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-422ce410-73f6-482c-a895-a1cec8ff0879 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:27.735807 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-422ce410-73f6-482c-a895-a1cec8ff0879 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1474 microversion: 2.1 time: 0.318026 Oct 11 04:13:27.753481 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 399/757] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:27 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1474 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:27.935679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdmin275Test-server-144558678", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": "none"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:28.027367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:13:28.027974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:13:28.028509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:13:28.029017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:13:28.029488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:13:28.042151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.043178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.043678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.044483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.045003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.045491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.052747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bc0ead8e-9301-49f1-8487-fb0faa2703fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.062398 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bc0ead8e-9301-49f1-8487-fb0faa2703fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1315 microversion: 2.1 time: 0.564076 Oct 11 04:13:28.082786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Getting quotas for project 2c12639490ad4451b3853b7818d738c3. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:13:28.082786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Getting quotas for user abef64e3ca4a4dcba416c87a931e7850 and project 2c12639490ad4451b3853b7818d738c3. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:13:28.083137 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 359/758] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:27 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:28.086492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d3b4c1e-d4c9-4274-95ad-a97d249decd7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:28.087520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7d3b4c1e-d4c9-4274-95ad-a97d249decd7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:28.090950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:13:28.093373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:13:28.101142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d3b4c1e-d4c9-4274-95ad-a97d249decd7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.102309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d3b4c1e-d4c9-4274-95ad-a97d249decd7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.103549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d3b4c1e-d4c9-4274-95ad-a97d249decd7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.106893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d3b4c1e-d4c9-4274-95ad-a97d249decd7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.107649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d3b4c1e-d4c9-4274-95ad-a97d249decd7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.108379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d3b4c1e-d4c9-4274-95ad-a97d249decd7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.266718 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-09897555-96d0-4239-a84e-9a8c2c389c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.75 time: 0.508369 Oct 11 04:13:28.268475 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 400/759] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:13:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:13:28.282825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c6bdf14f-14c4-4092-b4dd-fe97a05c518b req-1f5033fc-5010-4a7c-a2e9-db3fb5a0e4a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97202407-f542-4189-9582-1f1dd698c594", "name": "network-vif-plugged", "status": "completed", "tag": "dc8db1bd-a8a8-4b23-8837-a7b82504853f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:28.306419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c6bdf14f-14c4-4092-b4dd-fe97a05c518b req-1f5033fc-5010-4a7c-a2e9-db3fb5a0e4a8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.308266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c6bdf14f-14c4-4092-b4dd-fe97a05c518b req-1f5033fc-5010-4a7c-a2e9-db3fb5a0e4a8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.312312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c6bdf14f-14c4-4092-b4dd-fe97a05c518b req-1f5033fc-5010-4a7c-a2e9-db3fb5a0e4a8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.332478 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c6bdf14f-14c4-4092-b4dd-fe97a05c518b req-1f5033fc-5010-4a7c-a2e9-db3fb5a0e4a8 service nova] Creating event network-vif-plugged:dc8db1bd-a8a8-4b23-8837-a7b82504853f for instance 97202407-f542-4189-9582-1f1dd698c594 on n-h1-860892-1 Oct 11 04:13:28.342088 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c6bdf14f-14c4-4092-b4dd-fe97a05c518b req-1f5033fc-5010-4a7c-a2e9-db3fb5a0e4a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071457 Oct 11 04:13:28.343096 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 401/760] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:28.354985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d1fdb8c-fe16-477b-967f-2a50e32484d2 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:28.354985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d1fdb8c-fe16-477b-967f-2a50e32484d2 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:28.365087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1fdb8c-fe16-477b-967f-2a50e32484d2 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.365599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1fdb8c-fe16-477b-967f-2a50e32484d2 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.366390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1fdb8c-fe16-477b-967f-2a50e32484d2 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.367348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1fdb8c-fe16-477b-967f-2a50e32484d2 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.382654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1fdb8c-fe16-477b-967f-2a50e32484d2 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.384601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1fdb8c-fe16-477b-967f-2a50e32484d2 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.425211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d3b4c1e-d4c9-4274-95ad-a97d249decd7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.446912 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d3b4c1e-d4c9-4274-95ad-a97d249decd7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.363755 Oct 11 04:13:28.446912 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 360/761] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:28 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:28.457580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-be1f3712-1994-4159-84a6-033ca2739975 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:28.464320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-be1f3712-1994-4159-84a6-033ca2739975 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:28.515248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d1fdb8c-fe16-477b-967f-2a50e32484d2 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.534753 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d1fdb8c-fe16-477b-967f-2a50e32484d2 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1280 microversion: 2.1 time: 0.185537 Oct 11 04:13:28.534753 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 402/762] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:28 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1280 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:28.541136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:28.543645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:28.559977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.560526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.560956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.561613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.562071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.562535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.662267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be1f3712-1994-4159-84a6-033ca2739975 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.672335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be1f3712-1994-4159-84a6-033ca2739975 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.673964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be1f3712-1994-4159-84a6-033ca2739975 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.686005 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-be1f3712-1994-4159-84a6-033ca2739975 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "PUT /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1358 microversion: 2.75 time: 0.239398 Oct 11 04:13:28.686796 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 361/763] 10.222.0.26 () {62 vars in 1297 bytes} [Tue Oct 11 04:13:28 2022] PUT /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:28.714912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.718132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69268652-4155-458a-af8f-99f3c5eb637a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:28.718868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69268652-4155-458a-af8f-99f3c5eb637a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:28.723864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.727350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.729258 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3ae14d7f-a623-400d-afbf-5aa8dd82bd96 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.196471 Oct 11 04:13:28.730361 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 403/764] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:28 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:28.765517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31441101-2807-40ec-8ae2-2c8129df497a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:28.766346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31441101-2807-40ec-8ae2-2c8129df497a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:28.773769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31441101-2807-40ec-8ae2-2c8129df497a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.774563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31441101-2807-40ec-8ae2-2c8129df497a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.775110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31441101-2807-40ec-8ae2-2c8129df497a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.775823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31441101-2807-40ec-8ae2-2c8129df497a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.776303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31441101-2807-40ec-8ae2-2c8129df497a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.776860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31441101-2807-40ec-8ae2-2c8129df497a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.780679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-69268652-4155-458a-af8f-99f3c5eb637a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.789537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-69268652-4155-458a-af8f-99f3c5eb637a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.791782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-69268652-4155-458a-af8f-99f3c5eb637a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.798226 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69268652-4155-458a-af8f-99f3c5eb637a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1358 microversion: 2.75 time: 0.084937 Oct 11 04:13:28.799261 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 362/765] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:28 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1358 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:28.886792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a4da34a6-dc88-4ff9-a90b-c7e5476041c3 req-36914058-5594-4cae-b11f-cee83e2a78ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa356b6-3b84-4022-b47c-35239eaeb5c3", "tag": "c9c070fc-a59c-46ad-8b25-4293eab123bc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:28.899876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a4da34a6-dc88-4ff9-a90b-c7e5476041c3 req-36914058-5594-4cae-b11f-cee83e2a78ce service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:28.900656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a4da34a6-dc88-4ff9-a90b-c7e5476041c3 req-36914058-5594-4cae-b11f-cee83e2a78ce service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:28.901318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a4da34a6-dc88-4ff9-a90b-c7e5476041c3 req-36914058-5594-4cae-b11f-cee83e2a78ce service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:28.913708 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a4da34a6-dc88-4ff9-a90b-c7e5476041c3 req-36914058-5594-4cae-b11f-cee83e2a78ce service nova] Creating event network-changed:c9c070fc-a59c-46ad-8b25-4293eab123bc for instance afa356b6-3b84-4022-b47c-35239eaeb5c3 on n-h1-860892-1 Oct 11 04:13:28.921243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-a4da34a6-dc88-4ff9-a90b-c7e5476041c3 req-36914058-5594-4cae-b11f-cee83e2a78ce service nova] Instance afa356b6-3b84-4022-b47c-35239eaeb5c3 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:13:28.936729 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a4da34a6-dc88-4ff9-a90b-c7e5476041c3 req-36914058-5594-4cae-b11f-cee83e2a78ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056564 Oct 11 04:13:28.937767 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 363/766] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:13:28.938408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-31441101-2807-40ec-8ae2-2c8129df497a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:28.948482 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31441101-2807-40ec-8ae2-2c8129df497a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1474 microversion: 2.1 time: 0.186629 Oct 11 04:13:28.949558 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 404/767] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:28 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1474 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:29.090740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a42e474-7243-4743-9886-52414e9841e1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:29.091551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7a42e474-7243-4743-9886-52414e9841e1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:29.098674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a42e474-7243-4743-9886-52414e9841e1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:29.099160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a42e474-7243-4743-9886-52414e9841e1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:29.099761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a42e474-7243-4743-9886-52414e9841e1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:29.100477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a42e474-7243-4743-9886-52414e9841e1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:29.100928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a42e474-7243-4743-9886-52414e9841e1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:29.101353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a42e474-7243-4743-9886-52414e9841e1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:29.464325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5aa2bebc-8ed6-45b0-b60d-2b90a2efc696 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:29.465015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5aa2bebc-8ed6-45b0-b60d-2b90a2efc696 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:29.471554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5aa2bebc-8ed6-45b0-b60d-2b90a2efc696 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:29.472427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5aa2bebc-8ed6-45b0-b60d-2b90a2efc696 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:29.472870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5aa2bebc-8ed6-45b0-b60d-2b90a2efc696 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:29.476705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5aa2bebc-8ed6-45b0-b60d-2b90a2efc696 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:29.476705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5aa2bebc-8ed6-45b0-b60d-2b90a2efc696 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:29.476705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5aa2bebc-8ed6-45b0-b60d-2b90a2efc696 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:29.631246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5aa2bebc-8ed6-45b0-b60d-2b90a2efc696 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:29.639661 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5aa2bebc-8ed6-45b0-b60d-2b90a2efc696 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.179215 Oct 11 04:13:29.640264 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 405/768] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:29 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:29.644987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-12e7aad2-eb8c-4237-9983-0390e15d64a0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:29.645917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-12e7aad2-eb8c-4237-9983-0390e15d64a0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:29.655444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12e7aad2-eb8c-4237-9983-0390e15d64a0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:29.656023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12e7aad2-eb8c-4237-9983-0390e15d64a0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:29.656529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12e7aad2-eb8c-4237-9983-0390e15d64a0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:29.657294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12e7aad2-eb8c-4237-9983-0390e15d64a0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:29.657744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12e7aad2-eb8c-4237-9983-0390e15d64a0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:29.658254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12e7aad2-eb8c-4237-9983-0390e15d64a0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:29.775468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7a42e474-7243-4743-9886-52414e9841e1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:29.784474 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7a42e474-7243-4743-9886-52414e9841e1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1315 microversion: 2.1 time: 0.698074 Oct 11 04:13:29.785822 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 364/769] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:29 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1315 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:29.791398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:29.792119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:29.798287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:29.798785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:29.799221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:29.800038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:29.800725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:29.801157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:29.824155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-12e7aad2-eb8c-4237-9983-0390e15d64a0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:29.835744 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-12e7aad2-eb8c-4237-9983-0390e15d64a0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1322 microversion: 2.1 time: 0.194301 Oct 11 04:13:29.837704 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 406/770] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:29 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:29.856338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:29.858860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:29.865801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:29.866323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:29.866920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:29.867884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:29.868860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:29.869274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:29.989560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:29.998313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:29.999834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:30.007885 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-74c1cc5f-7b53-4f5e-a4f9-bf58e1594598 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1362 microversion: 2.75 time: 0.168856 Oct 11 04:13:30.008449 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 407/771] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:29 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:30.013971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef544dca-9ad3-48bd-bb36-2d022d7911f7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:30.026353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef544dca-9ad3-48bd-bb36-2d022d7911f7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:30.026353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef544dca-9ad3-48bd-bb36-2d022d7911f7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:30.026353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef544dca-9ad3-48bd-bb36-2d022d7911f7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:30.026353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef544dca-9ad3-48bd-bb36-2d022d7911f7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:30.026735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef544dca-9ad3-48bd-bb36-2d022d7911f7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:30.026735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef544dca-9ad3-48bd-bb36-2d022d7911f7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:30.026735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef544dca-9ad3-48bd-bb36-2d022d7911f7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:30.169400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef544dca-9ad3-48bd-bb36-2d022d7911f7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:30.177688 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef544dca-9ad3-48bd-bb36-2d022d7911f7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1474 microversion: 2.1 time: 0.167761 Oct 11 04:13:30.178253 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 408/772] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:30 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1474 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:30.194570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:30.203360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:30.204804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:30.205922 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a900a14c-e182-4dce-8fac-7e2f8c6aaa80 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.418959 Oct 11 04:13:30.206514 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 365/773] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:29 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:30.363468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-50321829-da2b-493f-b1a0-53f48e2edf88 req-cadba002-fc5b-4fd1-9f67-e17532677be6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721ec7b4-5d21-4da0-a478-d90bad272b94", "name": "network-vif-plugged", "status": "completed", "tag": "971a9abb-3c06-4885-970b-2a3b2e5b5ab8"}, {"server_uuid": "3c1ce880-49a7-475d-9f7c-a04705d0d35c", "name": "network-vif-plugged", "status": "completed", "tag": "5ac5d34a-b5ac-44e2-a066-af84d17457a2"}, {"server_uuid": "63a565eb-1de8-4b6b-bd27-ba53e0d9a821", "name": "network-vif-plugged", "status": "completed", "tag": "4d8dc49c-bed9-4a3b-8d71-e5f1ed05cb39"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:30.375660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-50321829-da2b-493f-b1a0-53f48e2edf88 req-cadba002-fc5b-4fd1-9f67-e17532677be6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:30.376230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-50321829-da2b-493f-b1a0-53f48e2edf88 req-cadba002-fc5b-4fd1-9f67-e17532677be6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:30.376727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-50321829-da2b-493f-b1a0-53f48e2edf88 req-cadba002-fc5b-4fd1-9f67-e17532677be6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:30.392094 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-50321829-da2b-493f-b1a0-53f48e2edf88 req-cadba002-fc5b-4fd1-9f67-e17532677be6 service nova] Creating event network-vif-plugged:971a9abb-3c06-4885-970b-2a3b2e5b5ab8 for instance 721ec7b4-5d21-4da0-a478-d90bad272b94 on n-h1-860892-1 Oct 11 04:13:30.392676 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-50321829-da2b-493f-b1a0-53f48e2edf88 req-cadba002-fc5b-4fd1-9f67-e17532677be6 service nova] Creating event network-vif-plugged:5ac5d34a-b5ac-44e2-a066-af84d17457a2 for instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c on n-h2-860892-1 Oct 11 04:13:30.393267 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-50321829-da2b-493f-b1a0-53f48e2edf88 req-cadba002-fc5b-4fd1-9f67-e17532677be6 service nova] Creating event network-vif-plugged:4d8dc49c-bed9-4a3b-8d71-e5f1ed05cb39 for instance 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 on n-h1-860892-1 Oct 11 04:13:30.404058 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-50321829-da2b-493f-b1a0-53f48e2edf88 req-cadba002-fc5b-4fd1-9f67-e17532677be6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.045913 Oct 11 04:13:30.414886 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 409/774] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:30.662756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c9e5476a-068c-4089-9fc5-869eb3022246 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:30.663461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c9e5476a-068c-4089-9fc5-869eb3022246 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:30.671592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e5476a-068c-4089-9fc5-869eb3022246 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:30.672897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e5476a-068c-4089-9fc5-869eb3022246 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:30.673906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e5476a-068c-4089-9fc5-869eb3022246 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:30.675058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e5476a-068c-4089-9fc5-869eb3022246 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:30.675765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e5476a-068c-4089-9fc5-869eb3022246 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:30.676313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e5476a-068c-4089-9fc5-869eb3022246 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:30.808556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2970647b-a3a4-4b63-b077-195019f80815 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:30.809260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2970647b-a3a4-4b63-b077-195019f80815 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:30.815545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2970647b-a3a4-4b63-b077-195019f80815 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:30.816027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2970647b-a3a4-4b63-b077-195019f80815 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:30.816685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2970647b-a3a4-4b63-b077-195019f80815 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:30.817570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2970647b-a3a4-4b63-b077-195019f80815 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:30.818021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2970647b-a3a4-4b63-b077-195019f80815 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:30.822884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2970647b-a3a4-4b63-b077-195019f80815 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:30.953062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2970647b-a3a4-4b63-b077-195019f80815 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:30.961234 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2970647b-a3a4-4b63-b077-195019f80815 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1315 microversion: 2.1 time: 0.156943 Oct 11 04:13:30.961804 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 410/775] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:30 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:30.966705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-855b4525-e9ba-40cc-9bc8-549cf9503a1c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:30.967555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-855b4525-e9ba-40cc-9bc8-549cf9503a1c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:30.973362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-855b4525-e9ba-40cc-9bc8-549cf9503a1c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:30.974068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-855b4525-e9ba-40cc-9bc8-549cf9503a1c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:30.974752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-855b4525-e9ba-40cc-9bc8-549cf9503a1c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:30.975642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-855b4525-e9ba-40cc-9bc8-549cf9503a1c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:30.976314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-855b4525-e9ba-40cc-9bc8-549cf9503a1c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:30.977206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-855b4525-e9ba-40cc-9bc8-549cf9503a1c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:30.989615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c9e5476a-068c-4089-9fc5-869eb3022246 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:30.998255 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c9e5476a-068c-4089-9fc5-869eb3022246 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.339477 Oct 11 04:13:31.011031 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 366/776] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:30 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:31.049767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:31.051811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:31.060287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:31.060950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:31.061477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:31.062479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:31.062938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:31.063356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:31.121681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-855b4525-e9ba-40cc-9bc8-549cf9503a1c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:31.130137 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-855b4525-e9ba-40cc-9bc8-549cf9503a1c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1322 microversion: 2.1 time: 0.166926 Oct 11 04:13:31.130741 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 411/777] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:30 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:31.177011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:31.185285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:31.186748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:31.191628 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1db2d2ed-7622-41f3-8242-5cbcfe7d631f tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1410 microversion: 2.75 time: 0.150223 Oct 11 04:13:31.192188 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 367/778] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:31 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1410 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:31.200600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-899ee321-20df-42ce-aef1-a588fb48542f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:31.201314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-899ee321-20df-42ce-aef1-a588fb48542f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:31.207510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-899ee321-20df-42ce-aef1-a588fb48542f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:31.208064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-899ee321-20df-42ce-aef1-a588fb48542f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:31.208564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-899ee321-20df-42ce-aef1-a588fb48542f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:31.209423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-899ee321-20df-42ce-aef1-a588fb48542f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:31.209951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-899ee321-20df-42ce-aef1-a588fb48542f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:31.210553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-899ee321-20df-42ce-aef1-a588fb48542f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:31.225384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-19d87444-c860-4d38-9842-df11e1f4c030 req-e6c400cf-12be-4898-808e-8c596ca432f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e", "tag": "b4654310-3e46-4989-977e-9e06fed03db8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:31.237371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-19d87444-c860-4d38-9842-df11e1f4c030 req-e6c400cf-12be-4898-808e-8c596ca432f6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:31.237850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-19d87444-c860-4d38-9842-df11e1f4c030 req-e6c400cf-12be-4898-808e-8c596ca432f6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:31.238319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-19d87444-c860-4d38-9842-df11e1f4c030 req-e6c400cf-12be-4898-808e-8c596ca432f6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:31.250514 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-19d87444-c860-4d38-9842-df11e1f4c030 req-e6c400cf-12be-4898-808e-8c596ca432f6 service nova] Creating event network-changed:b4654310-3e46-4989-977e-9e06fed03db8 for instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e on n-h2-860892-1 Oct 11 04:13:31.255294 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-19d87444-c860-4d38-9842-df11e1f4c030 req-e6c400cf-12be-4898-808e-8c596ca432f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033861 Oct 11 04:13:31.258446 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 368/779] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:13:31.268487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:31.268487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:31.269251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:31.269706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:31.270136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:31.270976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:31.271312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:31.271738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:31.379523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-899ee321-20df-42ce-aef1-a588fb48542f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:31.388525 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-899ee321-20df-42ce-aef1-a588fb48542f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1472 microversion: 2.1 time: 0.192138 Oct 11 04:13:31.389205 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 412/780] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:31 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:31.605470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:31.614669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:31.616105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:31.617218 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-17f5f470-9ead-424b-b872-5dda67b9c643 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.359706 Oct 11 04:13:31.627026 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 369/781] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:31 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:31.984749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-76aa45d6-a723-4d11-9010-37d3d3a965c6 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:31.985434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-76aa45d6-a723-4d11-9010-37d3d3a965c6 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:31.993245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76aa45d6-a723-4d11-9010-37d3d3a965c6 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:31.993729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76aa45d6-a723-4d11-9010-37d3d3a965c6 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:31.994161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76aa45d6-a723-4d11-9010-37d3d3a965c6 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:31.994938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76aa45d6-a723-4d11-9010-37d3d3a965c6 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:31.995383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76aa45d6-a723-4d11-9010-37d3d3a965c6 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:31.995802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76aa45d6-a723-4d11-9010-37d3d3a965c6 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.021336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-25e09b95-5bdc-48db-8cf7-5a7f11c53406 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:32.021950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-25e09b95-5bdc-48db-8cf7-5a7f11c53406 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:32.029146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25e09b95-5bdc-48db-8cf7-5a7f11c53406 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.029953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25e09b95-5bdc-48db-8cf7-5a7f11c53406 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.030629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25e09b95-5bdc-48db-8cf7-5a7f11c53406 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.031567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25e09b95-5bdc-48db-8cf7-5a7f11c53406 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.032231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25e09b95-5bdc-48db-8cf7-5a7f11c53406 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.032866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25e09b95-5bdc-48db-8cf7-5a7f11c53406 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.130321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-76aa45d6-a723-4d11-9010-37d3d3a965c6 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:32.138359 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-76aa45d6-a723-4d11-9010-37d3d3a965c6 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1465 microversion: 2.1 time: 0.157610 Oct 11 04:13:32.138936 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 413/782] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:31 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1465 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:32.154168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-50c29339-e6bf-45d8-8ce1-6587ae2fabab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:32.155203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50c29339-e6bf-45d8-8ce1-6587ae2fabab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:32.161335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c29339-e6bf-45d8-8ce1-6587ae2fabab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.161811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c29339-e6bf-45d8-8ce1-6587ae2fabab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.162263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c29339-e6bf-45d8-8ce1-6587ae2fabab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.162951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c29339-e6bf-45d8-8ce1-6587ae2fabab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.163393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c29339-e6bf-45d8-8ce1-6587ae2fabab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.163810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50c29339-e6bf-45d8-8ce1-6587ae2fabab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.171602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:32.237426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-25e09b95-5bdc-48db-8cf7-5a7f11c53406 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:32.245281 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-25e09b95-5bdc-48db-8cf7-5a7f11c53406 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1314 microversion: 2.1 time: 0.227988 Oct 11 04:13:32.245852 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 370/783] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:32 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:32.258369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cc8f212e-452f-4ccf-9bba-9b8c4d546a89 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-image-2033292990", "metadata": {"image_type": "test"}}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:32.258369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cc8f212e-452f-4ccf-9bba-9b8c4d546a89 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:32.261479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc8f212e-452f-4ccf-9bba-9b8c4d546a89 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.261479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc8f212e-452f-4ccf-9bba-9b8c4d546a89 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.261479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc8f212e-452f-4ccf-9bba-9b8c4d546a89 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.261479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc8f212e-452f-4ccf-9bba-9b8c4d546a89 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.261810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc8f212e-452f-4ccf-9bba-9b8c4d546a89 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.262030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc8f212e-452f-4ccf-9bba-9b8c4d546a89 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.297953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-cc8f212e-452f-4ccf-9bba-9b8c4d546a89 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Getting quotas for project d030baca29e8402896cdff2138cfcaab. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:13:32.301785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-cc8f212e-452f-4ccf-9bba-9b8c4d546a89 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Getting quotas for user c3dfadbfcdca4f31b4a0e2d960298fa6 and project d030baca29e8402896cdff2138cfcaab. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:13:32.307599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-50c29339-e6bf-45d8-8ce1-6587ae2fabab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:32.315155 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-50c29339-e6bf-45d8-8ce1-6587ae2fabab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1322 microversion: 2.1 time: 0.165729 Oct 11 04:13:32.315899 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 414/784] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:32 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:32.320250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:32.320846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:32.331413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.331901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.332335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.333026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.333471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.333888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.398014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:32.407912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:32.409708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:32.415291 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fc36e02d-dfec-4e65-bbc6-6a015413dee6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1418 microversion: 2.75 time: 0.098581 Oct 11 04:13:32.416042 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 415/785] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:32 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1418 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:32.420617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ed2c5a7a-bfb1-4ba2-94bb-6bbe16381e22 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:32.421222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ed2c5a7a-bfb1-4ba2-94bb-6bbe16381e22 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:32.426914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2c5a7a-bfb1-4ba2-94bb-6bbe16381e22 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.427390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2c5a7a-bfb1-4ba2-94bb-6bbe16381e22 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.427843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2c5a7a-bfb1-4ba2-94bb-6bbe16381e22 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.428525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2c5a7a-bfb1-4ba2-94bb-6bbe16381e22 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.428973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2c5a7a-bfb1-4ba2-94bb-6bbe16381e22 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.429395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2c5a7a-bfb1-4ba2-94bb-6bbe16381e22 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.582867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ed2c5a7a-bfb1-4ba2-94bb-6bbe16381e22 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:32.591252 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ed2c5a7a-bfb1-4ba2-94bb-6bbe16381e22 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1472 microversion: 2.1 time: 0.174165 Oct 11 04:13:32.591813 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 416/786] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:32 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1472 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:32.643335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:32.644110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:32.651777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.652332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.652772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.653622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:32.654065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:32.654538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:32.796335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:32.804590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:32.806715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:32.807812 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-054bbe8a-be77-46a7-8f97-06693665dece tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.168961 Oct 11 04:13:32.808384 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 417/787] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:32 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:32.928849 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cc8f212e-452f-4ccf-9bba-9b8c4d546a89 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "POST /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c/action" status: 202 len: 0 microversion: 2.1 time: 0.681691 Oct 11 04:13:32.929403 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 371/788] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:13:32 2022] POST /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c/action => generated 0 bytes in 683 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 04:13:32.940503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c94934bd-6d1b-4a0a-8d8f-790cefad36ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a31d5e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:32.984165 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c94934bd-6d1b-4a0a-8d8f-790cefad36ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.047420 Oct 11 04:13:32.984721 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 418/789] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:32 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:33.275180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d84672fa-dbe1-435f-b8a3-efb2363c84e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:33.275180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d84672fa-dbe1-435f-b8a3-efb2363c84e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:33.275180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:33.278460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d84672fa-dbe1-435f-b8a3-efb2363c84e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.278985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d84672fa-dbe1-435f-b8a3-efb2363c84e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.279427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d84672fa-dbe1-435f-b8a3-efb2363c84e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.280110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d84672fa-dbe1-435f-b8a3-efb2363c84e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.280841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d84672fa-dbe1-435f-b8a3-efb2363c84e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.281275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d84672fa-dbe1-435f-b8a3-efb2363c84e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.339408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a43cb2f-e49e-49ea-988e-a2c1064260d4 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:33.340047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1a43cb2f-e49e-49ea-988e-a2c1064260d4 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:33.346482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a43cb2f-e49e-49ea-988e-a2c1064260d4 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.346973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a43cb2f-e49e-49ea-988e-a2c1064260d4 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.347402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a43cb2f-e49e-49ea-988e-a2c1064260d4 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.348098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a43cb2f-e49e-49ea-988e-a2c1064260d4 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.348543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a43cb2f-e49e-49ea-988e-a2c1064260d4 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.348963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a43cb2f-e49e-49ea-988e-a2c1064260d4 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.492476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1a43cb2f-e49e-49ea-988e-a2c1064260d4 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:33.501448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1a43cb2f-e49e-49ea-988e-a2c1064260d4 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1322 microversion: 2.1 time: 0.166431 Oct 11 04:13:33.503073 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 419/790] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:33 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:33.508450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:33.509602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:33.516274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.516509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.516909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.517591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.518033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.519197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.589452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:33.597930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:33.599377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:33.605620 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-792c912d-0dc9-4d9e-87ca-44a99a55063d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1428 microversion: 2.75 time: 0.101536 Oct 11 04:13:33.606223 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 420/791] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:33 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1428 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:33.613954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f2fd82d0-abe3-4a47-b61d-45097dc4000b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:33.614741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f2fd82d0-abe3-4a47-b61d-45097dc4000b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:33.621289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2fd82d0-abe3-4a47-b61d-45097dc4000b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.621872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2fd82d0-abe3-4a47-b61d-45097dc4000b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.622430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2fd82d0-abe3-4a47-b61d-45097dc4000b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.623217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2fd82d0-abe3-4a47-b61d-45097dc4000b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.623763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2fd82d0-abe3-4a47-b61d-45097dc4000b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.625080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2fd82d0-abe3-4a47-b61d-45097dc4000b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.697970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d84672fa-dbe1-435f-b8a3-efb2363c84e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:33.705728 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d84672fa-dbe1-435f-b8a3-efb2363c84e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1464 microversion: 2.1 time: 0.440285 Oct 11 04:13:33.706319 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 372/792] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:33 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1464 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:33.731423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-592476bb-6d39-4d40-aa1e-7f00252c636d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:33.732171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-592476bb-6d39-4d40-aa1e-7f00252c636d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:33.738078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-592476bb-6d39-4d40-aa1e-7f00252c636d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.738810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-592476bb-6d39-4d40-aa1e-7f00252c636d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.739238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-592476bb-6d39-4d40-aa1e-7f00252c636d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.739969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-592476bb-6d39-4d40-aa1e-7f00252c636d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.740429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-592476bb-6d39-4d40-aa1e-7f00252c636d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.740859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-592476bb-6d39-4d40-aa1e-7f00252c636d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.755182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2fd82d0-abe3-4a47-b61d-45097dc4000b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:33.763238 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f2fd82d0-abe3-4a47-b61d-45097dc4000b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1472 microversion: 2.1 time: 0.153035 Oct 11 04:13:33.763804 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 421/793] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:33 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1472 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:33.833778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:33.837659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:33.841019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.841499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.841928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.842640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:33.843114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:33.843537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:33.873182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-592476bb-6d39-4d40-aa1e-7f00252c636d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:33.881128 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-592476bb-6d39-4d40-aa1e-7f00252c636d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1464 microversion: 2.1 time: 0.153535 Oct 11 04:13:33.881954 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 373/794] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:33 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1464 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:33.975812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:33.992187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:33.992832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminTestJSON-server-184311547", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "97202407-f542-4189-9582-1f1dd698c594"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:33.993707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:33.994877 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e866913-97ec-46e4-80f7-2e0738a9f9de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.165889 Oct 11 04:13:33.995424 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 422/795] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:33 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:33.999973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-79891573-af7b-42e7-8c78-f6e0edae8f9c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a20e940>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:34.045000 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-79891573-af7b-42e7-8c78-f6e0edae8f9c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.048523 Oct 11 04:13:34.045568 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 423/796] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:33 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:34.051902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:13:34.261775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:13:34.262088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:13:34.262581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:13:34.262985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:13:34.263388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:13:34.272160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:34.272708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:34.273134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:34.273850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:34.274328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:34.274748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:34.291691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Getting quotas for project 3a6a41baf5e342e595051a329ba6ea18. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:13:34.295644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Getting quotas for user 748ffa73f06244f3a8f2b14f81f486e0 and project 3a6a41baf5e342e595051a329ba6ea18. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:13:34.307079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:13:34.310042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:13:34.454033 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d243d5e1-c2dc-42f6-a7d4-d5d3794367fe tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.465063 Oct 11 04:13:34.454724 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 374/797] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:13:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:13:34.465732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-626ad306-39fa-4b94-bd1f-6d6ce6d7694d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:34.466370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-626ad306-39fa-4b94-bd1f-6d6ce6d7694d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:34.472925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:34.526008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-626ad306-39fa-4b94-bd1f-6d6ce6d7694d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:34.530347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-613104b4-e044-423c-8d88-3757a22cd26e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:34.536313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-613104b4-e044-423c-8d88-3757a22cd26e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:34.536581 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-626ad306-39fa-4b94-bd1f-6d6ce6d7694d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1213 microversion: 2.1 time: 0.071406 Oct 11 04:13:34.536581 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 424/798] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:34 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1213 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:34.538464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-613104b4-e044-423c-8d88-3757a22cd26e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:34.539016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-613104b4-e044-423c-8d88-3757a22cd26e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:34.539519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-613104b4-e044-423c-8d88-3757a22cd26e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:34.540301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-613104b4-e044-423c-8d88-3757a22cd26e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:34.540817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-613104b4-e044-423c-8d88-3757a22cd26e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:34.541563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-613104b4-e044-423c-8d88-3757a22cd26e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:34.638038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:34.639120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:34.645631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:34.646110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:34.646579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:34.647271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:34.647824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:34.648413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:34.685068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-613104b4-e044-423c-8d88-3757a22cd26e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:34.692970 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-613104b4-e044-423c-8d88-3757a22cd26e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1322 microversion: 2.1 time: 0.170598 Oct 11 04:13:34.693672 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 375/799] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:34 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1322 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:34.721235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:34.730081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:34.731548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:34.736534 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aa729f44-edaa-4940-9e51-916c166ecabf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1428 microversion: 2.75 time: 0.106050 Oct 11 04:13:34.737102 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 425/800] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:34 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1428 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:34.786801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-05b44622-d3cf-4ab8-9170-01f0c63861d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:34.787348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-05b44622-d3cf-4ab8-9170-01f0c63861d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:34.797473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b44622-d3cf-4ab8-9170-01f0c63861d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:34.797473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b44622-d3cf-4ab8-9170-01f0c63861d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:34.797473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b44622-d3cf-4ab8-9170-01f0c63861d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:34.797473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b44622-d3cf-4ab8-9170-01f0c63861d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:34.797836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b44622-d3cf-4ab8-9170-01f0c63861d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:34.797836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b44622-d3cf-4ab8-9170-01f0c63861d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:34.930350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-05b44622-d3cf-4ab8-9170-01f0c63861d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:34.938390 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-05b44622-d3cf-4ab8-9170-01f0c63861d2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1472 microversion: 2.1 time: 0.155537 Oct 11 04:13:34.939130 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 376/801] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:34 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1472 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:35.020164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:35.020775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:35.027595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:35.037836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:35.037836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:35.037836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:35.037836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:35.038507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:35.059893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ddeb4270-6fba-42ae-a623-7d781d76745d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a0d74c0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:35.104033 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ddeb4270-6fba-42ae-a623-7d781d76745d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.048350 Oct 11 04:13:35.104601 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 377/802] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:35 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:35.160991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:35.169659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:35.171104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:35.172387 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-da24a92b-ce48-4da7-9f90-677d0601c877 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1362 microversion: 2.25 time: 0.156118 Oct 11 04:13:35.172936 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 426/803] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:35 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:35.557520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ddff7bdb-79d5-4481-899e-94b859a88648 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:35.558123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ddff7bdb-79d5-4481-899e-94b859a88648 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:35.564210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ddff7bdb-79d5-4481-899e-94b859a88648 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:35.564724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ddff7bdb-79d5-4481-899e-94b859a88648 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:35.565167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ddff7bdb-79d5-4481-899e-94b859a88648 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:35.565862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ddff7bdb-79d5-4481-899e-94b859a88648 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:35.566350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ddff7bdb-79d5-4481-899e-94b859a88648 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:35.566780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ddff7bdb-79d5-4481-899e-94b859a88648 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:35.571906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:35.663808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ddff7bdb-79d5-4481-899e-94b859a88648 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:35.672388 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ddff7bdb-79d5-4481-899e-94b859a88648 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1217 microversion: 2.1 time: 0.119992 Oct 11 04:13:35.672963 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 378/804] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:35 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1217 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:35.715642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c03aca33-b410-4ad1-92d3-51b6b30740d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:35.716251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c03aca33-b410-4ad1-92d3-51b6b30740d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:35.722654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c03aca33-b410-4ad1-92d3-51b6b30740d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:35.723145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c03aca33-b410-4ad1-92d3-51b6b30740d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:35.723584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c03aca33-b410-4ad1-92d3-51b6b30740d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:35.724322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c03aca33-b410-4ad1-92d3-51b6b30740d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:35.724728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c03aca33-b410-4ad1-92d3-51b6b30740d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:35.725148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c03aca33-b410-4ad1-92d3-51b6b30740d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:35.766346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:35.767505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:35.783597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:35.786857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:35.786857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:35.786857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:35.787296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:35.790789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:35.893551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:35.903238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:35.907462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:35.912311 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b993cf8b-ac4b-4db0-b41b-0955aca0ae93 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1428 microversion: 2.75 time: 0.151407 Oct 11 04:13:35.912943 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 379/805] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:35 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1428 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:35.941899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c03aca33-b410-4ad1-92d3-51b6b30740d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:35.950047 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c03aca33-b410-4ad1-92d3-51b6b30740d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1322 microversion: 2.1 time: 0.238684 Oct 11 04:13:35.950875 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 427/806] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:35 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1322 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:35.963609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6e7d0a5a-62a0-4c3b-b343-38816f60b2bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:35.964518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6e7d0a5a-62a0-4c3b-b343-38816f60b2bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:35.971852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e7d0a5a-62a0-4c3b-b343-38816f60b2bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:35.972346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e7d0a5a-62a0-4c3b-b343-38816f60b2bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:35.972780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e7d0a5a-62a0-4c3b-b343-38816f60b2bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:35.973479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e7d0a5a-62a0-4c3b-b343-38816f60b2bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:35.973930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e7d0a5a-62a0-4c3b-b343-38816f60b2bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:35.974380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e7d0a5a-62a0-4c3b-b343-38816f60b2bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.122312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e1774569-4f28-4816-b78c-cfbb41a6efc9 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a31d0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:36.124979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6e7d0a5a-62a0-4c3b-b343-38816f60b2bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:36.134329 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6e7d0a5a-62a0-4c3b-b343-38816f60b2bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1469 microversion: 2.1 time: 0.175185 Oct 11 04:13:36.146106 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 380/807] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:35 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:36.157645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df04afcf-4fe3-4e08-8d13-96a6738671bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:36.158176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-df04afcf-4fe3-4e08-8d13-96a6738671bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:36.173924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df04afcf-4fe3-4e08-8d13-96a6738671bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.173924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df04afcf-4fe3-4e08-8d13-96a6738671bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.173924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df04afcf-4fe3-4e08-8d13-96a6738671bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.173924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df04afcf-4fe3-4e08-8d13-96a6738671bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.174335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df04afcf-4fe3-4e08-8d13-96a6738671bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.174335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df04afcf-4fe3-4e08-8d13-96a6738671bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.190944 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e1774569-4f28-4816-b78c-cfbb41a6efc9 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.074856 Oct 11 04:13:36.191845 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 428/808] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:36 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:36.197190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:36.199143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:36.205223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.205624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.206371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.207080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.207532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.207954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.351902 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df04afcf-4fe3-4e08-8d13-96a6738671bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "POST /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3/action" status: 204 len: 0 microversion: 2.1 time: 0.198080 Oct 11 04:13:36.356990 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 381/809] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:13:36 2022] POST /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3/action => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:13:36.363360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7546e20f-83ed-4997-8719-81419147e8d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:36.366800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:36.372148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7546e20f-83ed-4997-8719-81419147e8d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:36.379231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:36.381031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:36.382641 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7bc85375-9a52-4fa5-9e32-efd2aecf7564 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1557 microversion: 2.25 time: 0.189728 Oct 11 04:13:36.398483 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 429/810] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:36 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1557 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:36.398794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7546e20f-83ed-4997-8719-81419147e8d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.398794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7546e20f-83ed-4997-8719-81419147e8d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.398794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7546e20f-83ed-4997-8719-81419147e8d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.398794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7546e20f-83ed-4997-8719-81419147e8d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.399387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7546e20f-83ed-4997-8719-81419147e8d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.399387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7546e20f-83ed-4997-8719-81419147e8d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.551651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8e1dc15-91f4-4bb9-bfb8-9738062eb2c7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:36.552466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e8e1dc15-91f4-4bb9-bfb8-9738062eb2c7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:36.559813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8e1dc15-91f4-4bb9-bfb8-9738062eb2c7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.560372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8e1dc15-91f4-4bb9-bfb8-9738062eb2c7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.561170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8e1dc15-91f4-4bb9-bfb8-9738062eb2c7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.561957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8e1dc15-91f4-4bb9-bfb8-9738062eb2c7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.562517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8e1dc15-91f4-4bb9-bfb8-9738062eb2c7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.563075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8e1dc15-91f4-4bb9-bfb8-9738062eb2c7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.600035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7546e20f-83ed-4997-8719-81419147e8d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:36.614265 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7546e20f-83ed-4997-8719-81419147e8d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1469 microversion: 2.1 time: 0.250178 Oct 11 04:13:36.615131 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 382/811] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:36 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1469 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:36.697705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-530edda3-a7d3-40a3-9832-f95dc1616c62 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:36.699562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-530edda3-a7d3-40a3-9832-f95dc1616c62 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:36.709154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:36.712237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-530edda3-a7d3-40a3-9832-f95dc1616c62 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.713072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-530edda3-a7d3-40a3-9832-f95dc1616c62 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.713765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-530edda3-a7d3-40a3-9832-f95dc1616c62 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.716527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-530edda3-a7d3-40a3-9832-f95dc1616c62 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.717322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-530edda3-a7d3-40a3-9832-f95dc1616c62 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.717952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-530edda3-a7d3-40a3-9832-f95dc1616c62 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.732083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-e8e1dc15-91f4-4bb9-bfb8-9738062eb2c7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:13:36.809730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-530edda3-a7d3-40a3-9832-f95dc1616c62 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:36.817490 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-530edda3-a7d3-40a3-9832-f95dc1616c62 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1265 microversion: 2.1 time: 0.125397 Oct 11 04:13:36.818047 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 383/812] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:36 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1265 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:36.857173 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e8e1dc15-91f4-4bb9-bfb8-9738062eb2c7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 2050 microversion: 2.25 time: 0.449210 Oct 11 04:13:36.857868 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 430/813] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:36 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 2050 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:36.882927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a95e40fa-7d39-4bab-a915-40997424d090 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:36.884410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a95e40fa-7d39-4bab-a915-40997424d090 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:36.892665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95e40fa-7d39-4bab-a915-40997424d090 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.892665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95e40fa-7d39-4bab-a915-40997424d090 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.892665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95e40fa-7d39-4bab-a915-40997424d090 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.893270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95e40fa-7d39-4bab-a915-40997424d090 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.894095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95e40fa-7d39-4bab-a915-40997424d090 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.894864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95e40fa-7d39-4bab-a915-40997424d090 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.942777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:36.947303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:36.952386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.953229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.953830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:36.954562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:36.955008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:36.955420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:37.030517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:37.038775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:37.040265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:37.045411 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c2c7fb9d-0f46-4f4d-b563-152f821fbb16 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1416 microversion: 2.75 time: 0.108587 Oct 11 04:13:37.046163 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 431/814] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:36 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1416 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:37.050782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-93fd5ddd-77f8-4b98-8eec-7b21c3df8aef tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:37.051377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-93fd5ddd-77f8-4b98-8eec-7b21c3df8aef tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:37.057348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93fd5ddd-77f8-4b98-8eec-7b21c3df8aef tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:37.058026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93fd5ddd-77f8-4b98-8eec-7b21c3df8aef tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:37.058669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93fd5ddd-77f8-4b98-8eec-7b21c3df8aef tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:37.059534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93fd5ddd-77f8-4b98-8eec-7b21c3df8aef tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:37.060140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93fd5ddd-77f8-4b98-8eec-7b21c3df8aef tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:37.060716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93fd5ddd-77f8-4b98-8eec-7b21c3df8aef tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:37.157827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-a95e40fa-7d39-4bab-a915-40997424d090 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:13:37.203740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-93fd5ddd-77f8-4b98-8eec-7b21c3df8aef tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:37.210347 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a95e40fa-7d39-4bab-a915-40997424d090 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 2050 microversion: 2.25 time: 0.331419 Oct 11 04:13:37.221872 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-93fd5ddd-77f8-4b98-8eec-7b21c3df8aef tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1322 microversion: 2.1 time: 0.167766 Oct 11 04:13:37.221872 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 432/815] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:37 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:37.221872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40a4ca3d-3e08-4a9e-9484-731e53f05908 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a4f4a60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:37.226709 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 384/816] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:36 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 2050 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:37.235153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7982beec-0bd4-4d85-a549-13a6e748d3ff tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:37.239037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7982beec-0bd4-4d85-a549-13a6e748d3ff tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:37.239445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7982beec-0bd4-4d85-a549-13a6e748d3ff tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:37.244791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7982beec-0bd4-4d85-a549-13a6e748d3ff tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:37.244791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7982beec-0bd4-4d85-a549-13a6e748d3ff tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:37.244791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7982beec-0bd4-4d85-a549-13a6e748d3ff tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:37.245109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7982beec-0bd4-4d85-a549-13a6e748d3ff tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:37.265705 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7982beec-0bd4-4d85-a549-13a6e748d3ff tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.033994 Oct 11 04:13:37.266060 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 385/817] 10.222.0.26 () {60 vars in 1217 bytes} [Tue Oct 11 04:13:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:13:37.277374 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40a4ca3d-3e08-4a9e-9484-731e53f05908 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.060144 Oct 11 04:13:37.278127 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 433/818] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:37 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:37.278817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-de1e4a74-a020-4b86-bfdd-cad86281ab04 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860892-1", "block_migration": "auto"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:37.281341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-de1e4a74-a020-4b86-bfdd-cad86281ab04 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:37.290710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de1e4a74-a020-4b86-bfdd-cad86281ab04 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:37.290710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de1e4a74-a020-4b86-bfdd-cad86281ab04 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:37.290710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de1e4a74-a020-4b86-bfdd-cad86281ab04 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:37.290710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de1e4a74-a020-4b86-bfdd-cad86281ab04 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:37.291549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de1e4a74-a020-4b86-bfdd-cad86281ab04 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:37.291549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de1e4a74-a020-4b86-bfdd-cad86281ab04 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:37.324164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-de1e4a74-a020-4b86-bfdd-cad86281ab04 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'flavor' on Instance uuid 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:13:37.341649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-de1e4a74-a020-4b86-bfdd-cad86281ab04 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Going to try to live migrate instance to n-h2-860892-1 {{(pid=120993) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 04:13:37.640482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32981b10-57df-4141-9c74-880a27fa894b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:37.640991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-32981b10-57df-4141-9c74-880a27fa894b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:37.647771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32981b10-57df-4141-9c74-880a27fa894b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:37.648575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32981b10-57df-4141-9c74-880a27fa894b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:37.649330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32981b10-57df-4141-9c74-880a27fa894b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:37.650497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32981b10-57df-4141-9c74-880a27fa894b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:37.651099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32981b10-57df-4141-9c74-880a27fa894b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:37.651673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32981b10-57df-4141-9c74-880a27fa894b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:37.827210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-32981b10-57df-4141-9c74-880a27fa894b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:37.838567 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-32981b10-57df-4141-9c74-880a27fa894b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1469 microversion: 2.1 time: 0.201822 Oct 11 04:13:37.839846 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 434/819] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:37 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1469 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:37.862626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bbcc3ec4-8744-4a11-907e-4215a1bbaeac tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:37.863692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bbcc3ec4-8744-4a11-907e-4215a1bbaeac tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:37.906073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbcc3ec4-8744-4a11-907e-4215a1bbaeac tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:37.906073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbcc3ec4-8744-4a11-907e-4215a1bbaeac tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:37.906073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbcc3ec4-8744-4a11-907e-4215a1bbaeac tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:37.906073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbcc3ec4-8744-4a11-907e-4215a1bbaeac tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:37.906891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbcc3ec4-8744-4a11-907e-4215a1bbaeac tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:37.906891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbcc3ec4-8744-4a11-907e-4215a1bbaeac tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:37.923779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:38.058351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:38.067045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bbcc3ec4-8744-4a11-907e-4215a1bbaeac tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:38.082498 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bbcc3ec4-8744-4a11-907e-4215a1bbaeac tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1265 microversion: 2.1 time: 0.241347 Oct 11 04:13:38.101592 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 435/820] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:37 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1265 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:38.123820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-669fbf10-4f7a-41d9-ab10-8effeb82b25b req-21cb2669-0511-40c1-89ee-5f35ced590b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e", "name": "network-vif-plugged", "status": "completed", "tag": "b4654310-3e46-4989-977e-9e06fed03db8"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:38.159898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-669fbf10-4f7a-41d9-ab10-8effeb82b25b req-21cb2669-0511-40c1-89ee-5f35ced590b2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:38.159898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-669fbf10-4f7a-41d9-ab10-8effeb82b25b req-21cb2669-0511-40c1-89ee-5f35ced590b2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:38.159898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-669fbf10-4f7a-41d9-ab10-8effeb82b25b req-21cb2669-0511-40c1-89ee-5f35ced590b2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:38.194763 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-669fbf10-4f7a-41d9-ab10-8effeb82b25b req-21cb2669-0511-40c1-89ee-5f35ced590b2 service nova] Creating event network-vif-plugged:b4654310-3e46-4989-977e-9e06fed03db8 for instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e on n-h2-860892-1 Oct 11 04:13:38.207003 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-669fbf10-4f7a-41d9-ab10-8effeb82b25b req-21cb2669-0511-40c1-89ee-5f35ced590b2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092957 Oct 11 04:13:38.210599 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 436/821] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:38.219247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:38.220641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:38.248247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:38.250356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:38.252399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:38.256513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:38.257609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:38.260031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:38.376717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:38.386973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:38.388428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:38.393807 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ddebcfc9-1ecb-4ccb-a7b4-ba69229dfcf9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1416 microversion: 2.75 time: 0.181268 Oct 11 04:13:38.404573 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 437/822] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:38 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1416 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:38.404573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-73708933-59ac-4e5d-98ac-6a6296c13b81 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:38.404573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-73708933-59ac-4e5d-98ac-6a6296c13b81 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:38.415302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73708933-59ac-4e5d-98ac-6a6296c13b81 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:38.415302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73708933-59ac-4e5d-98ac-6a6296c13b81 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:38.415302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73708933-59ac-4e5d-98ac-6a6296c13b81 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:38.415302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73708933-59ac-4e5d-98ac-6a6296c13b81 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:38.415941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73708933-59ac-4e5d-98ac-6a6296c13b81 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:38.415941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73708933-59ac-4e5d-98ac-6a6296c13b81 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:38.620640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-73708933-59ac-4e5d-98ac-6a6296c13b81 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:38.630865 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-73708933-59ac-4e5d-98ac-6a6296c13b81 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1322 microversion: 2.1 time: 0.235145 Oct 11 04:13:38.631784 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 438/823] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:38 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:38.640944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-812932b3-eb57-4c47-8da7-87f425d293fa tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a20e430>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:38.695136 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-812932b3-eb57-4c47-8da7-87f425d293fa tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.062257 Oct 11 04:13:38.697061 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 439/824] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:38 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:38.866469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82b371ad-052e-454f-b734-7a4ca00f93bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:38.867367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82b371ad-052e-454f-b734-7a4ca00f93bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:38.877489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b371ad-052e-454f-b734-7a4ca00f93bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:38.877930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b371ad-052e-454f-b734-7a4ca00f93bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:38.878490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b371ad-052e-454f-b734-7a4ca00f93bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:38.879429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b371ad-052e-454f-b734-7a4ca00f93bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:38.879929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b371ad-052e-454f-b734-7a4ca00f93bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:38.880356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b371ad-052e-454f-b734-7a4ca00f93bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:39.085823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82b371ad-052e-454f-b734-7a4ca00f93bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:39.093877 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82b371ad-052e-454f-b734-7a4ca00f93bd tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1461 microversion: 2.1 time: 0.231555 Oct 11 04:13:39.094787 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 440/825] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:38 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1461 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:39.122549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab794697-b7b2-4b74-9abf-b2cce2bd746c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:39.123318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab794697-b7b2-4b74-9abf-b2cce2bd746c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:39.135242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab794697-b7b2-4b74-9abf-b2cce2bd746c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:39.144482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab794697-b7b2-4b74-9abf-b2cce2bd746c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:39.148392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab794697-b7b2-4b74-9abf-b2cce2bd746c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:39.150670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab794697-b7b2-4b74-9abf-b2cce2bd746c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:39.151280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab794697-b7b2-4b74-9abf-b2cce2bd746c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:39.152038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab794697-b7b2-4b74-9abf-b2cce2bd746c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:39.299056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab794697-b7b2-4b74-9abf-b2cce2bd746c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:39.308041 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab794697-b7b2-4b74-9abf-b2cce2bd746c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1461 microversion: 2.1 time: 0.190885 Oct 11 04:13:39.308896 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 441/826] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:39 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1461 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:39.313496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1de9c4d5-68ce-4dbe-aceb-73f4c5494274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:39.314550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1de9c4d5-68ce-4dbe-aceb-73f4c5494274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:39.322076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1de9c4d5-68ce-4dbe-aceb-73f4c5494274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:39.322984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1de9c4d5-68ce-4dbe-aceb-73f4c5494274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:39.323487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1de9c4d5-68ce-4dbe-aceb-73f4c5494274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:39.324671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1de9c4d5-68ce-4dbe-aceb-73f4c5494274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:39.325197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1de9c4d5-68ce-4dbe-aceb-73f4c5494274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:39.325713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1de9c4d5-68ce-4dbe-aceb-73f4c5494274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:39.438733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1de9c4d5-68ce-4dbe-aceb-73f4c5494274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:39.451856 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1de9c4d5-68ce-4dbe-aceb-73f4c5494274 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1273 microversion: 2.1 time: 0.141793 Oct 11 04:13:39.453013 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 442/827] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:39 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:39.457635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e5e61595-580a-40b0-8417-be6bca507447 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Action: 'create', calling method: .version_select at 0x7fda1a4f4af0>, body: {"keypair": {"name": "tempest-keypair-60156363", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBODb+dXFaTf/L1hEZvF5BV82lWSDFVSgPS2HFQnCVQbSJDQc3xvGFaLJD93PsudzbH6gSpxaSPFuatN+6CkMrkZWY4vSZsXJRILtkoSrc9bkkurep3PZHjqr+Sjl+G5Fuw=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:39.491608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-e5e61595-580a-40b0-8417-be6bca507447 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:13:39.493883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-e5e61595-580a-40b0-8417-be6bca507447 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for user a1df373e8ec14e2a84f0b8a62e0b884a and project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:13:39.616140 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e5e61595-580a-40b0-8417-be6bca507447 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.161942 Oct 11 04:13:39.623819 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 443/828] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:13:39 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:39.645078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:39.650711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:39.700098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:39.700596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:39.701034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:39.706304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:39.706304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:39.706304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:39.799900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:39.815360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:39.816873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:39.824891 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4b492f49-ca75-4f69-82ca-4ce3981139f0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1416 microversion: 2.75 time: 0.204689 Oct 11 04:13:39.838368 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 444/829] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:39 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1416 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:39.838368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43b3bf32-5ebf-4b4f-b81b-ea56c7a3a5aa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:39.838368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-43b3bf32-5ebf-4b4f-b81b-ea56c7a3a5aa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:39.845591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43b3bf32-5ebf-4b4f-b81b-ea56c7a3a5aa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:39.846471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43b3bf32-5ebf-4b4f-b81b-ea56c7a3a5aa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:39.847099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43b3bf32-5ebf-4b4f-b81b-ea56c7a3a5aa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:39.848015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43b3bf32-5ebf-4b4f-b81b-ea56c7a3a5aa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:39.848634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43b3bf32-5ebf-4b4f-b81b-ea56c7a3a5aa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:39.849352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43b3bf32-5ebf-4b4f-b81b-ea56c7a3a5aa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:40.076117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-43b3bf32-5ebf-4b4f-b81b-ea56c7a3a5aa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:40.084946 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-43b3bf32-5ebf-4b4f-b81b-ea56c7a3a5aa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1322 microversion: 2.1 time: 0.258003 Oct 11 04:13:40.085943 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 445/830] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:39 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:40.093002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-016facda-9029-460b-8ce4-cffdc115d48f tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a3090d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:40.149978 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-016facda-9029-460b-8ce4-cffdc115d48f tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.061414 Oct 11 04:13:40.151205 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 446/831] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:40 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:40.256956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1ed83034-3087-4765-b94c-ad9b3ba79628 req-c448ddd7-42ec-4821-a4cf-e2a2c71acbd3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa356b6-3b84-4022-b47c-35239eaeb5c3", "name": "network-vif-plugged", "status": "completed", "tag": "c9c070fc-a59c-46ad-8b25-4293eab123bc"}, {"server_uuid": "3c1ce880-49a7-475d-9f7c-a04705d0d35c", "name": "network-vif-plugged", "status": "completed", "tag": "5ac5d34a-b5ac-44e2-a066-af84d17457a2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:40.269049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1ed83034-3087-4765-b94c-ad9b3ba79628 req-c448ddd7-42ec-4821-a4cf-e2a2c71acbd3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:40.269526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1ed83034-3087-4765-b94c-ad9b3ba79628 req-c448ddd7-42ec-4821-a4cf-e2a2c71acbd3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:40.270034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1ed83034-3087-4765-b94c-ad9b3ba79628 req-c448ddd7-42ec-4821-a4cf-e2a2c71acbd3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:40.462102 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1ed83034-3087-4765-b94c-ad9b3ba79628 req-c448ddd7-42ec-4821-a4cf-e2a2c71acbd3 service nova] Creating event network-vif-plugged:c9c070fc-a59c-46ad-8b25-4293eab123bc for instance afa356b6-3b84-4022-b47c-35239eaeb5c3 on n-h1-860892-1 Oct 11 04:13:40.462628 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1ed83034-3087-4765-b94c-ad9b3ba79628 req-c448ddd7-42ec-4821-a4cf-e2a2c71acbd3 service nova] Creating event network-vif-plugged:5ac5d34a-b5ac-44e2-a066-af84d17457a2 for instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c on n-h2-860892-1 Oct 11 04:13:40.475100 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1ed83034-3087-4765-b94c-ad9b3ba79628 req-c448ddd7-42ec-4821-a4cf-e2a2c71acbd3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.232481 Oct 11 04:13:40.475842 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 447/832] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:40 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:13:40.480993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b950ed08-72e4-4f3a-abec-88a2121305b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:40.481860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b950ed08-72e4-4f3a-abec-88a2121305b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:40.489497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b950ed08-72e4-4f3a-abec-88a2121305b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:40.489497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b950ed08-72e4-4f3a-abec-88a2121305b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:40.489733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b950ed08-72e4-4f3a-abec-88a2121305b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:40.490445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b950ed08-72e4-4f3a-abec-88a2121305b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:40.490873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b950ed08-72e4-4f3a-abec-88a2121305b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:40.491681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b950ed08-72e4-4f3a-abec-88a2121305b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:40.593460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b950ed08-72e4-4f3a-abec-88a2121305b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:40.607143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b950ed08-72e4-4f3a-abec-88a2121305b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1271 microversion: 2.1 time: 0.129957 Oct 11 04:13:40.608223 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 448/833] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:40 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1271 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:40.855621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:40.856252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:40.863649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:40.864148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:40.864591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:40.865297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:40.865750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:40.866176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:40.951583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:40.959738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:40.961252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:40.968031 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-200b87f2-05eb-4888-8295-53e81df7cf71 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1437 microversion: 2.75 time: 0.116361 Oct 11 04:13:40.982425 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 449/834] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:40 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1437 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:41.004216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:41.007702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:41.015741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:41.016762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:41.017074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:41.017869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:41.018414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:41.020138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:41.123875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:13:41.123875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:13:41.123875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:13:41.123875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:13:41.123875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:13:41.669147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:41.681093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:41.683967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:41.700745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:41.706476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:41.707202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:41.708649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:41.863441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:41.878599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:41.880620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:41.890917 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-68af01c6-91ae-4178-8384-5682c138fc02 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "POST /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251/action" status: 202 len: 1494 microversion: 2.75 time: 0.893775 Oct 11 04:13:41.891568 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 450/835] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:13:40 2022] POST /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251/action => generated 1494 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 04:13:41.917850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-24ca9e08-a6f4-4ad5-9ba2-47bb3b630aab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:41.921322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-24ca9e08-a6f4-4ad5-9ba2-47bb3b630aab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:41.937868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24ca9e08-a6f4-4ad5-9ba2-47bb3b630aab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:41.938406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24ca9e08-a6f4-4ad5-9ba2-47bb3b630aab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:41.940037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24ca9e08-a6f4-4ad5-9ba2-47bb3b630aab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:41.940786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24ca9e08-a6f4-4ad5-9ba2-47bb3b630aab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:41.942491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24ca9e08-a6f4-4ad5-9ba2-47bb3b630aab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:41.942933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24ca9e08-a6f4-4ad5-9ba2-47bb3b630aab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:42.019924 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-de1e4a74-a020-4b86-bfdd-cad86281ab04 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821/action" status: 202 len: 0 microversion: 2.25 time: 4.740139 Oct 11 04:13:42.023104 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 386/836] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:13:37 2022] POST /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821/action => generated 0 bytes in 4749 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:13:42.046173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d9f73879-f813-4026-b46e-20b0bdf3b6cb tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a797820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:42.162158 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d9f73879-f813-4026-b46e-20b0bdf3b6cb tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.133218 Oct 11 04:13:42.163009 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 387/837] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:42 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:42.187013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7f283187-f2b3-463e-9758-285b9049abb6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:42.188333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7f283187-f2b3-463e-9758-285b9049abb6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:42.208364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f283187-f2b3-463e-9758-285b9049abb6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:42.208860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f283187-f2b3-463e-9758-285b9049abb6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:42.209294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f283187-f2b3-463e-9758-285b9049abb6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:42.212305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f283187-f2b3-463e-9758-285b9049abb6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:42.212755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f283187-f2b3-463e-9758-285b9049abb6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:42.215339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f283187-f2b3-463e-9758-285b9049abb6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:42.265246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-24ca9e08-a6f4-4ad5-9ba2-47bb3b630aab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:42.281134 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-24ca9e08-a6f4-4ad5-9ba2-47bb3b630aab tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1516 microversion: 2.1 time: 0.388496 Oct 11 04:13:42.283633 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 451/838] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:41 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1516 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:42.294791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:42.299104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:42.313299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:42.316112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:42.316639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:42.319524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:42.320943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:42.321409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:42.440069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:42.453041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:42.455304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:42.487999 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-259f43d0-ee7a-4f70-9d09-5a2836df2b95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.202505 Oct 11 04:13:42.506585 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 452/839] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:42 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:42.506585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:42.507940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:42.526061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:42.526877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:42.527347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:42.528109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:42.529459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:42.529459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:42.789861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7f283187-f2b3-463e-9758-285b9049abb6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:42.793956 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7f283187-f2b3-463e-9758-285b9049abb6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1313 microversion: 2.1 time: 0.616965 Oct 11 04:13:42.795140 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 388/840] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:42 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:42.800237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:42.812831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:42.815822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:42.818249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8ebbb79-0d75-4344-b51a-6de6fcb61785 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:42.819899 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-21f12e0b-9bc4-4a14-b925-13981913c414 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1567 microversion: 2.25 time: 0.328217 Oct 11 04:13:42.823721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d8ebbb79-0d75-4344-b51a-6de6fcb61785 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:42.824151 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 453/841] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:42 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1567 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:42.831716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8ebbb79-0d75-4344-b51a-6de6fcb61785 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:42.832466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8ebbb79-0d75-4344-b51a-6de6fcb61785 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:42.833431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8ebbb79-0d75-4344-b51a-6de6fcb61785 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:42.834324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8ebbb79-0d75-4344-b51a-6de6fcb61785 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:42.834957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8ebbb79-0d75-4344-b51a-6de6fcb61785 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:42.836874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8ebbb79-0d75-4344-b51a-6de6fcb61785 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:42.870848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-d8ebbb79-0d75-4344-b51a-6de6fcb61785 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lazy-loading 'flavor' on Instance uuid f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:13:43.180429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f5358d4-a3b1-471a-9632-6722922b2249 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a20e700>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:43.238249 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8ebbb79-0d75-4344-b51a-6de6fcb61785 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "POST /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e/action" status: 200 len: 32 microversion: 2.1 time: 0.425181 Oct 11 04:13:43.239086 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 389/842] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:13:42 2022] POST /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e/action => generated 32 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:13:43.249619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-74ae1109-b111-4836-88f6-fefbdaa421f0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:43.251094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-74ae1109-b111-4836-88f6-fefbdaa421f0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:43.262720 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6f5358d4-a3b1-471a-9632-6722922b2249 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.087670 Oct 11 04:13:43.263304 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 454/843] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:43 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:43.281392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ae1109-b111-4836-88f6-fefbdaa421f0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:43.282088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ae1109-b111-4836-88f6-fefbdaa421f0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:43.282720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ae1109-b111-4836-88f6-fefbdaa421f0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:43.286579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ae1109-b111-4836-88f6-fefbdaa421f0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:43.286579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ae1109-b111-4836-88f6-fefbdaa421f0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:43.286579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ae1109-b111-4836-88f6-fefbdaa421f0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:43.519255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:43.519891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:43.529435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:43.529932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:43.530393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:43.533818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:43.534734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:43.538052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:43.543689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:43.651934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:43.667112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:43.669190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:43.676933 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b6ec797-4b09-4a01-9b20-58451631ac31 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.161366 Oct 11 04:13:43.678764 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 455/844] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:43 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:43.781663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-74ae1109-b111-4836-88f6-fefbdaa421f0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:43.792712 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-74ae1109-b111-4836-88f6-fefbdaa421f0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.547671 Oct 11 04:13:43.793874 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 390/845] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:43 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:43.818466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0e7cf77f-bebe-43b4-a209-9c43d51c32b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:43.819377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0e7cf77f-bebe-43b4-a209-9c43d51c32b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:43.827120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e7cf77f-bebe-43b4-a209-9c43d51c32b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:43.827794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e7cf77f-bebe-43b4-a209-9c43d51c32b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:43.828329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e7cf77f-bebe-43b4-a209-9c43d51c32b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:43.829311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e7cf77f-bebe-43b4-a209-9c43d51c32b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:43.829838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e7cf77f-bebe-43b4-a209-9c43d51c32b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:43.830784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e7cf77f-bebe-43b4-a209-9c43d51c32b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:43.848513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:43.849132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:43.863052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:43.863530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:43.863985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:43.864683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:43.865147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:43.865566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:43.877012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:43.989711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0e7cf77f-bebe-43b4-a209-9c43d51c32b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:43.999215 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0e7cf77f-bebe-43b4-a209-9c43d51c32b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1313 microversion: 2.1 time: 0.184623 Oct 11 04:13:44.000114 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 456/846] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:43 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1313 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:44.021653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f0949d03-156b-4bc1-bf58-8d1251976355 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Calling method '.version_select at 0x7fda1a76b040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:44.026997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0949d03-156b-4bc1-bf58-8d1251976355 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:44.027588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0949d03-156b-4bc1-bf58-8d1251976355 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:44.028148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0949d03-156b-4bc1-bf58-8d1251976355 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:44.041972 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f0949d03-156b-4bc1-bf58-8d1251976355 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1186 microversion: 2.1 time: 0.030281 Oct 11 04:13:44.046249 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 457/847] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:13:43 2022] GET /compute/v2.1/os-migrations => generated 1186 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:44.070283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36737dac-77ed-4c98-bae3-9fde6c01cc52 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:44.080424 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-36737dac-77ed-4c98-bae3-9fde6c01cc52 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.015271 Oct 11 04:13:44.091764 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 458/848] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:13:44 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:44.098013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3e6cf17f-3d64-4288-a44d-6f63753315bf tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Action: 'create', calling method: >, body: {"flavor": {"name": "tempest-test_resize_flavor_-1276527591", "ram": 1024, "disk": 1, "vcpus": 1}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:44.166021 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3e6cf17f-3d64-4288-a44d-6f63753315bf tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 499 microversion: 2.1 time: 0.072553 Oct 11 04:13:44.173436 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 459/849] 10.222.0.26 () {60 vars in 1146 bytes} [Tue Oct 11 04:13:44 2022] POST /compute/v2.1/flavors => generated 499 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:44.182085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-76ab4c59-95e0-4945-9365-c75b09c60fd3 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:44.201260 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-76ab4c59-95e0-4945-9365-c75b09c60fd3 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.1 time: 0.026307 Oct 11 04:13:44.202018 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 460/850] 10.222.0.26 () {58 vars in 1182 bytes} [Tue Oct 11 04:13:44 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:13:44.280023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4e997b56-09d0-4535-8046-5c00e6b040ab tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a678a60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:44.302001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=20 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:44.331212 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4e997b56-09d0-4535-8046-5c00e6b040ab tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.055282 Oct 11 04:13:44.332159 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 461/851] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:44 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:44.337758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-189947960", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "fe2a745e-1776-4dd3-81a0-0a7f24d36592"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:44.398417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:13:44.831247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:44.850166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:44.863536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:44.864855 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c64f1405-eaaa-4bc7-9b73-27d99da2b391 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1567 microversion: 2.25 time: 1.020340 Oct 11 04:13:44.897139 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 391/852] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:43 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1567 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:44.903034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-285e1e27-f009-4fa3-b0d0-e3cd2bc39de5 req-66f40ca1-1d67-458a-b5a1-173f32eff00a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2078125-aecf-40d1-9ea7-cf38ca95c2b4", "tag": "14238ed7-9517-4b09-8d5d-05820caebb7d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:44.930526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-285e1e27-f009-4fa3-b0d0-e3cd2bc39de5 req-66f40ca1-1d67-458a-b5a1-173f32eff00a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:44.931503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-285e1e27-f009-4fa3-b0d0-e3cd2bc39de5 req-66f40ca1-1d67-458a-b5a1-173f32eff00a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:44.932236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-285e1e27-f009-4fa3-b0d0-e3cd2bc39de5 req-66f40ca1-1d67-458a-b5a1-173f32eff00a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:44.959204 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-285e1e27-f009-4fa3-b0d0-e3cd2bc39de5 req-66f40ca1-1d67-458a-b5a1-173f32eff00a service nova] Creating event network-changed:14238ed7-9517-4b09-8d5d-05820caebb7d for instance a2078125-aecf-40d1-9ea7-cf38ca95c2b4 on n-h1-860892-1 Oct 11 04:13:44.972760 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-285e1e27-f009-4fa3-b0d0-e3cd2bc39de5 req-66f40ca1-1d67-458a-b5a1-173f32eff00a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073809 Oct 11 04:13:44.974436 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 392/853] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:44.988038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:44.993631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:44.997142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:13:44.998092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:13:44.999069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:13:44.999643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:13:45.000215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:13:45.002937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:45.003698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:45.004505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:45.005407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:45.005930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:45.007219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:45.012830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:45.013518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:45.014120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:45.015529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:45.016001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:45.016542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:45.040537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:13:45.043163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:45.046810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for user a1df373e8ec14e2a84f0b8a62e0b884a and project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:13:45.065241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:13:45.068751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:13:45.212890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:45.241747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:45.246814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:45.250507 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d61d8860-62df-4df4-8c52-152855c43db4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.916906 Oct 11 04:13:45.253756 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-911661fb-d943-49c1-994c-dd7d0e83574a tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.275123 Oct 11 04:13:45.256565 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 393/855] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:44 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:45.260873 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 462/855] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:13:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:13:45.263466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3ed2897-8050-4f88-83b2-4a0f25db4dee tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:45.264715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3ed2897-8050-4f88-83b2-4a0f25db4dee tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:45.272240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ed2897-8050-4f88-83b2-4a0f25db4dee tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:45.273174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ed2897-8050-4f88-83b2-4a0f25db4dee tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:45.274730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ed2897-8050-4f88-83b2-4a0f25db4dee tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:45.276522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ed2897-8050-4f88-83b2-4a0f25db4dee tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:45.277222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ed2897-8050-4f88-83b2-4a0f25db4dee tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:45.277958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ed2897-8050-4f88-83b2-4a0f25db4dee tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:45.283253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13f5a4a6-7dbd-477b-9f98-d2494ea6fa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:45.283885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-13f5a4a6-7dbd-477b-9f98-d2494ea6fa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:45.293730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13f5a4a6-7dbd-477b-9f98-d2494ea6fa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:45.293730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13f5a4a6-7dbd-477b-9f98-d2494ea6fa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:45.293730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13f5a4a6-7dbd-477b-9f98-d2494ea6fa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:45.293730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13f5a4a6-7dbd-477b-9f98-d2494ea6fa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:45.294271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13f5a4a6-7dbd-477b-9f98-d2494ea6fa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:45.294703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13f5a4a6-7dbd-477b-9f98-d2494ea6fa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:45.532985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-13f5a4a6-7dbd-477b-9f98-d2494ea6fa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:45.548319 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-13f5a4a6-7dbd-477b-9f98-d2494ea6fa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1313 microversion: 2.1 time: 0.288987 Oct 11 04:13:45.548921 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 463/856] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:45 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1313 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:45.566152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-101267e5-09fd-4480-8a6f-a91b9ac7e5da tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:45.566803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-101267e5-09fd-4480-8a6f-a91b9ac7e5da tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:45.634985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-101267e5-09fd-4480-8a6f-a91b9ac7e5da tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:45.644616 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-101267e5-09fd-4480-8a6f-a91b9ac7e5da tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1278 microversion: 2.1 time: 0.094638 Oct 11 04:13:45.645192 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 464/857] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:45 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:45.662758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27a829c3-a1e7-4953-8ace-876564048895 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1aa28820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:45.715747 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-27a829c3-a1e7-4953-8ace-876564048895 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.069206 Oct 11 04:13:45.725892 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 465/858] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:45 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:45.752052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e3ed2897-8050-4f88-83b2-4a0f25db4dee tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:45.767706 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3ed2897-8050-4f88-83b2-4a0f25db4dee tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.508188 Oct 11 04:13:45.772288 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 394/859] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:45 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:45.897439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:45.900689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:45.909382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:45.910180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:45.910727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:45.911537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:45.912240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:45.912918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:46.091750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:46.102684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:46.104581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:46.105957 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3721b09d-73a5-4a6f-a411-d1f6e059fc40 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1567 microversion: 2.25 time: 0.213131 Oct 11 04:13:46.106734 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 466/860] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:45 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1567 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:46.310643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:46.310643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:46.310643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:46.310643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:46.311621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:46.311621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:46.311621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:46.311621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:46.366071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:46.374889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:46.376324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:46.381409 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e5611862-0c75-4c30-84c9-82a06de45de5 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.096155 Oct 11 04:13:46.388322 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 395/861] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:46 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:46.573314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dccbf604-47f8-4f1a-8c7f-d5e7f9e1070d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:46.573973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dccbf604-47f8-4f1a-8c7f-d5e7f9e1070d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:46.581222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dccbf604-47f8-4f1a-8c7f-d5e7f9e1070d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:46.581697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dccbf604-47f8-4f1a-8c7f-d5e7f9e1070d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:46.582291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dccbf604-47f8-4f1a-8c7f-d5e7f9e1070d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:46.583118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dccbf604-47f8-4f1a-8c7f-d5e7f9e1070d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:46.583634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dccbf604-47f8-4f1a-8c7f-d5e7f9e1070d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:46.584130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dccbf604-47f8-4f1a-8c7f-d5e7f9e1070d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:46.669377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41b53bbc-bfb3-4961-8317-d5f6a1a3af36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:46.670129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-41b53bbc-bfb3-4961-8317-d5f6a1a3af36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:46.763516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-41b53bbc-bfb3-4961-8317-d5f6a1a3af36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:46.771080 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41b53bbc-bfb3-4961-8317-d5f6a1a3af36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1278 microversion: 2.1 time: 0.105866 Oct 11 04:13:46.788582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dccbf604-47f8-4f1a-8c7f-d5e7f9e1070d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:46.791205 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 396/862] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:46 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1278 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:46.796115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-399b501a-cc69-487b-bb45-ce97b8dbc979 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a0d7ca0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:46.797958 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dccbf604-47f8-4f1a-8c7f-d5e7f9e1070d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1313 microversion: 2.1 time: 0.229749 Oct 11 04:13:46.798908 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 467/863] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:46 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1313 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:46.803704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d6699e15-d2c0-4e35-b594-3104638c744b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:46.804823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d6699e15-d2c0-4e35-b594-3104638c744b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:46.817866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6699e15-d2c0-4e35-b594-3104638c744b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:46.818700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6699e15-d2c0-4e35-b594-3104638c744b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:46.819294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6699e15-d2c0-4e35-b594-3104638c744b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:46.820147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6699e15-d2c0-4e35-b594-3104638c744b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:46.821266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6699e15-d2c0-4e35-b594-3104638c744b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:46.821845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6699e15-d2c0-4e35-b594-3104638c744b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:46.905884 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-399b501a-cc69-487b-bb45-ce97b8dbc979 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.113439 Oct 11 04:13:46.906912 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 397/864] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:46 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:47.003922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-64106bff-8d29-4884-9a25-d3fa77f6e514 req-2c8d118d-b80d-4878-b71b-a5c065ae77f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a565eb-1de8-4b6b-bd27-ba53e0d9a821", "name": "network-vif-unplugged", "status": "completed", "tag": "4d8dc49c-bed9-4a3b-8d71-e5f1ed05cb39"}, {"name": "network-changed", "server_uuid": "63a565eb-1de8-4b6b-bd27-ba53e0d9a821", "tag": "4d8dc49c-bed9-4a3b-8d71-e5f1ed05cb39"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:47.025154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d6699e15-d2c0-4e35-b594-3104638c744b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:47.027125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-64106bff-8d29-4884-9a25-d3fa77f6e514 req-2c8d118d-b80d-4878-b71b-a5c065ae77f5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:47.028055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-64106bff-8d29-4884-9a25-d3fa77f6e514 req-2c8d118d-b80d-4878-b71b-a5c065ae77f5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:47.032199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-64106bff-8d29-4884-9a25-d3fa77f6e514 req-2c8d118d-b80d-4878-b71b-a5c065ae77f5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:47.036029 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d6699e15-d2c0-4e35-b594-3104638c744b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.235616 Oct 11 04:13:47.037137 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 468/865] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:46 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:47.066962 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-64106bff-8d29-4884-9a25-d3fa77f6e514 req-2c8d118d-b80d-4878-b71b-a5c065ae77f5 service nova] Creating event network-vif-unplugged:4d8dc49c-bed9-4a3b-8d71-e5f1ed05cb39 for instance 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 on n-h1-860892-1 Oct 11 04:13:47.067808 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-64106bff-8d29-4884-9a25-d3fa77f6e514 req-2c8d118d-b80d-4878-b71b-a5c065ae77f5 service nova] Creating event network-changed:4d8dc49c-bed9-4a3b-8d71-e5f1ed05cb39 for instance 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 on n-h1-860892-1 Oct 11 04:13:47.075932 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-64106bff-8d29-4884-9a25-d3fa77f6e514 req-2c8d118d-b80d-4878-b71b-a5c065ae77f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.076340 Oct 11 04:13:47.077416 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 398/866] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:46 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:47.134777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:47.135954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:47.147506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:47.148919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:47.150713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:47.151611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:47.154296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:47.154904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:47.355609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:47.364622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:47.369762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:47.369762 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a18f9a3b-c70f-47cd-94d0-16b26e044276 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1567 microversion: 2.25 time: 0.237730 Oct 11 04:13:47.378102 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 469/867] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:47 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1567 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:47.409684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:47.410484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:47.417020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:47.419712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:47.420297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:47.420734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:47.421534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:47.422090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:47.422608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:47.494675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:47.506423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:47.519349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:47.528998 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b351befd-64d4-4eb6-bb83-9c1663dec6ce tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.123787 Oct 11 04:13:47.529876 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 399/868] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:47 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:47.796705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-086563e9-8db1-49d2-86ac-d7177cb7f448 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:47.797589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-086563e9-8db1-49d2-86ac-d7177cb7f448 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:47.805145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-086563e9-8db1-49d2-86ac-d7177cb7f448 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:47.805828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-086563e9-8db1-49d2-86ac-d7177cb7f448 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:47.806628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-086563e9-8db1-49d2-86ac-d7177cb7f448 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:47.807554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-086563e9-8db1-49d2-86ac-d7177cb7f448 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:47.808703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-086563e9-8db1-49d2-86ac-d7177cb7f448 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:47.809224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-086563e9-8db1-49d2-86ac-d7177cb7f448 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:47.824865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bb0540c2-06f0-4236-b77c-4f25695cbf0f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:47.826033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bb0540c2-06f0-4236-b77c-4f25695cbf0f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:47.834990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb0540c2-06f0-4236-b77c-4f25695cbf0f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:47.835993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb0540c2-06f0-4236-b77c-4f25695cbf0f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:47.837030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb0540c2-06f0-4236-b77c-4f25695cbf0f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:47.837966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb0540c2-06f0-4236-b77c-4f25695cbf0f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:47.838785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb0540c2-06f0-4236-b77c-4f25695cbf0f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:47.839448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb0540c2-06f0-4236-b77c-4f25695cbf0f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:47.885727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-086563e9-8db1-49d2-86ac-d7177cb7f448 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:47.893874 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-086563e9-8db1-49d2-86ac-d7177cb7f448 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1330 microversion: 2.1 time: 0.101053 Oct 11 04:13:47.894935 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 470/869] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:47 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:47.922843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65eaf64d-e27a-4d84-bba2-941635c153a4 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a7f6f70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:47.980185 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-65eaf64d-e27a-4d84-bba2-941635c153a4 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.061306 Oct 11 04:13:47.988551 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 471/870] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:47 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:48.015863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb0540c2-06f0-4236-b77c-4f25695cbf0f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:48.024543 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bb0540c2-06f0-4236-b77c-4f25695cbf0f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1313 microversion: 2.1 time: 0.206242 Oct 11 04:13:48.025107 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 400/871] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:47 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1313 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:48.064645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c556e6f-4d09-4527-952e-1ea57dae2927 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:48.065560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2c556e6f-4d09-4527-952e-1ea57dae2927 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:48.071919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c556e6f-4d09-4527-952e-1ea57dae2927 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:48.072613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c556e6f-4d09-4527-952e-1ea57dae2927 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:48.072886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c556e6f-4d09-4527-952e-1ea57dae2927 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:48.073754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c556e6f-4d09-4527-952e-1ea57dae2927 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:48.074221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c556e6f-4d09-4527-952e-1ea57dae2927 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:48.074766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c556e6f-4d09-4527-952e-1ea57dae2927 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:48.232417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2c556e6f-4d09-4527-952e-1ea57dae2927 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:48.245641 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c556e6f-4d09-4527-952e-1ea57dae2927 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.184767 Oct 11 04:13:48.256334 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 472/872] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:48 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:48.402942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:48.406047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:48.418870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:48.420599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:48.421307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:48.423004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:48.425172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:48.428768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:48.561871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:48.562942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:48.578265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:48.579954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:48.579954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:48.580660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:48.581321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:48.582225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:48.660937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:48.672518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:48.674605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:48.680180 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9ce373e6-64cc-4026-8994-cea3eaaf50a7 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.122281 Oct 11 04:13:48.699186 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 473/873] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:48 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:48.725515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:48.739103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:48.743720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:48.745152 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5311aa59-14db-4de4-ae61-9ca2034474f4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1567 microversion: 2.25 time: 0.353320 Oct 11 04:13:48.746028 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 401/874] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:48 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1567 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:48.917395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea4c5f67-780c-41ac-bf55-9c841312fa0a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:48.918470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea4c5f67-780c-41ac-bf55-9c841312fa0a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:48.926397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea4c5f67-780c-41ac-bf55-9c841312fa0a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:48.931842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea4c5f67-780c-41ac-bf55-9c841312fa0a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:48.931842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea4c5f67-780c-41ac-bf55-9c841312fa0a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:48.931842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea4c5f67-780c-41ac-bf55-9c841312fa0a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:48.931842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea4c5f67-780c-41ac-bf55-9c841312fa0a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:48.932202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea4c5f67-780c-41ac-bf55-9c841312fa0a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:48.997136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ea4c5f67-780c-41ac-bf55-9c841312fa0a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:48.997401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0283ff6c-b1f5-4614-ad5d-0562c46d9d54 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19ea65e0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:49.007199 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea4c5f67-780c-41ac-bf55-9c841312fa0a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1336 microversion: 2.1 time: 0.093721 Oct 11 04:13:49.010649 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 474/875] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:48 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1336 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:49.047850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-366ec70d-bd17-4740-a458-8721963fbca4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:49.048590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-366ec70d-bd17-4740-a458-8721963fbca4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:49.054766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-366ec70d-bd17-4740-a458-8721963fbca4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:49.055264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-366ec70d-bd17-4740-a458-8721963fbca4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:49.055768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-366ec70d-bd17-4740-a458-8721963fbca4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:49.056475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-366ec70d-bd17-4740-a458-8721963fbca4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:49.056944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-366ec70d-bd17-4740-a458-8721963fbca4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:49.057363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-366ec70d-bd17-4740-a458-8721963fbca4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:49.060454 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0283ff6c-b1f5-4614-ad5d-0562c46d9d54 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.067189 Oct 11 04:13:49.074851 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 402/876] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:48 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:49.231067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-366ec70d-bd17-4740-a458-8721963fbca4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:49.243177 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-366ec70d-bd17-4740-a458-8721963fbca4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1313 microversion: 2.1 time: 0.197347 Oct 11 04:13:49.258212 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 475/877] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:49 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1313 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:49.272353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fd2f619e-853a-46e1-b741-75650aae58ca tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:49.273844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fd2f619e-853a-46e1-b741-75650aae58ca tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:49.283237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd2f619e-853a-46e1-b741-75650aae58ca tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:49.283973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd2f619e-853a-46e1-b741-75650aae58ca tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:49.285412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd2f619e-853a-46e1-b741-75650aae58ca tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:49.286384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd2f619e-853a-46e1-b741-75650aae58ca tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:49.287048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd2f619e-853a-46e1-b741-75650aae58ca tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:49.287681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd2f619e-853a-46e1-b741-75650aae58ca tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:49.647548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fd2f619e-853a-46e1-b741-75650aae58ca tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:49.656158 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fd2f619e-853a-46e1-b741-75650aae58ca tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.391122 Oct 11 04:13:49.658741 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 403/878] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:49 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:49.714534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:49.715198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:49.721392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:49.721991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:49.722471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:49.723267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:49.723755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:49.724183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:49.771870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:49.772837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:49.785233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:49.786033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:49.787636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:49.788560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:49.791005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:49.791667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:49.799096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:49.898017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:49.900198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:49.912586 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9aedc806-34e8-4dbc-866c-18925b7457fa tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.202826 Oct 11 04:13:49.919436 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 476/879] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:49 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:50.031673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ded155d5-d92b-44b2-be32-035a93602714 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:50.032715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ded155d5-d92b-44b2-be32-035a93602714 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:50.045080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded155d5-d92b-44b2-be32-035a93602714 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:50.045728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded155d5-d92b-44b2-be32-035a93602714 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:50.046294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded155d5-d92b-44b2-be32-035a93602714 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:50.047097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded155d5-d92b-44b2-be32-035a93602714 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:50.048969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded155d5-d92b-44b2-be32-035a93602714 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:50.077848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded155d5-d92b-44b2-be32-035a93602714 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:50.252658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ded155d5-d92b-44b2-be32-035a93602714 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:50.262020 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ded155d5-d92b-44b2-be32-035a93602714 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1378 microversion: 2.1 time: 0.234159 Oct 11 04:13:50.263070 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 477/880] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:50 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1378 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:50.278911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5f1000f6-2996-479e-9a5e-bdca5ad577f1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a315e50>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:50.337333 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5f1000f6-2996-479e-9a5e-bdca5ad577f1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.061735 Oct 11 04:13:50.338038 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 478/881] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:50 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:50.343883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-73512d47-9ef7-4147-81d8-09132e66f891 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:50.344714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-73512d47-9ef7-4147-81d8-09132e66f891 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:50.352548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73512d47-9ef7-4147-81d8-09132e66f891 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:50.354844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73512d47-9ef7-4147-81d8-09132e66f891 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:50.355992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73512d47-9ef7-4147-81d8-09132e66f891 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:50.356788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73512d47-9ef7-4147-81d8-09132e66f891 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:50.357324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73512d47-9ef7-4147-81d8-09132e66f891 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:50.357813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73512d47-9ef7-4147-81d8-09132e66f891 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:50.518004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-73512d47-9ef7-4147-81d8-09132e66f891 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:50.529708 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-73512d47-9ef7-4147-81d8-09132e66f891 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1313 microversion: 2.1 time: 0.190071 Oct 11 04:13:50.530803 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 479/882] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:50 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:50.566232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:50.575641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:50.577428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:50.578718 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6c04f476-8b9a-44f3-b412-4671887304eb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1567 microversion: 2.25 time: 0.811941 Oct 11 04:13:50.579511 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 404/883] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:49 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1567 bytes in 813 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:50.679411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8b587e58-7be7-4a4d-b1b7-311cc6c1199e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:50.680788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8b587e58-7be7-4a4d-b1b7-311cc6c1199e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:50.693630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b587e58-7be7-4a4d-b1b7-311cc6c1199e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:50.694106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b587e58-7be7-4a4d-b1b7-311cc6c1199e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:50.694570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b587e58-7be7-4a4d-b1b7-311cc6c1199e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:50.695304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b587e58-7be7-4a4d-b1b7-311cc6c1199e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:50.695747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b587e58-7be7-4a4d-b1b7-311cc6c1199e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:50.696163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b587e58-7be7-4a4d-b1b7-311cc6c1199e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:50.833102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8b587e58-7be7-4a4d-b1b7-311cc6c1199e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:50.853928 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8b587e58-7be7-4a4d-b1b7-311cc6c1199e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.178308 Oct 11 04:13:50.855558 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 480/884] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:50 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:50.957527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:50.958486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:50.970347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:50.971301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:50.976255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:50.977202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:50.977836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:50.978578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:51.125456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:51.153535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:51.155260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:51.167360 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-be3230fd-a65b-4860-9718-ce7b39980229 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.213698 Oct 11 04:13:51.167949 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 405/885] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:50 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:51.290264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af6e6dae-8dab-471a-b7bb-d4e45241d9dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:51.292196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af6e6dae-8dab-471a-b7bb-d4e45241d9dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:51.307032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6e6dae-8dab-471a-b7bb-d4e45241d9dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:51.307798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6e6dae-8dab-471a-b7bb-d4e45241d9dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:51.308321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6e6dae-8dab-471a-b7bb-d4e45241d9dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:51.309161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6e6dae-8dab-471a-b7bb-d4e45241d9dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:51.310412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6e6dae-8dab-471a-b7bb-d4e45241d9dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:51.311541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6e6dae-8dab-471a-b7bb-d4e45241d9dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:51.316812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:51.353361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a1b36fd6-99a4-4bac-85a2-ce0797425cf2 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a382b80>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:51.409876 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a1b36fd6-99a4-4bac-85a2-ce0797425cf2 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1422 microversion: 2.1 time: 0.061343 Oct 11 04:13:51.410484 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 406/886] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:51 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1422 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:51.471183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-af6e6dae-8dab-471a-b7bb-d4e45241d9dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:51.479242 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af6e6dae-8dab-471a-b7bb-d4e45241d9dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1378 microversion: 2.1 time: 0.197824 Oct 11 04:13:51.494620 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 481/887] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:51 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1378 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:51.557058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-87d1df6c-7588-486b-ac72-64ec1b880a6f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:51.557058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-87d1df6c-7588-486b-ac72-64ec1b880a6f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:51.562343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87d1df6c-7588-486b-ac72-64ec1b880a6f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:51.562832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87d1df6c-7588-486b-ac72-64ec1b880a6f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:51.563267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87d1df6c-7588-486b-ac72-64ec1b880a6f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:51.563968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87d1df6c-7588-486b-ac72-64ec1b880a6f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:51.564422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87d1df6c-7588-486b-ac72-64ec1b880a6f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:51.564846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87d1df6c-7588-486b-ac72-64ec1b880a6f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:51.606469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:51.608672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:51.625437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:51.625984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:51.626395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:51.627098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:51.627618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:51.628002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:51.791708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:51.800877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:51.802577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:51.803742 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-47343f81-f36b-40e5-a9dc-40fd0c6e6008 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1567 microversion: 2.25 time: 0.204315 Oct 11 04:13:51.805187 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 482/888] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:51 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1567 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:51.815308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-87d1df6c-7588-486b-ac72-64ec1b880a6f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:51.823483 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-87d1df6c-7588-486b-ac72-64ec1b880a6f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1313 microversion: 2.1 time: 0.272517 Oct 11 04:13:51.824564 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 407/889] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:51 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1313 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:51.877195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fc1c7906-7fcb-47bc-b188-6e848da0c417 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:51.877727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fc1c7906-7fcb-47bc-b188-6e848da0c417 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:51.884358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1c7906-7fcb-47bc-b188-6e848da0c417 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:51.884831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1c7906-7fcb-47bc-b188-6e848da0c417 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:51.885257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1c7906-7fcb-47bc-b188-6e848da0c417 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:51.885935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1c7906-7fcb-47bc-b188-6e848da0c417 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:51.886439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1c7906-7fcb-47bc-b188-6e848da0c417 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:51.886861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc1c7906-7fcb-47bc-b188-6e848da0c417 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.032063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fc1c7906-7fcb-47bc-b188-6e848da0c417 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:52.039995 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fc1c7906-7fcb-47bc-b188-6e848da0c417 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.166661 Oct 11 04:13:52.040552 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 483/890] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:51 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:52.118811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-624cc78b-0ff1-4fb9-b8fb-7ee8628e4bef req-695468fa-75bd-4bd8-a4ac-4d811967916c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c533c21c-f66a-4a0e-b991-01c4a087f391", "tag": "986bccea-82d2-48c0-8f10-29fc77413e59"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:52.130772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-624cc78b-0ff1-4fb9-b8fb-7ee8628e4bef req-695468fa-75bd-4bd8-a4ac-4d811967916c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.131628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-624cc78b-0ff1-4fb9-b8fb-7ee8628e4bef req-695468fa-75bd-4bd8-a4ac-4d811967916c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.132299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-624cc78b-0ff1-4fb9-b8fb-7ee8628e4bef req-695468fa-75bd-4bd8-a4ac-4d811967916c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.144157 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-624cc78b-0ff1-4fb9-b8fb-7ee8628e4bef req-695468fa-75bd-4bd8-a4ac-4d811967916c service nova] Creating event network-changed:986bccea-82d2-48c0-8f10-29fc77413e59 for instance c533c21c-f66a-4a0e-b991-01c4a087f391 on n-h2-860892-1 Oct 11 04:13:52.150367 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-624cc78b-0ff1-4fb9-b8fb-7ee8628e4bef req-695468fa-75bd-4bd8-a4ac-4d811967916c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035946 Oct 11 04:13:52.151134 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 408/891] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:52.196408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:52.197141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:52.204854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.205538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.206029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.206820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.207335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.207828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.276239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:52.284738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:52.286257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:52.291314 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d92d5e59-ea39-4a3a-bbe5-456dcee51ec9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.099437 Oct 11 04:13:52.302293 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 484/892] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:52 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:52.427682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fc2eb882-9b6e-4acb-b22d-c990c3c3fe28 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19e97dc0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:52.501026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b85243e4-d3d0-4e50-a296-355b17a266d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:52.501645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b85243e4-d3d0-4e50-a296-355b17a266d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:52.503569 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fc2eb882-9b6e-4acb-b22d-c990c3c3fe28 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1431 microversion: 2.1 time: 0.079759 Oct 11 04:13:52.504583 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 409/893] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:52 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1431 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:52.522342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b85243e4-d3d0-4e50-a296-355b17a266d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.523980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8eb7d21-fc49-4c4f-9559-b66a053fdbfa tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a5178b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:52.527185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b85243e4-d3d0-4e50-a296-355b17a266d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.527665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b85243e4-d3d0-4e50-a296-355b17a266d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.528820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b85243e4-d3d0-4e50-a296-355b17a266d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.528950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b85243e4-d3d0-4e50-a296-355b17a266d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.529300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b85243e4-d3d0-4e50-a296-355b17a266d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.598757 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a8eb7d21-fc49-4c4f-9559-b66a053fdbfa tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 200 len: 1431 microversion: 2.1 time: 0.083160 Oct 11 04:13:52.600020 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 410/894] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:52 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 1431 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:52.613638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-58a8488e-05bf-496c-9003-8e4c7e554e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:52.615093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-58a8488e-05bf-496c-9003-8e4c7e554e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:52.622551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58a8488e-05bf-496c-9003-8e4c7e554e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.623066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58a8488e-05bf-496c-9003-8e4c7e554e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.623510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58a8488e-05bf-496c-9003-8e4c7e554e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.625649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58a8488e-05bf-496c-9003-8e4c7e554e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.627391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58a8488e-05bf-496c-9003-8e4c7e554e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.627391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58a8488e-05bf-496c-9003-8e4c7e554e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.749164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b85243e4-d3d0-4e50-a296-355b17a266d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:52.759829 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b85243e4-d3d0-4e50-a296-355b17a266d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1378 microversion: 2.1 time: 0.262711 Oct 11 04:13:52.760415 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 485/895] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:52 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1378 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:52.818222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6c94feb2-1da8-40db-ad83-1749c03b1ad4 req-dfabdbec-d6c6-4899-9a9e-3e4b16fafbf3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2078125-aecf-40d1-9ea7-cf38ca95c2b4", "name": "network-vif-plugged", "status": "completed", "tag": "14238ed7-9517-4b09-8d5d-05820caebb7d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:52.829226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6c94feb2-1da8-40db-ad83-1749c03b1ad4 req-dfabdbec-d6c6-4899-9a9e-3e4b16fafbf3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.829781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6c94feb2-1da8-40db-ad83-1749c03b1ad4 req-dfabdbec-d6c6-4899-9a9e-3e4b16fafbf3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.830216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6c94feb2-1da8-40db-ad83-1749c03b1ad4 req-dfabdbec-d6c6-4899-9a9e-3e4b16fafbf3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.846101 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6c94feb2-1da8-40db-ad83-1749c03b1ad4 req-dfabdbec-d6c6-4899-9a9e-3e4b16fafbf3 service nova] Creating event network-vif-plugged:14238ed7-9517-4b09-8d5d-05820caebb7d for instance a2078125-aecf-40d1-9ea7-cf38ca95c2b4 on n-h1-860892-1 Oct 11 04:13:52.848115 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6c94feb2-1da8-40db-ad83-1749c03b1ad4 req-dfabdbec-d6c6-4899-9a9e-3e4b16fafbf3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034380 Oct 11 04:13:52.848796 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 486/896] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:52.855275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:52.855426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-58a8488e-05bf-496c-9003-8e4c7e554e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:52.856035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:52.864019 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-58a8488e-05bf-496c-9003-8e4c7e554e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1465 microversion: 2.1 time: 0.254356 Oct 11 04:13:52.865076 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 411/897] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:52 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1465 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:52.871794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.872301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.872936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.873683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.874134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.880407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.886799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-18a19c2e-7791-4ae7-b3f2-d688cc702aa6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:52.888172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-18a19c2e-7791-4ae7-b3f2-d688cc702aa6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:52.896641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a19c2e-7791-4ae7-b3f2-d688cc702aa6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.897075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a19c2e-7791-4ae7-b3f2-d688cc702aa6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.897432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a19c2e-7791-4ae7-b3f2-d688cc702aa6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:52.898166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a19c2e-7791-4ae7-b3f2-d688cc702aa6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:52.898652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a19c2e-7791-4ae7-b3f2-d688cc702aa6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:52.899223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a19c2e-7791-4ae7-b3f2-d688cc702aa6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:53.044329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:53.054130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:53.056380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:53.057910 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f50cd080-cf0d-4391-a850-1db674e69462 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1567 microversion: 2.25 time: 0.207896 Oct 11 04:13:53.058796 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 487/898] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:52 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:53.063496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d289d72b-884d-4901-8211-4d05486e1da1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a309670>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:53.113504 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d289d72b-884d-4901-8211-4d05486e1da1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/f5e997ff-e5de-4be2-9fc9-af1f070d3e55" status: 200 len: 784 microversion: 2.1 time: 0.053511 Oct 11 04:13:53.114311 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 488/899] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:53 2022] GET /compute/v2.1/images/f5e997ff-e5de-4be2-9fc9-af1f070d3e55 => generated 784 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:53.119380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8c0d311f-9f7c-4165-9831-393b3fa13d7d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:53.120144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8c0d311f-9f7c-4165-9831-393b3fa13d7d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:53.126808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c0d311f-9f7c-4165-9831-393b3fa13d7d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:53.127295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c0d311f-9f7c-4165-9831-393b3fa13d7d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:53.127723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c0d311f-9f7c-4165-9831-393b3fa13d7d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:53.128452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c0d311f-9f7c-4165-9831-393b3fa13d7d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:53.128995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c0d311f-9f7c-4165-9831-393b3fa13d7d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:53.129385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c0d311f-9f7c-4165-9831-393b3fa13d7d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:53.211522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18a19c2e-7791-4ae7-b3f2-d688cc702aa6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:53.229123 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-18a19c2e-7791-4ae7-b3f2-d688cc702aa6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1313 microversion: 2.1 time: 0.362657 Oct 11 04:13:53.230131 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 412/900] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:52 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1313 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:53.238674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df384b7e-ee3b-43d5-898b-66dcfe52bb0f tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:53.245659 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df384b7e-ee3b-43d5-898b-66dcfe52bb0f tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014161 Oct 11 04:13:53.253578 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 413/901] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:13:53 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:53.259665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fd72bc76-15db-4732-868c-c71891cf0fbf tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19eb9700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:53.334702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8c0d311f-9f7c-4165-9831-393b3fa13d7d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:53.343868 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8c0d311f-9f7c-4165-9831-393b3fa13d7d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.228394 Oct 11 04:13:53.348664 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 489/902] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:53 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:53.354240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:53.354857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:53.365678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:53.368823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:53.368823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:53.368823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:53.368823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:53.369892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:53.446128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:53.454116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:53.455715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:53.460514 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e9d27965-4c8e-4241-984a-de75f5a956b6 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.110415 Oct 11 04:13:53.461729 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 490/903] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:53 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:53.789861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d2089ae4-2c6b-41dc-80f9-3c571bc43d8d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:53.790539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d2089ae4-2c6b-41dc-80f9-3c571bc43d8d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:53.796605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2089ae4-2c6b-41dc-80f9-3c571bc43d8d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:53.797092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2089ae4-2c6b-41dc-80f9-3c571bc43d8d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:53.797534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2089ae4-2c6b-41dc-80f9-3c571bc43d8d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:53.798283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2089ae4-2c6b-41dc-80f9-3c571bc43d8d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:53.798769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2089ae4-2c6b-41dc-80f9-3c571bc43d8d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:53.799198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2089ae4-2c6b-41dc-80f9-3c571bc43d8d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:53.960293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d2089ae4-2c6b-41dc-80f9-3c571bc43d8d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:53.968482 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d2089ae4-2c6b-41dc-80f9-3c571bc43d8d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1378 microversion: 2.1 time: 0.184761 Oct 11 04:13:53.968983 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 491/904] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:53 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1378 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:54.087900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:54.087900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:54.091069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.091561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.092005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.092707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.093589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.093589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.225254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:54.234004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:54.235474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:54.236629 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1989bc11-c3d8-4860-a86a-45c19ad8af36 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1567 microversion: 2.25 time: 0.157610 Oct 11 04:13:54.237185 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 492/905] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:54 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:54.253079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-93ac903b-8484-4559-9b48-f39b4a4a8c23 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:54.253689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-93ac903b-8484-4559-9b48-f39b4a4a8c23 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:54.259768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93ac903b-8484-4559-9b48-f39b4a4a8c23 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.260274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93ac903b-8484-4559-9b48-f39b4a4a8c23 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.260719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93ac903b-8484-4559-9b48-f39b4a4a8c23 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.261387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93ac903b-8484-4559-9b48-f39b4a4a8c23 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.261843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93ac903b-8484-4559-9b48-f39b4a4a8c23 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.262299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93ac903b-8484-4559-9b48-f39b4a4a8c23 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: AssertionError: do not call blocking functions from the mainloop Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 11 04:13:54.379048 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 141, in trampoline Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool AssertionError: do not call blocking functions from the mainloop Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: ERROR sqlalchemy.pool.impl.QueuePool Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: Exception ignored in: . at 0x7fda1ab72310> Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: Traceback (most recent call last): Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 488, in Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: and _finalize_fairy(None, rec, pool, ref, echo, True), Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 774, in _finalize_fairy Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: connection_record.checkin() Oct 11 04:13:54.380749 n-d-860892-1 devstack@n-api.service[120993]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 521, in checkin Oct 11 04:13:54.382687 n-d-860892-1 devstack@n-api.service[120993]: pool.dispatch.checkin(connection, self) Oct 11 04:13:54.382687 n-d-860892-1 devstack@n-api.service[120993]: File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/event/attr.py", line 343, in __call__ Oct 11 04:13:54.388658 n-d-860892-1 devstack@n-api.service[120993]: fn(*args, **kw) Oct 11 04:13:54.388658 n-d-860892-1 devstack@n-api.service[120993]: File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py", line 51, in _thread_yield Oct 11 04:13:54.393431 n-d-860892-1 devstack@n-api.service[120993]: time.sleep(0) Oct 11 04:13:54.393431 n-d-860892-1 devstack@n-api.service[120993]: File "/usr/local/lib/python3.8/dist-packages/eventlet/greenthread.py", line 33, in sleep Oct 11 04:13:54.393966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-93ac903b-8484-4559-9b48-f39b4a4a8c23 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:54.394936 n-d-860892-1 devstack@n-api.service[120993]: assert hub.greenlet is not current, 'do not call blocking functions from the mainloop' Oct 11 04:13:54.394936 n-d-860892-1 devstack@n-api.service[120993]: AssertionError: do not call blocking functions from the mainloop Oct 11 04:13:54.401733 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-93ac903b-8484-4559-9b48-f39b4a4a8c23 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1313 microversion: 2.1 time: 0.152365 Oct 11 04:13:54.402322 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 493/906] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:54 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:54.407139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2578a7a4-1af7-4966-8f2a-c5ba0421da2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:54.407746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2578a7a4-1af7-4966-8f2a-c5ba0421da2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:54.414252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2578a7a4-1af7-4966-8f2a-c5ba0421da2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.414854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2578a7a4-1af7-4966-8f2a-c5ba0421da2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.415359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2578a7a4-1af7-4966-8f2a-c5ba0421da2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.416078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2578a7a4-1af7-4966-8f2a-c5ba0421da2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.416524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2578a7a4-1af7-4966-8f2a-c5ba0421da2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.417103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2578a7a4-1af7-4966-8f2a-c5ba0421da2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.419882 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fd72bc76-15db-4732-868c-c71891cf0fbf tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "DELETE /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 204 len: 0 microversion: 2.1 time: 1.164809 Oct 11 04:13:54.420463 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 414/907] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:53 2022] DELETE /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 0 bytes in 1166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:13:54.428582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-47e5e079-fe98-418d-9649-06f5103278b7 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19e97700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:54.450910 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-47e5e079-fe98-418d-9649-06f5103278b7 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] HTTP exception thrown: Image not found. Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-47e5e079-fe98-418d-9649-06f5103278b7 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Request method failure captured: Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 HTTP/1.1 Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO1YFictUNNiX3RmY_udD9qDGdIwN6qSOynCBEQzvEt45ovpfRqqirB690gQH2im2mjDTxvOteZArMMcKw1_I1YwjwBTa0KiC7M2C-TaU2sQEfZn2ngadxiLCb4QseAtPLRS8Yu1dyIYAlXJo0V3OmLUZSVGP_A66bU6hePjZQf0SsA Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d030baca29e8402896cdff2138cfcaab Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesOneServerTestJSON-306707423 Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:13:54.453600 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d030baca29e8402896cdff2138cfcaab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d030baca29e8402896cdff2138cfcaab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d030baca29e8402896cdff2138cfcaab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d030baca29e8402896cdff2138cfcaab"}]}] Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesOneServerTestJSON-306707423 Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d030baca29e8402896cdff2138cfcaab Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-306707423 Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesOneServerTestJSON-306707423-project Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: c3dfadbfcdca4f31b4a0e2d960298fa6 Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesOneServerTestJSON-306707423-project Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'b260f373-d065-4eb0-8e67-00f047263de6'} Oct 11 04:13:54.455229 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:54.461875 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID b260f373-d065-4eb0-8e67-00f047263de6 Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:13:54.463031 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b260f373-d065-4eb0-8e67-00f047263de6 could not be found. Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:13:54.464401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-47e5e079-fe98-418d-9649-06f5103278b7 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:13:54.465766 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-47e5e079-fe98-418d-9649-06f5103278b7 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 404 len: 62 microversion: 2.1 time: 0.030412 Oct 11 04:13:54.469419 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 415/908] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:54 2022] GET /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 62 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 04:13:54.469419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-155f452d-6297-478e-80a7-294dc341e9f4 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-\u20a1-300417905"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:54.470118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-155f452d-6297-478e-80a7-294dc341e9f4 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:54.477670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-155f452d-6297-478e-80a7-294dc341e9f4 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.478214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-155f452d-6297-478e-80a7-294dc341e9f4 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.478643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-155f452d-6297-478e-80a7-294dc341e9f4 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.479368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-155f452d-6297-478e-80a7-294dc341e9f4 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.479814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-155f452d-6297-478e-80a7-294dc341e9f4 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.480232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-155f452d-6297-478e-80a7-294dc341e9f4 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.552586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2578a7a4-1af7-4966-8f2a-c5ba0421da2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:54.560484 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2578a7a4-1af7-4966-8f2a-c5ba0421da2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.157195 Oct 11 04:13:54.561149 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 494/909] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:54 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:54.565512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:54.566115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:54.571678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.572159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.572595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.573280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.573735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.574161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.639200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:54.647577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:54.649646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:54.654667 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1ba632d3-8863-459a-855b-ca050a4fb934 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.092685 Oct 11 04:13:54.655233 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 495/910] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:54 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:54.849093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae3d5f4a-30f6-4b10-b055-794fafb2a8f1 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c1ce1f3-c6d5-407d-ad99-4868dee0652a"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:54.852590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae3d5f4a-30f6-4b10-b055-794fafb2a8f1 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:54.858503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3d5f4a-30f6-4b10-b055-794fafb2a8f1 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.858987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3d5f4a-30f6-4b10-b055-794fafb2a8f1 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.859443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3d5f4a-30f6-4b10-b055-794fafb2a8f1 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.860124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3d5f4a-30f6-4b10-b055-794fafb2a8f1 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:54.860625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3d5f4a-30f6-4b10-b055-794fafb2a8f1 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:54.861058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3d5f4a-30f6-4b10-b055-794fafb2a8f1 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:54.928505 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-155f452d-6297-478e-80a7-294dc341e9f4 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "POST /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c/action" status: 202 len: 0 microversion: 2.1 time: 0.464714 Oct 11 04:13:54.932734 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 416/911] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:13:54 2022] POST /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c/action => generated 0 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 04:13:54.941056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1f243da4-24bb-488c-93ae-336d5f123e5a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a224430>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:54.988067 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1f243da4-24bb-488c-93ae-336d5f123e5a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.051450 Oct 11 04:13:54.988890 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 417/912] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:54 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:54.993422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eb4c2e8f-23a4-4e4d-a285-ef635c7a5fb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:54.994338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eb4c2e8f-23a4-4e4d-a285-ef635c7a5fb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:55.001928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb4c2e8f-23a4-4e4d-a285-ef635c7a5fb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.002439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb4c2e8f-23a4-4e4d-a285-ef635c7a5fb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.002879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb4c2e8f-23a4-4e4d-a285-ef635c7a5fb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.003564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb4c2e8f-23a4-4e4d-a285-ef635c7a5fb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.004011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb4c2e8f-23a4-4e4d-a285-ef635c7a5fb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.004432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb4c2e8f-23a4-4e4d-a285-ef635c7a5fb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.021216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:55.029177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:55.139650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eb4c2e8f-23a4-4e4d-a285-ef635c7a5fb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:55.149094 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eb4c2e8f-23a4-4e4d-a285-ef635c7a5fb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1378 microversion: 2.1 time: 0.159144 Oct 11 04:13:55.149795 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 418/913] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:54 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1378 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:55.261235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:55.261874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:55.268040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.268520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.268957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.269643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.270096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.270546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.404673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:55.412844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:55.414359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:55.415500 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b4e3b6e-3a76-4ec1-b6be-17c8a9326af3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1567 microversion: 2.25 time: 0.158338 Oct 11 04:13:55.416049 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 419/914] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:55 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:55.424604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fe0d0fdc-b7e6-4a8e-b6a2-a988d548a0e8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:55.425450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fe0d0fdc-b7e6-4a8e-b6a2-a988d548a0e8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:55.432112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe0d0fdc-b7e6-4a8e-b6a2-a988d548a0e8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.432859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe0d0fdc-b7e6-4a8e-b6a2-a988d548a0e8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.433500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe0d0fdc-b7e6-4a8e-b6a2-a988d548a0e8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.434435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe0d0fdc-b7e6-4a8e-b6a2-a988d548a0e8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.434885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe0d0fdc-b7e6-4a8e-b6a2-a988d548a0e8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.435472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe0d0fdc-b7e6-4a8e-b6a2-a988d548a0e8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.639510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fe0d0fdc-b7e6-4a8e-b6a2-a988d548a0e8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:55.639799 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae3d5f4a-30f6-4b10-b055-794fafb2a8f1 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "POST /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.794612 Oct 11 04:13:55.646763 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 496/915] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:13:54 2022] POST /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments => generated 194 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:13:55.648539 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fe0d0fdc-b7e6-4a8e-b6a2-a988d548a0e8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1463 microversion: 2.1 time: 0.227011 Oct 11 04:13:55.661098 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 420/916] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:55 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1463 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:55.661290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-58b2a664-e221-4287-a91a-9584a1ca809f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:55.661290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-58b2a664-e221-4287-a91a-9584a1ca809f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:55.661290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=22 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:55.661290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58b2a664-e221-4287-a91a-9584a1ca809f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.665603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58b2a664-e221-4287-a91a-9584a1ca809f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.665603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58b2a664-e221-4287-a91a-9584a1ca809f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.665603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58b2a664-e221-4287-a91a-9584a1ca809f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.665603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58b2a664-e221-4287-a91a-9584a1ca809f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.665950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58b2a664-e221-4287-a91a-9584a1ca809f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.825326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1f8d114d-8b9a-4611-96bc-678051091724 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:55.831130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1f8d114d-8b9a-4611-96bc-678051091724 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Searching by: {'deleted': False, 'project_id': 'f4fffb8ae3ad4a32ac3ab49828b856d2'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:13:55.837336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-58b2a664-e221-4287-a91a-9584a1ca809f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:55.837492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f8d114d-8b9a-4611-96bc-678051091724 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.837879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f8d114d-8b9a-4611-96bc-678051091724 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.838505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f8d114d-8b9a-4611-96bc-678051091724 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.839597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f8d114d-8b9a-4611-96bc-678051091724 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.840214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f8d114d-8b9a-4611-96bc-678051091724 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.841365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f8d114d-8b9a-4611-96bc-678051091724 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.849408 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-58b2a664-e221-4287-a91a-9584a1ca809f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.201373 Oct 11 04:13:55.850317 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 497/917] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:55 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:55.856399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:55.857098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:55.863902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.864601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.865250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.866586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.867651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.868077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.872930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:55.933470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:55.941753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:55.942374 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1f8d114d-8b9a-4611-96bc-678051091724 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 15 microversion: 2.1 time: 0.264522 Oct 11 04:13:55.942944 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 421/918] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:13:55 2022] GET /compute/v2.1/servers/detail => generated 15 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:13:55.946500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:55.951571 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a6cb732d-815a-48f7-8666-521eedbea404 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.100225 Oct 11 04:13:55.952150 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 498/919] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:55 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:55.967713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:55.973882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Searching by: {'deleted': False} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:13:55.979100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.979575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.980006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:55.980879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:55.981328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:55.981751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.003985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8352c1e7-17f7-41d9-a6fc-1a6dbd2a3033 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a059160>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:56.051399 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8352c1e7-17f7-41d9-a6fc-1a6dbd2a3033 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.051294 Oct 11 04:13:56.051973 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 499/920] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:55 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:56.097303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Listed batch of 12 results from cell out of 1000 limit. Returned 12 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:13:56.174029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cae3ccd5-a963-45c2-811c-b95906e1305e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:56.174758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cae3ccd5-a963-45c2-811c-b95906e1305e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:56.181884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cae3ccd5-a963-45c2-811c-b95906e1305e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.182636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cae3ccd5-a963-45c2-811c-b95906e1305e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.183447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cae3ccd5-a963-45c2-811c-b95906e1305e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.184167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cae3ccd5-a963-45c2-811c-b95906e1305e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.184625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cae3ccd5-a963-45c2-811c-b95906e1305e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.185233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cae3ccd5-a963-45c2-811c-b95906e1305e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.220462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.220856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.221319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.321859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cae3ccd5-a963-45c2-811c-b95906e1305e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:56.330414 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cae3ccd5-a963-45c2-811c-b95906e1305e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1378 microversion: 2.1 time: 0.161382 Oct 11 04:13:56.342326 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 500/921] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:56 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1378 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:56.440966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:56.441484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:56.455922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.456418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.457055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.457762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.458408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.459036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.621573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:56.639306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:56.641113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:56.643059 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-27ac29cb-1003-44c2-9fc9-159fb0880b16 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1567 microversion: 2.25 time: 0.206087 Oct 11 04:13:56.657622 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 501/922] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:56 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:13:56.658346 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-af15e903-94f1-491b-9f9d-5e47e02e60bc tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=" status: 200 len: 19652 microversion: 2.1 time: 0.692820 Oct 11 04:13:56.658346 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 422/923] 10.222.0.26 () {58 vars in 1171 bytes} [Tue Oct 11 04:13:55 2022] GET /compute/v2.1/servers/detail?all_tenants= => generated 19652 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:13:56.699143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c274de35-e478-4dd8-b041-e5a8849fd49b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:56.705078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c274de35-e478-4dd8-b041-e5a8849fd49b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Searching by: {'deleted': False, 'project_id': 'f4fffb8ae3ad4a32ac3ab49828b856d2'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:13:56.711915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c274de35-e478-4dd8-b041-e5a8849fd49b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.712442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c274de35-e478-4dd8-b041-e5a8849fd49b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.712867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c274de35-e478-4dd8-b041-e5a8849fd49b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.713604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c274de35-e478-4dd8-b041-e5a8849fd49b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.717575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c274de35-e478-4dd8-b041-e5a8849fd49b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.717575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c274de35-e478-4dd8-b041-e5a8849fd49b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.828265 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c274de35-e478-4dd8-b041-e5a8849fd49b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?tenant_id=3a6a41baf5e342e595051a329ba6ea18" status: 200 len: 15 microversion: 2.1 time: 0.133530 Oct 11 04:13:56.838359 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 502/924] 10.222.0.26 () {58 vars in 1231 bytes} [Tue Oct 11 04:13:56 2022] GET /compute/v2.1/servers/detail?tenant_id=3a6a41baf5e342e595051a329ba6ea18 => generated 15 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:13:56.849779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:56.856148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Searching by: {'tenant_id': '3a6a41baf5e342e595051a329ba6ea18', 'deleted': False} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:13:56.861398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.861994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.862801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.863581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.864220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.865081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.873777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-746db63f-7f62-40e5-9508-13bdb66020ed tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:56.874411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-746db63f-7f62-40e5-9508-13bdb66020ed tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:56.881135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746db63f-7f62-40e5-9508-13bdb66020ed tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.881629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746db63f-7f62-40e5-9508-13bdb66020ed tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.882066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746db63f-7f62-40e5-9508-13bdb66020ed tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.883369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746db63f-7f62-40e5-9508-13bdb66020ed tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.883829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746db63f-7f62-40e5-9508-13bdb66020ed tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.885192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746db63f-7f62-40e5-9508-13bdb66020ed tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:56.901162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:13:56.993106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:56.993831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:56.994454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.028857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-746db63f-7f62-40e5-9508-13bdb66020ed tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:57.036614 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-746db63f-7f62-40e5-9508-13bdb66020ed tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.167023 Oct 11 04:13:57.037542 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 503/925] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:56 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:57.042813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:57.043479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:57.050809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.051358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.062922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.062922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.062922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.062922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.125765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:57.136171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:57.138092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:57.141447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:57.157302 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-53cc0e4e-0999-4cb1-8e62-521a6058d99e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.106078 Oct 11 04:13:57.157302 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 504/926] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:57 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:57.157302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c994134-f457-4c26-b3c1-e488e5dd15fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a0bdb80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:57.196288 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c994134-f457-4c26-b3c1-e488e5dd15fe tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.050057 Oct 11 04:13:57.196856 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 505/927] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:57 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:57.205337 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-42f195c7-0040-48e9-92aa-e25502e815e7 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3a6a41baf5e342e595051a329ba6ea18" status: 200 len: 4827 microversion: 2.1 time: 0.358891 Oct 11 04:13:57.205472 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 423/928] 10.222.0.26 () {58 vars in 1257 bytes} [Tue Oct 11 04:13:56 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=3a6a41baf5e342e595051a329ba6ea18 => generated 4827 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:57.231408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c643b87b-c9bd-4e9f-ab64-27ce71799348 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:57.237372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c643b87b-c9bd-4e9f-ab64-27ce71799348 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Searching by: {'tenant_id': 'f4fffb8ae3ad4a32ac3ab49828b856d2', 'deleted': False} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:13:57.242660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c643b87b-c9bd-4e9f-ab64-27ce71799348 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.243132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c643b87b-c9bd-4e9f-ab64-27ce71799348 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.243554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c643b87b-c9bd-4e9f-ab64-27ce71799348 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.244258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c643b87b-c9bd-4e9f-ab64-27ce71799348 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.244987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c643b87b-c9bd-4e9f-ab64-27ce71799348 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.245231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c643b87b-c9bd-4e9f-ab64-27ce71799348 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.275719 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c643b87b-c9bd-4e9f-ab64-27ce71799348 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f4fffb8ae3ad4a32ac3ab49828b856d2" status: 200 len: 15 microversion: 2.1 time: 0.048047 Oct 11 04:13:57.276360 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 506/929] 10.222.0.26 () {58 vars in 1257 bytes} [Tue Oct 11 04:13:57 2022] GET /compute/v2.1/servers/detail?all_tenants=&tenant_id=f4fffb8ae3ad4a32ac3ab49828b856d2 => generated 15 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:13:57.297814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-08dfea25-28a6-42cc-9c4a-60ccab693af3 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:57.303104 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-08dfea25-28a6-42cc-9c4a-60ccab693af3 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=invalid_status" status: 200 len: 15 microversion: 2.1 time: 0.009142 Oct 11 04:13:57.303599 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 424/930] 10.222.0.26 () {58 vars in 1189 bytes} [Tue Oct 11 04:13:57 2022] GET /compute/v2.1/servers/detail?status=invalid_status => generated 15 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:13:57.325094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-914e6506-8c12-4411-94ab-3ee6dc293baa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:57.327279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-914e6506-8c12-4411-94ab-3ee6dc293baa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:57.333554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-914e6506-8c12-4411-94ab-3ee6dc293baa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.334027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-914e6506-8c12-4411-94ab-3ee6dc293baa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.334552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-914e6506-8c12-4411-94ab-3ee6dc293baa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.335862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-914e6506-8c12-4411-94ab-3ee6dc293baa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.336330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-914e6506-8c12-4411-94ab-3ee6dc293baa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.336744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-914e6506-8c12-4411-94ab-3ee6dc293baa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.355773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9bb7df84-a723-40ed-a363-025dc51f39d6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:57.356640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9bb7df84-a723-40ed-a363-025dc51f39d6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:57.364115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bb7df84-a723-40ed-a363-025dc51f39d6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.364899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bb7df84-a723-40ed-a363-025dc51f39d6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.365683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bb7df84-a723-40ed-a363-025dc51f39d6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.366736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bb7df84-a723-40ed-a363-025dc51f39d6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.367229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bb7df84-a723-40ed-a363-025dc51f39d6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.367767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bb7df84-a723-40ed-a363-025dc51f39d6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.543859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9bb7df84-a723-40ed-a363-025dc51f39d6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:57.552559 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9bb7df84-a723-40ed-a363-025dc51f39d6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1378 microversion: 2.1 time: 0.201484 Oct 11 04:13:57.565250 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 425/931] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:57 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1378 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:57.628884 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-914e6506-8c12-4411-94ab-3ee6dc293baa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action" status: 202 len: 0 microversion: 2.1 time: 0.307755 Oct 11 04:13:57.629750 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 507/932] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:13:57 2022] POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:13:57.639493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a4c8306-378f-46c8-9d15-563dfe5e721f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:57.645687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5a4c8306-378f-46c8-9d15-563dfe5e721f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:57.646771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5a4c8306-378f-46c8-9d15-563dfe5e721f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Searching by: {'vm_state': ['error'], 'deleted': False, 'project_id': '3a6a41baf5e342e595051a329ba6ea18'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:13:57.655320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a4c8306-378f-46c8-9d15-563dfe5e721f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.656231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a4c8306-378f-46c8-9d15-563dfe5e721f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.657624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a4c8306-378f-46c8-9d15-563dfe5e721f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.658676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a4c8306-378f-46c8-9d15-563dfe5e721f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.659713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a4c8306-378f-46c8-9d15-563dfe5e721f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.660288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a4c8306-378f-46c8-9d15-563dfe5e721f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.670168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:57.673337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:57.693738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.698076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.700085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.701634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.702231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.703749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.784484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-5a4c8306-378f-46c8-9d15-563dfe5e721f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:13:57.894082 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5a4c8306-378f-46c8-9d15-563dfe5e721f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers?status=error" status: 200 len: 339 microversion: 2.1 time: 0.258369 Oct 11 04:13:57.895076 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 426/933] 10.222.0.26 () {58 vars in 1150 bytes} [Tue Oct 11 04:13:57 2022] GET /compute/v2.1/servers?status=error => generated 339 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:57.902960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c5465342-d7fe-4cad-9fc7-0595e9056120 req-02853455-5274-44d7-9c18-2e49d3b517ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1ce880-49a7-475d-9f7c-a04705d0d35c", "name": "network-vif-unplugged", "status": "completed", "tag": "5ac5d34a-b5ac-44e2-a066-af84d17457a2"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:57.924842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c5465342-d7fe-4cad-9fc7-0595e9056120 req-02853455-5274-44d7-9c18-2e49d3b517ee service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.924983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:57.925321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c5465342-d7fe-4cad-9fc7-0595e9056120 req-02853455-5274-44d7-9c18-2e49d3b517ee service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.925743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c5465342-d7fe-4cad-9fc7-0595e9056120 req-02853455-5274-44d7-9c18-2e49d3b517ee service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.935730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:57.938480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:57.939677 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dcba979d-a4d9-4b3f-8d6f-156df0278529 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1557 microversion: 2.25 time: 0.274159 Oct 11 04:13:57.940288 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 508/934] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:57 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1557 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:57.947696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a04967f-bf50-4281-8a8d-39d853d0c8b0 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:57.949991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a04967f-bf50-4281-8a8d-39d853d0c8b0 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:57.958252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a04967f-bf50-4281-8a8d-39d853d0c8b0 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.961174 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c5465342-d7fe-4cad-9fc7-0595e9056120 req-02853455-5274-44d7-9c18-2e49d3b517ee service nova] Creating event network-vif-unplugged:5ac5d34a-b5ac-44e2-a066-af84d17457a2 for instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c on n-h2-860892-1 Oct 11 04:13:57.962921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a04967f-bf50-4281-8a8d-39d853d0c8b0 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.963740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a04967f-bf50-4281-8a8d-39d853d0c8b0 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.964558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a04967f-bf50-4281-8a8d-39d853d0c8b0 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.965069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a04967f-bf50-4281-8a8d-39d853d0c8b0 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.965492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a04967f-bf50-4281-8a8d-39d853d0c8b0 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.966744 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c5465342-d7fe-4cad-9fc7-0595e9056120 req-02853455-5274-44d7-9c18-2e49d3b517ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070273 Oct 11 04:13:57.967451 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 427/935] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:13:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:13:57.976754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-63d35f15-5bf5-4561-88e3-b398535df190 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '.version_select at 0x7fda1a3820d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:57.980850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63d35f15-5bf5-4561-88e3-b398535df190 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:57.981408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63d35f15-5bf5-4561-88e3-b398535df190 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:57.983224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63d35f15-5bf5-4561-88e3-b398535df190 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:57.990908 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-63d35f15-5bf5-4561-88e3-b398535df190 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1525 microversion: 2.25 time: 0.019056 Oct 11 04:13:57.991829 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 428/936] 10.222.0.26 () {60 vars in 1184 bytes} [Tue Oct 11 04:13:57 2022] GET /compute/v2.1/os-migrations => generated 1525 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:58.008766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1f4d9b49-3da6-4ec5-8b84-0170d012e052 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:58.009580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1f4d9b49-3da6-4ec5-8b84-0170d012e052 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:58.016105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f4d9b49-3da6-4ec5-8b84-0170d012e052 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.016597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f4d9b49-3da6-4ec5-8b84-0170d012e052 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.017034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f4d9b49-3da6-4ec5-8b84-0170d012e052 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:58.017729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f4d9b49-3da6-4ec5-8b84-0170d012e052 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.018181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f4d9b49-3da6-4ec5-8b84-0170d012e052 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.018667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f4d9b49-3da6-4ec5-8b84-0170d012e052 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:58.167256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-1f4d9b49-3da6-4ec5-8b84-0170d012e052 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:13:58.184553 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1f4d9b49-3da6-4ec5-8b84-0170d012e052 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 2050 microversion: 2.25 time: 0.181218 Oct 11 04:13:58.185242 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 429/937] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:58 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 2050 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:58.189712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6830b6ce-39c8-4e67-8d39-312b32810e4e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:58.191832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6830b6ce-39c8-4e67-8d39-312b32810e4e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:58.196905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6830b6ce-39c8-4e67-8d39-312b32810e4e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.197394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6830b6ce-39c8-4e67-8d39-312b32810e4e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.197836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6830b6ce-39c8-4e67-8d39-312b32810e4e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:58.198553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6830b6ce-39c8-4e67-8d39-312b32810e4e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.199010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6830b6ce-39c8-4e67-8d39-312b32810e4e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.199437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6830b6ce-39c8-4e67-8d39-312b32810e4e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:58.337186 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a04967f-bf50-4281-8a8d-39d853d0c8b0 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action" status: 202 len: 0 microversion: 2.1 time: 0.394704 Oct 11 04:13:58.338149 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 509/938] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:13:57 2022] POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action => generated 0 bytes in 397 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:13:58.343234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:58.343850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:58.352921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.353420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.353856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:58.354599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.355060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.358330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:58.372988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6830b6ce-39c8-4e67-8d39-312b32810e4e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:58.381491 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6830b6ce-39c8-4e67-8d39-312b32810e4e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.194860 Oct 11 04:13:58.390969 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 430/939] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:58 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:58.408423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f88cd547-9738-4bf0-87e3-c237c7e57840 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19ea6d30>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:58.450579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:58.450843 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f88cd547-9738-4bf0-87e3-c237c7e57840 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.058524 Oct 11 04:13:58.462279 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 431/940] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:58 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:58.463720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:58.465616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:58.467773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1657637577", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "89a2a2aa-9a7e-4acc-b86b-af482eea703c"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:58.472519 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a872f04-589f-445b-bb69-d5e92b4ea192 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.133315 Oct 11 04:13:58.473293 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 510/941] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:58 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:58.478971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-16233126-2036-417d-bcec-c1a292be54aa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:58.479760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-16233126-2036-417d-bcec-c1a292be54aa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:58.486817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16233126-2036-417d-bcec-c1a292be54aa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.487517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16233126-2036-417d-bcec-c1a292be54aa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.488105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16233126-2036-417d-bcec-c1a292be54aa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:58.489121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16233126-2036-417d-bcec-c1a292be54aa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.490288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16233126-2036-417d-bcec-c1a292be54aa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.491032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16233126-2036-417d-bcec-c1a292be54aa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:58.534062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] validate_networks() for [('89a2a2aa-9a7e-4acc-b86b-af482eea703c', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:13:58.652166 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-16233126-2036-417d-bcec-c1a292be54aa tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1615 microversion: 2.1 time: 0.174883 Oct 11 04:13:58.666008 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 511/942] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:58 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1615 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:58.666008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a72cf64-2d6d-424e-acd0-237c277cbde7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:58.666008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a72cf64-2d6d-424e-acd0-237c277cbde7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:58.681973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a72cf64-2d6d-424e-acd0-237c277cbde7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.682660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a72cf64-2d6d-424e-acd0-237c277cbde7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.683074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a72cf64-2d6d-424e-acd0-237c277cbde7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:58.683786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a72cf64-2d6d-424e-acd0-237c277cbde7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.684239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a72cf64-2d6d-424e-acd0-237c277cbde7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.684663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a72cf64-2d6d-424e-acd0-237c277cbde7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:58.856651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3a72cf64-2d6d-424e-acd0-237c277cbde7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:58.865742 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a72cf64-2d6d-424e-acd0-237c277cbde7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1378 microversion: 2.1 time: 0.211735 Oct 11 04:13:58.866372 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 512/943] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:58 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1378 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:58.870991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7e205617-5921-495c-8365-6e468770597e tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:58.871661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7e205617-5921-495c-8365-6e468770597e tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:58.877510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e205617-5921-495c-8365-6e468770597e tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.878166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e205617-5921-495c-8365-6e468770597e tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.878449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e205617-5921-495c-8365-6e468770597e tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:58.879145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e205617-5921-495c-8365-6e468770597e tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:58.879594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e205617-5921-495c-8365-6e468770597e tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:58.880017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e205617-5921-495c-8365-6e468770597e tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.031461 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7e205617-5921-495c-8365-6e468770597e tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1615 microversion: 2.1 time: 0.163920 Oct 11 04:13:59.033983 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 513/944] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:58 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1615 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:59.051864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:13:59.052415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:13:59.053004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:13:59.053427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:13:59.054444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:13:59.056824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-45c6a1fd-8085-4f12-8e78-86db79231e32 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:59.063221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45c6a1fd-8085-4f12-8e78-86db79231e32 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Searching by: {'host': 'n-h1-860892-1', 'deleted': False} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:13:59.065273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.065774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.066236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.067139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.067607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.068035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.068315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c6a1fd-8085-4f12-8e78-86db79231e32 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.068796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c6a1fd-8085-4f12-8e78-86db79231e32 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.069224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c6a1fd-8085-4f12-8e78-86db79231e32 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.070008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c6a1fd-8085-4f12-8e78-86db79231e32 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.070983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c6a1fd-8085-4f12-8e78-86db79231e32 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.071411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c6a1fd-8085-4f12-8e78-86db79231e32 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.089378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Getting quotas for project daa8ad03685c4b59b3274fc6407c9eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:13:59.091813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:59.095703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Getting quotas for user 917dab915f7d4303989abb47a33f47df and project daa8ad03685c4b59b3274fc6407c9eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:13:59.109089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:13:59.111496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:13:59.172296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-45c6a1fd-8085-4f12-8e78-86db79231e32 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Listed batch of 6 results from cell out of 1000 limit. Returned 6 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:13:59.242998 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-299a1411-7bf2-4694-85be-b27d5b445202 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 0.778262 Oct 11 04:13:59.249919 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 432/945] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:13:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 787 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:13:59.251499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:13:59.256892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-11d9b165-35d1-4532-ad22-871d159f2a0e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:59.258089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-11d9b165-35d1-4532-ad22-871d159f2a0e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:59.270015 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-45c6a1fd-8085-4f12-8e78-86db79231e32 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=n-h1-860892-1&all_tenants=1" status: 200 len: 1975 microversion: 2.1 time: 0.217886 Oct 11 04:13:59.279155 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 514/946] 10.222.0.26 () {58 vars in 1190 bytes} [Tue Oct 11 04:13:59 2022] GET /compute/v2.1/servers?host=n-h1-860892-1&all_tenants=1 => generated 1975 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:59.293821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32db1a7c-a5b3-4459-bfcb-0b69dbd79b18 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:59.315773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-32db1a7c-a5b3-4459-bfcb-0b69dbd79b18 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Searching by: {'host': 'nonexistent_host', 'deleted': False} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:13:59.318840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-11d9b165-35d1-4532-ad22-871d159f2a0e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:59.328052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-11d9b165-35d1-4532-ad22-871d159f2a0e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:59.329577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-11d9b165-35d1-4532-ad22-871d159f2a0e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:59.330825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32db1a7c-a5b3-4459-bfcb-0b69dbd79b18 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.331316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32db1a7c-a5b3-4459-bfcb-0b69dbd79b18 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.331630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-11d9b165-35d1-4532-ad22-871d159f2a0e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1262 microversion: 2.25 time: 0.080542 Oct 11 04:13:59.331769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32db1a7c-a5b3-4459-bfcb-0b69dbd79b18 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.332573 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 433/947] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:59 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1262 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:59.332703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32db1a7c-a5b3-4459-bfcb-0b69dbd79b18 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.335435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32db1a7c-a5b3-4459-bfcb-0b69dbd79b18 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.335949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32db1a7c-a5b3-4459-bfcb-0b69dbd79b18 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.360747 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-32db1a7c-a5b3-4459-bfcb-0b69dbd79b18 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1" status: 200 len: 15 microversion: 2.1 time: 0.071167 Oct 11 04:13:59.361436 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 515/948] 10.222.0.26 () {58 vars in 1196 bytes} [Tue Oct 11 04:13:59 2022] GET /compute/v2.1/servers?host=nonexistent_host&all_tenants=1 => generated 15 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:13:59.380341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c47867b6-c0ae-4296-adf6-9f6d30ab28b5 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:59.383394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c47867b6-c0ae-4296-adf6-9f6d30ab28b5 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:59.390121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c47867b6-c0ae-4296-adf6-9f6d30ab28b5 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.390664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c47867b6-c0ae-4296-adf6-9f6d30ab28b5 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.391106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c47867b6-c0ae-4296-adf6-9f6d30ab28b5 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.391810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c47867b6-c0ae-4296-adf6-9f6d30ab28b5 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.392267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c47867b6-c0ae-4296-adf6-9f6d30ab28b5 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.392696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c47867b6-c0ae-4296-adf6-9f6d30ab28b5 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.408705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44b3fd2b-934d-4bcb-8e04-05b7ffcd9c5b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:59.409316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44b3fd2b-934d-4bcb-8e04-05b7ffcd9c5b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:59.415806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44b3fd2b-934d-4bcb-8e04-05b7ffcd9c5b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.416288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44b3fd2b-934d-4bcb-8e04-05b7ffcd9c5b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.416720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44b3fd2b-934d-4bcb-8e04-05b7ffcd9c5b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.417405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44b3fd2b-934d-4bcb-8e04-05b7ffcd9c5b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.417851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44b3fd2b-934d-4bcb-8e04-05b7ffcd9c5b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.418658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44b3fd2b-934d-4bcb-8e04-05b7ffcd9c5b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.592656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44b3fd2b-934d-4bcb-8e04-05b7ffcd9c5b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:59.614984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44b3fd2b-934d-4bcb-8e04-05b7ffcd9c5b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.208788 Oct 11 04:13:59.632405 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 516/949] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:59 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:13:59.632405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cf0153a-a2fe-4de4-bc5b-4486a339210a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a0bd0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:59.659235 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c47867b6-c0ae-4296-adf6-9f6d30ab28b5 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action" status: 202 len: 0 microversion: 2.1 time: 0.286614 Oct 11 04:13:59.661158 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 434/950] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:13:59 2022] POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:13:59.669162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:59.669780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:59.677545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.678067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.678544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.680033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.680570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.681001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.698777 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2cf0153a-a2fe-4de4-bc5b-4486a339210a tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.078557 Oct 11 04:13:59.705664 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 517/951] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:13:59 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:13:59.713163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:13:59.717778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:59.729175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.730410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.731127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.731931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.732462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.732955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.776928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:59.786728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:59.788197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:13:59.801280 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d35cf0bd-9e45-4e5f-9e28-7bf34250504d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.139129 Oct 11 04:13:59.801842 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 435/952] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:13:59 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:13:59.871503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:13:59.872319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:13:59.873893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:13:59.874939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:13:59.875941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:13:59.888802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-be43be4c-52ee-4dc4-a97d-c2e204217aee tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:13:59.889484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-be43be4c-52ee-4dc4-a97d-c2e204217aee tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:13:59.895496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be43be4c-52ee-4dc4-a97d-c2e204217aee tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.896050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be43be4c-52ee-4dc4-a97d-c2e204217aee tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.896544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be43be4c-52ee-4dc4-a97d-c2e204217aee tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:13:59.897299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be43be4c-52ee-4dc4-a97d-c2e204217aee tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:13:59.898383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be43be4c-52ee-4dc4-a97d-c2e204217aee tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:13:59.899208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be43be4c-52ee-4dc4-a97d-c2e204217aee tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:00.096856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be43be4c-52ee-4dc4-a97d-c2e204217aee tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:00.113377 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-be43be4c-52ee-4dc4-a97d-c2e204217aee tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1378 microversion: 2.1 time: 0.221358 Oct 11 04:14:00.114276 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 436/953] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:13:59 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1378 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:00.119741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-bf69822b-0702-4434-8194-9a0c8fd69c0a req-00d547ff-1484-4d44-ac82-b5437d1244a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c533c21c-f66a-4a0e-b991-01c4a087f391", "name": "network-vif-plugged", "status": "completed", "tag": "986bccea-82d2-48c0-8f10-29fc77413e59"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:00.119894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:00.129650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bf69822b-0702-4434-8194-9a0c8fd69c0a req-00d547ff-1484-4d44-ac82-b5437d1244a2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:00.130426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bf69822b-0702-4434-8194-9a0c8fd69c0a req-00d547ff-1484-4d44-ac82-b5437d1244a2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:00.131313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bf69822b-0702-4434-8194-9a0c8fd69c0a req-00d547ff-1484-4d44-ac82-b5437d1244a2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:00.137567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=1,nova_cell1:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:00.139830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:00.140333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:00.140770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:00.141481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:00.141931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:00.142388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:00.148650 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-bf69822b-0702-4434-8194-9a0c8fd69c0a req-00d547ff-1484-4d44-ac82-b5437d1244a2 service nova] Creating event network-vif-plugged:986bccea-82d2-48c0-8f10-29fc77413e59 for instance c533c21c-f66a-4a0e-b991-01c4a087f391 on n-h2-860892-1 Oct 11 04:14:00.154273 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-bf69822b-0702-4434-8194-9a0c8fd69c0a req-00d547ff-1484-4d44-ac82-b5437d1244a2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038649 Oct 11 04:14:00.155604 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 437/954] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:00.169451 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d637ac61-b23b-4f31-9819-3ef9d5d0a52d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action" status: 202 len: 1068 microversion: 2.1 time: 0.462241 Oct 11 04:14:00.170335 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 518/955] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:13:59 2022] POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action => generated 1068 bytes in 464 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 04:14:00.193755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-faf147f3-b223-4e5b-8177-6a4b59284d07 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:00.194585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-faf147f3-b223-4e5b-8177-6a4b59284d07 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:00.210441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-faf147f3-b223-4e5b-8177-6a4b59284d07 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:00.210935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-faf147f3-b223-4e5b-8177-6a4b59284d07 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:00.211359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-faf147f3-b223-4e5b-8177-6a4b59284d07 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:00.215440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-faf147f3-b223-4e5b-8177-6a4b59284d07 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:00.227406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-faf147f3-b223-4e5b-8177-6a4b59284d07 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:00.228326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-faf147f3-b223-4e5b-8177-6a4b59284d07 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:00.357819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-671272e7-3b0b-40c9-bca1-281bbcbf77d8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:00.358371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-671272e7-3b0b-40c9-bca1-281bbcbf77d8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:00.441902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-671272e7-3b0b-40c9-bca1-281bbcbf77d8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:00.466975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-671272e7-3b0b-40c9-bca1-281bbcbf77d8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:00.471279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-671272e7-3b0b-40c9-bca1-281bbcbf77d8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:00.472531 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-671272e7-3b0b-40c9-bca1-281bbcbf77d8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1262 microversion: 2.25 time: 0.118959 Oct 11 04:14:00.474248 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 519/956] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:00 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1262 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:00.567416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-faf147f3-b223-4e5b-8177-6a4b59284d07 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:00.576446 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-faf147f3-b223-4e5b-8177-6a4b59284d07 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.387491 Oct 11 04:14:00.577221 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 438/957] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:00 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:00.640728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4990df8e-07a5-4ca7-8ead-b5af2888bb2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:00.641016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4990df8e-07a5-4ca7-8ead-b5af2888bb2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:00.648837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4990df8e-07a5-4ca7-8ead-b5af2888bb2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:00.649270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4990df8e-07a5-4ca7-8ead-b5af2888bb2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:00.649703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4990df8e-07a5-4ca7-8ead-b5af2888bb2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:00.650431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4990df8e-07a5-4ca7-8ead-b5af2888bb2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:00.651478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4990df8e-07a5-4ca7-8ead-b5af2888bb2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:00.651898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4990df8e-07a5-4ca7-8ead-b5af2888bb2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:00.715256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f3978de4-4c76-4c33-b07a-5f7273997145 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19b6b5e0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:00.768726 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f3978de4-4c76-4c33-b07a-5f7273997145 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.057324 Oct 11 04:14:00.777484 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 439/958] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:00 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:00.823679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4990df8e-07a5-4ca7-8ead-b5af2888bb2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:00.828846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:00.829573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:00.831957 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4990df8e-07a5-4ca7-8ead-b5af2888bb2f tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.195398 Oct 11 04:14:00.833047 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 520/959] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:00 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:00.849402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:00.849897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:00.850371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:00.851669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:00.852123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:00.852549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:00.951155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:00.962052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:00.963922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:00.969881 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-be21351d-1dad-4a88-9712-2e8a6c2b1255 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.145382 Oct 11 04:14:00.970483 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 440/960] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:00 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:01.141103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c34ea67-47cb-496f-bd50-212ac7fd96b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:01.142040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c34ea67-47cb-496f-bd50-212ac7fd96b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:01.149832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c34ea67-47cb-496f-bd50-212ac7fd96b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:01.150437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c34ea67-47cb-496f-bd50-212ac7fd96b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:01.151409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c34ea67-47cb-496f-bd50-212ac7fd96b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:01.153820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c34ea67-47cb-496f-bd50-212ac7fd96b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:01.153820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c34ea67-47cb-496f-bd50-212ac7fd96b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:01.154398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c34ea67-47cb-496f-bd50-212ac7fd96b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:01.344897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c34ea67-47cb-496f-bd50-212ac7fd96b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:01.355541 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c34ea67-47cb-496f-bd50-212ac7fd96b0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1378 microversion: 2.1 time: 0.218474 Oct 11 04:14:01.356761 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 521/961] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:01 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1378 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:01.500826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:01.501491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:01.509707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:01.512038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:01.513200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:01.514102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:01.514726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:01.515307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:01.600406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-463cbf12-1f0b-4569-af1a-03995831a27b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:01.601109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-463cbf12-1f0b-4569-af1a-03995831a27b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:01.609403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463cbf12-1f0b-4569-af1a-03995831a27b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:01.609888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463cbf12-1f0b-4569-af1a-03995831a27b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:01.610007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:01.610348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463cbf12-1f0b-4569-af1a-03995831a27b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:01.611036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463cbf12-1f0b-4569-af1a-03995831a27b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:01.617794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463cbf12-1f0b-4569-af1a-03995831a27b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:01.618489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-463cbf12-1f0b-4569-af1a-03995831a27b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:01.620793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:01.626014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:01.627561 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fc98c207-5c9c-4e1e-9ab7-9b0e03c89aa3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1314 microversion: 2.25 time: 0.130571 Oct 11 04:14:01.630422 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 441/962] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:01 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1314 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:01.785166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-201a3568-adc8-4196-aaf8-1ac481805109 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19c73c10>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:01.849141 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-201a3568-adc8-4196-aaf8-1ac481805109 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.068118 Oct 11 04:14:01.851218 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 442/963] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:01 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:01.861525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52024d21-3305-4152-8626-4c40a922305a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:01.862779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-52024d21-3305-4152-8626-4c40a922305a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:01.883895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52024d21-3305-4152-8626-4c40a922305a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:01.884698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52024d21-3305-4152-8626-4c40a922305a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:01.885308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52024d21-3305-4152-8626-4c40a922305a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:01.886920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52024d21-3305-4152-8626-4c40a922305a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:01.887549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52024d21-3305-4152-8626-4c40a922305a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:01.888130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52024d21-3305-4152-8626-4c40a922305a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:01.911109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-463cbf12-1f0b-4569-af1a-03995831a27b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:01.921156 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-463cbf12-1f0b-4569-af1a-03995831a27b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.324355 Oct 11 04:14:01.922221 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 522/964] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:01 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:01.999667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:02.000674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:02.025599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:02.026924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:02.028221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:02.030919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:02.035387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:02.035387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:02.087648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-52024d21-3305-4152-8626-4c40a922305a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:02.097961 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-52024d21-3305-4152-8626-4c40a922305a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.245696 Oct 11 04:14:02.098741 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 443/965] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:01 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:02.156482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:02.165525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:02.167244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:02.173277 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b1128797-71ab-4a63-8a74-bf7f4d784805 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.177956 Oct 11 04:14:02.187755 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 523/966] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:01 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:02.202031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-bb9cb789-1e6a-4519-9654-ef5701ec536e req-56dacc2b-c351-499e-96ee-afe94cb18492 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1ce880-49a7-475d-9f7c-a04705d0d35c", "name": "network-vif-plugged", "status": "completed", "tag": "5ac5d34a-b5ac-44e2-a066-af84d17457a2"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:02.214375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bb9cb789-1e6a-4519-9654-ef5701ec536e req-56dacc2b-c351-499e-96ee-afe94cb18492 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:02.215102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bb9cb789-1e6a-4519-9654-ef5701ec536e req-56dacc2b-c351-499e-96ee-afe94cb18492 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:02.215678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bb9cb789-1e6a-4519-9654-ef5701ec536e req-56dacc2b-c351-499e-96ee-afe94cb18492 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:02.227605 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-bb9cb789-1e6a-4519-9654-ef5701ec536e req-56dacc2b-c351-499e-96ee-afe94cb18492 service nova] Creating event network-vif-plugged:5ac5d34a-b5ac-44e2-a066-af84d17457a2 for instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c on n-h2-860892-1 Oct 11 04:14:02.233797 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-bb9cb789-1e6a-4519-9654-ef5701ec536e req-56dacc2b-c351-499e-96ee-afe94cb18492 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041489 Oct 11 04:14:02.241884 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 444/967] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:02.385094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab6cba56-9467-406f-9ef6-4243dac861f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:02.386363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab6cba56-9467-406f-9ef6-4243dac861f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:02.394051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab6cba56-9467-406f-9ef6-4243dac861f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:02.395388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab6cba56-9467-406f-9ef6-4243dac861f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:02.396033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab6cba56-9467-406f-9ef6-4243dac861f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:02.396929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab6cba56-9467-406f-9ef6-4243dac861f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:02.397798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab6cba56-9467-406f-9ef6-4243dac861f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:02.400271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab6cba56-9467-406f-9ef6-4243dac861f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:02.602576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab6cba56-9467-406f-9ef6-4243dac861f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:02.613503 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab6cba56-9467-406f-9ef6-4243dac861f6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1528 microversion: 2.1 time: 0.234792 Oct 11 04:14:02.614619 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 524/968] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:02 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1528 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:02.638069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-754cd66e-4578-46ff-bc00-b34a9f0b7cbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:02.638895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-754cd66e-4578-46ff-bc00-b34a9f0b7cbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:02.645211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754cd66e-4578-46ff-bc00-b34a9f0b7cbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:02.645698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754cd66e-4578-46ff-bc00-b34a9f0b7cbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:02.646134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754cd66e-4578-46ff-bc00-b34a9f0b7cbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:02.646864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754cd66e-4578-46ff-bc00-b34a9f0b7cbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:02.647317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754cd66e-4578-46ff-bc00-b34a9f0b7cbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:02.647805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754cd66e-4578-46ff-bc00-b34a9f0b7cbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:02.660492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:02.662641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:02.679362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:02.680173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:02.680823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:02.683543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:02.684949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:02.687141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:02.784664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:02.794412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:02.796743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:02.799983 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8404baf7-d9fa-4d99-a7cd-ecd29712bcaf tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1320 microversion: 2.25 time: 0.142621 Oct 11 04:14:02.799983 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 525/969] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:02 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1320 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:02.865748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ff5a57c-c13f-44f8-8e56-76f48a4a0900 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a038ee0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:02.899254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-754cd66e-4578-46ff-bc00-b34a9f0b7cbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:02.910892 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-754cd66e-4578-46ff-bc00-b34a9f0b7cbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1528 microversion: 2.1 time: 0.277017 Oct 11 04:14:02.911463 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 445/970] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:02 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1528 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:02.915981 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ff5a57c-c13f-44f8-8e56-76f48a4a0900 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.054885 Oct 11 04:14:02.924194 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 526/971] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:02 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:02.934656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5536a773-c9be-4cc1-9979-555089ab3d8a tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:02.949918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ded5290c-92bb-40b1-95cf-362ff3126668 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:02.950585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ded5290c-92bb-40b1-95cf-362ff3126668 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:02.960484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded5290c-92bb-40b1-95cf-362ff3126668 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:02.960992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded5290c-92bb-40b1-95cf-362ff3126668 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:02.961679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded5290c-92bb-40b1-95cf-362ff3126668 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:02.962139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded5290c-92bb-40b1-95cf-362ff3126668 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:02.962675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded5290c-92bb-40b1-95cf-362ff3126668 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:02.963109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded5290c-92bb-40b1-95cf-362ff3126668 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:03.035653 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5536a773-c9be-4cc1-9979-555089ab3d8a tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/fe2a745e-1776-4dd3-81a0-0a7f24d36592" status: 202 len: 0 microversion: 2.1 time: 0.103790 Oct 11 04:14:03.036176 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 446/972] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:14:02 2022] DELETE /compute/v2.1/flavors/fe2a745e-1776-4dd3-81a0-0a7f24d36592 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:14:03.045011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cc326021-d6ba-4d35-a220-972c92a167c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:03.069561 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cc326021-d6ba-4d35-a220-972c92a167c6 tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5814 microversion: 2.1 time: 0.028096 Oct 11 04:14:03.070621 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 447/973] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:14:03 2022] GET /compute/v2.1/flavors/detail => generated 5814 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:03.095023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:03.097889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:03.104629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:03.105345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:03.105872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:03.106703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:03.107388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:03.108024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:03.147869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:03.152691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ded5290c-92bb-40b1-95cf-362ff3126668 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:03.158870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Old instance type tempest-test_resize_flavor_-1276527591, new instance type m1.heat {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 04:14:03.162255 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ded5290c-92bb-40b1-95cf-362ff3126668 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.215951 Oct 11 04:14:03.163799 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 527/974] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:02 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:03.169291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:14:03.169969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:14:03.170247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9bd8b62c-2a0b-48bb-9d04-9ddc09083fd3 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:03.170828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:14:03.171883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9bd8b62c-2a0b-48bb-9d04-9ddc09083fd3 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:03.171991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:14:03.172451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:14:03.178615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bd8b62c-2a0b-48bb-9d04-9ddc09083fd3 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:03.179180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bd8b62c-2a0b-48bb-9d04-9ddc09083fd3 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:03.179621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bd8b62c-2a0b-48bb-9d04-9ddc09083fd3 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:03.180685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bd8b62c-2a0b-48bb-9d04-9ddc09083fd3 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:03.181478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bd8b62c-2a0b-48bb-9d04-9ddc09083fd3 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:03.181881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bd8b62c-2a0b-48bb-9d04-9ddc09083fd3 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:03.349845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9bd8b62c-2a0b-48bb-9d04-9ddc09083fd3 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:03.364385 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9bd8b62c-2a0b-48bb-9d04-9ddc09083fd3 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.199079 Oct 11 04:14:03.366901 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 528/975] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:03 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:03.371726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:03.372469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:03.380129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:03.382252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:03.382252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:03.383820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:03.384215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:03.384743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:03.416707 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f613450-ce43-489f-b331-49d81d5808ff tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "POST /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391/action" status: 202 len: 0 microversion: 2.1 time: 0.327080 Oct 11 04:14:03.417803 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 448/976] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:14:03 2022] POST /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391/action => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:14:03.432849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1bcc8cdc-2a7d-4e58-b0cc-d82838ca37f1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:03.435694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1bcc8cdc-2a7d-4e58-b0cc-d82838ca37f1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:03.453604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcc8cdc-2a7d-4e58-b0cc-d82838ca37f1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:03.454432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcc8cdc-2a7d-4e58-b0cc-d82838ca37f1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:03.455895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcc8cdc-2a7d-4e58-b0cc-d82838ca37f1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:03.458890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcc8cdc-2a7d-4e58-b0cc-d82838ca37f1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:03.459563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcc8cdc-2a7d-4e58-b0cc-d82838ca37f1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:03.460312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcc8cdc-2a7d-4e58-b0cc-d82838ca37f1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:03.532662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:03.549852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:03.551751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:03.565888 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-99934db9-e5ac-4ad0-85d9-8f5a1bab7a56 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.197751 Oct 11 04:14:03.566675 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 529/977] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:03 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:03.705268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1bcc8cdc-2a7d-4e58-b0cc-d82838ca37f1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:03.720032 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1bcc8cdc-2a7d-4e58-b0cc-d82838ca37f1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1537 microversion: 2.1 time: 0.291287 Oct 11 04:14:03.743157 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 449/978] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:03 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1537 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:03.829826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:03.830967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:03.840896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:03.841683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:03.842353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:03.843318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:03.843928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:03.844659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:03.931138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dd4ac5cb-55a0-4883-93a9-dfa8bfad1ed3 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19b0a820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:04.004257 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dd4ac5cb-55a0-4883-93a9-dfa8bfad1ed3 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.076367 Oct 11 04:14:04.005950 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 450/979] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:03 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:04.053093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:04.069365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:04.070972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:04.072175 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7b19e72e-a9f6-4267-b4f9-b9b28bc88336 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.247236 Oct 11 04:14:04.073098 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 530/980] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:03 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:04.189963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-61cb7917-bc55-4b42-8163-b082dd8c721e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:04.194113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-61cb7917-bc55-4b42-8163-b082dd8c721e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:04.208298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61cb7917-bc55-4b42-8163-b082dd8c721e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:04.211233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61cb7917-bc55-4b42-8163-b082dd8c721e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:04.216886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61cb7917-bc55-4b42-8163-b082dd8c721e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:04.217627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61cb7917-bc55-4b42-8163-b082dd8c721e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:04.218096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61cb7917-bc55-4b42-8163-b082dd8c721e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:04.218565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61cb7917-bc55-4b42-8163-b082dd8c721e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:04.395915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-816aba9e-cad2-40aa-b516-aa99b539baec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:04.405464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-816aba9e-cad2-40aa-b516-aa99b539baec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:04.435061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-816aba9e-cad2-40aa-b516-aa99b539baec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:04.435286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-816aba9e-cad2-40aa-b516-aa99b539baec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:04.437175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-816aba9e-cad2-40aa-b516-aa99b539baec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:04.439465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-816aba9e-cad2-40aa-b516-aa99b539baec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:04.439879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-816aba9e-cad2-40aa-b516-aa99b539baec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:04.440320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-816aba9e-cad2-40aa-b516-aa99b539baec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:04.585024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-61cb7917-bc55-4b42-8163-b082dd8c721e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:04.593929 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-61cb7917-bc55-4b42-8163-b082dd8c721e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.407764 Oct 11 04:14:04.618120 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 451/981] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:04 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:04.625370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:04.625994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:04.634796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:04.635364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:04.635802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:04.637404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:04.643564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:04.650104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:04.652831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-816aba9e-cad2-40aa-b516-aa99b539baec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:04.668058 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-816aba9e-cad2-40aa-b516-aa99b539baec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.280214 Oct 11 04:14:04.678230 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 531/982] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:04 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:04.750281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6dc8a7ae-3125-4a5d-9f9d-17ae60561b1b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:04.750940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6dc8a7ae-3125-4a5d-9f9d-17ae60561b1b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:04.753581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:04.758543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc8a7ae-3125-4a5d-9f9d-17ae60561b1b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:04.759048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc8a7ae-3125-4a5d-9f9d-17ae60561b1b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:04.759487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc8a7ae-3125-4a5d-9f9d-17ae60561b1b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:04.760460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc8a7ae-3125-4a5d-9f9d-17ae60561b1b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:04.760750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc8a7ae-3125-4a5d-9f9d-17ae60561b1b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:04.761153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dc8a7ae-3125-4a5d-9f9d-17ae60561b1b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:04.771085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:04.771085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:04.775447 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d40dd121-7f14-4768-ba7b-f1a4fa3e2dcf tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.156132 Oct 11 04:14:04.790719 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 452/983] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:04 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:05.068237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6dc8a7ae-3125-4a5d-9f9d-17ae60561b1b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:05.068237 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6dc8a7ae-3125-4a5d-9f9d-17ae60561b1b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1537 microversion: 2.1 time: 0.241793 Oct 11 04:14:05.068237 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 532/984] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:04 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1537 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:05.072773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-026ff8a6-c2bd-4f4d-9d33-7ab77dc3fdbf tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19b6b3a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:05.072773 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-026ff8a6-c2bd-4f4d-9d33-7ab77dc3fdbf tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.054061 Oct 11 04:14:05.074498 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 453/985] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:05 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:05.100865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:05.101697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:05.108413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:05.109026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:05.109460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:05.110279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:05.110639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:05.111088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:05.115075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:05.279801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:05.289999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:05.291533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:05.300325 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-616e86c0-aa35-4c96-ad14-bfe057945052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.197379 Oct 11 04:14:05.301578 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 533/986] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:05 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:05.302672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-677b9b9b-fca6-4687-984d-db496455562d req-02d9168f-8349-4703-93ac-cf7d57ea503e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0263254c-1383-4f74-8505-d1402be4bd56", "tag": "a2a80df7-c7d4-450b-bd19-d4a1c38a2015"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:05.325749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-677b9b9b-fca6-4687-984d-db496455562d req-02d9168f-8349-4703-93ac-cf7d57ea503e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:05.326638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-677b9b9b-fca6-4687-984d-db496455562d req-02d9168f-8349-4703-93ac-cf7d57ea503e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:05.333383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-677b9b9b-fca6-4687-984d-db496455562d req-02d9168f-8349-4703-93ac-cf7d57ea503e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:05.340719 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-677b9b9b-fca6-4687-984d-db496455562d req-02d9168f-8349-4703-93ac-cf7d57ea503e service nova] Creating event network-changed:a2a80df7-c7d4-450b-bd19-d4a1c38a2015 for instance 0263254c-1383-4f74-8505-d1402be4bd56 on n-h1-860892-1 Oct 11 04:14:05.347676 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-677b9b9b-fca6-4687-984d-db496455562d req-02d9168f-8349-4703-93ac-cf7d57ea503e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051092 Oct 11 04:14:05.348819 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 454/987] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:05.633151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0efdbb2a-6e26-4cc9-82f0-4c14406472f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:05.638636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0efdbb2a-6e26-4cc9-82f0-4c14406472f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:05.652869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0efdbb2a-6e26-4cc9-82f0-4c14406472f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:05.653393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0efdbb2a-6e26-4cc9-82f0-4c14406472f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:05.653849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0efdbb2a-6e26-4cc9-82f0-4c14406472f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:05.654630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0efdbb2a-6e26-4cc9-82f0-4c14406472f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:05.666716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0efdbb2a-6e26-4cc9-82f0-4c14406472f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:05.666716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0efdbb2a-6e26-4cc9-82f0-4c14406472f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:05.694603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bb79a624-a7a0-4293-8dce-2a52fdc3b6de tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:05.695553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bb79a624-a7a0-4293-8dce-2a52fdc3b6de tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:05.708189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb79a624-a7a0-4293-8dce-2a52fdc3b6de tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:05.710376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb79a624-a7a0-4293-8dce-2a52fdc3b6de tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:05.711091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb79a624-a7a0-4293-8dce-2a52fdc3b6de tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:05.712142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb79a624-a7a0-4293-8dce-2a52fdc3b6de tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:05.714587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb79a624-a7a0-4293-8dce-2a52fdc3b6de tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:05.715280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb79a624-a7a0-4293-8dce-2a52fdc3b6de tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:05.865054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0efdbb2a-6e26-4cc9-82f0-4c14406472f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:05.877801 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0efdbb2a-6e26-4cc9-82f0-4c14406472f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.250452 Oct 11 04:14:05.879033 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 534/988] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:05 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:05.884312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:05.884944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:05.892420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:05.896209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:05.896209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:05.896209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:05.896209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:05.896503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:05.961803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb79a624-a7a0-4293-8dce-2a52fdc3b6de tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:05.974536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:05.979226 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bb79a624-a7a0-4293-8dce-2a52fdc3b6de tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.289275 Oct 11 04:14:05.980032 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 455/989] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:05 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:05.995322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:05.995692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:06.002947 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-79d744eb-3a8e-460e-ad69-e7527f2f4816 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.122876 Oct 11 04:14:06.003627 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 535/990] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:05 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:06.029711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b5ba585-9530-4c09-ab34-13cf792bc674 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:06.030421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0b5ba585-9530-4c09-ab34-13cf792bc674 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:06.043597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b5ba585-9530-4c09-ab34-13cf792bc674 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:06.043597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b5ba585-9530-4c09-ab34-13cf792bc674 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:06.043597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b5ba585-9530-4c09-ab34-13cf792bc674 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:06.043597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b5ba585-9530-4c09-ab34-13cf792bc674 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:06.043983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b5ba585-9530-4c09-ab34-13cf792bc674 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:06.043983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b5ba585-9530-4c09-ab34-13cf792bc674 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:06.093753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-934db418-ead5-44d7-ac53-82ebb2210b46 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda1a00f040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:06.146293 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-934db418-ead5-44d7-ac53-82ebb2210b46 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.060836 Oct 11 04:14:06.146892 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 536/991] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:06 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:06.281331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b5ba585-9530-4c09-ab34-13cf792bc674 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:06.293168 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0b5ba585-9530-4c09-ab34-13cf792bc674 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1537 microversion: 2.1 time: 0.276619 Oct 11 04:14:06.294022 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 456/992] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:06 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1537 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:06.329692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:06.333472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:06.348686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:06.352469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:06.353434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:06.357674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:06.358503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:06.363004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:06.592260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:06.601050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:06.602525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:06.603704 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-76a46950-2bd5-4f1e-a2aa-e9ce4f92a35c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.282089 Oct 11 04:14:06.604858 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 537/993] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:06 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:06.901161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-426f59bc-6d97-4d20-b20e-b336fbc415b3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:06.902077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-426f59bc-6d97-4d20-b20e-b336fbc415b3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:06.909086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426f59bc-6d97-4d20-b20e-b336fbc415b3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:06.909751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426f59bc-6d97-4d20-b20e-b336fbc415b3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:06.910356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426f59bc-6d97-4d20-b20e-b336fbc415b3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:06.911151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426f59bc-6d97-4d20-b20e-b336fbc415b3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:06.911752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426f59bc-6d97-4d20-b20e-b336fbc415b3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:06.912508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426f59bc-6d97-4d20-b20e-b336fbc415b3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:07.002916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e42e5b79-da6d-425d-b3ce-eff471ceaaaa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:07.003823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e42e5b79-da6d-425d-b3ce-eff471ceaaaa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:07.017327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e42e5b79-da6d-425d-b3ce-eff471ceaaaa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:07.018027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e42e5b79-da6d-425d-b3ce-eff471ceaaaa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:07.018703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e42e5b79-da6d-425d-b3ce-eff471ceaaaa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:07.019577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e42e5b79-da6d-425d-b3ce-eff471ceaaaa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:07.020767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e42e5b79-da6d-425d-b3ce-eff471ceaaaa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:07.021864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e42e5b79-da6d-425d-b3ce-eff471ceaaaa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:07.081457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-426f59bc-6d97-4d20-b20e-b336fbc415b3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:07.090384 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-426f59bc-6d97-4d20-b20e-b336fbc415b3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.193264 Oct 11 04:14:07.098649 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 457/994] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:06 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:07.105680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:07.106760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:07.113901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:07.114695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:07.115405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:07.117306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:07.117934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:07.119259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:07.207204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:07.211956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e42e5b79-da6d-425d-b3ce-eff471ceaaaa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:07.216254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:07.218296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:07.223412 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e42e5b79-da6d-425d-b3ce-eff471ceaaaa tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.224240 Oct 11 04:14:07.224300 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 538/995] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:06 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:07.225068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5187b5e5-ed4b-472f-a41b-389dbbcb5c4e tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.124654 Oct 11 04:14:07.225909 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 458/996] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:07 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:07.228932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38dd1778-a5f2-4225-9dbb-c1fce9a3b9b3 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19ed8040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:07.278754 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-38dd1778-a5f2-4225-9dbb-c1fce9a3b9b3 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.053356 Oct 11 04:14:07.279330 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 539/997] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:07 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:07.320721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3fafc2fb-d863-425a-91e6-55ef7724e1dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:07.321406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3fafc2fb-d863-425a-91e6-55ef7724e1dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:07.327667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3fafc2fb-d863-425a-91e6-55ef7724e1dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:07.328273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3fafc2fb-d863-425a-91e6-55ef7724e1dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:07.328803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3fafc2fb-d863-425a-91e6-55ef7724e1dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:07.329617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3fafc2fb-d863-425a-91e6-55ef7724e1dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:07.330178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3fafc2fb-d863-425a-91e6-55ef7724e1dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:07.330724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3fafc2fb-d863-425a-91e6-55ef7724e1dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:07.489458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3fafc2fb-d863-425a-91e6-55ef7724e1dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:07.498164 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3fafc2fb-d863-425a-91e6-55ef7724e1dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1537 microversion: 2.1 time: 0.181637 Oct 11 04:14:07.498982 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 459/998] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:07 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1537 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:07.628746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:07.629915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:07.637361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:07.637913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:07.638385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:07.639082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:07.639946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:07.640380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:07.789739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:07.794718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:07.796256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:07.797435 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7b0b77b7-da2a-4916-85e7-790dbdf95f2c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.172466 Oct 11 04:14:07.798778 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 540/999] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:07 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:08.115276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bcef595a-f6ea-4ff6-8238-7f7cdf20d2e9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:08.116638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bcef595a-f6ea-4ff6-8238-7f7cdf20d2e9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:08.123598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcef595a-f6ea-4ff6-8238-7f7cdf20d2e9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:08.124204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcef595a-f6ea-4ff6-8238-7f7cdf20d2e9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:08.124762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcef595a-f6ea-4ff6-8238-7f7cdf20d2e9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:08.125550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcef595a-f6ea-4ff6-8238-7f7cdf20d2e9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:08.126103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcef595a-f6ea-4ff6-8238-7f7cdf20d2e9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:08.126642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcef595a-f6ea-4ff6-8238-7f7cdf20d2e9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:08.147496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:08.252583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b50394bb-ff63-4ca3-832a-fc1dbbbef20b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:08.253307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b50394bb-ff63-4ca3-832a-fc1dbbbef20b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:08.260976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b50394bb-ff63-4ca3-832a-fc1dbbbef20b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:08.261462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b50394bb-ff63-4ca3-832a-fc1dbbbef20b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:08.262151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b50394bb-ff63-4ca3-832a-fc1dbbbef20b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:08.263216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b50394bb-ff63-4ca3-832a-fc1dbbbef20b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:08.263856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b50394bb-ff63-4ca3-832a-fc1dbbbef20b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:08.264295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b50394bb-ff63-4ca3-832a-fc1dbbbef20b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:08.277308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bcef595a-f6ea-4ff6-8238-7f7cdf20d2e9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:08.291744 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bcef595a-f6ea-4ff6-8238-7f7cdf20d2e9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.180226 Oct 11 04:14:08.292566 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 460/1000] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:08 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:08.297509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:08.298103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:08.304395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:08.305171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:08.305858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:08.306739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:08.307355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:08.307911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:08.390699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:08.400338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:08.401814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:08.407514 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f9584c44-7179-4ffe-9cdf-735ba2c40509 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.113588 Oct 11 04:14:08.408161 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 461/1001] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:08 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:08.413437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7ce8729-c124-4b4c-9a1e-4f205c5fb70d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19b0a5e0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:08.415779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b50394bb-ff63-4ca3-832a-fc1dbbbef20b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:08.424713 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b50394bb-ff63-4ca3-832a-fc1dbbbef20b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.178842 Oct 11 04:14:08.425491 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 541/1002] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:08 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:08.458867 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a7ce8729-c124-4b4c-9a1e-4f205c5fb70d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.049541 Oct 11 04:14:08.459432 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 462/1003] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:08 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:08.526734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cf1217dd-5502-4740-9329-320b742933bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:08.527342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cf1217dd-5502-4740-9329-320b742933bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:08.533294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf1217dd-5502-4740-9329-320b742933bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:08.533772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf1217dd-5502-4740-9329-320b742933bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:08.534229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf1217dd-5502-4740-9329-320b742933bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:08.534913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf1217dd-5502-4740-9329-320b742933bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:08.535371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf1217dd-5502-4740-9329-320b742933bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:08.535794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf1217dd-5502-4740-9329-320b742933bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:08.667271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cf1217dd-5502-4740-9329-320b742933bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:08.675072 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cf1217dd-5502-4740-9329-320b742933bb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1537 microversion: 2.1 time: 0.152936 Oct 11 04:14:08.675635 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 542/1004] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:08 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1537 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:08.823459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:08.824076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:08.830357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:08.830851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:08.831283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:08.832014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:08.832474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:08.832909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:08.961899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:08.969925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:08.971401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:08.972499 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4022a328-f526-4f66-b738-a819ea2b4aea tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.153577 Oct 11 04:14:08.973042 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 463/1005] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:08 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:09.334359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-926b9926-083f-4fdf-9dd9-119694b6ba82 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:09.335094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-926b9926-083f-4fdf-9dd9-119694b6ba82 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:09.340939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:09.342506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-926b9926-083f-4fdf-9dd9-119694b6ba82 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:09.342991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-926b9926-083f-4fdf-9dd9-119694b6ba82 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:09.343424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-926b9926-083f-4fdf-9dd9-119694b6ba82 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:09.344878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-926b9926-083f-4fdf-9dd9-119694b6ba82 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:09.345339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-926b9926-083f-4fdf-9dd9-119694b6ba82 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:09.346369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-926b9926-083f-4fdf-9dd9-119694b6ba82 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:09.436917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:09.447569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:09.451568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=10 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:09.453347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=14 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:09.455258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:09.456181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:09.456826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:09.457721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:09.458213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:09.458791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:09.535957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-926b9926-083f-4fdf-9dd9-119694b6ba82 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:09.544074 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-926b9926-083f-4fdf-9dd9-119694b6ba82 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.213637 Oct 11 04:14:09.550302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:09.559194 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 543/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:09 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:09.561271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:09.563025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:09.565726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0aad150-3a60-4ecb-b16f-5208353ef6a8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:09.566389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d0aad150-3a60-4ecb-b16f-5208353ef6a8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:09.568909 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-19893fda-42cc-4729-8945-f97fcc631f95 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1446 microversion: 2.75 time: 0.135795 Oct 11 04:14:09.570507 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 464/1007] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:09 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1446 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:09.575446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ec35f5ad-e835-4b9f-b0fb-b5abae18e369 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19b2f700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:09.610116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0aad150-3a60-4ecb-b16f-5208353ef6a8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:09.610903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0aad150-3a60-4ecb-b16f-5208353ef6a8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:09.614350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0aad150-3a60-4ecb-b16f-5208353ef6a8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:09.615461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0aad150-3a60-4ecb-b16f-5208353ef6a8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:09.616505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0aad150-3a60-4ecb-b16f-5208353ef6a8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:09.616996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0aad150-3a60-4ecb-b16f-5208353ef6a8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:09.665236 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ec35f5ad-e835-4b9f-b0fb-b5abae18e369 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.093276 Oct 11 04:14:09.675264 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 465/1008] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:09 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:09.700122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cfda2d53-5b80-4fea-88a7-39df7124af8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:09.701175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cfda2d53-5b80-4fea-88a7-39df7124af8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:09.709843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfda2d53-5b80-4fea-88a7-39df7124af8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:09.710849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfda2d53-5b80-4fea-88a7-39df7124af8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:09.711796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfda2d53-5b80-4fea-88a7-39df7124af8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:09.712847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfda2d53-5b80-4fea-88a7-39df7124af8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:09.713608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfda2d53-5b80-4fea-88a7-39df7124af8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:09.714409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfda2d53-5b80-4fea-88a7-39df7124af8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:09.864600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d0aad150-3a60-4ecb-b16f-5208353ef6a8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:09.872529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cfda2d53-5b80-4fea-88a7-39df7124af8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:09.874832 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d0aad150-3a60-4ecb-b16f-5208353ef6a8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.314305 Oct 11 04:14:09.886277 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 544/1009] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:09 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:09.886472 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cfda2d53-5b80-4fea-88a7-39df7124af8f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1537 microversion: 2.1 time: 0.186942 Oct 11 04:14:09.886472 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 466/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:09 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1537 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:09.997282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:09.997990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:10.004562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:10.005136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:10.005935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:10.007318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:10.007845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:10.008345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:10.177424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:10.186277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:10.187708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:10.188859 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e0c5d5b2-c356-41e6-a008-238347ae1a41 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.195778 Oct 11 04:14:10.189603 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 545/1011] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:09 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:10.570395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6a428b1b-70ef-45e1-96cd-4763134a93fb tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:10.571998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6a428b1b-70ef-45e1-96cd-4763134a93fb tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:10.589094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a428b1b-70ef-45e1-96cd-4763134a93fb tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:10.590166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a428b1b-70ef-45e1-96cd-4763134a93fb tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:10.590869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a428b1b-70ef-45e1-96cd-4763134a93fb tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:10.592163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a428b1b-70ef-45e1-96cd-4763134a93fb tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:10.592877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a428b1b-70ef-45e1-96cd-4763134a93fb tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:10.593750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a428b1b-70ef-45e1-96cd-4763134a93fb tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:10.602675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:10.604058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:10.613273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:10.618519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:10.619218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:10.620526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:10.625438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:10.629336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:10.629818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:10.745039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:10.756996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:10.758760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:10.780172 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b4735565-aaa0-4477-8369-3dd733fd0ad1 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1464 microversion: 2.75 time: 0.174978 Oct 11 04:14:10.780821 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 546/1012] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:10 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1464 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:10.786355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e614c4fd-001b-40b6-98ea-39426963b61e tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19fe70d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:10.846285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6a428b1b-70ef-45e1-96cd-4763134a93fb tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:10.855956 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6a428b1b-70ef-45e1-96cd-4763134a93fb tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.289566 Oct 11 04:14:10.868403 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 467/1013] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:10 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:10.868687 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e614c4fd-001b-40b6-98ea-39426963b61e tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.082466 Oct 11 04:14:10.868687 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 547/1014] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:10 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:10.905541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-94e6cb34-d40c-4b35-ada1-b5e184a882ce tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:10.906394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-94e6cb34-d40c-4b35-ada1-b5e184a882ce tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:10.908730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9ffa710-a196-4626-b402-d43941598438 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:10.909683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e9ffa710-a196-4626-b402-d43941598438 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:10.924728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9ffa710-a196-4626-b402-d43941598438 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:10.925247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94e6cb34-d40c-4b35-ada1-b5e184a882ce tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:10.925930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94e6cb34-d40c-4b35-ada1-b5e184a882ce tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:10.926724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9ffa710-a196-4626-b402-d43941598438 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:10.927228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94e6cb34-d40c-4b35-ada1-b5e184a882ce tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:10.928151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94e6cb34-d40c-4b35-ada1-b5e184a882ce tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:10.929465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9ffa710-a196-4626-b402-d43941598438 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:10.930882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94e6cb34-d40c-4b35-ada1-b5e184a882ce tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:10.931103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9ffa710-a196-4626-b402-d43941598438 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:10.931878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9ffa710-a196-4626-b402-d43941598438 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:10.932339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94e6cb34-d40c-4b35-ada1-b5e184a882ce tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:10.934522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9ffa710-a196-4626-b402-d43941598438 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:11.176919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-94e6cb34-d40c-4b35-ada1-b5e184a882ce tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:11.189292 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-94e6cb34-d40c-4b35-ada1-b5e184a882ce tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1537 microversion: 2.1 time: 0.287125 Oct 11 04:14:11.189967 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 548/1015] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:10 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1537 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:11.195074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e0ad7d86-1a5a-4789-b3cf-816f3bcf288b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:11.197139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e0ad7d86-1a5a-4789-b3cf-816f3bcf288b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:11.203290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d86-1a5a-4789-b3cf-816f3bcf288b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:11.203778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d86-1a5a-4789-b3cf-816f3bcf288b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:11.204215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d86-1a5a-4789-b3cf-816f3bcf288b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:11.205056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d86-1a5a-4789-b3cf-816f3bcf288b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:11.205579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d86-1a5a-4789-b3cf-816f3bcf288b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:11.206689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0ad7d86-1a5a-4789-b3cf-816f3bcf288b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:11.219639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9ffa710-a196-4626-b402-d43941598438 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:11.228909 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9ffa710-a196-4626-b402-d43941598438 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.334750 Oct 11 04:14:11.231998 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 468/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:10 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:11.235190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:11.235968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:11.246150 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e0ad7d86-1a5a-4789-b3cf-816f3bcf288b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054868 Oct 11 04:14:11.247239 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 549/1017] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:14:11 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:11.254674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:11.261988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:11.262690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:11.263635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:11.264258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:11.264905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:11.265851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c7d7bfe-2ccd-4de4-961e-29e82fa8bf74 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:11.266935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c7d7bfe-2ccd-4de4-961e-29e82fa8bf74 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:11.275617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7d7bfe-2ccd-4de4-961e-29e82fa8bf74 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:11.276252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7d7bfe-2ccd-4de4-961e-29e82fa8bf74 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:11.276792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7d7bfe-2ccd-4de4-961e-29e82fa8bf74 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:11.277597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7d7bfe-2ccd-4de4-961e-29e82fa8bf74 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:11.278323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7d7bfe-2ccd-4de4-961e-29e82fa8bf74 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:11.278852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7d7bfe-2ccd-4de4-961e-29e82fa8bf74 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:11.433945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-5c7d7bfe-2ccd-4de4-961e-29e82fa8bf74 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lazy-loading 'services' on Instance uuid 64baf484-344e-4c1d-861d-c1dff29896e0 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:11.561550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:11.572812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:11.574353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:11.576995 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-80714fe7-afde-4c5b-925d-4788dc8c07a7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.346058 Oct 11 04:14:11.590740 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 469/1018] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:11 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:11.765622 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c7d7bfe-2ccd-4de4-961e-29e82fa8bf74 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "DELETE /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments/1c1ce1f3-c6d5-407d-ad99-4868dee0652a" status: 202 len: 0 microversion: 2.1 time: 0.509416 Oct 11 04:14:11.766715 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 550/1019] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:14:11 2022] DELETE /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments/1c1ce1f3-c6d5-407d-ad99-4868dee0652a => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:14:11.814393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:11.814986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:11.822425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:11.822909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:11.823341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:11.824638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:11.825265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:11.825918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:11.891752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db927edc-79ea-47ad-b15d-5f4d8d6082ed tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:11.892364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-db927edc-79ea-47ad-b15d-5f4d8d6082ed tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:11.901520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:11.903622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db927edc-79ea-47ad-b15d-5f4d8d6082ed tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:11.904124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db927edc-79ea-47ad-b15d-5f4d8d6082ed tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:11.904610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db927edc-79ea-47ad-b15d-5f4d8d6082ed tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:11.905370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db927edc-79ea-47ad-b15d-5f4d8d6082ed tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:11.905821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db927edc-79ea-47ad-b15d-5f4d8d6082ed tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:11.906308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db927edc-79ea-47ad-b15d-5f4d8d6082ed tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:11.914488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:11.939467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:11.941327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:11.949813 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-07a0ded0-23c5-4bc2-8a07-bc676b6663e0 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1452 microversion: 2.75 time: 0.139474 Oct 11 04:14:11.969663 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 470/1020] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:11 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:11.974887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-06246b7e-29b1-4864-8726-30ad1f7d2f54 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19b5dd30>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:12.039850 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-06246b7e-29b1-4864-8726-30ad1f7d2f54 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.068915 Oct 11 04:14:12.040659 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 471/1021] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:11 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:12.115641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-db927edc-79ea-47ad-b15d-5f4d8d6082ed tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:12.126266 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-db927edc-79ea-47ad-b15d-5f4d8d6082ed tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.246135 Oct 11 04:14:12.127720 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 551/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:11 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:12.213158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cc10ac44-dbcc-4c67-bfcf-3c3cce01d667 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:12.213682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cc10ac44-dbcc-4c67-bfcf-3c3cce01d667 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:12.217003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:DELETE=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:12.220957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc10ac44-dbcc-4c67-bfcf-3c3cce01d667 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:12.221459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc10ac44-dbcc-4c67-bfcf-3c3cce01d667 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:12.221897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc10ac44-dbcc-4c67-bfcf-3c3cce01d667 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:12.222646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc10ac44-dbcc-4c67-bfcf-3c3cce01d667 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:12.223110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc10ac44-dbcc-4c67-bfcf-3c3cce01d667 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:12.223542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc10ac44-dbcc-4c67-bfcf-3c3cce01d667 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:12.252375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-11b56b37-3164-48f6-bf09-60eee7a0cb3e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:12.253023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-11b56b37-3164-48f6-bf09-60eee7a0cb3e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:12.280265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11b56b37-3164-48f6-bf09-60eee7a0cb3e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:12.282932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11b56b37-3164-48f6-bf09-60eee7a0cb3e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:12.282932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11b56b37-3164-48f6-bf09-60eee7a0cb3e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:12.282932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11b56b37-3164-48f6-bf09-60eee7a0cb3e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:12.282932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11b56b37-3164-48f6-bf09-60eee7a0cb3e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:12.283323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11b56b37-3164-48f6-bf09-60eee7a0cb3e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:12.288214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:12.398458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cc10ac44-dbcc-4c67-bfcf-3c3cce01d667 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:12.409144 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cc10ac44-dbcc-4c67-bfcf-3c3cce01d667 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.200571 Oct 11 04:14:12.410084 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 472/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:12 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:12.462179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-11b56b37-3164-48f6-bf09-60eee7a0cb3e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:12.470772 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-11b56b37-3164-48f6-bf09-60eee7a0cb3e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.222166 Oct 11 04:14:12.471284 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 552/1024] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:12 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:12.609295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:12.609961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:12.616888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:12.617376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:12.617817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:12.618607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:12.619242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:12.619668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:12.754796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:12.763945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:12.765378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:12.766513 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f65a817b-9777-4d44-bfc8-a3e7b6429382 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.166206 Oct 11 04:14:12.778203 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 473/1025] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:12 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:12.984934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:12.985585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:12.993293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:12.993863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:12.994329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:12.995026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:12.995480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:12.995904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:13.057577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-58f26101-df84-41ba-902b-fd726a5ae1a8 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19b4d700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:13.077510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:13.104698 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-58f26101-df84-41ba-902b-fd726a5ae1a8 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.053345 Oct 11 04:14:13.105563 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 474/1026] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:13 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:13.105793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:13.107293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:13.114473 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b057a842-2388-48cc-aee8-702384c09c17 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1452 microversion: 2.75 time: 0.133184 Oct 11 04:14:13.115345 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 553/1027] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:12 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1452 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:13.150783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a08192c7-6580-4748-89b6-2ff487d792a6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:13.151395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a08192c7-6580-4748-89b6-2ff487d792a6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:13.157387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a08192c7-6580-4748-89b6-2ff487d792a6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:13.158033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a08192c7-6580-4748-89b6-2ff487d792a6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:13.158496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a08192c7-6580-4748-89b6-2ff487d792a6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:13.159194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a08192c7-6580-4748-89b6-2ff487d792a6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:13.159645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a08192c7-6580-4748-89b6-2ff487d792a6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:13.160070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a08192c7-6580-4748-89b6-2ff487d792a6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:13.228884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-914f12b5-d633-441c-a76c-2d06671be417 req-76e18791-fb4f-4f05-9d64-3df83f24743d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0263254c-1383-4f74-8505-d1402be4bd56", "name": "network-vif-plugged", "status": "completed", "tag": "a2a80df7-c7d4-450b-bd19-d4a1c38a2015"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:13.247230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-914f12b5-d633-441c-a76c-2d06671be417 req-76e18791-fb4f-4f05-9d64-3df83f24743d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:13.247710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-914f12b5-d633-441c-a76c-2d06671be417 req-76e18791-fb4f-4f05-9d64-3df83f24743d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:13.248161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-914f12b5-d633-441c-a76c-2d06671be417 req-76e18791-fb4f-4f05-9d64-3df83f24743d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:13.266680 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-914f12b5-d633-441c-a76c-2d06671be417 req-76e18791-fb4f-4f05-9d64-3df83f24743d service nova] Creating event network-vif-plugged:a2a80df7-c7d4-450b-bd19-d4a1c38a2015 for instance 0263254c-1383-4f74-8505-d1402be4bd56 on n-h1-860892-1 Oct 11 04:14:13.269514 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-914f12b5-d633-441c-a76c-2d06671be417 req-76e18791-fb4f-4f05-9d64-3df83f24743d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047872 Oct 11 04:14:13.270525 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 554/1028] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:13.327409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a08192c7-6580-4748-89b6-2ff487d792a6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:13.339015 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a08192c7-6580-4748-89b6-2ff487d792a6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.192108 Oct 11 04:14:13.340015 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 475/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:13 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:13.436361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e44c537-cc1e-436e-aa21-07ed341efa79 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:13.437162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e44c537-cc1e-436e-aa21-07ed341efa79 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:13.444767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e44c537-cc1e-436e-aa21-07ed341efa79 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:13.445267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e44c537-cc1e-436e-aa21-07ed341efa79 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:13.445702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e44c537-cc1e-436e-aa21-07ed341efa79 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:13.446594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e44c537-cc1e-436e-aa21-07ed341efa79 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:13.447053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e44c537-cc1e-436e-aa21-07ed341efa79 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:13.447479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e44c537-cc1e-436e-aa21-07ed341efa79 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:13.496662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b9658c7-51f5-4225-bf8d-911c61290088 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:13.496662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0b9658c7-51f5-4225-bf8d-911c61290088 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:13.508227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b9658c7-51f5-4225-bf8d-911c61290088 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:13.508931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b9658c7-51f5-4225-bf8d-911c61290088 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:13.509537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b9658c7-51f5-4225-bf8d-911c61290088 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:13.510433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b9658c7-51f5-4225-bf8d-911c61290088 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:13.512435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b9658c7-51f5-4225-bf8d-911c61290088 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:13.513128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b9658c7-51f5-4225-bf8d-911c61290088 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:13.605116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e44c537-cc1e-436e-aa21-07ed341efa79 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:13.615557 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e44c537-cc1e-436e-aa21-07ed341efa79 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.184096 Oct 11 04:14:13.616950 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 555/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:13 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:13.688764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b9658c7-51f5-4225-bf8d-911c61290088 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:13.699958 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0b9658c7-51f5-4225-bf8d-911c61290088 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.209363 Oct 11 04:14:13.700747 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 476/1031] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:13 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:13.792461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:13.792993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:13.800476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:13.801019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:13.801467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:13.802391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:13.802849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:13.803411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:13.957627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:13.987757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:13.987757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:13.987757 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1c873497-8436-422b-a2c3-f51dead1db23 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.185967 Oct 11 04:14:13.991196 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 556/1032] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:13 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:14.120549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-66e7747d-cc92-4c18-a3fb-f0b576fa0cb3 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19b5ddc0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:14.142613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:14.143297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:14.166462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:14.166914 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-66e7747d-cc92-4c18-a3fb-f0b576fa0cb3 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1426 microversion: 2.1 time: 0.050265 Oct 11 04:14:14.167697 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 477/1033] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:14 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1426 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:14.173992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:14.174497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:14.175228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:14.175684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:14.176108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:14.241218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:14.249321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:14.250788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:14.255801 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae3b62a0-f47a-41d2-81d2-701a18c1b09c tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1452 microversion: 2.75 time: 0.117092 Oct 11 04:14:14.257004 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 557/1034] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:14 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1452 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:14.362210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c4841150-8aee-4943-9740-2159a2591368 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:14.362906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c4841150-8aee-4943-9740-2159a2591368 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:14.370682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4841150-8aee-4943-9740-2159a2591368 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:14.371095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4841150-8aee-4943-9740-2159a2591368 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:14.371525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4841150-8aee-4943-9740-2159a2591368 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:14.372220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4841150-8aee-4943-9740-2159a2591368 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:14.372670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4841150-8aee-4943-9740-2159a2591368 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:14.373306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4841150-8aee-4943-9740-2159a2591368 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:14.504433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c4841150-8aee-4943-9740-2159a2591368 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:14.518309 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c4841150-8aee-4943-9740-2159a2591368 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1472 microversion: 2.1 time: 0.155294 Oct 11 04:14:14.524801 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 478/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:14 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1472 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:14.640992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-59a2b2ec-4706-494b-b145-9c0b59130302 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:14.641652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-59a2b2ec-4706-494b-b145-9c0b59130302 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:14.648297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a2b2ec-4706-494b-b145-9c0b59130302 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:14.649476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a2b2ec-4706-494b-b145-9c0b59130302 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:14.649476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a2b2ec-4706-494b-b145-9c0b59130302 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:14.649878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a2b2ec-4706-494b-b145-9c0b59130302 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:14.650352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a2b2ec-4706-494b-b145-9c0b59130302 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:14.650769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a2b2ec-4706-494b-b145-9c0b59130302 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:14.723085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f69402b-fcfc-41ee-ba08-0403e64e7a59 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:14.723685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2f69402b-fcfc-41ee-ba08-0403e64e7a59 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:14.730489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f69402b-fcfc-41ee-ba08-0403e64e7a59 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:14.736025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f69402b-fcfc-41ee-ba08-0403e64e7a59 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:14.736025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f69402b-fcfc-41ee-ba08-0403e64e7a59 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:14.736025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f69402b-fcfc-41ee-ba08-0403e64e7a59 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:14.736025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f69402b-fcfc-41ee-ba08-0403e64e7a59 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:14.736429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f69402b-fcfc-41ee-ba08-0403e64e7a59 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:14.809109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-59a2b2ec-4706-494b-b145-9c0b59130302 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:14.817448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-59a2b2ec-4706-494b-b145-9c0b59130302 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.180348 Oct 11 04:14:14.826423 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 558/1036] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:14 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:14.891089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f69402b-fcfc-41ee-ba08-0403e64e7a59 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:14.900821 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f69402b-fcfc-41ee-ba08-0403e64e7a59 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.181536 Oct 11 04:14:14.902338 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 479/1037] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:14 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:15.006796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:15.007412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:15.013435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:15.013920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:15.014410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:15.015107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:15.015555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:15.015973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:15.181843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff753fe4-46d1-4dc3-9a15-ed88874632d8 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19acb430>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:15.188326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:15.199730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:15.199730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:15.200744 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f654225-13a8-4940-bf2b-23e419c9f80c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.198376 Oct 11 04:14:15.201659 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 559/1038] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:15 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:15.244894 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff753fe4-46d1-4dc3-9a15-ed88874632d8 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1435 microversion: 2.1 time: 0.067124 Oct 11 04:14:15.245465 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 480/1039] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:15 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1435 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:15.260594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cdd5e08d-cb8c-4607-a745-0ce10af61791 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19e34ee0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:15.284002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:15.285659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:15.297078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:15.297946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:15.298774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:15.300339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:15.301184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:15.301744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:15.314058 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cdd5e08d-cb8c-4607-a745-0ce10af61791 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 200 len: 1435 microversion: 2.1 time: 0.058355 Oct 11 04:14:15.314844 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 560/1040] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:15 2022] GET /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 1435 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:15.328619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-baeb37cf-370f-4ab3-8a48-6b2832fd1f90 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:15.329225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-baeb37cf-370f-4ab3-8a48-6b2832fd1f90 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:15.335584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baeb37cf-370f-4ab3-8a48-6b2832fd1f90 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:15.336069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baeb37cf-370f-4ab3-8a48-6b2832fd1f90 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:15.336495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baeb37cf-370f-4ab3-8a48-6b2832fd1f90 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:15.337179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baeb37cf-370f-4ab3-8a48-6b2832fd1f90 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:15.337626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baeb37cf-370f-4ab3-8a48-6b2832fd1f90 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:15.338043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baeb37cf-370f-4ab3-8a48-6b2832fd1f90 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:15.371033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:15.380079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:15.381776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:15.387250 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-72554a94-3930-4ee5-a988-6a572dc1337b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1452 microversion: 2.75 time: 0.107686 Oct 11 04:14:15.387829 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 481/1041] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:15 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:15.473345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-baeb37cf-370f-4ab3-8a48-6b2832fd1f90 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:15.481865 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-baeb37cf-370f-4ab3-8a48-6b2832fd1f90 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1465 microversion: 2.1 time: 0.156968 Oct 11 04:14:15.482466 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 561/1042] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:15 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1465 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:15.507338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8a71861e-fd3c-428d-8463-487c19692952 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19b2f940>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:15.536559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0d65e25e-b0eb-47f0-b7a7-2ad33955c8f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:15.537179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0d65e25e-b0eb-47f0-b7a7-2ad33955c8f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:15.543678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d65e25e-b0eb-47f0-b7a7-2ad33955c8f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:15.544259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d65e25e-b0eb-47f0-b7a7-2ad33955c8f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:15.546354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d65e25e-b0eb-47f0-b7a7-2ad33955c8f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:15.547300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d65e25e-b0eb-47f0-b7a7-2ad33955c8f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:15.547746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d65e25e-b0eb-47f0-b7a7-2ad33955c8f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:15.548182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d65e25e-b0eb-47f0-b7a7-2ad33955c8f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:15.696630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0d65e25e-b0eb-47f0-b7a7-2ad33955c8f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:15.704385 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0d65e25e-b0eb-47f0-b7a7-2ad33955c8f5 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1478 microversion: 2.1 time: 0.171782 Oct 11 04:14:15.704956 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 562/1043] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:15 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1478 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:15.841163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1a21982-9264-40c8-abec-281969073437 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:15.841769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b1a21982-9264-40c8-abec-281969073437 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:15.847740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1a21982-9264-40c8-abec-281969073437 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:15.848222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1a21982-9264-40c8-abec-281969073437 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:15.848655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1a21982-9264-40c8-abec-281969073437 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:15.849338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1a21982-9264-40c8-abec-281969073437 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:15.850320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1a21982-9264-40c8-abec-281969073437 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:15.850740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1a21982-9264-40c8-abec-281969073437 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:15.991796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b1a21982-9264-40c8-abec-281969073437 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:15.999875 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b1a21982-9264-40c8-abec-281969073437 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.162566 Oct 11 04:14:16.000466 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 563/1044] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:15 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:16.010305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bffdccc2-1780-49d1-b902-6953a743e2d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:16.010963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bffdccc2-1780-49d1-b902-6953a743e2d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:16.017273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bffdccc2-1780-49d1-b902-6953a743e2d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:16.019613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bffdccc2-1780-49d1-b902-6953a743e2d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:16.019613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bffdccc2-1780-49d1-b902-6953a743e2d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:16.019613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bffdccc2-1780-49d1-b902-6953a743e2d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:16.019613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bffdccc2-1780-49d1-b902-6953a743e2d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:16.020053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bffdccc2-1780-49d1-b902-6953a743e2d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:16.169447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bffdccc2-1780-49d1-b902-6953a743e2d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:16.177647 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bffdccc2-1780-49d1-b902-6953a743e2d5 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.175331 Oct 11 04:14:16.178326 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 564/1045] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:16 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:16.226463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:16.227274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:16.233630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:16.234110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:16.234691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:16.235388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:16.235842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:16.236261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:16.375524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:16.384272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:16.385698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:16.386832 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f50b8512-a5ba-4961-b6f9-07adf30ff02e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.164646 Oct 11 04:14:16.387390 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 565/1046] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:16 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:16.414731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:16.415482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:16.421376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:16.421853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:16.422311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:16.422997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:16.423441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:16.423855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:16.489810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:16.496128 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8a71861e-fd3c-428d-8463-487c19692952 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "DELETE /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc" status: 204 len: 0 microversion: 2.1 time: 0.993685 Oct 11 04:14:16.496817 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 482/1047] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:15 2022] DELETE /compute/v2.1/images/cac15413-ec77-4506-877b-eeaa56d21dcc => generated 0 bytes in 995 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:14:16.503953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:16.504666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ee4051f1-f248-4246-a1ae-9e3c38c4c44d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '.version_select at 0x7fda19adec10>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:16.505395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:16.516522 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5bba5b7-1f8d-449c-bb0b-ab59d98b248b tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1452 microversion: 2.75 time: 0.103384 Oct 11 04:14:16.519010 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 566/1048] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:16 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1452 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:16.568065 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-ee4051f1-f248-4246-a1ae-9e3c38c4c44d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] HTTP exception thrown: Image not found. Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ee4051f1-f248-4246-a1ae-9e3c38c4c44d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Request method failure captured: Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 HTTP/1.1 Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO1YFictUNNiX3RmY_udD9qDGdIwN6qSOynCBEQzvEt45ovpfRqqirB690gQH2im2mjDTxvOteZArMMcKw1_I1YwjwBTa0KiC7M2C-TaU2sQEfZn2ngadxiLCb4QseAtPLRS8Yu1dyIYAlXJo0V3OmLUZSVGP_A66bU6hePjZQf0SsA Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d030baca29e8402896cdff2138cfcaab Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesOneServerTestJSON-306707423 Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:14:16.570066 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d030baca29e8402896cdff2138cfcaab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d030baca29e8402896cdff2138cfcaab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d030baca29e8402896cdff2138cfcaab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d030baca29e8402896cdff2138cfcaab"}]}] Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesOneServerTestJSON-306707423 Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d030baca29e8402896cdff2138cfcaab Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-306707423 Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesOneServerTestJSON-306707423-project Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: c3dfadbfcdca4f31b4a0e2d960298fa6 Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesOneServerTestJSON-306707423-project Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'b260f373-d065-4eb0-8e67-00f047263de6'} Oct 11 04:14:16.571889 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b260f373-d065-4eb0-8e67-00f047263de6 to delete Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:16.573435 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b260f373-d065-4eb0-8e67-00f047263de6 could not be found. Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:16.574890 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ee4051f1-f248-4246-a1ae-9e3c38c4c44d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:16.577963 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ee4051f1-f248-4246-a1ae-9e3c38c4c44d tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "DELETE /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6" status: 404 len: 62 microversion: 2.1 time: 0.070930 Oct 11 04:14:16.580153 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 483/1049] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:16 2022] DELETE /compute/v2.1/images/b260f373-d065-4eb0-8e67-00f047263de6 => generated 62 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 04:14:16.581326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-18e45dfc-58ed-4012-a516-7e3e73bbbc88 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:16.581820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-18e45dfc-58ed-4012-a516-7e3e73bbbc88 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:16.589163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e45dfc-58ed-4012-a516-7e3e73bbbc88 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:16.589646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e45dfc-58ed-4012-a516-7e3e73bbbc88 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:16.590079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e45dfc-58ed-4012-a516-7e3e73bbbc88 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:16.590816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e45dfc-58ed-4012-a516-7e3e73bbbc88 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:16.591590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e45dfc-58ed-4012-a516-7e3e73bbbc88 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:16.592194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e45dfc-58ed-4012-a516-7e3e73bbbc88 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:16.619049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-18e45dfc-58ed-4012-a516-7e3e73bbbc88 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:14:16.644376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-eddc973d-3eb7-4a99-8791-a509f7109f25 req-dbf71422-6d22-4878-86aa-de2ac83f1148 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97202407-f542-4189-9582-1f1dd698c594", "name": "network-vif-unplugged", "status": "completed", "tag": "dc8db1bd-a8a8-4b23-8837-a7b82504853f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:16.654693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-eddc973d-3eb7-4a99-8791-a509f7109f25 req-dbf71422-6d22-4878-86aa-de2ac83f1148 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:16.655178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-eddc973d-3eb7-4a99-8791-a509f7109f25 req-dbf71422-6d22-4878-86aa-de2ac83f1148 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:16.655637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-eddc973d-3eb7-4a99-8791-a509f7109f25 req-dbf71422-6d22-4878-86aa-de2ac83f1148 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:16.666530 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-eddc973d-3eb7-4a99-8791-a509f7109f25 req-dbf71422-6d22-4878-86aa-de2ac83f1148 service nova] Creating event network-vif-unplugged:dc8db1bd-a8a8-4b23-8837-a7b82504853f for instance 97202407-f542-4189-9582-1f1dd698c594 on n-h1-860892-1 Oct 11 04:14:16.671843 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-eddc973d-3eb7-4a99-8791-a509f7109f25 req-dbf71422-6d22-4878-86aa-de2ac83f1148 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032018 Oct 11 04:14:16.672996 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 484/1050] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:14:16.728069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9807b5e-3919-47a7-aed0-b53d809148b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:16.728699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9807b5e-3919-47a7-aed0-b53d809148b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:16.734909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9807b5e-3919-47a7-aed0-b53d809148b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:16.735606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9807b5e-3919-47a7-aed0-b53d809148b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:16.738323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9807b5e-3919-47a7-aed0-b53d809148b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:16.738323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9807b5e-3919-47a7-aed0-b53d809148b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:16.738323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9807b5e-3919-47a7-aed0-b53d809148b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:16.738323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9807b5e-3919-47a7-aed0-b53d809148b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:16.936965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b9807b5e-3919-47a7-aed0-b53d809148b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:16.940764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:16.946256 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b9807b5e-3919-47a7-aed0-b53d809148b6 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1478 microversion: 2.1 time: 0.222562 Oct 11 04:14:16.946838 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 485/1051] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:16 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1478 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:16.999783 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-18e45dfc-58ed-4012-a516-7e3e73bbbc88 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 204 len: 0 microversion: 2.1 time: 0.421915 Oct 11 04:14:17.000555 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 567/1052] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:14:16 2022] DELETE /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 0 bytes in 423 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:14:17.010270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-65dd4386-bf76-4a5f-bb0f-e46423bbc2ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:17.011016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-65dd4386-bf76-4a5f-bb0f-e46423bbc2ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:17.019672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65dd4386-bf76-4a5f-bb0f-e46423bbc2ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.020176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65dd4386-bf76-4a5f-bb0f-e46423bbc2ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.020621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65dd4386-bf76-4a5f-bb0f-e46423bbc2ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.021541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65dd4386-bf76-4a5f-bb0f-e46423bbc2ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.022162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65dd4386-bf76-4a5f-bb0f-e46423bbc2ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.022810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65dd4386-bf76-4a5f-bb0f-e46423bbc2ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.024878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43fab0ba-7daf-415e-bc47-b3bad35c6988 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:17.025798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-43fab0ba-7daf-415e-bc47-b3bad35c6988 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:17.031898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43fab0ba-7daf-415e-bc47-b3bad35c6988 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.032378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43fab0ba-7daf-415e-bc47-b3bad35c6988 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.036172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43fab0ba-7daf-415e-bc47-b3bad35c6988 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.036172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43fab0ba-7daf-415e-bc47-b3bad35c6988 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.036172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43fab0ba-7daf-415e-bc47-b3bad35c6988 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.036172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43fab0ba-7daf-415e-bc47-b3bad35c6988 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.165989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-65dd4386-bf76-4a5f-bb0f-e46423bbc2ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:17.174277 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-65dd4386-bf76-4a5f-bb0f-e46423bbc2ed tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1471 microversion: 2.1 time: 0.169648 Oct 11 04:14:17.175044 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 486/1053] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:17 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1471 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:17.175473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-43fab0ba-7daf-415e-bc47-b3bad35c6988 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:17.179527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:17.185648 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-43fab0ba-7daf-415e-bc47-b3bad35c6988 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.164820 Oct 11 04:14:17.186433 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 568/1054] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:17 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:17.203285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3de9c73c-356c-41ca-9d70-fdeb20634ce8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:17.203903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3de9c73c-356c-41ca-9d70-fdeb20634ce8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:17.211509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3de9c73c-356c-41ca-9d70-fdeb20634ce8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.211999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3de9c73c-356c-41ca-9d70-fdeb20634ce8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.212439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3de9c73c-356c-41ca-9d70-fdeb20634ce8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.213135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3de9c73c-356c-41ca-9d70-fdeb20634ce8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.213586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3de9c73c-356c-41ca-9d70-fdeb20634ce8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.214062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3de9c73c-356c-41ca-9d70-fdeb20634ce8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.252766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-34ca2c9c-c8ba-48d9-9bd4-1b61bbe9ae87 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:17.255475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-34ca2c9c-c8ba-48d9-9bd4-1b61bbe9ae87 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:17.263250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ca2c9c-c8ba-48d9-9bd4-1b61bbe9ae87 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.263831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ca2c9c-c8ba-48d9-9bd4-1b61bbe9ae87 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.264337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ca2c9c-c8ba-48d9-9bd4-1b61bbe9ae87 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.265113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ca2c9c-c8ba-48d9-9bd4-1b61bbe9ae87 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.265631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ca2c9c-c8ba-48d9-9bd4-1b61bbe9ae87 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.266341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ca2c9c-c8ba-48d9-9bd4-1b61bbe9ae87 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.302839 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-34ca2c9c-c8ba-48d9-9bd4-1b61bbe9ae87 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053840 Oct 11 04:14:17.303536 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 569/1055] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:14:17 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:14:17.356178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3de9c73c-356c-41ca-9d70-fdeb20634ce8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:17.364145 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3de9c73c-356c-41ca-9d70-fdeb20634ce8 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.165325 Oct 11 04:14:17.364708 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 487/1056] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:17 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:17.412641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:17.413256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:17.419856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.420333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.420764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.421444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.421894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.422345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.549193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:17.549873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:17.551217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:17.556485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.557106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.557541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.558272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.558728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.559152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.563131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:17.563131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:17.563131 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5037ea6f-238a-4f78-b5b3-12c10795a6c8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1362 microversion: 2.25 time: 0.153950 Oct 11 04:14:17.563445 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 570/1057] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:17 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:17.633769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:17.642043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:17.643520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:17.648185 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fc7955fc-7ae5-4e44-874e-9312e80f2aef tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1437 microversion: 2.75 time: 0.103178 Oct 11 04:14:17.648780 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 488/1058] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:17 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1437 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:17.725163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:17.727970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:17.733802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.734475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.738060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.738060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.738060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.738060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.814506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:14:17.814925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:14:17.815397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:14:17.815806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:14:17.816209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:14:17.968825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a4589c60-1d4b-4444-952b-576477a25029 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:17.969428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a4589c60-1d4b-4444-952b-576477a25029 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:17.975017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:17.976074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4589c60-1d4b-4444-952b-576477a25029 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.976834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4589c60-1d4b-4444-952b-576477a25029 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.977318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4589c60-1d4b-4444-952b-576477a25029 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.978319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4589c60-1d4b-4444-952b-576477a25029 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.978536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4589c60-1d4b-4444-952b-576477a25029 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.978931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4589c60-1d4b-4444-952b-576477a25029 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.981355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.982217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.982577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:17.983276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:17.983724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:17.984142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.102593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:18.114026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a4589c60-1d4b-4444-952b-576477a25029 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:18.121865 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a8bdc81-ef44-442e-bdf5-fce8adea6923 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251/action" status: 202 len: 1940 microversion: 2.75 time: 0.446886 Oct 11 04:14:18.122045 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a4589c60-1d4b-4444-952b-576477a25029 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1478 microversion: 2.1 time: 0.156963 Oct 11 04:14:18.122740 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 571/1059] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:14:17 2022] POST /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251/action => generated 1940 bytes in 448 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 11 04:14:18.122873 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 489/1060] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:17 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1478 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:18.148319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b1c8864-07dd-4a24-b8a1-5c73de4e01ab tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:18.148913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b1c8864-07dd-4a24-b8a1-5c73de4e01ab tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:18.155162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b1c8864-07dd-4a24-b8a1-5c73de4e01ab tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.155633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b1c8864-07dd-4a24-b8a1-5c73de4e01ab tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.156058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b1c8864-07dd-4a24-b8a1-5c73de4e01ab tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.156733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b1c8864-07dd-4a24-b8a1-5c73de4e01ab tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.157175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b1c8864-07dd-4a24-b8a1-5c73de4e01ab tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.157589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b1c8864-07dd-4a24-b8a1-5c73de4e01ab tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.198051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-30c9dff2-7061-45ab-a41b-e86e93f15165 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:18.198752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-30c9dff2-7061-45ab-a41b-e86e93f15165 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:18.204715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c9dff2-7061-45ab-a41b-e86e93f15165 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.205197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c9dff2-7061-45ab-a41b-e86e93f15165 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.207977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c9dff2-7061-45ab-a41b-e86e93f15165 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.207977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c9dff2-7061-45ab-a41b-e86e93f15165 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.207977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c9dff2-7061-45ab-a41b-e86e93f15165 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.207977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c9dff2-7061-45ab-a41b-e86e93f15165 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.233754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-9b1c8864-07dd-4a24-b8a1-5c73de4e01ab tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:18.251144 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b1c8864-07dd-4a24-b8a1-5c73de4e01ab tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.106402 Oct 11 04:14:18.251729 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 572/1061] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:18 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:18.256606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-47f14346-ac1f-4170-bca4-e41142f0bbbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:18.257208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-47f14346-ac1f-4170-bca4-e41142f0bbbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:18.262894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47f14346-ac1f-4170-bca4-e41142f0bbbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.263377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47f14346-ac1f-4170-bca4-e41142f0bbbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.263807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47f14346-ac1f-4170-bca4-e41142f0bbbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.264487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47f14346-ac1f-4170-bca4-e41142f0bbbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.264939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47f14346-ac1f-4170-bca4-e41142f0bbbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.265356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47f14346-ac1f-4170-bca4-e41142f0bbbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.348914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-30c9dff2-7061-45ab-a41b-e86e93f15165 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:18.357362 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-30c9dff2-7061-45ab-a41b-e86e93f15165 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1471 microversion: 2.1 time: 0.163067 Oct 11 04:14:18.357926 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 490/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:18 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1471 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:18.362751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-59aa0a85-65ab-4924-a5c4-deeb928ccf12 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:18.364968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-59aa0a85-65ab-4924-a5c4-deeb928ccf12 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:18.371261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59aa0a85-65ab-4924-a5c4-deeb928ccf12 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.371735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59aa0a85-65ab-4924-a5c4-deeb928ccf12 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.372166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59aa0a85-65ab-4924-a5c4-deeb928ccf12 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.373065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59aa0a85-65ab-4924-a5c4-deeb928ccf12 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.373520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59aa0a85-65ab-4924-a5c4-deeb928ccf12 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.373945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59aa0a85-65ab-4924-a5c4-deeb928ccf12 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.396903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-47f14346-ac1f-4170-bca4-e41142f0bbbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:18.403660 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-59aa0a85-65ab-4924-a5c4-deeb928ccf12 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044687 Oct 11 04:14:18.404219 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 491/1063] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:14:18 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:18.404529 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-47f14346-ac1f-4170-bca4-e41142f0bbbf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.151850 Oct 11 04:14:18.405271 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 573/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:18 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:18.408971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-82304a29-1cf5-4e88-a092-6248c48ee61b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:18.409572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-82304a29-1cf5-4e88-a092-6248c48ee61b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:18.415771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82304a29-1cf5-4e88-a092-6248c48ee61b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.416247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82304a29-1cf5-4e88-a092-6248c48ee61b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.416678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82304a29-1cf5-4e88-a092-6248c48ee61b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.417358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82304a29-1cf5-4e88-a092-6248c48ee61b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.417851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82304a29-1cf5-4e88-a092-6248c48ee61b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.418305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82304a29-1cf5-4e88-a092-6248c48ee61b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.544871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-82304a29-1cf5-4e88-a092-6248c48ee61b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:18.552465 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-82304a29-1cf5-4e88-a092-6248c48ee61b tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1522 microversion: 2.1 time: 0.147312 Oct 11 04:14:18.553598 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 492/1065] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:18 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:18.587338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:18.587944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:18.593797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.594368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.594751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.595426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.595873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.596298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.722133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:18.730847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:18.732281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:18.733420 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6dac690c-b38b-4554-86f9-b07434bff576 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1558 microversion: 2.25 time: 0.149943 Oct 11 04:14:18.734026 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 574/1066] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:18 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:18.757703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c2f9d62d-bd1d-4d77-b10d-ce9d7e0c58f3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:18.758338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c2f9d62d-bd1d-4d77-b10d-ce9d7e0c58f3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:18.764175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2f9d62d-bd1d-4d77-b10d-ce9d7e0c58f3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.764644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2f9d62d-bd1d-4d77-b10d-ce9d7e0c58f3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.765072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2f9d62d-bd1d-4d77-b10d-ce9d7e0c58f3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.765738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2f9d62d-bd1d-4d77-b10d-ce9d7e0c58f3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.766217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2f9d62d-bd1d-4d77-b10d-ce9d7e0c58f3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.766621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2f9d62d-bd1d-4d77-b10d-ce9d7e0c58f3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.891364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-c2f9d62d-bd1d-4d77-b10d-ce9d7e0c58f3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid 0263254c-1383-4f74-8505-d1402be4bd56 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:18.904412 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c2f9d62d-bd1d-4d77-b10d-ce9d7e0c58f3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 2051 microversion: 2.25 time: 0.150724 Oct 11 04:14:18.904984 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 493/1067] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:18 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 2051 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:18.928762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-571eab59-2c6a-4abe-868f-fb07a330198d tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:18.929371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-571eab59-2c6a-4abe-868f-fb07a330198d tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:18.935779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571eab59-2c6a-4abe-868f-fb07a330198d tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.936256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571eab59-2c6a-4abe-868f-fb07a330198d tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.936684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571eab59-2c6a-4abe-868f-fb07a330198d tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:18.937365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571eab59-2c6a-4abe-868f-fb07a330198d tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:18.937841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571eab59-2c6a-4abe-868f-fb07a330198d tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:18.938280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571eab59-2c6a-4abe-868f-fb07a330198d tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.065515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-571eab59-2c6a-4abe-868f-fb07a330198d tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid 0263254c-1383-4f74-8505-d1402be4bd56 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:19.078487 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-571eab59-2c6a-4abe-868f-fb07a330198d tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 2051 microversion: 2.25 time: 0.154140 Oct 11 04:14:19.079058 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 575/1068] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:18 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 2051 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:19.102473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3fecc05-eeb3-40cf-a05d-1d54051a810a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:19.105951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3fecc05-eeb3-40cf-a05d-1d54051a810a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.106461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3fecc05-eeb3-40cf-a05d-1d54051a810a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.106899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3fecc05-eeb3-40cf-a05d-1d54051a810a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.107617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3fecc05-eeb3-40cf-a05d-1d54051a810a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.108068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3fecc05-eeb3-40cf-a05d-1d54051a810a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.108489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3fecc05-eeb3-40cf-a05d-1d54051a810a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.132238 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d3fecc05-eeb3-40cf-a05d-1d54051a810a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.033312 Oct 11 04:14:19.132728 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 494/1069] 10.222.0.26 () {60 vars in 1217 bytes} [Tue Oct 11 04:14:19 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:14:19.144480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9ed2aa2-e57a-4e69-9114-4f73545a6862 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:19.144991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb8fa730-ba7b-4e2b-8e48-79d04baf43d4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:19.145101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e9ed2aa2-e57a-4e69-9114-4f73545a6862 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:19.145400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cb8fa730-ba7b-4e2b-8e48-79d04baf43d4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:19.151554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ed2aa2-e57a-4e69-9114-4f73545a6862 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.151720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8fa730-ba7b-4e2b-8e48-79d04baf43d4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.152037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ed2aa2-e57a-4e69-9114-4f73545a6862 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.152185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8fa730-ba7b-4e2b-8e48-79d04baf43d4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.152463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ed2aa2-e57a-4e69-9114-4f73545a6862 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.152618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8fa730-ba7b-4e2b-8e48-79d04baf43d4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.153144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ed2aa2-e57a-4e69-9114-4f73545a6862 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.153356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8fa730-ba7b-4e2b-8e48-79d04baf43d4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.153589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ed2aa2-e57a-4e69-9114-4f73545a6862 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.153813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8fa730-ba7b-4e2b-8e48-79d04baf43d4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.154008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ed2aa2-e57a-4e69-9114-4f73545a6862 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.154262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8fa730-ba7b-4e2b-8e48-79d04baf43d4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.283078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb8fa730-ba7b-4e2b-8e48-79d04baf43d4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:19.290654 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cb8fa730-ba7b-4e2b-8e48-79d04baf43d4 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1478 microversion: 2.1 time: 0.149424 Oct 11 04:14:19.291210 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 495/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:19 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1478 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:19.295565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-24d0cec8-7b18-455b-a485-696fedd680d9 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:19.300624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-24d0cec8-7b18-455b-a485-696fedd680d9 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:19.301599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24d0cec8-7b18-455b-a485-696fedd680d9 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.302075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24d0cec8-7b18-455b-a485-696fedd680d9 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.302541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24d0cec8-7b18-455b-a485-696fedd680d9 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.303708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24d0cec8-7b18-455b-a485-696fedd680d9 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.304153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24d0cec8-7b18-455b-a485-696fedd680d9 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.304574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24d0cec8-7b18-455b-a485-696fedd680d9 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.351045 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e9ed2aa2-e57a-4e69-9114-4f73545a6862 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56/action" status: 202 len: 0 microversion: 2.25 time: 0.210066 Oct 11 04:14:19.354931 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 576/1071] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:14:19 2022] POST /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56/action => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:14:19.360673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-355c8ada-d32e-46c6-8a10-4e15530abf84 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:19.361605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-355c8ada-d32e-46c6-8a10-4e15530abf84 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:19.368292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c8ada-d32e-46c6-8a10-4e15530abf84 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.369438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c8ada-d32e-46c6-8a10-4e15530abf84 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.369438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c8ada-d32e-46c6-8a10-4e15530abf84 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.369906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c8ada-d32e-46c6-8a10-4e15530abf84 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.370392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c8ada-d32e-46c6-8a10-4e15530abf84 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.370807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c8ada-d32e-46c6-8a10-4e15530abf84 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.419827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-24d0cec8-7b18-455b-a485-696fedd680d9 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:19.439323 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-24d0cec8-7b18-455b-a485-696fedd680d9 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.147073 Oct 11 04:14:19.443950 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 496/1072] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:19 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:19.451353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-83fc9273-bc0a-4dcd-8920-c7256976325c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:19.452038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-83fc9273-bc0a-4dcd-8920-c7256976325c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:19.457854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83fc9273-bc0a-4dcd-8920-c7256976325c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.458448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83fc9273-bc0a-4dcd-8920-c7256976325c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.459538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83fc9273-bc0a-4dcd-8920-c7256976325c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.460269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83fc9273-bc0a-4dcd-8920-c7256976325c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.460726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83fc9273-bc0a-4dcd-8920-c7256976325c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.461148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83fc9273-bc0a-4dcd-8920-c7256976325c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.521521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-355c8ada-d32e-46c6-8a10-4e15530abf84 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid 0263254c-1383-4f74-8505-d1402be4bd56 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:19.534860 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-355c8ada-d32e-46c6-8a10-4e15530abf84 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 2056 microversion: 2.25 time: 0.178281 Oct 11 04:14:19.535436 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 577/1073] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:19 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 2056 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:19.540102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a155df5-9bb0-4d60-a503-05fdb16d4f11 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:19.542716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a155df5-9bb0-4d60-a503-05fdb16d4f11 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:19.548767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a155df5-9bb0-4d60-a503-05fdb16d4f11 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.555947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a155df5-9bb0-4d60-a503-05fdb16d4f11 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.555947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a155df5-9bb0-4d60-a503-05fdb16d4f11 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.555947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a155df5-9bb0-4d60-a503-05fdb16d4f11 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.555947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a155df5-9bb0-4d60-a503-05fdb16d4f11 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.556421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a155df5-9bb0-4d60-a503-05fdb16d4f11 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.582481 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a155df5-9bb0-4d60-a503-05fdb16d4f11 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045955 Oct 11 04:14:19.583045 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 578/1074] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:14:19 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:14:19.587408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-15a1f24e-7b0e-482c-bdc7-d962b982aa99 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:19.588005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-15a1f24e-7b0e-482c-bdc7-d962b982aa99 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:19.608255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a1f24e-7b0e-482c-bdc7-d962b982aa99 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.608887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a1f24e-7b0e-482c-bdc7-d962b982aa99 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.609322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a1f24e-7b0e-482c-bdc7-d962b982aa99 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.610255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a1f24e-7b0e-482c-bdc7-d962b982aa99 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.613410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a1f24e-7b0e-482c-bdc7-d962b982aa99 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.613857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a1f24e-7b0e-482c-bdc7-d962b982aa99 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.743008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-83fc9273-bc0a-4dcd-8920-c7256976325c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:19.754614 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-83fc9273-bc0a-4dcd-8920-c7256976325c tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1471 microversion: 2.1 time: 0.312513 Oct 11 04:14:19.757886 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 497/1075] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:19 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1471 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:19.765209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2a6cfe95-c013-4421-8d01-4e47195e6b71 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:19.765982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2a6cfe95-c013-4421-8d01-4e47195e6b71 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:19.777646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6cfe95-c013-4421-8d01-4e47195e6b71 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.778463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6cfe95-c013-4421-8d01-4e47195e6b71 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.779087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6cfe95-c013-4421-8d01-4e47195e6b71 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.780227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6cfe95-c013-4421-8d01-4e47195e6b71 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.781024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6cfe95-c013-4421-8d01-4e47195e6b71 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.782333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6cfe95-c013-4421-8d01-4e47195e6b71 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.794764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-15a1f24e-7b0e-482c-bdc7-d962b982aa99 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:19.805180 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-15a1f24e-7b0e-482c-bdc7-d962b982aa99 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.220723 Oct 11 04:14:19.806378 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 579/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:19 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:19.812476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fafb1f9d-cdd0-46cc-a515-07eb0bc73219 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:19.815392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fafb1f9d-cdd0-46cc-a515-07eb0bc73219 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:19.822944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafb1f9d-cdd0-46cc-a515-07eb0bc73219 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.823477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafb1f9d-cdd0-46cc-a515-07eb0bc73219 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.824063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafb1f9d-cdd0-46cc-a515-07eb0bc73219 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.824907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafb1f9d-cdd0-46cc-a515-07eb0bc73219 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.825426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafb1f9d-cdd0-46cc-a515-07eb0bc73219 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.825971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafb1f9d-cdd0-46cc-a515-07eb0bc73219 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.853555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:19.863895 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fafb1f9d-cdd0-46cc-a515-07eb0bc73219 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056201 Oct 11 04:14:19.864579 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 580/1077] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:14:19 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:14:19.869429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-07d5aebd-fd2f-4c18-b72d-7fb6b846f540 req-3d2c88a6-1145-4116-a927-735ac85ae3db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1ce880-49a7-475d-9f7c-a04705d0d35c", "name": "network-vif-unplugged", "status": "completed", "tag": "5ac5d34a-b5ac-44e2-a066-af84d17457a2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:19.884293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-07d5aebd-fd2f-4c18-b72d-7fb6b846f540 req-3d2c88a6-1145-4116-a927-735ac85ae3db service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.884293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-07d5aebd-fd2f-4c18-b72d-7fb6b846f540 req-3d2c88a6-1145-4116-a927-735ac85ae3db service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.884293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-07d5aebd-fd2f-4c18-b72d-7fb6b846f540 req-3d2c88a6-1145-4116-a927-735ac85ae3db service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.898355 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-07d5aebd-fd2f-4c18-b72d-7fb6b846f540 req-3d2c88a6-1145-4116-a927-735ac85ae3db service nova] Creating event network-vif-unplugged:5ac5d34a-b5ac-44e2-a066-af84d17457a2 for instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c on n-h2-860892-1 Oct 11 04:14:19.904136 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-07d5aebd-fd2f-4c18-b72d-7fb6b846f540 req-3d2c88a6-1145-4116-a927-735ac85ae3db service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037895 Oct 11 04:14:19.905040 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 581/1078] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:19 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:19.949339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1231489c-ab49-4459-99f6-62302376c904 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:19.949914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1231489c-ab49-4459-99f6-62302376c904 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:19.958070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1231489c-ab49-4459-99f6-62302376c904 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.958582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1231489c-ab49-4459-99f6-62302376c904 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.959625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1231489c-ab49-4459-99f6-62302376c904 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.960324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1231489c-ab49-4459-99f6-62302376c904 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:19.960772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1231489c-ab49-4459-99f6-62302376c904 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:19.961192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1231489c-ab49-4459-99f6-62302376c904 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:19.989001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1231489c-ab49-4459-99f6-62302376c904 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:14:20.083399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2a6cfe95-c013-4421-8d01-4e47195e6b71 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:20.092014 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2a6cfe95-c013-4421-8d01-4e47195e6b71 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1502 microversion: 2.1 time: 0.332824 Oct 11 04:14:20.106734 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 498/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:19 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1502 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:20.120196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-391b96c9-5486-41cc-8d29-9a2b4a80bcec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Action: 'create', calling method: .version_select at 0x7fda19b2fdc0>, body: {"security_group": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1594862831", "description": "tempest-description-1794754322"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:20.234074 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1231489c-ab49-4459-99f6-62302376c904 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "DELETE /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 204 len: 0 microversion: 2.1 time: 0.290282 Oct 11 04:14:20.234679 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 582/1080] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:14:19 2022] DELETE /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:14:20.243312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5edc267d-da8c-4188-9eb3-e0d949771aeb tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:20.244089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5edc267d-da8c-4188-9eb3-e0d949771aeb tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:20.250053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5edc267d-da8c-4188-9eb3-e0d949771aeb tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.250549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5edc267d-da8c-4188-9eb3-e0d949771aeb tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.251019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5edc267d-da8c-4188-9eb3-e0d949771aeb tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.251706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5edc267d-da8c-4188-9eb3-e0d949771aeb tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.252154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5edc267d-da8c-4188-9eb3-e0d949771aeb tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.252572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5edc267d-da8c-4188-9eb3-e0d949771aeb tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.406330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5edc267d-da8c-4188-9eb3-e0d949771aeb tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:20.415192 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5edc267d-da8c-4188-9eb3-e0d949771aeb tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1680 microversion: 2.1 time: 0.176131 Oct 11 04:14:20.415948 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 583/1081] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:20 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1680 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:20.424751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e56c3189-a3c8-4c9a-a454-2f5e68564f67 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:20.425353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e56c3189-a3c8-4c9a-a454-2f5e68564f67 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:20.431411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56c3189-a3c8-4c9a-a454-2f5e68564f67 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.431818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56c3189-a3c8-4c9a-a454-2f5e68564f67 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.432248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56c3189-a3c8-4c9a-a454-2f5e68564f67 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.432980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56c3189-a3c8-4c9a-a454-2f5e68564f67 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.433429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56c3189-a3c8-4c9a-a454-2f5e68564f67 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.433884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56c3189-a3c8-4c9a-a454-2f5e68564f67 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.579801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e56c3189-a3c8-4c9a-a454-2f5e68564f67 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:20.587780 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e56c3189-a3c8-4c9a-a454-2f5e68564f67 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1478 microversion: 2.1 time: 0.166751 Oct 11 04:14:20.588344 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 584/1082] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:20 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1478 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:20.593226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1fc807c3-2d9c-410e-91e9-8f8125e210a8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:20.593919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1fc807c3-2d9c-410e-91e9-8f8125e210a8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:20.600079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fc807c3-2d9c-410e-91e9-8f8125e210a8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.600562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fc807c3-2d9c-410e-91e9-8f8125e210a8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.601006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fc807c3-2d9c-410e-91e9-8f8125e210a8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.601697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fc807c3-2d9c-410e-91e9-8f8125e210a8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.602144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fc807c3-2d9c-410e-91e9-8f8125e210a8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.602698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fc807c3-2d9c-410e-91e9-8f8125e210a8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.640406 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-391b96c9-5486-41cc-8d29-9a2b4a80bcec tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 251 microversion: 2.1 time: 0.524918 Oct 11 04:14:20.641792 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 499/1083] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:14:20 2022] POST /compute/v2.1/os-security-groups => generated 251 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:14:20.647615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-b5085941-1e35-4e0b-bc2f-a6948d3bf7f0 req-5cf28165-8fb6-4058-a61d-f63eac700cfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1ce880-49a7-475d-9f7c-a04705d0d35c", "name": "network-vif-deleted", "tag": "5ac5d34a-b5ac-44e2-a066-af84d17457a2"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:20.660083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b5085941-1e35-4e0b-bc2f-a6948d3bf7f0 req-5cf28165-8fb6-4058-a61d-f63eac700cfb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.660598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b5085941-1e35-4e0b-bc2f-a6948d3bf7f0 req-5cf28165-8fb6-4058-a61d-f63eac700cfb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.661021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b5085941-1e35-4e0b-bc2f-a6948d3bf7f0 req-5cf28165-8fb6-4058-a61d-f63eac700cfb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.672443 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-b5085941-1e35-4e0b-bc2f-a6948d3bf7f0 req-5cf28165-8fb6-4058-a61d-f63eac700cfb service nova] Creating event network-vif-deleted:5ac5d34a-b5ac-44e2-a066-af84d17457a2 for instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c on n-h2-860892-1 Oct 11 04:14:20.677558 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-b5085941-1e35-4e0b-bc2f-a6948d3bf7f0 req-5cf28165-8fb6-4058-a61d-f63eac700cfb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034290 Oct 11 04:14:20.678921 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 500/1084] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:20.684867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62ce5c05-298d-4d8c-991c-24edcec27404 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:20.685565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-62ce5c05-298d-4d8c-991c-24edcec27404 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:20.691718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ce5c05-298d-4d8c-991c-24edcec27404 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.692201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ce5c05-298d-4d8c-991c-24edcec27404 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.692635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ce5c05-298d-4d8c-991c-24edcec27404 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.693361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-1fc807c3-2d9c-410e-91e9-8f8125e210a8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:20.693480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ce5c05-298d-4d8c-991c-24edcec27404 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.693892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ce5c05-298d-4d8c-991c-24edcec27404 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.694343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ce5c05-298d-4d8c-991c-24edcec27404 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.711393 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1fc807c3-2d9c-410e-91e9-8f8125e210a8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.121997 Oct 11 04:14:20.711996 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 585/1085] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:20 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:20.716536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b5f472e1-0ac1-455f-acd9-2768ecf72246 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1594862831"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:20.717055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b5f472e1-0ac1-455f-acd9-2768ecf72246 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:20.723336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5f472e1-0ac1-455f-acd9-2768ecf72246 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.723995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5f472e1-0ac1-455f-acd9-2768ecf72246 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.724788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5f472e1-0ac1-455f-acd9-2768ecf72246 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.725634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5f472e1-0ac1-455f-acd9-2768ecf72246 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.726262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5f472e1-0ac1-455f-acd9-2768ecf72246 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.726833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5f472e1-0ac1-455f-acd9-2768ecf72246 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.827066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-62ce5c05-298d-4d8c-991c-24edcec27404 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid 0263254c-1383-4f74-8505-d1402be4bd56 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:20.843344 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-62ce5c05-298d-4d8c-991c-24edcec27404 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 2036 microversion: 2.25 time: 0.162546 Oct 11 04:14:20.843562 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 501/1086] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:20 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 2036 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:20.848109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-707a549c-2f76-4115-8b78-4db5392ce7c1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:20.848820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-707a549c-2f76-4115-8b78-4db5392ce7c1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:20.855896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-707a549c-2f76-4115-8b78-4db5392ce7c1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.856491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-707a549c-2f76-4115-8b78-4db5392ce7c1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.857010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-707a549c-2f76-4115-8b78-4db5392ce7c1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.857776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-707a549c-2f76-4115-8b78-4db5392ce7c1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.858521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-707a549c-2f76-4115-8b78-4db5392ce7c1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.859196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-707a549c-2f76-4115-8b78-4db5392ce7c1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.874681 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.network.security_group_api [None req-b5f472e1-0ac1-455f-acd9-2768ecf72246 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Adding security group 7be32fdb-f25d-45fc-9c2e-65c3ebd0bd01 to port b4654310-3e46-4989-977e-9e06fed03db8 Oct 11 04:14:20.947859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-707a549c-2f76-4115-8b78-4db5392ce7c1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:20.956104 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-707a549c-2f76-4115-8b78-4db5392ce7c1 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1429 microversion: 2.1 time: 0.111502 Oct 11 04:14:20.956915 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 502/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:20 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1429 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:20.961299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ac26104-2cfa-4236-aab5-27ca15f81a71 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:20.962147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5ac26104-2cfa-4236-aab5-27ca15f81a71 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:20.969761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ac26104-2cfa-4236-aab5-27ca15f81a71 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.970442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ac26104-2cfa-4236-aab5-27ca15f81a71 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.971366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ac26104-2cfa-4236-aab5-27ca15f81a71 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:20.972189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ac26104-2cfa-4236-aab5-27ca15f81a71 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:20.972941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ac26104-2cfa-4236-aab5-27ca15f81a71 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:20.973988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ac26104-2cfa-4236-aab5-27ca15f81a71 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:21.106603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5ac26104-2cfa-4236-aab5-27ca15f81a71 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:21.110276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:21.114916 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ac26104-2cfa-4236-aab5-27ca15f81a71 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.157299 Oct 11 04:14:21.116475 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 503/1088] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:20 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:21.122681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-938f4889-b0e4-443c-8495-762984a3757a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860892-1", "block_migration": "auto"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:21.125180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-938f4889-b0e4-443c-8495-762984a3757a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:21.132007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-938f4889-b0e4-443c-8495-762984a3757a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:21.132680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-938f4889-b0e4-443c-8495-762984a3757a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:21.133123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-938f4889-b0e4-443c-8495-762984a3757a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:21.133820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-938f4889-b0e4-443c-8495-762984a3757a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:21.134417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-938f4889-b0e4-443c-8495-762984a3757a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:21.134843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-938f4889-b0e4-443c-8495-762984a3757a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:21.160123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-938f4889-b0e4-443c-8495-762984a3757a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'flavor' on Instance uuid 0263254c-1383-4f74-8505-d1402be4bd56 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:21.172509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-938f4889-b0e4-443c-8495-762984a3757a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Going to try to live migrate instance to n-h2-860892-1 {{(pid=120993) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 04:14:21.319023 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b5f472e1-0ac1-455f-acd9-2768ecf72246 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "POST /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e/action" status: 202 len: 0 microversion: 2.1 time: 0.605450 Oct 11 04:14:21.323343 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 586/1089] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:14:20 2022] POST /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e/action => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:14:21.328469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7acbdf58-c944-45be-9f70-e8edb74e240a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-ServerRescueTestJSONUnderV235-securitygroup-1594862831"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:21.329014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7acbdf58-c944-45be-9f70-e8edb74e240a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:21.345621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7acbdf58-c944-45be-9f70-e8edb74e240a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:21.346606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7acbdf58-c944-45be-9f70-e8edb74e240a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:21.349106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7acbdf58-c944-45be-9f70-e8edb74e240a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:21.349106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7acbdf58-c944-45be-9f70-e8edb74e240a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:21.349106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7acbdf58-c944-45be-9f70-e8edb74e240a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:21.349106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7acbdf58-c944-45be-9f70-e8edb74e240a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:21.537057 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.network.security_group_api [None req-7acbdf58-c944-45be-9f70-e8edb74e240a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Removing security group 7be32fdb-f25d-45fc-9c2e-65c3ebd0bd01 from port b4654310-3e46-4989-977e-9e06fed03db8 Oct 11 04:14:22.032361 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7acbdf58-c944-45be-9f70-e8edb74e240a tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "POST /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e/action" status: 202 len: 0 microversion: 2.1 time: 0.707574 Oct 11 04:14:22.033474 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 587/1090] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:14:21 2022] POST /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e/action => generated 0 bytes in 709 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:14:22.052023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c575c783-3a7a-4d7a-a18c-5baf37aa2985 req-32f5c6e2-3f86-4a82-aa1a-a2b37901f9ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e", "tag": "b4654310-3e46-4989-977e-9e06fed03db8"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:22.059079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:22.083978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c575c783-3a7a-4d7a-a18c-5baf37aa2985 req-32f5c6e2-3f86-4a82-aa1a-a2b37901f9ff service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:22.086358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c575c783-3a7a-4d7a-a18c-5baf37aa2985 req-32f5c6e2-3f86-4a82-aa1a-a2b37901f9ff service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:22.087083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c575c783-3a7a-4d7a-a18c-5baf37aa2985 req-32f5c6e2-3f86-4a82-aa1a-a2b37901f9ff service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:22.117947 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c575c783-3a7a-4d7a-a18c-5baf37aa2985 req-32f5c6e2-3f86-4a82-aa1a-a2b37901f9ff service nova] Creating event network-changed:b4654310-3e46-4989-977e-9e06fed03db8 for instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e on n-h2-860892-1 Oct 11 04:14:22.126448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c575c783-3a7a-4d7a-a18c-5baf37aa2985 req-32f5c6e2-3f86-4a82-aa1a-a2b37901f9ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091515 Oct 11 04:14:22.127138 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 588/1091] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:22.151079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-241f836b-4d74-49c2-829c-4e6956e2c5aa tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:22.152111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-241f836b-4d74-49c2-829c-4e6956e2c5aa tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:22.159322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241f836b-4d74-49c2-829c-4e6956e2c5aa tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:22.159813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241f836b-4d74-49c2-829c-4e6956e2c5aa tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:22.160250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241f836b-4d74-49c2-829c-4e6956e2c5aa tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:22.160953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241f836b-4d74-49c2-829c-4e6956e2c5aa tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:22.161405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241f836b-4d74-49c2-829c-4e6956e2c5aa tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:22.162404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241f836b-4d74-49c2-829c-4e6956e2c5aa tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:22.482789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-241f836b-4d74-49c2-829c-4e6956e2c5aa tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '886899e459944df290afd3583310c873', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '65263374513549f0b6329862bd14f419', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:22.490753 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-241f836b-4d74-49c2-829c-4e6956e2c5aa tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 200 len: 1680 microversion: 2.1 time: 0.358173 Oct 11 04:14:22.491333 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 589/1092] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:22 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 1680 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:22.496149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0fd888f8-9337-4212-9abc-aeebb89b234a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:22.496760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0fd888f8-9337-4212-9abc-aeebb89b234a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:22.508231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd888f8-9337-4212-9abc-aeebb89b234a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:22.509004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd888f8-9337-4212-9abc-aeebb89b234a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:22.510216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd888f8-9337-4212-9abc-aeebb89b234a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:22.516266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd888f8-9337-4212-9abc-aeebb89b234a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:22.516266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd888f8-9337-4212-9abc-aeebb89b234a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:22.516266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd888f8-9337-4212-9abc-aeebb89b234a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:22.672443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0fd888f8-9337-4212-9abc-aeebb89b234a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:22.684872 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0fd888f8-9337-4212-9abc-aeebb89b234a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1478 microversion: 2.1 time: 0.192147 Oct 11 04:14:22.690082 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 590/1093] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:22 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1478 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:22.690403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a1fb86a9-847d-40f5-a26d-d964b8571b52 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:22.691234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a1fb86a9-847d-40f5-a26d-d964b8571b52 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:22.698356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1fb86a9-847d-40f5-a26d-d964b8571b52 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:22.699795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1fb86a9-847d-40f5-a26d-d964b8571b52 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:22.700325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1fb86a9-847d-40f5-a26d-d964b8571b52 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:22.701064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1fb86a9-847d-40f5-a26d-d964b8571b52 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:22.701573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1fb86a9-847d-40f5-a26d-d964b8571b52 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:22.702259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1fb86a9-847d-40f5-a26d-d964b8571b52 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:22.776118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-a1fb86a9-847d-40f5-a26d-d964b8571b52 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:22.794365 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a1fb86a9-847d-40f5-a26d-d964b8571b52 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.107733 Oct 11 04:14:22.799839 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 591/1094] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:22 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:22.799999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:22.800469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:22.806722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:22.807206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:22.807653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:22.808588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:22.809074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:22.809489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:22.851503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:22.852093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:22.852594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:22.853261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lazy-loading 'fault' on Instance uuid 3c1ce880-49a7-475d-9f7c-a04705d0d35c {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:23.198011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3dfadbfcdca4f31b4a0e2d960298fa6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd030baca29e8402896cdff2138cfcaab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:23.228521 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82e53ba7-a1a7-470c-8cef-93bbd8808e93 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 200 len: 1305 microversion: 2.1 time: 0.430720 Oct 11 04:14:23.228521 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 592/1095] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:22 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 1305 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:23.242275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-58778038-7e4b-42a6-9fdd-7a7ad5528fbc tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Action: 'create', calling method: .version_select at 0x7fda19d808b0>, body: {"pool": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:25.092989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-58778038-7e4b-42a6-9fdd-7a7ad5528fbc tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 1.864376 Oct 11 04:14:25.093702 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 593/1096] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:14:23 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 1866 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:25.098209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-688641f1-9683-46c4-9634-f8c4b1005847 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:25.099413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-688641f1-9683-46c4-9634-f8c4b1005847 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:25.105550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-688641f1-9683-46c4-9634-f8c4b1005847 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.106027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-688641f1-9683-46c4-9634-f8c4b1005847 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.106650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-688641f1-9683-46c4-9634-f8c4b1005847 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.107340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-688641f1-9683-46c4-9634-f8c4b1005847 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.107787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-688641f1-9683-46c4-9634-f8c4b1005847 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.108205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-688641f1-9683-46c4-9634-f8c4b1005847 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.139596 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-938f4889-b0e4-443c-8495-762984a3757a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56/action" status: 202 len: 0 microversion: 2.25 time: 4.022013 Oct 11 04:14:25.144136 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 504/1097] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:14:21 2022] POST /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56/action => generated 0 bytes in 4027 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:14:25.149217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b27076fc-e13f-47a4-ba58-04366cd9d36d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:25.149935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b27076fc-e13f-47a4-ba58-04366cd9d36d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:25.156926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27076fc-e13f-47a4-ba58-04366cd9d36d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.157410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27076fc-e13f-47a4-ba58-04366cd9d36d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.157841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27076fc-e13f-47a4-ba58-04366cd9d36d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.158565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27076fc-e13f-47a4-ba58-04366cd9d36d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.159201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27076fc-e13f-47a4-ba58-04366cd9d36d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.159619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27076fc-e13f-47a4-ba58-04366cd9d36d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.189340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b27076fc-e13f-47a4-ba58-04366cd9d36d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:14:25.258022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-688641f1-9683-46c4-9634-f8c4b1005847 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:25.265928 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-688641f1-9683-46c4-9634-f8c4b1005847 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.171246 Oct 11 04:14:25.266522 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 594/1098] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:25 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:25.271943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a32aa8bb-ec95-4638-b6a7-b3470a18de1a req-6f6de3c0-5603-4712-8996-d975932a4667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64baf484-344e-4c1d-861d-c1dff29896e0", "name": "network-vif-deleted", "tag": "95c78ef0-fc25-4830-b08c-6f9ff2e60f95"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:25.284190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a32aa8bb-ec95-4638-b6a7-b3470a18de1a req-6f6de3c0-5603-4712-8996-d975932a4667 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.287652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a32aa8bb-ec95-4638-b6a7-b3470a18de1a req-6f6de3c0-5603-4712-8996-d975932a4667 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.287652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a32aa8bb-ec95-4638-b6a7-b3470a18de1a req-6f6de3c0-5603-4712-8996-d975932a4667 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.298053 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a32aa8bb-ec95-4638-b6a7-b3470a18de1a req-6f6de3c0-5603-4712-8996-d975932a4667 service nova] Creating event network-vif-deleted:95c78ef0-fc25-4830-b08c-6f9ff2e60f95 for instance 64baf484-344e-4c1d-861d-c1dff29896e0 on n-h2-860892-1 Oct 11 04:14:25.303576 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a32aa8bb-ec95-4638-b6a7-b3470a18de1a req-6f6de3c0-5603-4712-8996-d975932a4667 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035930 Oct 11 04:14:25.304181 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 595/1099] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:25.309113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:25.309809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:25.315954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.316745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.316876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.317556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.318117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.318572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.333042 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] HTTP exception thrown: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Request method failure captured: Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 HTTP/1.1 Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROz2lq8tlzxkciCJV0DjrJtfQrLCJwSmAuEvMpzvzFslvhbOB44lKFPFxLg98NvH750vmXnjx5jCIBzrhlsjxsEeVHuWy4_SdYGRrPGpR5jathG5bkGT2Dkt6nr3TkU2EeZlz0rXI4HqddXCMVRxqyxGWcAU2D-_6xUXZCdxlNrtXGs Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 65263374513549f0b6329862bd14f419 Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1490631746 Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:14:25.335275 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/65263374513549f0b6329862bd14f419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_65263374513549f0b6329862bd14f419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65263374513549f0b6329862bd14f419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65263374513549f0b6329862bd14f419"}]}] Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1490631746 Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 65263374513549f0b6329862bd14f419 Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1490631746 Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachSCSIVolumeTestJSON-1490631746-project Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 886899e459944df290afd3583310c873 Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1490631746-project Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:25.336676 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '64baf484-344e-4c1d-861d-c1dff29896e0'} Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:25.337458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:25.338728 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:25.339820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Returning 404 to user: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:25.339820 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-12aa0154-f241-4e6f-8558-ff432c5f96b0 tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 404 len: 111 microversion: 2.1 time: 0.031421 Oct 11 04:14:25.339820 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 596/1100] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:25 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:25.341539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7a7157a4-40a7-44fa-9265-d207833f6a76 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:25.342148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7a7157a4-40a7-44fa-9265-d207833f6a76 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:25.347854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a7157a4-40a7-44fa-9265-d207833f6a76 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.348330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a7157a4-40a7-44fa-9265-d207833f6a76 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.348761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a7157a4-40a7-44fa-9265-d207833f6a76 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.349511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a7157a4-40a7-44fa-9265-d207833f6a76 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.349958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a7157a4-40a7-44fa-9265-d207833f6a76 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.350409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a7157a4-40a7-44fa-9265-d207833f6a76 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.495100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7a7157a4-40a7-44fa-9265-d207833f6a76 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:25.503320 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7a7157a4-40a7-44fa-9265-d207833f6a76 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1478 microversion: 2.1 time: 0.165122 Oct 11 04:14:25.503890 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 597/1101] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:25 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1478 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:25.508567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aa259c7a-b88b-4ca2-a71f-09a67a257a5d tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:25.509158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aa259c7a-b88b-4ca2-a71f-09a67a257a5d tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:25.515446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa259c7a-b88b-4ca2-a71f-09a67a257a5d tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.516109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa259c7a-b88b-4ca2-a71f-09a67a257a5d tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.518513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa259c7a-b88b-4ca2-a71f-09a67a257a5d tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.519842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa259c7a-b88b-4ca2-a71f-09a67a257a5d tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.520308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa259c7a-b88b-4ca2-a71f-09a67a257a5d tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.520735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa259c7a-b88b-4ca2-a71f-09a67a257a5d tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.548995 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b27076fc-e13f-47a4-ba58-04366cd9d36d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "DELETE /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 204 len: 0 microversion: 2.1 time: 0.403017 Oct 11 04:14:25.550093 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 505/1102] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:14:25 2022] DELETE /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:14:25.555687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-77537514-b49d-4453-886c-f4731177db4f req-fd3de362-0a21-464d-9a05-3f33644fd4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e", "tag": "b4654310-3e46-4989-977e-9e06fed03db8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:25.566316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-77537514-b49d-4453-886c-f4731177db4f req-fd3de362-0a21-464d-9a05-3f33644fd4e7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.567029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-77537514-b49d-4453-886c-f4731177db4f req-fd3de362-0a21-464d-9a05-3f33644fd4e7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.567633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-77537514-b49d-4453-886c-f4731177db4f req-fd3de362-0a21-464d-9a05-3f33644fd4e7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.579172 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-77537514-b49d-4453-886c-f4731177db4f req-fd3de362-0a21-464d-9a05-3f33644fd4e7 service nova] Creating event network-changed:b4654310-3e46-4989-977e-9e06fed03db8 for instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e on n-h2-860892-1 Oct 11 04:14:25.584822 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-77537514-b49d-4453-886c-f4731177db4f req-fd3de362-0a21-464d-9a05-3f33644fd4e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033097 Oct 11 04:14:25.585616 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 506/1103] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:25.592076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:25.592896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] [instance: 3c1ce880-49a7-475d-9f7c-a04705d0d35c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:25.599700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.600434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.601037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.601889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.602536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.603106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.608431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-aa259c7a-b88b-4ca2-a71f-09a67a257a5d tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:25.613144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:25.617681 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] HTTP exception thrown: Instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c could not be found. Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Request method failure captured: Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c HTTP/1.1 Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO1YFictUNNiX3RmY_udD9qDGdIwN6qSOynCBEQzvEt45ovpfRqqirB690gQH2im2mjDTxvOteZArMMcKw1_I1YwjwBTa0KiC7M2C-TaU2sQEfZn2ngadxiLCb4QseAtPLRS8Yu1dyIYAlXJo0V3OmLUZSVGP_A66bU6hePjZQf0SsA Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d030baca29e8402896cdff2138cfcaab Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesOneServerTestJSON-306707423 Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:14:25.619345 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d030baca29e8402896cdff2138cfcaab"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d030baca29e8402896cdff2138cfcaab"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d030baca29e8402896cdff2138cfcaab"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d030baca29e8402896cdff2138cfcaab"}]}] Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesOneServerTestJSON-306707423 Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d030baca29e8402896cdff2138cfcaab Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesOneServerTestJSON-306707423 Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesOneServerTestJSON-306707423-project Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: c3dfadbfcdca4f31b4a0e2d960298fa6 Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesOneServerTestJSON-306707423-project Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c could not be found. Oct 11 04:14:25.629185 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '3c1ce880-49a7-475d-9f7c-a04705d0d35c'} Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c could not be found. Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:25.631330 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c could not be found. Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c could not be found. Oct 11 04:14:25.632786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:25.634058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] Returning 404 to user: Instance 3c1ce880-49a7-475d-9f7c-a04705d0d35c could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:25.634058 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-07d3e000-300b-4fdd-8929-186094b86022 tempest-ImagesOneServerTestJSON-306707423 tempest-ImagesOneServerTestJSON-306707423-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c" status: 404 len: 111 microversion: 2.1 time: 0.034204 Oct 11 04:14:25.634058 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 507/1104] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:25 2022] GET /compute/v2.1/servers/3c1ce880-49a7-475d-9f7c-a04705d0d35c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:25.637263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-859206ff-150a-4781-8187-3e5e7cb45ee4 req-5bc22c0e-6f30-4510-b259-5ff8ebe0bfda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97202407-f542-4189-9582-1f1dd698c594", "name": "network-vif-plugged", "status": "completed", "tag": "dc8db1bd-a8a8-4b23-8837-a7b82504853f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:25.637940 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aa259c7a-b88b-4ca2-a71f-09a67a257a5d tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.132602 Oct 11 04:14:25.639049 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 598/1105] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:25 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:25.649355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-859206ff-150a-4781-8187-3e5e7cb45ee4 req-5bc22c0e-6f30-4510-b259-5ff8ebe0bfda service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.650947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-859206ff-150a-4781-8187-3e5e7cb45ee4 req-5bc22c0e-6f30-4510-b259-5ff8ebe0bfda service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.650947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-859206ff-150a-4781-8187-3e5e7cb45ee4 req-5bc22c0e-6f30-4510-b259-5ff8ebe0bfda service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.655801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.181"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:25.659428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:25.668216 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-859206ff-150a-4781-8187-3e5e7cb45ee4 req-5bc22c0e-6f30-4510-b259-5ff8ebe0bfda service nova] Creating event network-vif-plugged:dc8db1bd-a8a8-4b23-8837-a7b82504853f for instance 97202407-f542-4189-9582-1f1dd698c594 on n-h1-860892-1 Oct 11 04:14:25.674631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.674631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.674875 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-859206ff-150a-4781-8187-3e5e7cb45ee4 req-5bc22c0e-6f30-4510-b259-5ff8ebe0bfda service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049965 Oct 11 04:14:25.674973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.675086 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 508/1106] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:25.679010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.679207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:25.679949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:25.680394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.680998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.687344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.688025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.688626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.689325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:25.689776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:25.690216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:25.716104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "refresh_cache-f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:14:25.716971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquired lock "refresh_cache-f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:14:25.913090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:25.921990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:25.923595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:25.924790 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5dc568fd-bc03-4bd5-b388-02681a8302d5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1568 microversion: 2.25 time: 0.250072 Oct 11 04:14:25.925350 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 509/1107] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:25 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1568 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:25.930656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dc614141-0088-437f-ad8c-b474a7cafd2b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '.version_select at 0x7fda19aaf670>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:26.031096 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dc614141-0088-437f-ad8c-b474a7cafd2b tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-899887897" status: 202 len: 0 microversion: 2.1 time: 0.103391 Oct 11 04:14:26.037910 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 510/1108] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:14:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-899887897 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:14:26.043699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b02b57c-3785-4acb-a92d-fdf04327c34d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:26.044808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6b02b57c-3785-4acb-a92d-fdf04327c34d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:26.052783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b02b57c-3785-4acb-a92d-fdf04327c34d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:26.053506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b02b57c-3785-4acb-a92d-fdf04327c34d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:26.054243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b02b57c-3785-4acb-a92d-fdf04327c34d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:26.054943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b02b57c-3785-4acb-a92d-fdf04327c34d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:26.055544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b02b57c-3785-4acb-a92d-fdf04327c34d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:26.056763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b02b57c-3785-4acb-a92d-fdf04327c34d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:26.290312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b02b57c-3785-4acb-a92d-fdf04327c34d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:26.298753 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b02b57c-3785-4acb-a92d-fdf04327c34d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1712 microversion: 2.1 time: 0.259369 Oct 11 04:14:26.299642 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 511/1109] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:26 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1712 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:26.304780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-99971db0-d5dc-4d84-b2a1-e1d7262dbcb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:26.305386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-99971db0-d5dc-4d84-b2a1-e1d7262dbcb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:26.315402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99971db0-d5dc-4d84-b2a1-e1d7262dbcb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:26.316135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99971db0-d5dc-4d84-b2a1-e1d7262dbcb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:26.316585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99971db0-d5dc-4d84-b2a1-e1d7262dbcb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:26.317300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99971db0-d5dc-4d84-b2a1-e1d7262dbcb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:26.317773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99971db0-d5dc-4d84-b2a1-e1d7262dbcb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:26.318334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99971db0-d5dc-4d84-b2a1-e1d7262dbcb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:26.454392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-99971db0-d5dc-4d84-b2a1-e1d7262dbcb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:26.462124 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-99971db0-d5dc-4d84-b2a1-e1d7262dbcb4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.161445 Oct 11 04:14:26.462731 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 512/1110] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:26 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:26.527654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bdb9b0ac-58ef-46e1-b72b-1b0485af466f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:26.528259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bdb9b0ac-58ef-46e1-b72b-1b0485af466f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:26.534204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb9b0ac-58ef-46e1-b72b-1b0485af466f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:26.534699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb9b0ac-58ef-46e1-b72b-1b0485af466f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:26.535126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb9b0ac-58ef-46e1-b72b-1b0485af466f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:26.535806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb9b0ac-58ef-46e1-b72b-1b0485af466f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:26.536251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb9b0ac-58ef-46e1-b72b-1b0485af466f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:26.537205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb9b0ac-58ef-46e1-b72b-1b0485af466f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:26.739682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bdb9b0ac-58ef-46e1-b72b-1b0485af466f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:26.757830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bdb9b0ac-58ef-46e1-b72b-1b0485af466f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1478 microversion: 2.1 time: 0.235341 Oct 11 04:14:26.773022 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 513/1111] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:26 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1478 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:26.783550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c2ca414-c573-4601-89ac-b8a631f800fb tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:26.784160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5c2ca414-c573-4601-89ac-b8a631f800fb tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:26.790943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c2ca414-c573-4601-89ac-b8a631f800fb tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:26.793455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c2ca414-c573-4601-89ac-b8a631f800fb tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:26.793455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c2ca414-c573-4601-89ac-b8a631f800fb tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:26.804366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c2ca414-c573-4601-89ac-b8a631f800fb tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:26.805193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c2ca414-c573-4601-89ac-b8a631f800fb tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:26.806406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c2ca414-c573-4601-89ac-b8a631f800fb tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:26.925105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-5c2ca414-c573-4601-89ac-b8a631f800fb tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:26.947997 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5c2ca414-c573-4601-89ac-b8a631f800fb tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.167042 Oct 11 04:14:26.961204 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 514/1112] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:26 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:26.970504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:26.971298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:26.978984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:26.980596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:26.980596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:26.980855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:26.981562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:26.982017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:27.270862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:27.280135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:27.281823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:27.283170 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e31d4b82-bf77-4715-a52f-caca1f16a0e6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1568 microversion: 2.25 time: 0.333208 Oct 11 04:14:27.284023 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 515/1113] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:26 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1568 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:27.329166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e122a170-348c-4daf-bf39-f2063bb396e8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:27.330665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e122a170-348c-4daf-bf39-f2063bb396e8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:27.342464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e122a170-348c-4daf-bf39-f2063bb396e8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:27.344492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e122a170-348c-4daf-bf39-f2063bb396e8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:27.345187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e122a170-348c-4daf-bf39-f2063bb396e8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:27.347338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e122a170-348c-4daf-bf39-f2063bb396e8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:27.350801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e122a170-348c-4daf-bf39-f2063bb396e8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:27.353133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e122a170-348c-4daf-bf39-f2063bb396e8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:27.646972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e122a170-348c-4daf-bf39-f2063bb396e8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:27.668454 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e122a170-348c-4daf-bf39-f2063bb396e8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1712 microversion: 2.1 time: 0.347685 Oct 11 04:14:27.697103 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 516/1114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:27 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1712 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:27.704768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-70005e23-d2a5-467c-955b-ac4f9bd3c9ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:27.705377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-70005e23-d2a5-467c-955b-ac4f9bd3c9ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:27.725765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70005e23-d2a5-467c-955b-ac4f9bd3c9ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:27.728656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70005e23-d2a5-467c-955b-ac4f9bd3c9ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:27.730662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70005e23-d2a5-467c-955b-ac4f9bd3c9ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:27.731876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70005e23-d2a5-467c-955b-ac4f9bd3c9ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:27.732353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70005e23-d2a5-467c-955b-ac4f9bd3c9ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:27.732784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70005e23-d2a5-467c-955b-ac4f9bd3c9ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:27.985240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-70005e23-d2a5-467c-955b-ac4f9bd3c9ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:27.994733 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-70005e23-d2a5-467c-955b-ac4f9bd3c9ae tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.293585 Oct 11 04:14:28.011679 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 517/1115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:27 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:28.017579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-86213348-8f0d-4ca5-ad3d-8ee3a694bf09 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:28.018415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-86213348-8f0d-4ca5-ad3d-8ee3a694bf09 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:28.022146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:28.029890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86213348-8f0d-4ca5-ad3d-8ee3a694bf09 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:28.029890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86213348-8f0d-4ca5-ad3d-8ee3a694bf09 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:28.029890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86213348-8f0d-4ca5-ad3d-8ee3a694bf09 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:28.029890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86213348-8f0d-4ca5-ad3d-8ee3a694bf09 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:28.030306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86213348-8f0d-4ca5-ad3d-8ee3a694bf09 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:28.030306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86213348-8f0d-4ca5-ad3d-8ee3a694bf09 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:28.060213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Building network info cache for instance {{(pid=120994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 04:14:28.299708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-86213348-8f0d-4ca5-ad3d-8ee3a694bf09 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:28.308590 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-86213348-8f0d-4ca5-ad3d-8ee3a694bf09 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1478 microversion: 2.1 time: 0.295557 Oct 11 04:14:28.322218 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 518/1116] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:28 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1478 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:28.322218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-3ec2de1a-c771-42e8-8c02-a66f64889feb req-a8d79c3b-a939-4216-a3fb-8047037a6911 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0263254c-1383-4f74-8505-d1402be4bd56", "name": "network-vif-unplugged", "status": "completed", "tag": "a2a80df7-c7d4-450b-bd19-d4a1c38a2015"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:28.346726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3ec2de1a-c771-42e8-8c02-a66f64889feb req-a8d79c3b-a939-4216-a3fb-8047037a6911 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:28.347309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3ec2de1a-c771-42e8-8c02-a66f64889feb req-a8d79c3b-a939-4216-a3fb-8047037a6911 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:28.347802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3ec2de1a-c771-42e8-8c02-a66f64889feb req-a8d79c3b-a939-4216-a3fb-8047037a6911 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:28.373229 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-3ec2de1a-c771-42e8-8c02-a66f64889feb req-a8d79c3b-a939-4216-a3fb-8047037a6911 service nova] Creating event network-vif-unplugged:a2a80df7-c7d4-450b-bd19-d4a1c38a2015 for instance 0263254c-1383-4f74-8505-d1402be4bd56 on n-h1-860892-1 Oct 11 04:14:28.385322 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-3ec2de1a-c771-42e8-8c02-a66f64889feb req-a8d79c3b-a939-4216-a3fb-8047037a6911 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071624 Oct 11 04:14:28.386604 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 519/1117] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:28.399753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12678c95-f9a7-47c5-ad05-556a899f25d8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:28.401017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-12678c95-f9a7-47c5-ad05-556a899f25d8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:28.410424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12678c95-f9a7-47c5-ad05-556a899f25d8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:28.411945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12678c95-f9a7-47c5-ad05-556a899f25d8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:28.412932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12678c95-f9a7-47c5-ad05-556a899f25d8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:28.414131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12678c95-f9a7-47c5-ad05-556a899f25d8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:28.414846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12678c95-f9a7-47c5-ad05-556a899f25d8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:28.415906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12678c95-f9a7-47c5-ad05-556a899f25d8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:28.422458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:28.548899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-12678c95-f9a7-47c5-ad05-556a899f25d8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:28.566492 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-12678c95-f9a7-47c5-ad05-556a899f25d8 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.178612 Oct 11 04:14:28.567146 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 520/1118] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:28 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:28.571860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:28.572629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:28.578499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:28.579182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:28.579645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:28.580584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:28.581033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:28.581574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:28.810545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:28.819580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:28.823861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:28.828122 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-46cce55a-7b5d-4a41-8b50-c796beb53108 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1568 microversion: 2.25 time: 0.259941 Oct 11 04:14:28.831602 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 521/1119] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:28 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1568 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:28.922874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Updating instance_info_cache with network_info: [{"id": "b4654310-3e46-4989-977e-9e06fed03db8", "address": "fa:16:3e:8b:29:6a", "network": {"id": "32d9ddcc-2b51-45b4-8901-27596af8e539", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-900491536-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d36689c546841b191c6ae98991c8f4a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb4654310-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:14:29.049934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Releasing lock "refresh_cache-f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:14:29.051417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-594f2b55-ffc0-482e-b699-9b9a9b09d55c tempest-ListImagesTestJSON-2086929470 tempest-ListImagesTestJSON-2086929470-project] Calling method '.version_select at 0x7fda19a6d310>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:29.051694 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-81d4a703-2590-47e6-9829-b8daa2c2bf25 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "POST /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e/action" status: 202 len: 0 microversion: 2.1 time: 3.411089 Oct 11 04:14:29.053910 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 599/1120] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:14:25 2022] POST /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e/action => generated 0 bytes in 3414 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 04:14:29.065673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a12ef2b-40f4-4de7-8cf9-ce77d316b68f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:29.071483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a12ef2b-40f4-4de7-8cf9-ce77d316b68f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:29.095472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a12ef2b-40f4-4de7-8cf9-ce77d316b68f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:29.100446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a12ef2b-40f4-4de7-8cf9-ce77d316b68f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:29.101841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a12ef2b-40f4-4de7-8cf9-ce77d316b68f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:29.106518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a12ef2b-40f4-4de7-8cf9-ce77d316b68f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:29.107069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a12ef2b-40f4-4de7-8cf9-ce77d316b68f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:29.108689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a12ef2b-40f4-4de7-8cf9-ce77d316b68f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:29.114369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:29.155222 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-594f2b55-ffc0-482e-b699-9b9a9b09d55c tempest-ListImagesTestJSON-2086929470 tempest-ListImagesTestJSON-2086929470-project] 10.222.0.26 "GET /compute/v2.1/images/f5e997ff-e5de-4be2-9fc9-af1f070d3e55" status: 200 len: 784 microversion: 2.1 time: 0.322202 Oct 11 04:14:29.156063 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 522/1121] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:14:28 2022] GET /compute/v2.1/images/f5e997ff-e5de-4be2-9fc9-af1f070d3e55 => generated 784 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:29.169663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-640329dc-0752-470e-a7bf-07d930b4bfb2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:29.170303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-640329dc-0752-470e-a7bf-07d930b4bfb2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:29.182460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-640329dc-0752-470e-a7bf-07d930b4bfb2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:29.183069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-640329dc-0752-470e-a7bf-07d930b4bfb2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:29.187584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-640329dc-0752-470e-a7bf-07d930b4bfb2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:29.188452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-640329dc-0752-470e-a7bf-07d930b4bfb2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:29.189017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-640329dc-0752-470e-a7bf-07d930b4bfb2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:29.189714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-640329dc-0752-470e-a7bf-07d930b4bfb2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:29.248978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3a12ef2b-40f4-4de7-8cf9-ce77d316b68f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:29.268859 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a12ef2b-40f4-4de7-8cf9-ce77d316b68f tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1645 microversion: 2.1 time: 0.213723 Oct 11 04:14:29.269830 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 600/1122] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:29 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1645 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:29.283698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.181"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:29.455815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-640329dc-0752-470e-a7bf-07d930b4bfb2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:29.474534 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-640329dc-0752-470e-a7bf-07d930b4bfb2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1542 microversion: 2.1 time: 0.313006 Oct 11 04:14:29.475107 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 523/1123] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:29 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1542 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:29.480175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e9090c6-058a-41b2-b313-91273864dde0 tempest-ListImagesTestJSON-2086929470 tempest-ListImagesTestJSON-2086929470-project] Calling method '.version_select at 0x7fda19b5ddc0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:29.548987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:29.558827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:29.558827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:29.558827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:29.558827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:29.559361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:29.559361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:29.604146 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4e9090c6-058a-41b2-b313-91273864dde0 tempest-ListImagesTestJSON-2086929470 tempest-ListImagesTestJSON-2086929470-project] 10.222.0.26 "GET /compute/v2.1/images" status: 200 len: 445 microversion: 2.1 time: 0.127714 Oct 11 04:14:29.605299 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 524/1124] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Oct 11 04:14:29 2022] GET /compute/v2.1/images => generated 445 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:29.618503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c0a32f88-7966-4439-a57e-fd88c7e58616 req-c522fddd-c820-46fa-8981-9ee87a30d206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02cb0576-4cd8-443a-a6f1-3191ea67e719", "name": "network-vif-deleted", "tag": "3af4d53e-787c-4da0-bedf-ead9361a4a86"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:29.645904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c0a32f88-7966-4439-a57e-fd88c7e58616 req-c522fddd-c820-46fa-8981-9ee87a30d206 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:29.650438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c0a32f88-7966-4439-a57e-fd88c7e58616 req-c522fddd-c820-46fa-8981-9ee87a30d206 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:29.650909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c0a32f88-7966-4439-a57e-fd88c7e58616 req-c522fddd-c820-46fa-8981-9ee87a30d206 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:29.664528 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c0a32f88-7966-4439-a57e-fd88c7e58616 req-c522fddd-c820-46fa-8981-9ee87a30d206 service nova] Creating event network-vif-deleted:3af4d53e-787c-4da0-bedf-ead9361a4a86 for instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 on n-h1-860892-1 Oct 11 04:14:29.670427 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c0a32f88-7966-4439-a57e-fd88c7e58616 req-c522fddd-c820-46fa-8981-9ee87a30d206 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063890 Oct 11 04:14:29.671229 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 525/1125] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:29.679479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7e673a14-7970-4c49-975c-959d4cdac135 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:29.683992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7e673a14-7970-4c49-975c-959d4cdac135 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:29.718156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e673a14-7970-4c49-975c-959d4cdac135 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:29.718996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e673a14-7970-4c49-975c-959d4cdac135 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:29.719631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e673a14-7970-4c49-975c-959d4cdac135 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:29.720545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e673a14-7970-4c49-975c-959d4cdac135 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:29.721137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e673a14-7970-4c49-975c-959d4cdac135 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:29.721708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e673a14-7970-4c49-975c-959d4cdac135 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:29.933599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7e673a14-7970-4c49-975c-959d4cdac135 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:29.942239 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7e673a14-7970-4c49-975c-959d4cdac135 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1464 microversion: 2.1 time: 0.268169 Oct 11 04:14:29.943128 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 526/1126] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:29 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1464 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:29.954913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-989b3d6e-ebdb-4556-93bd-add4c4e19a07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:29.955759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-989b3d6e-ebdb-4556-93bd-add4c4e19a07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:29.965713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989b3d6e-ebdb-4556-93bd-add4c4e19a07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:29.966221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989b3d6e-ebdb-4556-93bd-add4c4e19a07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:29.966837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989b3d6e-ebdb-4556-93bd-add4c4e19a07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:29.967733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989b3d6e-ebdb-4556-93bd-add4c4e19a07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:29.968434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989b3d6e-ebdb-4556-93bd-add4c4e19a07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:29.969211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989b3d6e-ebdb-4556-93bd-add4c4e19a07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:29.976993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "refresh_cache-f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:14:29.976993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquired lock "refresh_cache-f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:14:30.066578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-989b3d6e-ebdb-4556-93bd-add4c4e19a07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:30.091772 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-989b3d6e-ebdb-4556-93bd-add4c4e19a07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.147482 Oct 11 04:14:30.092903 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 527/1127] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:29 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:30.099456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5edc22d-2263-4810-a437-2c6f75d8df8c tempest-ListImagesTestJSON-2086929470 tempest-ListImagesTestJSON-2086929470-project] Calling method '.version_select at 0x7fda19b2f3a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:30.237916 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d5edc22d-2263-4810-a437-2c6f75d8df8c tempest-ListImagesTestJSON-2086929470 tempest-ListImagesTestJSON-2086929470-project] 10.222.0.26 "GET /compute/v2.1/images/detail" status: 200 len: 787 microversion: 2.1 time: 0.143121 Oct 11 04:14:30.252807 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 528/1128] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:14:30 2022] GET /compute/v2.1/images/detail => generated 787 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:30.271460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:30.276156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:30.298866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:30.301282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:30.301905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:30.305414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:30.312382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:30.312382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:30.695646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:30.711098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:30.715211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:30.718061 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3bb2a605-3356-4007-b306-c106703e3ac9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1568 microversion: 2.25 time: 0.458026 Oct 11 04:14:30.742616 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 529/1129] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:30 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1568 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:30.752449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cff12469-1c34-4093-a117-b14c33acec2d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:30.753059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cff12469-1c34-4093-a117-b14c33acec2d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:30.766026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff12469-1c34-4093-a117-b14c33acec2d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:30.768156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff12469-1c34-4093-a117-b14c33acec2d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:30.768628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff12469-1c34-4093-a117-b14c33acec2d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:30.769399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff12469-1c34-4093-a117-b14c33acec2d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:30.769857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff12469-1c34-4093-a117-b14c33acec2d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:30.770304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff12469-1c34-4093-a117-b14c33acec2d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:31.019122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cff12469-1c34-4093-a117-b14c33acec2d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:31.031397 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cff12469-1c34-4093-a117-b14c33acec2d tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1464 microversion: 2.1 time: 0.286763 Oct 11 04:14:31.034101 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 530/1130] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:30 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1464 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:31.042810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:31.043759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:31.062811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:31.064480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:31.065104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:31.067999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:31.068688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:31.072342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:31.110942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:31.111420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:31.111859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:31.112309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lazy-loading 'fault' on Instance uuid 02cb0576-4cd8-443a-a6f1-3191ea67e719 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:31.220072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28240e25179b447781e0e351c659c065', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49ed194cff9c4482a96dff268602479a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:31.223416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Building network info cache for instance {{(pid=120994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 04:14:31.241054 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4185d4d8-5fae-49cc-841d-d5a9a8dd0f59 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 200 len: 1354 microversion: 2.1 time: 0.199456 Oct 11 04:14:31.243555 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 531/1131] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:31 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 1354 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:31.257688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-7ca72866-13f4-4fd0-87dc-66fae653bdf4 req-ef6f2e09-cafa-45c8-8bcf-fda034a4af52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e", "tag": "b4654310-3e46-4989-977e-9e06fed03db8"}, {"name": "network-changed", "server_uuid": "0263254c-1383-4f74-8505-d1402be4bd56", "tag": "a2a80df7-c7d4-450b-bd19-d4a1c38a2015"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:31.302782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7ca72866-13f4-4fd0-87dc-66fae653bdf4 req-ef6f2e09-cafa-45c8-8bcf-fda034a4af52 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:31.303717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7ca72866-13f4-4fd0-87dc-66fae653bdf4 req-ef6f2e09-cafa-45c8-8bcf-fda034a4af52 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:31.304366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7ca72866-13f4-4fd0-87dc-66fae653bdf4 req-ef6f2e09-cafa-45c8-8bcf-fda034a4af52 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:31.330478 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7ca72866-13f4-4fd0-87dc-66fae653bdf4 req-ef6f2e09-cafa-45c8-8bcf-fda034a4af52 service nova] Creating event network-changed:b4654310-3e46-4989-977e-9e06fed03db8 for instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e on n-h2-860892-1 Oct 11 04:14:31.331232 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7ca72866-13f4-4fd0-87dc-66fae653bdf4 req-ef6f2e09-cafa-45c8-8bcf-fda034a4af52 service nova] Creating event network-changed:a2a80df7-c7d4-450b-bd19-d4a1c38a2015 for instance 0263254c-1383-4f74-8505-d1402be4bd56 on n-h1-860892-1 Oct 11 04:14:31.341626 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-7ca72866-13f4-4fd0-87dc-66fae653bdf4 req-ef6f2e09-cafa-45c8-8bcf-fda034a4af52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.096765 Oct 11 04:14:31.343130 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 532/1132] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:31.350570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c9c4b8f8-1abe-4667-ba40-b44f28f690fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:31.356280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c9c4b8f8-1abe-4667-ba40-b44f28f690fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:31.375723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9c4b8f8-1abe-4667-ba40-b44f28f690fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:31.378986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9c4b8f8-1abe-4667-ba40-b44f28f690fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:31.382404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9c4b8f8-1abe-4667-ba40-b44f28f690fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:31.382404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9c4b8f8-1abe-4667-ba40-b44f28f690fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:31.382404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9c4b8f8-1abe-4667-ba40-b44f28f690fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:31.383789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9c4b8f8-1abe-4667-ba40-b44f28f690fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:31.829757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c9c4b8f8-1abe-4667-ba40-b44f28f690fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:31.840687 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c9c4b8f8-1abe-4667-ba40-b44f28f690fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1541 microversion: 2.1 time: 0.495903 Oct 11 04:14:31.844610 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 533/1133] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:31 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1541 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:31.858232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:31.861368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:31.872399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:31.877321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:31.877949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:31.878897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:31.879496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:31.880100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:32.025776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:14:32.031199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:14:32.031731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:14:32.032139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:14:32.032549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:14:32.319559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:32.344544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:32.345039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:32.351739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:32.352624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:32.353096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:32.356600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:32.439247 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5bed84fc-531b-4dfa-a5d3-0694cc178860 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action" status: 202 len: 1068 microversion: 2.1 time: 0.593289 Oct 11 04:14:32.451759 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 534/1134] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:14:31 2022] POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action => generated 1068 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 04:14:32.458206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-49cef740-7211-4bc2-8dd2-7047fadef6bf tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:32.459281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-49cef740-7211-4bc2-8dd2-7047fadef6bf tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:32.490874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49cef740-7211-4bc2-8dd2-7047fadef6bf tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:32.493170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49cef740-7211-4bc2-8dd2-7047fadef6bf tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:32.493809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49cef740-7211-4bc2-8dd2-7047fadef6bf tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:32.495061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49cef740-7211-4bc2-8dd2-7047fadef6bf tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:32.495929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49cef740-7211-4bc2-8dd2-7047fadef6bf tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:32.496559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49cef740-7211-4bc2-8dd2-7047fadef6bf tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:32.632375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Updating instance_info_cache with network_info: [{"id": "b4654310-3e46-4989-977e-9e06fed03db8", "address": "fa:16:3e:8b:29:6a", "network": {"id": "32d9ddcc-2b51-45b4-8901-27596af8e539", "bridge": null, "label": "tempest-ServerRescueTestJSONUnderV235-900491536-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {}}], "meta": {"injected": false, "tenant_id": "8d36689c546841b191c6ae98991c8f4a", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapb4654310-3e", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:14:32.753127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Releasing lock "refresh_cache-f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:14:32.754301 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b39b425-646f-4c6d-8ddf-1ef381cbbb02 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "POST /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e/action" status: 202 len: 0 microversion: 2.1 time: 3.482025 Oct 11 04:14:32.755145 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 601/1135] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:14:29 2022] POST /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e/action => generated 0 bytes in 3484 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 04:14:32.760118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-64b4bdfb-12aa-4b6e-bdd2-519f769aad39 req-febccaf1-4c85-4c4f-8dab-f5bdff78af71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c533c21c-f66a-4a0e-b991-01c4a087f391", "name": "network-vif-unplugged", "status": "completed", "tag": "986bccea-82d2-48c0-8f10-29fc77413e59"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:32.807226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-49cef740-7211-4bc2-8dd2-7047fadef6bf tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:32.810153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-64b4bdfb-12aa-4b6e-bdd2-519f769aad39 req-febccaf1-4c85-4c4f-8dab-f5bdff78af71 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:32.810872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-64b4bdfb-12aa-4b6e-bdd2-519f769aad39 req-febccaf1-4c85-4c4f-8dab-f5bdff78af71 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:32.811731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-64b4bdfb-12aa-4b6e-bdd2-519f769aad39 req-febccaf1-4c85-4c4f-8dab-f5bdff78af71 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:32.857864 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-64b4bdfb-12aa-4b6e-bdd2-519f769aad39 req-febccaf1-4c85-4c4f-8dab-f5bdff78af71 service nova] Creating event network-vif-unplugged:986bccea-82d2-48c0-8f10-29fc77413e59 for instance c533c21c-f66a-4a0e-b991-01c4a087f391 on n-h1-860892-1 Oct 11 04:14:32.867895 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-49cef740-7211-4bc2-8dd2-7047fadef6bf tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.414675 Oct 11 04:14:32.876665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-64b4bdfb-12aa-4b6e-bdd2-519f769aad39 req-febccaf1-4c85-4c4f-8dab-f5bdff78af71 service nova] Instance c533c21c-f66a-4a0e-b991-01c4a087f391 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:14:32.884131 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 535/1136] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:32 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:32.902282 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-64b4bdfb-12aa-4b6e-bdd2-519f769aad39 req-febccaf1-4c85-4c4f-8dab-f5bdff78af71 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.145277 Oct 11 04:14:32.903615 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 602/1137] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:32.911188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:32.915493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:32.920707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:32.921324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:32.923333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:32.929884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:32.929884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:32.929884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:32.930165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:32.930165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:32.946380 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] HTTP exception thrown: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Request method failure captured: Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 HTTP/1.1 Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROy8wySxQbF6M0ICrqAT-duRciejIJsdaKS3ttYyUMucvA5YDFumCjdP1KYQativfL3oUbCUB6Is8zIAkOA8QM3k3igjRFKDcCHbWUJed01avwgip2maQpDEt3AmLYlnEXCPQ8sUNjbvzLJ9ZecjahLFn0Yg4iakV0jD5zp85aaR_TA Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:14:32.954204 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49ed194cff9c4482a96dff268602479a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49ed194cff9c4482a96dff268602479a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}] Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 28240e25179b447781e0e351c659c065 Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:32.955511 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '02cb0576-4cd8-443a-a6f1-3191ea67e719'} Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:32.956238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:32.957474 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:32.959239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Returning 404 to user: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:32.959239 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-df81e5d3-fe47-42f1-a6db-5296c123ff6c tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 404 len: 111 microversion: 2.1 time: 0.045094 Oct 11 04:14:32.959239 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 603/1138] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:32 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:32.959485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:32.959485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:32.959485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:32.959485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:32.963441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:32.968028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:32.980410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aa0af539-83ca-47c9-8031-ce35da5c7826 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:32.981691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aa0af539-83ca-47c9-8031-ce35da5c7826 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:33.004404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa0af539-83ca-47c9-8031-ce35da5c7826 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:33.005986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa0af539-83ca-47c9-8031-ce35da5c7826 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:33.006612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa0af539-83ca-47c9-8031-ce35da5c7826 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:33.008629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa0af539-83ca-47c9-8031-ce35da5c7826 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:33.009389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa0af539-83ca-47c9-8031-ce35da5c7826 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:33.009862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa0af539-83ca-47c9-8031-ce35da5c7826 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:33.215832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aa0af539-83ca-47c9-8031-ce35da5c7826 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:33.227223 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aa0af539-83ca-47c9-8031-ce35da5c7826 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.274853 Oct 11 04:14:33.228220 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 604/1139] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:32 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:33.248563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cb2b8cfc-a320-4af2-83aa-07b21c06a822 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '.version_select at 0x7fda19d80790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:33.778772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:33.789276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:33.791657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:33.793029 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e96bfc73-76c4-4d6a-855c-347398565ff4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1568 microversion: 2.25 time: 0.907838 Oct 11 04:14:33.793714 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 536/1140] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:32 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1568 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:33.811234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b65819c-d02e-4dea-b740-fb4825363b53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:33.812661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2b65819c-d02e-4dea-b740-fb4825363b53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:33.821068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b65819c-d02e-4dea-b740-fb4825363b53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:33.825832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b65819c-d02e-4dea-b740-fb4825363b53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:33.825832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b65819c-d02e-4dea-b740-fb4825363b53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:33.825832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b65819c-d02e-4dea-b740-fb4825363b53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:33.825832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b65819c-d02e-4dea-b740-fb4825363b53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:33.826344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b65819c-d02e-4dea-b740-fb4825363b53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.184476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2b65819c-d02e-4dea-b740-fb4825363b53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:34.192583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:34.195149 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b65819c-d02e-4dea-b740-fb4825363b53 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1541 microversion: 2.1 time: 0.400453 Oct 11 04:14:34.196138 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 537/1141] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:33 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1541 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:34.201025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:34.201700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:34.208792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.209444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.210063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.210936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.211523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.212085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.227262 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] HTTP exception thrown: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Request method failure captured: Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 HTTP/1.1 Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROy8wySxQbF6M0ICrqAT-duRciejIJsdaKS3ttYyUMucvA5YDFumCjdP1KYQativfL3oUbCUB6Is8zIAkOA8QM3k3igjRFKDcCHbWUJed01avwgip2maQpDEt3AmLYlnEXCPQ8sUNjbvzLJ9ZecjahLFn0Yg4iakV0jD5zp85aaR_TA Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:14:34.228932 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49ed194cff9c4482a96dff268602479a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49ed194cff9c4482a96dff268602479a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}] Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 28240e25179b447781e0e351c659c065 Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:34.230303 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e3a2d8cb-5666-44f2-b773-bc4305262557'} Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:34.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:34.233131 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.237999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Returning 404 to user: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:34.237999 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9417725d-81b6-4d68-b8ae-168f162c9998 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 404 len: 111 microversion: 2.1 time: 0.032816 Oct 11 04:14:34.237999 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 538/1142] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:14:34 2022] DELETE /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:34.237999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-bba1a9c5-22c5-49d1-8c93-be35e65e3d6e req-7fa3cfc2-5afa-4a38-a7bb-1610c895c884 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e", "tag": "b4654310-3e46-4989-977e-9e06fed03db8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:34.245946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bba1a9c5-22c5-49d1-8c93-be35e65e3d6e req-7fa3cfc2-5afa-4a38-a7bb-1610c895c884 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.246571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bba1a9c5-22c5-49d1-8c93-be35e65e3d6e req-7fa3cfc2-5afa-4a38-a7bb-1610c895c884 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.246997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bba1a9c5-22c5-49d1-8c93-be35e65e3d6e req-7fa3cfc2-5afa-4a38-a7bb-1610c895c884 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.260137 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-bba1a9c5-22c5-49d1-8c93-be35e65e3d6e req-7fa3cfc2-5afa-4a38-a7bb-1610c895c884 service nova] Creating event network-changed:b4654310-3e46-4989-977e-9e06fed03db8 for instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e on n-h2-860892-1 Oct 11 04:14:34.265685 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-bba1a9c5-22c5-49d1-8c93-be35e65e3d6e req-7fa3cfc2-5afa-4a38-a7bb-1610c895c884 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033374 Oct 11 04:14:34.267014 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 539/1143] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:34.273104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b842e87b-8c2d-448d-8e63-38dae1d30d24 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:34.274587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b842e87b-8c2d-448d-8e63-38dae1d30d24 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:34.282381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b842e87b-8c2d-448d-8e63-38dae1d30d24 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.283086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b842e87b-8c2d-448d-8e63-38dae1d30d24 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.283673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b842e87b-8c2d-448d-8e63-38dae1d30d24 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.289117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b842e87b-8c2d-448d-8e63-38dae1d30d24 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.289117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b842e87b-8c2d-448d-8e63-38dae1d30d24 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.289117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b842e87b-8c2d-448d-8e63-38dae1d30d24 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.389652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-b842e87b-8c2d-448d-8e63-38dae1d30d24 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:34.419013 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b842e87b-8c2d-448d-8e63-38dae1d30d24 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.149920 Oct 11 04:14:34.422092 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 540/1144] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:34 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:34.424997 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cb2b8cfc-a320-4af2-83aa-07b21c06a822 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/f10c1128-c9eb-4348-ae6b-1f48bdca0705" status: 202 len: 0 microversion: 2.1 time: 1.194999 Oct 11 04:14:34.426722 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 605/1145] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:14:33 2022] DELETE /compute/v2.1/os-floating-ips/f10c1128-c9eb-4348-ae6b-1f48bdca0705 => generated 0 bytes in 1198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:14:34.428107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:34.428713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:34.436370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.436866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.437414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.438103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.438576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.439052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.446788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a9a8f2f-79d5-481f-a643-88a5d6d43bb8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:34.447531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2a9a8f2f-79d5-481f-a643-88a5d6d43bb8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:34.457456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9a8f2f-79d5-481f-a643-88a5d6d43bb8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.458628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9a8f2f-79d5-481f-a643-88a5d6d43bb8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.459144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9a8f2f-79d5-481f-a643-88a5d6d43bb8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.459929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9a8f2f-79d5-481f-a643-88a5d6d43bb8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.460480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9a8f2f-79d5-481f-a643-88a5d6d43bb8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.461004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9a8f2f-79d5-481f-a643-88a5d6d43bb8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.464426 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] HTTP exception thrown: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Request method failure captured: Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 HTTP/1.1 Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROy8wySxQbF6M0ICrqAT-duRciejIJsdaKS3ttYyUMucvA5YDFumCjdP1KYQativfL3oUbCUB6Is8zIAkOA8QM3k3igjRFKDcCHbWUJed01avwgip2maQpDEt3AmLYlnEXCPQ8sUNjbvzLJ9ZecjahLFn0Yg4iakV0jD5zp85aaR_TA Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:14:34.466937 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49ed194cff9c4482a96dff268602479a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49ed194cff9c4482a96dff268602479a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}] Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 28240e25179b447781e0e351c659c065 Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:34.468892 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e3a2d8cb-5666-44f2-b773-bc4305262557'} Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:34.470013 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:34.471681 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.473167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Returning 404 to user: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:34.473167 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5aa4f6b1-dbbe-494c-b50e-2947b90eb968 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 404 len: 111 microversion: 2.1 time: 0.045537 Oct 11 04:14:34.473167 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 541/1146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:34 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:34.645684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5d429ab-d5cc-4295-918c-9dc142ead267 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Action: 'create', calling method: .version_select at 0x7fda19ae3e50>, body: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW8hHVkDm6SjCnGBvOegc0ZEED45Spacm06+CilJM1DtvIyZQ1Ym3COLE2nCOlHKVf2LfeoY5KNfFjCPk4hPEb3Vskug2A1BfWu389UTTz2ANMkoThD/V8s6tQUKkBJeA=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5d429ab-d5cc-4295-918c-9dc142ead267 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Request method failure captured: Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 257 Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO2qlTN24nprJTHvOqYQOGOEBnG5kJ9bHHRe1W4ElQoNB6mEfbkI4arYD7eQclKgr6t4tEe8_JI8lxpaGdE8qB6ymWjTmz942KyyjDVD447NBppCExVirHkq8TBk5dtMGHnsFD49ePRSMaXTKKTtVfGTc_5UuyaLoHtWyrnQDer2-Sk Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:14:34.650744 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:14:34.652206 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}] Oct 11 04:14:34.652206 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:34.652206 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:34.652206 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:34.652206 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:34.652206 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:14:34.652206 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:14:34.652206 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:34.652206 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:34.652206 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:14:34.652206 n-d-860892-1 devstack@n-api.service[120993]: {"keypair": {"name": "key_/.\\@:", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW8hHVkDm6SjCnGBvOegc0ZEED45Spacm06+CilJM1DtvIyZQ1Ym3COLE2nCOlHKVf2LfeoY5KNfFjCPk4hPEb3Vskug2A1BfWu389UTTz2ANMkoThD/V8s6tQUKkBJeA=="}} Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: exception: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'keypair': {'name': 'key_/.\\@:', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGW8hHVkDm6SjCnGBvOegc0ZEED45Spacm06+CilJM1DtvIyZQ1Ym3COLE2nCOlHKVf2LfeoY5KNfFjCPk4hPEb3Vskug2A1BfWu389UTTz2ANMkoThD/V8s6tQUKkBJeA=='}}} Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 161, in _validate_keypair_name_20 Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return _validate_keypair_name(keypair_name, safe_chars) Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 175, in _validate_keypair_name Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InvalidName(reason=reason) Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InvalidName: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.652944 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'key_/.\\@:' is not a 'keypair_name_20' Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['keypair']['properties']['name']['allOf'][1]: Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'format': 'keypair_name_20', Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'maxLength': 255, Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'minLength': 1, Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': 'string'} Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['keypair']['name']: Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'key_/.\\@:' Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:14:34.654051 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:14:34.655920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:14:34.657359 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] Oct 11 04:14:34.657359 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.657359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5d429ab-d5cc-4295-918c-9dc142ead267 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Returning 400 to user: An invalid 'name' value was provided. The name must be: Only expected characters: [_- 0123456789abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:34.657359 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d5d429ab-d5cc-4295-918c-9dc142ead267 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 193 microversion: 2.1 time: 0.179794 Oct 11 04:14:34.657359 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 542/1147] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:14:34 2022] POST /compute/v2.1/os-keypairs => generated 193 bytes in 181 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:14:34.660118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8ffb441f-3c49-49c3-9b4a-6eba449bf77d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '.version_select at 0x7fda19a889d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:34.744926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2a9a8f2f-79d5-481f-a643-88a5d6d43bb8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:34.759557 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2a9a8f2f-79d5-481f-a643-88a5d6d43bb8 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.331380 Oct 11 04:14:34.761660 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 606/1148] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:34 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:34.766554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dc4f3795-ec5e-4615-a1b0-b6e6a286a52d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '.version_select at 0x7fda19efa4c0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:34.861411 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dc4f3795-ec5e-4615-a1b0-b6e6a286a52d tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042032906" status: 202 len: 0 microversion: 2.1 time: 0.098320 Oct 11 04:14:34.866581 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 607/1149] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:14:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2042032906 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:14:34.888204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:34.888767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:34.901706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.904434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.905543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.910111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.911684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.914422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.939270 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8ffb441f-3c49-49c3-9b4a-6eba449bf77d tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/7be32fdb-f25d-45fc-9c2e-65c3ebd0bd01" status: 202 len: 0 microversion: 2.1 time: 0.284820 Oct 11 04:14:34.939872 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 543/1150] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:14:34 2022] DELETE /compute/v2.1/os-security-groups/7be32fdb-f25d-45fc-9c2e-65c3ebd0bd01 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:14:34.945104 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] HTTP exception thrown: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:34.946485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-91acb000-aaee-4d4e-94ce-7bdb8626722a tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Action: 'create', calling method: .version_select at 0x7fda19ae3550>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-52119948", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Request method failure captured: Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 HTTP/1.1 Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROz2lq8tlzxkciCJV0DjrJtfQrLCJwSmAuEvMpzvzFslvhbOB44lKFPFxLg98NvH750vmXnjx5jCIBzrhlsjxsEeVHuWy4_SdYGRrPGpR5jathG5bkGT2Dkt6nr3TkU2EeZlz0rXI4HqddXCMVRxqyxGWcAU2D-_6xUXZCdxlNrtXGs Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 65263374513549f0b6329862bd14f419 Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1490631746 Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/65263374513549f0b6329862bd14f419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_65263374513549f0b6329862bd14f419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65263374513549f0b6329862bd14f419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65263374513549f0b6329862bd14f419"}]}] Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1490631746 Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 65263374513549f0b6329862bd14f419 Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1490631746 Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachSCSIVolumeTestJSON-1490631746-project Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 886899e459944df290afd3583310c873 Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1490631746-project Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '64baf484-344e-4c1d-861d-c1dff29896e0'} Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:34.947916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:34.951851 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:34.951851 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.951851 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:34.951851 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.951851 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:34.951851 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:34.951851 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:34.951851 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:34.951851 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:34.951851 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:34.951851 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:34.954565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Returning 404 to user: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:34.957138 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e577219c-1da6-48e2-9464-9bd5a136e23d tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "DELETE /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 404 len: 111 microversion: 2.1 time: 0.079175 Oct 11 04:14:34.961400 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 608/1151] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:14:34 2022] DELETE /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:34.970079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:34.970850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:34.979393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.980160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.980784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.981638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:34.982313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:34.982584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-91acb000-aaee-4d4e-94ce-7bdb8626722a tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Getting quotas for project 0c2bc5a5c426439fa26df3cd585fd725. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:14:34.982939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:34.992892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-91acb000-aaee-4d4e-94ce-7bdb8626722a tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Getting quotas for user 0b78414446d84b8196087d3090ef8c35 and project 0c2bc5a5c426439fa26df3cd585fd725. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:14:35.045245 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-91acb000-aaee-4d4e-94ce-7bdb8626722a tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-91acb000-aaee-4d4e-94ce-7bdb8626722a tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Request method failure captured: Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 2165 Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO2qlTN24nprJTHvOqYQOGOEBnG5kJ9bHHRe1W4ElQoNB6mEfbkI4arYD7eQclKgr6t4tEe8_JI8lxpaGdE8qB6ymWjTmz942KyyjDVD447NBppCExVirHkq8TBk5dtMGHnsFD49ePRSMaXTKKTtVfGTc_5UuyaLoHtWyrnQDer2-Sk Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}] Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-52119948", "public_key": "ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu"}} Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:14:35.061008 n-d-860892-1 devstack@n-api.service[120993]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-52119948', 'public_key': 'ssh-rsa AAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA openstack@ubuntu'}}} Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 666, in load_ssh_public_key Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid key format") Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ValueError: Invalid key format Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:35.063628 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-91acb000-aaee-4d4e-94ce-7bdb8626722a tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:35.066724 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-91acb000-aaee-4d4e-94ce-7bdb8626722a tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.121518 Oct 11 04:14:35.072087 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 544/1152] 10.222.0.26 () {60 vars in 1160 bytes} [Tue Oct 11 04:14:34 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:14:35.079644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-10b47e07-d32c-4fcb-b6e5-3bff3a28d3d7 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:35.081361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-10b47e07-d32c-4fcb-b6e5-3bff3a28d3d7 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:35.092411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10b47e07-d32c-4fcb-b6e5-3bff3a28d3d7 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.093058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10b47e07-d32c-4fcb-b6e5-3bff3a28d3d7 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.093669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10b47e07-d32c-4fcb-b6e5-3bff3a28d3d7 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.094547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10b47e07-d32c-4fcb-b6e5-3bff3a28d3d7 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.095129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10b47e07-d32c-4fcb-b6e5-3bff3a28d3d7 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.095683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10b47e07-d32c-4fcb-b6e5-3bff3a28d3d7 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.139236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-10b47e07-d32c-4fcb-b6e5-3bff3a28d3d7 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:14:35.248093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:35.257139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:35.258587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:35.259837 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-889794d9-8a72-4fdc-bb9f-50542eaa70a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1568 microversion: 2.25 time: 0.296575 Oct 11 04:14:35.260388 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 609/1153] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:34 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1568 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:35.264728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:35.265448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] [instance: 64baf484-344e-4c1d-861d-c1dff29896e0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:35.271363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.271833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.272258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.272942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.273387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.273799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.289449 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] HTTP exception thrown: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Request method failure captured: Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 HTTP/1.1 Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROz2lq8tlzxkciCJV0DjrJtfQrLCJwSmAuEvMpzvzFslvhbOB44lKFPFxLg98NvH750vmXnjx5jCIBzrhlsjxsEeVHuWy4_SdYGRrPGpR5jathG5bkGT2Dkt6nr3TkU2EeZlz0rXI4HqddXCMVRxqyxGWcAU2D-_6xUXZCdxlNrtXGs Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 65263374513549f0b6329862bd14f419 Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1490631746 Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/65263374513549f0b6329862bd14f419"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_65263374513549f0b6329862bd14f419"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65263374513549f0b6329862bd14f419"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/65263374513549f0b6329862bd14f419"}]}] Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1490631746 Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 65263374513549f0b6329862bd14f419 Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1490631746 Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachSCSIVolumeTestJSON-1490631746-project Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 886899e459944df290afd3583310c873 Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1490631746-project Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '64baf484-344e-4c1d-861d-c1dff29896e0'} Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:35.291215 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.295797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.295797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:35.295797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:35.295797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:35.295797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:35.295797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. Oct 11 04:14:35.295797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.295797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] Returning 404 to user: Instance 64baf484-344e-4c1d-861d-c1dff29896e0 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:35.295797 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a0f25cc-a88f-46dd-a75c-70329c7f16dd tempest-AttachSCSIVolumeTestJSON-1490631746 tempest-AttachSCSIVolumeTestJSON-1490631746-project] 10.222.0.26 "GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0" status: 404 len: 111 microversion: 2.1 time: 0.031950 Oct 11 04:14:35.306642 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 610/1154] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:35 2022] GET /compute/v2.1/servers/64baf484-344e-4c1d-861d-c1dff29896e0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:35.312576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbe319c3-f17f-4399-84fb-af977863cb41 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Action: 'create', calling method: .version_select at 0x7fda1a038b80>, body: {"keypair": {"name": "tempest-keypair-118907434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFyknfpHCJACtu0oVG0/fUaTI1msPaSScybXO4W2+B9LweHSvAn1U/h727VcqB3gdqswXeea7s3H01KUpHwut988TJ5k/iywVQ4eR6/vuGwuzW9ljRRQYOYfPD7obdn57A=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:35.357713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-cbe319c3-f17f-4399-84fb-af977863cb41 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Getting quotas for project 0c2bc5a5c426439fa26df3cd585fd725. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:14:35.370874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-cbe319c3-f17f-4399-84fb-af977863cb41 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Getting quotas for user 0b78414446d84b8196087d3090ef8c35 and project 0c2bc5a5c426439fa26df3cd585fd725. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:14:35.474320 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cbe319c3-f17f-4399-84fb-af977863cb41 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.166114 Oct 11 04:14:35.475766 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 611/1155] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:14:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:35.482824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb835fd2-3062-49d0-b5ab-103acc96f82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:35.484289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bb835fd2-3062-49d0-b5ab-103acc96f82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:35.496326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb835fd2-3062-49d0-b5ab-103acc96f82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.498466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb835fd2-3062-49d0-b5ab-103acc96f82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.498466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb835fd2-3062-49d0-b5ab-103acc96f82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.499770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb835fd2-3062-49d0-b5ab-103acc96f82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.500481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb835fd2-3062-49d0-b5ab-103acc96f82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.501179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb835fd2-3062-49d0-b5ab-103acc96f82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.519116 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-10b47e07-d32c-4fcb-b6e5-3bff3a28d3d7 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 204 len: 0 microversion: 2.1 time: 0.445495 Oct 11 04:14:35.520498 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 545/1156] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:14:35 2022] DELETE /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 0 bytes in 448 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:14:35.527831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e2da0df1-d6cc-4854-84ea-158cc9067ec5 req-ec5dead8-9f02-4b40-9a6d-e88c5facae8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c533c21c-f66a-4a0e-b991-01c4a087f391", "tag": "986bccea-82d2-48c0-8f10-29fc77413e59"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:35.550026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e2da0df1-d6cc-4854-84ea-158cc9067ec5 req-ec5dead8-9f02-4b40-9a6d-e88c5facae8a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.550743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e2da0df1-d6cc-4854-84ea-158cc9067ec5 req-ec5dead8-9f02-4b40-9a6d-e88c5facae8a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.551169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e2da0df1-d6cc-4854-84ea-158cc9067ec5 req-ec5dead8-9f02-4b40-9a6d-e88c5facae8a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.563759 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e2da0df1-d6cc-4854-84ea-158cc9067ec5 req-ec5dead8-9f02-4b40-9a6d-e88c5facae8a service nova] Creating event network-changed:986bccea-82d2-48c0-8f10-29fc77413e59 for instance c533c21c-f66a-4a0e-b991-01c4a087f391 on n-h1-860892-1 Oct 11 04:14:35.574903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-e2da0df1-d6cc-4854-84ea-158cc9067ec5 req-ec5dead8-9f02-4b40-9a6d-e88c5facae8a service nova] Instance c533c21c-f66a-4a0e-b991-01c4a087f391 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:14:35.587330 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e2da0df1-d6cc-4854-84ea-158cc9067ec5 req-ec5dead8-9f02-4b40-9a6d-e88c5facae8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064820 Oct 11 04:14:35.588460 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 546/1157] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:35.593553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2a15286a-d813-40ee-8b2e-bd2bb2306c07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:35.595072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2a15286a-d813-40ee-8b2e-bd2bb2306c07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:35.605178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a15286a-d813-40ee-8b2e-bd2bb2306c07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.605975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a15286a-d813-40ee-8b2e-bd2bb2306c07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.606624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a15286a-d813-40ee-8b2e-bd2bb2306c07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.608485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a15286a-d813-40ee-8b2e-bd2bb2306c07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.609145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a15286a-d813-40ee-8b2e-bd2bb2306c07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.609819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a15286a-d813-40ee-8b2e-bd2bb2306c07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.703386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb835fd2-3062-49d0-b5ab-103acc96f82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:35.717625 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb835fd2-3062-49d0-b5ab-103acc96f82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1473 microversion: 2.1 time: 0.240478 Oct 11 04:14:35.727881 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 612/1158] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:35 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1473 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:35.727998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-2a15286a-d813-40ee-8b2e-bd2bb2306c07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:35.733748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48ef639f-2f11-420d-9727-ab9f9d6ad90f tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Action: 'create', calling method: .version_select at 0x7fda19d84700>, body: {"keypair": {"name": "tempest-keypair-118907434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvK9W9wpTZiLybNzW9Y7qfqiWCowJoUKGDts5m2h7DELv2ATibeoHdJwuS+n609CAKXehr86gECqxrGn8t/Z/cGfvQAToaBw1oOyYSnoIGYZUqKZ6Fk32EYjt91cStEwQ=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:35.750884 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2a15286a-d813-40ee-8b2e-bd2bb2306c07 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.161033 Oct 11 04:14:35.757173 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 547/1159] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:35 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:35.761685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-48ef639f-2f11-420d-9727-ab9f9d6ad90f tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Getting quotas for project 0c2bc5a5c426439fa26df3cd585fd725. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:14:35.767683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-48ef639f-2f11-420d-9727-ab9f9d6ad90f tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Getting quotas for user 0b78414446d84b8196087d3090ef8c35 and project 0c2bc5a5c426439fa26df3cd585fd725. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:14:35.773706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e1f56156-bf98-4e6f-927c-37d450e4f95e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:35.774372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e1f56156-bf98-4e6f-927c-37d450e4f95e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:35.788360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1f56156-bf98-4e6f-927c-37d450e4f95e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.791454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1f56156-bf98-4e6f-927c-37d450e4f95e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.791454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1f56156-bf98-4e6f-927c-37d450e4f95e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.791454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1f56156-bf98-4e6f-927c-37d450e4f95e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.791454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1f56156-bf98-4e6f-927c-37d450e4f95e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.791454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1f56156-bf98-4e6f-927c-37d450e4f95e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.854574 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-48ef639f-2f11-420d-9727-ab9f9d6ad90f tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] HTTP exception thrown: Key pair 'tempest-keypair-118907434' already exists. Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48ef639f-2f11-420d-9727-ab9f9d6ad90f tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Request method failure captured: Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 272 Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO2qlTN24nprJTHvOqYQOGOEBnG5kJ9bHHRe1W4ElQoNB6mEfbkI4arYD7eQclKgr6t4tEe8_JI8lxpaGdE8qB6ymWjTmz942KyyjDVD447NBppCExVirHkq8TBk5dtMGHnsFD49ePRSMaXTKKTtVfGTc_5UuyaLoHtWyrnQDer2-Sk Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}] Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: {"keypair": {"name": "tempest-keypair-118907434", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvK9W9wpTZiLybNzW9Y7qfqiWCowJoUKGDts5m2h7DELv2ATibeoHdJwuS+n609CAKXehr86gECqxrGn8t/Z/cGfvQAToaBw1oOyYSnoIGYZUqKZ6Fk32EYjt91cStEwQ=="}} Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: exception: Key pair 'tempest-keypair-118907434' already exists. Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'keypair': {'name': 'tempest-keypair-118907434', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvK9W9wpTZiLybNzW9Y7qfqiWCowJoUKGDts5m2h7DELv2ATibeoHdJwuS+n609CAKXehr86gECqxrGn8t/Z/cGfvQAToaBw1oOyYSnoIGYZUqKZ6Fk32EYjt91cStEwQ=='}}} Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result.read() Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '0b78414446d84b8196087d3090ef8c35-tempest-keypair-118907434' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 11 04:14:35.877179 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 69, in _create_in_db Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi kp.save(context.session) Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result.read() Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 04:14:35.882523 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '0b78414446d84b8196087d3090ef8c35-tempest-keypair-118907434' for key 'key_pairs.uniq_key_pairs0user_id0name'") Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO key_pairs (created_at, updated_at, name, user_id, fingerprint, public_key, type) VALUES (%(created_at)s, %(updated_at)s, %(name)s, %(user_id)s, %(fingerprint)s, %(public_key)s, %(type)s)] Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 4, 14, 35, 792685), 'updated_at': None, 'name': 'tempest-keypair-118907434', 'user_id': '0b78414446d84b8196087d3090ef8c35', 'fingerprint': '40:d0:6d:8f:9a:61:83:9c:ce:55:a2:1d:9c:58:c2:ad', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPvK9W9wpTZiLybNzW9Y7qfqiWCowJoUKGDts5m2h7DELv2ATibeoHdJwuS+n609CAKXehr86gECqxrGn8t/Z/cGfvQAToaBw1oOyYSnoIGYZUqKZ6Fk32EYjt91cStEwQ==', 'type': 'ssh'}] Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6777, in import_key_pair Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi keypair.create() Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 158, in create Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._create() Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 162, in _create Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_keypair = self._create_in_db(self._context, updates) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 134, in _create_in_db Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return _create_in_db(context, values) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 71, in _create_in_db Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.KeyPairExists(key_name=values['name']) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.KeyPairExists: Key pair 'tempest-keypair-118907434' already exists. Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 132, in _create Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=exc.format_message()) Oct 11 04:14:35.886565 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Key pair 'tempest-keypair-118907434' already exists. Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Key pair 'tempest-keypair-118907434' already exists. Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48ef639f-2f11-420d-9727-ab9f9d6ad90f tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Returning 409 to user: Key pair 'tempest-keypair-118907434' already exists. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48ef639f-2f11-420d-9727-ab9f9d6ad90f tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 409 len: 104 microversion: 2.1 time: 0.158747 Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 613/1160] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:14:35 2022] POST /compute/v2.1/os-keypairs => generated 104 bytes in 160 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d785e996-d0fe-4a49-b8ca-0d057398fdb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:35.892187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d785e996-d0fe-4a49-b8ca-0d057398fdb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:35.896135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d785e996-d0fe-4a49-b8ca-0d057398fdb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.897183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d785e996-d0fe-4a49-b8ca-0d057398fdb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.897183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d785e996-d0fe-4a49-b8ca-0d057398fdb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:35.899499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d785e996-d0fe-4a49-b8ca-0d057398fdb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:35.899499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d785e996-d0fe-4a49-b8ca-0d057398fdb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:35.899499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d785e996-d0fe-4a49-b8ca-0d057398fdb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.044297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d785e996-d0fe-4a49-b8ca-0d057398fdb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:36.055078 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d785e996-d0fe-4a49-b8ca-0d057398fdb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.171012 Oct 11 04:14:36.055953 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 614/1161] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:35 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:36.077656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a4e504b-6758-400a-994b-86a6a79153c9 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Calling method '.version_select at 0x7fda19b73dc0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.093914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e1f56156-bf98-4e6f-927c-37d450e4f95e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:36.103833 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e1f56156-bf98-4e6f-927c-37d450e4f95e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1508 microversion: 2.1 time: 0.349218 Oct 11 04:14:36.104640 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 548/1162] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:35 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1508 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:36.137605 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a4e504b-6758-400a-994b-86a6a79153c9 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-118907434" status: 202 len: 0 microversion: 2.1 time: 0.072857 Oct 11 04:14:36.138283 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 615/1163] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:14:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-118907434 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:14:36.150908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-223508c6-6730-4174-b17c-514441308172 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Action: 'create', calling method: .version_select at 0x7fda19a2f040>, body: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEO1hZwG13JMz3i0vphmyTvSFgBt7/D9MavX3Us+E79lZDVL1+BD3A6ohrg2wt3g9+i8PrYZwCAYK7VOtdgGLajNmdujN/jfJOnYoq4IuWNwhz1fYCshfzmUyurSOzo7Q=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-223508c6-6730-4174-b17c-514441308172 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Request method failure captured: Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 247 Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO2qlTN24nprJTHvOqYQOGOEBnG5kJ9bHHRe1W4ElQoNB6mEfbkI4arYD7eQclKgr6t4tEe8_JI8lxpaGdE8qB6ymWjTmz942KyyjDVD447NBppCExVirHkq8TBk5dtMGHnsFD49ePRSMaXTKKTtVfGTc_5UuyaLoHtWyrnQDer2-Sk Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}] Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: {"keypair": {"name": "", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEO1hZwG13JMz3i0vphmyTvSFgBt7/D9MavX3Us+E79lZDVL1+BD3A6ohrg2wt3g9+i8PrYZwCAYK7VOtdgGLajNmdujN/jfJOnYoq4IuWNwhz1fYCshfzmUyurSOzo7Q=="}} Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'keypair': {'name': '', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCEO1hZwG13JMz3i0vphmyTvSFgBt7/D9MavX3Us+E79lZDVL1+BD3A6ohrg2wt3g9+i8PrYZwCAYK7VOtdgGLajNmdujN/jfJOnYoq4IuWNwhz1fYCshfzmUyurSOzo7Q=='}}} Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi '' Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:14:36.155148 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-223508c6-6730-4174-b17c-514441308172 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-223508c6-6730-4174-b17c-514441308172 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 108 microversion: 2.1 time: 0.010892 Oct 11 04:14:36.164491 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 549/1164] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:14:36 2022] POST /compute/v2.1/os-keypairs => generated 108 bytes in 13 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:14:36.170568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69eba9f5-82b6-4a95-a0ac-ace977c74d16 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Action: 'create', calling method: .version_select at 0x7fda19b778b0>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1866837259", "public_key": " "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:36.187059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-69eba9f5-82b6-4a95-a0ac-ace977c74d16 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Getting quotas for project 0c2bc5a5c426439fa26df3cd585fd725. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:14:36.190962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-69eba9f5-82b6-4a95-a0ac-ace977c74d16 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Getting quotas for user 0b78414446d84b8196087d3090ef8c35 and project 0c2bc5a5c426439fa26df3cd585fd725. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:14:36.206993 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-69eba9f5-82b6-4a95-a0ac-ace977c74d16 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69eba9f5-82b6-4a95-a0ac-ace977c74d16 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Request method failure captured: Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 95 Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO2qlTN24nprJTHvOqYQOGOEBnG5kJ9bHHRe1W4ElQoNB6mEfbkI4arYD7eQclKgr6t4tEe8_JI8lxpaGdE8qB6ymWjTmz942KyyjDVD447NBppCExVirHkq8TBk5dtMGHnsFD49ePRSMaXTKKTtVfGTc_5UuyaLoHtWyrnQDer2-Sk Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}] Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-1866837259", "public_key": " "}} Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-1866837259', 'public_key': ' '}}} Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 650, in load_ssh_public_key Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid line format") Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ValueError: Invalid line format Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.209360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69eba9f5-82b6-4a95-a0ac-ace977c74d16 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-69eba9f5-82b6-4a95-a0ac-ace977c74d16 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.045655 Oct 11 04:14:36.213775 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 616/1165] 10.222.0.26 () {60 vars in 1158 bytes} [Tue Oct 11 04:14:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 47 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:14:36.223042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d55e26e6-5b4d-4d29-a6a3-bea0557937f7 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Action: 'create', calling method: .version_select at 0x7fda19a1eee0>, body: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/kk96LuLMtB8Xitf6gC18wg5B8nBJ+4ZFUAEo1BEq09slonkxlCKDjxavwqOfd7vnC6T7D0O+rBSNPM3zXmysoV6Z2pVq/zPrU5T9C9n51ggo4r0As0dbOKJc84qsNIw=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d55e26e6-5b4d-4d29-a6a3-bea0557937f7 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Request method failure captured: Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 507 Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO2qlTN24nprJTHvOqYQOGOEBnG5kJ9bHHRe1W4ElQoNB6mEfbkI4arYD7eQclKgr6t4tEe8_JI8lxpaGdE8qB6ymWjTmz942KyyjDVD447NBppCExVirHkq8TBk5dtMGHnsFD49ePRSMaXTKKTtVfGTc_5UuyaLoHtWyrnQDer2-Sk Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}] Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: {"keypair": {"name": "keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/kk96LuLMtB8Xitf6gC18wg5B8nBJ+4ZFUAEo1BEq09slonkxlCKDjxavwqOfd7vnC6T7D0O+rBSNPM3zXmysoV6Z2pVq/zPrU5T9C9n51ggo4r0As0dbOKJc84qsNIw=="}} Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'keypair': {'name': 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000', 'public_key': 'ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO/kk96LuLMtB8Xitf6gC18wg5B8nBJ+4ZFUAEo1BEq09slonkxlCKDjxavwqOfd7vnC6T7D0O+rBSNPM3zXmysoV6Z2pVq/zPrU5T9C9n51ggo4r0As0dbOKJc84qsNIw=='}}} Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['keypair']['properties']['name']['allOf'][0]: Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['keypair']: Oct 11 04:14:36.227657 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d55e26e6-5b4d-4d29-a6a3-bea0557937f7 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Returning 400 to user: Invalid input for field/attribute name. Value: keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000. 'keypair-000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000000' is too long {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d55e26e6-5b4d-4d29-a6a3-bea0557937f7 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 627 microversion: 2.1 time: 0.009855 Oct 11 04:14:36.231140 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 550/1166] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:14:36 2022] POST /compute/v2.1/os-keypairs => generated 627 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:14:36.238572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dbd0aee7-0f5b-4110-8969-cbb9e5e2d41b tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Action: 'create', calling method: .version_select at 0x7fda19b77e50>, body: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-321291091", "public_key": "ssh-rsa JUNK nova@ubuntu"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:36.253748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-dbd0aee7-0f5b-4110-8969-cbb9e5e2d41b tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Getting quotas for project 0c2bc5a5c426439fa26df3cd585fd725. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:14:36.258479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-dbd0aee7-0f5b-4110-8969-cbb9e5e2d41b tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Getting quotas for user 0b78414446d84b8196087d3090ef8c35 and project 0c2bc5a5c426439fa26df3cd585fd725. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:14:36.267661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=2,nova_api:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:36.274854 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-dbd0aee7-0f5b-4110-8969-cbb9e5e2d41b tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] HTTP exception thrown: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dbd0aee7-0f5b-4110-8969-cbb9e5e2d41b tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Request method failure captured: Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-keypairs HTTP/1.1 Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 117 Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO2qlTN24nprJTHvOqYQOGOEBnG5kJ9bHHRe1W4ElQoNB6mEfbkI4arYD7eQclKgr6t4tEe8_JI8lxpaGdE8qB6ymWjTmz942KyyjDVD447NBppCExVirHkq8TBk5dtMGHnsFD49ePRSMaXTKKTtVfGTc_5UuyaLoHtWyrnQDer2-Sk Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}] Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: {"keypair": {"name": "tempest-KeyPairsNegativeTestJSON-keypair-321291091", "public_key": "ssh-rsa JUNK nova@ubuntu"}} Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: exception: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'keypair': {'name': 'tempest-KeyPairsNegativeTestJSON-keypair-321291091', 'public_key': 'ssh-rsa JUNK nova@ubuntu'}}} Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 71, in generate_fingerprint Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi serialization.load_ssh_public_key( Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 664, in load_ssh_public_key Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi inner_key_type, data = _get_sshstr(data) Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 134, in _get_sshstr Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi n, data = _get_u32(data) Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cryptography/hazmat/primitives/serialization/ssh.py", line 121, in _get_u32 Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise ValueError("Invalid data") Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ValueError: Invalid data Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 117, in _create Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi keypair = self.api.import_key_pair( Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6774, in import_key_pair Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi fingerprint = self._generate_fingerprint(public_key, key_type) Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6847, in _generate_fingerprint Oct 11 04:14:36.276778 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return crypto.generate_fingerprint(public_key) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/crypto.py", line 77, in generate_fingerprint Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InvalidKeypair( Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidKeypair: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 103, in create Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._create(req, body) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 130, in _create Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPBadRequest(explanation=exc.format_message()) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair data is invalid: failed to generate fingerprint Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dbd0aee7-0f5b-4110-8969-cbb9e5e2d41b tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Returning 400 to user: Keypair data is invalid: failed to generate fingerprint {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dbd0aee7-0f5b-4110-8969-cbb9e5e2d41b tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 400 len: 99 microversion: 2.1 time: 0.043444 Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 617/1167] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:14:36 2022] POST /compute/v2.1/os-keypairs => generated 99 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:14:36.289395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5284d83b-ecd9-43ce-85de-2c62e6251e50 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Calling method '.version_select at 0x7fda19b77f70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.298138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.298999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:36.301240 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-5284d83b-ecd9-43ce-85de-2c62e6251e50 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] HTTP exception thrown: Keypair tempest-keypair-non-existent-2145918685 not found for user 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5284d83b-ecd9-43ce-85de-2c62e6251e50 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Request method failure captured: Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2145918685 HTTP/1.1 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO2qlTN24nprJTHvOqYQOGOEBnG5kJ9bHHRe1W4ElQoNB6mEfbkI4arYD7eQclKgr6t4tEe8_JI8lxpaGdE8qB6ymWjTmz942KyyjDVD447NBppCExVirHkq8TBk5dtMGHnsFD49ePRSMaXTKKTtVfGTc_5UuyaLoHtWyrnQDer2-Sk Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0c2bc5a5c426439fa26df3cd585fd725"}]}] Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 0c2bc5a5c426439fa26df3cd585fd725 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-KeyPairsNegativeTestJSON-231810017 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-KeyPairsNegativeTestJSON-231810017-project Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: exception: Keypair tempest-keypair-non-existent-2145918685 not found for user 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'tempest-keypair-non-existent-2145918685'} Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 170, in _delete Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.api.delete_key_pair(context, user_id, id) Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 71, in wrapped Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _emit_versioned_exception_notification( Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, *args, **kw) Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6861, in delete_key_pair Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi keypair = self.get_key_pair(context, user_id, key_name) Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6882, in get_key_pair Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return objects.KeyPair.get_by_name(context, user_id, key_name) Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-keypair-non-existent-2145918685 not found for user 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.303201 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 143, in delete Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req, id) Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/keypairs.py", line 172, in _delete Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=exc.format_message()) Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Keypair tempest-keypair-non-existent-2145918685 not found for user 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Keypair tempest-keypair-non-existent-2145918685 not found for user 0b78414446d84b8196087d3090ef8c35 Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5284d83b-ecd9-43ce-85de-2c62e6251e50 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] Returning 404 to user: Keypair tempest-keypair-non-existent-2145918685 not found for user 0b78414446d84b8196087d3090ef8c35 {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:36.309870 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5284d83b-ecd9-43ce-85de-2c62e6251e50 tempest-KeyPairsNegativeTestJSON-231810017 tempest-KeyPairsNegativeTestJSON-231810017-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2145918685" status: 404 len: 145 microversion: 2.1 time: 0.020612 Oct 11 04:14:36.312229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.312229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.312229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.312229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.313068 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 618/1168] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:14:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-non-existent-2145918685 => generated 145 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:14:36.315376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.315376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.424193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e1238f3-b423-43b0-8fdb-78c0ecea878f tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.479534 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e1238f3-b423-43b0-8fdb-78c0ecea878f tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/54296184" status: 202 len: 0 microversion: 2.1 time: 0.059936 Oct 11 04:14:36.480201 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 619/1169] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:14:36 2022] DELETE /compute/v2.1/flavors/54296184 => generated 0 bytes in 61 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:14:36.488139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a5e71b7-94bc-4c83-9e02-a85653b3357f tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.511986 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a5e71b7-94bc-4c83-9e02-a85653b3357f tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5406 microversion: 2.1 time: 0.027334 Oct 11 04:14:36.512573 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 620/1170] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:14:36 2022] GET /compute/v2.1/flavors/detail => generated 5406 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:36.539055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aa42bed5-1a8d-4010-acc6-0e6e6e51a9a3 tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.565865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:36.578957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:36.580859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:36.582241 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-40ea2012-a0fb-4796-acae-9f493769479d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1568 microversion: 2.25 time: 0.299918 Oct 11 04:14:36.583416 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 551/1171] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:36 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1568 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:36.627896 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aa42bed5-1a8d-4010-acc6-0e6e6e51a9a3 tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1151262366" status: 202 len: 0 microversion: 2.1 time: 0.092910 Oct 11 04:14:36.628946 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 621/1172] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:14:36 2022] DELETE /compute/v2.1/flavors/1151262366 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:14:36.638848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3018b12d-e139-4c01-bad3-1e0c6340eb2b tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.659832 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3018b12d-e139-4c01-bad3-1e0c6340eb2b tempest-ServersWithSpecificFlavorTestJSON-282689886 tempest-ServersWithSpecificFlavorTestJSON-282689886-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025228 Oct 11 04:14:36.678347 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 552/1173] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:14:36 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:36.691599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.692178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:36.699066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.699551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.700314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.701264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.701865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.702546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.719034 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] HTTP exception thrown: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Request method failure captured: Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 HTTP/1.1 Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROy8wySxQbF6M0ICrqAT-duRciejIJsdaKS3ttYyUMucvA5YDFumCjdP1KYQativfL3oUbCUB6Is8zIAkOA8QM3k3igjRFKDcCHbWUJed01avwgip2maQpDEt3AmLYlnEXCPQ8sUNjbvzLJ9ZecjahLFn0Yg4iakV0jD5zp85aaR_TA Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49ed194cff9c4482a96dff268602479a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49ed194cff9c4482a96dff268602479a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}] Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 28240e25179b447781e0e351c659c065 Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '02cb0576-4cd8-443a-a6f1-3191ea67e719'} Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:36.720812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Returning 404 to user: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a362d769-401d-4061-892c-d21f798aa1bc tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "DELETE /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 404 len: 111 microversion: 2.1 time: 0.035051 Oct 11 04:14:36.732993 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 622/1174] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:14:36 2022] DELETE /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:36.734035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.734035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: 02cb0576-4cd8-443a-a6f1-3191ea67e719] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:36.738038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.738598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.739583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.740270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.740739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.741159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.742608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ed834598-fa39-4472-bac3-e8e334c078de tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.743217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ed834598-fa39-4472-bac3-e8e334c078de tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:36.749499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed834598-fa39-4472-bac3-e8e334c078de tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.750118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed834598-fa39-4472-bac3-e8e334c078de tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.750930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed834598-fa39-4472-bac3-e8e334c078de tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.751864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed834598-fa39-4472-bac3-e8e334c078de tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.752464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed834598-fa39-4472-bac3-e8e334c078de tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.752985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed834598-fa39-4472-bac3-e8e334c078de tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.757686 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] HTTP exception thrown: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Request method failure captured: Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 HTTP/1.1 Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROy8wySxQbF6M0ICrqAT-duRciejIJsdaKS3ttYyUMucvA5YDFumCjdP1KYQativfL3oUbCUB6Is8zIAkOA8QM3k3igjRFKDcCHbWUJed01avwgip2maQpDEt3AmLYlnEXCPQ8sUNjbvzLJ9ZecjahLFn0Yg4iakV0jD5zp85aaR_TA Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49ed194cff9c4482a96dff268602479a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49ed194cff9c4482a96dff268602479a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}] Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 28240e25179b447781e0e351c659c065 Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '02cb0576-4cd8-443a-a6f1-3191ea67e719'} Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:36.762069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Returning 404 to user: Instance 02cb0576-4cd8-443a-a6f1-3191ea67e719 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-20fc5793-4245-4984-8839-b19f6a98efb8 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719" status: 404 len: 111 microversion: 2.1 time: 0.034070 Oct 11 04:14:36.766692 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 553/1175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:36 2022] GET /compute/v2.1/servers/02cb0576-4cd8-443a-a6f1-3191ea67e719 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:36.771182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.771678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:36.778912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.779397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.779828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.780522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.780957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.781381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.802993 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] HTTP exception thrown: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Request method failure captured: Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 HTTP/1.1 Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROy8wySxQbF6M0ICrqAT-duRciejIJsdaKS3ttYyUMucvA5YDFumCjdP1KYQativfL3oUbCUB6Is8zIAkOA8QM3k3igjRFKDcCHbWUJed01avwgip2maQpDEt3AmLYlnEXCPQ8sUNjbvzLJ9ZecjahLFn0Yg4iakV0jD5zp85aaR_TA Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49ed194cff9c4482a96dff268602479a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49ed194cff9c4482a96dff268602479a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}] Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 28240e25179b447781e0e351c659c065 Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e3a2d8cb-5666-44f2-b773-bc4305262557'} Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:36.805092 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Returning 404 to user: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:36.809613 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6323107b-bd0f-43a7-966a-49fa6af865bd tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 404 len: 111 microversion: 2.1 time: 0.042961 Oct 11 04:14:36.821197 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 554/1176] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:14:36 2022] DELETE /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:36.821197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00ca434c-365a-4887-94ca-d1b0e327e46c tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.821197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00ca434c-365a-4887-94ca-d1b0e327e46c tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:36.824592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00ca434c-365a-4887-94ca-d1b0e327e46c tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.825084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00ca434c-365a-4887-94ca-d1b0e327e46c tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.825535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00ca434c-365a-4887-94ca-d1b0e327e46c tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.826266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00ca434c-365a-4887-94ca-d1b0e327e46c tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.826676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00ca434c-365a-4887-94ca-d1b0e327e46c tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.827094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00ca434c-365a-4887-94ca-d1b0e327e46c tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.918931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ed834598-fa39-4472-bac3-e8e334c078de tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:36.926831 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ed834598-fa39-4472-bac3-e8e334c078de tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1473 microversion: 2.1 time: 0.188675 Oct 11 04:14:36.928671 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 623/1177] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:36 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1473 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:36.933346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:36.933946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] [instance: e3a2d8cb-5666-44f2-b773-bc4305262557] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:36.938768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-00ca434c-365a-4887-94ca-d1b0e327e46c tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:36.947290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.948172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.948785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.949654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:36.950299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:36.950897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:36.961397 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00ca434c-365a-4887-94ca-d1b0e327e46c tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.147768 Oct 11 04:14:36.961973 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 555/1178] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:36 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:36.966441 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] HTTP exception thrown: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Request method failure captured: Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 HTTP/1.1 Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROy8wySxQbF6M0ICrqAT-duRciejIJsdaKS3ttYyUMucvA5YDFumCjdP1KYQativfL3oUbCUB6Is8zIAkOA8QM3k3igjRFKDcCHbWUJed01avwgip2maQpDEt3AmLYlnEXCPQ8sUNjbvzLJ9ZecjahLFn0Yg4iakV0jD5zp85aaR_TA Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/49ed194cff9c4482a96dff268602479a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_49ed194cff9c4482a96dff268602479a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/49ed194cff9c4482a96dff268602479a"}]}] Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 49ed194cff9c4482a96dff268602479a Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459 Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 28240e25179b447781e0e351c659c065 Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersWithSpecificFlavorTestJSON-1765472459-project Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e3a2d8cb-5666-44f2-b773-bc4305262557'} Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:36.967976 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.972685 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:36.972685 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.972685 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:36.972685 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:36.972685 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:36.972685 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:36.972685 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:36.972685 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. Oct 11 04:14:36.972685 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:36.972685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] Returning 404 to user: Instance e3a2d8cb-5666-44f2-b773-bc4305262557 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:36.972685 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-793f272a-1f67-4384-a12f-f46249ea10e9 tempest-ServersWithSpecificFlavorTestJSON-1765472459 tempest-ServersWithSpecificFlavorTestJSON-1765472459-project] 10.222.0.26 "GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557" status: 404 len: 111 microversion: 2.1 time: 0.040681 Oct 11 04:14:36.973711 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 624/1179] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:36 2022] GET /compute/v2.1/servers/e3a2d8cb-5666-44f2-b773-bc4305262557 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:37.079916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1fb8d9e7-8f7b-4bbc-bf7b-76593c4b402a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:37.080767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1fb8d9e7-8f7b-4bbc-bf7b-76593c4b402a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:37.088248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fb8d9e7-8f7b-4bbc-bf7b-76593c4b402a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:37.088934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fb8d9e7-8f7b-4bbc-bf7b-76593c4b402a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:37.089572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fb8d9e7-8f7b-4bbc-bf7b-76593c4b402a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:37.090521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fb8d9e7-8f7b-4bbc-bf7b-76593c4b402a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:37.091141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fb8d9e7-8f7b-4bbc-bf7b-76593c4b402a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:37.091744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fb8d9e7-8f7b-4bbc-bf7b-76593c4b402a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:37.128924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d4465904-c8e4-4b50-b161-7a94cf2766b0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:37.129602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d4465904-c8e4-4b50-b161-7a94cf2766b0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:37.139337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4465904-c8e4-4b50-b161-7a94cf2766b0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:37.140102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4465904-c8e4-4b50-b161-7a94cf2766b0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:37.140737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4465904-c8e4-4b50-b161-7a94cf2766b0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:37.141673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4465904-c8e4-4b50-b161-7a94cf2766b0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:37.142315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4465904-c8e4-4b50-b161-7a94cf2766b0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:37.142902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4465904-c8e4-4b50-b161-7a94cf2766b0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:37.333786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1fb8d9e7-8f7b-4bbc-bf7b-76593c4b402a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:37.343062 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1fb8d9e7-8f7b-4bbc-bf7b-76593c4b402a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.266919 Oct 11 04:14:37.351682 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 556/1180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:37 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:37.462220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d4465904-c8e4-4b50-b161-7a94cf2766b0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:37.472456 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d4465904-c8e4-4b50-b161-7a94cf2766b0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1508 microversion: 2.1 time: 0.347193 Oct 11 04:14:37.473425 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 625/1181] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:37 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1508 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:37.607782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:37.622445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:37.622445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:37.622445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:37.622445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:37.622445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:37.622445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:37.622445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:37.951209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-57ac8249-f80d-4f32-89f3-2716c8de38fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:37.952138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-57ac8249-f80d-4f32-89f3-2716c8de38fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:37.959305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ac8249-f80d-4f32-89f3-2716c8de38fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:37.959945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ac8249-f80d-4f32-89f3-2716c8de38fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:37.960488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ac8249-f80d-4f32-89f3-2716c8de38fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:37.961431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ac8249-f80d-4f32-89f3-2716c8de38fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:37.962096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ac8249-f80d-4f32-89f3-2716c8de38fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:37.962868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ac8249-f80d-4f32-89f3-2716c8de38fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:38.146433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:38.158628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:38.162064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:38.164649 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-78a5cb88-c622-4b77-824b-4e3e320a42f8 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1568 microversion: 2.25 time: 0.560192 Oct 11 04:14:38.166142 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 557/1182] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:37 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1568 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:38.173545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f23233f-1454-43ea-91a3-e328d2437a21 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:38.174486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f23233f-1454-43ea-91a3-e328d2437a21 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:38.181671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f23233f-1454-43ea-91a3-e328d2437a21 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:38.182420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f23233f-1454-43ea-91a3-e328d2437a21 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:38.184202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f23233f-1454-43ea-91a3-e328d2437a21 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:38.185308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f23233f-1454-43ea-91a3-e328d2437a21 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:38.186063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f23233f-1454-43ea-91a3-e328d2437a21 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:38.187050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f23233f-1454-43ea-91a3-e328d2437a21 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:38.358760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-8f23233f-1454-43ea-91a3-e328d2437a21 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:38.377729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:38.380612 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f23233f-1454-43ea-91a3-e328d2437a21 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.212465 Oct 11 04:14:38.381322 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 558/1183] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:38 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:38.386598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-608781d4-3154-4730-b6c3-24ec5cd65a93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:38.387442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-608781d4-3154-4730-b6c3-24ec5cd65a93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:38.398661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-608781d4-3154-4730-b6c3-24ec5cd65a93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:38.399915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-608781d4-3154-4730-b6c3-24ec5cd65a93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:38.400489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-608781d4-3154-4730-b6c3-24ec5cd65a93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:38.401375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-608781d4-3154-4730-b6c3-24ec5cd65a93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:38.401836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-608781d4-3154-4730-b6c3-24ec5cd65a93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:38.402335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-608781d4-3154-4730-b6c3-24ec5cd65a93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:38.457093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-57ac8249-f80d-4f32-89f3-2716c8de38fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:38.468296 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-57ac8249-f80d-4f32-89f3-2716c8de38fa tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1473 microversion: 2.1 time: 0.521256 Oct 11 04:14:38.469341 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 626/1184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:37 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1473 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:38.507229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cfe8eaeb-7f22-4dbc-a86a-d89da85d727c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:38.527410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cfe8eaeb-7f22-4dbc-a86a-d89da85d727c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:38.542813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfe8eaeb-7f22-4dbc-a86a-d89da85d727c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:38.542813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfe8eaeb-7f22-4dbc-a86a-d89da85d727c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:38.543272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfe8eaeb-7f22-4dbc-a86a-d89da85d727c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:38.545794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfe8eaeb-7f22-4dbc-a86a-d89da85d727c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:38.546719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfe8eaeb-7f22-4dbc-a86a-d89da85d727c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:38.547049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfe8eaeb-7f22-4dbc-a86a-d89da85d727c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:38.761907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cfe8eaeb-7f22-4dbc-a86a-d89da85d727c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:38.770968 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cfe8eaeb-7f22-4dbc-a86a-d89da85d727c tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1508 microversion: 2.1 time: 0.277046 Oct 11 04:14:38.771550 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 627/1185] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:38 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1508 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:38.948758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-608781d4-3154-4730-b6c3-24ec5cd65a93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:38.966228 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-608781d4-3154-4730-b6c3-24ec5cd65a93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.581220 Oct 11 04:14:38.984543 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 559/1186] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:38 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:39.191281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:39.191904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:39.204122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.204613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.205040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:39.205733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.210609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.211257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:39.251376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:UPDATE=2,nova_cell1:RELEASE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:39.408473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2fcf31b5-a1e5-4f9a-9e93-652cca04581b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:39.409090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2fcf31b5-a1e5-4f9a-9e93-652cca04581b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:39.418225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fcf31b5-a1e5-4f9a-9e93-652cca04581b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.418716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fcf31b5-a1e5-4f9a-9e93-652cca04581b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.419152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fcf31b5-a1e5-4f9a-9e93-652cca04581b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:39.424035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fcf31b5-a1e5-4f9a-9e93-652cca04581b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.426363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fcf31b5-a1e5-4f9a-9e93-652cca04581b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.432380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fcf31b5-a1e5-4f9a-9e93-652cca04581b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:39.592271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-2fcf31b5-a1e5-4f9a-9e93-652cca04581b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:39.596350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:39.613521 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2fcf31b5-a1e5-4f9a-9e93-652cca04581b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.208586 Oct 11 04:14:39.615453 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 560/1187] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:39 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:39.620804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e2bf8b09-6f63-44d2-bc1b-51950cea0b36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:39.621808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e2bf8b09-6f63-44d2-bc1b-51950cea0b36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:39.628572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2bf8b09-6f63-44d2-bc1b-51950cea0b36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.629437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2bf8b09-6f63-44d2-bc1b-51950cea0b36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.631136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2bf8b09-6f63-44d2-bc1b-51950cea0b36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:39.632238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2bf8b09-6f63-44d2-bc1b-51950cea0b36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.632965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2bf8b09-6f63-44d2-bc1b-51950cea0b36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.633616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2bf8b09-6f63-44d2-bc1b-51950cea0b36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:39.704592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:39.728682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:39.740253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:39.741913 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cfb60e90-1680-4af5-af88-d841f6e80eab tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1543 microversion: 2.25 time: 0.556036 Oct 11 04:14:39.743313 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 628/1188] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:39 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1543 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:39.757135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-0589095e-c047-479e-b0e5-bd4d829d1bd1 req-f8fead9e-b420-42fb-90dd-13488dffc042 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e", "name": "network-vif-deleted", "tag": "b4654310-3e46-4989-977e-9e06fed03db8"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:39.781451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0589095e-c047-479e-b0e5-bd4d829d1bd1 req-f8fead9e-b420-42fb-90dd-13488dffc042 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.782361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0589095e-c047-479e-b0e5-bd4d829d1bd1 req-f8fead9e-b420-42fb-90dd-13488dffc042 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.787539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0589095e-c047-479e-b0e5-bd4d829d1bd1 req-f8fead9e-b420-42fb-90dd-13488dffc042 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:39.818465 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-0589095e-c047-479e-b0e5-bd4d829d1bd1 req-f8fead9e-b420-42fb-90dd-13488dffc042 service nova] Creating event network-vif-deleted:b4654310-3e46-4989-977e-9e06fed03db8 for instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e on n-h2-860892-1 Oct 11 04:14:39.839482 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-0589095e-c047-479e-b0e5-bd4d829d1bd1 req-f8fead9e-b420-42fb-90dd-13488dffc042 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093018 Oct 11 04:14:39.840680 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 629/1189] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:39.861965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2ae47a32-6d0f-4eaa-b362-687e206322d8 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '.version_select at 0x7fda19d1d1f0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:39.883634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae47a32-6d0f-4eaa-b362-687e206322d8 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.884510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae47a32-6d0f-4eaa-b362-687e206322d8 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.884963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae47a32-6d0f-4eaa-b362-687e206322d8 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:39.903287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e2bf8b09-6f63-44d2-bc1b-51950cea0b36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:39.905387 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2ae47a32-6d0f-4eaa-b362-687e206322d8 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 2365 microversion: 2.25 time: 0.063267 Oct 11 04:14:39.906546 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 630/1190] 10.222.0.26 () {60 vars in 1184 bytes} [Tue Oct 11 04:14:39 2022] GET /compute/v2.1/os-migrations => generated 2365 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:39.917412 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e2bf8b09-6f63-44d2-bc1b-51950cea0b36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1470 microversion: 2.1 time: 0.300420 Oct 11 04:14:39.917888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-73dc6050-9adb-4ea6-9364-40ccc6ab417e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:39.918672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-73dc6050-9adb-4ea6-9364-40ccc6ab417e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:39.928228 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 561/1191] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:39 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1470 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:39.933915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73dc6050-9adb-4ea6-9364-40ccc6ab417e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.934276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f3cad81f-406c-49df-8d25-bfe9ed2dada3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:39.934405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73dc6050-9adb-4ea6-9364-40ccc6ab417e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.935093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73dc6050-9adb-4ea6-9364-40ccc6ab417e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:39.935476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f3cad81f-406c-49df-8d25-bfe9ed2dada3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:39.935800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73dc6050-9adb-4ea6-9364-40ccc6ab417e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.936256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73dc6050-9adb-4ea6-9364-40ccc6ab417e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.936705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73dc6050-9adb-4ea6-9364-40ccc6ab417e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:39.943658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3cad81f-406c-49df-8d25-bfe9ed2dada3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.946718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3cad81f-406c-49df-8d25-bfe9ed2dada3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.946718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3cad81f-406c-49df-8d25-bfe9ed2dada3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:39.946718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3cad81f-406c-49df-8d25-bfe9ed2dada3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:39.946718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3cad81f-406c-49df-8d25-bfe9ed2dada3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:39.946718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3cad81f-406c-49df-8d25-bfe9ed2dada3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:40.063653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-73dc6050-9adb-4ea6-9364-40ccc6ab417e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:40.079866 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-73dc6050-9adb-4ea6-9364-40ccc6ab417e tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1293 microversion: 2.1 time: 0.171937 Oct 11 04:14:40.090350 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 631/1192] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:39 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1293 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:40.108144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-f3cad81f-406c-49df-8d25-bfe9ed2dada3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid 0263254c-1383-4f74-8505-d1402be4bd56 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:40.108969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:40.110471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:40.120188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:40.121012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:40.121664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:40.122651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:40.123336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:40.124207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:40.125665 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f3cad81f-406c-49df-8d25-bfe9ed2dada3 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 2036 microversion: 2.25 time: 0.195881 Oct 11 04:14:40.126594 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 562/1193] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:39 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 2036 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:40.134590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7495ba02-2e8b-4ebc-93d9-bc75955c1564 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:40.136369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7495ba02-2e8b-4ebc-93d9-bc75955c1564 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:40.153361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7495ba02-2e8b-4ebc-93d9-bc75955c1564 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:40.154223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7495ba02-2e8b-4ebc-93d9-bc75955c1564 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:40.154944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7495ba02-2e8b-4ebc-93d9-bc75955c1564 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:40.156856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7495ba02-2e8b-4ebc-93d9-bc75955c1564 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:40.157346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7495ba02-2e8b-4ebc-93d9-bc75955c1564 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:40.157791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7495ba02-2e8b-4ebc-93d9-bc75955c1564 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:40.218890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:40.221214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:40.221214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:40.221214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:40.221656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:40.222160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:40.258560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'cores', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:14:40.266389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for user a1df373e8ec14e2a84f0b8a62e0b884a and project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'cores', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:14:40.368983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7495ba02-2e8b-4ebc-93d9-bc75955c1564 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:40.379014 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7495ba02-2e8b-4ebc-93d9-bc75955c1564 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.250888 Oct 11 04:14:40.380651 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 563/1194] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:40 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:40.401107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a35babd8-0528-45b9-9cdb-54da93d5776e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Action: 'create', calling method: .version_select at 0x7fda19a6dd30>, body: {"keypair": {"name": "tempest-keypair-208254070", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbOV/WW4d2K9+onDisx9mPIx4M0DE81guLzXL8Owf2LE3hkPPIHMuIxO4n/gr2oix7sDvHY5NTcOfDAIBR8JtqWpUdYKYsrFjtTZtYNDAjefEytZOPRSnZuiRvEkbOz7w=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:40.427592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a35babd8-0528-45b9-9cdb-54da93d5776e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Getting quotas for project daa8ad03685c4b59b3274fc6407c9eb7. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:14:40.433945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a35babd8-0528-45b9-9cdb-54da93d5776e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Getting quotas for user 917dab915f7d4303989abb47a33f47df and project daa8ad03685c4b59b3274fc6407c9eb7. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:14:40.520940 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a35babd8-0528-45b9-9cdb-54da93d5776e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.25 time: 0.134965 Oct 11 04:14:40.524120 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 564/1195] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 11 04:14:40 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 04:14:40.644846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-95fa6b53-a670-446c-9d78-dbdb8ab3691b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:40.648218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-95fa6b53-a670-446c-9d78-dbdb8ab3691b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:40.653653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6b53-a670-446c-9d78-dbdb8ab3691b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:40.654168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6b53-a670-446c-9d78-dbdb8ab3691b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:40.655392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6b53-a670-446c-9d78-dbdb8ab3691b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:40.656917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6b53-a670-446c-9d78-dbdb8ab3691b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:40.657568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6b53-a670-446c-9d78-dbdb8ab3691b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:40.658343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6b53-a670-446c-9d78-dbdb8ab3691b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:40.757478 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c9ad47b0-ab85-4ef0-933f-e38fede8971f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "POST /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391/action" status: 202 len: 0 microversion: 2.1 time: 0.665448 Oct 11 04:14:40.758120 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 632/1196] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:14:40 2022] POST /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391/action => generated 0 bytes in 667 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:14:40.780510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f89db4b9-2b55-4b91-be1f-7a30eac7f381 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:40.781220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f89db4b9-2b55-4b91-be1f-7a30eac7f381 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:40.811263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-95fa6b53-a670-446c-9d78-dbdb8ab3691b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:40.815705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89db4b9-2b55-4b91-be1f-7a30eac7f381 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:40.823591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89db4b9-2b55-4b91-be1f-7a30eac7f381 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:40.824231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89db4b9-2b55-4b91-be1f-7a30eac7f381 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:40.826880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89db4b9-2b55-4b91-be1f-7a30eac7f381 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:40.831508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89db4b9-2b55-4b91-be1f-7a30eac7f381 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:40.831508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89db4b9-2b55-4b91-be1f-7a30eac7f381 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:40.849803 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-95fa6b53-a670-446c-9d78-dbdb8ab3691b tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.209965 Oct 11 04:14:40.851716 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 565/1197] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:40 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:41.102938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:41.105354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:41.116819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:41.117639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:41.117823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:41.118863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:41.119268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:41.119670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:41.189226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:41.189739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:41.190290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:41.191950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lazy-loading 'fault' on Instance uuid f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:41.341456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5d740955dee145f4a79d6cd37d209ed4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d36689c546841b191c6ae98991c8f4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:41.360551 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ad7bc11-9f25-4c4c-8142-29f2b63ad585 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 200 len: 1312 microversion: 2.1 time: 0.261427 Oct 11 04:14:41.366289 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 566/1198] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:41 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 1312 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:41.409506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bdcdf24-9dff-4ea2-84bd-d4d820b21c36 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:41.409506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0bdcdf24-9dff-4ea2-84bd-d4d820b21c36 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:41.423106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bdcdf24-9dff-4ea2-84bd-d4d820b21c36 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:41.423106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bdcdf24-9dff-4ea2-84bd-d4d820b21c36 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:41.423106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bdcdf24-9dff-4ea2-84bd-d4d820b21c36 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:41.425814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bdcdf24-9dff-4ea2-84bd-d4d820b21c36 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:41.427943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bdcdf24-9dff-4ea2-84bd-d4d820b21c36 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:41.428403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bdcdf24-9dff-4ea2-84bd-d4d820b21c36 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:41.649443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f89db4b9-2b55-4b91-be1f-7a30eac7f381 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:41.661397 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f89db4b9-2b55-4b91-be1f-7a30eac7f381 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1469 microversion: 2.1 time: 0.898350 Oct 11 04:14:41.662491 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 633/1199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:40 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1469 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:41.699567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0bdcdf24-9dff-4ea2-84bd-d4d820b21c36 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:41.707443 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0bdcdf24-9dff-4ea2-84bd-d4d820b21c36 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.307223 Oct 11 04:14:41.710112 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 567/1200] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:41 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:41.877241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3313737d-1f09-4d09-96ea-bc9cf6e84f3f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:41.877862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3313737d-1f09-4d09-96ea-bc9cf6e84f3f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:41.896251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3313737d-1f09-4d09-96ea-bc9cf6e84f3f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:41.896755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3313737d-1f09-4d09-96ea-bc9cf6e84f3f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:41.897192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3313737d-1f09-4d09-96ea-bc9cf6e84f3f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:41.897903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3313737d-1f09-4d09-96ea-bc9cf6e84f3f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:41.898394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3313737d-1f09-4d09-96ea-bc9cf6e84f3f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:41.898893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3313737d-1f09-4d09-96ea-bc9cf6e84f3f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:42.063905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-3313737d-1f09-4d09-96ea-bc9cf6e84f3f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:42.085709 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3313737d-1f09-4d09-96ea-bc9cf6e84f3f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.212435 Oct 11 04:14:42.099425 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 634/1201] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:41 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:42.388595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:42.388595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] [instance: f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:42.402283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:42.403098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:42.403751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:42.404733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:42.405351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:42.406011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:42.423607 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] HTTP exception thrown: Instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e could not be found. Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Request method failure captured: Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e HTTP/1.1 Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO1hpO-3wY6VSEpJqZgshRbNjm2RDId2FdqK_lio9lX8JHPKz_cvBtTuhVTeAOiiWv9zjoQCikgRO1HRQPwDy-Q7RrAGUVSVee_y4c7bh8xUl3U0wf6cu4WLG1zDaZIGnI6AwZYP3pBESk-9t1A1VWDJi81AWDlheZThNRF4WAC8BEA Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 8d36689c546841b191c6ae98991c8f4a Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerRescueTestJSONUnderV235-352188206 Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d36689c546841b191c6ae98991c8f4a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d36689c546841b191c6ae98991c8f4a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d36689c546841b191c6ae98991c8f4a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d36689c546841b191c6ae98991c8f4a"}]}] Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerRescueTestJSONUnderV235-352188206 Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 8d36689c546841b191c6ae98991c8f4a Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerRescueTestJSONUnderV235-352188206 Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerRescueTestJSONUnderV235-352188206-project Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5d740955dee145f4a79d6cd37d209ed4 Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerRescueTestJSONUnderV235-352188206-project Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e could not be found. Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e'} Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e could not be found. Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e could not be found. Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:42.425581 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:42.429656 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:42.429656 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:42.429656 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:42.429656 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:42.429656 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:42.429656 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:42.429656 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e could not be found. Oct 11 04:14:42.429656 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:14:42.432086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] Returning 404 to user: Instance f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:42.433247 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8473557-261c-46fe-8e21-4725589a58d0 tempest-ServerRescueTestJSONUnderV235-352188206 tempest-ServerRescueTestJSONUnderV235-352188206-project] 10.222.0.26 "GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e" status: 404 len: 111 microversion: 2.1 time: 0.051391 Oct 11 04:14:42.437786 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 568/1202] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:42 2022] GET /compute/v2.1/servers/f5b38deb-2e44-4b3f-b689-dbd21ddfcb2e => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:42.687383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-50e84fdb-d610-4cc8-83d3-d00e2a6e540a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:42.688351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50e84fdb-d610-4cc8-83d3-d00e2a6e540a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:42.703191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50e84fdb-d610-4cc8-83d3-d00e2a6e540a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:42.706162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50e84fdb-d610-4cc8-83d3-d00e2a6e540a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:42.706859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50e84fdb-d610-4cc8-83d3-d00e2a6e540a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:42.709573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50e84fdb-d610-4cc8-83d3-d00e2a6e540a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:42.710944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50e84fdb-d610-4cc8-83d3-d00e2a6e540a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:42.712544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50e84fdb-d610-4cc8-83d3-d00e2a6e540a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:42.742469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a820aee4-ff97-451c-9386-0da43a4b0d78 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:42.743092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a820aee4-ff97-451c-9386-0da43a4b0d78 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:42.764938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a820aee4-ff97-451c-9386-0da43a4b0d78 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:42.765770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a820aee4-ff97-451c-9386-0da43a4b0d78 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:42.766527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a820aee4-ff97-451c-9386-0da43a4b0d78 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:42.767454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a820aee4-ff97-451c-9386-0da43a4b0d78 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:42.768097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a820aee4-ff97-451c-9386-0da43a4b0d78 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:42.768717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a820aee4-ff97-451c-9386-0da43a4b0d78 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:43.339509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a820aee4-ff97-451c-9386-0da43a4b0d78 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:43.359827 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a820aee4-ff97-451c-9386-0da43a4b0d78 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.621139 Oct 11 04:14:43.361119 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 569/1203] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:42 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:14:43.378272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a450200f-81ef-4aeb-b84c-50054561acd0 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:43.379669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a450200f-81ef-4aeb-b84c-50054561acd0 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:43.390493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a450200f-81ef-4aeb-b84c-50054561acd0 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:43.394275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a450200f-81ef-4aeb-b84c-50054561acd0 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:43.395630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a450200f-81ef-4aeb-b84c-50054561acd0 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:43.400199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a450200f-81ef-4aeb-b84c-50054561acd0 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:43.400973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a450200f-81ef-4aeb-b84c-50054561acd0 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:43.401678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a450200f-81ef-4aeb-b84c-50054561acd0 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:43.411988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-50e84fdb-d610-4cc8-83d3-d00e2a6e540a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:43.424931 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-50e84fdb-d610-4cc8-83d3-d00e2a6e540a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1469 microversion: 2.1 time: 0.743184 Oct 11 04:14:43.429200 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 635/1204] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:42 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1469 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:43.544566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-a450200f-81ef-4aeb-b84c-50054561acd0 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:43.596330 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a450200f-81ef-4aeb-b84c-50054561acd0 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.232154 Oct 11 04:14:43.597651 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 570/1205] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:43 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:43.624731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4031b4eb-d32b-403c-a012-96bf69014c4e req-af54f2b5-ee3d-4baf-8b72-f8dd9a7ecee0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c533c21c-f66a-4a0e-b991-01c4a087f391", "name": "network-vif-plugged", "status": "completed", "tag": "986bccea-82d2-48c0-8f10-29fc77413e59"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:43.635946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4031b4eb-d32b-403c-a012-96bf69014c4e req-af54f2b5-ee3d-4baf-8b72-f8dd9a7ecee0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:43.635946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4031b4eb-d32b-403c-a012-96bf69014c4e req-af54f2b5-ee3d-4baf-8b72-f8dd9a7ecee0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:43.635946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4031b4eb-d32b-403c-a012-96bf69014c4e req-af54f2b5-ee3d-4baf-8b72-f8dd9a7ecee0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:43.648230 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4031b4eb-d32b-403c-a012-96bf69014c4e req-af54f2b5-ee3d-4baf-8b72-f8dd9a7ecee0 service nova] Creating event network-vif-plugged:986bccea-82d2-48c0-8f10-29fc77413e59 for instance c533c21c-f66a-4a0e-b991-01c4a087f391 on n-h1-860892-1 Oct 11 04:14:43.654532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-4031b4eb-d32b-403c-a012-96bf69014c4e req-af54f2b5-ee3d-4baf-8b72-f8dd9a7ecee0 service nova] Instance c533c21c-f66a-4a0e-b991-01c4a087f391 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:14:43.667680 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4031b4eb-d32b-403c-a012-96bf69014c4e req-af54f2b5-ee3d-4baf-8b72-f8dd9a7ecee0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046720 Oct 11 04:14:43.668891 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 636/1206] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:44.394437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7bc05497-2036-4dc8-9ee5-8e5ff15669ec tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:44.398343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7bc05497-2036-4dc8-9ee5-8e5ff15669ec tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:44.409101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc05497-2036-4dc8-9ee5-8e5ff15669ec tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:44.410141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc05497-2036-4dc8-9ee5-8e5ff15669ec tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:44.411454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc05497-2036-4dc8-9ee5-8e5ff15669ec tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:44.412421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc05497-2036-4dc8-9ee5-8e5ff15669ec tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:44.413067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc05497-2036-4dc8-9ee5-8e5ff15669ec tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:44.429386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc05497-2036-4dc8-9ee5-8e5ff15669ec tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:44.455459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0bb3fe49-abdd-4ed3-bf51-e0ba39b31c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:44.458215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0bb3fe49-abdd-4ed3-bf51-e0ba39b31c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:44.472909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bb3fe49-abdd-4ed3-bf51-e0ba39b31c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:44.473997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bb3fe49-abdd-4ed3-bf51-e0ba39b31c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:44.474779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bb3fe49-abdd-4ed3-bf51-e0ba39b31c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:44.475762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bb3fe49-abdd-4ed3-bf51-e0ba39b31c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:44.482408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bb3fe49-abdd-4ed3-bf51-e0ba39b31c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:44.483261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bb3fe49-abdd-4ed3-bf51-e0ba39b31c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:44.648664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7bc05497-2036-4dc8-9ee5-8e5ff15669ec tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:44.657398 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7bc05497-2036-4dc8-9ee5-8e5ff15669ec tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.271675 Oct 11 04:14:44.658580 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 571/1207] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:44 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:44.664388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-1169085462", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "89a2a2aa-9a7e-4acc-b86b-af482eea703c"}], "security_groups": [{"name": "tempest-securitygroup--1322316678"}], "key_name": "tempest-keypair-208254070", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:44.780395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] validate_networks() for [('89a2a2aa-9a7e-4acc-b86b-af482eea703c', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:14:45.119038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0bb3fe49-abdd-4ed3-bf51-e0ba39b31c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:45.132177 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0bb3fe49-abdd-4ed3-bf51-e0ba39b31c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1469 microversion: 2.1 time: 0.681062 Oct 11 04:14:45.133659 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 637/1208] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:44 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1469 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:45.152595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6173b904-e95b-408f-91a7-c3d007082611 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:45.153577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6173b904-e95b-408f-91a7-c3d007082611 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:45.173513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6173b904-e95b-408f-91a7-c3d007082611 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:45.174347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6173b904-e95b-408f-91a7-c3d007082611 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:45.175790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6173b904-e95b-408f-91a7-c3d007082611 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:45.176833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6173b904-e95b-408f-91a7-c3d007082611 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:45.177471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6173b904-e95b-408f-91a7-c3d007082611 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:45.178060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6173b904-e95b-408f-91a7-c3d007082611 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:45.296120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:14:45.297898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:14:45.298659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:14:45.299299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:14:45.301541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:14:45.323248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:45.324176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:45.324872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:45.325819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:45.326643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:45.327401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:45.370726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-6173b904-e95b-408f-91a7-c3d007082611 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:45.384163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Getting quotas for project daa8ad03685c4b59b3274fc6407c9eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:14:45.396706 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6173b904-e95b-408f-91a7-c3d007082611 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.261226 Oct 11 04:14:45.397783 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 638/1209] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:45 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:45.425712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Getting quotas for user 917dab915f7d4303989abb47a33f47df and project daa8ad03685c4b59b3274fc6407c9eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:14:45.470227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:14:45.474434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:14:45.682363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-05863ace-546a-441d-8b97-1890e8306e93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:45.684820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-05863ace-546a-441d-8b97-1890e8306e93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:45.692297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05863ace-546a-441d-8b97-1890e8306e93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:45.693082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05863ace-546a-441d-8b97-1890e8306e93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:45.693750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05863ace-546a-441d-8b97-1890e8306e93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:45.694672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05863ace-546a-441d-8b97-1890e8306e93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:45.695955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05863ace-546a-441d-8b97-1890e8306e93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:45.696572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05863ace-546a-441d-8b97-1890e8306e93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:45.790067 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-035b211c-6c49-4de0-9116-620bdce26948 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.25 time: 1.129467 Oct 11 04:14:45.791400 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 572/1210] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:14:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 1132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:14:45.837134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75a638bc-1f81-4405-84c0-f691bf141ac0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:45.837134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-75a638bc-1f81-4405-84c0-f691bf141ac0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:46.018783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75a638bc-1f81-4405-84c0-f691bf141ac0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:46.039761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75a638bc-1f81-4405-84c0-f691bf141ac0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:46.040488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75a638bc-1f81-4405-84c0-f691bf141ac0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:46.041823 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-75a638bc-1f81-4405-84c0-f691bf141ac0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1285 microversion: 2.25 time: 0.242526 Oct 11 04:14:46.068152 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 573/1211] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:45 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1285 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:46.156975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cccf69f6-b0e4-45b8-8772-aac80af11059 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:46.159141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cccf69f6-b0e4-45b8-8772-aac80af11059 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:46.181732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cccf69f6-b0e4-45b8-8772-aac80af11059 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:46.182260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cccf69f6-b0e4-45b8-8772-aac80af11059 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:46.182705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cccf69f6-b0e4-45b8-8772-aac80af11059 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:46.183467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cccf69f6-b0e4-45b8-8772-aac80af11059 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:46.183957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cccf69f6-b0e4-45b8-8772-aac80af11059 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:46.184382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cccf69f6-b0e4-45b8-8772-aac80af11059 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:46.265236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=16 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:46.672142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cccf69f6-b0e4-45b8-8772-aac80af11059 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:46.685465 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cccf69f6-b0e4-45b8-8772-aac80af11059 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1535 microversion: 2.1 time: 0.532390 Oct 11 04:14:46.698244 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 574/1212] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:46 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1535 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:46.702288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f02b8f00-3395-4f52-bbd2-a5ca10873095 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:46.703207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f02b8f00-3395-4f52-bbd2-a5ca10873095 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:46.713454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f02b8f00-3395-4f52-bbd2-a5ca10873095 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:46.713938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f02b8f00-3395-4f52-bbd2-a5ca10873095 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:46.714416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f02b8f00-3395-4f52-bbd2-a5ca10873095 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:46.715121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f02b8f00-3395-4f52-bbd2-a5ca10873095 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:46.715569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f02b8f00-3395-4f52-bbd2-a5ca10873095 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:46.715991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f02b8f00-3395-4f52-bbd2-a5ca10873095 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:46.762982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-05863ace-546a-441d-8b97-1890e8306e93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:46.777138 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-05863ace-546a-441d-8b97-1890e8306e93 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 1.099213 Oct 11 04:14:46.789241 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 639/1213] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:45 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:46.898823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-f02b8f00-3395-4f52-bbd2-a5ca10873095 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:46.928859 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f02b8f00-3395-4f52-bbd2-a5ca10873095 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.241185 Oct 11 04:14:46.930035 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 575/1214] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:46 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:47.072206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bf925eca-8683-4d25-8cbd-ba403f3c43c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:47.079189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bf925eca-8683-4d25-8cbd-ba403f3c43c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:47.253703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf925eca-8683-4d25-8cbd-ba403f3c43c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:47.291187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf925eca-8683-4d25-8cbd-ba403f3c43c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:47.293903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf925eca-8683-4d25-8cbd-ba403f3c43c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:47.305376 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bf925eca-8683-4d25-8cbd-ba403f3c43c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1285 microversion: 2.25 time: 0.234977 Oct 11 04:14:47.307300 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 640/1215] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:47 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1285 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:47.711644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f483fa87-daa7-4e45-975f-1007802f39bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:47.713417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f483fa87-daa7-4e45-975f-1007802f39bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:47.731883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f483fa87-daa7-4e45-975f-1007802f39bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:47.732531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f483fa87-daa7-4e45-975f-1007802f39bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:47.738165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f483fa87-daa7-4e45-975f-1007802f39bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:47.739721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f483fa87-daa7-4e45-975f-1007802f39bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:47.740219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f483fa87-daa7-4e45-975f-1007802f39bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:47.740665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f483fa87-daa7-4e45-975f-1007802f39bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:47.814124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e351c82-0e99-4d8e-bac1-373580e20e29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:47.815149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e351c82-0e99-4d8e-bac1-373580e20e29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:47.826216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e351c82-0e99-4d8e-bac1-373580e20e29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:47.828481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e351c82-0e99-4d8e-bac1-373580e20e29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:47.844001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e351c82-0e99-4d8e-bac1-373580e20e29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:47.845796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e351c82-0e99-4d8e-bac1-373580e20e29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:47.849928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e351c82-0e99-4d8e-bac1-373580e20e29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:47.850522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e351c82-0e99-4d8e-bac1-373580e20e29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:48.178969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f483fa87-daa7-4e45-975f-1007802f39bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:48.188806 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f483fa87-daa7-4e45-975f-1007802f39bc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1535 microversion: 2.1 time: 0.481699 Oct 11 04:14:48.189468 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 576/1216] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:47 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1535 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:48.206988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-50462c17-7fc2-461d-83f7-1a6672e09957 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:48.208848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-50462c17-7fc2-461d-83f7-1a6672e09957 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:48.215710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50462c17-7fc2-461d-83f7-1a6672e09957 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:48.216966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50462c17-7fc2-461d-83f7-1a6672e09957 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:48.217477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50462c17-7fc2-461d-83f7-1a6672e09957 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:48.218427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50462c17-7fc2-461d-83f7-1a6672e09957 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:48.218962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50462c17-7fc2-461d-83f7-1a6672e09957 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:48.219493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50462c17-7fc2-461d-83f7-1a6672e09957 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:48.292638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e351c82-0e99-4d8e-bac1-373580e20e29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:48.303551 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e351c82-0e99-4d8e-bac1-373580e20e29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.494130 Oct 11 04:14:48.309904 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 641/1217] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:47 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:48.310422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5ea007bc-d4e1-4284-9cf3-1404d56c891c req-c5bffe50-efc9-43c3-95ca-c7d80dde488f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c533c21c-f66a-4a0e-b991-01c4a087f391", "name": "network-vif-unplugged", "status": "completed", "tag": "986bccea-82d2-48c0-8f10-29fc77413e59"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:48.330019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5ea007bc-d4e1-4284-9cf3-1404d56c891c req-c5bffe50-efc9-43c3-95ca-c7d80dde488f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:48.330635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5ea007bc-d4e1-4284-9cf3-1404d56c891c req-c5bffe50-efc9-43c3-95ca-c7d80dde488f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:48.331137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5ea007bc-d4e1-4284-9cf3-1404d56c891c req-c5bffe50-efc9-43c3-95ca-c7d80dde488f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:48.346475 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5ea007bc-d4e1-4284-9cf3-1404d56c891c req-c5bffe50-efc9-43c3-95ca-c7d80dde488f service nova] Creating event network-vif-unplugged:986bccea-82d2-48c0-8f10-29fc77413e59 for instance c533c21c-f66a-4a0e-b991-01c4a087f391 on n-h2-860892-1 Oct 11 04:14:48.354963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-5ea007bc-d4e1-4284-9cf3-1404d56c891c req-c5bffe50-efc9-43c3-95ca-c7d80dde488f service nova] Instance c533c21c-f66a-4a0e-b991-01c4a087f391 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:14:48.369080 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5ea007bc-d4e1-4284-9cf3-1404d56c891c req-c5bffe50-efc9-43c3-95ca-c7d80dde488f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063025 Oct 11 04:14:48.369706 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 642/1218] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:48.375528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:48.376218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:48.384274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:48.385043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:48.385477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:48.386786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:48.387418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:48.391057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:48.532654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:48.541704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:48.543332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:48.544512 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d0161656-31bb-4b77-b803-879bd84e0b07 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1337 microversion: 2.25 time: 0.173496 Oct 11 04:14:48.545725 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 643/1219] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:48 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1337 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:48.690445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-50462c17-7fc2-461d-83f7-1a6672e09957 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:48.716802 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-50462c17-7fc2-461d-83f7-1a6672e09957 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.526111 Oct 11 04:14:48.718630 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 577/1220] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:48 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:49.217697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ef68032-13ab-441e-a10e-1f5491e4a831 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:49.220014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3ef68032-13ab-441e-a10e-1f5491e4a831 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:49.232186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ef68032-13ab-441e-a10e-1f5491e4a831 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:49.232683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ef68032-13ab-441e-a10e-1f5491e4a831 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:49.237210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ef68032-13ab-441e-a10e-1f5491e4a831 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:49.238803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ef68032-13ab-441e-a10e-1f5491e4a831 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:49.241092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ef68032-13ab-441e-a10e-1f5491e4a831 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:49.242738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ef68032-13ab-441e-a10e-1f5491e4a831 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:49.290810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:49.329290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6abc2f52-2796-4050-afe3-a00e6fd0159c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:49.329908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6abc2f52-2796-4050-afe3-a00e6fd0159c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:49.356258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6abc2f52-2796-4050-afe3-a00e6fd0159c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:49.362401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6abc2f52-2796-4050-afe3-a00e6fd0159c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:49.363981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6abc2f52-2796-4050-afe3-a00e6fd0159c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:49.373123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6abc2f52-2796-4050-afe3-a00e6fd0159c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:49.373934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6abc2f52-2796-4050-afe3-a00e6fd0159c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:49.378285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6abc2f52-2796-4050-afe3-a00e6fd0159c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:49.747312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3ef68032-13ab-441e-a10e-1f5491e4a831 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:49.764904 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3ef68032-13ab-441e-a10e-1f5491e4a831 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1535 microversion: 2.1 time: 0.550967 Oct 11 04:14:49.766507 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 644/1221] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:49 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1535 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:49.779398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:49.780341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:49.794394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:49.795180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:49.795800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:49.796852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:49.797463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:49.798048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:49.975446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:49.995338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:49.996961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:49.999299 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-169027dd-92eb-449e-bb68-2cd12185610a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1343 microversion: 2.25 time: 0.230362 Oct 11 04:14:50.000082 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 645/1222] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:49 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1343 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:50.006288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3f22414e-6476-4da3-b80e-c0fd62037b92 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:50.007714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3f22414e-6476-4da3-b80e-c0fd62037b92 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:50.014697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f22414e-6476-4da3-b80e-c0fd62037b92 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:50.015445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f22414e-6476-4da3-b80e-c0fd62037b92 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:50.016810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f22414e-6476-4da3-b80e-c0fd62037b92 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:50.017745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f22414e-6476-4da3-b80e-c0fd62037b92 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:50.018414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f22414e-6476-4da3-b80e-c0fd62037b92 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:50.019090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f22414e-6476-4da3-b80e-c0fd62037b92 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:50.034784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6abc2f52-2796-4050-afe3-a00e6fd0159c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:50.040696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:50.047860 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6abc2f52-2796-4050-afe3-a00e6fd0159c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.722199 Oct 11 04:14:50.049114 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 578/1223] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:49 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:50.147109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-3f22414e-6476-4da3-b80e-c0fd62037b92 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:50.218683 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3f22414e-6476-4da3-b80e-c0fd62037b92 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.217033 Oct 11 04:14:50.234234 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 646/1224] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:50 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:50.399498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-481c0d9a-16ce-426e-9e3f-03a9a3751b45 req-9849fc20-3ed1-456d-9b4d-079b21092c74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c533c21c-f66a-4a0e-b991-01c4a087f391", "tag": "986bccea-82d2-48c0-8f10-29fc77413e59"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:50.423769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-481c0d9a-16ce-426e-9e3f-03a9a3751b45 req-9849fc20-3ed1-456d-9b4d-079b21092c74 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:50.424261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-481c0d9a-16ce-426e-9e3f-03a9a3751b45 req-9849fc20-3ed1-456d-9b4d-079b21092c74 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:50.424817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-481c0d9a-16ce-426e-9e3f-03a9a3751b45 req-9849fc20-3ed1-456d-9b4d-079b21092c74 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:50.454421 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-481c0d9a-16ce-426e-9e3f-03a9a3751b45 req-9849fc20-3ed1-456d-9b4d-079b21092c74 service nova] Creating event network-changed:986bccea-82d2-48c0-8f10-29fc77413e59 for instance c533c21c-f66a-4a0e-b991-01c4a087f391 on n-h2-860892-1 Oct 11 04:14:50.464463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-481c0d9a-16ce-426e-9e3f-03a9a3751b45 req-9849fc20-3ed1-456d-9b4d-079b21092c74 service nova] Instance c533c21c-f66a-4a0e-b991-01c4a087f391 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:14:50.483759 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-481c0d9a-16ce-426e-9e3f-03a9a3751b45 req-9849fc20-3ed1-456d-9b4d-079b21092c74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091418 Oct 11 04:14:50.490524 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 579/1225] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:50.796078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-42e92a78-1f80-433f-ac22-c2b8a532df1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:50.797168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-42e92a78-1f80-433f-ac22-c2b8a532df1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:50.808682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:50.810980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42e92a78-1f80-433f-ac22-c2b8a532df1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:50.819747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42e92a78-1f80-433f-ac22-c2b8a532df1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:50.820619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42e92a78-1f80-433f-ac22-c2b8a532df1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:50.822345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42e92a78-1f80-433f-ac22-c2b8a532df1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:50.829515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42e92a78-1f80-433f-ac22-c2b8a532df1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:50.830675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42e92a78-1f80-433f-ac22-c2b8a532df1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:51.036994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:51.038345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:51.052863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:51.053672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:51.057233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:51.058290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:51.058925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:51.059518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:51.288267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-42e92a78-1f80-433f-ac22-c2b8a532df1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:51.312199 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-42e92a78-1f80-433f-ac22-c2b8a532df1f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1535 microversion: 2.1 time: 0.521109 Oct 11 04:14:51.313154 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 647/1226] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:50 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1535 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:51.331252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33feecab-9ad6-48ca-8d44-bbd12c30c1ad tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:51.334831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-33feecab-9ad6-48ca-8d44-bbd12c30c1ad tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:51.344636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33feecab-9ad6-48ca-8d44-bbd12c30c1ad tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:51.344636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33feecab-9ad6-48ca-8d44-bbd12c30c1ad tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:51.344636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33feecab-9ad6-48ca-8d44-bbd12c30c1ad tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:51.344636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33feecab-9ad6-48ca-8d44-bbd12c30c1ad tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:51.344636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33feecab-9ad6-48ca-8d44-bbd12c30c1ad tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:51.344636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33feecab-9ad6-48ca-8d44-bbd12c30c1ad tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:51.652101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:51.666851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:51.680722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:51.682082 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-62e5be6a-3aa0-4f61-9e61-b63dc8d5f07c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1343 microversion: 2.25 time: 0.653983 Oct 11 04:14:51.682998 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 580/1227] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:51 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1343 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:51.693980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c799ac7-e500-4978-a3d2-53e412d3448e tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:51.693980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c799ac7-e500-4978-a3d2-53e412d3448e tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:51.699564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c799ac7-e500-4978-a3d2-53e412d3448e tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:51.700702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c799ac7-e500-4978-a3d2-53e412d3448e tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:51.701298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c799ac7-e500-4978-a3d2-53e412d3448e tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:51.702167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c799ac7-e500-4978-a3d2-53e412d3448e tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:51.702864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c799ac7-e500-4978-a3d2-53e412d3448e tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:51.704327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c799ac7-e500-4978-a3d2-53e412d3448e tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:51.725200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-33feecab-9ad6-48ca-8d44-bbd12c30c1ad tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:51.743783 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-33feecab-9ad6-48ca-8d44-bbd12c30c1ad tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.429570 Oct 11 04:14:51.746917 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 648/1228] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:51 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:51.926596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-8c799ac7-e500-4978-a3d2-53e412d3448e tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:51.965117 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8c799ac7-e500-4978-a3d2-53e412d3448e tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1927 microversion: 2.75 time: 0.280880 Oct 11 04:14:51.966802 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 581/1229] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:51 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1927 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:52.338940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d1e6331-97e7-4f02-9c09-a76498f1395d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:52.340321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d1e6331-97e7-4f02-9c09-a76498f1395d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:52.355072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1e6331-97e7-4f02-9c09-a76498f1395d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:52.355835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1e6331-97e7-4f02-9c09-a76498f1395d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:52.358308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1e6331-97e7-4f02-9c09-a76498f1395d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:52.363893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1e6331-97e7-4f02-9c09-a76498f1395d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:52.363893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1e6331-97e7-4f02-9c09-a76498f1395d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:52.363893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d1e6331-97e7-4f02-9c09-a76498f1395d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:52.715902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:52.717136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:52.728828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:52.729653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:52.730375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:52.731315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:52.732246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:52.732941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:53.074123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d1e6331-97e7-4f02-9c09-a76498f1395d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:53.097631 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d1e6331-97e7-4f02-9c09-a76498f1395d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1535 microversion: 2.1 time: 0.763515 Oct 11 04:14:53.100331 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 649/1230] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:52 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1535 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:53.114898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b537da81-9ca1-4eef-b2a7-e65fd34dfe29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:53.116505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b537da81-9ca1-4eef-b2a7-e65fd34dfe29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:53.132636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b537da81-9ca1-4eef-b2a7-e65fd34dfe29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:53.134217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b537da81-9ca1-4eef-b2a7-e65fd34dfe29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:53.135078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b537da81-9ca1-4eef-b2a7-e65fd34dfe29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:53.141714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b537da81-9ca1-4eef-b2a7-e65fd34dfe29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:53.141714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b537da81-9ca1-4eef-b2a7-e65fd34dfe29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:53.141714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b537da81-9ca1-4eef-b2a7-e65fd34dfe29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:53.216556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:53.229688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:53.232933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:53.232933 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b517308-dfa4-4f4d-a0bd-7aa60e425a2b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1411 microversion: 2.25 time: 0.520566 Oct 11 04:14:53.233540 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 582/1231] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:52 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1411 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:53.255733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f03f459-67a3-465e-87dc-33b5080ec962 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:53.256734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f03f459-67a3-465e-87dc-33b5080ec962 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:53.263881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f03f459-67a3-465e-87dc-33b5080ec962 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:53.264359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f03f459-67a3-465e-87dc-33b5080ec962 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:53.265000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f03f459-67a3-465e-87dc-33b5080ec962 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:53.267284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f03f459-67a3-465e-87dc-33b5080ec962 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:53.267284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f03f459-67a3-465e-87dc-33b5080ec962 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:53.267284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f03f459-67a3-465e-87dc-33b5080ec962 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:53.421584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-0f03f459-67a3-465e-87dc-33b5080ec962 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:53.535298 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f03f459-67a3-465e-87dc-33b5080ec962 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1933 microversion: 2.75 time: 0.289529 Oct 11 04:14:53.536153 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 583/1232] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:53 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1933 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:53.653143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b537da81-9ca1-4eef-b2a7-e65fd34dfe29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:53.676304 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b537da81-9ca1-4eef-b2a7-e65fd34dfe29 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.567676 Oct 11 04:14:53.699866 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 650/1233] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:53 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:54.124995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92602d2e-5339-4851-b180-bb6418092a4d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:54.125624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-92602d2e-5339-4851-b180-bb6418092a4d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:54.145967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92602d2e-5339-4851-b180-bb6418092a4d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:54.146903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92602d2e-5339-4851-b180-bb6418092a4d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:54.147557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92602d2e-5339-4851-b180-bb6418092a4d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:54.148475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92602d2e-5339-4851-b180-bb6418092a4d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:54.149200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92602d2e-5339-4851-b180-bb6418092a4d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:54.149815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92602d2e-5339-4851-b180-bb6418092a4d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:54.262003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:54.262902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:54.266608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=6,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:54.275757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:54.276276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:54.276724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:54.279620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:54.280363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:54.280803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:54.589202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:54.606317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92602d2e-5339-4851-b180-bb6418092a4d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:54.618501 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92602d2e-5339-4851-b180-bb6418092a4d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1528 microversion: 2.1 time: 0.497413 Oct 11 04:14:54.625970 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 584/1234] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:54 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1528 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:54.627747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:54.633977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:54.637212 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-53cb46de-f819-4e48-9cf4-b20e44d1ea14 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1411 microversion: 2.25 time: 0.379097 Oct 11 04:14:54.640809 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 651/1235] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:54 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1411 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:54.642021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6a38e663-1112-47ea-b719-70bef41b4a0f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:54.643258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6a38e663-1112-47ea-b719-70bef41b4a0f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:54.656298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-18945d25-55f9-45ca-bd26-c2e237c0cbe5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:54.657593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a38e663-1112-47ea-b719-70bef41b4a0f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:54.658442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-18945d25-55f9-45ca-bd26-c2e237c0cbe5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:54.660676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a38e663-1112-47ea-b719-70bef41b4a0f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:54.661383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a38e663-1112-47ea-b719-70bef41b4a0f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:54.663256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a38e663-1112-47ea-b719-70bef41b4a0f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:54.663727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a38e663-1112-47ea-b719-70bef41b4a0f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:54.667213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a38e663-1112-47ea-b719-70bef41b4a0f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:54.667971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18945d25-55f9-45ca-bd26-c2e237c0cbe5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:54.668702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18945d25-55f9-45ca-bd26-c2e237c0cbe5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:54.669339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18945d25-55f9-45ca-bd26-c2e237c0cbe5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:54.670649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18945d25-55f9-45ca-bd26-c2e237c0cbe5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:54.671420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18945d25-55f9-45ca-bd26-c2e237c0cbe5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:54.673255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18945d25-55f9-45ca-bd26-c2e237c0cbe5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:54.826595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-6a38e663-1112-47ea-b719-70bef41b4a0f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:54.860441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:54.867282 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6a38e663-1112-47ea-b719-70bef41b4a0f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1933 microversion: 2.75 time: 0.238184 Oct 11 04:14:54.872744 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 585/1236] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:54 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1933 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:54.883571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-271aaaee-ead5-48f5-9873-894f347275f7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:54.884471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-271aaaee-ead5-48f5-9873-894f347275f7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:54.898687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-271aaaee-ead5-48f5-9873-894f347275f7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:54.899501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-271aaaee-ead5-48f5-9873-894f347275f7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:54.900288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-271aaaee-ead5-48f5-9873-894f347275f7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:54.901246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-271aaaee-ead5-48f5-9873-894f347275f7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:54.901865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-271aaaee-ead5-48f5-9873-894f347275f7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:54.902473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-271aaaee-ead5-48f5-9873-894f347275f7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:55.116750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-18945d25-55f9-45ca-bd26-c2e237c0cbe5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:55.134777 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-18945d25-55f9-45ca-bd26-c2e237c0cbe5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1528 microversion: 2.1 time: 0.483174 Oct 11 04:14:55.139403 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 652/1237] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:54 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1528 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:55.163382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0088f959-5948-4f7e-b953-3fdddf57501c tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:55.177683 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-0088f959-5948-4f7e-b953-3fdddf57501c tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] HTTP exception thrown: Flavor fe2a745e-1776-4dd3-81a0-0a7f24d36592 could not be found. Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0088f959-5948-4f7e-b953-3fdddf57501c tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Request method failure captured: Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/flavors/fe2a745e-1776-4dd3-81a0-0a7f24d36592 HTTP/1.1 Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzYbhswUSdnHwfnaSUxwyjrKMyJYmwfSTc6ITL5jYGSfcmXuP16W8lqJdc-1iv0ZOJlbTRJibNrFFa2ztHeOZENVghuu7GQePrra5mgIL1TPzv9Obiv8Qtylrx4dGEqxvxXqqByvO6Dc4pfmQjDREC5HGSpW95joc_TF6kos9BBk1M Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: acfdccb0c6a84bbf8dd51c4d8b2cf590 Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-MigrationsAdminTest-1148131893 Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/acfdccb0c6a84bbf8dd51c4d8b2cf590"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_acfdccb0c6a84bbf8dd51c4d8b2cf590"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/acfdccb0c6a84bbf8dd51c4d8b2cf590"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/acfdccb0c6a84bbf8dd51c4d8b2cf590"}]}] Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-MigrationsAdminTest-1148131893 Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: acfdccb0c6a84bbf8dd51c4d8b2cf590 Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-MigrationsAdminTest-1148131893 Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-MigrationsAdminTest-1148131893-project-admin Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 4733b24a80eb4fe7ae779f43b0c83f3f Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-MigrationsAdminTest-1148131893-project-admin Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: exception: Flavor fe2a745e-1776-4dd3-81a0-0a7f24d36592 could not be found. Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'fe2a745e-1776-4dd3-81a0-0a7f24d36592'} Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 43, in _delete Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi flavor.destroy() Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 558, in destroy Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_flavor = self._flavor_destroy(self._context, Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 544, in _flavor_destroy Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return _flavor_destroy(context, flavor_id=flavor_id, flavorid=flavorid) Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 185, in _flavor_destroy Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=(flavor_id or flavorid)) Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor fe2a745e-1776-4dd3-81a0-0a7f24d36592 could not be found. Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_manage.py", line 45, in _delete Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor fe2a745e-1776-4dd3-81a0-0a7f24d36592 could not be found. Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:55.196899 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:14:55.203178 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:55.203178 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:14:55.203178 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:14:55.203178 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:14:55.203178 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:14:55.203178 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:14:55.203178 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor fe2a745e-1776-4dd3-81a0-0a7f24d36592 could not be found. Oct 11 04:14:55.203178 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:14:55.206120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0088f959-5948-4f7e-b953-3fdddf57501c tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Returning 404 to user: Flavor fe2a745e-1776-4dd3-81a0-0a7f24d36592 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:14:55.208159 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0088f959-5948-4f7e-b953-3fdddf57501c tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/fe2a745e-1776-4dd3-81a0-0a7f24d36592" status: 404 len: 109 microversion: 2.1 time: 0.050364 Oct 11 04:14:55.209834 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 653/1238] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:14:55 2022] DELETE /compute/v2.1/flavors/fe2a745e-1776-4dd3-81a0-0a7f24d36592 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:14:55.299180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-271aaaee-ead5-48f5-9873-894f347275f7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:55.320836 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-271aaaee-ead5-48f5-9873-894f347275f7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.441976 Oct 11 04:14:55.320836 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 586/1239] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:54 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:55.377703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-680eca9f-51ab-46e9-b427-4b6396a23e31 req-f241c52c-17e7-40e0-8418-809ffc282bf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4133104-80ff-4629-bf97-1d0c7441fbfd", "tag": "a2a973b4-1299-427e-947a-59fb8153c4c0"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:55.420112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MigrationsAdminTest-server-2046865095", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:55.436920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-680eca9f-51ab-46e9-b427-4b6396a23e31 req-f241c52c-17e7-40e0-8418-809ffc282bf4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:55.443075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-680eca9f-51ab-46e9-b427-4b6396a23e31 req-f241c52c-17e7-40e0-8418-809ffc282bf4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:55.446168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-680eca9f-51ab-46e9-b427-4b6396a23e31 req-f241c52c-17e7-40e0-8418-809ffc282bf4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:55.496337 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-680eca9f-51ab-46e9-b427-4b6396a23e31 req-f241c52c-17e7-40e0-8418-809ffc282bf4 service nova] Creating event network-changed:a2a973b4-1299-427e-947a-59fb8153c4c0 for instance f4133104-80ff-4629-bf97-1d0c7441fbfd on n-h2-860892-1 Oct 11 04:14:55.497232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:55.531508 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-680eca9f-51ab-46e9-b427-4b6396a23e31 req-f241c52c-17e7-40e0-8418-809ffc282bf4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153721 Oct 11 04:14:55.533529 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 654/1240] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:55.553388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:14:55.969091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7a38abf7-8365-41b7-ab03-64f334d66b70 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Action: 'create', calling method: .version_select at 0x7fda1a50ef70>, body: {"keypair": {"name": "tempest-keypair-1804752598", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGv+Cv08XQ/6le4+y2NEHpjXvB0vQ9VKFMX5hCq/o9UWFdMqhW6503u+oyourTb3eSdM2fNQLQyYFOokftXk5ycopacgwXkI0N4Fl0QCPdmmtVps4iI/FX6ixleJJBEblA=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:56.029700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=16 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:56.046212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-7a38abf7-8365-41b7-ab03-64f334d66b70 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Getting quotas for project 7dcd9cbd3fbe4c24add13c912979deb7. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:14:56.066495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-7a38abf7-8365-41b7-ab03-64f334d66b70 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Getting quotas for user 12aa2047c1ec47f6b6594e9109f8ec6c and project 7dcd9cbd3fbe4c24add13c912979deb7. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:14:56.217844 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7a38abf7-8365-41b7-ab03-64f334d66b70 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.578120 Oct 11 04:14:56.219143 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 655/1241] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:14:55 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:56.229643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:56.230684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:56.250995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:56.251504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:56.252146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:56.252881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:56.253324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:56.255963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:56.499972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:56.523125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:56.530227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:56.531421 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-51abde27-92f9-4a24-b8fb-d087567bd499 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1411 microversion: 2.25 time: 0.311123 Oct 11 04:14:56.532011 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 656/1242] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:56 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1411 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:56.568085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b18c1c2e-b55f-45b5-bc53-33dc1078c24f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:56.569257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b18c1c2e-b55f-45b5-bc53-33dc1078c24f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:56.588667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b18c1c2e-b55f-45b5-bc53-33dc1078c24f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:56.590709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b18c1c2e-b55f-45b5-bc53-33dc1078c24f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:56.592675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b18c1c2e-b55f-45b5-bc53-33dc1078c24f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:56.595383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b18c1c2e-b55f-45b5-bc53-33dc1078c24f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:56.596036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b18c1c2e-b55f-45b5-bc53-33dc1078c24f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:56.598400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b18c1c2e-b55f-45b5-bc53-33dc1078c24f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:56.786356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-b18c1c2e-b55f-45b5-bc53-33dc1078c24f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:56.808307 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b18c1c2e-b55f-45b5-bc53-33dc1078c24f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1933 microversion: 2.75 time: 0.255834 Oct 11 04:14:56.808307 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 657/1243] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:56 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1933 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:56.813047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0f6a8ace-5bc1-4420-baf5-fa98bd10eaea tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:56.813654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0f6a8ace-5bc1-4420-baf5-fa98bd10eaea tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:56.821776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f6a8ace-5bc1-4420-baf5-fa98bd10eaea tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:56.822542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f6a8ace-5bc1-4420-baf5-fa98bd10eaea tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:56.823386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f6a8ace-5bc1-4420-baf5-fa98bd10eaea tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:56.824289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f6a8ace-5bc1-4420-baf5-fa98bd10eaea tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:56.824921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f6a8ace-5bc1-4420-baf5-fa98bd10eaea tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:56.825641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f6a8ace-5bc1-4420-baf5-fa98bd10eaea tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:57.022073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:14:57.022609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:14:57.022959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:14:57.023572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:14:57.024312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:14:57.047573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:57.048061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:57.048492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:57.049410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:57.049866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:57.050321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:57.076298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:14:57.082571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Getting quotas for user a1df373e8ec14e2a84f0b8a62e0b884a and project bcce9ce30d3a4a15985192c8e12c040c. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:14:57.100680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:14:57.104254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:14:57.157681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0f6a8ace-5bc1-4420-baf5-fa98bd10eaea tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:57.169209 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0f6a8ace-5bc1-4420-baf5-fa98bd10eaea tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.360455 Oct 11 04:14:57.171111 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 658/1244] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:56 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:57.177510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-aaacba92-44e5-4191-a697-c9a89b90150a req-7e901487-e716-4d76-a647-ca69394ebd9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c533c21c-f66a-4a0e-b991-01c4a087f391", "name": "network-vif-plugged", "status": "completed", "tag": "986bccea-82d2-48c0-8f10-29fc77413e59"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:57.211595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-aaacba92-44e5-4191-a697-c9a89b90150a req-7e901487-e716-4d76-a647-ca69394ebd9c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:57.212588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-aaacba92-44e5-4191-a697-c9a89b90150a req-7e901487-e716-4d76-a647-ca69394ebd9c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:57.213361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-aaacba92-44e5-4191-a697-c9a89b90150a req-7e901487-e716-4d76-a647-ca69394ebd9c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:57.234387 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-aaacba92-44e5-4191-a697-c9a89b90150a req-7e901487-e716-4d76-a647-ca69394ebd9c service nova] Creating event network-vif-plugged:986bccea-82d2-48c0-8f10-29fc77413e59 for instance c533c21c-f66a-4a0e-b991-01c4a087f391 on n-h2-860892-1 Oct 11 04:14:57.246065 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-aaacba92-44e5-4191-a697-c9a89b90150a req-7e901487-e716-4d76-a647-ca69394ebd9c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070729 Oct 11 04:14:57.248075 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 659/1245] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:14:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:14:57.274787 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-290da387-cb41-4380-a313-a044464f8829 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.868783 Oct 11 04:14:57.275690 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 587/1246] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:14:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:14:57.290517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65755c10-f2e6-49c5-b37f-5c38145a735f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:57.291377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-65755c10-f2e6-49c5-b37f-5c38145a735f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:57.354585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-65755c10-f2e6-49c5-b37f-5c38145a735f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:57.363359 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-65755c10-f2e6-49c5-b37f-5c38145a735f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1213 microversion: 2.1 time: 0.078825 Oct 11 04:14:57.367624 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 660/1247] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:57 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:57.560971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:57.562620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:57.593510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:57.594021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:57.598531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:57.603884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:57.607707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:57.612404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:57.848402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ffeda7f7-9a3f-4f28-90b5-95fb689ea56f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:57.848402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ffeda7f7-9a3f-4f28-90b5-95fb689ea56f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:57.854468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffeda7f7-9a3f-4f28-90b5-95fb689ea56f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:57.854967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffeda7f7-9a3f-4f28-90b5-95fb689ea56f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:57.855402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffeda7f7-9a3f-4f28-90b5-95fb689ea56f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:57.856202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffeda7f7-9a3f-4f28-90b5-95fb689ea56f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:57.857776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffeda7f7-9a3f-4f28-90b5-95fb689ea56f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:57.858104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffeda7f7-9a3f-4f28-90b5-95fb689ea56f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:57.922902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:57.950798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:57.956406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:57.959229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-ffeda7f7-9a3f-4f28-90b5-95fb689ea56f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:57.962087 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-56f3cf0f-93e5-42c3-b423-67f0ad76fe8d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1411 microversion: 2.25 time: 0.403768 Oct 11 04:14:57.982665 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 588/1248] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:57 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1411 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:58.028221 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ffeda7f7-9a3f-4f28-90b5-95fb689ea56f tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1933 microversion: 2.75 time: 0.190363 Oct 11 04:14:58.028828 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 661/1249] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:57 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1933 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:14:58.202062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9e785f7-ef02-4c6b-9ae1-916f74bb1229 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:58.202062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e9e785f7-ef02-4c6b-9ae1-916f74bb1229 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:58.207319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e785f7-ef02-4c6b-9ae1-916f74bb1229 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:58.214301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e785f7-ef02-4c6b-9ae1-916f74bb1229 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:58.215047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e785f7-ef02-4c6b-9ae1-916f74bb1229 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:58.216459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e785f7-ef02-4c6b-9ae1-916f74bb1229 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:58.222516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e785f7-ef02-4c6b-9ae1-916f74bb1229 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:58.224807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e785f7-ef02-4c6b-9ae1-916f74bb1229 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:58.514883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV257Test-server-1010164082", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": "none"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:14:58.620718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:14:58.621153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:14:58.621601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:14:58.621997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:14:58.622428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:14:58.632697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:58.633424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:58.633851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:58.634597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:58.635213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:58.635908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:58.661453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Getting quotas for project 3a7b9d81a2ec4e3dbdb852a11c48ea88. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:14:58.667798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Getting quotas for user 2107b58c410b4a538395fae441ae918f and project 3a7b9d81a2ec4e3dbdb852a11c48ea88. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:14:58.682892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:14:58.685686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:14:58.696425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9e785f7-ef02-4c6b-9ae1-916f74bb1229 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:58.713598 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9e785f7-ef02-4c6b-9ae1-916f74bb1229 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.519933 Oct 11 04:14:58.729739 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 589/1250] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:58 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:58.741881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb51c131-5747-4a51-81be-a41a59523063 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:58.742527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cb51c131-5747-4a51-81be-a41a59523063 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:58.749618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb51c131-5747-4a51-81be-a41a59523063 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:58.750452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb51c131-5747-4a51-81be-a41a59523063 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:58.751593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb51c131-5747-4a51-81be-a41a59523063 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:58.752500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb51c131-5747-4a51-81be-a41a59523063 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:58.753217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb51c131-5747-4a51-81be-a41a59523063 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:58.754411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb51c131-5747-4a51-81be-a41a59523063 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:58.870768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb51c131-5747-4a51-81be-a41a59523063 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:58.879831 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cb51c131-5747-4a51-81be-a41a59523063 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1217 microversion: 2.1 time: 0.148488 Oct 11 04:14:58.881296 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 590/1251] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:58 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1217 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:14:58.916876 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2204d6d0-cad1-472d-8db3-2073f661dbfc tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.57 time: 0.695201 Oct 11 04:14:58.925348 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 662/1252] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:14:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 709 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:14:58.931875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6e3efe2b-720f-4b20-a3c5-66f76a93d8bd tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:58.933026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6e3efe2b-720f-4b20-a3c5-66f76a93d8bd tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:58.993899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:58.994622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:59.004115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:59.008109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:59.008109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:59.008109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:59.008109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:59.008109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:59.182387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6e3efe2b-720f-4b20-a3c5-66f76a93d8bd tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:59.196669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6e3efe2b-720f-4b20-a3c5-66f76a93d8bd tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:59.200526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6e3efe2b-720f-4b20-a3c5-66f76a93d8bd tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:59.205542 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6e3efe2b-720f-4b20-a3c5-66f76a93d8bd tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1278 microversion: 2.57 time: 0.275971 Oct 11 04:14:59.210614 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 591/1253] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:58 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1278 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:59.226494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fe16da4e-f997-4afe-b30b-a6be2470c6b4 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:59.227114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fe16da4e-f997-4afe-b30b-a6be2470c6b4 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:59.239996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe16da4e-f997-4afe-b30b-a6be2470c6b4 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:59.240493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe16da4e-f997-4afe-b30b-a6be2470c6b4 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:59.241003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe16da4e-f997-4afe-b30b-a6be2470c6b4 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:59.250642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe16da4e-f997-4afe-b30b-a6be2470c6b4 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:59.262466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe16da4e-f997-4afe-b30b-a6be2470c6b4 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:59.262466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe16da4e-f997-4afe-b30b-a6be2470c6b4 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:59.290248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:59.311332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:59.314251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:14:59.315756 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eff56280-80a3-434a-9c2e-a68b641c35de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1411 microversion: 2.25 time: 0.326229 Oct 11 04:14:59.332988 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 663/1254] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:58 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1411 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:59.385073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-fe16da4e-f997-4afe-b30b-a6be2470c6b4 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] Lazy-loading 'services' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:14:59.427926 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fe16da4e-f997-4afe-b30b-a6be2470c6b4 tempest-ServersAdmin275Test-1322053436 tempest-ServersAdmin275Test-1322053436-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1918 microversion: 2.75 time: 0.216142 Oct 11 04:14:59.430887 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 592/1255] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:14:59 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1918 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:14:59.485260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dc83c8a2-8945-4de7-bfd6-b71583e7e642 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:59.485867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dc83c8a2-8945-4de7-bfd6-b71583e7e642 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:59.495267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc83c8a2-8945-4de7-bfd6-b71583e7e642 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:59.504295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc83c8a2-8945-4de7-bfd6-b71583e7e642 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:59.504848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc83c8a2-8945-4de7-bfd6-b71583e7e642 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:59.506224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc83c8a2-8945-4de7-bfd6-b71583e7e642 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:59.508136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc83c8a2-8945-4de7-bfd6-b71583e7e642 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:59.508568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc83c8a2-8945-4de7-bfd6-b71583e7e642 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:59.553789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dc83c8a2-8945-4de7-bfd6-b71583e7e642 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:14:59.574951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:14:59.742823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3621ee1a-7ed5-478f-9a88-9ab840b2f925 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:14:59.743430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3621ee1a-7ed5-478f-9a88-9ab840b2f925 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:14:59.751717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3621ee1a-7ed5-478f-9a88-9ab840b2f925 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:59.752718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3621ee1a-7ed5-478f-9a88-9ab840b2f925 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:59.753478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3621ee1a-7ed5-478f-9a88-9ab840b2f925 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:14:59.754340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3621ee1a-7ed5-478f-9a88-9ab840b2f925 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:14:59.755265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3621ee1a-7ed5-478f-9a88-9ab840b2f925 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:14:59.755927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3621ee1a-7ed5-478f-9a88-9ab840b2f925 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:00.091616 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dc83c8a2-8945-4de7-bfd6-b71583e7e642 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 204 len: 0 microversion: 2.75 time: 0.606137 Oct 11 04:15:00.091616 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 664/1256] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:14:59 2022] DELETE /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:15:00.103445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8b155a7-457c-4a8e-8425-503375725e06 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:00.104156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e8b155a7-457c-4a8e-8425-503375725e06 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:00.129781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8b155a7-457c-4a8e-8425-503375725e06 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:00.133751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8b155a7-457c-4a8e-8425-503375725e06 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:00.134549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8b155a7-457c-4a8e-8425-503375725e06 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:00.137366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8b155a7-457c-4a8e-8425-503375725e06 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:00.138551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8b155a7-457c-4a8e-8425-503375725e06 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:00.139971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8b155a7-457c-4a8e-8425-503375725e06 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:00.265682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e8b155a7-457c-4a8e-8425-503375725e06 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:00.275667 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e8b155a7-457c-4a8e-8425-503375725e06 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1265 microversion: 2.1 time: 0.177817 Oct 11 04:15:00.276830 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 665/1257] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:00 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1265 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:00.282244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:00.283126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:00.295884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:00.297893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:00.297893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:00.299426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:00.300021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:00.301352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:00.414169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:00.424518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:00.425969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:00.443739 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b3710e2-f721-4b4c-9b03-630139a61595 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1443 microversion: 2.75 time: 0.165502 Oct 11 04:15:00.444336 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 666/1258] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:00 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1443 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:00.492604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:00.494790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:00.517396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:00.517893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:00.524766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:00.525625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:00.526103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:00.526562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:00.621089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:00.635965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:00.637592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:00.639338 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f159dc3-8372-45cf-8893-3a450c045544 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1282 microversion: 2.57 time: 0.188413 Oct 11 04:15:00.642482 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 667/1259] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:00 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1282 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:00.655278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3621ee1a-7ed5-478f-9a88-9ab840b2f925 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:00.663011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:00.663918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:00.670328 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3621ee1a-7ed5-478f-9a88-9ab840b2f925 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.932317 Oct 11 04:15:00.671583 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 593/1260] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:14:59 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:00.672007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:00.672598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:00.673039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:00.673820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:00.674419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:00.674848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:00.883888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:00.893388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:00.895225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:00.896391 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef827bf1-310f-4f9c-9b2e-0a50c923af6b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1411 microversion: 2.25 time: 0.250712 Oct 11 04:15:00.897001 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 668/1261] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:00 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1411 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:01.307807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-181f0686-7d54-42c8-b62e-27e788fd6ad2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:01.309792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-181f0686-7d54-42c8-b62e-27e788fd6ad2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:01.318775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181f0686-7d54-42c8-b62e-27e788fd6ad2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:01.319484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181f0686-7d54-42c8-b62e-27e788fd6ad2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:01.319915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181f0686-7d54-42c8-b62e-27e788fd6ad2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:01.321360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181f0686-7d54-42c8-b62e-27e788fd6ad2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:01.322091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181f0686-7d54-42c8-b62e-27e788fd6ad2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:01.322744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181f0686-7d54-42c8-b62e-27e788fd6ad2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:01.401170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-181f0686-7d54-42c8-b62e-27e788fd6ad2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:01.414938 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-181f0686-7d54-42c8-b62e-27e788fd6ad2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1271 microversion: 2.1 time: 0.112432 Oct 11 04:15:01.415511 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 594/1262] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:01 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1271 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:01.475688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:01.476322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:01.501241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:01.501731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:01.502163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:01.502883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:01.503435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:01.503856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:01.672309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:01.673496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:01.681270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:01.681943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:01.682569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:01.683439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:01.684078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:01.685079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:01.694772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:01.707511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:01.715579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:01.735127 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1dc222cd-a84a-4f87-adbe-069aa534ed41 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1443 microversion: 2.75 time: 0.263576 Oct 11 04:15:01.735758 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 669/1263] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:01 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1443 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:01.747523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-67df6585-2415-4990-aa9d-29b6456d9917 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:01.759346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-67df6585-2415-4990-aa9d-29b6456d9917 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:01.774437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67df6585-2415-4990-aa9d-29b6456d9917 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:01.774971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67df6585-2415-4990-aa9d-29b6456d9917 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:01.775664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67df6585-2415-4990-aa9d-29b6456d9917 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:01.776429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67df6585-2415-4990-aa9d-29b6456d9917 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:01.776888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67df6585-2415-4990-aa9d-29b6456d9917 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:01.780113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67df6585-2415-4990-aa9d-29b6456d9917 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:01.844730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:01.854030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:01.855628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:01.857345 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b888844b-7367-4940-9e7e-846244eace94 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1330 microversion: 2.57 time: 0.188646 Oct 11 04:15:01.879690 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 595/1264] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:01 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1330 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:15:01.928088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:01.928768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:01.946891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:01.947432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:01.950797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:01.957587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:01.957587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:01.957587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:01.976639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:02.118286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-67df6585-2415-4990-aa9d-29b6456d9917 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:02.127169 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-67df6585-2415-4990-aa9d-29b6456d9917 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.383479 Oct 11 04:15:02.131933 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 670/1265] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:01 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:02.236539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:02.245129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:02.247115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:02.248229 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f56e4988-ad68-42fb-b157-0d48e21602de tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1411 microversion: 2.25 time: 0.324465 Oct 11 04:15:02.248946 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 596/1266] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:01 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1411 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:02.311674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-96d8ccb4-ce01-4737-b3fe-81ccef55127f req-0f7550a1-2721-4d7b-ad82-0359e62d5c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4133104-80ff-4629-bf97-1d0c7441fbfd", "name": "network-vif-plugged", "status": "completed", "tag": "a2a973b4-1299-427e-947a-59fb8153c4c0"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:02.323822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-96d8ccb4-ce01-4737-b3fe-81ccef55127f req-0f7550a1-2721-4d7b-ad82-0359e62d5c89 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:02.324377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-96d8ccb4-ce01-4737-b3fe-81ccef55127f req-0f7550a1-2721-4d7b-ad82-0359e62d5c89 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:02.324899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-96d8ccb4-ce01-4737-b3fe-81ccef55127f req-0f7550a1-2721-4d7b-ad82-0359e62d5c89 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:02.337996 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-96d8ccb4-ce01-4737-b3fe-81ccef55127f req-0f7550a1-2721-4d7b-ad82-0359e62d5c89 service nova] Creating event network-vif-plugged:a2a973b4-1299-427e-947a-59fb8153c4c0 for instance f4133104-80ff-4629-bf97-1d0c7441fbfd on n-h2-860892-1 Oct 11 04:15:02.346548 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-96d8ccb4-ce01-4737-b3fe-81ccef55127f req-0f7550a1-2721-4d7b-ad82-0359e62d5c89 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042898 Oct 11 04:15:02.348062 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 671/1267] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:02.438948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92ec20a4-0ca3-45b2-b9aa-a1948ae3275d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:02.439563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-92ec20a4-0ca3-45b2-b9aa-a1948ae3275d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:02.462764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92ec20a4-0ca3-45b2-b9aa-a1948ae3275d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:02.465181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92ec20a4-0ca3-45b2-b9aa-a1948ae3275d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:02.466889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92ec20a4-0ca3-45b2-b9aa-a1948ae3275d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:02.468333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92ec20a4-0ca3-45b2-b9aa-a1948ae3275d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:02.468818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92ec20a4-0ca3-45b2-b9aa-a1948ae3275d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:02.469256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92ec20a4-0ca3-45b2-b9aa-a1948ae3275d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:02.768008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:02.768008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:02.775599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:02.780067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:02.783314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:02.784309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:02.788657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:02.789314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:02.836555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92ec20a4-0ca3-45b2-b9aa-a1948ae3275d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:02.845054 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92ec20a4-0ca3-45b2-b9aa-a1948ae3275d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1313 microversion: 2.1 time: 0.410910 Oct 11 04:15:02.845624 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 597/1268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:02 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1313 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:02.891539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:02.892151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:02.899075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:02.899542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:02.899979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:02.900672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:02.901115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:02.901779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:02.912690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:02.926666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:02.928110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:02.941999 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0f260eb7-d487-4fc5-aff8-9deb2c56ab9d tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1443 microversion: 2.75 time: 0.180271 Oct 11 04:15:02.943968 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 672/1269] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:02 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1443 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:03.023567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:03.031664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:03.033096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:03.034333 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2d563e3d-ba89-42ee-94e2-9344ca3d960a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1348 microversion: 2.57 time: 0.146702 Oct 11 04:15:03.035667 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 598/1270] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:02 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1348 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:03.154723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30c711e9-e418-447a-bba0-457f8184a328 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:03.156266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30c711e9-e418-447a-bba0-457f8184a328 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:03.164236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30c711e9-e418-447a-bba0-457f8184a328 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:03.164958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30c711e9-e418-447a-bba0-457f8184a328 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:03.165553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30c711e9-e418-447a-bba0-457f8184a328 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:03.167078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30c711e9-e418-447a-bba0-457f8184a328 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:03.167701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30c711e9-e418-447a-bba0-457f8184a328 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:03.168284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30c711e9-e418-447a-bba0-457f8184a328 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:03.274642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:03.285043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:03.310741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:03.311552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:03.312007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:03.316330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:03.316330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:03.316330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:03.358254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30c711e9-e418-447a-bba0-457f8184a328 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:03.367231 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30c711e9-e418-447a-bba0-457f8184a328 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1473 microversion: 2.1 time: 0.217573 Oct 11 04:15:03.368481 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 673/1271] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:03 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1473 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:03.576726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:03.594905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:03.597830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:03.599301 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35f0cf2f-0749-4fea-a4f1-161ed81e33fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1411 microversion: 2.25 time: 0.330292 Oct 11 04:15:03.601176 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 599/1272] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:03 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1411 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:03.869720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-addd37d7-3bd7-4c8d-9f9d-b7f57bea1f8c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:03.870364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-addd37d7-3bd7-4c8d-9f9d-b7f57bea1f8c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:03.886706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addd37d7-3bd7-4c8d-9f9d-b7f57bea1f8c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:03.888895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addd37d7-3bd7-4c8d-9f9d-b7f57bea1f8c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:03.890887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addd37d7-3bd7-4c8d-9f9d-b7f57bea1f8c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:03.891954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addd37d7-3bd7-4c8d-9f9d-b7f57bea1f8c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:03.893056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addd37d7-3bd7-4c8d-9f9d-b7f57bea1f8c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:03.893491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addd37d7-3bd7-4c8d-9f9d-b7f57bea1f8c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:03.976784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:03.977781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:03.995897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:03.997251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:03.997734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:03.998534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:04.000519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:04.000983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:04.108002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:04.108780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:04.109633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:04.111056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lazy-loading 'fault' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:15:04.168827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-addd37d7-3bd7-4c8d-9f9d-b7f57bea1f8c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:04.180892 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-addd37d7-3bd7-4c8d-9f9d-b7f57bea1f8c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1313 microversion: 2.1 time: 0.315000 Oct 11 04:15:04.181516 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 674/1273] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:03 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1313 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:04.186057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:04.186792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:04.196568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:04.198717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:04.199344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:04.200347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:04.200962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:04.201544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:04.335753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:04.342596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:04.343968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:04.345407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:04.356244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:04.361555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:04.363169 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-99004691-274e-4b97-84fd-aa18d77f55e9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1336 microversion: 2.57 time: 0.180737 Oct 11 04:15:04.367144 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 675/1274] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:04 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1336 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:04.380395 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-031e89f5-bce6-4c7a-b7f7-1971d5cd3ad9 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1448 microversion: 2.75 time: 0.408921 Oct 11 04:15:04.381305 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 600/1275] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:03 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1448 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:15:04.395716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7351f324-9246-4b1d-bc71-01a384ddbe9a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:04.396637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7351f324-9246-4b1d-bc71-01a384ddbe9a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:04.405823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7351f324-9246-4b1d-bc71-01a384ddbe9a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:04.407966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7351f324-9246-4b1d-bc71-01a384ddbe9a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:04.409571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7351f324-9246-4b1d-bc71-01a384ddbe9a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:04.410553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7351f324-9246-4b1d-bc71-01a384ddbe9a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:04.413004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7351f324-9246-4b1d-bc71-01a384ddbe9a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:04.413660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7351f324-9246-4b1d-bc71-01a384ddbe9a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:04.633545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:04.634603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:04.653158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:04.654001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:04.655519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:04.657590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:04.658699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:04.660491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:04.680522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7351f324-9246-4b1d-bc71-01a384ddbe9a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:04.692509 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7351f324-9246-4b1d-bc71-01a384ddbe9a tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1479 microversion: 2.1 time: 0.301562 Oct 11 04:15:04.693870 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 676/1276] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:04 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1479 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:05.037906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:05.049191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:05.066436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:05.068074 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1956d71b-ca60-4b30-9df1-f4aaf5be8f8e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1411 microversion: 2.25 time: 0.446857 Oct 11 04:15:05.083537 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 601/1277] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:04 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1411 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:05.221484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-62e5a174-b2b1-41f1-a197-c133bce75bdb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:05.222294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-62e5a174-b2b1-41f1-a197-c133bce75bdb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:05.239341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62e5a174-b2b1-41f1-a197-c133bce75bdb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:05.239790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62e5a174-b2b1-41f1-a197-c133bce75bdb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:05.240718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62e5a174-b2b1-41f1-a197-c133bce75bdb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:05.252274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62e5a174-b2b1-41f1-a197-c133bce75bdb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:05.255428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62e5a174-b2b1-41f1-a197-c133bce75bdb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:05.255867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62e5a174-b2b1-41f1-a197-c133bce75bdb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:05.369215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ce80cb48-65be-4985-a28d-8fc6f483f7ff req-c6719881-aae9-4803-9a12-3a6bddf65912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72660709-ce51-4053-af08-b1cd828c95d4", "tag": "66639d0c-5518-4300-98e7-ab09ecbda154"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:05.391518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ce80cb48-65be-4985-a28d-8fc6f483f7ff req-c6719881-aae9-4803-9a12-3a6bddf65912 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:05.392016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ce80cb48-65be-4985-a28d-8fc6f483f7ff req-c6719881-aae9-4803-9a12-3a6bddf65912 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:05.392453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ce80cb48-65be-4985-a28d-8fc6f483f7ff req-c6719881-aae9-4803-9a12-3a6bddf65912 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:05.412724 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ce80cb48-65be-4985-a28d-8fc6f483f7ff req-c6719881-aae9-4803-9a12-3a6bddf65912 service nova] Creating event network-changed:66639d0c-5518-4300-98e7-ab09ecbda154 for instance 72660709-ce51-4053-af08-b1cd828c95d4 on n-h2-860892-1 Oct 11 04:15:05.419938 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ce80cb48-65be-4985-a28d-8fc6f483f7ff req-c6719881-aae9-4803-9a12-3a6bddf65912 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055627 Oct 11 04:15:05.421481 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 602/1278] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:05.432629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:05.433863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:05.443774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:05.444880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:05.445570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:05.446806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:05.447484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:05.448074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:05.584672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-62e5a174-b2b1-41f1-a197-c133bce75bdb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:05.593831 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-62e5a174-b2b1-41f1-a197-c133bce75bdb tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1313 microversion: 2.1 time: 0.381812 Oct 11 04:15:05.614144 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 677/1279] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:05 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1313 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:05.616653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:05.617626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:05.625320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:05.626334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:05.626944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:05.627826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:05.628949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:05.629625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:05.689577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:05.690077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:05.711787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:05.711787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lazy-loading 'fault' on Instance uuid 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:15:05.746497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:05.753687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:05.761392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:05.763146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'abef64e3ca4a4dcba416c87a931e7850', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c12639490ad4451b3853b7818d738c3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:05.763530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:05.765343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:05.766891 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0710af8c-1d04-4597-8d7a-0ac60c3619d5 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1336 microversion: 2.57 time: 0.344092 Oct 11 04:15:05.769722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:05.771150 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 603/1280] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:05 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1336 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:05.772156 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9a6fe28a-1f0a-4774-a70a-4d225a04af27 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 200 len: 1448 microversion: 2.75 time: 0.159520 Oct 11 04:15:05.772970 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 678/1281] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:05 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 1448 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:05.793716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-94a0f8be-8f41-4008-b6f3-541af9ac00a9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:05.794579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-94a0f8be-8f41-4008-b6f3-541af9ac00a9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:05.804006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a0f8be-8f41-4008-b6f3-541af9ac00a9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:05.804290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a0f8be-8f41-4008-b6f3-541af9ac00a9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:05.804737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a0f8be-8f41-4008-b6f3-541af9ac00a9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:05.805455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a0f8be-8f41-4008-b6f3-541af9ac00a9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:05.805905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a0f8be-8f41-4008-b6f3-541af9ac00a9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:05.809777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a0f8be-8f41-4008-b6f3-541af9ac00a9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:06.068149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-94a0f8be-8f41-4008-b6f3-541af9ac00a9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:06.083409 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-94a0f8be-8f41-4008-b6f3-541af9ac00a9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1479 microversion: 2.1 time: 0.309063 Oct 11 04:15:06.087858 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 679/1282] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:05 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1479 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:06.097693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:06.098574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:06.113582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:06.116608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:06.116608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:06.116608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:06.116608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:06.116608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:06.137775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a2075014-34cf-4674-9d44-e60c1ede4ec6 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-736942577", "id": 2049134606, "os-flavor-access:is_public": "False"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:06.167481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:06.284016 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a2075014-34cf-4674-9d44-e60c1ede4ec6 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.492427 Oct 11 04:15:06.285410 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 604/1283] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:15:05 2022] POST /compute/v2.1/flavors => generated 438 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:06.308667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef557354-11b0-4c44-b3e6-204335417ff5 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0159ca06eea74bfe9c4325ca2252e8f6"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:06.338773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:06.352341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:06.354686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:06.357294 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7121f4d9-37ef-42dc-bfbb-61df8ce14575 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1606 microversion: 2.25 time: 0.263707 Oct 11 04:15:06.358890 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 680/1284] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:06 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1606 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:06.388977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c177b103-090f-4ccf-9b57-ac8c1157cfd4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:06.388977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c177b103-090f-4ccf-9b57-ac8c1157cfd4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:06.393567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c177b103-090f-4ccf-9b57-ac8c1157cfd4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:06.394864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c177b103-090f-4ccf-9b57-ac8c1157cfd4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:06.395518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c177b103-090f-4ccf-9b57-ac8c1157cfd4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:06.396454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c177b103-090f-4ccf-9b57-ac8c1157cfd4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:06.397093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c177b103-090f-4ccf-9b57-ac8c1157cfd4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:06.397666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c177b103-090f-4ccf-9b57-ac8c1157cfd4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:06.502385 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef557354-11b0-4c44-b3e6-204335417ff5 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/2049134606/action" status: 200 len: 97 microversion: 2.1 time: 0.204845 Oct 11 04:15:06.503235 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 605/1285] 10.222.0.26 () {60 vars in 1200 bytes} [Tue Oct 11 04:15:06 2022] POST /compute/v2.1/flavors/2049134606/action => generated 97 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:15:06.521227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1e725b14-20ec-4f68-9786-5b4bd5b8d3ae tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0159ca06eea74bfe9c4325ca2252e8f6"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:06.561022 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c177b103-090f-4ccf-9b57-ac8c1157cfd4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-interface" status: 200 len: 284 microversion: 2.25 time: 0.181575 Oct 11 04:15:06.561888 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 681/1286] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Oct 11 04:15:06 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-interface => generated 284 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:15:06.617775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c92c9f5f-c3be-4ee0-864d-17e074ecdc89 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:06.618691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c92c9f5f-c3be-4ee0-864d-17e074ecdc89 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:06.637687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c92c9f5f-c3be-4ee0-864d-17e074ecdc89 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:06.639169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c92c9f5f-c3be-4ee0-864d-17e074ecdc89 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:06.639169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c92c9f5f-c3be-4ee0-864d-17e074ecdc89 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:06.645155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c92c9f5f-c3be-4ee0-864d-17e074ecdc89 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:06.646347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c92c9f5f-c3be-4ee0-864d-17e074ecdc89 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:06.647507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c92c9f5f-c3be-4ee0-864d-17e074ecdc89 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:06.712740 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-1e725b14-20ec-4f68-9786-5b4bd5b8d3ae tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] HTTP exception thrown: Flavor access already exists for flavor 36 and project 0159ca06eea74bfe9c4325ca2252e8f6 combination. Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1e725b14-20ec-4f68-9786-5b4bd5b8d3ae tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Request method failure captured: Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/flavors/2049134606/action HTTP/1.1 Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 67 Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO3IENlvFo-rH_W9I_Yk9uw4aPITDW51vzDU0Gz2ywYp2KijCp_QzF6JXyRaO7CZ-bb5nhWY1avrryXYNjwKufdY9OBDJ9-zTnFV-Zn__HB3uaOxFVVvyIwopjInP6MMeMOQfIU3uo6TI8HOGWWZK-02wLcTbrdXtYp5Suoka46ZuRA Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 21ac2d8225b348f9b1e98206d0b9d290 Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1699667113 Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21ac2d8225b348f9b1e98206d0b9d290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21ac2d8225b348f9b1e98206d0b9d290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21ac2d8225b348f9b1e98206d0b9d290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21ac2d8225b348f9b1e98206d0b9d290"}]}] Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1699667113 Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 21ac2d8225b348f9b1e98206d0b9d290 Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1699667113 Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 6663cbb468e14efb87c9ecb3733bcf8f Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: {"addTenantAccess": {"tenant": "0159ca06eea74bfe9c4325ca2252e8f6"}} Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: exception: Flavor access already exists for flavor 36 and project 0159ca06eea74bfe9c4325ca2252e8f6 combination. Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '2049134606', 'body': {'addTenantAccess': {'tenant': '0159ca06eea74bfe9c4325ca2252e8f6'}}} Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result.read() Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi pymysql.err.IntegrityError: (1062, "Duplicate entry '36-0159ca06eea74bfe9c4325ca2252e8f6' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:06.722020 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 73, in _flavor_add_project Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi project.save(context.session) Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/models.py", line 38, in save Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi session.flush() Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._flush(objects) Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi transaction.rollback(_capture_exception=True) Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi compat.raise_( Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi flush_context.execute() Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi rec.execute(self) Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi util.preloaded.orm_persistence.save_obj( Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _emit_insert_statements( Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = connection._execute_20( Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return meth(self, args_10style, kwargs_10style, execution_options) Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return connection._execute_clauseelement( Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = self._execute_context( Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_dbapi_exception( Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.dialect.do_execute( Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi cursor.execute(statement, parameters) Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = self._query(query) Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi conn.query(q) Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result.read() Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi first_packet = self.connection._read_packet() Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi packet.raise_for_error() Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi err.raise_mysql_exception(self._data) Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 11 04:15:06.727507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise errorclass(errno, errval) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '36-0159ca06eea74bfe9c4325ca2252e8f6' for key 'flavor_projects.uniq_flavor_projects0flavor_id0project_id'") Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [SQL: INSERT INTO flavor_projects (created_at, updated_at, flavor_id, project_id) VALUES (%(created_at)s, %(updated_at)s, %(flavor_id)s, %(project_id)s)] Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [parameters: {'created_at': datetime.datetime(2022, 10, 11, 4, 15, 6, 631408), 'updated_at': None, 'flavor_id': 36, 'project_id': '0159ca06eea74bfe9c4325ca2252e8f6'}] Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 79, in _add_tenant_access Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi flavor.add_access(tenant) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 411, in add_access Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._add_access(project_id) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 404, in _add_access Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._flavor_add_project(self._context, self.id, project_id) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 397, in _flavor_add_project Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return _flavor_add_project(context, flavor_id, project_id) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 75, in _flavor_add_project Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessExists(flavor_id=flavor_id, Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessExists: Flavor access already exists for flavor 36 and project 0159ca06eea74bfe9c4325ca2252e8f6 combination. Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 83, in _add_tenant_access Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=err.format_message()) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Flavor access already exists for flavor 36 and project 0159ca06eea74bfe9c4325ca2252e8f6 combination. Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access already exists for flavor 36 and project 0159ca06eea74bfe9c4325ca2252e8f6 combination. Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1e725b14-20ec-4f68-9786-5b4bd5b8d3ae tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Returning 409 to user: Flavor access already exists for flavor 36 and project 0159ca06eea74bfe9c4325ca2252e8f6 combination. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:15:06.732722 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1e725b14-20ec-4f68-9786-5b4bd5b8d3ae tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/2049134606/action" status: 409 len: 152 microversion: 2.1 time: 0.215210 Oct 11 04:15:06.739628 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 606/1287] 10.222.0.26 () {60 vars in 1200 bytes} [Tue Oct 11 04:15:06 2022] POST /compute/v2.1/flavors/2049134606/action => generated 152 bytes in 217 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:15:06.742213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5e476040-b514-4043-b5e2-c49ca83e2fa4 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0159ca06eea74bfe9c4325ca2252e8f6"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:06.931670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c92c9f5f-c3be-4ee0-864d-17e074ecdc89 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:06.965884 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5e476040-b514-4043-b5e2-c49ca83e2fa4 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/2049134606/action" status: 200 len: 21 microversion: 2.1 time: 0.235343 Oct 11 04:15:06.976226 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 607/1288] 10.222.0.26 () {60 vars in 1200 bytes} [Tue Oct 11 04:15:06 2022] POST /compute/v2.1/flavors/2049134606/action => generated 21 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:15:06.981704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:06.983891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:06.984845 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c92c9f5f-c3be-4ee0-864d-17e074ecdc89 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1313 microversion: 2.1 time: 0.366925 Oct 11 04:15:06.989307 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 682/1289] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:06 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:07.003948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:07.004810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] [instance: 5c9fcdbf-f055-4d4a-8bff-bf55f1922251] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:07.010416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.014035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.014035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.014359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.014468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.014550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.014633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.014633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.016470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.017410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.018257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.018959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.049402 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] HTTP exception thrown: Instance 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 could not be found. Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Request method failure captured: Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 HTTP/1.1 Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO1mqGptKKk2WIH6lJD_mhJ53L86rxuLLgr4gmzWGYZ-m7ksr_E3YZeHgx_932APMlTHIQ0hjEWDnnWyO3LZmnrc6b12rFqLB4DHf2G1Fm5naD8ipvSgd_mM-3lltpBgo9dGNTaAD3tz7OjDMVeOrnfg3G9ex-U1gEY7WX1Vbnywb0g Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.75 Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 2c12639490ad4451b3853b7818d738c3 Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersAdmin275Test-291254917 Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2c12639490ad4451b3853b7818d738c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2c12639490ad4451b3853b7818d738c3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c12639490ad4451b3853b7818d738c3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2c12639490ad4451b3853b7818d738c3"}]}] Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersAdmin275Test-291254917 Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 2c12639490ad4451b3853b7818d738c3 Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersAdmin275Test-291254917 Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersAdmin275Test-291254917-project Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: abef64e3ca4a4dcba416c87a931e7850 Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersAdmin275Test-291254917-project Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 could not be found. Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '5c9fcdbf-f055-4d4a-8bff-bf55f1922251'} Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 could not be found. Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 could not be found. Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:07.051678 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:07.056812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:07.056812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:07.056812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:07.056812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:15:07.056812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:15:07.056812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 could not be found. Oct 11 04:15:07.056812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:07.058369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] Returning 404 to user: Instance 5c9fcdbf-f055-4d4a-8bff-bf55f1922251 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:15:07.059878 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-80ce840f-00b3-46c7-9b1d-81ef4a4a7590 tempest-ServersAdmin275Test-291254917 tempest-ServersAdmin275Test-291254917-project] 10.222.0.26 "GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251" status: 404 len: 111 microversion: 2.75 time: 0.068647 Oct 11 04:15:07.061262 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 683/1290] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:06 2022] GET /compute/v2.1/servers/5c9fcdbf-f055-4d4a-8bff-bf55f1922251 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:15:07.083916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e49e8e3a-2fb2-42d3-a511-686255566588 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:07.085490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:07.192098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:07.207298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:07.208752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:07.209951 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b8a45e81-79e3-4c7f-8c13-eb5793e3b802 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1357 microversion: 2.57 time: 0.232519 Oct 11 04:15:07.221085 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e49e8e3a-2fb2-42d3-a511-686255566588 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/2049134606" status: 202 len: 0 microversion: 2.1 time: 0.158595 Oct 11 04:15:07.224835 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 684/1291] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:15:07 2022] DELETE /compute/v2.1/flavors/2049134606 => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:15:07.232634 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 608/1292] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:06 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1357 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:07.248469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-7c36b527-5d84-4b7a-8372-a1ad1052d75e req-60fff492-ae72-44b9-8413-d16914b33c3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97202407-f542-4189-9582-1f1dd698c594", "name": "network-vif-unplugged", "status": "completed", "tag": "dc8db1bd-a8a8-4b23-8837-a7b82504853f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:07.252269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c7c1b506-35c3-49c0-a3bd-dd7daf7d5951 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:07.254301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c7c1b506-35c3-49c0-a3bd-dd7daf7d5951 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:07.272256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c1b506-35c3-49c0-a3bd-dd7daf7d5951 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.272768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c1b506-35c3-49c0-a3bd-dd7daf7d5951 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.279387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c1b506-35c3-49c0-a3bd-dd7daf7d5951 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.279387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c1b506-35c3-49c0-a3bd-dd7daf7d5951 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.279387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c1b506-35c3-49c0-a3bd-dd7daf7d5951 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.279816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c1b506-35c3-49c0-a3bd-dd7daf7d5951 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.282391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7c36b527-5d84-4b7a-8372-a1ad1052d75e req-60fff492-ae72-44b9-8413-d16914b33c3f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.282882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7c36b527-5d84-4b7a-8372-a1ad1052d75e req-60fff492-ae72-44b9-8413-d16914b33c3f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.284454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7c36b527-5d84-4b7a-8372-a1ad1052d75e req-60fff492-ae72-44b9-8413-d16914b33c3f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.335383 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7c36b527-5d84-4b7a-8372-a1ad1052d75e req-60fff492-ae72-44b9-8413-d16914b33c3f service nova] Creating event network-vif-unplugged:dc8db1bd-a8a8-4b23-8837-a7b82504853f for instance 97202407-f542-4189-9582-1f1dd698c594 on n-h1-860892-1 Oct 11 04:15:07.341412 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-7c36b527-5d84-4b7a-8372-a1ad1052d75e req-60fff492-ae72-44b9-8413-d16914b33c3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.114781 Oct 11 04:15:07.341628 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 609/1293] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:07.348733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-19c7c55d-5098-41f2-8307-be947f654fb6 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:07.375239 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-19c7c55d-5098-41f2-8307-be947f654fb6 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.030599 Oct 11 04:15:07.376002 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 610/1294] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:15:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:07.383285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Action: 'action', calling method: >, body: {"rebuild": {"user_data": "ZWNobyAiaGVsbG8gd29ybGQi", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:07.386822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:07.401245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.401756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.402239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.402961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.403616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.404218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.579824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:15:07.585181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:15:07.585181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:15:07.585181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:15:07.585181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:15:07.637764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c7c1b506-35c3-49c0-a3bd-dd7daf7d5951 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:07.650306 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c7c1b506-35c3-49c0-a3bd-dd7daf7d5951 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1479 microversion: 2.1 time: 0.427307 Oct 11 04:15:07.651770 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 685/1295] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:07 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1479 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:07.659001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-66c0de80-d37f-4416-b895-0670050df11c tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1978591754", "id": 115941729, "os-flavor-access:is_public": "True"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:07.770213 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-66c0de80-d37f-4416-b895-0670050df11c tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 435 microversion: 2.1 time: 0.116683 Oct 11 04:15:07.770813 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 686/1296] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:15:07 2022] POST /compute/v2.1/flavors => generated 435 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:07.785549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-769f6ba8-109f-494b-9ee3-3007f154f93d tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:07.793248 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-769f6ba8-109f-494b-9ee3-3007f154f93d tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] HTTP exception thrown: Access list not available for public flavors. Oct 11 04:15:07.807688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-769f6ba8-109f-494b-9ee3-3007f154f93d tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Request method failure captured: Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/flavors/115941729/os-flavor-access HTTP/1.1 Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO3IENlvFo-rH_W9I_Yk9uw4aPITDW51vzDU0Gz2ywYp2KijCp_QzF6JXyRaO7CZ-bb5nhWY1avrryXYNjwKufdY9OBDJ9-zTnFV-Zn__HB3uaOxFVVvyIwopjInP6MMeMOQfIU3uo6TI8HOGWWZK-02wLcTbrdXtYp5Suoka46ZuRA Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 21ac2d8225b348f9b1e98206d0b9d290 Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1699667113 Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21ac2d8225b348f9b1e98206d0b9d290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21ac2d8225b348f9b1e98206d0b9d290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21ac2d8225b348f9b1e98206d0b9d290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21ac2d8225b348f9b1e98206d0b9d290"}]}] Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1699667113 Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 21ac2d8225b348f9b1e98206d0b9d290 Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1699667113 Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 6663cbb468e14efb87c9ecb3733bcf8f Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: exception: Access list not available for public flavors. Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'flavor_id': '115941729'} Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 52, in index Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Access list not available for public flavors. Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Access list not available for public flavors. Oct 11 04:15:07.811872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:07.816762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-769f6ba8-109f-494b-9ee3-3007f154f93d tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Returning 404 to user: Access list not available for public flavors. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:15:07.816762 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-769f6ba8-109f-494b-9ee3-3007f154f93d tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/115941729/os-flavor-access" status: 404 len: 91 microversion: 2.1 time: 0.034054 Oct 11 04:15:07.817751 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 687/1297] 10.222.0.26 () {58 vars in 1206 bytes} [Tue Oct 11 04:15:07 2022] GET /compute/v2.1/flavors/115941729/os-flavor-access => generated 91 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 04:15:07.831141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.832526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.834319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1afec9da-61f3-45e2-bbce-5cd300365592 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:07.838504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.841286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.841942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.843307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.915434 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5fa8cee1-e415-4620-9c29-1d9e64673496 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "POST /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5/action" status: 202 len: 1138 microversion: 2.57 time: 0.537919 Oct 11 04:15:07.921142 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 611/1298] 10.222.0.26 () {62 vars in 1320 bytes} [Tue Oct 11 04:15:07 2022] POST /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5/action => generated 1138 bytes in 540 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 04:15:07.945761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:07.950325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:07.958621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.959340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.959946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.960844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:07.961550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:07.963039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:07.970454 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1afec9da-61f3-45e2-bbce-5cd300365592 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/115941729" status: 202 len: 0 microversion: 2.1 time: 0.151463 Oct 11 04:15:07.971887 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 688/1299] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:15:07 2022] DELETE /compute/v2.1/flavors/115941729 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:15:07.981540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff5b5b14-1b7e-4156-a437-5d06ee523d9b tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:08.014106 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff5b5b14-1b7e-4156-a437-5d06ee523d9b tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.037490 Oct 11 04:15:08.016818 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 689/1300] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:15:07 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:08.027015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3fdb7a64-7b01-4c14-b983-05e856c00f40 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:08.027893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3fdb7a64-7b01-4c14-b983-05e856c00f40 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:08.040287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fdb7a64-7b01-4c14-b983-05e856c00f40 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:08.041785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fdb7a64-7b01-4c14-b983-05e856c00f40 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:08.043129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fdb7a64-7b01-4c14-b983-05e856c00f40 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:08.043888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fdb7a64-7b01-4c14-b983-05e856c00f40 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:08.044368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fdb7a64-7b01-4c14-b983-05e856c00f40 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:08.046535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fdb7a64-7b01-4c14-b983-05e856c00f40 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:08.132864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:08.146513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:08.148308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:08.150343 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4c9f6cd2-91f0-4455-a589-79b853142479 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.212787 Oct 11 04:15:08.151096 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 612/1301] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:07 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:08.177089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-395e9cd0-2cb9-4f29-b913-4529edd85c2f tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-99813609", "id": 1198696258, "os-flavor-access:is_public": "False"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:08.333799 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-395e9cd0-2cb9-4f29-b913-4529edd85c2f tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 437 microversion: 2.1 time: 0.160294 Oct 11 04:15:08.333799 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 613/1302] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:15:08 2022] POST /compute/v2.1/flavors => generated 437 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:08.647289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:08.668686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e68ad263-3203-4d94-9457-0f0e85576309 tempest-FlavorsAccessNegativeTestJSON-1344462547 tempest-FlavorsAccessNegativeTestJSON-1344462547-project] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0159ca06eea74bfe9c4325ca2252e8f6"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:08.672374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e68ad263-3203-4d94-9457-0f0e85576309 tempest-FlavorsAccessNegativeTestJSON-1344462547 tempest-FlavorsAccessNegativeTestJSON-1344462547-project] Policy check for os_compute_api:os-flavor-access:add_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f55714dc2a404fa98fd72d89df1a97f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159ca06eea74bfe9c4325ca2252e8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e68ad263-3203-4d94-9457-0f0e85576309 tempest-FlavorsAccessNegativeTestJSON-1344462547 tempest-FlavorsAccessNegativeTestJSON-1344462547-project] Request method failure captured: Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/flavors/1198696258/action HTTP/1.1 Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 67 Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO3HY28Aw0vQypm2qvcgyedv395BcAppdXm6aZhb7aBFypVxLs-JvpmrFjZwDQLZeSANw5i7HAWcbai-fhWNSE3J_jZgECbe4RWGEjcUFqW8zHn1aWv9YlkPuXtndpKi2_wUg-lLK0s_Xe1Rwb0mSm6EI_MJ7gSQgG96rUT8aDUqk8Q Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 0159ca06eea74bfe9c4325ca2252e8f6 Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1344462547 Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0159ca06eea74bfe9c4325ca2252e8f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0159ca06eea74bfe9c4325ca2252e8f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0159ca06eea74bfe9c4325ca2252e8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0159ca06eea74bfe9c4325ca2252e8f6"}]}] Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1344462547 Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 0159ca06eea74bfe9c4325ca2252e8f6 Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1344462547 Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FlavorsAccessNegativeTestJSON-1344462547-project Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: f55714dc2a404fa98fd72d89df1a97f3 Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1344462547-project Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: {"addTenantAccess": {"tenant": "0159ca06eea74bfe9c4325ca2252e8f6"}} Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1198696258', 'body': {'addTenantAccess': {'tenant': '0159ca06eea74bfe9c4325ca2252e8f6'}}} Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 66, in _add_tenant_access Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(fa_policies.POLICY_ROOT % "add_tenant_access", target={}) Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:15:08.674584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 04:15:08.679747 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:08.679747 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:08.679747 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:08.679747 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:08.679747 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:08.679747 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:08.679747 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:15:08.679747 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:15:08.679747 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. Oct 11 04:15:08.679747 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:08.680457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=14 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:08.683509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e68ad263-3203-4d94-9457-0f0e85576309 tempest-FlavorsAccessNegativeTestJSON-1344462547 tempest-FlavorsAccessNegativeTestJSON-1344462547-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:add_tenant_access to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:15:08.685198 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e68ad263-3203-4d94-9457-0f0e85576309 tempest-FlavorsAccessNegativeTestJSON-1344462547 tempest-FlavorsAccessNegativeTestJSON-1344462547-project] 10.222.0.26 "POST /compute/v2.1/flavors/1198696258/action" status: 403 len: 130 microversion: 2.1 time: 0.347856 Oct 11 04:15:08.686603 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 614/1303] 10.222.0.26 () {60 vars in 1200 bytes} [Tue Oct 11 04:15:08 2022] POST /compute/v2.1/flavors/1198696258/action => generated 130 bytes in 351 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:15:08.700055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90c422c0-8447-489a-86f8-0b0e4cd6aa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:08.703051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90c422c0-8447-489a-86f8-0b0e4cd6aa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:08.713952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90c422c0-8447-489a-86f8-0b0e4cd6aa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:08.715048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90c422c0-8447-489a-86f8-0b0e4cd6aa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:08.715792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90c422c0-8447-489a-86f8-0b0e4cd6aa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:08.717098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90c422c0-8447-489a-86f8-0b0e4cd6aa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:08.717732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90c422c0-8447-489a-86f8-0b0e4cd6aa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:08.718391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90c422c0-8447-489a-86f8-0b0e4cd6aa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:08.893287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3fdb7a64-7b01-4c14-b983-05e856c00f40 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:08.904907 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3fdb7a64-7b01-4c14-b983-05e856c00f40 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1313 microversion: 2.1 time: 0.886723 Oct 11 04:15:08.905602 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 690/1304] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:08 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1313 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:08.910551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c4e70e9a-dbc4-4ab7-bd3f-f48d5a007290 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:08.940253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90c422c0-8447-489a-86f8-0b0e4cd6aa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:08.950181 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90c422c0-8447-489a-86f8-0b0e4cd6aa5c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1479 microversion: 2.1 time: 0.260982 Oct 11 04:15:08.951003 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 615/1305] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:08 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1479 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:09.011539 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c4e70e9a-dbc4-4ab7-bd3f-f48d5a007290 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1198696258" status: 202 len: 0 microversion: 2.1 time: 0.104350 Oct 11 04:15:09.015182 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 691/1306] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:15:08 2022] DELETE /compute/v2.1/flavors/1198696258 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:15:09.024439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5854695c-f63e-41ea-b01c-d0ca7a2ca3f8 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:09.034140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:09.052187 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5854695c-f63e-41ea-b01c-d0ca7a2ca3f8 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.032052 Oct 11 04:15:09.055384 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 616/1307] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:15:09 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:09.075426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4c9187f4-9afd-48ef-99d0-7ba541305356 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1906861063", "id": 1939109572, "os-flavor-access:is_public": "False"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:09.169762 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4c9187f4-9afd-48ef-99d0-7ba541305356 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.094482 Oct 11 04:15:09.169762 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 692/1308] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:15:09 2022] POST /compute/v2.1/flavors => generated 439 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:09.181600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:09.182561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:09.191228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3be94a9-a138-40d4-964a-1f42a221a4f1 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Action: 'action', calling method: >, body: {"addTenantAccess": {"tenant": "0159ca06eea74bfe9c4325ca2252e8f6"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:09.193835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:09.196004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:09.196490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:09.200541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:09.201281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:09.201906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:09.203377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:09.366417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:09.380710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:09.385150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:09.386787 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bea863fa-caf2-4302-909e-99b5099949ac tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.209449 Oct 11 04:15:09.390321 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 617/1309] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:09 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:09.513313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a8c4e999-ee8e-47a3-a3d0-2442ea2884b4 req-ddb235bc-aa67-472e-8c8d-eb12db34fd96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4133104-80ff-4629-bf97-1d0c7441fbfd", "tag": "a2a973b4-1299-427e-947a-59fb8153c4c0"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:09.539208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a8c4e999-ee8e-47a3-a3d0-2442ea2884b4 req-ddb235bc-aa67-472e-8c8d-eb12db34fd96 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:09.540622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a8c4e999-ee8e-47a3-a3d0-2442ea2884b4 req-ddb235bc-aa67-472e-8c8d-eb12db34fd96 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:09.543437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a8c4e999-ee8e-47a3-a3d0-2442ea2884b4 req-ddb235bc-aa67-472e-8c8d-eb12db34fd96 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:09.572526 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a8c4e999-ee8e-47a3-a3d0-2442ea2884b4 req-ddb235bc-aa67-472e-8c8d-eb12db34fd96 service nova] Creating event network-changed:a2a973b4-1299-427e-947a-59fb8153c4c0 for instance f4133104-80ff-4629-bf97-1d0c7441fbfd on n-h2-860892-1 Oct 11 04:15:09.580467 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a8c4e999-ee8e-47a3-a3d0-2442ea2884b4 req-ddb235bc-aa67-472e-8c8d-eb12db34fd96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073164 Oct 11 04:15:09.583001 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 618/1310] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:15:09.775228 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3be94a9-a138-40d4-964a-1f42a221a4f1 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1939109572/action" status: 200 len: 97 microversion: 2.1 time: 0.588066 Oct 11 04:15:09.782216 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 693/1311] 10.222.0.26 () {60 vars in 1200 bytes} [Tue Oct 11 04:15:09 2022] POST /compute/v2.1/flavors/1939109572/action => generated 97 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:15:09.789371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-424dd886-e940-4e76-9bbb-a2c44e1f48b2 tempest-FlavorsAccessNegativeTestJSON-1344462547 tempest-FlavorsAccessNegativeTestJSON-1344462547-project] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0159ca06eea74bfe9c4325ca2252e8f6"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:09.794603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-424dd886-e940-4e76-9bbb-a2c44e1f48b2 tempest-FlavorsAccessNegativeTestJSON-1344462547 tempest-FlavorsAccessNegativeTestJSON-1344462547-project] Policy check for os_compute_api:os-flavor-access:remove_tenant_access failed with credentials {'is_admin': False, 'user_id': 'f55714dc2a404fa98fd72d89df1a97f3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0159ca06eea74bfe9c4325ca2252e8f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-424dd886-e940-4e76-9bbb-a2c44e1f48b2 tempest-FlavorsAccessNegativeTestJSON-1344462547 tempest-FlavorsAccessNegativeTestJSON-1344462547-project] Request method failure captured: Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/flavors/1939109572/action HTTP/1.1 Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 70 Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO3HY28Aw0vQypm2qvcgyedv395BcAppdXm6aZhb7aBFypVxLs-JvpmrFjZwDQLZeSANw5i7HAWcbai-fhWNSE3J_jZgECbe4RWGEjcUFqW8zHn1aWv9YlkPuXtndpKi2_wUg-lLK0s_Xe1Rwb0mSm6EI_MJ7gSQgG96rUT8aDUqk8Q Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 0159ca06eea74bfe9c4325ca2252e8f6 Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1344462547 Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0159ca06eea74bfe9c4325ca2252e8f6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0159ca06eea74bfe9c4325ca2252e8f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0159ca06eea74bfe9c4325ca2252e8f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0159ca06eea74bfe9c4325ca2252e8f6"}]}] Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1344462547 Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 0159ca06eea74bfe9c4325ca2252e8f6 Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1344462547 Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FlavorsAccessNegativeTestJSON-1344462547-project Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: f55714dc2a404fa98fd72d89df1a97f3 Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1344462547-project Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: {"removeTenantAccess": {"tenant": "0159ca06eea74bfe9c4325ca2252e8f6"}} Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1939109572', 'body': {'removeTenantAccess': {'tenant': '0159ca06eea74bfe9c4325ca2252e8f6'}}} Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 91, in _remove_tenant_access Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can( Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 04:15:09.799762 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:09.806928 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:09.806928 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:09.806928 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:09.806928 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:09.806928 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:09.806928 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:15:09.806928 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:15:09.806928 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. Oct 11 04:15:09.806928 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:09.806928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-424dd886-e940-4e76-9bbb-a2c44e1f48b2 tempest-FlavorsAccessNegativeTestJSON-1344462547 tempest-FlavorsAccessNegativeTestJSON-1344462547-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-flavor-access:remove_tenant_access to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:15:09.807726 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-424dd886-e940-4e76-9bbb-a2c44e1f48b2 tempest-FlavorsAccessNegativeTestJSON-1344462547 tempest-FlavorsAccessNegativeTestJSON-1344462547-project] 10.222.0.26 "POST /compute/v2.1/flavors/1939109572/action" status: 403 len: 133 microversion: 2.1 time: 0.023130 Oct 11 04:15:09.809189 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 619/1312] 10.222.0.26 () {60 vars in 1200 bytes} [Tue Oct 11 04:15:09 2022] POST /compute/v2.1/flavors/1939109572/action => generated 133 bytes in 28 msecs (HTTP/1.1 403) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:15:09.827473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-61aaf6d7-6311-4382-b0bf-0ea321030bfe tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "0159ca06eea74bfe9c4325ca2252e8f6"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:09.930547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f677230-64f3-48f0-af52-fe80188db796 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:09.931287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f677230-64f3-48f0-af52-fe80188db796 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:09.956621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f677230-64f3-48f0-af52-fe80188db796 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:09.957125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f677230-64f3-48f0-af52-fe80188db796 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:09.957568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f677230-64f3-48f0-af52-fe80188db796 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:09.958309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f677230-64f3-48f0-af52-fe80188db796 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:09.958766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f677230-64f3-48f0-af52-fe80188db796 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:09.959186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f677230-64f3-48f0-af52-fe80188db796 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:10.169401 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-61aaf6d7-6311-4382-b0bf-0ea321030bfe tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1939109572/action" status: 200 len: 21 microversion: 2.1 time: 0.350639 Oct 11 04:15:10.176496 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 694/1313] 10.222.0.26 () {60 vars in 1200 bytes} [Tue Oct 11 04:15:09 2022] POST /compute/v2.1/flavors/1939109572/action => generated 21 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:15:10.181265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d436007-9e4c-4a6e-b175-6cd523643cc9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:10.184869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d436007-9e4c-4a6e-b175-6cd523643cc9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:10.201151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d436007-9e4c-4a6e-b175-6cd523643cc9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:10.201984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d436007-9e4c-4a6e-b175-6cd523643cc9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:10.202614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d436007-9e4c-4a6e-b175-6cd523643cc9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:10.203505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d436007-9e4c-4a6e-b175-6cd523643cc9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:10.204115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d436007-9e4c-4a6e-b175-6cd523643cc9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:10.204696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d436007-9e4c-4a6e-b175-6cd523643cc9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:10.613094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f677230-64f3-48f0-af52-fe80188db796 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:10.631346 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f677230-64f3-48f0-af52-fe80188db796 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1313 microversion: 2.1 time: 0.699475 Oct 11 04:15:10.643184 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 620/1314] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:09 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1313 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:10.651865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d78fc9a-9b8d-45fb-94c6-61ea0c796d10 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:10.667296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d436007-9e4c-4a6e-b175-6cd523643cc9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:10.682735 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d436007-9e4c-4a6e-b175-6cd523643cc9 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1479 microversion: 2.1 time: 0.511193 Oct 11 04:15:10.694249 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 695/1315] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:10 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1479 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:10.699156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:10.700646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:10.716228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:10.717128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:10.717569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:10.720864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:10.721734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:10.722208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:10.753316 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0d78fc9a-9b8d-45fb-94c6-61ea0c796d10 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1939109572" status: 202 len: 0 microversion: 2.1 time: 0.107775 Oct 11 04:15:10.754414 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 621/1316] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:15:10 2022] DELETE /compute/v2.1/flavors/1939109572 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:15:10.762893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-acebdc1a-9f47-42cc-9716-74a1705529c6 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:10.806374 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-acebdc1a-9f47-42cc-9716-74a1705529c6 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.039998 Oct 11 04:15:10.808681 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 622/1317] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:15:10 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:10.834444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e5daeca-5520-422a-bb1b-aa2312278518 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "disk": 10, "name": "tempest-FlavorsAccessNegativeTestJSON-flavor-1617247751", "id": 1713509398, "os-flavor-access:is_public": "False"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:10.866012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:10.890768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:10.899535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:10.904087 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5d0d896-5829-438a-8695-dcab123b1216 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.216331 Oct 11 04:15:10.920759 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 696/1318] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:10 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:10.943665 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4e5daeca-5520-422a-bb1b-aa2312278518 tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 439 microversion: 2.1 time: 0.115945 Oct 11 04:15:10.944547 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 623/1319] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:15:10 2022] POST /compute/v2.1/flavors => generated 439 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:15:10.958115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce28fe73-d11a-4745-b789-b0edd41bddff tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Action: 'action', calling method: >, body: {"removeTenantAccess": {"tenant": "07ccbe60d03a492488426f1876f7a649"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:11.252807 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ce28fe73-d11a-4745-b789-b0edd41bddff tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] HTTP exception thrown: Flavor access not found for 40 / 07ccbe60d03a492488426f1876f7a649 combination. Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce28fe73-d11a-4745-b789-b0edd41bddff tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Request method failure captured: Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/flavors/1713509398/action HTTP/1.1 Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 70 Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO3IENlvFo-rH_W9I_Yk9uw4aPITDW51vzDU0Gz2ywYp2KijCp_QzF6JXyRaO7CZ-bb5nhWY1avrryXYNjwKufdY9OBDJ9-zTnFV-Zn__HB3uaOxFVVvyIwopjInP6MMeMOQfIU3uo6TI8HOGWWZK-02wLcTbrdXtYp5Suoka46ZuRA Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 21ac2d8225b348f9b1e98206d0b9d290 Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FlavorsAccessNegativeTestJSON-1699667113 Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21ac2d8225b348f9b1e98206d0b9d290"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21ac2d8225b348f9b1e98206d0b9d290"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21ac2d8225b348f9b1e98206d0b9d290"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21ac2d8225b348f9b1e98206d0b9d290"}]}] Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FlavorsAccessNegativeTestJSON-1699667113 Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 21ac2d8225b348f9b1e98206d0b9d290 Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FlavorsAccessNegativeTestJSON-1699667113 Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 6663cbb468e14efb87c9ecb3733bcf8f Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: {"removeTenantAccess": {"tenant": "07ccbe60d03a492488426f1876f7a649"}} Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: exception: Flavor access not found for 40 / 07ccbe60d03a492488426f1876f7a649 combination. Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1713509398', 'body': {'removeTenantAccess': {'tenant': '07ccbe60d03a492488426f1876f7a649'}}} Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 104, in _remove_tenant_access Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi flavor.remove_access(tenant) Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 226, in wrapper Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(self, *args, **kwargs) Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 423, in remove_access Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._remove_access(project_id) Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 416, in _remove_access Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._flavor_del_project(self._context, self.id, project_id) Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 401, in _flavor_del_project Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return _flavor_del_project(context, flavor_id, project_id) Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 86, in _flavor_del_project Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.FlavorAccessNotFound(flavor_id=flavor_id, Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.FlavorAccessNotFound: Flavor access not found for 40 / 07ccbe60d03a492488426f1876f7a649 combination. Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:15:11.255226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavor_access.py", line 107, in _remove_tenant_access Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor access not found for 40 / 07ccbe60d03a492488426f1876f7a649 combination. Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor access not found for 40 / 07ccbe60d03a492488426f1876f7a649 combination. Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce28fe73-d11a-4745-b789-b0edd41bddff tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Returning 404 to user: Flavor access not found for 40 / 07ccbe60d03a492488426f1876f7a649 combination. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce28fe73-d11a-4745-b789-b0edd41bddff tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors/1713509398/action" status: 404 len: 124 microversion: 2.1 time: 0.303415 Oct 11 04:15:11.266490 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 697/1320] 10.222.0.26 () {60 vars in 1200 bytes} [Tue Oct 11 04:15:10 2022] POST /compute/v2.1/flavors/1713509398/action => generated 124 bytes in 305 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:15:11.284786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-66d6bf44-fdb4-4b61-9fc7-906d06007b2e tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:11.402575 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-66d6bf44-fdb4-4b61-9fc7-906d06007b2e tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1713509398" status: 202 len: 0 microversion: 2.1 time: 0.135921 Oct 11 04:15:11.403635 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 624/1321] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:15:11 2022] DELETE /compute/v2.1/flavors/1713509398 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:15:11.412669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c4116f3-ce60-4261-aa80-17e5a29a109e tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:11.481458 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c4116f3-ce60-4261-aa80-17e5a29a109e tempest-FlavorsAccessNegativeTestJSON-1699667113 tempest-FlavorsAccessNegativeTestJSON-1699667113-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.072660 Oct 11 04:15:11.482789 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 698/1322] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:15:11 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:11.655470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f32d5474-cdd0-4ebf-8cdd-3e9a20d8abb3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:11.656222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f32d5474-cdd0-4ebf-8cdd-3e9a20d8abb3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:11.669922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f32d5474-cdd0-4ebf-8cdd-3e9a20d8abb3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:11.672612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f32d5474-cdd0-4ebf-8cdd-3e9a20d8abb3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:11.674243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f32d5474-cdd0-4ebf-8cdd-3e9a20d8abb3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:11.676752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f32d5474-cdd0-4ebf-8cdd-3e9a20d8abb3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:11.678902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f32d5474-cdd0-4ebf-8cdd-3e9a20d8abb3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:11.679656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f32d5474-cdd0-4ebf-8cdd-3e9a20d8abb3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:11.713880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea1e8549-22be-4fb8-9c57-ea69714e2a8f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:11.714776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea1e8549-22be-4fb8-9c57-ea69714e2a8f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:11.729462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea1e8549-22be-4fb8-9c57-ea69714e2a8f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:11.731689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea1e8549-22be-4fb8-9c57-ea69714e2a8f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:11.732947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea1e8549-22be-4fb8-9c57-ea69714e2a8f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:11.735313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:11.738074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea1e8549-22be-4fb8-9c57-ea69714e2a8f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:11.738784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea1e8549-22be-4fb8-9c57-ea69714e2a8f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:11.740227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea1e8549-22be-4fb8-9c57-ea69714e2a8f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:11.940750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f32d5474-cdd0-4ebf-8cdd-3e9a20d8abb3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:11.952361 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f32d5474-cdd0-4ebf-8cdd-3e9a20d8abb3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1313 microversion: 2.1 time: 0.301173 Oct 11 04:15:11.958039 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 625/1323] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:11 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1313 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:11.969229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:11.970136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:11.986601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:11.998488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:11.999075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:11.999841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:12.000323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:12.013436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:12.152050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ea1e8549-22be-4fb8-9c57-ea69714e2a8f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:12.188330 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea1e8549-22be-4fb8-9c57-ea69714e2a8f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1479 microversion: 2.1 time: 0.479027 Oct 11 04:15:12.193727 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 699/1324] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:11 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1479 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:12.207172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:12.222343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:12.226274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:12.228402 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cdb1ee76-08ea-4f47-9fb1-a9e982ebdf88 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.269271 Oct 11 04:15:12.235777 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 626/1325] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:11 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:12.983581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-42bdc03b-0d84-4a92-b441-289ad3168928 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:12.986682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-42bdc03b-0d84-4a92-b441-289ad3168928 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:13.004586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42bdc03b-0d84-4a92-b441-289ad3168928 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:13.005561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42bdc03b-0d84-4a92-b441-289ad3168928 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:13.006180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42bdc03b-0d84-4a92-b441-289ad3168928 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:13.007009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42bdc03b-0d84-4a92-b441-289ad3168928 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:13.007468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42bdc03b-0d84-4a92-b441-289ad3168928 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:13.008012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42bdc03b-0d84-4a92-b441-289ad3168928 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:13.032772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce6bc5f0-d9f0-43b5-9883-946cf448dbf5 tempest-FloatingIPDetailsNegativeTestJSON-531459608 tempest-FloatingIPDetailsNegativeTestJSON-531459608-project] Calling method '.version_select at 0x7fda19a98af0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG neutronclient.v2_0.client [None req-ce6bc5f0-d9f0-43b5-9883-946cf448dbf5 tempest-FloatingIPDetailsNegativeTestJSON-531459608 tempest-FloatingIPDetailsNegativeTestJSON-531459608-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 347cc29a-6d7f-46f6-be7e-20db59dd7768 could not be found", "detail": ""}} {{(pid=120994) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ce6bc5f0-d9f0-43b5-9883-946cf448dbf5 tempest-FloatingIPDetailsNegativeTestJSON-531459608 tempest-FloatingIPDetailsNegativeTestJSON-531459608-project] HTTP exception thrown: Floating IP not found for ID 347cc29a-6d7f-46f6-be7e-20db59dd7768 Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce6bc5f0-d9f0-43b5-9883-946cf448dbf5 tempest-FloatingIPDetailsNegativeTestJSON-531459608 tempest-FloatingIPDetailsNegativeTestJSON-531459608-project] Request method failure captured: Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-floating-ips/347cc29a-6d7f-46f6-be7e-20db59dd7768 HTTP/1.1 Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO3QWLj6S4ZlcObwvJJtqCVZLTqCB5asE2zjkgwyHGAzpAdhb5pz62jvxgie13oILk4H9se45EJIqiy60DBCkBQDxDwL50DM6ITQSe8G99GHz1-Aro2ycHMyrUE6U4ckuwU0DGtAQi4aCDDkpVrggfDIqEFTZuiTvNBqYIqCjM8T2PQ Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 2b638ab8aa2b42b48a4b7b28ea39d515 Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FloatingIPDetailsNegativeTestJSON-531459608 Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2b638ab8aa2b42b48a4b7b28ea39d515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2b638ab8aa2b42b48a4b7b28ea39d515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b638ab8aa2b42b48a4b7b28ea39d515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2b638ab8aa2b42b48a4b7b28ea39d515"}]}] Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FloatingIPDetailsNegativeTestJSON-531459608 Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 2b638ab8aa2b42b48a4b7b28ea39d515 Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FloatingIPDetailsNegativeTestJSON-531459608 Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FloatingIPDetailsNegativeTestJSON-531459608-project Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 38c3648d494b4aae9a921b832363b4ea Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FloatingIPDetailsNegativeTestJSON-531459608-project Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: exception: Floating IP not found for ID 347cc29a-6d7f-46f6-be7e-20db59dd7768 Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '347cc29a-6d7f-46f6-be7e-20db59dd7768'} Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:15:13.127205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 347cc29a-6d7f-46f6-be7e-20db59dd7768 could not be found Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ee1f35fc-be14-4751-829a-3e457d1e210f'] Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 347cc29a-6d7f-46f6-be7e-20db59dd7768. Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 347cc29a-6d7f-46f6-be7e-20db59dd7768 Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 347cc29a-6d7f-46f6-be7e-20db59dd7768 Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce6bc5f0-d9f0-43b5-9883-946cf448dbf5 tempest-FloatingIPDetailsNegativeTestJSON-531459608 tempest-FloatingIPDetailsNegativeTestJSON-531459608-project] Returning 404 to user: Floating IP not found for ID 347cc29a-6d7f-46f6-be7e-20db59dd7768 {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce6bc5f0-d9f0-43b5-9883-946cf448dbf5 tempest-FloatingIPDetailsNegativeTestJSON-531459608 tempest-FloatingIPDetailsNegativeTestJSON-531459608-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/347cc29a-6d7f-46f6-be7e-20db59dd7768" status: 404 len: 111 microversion: 2.1 time: 0.421177 Oct 11 04:15:13.133133 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 700/1326] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:15:12 2022] GET /compute/v2.1/os-floating-ips/347cc29a-6d7f-46f6-be7e-20db59dd7768 => generated 111 bytes in 429 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:15:13.207420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e7730eb2-59e9-4edd-ae0d-832351d6ef62 req-24b875b6-1764-4d06-b098-a771bb614c4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72660709-ce51-4053-af08-b1cd828c95d4", "name": "network-vif-plugged", "status": "completed", "tag": "66639d0c-5518-4300-98e7-ab09ecbda154"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:13.250071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e7730eb2-59e9-4edd-ae0d-832351d6ef62 req-24b875b6-1764-4d06-b098-a771bb614c4a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:13.253387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-42bdc03b-0d84-4a92-b441-289ad3168928 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:13.253929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e7730eb2-59e9-4edd-ae0d-832351d6ef62 req-24b875b6-1764-4d06-b098-a771bb614c4a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:13.256015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e7730eb2-59e9-4edd-ae0d-832351d6ef62 req-24b875b6-1764-4d06-b098-a771bb614c4a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:13.267591 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-42bdc03b-0d84-4a92-b441-289ad3168928 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1313 microversion: 2.1 time: 0.288639 Oct 11 04:15:13.283261 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 627/1327] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:12 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:13.293569 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e7730eb2-59e9-4edd-ae0d-832351d6ef62 req-24b875b6-1764-4d06-b098-a771bb614c4a service nova] Creating event network-vif-plugged:66639d0c-5518-4300-98e7-ab09ecbda154 for instance 72660709-ce51-4053-af08-b1cd828c95d4 on n-h2-860892-1 Oct 11 04:15:13.306944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9924d785-63c5-47bc-a535-5266cd6c6856 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:13.307775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9924d785-63c5-47bc-a535-5266cd6c6856 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:13.315100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9924d785-63c5-47bc-a535-5266cd6c6856 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:13.315986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9924d785-63c5-47bc-a535-5266cd6c6856 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:13.316594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9924d785-63c5-47bc-a535-5266cd6c6856 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:13.322139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9924d785-63c5-47bc-a535-5266cd6c6856 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:13.322305 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e7730eb2-59e9-4edd-ae0d-832351d6ef62 req-24b875b6-1764-4d06-b098-a771bb614c4a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115849 Oct 11 04:15:13.322412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9924d785-63c5-47bc-a535-5266cd6c6856 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:13.322526 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 701/1328] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:15:13.322634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9924d785-63c5-47bc-a535-5266cd6c6856 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:13.351585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:13.358063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:13.391614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:13.393752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:13.397405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:13.399514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:13.401743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:13.402571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:13.638586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9924d785-63c5-47bc-a535-5266cd6c6856 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:13.657469 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9924d785-63c5-47bc-a535-5266cd6c6856 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1479 microversion: 2.1 time: 0.358651 Oct 11 04:15:13.658104 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 628/1329] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:13 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1479 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:13.682733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:13.696370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:13.704990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:13.710688 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5362e72b-3a14-47fe-a18a-c0facbdf8483 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.384324 Oct 11 04:15:13.712501 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 702/1330] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:13 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:14.296391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-54073d23-c347-43a0-b3a9-6a610e59bbf6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:14.297277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-54073d23-c347-43a0-b3a9-6a610e59bbf6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:14.316911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54073d23-c347-43a0-b3a9-6a610e59bbf6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:14.322470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54073d23-c347-43a0-b3a9-6a610e59bbf6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:14.322470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54073d23-c347-43a0-b3a9-6a610e59bbf6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:14.322470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54073d23-c347-43a0-b3a9-6a610e59bbf6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:14.322470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54073d23-c347-43a0-b3a9-6a610e59bbf6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:14.322470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54073d23-c347-43a0-b3a9-6a610e59bbf6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:14.552199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-54073d23-c347-43a0-b3a9-6a610e59bbf6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:14.561727 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-54073d23-c347-43a0-b3a9-6a610e59bbf6 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1313 microversion: 2.1 time: 0.269340 Oct 11 04:15:14.562339 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 629/1331] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:14 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:14.684105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1adf7279-1e6e-4902-aa9a-6e42d83d4de1 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:14.688990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1adf7279-1e6e-4902-aa9a-6e42d83d4de1 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:14.691347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1adf7279-1e6e-4902-aa9a-6e42d83d4de1 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:14.691997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1adf7279-1e6e-4902-aa9a-6e42d83d4de1 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:14.692614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1adf7279-1e6e-4902-aa9a-6e42d83d4de1 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:14.693472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1adf7279-1e6e-4902-aa9a-6e42d83d4de1 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:14.693921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1adf7279-1e6e-4902-aa9a-6e42d83d4de1 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:14.694396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1adf7279-1e6e-4902-aa9a-6e42d83d4de1 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:14.742214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:14.742942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:14.759060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:14.759651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:14.761007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:14.763371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:14.764101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:14.764756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:14.870011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:14.881009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:14.882990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:14.884695 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3deb0f88-3e2a-4fb7-9f32-569952e3eb53 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.146974 Oct 11 04:15:14.886258 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 630/1332] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:14 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:15.035969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1adf7279-1e6e-4902-aa9a-6e42d83d4de1 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:15.044254 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1adf7279-1e6e-4902-aa9a-6e42d83d4de1 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1479 microversion: 2.1 time: 0.364080 Oct 11 04:15:15.044870 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 703/1333] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:14 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1479 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:15.363603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c7cf0b36-af57-4e8a-afc7-1f1439080619 req-2ba71279-798e-4457-899c-f8e1a6e49bd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97202407-f542-4189-9582-1f1dd698c594", "name": "network-vif-plugged", "status": "completed", "tag": "dc8db1bd-a8a8-4b23-8837-a7b82504853f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:15.405787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c7cf0b36-af57-4e8a-afc7-1f1439080619 req-2ba71279-798e-4457-899c-f8e1a6e49bd9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:15.415178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c7cf0b36-af57-4e8a-afc7-1f1439080619 req-2ba71279-798e-4457-899c-f8e1a6e49bd9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:15.426819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c7cf0b36-af57-4e8a-afc7-1f1439080619 req-2ba71279-798e-4457-899c-f8e1a6e49bd9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:15.444083 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c7cf0b36-af57-4e8a-afc7-1f1439080619 req-2ba71279-798e-4457-899c-f8e1a6e49bd9 service nova] Creating event network-vif-plugged:dc8db1bd-a8a8-4b23-8837-a7b82504853f for instance 97202407-f542-4189-9582-1f1dd698c594 on n-h1-860892-1 Oct 11 04:15:15.461786 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c7cf0b36-af57-4e8a-afc7-1f1439080619 req-2ba71279-798e-4457-899c-f8e1a6e49bd9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107905 Oct 11 04:15:15.463626 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 631/1334] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:15.589228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-28a2f20e-d0ff-4924-84a2-5d9fc2892303 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:15.590047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-28a2f20e-d0ff-4924-84a2-5d9fc2892303 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:15.600947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28a2f20e-d0ff-4924-84a2-5d9fc2892303 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:15.602900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28a2f20e-d0ff-4924-84a2-5d9fc2892303 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:15.604792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28a2f20e-d0ff-4924-84a2-5d9fc2892303 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:15.606951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28a2f20e-d0ff-4924-84a2-5d9fc2892303 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:15.607618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28a2f20e-d0ff-4924-84a2-5d9fc2892303 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:15.610604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28a2f20e-d0ff-4924-84a2-5d9fc2892303 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:15.917242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:15.934565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-28a2f20e-d0ff-4924-84a2-5d9fc2892303 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:15.939078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:15.949048 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-28a2f20e-d0ff-4924-84a2-5d9fc2892303 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1462 microversion: 2.1 time: 0.365542 Oct 11 04:15:15.950361 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 704/1335] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:15 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1462 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:15.953918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:15.954451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:15.961728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:15.962510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:15.964150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:15.966026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:15.975460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3fa0234d-151a-4779-8d3b-0850a759c69b tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:15.976580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3fa0234d-151a-4779-8d3b-0850a759c69b tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:15.986400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fa0234d-151a-4779-8d3b-0850a759c69b tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:15.987035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fa0234d-151a-4779-8d3b-0850a759c69b tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:15.988216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fa0234d-151a-4779-8d3b-0850a759c69b tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:15.988862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fa0234d-151a-4779-8d3b-0850a759c69b tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:15.989669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fa0234d-151a-4779-8d3b-0850a759c69b tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:15.990165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fa0234d-151a-4779-8d3b-0850a759c69b tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:16.188990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:16.199578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:16.201820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:16.202929 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-556f7b69-3307-467c-b9be-2ec993933c09 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.294856 Oct 11 04:15:16.203967 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 632/1336] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:15 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:16.208980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-01906b04-34c9-4c7b-a315-4db049f238b7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:16.209798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-01906b04-34c9-4c7b-a315-4db049f238b7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:16.216096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01906b04-34c9-4c7b-a315-4db049f238b7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:16.216783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01906b04-34c9-4c7b-a315-4db049f238b7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:16.217359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01906b04-34c9-4c7b-a315-4db049f238b7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:16.219231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01906b04-34c9-4c7b-a315-4db049f238b7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:16.220133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01906b04-34c9-4c7b-a315-4db049f238b7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:16.220894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01906b04-34c9-4c7b-a315-4db049f238b7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:16.314623 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3fa0234d-151a-4779-8d3b-0850a759c69b tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1613 microversion: 2.1 time: 0.346407 Oct 11 04:15:16.328165 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 705/1337] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:15 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1613 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:16.345378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:16.345378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:16.351437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:16.352052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:16.352733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:16.353653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:16.354529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:16.355173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:16.386936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '4733b24a80eb4fe7ae779f43b0c83f3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acfdccb0c6a84bbf8dd51c4d8b2cf590', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:16.387822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] flavor_id is None. Assuming migration. {{(pid=120994) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 04:15:16.389742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120994) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 04:15:16.666940 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1655c23b-c54c-445b-bf1e-652e69ab2bba tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4/action" status: 202 len: 0 microversion: 2.1 time: 0.325279 Oct 11 04:15:16.668578 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 706/1338] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:15:16 2022] POST /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4/action => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:15:16.677138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-763ffc02-6b84-46c9-97b5-1da60eacfa0b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:16.678119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-763ffc02-6b84-46c9-97b5-1da60eacfa0b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:16.692944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-763ffc02-6b84-46c9-97b5-1da60eacfa0b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:16.694471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-763ffc02-6b84-46c9-97b5-1da60eacfa0b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:16.696624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-763ffc02-6b84-46c9-97b5-1da60eacfa0b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:16.700096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-763ffc02-6b84-46c9-97b5-1da60eacfa0b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:16.701482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-763ffc02-6b84-46c9-97b5-1da60eacfa0b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:16.704224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-763ffc02-6b84-46c9-97b5-1da60eacfa0b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:16.890438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-763ffc02-6b84-46c9-97b5-1da60eacfa0b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:16.902740 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-763ffc02-6b84-46c9-97b5-1da60eacfa0b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1471 microversion: 2.1 time: 0.230152 Oct 11 04:15:16.919075 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 707/1339] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:16 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1471 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:16.961460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-01906b04-34c9-4c7b-a315-4db049f238b7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:16.972510 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-01906b04-34c9-4c7b-a315-4db049f238b7 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1479 microversion: 2.1 time: 0.766905 Oct 11 04:15:16.973240 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 633/1340] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:16 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1479 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:17.230741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:17.232521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:17.246269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:17.249540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:17.250612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:17.251696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:17.253776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:17.256473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:17.437278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:17.447700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:17.450072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:17.451467 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a44454b-1f53-4667-be6d-8ecc95141ed3 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.226178 Oct 11 04:15:17.452787 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 708/1341] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:17 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:17.935036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-768ce66c-ab17-4e29-8056-1e7eecd00c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:17.935743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-768ce66c-ab17-4e29-8056-1e7eecd00c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:17.948013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768ce66c-ab17-4e29-8056-1e7eecd00c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:17.948822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768ce66c-ab17-4e29-8056-1e7eecd00c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:17.949458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768ce66c-ab17-4e29-8056-1e7eecd00c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:17.950426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768ce66c-ab17-4e29-8056-1e7eecd00c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:17.951116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768ce66c-ab17-4e29-8056-1e7eecd00c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:17.952031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-768ce66c-ab17-4e29-8056-1e7eecd00c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:17.996807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43a7d550-c34e-43a1-937b-161fd5daef08 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:17.997462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-43a7d550-c34e-43a1-937b-161fd5daef08 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:18.007075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43a7d550-c34e-43a1-937b-161fd5daef08 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:18.007570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43a7d550-c34e-43a1-937b-161fd5daef08 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:18.008085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43a7d550-c34e-43a1-937b-161fd5daef08 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:18.008701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43a7d550-c34e-43a1-937b-161fd5daef08 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:18.014874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43a7d550-c34e-43a1-937b-161fd5daef08 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:18.015312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43a7d550-c34e-43a1-937b-161fd5daef08 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:18.065414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:18.292972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-43a7d550-c34e-43a1-937b-161fd5daef08 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:18.314220 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-43a7d550-c34e-43a1-937b-161fd5daef08 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1464 microversion: 2.1 time: 0.321559 Oct 11 04:15:18.316333 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 709/1342] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:17 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1464 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:18.368290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f1dbfd76-d62a-4c4d-bcbe-339d113b48df tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:18.376902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f1dbfd76-d62a-4c4d-bcbe-339d113b48df tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:18.399776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dbfd76-d62a-4c4d-bcbe-339d113b48df tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:18.404493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dbfd76-d62a-4c4d-bcbe-339d113b48df tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:18.405336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dbfd76-d62a-4c4d-bcbe-339d113b48df tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:18.407095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-768ce66c-ab17-4e29-8056-1e7eecd00c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:18.409684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dbfd76-d62a-4c4d-bcbe-339d113b48df tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:18.413512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dbfd76-d62a-4c4d-bcbe-339d113b48df tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:18.414151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dbfd76-d62a-4c4d-bcbe-339d113b48df tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:18.420096 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-768ce66c-ab17-4e29-8056-1e7eecd00c4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1471 microversion: 2.1 time: 0.496254 Oct 11 04:15:18.420703 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 634/1343] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:17 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1471 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:18.480984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:18.481593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:18.488953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:18.489436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:18.489876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:18.490609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:18.491060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:18.499266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:18.661861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:18.677506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:18.688292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:18.692462 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c024281a-c6bb-4cc1-b3ad-03eea1d03aca tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.215370 Oct 11 04:15:18.696181 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 635/1344] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:18 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:18.884080 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f1dbfd76-d62a-4c4d-bcbe-339d113b48df tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action" status: 202 len: 0 microversion: 2.1 time: 0.532351 Oct 11 04:15:18.884870 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 710/1345] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:15:18 2022] POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:15:18.903149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:18.906628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:18.922106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:18.922750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:18.923791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:18.925523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:18.927616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:18.928145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:18.986250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:18.987432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:18.987880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:18.988348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lazy-loading 'fault' on Instance uuid 97202407-f542-4189-9582-1f1dd698c594 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:15:19.336222 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-beb039cc-c056-4e8f-a4ff-ab78c7d84f4b tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1598 microversion: 2.1 time: 0.445550 Oct 11 04:15:19.338100 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 636/1346] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:18 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1598 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:19.359636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f99d336f-96a8-4e96-bea1-8658526ea336 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "active"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:19.364114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f99d336f-96a8-4e96-bea1-8658526ea336 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:19.373211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f99d336f-96a8-4e96-bea1-8658526ea336 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:19.377461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f99d336f-96a8-4e96-bea1-8658526ea336 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:19.378223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f99d336f-96a8-4e96-bea1-8658526ea336 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:19.380207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f99d336f-96a8-4e96-bea1-8658526ea336 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:19.382581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f99d336f-96a8-4e96-bea1-8658526ea336 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:19.383189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f99d336f-96a8-4e96-bea1-8658526ea336 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:19.450922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7858d29e-eb90-456a-938d-f6738ed513f9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:19.450922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7858d29e-eb90-456a-938d-f6738ed513f9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:19.461864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7858d29e-eb90-456a-938d-f6738ed513f9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:19.462935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7858d29e-eb90-456a-938d-f6738ed513f9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:19.463542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7858d29e-eb90-456a-938d-f6738ed513f9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:19.464580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7858d29e-eb90-456a-938d-f6738ed513f9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:19.477784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7858d29e-eb90-456a-938d-f6738ed513f9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:19.482223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7858d29e-eb90-456a-938d-f6738ed513f9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:19.786705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7858d29e-eb90-456a-938d-f6738ed513f9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:19.801941 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7858d29e-eb90-456a-938d-f6738ed513f9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1471 microversion: 2.1 time: 0.357893 Oct 11 04:15:19.810379 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 637/1347] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:19 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1471 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:19.838831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:19.840265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:19.853311 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f99d336f-96a8-4e96-bea1-8658526ea336 tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action" status: 202 len: 0 microversion: 2.1 time: 0.498193 Oct 11 04:15:19.857336 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 711/1348] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:15:19 2022] POST /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:15:19.862984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5f067f2-bfdd-4064-acc4-3ba5641346db tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:19.863820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5f067f2-bfdd-4064-acc4-3ba5641346db tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:19.878433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:19.878963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:19.879408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:19.883409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:19.886813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f067f2-bfdd-4064-acc4-3ba5641346db tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:19.887173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:19.887838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f067f2-bfdd-4064-acc4-3ba5641346db tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:19.894360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f067f2-bfdd-4064-acc4-3ba5641346db tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:19.894360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f067f2-bfdd-4064-acc4-3ba5641346db tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:19.894360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f067f2-bfdd-4064-acc4-3ba5641346db tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:19.894360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f067f2-bfdd-4064-acc4-3ba5641346db tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:19.894786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:20.105289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:20.124054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:20.127993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:20.129235 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f5168942-c9fa-4276-85c1-e19d35eda319 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.317645 Oct 11 04:15:20.130050 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 638/1349] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:19 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:20.276098 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5f067f2-bfdd-4064-acc4-3ba5641346db tempest-ServersAdminTestJSON-1317855471 tempest-ServersAdminTestJSON-1317855471-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1615 microversion: 2.1 time: 0.417520 Oct 11 04:15:20.279523 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 712/1350] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:19 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1615 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:20.317170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f4775e0-e052-4180-9057-56cd0dfd67f3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:20.317170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f4775e0-e052-4180-9057-56cd0dfd67f3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:20.319059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f4775e0-e052-4180-9057-56cd0dfd67f3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:20.320064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f4775e0-e052-4180-9057-56cd0dfd67f3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:20.320887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f4775e0-e052-4180-9057-56cd0dfd67f3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:20.321769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f4775e0-e052-4180-9057-56cd0dfd67f3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:20.325676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f4775e0-e052-4180-9057-56cd0dfd67f3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:20.326380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f4775e0-e052-4180-9057-56cd0dfd67f3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:20.362919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f4775e0-e052-4180-9057-56cd0dfd67f3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:15:20.835098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c5a9284-6a2a-4966-b262-b1972a3ed82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:20.835816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2c5a9284-6a2a-4966-b262-b1972a3ed82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:20.854489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5a9284-6a2a-4966-b262-b1972a3ed82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:20.856893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5a9284-6a2a-4966-b262-b1972a3ed82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:20.859094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5a9284-6a2a-4966-b262-b1972a3ed82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:20.860107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5a9284-6a2a-4966-b262-b1972a3ed82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:20.867792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5a9284-6a2a-4966-b262-b1972a3ed82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:20.868348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5a9284-6a2a-4966-b262-b1972a3ed82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:21.089948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2c5a9284-6a2a-4966-b262-b1972a3ed82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:21.100182 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c5a9284-6a2a-4966-b262-b1972a3ed82e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1471 microversion: 2.1 time: 0.273451 Oct 11 04:15:21.101369 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 713/1351] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:20 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1471 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:21.307832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a630915-bfe3-4a1e-b075-d26e9440954b tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Calling method '.version_select at 0x7fda19ad65e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:21.311996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a630915-bfe3-4a1e-b075-d26e9440954b tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:21.316884 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f4775e0-e052-4180-9057-56cd0dfd67f3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 204 len: 0 microversion: 2.1 time: 1.005407 Oct 11 04:15:21.316884 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 639/1352] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:15:20 2022] DELETE /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 0 bytes in 1007 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:15:21.317500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a630915-bfe3-4a1e-b075-d26e9440954b tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:21.317500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a630915-bfe3-4a1e-b075-d26e9440954b tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:21.319681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:21.324004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:21.338335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:21.339111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=86,nova_api:DELETE=11,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:21.342311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:21.342469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a630915-bfe3-4a1e-b075-d26e9440954b tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:21.343321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a630915-bfe3-4a1e-b075-d26e9440954b tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:21.343730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:21.344532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a630915-bfe3-4a1e-b075-d26e9440954b tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:21.344916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:21.346366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:21.348216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:21.361047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a630915-bfe3-4a1e-b075-d26e9440954b tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:21.361954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a630915-bfe3-4a1e-b075-d26e9440954b tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:21.362578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a630915-bfe3-4a1e-b075-d26e9440954b tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:21.379229 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a630915-bfe3-4a1e-b075-d26e9440954b tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.276203 Oct 11 04:15:21.390161 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 714/1353] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:15:21 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:21.400610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13983543-7ec8-4e13-ba00-a5d8a5bb8f16 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:21.403559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-13983543-7ec8-4e13-ba00-a5d8a5bb8f16 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:21.416501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13983543-7ec8-4e13-ba00-a5d8a5bb8f16 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:21.419851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13983543-7ec8-4e13-ba00-a5d8a5bb8f16 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:21.420559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13983543-7ec8-4e13-ba00-a5d8a5bb8f16 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:21.424249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13983543-7ec8-4e13-ba00-a5d8a5bb8f16 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:21.425588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13983543-7ec8-4e13-ba00-a5d8a5bb8f16 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:21.427551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13983543-7ec8-4e13-ba00-a5d8a5bb8f16 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:21.785024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-13983543-7ec8-4e13-ba00-a5d8a5bb8f16 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:21.796694 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-13983543-7ec8-4e13-ba00-a5d8a5bb8f16 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1469 microversion: 2.1 time: 0.402919 Oct 11 04:15:21.803919 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 715/1354] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:21 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1469 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:21.819083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1be4ac7b-4745-4573-9154-ddf98ee4661d tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Calling method '.version_select at 0x7fda1e1441f0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:21.821282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1be4ac7b-4745-4573-9154-ddf98ee4661d tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:21.821951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1be4ac7b-4745-4573-9154-ddf98ee4661d tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:21.822538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1be4ac7b-4745-4573-9154-ddf98ee4661d tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:21.896492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1be4ac7b-4745-4573-9154-ddf98ee4661d tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:21.898958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1be4ac7b-4745-4573-9154-ddf98ee4661d tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:21.910269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1be4ac7b-4745-4573-9154-ddf98ee4661d tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:21.976350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1be4ac7b-4745-4573-9154-ddf98ee4661d tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:21.976968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1be4ac7b-4745-4573-9154-ddf98ee4661d tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:21.983590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1be4ac7b-4745-4573-9154-ddf98ee4661d tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:21.999127 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1be4ac7b-4745-4573-9154-ddf98ee4661d tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h2-860892-1/servers" status: 200 len: 670 microversion: 2.1 time: 0.192858 Oct 11 04:15:22.001111 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 716/1355] 10.222.0.26 () {58 vars in 1212 bytes} [Tue Oct 11 04:15:21 2022] GET /compute/v2.1/os-hypervisors/n-h2-860892-1/servers => generated 670 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:22.023891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6b10a300-67e2-4990-8ed1-eab0a5452b42 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Calling method '.version_select at 0x7fda19d80ca0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:22.026308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b10a300-67e2-4990-8ed1-eab0a5452b42 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:22.027414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b10a300-67e2-4990-8ed1-eab0a5452b42 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:22.028036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b10a300-67e2-4990-8ed1-eab0a5452b42 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:22.043283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:22.043835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b10a300-67e2-4990-8ed1-eab0a5452b42 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:22.046909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:22.050000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b10a300-67e2-4990-8ed1-eab0a5452b42 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:22.050561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b10a300-67e2-4990-8ed1-eab0a5452b42 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:22.056954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:22.056954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:22.056954 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3d096979-2b4c-4898-a2a7-611f993e7eba tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.742665 Oct 11 04:15:22.069716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b10a300-67e2-4990-8ed1-eab0a5452b42 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:22.070636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b10a300-67e2-4990-8ed1-eab0a5452b42 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:22.071288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b10a300-67e2-4990-8ed1-eab0a5452b42 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:22.077912 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6b10a300-67e2-4990-8ed1-eab0a5452b42 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.067847 Oct 11 04:15:22.082351 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 717/1356] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:15:22 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:22.084795 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 640/1357] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:21 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:22.100854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f9595975-01ed-4412-99d3-23f03952a342 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Calling method '.version_select at 0x7fda19b03820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:22.104150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9595975-01ed-4412-99d3-23f03952a342 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:22.105462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9595975-01ed-4412-99d3-23f03952a342 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:22.106376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9595975-01ed-4412-99d3-23f03952a342 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:22.129597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e8fb5f8-49ee-4424-b9ae-3238c8bcbce8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:22.130599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9e8fb5f8-49ee-4424-b9ae-3238c8bcbce8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:22.143483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e8fb5f8-49ee-4424-b9ae-3238c8bcbce8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:22.143483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e8fb5f8-49ee-4424-b9ae-3238c8bcbce8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:22.143483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e8fb5f8-49ee-4424-b9ae-3238c8bcbce8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:22.143747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9595975-01ed-4412-99d3-23f03952a342 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:22.143747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9595975-01ed-4412-99d3-23f03952a342 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:22.143747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9595975-01ed-4412-99d3-23f03952a342 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:22.143981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e8fb5f8-49ee-4424-b9ae-3238c8bcbce8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:22.144062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e8fb5f8-49ee-4424-b9ae-3238c8bcbce8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:22.144450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e8fb5f8-49ee-4424-b9ae-3238c8bcbce8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:22.161735 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f9595975-01ed-4412-99d3-23f03952a342 tempest-HypervisorAdminUnderV252Test-43066717 tempest-HypervisorAdminUnderV252Test-43066717-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors/n-h2-860892-1/search" status: 200 len: 104 microversion: 2.1 time: 0.071910 Oct 11 04:15:22.162762 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 718/1358] 10.222.0.26 () {58 vars in 1209 bytes} [Tue Oct 11 04:15:22 2022] GET /compute/v2.1/os-hypervisors/n-h2-860892-1/search => generated 104 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:22.823543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e6316f3-fb37-4e16-bf99-463f63fab1dd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:22.824171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e6316f3-fb37-4e16-bf99-463f63fab1dd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:22.836907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9e8fb5f8-49ee-4424-b9ae-3238c8bcbce8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:22.856922 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9e8fb5f8-49ee-4424-b9ae-3238c8bcbce8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.729934 Oct 11 04:15:22.856922 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 641/1359] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:22 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:22.861689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6316f3-fb37-4e16-bf99-463f63fab1dd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:22.865262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6316f3-fb37-4e16-bf99-463f63fab1dd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:22.865953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6316f3-fb37-4e16-bf99-463f63fab1dd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:22.872435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6316f3-fb37-4e16-bf99-463f63fab1dd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:22.872926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6316f3-fb37-4e16-bf99-463f63fab1dd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:22.873362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6316f3-fb37-4e16-bf99-463f63fab1dd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:23.093408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:23.094020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:23.107757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:23.111184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:23.114966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:23.116136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:23.116604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:23.117030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:23.300915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:23.312205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:23.318064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:23.318064 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ddec41b-2042-492b-8e5a-a29d9e21b27a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.227171 Oct 11 04:15:23.318064 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 642/1360] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:23 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:15:23.403859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e6316f3-fb37-4e16-bf99-463f63fab1dd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:23.414035 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e6316f3-fb37-4e16-bf99-463f63fab1dd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1469 microversion: 2.1 time: 0.595343 Oct 11 04:15:23.417857 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 719/1361] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:22 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1469 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:23.883210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-44b060ba-aaa6-469e-a133-6809357551bf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:23.884553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-44b060ba-aaa6-469e-a133-6809357551bf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:23.891903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44b060ba-aaa6-469e-a133-6809357551bf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:23.893635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44b060ba-aaa6-469e-a133-6809357551bf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:23.894368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44b060ba-aaa6-469e-a133-6809357551bf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:23.895333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44b060ba-aaa6-469e-a133-6809357551bf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:23.896003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44b060ba-aaa6-469e-a133-6809357551bf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:23.896664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44b060ba-aaa6-469e-a133-6809357551bf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:24.246789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-68b84d93-f8ed-488b-b774-0b29d4aee457 req-2672e01e-50d2-4121-822f-c4d71b8e2889 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2078125-aecf-40d1-9ea7-cf38ca95c2b4", "name": "network-vif-deleted", "tag": "14238ed7-9517-4b09-8d5d-05820caebb7d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:24.310272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-68b84d93-f8ed-488b-b774-0b29d4aee457 req-2672e01e-50d2-4121-822f-c4d71b8e2889 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:24.313114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-68b84d93-f8ed-488b-b774-0b29d4aee457 req-2672e01e-50d2-4121-822f-c4d71b8e2889 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:24.313114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-68b84d93-f8ed-488b-b774-0b29d4aee457 req-2672e01e-50d2-4121-822f-c4d71b8e2889 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:24.326143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-68b84d93-f8ed-488b-b774-0b29d4aee457 req-2672e01e-50d2-4121-822f-c4d71b8e2889 service nova] Creating event network-vif-deleted:14238ed7-9517-4b09-8d5d-05820caebb7d for instance a2078125-aecf-40d1-9ea7-cf38ca95c2b4 on n-h1-860892-1 Oct 11 04:15:24.335137 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-68b84d93-f8ed-488b-b774-0b29d4aee457 req-2672e01e-50d2-4121-822f-c4d71b8e2889 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101081 Oct 11 04:15:24.337186 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 720/1362] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:15:24.353491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:24.355064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:24.368199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:24.368199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:24.368199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:24.369252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:24.370090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:24.370710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:24.428281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-44b060ba-aaa6-469e-a133-6809357551bf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:24.441564 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-44b060ba-aaa6-469e-a133-6809357551bf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.565183 Oct 11 04:15:24.453184 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 643/1363] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:23 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:24.453184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-045102ca-f9ab-4a14-9930-53d13551dd8b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:24.453184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-045102ca-f9ab-4a14-9930-53d13551dd8b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:24.463168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-045102ca-f9ab-4a14-9930-53d13551dd8b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:24.463753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-045102ca-f9ab-4a14-9930-53d13551dd8b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:24.464217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-045102ca-f9ab-4a14-9930-53d13551dd8b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:24.464951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-045102ca-f9ab-4a14-9930-53d13551dd8b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:24.465406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-045102ca-f9ab-4a14-9930-53d13551dd8b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:24.465838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-045102ca-f9ab-4a14-9930-53d13551dd8b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:24.627068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:24.650581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:24.655971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:24.657771 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c839d9b-5718-4633-b889-9f7d6af4e4a4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.317707 Oct 11 04:15:24.658386 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 721/1364] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:24 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:24.716560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-045102ca-f9ab-4a14-9930-53d13551dd8b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:24.742696 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-045102ca-f9ab-4a14-9930-53d13551dd8b tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1298 microversion: 2.1 time: 0.294628 Oct 11 04:15:24.760434 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 644/1365] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:24 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1298 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:25.468762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d73599f-6859-409d-bbb3-7f46ae3a873b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:25.469647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4d73599f-6859-409d-bbb3-7f46ae3a873b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:25.476917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d73599f-6859-409d-bbb3-7f46ae3a873b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:25.477825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d73599f-6859-409d-bbb3-7f46ae3a873b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:25.478567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d73599f-6859-409d-bbb3-7f46ae3a873b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:25.479540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d73599f-6859-409d-bbb3-7f46ae3a873b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:25.480247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d73599f-6859-409d-bbb3-7f46ae3a873b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:25.480862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d73599f-6859-409d-bbb3-7f46ae3a873b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:25.676033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4d73599f-6859-409d-bbb3-7f46ae3a873b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:25.684779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:25.685394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:25.693673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:25.694155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:25.694634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:25.695531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:25.695977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:25.696397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:25.697507 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4d73599f-6859-409d-bbb3-7f46ae3a873b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.233470 Oct 11 04:15:25.712183 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 722/1366] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:25 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:25.769719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:25.769983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:25.769983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:25.776853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:25.777358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:25.777987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:25.778729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:25.779185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:25.779613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:25.780319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:25.781821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:25.784186 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-75b88080-e504-4669-9a88-8c66c86cb260 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.103824 Oct 11 04:15:25.786048 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 645/1367] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:25 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:15:25.804108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:25.819501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:25.819980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:25.820409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:25.820855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lazy-loading 'fault' on Instance uuid a2078125-aecf-40d1-9ea7-cf38ca95c2b4 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:15:25.862842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:25.870906 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a41dee4-fafe-47d0-8b9f-8068f66397e3 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 200 len: 1303 microversion: 2.1 time: 0.106199 Oct 11 04:15:25.872005 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 723/1368] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:25 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 1303 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:26.726092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-82e759c9-69e3-4815-8c0d-8428924a111c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:26.727405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-82e759c9-69e3-4815-8c0d-8428924a111c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:26.735435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e759c9-69e3-4815-8c0d-8428924a111c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:26.737527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e759c9-69e3-4815-8c0d-8428924a111c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:26.737527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e759c9-69e3-4815-8c0d-8428924a111c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:26.738623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e759c9-69e3-4815-8c0d-8428924a111c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:26.739286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e759c9-69e3-4815-8c0d-8428924a111c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:26.739723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e759c9-69e3-4815-8c0d-8428924a111c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:26.813991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:26.814718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:26.835751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:26.836441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:26.837390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:26.838130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:26.838615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:26.841959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:27.076984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-82e759c9-69e3-4815-8c0d-8428924a111c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:27.087049 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-82e759c9-69e3-4815-8c0d-8428924a111c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.364696 Oct 11 04:15:27.098356 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 646/1369] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:26 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:27.107600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:27.108476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: a2078125-aecf-40d1-9ea7-cf38ca95c2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:27.114989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:27.115792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:27.116717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:27.117603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:27.118260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:27.118855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:27.144984 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] HTTP exception thrown: Instance a2078125-aecf-40d1-9ea7-cf38ca95c2b4 could not be found. Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Request method failure captured: Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 HTTP/1.1 Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO1HwfrbLRZONdcl1o03Ne0N-0INxCpbD3toEI5Pc1Qj5V6GycpHZOAeXHpt0b2VTbCqAuevZTLkjMDPKn7FlDHmxIcpUppAD-8tX1fob6JaKHVTtnr0tzrOYpIXW9qLDVYFMyA5HgXkjc5pDsppzv2_QfO_LzJex71Mp1IsFDAACss Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 3a6a41baf5e342e595051a329ba6ea18 Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAdminTestJSON-1250631818 Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a6a41baf5e342e595051a329ba6ea18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a6a41baf5e342e595051a329ba6ea18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a6a41baf5e342e595051a329ba6ea18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a6a41baf5e342e595051a329ba6ea18"}]}] Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAdminTestJSON-1250631818 Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 3a6a41baf5e342e595051a329ba6ea18 Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAdminTestJSON-1250631818 Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAdminTestJSON-1250631818-project Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 748ffa73f06244f3a8f2b14f81f486e0 Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAdminTestJSON-1250631818-project Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance a2078125-aecf-40d1-9ea7-cf38ca95c2b4 could not be found. Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'a2078125-aecf-40d1-9ea7-cf38ca95c2b4'} Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2078125-aecf-40d1-9ea7-cf38ca95c2b4 could not be found. Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2078125-aecf-40d1-9ea7-cf38ca95c2b4 could not be found. Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:27.147156 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:27.159570 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:27.159570 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:27.159570 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:27.159570 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:15:27.159570 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:15:27.159570 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2078125-aecf-40d1-9ea7-cf38ca95c2b4 could not be found. Oct 11 04:15:27.159570 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:27.159570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Returning 404 to user: Instance a2078125-aecf-40d1-9ea7-cf38ca95c2b4 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:15:27.159570 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-29a9e942-8c31-4d2d-b946-c148c1455e2f tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4" status: 404 len: 111 microversion: 2.1 time: 0.049036 Oct 11 04:15:27.159570 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 647/1370] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:27 2022] GET /compute/v2.1/servers/a2078125-aecf-40d1-9ea7-cf38ca95c2b4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:15:27.348248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:27.360377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:27.364001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-1919323252", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "771b531d-e085-4be0-a5db-f8ca98902475"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:27.366315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:27.368710 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-35a2f4a6-ff15-4e2f-ad9c-3133332c1d84 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.560156 Oct 11 04:15:27.377934 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 724/1371] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:26 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:27.403565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bfbee004-7755-4ce4-9d01-aa37a90aeecd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:27.404501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bfbee004-7755-4ce4-9d01-aa37a90aeecd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:27.423419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfbee004-7755-4ce4-9d01-aa37a90aeecd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:27.423977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfbee004-7755-4ce4-9d01-aa37a90aeecd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:27.432840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfbee004-7755-4ce4-9d01-aa37a90aeecd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:27.433638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfbee004-7755-4ce4-9d01-aa37a90aeecd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:27.434119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfbee004-7755-4ce4-9d01-aa37a90aeecd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:27.436263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfbee004-7755-4ce4-9d01-aa37a90aeecd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:27.454930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] validate_networks() for [('771b531d-e085-4be0-a5db-f8ca98902475', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:15:27.504879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bfbee004-7755-4ce4-9d01-aa37a90aeecd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:15:28.055577 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bfbee004-7755-4ce4-9d01-aa37a90aeecd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "DELETE /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 204 len: 0 microversion: 2.1 time: 0.675138 Oct 11 04:15:28.056611 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 725/1372] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:15:27 2022] DELETE /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:15:28.065401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c00777b7-b2b8-4ac8-aba9-f2c51d8af762 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:28.067199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c00777b7-b2b8-4ac8-aba9-f2c51d8af762 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:28.081860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c00777b7-b2b8-4ac8-aba9-f2c51d8af762 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:28.082637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c00777b7-b2b8-4ac8-aba9-f2c51d8af762 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:28.083437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c00777b7-b2b8-4ac8-aba9-f2c51d8af762 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:28.084766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c00777b7-b2b8-4ac8-aba9-f2c51d8af762 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:28.085399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c00777b7-b2b8-4ac8-aba9-f2c51d8af762 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:28.086228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c00777b7-b2b8-4ac8-aba9-f2c51d8af762 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:28.309004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:15:28.312828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:15:28.312828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:15:28.312828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:15:28.313682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:15:28.338939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:28.340038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:28.341600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:28.343914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:28.347751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:28.349808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:28.399166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c00777b7-b2b8-4ac8-aba9-f2c51d8af762 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:28.401139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Getting quotas for project 26ea13948bbf479386c8b9ee5e1aa5cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:15:28.405825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Getting quotas for user ab384b5b9a1b484bb001a06b0998f680 and project 26ea13948bbf479386c8b9ee5e1aa5cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:15:28.406792 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c00777b7-b2b8-4ac8-aba9-f2c51d8af762 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1470 microversion: 2.1 time: 0.345515 Oct 11 04:15:28.420384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:15:28.426529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:15:28.427297 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 726/1373] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:28 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1470 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:28.432301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e7520dd2-6817-454f-81f6-48c3895460b5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:28.432921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e7520dd2-6817-454f-81f6-48c3895460b5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:28.450521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7520dd2-6817-454f-81f6-48c3895460b5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:28.451570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7520dd2-6817-454f-81f6-48c3895460b5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:28.452211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7520dd2-6817-454f-81f6-48c3895460b5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:28.453138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7520dd2-6817-454f-81f6-48c3895460b5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:28.457626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7520dd2-6817-454f-81f6-48c3895460b5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:28.458385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7520dd2-6817-454f-81f6-48c3895460b5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:28.548249 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09a9ed11-9c60-4499-b979-f33595762712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.396934 Oct 11 04:15:28.555736 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 648/1374] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:15:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1406 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:15:28.563711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:28.569351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:28.587535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:28.588538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:28.595407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:28.597089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:28.597722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:28.598339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:28.680927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:28.692912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:28.694949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:28.696663 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c2a1de41-787f-4f38-a2f9-d39df11794f9 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.139294 Oct 11 04:15:28.710429 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 649/1375] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:28 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:28.714444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4ba307c1-44c0-4ed5-8c60-c4638f39f47d tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:28.722601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4ba307c1-44c0-4ed5-8c60-c4638f39f47d tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:28.727586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=6,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:28.790881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ba307c1-44c0-4ed5-8c60-c4638f39f47d tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:28.801335 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4ba307c1-44c0-4ed5-8c60-c4638f39f47d tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1224 microversion: 2.1 time: 0.095221 Oct 11 04:15:28.811154 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 650/1376] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:28 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:28.851202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7520dd2-6817-454f-81f6-48c3895460b5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:28.861378 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e7520dd2-6817-454f-81f6-48c3895460b5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.432570 Oct 11 04:15:28.862836 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 727/1377] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:28 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:29.437309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3d20ab14-3b6d-4b44-97ee-5a5d7870b833 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:29.438370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3d20ab14-3b6d-4b44-97ee-5a5d7870b833 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:29.448521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d20ab14-3b6d-4b44-97ee-5a5d7870b833 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:29.449113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d20ab14-3b6d-4b44-97ee-5a5d7870b833 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:29.450097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d20ab14-3b6d-4b44-97ee-5a5d7870b833 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:29.451108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d20ab14-3b6d-4b44-97ee-5a5d7870b833 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:29.451817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d20ab14-3b6d-4b44-97ee-5a5d7870b833 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:29.452498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d20ab14-3b6d-4b44-97ee-5a5d7870b833 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:29.683540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d20ab14-3b6d-4b44-97ee-5a5d7870b833 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:29.694367 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3d20ab14-3b6d-4b44-97ee-5a5d7870b833 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1470 microversion: 2.1 time: 0.263689 Oct 11 04:15:29.695755 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 651/1378] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:29 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1470 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:29.724510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:29.725128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:29.743036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:29.750227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:29.753797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:29.759532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:29.760020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:29.760886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:29.826028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-97b7a84e-9dfa-4021-b7b4-fbd37f615531 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:29.826690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-97b7a84e-9dfa-4021-b7b4-fbd37f615531 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:29.972483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:29.984740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:29.992904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:29.994980 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb64c1bc-01d5-4aaa-a5ab-0474b545a62f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.274928 Oct 11 04:15:29.998155 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 728/1379] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:29 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:30.006743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-97b7a84e-9dfa-4021-b7b4-fbd37f615531 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:30.008676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4e0b982b-6746-41fc-b5a5-a77cfa765e2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:30.011260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4e0b982b-6746-41fc-b5a5-a77cfa765e2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:30.016827 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-97b7a84e-9dfa-4021-b7b4-fbd37f615531 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1224 microversion: 2.1 time: 0.195638 Oct 11 04:15:30.022743 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 652/1380] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:29 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1224 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:30.030755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e0b982b-6746-41fc-b5a5-a77cfa765e2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:30.031554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e0b982b-6746-41fc-b5a5-a77cfa765e2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:30.033792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e0b982b-6746-41fc-b5a5-a77cfa765e2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:30.035059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e0b982b-6746-41fc-b5a5-a77cfa765e2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:30.035865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e0b982b-6746-41fc-b5a5-a77cfa765e2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:30.036833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e0b982b-6746-41fc-b5a5-a77cfa765e2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:30.384699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4e0b982b-6746-41fc-b5a5-a77cfa765e2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:30.396072 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4e0b982b-6746-41fc-b5a5-a77cfa765e2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.396495 Oct 11 04:15:30.398891 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 729/1381] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:29 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:30.718229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a78ce743-8acc-4555-a780-946f0d35bfa2 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:30.719811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a78ce743-8acc-4555-a780-946f0d35bfa2 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:30.733964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a78ce743-8acc-4555-a780-946f0d35bfa2 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:30.734899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a78ce743-8acc-4555-a780-946f0d35bfa2 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:30.735578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a78ce743-8acc-4555-a780-946f0d35bfa2 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:30.737101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a78ce743-8acc-4555-a780-946f0d35bfa2 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:30.738002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a78ce743-8acc-4555-a780-946f0d35bfa2 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:30.738886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a78ce743-8acc-4555-a780-946f0d35bfa2 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:31.251082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a78ce743-8acc-4555-a780-946f0d35bfa2 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:31.261934 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a78ce743-8acc-4555-a780-946f0d35bfa2 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1470 microversion: 2.1 time: 0.548745 Oct 11 04:15:31.263326 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 653/1382] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:30 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1470 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:31.269092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:31.270038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:31.283856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:31.284754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:31.286026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:31.287265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:31.288143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:31.289057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:31.490149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6da1cef1-d06a-4089-9ef6-7ce56d6d72d7 tempest-NetworksTest-772126397 tempest-NetworksTest-772126397-project-admin] Calling method '.version_select at 0x7fda1e14e8b0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:31.539694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:31.567139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:31.567139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:31.567139 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-53e78861-cb20-4d11-9482-04a2fc6f9b4a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.298910 Oct 11 04:15:31.567139 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 654/1383] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:31 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:31.578901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d182c3cc-ce87-406f-9e6e-0fe21290f86a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:31.580742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d182c3cc-ce87-406f-9e6e-0fe21290f86a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:31.598759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d182c3cc-ce87-406f-9e6e-0fe21290f86a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:31.599522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d182c3cc-ce87-406f-9e6e-0fe21290f86a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:31.601467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d182c3cc-ce87-406f-9e6e-0fe21290f86a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:31.603337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d182c3cc-ce87-406f-9e6e-0fe21290f86a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:31.605840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d182c3cc-ce87-406f-9e6e-0fe21290f86a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:31.606746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d182c3cc-ce87-406f-9e6e-0fe21290f86a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:31.783974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d182c3cc-ce87-406f-9e6e-0fe21290f86a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:31.798603 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d182c3cc-ce87-406f-9e6e-0fe21290f86a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1276 microversion: 2.1 time: 0.227440 Oct 11 04:15:31.810308 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 655/1384] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:31 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1276 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:31.820101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-4f630e62-0952-40f8-940d-9ab1331293ae req-1c097342-59d2-416f-9221-98425ea8ddc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "721ec7b4-5d21-4da0-a478-d90bad272b94", "name": "network-vif-deleted", "tag": "971a9abb-3c06-4885-970b-2a3b2e5b5ab8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:31.844593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4f630e62-0952-40f8-940d-9ab1331293ae req-1c097342-59d2-416f-9221-98425ea8ddc4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:31.849898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4f630e62-0952-40f8-940d-9ab1331293ae req-1c097342-59d2-416f-9221-98425ea8ddc4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:31.850697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4f630e62-0952-40f8-940d-9ab1331293ae req-1c097342-59d2-416f-9221-98425ea8ddc4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:31.876339 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-4f630e62-0952-40f8-940d-9ab1331293ae req-1c097342-59d2-416f-9221-98425ea8ddc4 service nova] Creating event network-vif-deleted:971a9abb-3c06-4885-970b-2a3b2e5b5ab8 for instance 721ec7b4-5d21-4da0-a478-d90bad272b94 on n-h1-860892-1 Oct 11 04:15:31.893512 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-4f630e62-0952-40f8-940d-9ab1331293ae req-1c097342-59d2-416f-9221-98425ea8ddc4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087179 Oct 11 04:15:31.896342 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 656/1385] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:31.918939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9cf3d21a-ac01-4b30-ae6f-a8e73e4c8d92 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:31.923205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9cf3d21a-ac01-4b30-ae6f-a8e73e4c8d92 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:31.947444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cf3d21a-ac01-4b30-ae6f-a8e73e4c8d92 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:31.951810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cf3d21a-ac01-4b30-ae6f-a8e73e4c8d92 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:31.951810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cf3d21a-ac01-4b30-ae6f-a8e73e4c8d92 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:31.953686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cf3d21a-ac01-4b30-ae6f-a8e73e4c8d92 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:31.954302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cf3d21a-ac01-4b30-ae6f-a8e73e4c8d92 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:31.956581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cf3d21a-ac01-4b30-ae6f-a8e73e4c8d92 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:32.207886 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6da1cef1-d06a-4089-9ef6-7ce56d6d72d7 tempest-NetworksTest-772126397 tempest-NetworksTest-772126397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 5380 microversion: 2.1 time: 1.190499 Oct 11 04:15:32.208664 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 730/1386] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:15:31 2022] GET /compute/v2.1/os-networks => generated 5380 bytes in 1192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:32.220998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d68722b-0f96-4724-8dbc-e979ebccfefa tempest-NetworksTest-772126397 tempest-NetworksTest-772126397-project-admin] Calling method '.version_select at 0x7fda1e0ea3a0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:32.534841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9cf3d21a-ac01-4b30-ae6f-a8e73e4c8d92 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:32.548710 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9cf3d21a-ac01-4b30-ae6f-a8e73e4c8d92 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.650684 Oct 11 04:15:32.570016 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 657/1387] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:31 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:32.605409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:32.620107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:32.647943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:32.649120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:32.652537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:32.656835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:32.659289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:32.663594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:32.795849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:32.796492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:32.803605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:32.804227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lazy-loading 'fault' on Instance uuid 721ec7b4-5d21-4da0-a478-d90bad272b94 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:15:32.934010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:32.947803 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-519d5d37-b1b8-4055-af5d-5febee906cb0 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 200 len: 1304 microversion: 2.1 time: 0.350036 Oct 11 04:15:32.951995 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 658/1388] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:32 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 1304 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:32.966855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:32.970263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:32.978459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:32.980371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:32.981953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:32.985024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:32.986394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:32.988935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:33.064976 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d68722b-0f96-4724-8dbc-e979ebccfefa tempest-NetworksTest-772126397 tempest-NetworksTest-772126397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks/99809ad0-6d54-41b3-974c-c4cb964f66c2" status: 200 len: 652 microversion: 2.1 time: 0.848433 Oct 11 04:15:33.067077 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 731/1389] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:15:32 2022] GET /compute/v2.1/os-networks/99809ad0-6d54-41b3-974c-c4cb964f66c2 => generated 652 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:33.075758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-280e0a3a-9983-428f-ac32-ea2987d1c69a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:33.077575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-280e0a3a-9983-428f-ac32-ea2987d1c69a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:33.092156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-280e0a3a-9983-428f-ac32-ea2987d1c69a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:33.093028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-280e0a3a-9983-428f-ac32-ea2987d1c69a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:33.093748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-280e0a3a-9983-428f-ac32-ea2987d1c69a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:33.094783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-280e0a3a-9983-428f-ac32-ea2987d1c69a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:33.096148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-280e0a3a-9983-428f-ac32-ea2987d1c69a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:33.097855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-280e0a3a-9983-428f-ac32-ea2987d1c69a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:33.149221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:33.162455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:33.165207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:33.167218 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-949eacb2-1f6c-4a94-8760-eaa7df925d70 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.213680 Oct 11 04:15:33.167674 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 659/1390] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:32 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:33.173655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fd691fdd-f3ac-4383-b15e-3fd0b5838140 tempest-NetworksTest-772126397 tempest-NetworksTest-772126397-project-admin] Calling method '.version_select at 0x7fda1a904430>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:33.254061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-280e0a3a-9983-428f-ac32-ea2987d1c69a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:33.264169 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-280e0a3a-9983-428f-ac32-ea2987d1c69a tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1282 microversion: 2.1 time: 0.195823 Oct 11 04:15:33.264754 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 732/1391] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:33 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:33.561439 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fd691fdd-f3ac-4383-b15e-3fd0b5838140 tempest-NetworksTest-772126397 tempest-NetworksTest-772126397-project-admin] 10.222.0.26 "GET /compute/v2.1/os-networks" status: 200 len: 5380 microversion: 2.1 time: 0.392577 Oct 11 04:15:33.566081 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 660/1392] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:15:33 2022] GET /compute/v2.1/os-networks => generated 5380 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:33.597540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8df6f54b-0769-433b-8749-09b7f1f40eca tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:33.598163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8df6f54b-0769-433b-8749-09b7f1f40eca tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:33.611300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df6f54b-0769-433b-8749-09b7f1f40eca tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:33.612544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df6f54b-0769-433b-8749-09b7f1f40eca tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:33.613181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df6f54b-0769-433b-8749-09b7f1f40eca tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:33.616604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df6f54b-0769-433b-8749-09b7f1f40eca tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:33.617238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df6f54b-0769-433b-8749-09b7f1f40eca tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:33.617845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df6f54b-0769-433b-8749-09b7f1f40eca tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:33.981591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:33.985951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 721ec7b4-5d21-4da0-a478-d90bad272b94] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:33.992669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:33.993527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:33.994341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:33.995252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:33.996202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:33.996786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:34.014961 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] HTTP exception thrown: Instance 721ec7b4-5d21-4da0-a478-d90bad272b94 could not be found. Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Request method failure captured: Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 HTTP/1.1 Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO1HwfrbLRZONdcl1o03Ne0N-0INxCpbD3toEI5Pc1Qj5V6GycpHZOAeXHpt0b2VTbCqAuevZTLkjMDPKn7FlDHmxIcpUppAD-8tX1fob6JaKHVTtnr0tzrOYpIXW9qLDVYFMyA5HgXkjc5pDsppzv2_QfO_LzJex71Mp1IsFDAACss Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 3a6a41baf5e342e595051a329ba6ea18 Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAdminTestJSON-1250631818 Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a6a41baf5e342e595051a329ba6ea18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a6a41baf5e342e595051a329ba6ea18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a6a41baf5e342e595051a329ba6ea18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a6a41baf5e342e595051a329ba6ea18"}]}] Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAdminTestJSON-1250631818 Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 3a6a41baf5e342e595051a329ba6ea18 Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAdminTestJSON-1250631818 Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAdminTestJSON-1250631818-project Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 748ffa73f06244f3a8f2b14f81f486e0 Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAdminTestJSON-1250631818-project Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 721ec7b4-5d21-4da0-a478-d90bad272b94 could not be found. Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '721ec7b4-5d21-4da0-a478-d90bad272b94'} Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 721ec7b4-5d21-4da0-a478-d90bad272b94 could not be found. Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 721ec7b4-5d21-4da0-a478-d90bad272b94 could not be found. Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:34.017533 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:34.032241 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:34.032241 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:34.032241 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:34.032241 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:15:34.032241 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:15:34.032241 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 721ec7b4-5d21-4da0-a478-d90bad272b94 could not be found. Oct 11 04:15:34.032241 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:34.032241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Returning 404 to user: Instance 721ec7b4-5d21-4da0-a478-d90bad272b94 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:15:34.032241 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6c51abbe-4fbc-4da0-8df9-6d70d9091263 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94" status: 404 len: 111 microversion: 2.1 time: 0.045679 Oct 11 04:15:34.032241 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 661/1393] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:33 2022] GET /compute/v2.1/servers/721ec7b4-5d21-4da0-a478-d90bad272b94 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:15:34.033867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8df6f54b-0769-433b-8749-09b7f1f40eca tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:34.037717 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8df6f54b-0769-433b-8749-09b7f1f40eca tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.444633 Oct 11 04:15:34.038120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-167aa136-e418-4912-be59-77de7c1a3fcd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:34.044980 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 733/1394] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:33 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:34.046446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-167aa136-e418-4912-be59-77de7c1a3fcd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:34.067339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167aa136-e418-4912-be59-77de7c1a3fcd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:34.070613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167aa136-e418-4912-be59-77de7c1a3fcd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:34.071267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167aa136-e418-4912-be59-77de7c1a3fcd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:34.072439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167aa136-e418-4912-be59-77de7c1a3fcd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:34.073050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167aa136-e418-4912-be59-77de7c1a3fcd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:34.073624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167aa136-e418-4912-be59-77de7c1a3fcd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:34.115519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-167aa136-e418-4912-be59-77de7c1a3fcd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:15:34.130798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:34.198720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:34.210855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:34.230506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:34.231704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:34.232147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:34.233035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:34.233713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:34.234708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:34.706662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:34.711713 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-167aa136-e418-4912-be59-77de7c1a3fcd tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "DELETE /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 204 len: 0 microversion: 2.1 time: 0.685514 Oct 11 04:15:34.712352 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 662/1395] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:15:34 2022] DELETE /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:15:34.718065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a49dc62-df8f-4383-9f3e-14abf09d44ba tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:34.721539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:34.721725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9a49dc62-df8f-4383-9f3e-14abf09d44ba tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:34.727899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:34.730971 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0138d08f-b924-4c34-8ddc-e42a9c711f6f tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.538028 Oct 11 04:15:34.733583 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 734/1396] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:34 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:34.734608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a49dc62-df8f-4383-9f3e-14abf09d44ba tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:34.735418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a49dc62-df8f-4383-9f3e-14abf09d44ba tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:34.736602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a49dc62-df8f-4383-9f3e-14abf09d44ba tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:34.737511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a49dc62-df8f-4383-9f3e-14abf09d44ba tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:34.738157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a49dc62-df8f-4383-9f3e-14abf09d44ba tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:34.738809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a49dc62-df8f-4383-9f3e-14abf09d44ba tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:34.741513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d4da9a3a-85cc-4236-8044-45602c227f7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:34.745294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d4da9a3a-85cc-4236-8044-45602c227f7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:34.757702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4da9a3a-85cc-4236-8044-45602c227f7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:34.760041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4da9a3a-85cc-4236-8044-45602c227f7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:34.761468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4da9a3a-85cc-4236-8044-45602c227f7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:34.763807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4da9a3a-85cc-4236-8044-45602c227f7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:34.764349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4da9a3a-85cc-4236-8044-45602c227f7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:34.764889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4da9a3a-85cc-4236-8044-45602c227f7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:35.017774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d4da9a3a-85cc-4236-8044-45602c227f7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:35.020411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9a49dc62-df8f-4383-9f3e-14abf09d44ba tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:35.027988 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d4da9a3a-85cc-4236-8044-45602c227f7e tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1470 microversion: 2.1 time: 0.292996 Oct 11 04:15:35.028574 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 735/1397] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:34 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1470 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:35.029459 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9a49dc62-df8f-4383-9f3e-14abf09d44ba tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1324 microversion: 2.1 time: 0.315557 Oct 11 04:15:35.042792 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 663/1398] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:34 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1324 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:35.063760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-685e9a08-13ce-4b17-adcc-ffbcf711f712 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:35.064440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-685e9a08-13ce-4b17-adcc-ffbcf711f712 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:35.071594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-685e9a08-13ce-4b17-adcc-ffbcf711f712 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:35.072149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-685e9a08-13ce-4b17-adcc-ffbcf711f712 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:35.072765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-685e9a08-13ce-4b17-adcc-ffbcf711f712 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:35.073497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-685e9a08-13ce-4b17-adcc-ffbcf711f712 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:35.073937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-685e9a08-13ce-4b17-adcc-ffbcf711f712 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:35.074479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-685e9a08-13ce-4b17-adcc-ffbcf711f712 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:35.308689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-685e9a08-13ce-4b17-adcc-ffbcf711f712 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:35.318688 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-685e9a08-13ce-4b17-adcc-ffbcf711f712 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.259061 Oct 11 04:15:35.319553 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 736/1399] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:35 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:35.763160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:35.764065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:35.776489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:35.778636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:35.780278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:35.784055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:35.784782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:35.786127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:35.935647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:35.945487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:35.947650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:35.949149 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-73fa31c1-fc23-466f-9221-588e972da969 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.190862 Oct 11 04:15:35.950096 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 664/1400] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:35 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:36.055148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-49397110-3b86-418b-bf64-390c80778388 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:36.056562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-49397110-3b86-418b-bf64-390c80778388 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:36.064046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49397110-3b86-418b-bf64-390c80778388 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:36.064635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49397110-3b86-418b-bf64-390c80778388 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:36.064951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49397110-3b86-418b-bf64-390c80778388 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:36.069563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49397110-3b86-418b-bf64-390c80778388 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:36.070929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49397110-3b86-418b-bf64-390c80778388 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:36.071449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49397110-3b86-418b-bf64-390c80778388 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:36.096015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b12b72f4-dd71-4e60-bdf6-e45f0325ce7c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Action: 'create', calling method: .version_select at 0x7fda1e144d30>, body: {"keypair": {"name": "tempest-keypair-298367566", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEbGVXEphaowka0CzVO0YAdhzmvL9/GAzZXo/F78eGm9vS+6QBZe0YWH0XTOLoCP4Z6TpGcOr766+FdCSoDqZ6UVokvGNkal4Y9IZimwr9k8+L2EzBkcCUiyVedbC9I22w=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:36.117436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b12b72f4-dd71-4e60-bdf6-e45f0325ce7c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Getting quotas for project cfa2ff1f293640e6a2302bae4d10048e. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:15:36.121694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b12b72f4-dd71-4e60-bdf6-e45f0325ce7c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Getting quotas for user 6be7a47546714f65a31dcba5eb765185 and project cfa2ff1f293640e6a2302bae4d10048e. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:15:36.228494 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b12b72f4-dd71-4e60-bdf6-e45f0325ce7c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.315093 Oct 11 04:15:36.229254 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 737/1401] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:15:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:15:36.236158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25b6f6bb-e5d6-421e-b518-bae25f378182 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:36.236819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-25b6f6bb-e5d6-421e-b518-bae25f378182 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:36.245284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b6f6bb-e5d6-421e-b518-bae25f378182 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:36.246091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b6f6bb-e5d6-421e-b518-bae25f378182 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:36.256554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b6f6bb-e5d6-421e-b518-bae25f378182 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:36.256554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b6f6bb-e5d6-421e-b518-bae25f378182 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:36.256554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b6f6bb-e5d6-421e-b518-bae25f378182 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:36.256554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b6f6bb-e5d6-421e-b518-bae25f378182 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:36.446633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25b6f6bb-e5d6-421e-b518-bae25f378182 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:36.459948 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-25b6f6bb-e5d6-421e-b518-bae25f378182 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1324 microversion: 2.1 time: 0.229390 Oct 11 04:15:36.463211 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 738/1402] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:36 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1324 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:36.478360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-408847cc-7eb2-4582-8663-da375847ffae req-09041478-41fb-4841-b761-70dbed68a61b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e3c3e6-a98f-4e56-a548-439d14a51e92", "tag": "9ada40c6-66d1-4d89-a451-50125c8dfce0"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:36.505493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-408847cc-7eb2-4582-8663-da375847ffae req-09041478-41fb-4841-b761-70dbed68a61b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:36.510919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-408847cc-7eb2-4582-8663-da375847ffae req-09041478-41fb-4841-b761-70dbed68a61b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:36.511477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-408847cc-7eb2-4582-8663-da375847ffae req-09041478-41fb-4841-b761-70dbed68a61b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:36.539485 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-408847cc-7eb2-4582-8663-da375847ffae req-09041478-41fb-4841-b761-70dbed68a61b service nova] Creating event network-changed:9ada40c6-66d1-4d89-a451-50125c8dfce0 for instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 on n-h1-860892-1 Oct 11 04:15:36.547179 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-408847cc-7eb2-4582-8663-da375847ffae req-09041478-41fb-4841-b761-70dbed68a61b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082556 Oct 11 04:15:36.549042 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 739/1403] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:36.554493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a40ccb8-0314-45fe-9914-781f48ea04f0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:36.555911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2a40ccb8-0314-45fe-9914-781f48ea04f0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:36.566518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-49397110-3b86-418b-bf64-390c80778388 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:36.568655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a40ccb8-0314-45fe-9914-781f48ea04f0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:36.569347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a40ccb8-0314-45fe-9914-781f48ea04f0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:36.569979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a40ccb8-0314-45fe-9914-781f48ea04f0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:36.571073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a40ccb8-0314-45fe-9914-781f48ea04f0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:36.571725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a40ccb8-0314-45fe-9914-781f48ea04f0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:36.572457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a40ccb8-0314-45fe-9914-781f48ea04f0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:36.578443 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-49397110-3b86-418b-bf64-390c80778388 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1470 microversion: 2.1 time: 0.526951 Oct 11 04:15:36.598800 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 665/1404] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:36 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1470 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:36.780638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2a40ccb8-0314-45fe-9914-781f48ea04f0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:36.789517 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2a40ccb8-0314-45fe-9914-781f48ea04f0 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.239060 Oct 11 04:15:36.790152 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 740/1405] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:36 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:36.979704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:36.980932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:36.989530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:36.990790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:36.992196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:36.993400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:36.994002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:36.994464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:37.114081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:37.124538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:37.138010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:37.139670 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2ca42294-1a00-432d-a56b-b1ec8876a531 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.167218 Oct 11 04:15:37.140776 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 666/1406] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:36 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:37.485254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ba55dafa-d38c-4dae-9d03-a9310a3db263 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:37.486531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ba55dafa-d38c-4dae-9d03-a9310a3db263 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:37.495714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba55dafa-d38c-4dae-9d03-a9310a3db263 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:37.496509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba55dafa-d38c-4dae-9d03-a9310a3db263 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:37.497024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba55dafa-d38c-4dae-9d03-a9310a3db263 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:37.497794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba55dafa-d38c-4dae-9d03-a9310a3db263 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:37.498428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba55dafa-d38c-4dae-9d03-a9310a3db263 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:37.499108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba55dafa-d38c-4dae-9d03-a9310a3db263 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:37.605336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6213e0b0-eba3-4694-80a2-8f704719d424 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:37.606233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6213e0b0-eba3-4694-80a2-8f704719d424 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:37.612651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6213e0b0-eba3-4694-80a2-8f704719d424 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:37.613152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6213e0b0-eba3-4694-80a2-8f704719d424 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:37.613616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6213e0b0-eba3-4694-80a2-8f704719d424 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:37.614363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6213e0b0-eba3-4694-80a2-8f704719d424 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:37.614824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6213e0b0-eba3-4694-80a2-8f704719d424 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:37.615253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6213e0b0-eba3-4694-80a2-8f704719d424 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:37.687512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6213e0b0-eba3-4694-80a2-8f704719d424 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:37.698026 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6213e0b0-eba3-4694-80a2-8f704719d424 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1428 microversion: 2.1 time: 0.096763 Oct 11 04:15:37.698930 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 667/1407] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:37 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1428 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:37.747369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ba55dafa-d38c-4dae-9d03-a9310a3db263 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:37.756499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:37.767469 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ba55dafa-d38c-4dae-9d03-a9310a3db263 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1324 microversion: 2.1 time: 0.286248 Oct 11 04:15:37.769158 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 741/1408] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:37 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1324 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:37.814623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef5a490e-ea88-488e-9e3b-dffbb6b59618 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:37.815332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef5a490e-ea88-488e-9e3b-dffbb6b59618 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:37.821640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef5a490e-ea88-488e-9e3b-dffbb6b59618 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:37.822089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef5a490e-ea88-488e-9e3b-dffbb6b59618 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:37.822578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef5a490e-ea88-488e-9e3b-dffbb6b59618 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:37.823275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef5a490e-ea88-488e-9e3b-dffbb6b59618 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:37.823725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef5a490e-ea88-488e-9e3b-dffbb6b59618 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:37.824154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef5a490e-ea88-488e-9e3b-dffbb6b59618 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:37.969057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef5a490e-ea88-488e-9e3b-dffbb6b59618 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:37.979751 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef5a490e-ea88-488e-9e3b-dffbb6b59618 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.169454 Oct 11 04:15:37.982560 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 668/1409] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:37 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:38.168270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:38.169404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:38.181095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:38.181874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:38.182576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:38.183568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:38.184217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:38.184806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:38.260919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:38.270708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:38.272455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:38.273848 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-68720c55-cfb2-4632-920a-ba21597d0b65 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.110413 Oct 11 04:15:38.274441 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 742/1410] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:38 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:38.576136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a2f925f1-c12f-4878-9fde-177cb4215030 req-afe7ff6b-ec51-48ce-9744-d86eee060420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97202407-f542-4189-9582-1f1dd698c594", "name": "network-vif-deleted", "tag": "dc8db1bd-a8a8-4b23-8837-a7b82504853f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:38.584425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:38.586543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a2f925f1-c12f-4878-9fde-177cb4215030 req-afe7ff6b-ec51-48ce-9744-d86eee060420 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:38.587410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a2f925f1-c12f-4878-9fde-177cb4215030 req-afe7ff6b-ec51-48ce-9744-d86eee060420 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:38.588072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a2f925f1-c12f-4878-9fde-177cb4215030 req-afe7ff6b-ec51-48ce-9744-d86eee060420 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:38.600618 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a2f925f1-c12f-4878-9fde-177cb4215030 req-afe7ff6b-ec51-48ce-9744-d86eee060420 service nova] Creating event network-vif-deleted:dc8db1bd-a8a8-4b23-8837-a7b82504853f for instance 97202407-f542-4189-9582-1f1dd698c594 on n-h1-860892-1 Oct 11 04:15:38.607942 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a2f925f1-c12f-4878-9fde-177cb4215030 req-afe7ff6b-ec51-48ce-9744-d86eee060420 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037200 Oct 11 04:15:38.613355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 669/1411] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:15:38.723711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d28292e1-af26-4f0a-a04a-17d8e3e90738 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:38.725155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d28292e1-af26-4f0a-a04a-17d8e3e90738 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:38.734220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d28292e1-af26-4f0a-a04a-17d8e3e90738 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:38.735324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d28292e1-af26-4f0a-a04a-17d8e3e90738 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:38.736554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d28292e1-af26-4f0a-a04a-17d8e3e90738 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:38.737478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d28292e1-af26-4f0a-a04a-17d8e3e90738 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:38.738698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d28292e1-af26-4f0a-a04a-17d8e3e90738 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:38.739158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d28292e1-af26-4f0a-a04a-17d8e3e90738 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:38.792318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68c5a13b-a3fd-4601-95ce-c578d28c93e6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:38.793513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68c5a13b-a3fd-4601-95ce-c578d28c93e6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:38.801693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c5a13b-a3fd-4601-95ce-c578d28c93e6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:38.802438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c5a13b-a3fd-4601-95ce-c578d28c93e6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:38.803104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c5a13b-a3fd-4601-95ce-c578d28c93e6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:38.804019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c5a13b-a3fd-4601-95ce-c578d28c93e6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:38.804527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c5a13b-a3fd-4601-95ce-c578d28c93e6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:38.804999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c5a13b-a3fd-4601-95ce-c578d28c93e6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:38.820173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d28292e1-af26-4f0a-a04a-17d8e3e90738 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:38.830135 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d28292e1-af26-4f0a-a04a-17d8e3e90738 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1428 microversion: 2.1 time: 0.110622 Oct 11 04:15:38.830728 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 743/1412] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:38 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1428 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:39.005783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9fb4823a-4887-417d-a9aa-34e18ba4cefe tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:39.006821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9fb4823a-4887-417d-a9aa-34e18ba4cefe tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:39.016111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb4823a-4887-417d-a9aa-34e18ba4cefe tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:39.018984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb4823a-4887-417d-a9aa-34e18ba4cefe tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:39.019867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb4823a-4887-417d-a9aa-34e18ba4cefe tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:39.021178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb4823a-4887-417d-a9aa-34e18ba4cefe tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:39.021857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb4823a-4887-417d-a9aa-34e18ba4cefe tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:39.022390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb4823a-4887-417d-a9aa-34e18ba4cefe tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:39.060864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68c5a13b-a3fd-4601-95ce-c578d28c93e6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:39.070726 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68c5a13b-a3fd-4601-95ce-c578d28c93e6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1324 microversion: 2.1 time: 0.281968 Oct 11 04:15:39.074981 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 670/1413] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:38 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1324 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:39.246803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9fb4823a-4887-417d-a9aa-34e18ba4cefe tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:39.256542 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9fb4823a-4887-417d-a9aa-34e18ba4cefe tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.254596 Oct 11 04:15:39.267885 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 744/1414] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:38 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:39.301459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:39.302447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:39.315310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:39.315807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:39.316242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:39.316945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:39.324101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:39.324605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:39.500359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:39.520133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:39.523079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:39.525331 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1d808c76-a7c0-4ea1-8636-a5f21feca2e2 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1366 microversion: 2.57 time: 0.229151 Oct 11 04:15:39.528847 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 671/1415] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:39 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:39.792913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestManualDisk-server-633068816", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "f71ffd4f-ac62-4178-b3e6-c41207edf5fd"}], "security_groups": [{"name": "tempest-securitygroup--1950231653"}], "key_name": "tempest-keypair-298367566", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:39.853701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:39.854353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:39.863896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:39.864416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:39.868804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:39.868804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:39.868804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:39.868804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:39.910237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] validate_networks() for [('f71ffd4f-ac62-4178-b3e6-c41207edf5fd', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:15:39.916182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:39.916626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:39.917149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:39.917672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lazy-loading 'fault' on Instance uuid 97202407-f542-4189-9582-1f1dd698c594 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:15:39.966636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '748ffa73f06244f3a8f2b14f81f486e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a6a41baf5e342e595051a329ba6ea18', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:39.975281 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b7ba51ba-542c-4b84-a514-8ff43ed63608 tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 200 len: 1304 microversion: 2.1 time: 0.126392 Oct 11 04:15:39.975856 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 672/1416] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:39 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:40.100839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-28774a50-ccfc-423e-a9ca-47ad72cb8373 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:40.101523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-28774a50-ccfc-423e-a9ca-47ad72cb8373 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:40.107531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=10 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:40.109462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28774a50-ccfc-423e-a9ca-47ad72cb8373 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:40.110363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28774a50-ccfc-423e-a9ca-47ad72cb8373 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:40.110971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28774a50-ccfc-423e-a9ca-47ad72cb8373 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:40.111852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28774a50-ccfc-423e-a9ca-47ad72cb8373 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:40.112483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28774a50-ccfc-423e-a9ca-47ad72cb8373 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:40.113067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28774a50-ccfc-423e-a9ca-47ad72cb8373 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:40.304930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-28774a50-ccfc-423e-a9ca-47ad72cb8373 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:40.313349 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-28774a50-ccfc-423e-a9ca-47ad72cb8373 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1324 microversion: 2.1 time: 0.216753 Oct 11 04:15:40.314714 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 673/1417] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:40 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1324 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:40.320986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4b6831b4-e68f-4a17-bda7-f7e7d1c1e277 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:40.321909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4b6831b4-e68f-4a17-bda7-f7e7d1c1e277 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:40.328480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b6831b4-e68f-4a17-bda7-f7e7d1c1e277 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:40.329318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b6831b4-e68f-4a17-bda7-f7e7d1c1e277 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:40.329997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b6831b4-e68f-4a17-bda7-f7e7d1c1e277 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:40.331073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b6831b4-e68f-4a17-bda7-f7e7d1c1e277 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:40.331595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b6831b4-e68f-4a17-bda7-f7e7d1c1e277 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:40.332062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b6831b4-e68f-4a17-bda7-f7e7d1c1e277 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:40.403524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Getting quotas for project cfa2ff1f293640e6a2302bae4d10048e. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:15:40.408203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Getting quotas for user 6be7a47546714f65a31dcba5eb765185 and project cfa2ff1f293640e6a2302bae4d10048e. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:15:40.419760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:15:40.420333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:15:40.420916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:15:40.421501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:15:40.421982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:15:40.430513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:40.431049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:40.431482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:40.432227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:40.432671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:40.434679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:40.450457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Getting quotas for project cfa2ff1f293640e6a2302bae4d10048e. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:15:40.455059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Getting quotas for user 6be7a47546714f65a31dcba5eb765185 and project cfa2ff1f293640e6a2302bae4d10048e. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:15:40.458507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:40.468834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:15:40.472126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:15:40.473889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4b6831b4-e68f-4a17-bda7-f7e7d1c1e277 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:40.481891 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4b6831b4-e68f-4a17-bda7-f7e7d1c1e277 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.165257 Oct 11 04:15:40.492544 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 674/1418] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:40 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:40.603672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1683fd75-d079-4851-9140-31704000381e tempest-QuotaClassesAdminTestJSON-301941190 tempest-QuotaClassesAdminTestJSON-301941190-project-admin] Calling method '.version_select at 0x7fda19a443a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:40.616720 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1683fd75-d079-4851-9140-31704000381e tempest-QuotaClassesAdminTestJSON-301941190 tempest-QuotaClassesAdminTestJSON-301941190-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 303 microversion: 2.1 time: 0.133299 Oct 11 04:15:40.621960 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 675/1419] 10.222.0.26 () {58 vars in 1185 bytes} [Tue Oct 11 04:15:40 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 303 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:40.622100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:40.622726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:40.630322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:40.630811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:40.631244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:40.631941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:40.632413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:40.632832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:40.668105 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0065b9bc-18ee-4769-b329-f02a7e31603c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.880646 Oct 11 04:15:40.675810 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 745/1420] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:15:39 2022] POST /compute/v2.1/servers => generated 409 bytes in 882 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:15:40.675810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ad001a7c-7df7-46b1-9bf3-23c91d3cce8d tempest-QuotaClassesAdminTestJSON-301941190 tempest-QuotaClassesAdminTestJSON-301941190-project-admin] Action: 'update', calling method: .version_select at 0x7fda1e14e1f0>, body: {"quota_class_set": {"cores": 120, "fixed_ips": 99, "floating_ips": 99, "injected_file_content_bytes": 10340, "injected_file_path_bytes": 355, "injected_files": 105, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "security_group_rules": 99, "security_groups": 99}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:40.719404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:40.729037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:40.730760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:40.731927 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-511bba54-f082-4e97-a38a-30a58a20f615 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1384 microversion: 2.57 time: 0.113770 Oct 11 04:15:40.732493 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 676/1421] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:40 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1384 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:40.737498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-20cc0635-45e8-4404-8c38-1ad5ecaa68b6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:40.738115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-20cc0635-45e8-4404-8c38-1ad5ecaa68b6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:40.792543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-20cc0635-45e8-4404-8c38-1ad5ecaa68b6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:40.800545 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-20cc0635-45e8-4404-8c38-1ad5ecaa68b6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1276 microversion: 2.1 time: 0.067031 Oct 11 04:15:40.801126 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 677/1422] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:40 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1276 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:40.998721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:40.999403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] [instance: 97202407-f542-4189-9582-1f1dd698c594] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:41.008214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:41.008731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:41.009175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:41.009861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:41.010362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:41.010806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:41.024374 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] HTTP exception thrown: Instance 97202407-f542-4189-9582-1f1dd698c594 could not be found. Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Request method failure captured: Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 HTTP/1.1 Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO1HwfrbLRZONdcl1o03Ne0N-0INxCpbD3toEI5Pc1Qj5V6GycpHZOAeXHpt0b2VTbCqAuevZTLkjMDPKn7FlDHmxIcpUppAD-8tX1fob6JaKHVTtnr0tzrOYpIXW9qLDVYFMyA5HgXkjc5pDsppzv2_QfO_LzJex71Mp1IsFDAACss Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 3a6a41baf5e342e595051a329ba6ea18 Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAdminTestJSON-1250631818 Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a6a41baf5e342e595051a329ba6ea18"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a6a41baf5e342e595051a329ba6ea18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a6a41baf5e342e595051a329ba6ea18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a6a41baf5e342e595051a329ba6ea18"}]}] Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAdminTestJSON-1250631818 Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 3a6a41baf5e342e595051a329ba6ea18 Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAdminTestJSON-1250631818 Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAdminTestJSON-1250631818-project Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 748ffa73f06244f3a8f2b14f81f486e0 Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAdminTestJSON-1250631818-project Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 97202407-f542-4189-9582-1f1dd698c594 could not be found. Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '97202407-f542-4189-9582-1f1dd698c594'} Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97202407-f542-4189-9582-1f1dd698c594 could not be found. Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97202407-f542-4189-9582-1f1dd698c594 could not be found. Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:41.026014 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:41.031360 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:41.031360 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:41.031360 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:41.031360 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:15:41.031360 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:15:41.031360 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97202407-f542-4189-9582-1f1dd698c594 could not be found. Oct 11 04:15:41.031360 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:15:41.031360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] Returning 404 to user: Instance 97202407-f542-4189-9582-1f1dd698c594 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:15:41.031360 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-893cd4c3-be0d-4e18-b408-d64c7e287e1c tempest-ServersAdminTestJSON-1250631818 tempest-ServersAdminTestJSON-1250631818-project] 10.222.0.26 "GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594" status: 404 len: 111 microversion: 2.1 time: 0.033156 Oct 11 04:15:41.031360 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 678/1423] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:40 2022] GET /compute/v2.1/servers/97202407-f542-4189-9582-1f1dd698c594 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:15:41.338162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3982dcb4-8aca-4117-95f2-712313a2a7c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:41.338954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3982dcb4-8aca-4117-95f2-712313a2a7c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:41.345864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3982dcb4-8aca-4117-95f2-712313a2a7c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:41.346385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3982dcb4-8aca-4117-95f2-712313a2a7c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:41.346828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3982dcb4-8aca-4117-95f2-712313a2a7c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:41.347537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3982dcb4-8aca-4117-95f2-712313a2a7c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:41.347995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3982dcb4-8aca-4117-95f2-712313a2a7c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:41.348611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3982dcb4-8aca-4117-95f2-712313a2a7c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:41.513649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3982dcb4-8aca-4117-95f2-712313a2a7c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:41.523080 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3982dcb4-8aca-4117-95f2-712313a2a7c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1324 microversion: 2.1 time: 0.188623 Oct 11 04:15:41.523760 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 679/1424] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:41 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1324 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:41.531819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-48bfe957-c8cd-4515-bd54-b8390ef2cd0e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:41.532541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-48bfe957-c8cd-4515-bd54-b8390ef2cd0e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:41.538655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48bfe957-c8cd-4515-bd54-b8390ef2cd0e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:41.544027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48bfe957-c8cd-4515-bd54-b8390ef2cd0e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:41.544027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48bfe957-c8cd-4515-bd54-b8390ef2cd0e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:41.544027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48bfe957-c8cd-4515-bd54-b8390ef2cd0e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:41.544027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48bfe957-c8cd-4515-bd54-b8390ef2cd0e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:41.544027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48bfe957-c8cd-4515-bd54-b8390ef2cd0e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:41.711612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48bfe957-c8cd-4515-bd54-b8390ef2cd0e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:41.716085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:41.723022 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-48bfe957-c8cd-4515-bd54-b8390ef2cd0e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.195508 Oct 11 04:15:41.738213 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 680/1425] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:41 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:41.770807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:41.771375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:41.779599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:41.780354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:41.780786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:41.781486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:41.781934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:41.782459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:41.881466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:41.889985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:41.891489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:41.892651 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f5d6cf1b-cd7c-4592-bdff-d93d70e01298 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1372 microversion: 2.57 time: 0.129811 Oct 11 04:15:41.893219 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 681/1426] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:41 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1372 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:41.899303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a5a6f098-357d-4dee-b27d-aee49227d4da tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:41.908670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a5a6f098-357d-4dee-b27d-aee49227d4da tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:41.973788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a5a6f098-357d-4dee-b27d-aee49227d4da tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:41.981733 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a5a6f098-357d-4dee-b27d-aee49227d4da tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1276 microversion: 2.1 time: 0.087165 Oct 11 04:15:41.982682 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 682/1427] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:41 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:42.486779 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ad001a7c-7df7-46b1-9bf3-23c91d3cce8d tempest-QuotaClassesAdminTestJSON-301941190 tempest-QuotaClassesAdminTestJSON-301941190-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 290 microversion: 2.1 time: 1.816653 Oct 11 04:15:42.487543 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 746/1428] 10.222.0.26 () {60 vars in 1206 bytes} [Tue Oct 11 04:15:40 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 290 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:42.498814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b3838a3-7e3d-4181-baae-45e3595e33b4 tempest-QuotaClassesAdminTestJSON-301941190 tempest-QuotaClassesAdminTestJSON-301941190-project-admin] Calling method '.version_select at 0x7fda19a02ee0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:42.511406 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b3838a3-7e3d-4181-baae-45e3595e33b4 tempest-QuotaClassesAdminTestJSON-301941190 tempest-QuotaClassesAdminTestJSON-301941190-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 307 microversion: 2.1 time: 0.016338 Oct 11 04:15:42.512000 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 683/1429] 10.222.0.26 () {58 vars in 1185 bytes} [Tue Oct 11 04:15:42 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 307 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:42.524785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c3771e2c-dc39-485a-8f0e-858214e6b601 tempest-QuotaClassesAdminTestJSON-301941190 tempest-QuotaClassesAdminTestJSON-301941190-project-admin] Action: 'update', calling method: .version_select at 0x7fda1e137430>, body: {"quota_class_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:42.546134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0c00b73c-60b2-42ef-96b4-5d6d41ea662b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:42.546764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0c00b73c-60b2-42ef-96b4-5d6d41ea662b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:42.553370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c00b73c-60b2-42ef-96b4-5d6d41ea662b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:42.553885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c00b73c-60b2-42ef-96b4-5d6d41ea662b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:42.554349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c00b73c-60b2-42ef-96b4-5d6d41ea662b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:42.555110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c00b73c-60b2-42ef-96b4-5d6d41ea662b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:42.555850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c00b73c-60b2-42ef-96b4-5d6d41ea662b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:42.556279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c00b73c-60b2-42ef-96b4-5d6d41ea662b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:42.698458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0c00b73c-60b2-42ef-96b4-5d6d41ea662b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:42.707100 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0c00b73c-60b2-42ef-96b4-5d6d41ea662b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1324 microversion: 2.1 time: 0.164867 Oct 11 04:15:42.707656 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 684/1430] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:42 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1324 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:42.751289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-319b5e5e-c4a8-4600-969e-f82ca72e1fa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:42.751907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-319b5e5e-c4a8-4600-969e-f82ca72e1fa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:42.758427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-319b5e5e-c4a8-4600-969e-f82ca72e1fa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:42.758915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-319b5e5e-c4a8-4600-969e-f82ca72e1fa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:42.759360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-319b5e5e-c4a8-4600-969e-f82ca72e1fa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:42.760079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-319b5e5e-c4a8-4600-969e-f82ca72e1fa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:42.760584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-319b5e5e-c4a8-4600-969e-f82ca72e1fa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:42.761144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-319b5e5e-c4a8-4600-969e-f82ca72e1fa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:42.900324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-319b5e5e-c4a8-4600-969e-f82ca72e1fa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:42.908498 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-319b5e5e-c4a8-4600-969e-f82ca72e1fa4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.161272 Oct 11 04:15:42.909079 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 685/1431] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:42 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:42.919156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:42.919765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:42.925620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:42.926472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:42.926916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:42.927614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:42.928689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:42.929117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:43.001960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:43.010520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:43.011951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:43.013135 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f3c5541f-b16c-46f6-8e37-fdad7d445cdf tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1372 microversion: 2.57 time: 0.097693 Oct 11 04:15:43.013681 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 686/1432] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:42 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:15:43.018664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b05d4d96-e04f-417c-8f8b-6265525c9658 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:43.019263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b05d4d96-e04f-417c-8f8b-6265525c9658 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:43.025158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05d4d96-e04f-417c-8f8b-6265525c9658 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:43.025640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05d4d96-e04f-417c-8f8b-6265525c9658 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:43.026071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05d4d96-e04f-417c-8f8b-6265525c9658 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:43.026782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05d4d96-e04f-417c-8f8b-6265525c9658 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:43.027229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05d4d96-e04f-417c-8f8b-6265525c9658 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:43.027677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05d4d96-e04f-417c-8f8b-6265525c9658 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:43.090062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b05d4d96-e04f-417c-8f8b-6265525c9658 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:43.098637 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b05d4d96-e04f-417c-8f8b-6265525c9658 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1280 microversion: 2.1 time: 0.083951 Oct 11 04:15:43.099197 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 687/1433] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:43 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1280 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:43.441432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c0608339-625a-437d-b5ac-1d36aacf46a2 req-23a24721-7e04-461d-9e3f-08f9ca2c7d23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e3c3e6-a98f-4e56-a548-439d14a51e92", "name": "network-vif-plugged", "status": "completed", "tag": "9ada40c6-66d1-4d89-a451-50125c8dfce0"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:43.454497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c0608339-625a-437d-b5ac-1d36aacf46a2 req-23a24721-7e04-461d-9e3f-08f9ca2c7d23 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:43.455068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c0608339-625a-437d-b5ac-1d36aacf46a2 req-23a24721-7e04-461d-9e3f-08f9ca2c7d23 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:43.455396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c0608339-625a-437d-b5ac-1d36aacf46a2 req-23a24721-7e04-461d-9e3f-08f9ca2c7d23 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:43.471293 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c0608339-625a-437d-b5ac-1d36aacf46a2 req-23a24721-7e04-461d-9e3f-08f9ca2c7d23 service nova] Creating event network-vif-plugged:9ada40c6-66d1-4d89-a451-50125c8dfce0 for instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 on n-h1-860892-1 Oct 11 04:15:43.477813 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c0608339-625a-437d-b5ac-1d36aacf46a2 req-23a24721-7e04-461d-9e3f-08f9ca2c7d23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040163 Oct 11 04:15:43.478796 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 688/1434] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:15:43.731477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4749660a-d03e-420d-8c94-119a3830f6de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:43.732003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4749660a-d03e-420d-8c94-119a3830f6de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:43.739836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4749660a-d03e-420d-8c94-119a3830f6de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:43.740362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4749660a-d03e-420d-8c94-119a3830f6de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:43.740896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4749660a-d03e-420d-8c94-119a3830f6de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:43.741582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4749660a-d03e-420d-8c94-119a3830f6de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:43.742040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4749660a-d03e-420d-8c94-119a3830f6de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:43.742530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4749660a-d03e-420d-8c94-119a3830f6de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:43.892652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4749660a-d03e-420d-8c94-119a3830f6de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:43.900232 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4749660a-d03e-420d-8c94-119a3830f6de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1324 microversion: 2.1 time: 0.173783 Oct 11 04:15:43.900794 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 689/1435] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:43 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1324 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:43.931301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-55816ef5-ebfd-4e80-9deb-cb3108bb5c2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:43.932194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-55816ef5-ebfd-4e80-9deb-cb3108bb5c2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:43.938408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55816ef5-ebfd-4e80-9deb-cb3108bb5c2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:43.939262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55816ef5-ebfd-4e80-9deb-cb3108bb5c2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:43.939711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55816ef5-ebfd-4e80-9deb-cb3108bb5c2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:43.940459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55816ef5-ebfd-4e80-9deb-cb3108bb5c2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:43.940913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55816ef5-ebfd-4e80-9deb-cb3108bb5c2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:43.941343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55816ef5-ebfd-4e80-9deb-cb3108bb5c2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:44.091305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-55816ef5-ebfd-4e80-9deb-cb3108bb5c2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:44.094657 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-55816ef5-ebfd-4e80-9deb-cb3108bb5c2f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.167172 Oct 11 04:15:44.095253 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 690/1436] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:43 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:44.100405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:44.101025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:44.106947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:44.107479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:44.107916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:44.108618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:44.109052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:44.109474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:44.174591 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c3771e2c-dc39-485a-8f0e-858214e6b601 tempest-QuotaClassesAdminTestJSON-301941190 tempest-QuotaClassesAdminTestJSON-301941190-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 286 microversion: 2.1 time: 1.653584 Oct 11 04:15:44.175200 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 747/1437] 10.222.0.26 () {60 vars in 1206 bytes} [Tue Oct 11 04:15:42 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 286 bytes in 1655 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:15:44.180178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce41a07b-379c-447b-b556-c2c95bfe2410 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:44.180764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:44.180905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce41a07b-379c-447b-b556-c2c95bfe2410 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:44.189078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce41a07b-379c-447b-b556-c2c95bfe2410 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:44.189570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce41a07b-379c-447b-b556-c2c95bfe2410 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:44.190010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce41a07b-379c-447b-b556-c2c95bfe2410 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:44.190806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce41a07b-379c-447b-b556-c2c95bfe2410 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:44.191415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce41a07b-379c-447b-b556-c2c95bfe2410 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:44.191980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce41a07b-379c-447b-b556-c2c95bfe2410 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:44.192129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:44.193760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:44.195307 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-63f377fe-77c4-493d-879e-db784c737ea4 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1357 microversion: 2.57 time: 0.098639 Oct 11 04:15:44.196049 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 691/1438] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:44 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1357 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:44.235937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cf1f9b0d-7f45-4b00-81b2-e7b5dd82904d tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:44.236444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf1f9b0d-7f45-4b00-81b2-e7b5dd82904d tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:44.239571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:44.243041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1f9b0d-7f45-4b00-81b2-e7b5dd82904d tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:44.243524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1f9b0d-7f45-4b00-81b2-e7b5dd82904d tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:44.243959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1f9b0d-7f45-4b00-81b2-e7b5dd82904d tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:44.244839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1f9b0d-7f45-4b00-81b2-e7b5dd82904d tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:44.245533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1f9b0d-7f45-4b00-81b2-e7b5dd82904d tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:44.245887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1f9b0d-7f45-4b00-81b2-e7b5dd82904d tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:44.279450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce41a07b-379c-447b-b556-c2c95bfe2410 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:44.283148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf1f9b0d-7f45-4b00-81b2-e7b5dd82904d tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:15:44.293024 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce41a07b-379c-447b-b556-c2c95bfe2410 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1328 microversion: 2.1 time: 0.114700 Oct 11 04:15:44.293685 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 748/1439] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:44 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:44.804059 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cf1f9b0d-7f45-4b00-81b2-e7b5dd82904d tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "DELETE /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 204 len: 0 microversion: 2.57 time: 0.573540 Oct 11 04:15:44.805280 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 692/1440] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:15:44 2022] DELETE /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 04:15:44.814790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:44.817441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:44.828869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:44.829362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:44.830454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:44.831888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:44.833735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:44.837164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:44.915144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:44.926055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-61fb211a-c0f6-4af1-ae81-02dddc4895de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:44.933075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-61fb211a-c0f6-4af1-ae81-02dddc4895de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:44.933214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:44.933214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:44.933214 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40ac79e2-dc2f-4ec1-89c0-7b56816d729b tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1363 microversion: 2.57 time: 0.120470 Oct 11 04:15:44.933214 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 749/1441] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:44 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1363 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:15:44.937143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fb211a-c0f6-4af1-ae81-02dddc4895de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:44.941804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fb211a-c0f6-4af1-ae81-02dddc4895de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:44.942420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fb211a-c0f6-4af1-ae81-02dddc4895de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:44.943183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fb211a-c0f6-4af1-ae81-02dddc4895de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:44.944021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fb211a-c0f6-4af1-ae81-02dddc4895de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:44.944481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fb211a-c0f6-4af1-ae81-02dddc4895de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:45.121945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f8e833c0-26f9-4284-9104-4495bc63161f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:45.123305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f8e833c0-26f9-4284-9104-4495bc63161f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:45.131365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=15,nova_api:UPDATE=24 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:45.134072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8e833c0-26f9-4284-9104-4495bc63161f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:45.134721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8e833c0-26f9-4284-9104-4495bc63161f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:45.135256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8e833c0-26f9-4284-9104-4495bc63161f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:45.136082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8e833c0-26f9-4284-9104-4495bc63161f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:45.136657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8e833c0-26f9-4284-9104-4495bc63161f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:45.138929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8e833c0-26f9-4284-9104-4495bc63161f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:45.345523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-61fb211a-c0f6-4af1-ae81-02dddc4895de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:45.355586 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-61fb211a-c0f6-4af1-ae81-02dddc4895de tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1324 microversion: 2.1 time: 0.435648 Oct 11 04:15:45.356360 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 693/1442] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:44 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1324 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:45.362022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8fb67067-244e-453a-b1c5-48faff1e9588 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:45.362729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8fb67067-244e-453a-b1c5-48faff1e9588 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:45.363911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f8e833c0-26f9-4284-9104-4495bc63161f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:45.373789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fb67067-244e-453a-b1c5-48faff1e9588 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:45.374366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fb67067-244e-453a-b1c5-48faff1e9588 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:45.374812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fb67067-244e-453a-b1c5-48faff1e9588 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:45.376769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fb67067-244e-453a-b1c5-48faff1e9588 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:45.378404 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f8e833c0-26f9-4284-9104-4495bc63161f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.263392 Oct 11 04:15:45.380498 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 750/1443] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:45 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:45.388804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fb67067-244e-453a-b1c5-48faff1e9588 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:45.389169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fb67067-244e-453a-b1c5-48faff1e9588 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:45.498804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8fb67067-244e-453a-b1c5-48faff1e9588 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:45.509900 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8fb67067-244e-453a-b1c5-48faff1e9588 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1346 microversion: 2.1 time: 0.152319 Oct 11 04:15:45.522743 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 694/1444] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:45 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1346 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:45.957224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:45.958162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:45.964985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:45.966927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:45.967628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:45.968549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:45.969220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:45.970313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:46.069957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:46.081527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:46.083484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '2107b58c410b4a538395fae441ae918f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a7b9d81a2ec4e3dbdb852a11c48ea88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:46.085572 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e567bf1e-b2d0-4444-a965-0b654f8dee5a tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 200 len: 1363 microversion: 2.57 time: 0.132333 Oct 11 04:15:46.095627 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 751/1445] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:45 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 1363 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:46.379767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0de44e7a-8483-42bf-9ed6-bdda67af659e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:46.380387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0de44e7a-8483-42bf-9ed6-bdda67af659e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:46.396472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0de44e7a-8483-42bf-9ed6-bdda67af659e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:46.396970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0de44e7a-8483-42bf-9ed6-bdda67af659e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:46.406342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-904e8d6c-ca25-4228-a8b3-d85e61bb4082 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:46.407980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-904e8d6c-ca25-4228-a8b3-d85e61bb4082 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:46.415570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0de44e7a-8483-42bf-9ed6-bdda67af659e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:46.418092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0de44e7a-8483-42bf-9ed6-bdda67af659e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:46.421900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0de44e7a-8483-42bf-9ed6-bdda67af659e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:46.423895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-904e8d6c-ca25-4228-a8b3-d85e61bb4082 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:46.424581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0de44e7a-8483-42bf-9ed6-bdda67af659e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:46.429919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-904e8d6c-ca25-4228-a8b3-d85e61bb4082 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:46.431991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-904e8d6c-ca25-4228-a8b3-d85e61bb4082 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:46.432928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-904e8d6c-ca25-4228-a8b3-d85e61bb4082 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:46.438880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-904e8d6c-ca25-4228-a8b3-d85e61bb4082 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:46.442172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-904e8d6c-ca25-4228-a8b3-d85e61bb4082 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:46.698153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-904e8d6c-ca25-4228-a8b3-d85e61bb4082 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:46.711747 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-904e8d6c-ca25-4228-a8b3-d85e61bb4082 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.306602 Oct 11 04:15:46.714173 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 752/1446] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:46 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:46.728372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c35b221e-143a-42fc-bb89-4c13ecc504a6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:46.729207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c35b221e-143a-42fc-bb89-4c13ecc504a6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:46.752006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c35b221e-143a-42fc-bb89-4c13ecc504a6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:46.753115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c35b221e-143a-42fc-bb89-4c13ecc504a6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:46.755190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c35b221e-143a-42fc-bb89-4c13ecc504a6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:46.758101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c35b221e-143a-42fc-bb89-4c13ecc504a6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:46.759240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c35b221e-143a-42fc-bb89-4c13ecc504a6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:46.759777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c35b221e-143a-42fc-bb89-4c13ecc504a6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:46.901556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0de44e7a-8483-42bf-9ed6-bdda67af659e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:46.915296 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0de44e7a-8483-42bf-9ed6-bdda67af659e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1519 microversion: 2.1 time: 0.540730 Oct 11 04:15:46.915935 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 695/1447] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:46 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1519 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:46.941248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cbe07ca6-e48b-47ed-a19e-ea90e1860ed4 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Action: 'create', calling method: .version_select at 0x7fda19a02e50>, body: {"pool": null} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:47.016051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c35b221e-143a-42fc-bb89-4c13ecc504a6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:47.029255 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c35b221e-143a-42fc-bb89-4c13ecc504a6 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1402 microversion: 2.1 time: 0.313788 Oct 11 04:15:47.033659 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 753/1448] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:46 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1402 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:47.304919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1570838091", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:47.369357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:15:47.644484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:15:47.646906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:15:47.647588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:15:47.648183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:15:47.648756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:15:47.660690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:47.661211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:47.661648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:47.662487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:47.662947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:47.663373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:47.699851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:15:47.718937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:15:47.735960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:15:47.740997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:15:47.933189 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-77b99406-3a00-46f2-beac-731051c8077f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.898014 Oct 11 04:15:47.934487 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 754/1449] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:15:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:15:47.942323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:47.944472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] [instance: 35e2dda1-5b63-4e8c-9a27-f925efea73f5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:47.957543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:47.957543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:47.957543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:47.957543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:47.957543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:47.957543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:47.977486 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] HTTP exception thrown: Instance 35e2dda1-5b63-4e8c-9a27-f925efea73f5 could not be found. Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Request method failure captured: Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 HTTP/1.1 Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO3BerTWFMWODneheRteGZr_HiSyW7IbG6bC-CTFPaMJg5O2NF_q9A8tXwgeG81RtimZvQqZOpu9nIj1GBlPF6Jje8PHZDI1kPw45bBIXZu_HmhSFtIyZ8PLVBOEDhMtkKyYwZJ5UrXCOPGOQhzc_YWWy7Fpb5XVG3AmvbYaH1mgNdM Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.57 Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 3a7b9d81a2ec4e3dbdb852a11c48ea88 Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerShowV257Test-1193448965 Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3a7b9d81a2ec4e3dbdb852a11c48ea88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3a7b9d81a2ec4e3dbdb852a11c48ea88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a7b9d81a2ec4e3dbdb852a11c48ea88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3a7b9d81a2ec4e3dbdb852a11c48ea88"}]}] Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerShowV257Test-1193448965 Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 3a7b9d81a2ec4e3dbdb852a11c48ea88 Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerShowV257Test-1193448965 Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerShowV257Test-1193448965-project Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 2107b58c410b4a538395fae441ae918f Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerShowV257Test-1193448965-project Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 35e2dda1-5b63-4e8c-9a27-f925efea73f5 could not be found. Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '35e2dda1-5b63-4e8c-9a27-f925efea73f5'} Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 35e2dda1-5b63-4e8c-9a27-f925efea73f5 could not be found. Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 35e2dda1-5b63-4e8c-9a27-f925efea73f5 could not be found. Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:15:47.979245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:47.984654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:15:47.984654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:15:47.984654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:15:47.984654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:15:47.984654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:15:47.984654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 35e2dda1-5b63-4e8c-9a27-f925efea73f5 could not be found. Oct 11 04:15:47.984654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:15:47.984654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] Returning 404 to user: Instance 35e2dda1-5b63-4e8c-9a27-f925efea73f5 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:15:47.984654 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e6c04e3-5d18-47ea-9d59-3b3b83a3d074 tempest-ServerShowV257Test-1193448965 tempest-ServerShowV257Test-1193448965-project] 10.222.0.26 "GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5" status: 404 len: 111 microversion: 2.57 time: 0.045501 Oct 11 04:15:47.985950 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 755/1450] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:47 2022] GET /compute/v2.1/servers/35e2dda1-5b63-4e8c-9a27-f925efea73f5 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:15:47.991815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af2f0e74-6596-4e2c-8605-77923e67afe4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:47.991815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af2f0e74-6596-4e2c-8605-77923e67afe4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:47.997064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af2f0e74-6596-4e2c-8605-77923e67afe4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:47.997550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af2f0e74-6596-4e2c-8605-77923e67afe4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:47.997982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af2f0e74-6596-4e2c-8605-77923e67afe4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:47.998711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af2f0e74-6596-4e2c-8605-77923e67afe4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:47.999156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af2f0e74-6596-4e2c-8605-77923e67afe4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:47.999619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af2f0e74-6596-4e2c-8605-77923e67afe4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:48.167422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-af2f0e74-6596-4e2c-8605-77923e67afe4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:48.178223 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af2f0e74-6596-4e2c-8605-77923e67afe4 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.190900 Oct 11 04:15:48.180685 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 756/1451] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:47 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:48.199287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestBootFromVolume-server-1580798210", "imageRef": "", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "66a7d8b1-6445-4454-a6a1-af56b53296a9"}], "security_groups": [{"name": "tempest-securitygroup--538245165"}], "key_name": "tempest-keypair-1804752598", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "f8c35bcc-08ed-4904-b601-e0f2f7907adc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "OS-DCF:diskConfig": "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:48.337829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] validate_networks() for [('66a7d8b1-6445-4454-a6a1-af56b53296a9', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:15:48.827264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Getting quotas for project 7dcd9cbd3fbe4c24add13c912979deb7. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:15:48.843300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Getting quotas for user 12aa2047c1ec47f6b6594e9109f8ec6c and project 7dcd9cbd3fbe4c24add13c912979deb7. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:15:48.869557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:15:48.870254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:15:48.871278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:15:48.872268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:15:48.872964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:15:48.890554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:48.892242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:48.892904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:48.893885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:48.894587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:48.895543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:48.931225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Getting quotas for project 7dcd9cbd3fbe4c24add13c912979deb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:15:48.938705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Getting quotas for user 12aa2047c1ec47f6b6594e9109f8ec6c and project 7dcd9cbd3fbe4c24add13c912979deb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:15:49.008691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:15:49.010904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f8c35bcc-08ed-4904-b601-e0f2f7907adc',volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:15:49.496136 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a55b26c-0775-4485-8abd-14b88d746267 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.314166 Oct 11 04:15:49.497022 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 757/1452] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:15:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:15:49.501859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38005a60-c425-4f06-90cc-946296328e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:49.502743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-38005a60-c425-4f06-90cc-946296328e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:49.516961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38005a60-c425-4f06-90cc-946296328e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:49.517457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38005a60-c425-4f06-90cc-946296328e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:49.517893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38005a60-c425-4f06-90cc-946296328e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:49.523259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38005a60-c425-4f06-90cc-946296328e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:49.523259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38005a60-c425-4f06-90cc-946296328e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:49.523259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38005a60-c425-4f06-90cc-946296328e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:49.588138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-38005a60-c425-4f06-90cc-946296328e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:49.617747 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-38005a60-c425-4f06-90cc-946296328e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1221 microversion: 2.1 time: 0.119369 Oct 11 04:15:49.618560 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 758/1453] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:49 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1221 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:49.625879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-192ceffe-3d2f-4e21-8b7c-017b17b73fd5 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:49.627350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-192ceffe-3d2f-4e21-8b7c-017b17b73fd5 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:49.641209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-192ceffe-3d2f-4e21-8b7c-017b17b73fd5 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:49.641807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-192ceffe-3d2f-4e21-8b7c-017b17b73fd5 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:49.643061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-192ceffe-3d2f-4e21-8b7c-017b17b73fd5 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:49.643880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-192ceffe-3d2f-4e21-8b7c-017b17b73fd5 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:49.644532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-192ceffe-3d2f-4e21-8b7c-017b17b73fd5 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:49.645050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-192ceffe-3d2f-4e21-8b7c-017b17b73fd5 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:49.791211 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cbe07ca6-e48b-47ed-a19e-ea90e1860ed4 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 2.853908 Oct 11 04:15:49.793110 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 696/1454] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:15:46 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 2855 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:15:49.830259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-192ceffe-3d2f-4e21-8b7c-017b17b73fd5 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:49.837850 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-192ceffe-3d2f-4e21-8b7c-017b17b73fd5 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1402 microversion: 2.1 time: 0.218061 Oct 11 04:15:49.838454 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 759/1455] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:49 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1402 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:49.855254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8cbed193-ef34-4e8d-a3aa-e28b8542b909 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:49.855858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8cbed193-ef34-4e8d-a3aa-e28b8542b909 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:49.862650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cbed193-ef34-4e8d-a3aa-e28b8542b909 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:49.863138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cbed193-ef34-4e8d-a3aa-e28b8542b909 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:49.863828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cbed193-ef34-4e8d-a3aa-e28b8542b909 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:49.864528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cbed193-ef34-4e8d-a3aa-e28b8542b909 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:49.865163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cbed193-ef34-4e8d-a3aa-e28b8542b909 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:49.865588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cbed193-ef34-4e8d-a3aa-e28b8542b909 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:49.935368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-b29e221b-d0fd-492b-9705-3cad475d8ed8 req-16490013-a51c-4145-925f-89a9d6844619 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4d394b-f24d-4e16-9ba1-ea7258409ba1", "tag": "0f2d4990-788c-41e8-a1d7-9dece272e13f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:49.960192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b29e221b-d0fd-492b-9705-3cad475d8ed8 req-16490013-a51c-4145-925f-89a9d6844619 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:49.960894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b29e221b-d0fd-492b-9705-3cad475d8ed8 req-16490013-a51c-4145-925f-89a9d6844619 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:49.963701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b29e221b-d0fd-492b-9705-3cad475d8ed8 req-16490013-a51c-4145-925f-89a9d6844619 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:49.981409 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-b29e221b-d0fd-492b-9705-3cad475d8ed8 req-16490013-a51c-4145-925f-89a9d6844619 service nova] Creating event network-changed:0f2d4990-788c-41e8-a1d7-9dece272e13f for instance bf4d394b-f24d-4e16-9ba1-ea7258409ba1 on n-h1-860892-1 Oct 11 04:15:49.986856 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-b29e221b-d0fd-492b-9705-3cad475d8ed8 req-16490013-a51c-4145-925f-89a9d6844619 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193849 Oct 11 04:15:49.987665 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 697/1456] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:49.997534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ff41f38-29e9-4b64-9cd6-780b58fccfff tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:49.998482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5ff41f38-29e9-4b64-9cd6-780b58fccfff tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:50.024246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8cbed193-ef34-4e8d-a3aa-e28b8542b909 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:50.034763 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8cbed193-ef34-4e8d-a3aa-e28b8542b909 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.183281 Oct 11 04:15:50.046370 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 760/1457] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:49 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:50.056839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5ff41f38-29e9-4b64-9cd6-780b58fccfff tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:50.068623 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ff41f38-29e9-4b64-9cd6-780b58fccfff tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1122 microversion: 2.1 time: 0.073597 Oct 11 04:15:50.069298 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 698/1458] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:49 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1122 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:50.092184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FloatingIPsAssociationTestJSON-server-291684612", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "771b531d-e085-4be0-a5db-f8ca98902475"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:50.154622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] validate_networks() for [('771b531d-e085-4be0-a5db-f8ca98902475', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:15:50.637443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiagnosticsNegativeTest-server-828183648", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:50.644062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:15:50.644480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:15:50.645110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:15:50.645520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:15:50.646108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:15:50.655209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:50.655980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:50.657259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:50.658219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:50.658703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:50.659114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:50.683648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Getting quotas for project 26ea13948bbf479386c8b9ee5e1aa5cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:15:50.685309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Getting quotas for user ab384b5b9a1b484bb001a06b0998f680 and project 26ea13948bbf479386c8b9ee5e1aa5cf. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:15:50.697766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:15:50.700027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:15:50.701166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:15:50.878942 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f509c8d4-fd42-4ebb-90e1-074a2448abfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.801311 Oct 11 04:15:50.880393 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 761/1459] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:15:50.888029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-29a029e2-9e9c-4fb2-afdb-e3b3438a924b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:50.893621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-29a029e2-9e9c-4fb2-afdb-e3b3438a924b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:50.896349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29a029e2-9e9c-4fb2-afdb-e3b3438a924b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:50.896854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29a029e2-9e9c-4fb2-afdb-e3b3438a924b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:50.897641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29a029e2-9e9c-4fb2-afdb-e3b3438a924b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:50.898684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29a029e2-9e9c-4fb2-afdb-e3b3438a924b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:50.899352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29a029e2-9e9c-4fb2-afdb-e3b3438a924b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:50.899861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29a029e2-9e9c-4fb2-afdb-e3b3438a924b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:51.009485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-29a029e2-9e9c-4fb2-afdb-e3b3438a924b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:51.022256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:15:51.024181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:15:51.024181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:15:51.024181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:15:51.024181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:15:51.029186 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-29a029e2-9e9c-4fb2-afdb-e3b3438a924b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1277 microversion: 2.1 time: 0.147514 Oct 11 04:15:51.034257 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 762/1460] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:50 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1277 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:51.035823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b655150d-59cf-4086-a164-f5a77c2d309c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:51.037271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b655150d-59cf-4086-a164-f5a77c2d309c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:51.043222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:51.043922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:51.044561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:51.045500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:51.045995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:51.046461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:51.052374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b655150d-59cf-4086-a164-f5a77c2d309c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:51.053271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b655150d-59cf-4086-a164-f5a77c2d309c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:51.054518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b655150d-59cf-4086-a164-f5a77c2d309c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:51.055529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b655150d-59cf-4086-a164-f5a77c2d309c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:51.056342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b655150d-59cf-4086-a164-f5a77c2d309c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:51.057193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b655150d-59cf-4086-a164-f5a77c2d309c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:51.073623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Getting quotas for project f93ac52a8285437d9875b02ff758eaae. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:15:51.080610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Getting quotas for user f1e6e057d5e849899bda86587049e1ce and project f93ac52a8285437d9875b02ff758eaae. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:15:51.095153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:15:51.098068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:15:51.260880 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1fd3327a-0955-41b0-99ab-d2a591be2b61 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.767825 Oct 11 04:15:51.261866 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 699/1461] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:15:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:15:51.268084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df2cdf8b-e181-4bec-a77a-07f4a97d96ad tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:51.269077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-df2cdf8b-e181-4bec-a77a-07f4a97d96ad tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:51.304898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b655150d-59cf-4086-a164-f5a77c2d309c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:51.317508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:51.330551 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b655150d-59cf-4086-a164-f5a77c2d309c tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1402 microversion: 2.1 time: 0.295933 Oct 11 04:15:51.348845 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 763/1462] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:51 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1402 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:51.355751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e09a3f67-7f14-4f10-b509-3a71ea26b32d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:51.356382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e09a3f67-7f14-4f10-b509-3a71ea26b32d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:51.363640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e09a3f67-7f14-4f10-b509-3a71ea26b32d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:51.364180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e09a3f67-7f14-4f10-b509-3a71ea26b32d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:51.364650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e09a3f67-7f14-4f10-b509-3a71ea26b32d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:51.366675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e09a3f67-7f14-4f10-b509-3a71ea26b32d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:51.367143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e09a3f67-7f14-4f10-b509-3a71ea26b32d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:51.367647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e09a3f67-7f14-4f10-b509-3a71ea26b32d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:51.377994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-df2cdf8b-e181-4bec-a77a-07f4a97d96ad tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:51.388237 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df2cdf8b-e181-4bec-a77a-07f4a97d96ad tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1223 microversion: 2.1 time: 0.123370 Oct 11 04:15:51.388839 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 700/1463] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:51 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1223 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:51.410284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a04751ec-737d-4192-a546-fded0e3601c8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:51.425502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a04751ec-737d-4192-a546-fded0e3601c8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:51.436396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a04751ec-737d-4192-a546-fded0e3601c8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:51.437126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a04751ec-737d-4192-a546-fded0e3601c8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:51.437775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a04751ec-737d-4192-a546-fded0e3601c8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:51.438821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a04751ec-737d-4192-a546-fded0e3601c8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:51.440135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a04751ec-737d-4192-a546-fded0e3601c8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:51.440779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a04751ec-737d-4192-a546-fded0e3601c8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:51.593059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a04751ec-737d-4192-a546-fded0e3601c8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:51.602023 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a04751ec-737d-4192-a546-fded0e3601c8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1164 microversion: 2.1 time: 0.207765 Oct 11 04:15:51.608634 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 701/1464] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:51 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1164 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:51.614156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-23f1f719-a5e5-4ec1-85de-7293f635597d tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:51.614947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-23f1f719-a5e5-4ec1-85de-7293f635597d tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:51.681170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e09a3f67-7f14-4f10-b509-3a71ea26b32d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:51.690646 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e09a3f67-7f14-4f10-b509-3a71ea26b32d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.339649 Oct 11 04:15:51.698977 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 764/1465] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:51 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:51.736346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-23f1f719-a5e5-4ec1-85de-7293f635597d tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:51.742906 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-23f1f719-a5e5-4ec1-85de-7293f635597d tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1222 microversion: 2.1 time: 0.132228 Oct 11 04:15:51.743487 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 702/1466] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:51 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1222 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:51.748875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0da13744-bf2e-4414-862a-75e744f549c0 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:51.752886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0da13744-bf2e-4414-862a-75e744f549c0 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:51.761512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0da13744-bf2e-4414-862a-75e744f549c0 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:51.761932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0da13744-bf2e-4414-862a-75e744f549c0 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:51.762727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0da13744-bf2e-4414-862a-75e744f549c0 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:51.763537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0da13744-bf2e-4414-862a-75e744f549c0 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:51.763988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0da13744-bf2e-4414-862a-75e744f549c0 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:51.764542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0da13744-bf2e-4414-862a-75e744f549c0 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.020497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-0da13744-bf2e-4414-862a-75e744f549c0 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid f4133104-80ff-4629-bf97-1d0c7441fbfd {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:15:52.036311 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0da13744-bf2e-4414-862a-75e744f549c0 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 2344 microversion: 2.25 time: 0.291106 Oct 11 04:15:52.037021 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 765/1467] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:15:51 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 2344 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:15:52.058427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2e666a2d-9954-46d4-9d6b-808d796f5a82 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:52.059874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2e666a2d-9954-46d4-9d6b-808d796f5a82 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:52.062051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d61293b1-0bf9-4f5c-9b62-0621575aa7e7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:52.066168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e666a2d-9954-46d4-9d6b-808d796f5a82 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.066331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61293b1-0bf9-4f5c-9b62-0621575aa7e7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.066682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e666a2d-9954-46d4-9d6b-808d796f5a82 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.066948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61293b1-0bf9-4f5c-9b62-0621575aa7e7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.067167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e666a2d-9954-46d4-9d6b-808d796f5a82 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.067340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61293b1-0bf9-4f5c-9b62-0621575aa7e7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.067981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e666a2d-9954-46d4-9d6b-808d796f5a82 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.069235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61293b1-0bf9-4f5c-9b62-0621575aa7e7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.069854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61293b1-0bf9-4f5c-9b62-0621575aa7e7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.070028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e666a2d-9954-46d4-9d6b-808d796f5a82 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.070742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d61293b1-0bf9-4f5c-9b62-0621575aa7e7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.071298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e666a2d-9954-46d4-9d6b-808d796f5a82 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.101107 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d61293b1-0bf9-4f5c-9b62-0621575aa7e7 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.043170 Oct 11 04:15:52.101712 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 766/1468] 10.222.0.26 () {60 vars in 1217 bytes} [Tue Oct 11 04:15:52 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:15:52.185705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2e666a2d-9954-46d4-9d6b-808d796f5a82 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:52.190279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:52.197613 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2e666a2d-9954-46d4-9d6b-808d796f5a82 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1275 microversion: 2.1 time: 0.141611 Oct 11 04:15:52.209566 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 703/1469] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:52 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1275 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:52.357671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5533d03-348f-46a4-b8aa-b03458db2e32 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:52.358581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c5533d03-348f-46a4-b8aa-b03458db2e32 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:52.366462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5533d03-348f-46a4-b8aa-b03458db2e32 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.367175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5533d03-348f-46a4-b8aa-b03458db2e32 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.367734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5533d03-348f-46a4-b8aa-b03458db2e32 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.368435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5533d03-348f-46a4-b8aa-b03458db2e32 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.368879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5533d03-348f-46a4-b8aa-b03458db2e32 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.369373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5533d03-348f-46a4-b8aa-b03458db2e32 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.422765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-188a099f-74f1-42c9-aefa-47018ed571ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:52.423825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-188a099f-74f1-42c9-aefa-47018ed571ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:52.434149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-188a099f-74f1-42c9-aefa-47018ed571ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.434978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-188a099f-74f1-42c9-aefa-47018ed571ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.438559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-188a099f-74f1-42c9-aefa-47018ed571ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.438559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-188a099f-74f1-42c9-aefa-47018ed571ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.438559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-188a099f-74f1-42c9-aefa-47018ed571ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.439648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-188a099f-74f1-42c9-aefa-47018ed571ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.535248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-188a099f-74f1-42c9-aefa-47018ed571ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:52.543783 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-188a099f-74f1-42c9-aefa-47018ed571ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1227 microversion: 2.1 time: 0.125525 Oct 11 04:15:52.544606 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 704/1470] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:52 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1227 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:52.570723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5533d03-348f-46a4-b8aa-b03458db2e32 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:52.579639 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c5533d03-348f-46a4-b8aa-b03458db2e32 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1402 microversion: 2.1 time: 0.226627 Oct 11 04:15:52.580198 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 767/1471] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:52 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1402 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:52.629624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca56ebd5-04a6-4aac-b314-049cea104d7b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:52.630376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ca56ebd5-04a6-4aac-b314-049cea104d7b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:52.636755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca56ebd5-04a6-4aac-b314-049cea104d7b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.637514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca56ebd5-04a6-4aac-b314-049cea104d7b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.638167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca56ebd5-04a6-4aac-b314-049cea104d7b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.644963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca56ebd5-04a6-4aac-b314-049cea104d7b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.644963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca56ebd5-04a6-4aac-b314-049cea104d7b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.644963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca56ebd5-04a6-4aac-b314-049cea104d7b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.714697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4378012e-1d06-444c-9e2b-3fa1e87924d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:52.715397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4378012e-1d06-444c-9e2b-3fa1e87924d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:52.722796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4378012e-1d06-444c-9e2b-3fa1e87924d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.723468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4378012e-1d06-444c-9e2b-3fa1e87924d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.723896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4378012e-1d06-444c-9e2b-3fa1e87924d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.724860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4378012e-1d06-444c-9e2b-3fa1e87924d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.725674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4378012e-1d06-444c-9e2b-3fa1e87924d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.725674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4378012e-1d06-444c-9e2b-3fa1e87924d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.742955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ca56ebd5-04a6-4aac-b314-049cea104d7b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:52.756365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ca56ebd5-04a6-4aac-b314-049cea104d7b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1228 microversion: 2.1 time: 0.131279 Oct 11 04:15:52.758638 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 705/1472] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:52 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1228 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:52.780182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a832e5a1-ac39-4682-93b9-fa372011d2e1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:52.780989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a832e5a1-ac39-4682-93b9-fa372011d2e1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:52.805860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a832e5a1-ac39-4682-93b9-fa372011d2e1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.807145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a832e5a1-ac39-4682-93b9-fa372011d2e1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.809542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a832e5a1-ac39-4682-93b9-fa372011d2e1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.810501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a832e5a1-ac39-4682-93b9-fa372011d2e1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:52.813405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a832e5a1-ac39-4682-93b9-fa372011d2e1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:52.814072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a832e5a1-ac39-4682-93b9-fa372011d2e1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:52.927538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a832e5a1-ac39-4682-93b9-fa372011d2e1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:52.935777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4378012e-1d06-444c-9e2b-3fa1e87924d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:52.944984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4378012e-1d06-444c-9e2b-3fa1e87924d3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1476 microversion: 2.1 time: 0.234128 Oct 11 04:15:52.946479 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 768/1473] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:52 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1476 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:15:52.956631 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a832e5a1-ac39-4682-93b9-fa372011d2e1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1226 microversion: 2.1 time: 0.178663 Oct 11 04:15:52.959733 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 706/1474] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:52 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1226 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:53.219994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f70e1bf8-4485-4a4a-bf68-f32616a1c1f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:53.220569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f70e1bf8-4485-4a4a-bf68-f32616a1c1f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:53.228525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f70e1bf8-4485-4a4a-bf68-f32616a1c1f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:53.228750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f70e1bf8-4485-4a4a-bf68-f32616a1c1f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:53.229186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f70e1bf8-4485-4a4a-bf68-f32616a1c1f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:53.230178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f70e1bf8-4485-4a4a-bf68-f32616a1c1f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:53.230961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f70e1bf8-4485-4a4a-bf68-f32616a1c1f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:53.231392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f70e1bf8-4485-4a4a-bf68-f32616a1c1f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:53.569593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f25c966-6462-40ce-aee8-82464600ed93 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:53.570289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f25c966-6462-40ce-aee8-82464600ed93 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:53.581354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f25c966-6462-40ce-aee8-82464600ed93 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:53.581839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f25c966-6462-40ce-aee8-82464600ed93 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:53.599038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f25c966-6462-40ce-aee8-82464600ed93 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:53.599038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f25c966-6462-40ce-aee8-82464600ed93 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:53.599038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f25c966-6462-40ce-aee8-82464600ed93 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:53.599038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f25c966-6462-40ce-aee8-82464600ed93 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:53.739190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f25c966-6462-40ce-aee8-82464600ed93 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:53.750503 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f25c966-6462-40ce-aee8-82464600ed93 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1275 microversion: 2.1 time: 0.184541 Oct 11 04:15:53.761972 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 707/1475] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:53 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1275 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:53.768773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1fad5fe6-a61d-472d-acc1-1e257b4ce35a tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:53.769586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1fad5fe6-a61d-472d-acc1-1e257b4ce35a tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:53.784324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad5fe6-a61d-472d-acc1-1e257b4ce35a tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:53.785075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad5fe6-a61d-472d-acc1-1e257b4ce35a tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:53.793866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad5fe6-a61d-472d-acc1-1e257b4ce35a tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:53.793866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad5fe6-a61d-472d-acc1-1e257b4ce35a tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:53.793866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad5fe6-a61d-472d-acc1-1e257b4ce35a tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:53.793866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fad5fe6-a61d-472d-acc1-1e257b4ce35a tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:54.666267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f70e1bf8-4485-4a4a-bf68-f32616a1c1f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:54.679870 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f70e1bf8-4485-4a4a-bf68-f32616a1c1f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1317 microversion: 2.1 time: 1.464487 Oct 11 04:15:54.680457 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 769/1476] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:53 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1317 bytes in 1466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:54.692033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ccf68b0-8b50-4880-8210-5bd255b9a78d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:54.695138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0ccf68b0-8b50-4880-8210-5bd255b9a78d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:54.710223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ccf68b0-8b50-4880-8210-5bd255b9a78d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:54.710741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ccf68b0-8b50-4880-8210-5bd255b9a78d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:54.711173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ccf68b0-8b50-4880-8210-5bd255b9a78d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:54.711874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ccf68b0-8b50-4880-8210-5bd255b9a78d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:54.714045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ccf68b0-8b50-4880-8210-5bd255b9a78d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:54.717376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ccf68b0-8b50-4880-8210-5bd255b9a78d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:54.866298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0ccf68b0-8b50-4880-8210-5bd255b9a78d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:54.877902 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0ccf68b0-8b50-4880-8210-5bd255b9a78d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1238 microversion: 2.1 time: 0.196219 Oct 11 04:15:54.879256 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 770/1477] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:54 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1238 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:54.885228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-08bcad09-ce5b-4cbb-abfb-57c268ebe766 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:54.886291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-08bcad09-ce5b-4cbb-abfb-57c268ebe766 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:54.895519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08bcad09-ce5b-4cbb-abfb-57c268ebe766 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:54.896342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08bcad09-ce5b-4cbb-abfb-57c268ebe766 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:54.896990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08bcad09-ce5b-4cbb-abfb-57c268ebe766 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:54.898603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08bcad09-ce5b-4cbb-abfb-57c268ebe766 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:54.898603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08bcad09-ce5b-4cbb-abfb-57c268ebe766 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:54.899479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08bcad09-ce5b-4cbb-abfb-57c268ebe766 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:55.188796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1fad5fe6-a61d-472d-acc1-1e257b4ce35a tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:55.207068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1fad5fe6-a61d-472d-acc1-1e257b4ce35a tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1402 microversion: 2.1 time: 1.443264 Oct 11 04:15:55.211299 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 708/1478] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:53 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1402 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:55.231408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-73bd3d13-8f9e-492c-b619-6bea3a33246b tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:55.232073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73bd3d13-8f9e-492c-b619-6bea3a33246b tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:55.254811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73bd3d13-8f9e-492c-b619-6bea3a33246b tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:55.255528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73bd3d13-8f9e-492c-b619-6bea3a33246b tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:55.256173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73bd3d13-8f9e-492c-b619-6bea3a33246b tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:55.257080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73bd3d13-8f9e-492c-b619-6bea3a33246b tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:55.258573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73bd3d13-8f9e-492c-b619-6bea3a33246b tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:55.261500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73bd3d13-8f9e-492c-b619-6bea3a33246b tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:55.391377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73bd3d13-8f9e-492c-b619-6bea3a33246b tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:55.400864 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-73bd3d13-8f9e-492c-b619-6bea3a33246b tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1282 microversion: 2.1 time: 0.188145 Oct 11 04:15:55.401377 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 709/1479] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:55 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1282 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:55.409322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3cb6a162-5f73-4615-9d8c-c53149d7efec tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:55.410088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3cb6a162-5f73-4615-9d8c-c53149d7efec tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:55.431553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cb6a162-5f73-4615-9d8c-c53149d7efec tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:55.434147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cb6a162-5f73-4615-9d8c-c53149d7efec tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:55.434890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cb6a162-5f73-4615-9d8c-c53149d7efec tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:55.435893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cb6a162-5f73-4615-9d8c-c53149d7efec tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:55.436505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cb6a162-5f73-4615-9d8c-c53149d7efec tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:55.437101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cb6a162-5f73-4615-9d8c-c53149d7efec tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:55.455003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-08bcad09-ce5b-4cbb-abfb-57c268ebe766 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:55.524726 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-08bcad09-ce5b-4cbb-abfb-57c268ebe766 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1475 microversion: 2.1 time: 0.587125 Oct 11 04:15:55.524726 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 771/1480] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:54 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1475 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:55.524726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5b08045-47b7-43ec-98d2-a952883e376a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e8df0063-ee71-484e-b291-c6033329188f", "device": "/dev/xvdb"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:55.524726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5b08045-47b7-43ec-98d2-a952883e376a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:55.524726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5b08045-47b7-43ec-98d2-a952883e376a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:55.524726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5b08045-47b7-43ec-98d2-a952883e376a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:55.531815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5b08045-47b7-43ec-98d2-a952883e376a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:55.534280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5b08045-47b7-43ec-98d2-a952883e376a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:55.535960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5b08045-47b7-43ec-98d2-a952883e376a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:55.538332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5b08045-47b7-43ec-98d2-a952883e376a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:55.770542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3cb6a162-5f73-4615-9d8c-c53149d7efec tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:55.785140 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3cb6a162-5f73-4615-9d8c-c53149d7efec tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1281 microversion: 2.1 time: 0.382693 Oct 11 04:15:55.815708 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 710/1481] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:55 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1281 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:55.825755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62925b56-fe78-4241-9bd1-12d570826c4e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:55.826531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-62925b56-fe78-4241-9bd1-12d570826c4e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:55.844668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62925b56-fe78-4241-9bd1-12d570826c4e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:55.845185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62925b56-fe78-4241-9bd1-12d570826c4e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:55.845633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62925b56-fe78-4241-9bd1-12d570826c4e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:55.847599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62925b56-fe78-4241-9bd1-12d570826c4e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:55.848089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62925b56-fe78-4241-9bd1-12d570826c4e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:55.848533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62925b56-fe78-4241-9bd1-12d570826c4e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:56.748536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62925b56-fe78-4241-9bd1-12d570826c4e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:56.756791 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-62925b56-fe78-4241-9bd1-12d570826c4e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1317 microversion: 2.1 time: 0.939557 Oct 11 04:15:56.762897 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 711/1482] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:55 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1317 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:56.779666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-81fcccc2-5c94-49ce-ba45-a79e3fe20ead tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:56.780609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-81fcccc2-5c94-49ce-ba45-a79e3fe20ead tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:56.789640 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5b08045-47b7-43ec-98d2-a952883e376a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "POST /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments" status: 200 len: 194 microversion: 2.25 time: 1.313324 Oct 11 04:15:56.791055 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 772/1483] 10.222.0.26 () {62 vars in 1364 bytes} [Tue Oct 11 04:15:55 2022] POST /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments => generated 194 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:15:56.794660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcccc2-5c94-49ce-ba45-a79e3fe20ead tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:56.799769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcccc2-5c94-49ce-ba45-a79e3fe20ead tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:56.799769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcccc2-5c94-49ce-ba45-a79e3fe20ead tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:56.813164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcccc2-5c94-49ce-ba45-a79e3fe20ead tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:56.813855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcccc2-5c94-49ce-ba45-a79e3fe20ead tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:56.814452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcccc2-5c94-49ce-ba45-a79e3fe20ead tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:56.824899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-12bb91e9-ff08-4cfe-97c0-668af18fe31d tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:56.828877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-12bb91e9-ff08-4cfe-97c0-668af18fe31d tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:56.843711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:56.848089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12bb91e9-ff08-4cfe-97c0-668af18fe31d tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:56.851258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12bb91e9-ff08-4cfe-97c0-668af18fe31d tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:56.851839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12bb91e9-ff08-4cfe-97c0-668af18fe31d tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:56.857469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12bb91e9-ff08-4cfe-97c0-668af18fe31d tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:56.857469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12bb91e9-ff08-4cfe-97c0-668af18fe31d tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:56.857469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12bb91e9-ff08-4cfe-97c0-668af18fe31d tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:57.140779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-81fcccc2-5c94-49ce-ba45-a79e3fe20ead tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:57.150222 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-81fcccc2-5c94-49ce-ba45-a79e3fe20ead tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1238 microversion: 2.1 time: 0.386215 Oct 11 04:15:57.160796 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 712/1484] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:56 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1238 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:57.166641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e21b0f07-cb28-4714-87bb-c5bf00a82e8d req-a9934d56-5492-4fec-9de7-cf04c0ca181a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4d394b-f24d-4e16-9ba1-ea7258409ba1", "name": "network-vif-plugged", "status": "completed", "tag": "0f2d4990-788c-41e8-a1d7-9dece272e13f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:57.185525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e21b0f07-cb28-4714-87bb-c5bf00a82e8d req-a9934d56-5492-4fec-9de7-cf04c0ca181a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:57.188756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e21b0f07-cb28-4714-87bb-c5bf00a82e8d req-a9934d56-5492-4fec-9de7-cf04c0ca181a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:57.189323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e21b0f07-cb28-4714-87bb-c5bf00a82e8d req-a9934d56-5492-4fec-9de7-cf04c0ca181a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:57.217526 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e21b0f07-cb28-4714-87bb-c5bf00a82e8d req-a9934d56-5492-4fec-9de7-cf04c0ca181a service nova] Creating event network-vif-plugged:0f2d4990-788c-41e8-a1d7-9dece272e13f for instance bf4d394b-f24d-4e16-9ba1-ea7258409ba1 on n-h1-860892-1 Oct 11 04:15:57.225060 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e21b0f07-cb28-4714-87bb-c5bf00a82e8d req-a9934d56-5492-4fec-9de7-cf04c0ca181a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062488 Oct 11 04:15:57.226107 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 713/1485] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:57.231537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0a786af9-a703-4960-b34d-9465a3ca251f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:57.236150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0a786af9-a703-4960-b34d-9465a3ca251f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:57.240213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a786af9-a703-4960-b34d-9465a3ca251f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:57.241286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a786af9-a703-4960-b34d-9465a3ca251f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:57.241973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a786af9-a703-4960-b34d-9465a3ca251f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:57.243160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a786af9-a703-4960-b34d-9465a3ca251f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:57.243849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a786af9-a703-4960-b34d-9465a3ca251f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:57.244525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a786af9-a703-4960-b34d-9465a3ca251f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:57.401855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-12bb91e9-ff08-4cfe-97c0-668af18fe31d tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:57.411898 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-12bb91e9-ff08-4cfe-97c0-668af18fe31d tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1402 microversion: 2.1 time: 0.619274 Oct 11 04:15:57.414350 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 773/1486] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:56 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1402 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:57.423689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0a786af9-a703-4960-b34d-9465a3ca251f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:57.444860 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0a786af9-a703-4960-b34d-9465a3ca251f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1280 microversion: 2.1 time: 0.210130 Oct 11 04:15:57.444860 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 714/1487] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:57 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1280 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:57.445177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2c8ba6b-13ee-4da5-9afb-e11e35b22acf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:57.445177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b2c8ba6b-13ee-4da5-9afb-e11e35b22acf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:57.456260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3edf332-50f8-45e7-90b8-88be69b807e8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:57.459774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3edf332-50f8-45e7-90b8-88be69b807e8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:57.464222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c8ba6b-13ee-4da5-9afb-e11e35b22acf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:57.473118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c8ba6b-13ee-4da5-9afb-e11e35b22acf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:57.473826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c8ba6b-13ee-4da5-9afb-e11e35b22acf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:57.474821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c8ba6b-13ee-4da5-9afb-e11e35b22acf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:57.476860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c8ba6b-13ee-4da5-9afb-e11e35b22acf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:57.479371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3edf332-50f8-45e7-90b8-88be69b807e8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:57.480097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c8ba6b-13ee-4da5-9afb-e11e35b22acf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:57.480854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3edf332-50f8-45e7-90b8-88be69b807e8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:57.483727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3edf332-50f8-45e7-90b8-88be69b807e8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:57.487116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3edf332-50f8-45e7-90b8-88be69b807e8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:57.487748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3edf332-50f8-45e7-90b8-88be69b807e8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:57.488942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3edf332-50f8-45e7-90b8-88be69b807e8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:58.033305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b2c8ba6b-13ee-4da5-9afb-e11e35b22acf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:58.049032 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2c8ba6b-13ee-4da5-9afb-e11e35b22acf tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1475 microversion: 2.1 time: 0.608390 Oct 11 04:15:58.049645 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 774/1488] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:57 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1475 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:58.064347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-be0eb2f7-caee-43ff-b48c-9d6149960005 req-634c13c7-2a16-4fe1-a6a1-5018d02796ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72660709-ce51-4053-af08-b1cd828c95d4", "name": "network-vif-unplugged", "status": "completed", "tag": "66639d0c-5518-4300-98e7-ab09ecbda154"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:15:58.100190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-be0eb2f7-caee-43ff-b48c-9d6149960005 req-634c13c7-2a16-4fe1-a6a1-5018d02796ee service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:58.104345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-be0eb2f7-caee-43ff-b48c-9d6149960005 req-634c13c7-2a16-4fe1-a6a1-5018d02796ee service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:58.107151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-be0eb2f7-caee-43ff-b48c-9d6149960005 req-634c13c7-2a16-4fe1-a6a1-5018d02796ee service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:58.152449 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-be0eb2f7-caee-43ff-b48c-9d6149960005 req-634c13c7-2a16-4fe1-a6a1-5018d02796ee service nova] Creating event network-vif-unplugged:66639d0c-5518-4300-98e7-ab09ecbda154 for instance 72660709-ce51-4053-af08-b1cd828c95d4 on n-h1-860892-1 Oct 11 04:15:58.172243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a3edf332-50f8-45e7-90b8-88be69b807e8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:58.175002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-be0eb2f7-caee-43ff-b48c-9d6149960005 req-634c13c7-2a16-4fe1-a6a1-5018d02796ee service nova] Instance 72660709-ce51-4053-af08-b1cd828c95d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:15:58.185199 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3edf332-50f8-45e7-90b8-88be69b807e8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.740978 Oct 11 04:15:58.188597 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 715/1489] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:57 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:58.204301 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-be0eb2f7-caee-43ff-b48c-9d6149960005 req-634c13c7-2a16-4fe1-a6a1-5018d02796ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.149979 Oct 11 04:15:58.206840 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 775/1490] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:15:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:15:58.219876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3d6cc79f-3dee-4ea2-b245-7ed218d182b3 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:58.223506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3d6cc79f-3dee-4ea2-b245-7ed218d182b3 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:58.236918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5cff16bc-269a-4394-ada9-fd82966ad1a2 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:58.240623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d6cc79f-3dee-4ea2-b245-7ed218d182b3 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:58.241201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d6cc79f-3dee-4ea2-b245-7ed218d182b3 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:58.241852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d6cc79f-3dee-4ea2-b245-7ed218d182b3 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:58.242817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d6cc79f-3dee-4ea2-b245-7ed218d182b3 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:58.243108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5cff16bc-269a-4394-ada9-fd82966ad1a2 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:58.245512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d6cc79f-3dee-4ea2-b245-7ed218d182b3 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:58.246183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d6cc79f-3dee-4ea2-b245-7ed218d182b3 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:58.259381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cff16bc-269a-4394-ada9-fd82966ad1a2 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:58.260882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cff16bc-269a-4394-ada9-fd82966ad1a2 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:58.262623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cff16bc-269a-4394-ada9-fd82966ad1a2 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:58.263953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cff16bc-269a-4394-ada9-fd82966ad1a2 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:58.266445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cff16bc-269a-4394-ada9-fd82966ad1a2 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:58.267063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cff16bc-269a-4394-ada9-fd82966ad1a2 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:58.816598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d6cc79f-3dee-4ea2-b245-7ed218d182b3 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:58.825227 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3d6cc79f-3dee-4ea2-b245-7ed218d182b3 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1317 microversion: 2.1 time: 0.624916 Oct 11 04:15:58.840893 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 716/1491] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:58 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1317 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:58.851787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-34738cba-b087-4d0b-9681-4170606390a2 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:58.852842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-34738cba-b087-4d0b-9681-4170606390a2 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:58.859730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34738cba-b087-4d0b-9681-4170606390a2 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:58.860505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34738cba-b087-4d0b-9681-4170606390a2 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:58.861696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34738cba-b087-4d0b-9681-4170606390a2 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:58.862932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34738cba-b087-4d0b-9681-4170606390a2 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:58.863465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34738cba-b087-4d0b-9681-4170606390a2 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:58.863948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34738cba-b087-4d0b-9681-4170606390a2 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:58.927164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5cff16bc-269a-4394-ada9-fd82966ad1a2 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:58.940278 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5cff16bc-269a-4394-ada9-fd82966ad1a2 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1305 microversion: 2.1 time: 0.731923 Oct 11 04:15:58.941159 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 776/1492] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:58 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1305 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:58.965464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e22a17c5-e13b-45d6-abb6-b20de57d8dbd tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:58.972096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e22a17c5-e13b-45d6-abb6-b20de57d8dbd tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:58.974325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e22a17c5-e13b-45d6-abb6-b20de57d8dbd tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:58.974989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e22a17c5-e13b-45d6-abb6-b20de57d8dbd tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:58.976148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e22a17c5-e13b-45d6-abb6-b20de57d8dbd tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:58.976868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e22a17c5-e13b-45d6-abb6-b20de57d8dbd tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:58.978122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e22a17c5-e13b-45d6-abb6-b20de57d8dbd tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:58.979101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e22a17c5-e13b-45d6-abb6-b20de57d8dbd tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:59.126262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e22a17c5-e13b-45d6-abb6-b20de57d8dbd tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:59.135141 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e22a17c5-e13b-45d6-abb6-b20de57d8dbd tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1280 microversion: 2.1 time: 0.175054 Oct 11 04:15:59.135734 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 777/1493] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:58 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1280 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:59.150310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a2223486-2ee2-486d-81b4-068a78fb581d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:59.150310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a2223486-2ee2-486d-81b4-068a78fb581d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:59.156360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2223486-2ee2-486d-81b4-068a78fb581d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:59.157491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2223486-2ee2-486d-81b4-068a78fb581d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:59.158174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2223486-2ee2-486d-81b4-068a78fb581d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:59.159363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2223486-2ee2-486d-81b4-068a78fb581d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:59.159930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2223486-2ee2-486d-81b4-068a78fb581d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:59.160462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2223486-2ee2-486d-81b4-068a78fb581d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:59.462826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a2223486-2ee2-486d-81b4-068a78fb581d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:59.465100 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a2223486-2ee2-486d-81b4-068a78fb581d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1475 microversion: 2.1 time: 0.326303 Oct 11 04:15:59.471291 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 778/1494] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:59 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1475 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:59.478596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-886f155f-fa20-4130-8650-37b8e60aa5e2 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:59.484644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-886f155f-fa20-4130-8650-37b8e60aa5e2 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:59.493606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886f155f-fa20-4130-8650-37b8e60aa5e2 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:59.496880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886f155f-fa20-4130-8650-37b8e60aa5e2 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:59.497536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886f155f-fa20-4130-8650-37b8e60aa5e2 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:59.499186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886f155f-fa20-4130-8650-37b8e60aa5e2 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:59.501983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886f155f-fa20-4130-8650-37b8e60aa5e2 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:59.502806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886f155f-fa20-4130-8650-37b8e60aa5e2 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:59.742374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-34738cba-b087-4d0b-9681-4170606390a2 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:59.759289 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-34738cba-b087-4d0b-9681-4170606390a2 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1402 microversion: 2.1 time: 0.918566 Oct 11 04:15:59.759996 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 717/1495] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:58 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1402 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:15:59.849698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a2a8df77-b1fb-4f3b-b007-bebcd726ef83 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:15:59.851474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a2a8df77-b1fb-4f3b-b007-bebcd726ef83 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:15:59.860799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a8df77-b1fb-4f3b-b007-bebcd726ef83 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:59.861622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a8df77-b1fb-4f3b-b007-bebcd726ef83 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:59.875039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a8df77-b1fb-4f3b-b007-bebcd726ef83 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:59.878057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a8df77-b1fb-4f3b-b007-bebcd726ef83 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:15:59.878057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a8df77-b1fb-4f3b-b007-bebcd726ef83 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:15:59.878057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a8df77-b1fb-4f3b-b007-bebcd726ef83 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:15:59.985963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-886f155f-fa20-4130-8650-37b8e60aa5e2 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:15:59.990403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:15:59.998219 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-886f155f-fa20-4130-8650-37b8e60aa5e2 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.525214 Oct 11 04:16:00.004967 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 779/1496] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:59 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:00.014424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65b8e36f-2c87-4854-a2e4-2b7e2c700011 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:00.016055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-65b8e36f-2c87-4854-a2e4-2b7e2c700011 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:00.032766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b8e36f-2c87-4854-a2e4-2b7e2c700011 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:00.033816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b8e36f-2c87-4854-a2e4-2b7e2c700011 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:00.034532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b8e36f-2c87-4854-a2e4-2b7e2c700011 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:00.035498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b8e36f-2c87-4854-a2e4-2b7e2c700011 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:00.036204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b8e36f-2c87-4854-a2e4-2b7e2c700011 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:00.037537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b8e36f-2c87-4854-a2e4-2b7e2c700011 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:00.233700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a2a8df77-b1fb-4f3b-b007-bebcd726ef83 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:00.243287 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a2a8df77-b1fb-4f3b-b007-bebcd726ef83 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1317 microversion: 2.1 time: 0.397508 Oct 11 04:16:00.243928 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 718/1497] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:15:59 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1317 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:00.267940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4202118c-b985-40a8-a201-007d398ead1c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:00.279349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4202118c-b985-40a8-a201-007d398ead1c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:00.292840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4202118c-b985-40a8-a201-007d398ead1c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:00.297275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4202118c-b985-40a8-a201-007d398ead1c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:00.297459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4202118c-b985-40a8-a201-007d398ead1c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:00.298331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4202118c-b985-40a8-a201-007d398ead1c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:00.299208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4202118c-b985-40a8-a201-007d398ead1c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:00.301167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4202118c-b985-40a8-a201-007d398ead1c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:00.405476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4202118c-b985-40a8-a201-007d398ead1c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:00.411943 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4202118c-b985-40a8-a201-007d398ead1c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1280 microversion: 2.1 time: 0.147724 Oct 11 04:16:00.413187 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 719/1498] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:00 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1280 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:00.417839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-1fd794e0-b85a-4858-adfc-cf5aaf72afc9 req-0589df1a-226e-4496-ad6c-453a003256b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b997d21c-b814-4e0c-aba4-53ea4b3c590b", "tag": "dd60a4e4-6300-4a22-a81f-9f24c68978fb"}, {"name": "network-changed", "server_uuid": "72660709-ce51-4053-af08-b1cd828c95d4", "tag": "66639d0c-5518-4300-98e7-ab09ecbda154"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:00.428452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1fd794e0-b85a-4858-adfc-cf5aaf72afc9 req-0589df1a-226e-4496-ad6c-453a003256b1 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:00.429282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1fd794e0-b85a-4858-adfc-cf5aaf72afc9 req-0589df1a-226e-4496-ad6c-453a003256b1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:00.429933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1fd794e0-b85a-4858-adfc-cf5aaf72afc9 req-0589df1a-226e-4496-ad6c-453a003256b1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:00.451949 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-1fd794e0-b85a-4858-adfc-cf5aaf72afc9 req-0589df1a-226e-4496-ad6c-453a003256b1 service nova] Creating event network-changed:dd60a4e4-6300-4a22-a81f-9f24c68978fb for instance b997d21c-b814-4e0c-aba4-53ea4b3c590b on n-h2-860892-1 Oct 11 04:16:00.452812 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-1fd794e0-b85a-4858-adfc-cf5aaf72afc9 req-0589df1a-226e-4496-ad6c-453a003256b1 service nova] Creating event network-changed:66639d0c-5518-4300-98e7-ab09ecbda154 for instance 72660709-ce51-4053-af08-b1cd828c95d4 on n-h1-860892-1 Oct 11 04:16:00.460011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-1fd794e0-b85a-4858-adfc-cf5aaf72afc9 req-0589df1a-226e-4496-ad6c-453a003256b1 service nova] Instance 72660709-ce51-4053-af08-b1cd828c95d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:16:00.465897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-65b8e36f-2c87-4854-a2e4-2b7e2c700011 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:00.474015 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-65b8e36f-2c87-4854-a2e4-2b7e2c700011 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1305 microversion: 2.1 time: 0.467598 Oct 11 04:16:00.476292 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-1fd794e0-b85a-4858-adfc-cf5aaf72afc9 req-0589df1a-226e-4496-ad6c-453a003256b1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.061279 Oct 11 04:16:00.477498 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 720/1499] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:00.482909 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 780/1500] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:00 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1305 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:00.498772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41f34ebf-6d64-4770-8171-033014989fc1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:00.499770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-41f34ebf-6d64-4770-8171-033014989fc1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:00.507542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f34ebf-6d64-4770-8171-033014989fc1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:00.509314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f34ebf-6d64-4770-8171-033014989fc1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:00.510455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f34ebf-6d64-4770-8171-033014989fc1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:00.511438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f34ebf-6d64-4770-8171-033014989fc1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:00.512282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f34ebf-6d64-4770-8171-033014989fc1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:00.512940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f34ebf-6d64-4770-8171-033014989fc1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:00.544440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:00.785388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f7bc6f8c-2bf6-46e6-9f0f-7815b01f4ce9 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:00.786062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f7bc6f8c-2bf6-46e6-9f0f-7815b01f4ce9 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:00.789804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=76,nova_cell0:UPDATE=12 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:00.793933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7bc6f8c-2bf6-46e6-9f0f-7815b01f4ce9 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:00.794444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7bc6f8c-2bf6-46e6-9f0f-7815b01f4ce9 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:00.794900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7bc6f8c-2bf6-46e6-9f0f-7815b01f4ce9 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:00.795599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7bc6f8c-2bf6-46e6-9f0f-7815b01f4ce9 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:00.796036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7bc6f8c-2bf6-46e6-9f0f-7815b01f4ce9 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:00.796460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7bc6f8c-2bf6-46e6-9f0f-7815b01f4ce9 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:01.056846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:01.085497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f7bc6f8c-2bf6-46e6-9f0f-7815b01f4ce9 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:01.090299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-41f34ebf-6d64-4770-8171-033014989fc1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:01.096416 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f7bc6f8c-2bf6-46e6-9f0f-7815b01f4ce9 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1590 microversion: 2.1 time: 0.314754 Oct 11 04:16:01.111327 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 781/1501] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:00 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1590 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:01.114214 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41f34ebf-6d64-4770-8171-033014989fc1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1475 microversion: 2.1 time: 0.620148 Oct 11 04:16:01.116541 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 721/1502] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:00 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1475 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:01.126102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a51cfc9e-2f99-461b-bfe7-e8d75b3a6fcc tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:01.127140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a51cfc9e-2f99-461b-bfe7-e8d75b3a6fcc tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:01.138670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5c44dd0d-f17a-4e1f-8cc2-8509a3530c22 req-4920e3d4-f450-464b-87e4-1ac73df26ace service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b55166-b6c5-400e-b0c6-f1a04c595b75", "tag": "5db01fd1-2d11-42b1-a3c9-a52cca1b8138"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:01.147261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51cfc9e-2f99-461b-bfe7-e8d75b3a6fcc tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:01.148142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51cfc9e-2f99-461b-bfe7-e8d75b3a6fcc tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:01.149689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51cfc9e-2f99-461b-bfe7-e8d75b3a6fcc tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:01.150419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5c44dd0d-f17a-4e1f-8cc2-8509a3530c22 req-4920e3d4-f450-464b-87e4-1ac73df26ace service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:01.150904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5c44dd0d-f17a-4e1f-8cc2-8509a3530c22 req-4920e3d4-f450-464b-87e4-1ac73df26ace service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:01.151336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5c44dd0d-f17a-4e1f-8cc2-8509a3530c22 req-4920e3d4-f450-464b-87e4-1ac73df26ace service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:01.153813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51cfc9e-2f99-461b-bfe7-e8d75b3a6fcc tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:01.154631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51cfc9e-2f99-461b-bfe7-e8d75b3a6fcc tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:01.155357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51cfc9e-2f99-461b-bfe7-e8d75b3a6fcc tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:01.174683 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5c44dd0d-f17a-4e1f-8cc2-8509a3530c22 req-4920e3d4-f450-464b-87e4-1ac73df26ace service nova] Creating event network-changed:5db01fd1-2d11-42b1-a3c9-a52cca1b8138 for instance 75b55166-b6c5-400e-b0c6-f1a04c595b75 on n-h2-860892-1 Oct 11 04:16:01.191172 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5c44dd0d-f17a-4e1f-8cc2-8509a3530c22 req-4920e3d4-f450-464b-87e4-1ac73df26ace service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078228 Oct 11 04:16:01.192111 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 782/1503] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:01.202933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-34731d79-afd0-4ffa-9602-21e03523050b tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:01.203568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-34731d79-afd0-4ffa-9602-21e03523050b tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:01.217431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34731d79-afd0-4ffa-9602-21e03523050b tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:01.217927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34731d79-afd0-4ffa-9602-21e03523050b tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:01.220260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34731d79-afd0-4ffa-9602-21e03523050b tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:01.222644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34731d79-afd0-4ffa-9602-21e03523050b tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:01.223292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34731d79-afd0-4ffa-9602-21e03523050b tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:01.226725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34731d79-afd0-4ffa-9602-21e03523050b tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:01.336084 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-34731d79-afd0-4ffa-9602-21e03523050b tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142701 Oct 11 04:16:01.337417 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 783/1504] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:16:01 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1/os-interface => generated 285 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:01.343253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5f8b2f9-2efb-448e-a79e-95437ff7ec78 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:01.344624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5f8b2f9-2efb-448e-a79e-95437ff7ec78 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:01.358563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f8b2f9-2efb-448e-a79e-95437ff7ec78 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:01.360397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f8b2f9-2efb-448e-a79e-95437ff7ec78 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:01.362017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f8b2f9-2efb-448e-a79e-95437ff7ec78 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:01.362794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f8b2f9-2efb-448e-a79e-95437ff7ec78 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:01.367853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f8b2f9-2efb-448e-a79e-95437ff7ec78 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:01.368369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f8b2f9-2efb-448e-a79e-95437ff7ec78 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:01.739860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=20 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:01.782142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5f8b2f9-2efb-448e-a79e-95437ff7ec78 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:01.798336 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5f8b2f9-2efb-448e-a79e-95437ff7ec78 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1317 microversion: 2.1 time: 0.453133 Oct 11 04:16:01.799073 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 784/1505] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:01 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1317 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:01.805175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-195be139-4c41-426a-948a-37ed1ba7521c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:01.810282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-195be139-4c41-426a-948a-37ed1ba7521c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:01.823416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-195be139-4c41-426a-948a-37ed1ba7521c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:01.824187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-195be139-4c41-426a-948a-37ed1ba7521c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:01.824811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-195be139-4c41-426a-948a-37ed1ba7521c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:01.834387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-195be139-4c41-426a-948a-37ed1ba7521c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:01.835117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-195be139-4c41-426a-948a-37ed1ba7521c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:01.835722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-195be139-4c41-426a-948a-37ed1ba7521c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:02.083126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=10 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:02.251256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a51cfc9e-2f99-461b-bfe7-e8d75b3a6fcc tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:02.257546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-195be139-4c41-426a-948a-37ed1ba7521c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:02.266774 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-195be139-4c41-426a-948a-37ed1ba7521c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.466005 Oct 11 04:16:02.272267 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 785/1506] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:01 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:02.276106 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a51cfc9e-2f99-461b-bfe7-e8d75b3a6fcc tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 1.157758 Oct 11 04:16:02.281536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-02985662-6b0b-4afa-9f4e-f12b69208541 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:02.287048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-02985662-6b0b-4afa-9f4e-f12b69208541 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:02.293279 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 722/1507] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:01 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:02.301460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-22bd856b-d85a-45b7-90e8-132c92510ee3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:02.302367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-22bd856b-d85a-45b7-90e8-132c92510ee3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:02.304788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02985662-6b0b-4afa-9f4e-f12b69208541 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:02.305630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02985662-6b0b-4afa-9f4e-f12b69208541 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:02.305776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02985662-6b0b-4afa-9f4e-f12b69208541 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:02.306459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02985662-6b0b-4afa-9f4e-f12b69208541 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:02.307007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02985662-6b0b-4afa-9f4e-f12b69208541 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:02.307444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02985662-6b0b-4afa-9f4e-f12b69208541 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:02.310617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd856b-d85a-45b7-90e8-132c92510ee3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:02.311316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd856b-d85a-45b7-90e8-132c92510ee3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:02.311916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd856b-d85a-45b7-90e8-132c92510ee3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:02.312836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd856b-d85a-45b7-90e8-132c92510ee3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:02.313443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd856b-d85a-45b7-90e8-132c92510ee3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:02.314326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd856b-d85a-45b7-90e8-132c92510ee3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:02.728588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-02985662-6b0b-4afa-9f4e-f12b69208541 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:02.739244 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-02985662-6b0b-4afa-9f4e-f12b69208541 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1305 microversion: 2.1 time: 0.464725 Oct 11 04:16:02.749592 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 786/1508] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:02 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1305 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:02.760554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4d980725-0aae-4e75-b014-ce5562f82f51 req-b330d7ec-8914-4498-b55d-999bd5383f01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927821c1-5dca-4ee7-8072-d2ab4d97368b", "tag": "c5691c2d-c5a4-490b-b7b5-6f6dbad53a41"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:02.782208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4d980725-0aae-4e75-b014-ce5562f82f51 req-b330d7ec-8914-4498-b55d-999bd5383f01 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:02.782845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4d980725-0aae-4e75-b014-ce5562f82f51 req-b330d7ec-8914-4498-b55d-999bd5383f01 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:02.783563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4d980725-0aae-4e75-b014-ce5562f82f51 req-b330d7ec-8914-4498-b55d-999bd5383f01 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:02.805356 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4d980725-0aae-4e75-b014-ce5562f82f51 req-b330d7ec-8914-4498-b55d-999bd5383f01 service nova] Creating event network-changed:c5691c2d-c5a4-490b-b7b5-6f6dbad53a41 for instance 927821c1-5dca-4ee7-8072-d2ab4d97368b on n-h1-860892-1 Oct 11 04:16:02.811621 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4d980725-0aae-4e75-b014-ce5562f82f51 req-b330d7ec-8914-4498-b55d-999bd5383f01 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058762 Oct 11 04:16:02.813919 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 787/1509] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:02.830444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-be5f7831-5b4a-4356-b42f-ba0be03c54d5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:02.831304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-be5f7831-5b4a-4356-b42f-ba0be03c54d5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:02.840686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5f7831-5b4a-4356-b42f-ba0be03c54d5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:02.840686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5f7831-5b4a-4356-b42f-ba0be03c54d5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:02.841357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5f7831-5b4a-4356-b42f-ba0be03c54d5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:02.842853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5f7831-5b4a-4356-b42f-ba0be03c54d5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:02.844229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5f7831-5b4a-4356-b42f-ba0be03c54d5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:02.844922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5f7831-5b4a-4356-b42f-ba0be03c54d5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:03.133675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be5f7831-5b4a-4356-b42f-ba0be03c54d5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:03.149901 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-be5f7831-5b4a-4356-b42f-ba0be03c54d5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1317 microversion: 2.1 time: 0.326222 Oct 11 04:16:03.165838 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 788/1510] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:02 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1317 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:03.294870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1223d4bf-c322-447d-b7f3-03085b85741f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:03.295752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1223d4bf-c322-447d-b7f3-03085b85741f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:03.308174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1223d4bf-c322-447d-b7f3-03085b85741f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:03.309032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1223d4bf-c322-447d-b7f3-03085b85741f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:03.314440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1223d4bf-c322-447d-b7f3-03085b85741f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:03.319986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1223d4bf-c322-447d-b7f3-03085b85741f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:03.319986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1223d4bf-c322-447d-b7f3-03085b85741f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:03.319986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1223d4bf-c322-447d-b7f3-03085b85741f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:03.320326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-22bd856b-d85a-45b7-90e8-132c92510ee3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:03.330268 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-22bd856b-d85a-45b7-90e8-132c92510ee3 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1475 microversion: 2.1 time: 1.033084 Oct 11 04:16:03.330692 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 723/1511] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:02 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1475 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:03.348276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6543d621-a0a8-43d7-b045-d3d7069c856c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:03.352982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6543d621-a0a8-43d7-b045-d3d7069c856c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:03.362622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6543d621-a0a8-43d7-b045-d3d7069c856c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:03.364033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6543d621-a0a8-43d7-b045-d3d7069c856c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:03.364485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6543d621-a0a8-43d7-b045-d3d7069c856c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:03.365408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6543d621-a0a8-43d7-b045-d3d7069c856c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:03.367747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6543d621-a0a8-43d7-b045-d3d7069c856c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:03.368411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6543d621-a0a8-43d7-b045-d3d7069c856c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:03.817219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6543d621-a0a8-43d7-b045-d3d7069c856c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:03.832759 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6543d621-a0a8-43d7-b045-d3d7069c856c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.489344 Oct 11 04:16:03.837569 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 724/1512] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:03 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:03.847547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-839b23c4-f178-4fdd-ab40-dbde6717a0e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:03.848171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-839b23c4-f178-4fdd-ab40-dbde6717a0e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:03.865524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-839b23c4-f178-4fdd-ab40-dbde6717a0e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:03.866015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-839b23c4-f178-4fdd-ab40-dbde6717a0e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:03.866482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-839b23c4-f178-4fdd-ab40-dbde6717a0e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:03.867185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-839b23c4-f178-4fdd-ab40-dbde6717a0e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:03.867733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-839b23c4-f178-4fdd-ab40-dbde6717a0e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:03.869329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-839b23c4-f178-4fdd-ab40-dbde6717a0e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:04.011213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1223d4bf-c322-447d-b7f3-03085b85741f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:04.023194 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1223d4bf-c322-447d-b7f3-03085b85741f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.731946 Oct 11 04:16:04.024725 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 789/1513] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:03 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:04.174136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d5ff814a-a526-48a7-a17f-ca7887d039f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:04.175073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d5ff814a-a526-48a7-a17f-ca7887d039f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:04.190101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5ff814a-a526-48a7-a17f-ca7887d039f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:04.190101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5ff814a-a526-48a7-a17f-ca7887d039f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:04.190101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5ff814a-a526-48a7-a17f-ca7887d039f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:04.190101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5ff814a-a526-48a7-a17f-ca7887d039f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:04.190101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5ff814a-a526-48a7-a17f-ca7887d039f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:04.190101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5ff814a-a526-48a7-a17f-ca7887d039f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:04.420323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-839b23c4-f178-4fdd-ab40-dbde6717a0e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:04.428722 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-839b23c4-f178-4fdd-ab40-dbde6717a0e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1305 microversion: 2.1 time: 0.590043 Oct 11 04:16:04.445484 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 725/1514] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:03 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1305 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:04.536032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d5ff814a-a526-48a7-a17f-ca7887d039f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:04.548801 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d5ff814a-a526-48a7-a17f-ca7887d039f1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1317 microversion: 2.1 time: 0.378801 Oct 11 04:16:04.551745 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 790/1515] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:04 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1317 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:04.706563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-877aaad8-e8e5-4b6c-805e-51c8969677c1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:04.707451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-877aaad8-e8e5-4b6c-805e-51c8969677c1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:04.717467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877aaad8-e8e5-4b6c-805e-51c8969677c1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:04.718267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877aaad8-e8e5-4b6c-805e-51c8969677c1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:04.719473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877aaad8-e8e5-4b6c-805e-51c8969677c1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:04.721013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877aaad8-e8e5-4b6c-805e-51c8969677c1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:04.721701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877aaad8-e8e5-4b6c-805e-51c8969677c1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:04.722414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877aaad8-e8e5-4b6c-805e-51c8969677c1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:04.859452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9ef847f7-0571-4c1f-9318-101036589564 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:04.860201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9ef847f7-0571-4c1f-9318-101036589564 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:04.880638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef847f7-0571-4c1f-9318-101036589564 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:04.881406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef847f7-0571-4c1f-9318-101036589564 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:04.882813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef847f7-0571-4c1f-9318-101036589564 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:04.884905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef847f7-0571-4c1f-9318-101036589564 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:04.886002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef847f7-0571-4c1f-9318-101036589564 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:04.887255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef847f7-0571-4c1f-9318-101036589564 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:05.070823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-877aaad8-e8e5-4b6c-805e-51c8969677c1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:05.101135 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-877aaad8-e8e5-4b6c-805e-51c8969677c1 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1473 microversion: 2.1 time: 0.650648 Oct 11 04:16:05.101135 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 726/1516] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:04 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1473 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:05.103910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2fd05d5b-0147-47e7-a942-061fa50314d6 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:05.105725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2fd05d5b-0147-47e7-a942-061fa50314d6 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:05.113021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd05d5b-0147-47e7-a942-061fa50314d6 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:05.115051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd05d5b-0147-47e7-a942-061fa50314d6 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:05.116360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd05d5b-0147-47e7-a942-061fa50314d6 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:05.117382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd05d5b-0147-47e7-a942-061fa50314d6 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:05.118093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd05d5b-0147-47e7-a942-061fa50314d6 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:05.118836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd05d5b-0147-47e7-a942-061fa50314d6 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:05.169367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9ef847f7-0571-4c1f-9318-101036589564 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:05.198989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9ef847f7-0571-4c1f-9318-101036589564 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.343574 Oct 11 04:16:05.222911 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 791/1517] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:04 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:05.451569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-78a7fbf2-090c-4382-8a81-d8fef8392bab tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:05.454777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-78a7fbf2-090c-4382-8a81-d8fef8392bab tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:05.467097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78a7fbf2-090c-4382-8a81-d8fef8392bab tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:05.474231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78a7fbf2-090c-4382-8a81-d8fef8392bab tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:05.474938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78a7fbf2-090c-4382-8a81-d8fef8392bab tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:05.477840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78a7fbf2-090c-4382-8a81-d8fef8392bab tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:05.479363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78a7fbf2-090c-4382-8a81-d8fef8392bab tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:05.481697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78a7fbf2-090c-4382-8a81-d8fef8392bab tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:05.879892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-78a7fbf2-090c-4382-8a81-d8fef8392bab tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:05.889113 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-78a7fbf2-090c-4382-8a81-d8fef8392bab tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1305 microversion: 2.1 time: 0.441776 Oct 11 04:16:05.893428 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 792/1518] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:05 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1305 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:05.904431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f2137e27-6ef0-4665-86b2-014b614c3001 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:05.905495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f2137e27-6ef0-4665-86b2-014b614c3001 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:05.920160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2137e27-6ef0-4665-86b2-014b614c3001 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:05.921986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2137e27-6ef0-4665-86b2-014b614c3001 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:05.922671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2137e27-6ef0-4665-86b2-014b614c3001 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:05.925379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2137e27-6ef0-4665-86b2-014b614c3001 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:05.926024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2137e27-6ef0-4665-86b2-014b614c3001 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:05.927763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2137e27-6ef0-4665-86b2-014b614c3001 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:06.248613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2137e27-6ef0-4665-86b2-014b614c3001 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:06.267091 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f2137e27-6ef0-4665-86b2-014b614c3001 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1317 microversion: 2.1 time: 0.372243 Oct 11 04:16:06.268009 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 793/1519] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:05 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1317 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:06.282852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a4ebb79-9feb-4af1-a0b3-12adf8684f5f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:06.286165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6a4ebb79-9feb-4af1-a0b3-12adf8684f5f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:06.311000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a4ebb79-9feb-4af1-a0b3-12adf8684f5f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:06.314158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a4ebb79-9feb-4af1-a0b3-12adf8684f5f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:06.315282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a4ebb79-9feb-4af1-a0b3-12adf8684f5f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:06.321082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a4ebb79-9feb-4af1-a0b3-12adf8684f5f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:06.323298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a4ebb79-9feb-4af1-a0b3-12adf8684f5f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:06.323983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a4ebb79-9feb-4af1-a0b3-12adf8684f5f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:06.397352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2fd05d5b-0147-47e7-a942-061fa50314d6 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:06.414832 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2fd05d5b-0147-47e7-a942-061fa50314d6 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 1.306558 Oct 11 04:16:06.415771 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 727/1520] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:05 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 1317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:06.420759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f31f8f8d-c81c-4642-9b70-fd173e5b8652 req-fcee23a8-f51c-41bf-b79d-0c8acd873466 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf4d394b-f24d-4e16-9ba1-ea7258409ba1", "tag": "0f2d4990-788c-41e8-a1d7-9dece272e13f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:06.440099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f31f8f8d-c81c-4642-9b70-fd173e5b8652 req-fcee23a8-f51c-41bf-b79d-0c8acd873466 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:06.446224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f31f8f8d-c81c-4642-9b70-fd173e5b8652 req-fcee23a8-f51c-41bf-b79d-0c8acd873466 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:06.446224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f31f8f8d-c81c-4642-9b70-fd173e5b8652 req-fcee23a8-f51c-41bf-b79d-0c8acd873466 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:06.456413 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f31f8f8d-c81c-4642-9b70-fd173e5b8652 req-fcee23a8-f51c-41bf-b79d-0c8acd873466 service nova] Creating event network-changed:0f2d4990-788c-41e8-a1d7-9dece272e13f for instance bf4d394b-f24d-4e16-9ba1-ea7258409ba1 on n-h1-860892-1 Oct 11 04:16:06.462915 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f31f8f8d-c81c-4642-9b70-fd173e5b8652 req-fcee23a8-f51c-41bf-b79d-0c8acd873466 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045528 Oct 11 04:16:06.468009 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 728/1521] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:06.482242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d97c91be-522b-46fb-9c2e-a635d40f989b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:06.483561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d97c91be-522b-46fb-9c2e-a635d40f989b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:06.506963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d97c91be-522b-46fb-9c2e-a635d40f989b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:06.507693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d97c91be-522b-46fb-9c2e-a635d40f989b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:06.508334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d97c91be-522b-46fb-9c2e-a635d40f989b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:06.509866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d97c91be-522b-46fb-9c2e-a635d40f989b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:06.510590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d97c91be-522b-46fb-9c2e-a635d40f989b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:06.511171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d97c91be-522b-46fb-9c2e-a635d40f989b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:06.858008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a4ebb79-9feb-4af1-a0b3-12adf8684f5f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:06.867847 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a4ebb79-9feb-4af1-a0b3-12adf8684f5f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1590 microversion: 2.1 time: 0.596754 Oct 11 04:16:06.893666 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 794/1522] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:06 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1590 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:06.906581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-282147b9-4e65-4628-81fb-e17cefc5dab7 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:06.914926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-282147b9-4e65-4628-81fb-e17cefc5dab7 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:06.928290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-282147b9-4e65-4628-81fb-e17cefc5dab7 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:06.929554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-282147b9-4e65-4628-81fb-e17cefc5dab7 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:06.930266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-282147b9-4e65-4628-81fb-e17cefc5dab7 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:06.931157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-282147b9-4e65-4628-81fb-e17cefc5dab7 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:06.934675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-282147b9-4e65-4628-81fb-e17cefc5dab7 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:06.935258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-282147b9-4e65-4628-81fb-e17cefc5dab7 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:07.487600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-282147b9-4e65-4628-81fb-e17cefc5dab7 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:07.501378 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-282147b9-4e65-4628-81fb-e17cefc5dab7 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.604229 Oct 11 04:16:07.503952 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 795/1523] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:06 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:07.519170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c81accca-1b7a-4c75-b54c-12bc6ced1f89 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:07.520059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c81accca-1b7a-4c75-b54c-12bc6ced1f89 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:07.535064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c81accca-1b7a-4c75-b54c-12bc6ced1f89 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:07.538437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c81accca-1b7a-4c75-b54c-12bc6ced1f89 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:07.539129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c81accca-1b7a-4c75-b54c-12bc6ced1f89 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:07.540025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c81accca-1b7a-4c75-b54c-12bc6ced1f89 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:07.543551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c81accca-1b7a-4c75-b54c-12bc6ced1f89 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:07.544342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c81accca-1b7a-4c75-b54c-12bc6ced1f89 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:07.956559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d97c91be-522b-46fb-9c2e-a635d40f989b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:07.971387 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d97c91be-522b-46fb-9c2e-a635d40f989b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1470 microversion: 2.1 time: 1.501271 Oct 11 04:16:07.972581 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 729/1524] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:06 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1470 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:07.977528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69059f3b-21b0-4e2c-9d98-2205f136e614 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:07.985008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69059f3b-21b0-4e2c-9d98-2205f136e614 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:08.011464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:08.020750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c81accca-1b7a-4c75-b54c-12bc6ced1f89 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:08.021644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69059f3b-21b0-4e2c-9d98-2205f136e614 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:08.023878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69059f3b-21b0-4e2c-9d98-2205f136e614 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:08.024579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69059f3b-21b0-4e2c-9d98-2205f136e614 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:08.025876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69059f3b-21b0-4e2c-9d98-2205f136e614 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:08.028571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69059f3b-21b0-4e2c-9d98-2205f136e614 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:08.029264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69059f3b-21b0-4e2c-9d98-2205f136e614 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:08.033398 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c81accca-1b7a-4c75-b54c-12bc6ced1f89 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1293 microversion: 2.1 time: 0.526818 Oct 11 04:16:08.034343 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 796/1525] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:07 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1293 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:08.048041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af1b7ba7-e2a8-4594-8a00-625ff264b1fb tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:08.059423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af1b7ba7-e2a8-4594-8a00-625ff264b1fb tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:08.070721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af1b7ba7-e2a8-4594-8a00-625ff264b1fb tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:08.072698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af1b7ba7-e2a8-4594-8a00-625ff264b1fb tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:08.086405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af1b7ba7-e2a8-4594-8a00-625ff264b1fb tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:08.091641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af1b7ba7-e2a8-4594-8a00-625ff264b1fb tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:08.092895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af1b7ba7-e2a8-4594-8a00-625ff264b1fb tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:08.094175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af1b7ba7-e2a8-4594-8a00-625ff264b1fb tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:08.323711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-af1b7ba7-e2a8-4594-8a00-625ff264b1fb tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:08.340027 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af1b7ba7-e2a8-4594-8a00-625ff264b1fb tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.298518 Oct 11 04:16:08.340027 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 797/1526] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:08 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:08.340286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d4fea58-d432-41f1-94ad-79d6113ca3b7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:08.340767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4d4fea58-d432-41f1-94ad-79d6113ca3b7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:08.353527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d4fea58-d432-41f1-94ad-79d6113ca3b7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:08.354397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d4fea58-d432-41f1-94ad-79d6113ca3b7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:08.354905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d4fea58-d432-41f1-94ad-79d6113ca3b7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:08.355687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d4fea58-d432-41f1-94ad-79d6113ca3b7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:08.356214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d4fea58-d432-41f1-94ad-79d6113ca3b7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:08.356709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d4fea58-d432-41f1-94ad-79d6113ca3b7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:08.361678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:08.494600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-69059f3b-21b0-4e2c-9d98-2205f136e614 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:08.503404 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69059f3b-21b0-4e2c-9d98-2205f136e614 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1317 microversion: 2.1 time: 0.529575 Oct 11 04:16:08.504007 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 730/1527] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:07 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1317 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:08.531663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-27fd8fa6-2742-4c8c-93ce-06fa9d3d40ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:08.532275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-27fd8fa6-2742-4c8c-93ce-06fa9d3d40ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:08.538572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27fd8fa6-2742-4c8c-93ce-06fa9d3d40ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:08.539339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27fd8fa6-2742-4c8c-93ce-06fa9d3d40ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:08.539949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27fd8fa6-2742-4c8c-93ce-06fa9d3d40ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:08.540653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27fd8fa6-2742-4c8c-93ce-06fa9d3d40ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:08.541101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27fd8fa6-2742-4c8c-93ce-06fa9d3d40ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:08.541518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27fd8fa6-2742-4c8c-93ce-06fa9d3d40ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:08.720851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-27fd8fa6-2742-4c8c-93ce-06fa9d3d40ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:08.729469 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-27fd8fa6-2742-4c8c-93ce-06fa9d3d40ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.202192 Oct 11 04:16:08.744847 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 731/1528] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:08 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:08.750918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-7d139749-b650-4bf0-8847-d0b90d108888 req-ebe7592e-edb9-4347-a909-1c55f4f8e655 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e574c295-e9b3-4047-acbb-78f086432245", "tag": "9769a2e6-fb73-4776-9ec6-f2a0fc75e9fc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:08.763315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7d139749-b650-4bf0-8847-d0b90d108888 req-ebe7592e-edb9-4347-a909-1c55f4f8e655 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:08.763787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7d139749-b650-4bf0-8847-d0b90d108888 req-ebe7592e-edb9-4347-a909-1c55f4f8e655 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:08.764215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7d139749-b650-4bf0-8847-d0b90d108888 req-ebe7592e-edb9-4347-a909-1c55f4f8e655 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:08.776075 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7d139749-b650-4bf0-8847-d0b90d108888 req-ebe7592e-edb9-4347-a909-1c55f4f8e655 service nova] Creating event network-changed:9769a2e6-fb73-4776-9ec6-f2a0fc75e9fc for instance e574c295-e9b3-4047-acbb-78f086432245 on n-h1-860892-1 Oct 11 04:16:08.781465 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-7d139749-b650-4bf0-8847-d0b90d108888 req-ebe7592e-edb9-4347-a909-1c55f4f8e655 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034905 Oct 11 04:16:08.782309 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 732/1529] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:08.806154 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4d4fea58-d432-41f1-94ad-79d6113ca3b7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "POST /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4/action" status: 202 len: 0 microversion: 2.1 time: 0.468750 Oct 11 04:16:08.810212 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 798/1530] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:16:08 2022] POST /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:16:08.816118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c27d3cc-de13-4520-907f-05aa12d75f49 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:08.816959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c27d3cc-de13-4520-907f-05aa12d75f49 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:08.823719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c27d3cc-de13-4520-907f-05aa12d75f49 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:08.824207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c27d3cc-de13-4520-907f-05aa12d75f49 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:08.826764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c27d3cc-de13-4520-907f-05aa12d75f49 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:08.829455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c27d3cc-de13-4520-907f-05aa12d75f49 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:08.829971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c27d3cc-de13-4520-907f-05aa12d75f49 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:08.834441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c27d3cc-de13-4520-907f-05aa12d75f49 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:08.987310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8c27d3cc-de13-4520-907f-05aa12d75f49 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:08.995565 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8c27d3cc-de13-4520-907f-05aa12d75f49 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.183481 Oct 11 04:16:08.996272 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 733/1531] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:08 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:09.060727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae2cdfa0-17dd-4c89-b1ea-f7a3a75dee75 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:09.061402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae2cdfa0-17dd-4c89-b1ea-f7a3a75dee75 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:09.068386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae2cdfa0-17dd-4c89-b1ea-f7a3a75dee75 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:09.072875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae2cdfa0-17dd-4c89-b1ea-f7a3a75dee75 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:09.072875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae2cdfa0-17dd-4c89-b1ea-f7a3a75dee75 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:09.072875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae2cdfa0-17dd-4c89-b1ea-f7a3a75dee75 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:09.072875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae2cdfa0-17dd-4c89-b1ea-f7a3a75dee75 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:09.072875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae2cdfa0-17dd-4c89-b1ea-f7a3a75dee75 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:09.220784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae2cdfa0-17dd-4c89-b1ea-f7a3a75dee75 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:09.229534 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae2cdfa0-17dd-4c89-b1ea-f7a3a75dee75 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1293 microversion: 2.1 time: 0.173189 Oct 11 04:16:09.230145 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 799/1532] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:09 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1293 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:09.357867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9f5adaf-b628-4bd4-8dfc-672f13bf0a42 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:09.358510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d9f5adaf-b628-4bd4-8dfc-672f13bf0a42 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:09.364468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f5adaf-b628-4bd4-8dfc-672f13bf0a42 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:09.364954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f5adaf-b628-4bd4-8dfc-672f13bf0a42 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:09.365384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f5adaf-b628-4bd4-8dfc-672f13bf0a42 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:09.366061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f5adaf-b628-4bd4-8dfc-672f13bf0a42 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:09.366534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f5adaf-b628-4bd4-8dfc-672f13bf0a42 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:09.366949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f5adaf-b628-4bd4-8dfc-672f13bf0a42 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:09.558592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d9f5adaf-b628-4bd4-8dfc-672f13bf0a42 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:09.569232 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d9f5adaf-b628-4bd4-8dfc-672f13bf0a42 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.214985 Oct 11 04:16:09.569723 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 800/1533] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:09 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:09.591461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9e867a8-8ce3-44b6-97c9-8135460ca01a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:09.592397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d9e867a8-8ce3-44b6-97c9-8135460ca01a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:09.601579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e867a8-8ce3-44b6-97c9-8135460ca01a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:09.602427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e867a8-8ce3-44b6-97c9-8135460ca01a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:09.603205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e867a8-8ce3-44b6-97c9-8135460ca01a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:09.604685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e867a8-8ce3-44b6-97c9-8135460ca01a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:09.605366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e867a8-8ce3-44b6-97c9-8135460ca01a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:09.605992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e867a8-8ce3-44b6-97c9-8135460ca01a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:09.617885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a76e5d9e-160c-478c-b799-39c8548ba407 req-3f83187e-f99b-4b07-9b10-06d61705a7af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b997d21c-b814-4e0c-aba4-53ea4b3c590b", "name": "network-vif-plugged", "status": "completed", "tag": "dd60a4e4-6300-4a22-a81f-9f24c68978fb"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:09.630857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a76e5d9e-160c-478c-b799-39c8548ba407 req-3f83187e-f99b-4b07-9b10-06d61705a7af service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:09.631456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a76e5d9e-160c-478c-b799-39c8548ba407 req-3f83187e-f99b-4b07-9b10-06d61705a7af service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:09.631953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a76e5d9e-160c-478c-b799-39c8548ba407 req-3f83187e-f99b-4b07-9b10-06d61705a7af service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:09.648575 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a76e5d9e-160c-478c-b799-39c8548ba407 req-3f83187e-f99b-4b07-9b10-06d61705a7af service nova] Creating event network-vif-plugged:dd60a4e4-6300-4a22-a81f-9f24c68978fb for instance b997d21c-b814-4e0c-aba4-53ea4b3c590b on n-h2-860892-1 Oct 11 04:16:09.653985 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a76e5d9e-160c-478c-b799-39c8548ba407 req-3f83187e-f99b-4b07-9b10-06d61705a7af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.321207 Oct 11 04:16:09.655256 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 734/1534] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:09.756034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d9e867a8-8ce3-44b6-97c9-8135460ca01a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:09.756785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c56219e3-d5d6-4429-9843-1b3dc55ecd79 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:09.757676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c56219e3-d5d6-4429-9843-1b3dc55ecd79 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:09.764834 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d9e867a8-8ce3-44b6-97c9-8135460ca01a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1317 microversion: 2.1 time: 0.193837 Oct 11 04:16:09.766304 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 801/1535] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:09 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1317 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:09.766672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56219e3-d5d6-4429-9843-1b3dc55ecd79 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:09.767516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56219e3-d5d6-4429-9843-1b3dc55ecd79 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:09.768183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56219e3-d5d6-4429-9843-1b3dc55ecd79 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:09.769128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56219e3-d5d6-4429-9843-1b3dc55ecd79 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:09.769788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56219e3-d5d6-4429-9843-1b3dc55ecd79 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:09.770452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56219e3-d5d6-4429-9843-1b3dc55ecd79 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:10.010295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c56219e3-d5d6-4429-9843-1b3dc55ecd79 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:10.019557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-430412a9-3712-4759-964e-49186e6feb4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:10.020170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-430412a9-3712-4759-964e-49186e6feb4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:10.021761 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c56219e3-d5d6-4429-9843-1b3dc55ecd79 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.270331 Oct 11 04:16:10.029619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-430412a9-3712-4759-964e-49186e6feb4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:10.030109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-430412a9-3712-4759-964e-49186e6feb4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:10.031160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-430412a9-3712-4759-964e-49186e6feb4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:10.031862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-430412a9-3712-4759-964e-49186e6feb4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:10.032314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-430412a9-3712-4759-964e-49186e6feb4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:10.032738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-430412a9-3712-4759-964e-49186e6feb4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:10.037266 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 735/1536] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:09 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:10.190592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-430412a9-3712-4759-964e-49186e6feb4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:10.201354 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-430412a9-3712-4759-964e-49186e6feb4b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.185510 Oct 11 04:16:10.202033 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 802/1537] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:10 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:10.256050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2262eeab-f2b2-4044-ade6-5eb4888ee144 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:10.256871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2262eeab-f2b2-4044-ade6-5eb4888ee144 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:10.263294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2262eeab-f2b2-4044-ade6-5eb4888ee144 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:10.264124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2262eeab-f2b2-4044-ade6-5eb4888ee144 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:10.264741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2262eeab-f2b2-4044-ade6-5eb4888ee144 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:10.266128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2262eeab-f2b2-4044-ade6-5eb4888ee144 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:10.266771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2262eeab-f2b2-4044-ade6-5eb4888ee144 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:10.267361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2262eeab-f2b2-4044-ade6-5eb4888ee144 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:10.545793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2262eeab-f2b2-4044-ade6-5eb4888ee144 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:10.554417 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2262eeab-f2b2-4044-ade6-5eb4888ee144 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1293 microversion: 2.1 time: 0.302805 Oct 11 04:16:10.555100 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 736/1538] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:10 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1293 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:10.592916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a186993f-86b2-4cb2-883a-5a226a6696ef tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:10.594090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a186993f-86b2-4cb2-883a-5a226a6696ef tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:10.600200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a186993f-86b2-4cb2-883a-5a226a6696ef tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:10.600677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a186993f-86b2-4cb2-883a-5a226a6696ef tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:10.601108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a186993f-86b2-4cb2-883a-5a226a6696ef tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:10.601794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a186993f-86b2-4cb2-883a-5a226a6696ef tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:10.602270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a186993f-86b2-4cb2-883a-5a226a6696ef tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:10.602695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a186993f-86b2-4cb2-883a-5a226a6696ef tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:10.736434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a186993f-86b2-4cb2-883a-5a226a6696ef tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:10.744623 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a186993f-86b2-4cb2-883a-5a226a6696ef tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.155564 Oct 11 04:16:10.745573 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 803/1539] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:10 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:10.788907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c4b1fa6c-3a3c-4f9e-af25-4baf8467bdde tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:10.789431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c4b1fa6c-3a3c-4f9e-af25-4baf8467bdde tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:10.805674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b1fa6c-3a3c-4f9e-af25-4baf8467bdde tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:10.806098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b1fa6c-3a3c-4f9e-af25-4baf8467bdde tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:10.806536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b1fa6c-3a3c-4f9e-af25-4baf8467bdde tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:10.807242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b1fa6c-3a3c-4f9e-af25-4baf8467bdde tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:10.807690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b1fa6c-3a3c-4f9e-af25-4baf8467bdde tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:10.808111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b1fa6c-3a3c-4f9e-af25-4baf8467bdde tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:11.042684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c4b1fa6c-3a3c-4f9e-af25-4baf8467bdde tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:11.045710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e477a5c-6711-4429-92f2-0cc22447a001 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:11.046926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e477a5c-6711-4429-92f2-0cc22447a001 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:11.053881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e477a5c-6711-4429-92f2-0cc22447a001 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:11.054638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e477a5c-6711-4429-92f2-0cc22447a001 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:11.055233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e477a5c-6711-4429-92f2-0cc22447a001 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:11.061225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e477a5c-6711-4429-92f2-0cc22447a001 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:11.061225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e477a5c-6711-4429-92f2-0cc22447a001 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:11.061225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e477a5c-6711-4429-92f2-0cc22447a001 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:11.071722 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c4b1fa6c-3a3c-4f9e-af25-4baf8467bdde tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1317 microversion: 2.1 time: 0.284325 Oct 11 04:16:11.079346 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 737/1540] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:10 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1317 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:11.226054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07968468-2e9c-4c35-b4b9-a70172c31ea9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:11.226733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-07968468-2e9c-4c35-b4b9-a70172c31ea9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:11.231630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e477a5c-6711-4429-92f2-0cc22447a001 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:11.236334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07968468-2e9c-4c35-b4b9-a70172c31ea9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:11.237203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07968468-2e9c-4c35-b4b9-a70172c31ea9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:11.237826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07968468-2e9c-4c35-b4b9-a70172c31ea9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:11.238830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07968468-2e9c-4c35-b4b9-a70172c31ea9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:11.239983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07968468-2e9c-4c35-b4b9-a70172c31ea9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:11.240492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07968468-2e9c-4c35-b4b9-a70172c31ea9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:11.242970 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e477a5c-6711-4429-92f2-0cc22447a001 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.201325 Oct 11 04:16:11.245511 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 804/1541] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:11 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:11.466365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-07968468-2e9c-4c35-b4b9-a70172c31ea9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:11.484400 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-07968468-2e9c-4c35-b4b9-a70172c31ea9 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.262369 Oct 11 04:16:11.484995 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 738/1542] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:11 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:11.578857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e072a502-2360-4819-b21c-083420a4625c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:11.579686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e072a502-2360-4819-b21c-083420a4625c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:11.592982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e072a502-2360-4819-b21c-083420a4625c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:11.597080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e072a502-2360-4819-b21c-083420a4625c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:11.597709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e072a502-2360-4819-b21c-083420a4625c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:11.599372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e072a502-2360-4819-b21c-083420a4625c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:11.601445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e072a502-2360-4819-b21c-083420a4625c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:11.602068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e072a502-2360-4819-b21c-083420a4625c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:11.753014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f68a63b7-c9f3-4a30-8f0e-4a1f5ad4b0d6 req-e892ae8f-d251-445a-b557-5038c44b295d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72660709-ce51-4053-af08-b1cd828c95d4", "name": "network-vif-plugged", "status": "completed", "tag": "66639d0c-5518-4300-98e7-ab09ecbda154"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:11.774504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f68a63b7-c9f3-4a30-8f0e-4a1f5ad4b0d6 req-e892ae8f-d251-445a-b557-5038c44b295d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:11.775815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f68a63b7-c9f3-4a30-8f0e-4a1f5ad4b0d6 req-e892ae8f-d251-445a-b557-5038c44b295d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:11.777238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f68a63b7-c9f3-4a30-8f0e-4a1f5ad4b0d6 req-e892ae8f-d251-445a-b557-5038c44b295d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:11.808312 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f68a63b7-c9f3-4a30-8f0e-4a1f5ad4b0d6 req-e892ae8f-d251-445a-b557-5038c44b295d service nova] Creating event network-vif-plugged:66639d0c-5518-4300-98e7-ab09ecbda154 for instance 72660709-ce51-4053-af08-b1cd828c95d4 on n-h1-860892-1 Oct 11 04:16:11.824922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-f68a63b7-c9f3-4a30-8f0e-4a1f5ad4b0d6 req-e892ae8f-d251-445a-b557-5038c44b295d service nova] Instance 72660709-ce51-4053-af08-b1cd828c95d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:16:11.852698 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f68a63b7-c9f3-4a30-8f0e-4a1f5ad4b0d6 req-e892ae8f-d251-445a-b557-5038c44b295d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.104716 Oct 11 04:16:11.855068 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 739/1543] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Oct 11 04:16:11.871548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e072a502-2360-4819-b21c-083420a4625c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:11.885738 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e072a502-2360-4819-b21c-083420a4625c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1293 microversion: 2.1 time: 0.311870 Oct 11 04:16:11.887808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3bca08d1-6aa4-4fdc-aa71-c904367b1bd2 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:11.888516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3bca08d1-6aa4-4fdc-aa71-c904367b1bd2 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:11.890916 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 805/1544] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:11 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1293 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:11.897150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bca08d1-6aa4-4fdc-aa71-c904367b1bd2 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:11.897834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bca08d1-6aa4-4fdc-aa71-c904367b1bd2 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:11.898455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bca08d1-6aa4-4fdc-aa71-c904367b1bd2 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:11.899339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bca08d1-6aa4-4fdc-aa71-c904367b1bd2 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:11.899985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bca08d1-6aa4-4fdc-aa71-c904367b1bd2 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:11.900567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bca08d1-6aa4-4fdc-aa71-c904367b1bd2 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:11.928297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:12.108648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-93f81e8f-a003-459c-bc47-a4c1420dfe61 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:12.109024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-93f81e8f-a003-459c-bc47-a4c1420dfe61 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:12.118292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93f81e8f-a003-459c-bc47-a4c1420dfe61 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:12.119160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93f81e8f-a003-459c-bc47-a4c1420dfe61 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:12.119805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93f81e8f-a003-459c-bc47-a4c1420dfe61 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:12.120739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93f81e8f-a003-459c-bc47-a4c1420dfe61 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:12.121401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93f81e8f-a003-459c-bc47-a4c1420dfe61 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:12.122051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93f81e8f-a003-459c-bc47-a4c1420dfe61 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:12.139571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3bca08d1-6aa4-4fdc-aa71-c904367b1bd2 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:12.151184 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3bca08d1-6aa4-4fdc-aa71-c904367b1bd2 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.291375 Oct 11 04:16:12.152084 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 740/1545] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:11 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:12.268904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1a71c92f-6e49-4b32-bd6e-c63feb8ff426 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:12.269641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1a71c92f-6e49-4b32-bd6e-c63feb8ff426 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:12.275917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a71c92f-6e49-4b32-bd6e-c63feb8ff426 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:12.276612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a71c92f-6e49-4b32-bd6e-c63feb8ff426 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:12.277263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a71c92f-6e49-4b32-bd6e-c63feb8ff426 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:12.278357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a71c92f-6e49-4b32-bd6e-c63feb8ff426 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:12.278972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a71c92f-6e49-4b32-bd6e-c63feb8ff426 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:12.279696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a71c92f-6e49-4b32-bd6e-c63feb8ff426 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:12.294582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-93f81e8f-a003-459c-bc47-a4c1420dfe61 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:12.305791 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-93f81e8f-a003-459c-bc47-a4c1420dfe61 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1466 microversion: 2.1 time: 0.201976 Oct 11 04:16:12.306814 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 806/1546] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:12 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1466 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:12.450490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c1ca5a7-c964-439f-a590-7e476ca144bb tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:12.455099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2c1ca5a7-c964-439f-a590-7e476ca144bb tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:12.458243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c1ca5a7-c964-439f-a590-7e476ca144bb tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:12.458741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c1ca5a7-c964-439f-a590-7e476ca144bb tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:12.459177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c1ca5a7-c964-439f-a590-7e476ca144bb tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:12.459876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c1ca5a7-c964-439f-a590-7e476ca144bb tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:12.460329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c1ca5a7-c964-439f-a590-7e476ca144bb tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:12.460756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c1ca5a7-c964-439f-a590-7e476ca144bb tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:12.524702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1a71c92f-6e49-4b32-bd6e-c63feb8ff426 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:12.548992 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1a71c92f-6e49-4b32-bd6e-c63feb8ff426 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.284337 Oct 11 04:16:12.550078 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 741/1547] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:12 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:12.555957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8be58c0-dd23-4045-9467-c8560c6856ba tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:12.562416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a8be58c0-dd23-4045-9467-c8560c6856ba tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:12.568514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8be58c0-dd23-4045-9467-c8560c6856ba tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:12.576473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8be58c0-dd23-4045-9467-c8560c6856ba tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:12.577732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8be58c0-dd23-4045-9467-c8560c6856ba tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:12.579056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8be58c0-dd23-4045-9467-c8560c6856ba tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:12.579695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8be58c0-dd23-4045-9467-c8560c6856ba tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:12.580617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8be58c0-dd23-4045-9467-c8560c6856ba tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:12.821170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a8be58c0-dd23-4045-9467-c8560c6856ba tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:12.822902 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c1ca5a7-c964-439f-a590-7e476ca144bb tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1617 microversion: 2.1 time: 0.497972 Oct 11 04:16:12.823816 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 807/1548] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:12 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1617 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:12.846744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df1aa595-e790-46af-9f22-12297eaadddf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Action: 'create', calling method: .version_select at 0x7fda1e1068b0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-1151925953", "policies": ["affinity"]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:12.848469 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a8be58c0-dd23-4045-9467-c8560c6856ba tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.296433 Oct 11 04:16:12.868814 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 742/1549] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:12 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:12.892277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-df1aa595-e790-46af-9f22-12297eaadddf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:12.901605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-df1aa595-e790-46af-9f22-12297eaadddf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:12.908771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c410f584-f650-443a-866c-c9cde5bcb6f1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:12.909388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c410f584-f650-443a-866c-c9cde5bcb6f1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:12.922692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c410f584-f650-443a-866c-c9cde5bcb6f1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:12.923034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c410f584-f650-443a-866c-c9cde5bcb6f1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:12.923480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c410f584-f650-443a-866c-c9cde5bcb6f1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:12.924227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c410f584-f650-443a-866c-c9cde5bcb6f1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:12.924987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c410f584-f650-443a-866c-c9cde5bcb6f1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:12.925106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c410f584-f650-443a-866c-c9cde5bcb6f1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:13.053328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-df1aa595-e790-46af-9f22-12297eaadddf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:13.058648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-df1aa595-e790-46af-9f22-12297eaadddf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:13.070846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:13.075272 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-df1aa595-e790-46af-9f22-12297eaadddf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 188 microversion: 2.1 time: 0.233039 Oct 11 04:16:13.075893 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 808/1550] 10.222.0.26 () {60 vars in 1174 bytes} [Tue Oct 11 04:16:12 2022] POST /compute/v2.1/os-server-groups => generated 188 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:16:13.175895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ddedad1e-9ee3-49cb-8510-64d783b299d7 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:13.176670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ddedad1e-9ee3-49cb-8510-64d783b299d7 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:13.185930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddedad1e-9ee3-49cb-8510-64d783b299d7 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:13.186556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddedad1e-9ee3-49cb-8510-64d783b299d7 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:13.187710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddedad1e-9ee3-49cb-8510-64d783b299d7 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:13.188797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddedad1e-9ee3-49cb-8510-64d783b299d7 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:13.189456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddedad1e-9ee3-49cb-8510-64d783b299d7 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:13.190536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddedad1e-9ee3-49cb-8510-64d783b299d7 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:13.351895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ddedad1e-9ee3-49cb-8510-64d783b299d7 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:13.361119 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ddedad1e-9ee3-49cb-8510-64d783b299d7 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.190022 Oct 11 04:16:13.362254 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 809/1551] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:13 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:13.370614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1224986428", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "9ca972c2-753f-4d2d-a1a6-2b819b624a49"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:13.484302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:16:13.761702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:16:13.762137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:16:13.762647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:16:13.763059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:16:13.763811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:16:13.797865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:13.798865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:13.799472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:13.800382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:13.801003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:13.801920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:13.829356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:13.836830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:13.853474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Going to run 2 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:16:13.863687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:16:13.885093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c410f584-f650-443a-866c-c9cde5bcb6f1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:13.896479 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c410f584-f650-443a-866c-c9cde5bcb6f1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1293 microversion: 2.1 time: 0.991575 Oct 11 04:16:13.897278 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 743/1552] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:12 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1293 bytes in 993 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:13.918139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f545ae82-261f-46a5-a78d-5a87ad3ccbed tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:13.921011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f545ae82-261f-46a5-a78d-5a87ad3ccbed tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:13.937892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f545ae82-261f-46a5-a78d-5a87ad3ccbed tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:13.947647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f545ae82-261f-46a5-a78d-5a87ad3ccbed tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:13.947647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f545ae82-261f-46a5-a78d-5a87ad3ccbed tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:13.947647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f545ae82-261f-46a5-a78d-5a87ad3ccbed tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:13.947647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f545ae82-261f-46a5-a78d-5a87ad3ccbed tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:13.947647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f545ae82-261f-46a5-a78d-5a87ad3ccbed tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:14.104042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Checking whether user_id and queued_for_delete are populated for all projects {{(pid=120994) is_qfd_populated /opt/stack/nova/nova/quota.py:1268}} Oct 11 04:16:14.140461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:14.149529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:14.294745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:14.304958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:14.328678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=50866ec2-e637-49e6-a467-926c4fc44ab3,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:16:14.537504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:14.543024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:14.560667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f545ae82-261f-46a5-a78d-5a87ad3ccbed tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:14.569832 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f545ae82-261f-46a5-a78d-5a87ad3ccbed tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.664622 Oct 11 04:16:14.570514 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 744/1553] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:13 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:14.575748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d5aaf02-727b-4cba-a715-40b6d54b09c2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:14.576707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0d5aaf02-727b-4cba-a715-40b6d54b09c2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:14.585425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d5aaf02-727b-4cba-a715-40b6d54b09c2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:14.586181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d5aaf02-727b-4cba-a715-40b6d54b09c2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:14.586711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d5aaf02-727b-4cba-a715-40b6d54b09c2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:14.587477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d5aaf02-727b-4cba-a715-40b6d54b09c2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:14.588202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d5aaf02-727b-4cba-a715-40b6d54b09c2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:14.588636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d5aaf02-727b-4cba-a715-40b6d54b09c2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:14.667765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:14.673062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:14.712123 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a45458a7-1e51-4487-b3c8-9e72904a444d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.348683 Oct 11 04:16:14.712947 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 810/1554] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:16:13 2022] POST /compute/v2.1/servers => generated 32 bytes in 1350 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 11 04:16:14.717467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fb98de88-230a-4087-bcfb-b037781afded tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:14.718137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fb98de88-230a-4087-bcfb-b037781afded tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:14.724844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb98de88-230a-4087-bcfb-b037781afded tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:14.725341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb98de88-230a-4087-bcfb-b037781afded tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:14.725995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb98de88-230a-4087-bcfb-b037781afded tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:14.726513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb98de88-230a-4087-bcfb-b037781afded tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:14.727254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb98de88-230a-4087-bcfb-b037781afded tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:14.727394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb98de88-230a-4087-bcfb-b037781afded tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:14.902019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fb98de88-230a-4087-bcfb-b037781afded tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:14.914346 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fb98de88-230a-4087-bcfb-b037781afded tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.200498 Oct 11 04:16:14.915429 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 811/1555] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:14 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:14.936994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d01b9cf-e56e-46ba-8457-b65388f6e1f2 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:14.937671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d01b9cf-e56e-46ba-8457-b65388f6e1f2 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:14.944833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d01b9cf-e56e-46ba-8457-b65388f6e1f2 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:14.945597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d01b9cf-e56e-46ba-8457-b65388f6e1f2 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:14.946421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d01b9cf-e56e-46ba-8457-b65388f6e1f2 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:14.947543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d01b9cf-e56e-46ba-8457-b65388f6e1f2 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:14.948196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d01b9cf-e56e-46ba-8457-b65388f6e1f2 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:14.948945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d01b9cf-e56e-46ba-8457-b65388f6e1f2 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:15.152326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-5d01b9cf-e56e-46ba-8457-b65388f6e1f2 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid f4133104-80ff-4629-bf97-1d0c7441fbfd {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:16:15.172990 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d01b9cf-e56e-46ba-8457-b65388f6e1f2 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 2422 microversion: 2.25 time: 0.240063 Oct 11 04:16:15.173744 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 812/1556] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:14 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 2422 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:15.178996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2fd25bc7-8ec9-4630-abec-d4f2c08413fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:15.191956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2fd25bc7-8ec9-4630-abec-d4f2c08413fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:15.193118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2fd25bc7-8ec9-4630-abec-d4f2c08413fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Searching by: {'deleted': False, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:16:15.215752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fd25bc7-8ec9-4630-abec-d4f2c08413fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:15.216618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fd25bc7-8ec9-4630-abec-d4f2c08413fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:15.217148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fd25bc7-8ec9-4630-abec-d4f2c08413fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:15.218051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fd25bc7-8ec9-4630-abec-d4f2c08413fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:15.218613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fd25bc7-8ec9-4630-abec-d4f2c08413fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:15.219242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fd25bc7-8ec9-4630-abec-d4f2c08413fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:15.301566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0d5aaf02-727b-4cba-a715-40b6d54b09c2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:15.318921 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0d5aaf02-727b-4cba-a715-40b6d54b09c2 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.747146 Oct 11 04:16:15.320776 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 745/1557] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:14 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:15.329473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ed9565e-cd23-47e6-a737-4ab00717355a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:15.332460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ed9565e-cd23-47e6-a737-4ab00717355a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:15.334527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-2fd25bc7-8ec9-4630-abec-d4f2c08413fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Listed batch of 1 results from cell out of 998 limit. Returned 1 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:16:15.339286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed9565e-cd23-47e6-a737-4ab00717355a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:15.339714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed9565e-cd23-47e6-a737-4ab00717355a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:15.340327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed9565e-cd23-47e6-a737-4ab00717355a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:15.341025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed9565e-cd23-47e6-a737-4ab00717355a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:15.341655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed9565e-cd23-47e6-a737-4ab00717355a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:15.350671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed9565e-cd23-47e6-a737-4ab00717355a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:15.402455 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2fd25bc7-8ec9-4630-abec-d4f2c08413fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1004 microversion: 2.1 time: 0.227216 Oct 11 04:16:15.403045 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 813/1558] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:16:15 2022] GET /compute/v2.1/servers => generated 1004 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:15.407893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f69c4688-02b0-4167-ad62-4ad9dc971f69 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860892-1", "block_migration": "auto"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:15.410541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f69c4688-02b0-4167-ad62-4ad9dc971f69 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:15.421184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f69c4688-02b0-4167-ad62-4ad9dc971f69 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:15.422059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f69c4688-02b0-4167-ad62-4ad9dc971f69 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:15.422830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f69c4688-02b0-4167-ad62-4ad9dc971f69 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:15.424164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f69c4688-02b0-4167-ad62-4ad9dc971f69 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:15.425140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f69c4688-02b0-4167-ad62-4ad9dc971f69 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:15.425761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f69c4688-02b0-4167-ad62-4ad9dc971f69 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:15.428888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:15.459458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-f69c4688-02b0-4167-ad62-4ad9dc971f69 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'flavor' on Instance uuid f4133104-80ff-4629-bf97-1d0c7441fbfd {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:16:15.480323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f69c4688-02b0-4167-ad62-4ad9dc971f69 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Going to try to live migrate instance to n-h1-860892-1 {{(pid=120994) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 04:16:16.193285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ed9565e-cd23-47e6-a737-4ab00717355a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:16.219703 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ed9565e-cd23-47e6-a737-4ab00717355a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1293 microversion: 2.1 time: 0.885627 Oct 11 04:16:16.220969 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 746/1559] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:15 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1293 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:16.240800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-04c81d7d-3705-4940-97f3-30ccfa49b1bd tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:16.241647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-04c81d7d-3705-4940-97f3-30ccfa49b1bd tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:16.363494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-04c81d7d-3705-4940-97f3-30ccfa49b1bd tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:16.370653 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-04c81d7d-3705-4940-97f3-30ccfa49b1bd tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1219 microversion: 2.1 time: 0.147095 Oct 11 04:16:16.371222 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 747/1560] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:16 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1219 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:16.376233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-708390c7-8a89-4025-8faf-2aa086cdf59e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:16.376233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-708390c7-8a89-4025-8faf-2aa086cdf59e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:16.382627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-708390c7-8a89-4025-8faf-2aa086cdf59e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:16.383089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-708390c7-8a89-4025-8faf-2aa086cdf59e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:16.383521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-708390c7-8a89-4025-8faf-2aa086cdf59e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:16.384200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-708390c7-8a89-4025-8faf-2aa086cdf59e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:16.384814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-708390c7-8a89-4025-8faf-2aa086cdf59e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:16.385402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-708390c7-8a89-4025-8faf-2aa086cdf59e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:16.569948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-708390c7-8a89-4025-8faf-2aa086cdf59e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:16.579092 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-708390c7-8a89-4025-8faf-2aa086cdf59e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.206838 Oct 11 04:16:16.579674 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 748/1561] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:16 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:16.586547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-677cef0b-1dc6-428b-9247-7841c22e4e6f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:16.587311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-677cef0b-1dc6-428b-9247-7841c22e4e6f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:16.598926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-677cef0b-1dc6-428b-9247-7841c22e4e6f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:16.599417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-677cef0b-1dc6-428b-9247-7841c22e4e6f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:16.600081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-677cef0b-1dc6-428b-9247-7841c22e4e6f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:16.600793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-677cef0b-1dc6-428b-9247-7841c22e4e6f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:16.601338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-677cef0b-1dc6-428b-9247-7841c22e4e6f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:16.601772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-677cef0b-1dc6-428b-9247-7841c22e4e6f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:16.789552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-677cef0b-1dc6-428b-9247-7841c22e4e6f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:16.798412 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-677cef0b-1dc6-428b-9247-7841c22e4e6f tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.217371 Oct 11 04:16:16.799045 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 749/1562] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:16 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:16.803587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8b4f1c25-67d4-426f-a3d2-824f472ffa5a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:16.804183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8b4f1c25-67d4-426f-a3d2-824f472ffa5a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:16.810376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c25-67d4-426f-a3d2-824f472ffa5a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:16.810858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c25-67d4-426f-a3d2-824f472ffa5a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:16.811309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c25-67d4-426f-a3d2-824f472ffa5a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:16.812510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c25-67d4-426f-a3d2-824f472ffa5a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:16.812950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c25-67d4-426f-a3d2-824f472ffa5a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:16.813554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b4f1c25-67d4-426f-a3d2-824f472ffa5a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:16.956089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8b4f1c25-67d4-426f-a3d2-824f472ffa5a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:16.964195 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8b4f1c25-67d4-426f-a3d2-824f472ffa5a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.164007 Oct 11 04:16:16.965080 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 750/1563] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:16 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:16.969998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-016bf677-97d9-444f-8bb2-2f1c0512dc27 req-7d8334db-7074-442c-a474-ef4b4d86475c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927821c1-5dca-4ee7-8072-d2ab4d97368b", "name": "network-vif-plugged", "status": "completed", "tag": "c5691c2d-c5a4-490b-b7b5-6f6dbad53a41"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:16.980234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-016bf677-97d9-444f-8bb2-2f1c0512dc27 req-7d8334db-7074-442c-a474-ef4b4d86475c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:16.980428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-016bf677-97d9-444f-8bb2-2f1c0512dc27 req-7d8334db-7074-442c-a474-ef4b4d86475c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:16.980866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-016bf677-97d9-444f-8bb2-2f1c0512dc27 req-7d8334db-7074-442c-a474-ef4b4d86475c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:16.993880 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-016bf677-97d9-444f-8bb2-2f1c0512dc27 req-7d8334db-7074-442c-a474-ef4b4d86475c service nova] Creating event network-vif-plugged:c5691c2d-c5a4-490b-b7b5-6f6dbad53a41 for instance 927821c1-5dca-4ee7-8072-d2ab4d97368b on n-h1-860892-1 Oct 11 04:16:16.999002 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-016bf677-97d9-444f-8bb2-2f1c0512dc27 req-7d8334db-7074-442c-a474-ef4b4d86475c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032301 Oct 11 04:16:17.000023 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 751/1564] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:17.051373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestMultiTenantJSON-server-1140446455", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "e094473a-9f57-461d-87f2-c93273860ac2"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:17.107587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] validate_networks() for [('e094473a-9f57-461d-87f2-c93273860ac2', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:16:17.535879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:16:17.536473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:16:17.536766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:16:17.537176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:16:17.537614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:16:17.547108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:17.547620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:17.548095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:17.548773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:17.549337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:17.549765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:17.567353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Getting quotas for project bdb29de9961945fe8091982e974bb494. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:17.573418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Getting quotas for user 6a00d408c2d04fb1b049a3de25519993 and project bdb29de9961945fe8091982e974bb494. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:17.589261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:16:17.593602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:16:17.701940 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7b349d12-1e85-4f8e-943c-37c32a5d4e78 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700700 Oct 11 04:16:17.711107 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 752/1565] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:16:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:16:17.716252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b242579c-7233-46e1-bd0a-0e112818e6e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:17.717102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b242579c-7233-46e1-bd0a-0e112818e6e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:17.725554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b242579c-7233-46e1-bd0a-0e112818e6e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:17.726999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b242579c-7233-46e1-bd0a-0e112818e6e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:17.727782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b242579c-7233-46e1-bd0a-0e112818e6e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:17.728743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b242579c-7233-46e1-bd0a-0e112818e6e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:17.729303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b242579c-7233-46e1-bd0a-0e112818e6e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:17.729952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b242579c-7233-46e1-bd0a-0e112818e6e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:17.926111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b242579c-7233-46e1-bd0a-0e112818e6e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:17.935390 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b242579c-7233-46e1-bd0a-0e112818e6e0 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1293 microversion: 2.1 time: 0.222911 Oct 11 04:16:17.937873 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 753/1566] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:17 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1293 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:17.943933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c0581ca-3a2c-4b11-9ad7-020a1cfd6d35 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:17.945134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5c0581ca-3a2c-4b11-9ad7-020a1cfd6d35 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:17.956953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c0581ca-3a2c-4b11-9ad7-020a1cfd6d35 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:17.957540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c0581ca-3a2c-4b11-9ad7-020a1cfd6d35 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:17.957980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c0581ca-3a2c-4b11-9ad7-020a1cfd6d35 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:17.959153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c0581ca-3a2c-4b11-9ad7-020a1cfd6d35 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:17.963619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c0581ca-3a2c-4b11-9ad7-020a1cfd6d35 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:17.963619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c0581ca-3a2c-4b11-9ad7-020a1cfd6d35 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:18.045622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5c0581ca-3a2c-4b11-9ad7-020a1cfd6d35 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:18.054599 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5c0581ca-3a2c-4b11-9ad7-020a1cfd6d35 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1223 microversion: 2.1 time: 0.116102 Oct 11 04:16:18.055115 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 754/1567] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:17 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1223 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:18.059645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75ee7590-f54b-4bf4-b928-d790d075906c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:18.060254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-75ee7590-f54b-4bf4-b928-d790d075906c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:18.065986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ee7590-f54b-4bf4-b928-d790d075906c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:18.066507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ee7590-f54b-4bf4-b928-d790d075906c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:18.066946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ee7590-f54b-4bf4-b928-d790d075906c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:18.071157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ee7590-f54b-4bf4-b928-d790d075906c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:18.071675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ee7590-f54b-4bf4-b928-d790d075906c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:18.072295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ee7590-f54b-4bf4-b928-d790d075906c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:18.207864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75ee7590-f54b-4bf4-b928-d790d075906c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:18.215660 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-75ee7590-f54b-4bf4-b928-d790d075906c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.159527 Oct 11 04:16:18.216298 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 755/1568] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:18 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:18.221029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-43138cd1-7f34-45ef-800a-00e77cb30bc3 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:18.221708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-43138cd1-7f34-45ef-800a-00e77cb30bc3 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:18.273554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-43138cd1-7f34-45ef-800a-00e77cb30bc3 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:18.281043 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-43138cd1-7f34-45ef-800a-00e77cb30bc3 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1228 microversion: 2.1 time: 0.063164 Oct 11 04:16:18.281611 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 756/1569] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:18 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1228 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:18.286097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4944e97f-4c59-43c8-9aa5-ae67577066d1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:18.286750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4944e97f-4c59-43c8-9aa5-ae67577066d1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:18.292876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4944e97f-4c59-43c8-9aa5-ae67577066d1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:18.293578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4944e97f-4c59-43c8-9aa5-ae67577066d1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:18.294223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4944e97f-4c59-43c8-9aa5-ae67577066d1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:18.295092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4944e97f-4c59-43c8-9aa5-ae67577066d1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:18.296018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4944e97f-4c59-43c8-9aa5-ae67577066d1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:18.296608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4944e97f-4c59-43c8-9aa5-ae67577066d1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:18.458132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4944e97f-4c59-43c8-9aa5-ae67577066d1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:18.465986 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4944e97f-4c59-43c8-9aa5-ae67577066d1 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.183337 Oct 11 04:16:18.466601 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 757/1570] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:18 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:18.482107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-764f6656-8d62-4073-8726-32300d84e969 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:18.482843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-764f6656-8d62-4073-8726-32300d84e969 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:18.492986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-764f6656-8d62-4073-8726-32300d84e969 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:18.493486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-764f6656-8d62-4073-8726-32300d84e969 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:18.493948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-764f6656-8d62-4073-8726-32300d84e969 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:18.494689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-764f6656-8d62-4073-8726-32300d84e969 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:18.495146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-764f6656-8d62-4073-8726-32300d84e969 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:18.495573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-764f6656-8d62-4073-8726-32300d84e969 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:18.678705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-764f6656-8d62-4073-8726-32300d84e969 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:18.687485 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-764f6656-8d62-4073-8726-32300d84e969 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.215144 Oct 11 04:16:18.689680 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 758/1571] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:18 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:18.959644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d6bbca90-fce0-49fb-bdd8-4fd266982424 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:18.960604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d6bbca90-fce0-49fb-bdd8-4fd266982424 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:18.968407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6bbca90-fce0-49fb-bdd8-4fd266982424 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:18.968923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6bbca90-fce0-49fb-bdd8-4fd266982424 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:18.969355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6bbca90-fce0-49fb-bdd8-4fd266982424 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:18.970062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6bbca90-fce0-49fb-bdd8-4fd266982424 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:18.970544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6bbca90-fce0-49fb-bdd8-4fd266982424 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:18.970974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6bbca90-fce0-49fb-bdd8-4fd266982424 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:19.166800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d6bbca90-fce0-49fb-bdd8-4fd266982424 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:19.175068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d6bbca90-fce0-49fb-bdd8-4fd266982424 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1293 microversion: 2.1 time: 0.219348 Oct 11 04:16:19.181964 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 759/1572] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:18 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1293 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:19.197770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2cabeea4-9dc5-447e-882e-f349a9d2fb27 req-19ff8722-b52c-4e3d-908d-31a8de48a70c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b55166-b6c5-400e-b0c6-f1a04c595b75", "name": "network-vif-plugged", "status": "completed", "tag": "5db01fd1-2d11-42b1-a3c9-a52cca1b8138"}, {"server_uuid": "e574c295-e9b3-4047-acbb-78f086432245", "name": "network-vif-plugged", "status": "completed", "tag": "9769a2e6-fb73-4776-9ec6-f2a0fc75e9fc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:19.218051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2cabeea4-9dc5-447e-882e-f349a9d2fb27 req-19ff8722-b52c-4e3d-908d-31a8de48a70c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:19.218556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2cabeea4-9dc5-447e-882e-f349a9d2fb27 req-19ff8722-b52c-4e3d-908d-31a8de48a70c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:19.218990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2cabeea4-9dc5-447e-882e-f349a9d2fb27 req-19ff8722-b52c-4e3d-908d-31a8de48a70c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:19.245161 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2cabeea4-9dc5-447e-882e-f349a9d2fb27 req-19ff8722-b52c-4e3d-908d-31a8de48a70c service nova] Creating event network-vif-plugged:5db01fd1-2d11-42b1-a3c9-a52cca1b8138 for instance 75b55166-b6c5-400e-b0c6-f1a04c595b75 on n-h2-860892-1 Oct 11 04:16:19.246940 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2cabeea4-9dc5-447e-882e-f349a9d2fb27 req-19ff8722-b52c-4e3d-908d-31a8de48a70c service nova] Creating event network-vif-plugged:9769a2e6-fb73-4776-9ec6-f2a0fc75e9fc for instance e574c295-e9b3-4047-acbb-78f086432245 on n-h1-860892-1 Oct 11 04:16:19.262559 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2cabeea4-9dc5-447e-882e-f349a9d2fb27 req-19ff8722-b52c-4e3d-908d-31a8de48a70c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.079129 Oct 11 04:16:19.263540 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 760/1573] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:19 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:19.287443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92e62205-fa3e-4930-a241-f7a37cdf98bc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:19.290638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-92e62205-fa3e-4930-a241-f7a37cdf98bc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:19.299814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92e62205-fa3e-4930-a241-f7a37cdf98bc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:19.300552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92e62205-fa3e-4930-a241-f7a37cdf98bc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:19.302297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92e62205-fa3e-4930-a241-f7a37cdf98bc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:19.303432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92e62205-fa3e-4930-a241-f7a37cdf98bc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:19.303895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92e62205-fa3e-4930-a241-f7a37cdf98bc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:19.304324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92e62205-fa3e-4930-a241-f7a37cdf98bc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:19.332644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:19.415824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92e62205-fa3e-4930-a241-f7a37cdf98bc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:19.424792 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92e62205-fa3e-4930-a241-f7a37cdf98bc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1215 microversion: 2.1 time: 0.158614 Oct 11 04:16:19.426022 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 761/1574] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:19 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:19.431593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6819f3e8-f975-4247-a7fe-8832d7c6b60c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:19.432429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6819f3e8-f975-4247-a7fe-8832d7c6b60c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:19.447329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6819f3e8-f975-4247-a7fe-8832d7c6b60c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:19.466280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6819f3e8-f975-4247-a7fe-8832d7c6b60c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:19.466657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6819f3e8-f975-4247-a7fe-8832d7c6b60c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:19.467410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6819f3e8-f975-4247-a7fe-8832d7c6b60c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:19.470984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6819f3e8-f975-4247-a7fe-8832d7c6b60c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:19.471747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6819f3e8-f975-4247-a7fe-8832d7c6b60c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:19.737982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6819f3e8-f975-4247-a7fe-8832d7c6b60c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:19.756768 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6819f3e8-f975-4247-a7fe-8832d7c6b60c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1323 microversion: 2.1 time: 0.329194 Oct 11 04:16:19.757915 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 762/1575] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:19 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1323 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:19.763054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a24c743e-3250-4fca-97c5-c8fcdcd795ca tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:19.763869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a24c743e-3250-4fca-97c5-c8fcdcd795ca tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:19.780417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a24c743e-3250-4fca-97c5-c8fcdcd795ca tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:19.781092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a24c743e-3250-4fca-97c5-c8fcdcd795ca tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:19.781723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a24c743e-3250-4fca-97c5-c8fcdcd795ca tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:19.782646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a24c743e-3250-4fca-97c5-c8fcdcd795ca tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:19.783270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a24c743e-3250-4fca-97c5-c8fcdcd795ca tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:19.783702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a24c743e-3250-4fca-97c5-c8fcdcd795ca tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:19.874395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a24c743e-3250-4fca-97c5-c8fcdcd795ca tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:19.882295 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a24c743e-3250-4fca-97c5-c8fcdcd795ca tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1224 microversion: 2.1 time: 0.123159 Oct 11 04:16:19.882891 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 763/1576] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:19 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1224 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:19.900104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-625648b1-0b53-4bc4-9248-73fe6cb2f8aa tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:19.900720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-625648b1-0b53-4bc4-9248-73fe6cb2f8aa tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:19.909578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-625648b1-0b53-4bc4-9248-73fe6cb2f8aa tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:19.910081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-625648b1-0b53-4bc4-9248-73fe6cb2f8aa tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:19.910553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-625648b1-0b53-4bc4-9248-73fe6cb2f8aa tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:19.911272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-625648b1-0b53-4bc4-9248-73fe6cb2f8aa tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:19.911709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-625648b1-0b53-4bc4-9248-73fe6cb2f8aa tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:19.912134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-625648b1-0b53-4bc4-9248-73fe6cb2f8aa tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.049586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-625648b1-0b53-4bc4-9248-73fe6cb2f8aa tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:20.057537 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-625648b1-0b53-4bc4-9248-73fe6cb2f8aa tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.173707 Oct 11 04:16:20.058090 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 764/1577] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:19 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:20.063267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-403cab39-5ce9-4841-a979-bc98a926c16c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:20.063872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-403cab39-5ce9-4841-a979-bc98a926c16c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:20.069841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-403cab39-5ce9-4841-a979-bc98a926c16c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.072500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-403cab39-5ce9-4841-a979-bc98a926c16c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.072500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-403cab39-5ce9-4841-a979-bc98a926c16c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.072500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-403cab39-5ce9-4841-a979-bc98a926c16c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.072500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-403cab39-5ce9-4841-a979-bc98a926c16c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.073148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-403cab39-5ce9-4841-a979-bc98a926c16c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.094907 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f69c4688-02b0-4167-ad62-4ad9dc971f69 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/action" status: 202 len: 0 microversion: 2.25 time: 4.690514 Oct 11 04:16:20.095689 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 814/1578] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:16:15 2022] POST /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/action => generated 0 bytes in 4692 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:16:20.103599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:20.104206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:20.111804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.112282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.112712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.113416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.113851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.114305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.211605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-403cab39-5ce9-4841-a979-bc98a926c16c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:20.219540 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-403cab39-5ce9-4841-a979-bc98a926c16c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.160453 Oct 11 04:16:20.220118 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 765/1579] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:20 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:20.224782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c6a6cf1a-d101-4583-baca-cb85292fb01d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:20.225398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c6a6cf1a-d101-4583-baca-cb85292fb01d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:20.231257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a6cf1a-d101-4583-baca-cb85292fb01d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.231997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a6cf1a-d101-4583-baca-cb85292fb01d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.232429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a6cf1a-d101-4583-baca-cb85292fb01d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.233674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a6cf1a-d101-4583-baca-cb85292fb01d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.234328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a6cf1a-d101-4583-baca-cb85292fb01d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.234909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a6cf1a-d101-4583-baca-cb85292fb01d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.255242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:20.264047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:20.266711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:20.267890 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1591353d-a4bc-4bd0-b953-4bf83d40855f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.168070 Oct 11 04:16:20.268461 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 815/1580] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:20 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:16:20.375841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c6a6cf1a-d101-4583-baca-cb85292fb01d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:20.383828 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c6a6cf1a-d101-4583-baca-cb85292fb01d tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1293 microversion: 2.1 time: 0.162734 Oct 11 04:16:20.384384 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 766/1581] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:20 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1293 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:20.449758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-54f81409-90bd-4f3c-aee8-b39129978d86 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:20.450310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-54f81409-90bd-4f3c-aee8-b39129978d86 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:20.457697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54f81409-90bd-4f3c-aee8-b39129978d86 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.458170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54f81409-90bd-4f3c-aee8-b39129978d86 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.458620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54f81409-90bd-4f3c-aee8-b39129978d86 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.459303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54f81409-90bd-4f3c-aee8-b39129978d86 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.459783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54f81409-90bd-4f3c-aee8-b39129978d86 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.460240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54f81409-90bd-4f3c-aee8-b39129978d86 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.523679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-54f81409-90bd-4f3c-aee8-b39129978d86 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:20.532041 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-54f81409-90bd-4f3c-aee8-b39129978d86 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1215 microversion: 2.1 time: 0.087109 Oct 11 04:16:20.532613 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 816/1582] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:20 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:20.783772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cf482dcc-5d5f-413f-b9bd-cd90042e3d57 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:20.784486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf482dcc-5d5f-413f-b9bd-cd90042e3d57 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:20.790517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf482dcc-5d5f-413f-b9bd-cd90042e3d57 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.790996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf482dcc-5d5f-413f-b9bd-cd90042e3d57 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.791426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf482dcc-5d5f-413f-b9bd-cd90042e3d57 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.792125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf482dcc-5d5f-413f-b9bd-cd90042e3d57 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.792583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf482dcc-5d5f-413f-b9bd-cd90042e3d57 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.793058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf482dcc-5d5f-413f-b9bd-cd90042e3d57 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.906474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-993bc487-a4ea-44b3-ad9b-f2e0ffb248e8 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:20.907283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-993bc487-a4ea-44b3-ad9b-f2e0ffb248e8 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:20.914775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc487-a4ea-44b3-ad9b-f2e0ffb248e8 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.915761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc487-a4ea-44b3-ad9b-f2e0ffb248e8 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.916754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc487-a4ea-44b3-ad9b-f2e0ffb248e8 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.918616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc487-a4ea-44b3-ad9b-f2e0ffb248e8 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:20.919303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc487-a4ea-44b3-ad9b-f2e0ffb248e8 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:20.920040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc487-a4ea-44b3-ad9b-f2e0ffb248e8 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:20.963259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cf482dcc-5d5f-413f-b9bd-cd90042e3d57 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:20.971956 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cf482dcc-5d5f-413f-b9bd-cd90042e3d57 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1518 microversion: 2.1 time: 0.192117 Oct 11 04:16:20.972532 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 767/1583] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:20 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1518 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:20.994342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-993bc487-a4ea-44b3-ad9b-f2e0ffb248e8 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:21.001385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.49"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:21.002097 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-993bc487-a4ea-44b3-ad9b-f2e0ffb248e8 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1224 microversion: 2.1 time: 0.100235 Oct 11 04:16:21.002696 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 817/1584] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:20 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:21.004849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:21.011890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.012370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.012820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.013784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.014873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.019871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.043134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "refresh_cache-15e3c3e6-a98f-4e56-a548-439d14a51e92" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:16:21.043531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquired lock "refresh_cache-15e3c3e6-a98f-4e56-a548-439d14a51e92" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:16:21.081566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a734e64b-1c6f-426c-8531-9d29e8cbe7ca tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:21.082305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a734e64b-1c6f-426c-8531-9d29e8cbe7ca tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:21.088464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a734e64b-1c6f-426c-8531-9d29e8cbe7ca tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.089015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a734e64b-1c6f-426c-8531-9d29e8cbe7ca tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.089550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a734e64b-1c6f-426c-8531-9d29e8cbe7ca tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.090337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a734e64b-1c6f-426c-8531-9d29e8cbe7ca tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.090907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a734e64b-1c6f-426c-8531-9d29e8cbe7ca tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.091385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a734e64b-1c6f-426c-8531-9d29e8cbe7ca tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.229648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a734e64b-1c6f-426c-8531-9d29e8cbe7ca tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:21.238327 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a734e64b-1c6f-426c-8531-9d29e8cbe7ca tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1322 microversion: 2.1 time: 0.160759 Oct 11 04:16:21.238827 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 818/1585] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:21 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:21.243737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f621ce8-b29f-42c1-af8e-a681dd39480b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:21.244515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f621ce8-b29f-42c1-af8e-a681dd39480b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:21.252483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f621ce8-b29f-42c1-af8e-a681dd39480b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.253003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f621ce8-b29f-42c1-af8e-a681dd39480b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.253445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f621ce8-b29f-42c1-af8e-a681dd39480b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.254427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f621ce8-b29f-42c1-af8e-a681dd39480b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.254901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f621ce8-b29f-42c1-af8e-a681dd39480b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.255611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f621ce8-b29f-42c1-af8e-a681dd39480b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.397622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2f621ce8-b29f-42c1-af8e-a681dd39480b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:21.409394 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f621ce8-b29f-42c1-af8e-a681dd39480b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.168876 Oct 11 04:16:21.423367 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 819/1586] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:21 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:21.435506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:21.436546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:21.444012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.445342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.445933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.454315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.457562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.457562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.661945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:21.673630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:21.675496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:21.677700 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f573afdb-0f88-4ad3-8e67-de79735091e1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.252637 Oct 11 04:16:21.678862 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 820/1587] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:21 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:21.684135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4264a3f7-2ba7-4ef2-bcc3-dce2e977156e tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:21.685841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4264a3f7-2ba7-4ef2-bcc3-dce2e977156e tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:21.693196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4264a3f7-2ba7-4ef2-bcc3-dce2e977156e tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.694276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4264a3f7-2ba7-4ef2-bcc3-dce2e977156e tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.694856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4264a3f7-2ba7-4ef2-bcc3-dce2e977156e tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.695698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4264a3f7-2ba7-4ef2-bcc3-dce2e977156e tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.696332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4264a3f7-2ba7-4ef2-bcc3-dce2e977156e tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.696893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4264a3f7-2ba7-4ef2-bcc3-dce2e977156e tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.834765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4264a3f7-2ba7-4ef2-bcc3-dce2e977156e tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:21.843263 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4264a3f7-2ba7-4ef2-bcc3-dce2e977156e tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1483 microversion: 2.1 time: 0.162574 Oct 11 04:16:21.843844 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 821/1588] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:21 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1483 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:21.858535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-104a3d8d-0a57-4418-9073-90c9a24883b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:21.859225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-104a3d8d-0a57-4418-9073-90c9a24883b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:21.862302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:21.865782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104a3d8d-0a57-4418-9073-90c9a24883b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.866285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104a3d8d-0a57-4418-9073-90c9a24883b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.866722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104a3d8d-0a57-4418-9073-90c9a24883b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.867466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104a3d8d-0a57-4418-9073-90c9a24883b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.867908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104a3d8d-0a57-4418-9073-90c9a24883b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.868325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104a3d8d-0a57-4418-9073-90c9a24883b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.934925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-104a3d8d-0a57-4418-9073-90c9a24883b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:21.944167 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-104a3d8d-0a57-4418-9073-90c9a24883b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1215 microversion: 2.1 time: 0.098778 Oct 11 04:16:21.961214 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 822/1589] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:21 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:21.966158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0cdfb779-ad2a-4a69-837a-3b5c96d5968b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:21.966667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0cdfb779-ad2a-4a69-837a-3b5c96d5968b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:21.972905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cdfb779-ad2a-4a69-837a-3b5c96d5968b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.973383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cdfb779-ad2a-4a69-837a-3b5c96d5968b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.973812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cdfb779-ad2a-4a69-837a-3b5c96d5968b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:21.974525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cdfb779-ad2a-4a69-837a-3b5c96d5968b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:21.974971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cdfb779-ad2a-4a69-837a-3b5c96d5968b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:21.975387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cdfb779-ad2a-4a69-837a-3b5c96d5968b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:22.060985 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0cdfb779-ad2a-4a69-837a-3b5c96d5968b tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098678 Oct 11 04:16:22.062930 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 823/1590] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:16:21 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:22.067630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6ed20e05-d7e0-4fba-9ccf-da09f4971b17 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:22.068385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6ed20e05-d7e0-4fba-9ccf-da09f4971b17 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:22.079381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ed20e05-d7e0-4fba-9ccf-da09f4971b17 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:22.079381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ed20e05-d7e0-4fba-9ccf-da09f4971b17 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:22.079381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ed20e05-d7e0-4fba-9ccf-da09f4971b17 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:22.079381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ed20e05-d7e0-4fba-9ccf-da09f4971b17 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:22.079381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ed20e05-d7e0-4fba-9ccf-da09f4971b17 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:22.079381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ed20e05-d7e0-4fba-9ccf-da09f4971b17 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:22.193150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6ed20e05-d7e0-4fba-9ccf-da09f4971b17 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:22.201275 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6ed20e05-d7e0-4fba-9ccf-da09f4971b17 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1224 microversion: 2.1 time: 0.137327 Oct 11 04:16:22.216878 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 824/1591] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:22 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1224 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:22.221822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-aa93d040-fbfc-4ab7-aba2-7a7b548fef22 req-d35ecfbe-3129-4ee8-8547-e508f745cb9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72660709-ce51-4053-af08-b1cd828c95d4", "name": "network-vif-unplugged", "status": "completed", "tag": "66639d0c-5518-4300-98e7-ab09ecbda154"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:22.231534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-aa93d040-fbfc-4ab7-aba2-7a7b548fef22 req-d35ecfbe-3129-4ee8-8547-e508f745cb9b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:22.232065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-aa93d040-fbfc-4ab7-aba2-7a7b548fef22 req-d35ecfbe-3129-4ee8-8547-e508f745cb9b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:22.232415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-aa93d040-fbfc-4ab7-aba2-7a7b548fef22 req-d35ecfbe-3129-4ee8-8547-e508f745cb9b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:22.244984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-aa93d040-fbfc-4ab7-aba2-7a7b548fef22 req-d35ecfbe-3129-4ee8-8547-e508f745cb9b service nova] Creating event network-vif-unplugged:66639d0c-5518-4300-98e7-ab09ecbda154 for instance 72660709-ce51-4053-af08-b1cd828c95d4 on n-h2-860892-1 Oct 11 04:16:22.251343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-aa93d040-fbfc-4ab7-aba2-7a7b548fef22 req-d35ecfbe-3129-4ee8-8547-e508f745cb9b service nova] Instance 72660709-ce51-4053-af08-b1cd828c95d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:16:22.262926 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-aa93d040-fbfc-4ab7-aba2-7a7b548fef22 req-d35ecfbe-3129-4ee8-8547-e508f745cb9b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044642 Oct 11 04:16:22.263632 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 825/1592] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:22.269387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab2bdfcf-6f31-43e1-b1fc-0b31c5cae58c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:22.269387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab2bdfcf-6f31-43e1-b1fc-0b31c5cae58c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:22.275480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab2bdfcf-6f31-43e1-b1fc-0b31c5cae58c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:22.275926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab2bdfcf-6f31-43e1-b1fc-0b31c5cae58c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:22.276369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab2bdfcf-6f31-43e1-b1fc-0b31c5cae58c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:22.277025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab2bdfcf-6f31-43e1-b1fc-0b31c5cae58c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:22.277552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab2bdfcf-6f31-43e1-b1fc-0b31c5cae58c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:22.277973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab2bdfcf-6f31-43e1-b1fc-0b31c5cae58c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:22.860256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab2bdfcf-6f31-43e1-b1fc-0b31c5cae58c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:22.868732 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab2bdfcf-6f31-43e1-b1fc-0b31c5cae58c tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1471 microversion: 2.1 time: 0.603922 Oct 11 04:16:22.880704 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 826/1593] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:22 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1471 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:22.885999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e123200-e48a-494a-9a58-9f172e8b9128 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:22.894100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e123200-e48a-494a-9a58-9f172e8b9128 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:22.902416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e123200-e48a-494a-9a58-9f172e8b9128 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:22.902999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e123200-e48a-494a-9a58-9f172e8b9128 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:22.904498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e123200-e48a-494a-9a58-9f172e8b9128 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:22.904498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e123200-e48a-494a-9a58-9f172e8b9128 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:22.904667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e123200-e48a-494a-9a58-9f172e8b9128 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:22.905589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e123200-e48a-494a-9a58-9f172e8b9128 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:23.108722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e123200-e48a-494a-9a58-9f172e8b9128 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:23.118111 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e123200-e48a-494a-9a58-9f172e8b9128 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.235850 Oct 11 04:16:23.119045 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 827/1594] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:22 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:23.123494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:23.125951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:23.132664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:23.133284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:23.133916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:23.134924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:23.135487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:23.136296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:23.385083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:23.394805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:23.401359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:23.401359 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d0446b8-1c38-49b5-afa3-3c97e65630f1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.276818 Oct 11 04:16:23.401359 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 828/1595] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:23 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:23.402523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:23.403203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:23.410030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:23.410731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:23.411340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:23.412245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:23.412860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:23.413440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:23.435323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:23.439420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-server-diagnostics failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Request method failure captured: Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245/diagnostics HTTP/1.1 Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO31xRbp3kpkWH4_ljLQOOMS2sWTm8wy0xJ8cxytnfGN6J3JRPVzDRw5jBaFn4PPc0Td-6VDK2qsSUAQNzBne6UkUMflS2ApM_CBWSmCUiyW6xD1TwaDee4UxxdwZjGzqM2gNihMb4uo98U91rUiFhwHOskK6XtpD0ceTGAEkyC7__U Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f93ac52a8285437d9875b02ff758eaae Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1515621319 Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f93ac52a8285437d9875b02ff758eaae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f93ac52a8285437d9875b02ff758eaae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f93ac52a8285437d9875b02ff758eaae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f93ac52a8285437d9875b02ff758eaae"}]}] Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1515621319 Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f93ac52a8285437d9875b02ff758eaae Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1515621319 Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerDiagnosticsNegativeTest-1515621319-project Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: f1e6e057d5e849899bda86587049e1ce Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1515621319-project Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: exception: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'server_id': 'e574c295-e9b3-4047-acbb-78f086432245'} Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_diagnostics.py", line 38, in index Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi context.can(sd_policies.BASE_POLICY_NAME, Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:23.444743 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:23.449776 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:23.449776 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:23.449776 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:16:23.449776 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:16:23.449776 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. Oct 11 04:16:23.449776 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:23.463023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-server-diagnostics to be performed. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:16:23.463919 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-36c9aeae-6a75-4cf2-897a-9a3c685a15f5 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245/diagnostics" status: 403 len: 117 microversion: 2.1 time: 0.065713 Oct 11 04:16:23.464491 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 829/1596] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:16:23 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245/diagnostics => generated 117 bytes in 67 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:16:23.472937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43853e0e-e041-4f01-b46c-b28d4a554f46 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:23.473691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-43853e0e-e041-4f01-b46c-b28d4a554f46 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:23.481192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43853e0e-e041-4f01-b46c-b28d4a554f46 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:23.481765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43853e0e-e041-4f01-b46c-b28d4a554f46 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:23.482484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43853e0e-e041-4f01-b46c-b28d4a554f46 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:23.483977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43853e0e-e041-4f01-b46c-b28d4a554f46 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:23.484629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43853e0e-e041-4f01-b46c-b28d4a554f46 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:23.485262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43853e0e-e041-4f01-b46c-b28d4a554f46 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:23.585223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-43853e0e-e041-4f01-b46c-b28d4a554f46 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:23.595464 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-43853e0e-e041-4f01-b46c-b28d4a554f46 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1279 microversion: 2.1 time: 0.127061 Oct 11 04:16:23.596047 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 830/1597] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:23 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1279 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:23.600802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-133c01b1-9aed-4e9e-b6b5-ddc71a483822 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:23.601486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-133c01b1-9aed-4e9e-b6b5-ddc71a483822 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:23.607810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-133c01b1-9aed-4e9e-b6b5-ddc71a483822 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:23.608657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-133c01b1-9aed-4e9e-b6b5-ddc71a483822 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:23.609358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-133c01b1-9aed-4e9e-b6b5-ddc71a483822 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:23.610322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-133c01b1-9aed-4e9e-b6b5-ddc71a483822 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:23.611074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-133c01b1-9aed-4e9e-b6b5-ddc71a483822 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:23.611713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-133c01b1-9aed-4e9e-b6b5-ddc71a483822 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:23.728498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-133c01b1-9aed-4e9e-b6b5-ddc71a483822 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:23.739272 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-133c01b1-9aed-4e9e-b6b5-ddc71a483822 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1280 microversion: 2.1 time: 0.141931 Oct 11 04:16:23.768190 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 831/1598] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:23 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1280 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:23.775304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-046a4508-4bfa-4026-9883-3775b7e75d2a tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:23.776421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-046a4508-4bfa-4026-9883-3775b7e75d2a tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:23.790008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-046a4508-4bfa-4026-9883-3775b7e75d2a tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:23.791428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-046a4508-4bfa-4026-9883-3775b7e75d2a tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:23.791983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-046a4508-4bfa-4026-9883-3775b7e75d2a tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:23.794215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-046a4508-4bfa-4026-9883-3775b7e75d2a tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:23.794804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-046a4508-4bfa-4026-9883-3775b7e75d2a tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:23.796264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-046a4508-4bfa-4026-9883-3775b7e75d2a tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:23.841755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-046a4508-4bfa-4026-9883-3775b7e75d2a tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:16:24.151920 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-046a4508-4bfa-4026-9883-3775b7e75d2a tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 204 len: 0 microversion: 2.1 time: 0.381242 Oct 11 04:16:24.159355 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 832/1599] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:16:23 2022] DELETE /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:16:24.172263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-96d6291c-1355-4e7b-8a71-629f94ac8aa9 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:24.173820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-96d6291c-1355-4e7b-8a71-629f94ac8aa9 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:24.185719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d6291c-1355-4e7b-8a71-629f94ac8aa9 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:24.186924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d6291c-1355-4e7b-8a71-629f94ac8aa9 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:24.187509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d6291c-1355-4e7b-8a71-629f94ac8aa9 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:24.188322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d6291c-1355-4e7b-8a71-629f94ac8aa9 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:24.188885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d6291c-1355-4e7b-8a71-629f94ac8aa9 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:24.189577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d6291c-1355-4e7b-8a71-629f94ac8aa9 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:24.404652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Building network info cache for instance {{(pid=120993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 04:16:24.630447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-96d6291c-1355-4e7b-8a71-629f94ac8aa9 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:24.642737 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-96d6291c-1355-4e7b-8a71-629f94ac8aa9 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1483 microversion: 2.1 time: 0.482106 Oct 11 04:16:24.658373 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 833/1600] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:24 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1483 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:24.658373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-91171758-54ce-4ec2-a66d-52d39262e364 req-dab8e58b-3883-419c-94da-9f2a68feee4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "75b55166-b6c5-400e-b0c6-f1a04c595b75", "tag": "5db01fd1-2d11-42b1-a3c9-a52cca1b8138"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:24.686292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=30 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:24.688685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-91171758-54ce-4ec2-a66d-52d39262e364 req-dab8e58b-3883-419c-94da-9f2a68feee4d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:24.689030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-91171758-54ce-4ec2-a66d-52d39262e364 req-dab8e58b-3883-419c-94da-9f2a68feee4d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:24.689468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-91171758-54ce-4ec2-a66d-52d39262e364 req-dab8e58b-3883-419c-94da-9f2a68feee4d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:24.718179 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-91171758-54ce-4ec2-a66d-52d39262e364 req-dab8e58b-3883-419c-94da-9f2a68feee4d service nova] Creating event network-changed:5db01fd1-2d11-42b1-a3c9-a52cca1b8138 for instance 75b55166-b6c5-400e-b0c6-f1a04c595b75 on n-h2-860892-1 Oct 11 04:16:24.732336 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-91171758-54ce-4ec2-a66d-52d39262e364 req-dab8e58b-3883-419c-94da-9f2a68feee4d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085563 Oct 11 04:16:24.733459 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 834/1601] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:24.758787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0887784c-5d20-4091-84ed-86baeab49dd5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:24.759514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0887784c-5d20-4091-84ed-86baeab49dd5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:24.778150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0887784c-5d20-4091-84ed-86baeab49dd5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:24.778978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0887784c-5d20-4091-84ed-86baeab49dd5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:24.779435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0887784c-5d20-4091-84ed-86baeab49dd5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:24.780223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0887784c-5d20-4091-84ed-86baeab49dd5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:24.784835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0887784c-5d20-4091-84ed-86baeab49dd5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:24.785345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0887784c-5d20-4091-84ed-86baeab49dd5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:25.091272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0887784c-5d20-4091-84ed-86baeab49dd5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:25.125955 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0887784c-5d20-4091-84ed-86baeab49dd5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.386241 Oct 11 04:16:25.127109 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 835/1602] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:24 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:25.138777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2d541c5-370a-46a9-9b9e-584c51f16565 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:25.148321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b2d541c5-370a-46a9-9b9e-584c51f16565 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:25.163634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d541c5-370a-46a9-9b9e-584c51f16565 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:25.164192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d541c5-370a-46a9-9b9e-584c51f16565 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:25.164640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d541c5-370a-46a9-9b9e-584c51f16565 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:25.165367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d541c5-370a-46a9-9b9e-584c51f16565 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:25.165829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d541c5-370a-46a9-9b9e-584c51f16565 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:25.166289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d541c5-370a-46a9-9b9e-584c51f16565 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:25.252517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:25.383960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b2d541c5-370a-46a9-9b9e-584c51f16565 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:25.394612 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2d541c5-370a-46a9-9b9e-584c51f16565 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1477 microversion: 2.1 time: 0.266135 Oct 11 04:16:25.395606 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 836/1603] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:25 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1477 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:25.401731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b36dee6f-a406-4438-89cf-8020a7565e8f req-88005a34-ab04-4dca-a34c-190b204c48cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "72660709-ce51-4053-af08-b1cd828c95d4", "tag": "66639d0c-5518-4300-98e7-ab09ecbda154"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:25.415414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b36dee6f-a406-4438-89cf-8020a7565e8f req-88005a34-ab04-4dca-a34c-190b204c48cb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:25.416952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b36dee6f-a406-4438-89cf-8020a7565e8f req-88005a34-ab04-4dca-a34c-190b204c48cb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:25.417396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b36dee6f-a406-4438-89cf-8020a7565e8f req-88005a34-ab04-4dca-a34c-190b204c48cb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:25.439621 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b36dee6f-a406-4438-89cf-8020a7565e8f req-88005a34-ab04-4dca-a34c-190b204c48cb service nova] Creating event network-changed:66639d0c-5518-4300-98e7-ab09ecbda154 for instance 72660709-ce51-4053-af08-b1cd828c95d4 on n-h2-860892-1 Oct 11 04:16:25.450001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-b36dee6f-a406-4438-89cf-8020a7565e8f req-88005a34-ab04-4dca-a34c-190b204c48cb service nova] Instance 72660709-ce51-4053-af08-b1cd828c95d4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:16:25.474944 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b36dee6f-a406-4438-89cf-8020a7565e8f req-88005a34-ab04-4dca-a34c-190b204c48cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077694 Oct 11 04:16:25.491636 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 837/1604] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:25.501097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:25.501097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:25.513019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:25.513019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:25.513019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:25.513019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:25.513019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:25.513019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:25.778885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:25.788689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:25.790810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:25.791998 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-134e8101-cda6-42c9-8213-eb4c0bd4ff49 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.299089 Oct 11 04:16:25.792972 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 838/1605] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:25 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:25.800019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-97a2690b-303d-44d6-af9b-ffaed3fcad49 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:25.800019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-97a2690b-303d-44d6-af9b-ffaed3fcad49 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:25.804710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97a2690b-303d-44d6-af9b-ffaed3fcad49 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:25.805199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97a2690b-303d-44d6-af9b-ffaed3fcad49 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:25.805630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97a2690b-303d-44d6-af9b-ffaed3fcad49 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:25.806691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97a2690b-303d-44d6-af9b-ffaed3fcad49 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:25.807151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97a2690b-303d-44d6-af9b-ffaed3fcad49 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:25.807746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97a2690b-303d-44d6-af9b-ffaed3fcad49 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:25.925443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-97a2690b-303d-44d6-af9b-ffaed3fcad49 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:25.938940 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-97a2690b-303d-44d6-af9b-ffaed3fcad49 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1277 microversion: 2.1 time: 0.144868 Oct 11 04:16:25.950292 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 839/1606] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:25 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1277 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:25.968192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9486ccac-43d2-478a-a56c-b09b3e06485e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:25.968856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9486ccac-43d2-478a-a56c-b09b3e06485e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:25.988415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9486ccac-43d2-478a-a56c-b09b3e06485e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:25.992482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9486ccac-43d2-478a-a56c-b09b3e06485e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:25.994899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9486ccac-43d2-478a-a56c-b09b3e06485e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:25.995891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9486ccac-43d2-478a-a56c-b09b3e06485e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:25.997492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9486ccac-43d2-478a-a56c-b09b3e06485e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:25.998363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9486ccac-43d2-478a-a56c-b09b3e06485e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:26.409830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9486ccac-43d2-478a-a56c-b09b3e06485e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:26.422775 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9486ccac-43d2-478a-a56c-b09b3e06485e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1288 microversion: 2.1 time: 0.471097 Oct 11 04:16:26.427628 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 840/1607] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:25 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1288 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:26.433497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-512a7935-5cf5-40b3-adbf-b83049dee95e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:26.434048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-512a7935-5cf5-40b3-adbf-b83049dee95e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:26.452197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512a7935-5cf5-40b3-adbf-b83049dee95e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:26.453173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512a7935-5cf5-40b3-adbf-b83049dee95e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:26.453634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512a7935-5cf5-40b3-adbf-b83049dee95e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:26.454412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512a7935-5cf5-40b3-adbf-b83049dee95e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:26.454873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512a7935-5cf5-40b3-adbf-b83049dee95e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:26.455299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512a7935-5cf5-40b3-adbf-b83049dee95e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:26.912853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-512a7935-5cf5-40b3-adbf-b83049dee95e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:26.924604 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-512a7935-5cf5-40b3-adbf-b83049dee95e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1469 microversion: 2.1 time: 0.495791 Oct 11 04:16:26.928981 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 841/1608] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:26 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1469 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:26.943762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-07a5b7ee-68e2-4dda-ac25-a0c00aaab607 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:26.945504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-07a5b7ee-68e2-4dda-ac25-a0c00aaab607 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:26.963618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07a5b7ee-68e2-4dda-ac25-a0c00aaab607 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:26.964523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07a5b7ee-68e2-4dda-ac25-a0c00aaab607 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:26.969756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07a5b7ee-68e2-4dda-ac25-a0c00aaab607 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:26.970845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07a5b7ee-68e2-4dda-ac25-a0c00aaab607 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:26.971677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07a5b7ee-68e2-4dda-ac25-a0c00aaab607 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:26.972379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07a5b7ee-68e2-4dda-ac25-a0c00aaab607 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:27.560119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:27.690495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Updating instance_info_cache with network_info: [{"id": "9ada40c6-66d1-4d89-a451-50125c8dfce0", "address": "fa:16:3e:23:39:3c", "network": {"id": "771b531d-e085-4be0-a5db-f8ca98902475", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694233747-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "26ea13948bbf479386c8b9ee5e1aa5cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9ada40c6-66", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:16:27.756232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-07a5b7ee-68e2-4dda-ac25-a0c00aaab607 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:27.770164 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-07a5b7ee-68e2-4dda-ac25-a0c00aaab607 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1477 microversion: 2.1 time: 0.839182 Oct 11 04:16:27.772313 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 842/1609] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:26 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1477 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:27.779328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:27.780460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:27.795769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:27.798765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:27.805540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:27.806602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:27.807050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Releasing lock "refresh_cache-15e3c3e6-a98f-4e56-a548-439d14a51e92" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:16:27.808941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:27.808941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:27.810615 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e2b3d405-660c-40a7-96aa-c66088b709ee tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "POST /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92/action" status: 202 len: 0 microversion: 2.1 time: 6.813263 Oct 11 04:16:27.839077 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 768/1610] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:16:20 2022] POST /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92/action => generated 0 bytes in 6843 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 11 04:16:27.876185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-96396e71-8eda-4f56-b844-494882e97e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:27.894628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-96396e71-8eda-4f56-b844-494882e97e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:27.927436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96396e71-8eda-4f56-b844-494882e97e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:27.929439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96396e71-8eda-4f56-b844-494882e97e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:27.929439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96396e71-8eda-4f56-b844-494882e97e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:27.934222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96396e71-8eda-4f56-b844-494882e97e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:27.935247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96396e71-8eda-4f56-b844-494882e97e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:27.937772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96396e71-8eda-4f56-b844-494882e97e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:28.148434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:28.157783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:28.159260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:28.160508 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-65f8d752-598f-4e26-9a0d-749ecb1eaf70 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.387117 Oct 11 04:16:28.174457 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 843/1611] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:27 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:28.174457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-659559b9-4d0e-4fca-a5d4-ccdeb127bed9 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:28.174457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-659559b9-4d0e-4fca-a5d4-ccdeb127bed9 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:28.183121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-659559b9-4d0e-4fca-a5d4-ccdeb127bed9 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:28.183613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-659559b9-4d0e-4fca-a5d4-ccdeb127bed9 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:28.186979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-659559b9-4d0e-4fca-a5d4-ccdeb127bed9 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:28.189834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-659559b9-4d0e-4fca-a5d4-ccdeb127bed9 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:28.189834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-659559b9-4d0e-4fca-a5d4-ccdeb127bed9 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:28.189834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-659559b9-4d0e-4fca-a5d4-ccdeb127bed9 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:28.277442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=10 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:28.397635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-659559b9-4d0e-4fca-a5d4-ccdeb127bed9 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:28.413989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-659559b9-4d0e-4fca-a5d4-ccdeb127bed9 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1286 microversion: 2.1 time: 0.243242 Oct 11 04:16:28.414370 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 844/1612] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:28 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1286 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:28.419992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.49"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:28.429634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:28.446162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:28.446597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:28.447062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:28.447727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:28.453354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:28.453827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:28.525316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "refresh_cache-927821c1-5dca-4ee7-8072-d2ab4d97368b" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:16:28.526029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquired lock "refresh_cache-927821c1-5dca-4ee7-8072-d2ab4d97368b" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:16:28.595195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-96396e71-8eda-4f56-b844-494882e97e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:28.603984 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-96396e71-8eda-4f56-b844-494882e97e99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.755427 Oct 11 04:16:28.618618 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 769/1613] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:27 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:28.625755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-39f22622-03a5-48b2-bc78-7540aee725ea req-2a136752-0208-4c67-a70f-a0a0ce155f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e3c3e6-a98f-4e56-a548-439d14a51e92", "tag": "9ada40c6-66d1-4d89-a451-50125c8dfce0"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:28.638068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-39f22622-03a5-48b2-bc78-7540aee725ea req-2a136752-0208-4c67-a70f-a0a0ce155f08 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:28.638952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-39f22622-03a5-48b2-bc78-7540aee725ea req-2a136752-0208-4c67-a70f-a0a0ce155f08 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:28.640189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-39f22622-03a5-48b2-bc78-7540aee725ea req-2a136752-0208-4c67-a70f-a0a0ce155f08 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:28.652773 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-39f22622-03a5-48b2-bc78-7540aee725ea req-2a136752-0208-4c67-a70f-a0a0ce155f08 service nova] Creating event network-changed:9ada40c6-66d1-4d89-a451-50125c8dfce0 for instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 on n-h1-860892-1 Oct 11 04:16:28.661234 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-39f22622-03a5-48b2-bc78-7540aee725ea req-2a136752-0208-4c67-a70f-a0a0ce155f08 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041131 Oct 11 04:16:28.663972 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 770/1614] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:28.671720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ad34e2df-c93d-42a9-8028-f799590846dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:28.681404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ad34e2df-c93d-42a9-8028-f799590846dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:28.681404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:28.686435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad34e2df-c93d-42a9-8028-f799590846dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:28.687177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad34e2df-c93d-42a9-8028-f799590846dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:28.687869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad34e2df-c93d-42a9-8028-f799590846dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:28.688857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad34e2df-c93d-42a9-8028-f799590846dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:28.689541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad34e2df-c93d-42a9-8028-f799590846dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:28.690227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad34e2df-c93d-42a9-8028-f799590846dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:30.032055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ad34e2df-c93d-42a9-8028-f799590846dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:30.042664 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ad34e2df-c93d-42a9-8028-f799590846dc tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1462 microversion: 2.1 time: 1.377140 Oct 11 04:16:30.046227 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 771/1615] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:28 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1462 bytes in 1381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:30.058876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-4f02446d-cddb-40e4-82d7-f4b7f32d3572 req-6ef970d5-7276-4c53-a6cb-beb75fc6b274 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e574c295-e9b3-4047-acbb-78f086432245", "name": "network-vif-deleted", "tag": "9769a2e6-fb73-4776-9ec6-f2a0fc75e9fc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:30.081586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4f02446d-cddb-40e4-82d7-f4b7f32d3572 req-6ef970d5-7276-4c53-a6cb-beb75fc6b274 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:30.084960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4f02446d-cddb-40e4-82d7-f4b7f32d3572 req-6ef970d5-7276-4c53-a6cb-beb75fc6b274 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:30.086779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4f02446d-cddb-40e4-82d7-f4b7f32d3572 req-6ef970d5-7276-4c53-a6cb-beb75fc6b274 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:30.101026 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-4f02446d-cddb-40e4-82d7-f4b7f32d3572 req-6ef970d5-7276-4c53-a6cb-beb75fc6b274 service nova] Creating event network-vif-deleted:9769a2e6-fb73-4776-9ec6-f2a0fc75e9fc for instance e574c295-e9b3-4047-acbb-78f086432245 on n-h1-860892-1 Oct 11 04:16:30.107752 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-4f02446d-cddb-40e4-82d7-f4b7f32d3572 req-6ef970d5-7276-4c53-a6cb-beb75fc6b274 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058194 Oct 11 04:16:30.111436 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 772/1616] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:30.118347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:30.119543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:30.128028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:30.129900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:30.130611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:30.131501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:30.132113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:30.132763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:30.173054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:30.173907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:30.174529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:30.175138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lazy-loading 'fault' on Instance uuid e574c295-e9b3-4047-acbb-78f086432245 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:16:30.331545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f1e6e057d5e849899bda86587049e1ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f93ac52a8285437d9875b02ff758eaae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:30.358715 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8aa5126f-01dc-4683-b47b-53e4dd178b77 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 200 len: 1312 microversion: 2.1 time: 0.243754 Oct 11 04:16:30.359569 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 773/1617] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:30 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 1312 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:30.382057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:30.385244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:30.397153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:30.400349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:30.407451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:30.407451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:30.407451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:30.407451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:30.890934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:30.911180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:30.912810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:30.919667 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dc8b6d59-47cf-45ab-8686-58692db9d3a9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.552307 Oct 11 04:16:30.931655 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 774/1618] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:30 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:30.934497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b0808b44-9b8c-486d-a2ac-ae2cb33fb0c7 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:30.936754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b0808b44-9b8c-486d-a2ac-ae2cb33fb0c7 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:30.949457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0808b44-9b8c-486d-a2ac-ae2cb33fb0c7 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:30.949963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0808b44-9b8c-486d-a2ac-ae2cb33fb0c7 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:30.951549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0808b44-9b8c-486d-a2ac-ae2cb33fb0c7 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:30.951549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0808b44-9b8c-486d-a2ac-ae2cb33fb0c7 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:30.952640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0808b44-9b8c-486d-a2ac-ae2cb33fb0c7 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:30.953073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0808b44-9b8c-486d-a2ac-ae2cb33fb0c7 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:31.527578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b0808b44-9b8c-486d-a2ac-ae2cb33fb0c7 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:31.536299 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b0808b44-9b8c-486d-a2ac-ae2cb33fb0c7 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.611463 Oct 11 04:16:31.537146 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 775/1619] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:30 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:31.543377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12e00e04-1d35-41d5-8c08-b88eafae93de tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:31.544213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-12e00e04-1d35-41d5-8c08-b88eafae93de tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:31.550462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e00e04-1d35-41d5-8c08-b88eafae93de tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:31.551212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e00e04-1d35-41d5-8c08-b88eafae93de tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:31.551823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e00e04-1d35-41d5-8c08-b88eafae93de tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:31.552720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e00e04-1d35-41d5-8c08-b88eafae93de tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:31.553353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e00e04-1d35-41d5-8c08-b88eafae93de tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:31.553952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e00e04-1d35-41d5-8c08-b88eafae93de tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:31.679132 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.network.neutron [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] re-assign floating IP 172.25.6.49 from instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 Oct 11 04:16:31.737246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:31.739859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Building network info cache for instance {{(pid=120994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 04:16:31.946170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-12e00e04-1d35-41d5-8c08-b88eafae93de tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:31.955885 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-12e00e04-1d35-41d5-8c08-b88eafae93de tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.417299 Oct 11 04:16:31.957354 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 776/1620] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:31 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:31.962474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-760a2fab-5cd4-4fff-9bcf-a515583d3c8d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:31.963369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-760a2fab-5cd4-4fff-9bcf-a515583d3c8d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:31.970289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-760a2fab-5cd4-4fff-9bcf-a515583d3c8d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:31.971186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-760a2fab-5cd4-4fff-9bcf-a515583d3c8d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:31.971866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-760a2fab-5cd4-4fff-9bcf-a515583d3c8d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:31.972854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-760a2fab-5cd4-4fff-9bcf-a515583d3c8d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:31.973704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-760a2fab-5cd4-4fff-9bcf-a515583d3c8d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:31.974407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-760a2fab-5cd4-4fff-9bcf-a515583d3c8d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:32.362371 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-760a2fab-5cd4-4fff-9bcf-a515583d3c8d tempest-MigrationsAdminTest-1148131893 tempest-MigrationsAdminTest-1148131893-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1613 microversion: 2.1 time: 0.403656 Oct 11 04:16:32.364747 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 777/1621] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:31 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1613 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:32.372222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-1ef6f28d-d2ae-45fd-ad0a-7c6fbeac34af req-94ba4589-bf69-42c1-a208-450dfb5a53a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50866ec2-e637-49e6-a467-926c4fc44ab3", "tag": "7921604d-afba-4e2c-8179-da186a45915f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:32.375829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Updating instance_info_cache with network_info: [{"id": "9ada40c6-66d1-4d89-a451-50125c8dfce0", "address": "fa:16:3e:23:39:3c", "network": {"id": "771b531d-e085-4be0-a5db-f8ca98902475", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694233747-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "26ea13948bbf479386c8b9ee5e1aa5cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9ada40c6-66", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:16:32.384886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1ef6f28d-d2ae-45fd-ad0a-7c6fbeac34af req-94ba4589-bf69-42c1-a208-450dfb5a53a9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:32.385495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1ef6f28d-d2ae-45fd-ad0a-7c6fbeac34af req-94ba4589-bf69-42c1-a208-450dfb5a53a9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:32.386105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1ef6f28d-d2ae-45fd-ad0a-7c6fbeac34af req-94ba4589-bf69-42c1-a208-450dfb5a53a9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:32.389855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=1,nova_cell1:RELEASE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:32.403849 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-1ef6f28d-d2ae-45fd-ad0a-7c6fbeac34af req-94ba4589-bf69-42c1-a208-450dfb5a53a9 service nova] Creating event network-changed:7921604d-afba-4e2c-8179-da186a45915f for instance 50866ec2-e637-49e6-a467-926c4fc44ab3 on n-h1-860892-1 Oct 11 04:16:32.409603 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-1ef6f28d-d2ae-45fd-ad0a-7c6fbeac34af req-94ba4589-bf69-42c1-a208-450dfb5a53a9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042556 Oct 11 04:16:32.410585 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 778/1622] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:32.416029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:32.417186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] [instance: e574c295-e9b3-4047-acbb-78f086432245] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:32.425405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:32.425895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:32.426396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:32.427119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:32.427566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:32.427984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:32.450395 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] HTTP exception thrown: Instance e574c295-e9b3-4047-acbb-78f086432245 could not be found. Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Request method failure captured: Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 HTTP/1.1 Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO31xRbp3kpkWH4_ljLQOOMS2sWTm8wy0xJ8cxytnfGN6J3JRPVzDRw5jBaFn4PPc0Td-6VDK2qsSUAQNzBne6UkUMflS2ApM_CBWSmCUiyW6xD1TwaDee4UxxdwZjGzqM2gNihMb4uo98U91rUiFhwHOskK6XtpD0ceTGAEkyC7__U Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f93ac52a8285437d9875b02ff758eaae Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerDiagnosticsNegativeTest-1515621319 Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f93ac52a8285437d9875b02ff758eaae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f93ac52a8285437d9875b02ff758eaae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f93ac52a8285437d9875b02ff758eaae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f93ac52a8285437d9875b02ff758eaae"}]}] Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerDiagnosticsNegativeTest-1515621319 Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f93ac52a8285437d9875b02ff758eaae Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerDiagnosticsNegativeTest-1515621319 Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerDiagnosticsNegativeTest-1515621319-project Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: f1e6e057d5e849899bda86587049e1ce Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerDiagnosticsNegativeTest-1515621319-project Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance e574c295-e9b3-4047-acbb-78f086432245 could not be found. Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e574c295-e9b3-4047-acbb-78f086432245'} Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e574c295-e9b3-4047-acbb-78f086432245 could not be found. Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e574c295-e9b3-4047-acbb-78f086432245 could not be found. Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:32.452251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:32.458114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:32.458114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:32.458114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:32.458114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:32.458114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:16:32.458114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:16:32.458114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e574c295-e9b3-4047-acbb-78f086432245 could not be found. Oct 11 04:16:32.458114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:32.458114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] Returning 404 to user: Instance e574c295-e9b3-4047-acbb-78f086432245 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:16:32.458114 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c76f7c9-6984-44b7-9303-bf5594ff71a0 tempest-ServerDiagnosticsNegativeTest-1515621319 tempest-ServerDiagnosticsNegativeTest-1515621319-project] 10.222.0.26 "GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245" status: 404 len: 111 microversion: 2.1 time: 0.041994 Oct 11 04:16:32.458114 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 779/1623] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:32 2022] GET /compute/v2.1/servers/e574c295-e9b3-4047-acbb-78f086432245 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:16:32.462344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-37234385-0fbb-4dbe-9ebf-d8c4b37c8b42 req-c5a9502c-42fd-428d-b3bf-8665ea82bbcd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72660709-ce51-4053-af08-b1cd828c95d4", "name": "network-vif-plugged", "status": "completed", "tag": "66639d0c-5518-4300-98e7-ab09ecbda154"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:32.468495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Building network info cache for instance {{(pid=120994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 04:16:32.473770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-37234385-0fbb-4dbe-9ebf-d8c4b37c8b42 req-c5a9502c-42fd-428d-b3bf-8665ea82bbcd service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:32.474338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-37234385-0fbb-4dbe-9ebf-d8c4b37c8b42 req-c5a9502c-42fd-428d-b3bf-8665ea82bbcd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:32.474874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-37234385-0fbb-4dbe-9ebf-d8c4b37c8b42 req-c5a9502c-42fd-428d-b3bf-8665ea82bbcd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:32.489241 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-37234385-0fbb-4dbe-9ebf-d8c4b37c8b42 req-c5a9502c-42fd-428d-b3bf-8665ea82bbcd service nova] Creating event network-vif-plugged:66639d0c-5518-4300-98e7-ab09ecbda154 for instance 72660709-ce51-4053-af08-b1cd828c95d4 on n-h2-860892-1 Oct 11 04:16:32.500738 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-37234385-0fbb-4dbe-9ebf-d8c4b37c8b42 req-c5a9502c-42fd-428d-b3bf-8665ea82bbcd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042164 Oct 11 04:16:32.501359 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 780/1624] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:32.516133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:32.516862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:32.532168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:32.536184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:32.536184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:32.536184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:32.536184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:32.536184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:32.734360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:32.743930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:32.745425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:32.746625 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f9f2e418-6417-4f82-861b-5ec57204dd9d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.243768 Oct 11 04:16:32.747792 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 781/1625] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:32 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:32.848618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-081ac3dd-cb51-423e-9240-5c4197e5c4b0 req-9747e7ad-6242-41af-a895-946d7ea97d14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e3c3e6-a98f-4e56-a548-439d14a51e92", "tag": "9ada40c6-66d1-4d89-a451-50125c8dfce0"}, {"name": "network-changed", "server_uuid": "927821c1-5dca-4ee7-8072-d2ab4d97368b", "tag": "c5691c2d-c5a4-490b-b7b5-6f6dbad53a41"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:32.862112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-081ac3dd-cb51-423e-9240-5c4197e5c4b0 req-9747e7ad-6242-41af-a895-946d7ea97d14 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:32.863360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-081ac3dd-cb51-423e-9240-5c4197e5c4b0 req-9747e7ad-6242-41af-a895-946d7ea97d14 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:32.863360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-081ac3dd-cb51-423e-9240-5c4197e5c4b0 req-9747e7ad-6242-41af-a895-946d7ea97d14 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:32.878831 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-081ac3dd-cb51-423e-9240-5c4197e5c4b0 req-9747e7ad-6242-41af-a895-946d7ea97d14 service nova] Creating event network-changed:9ada40c6-66d1-4d89-a451-50125c8dfce0 for instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 on n-h1-860892-1 Oct 11 04:16:32.879956 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-081ac3dd-cb51-423e-9240-5c4197e5c4b0 req-9747e7ad-6242-41af-a895-946d7ea97d14 service nova] Creating event network-changed:c5691c2d-c5a4-490b-b7b5-6f6dbad53a41 for instance 927821c1-5dca-4ee7-8072-d2ab4d97368b on n-h1-860892-1 Oct 11 04:16:32.887111 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-081ac3dd-cb51-423e-9240-5c4197e5c4b0 req-9747e7ad-6242-41af-a895-946d7ea97d14 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.137908 Oct 11 04:16:32.888060 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 782/1626] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:32 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:32.898539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c70bf5f9-4d07-4409-bb99-14395c9fb1ed tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:32.899286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c70bf5f9-4d07-4409-bb99-14395c9fb1ed tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:32.906521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70bf5f9-4d07-4409-bb99-14395c9fb1ed tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:32.907369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70bf5f9-4d07-4409-bb99-14395c9fb1ed tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:32.908032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70bf5f9-4d07-4409-bb99-14395c9fb1ed tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:32.908976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70bf5f9-4d07-4409-bb99-14395c9fb1ed tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:32.909617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70bf5f9-4d07-4409-bb99-14395c9fb1ed tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:32.910350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70bf5f9-4d07-4409-bb99-14395c9fb1ed tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:32.940431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c70bf5f9-4d07-4409-bb99-14395c9fb1ed tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:16:33.135795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Updating instance_info_cache with network_info: [{"id": "c5691c2d-c5a4-490b-b7b5-6f6dbad53a41", "address": "fa:16:3e:8b:0d:11", "network": {"id": "771b531d-e085-4be0-a5db-f8ca98902475", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694233747-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "26ea13948bbf479386c8b9ee5e1aa5cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5691c2d-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:16:33.223254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Releasing lock "refresh_cache-927821c1-5dca-4ee7-8072-d2ab4d97368b" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:16:33.224126 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a52676f5-9d0e-48cf-8bbe-8bd201ab2497 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "POST /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b/action" status: 202 len: 0 microversion: 2.1 time: 4.808734 Oct 11 04:16:33.224903 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 845/1627] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:16:28 2022] POST /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b/action => generated 0 bytes in 4810 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 04:16:33.230296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f9f5cd6-fe42-4dc7-a658-4c2348fc7246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:33.232264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f9f5cd6-fe42-4dc7-a658-4c2348fc7246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:33.239199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f9f5cd6-fe42-4dc7-a658-4c2348fc7246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:33.240151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f9f5cd6-fe42-4dc7-a658-4c2348fc7246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:33.240772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f9f5cd6-fe42-4dc7-a658-4c2348fc7246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:33.241514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f9f5cd6-fe42-4dc7-a658-4c2348fc7246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:33.242004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f9f5cd6-fe42-4dc7-a658-4c2348fc7246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:33.242775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f9f5cd6-fe42-4dc7-a658-4c2348fc7246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:33.255687 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c70bf5f9-4d07-4409-bb99-14395c9fb1ed tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 204 len: 0 microversion: 2.1 time: 0.362885 Oct 11 04:16:33.259784 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 783/1628] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:16:32 2022] DELETE /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:16:33.262771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-982ee0f6-35ff-456a-9379-c2cdbf60a42d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:33.263556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-982ee0f6-35ff-456a-9379-c2cdbf60a42d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:33.278055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-982ee0f6-35ff-456a-9379-c2cdbf60a42d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:33.278972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-982ee0f6-35ff-456a-9379-c2cdbf60a42d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:33.280047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-982ee0f6-35ff-456a-9379-c2cdbf60a42d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:33.282772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-982ee0f6-35ff-456a-9379-c2cdbf60a42d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:33.283235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-982ee0f6-35ff-456a-9379-c2cdbf60a42d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:33.286873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-982ee0f6-35ff-456a-9379-c2cdbf60a42d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:33.416693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f9f5cd6-fe42-4dc7-a658-4c2348fc7246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:33.425939 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f9f5cd6-fe42-4dc7-a658-4c2348fc7246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.199898 Oct 11 04:16:33.426463 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 846/1629] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:33 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:33.441630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.49"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:33.497378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-982ee0f6-35ff-456a-9379-c2cdbf60a42d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:33.524474 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-982ee0f6-35ff-456a-9379-c2cdbf60a42d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.266536 Oct 11 04:16:33.525365 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 784/1630] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:33 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:33.534388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fa276bc4-2156-4046-9e71-f4c197cc272f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:33.535005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fa276bc4-2156-4046-9e71-f4c197cc272f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:33.550108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa276bc4-2156-4046-9e71-f4c197cc272f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:33.550630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa276bc4-2156-4046-9e71-f4c197cc272f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:33.551064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa276bc4-2156-4046-9e71-f4c197cc272f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:33.551965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa276bc4-2156-4046-9e71-f4c197cc272f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:33.552466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa276bc4-2156-4046-9e71-f4c197cc272f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:33.552890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa276bc4-2156-4046-9e71-f4c197cc272f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:33.595463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:33.602763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:33.603514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:33.603963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:33.604661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:33.605106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:33.605522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:33.706813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa276bc4-2156-4046-9e71-f4c197cc272f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:33.712666 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fa276bc4-2156-4046-9e71-f4c197cc272f tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1468 microversion: 2.1 time: 0.186478 Oct 11 04:16:33.713334 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 785/1631] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:33 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1468 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:33.773154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:33.773890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:33.780166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:33.780652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:33.781127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:33.781824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:33.782333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:33.782780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:33.841587 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] HTTP exception thrown: Floating IP 172.25.6.49 is not associated with instance 15e3c3e6-a98f-4e56-a548-439d14a51e92. Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Request method failure captured: Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92/action HTTP/1.1 Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 48 Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO3eKPeAlPeermk_00UJNdtrMz_eqsC4Otf73nv-kJTdm9jlMNQEAhzTVerAMi-hvaFptUfoGK4TtLjOFdjyroIPYRMlzS_FCDfN3xSPUe15oVx0cIfYw5elFIb6puOQvJ3x1N369Wfdw-0ljsaa1fzRzAZySBt-M7EOC7FVdVem7_k Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 26ea13948bbf479386c8b9ee5e1aa5cf Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1854621729 Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/26ea13948bbf479386c8b9ee5e1aa5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_26ea13948bbf479386c8b9ee5e1aa5cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26ea13948bbf479386c8b9ee5e1aa5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26ea13948bbf479386c8b9ee5e1aa5cf"}]}] Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1854621729 Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 26ea13948bbf479386c8b9ee5e1aa5cf Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1854621729 Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FloatingIPsAssociationTestJSON-1854621729-project Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: ab384b5b9a1b484bb001a06b0998f680 Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1854621729-project Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: {"removeFloatingIp": {"address": "172.25.6.49"}} Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: exception: Floating IP 172.25.6.49 is not associated with instance 15e3c3e6-a98f-4e56-a548-439d14a51e92. Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '15e3c3e6-a98f-4e56-a548-439d14a51e92', 'body': {'removeFloatingIp': {'address': '172.25.6.49'}}} Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 300, in _remove_floating_ip Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Floating IP 172.25.6.49 is not associated with instance 15e3c3e6-a98f-4e56-a548-439d14a51e92. Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP 172.25.6.49 is not associated with instance 15e3c3e6-a98f-4e56-a548-439d14a51e92. Oct 11 04:16:33.843732 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:33.848415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Returning 409 to user: Floating IP 172.25.6.49 is not associated with instance 15e3c3e6-a98f-4e56-a548-439d14a51e92. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:16:33.848415 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-35733c46-0975-4f03-9649-91cda55432fe tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "POST /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92/action" status: 409 len: 145 microversion: 2.1 time: 0.410373 Oct 11 04:16:33.848646 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 847/1632] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:16:33 2022] POST /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92/action => generated 145 bytes in 418 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:16:33.856937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.49"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:33.948064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:33.959282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:33.961308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:33.962811 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-390158e9-c2e7-4af5-a0e2-a78b62895f1a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.193421 Oct 11 04:16:33.963373 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 786/1633] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:33 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:16:33.996875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:34.003896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:34.010250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:34.010250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:34.010250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:34.010250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:34.010250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:34.214092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "refresh_cache-927821c1-5dca-4ee7-8072-d2ab4d97368b" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:16:34.214724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquired lock "refresh_cache-927821c1-5dca-4ee7-8072-d2ab4d97368b" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:16:34.431616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-75a7dd23-bb57-4b30-85ec-c31d9a8c5fc3 req-b7e75148-8ad5-4d34-9e9c-2f8a08a66cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b31eca0-f0fd-4aee-bbc8-f337cf296ea0", "tag": "643bc099-b3db-4c14-80a2-6176e9969a13"}, {"name": "network-changed", "server_uuid": "1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25", "tag": "05914072-748c-496b-8be4-c8a95fdb871f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:34.449261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-75a7dd23-bb57-4b30-85ec-c31d9a8c5fc3 req-b7e75148-8ad5-4d34-9e9c-2f8a08a66cfe service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:34.450056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-75a7dd23-bb57-4b30-85ec-c31d9a8c5fc3 req-b7e75148-8ad5-4d34-9e9c-2f8a08a66cfe service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:34.450845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-75a7dd23-bb57-4b30-85ec-c31d9a8c5fc3 req-b7e75148-8ad5-4d34-9e9c-2f8a08a66cfe service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:34.491486 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-75a7dd23-bb57-4b30-85ec-c31d9a8c5fc3 req-b7e75148-8ad5-4d34-9e9c-2f8a08a66cfe service nova] Creating event network-changed:643bc099-b3db-4c14-80a2-6176e9969a13 for instance 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 on n-h1-860892-1 Oct 11 04:16:34.492894 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-75a7dd23-bb57-4b30-85ec-c31d9a8c5fc3 req-b7e75148-8ad5-4d34-9e9c-2f8a08a66cfe service nova] Creating event network-changed:05914072-748c-496b-8be4-c8a95fdb871f for instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 on n-h1-860892-1 Oct 11 04:16:34.503186 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-75a7dd23-bb57-4b30-85ec-c31d9a8c5fc3 req-b7e75148-8ad5-4d34-9e9c-2f8a08a66cfe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.077652 Oct 11 04:16:34.507584 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 787/1634] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:34 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:16:34.512726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-01aeef91-24d7-4d87-8c0c-40d6d93b2c5c tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:34.516906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-01aeef91-24d7-4d87-8c0c-40d6d93b2c5c tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:34.526344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01aeef91-24d7-4d87-8c0c-40d6d93b2c5c tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:34.527280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01aeef91-24d7-4d87-8c0c-40d6d93b2c5c tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:34.528560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01aeef91-24d7-4d87-8c0c-40d6d93b2c5c tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:34.529849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01aeef91-24d7-4d87-8c0c-40d6d93b2c5c tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:34.530487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01aeef91-24d7-4d87-8c0c-40d6d93b2c5c tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:34.531239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01aeef91-24d7-4d87-8c0c-40d6d93b2c5c tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:35.314261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-01aeef91-24d7-4d87-8c0c-40d6d93b2c5c tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:35.323220 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-01aeef91-24d7-4d87-8c0c-40d6d93b2c5c tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.817118 Oct 11 04:16:35.338431 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 788/1635] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:34 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:35.344823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f9a50b7-ca48-4596-ae9d-6de9cdddf8fb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:35.345606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3f9a50b7-ca48-4596-ae9d-6de9cdddf8fb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:35.351933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f9a50b7-ca48-4596-ae9d-6de9cdddf8fb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:35.352681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f9a50b7-ca48-4596-ae9d-6de9cdddf8fb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:35.353295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f9a50b7-ca48-4596-ae9d-6de9cdddf8fb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:35.354151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f9a50b7-ca48-4596-ae9d-6de9cdddf8fb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:35.354800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f9a50b7-ca48-4596-ae9d-6de9cdddf8fb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:35.355369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f9a50b7-ca48-4596-ae9d-6de9cdddf8fb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:35.811401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3f9a50b7-ca48-4596-ae9d-6de9cdddf8fb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:35.818706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Building network info cache for instance {{(pid=120994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 04:16:35.834754 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3f9a50b7-ca48-4596-ae9d-6de9cdddf8fb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.493364 Oct 11 04:16:35.837171 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 789/1636] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:35 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:35.843630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5321283a-94cf-4592-9915-a76d353b6a65 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:35.844526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5321283a-94cf-4592-9915-a76d353b6a65 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:35.856666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5321283a-94cf-4592-9915-a76d353b6a65 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:35.857169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5321283a-94cf-4592-9915-a76d353b6a65 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:35.859883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5321283a-94cf-4592-9915-a76d353b6a65 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:35.860655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5321283a-94cf-4592-9915-a76d353b6a65 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:35.861117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5321283a-94cf-4592-9915-a76d353b6a65 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:35.865387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5321283a-94cf-4592-9915-a76d353b6a65 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:36.162275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5321283a-94cf-4592-9915-a76d353b6a65 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:36.173150 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5321283a-94cf-4592-9915-a76d353b6a65 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1468 microversion: 2.1 time: 0.333955 Oct 11 04:16:36.173766 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 790/1637] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:35 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1468 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:36.194933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:36.196109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:36.217637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:36.220452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:36.220929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:36.221724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:36.222434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:36.223052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:36.446937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:36.458483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:36.460188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:36.462779 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8662de27-b626-4541-9538-93b339cb6c9c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.275872 Oct 11 04:16:36.464268 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 791/1638] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:36 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:36.470527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-3e63436e-956a-4324-b99a-3479a1ae34d2 req-9b05f58f-48fe-46b3-b0fd-4678fae78ba7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "927821c1-5dca-4ee7-8072-d2ab4d97368b", "tag": "c5691c2d-c5a4-490b-b7b5-6f6dbad53a41"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:36.484502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3e63436e-956a-4324-b99a-3479a1ae34d2 req-9b05f58f-48fe-46b3-b0fd-4678fae78ba7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:36.485272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3e63436e-956a-4324-b99a-3479a1ae34d2 req-9b05f58f-48fe-46b3-b0fd-4678fae78ba7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:36.485821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3e63436e-956a-4324-b99a-3479a1ae34d2 req-9b05f58f-48fe-46b3-b0fd-4678fae78ba7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:36.499645 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-3e63436e-956a-4324-b99a-3479a1ae34d2 req-9b05f58f-48fe-46b3-b0fd-4678fae78ba7 service nova] Creating event network-changed:c5691c2d-c5a4-490b-b7b5-6f6dbad53a41 for instance 927821c1-5dca-4ee7-8072-d2ab4d97368b on n-h1-860892-1 Oct 11 04:16:36.505319 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-3e63436e-956a-4324-b99a-3479a1ae34d2 req-9b05f58f-48fe-46b3-b0fd-4678fae78ba7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039566 Oct 11 04:16:36.506390 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 792/1639] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:36.512033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8bbd030-f668-4acd-aae0-2d8ecc86aa4e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:36.512803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d8bbd030-f668-4acd-aae0-2d8ecc86aa4e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:36.519801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8bbd030-f668-4acd-aae0-2d8ecc86aa4e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:36.520377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8bbd030-f668-4acd-aae0-2d8ecc86aa4e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:36.520881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8bbd030-f668-4acd-aae0-2d8ecc86aa4e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:36.521861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8bbd030-f668-4acd-aae0-2d8ecc86aa4e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:36.523164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8bbd030-f668-4acd-aae0-2d8ecc86aa4e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:36.523658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8bbd030-f668-4acd-aae0-2d8ecc86aa4e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:36.695154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Updating instance_info_cache with network_info: [{"id": "c5691c2d-c5a4-490b-b7b5-6f6dbad53a41", "address": "fa:16:3e:8b:0d:11", "network": {"id": "771b531d-e085-4be0-a5db-f8ca98902475", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694233747-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "26ea13948bbf479386c8b9ee5e1aa5cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tapc5691c2d-c5", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:16:36.716845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d8bbd030-f668-4acd-aae0-2d8ecc86aa4e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:36.725407 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8bbd030-f668-4acd-aae0-2d8ecc86aa4e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.217588 Oct 11 04:16:36.726360 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 793/1640] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:36 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:36.766162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Releasing lock "refresh_cache-927821c1-5dca-4ee7-8072-d2ab4d97368b" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:16:36.767191 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-362cd9e6-4f15-4079-ad20-fe5e5cae3c2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "POST /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b/action" status: 202 len: 0 microversion: 2.1 time: 2.914252 Oct 11 04:16:36.771031 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 848/1641] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:16:33 2022] POST /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b/action => generated 0 bytes in 2916 msecs (HTTP/1.1 202) 9 headers in 369 bytes (2 switches on core 0) Oct 11 04:16:36.778010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c58fae59-8aee-4d4d-a442-662f4f24919b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:36.778667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c58fae59-8aee-4d4d-a442-662f4f24919b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:36.786981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58fae59-8aee-4d4d-a442-662f4f24919b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:36.787963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58fae59-8aee-4d4d-a442-662f4f24919b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:36.788402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58fae59-8aee-4d4d-a442-662f4f24919b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:36.789272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58fae59-8aee-4d4d-a442-662f4f24919b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:36.789728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58fae59-8aee-4d4d-a442-662f4f24919b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:36.790153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58fae59-8aee-4d4d-a442-662f4f24919b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:36.829650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c58fae59-8aee-4d4d-a442-662f4f24919b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:16:36.862401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-377bc6a3-ebd9-4344-aa77-413d69342b2a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:36.865184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-377bc6a3-ebd9-4344-aa77-413d69342b2a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:36.874825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-377bc6a3-ebd9-4344-aa77-413d69342b2a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:36.875853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-377bc6a3-ebd9-4344-aa77-413d69342b2a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:36.876934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-377bc6a3-ebd9-4344-aa77-413d69342b2a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:36.877996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-377bc6a3-ebd9-4344-aa77-413d69342b2a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:36.880205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-377bc6a3-ebd9-4344-aa77-413d69342b2a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:36.880880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-377bc6a3-ebd9-4344-aa77-413d69342b2a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:37.088877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-377bc6a3-ebd9-4344-aa77-413d69342b2a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:37.100232 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-377bc6a3-ebd9-4344-aa77-413d69342b2a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.242811 Oct 11 04:16:37.101061 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 849/1642] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:36 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:37.146169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-efbacc7b-318d-4ecc-8f75-8aa82b0dd3a0 req-42f4fe28-4895-4eff-b5f8-fcd270c59e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50866ec2-e637-49e6-a467-926c4fc44ab3", "name": "network-vif-plugged", "status": "completed", "tag": "7921604d-afba-4e2c-8179-da186a45915f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:37.156253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-efbacc7b-318d-4ecc-8f75-8aa82b0dd3a0 req-42f4fe28-4895-4eff-b5f8-fcd270c59e9e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:37.156661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-efbacc7b-318d-4ecc-8f75-8aa82b0dd3a0 req-42f4fe28-4895-4eff-b5f8-fcd270c59e9e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:37.157153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-efbacc7b-318d-4ecc-8f75-8aa82b0dd3a0 req-42f4fe28-4895-4eff-b5f8-fcd270c59e9e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:37.168291 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-efbacc7b-318d-4ecc-8f75-8aa82b0dd3a0 req-42f4fe28-4895-4eff-b5f8-fcd270c59e9e service nova] Creating event network-vif-plugged:7921604d-afba-4e2c-8179-da186a45915f for instance 50866ec2-e637-49e6-a467-926c4fc44ab3 on n-h1-860892-1 Oct 11 04:16:37.174041 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-efbacc7b-318d-4ecc-8f75-8aa82b0dd3a0 req-42f4fe28-4895-4eff-b5f8-fcd270c59e9e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031579 Oct 11 04:16:37.174841 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 850/1643] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:16:37.196759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:37.197460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:37.201837 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c58fae59-8aee-4d4d-a442-662f4f24919b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "DELETE /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 204 len: 0 microversion: 2.1 time: 0.428039 Oct 11 04:16:37.204153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:37.204642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:37.209996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:37.209996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:37.209996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:37.209996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:37.214933 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 794/1644] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:16:36 2022] DELETE /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:16:37.214933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Action: 'action', calling method: , body: {"addFloatingIp": {"address": "172.25.6.49"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:37.217547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:37.224251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:37.225066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:37.225215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:37.225974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:37.226470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:37.226809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:37.239374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:37.239856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:37.240490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:37.240942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lazy-loading 'fault' on Instance uuid 72660709-ce51-4053-af08-b1cd828c95d4 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:16:37.243640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:37.256321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "refresh_cache-15e3c3e6-a98f-4e56-a548-439d14a51e92" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:16:37.256723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquired lock "refresh_cache-15e3c3e6-a98f-4e56-a548-439d14a51e92" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:16:37.317373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:37.335177 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2fab39c-b325-4fba-a32a-fe2c3744601c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 200 len: 1303 microversion: 2.1 time: 0.140670 Oct 11 04:16:37.335177 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 851/1645] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:37 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 1303 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:37.488821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:37.489484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:37.495627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:37.496112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:37.496540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:37.497231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:37.497683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:37.498131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:37.696972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:37.716345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:37.716345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:37.716345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3cb4a6a-3603-4273-add0-d03c8774a681 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.225335 Oct 11 04:16:37.716345 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 852/1646] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:37 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:16:37.749502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b82928c1-ee91-4249-950f-6ebdc8c62d4b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:37.750566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b82928c1-ee91-4249-950f-6ebdc8c62d4b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:37.759306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b82928c1-ee91-4249-950f-6ebdc8c62d4b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:37.760221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b82928c1-ee91-4249-950f-6ebdc8c62d4b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:37.760837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b82928c1-ee91-4249-950f-6ebdc8c62d4b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:37.761844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b82928c1-ee91-4249-950f-6ebdc8c62d4b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:37.762651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b82928c1-ee91-4249-950f-6ebdc8c62d4b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:37.763247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b82928c1-ee91-4249-950f-6ebdc8c62d4b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:37.936801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b82928c1-ee91-4249-950f-6ebdc8c62d4b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:37.945480 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b82928c1-ee91-4249-950f-6ebdc8c62d4b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.200075 Oct 11 04:16:37.946536 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 853/1647] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:37 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:38.065145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-16680409", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:38.117068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:16:38.309844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:16:38.310289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:16:38.311325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:16:38.311728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:16:38.312140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:16:38.320768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:38.321247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:38.321674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:38.322428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:38.322874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:38.323297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:38.339677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Getting quotas for project 702da37a766e4613bceb0f78bc71df56. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:38.345251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Getting quotas for user cfa9dc90efcf4ba9a1edcc5c19a8f3c6 and project 702da37a766e4613bceb0f78bc71df56. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:38.357998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:16:38.360379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:16:38.581977 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fa789d4d-7feb-488d-b103-41c6ebdb4555 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.632732 Oct 11 04:16:38.583301 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 854/1648] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:16:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:16:38.588258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2275d57a-32a6-4ea8-9e59-fb09e6fe19d4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:38.589199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2275d57a-32a6-4ea8-9e59-fb09e6fe19d4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:38.597231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2275d57a-32a6-4ea8-9e59-fb09e6fe19d4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:38.597930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2275d57a-32a6-4ea8-9e59-fb09e6fe19d4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:38.602730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2275d57a-32a6-4ea8-9e59-fb09e6fe19d4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:38.602730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2275d57a-32a6-4ea8-9e59-fb09e6fe19d4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:38.602730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2275d57a-32a6-4ea8-9e59-fb09e6fe19d4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:38.602730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2275d57a-32a6-4ea8-9e59-fb09e6fe19d4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:38.750592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2275d57a-32a6-4ea8-9e59-fb09e6fe19d4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:38.759419 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2275d57a-32a6-4ea8-9e59-fb09e6fe19d4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.174808 Oct 11 04:16:38.760506 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 855/1649] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:38 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:38.766641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:38.768255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 72660709-ce51-4053-af08-b1cd828c95d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:38.779343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:38.779343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:38.779343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:38.779343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:38.779343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:38.779720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:38.796335 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] HTTP exception thrown: Instance 72660709-ce51-4053-af08-b1cd828c95d4 could not be found. Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Request method failure captured: Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 HTTP/1.1 Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzVXK0zaVQbhEX1-cTggS_6AF670oSjUyaWqNRNZ0AKjB4jOp4UmqRnZrRxpvEJCRG8ESeEkSohR0vbNNez8eTdxgu5C3lz83-lIlmo46HncDthZwdU_l69djUs4QZxOD6JVN8v9luoPVncLFGWaloRCOIWL6Xi7vGVgFgMxw1FQ6o Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: bcce9ce30d3a4a15985192c8e12c040c Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcce9ce30d3a4a15985192c8e12c040c"}]}] Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: bcce9ce30d3a4a15985192c8e12c040c Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-MigrationsAdminTest-2070201961-project Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a1df373e8ec14e2a84f0b8a62e0b884a Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-MigrationsAdminTest-2070201961-project Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 72660709-ce51-4053-af08-b1cd828c95d4 could not be found. Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '72660709-ce51-4053-af08-b1cd828c95d4'} Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 72660709-ce51-4053-af08-b1cd828c95d4 could not be found. Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 72660709-ce51-4053-af08-b1cd828c95d4 could not be found. Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:38.798564 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:38.808766 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:38.808766 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:38.808766 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:38.808766 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:16:38.808766 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:16:38.808766 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 72660709-ce51-4053-af08-b1cd828c95d4 could not be found. Oct 11 04:16:38.808766 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:38.808766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Returning 404 to user: Instance 72660709-ce51-4053-af08-b1cd828c95d4 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:16:38.808766 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-38ad35d0-de43-4ec1-b0bd-1b5f10092e9b tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4" status: 404 len: 111 microversion: 2.1 time: 0.038392 Oct 11 04:16:38.808766 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 856/1650] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:38 2022] GET /compute/v2.1/servers/72660709-ce51-4053-af08-b1cd828c95d4 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:16:38.812041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-24af8ece-fc69-4f47-8fac-319ee4acdf25 req-887b77c4-0b23-49b8-9e0d-828803fa87fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "72660709-ce51-4053-af08-b1cd828c95d4", "name": "network-vif-deleted", "tag": "66639d0c-5518-4300-98e7-ab09ecbda154"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:38.822819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-24af8ece-fc69-4f47-8fac-319ee4acdf25 req-887b77c4-0b23-49b8-9e0d-828803fa87fd service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:38.823406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-24af8ece-fc69-4f47-8fac-319ee4acdf25 req-887b77c4-0b23-49b8-9e0d-828803fa87fd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:38.826734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-24af8ece-fc69-4f47-8fac-319ee4acdf25 req-887b77c4-0b23-49b8-9e0d-828803fa87fd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:38.838283 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-24af8ece-fc69-4f47-8fac-319ee4acdf25 req-887b77c4-0b23-49b8-9e0d-828803fa87fd service nova] Creating event network-vif-deleted:66639d0c-5518-4300-98e7-ab09ecbda154 for instance 72660709-ce51-4053-af08-b1cd828c95d4 on n-h2-860892-1 Oct 11 04:16:38.845341 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-24af8ece-fc69-4f47-8fac-319ee4acdf25 req-887b77c4-0b23-49b8-9e0d-828803fa87fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042448 Oct 11 04:16:38.846363 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 857/1651] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:38.853264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7b849ee0-2aa6-4c0d-98a8-a15e1eb18724 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:38.855322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7b849ee0-2aa6-4c0d-98a8-a15e1eb18724 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:38.909177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7b849ee0-2aa6-4c0d-98a8-a15e1eb18724 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:38.916225 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7b849ee0-2aa6-4c0d-98a8-a15e1eb18724 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1220 microversion: 2.1 time: 0.068394 Oct 11 04:16:38.916794 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 858/1652] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:38 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1220 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:38.921946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:38.922517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:38.928489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:38.928966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:38.929390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:38.930124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:38.930599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:38.931017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:39.071107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:39.081173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:39.082842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:39.084041 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a196d81d-d238-48cf-b8d6-f55b21e46cbd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.166330 Oct 11 04:16:39.084609 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 859/1653] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:38 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:39.098373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce8e71f7-93c9-4c8c-af2d-0e405d1505d5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:39.098373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce8e71f7-93c9-4c8c-af2d-0e405d1505d5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:39.098373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:39.098373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8e71f7-93c9-4c8c-af2d-0e405d1505d5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:39.098373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8e71f7-93c9-4c8c-af2d-0e405d1505d5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:39.098373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8e71f7-93c9-4c8c-af2d-0e405d1505d5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:39.098373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8e71f7-93c9-4c8c-af2d-0e405d1505d5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:39.098373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8e71f7-93c9-4c8c-af2d-0e405d1505d5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:39.099099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8e71f7-93c9-4c8c-af2d-0e405d1505d5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:39.125221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce8e71f7-93c9-4c8c-af2d-0e405d1505d5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:16:39.470119 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce8e71f7-93c9-4c8c-af2d-0e405d1505d5 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 204 len: 0 microversion: 2.1 time: 0.384186 Oct 11 04:16:39.470751 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 860/1654] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:16:39 2022] DELETE /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:16:39.475889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-742f4428-d071-4377-8d0d-ace112515cc0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:39.476533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-742f4428-d071-4377-8d0d-ace112515cc0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:39.491023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-742f4428-d071-4377-8d0d-ace112515cc0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:39.491596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-742f4428-d071-4377-8d0d-ace112515cc0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:39.492094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-742f4428-d071-4377-8d0d-ace112515cc0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:39.493085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-742f4428-d071-4377-8d0d-ace112515cc0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:39.493379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-742f4428-d071-4377-8d0d-ace112515cc0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:39.493870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-742f4428-d071-4377-8d0d-ace112515cc0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:39.511597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=89,nova_cell1:SAVEPOINT=3,nova_cell1:UPDATE=4,nova_cell1:RELEASE=3,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:39.639111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-742f4428-d071-4377-8d0d-ace112515cc0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:39.648987 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-742f4428-d071-4377-8d0d-ace112515cc0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.176937 Oct 11 04:16:39.649977 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 861/1655] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:39 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:39.654458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-70931cb9-db16-4694-a287-e8a65b1fe740 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:39.655206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-70931cb9-db16-4694-a287-e8a65b1fe740 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:39.662621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70931cb9-db16-4694-a287-e8a65b1fe740 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:39.663635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70931cb9-db16-4694-a287-e8a65b1fe740 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:39.664259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70931cb9-db16-4694-a287-e8a65b1fe740 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:39.665247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70931cb9-db16-4694-a287-e8a65b1fe740 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:39.665910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70931cb9-db16-4694-a287-e8a65b1fe740 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:39.666539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70931cb9-db16-4694-a287-e8a65b1fe740 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:39.804774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Building network info cache for instance {{(pid=120993) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 04:16:39.817515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-70931cb9-db16-4694-a287-e8a65b1fe740 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:39.825970 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-70931cb9-db16-4694-a287-e8a65b1fe740 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1534 microversion: 2.1 time: 0.174999 Oct 11 04:16:39.830379 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 862/1656] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:39 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1534 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:39.831716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-91797379-0274-45ce-8072-1e0dccb9c45f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:39.832524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-91797379-0274-45ce-8072-1e0dccb9c45f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:39.840688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91797379-0274-45ce-8072-1e0dccb9c45f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:39.841892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91797379-0274-45ce-8072-1e0dccb9c45f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:39.842536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91797379-0274-45ce-8072-1e0dccb9c45f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:39.843387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91797379-0274-45ce-8072-1e0dccb9c45f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:39.844008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91797379-0274-45ce-8072-1e0dccb9c45f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:39.844438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91797379-0274-45ce-8072-1e0dccb9c45f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:39.990225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-91797379-0274-45ce-8072-1e0dccb9c45f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:39.996547 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-91797379-0274-45ce-8072-1e0dccb9c45f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.168877 Oct 11 04:16:40.003213 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 863/1657] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:39 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:40.009993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-bd911096-474c-4658-8639-ca74055bc88c req-e08dd30d-7430-42e0-81f0-2b8dad6c53aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e3c3e6-a98f-4e56-a548-439d14a51e92", "tag": "9ada40c6-66d1-4d89-a451-50125c8dfce0"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:40.021565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bd911096-474c-4658-8639-ca74055bc88c req-e08dd30d-7430-42e0-81f0-2b8dad6c53aa service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.022041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bd911096-474c-4658-8639-ca74055bc88c req-e08dd30d-7430-42e0-81f0-2b8dad6c53aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.022488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bd911096-474c-4658-8639-ca74055bc88c req-e08dd30d-7430-42e0-81f0-2b8dad6c53aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:40.034161 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-bd911096-474c-4658-8639-ca74055bc88c req-e08dd30d-7430-42e0-81f0-2b8dad6c53aa service nova] Creating event network-changed:9ada40c6-66d1-4d89-a451-50125c8dfce0 for instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 on n-h1-860892-1 Oct 11 04:16:40.039134 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-bd911096-474c-4658-8639-ca74055bc88c req-e08dd30d-7430-42e0-81f0-2b8dad6c53aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033408 Oct 11 04:16:40.040020 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 864/1658] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:40.045901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c3c3f8f-62d2-4d63-aa28-9be14975358a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:40.046620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2c3c3f8f-62d2-4d63-aa28-9be14975358a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:40.053159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c3c3f8f-62d2-4d63-aa28-9be14975358a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.053350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c3c3f8f-62d2-4d63-aa28-9be14975358a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.053634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c3c3f8f-62d2-4d63-aa28-9be14975358a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:40.054378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c3c3f8f-62d2-4d63-aa28-9be14975358a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.054829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c3c3f8f-62d2-4d63-aa28-9be14975358a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.055251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c3c3f8f-62d2-4d63-aa28-9be14975358a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:40.120451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2c3c3f8f-62d2-4d63-aa28-9be14975358a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:40.129470 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c3c3f8f-62d2-4d63-aa28-9be14975358a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1224 microversion: 2.1 time: 0.087882 Oct 11 04:16:40.130281 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 865/1659] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:40 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1224 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:40.137667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:40.138818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:40.144616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.144757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.145108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:40.145921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.146403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.146823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:40.287896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:40.298134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:40.299638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:40.300808 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cbf845ef-e575-4fb7-974f-80679cb3fd3c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.167135 Oct 11 04:16:40.301611 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 866/1660] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:40 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:40.359197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Updating instance_info_cache with network_info: [{"id": "9ada40c6-66d1-4d89-a451-50125c8dfce0", "address": "fa:16:3e:23:39:3c", "network": {"id": "771b531d-e085-4be0-a5db-f8ca98902475", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694233747-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.25.6.49", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "26ea13948bbf479386c8b9ee5e1aa5cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9ada40c6-66", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120993) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:16:40.457178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Releasing lock "refresh_cache-15e3c3e6-a98f-4e56-a548-439d14a51e92" {{(pid=120993) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:16:40.458060 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5c84d791-a1c8-464e-8974-2d1763e9d340 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "POST /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92/action" status: 202 len: 0 microversion: 2.1 time: 3.248250 Oct 11 04:16:40.458768 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 795/1661] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:16:37 2022] POST /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92/action => generated 0 bytes in 3250 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 04:16:40.467341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f22ddda6-90bd-4cf8-bea2-040ccf845dfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '.version_select at 0x7fda19d80550>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:40.676440 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f22ddda6-90bd-4cf8-bea2-040ccf845dfb tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/44d4b7d7-7f44-4fec-9c77-18920f1f9bf1" status: 200 len: 183 microversion: 2.1 time: 0.213371 Oct 11 04:16:40.686260 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 867/1662] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:16:40 2022] GET /compute/v2.1/os-floating-ips/44d4b7d7-7f44-4fec-9c77-18920f1f9bf1 => generated 183 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:40.686612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff3fdb03-e502-4ec3-b2ac-c16c5a19f98f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:40.686612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff3fdb03-e502-4ec3-b2ac-c16c5a19f98f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:40.688519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff3fdb03-e502-4ec3-b2ac-c16c5a19f98f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.689003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff3fdb03-e502-4ec3-b2ac-c16c5a19f98f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.689478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff3fdb03-e502-4ec3-b2ac-c16c5a19f98f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:40.690157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff3fdb03-e502-4ec3-b2ac-c16c5a19f98f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.690730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff3fdb03-e502-4ec3-b2ac-c16c5a19f98f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.691154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff3fdb03-e502-4ec3-b2ac-c16c5a19f98f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:40.696203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Action: 'action', calling method: , body: {"removeFloatingIp": {"address": "172.25.6.49"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:40.874432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff3fdb03-e502-4ec3-b2ac-c16c5a19f98f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:40.892488 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff3fdb03-e502-4ec3-b2ac-c16c5a19f98f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.209088 Oct 11 04:16:40.892604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:40.892702 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 796/1663] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:40 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:40.892702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6d3c8438-d6d4-42e6-8cbd-b0ea1d58c108 req-ba5ec7c2-479e-4e70-b1dc-42c486c7504e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b31eca0-f0fd-4aee-bbc8-f337cf296ea0", "name": "network-vif-plugged", "status": "completed", "tag": "643bc099-b3db-4c14-80a2-6176e9969a13"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:40.893443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.893934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.894404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:40.895101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.895632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.896052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:40.900982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d3c8438-d6d4-42e6-8cbd-b0ea1d58c108 req-ba5ec7c2-479e-4e70-b1dc-42c486c7504e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.901423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d3c8438-d6d4-42e6-8cbd-b0ea1d58c108 req-ba5ec7c2-479e-4e70-b1dc-42c486c7504e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.901849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d3c8438-d6d4-42e6-8cbd-b0ea1d58c108 req-ba5ec7c2-479e-4e70-b1dc-42c486c7504e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:40.913722 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6d3c8438-d6d4-42e6-8cbd-b0ea1d58c108 req-ba5ec7c2-479e-4e70-b1dc-42c486c7504e service nova] Creating event network-vif-plugged:643bc099-b3db-4c14-80a2-6176e9969a13 for instance 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 on n-h1-860892-1 Oct 11 04:16:40.919059 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6d3c8438-d6d4-42e6-8cbd-b0ea1d58c108 req-ba5ec7c2-479e-4e70-b1dc-42c486c7504e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033376 Oct 11 04:16:40.920172 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 797/1664] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:40.926288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-27460bbd-eb6a-4b91-8a12-0559cf630881 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:40.927175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-27460bbd-eb6a-4b91-8a12-0559cf630881 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:40.934261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27460bbd-eb6a-4b91-8a12-0559cf630881 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.935998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27460bbd-eb6a-4b91-8a12-0559cf630881 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.936601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27460bbd-eb6a-4b91-8a12-0559cf630881 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:40.937909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27460bbd-eb6a-4b91-8a12-0559cf630881 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:40.938572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27460bbd-eb6a-4b91-8a12-0559cf630881 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:40.939177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27460bbd-eb6a-4b91-8a12-0559cf630881 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:41.094351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-27460bbd-eb6a-4b91-8a12-0559cf630881 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:41.102560 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-27460bbd-eb6a-4b91-8a12-0559cf630881 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1534 microversion: 2.1 time: 0.181055 Oct 11 04:16:41.118495 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 798/1665] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:40 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1534 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:41.118495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9d8204b-2219-46c7-b1c7-011f9dd99e1d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:41.118495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9d8204b-2219-46c7-b1c7-011f9dd99e1d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:41.118495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d8204b-2219-46c7-b1c7-011f9dd99e1d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:41.118495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d8204b-2219-46c7-b1c7-011f9dd99e1d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:41.118495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d8204b-2219-46c7-b1c7-011f9dd99e1d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:41.118495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d8204b-2219-46c7-b1c7-011f9dd99e1d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:41.118495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d8204b-2219-46c7-b1c7-011f9dd99e1d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:41.119320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d8204b-2219-46c7-b1c7-011f9dd99e1d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:41.277253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b9d8204b-2219-46c7-b1c7-011f9dd99e1d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:41.287226 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b9d8204b-2219-46c7-b1c7-011f9dd99e1d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.182621 Oct 11 04:16:41.287798 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 799/1666] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:41 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:41.294141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e6c3b7b-954b-404a-82de-2d0d3fc3136e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:41.295533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9e6c3b7b-954b-404a-82de-2d0d3fc3136e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:41.301946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e6c3b7b-954b-404a-82de-2d0d3fc3136e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:41.302709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e6c3b7b-954b-404a-82de-2d0d3fc3136e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:41.303225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e6c3b7b-954b-404a-82de-2d0d3fc3136e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:41.303939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e6c3b7b-954b-404a-82de-2d0d3fc3136e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:41.304410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e6c3b7b-954b-404a-82de-2d0d3fc3136e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:41.304815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e6c3b7b-954b-404a-82de-2d0d3fc3136e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:41.382447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9e6c3b7b-954b-404a-82de-2d0d3fc3136e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:41.390698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "refresh_cache-15e3c3e6-a98f-4e56-a548-439d14a51e92" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 11 04:16:41.391182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquired lock "refresh_cache-15e3c3e6-a98f-4e56-a548-439d14a51e92" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 11 04:16:41.398546 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9e6c3b7b-954b-404a-82de-2d0d3fc3136e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1272 microversion: 2.1 time: 0.108704 Oct 11 04:16:41.399034 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 800/1667] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:41 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1272 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:41.404755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:41.405365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:41.411482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:41.411943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:41.412386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:41.413055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:41.413498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:41.413912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:41.568908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:41.578630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:41.580056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:41.581210 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b8b77020-dbf9-47a0-9834-d045876a4d4e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.181267 Oct 11 04:16:41.581770 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 801/1668] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:41 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:41.909175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8d01320d-1801-424f-95b2-ed44aebbba6b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:41.909862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8d01320d-1801-424f-95b2-ed44aebbba6b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:41.916715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d01320d-1801-424f-95b2-ed44aebbba6b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:41.917198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d01320d-1801-424f-95b2-ed44aebbba6b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:41.917625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d01320d-1801-424f-95b2-ed44aebbba6b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:41.918347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d01320d-1801-424f-95b2-ed44aebbba6b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:41.918818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d01320d-1801-424f-95b2-ed44aebbba6b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:41.919242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d01320d-1801-424f-95b2-ed44aebbba6b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:42.159776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8d01320d-1801-424f-95b2-ed44aebbba6b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:42.173361 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8d01320d-1801-424f-95b2-ed44aebbba6b tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.268142 Oct 11 04:16:42.189098 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 802/1669] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:41 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:42.194512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-55dcee33-698b-46f7-9422-12093a8d9cf7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:42.195485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-55dcee33-698b-46f7-9422-12093a8d9cf7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:42.202092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55dcee33-698b-46f7-9422-12093a8d9cf7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:42.202948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55dcee33-698b-46f7-9422-12093a8d9cf7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:42.203633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55dcee33-698b-46f7-9422-12093a8d9cf7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:42.204597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55dcee33-698b-46f7-9422-12093a8d9cf7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:42.205269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55dcee33-698b-46f7-9422-12093a8d9cf7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:42.205875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55dcee33-698b-46f7-9422-12093a8d9cf7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:42.352119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-55dcee33-698b-46f7-9422-12093a8d9cf7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:42.366411 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-55dcee33-698b-46f7-9422-12093a8d9cf7 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1492 microversion: 2.1 time: 0.173094 Oct 11 04:16:42.367189 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 803/1670] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:42 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1492 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:42.398073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8086230e-03fc-4a59-bd11-3bdf2eb7b64a req-1ec1b326-25e8-4e61-a43d-43d54664ef36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c533c21c-f66a-4a0e-b991-01c4a087f391", "name": "network-vif-deleted", "tag": "986bccea-82d2-48c0-8f10-29fc77413e59"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:42.409736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8086230e-03fc-4a59-bd11-3bdf2eb7b64a req-1ec1b326-25e8-4e61-a43d-43d54664ef36 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:42.412309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8086230e-03fc-4a59-bd11-3bdf2eb7b64a req-1ec1b326-25e8-4e61-a43d-43d54664ef36 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:42.417774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8086230e-03fc-4a59-bd11-3bdf2eb7b64a req-1ec1b326-25e8-4e61-a43d-43d54664ef36 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:42.443781 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8086230e-03fc-4a59-bd11-3bdf2eb7b64a req-1ec1b326-25e8-4e61-a43d-43d54664ef36 service nova] Creating event network-vif-deleted:986bccea-82d2-48c0-8f10-29fc77413e59 for instance c533c21c-f66a-4a0e-b991-01c4a087f391 on n-h2-860892-1 Oct 11 04:16:42.450459 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8086230e-03fc-4a59-bd11-3bdf2eb7b64a req-1ec1b326-25e8-4e61-a43d-43d54664ef36 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081648 Oct 11 04:16:42.452775 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 804/1671] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:42.464013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ef93c86-cd97-43f0-9060-45ee286565a2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:42.467143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5ef93c86-cd97-43f0-9060-45ee286565a2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:42.491512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef93c86-cd97-43f0-9060-45ee286565a2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:42.495464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef93c86-cd97-43f0-9060-45ee286565a2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:42.495464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef93c86-cd97-43f0-9060-45ee286565a2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:42.496221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef93c86-cd97-43f0-9060-45ee286565a2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:42.496905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef93c86-cd97-43f0-9060-45ee286565a2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:42.497801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef93c86-cd97-43f0-9060-45ee286565a2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:42.678127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Building network info cache for instance {{(pid=120994) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1987}} Oct 11 04:16:42.727728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5ef93c86-cd97-43f0-9060-45ee286565a2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:42.737180 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ef93c86-cd97-43f0-9060-45ee286565a2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.282970 Oct 11 04:16:42.738019 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 805/1672] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:42 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:42.742814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-55f830cd-9759-4701-920e-338eebd2f627 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:42.743487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-55f830cd-9759-4701-920e-338eebd2f627 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:42.750882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f830cd-9759-4701-920e-338eebd2f627 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:42.751758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f830cd-9759-4701-920e-338eebd2f627 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:42.752191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f830cd-9759-4701-920e-338eebd2f627 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:42.752916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f830cd-9759-4701-920e-338eebd2f627 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:42.759246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f830cd-9759-4701-920e-338eebd2f627 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:42.770775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f830cd-9759-4701-920e-338eebd2f627 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:42.838022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-55f830cd-9759-4701-920e-338eebd2f627 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:42.850682 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-55f830cd-9759-4701-920e-338eebd2f627 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1278 microversion: 2.1 time: 0.111701 Oct 11 04:16:42.856775 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 806/1673] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:42 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1278 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:42.863322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:42.866149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:42.874029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:42.874771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:42.875370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:42.876292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:42.876896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:42.877475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.163879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:43.180566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:43.183257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:43.185959 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e1782a92-c3db-4cd2-92b9-0a6470ced3b0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.328582 Oct 11 04:16:43.187971 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 807/1674] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:42 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:43.199565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f961617-e681-445e-8708-9ceadc4594bf tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:43.200555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5f961617-e681-445e-8708-9ceadc4594bf tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:43.209833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f961617-e681-445e-8708-9ceadc4594bf tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.211265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f961617-e681-445e-8708-9ceadc4594bf tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.212072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f961617-e681-445e-8708-9ceadc4594bf tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.213996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f961617-e681-445e-8708-9ceadc4594bf tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.214640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f961617-e681-445e-8708-9ceadc4594bf tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.215239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f961617-e681-445e-8708-9ceadc4594bf tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.486375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Updating instance_info_cache with network_info: [{"id": "9ada40c6-66d1-4d89-a451-50125c8dfce0", "address": "fa:16:3e:23:39:3c", "network": {"id": "771b531d-e085-4be0-a5db-f8ca98902475", "bridge": null, "label": "tempest-FloatingIPsAssociationTestJSON-694233747-network", "subnets": [{"cidr": "172.20.0.0/28", "dns": [], "gateway": {"address": "172.20.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "172.20.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "172.20.0.2"}}], "meta": {"injected": false, "tenant_id": "26ea13948bbf479386c8b9ee5e1aa5cf", "mtu": 1500, "physical_network": "physnet1", "tunneled": false}}, "type": "hyperv", "details": {"connectivity": "legacy", "port_filter": false, "bound_drivers": {"0": "hyperv"}}, "devname": "tap9ada40c6-66", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=120994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:16:43.522874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Releasing lock "refresh_cache-15e3c3e6-a98f-4e56-a548-439d14a51e92" {{(pid=120994) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 11 04:16:43.524675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5f961617-e681-445e-8708-9ceadc4594bf tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:43.527866 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef6a807d-5470-4f06-8227-c2e5f0c13712 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "POST /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92/action" status: 202 len: 0 microversion: 2.1 time: 2.833008 Oct 11 04:16:43.532717 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 868/1675] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:16:40 2022] POST /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92/action => generated 0 bytes in 2842 msecs (HTTP/1.1 202) 9 headers in 369 bytes (1 switches on core 0) Oct 11 04:16:43.539679 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5f961617-e681-445e-8708-9ceadc4594bf tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.346399 Oct 11 04:16:43.548268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:43.553002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:43.559198 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 808/1676] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:43 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:43.568155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3e17109-0ce7-4076-8ba1-72306f9043c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:43.568919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3e17109-0ce7-4076-8ba1-72306f9043c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:43.576892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3e17109-0ce7-4076-8ba1-72306f9043c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.577387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3e17109-0ce7-4076-8ba1-72306f9043c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.577819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3e17109-0ce7-4076-8ba1-72306f9043c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.578654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.578967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3e17109-0ce7-4076-8ba1-72306f9043c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.579497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.579801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3e17109-0ce7-4076-8ba1-72306f9043c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.580152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.580553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3e17109-0ce7-4076-8ba1-72306f9043c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.581395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.583296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.583848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.625536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3e17109-0ce7-4076-8ba1-72306f9043c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:16:43.630291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.631105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.631786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.632459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lazy-loading 'fault' on Instance uuid c533c21c-f66a-4a0e-b991-01c4a087f391 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:16:43.685765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:43.698705 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-16895251-4fca-4aac-be85-6919bed06ac8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 200 len: 1368 microversion: 2.1 time: 0.164150 Oct 11 04:16:43.707267 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 869/1677] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:43 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:43.757377 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.compute.api [None req-e3e17109-0ce7-4076-8ba1-72306f9043c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Instance is already in deleting state, ignoring this request Oct 11 04:16:43.758841 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3e17109-0ce7-4076-8ba1-72306f9043c6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "DELETE /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 204 len: 0 microversion: 2.1 time: 0.195625 Oct 11 04:16:43.763224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-314fe319-a1e5-4934-adaf-570062718b13 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:43.763623 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 809/1678] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:16:43 2022] DELETE /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 0 bytes in 200 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:16:43.764081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-314fe319-a1e5-4934-adaf-570062718b13 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:43.769270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d0cd4152-1964-4a3b-99f1-65c9225333cd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:43.770175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d0cd4152-1964-4a3b-99f1-65c9225333cd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:43.773684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314fe319-a1e5-4934-adaf-570062718b13 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.775816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314fe319-a1e5-4934-adaf-570062718b13 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.776334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314fe319-a1e5-4934-adaf-570062718b13 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.777426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314fe319-a1e5-4934-adaf-570062718b13 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.778131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314fe319-a1e5-4934-adaf-570062718b13 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.779235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314fe319-a1e5-4934-adaf-570062718b13 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.780218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0cd4152-1964-4a3b-99f1-65c9225333cd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.780887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0cd4152-1964-4a3b-99f1-65c9225333cd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.781502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0cd4152-1964-4a3b-99f1-65c9225333cd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.782519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0cd4152-1964-4a3b-99f1-65c9225333cd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.783331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0cd4152-1964-4a3b-99f1-65c9225333cd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.784406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0cd4152-1964-4a3b-99f1-65c9225333cd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:43.969862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-314fe319-a1e5-4934-adaf-570062718b13 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:43.979588 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-314fe319-a1e5-4934-adaf-570062718b13 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.221762 Oct 11 04:16:43.983515 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 870/1679] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:43 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:43.987266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cb421a03-6beb-4d69-b0bc-b5da2b4b2dff tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:43.988130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cb421a03-6beb-4d69-b0bc-b5da2b4b2dff tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:43.997056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb421a03-6beb-4d69-b0bc-b5da2b4b2dff tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:43.998521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb421a03-6beb-4d69-b0bc-b5da2b4b2dff tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:43.999145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb421a03-6beb-4d69-b0bc-b5da2b4b2dff tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:44.000077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb421a03-6beb-4d69-b0bc-b5da2b4b2dff tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:44.000752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb421a03-6beb-4d69-b0bc-b5da2b4b2dff tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:44.001341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb421a03-6beb-4d69-b0bc-b5da2b4b2dff tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:44.098572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cb421a03-6beb-4d69-b0bc-b5da2b4b2dff tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:44.104430 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cb421a03-6beb-4d69-b0bc-b5da2b4b2dff tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1278 microversion: 2.1 time: 0.122503 Oct 11 04:16:44.105026 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 871/1680] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:43 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:44.119843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d0cd4152-1964-4a3b-99f1-65c9225333cd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:44.128602 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d0cd4152-1964-4a3b-99f1-65c9225333cd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1524 microversion: 2.1 time: 0.363310 Oct 11 04:16:44.129933 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 810/1681] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:43 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1524 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:44.217169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:44.218846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:44.225987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:44.226707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:44.227144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:44.229552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:44.230031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:44.230542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:44.568143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-60b84c77-99f9-404d-8a98-f82963d27c58 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:44.569612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-60b84c77-99f9-404d-8a98-f82963d27c58 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:44.579004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60b84c77-99f9-404d-8a98-f82963d27c58 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:44.580428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60b84c77-99f9-404d-8a98-f82963d27c58 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:44.581440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60b84c77-99f9-404d-8a98-f82963d27c58 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:44.583301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60b84c77-99f9-404d-8a98-f82963d27c58 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:44.584624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60b84c77-99f9-404d-8a98-f82963d27c58 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:44.585420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60b84c77-99f9-404d-8a98-f82963d27c58 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:44.593267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:SAVEPOINT=1,nova_cell1:UPDATE=2,nova_cell1:RELEASE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:44.867959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-60b84c77-99f9-404d-8a98-f82963d27c58 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:44.876193 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-60b84c77-99f9-404d-8a98-f82963d27c58 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.313910 Oct 11 04:16:44.876758 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 811/1682] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:44 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:44.895763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:44.896699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: c533c21c-f66a-4a0e-b991-01c4a087f391] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:44.905457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:44.906173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:44.906782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:44.907641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:44.908563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:44.909401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:44.929158 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] HTTP exception thrown: Instance c533c21c-f66a-4a0e-b991-01c4a087f391 could not be found. Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Request method failure captured: Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 HTTP/1.1 Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjROzVXK0zaVQbhEX1-cTggS_6AF670oSjUyaWqNRNZ0AKjB4jOp4UmqRnZrRxpvEJCRG8ESeEkSohR0vbNNez8eTdxgu5C3lz83-lIlmo46HncDthZwdU_l69djUs4QZxOD6JVN8v9luoPVncLFGWaloRCOIWL6Xi7vGVgFgMxw1FQ6o Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: bcce9ce30d3a4a15985192c8e12c040c Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcce9ce30d3a4a15985192c8e12c040c"}]}] Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: bcce9ce30d3a4a15985192c8e12c040c Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-MigrationsAdminTest-2070201961-project Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a1df373e8ec14e2a84f0b8a62e0b884a Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-MigrationsAdminTest-2070201961-project Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance c533c21c-f66a-4a0e-b991-01c4a087f391 could not be found. Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'c533c21c-f66a-4a0e-b991-01c4a087f391'} Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c533c21c-f66a-4a0e-b991-01c4a087f391 could not be found. Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c533c21c-f66a-4a0e-b991-01c4a087f391 could not be found. Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:44.930986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:44.935815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:44.935815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:44.935815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:44.935815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:16:44.935815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:16:44.935815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c533c21c-f66a-4a0e-b991-01c4a087f391 could not be found. Oct 11 04:16:44.935815 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:44.935815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Returning 404 to user: Instance c533c21c-f66a-4a0e-b991-01c4a087f391 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:16:44.935815 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8eb7974-9898-4e8c-9bdd-4f8b56bdb979 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391" status: 404 len: 111 microversion: 2.1 time: 0.054518 Oct 11 04:16:44.935815 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 812/1683] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:44 2022] GET /compute/v2.1/servers/c533c21c-f66a-4a0e-b991-01c4a087f391 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:16:44.940846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-05682d7c-7450-4a34-bc1e-f403c3b72739 req-3deb7402-76f7-4e39-bdb0-6b4714d3631b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15e3c3e6-a98f-4e56-a548-439d14a51e92", "tag": "9ada40c6-66d1-4d89-a451-50125c8dfce0"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:44.955006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-05682d7c-7450-4a34-bc1e-f403c3b72739 req-3deb7402-76f7-4e39-bdb0-6b4714d3631b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:44.955827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-05682d7c-7450-4a34-bc1e-f403c3b72739 req-3deb7402-76f7-4e39-bdb0-6b4714d3631b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:44.956497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-05682d7c-7450-4a34-bc1e-f403c3b72739 req-3deb7402-76f7-4e39-bdb0-6b4714d3631b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:44.966268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:44.970047 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-05682d7c-7450-4a34-bc1e-f403c3b72739 req-3deb7402-76f7-4e39-bdb0-6b4714d3631b service nova] Creating event network-changed:9ada40c6-66d1-4d89-a451-50125c8dfce0 for instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 on n-h1-860892-1 Oct 11 04:16:44.976019 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-05682d7c-7450-4a34-bc1e-f403c3b72739 req-3deb7402-76f7-4e39-bdb0-6b4714d3631b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039007 Oct 11 04:16:44.977119 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 813/1684] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:44.979185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:44.981028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:44.983429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5664dd7e-9c8b-4e7c-85dc-3b5c4ff2627d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '.version_select at 0x7fda19a78ca0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:44.983823 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e2185842-c4dc-4f57-bb5b-d62fa828bd72 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.771648 Oct 11 04:16:44.985114 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 872/1685] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:44 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:44.995995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:45.003834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-06c4fdf1-ee78-4334-a418-f543009e689b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:45.004965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-06c4fdf1-ee78-4334-a418-f543009e689b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:45.012452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06c4fdf1-ee78-4334-a418-f543009e689b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:45.013594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06c4fdf1-ee78-4334-a418-f543009e689b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:45.014677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06c4fdf1-ee78-4334-a418-f543009e689b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:45.028236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06c4fdf1-ee78-4334-a418-f543009e689b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:45.028236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06c4fdf1-ee78-4334-a418-f543009e689b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:45.028236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06c4fdf1-ee78-4334-a418-f543009e689b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:45.076812 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5664dd7e-9c8b-4e7c-85dc-3b5c4ff2627d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-60156363" status: 202 len: 0 microversion: 2.1 time: 0.098171 Oct 11 04:16:45.077467 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 814/1686] 10.222.0.26 () {58 vars in 1215 bytes} [Tue Oct 11 04:16:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-60156363 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:16:45.130403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3d16a5ee-32f6-4860-a1c6-cc73e08cdf96 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:45.131554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3d16a5ee-32f6-4860-a1c6-cc73e08cdf96 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:45.138672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d16a5ee-32f6-4860-a1c6-cc73e08cdf96 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:45.139450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d16a5ee-32f6-4860-a1c6-cc73e08cdf96 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:45.140066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d16a5ee-32f6-4860-a1c6-cc73e08cdf96 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:45.142091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d16a5ee-32f6-4860-a1c6-cc73e08cdf96 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:45.142743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d16a5ee-32f6-4860-a1c6-cc73e08cdf96 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:45.143411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d16a5ee-32f6-4860-a1c6-cc73e08cdf96 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:45.268506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-06c4fdf1-ee78-4334-a418-f543009e689b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:45.276950 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-06c4fdf1-ee78-4334-a418-f543009e689b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.276983 Oct 11 04:16:45.292978 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 873/1687] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:44 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:45.298356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-467893c2-9019-44bf-8b1c-bcbac5235e61 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:45.298973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-467893c2-9019-44bf-8b1c-bcbac5235e61 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:45.305530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-467893c2-9019-44bf-8b1c-bcbac5235e61 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:45.306325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-467893c2-9019-44bf-8b1c-bcbac5235e61 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:45.306506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-467893c2-9019-44bf-8b1c-bcbac5235e61 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:45.307169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-467893c2-9019-44bf-8b1c-bcbac5235e61 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:45.307611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-467893c2-9019-44bf-8b1c-bcbac5235e61 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:45.308027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-467893c2-9019-44bf-8b1c-bcbac5235e61 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:45.435064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d16a5ee-32f6-4860-a1c6-cc73e08cdf96 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:45.445464 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3d16a5ee-32f6-4860-a1c6-cc73e08cdf96 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1320 microversion: 2.1 time: 0.319670 Oct 11 04:16:45.446049 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 815/1688] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:45 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1320 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:45.561555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-467893c2-9019-44bf-8b1c-bcbac5235e61 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:45.571723 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-467893c2-9019-44bf-8b1c-bcbac5235e61 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1524 microversion: 2.1 time: 0.277829 Oct 11 04:16:45.582911 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 874/1689] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:45 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1524 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:45.649000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-d270b71d-8995-4dac-8c00-2b60d53a23e5 req-7ea008ed-2857-4f90-9742-61b2adffa271 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25", "name": "network-vif-plugged", "status": "completed", "tag": "05914072-748c-496b-8be4-c8a95fdb871f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:45.667950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d270b71d-8995-4dac-8c00-2b60d53a23e5 req-7ea008ed-2857-4f90-9742-61b2adffa271 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:45.668441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d270b71d-8995-4dac-8c00-2b60d53a23e5 req-7ea008ed-2857-4f90-9742-61b2adffa271 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:45.668877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d270b71d-8995-4dac-8c00-2b60d53a23e5 req-7ea008ed-2857-4f90-9742-61b2adffa271 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:45.694397 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-d270b71d-8995-4dac-8c00-2b60d53a23e5 req-7ea008ed-2857-4f90-9742-61b2adffa271 service nova] Creating event network-vif-plugged:05914072-748c-496b-8be4-c8a95fdb871f for instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 on n-h1-860892-1 Oct 11 04:16:45.702282 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-d270b71d-8995-4dac-8c00-2b60d53a23e5 req-7ea008ed-2857-4f90-9742-61b2adffa271 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058730 Oct 11 04:16:45.704842 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 816/1690] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:45.856794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4f20131c-43fc-467a-9e3b-01f689cb7eb1 req-7c795b27-0b0b-420b-b209-8258f64172dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58b387b4-b392-4d20-90b2-588a989415d4", "tag": "b84a921c-9d36-40b5-b62d-04b068e7459d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:45.867170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4f20131c-43fc-467a-9e3b-01f689cb7eb1 req-7c795b27-0b0b-420b-b209-8258f64172dd service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:45.867642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4f20131c-43fc-467a-9e3b-01f689cb7eb1 req-7c795b27-0b0b-420b-b209-8258f64172dd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:45.868267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4f20131c-43fc-467a-9e3b-01f689cb7eb1 req-7c795b27-0b0b-420b-b209-8258f64172dd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:45.880352 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4f20131c-43fc-467a-9e3b-01f689cb7eb1 req-7c795b27-0b0b-420b-b209-8258f64172dd service nova] Creating event network-changed:b84a921c-9d36-40b5-b62d-04b068e7459d for instance 58b387b4-b392-4d20-90b2-588a989415d4 on n-h2-860892-1 Oct 11 04:16:45.885723 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4f20131c-43fc-467a-9e3b-01f689cb7eb1 req-7c795b27-0b0b-420b-b209-8258f64172dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032769 Oct 11 04:16:45.890512 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 875/1691] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:45.905880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c3ca7c0-0404-4af4-bc34-8cc711993a45 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:45.908297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c3ca7c0-0404-4af4-bc34-8cc711993a45 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:45.915778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c3ca7c0-0404-4af4-bc34-8cc711993a45 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:45.916579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c3ca7c0-0404-4af4-bc34-8cc711993a45 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:45.917099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c3ca7c0-0404-4af4-bc34-8cc711993a45 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:45.917923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c3ca7c0-0404-4af4-bc34-8cc711993a45 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:45.918612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c3ca7c0-0404-4af4-bc34-8cc711993a45 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:45.919100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c3ca7c0-0404-4af4-bc34-8cc711993a45 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.010859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:46.018308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:46.021351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.022327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.023292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.024242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.025128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.025772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.157587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8c3ca7c0-0404-4af4-bc34-8cc711993a45 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:46.167002 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8c3ca7c0-0404-4af4-bc34-8cc711993a45 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.266002 Oct 11 04:16:46.178592 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 817/1692] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:45 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:46.300846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:46.305125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eed0c659-e975-412a-a61f-3bbfb6a66dd7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:46.311588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eed0c659-e975-412a-a61f-3bbfb6a66dd7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:46.323356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:46.328184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eed0c659-e975-412a-a61f-3bbfb6a66dd7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.330587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eed0c659-e975-412a-a61f-3bbfb6a66dd7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.331032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eed0c659-e975-412a-a61f-3bbfb6a66dd7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.332163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:46.333811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eed0c659-e975-412a-a61f-3bbfb6a66dd7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.334307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eed0c659-e975-412a-a61f-3bbfb6a66dd7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.334741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eed0c659-e975-412a-a61f-3bbfb6a66dd7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.341597 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a3271333-0235-443c-9706-f8f53aaaeab2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.328314 Oct 11 04:16:46.344592 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 876/1693] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:46 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:16:46.414342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b114ce0-7dc6-46e9-b6fb-23cbb567a44e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:46.415443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b114ce0-7dc6-46e9-b6fb-23cbb567a44e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:46.431978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b114ce0-7dc6-46e9-b6fb-23cbb567a44e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.432490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b114ce0-7dc6-46e9-b6fb-23cbb567a44e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.432922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b114ce0-7dc6-46e9-b6fb-23cbb567a44e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.433792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b114ce0-7dc6-46e9-b6fb-23cbb567a44e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.434282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b114ce0-7dc6-46e9-b6fb-23cbb567a44e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.434971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b114ce0-7dc6-46e9-b6fb-23cbb567a44e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.473042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b114ce0-7dc6-46e9-b6fb-23cbb567a44e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:16:46.636240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:46.713250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eed0c659-e975-412a-a61f-3bbfb6a66dd7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:46.723226 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eed0c659-e975-412a-a61f-3bbfb6a66dd7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1319 microversion: 2.1 time: 0.425379 Oct 11 04:16:46.724373 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 818/1694] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:46 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1319 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:46.732898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5e6d78e1-9c85-4d76-9ce2-9a2e75f92b32 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:46.733810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5e6d78e1-9c85-4d76-9ce2-9a2e75f92b32 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:46.743088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e6d78e1-9c85-4d76-9ce2-9a2e75f92b32 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.744285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e6d78e1-9c85-4d76-9ce2-9a2e75f92b32 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.745006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e6d78e1-9c85-4d76-9ce2-9a2e75f92b32 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.745782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e6d78e1-9c85-4d76-9ce2-9a2e75f92b32 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.746360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e6d78e1-9c85-4d76-9ce2-9a2e75f92b32 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.747331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e6d78e1-9c85-4d76-9ce2-9a2e75f92b32 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.795876 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b114ce0-7dc6-46e9-b6fb-23cbb567a44e tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 204 len: 0 microversion: 2.1 time: 0.388535 Oct 11 04:16:46.796475 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 877/1695] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:16:46 2022] DELETE /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:16:46.802395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8618eb3d-2e64-48be-8b90-f8e10110be2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:46.803264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8618eb3d-2e64-48be-8b90-f8e10110be2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:46.812181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8618eb3d-2e64-48be-8b90-f8e10110be2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.812702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8618eb3d-2e64-48be-8b90-f8e10110be2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.813334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8618eb3d-2e64-48be-8b90-f8e10110be2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.814159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8618eb3d-2e64-48be-8b90-f8e10110be2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.814802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8618eb3d-2e64-48be-8b90-f8e10110be2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.815401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8618eb3d-2e64-48be-8b90-f8e10110be2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.886739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8618eb3d-2e64-48be-8b90-f8e10110be2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:46.895375 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8618eb3d-2e64-48be-8b90-f8e10110be2b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1482 microversion: 2.1 time: 0.097342 Oct 11 04:16:46.897191 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 878/1696] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:46 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1482 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:46.902551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ed958ee1-3d6e-4daa-949a-7f30ba4ac67c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:46.903160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ed958ee1-3d6e-4daa-949a-7f30ba4ac67c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:46.917130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed958ee1-3d6e-4daa-949a-7f30ba4ac67c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.917896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed958ee1-3d6e-4daa-949a-7f30ba4ac67c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.918585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed958ee1-3d6e-4daa-949a-7f30ba4ac67c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:46.919440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed958ee1-3d6e-4daa-949a-7f30ba4ac67c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:46.920089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed958ee1-3d6e-4daa-949a-7f30ba4ac67c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:46.920574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed958ee1-3d6e-4daa-949a-7f30ba4ac67c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:47.050977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e6d78e1-9c85-4d76-9ce2-9a2e75f92b32 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:47.059897 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5e6d78e1-9c85-4d76-9ce2-9a2e75f92b32 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1320 microversion: 2.1 time: 0.333593 Oct 11 04:16:47.063844 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 819/1697] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:46 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1320 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:47.078846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-69a5d566-7960-4ccd-a6da-3d32f3dc6d10 req-180eb9e0-37b6-4556-8606-55e27584dd7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "927821c1-5dca-4ee7-8072-d2ab4d97368b", "name": "network-vif-deleted", "tag": "c5691c2d-c5a4-490b-b7b5-6f6dbad53a41"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:47.097956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-69a5d566-7960-4ccd-a6da-3d32f3dc6d10 req-180eb9e0-37b6-4556-8606-55e27584dd7d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:47.100125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-69a5d566-7960-4ccd-a6da-3d32f3dc6d10 req-180eb9e0-37b6-4556-8606-55e27584dd7d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:47.100558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-69a5d566-7960-4ccd-a6da-3d32f3dc6d10 req-180eb9e0-37b6-4556-8606-55e27584dd7d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:47.122104 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-69a5d566-7960-4ccd-a6da-3d32f3dc6d10 req-180eb9e0-37b6-4556-8606-55e27584dd7d service nova] Creating event network-vif-deleted:c5691c2d-c5a4-490b-b7b5-6f6dbad53a41 for instance 927821c1-5dca-4ee7-8072-d2ab4d97368b on n-h1-860892-1 Oct 11 04:16:47.131747 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-69a5d566-7960-4ccd-a6da-3d32f3dc6d10 req-180eb9e0-37b6-4556-8606-55e27584dd7d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065806 Oct 11 04:16:47.132809 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 820/1698] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:47.197620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-da81275d-fa0a-47d3-9065-bf049ae80998 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:47.199267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-da81275d-fa0a-47d3-9065-bf049ae80998 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:47.214017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da81275d-fa0a-47d3-9065-bf049ae80998 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:47.215505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da81275d-fa0a-47d3-9065-bf049ae80998 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:47.216439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da81275d-fa0a-47d3-9065-bf049ae80998 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:47.217543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da81275d-fa0a-47d3-9065-bf049ae80998 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:47.218018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da81275d-fa0a-47d3-9065-bf049ae80998 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:47.218637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da81275d-fa0a-47d3-9065-bf049ae80998 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:47.308980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ed958ee1-3d6e-4daa-949a-7f30ba4ac67c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:47.321718 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ed958ee1-3d6e-4daa-949a-7f30ba4ac67c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1467 microversion: 2.1 time: 0.423215 Oct 11 04:16:47.334309 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 879/1699] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:46 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1467 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:47.369112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:47.369815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:47.376889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:47.377442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:47.377819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:47.378564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:47.379317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:47.380000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:47.447717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-da81275d-fa0a-47d3-9065-bf049ae80998 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:47.455650 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-da81275d-fa0a-47d3-9065-bf049ae80998 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.265923 Oct 11 04:16:47.456208 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 821/1700] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:47 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:47.583899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:47.593608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:47.595046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:47.596213 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-80ba1cec-5f14-499c-98dc-724efe6af6a0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.231657 Oct 11 04:16:47.596768 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 880/1701] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:47 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:16:47.747944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cbfe9010-0eba-48e9-bdaf-13c00714f606 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:47.748558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cbfe9010-0eba-48e9-bdaf-13c00714f606 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:47.755661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbfe9010-0eba-48e9-bdaf-13c00714f606 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:47.755967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbfe9010-0eba-48e9-bdaf-13c00714f606 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:47.756470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbfe9010-0eba-48e9-bdaf-13c00714f606 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:47.757311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbfe9010-0eba-48e9-bdaf-13c00714f606 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:47.757759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbfe9010-0eba-48e9-bdaf-13c00714f606 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:47.758244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbfe9010-0eba-48e9-bdaf-13c00714f606 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:47.904388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cbfe9010-0eba-48e9-bdaf-13c00714f606 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:47.912493 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cbfe9010-0eba-48e9-bdaf-13c00714f606 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1469 microversion: 2.1 time: 0.168654 Oct 11 04:16:47.913372 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 822/1702] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:47 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:47.920841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4cd8ddbf-0526-48a4-863b-f88bb45ec2b0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:47.921540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4cd8ddbf-0526-48a4-863b-f88bb45ec2b0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:47.927711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cd8ddbf-0526-48a4-863b-f88bb45ec2b0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:47.928269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cd8ddbf-0526-48a4-863b-f88bb45ec2b0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:47.928772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cd8ddbf-0526-48a4-863b-f88bb45ec2b0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:47.929617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cd8ddbf-0526-48a4-863b-f88bb45ec2b0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:47.930163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cd8ddbf-0526-48a4-863b-f88bb45ec2b0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:47.930702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cd8ddbf-0526-48a4-863b-f88bb45ec2b0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:47.936783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3b70121e-4aa5-430b-94cb-dccb6a581f64 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:47.936783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3b70121e-4aa5-430b-94cb-dccb6a581f64 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:47.943450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b70121e-4aa5-430b-94cb-dccb6a581f64 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:47.943936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b70121e-4aa5-430b-94cb-dccb6a581f64 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:47.944373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b70121e-4aa5-430b-94cb-dccb6a581f64 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:47.945110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b70121e-4aa5-430b-94cb-dccb6a581f64 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:47.945566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b70121e-4aa5-430b-94cb-dccb6a581f64 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:47.945993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b70121e-4aa5-430b-94cb-dccb6a581f64 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.017086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4cd8ddbf-0526-48a4-863b-f88bb45ec2b0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:48.026271 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4cd8ddbf-0526-48a4-863b-f88bb45ec2b0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1308 microversion: 2.1 time: 0.109149 Oct 11 04:16:48.027024 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 881/1703] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:47 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1308 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:48.085690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3b70121e-4aa5-430b-94cb-dccb6a581f64 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:48.094845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a6ce407-5ae7-46c6-ac26-30c2dc789ffa tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:48.095050 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3b70121e-4aa5-430b-94cb-dccb6a581f64 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3" status: 200 len: 1468 microversion: 2.1 time: 0.163611 Oct 11 04:16:48.095438 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 823/1704] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:47 2022] GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3 => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:48.095607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a6ce407-5ae7-46c6-ac26-30c2dc789ffa tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:48.101760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a6ce407-5ae7-46c6-ac26-30c2dc789ffa tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.102272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a6ce407-5ae7-46c6-ac26-30c2dc789ffa tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.102712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a6ce407-5ae7-46c6-ac26-30c2dc789ffa tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.103395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a6ce407-5ae7-46c6-ac26-30c2dc789ffa tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.103848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a6ce407-5ae7-46c6-ac26-30c2dc789ffa tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.104276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a6ce407-5ae7-46c6-ac26-30c2dc789ffa tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.116832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:48.122937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:48.123395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Searching by: {'reservation_id': 'r-mn94ifg0', 'deleted': False, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:16:48.128659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.129483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.129925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.130705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.131162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.131595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.280636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:16:48.331354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:48.364048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:48.371181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.371665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.372103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.384937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a6ce407-5ae7-46c6-ac26-30c2dc789ffa tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:48.393720 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a6ce407-5ae7-46c6-ac26-30c2dc789ffa tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1320 microversion: 2.1 time: 0.303412 Oct 11 04:16:48.394335 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 882/1705] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:48 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1320 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:48.401824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8afeaaac-6066-423f-8a85-28c4efdb6154 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:48.401824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8afeaaac-6066-423f-8a85-28c4efdb6154 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:48.406545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8afeaaac-6066-423f-8a85-28c4efdb6154 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.407097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8afeaaac-6066-423f-8a85-28c4efdb6154 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.407642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8afeaaac-6066-423f-8a85-28c4efdb6154 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.408343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8afeaaac-6066-423f-8a85-28c4efdb6154 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.408799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8afeaaac-6066-423f-8a85-28c4efdb6154 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.409228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8afeaaac-6066-423f-8a85-28c4efdb6154 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.512912 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-65c3b6e0-a039-4c9c-b385-52581cf66a55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-mn94ifg0" status: 200 len: 2930 microversion: 2.1 time: 0.399443 Oct 11 04:16:48.514020 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 824/1706] 10.222.0.26 () {58 vars in 1197 bytes} [Tue Oct 11 04:16:48 2022] GET /compute/v2.1/servers/detail?reservation_id=r-mn94ifg0 => generated 2930 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:48.518869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a3501f9-d859-452b-b3d5-dc718f33194f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:48.519477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7a3501f9-d859-452b-b3d5-dc718f33194f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:48.526134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a3501f9-d859-452b-b3d5-dc718f33194f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.526134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a3501f9-d859-452b-b3d5-dc718f33194f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.526567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a3501f9-d859-452b-b3d5-dc718f33194f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.527267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a3501f9-d859-452b-b3d5-dc718f33194f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.527716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a3501f9-d859-452b-b3d5-dc718f33194f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.528134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a3501f9-d859-452b-b3d5-dc718f33194f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.567013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8afeaaac-6066-423f-8a85-28c4efdb6154 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:48.578816 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8afeaaac-6066-423f-8a85-28c4efdb6154 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1467 microversion: 2.1 time: 0.183436 Oct 11 04:16:48.590263 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 883/1707] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:48 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1467 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:48.590263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-affd2a6c-d351-4438-a490-cb70e5d7ce1e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:48.602955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.compute.server_groups [None req-affd2a6c-d351-4438-a490-cb70e5d7ce1e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Querying cell 7f919055-bb4c-4077-93f0-960b402ab88d(cell1) for 2 instances {{(pid=120994) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 04:16:48.603804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-affd2a6c-d351-4438-a490-cb70e5d7ce1e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.604388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-affd2a6c-d351-4438-a490-cb70e5d7ce1e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.605186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-affd2a6c-d351-4438-a490-cb70e5d7ce1e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.641020 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-affd2a6c-d351-4438-a490-cb70e5d7ce1e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/9ca972c2-753f-4d2d-a1a6-2b819b624a49" status: 200 len: 266 microversion: 2.1 time: 0.059949 Oct 11 04:16:48.641614 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 884/1708] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:16:48 2022] GET /compute/v2.1/os-server-groups/9ca972c2-753f-4d2d-a1a6-2b819b624a49 => generated 266 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:48.652734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:48.653268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:48.659356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.659837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.660298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.661269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.661394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.661834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.670109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7a3501f9-d859-452b-b3d5-dc718f33194f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:48.680711 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7a3501f9-d859-452b-b3d5-dc718f33194f tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1328 microversion: 2.1 time: 0.165276 Oct 11 04:16:48.681462 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 825/1709] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:48 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1328 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:48.687080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00f1cd09-3216-46e4-abf5-a89c1a386d14 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:48.687853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00f1cd09-3216-46e4-abf5-a89c1a386d14 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:48.699867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00f1cd09-3216-46e4-abf5-a89c1a386d14 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.701600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00f1cd09-3216-46e4-abf5-a89c1a386d14 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.701600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00f1cd09-3216-46e4-abf5-a89c1a386d14 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.702558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00f1cd09-3216-46e4-abf5-a89c1a386d14 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.703075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00f1cd09-3216-46e4-abf5-a89c1a386d14 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.707117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00f1cd09-3216-46e4-abf5-a89c1a386d14 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.820087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:48.829382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:48.830834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:48.832014 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-852d0a5f-0506-436e-b038-00aa1bc6d79a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.184835 Oct 11 04:16:48.832712 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 885/1710] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:48 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:48.958511 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00f1cd09-3216-46e4-abf5-a89c1a386d14 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 200 len: 1620 microversion: 2.1 time: 0.275738 Oct 11 04:16:48.961016 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 826/1711] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:48 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 1620 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:48.981208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fa221f97-9280-40fd-8419-040672666bf1 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:48.982511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fa221f97-9280-40fd-8419-040672666bf1 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:48.984342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:48.989286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa221f97-9280-40fd-8419-040672666bf1 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.989775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa221f97-9280-40fd-8419-040672666bf1 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.990238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa221f97-9280-40fd-8419-040672666bf1 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:48.990933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa221f97-9280-40fd-8419-040672666bf1 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:48.991383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa221f97-9280-40fd-8419-040672666bf1 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:48.996523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa221f97-9280-40fd-8419-040672666bf1 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:49.050862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:49.051478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:49.057419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:49.057905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:49.058371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:49.059100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:49.059551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:49.060008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:49.091873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:49.092354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:49.092792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:49.093245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lazy-loading 'fault' on Instance uuid 927821c1-5dca-4ee7-8072-d2ab4d97368b {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:16:49.117360 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fa221f97-9280-40fd-8419-040672666bf1 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3" status: 200 len: 1619 microversion: 2.1 time: 0.139748 Oct 11 04:16:49.118003 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 886/1712] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:48 2022] GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3 => generated 1619 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:49.134234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:49.144529 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a0413877-6538-4c03-a1d3-30133940a5f9 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 200 len: 1313 microversion: 2.1 time: 0.097563 Oct 11 04:16:49.144656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-15bb5f50-6a6f-453f-858f-375a1f78f99d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Action: 'create', calling method: .version_select at 0x7fda1a00f1f0>, body: {"server_group": {"name": "tempest-ServersOnMultiNodesTest-Server-Group-2027810154", "policies": ["anti-affinity"]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:49.145169 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 827/1713] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:49 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 1313 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:49.150304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-efc022cc-a959-4267-ad86-59141e23102b req-74a5fa8c-9295-4c16-ac58-43651039eefc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4133104-80ff-4629-bf97-1d0c7441fbfd", "name": "network-vif-unplugged", "status": "completed", "tag": "a2a973b4-1299-427e-947a-59fb8153c4c0"}, {"name": "network-changed", "server_uuid": "f4133104-80ff-4629-bf97-1d0c7441fbfd", "tag": "a2a973b4-1299-427e-947a-59fb8153c4c0"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:49.160589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-efc022cc-a959-4267-ad86-59141e23102b req-74a5fa8c-9295-4c16-ac58-43651039eefc service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:49.161278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-efc022cc-a959-4267-ad86-59141e23102b req-74a5fa8c-9295-4c16-ac58-43651039eefc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:49.161714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-efc022cc-a959-4267-ad86-59141e23102b req-74a5fa8c-9295-4c16-ac58-43651039eefc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:49.164231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-15bb5f50-6a6f-453f-858f-375a1f78f99d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:49.169566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-15bb5f50-6a6f-453f-858f-375a1f78f99d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:49.172603 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-efc022cc-a959-4267-ad86-59141e23102b req-74a5fa8c-9295-4c16-ac58-43651039eefc service nova] Creating event network-vif-unplugged:a2a973b4-1299-427e-947a-59fb8153c4c0 for instance f4133104-80ff-4629-bf97-1d0c7441fbfd on n-h2-860892-1 Oct 11 04:16:49.173070 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-efc022cc-a959-4267-ad86-59141e23102b req-74a5fa8c-9295-4c16-ac58-43651039eefc service nova] Creating event network-changed:a2a973b4-1299-427e-947a-59fb8153c4c0 for instance f4133104-80ff-4629-bf97-1d0c7441fbfd on n-h2-860892-1 Oct 11 04:16:49.178219 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-efc022cc-a959-4267-ad86-59141e23102b req-74a5fa8c-9295-4c16-ac58-43651039eefc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 352 microversion: 2.1 time: 0.031385 Oct 11 04:16:49.178821 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 828/1714] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:49 2022] POST /compute/v2.1/os-server-external-events => generated 352 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:16:49.312105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-15bb5f50-6a6f-453f-858f-375a1f78f99d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:49.319461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-15bb5f50-6a6f-453f-858f-375a1f78f99d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:49.335947 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-15bb5f50-6a6f-453f-858f-375a1f78f99d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 193 microversion: 2.1 time: 0.195371 Oct 11 04:16:49.337534 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 887/1715] 10.222.0.26 () {60 vars in 1174 bytes} [Tue Oct 11 04:16:49 2022] POST /compute/v2.1/os-server-groups => generated 193 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:49.416962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d7202114-d322-4e76-bda1-f64bc4114802 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:49.417856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d7202114-d322-4e76-bda1-f64bc4114802 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:49.436742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7202114-d322-4e76-bda1-f64bc4114802 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:49.437360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7202114-d322-4e76-bda1-f64bc4114802 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:49.437911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7202114-d322-4e76-bda1-f64bc4114802 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:49.441270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7202114-d322-4e76-bda1-f64bc4114802 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:49.442053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7202114-d322-4e76-bda1-f64bc4114802 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:49.442803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7202114-d322-4e76-bda1-f64bc4114802 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:49.519507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-1971108604", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "min_count": 2, "return_reservation_id": true}, "os:scheduler_hints": {"group": "3ca432a7-1fef-4079-8b0f-d93548027b7b"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:49.585660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:16:49.896454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:16:49.896903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:16:49.897371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:16:49.897771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:16:49.898178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:16:49.913190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:49.913661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:49.914091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:49.914853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:49.915273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:49.915683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:49.927607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:49.934530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:49.939654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:49.952576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Going to run 2 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:16:49.955060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: eba839a6-aa74-4b1a-9393-a9538ec7b2db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:16:49.986825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d7202114-d322-4e76-bda1-f64bc4114802 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:49.995064 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d7202114-d322-4e76-bda1-f64bc4114802 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1320 microversion: 2.1 time: 0.582329 Oct 11 04:16:49.995713 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 829/1716] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:49 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1320 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:50.013592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0fa7e996-69e4-4427-80b2-5ffc0d5eef36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:50.014394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0fa7e996-69e4-4427-80b2-5ffc0d5eef36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:50.021096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa7e996-69e4-4427-80b2-5ffc0d5eef36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:50.021655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa7e996-69e4-4427-80b2-5ffc0d5eef36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:50.022375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa7e996-69e4-4427-80b2-5ffc0d5eef36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:50.023340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa7e996-69e4-4427-80b2-5ffc0d5eef36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:50.024134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa7e996-69e4-4427-80b2-5ffc0d5eef36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:50.024740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa7e996-69e4-4427-80b2-5ffc0d5eef36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:50.120785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:50.128784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:50.339773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:50.360795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:50.384910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=eba839a6-aa74-4b1a-9393-a9538ec7b2db,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:16:50.586715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:50.592098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:50.705075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:50.710534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:50.745908 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b06ba5dc-26e3-4cdf-bc51-d99d3058fc08 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.230473 Oct 11 04:16:50.749788 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 888/1717] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:16:49 2022] POST /compute/v2.1/servers => generated 32 bytes in 1232 msecs (HTTP/1.1 202) 9 headers in 362 bytes (1 switches on core 0) Oct 11 04:16:50.751886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3869470-88c0-4b5e-9566-3e607f68b9c0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:50.752539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3869470-88c0-4b5e-9566-3e607f68b9c0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:50.758918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3869470-88c0-4b5e-9566-3e607f68b9c0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:50.759402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3869470-88c0-4b5e-9566-3e607f68b9c0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:50.764124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3869470-88c0-4b5e-9566-3e607f68b9c0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:50.764124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3869470-88c0-4b5e-9566-3e607f68b9c0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:50.764124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3869470-88c0-4b5e-9566-3e607f68b9c0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:50.764124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3869470-88c0-4b5e-9566-3e607f68b9c0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:50.785625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0fa7e996-69e4-4427-80b2-5ffc0d5eef36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:50.801398 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0fa7e996-69e4-4427-80b2-5ffc0d5eef36 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1467 microversion: 2.1 time: 0.791434 Oct 11 04:16:50.802068 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 830/1718] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:50 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1467 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:50.817615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:50.818519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:50.827667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:50.828414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:50.829180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:50.830052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:50.830703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:50.831340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:50.837546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:51.131007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:51.157178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:51.158700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:51.159920 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6de2408c-dc52-4eed-ae81-d729108e56be tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.356390 Oct 11 04:16:51.165034 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 831/1719] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:50 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:51.179368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:51.180426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 927821c1-5dca-4ee7-8072-d2ab4d97368b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:51.200858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.203464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.204411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3869470-88c0-4b5e-9566-3e607f68b9c0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:51.205570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.207596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.212629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.212759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.235722 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3869470-88c0-4b5e-9566-3e607f68b9c0 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1528 microversion: 2.1 time: 0.486597 Oct 11 04:16:51.236336 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 889/1720] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:50 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1528 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:51.243931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48d1166d-c153-46fd-b899-3ae8554446e5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:51.248188 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] HTTP exception thrown: Instance 927821c1-5dca-4ee7-8072-d2ab4d97368b could not be found. Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Request method failure captured: Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b HTTP/1.1 Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO3eKPeAlPeermk_00UJNdtrMz_eqsC4Otf73nv-kJTdm9jlMNQEAhzTVerAMi-hvaFptUfoGK4TtLjOFdjyroIPYRMlzS_FCDfN3xSPUe15oVx0cIfYw5elFIb6puOQvJ3x1N369Wfdw-0ljsaa1fzRzAZySBt-M7EOC7FVdVem7_k Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 26ea13948bbf479386c8b9ee5e1aa5cf Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1854621729 Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/26ea13948bbf479386c8b9ee5e1aa5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_26ea13948bbf479386c8b9ee5e1aa5cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26ea13948bbf479386c8b9ee5e1aa5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26ea13948bbf479386c8b9ee5e1aa5cf"}]}] Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1854621729 Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 26ea13948bbf479386c8b9ee5e1aa5cf Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1854621729 Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FloatingIPsAssociationTestJSON-1854621729-project Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: ab384b5b9a1b484bb001a06b0998f680 Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1854621729-project Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 927821c1-5dca-4ee7-8072-d2ab4d97368b could not be found. Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '927821c1-5dca-4ee7-8072-d2ab4d97368b'} Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 927821c1-5dca-4ee7-8072-d2ab4d97368b could not be found. Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 927821c1-5dca-4ee7-8072-d2ab4d97368b could not be found. Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:51.250173 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:51.261118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:51.261118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:51.261118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:51.261118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:51.261118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:16:51.261118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:16:51.261118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 927821c1-5dca-4ee7-8072-d2ab4d97368b could not be found. Oct 11 04:16:51.261118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:51.262505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48d1166d-c153-46fd-b899-3ae8554446e5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:51.262505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-48d1166d-c153-46fd-b899-3ae8554446e5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Searching by: {'deleted': False, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:16:51.262789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Returning 404 to user: Instance 927821c1-5dca-4ee7-8072-d2ab4d97368b could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:16:51.262789 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-28819ac3-27e4-4071-aef1-c84ee21038c0 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b" status: 404 len: 111 microversion: 2.1 time: 0.090451 Oct 11 04:16:51.262789 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 832/1721] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:51 2022] GET /compute/v2.1/servers/927821c1-5dca-4ee7-8072-d2ab4d97368b => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:16:51.268524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3e80f19-e8c2-42b5-816a-d6949664d210 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:51.269428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d3e80f19-e8c2-42b5-816a-d6949664d210 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:51.276887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48d1166d-c153-46fd-b899-3ae8554446e5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.277456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48d1166d-c153-46fd-b899-3ae8554446e5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.278150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48d1166d-c153-46fd-b899-3ae8554446e5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.289131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48d1166d-c153-46fd-b899-3ae8554446e5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.289131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48d1166d-c153-46fd-b899-3ae8554446e5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.289131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48d1166d-c153-46fd-b899-3ae8554446e5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.289764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e80f19-e8c2-42b5-816a-d6949664d210 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.289764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e80f19-e8c2-42b5-816a-d6949664d210 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.289764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e80f19-e8c2-42b5-816a-d6949664d210 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.289764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e80f19-e8c2-42b5-816a-d6949664d210 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.289764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e80f19-e8c2-42b5-816a-d6949664d210 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.289764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e80f19-e8c2-42b5-816a-d6949664d210 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.321772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-48d1166d-c153-46fd-b899-3ae8554446e5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Listed batch of 3 results from cell out of 998 limit. Returned 3 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:16:51.354989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48d1166d-c153-46fd-b899-3ae8554446e5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1666 microversion: 2.1 time: 0.115254 Oct 11 04:16:51.356335 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 890/1722] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:16:51 2022] GET /compute/v2.1/servers => generated 1666 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:51.368281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee79e0b4-f52f-4214-96ab-124a4041bf61 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:51.368925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee79e0b4-f52f-4214-96ab-124a4041bf61 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:51.375950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee79e0b4-f52f-4214-96ab-124a4041bf61 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.376668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee79e0b4-f52f-4214-96ab-124a4041bf61 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.377106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee79e0b4-f52f-4214-96ab-124a4041bf61 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.377805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee79e0b4-f52f-4214-96ab-124a4041bf61 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.378339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee79e0b4-f52f-4214-96ab-124a4041bf61 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.378708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee79e0b4-f52f-4214-96ab-124a4041bf61 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.440110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d3e80f19-e8c2-42b5-816a-d6949664d210 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:51.448410 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d3e80f19-e8c2-42b5-816a-d6949664d210 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1320 microversion: 2.1 time: 0.188874 Oct 11 04:16:51.449353 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 833/1723] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:51 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1320 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:51.455191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-99c2b43d-fd6d-45a7-81cb-3c89aa16e12c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '.version_select at 0x7fda1e127c10>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:51.543431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee79e0b4-f52f-4214-96ab-124a4041bf61 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:51.558828 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee79e0b4-f52f-4214-96ab-124a4041bf61 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1528 microversion: 2.1 time: 0.195524 Oct 11 04:16:51.559649 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 891/1724] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:51 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1528 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:51.568406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-31cebb2a-aba2-412e-9f8f-79a25543d06e req-f2d69185-3a0c-4af1-ab99-699f2b7340cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa356b6-3b84-4022-b47c-35239eaeb5c3", "name": "network-vif-deleted", "tag": "c9c070fc-a59c-46ad-8b25-4293eab123bc"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:51.590566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-31cebb2a-aba2-412e-9f8f-79a25543d06e req-f2d69185-3a0c-4af1-ab99-699f2b7340cb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.591725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-31cebb2a-aba2-412e-9f8f-79a25543d06e req-f2d69185-3a0c-4af1-ab99-699f2b7340cb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.592163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-31cebb2a-aba2-412e-9f8f-79a25543d06e req-f2d69185-3a0c-4af1-ab99-699f2b7340cb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.604731 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-31cebb2a-aba2-412e-9f8f-79a25543d06e req-f2d69185-3a0c-4af1-ab99-699f2b7340cb service nova] Creating event network-vif-deleted:c9c070fc-a59c-46ad-8b25-4293eab123bc for instance afa356b6-3b84-4022-b47c-35239eaeb5c3 on n-h1-860892-1 Oct 11 04:16:51.610000 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-31cebb2a-aba2-412e-9f8f-79a25543d06e req-f2d69185-3a0c-4af1-ab99-699f2b7340cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048707 Oct 11 04:16:51.610796 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 892/1725] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:51.617217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-477d878e-5580-41da-95bb-ed31ff81b241 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:51.618035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-477d878e-5580-41da-95bb-ed31ff81b241 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:51.683031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-477d878e-5580-41da-95bb-ed31ff81b241 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:51.708966 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-477d878e-5580-41da-95bb-ed31ff81b241 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1219 microversion: 2.1 time: 0.092572 Oct 11 04:16:51.709643 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 893/1726] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:51 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:51.868000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:51.868649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:51.875576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.876273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.876886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.877779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.878542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.879435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.907805 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] HTTP exception thrown: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Request method failure captured: Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 HTTP/1.1 Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO4QLILuMpfnS2lLN8OzVyMhnxJnl2TThpGyJGhRcTBI2cE7WK7BZYfYwRqhQaQWGvowJx0pptag_a8ZulVFfyu3pzCGuVh8ZnO2JV37yfVQd5XlxpLp7IazgkdPBsGl4I0v-GSVAOhI-KtFJAwS2PlJQAAEhCOKLARLo5t1sFppyh0 Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f5bcb46bb4b04d51ba36fd070f93e066 Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-849931841 Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5bcb46bb4b04d51ba36fd070f93e066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5bcb46bb4b04d51ba36fd070f93e066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5bcb46bb4b04d51ba36fd070f93e066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5bcb46bb4b04d51ba36fd070f93e066"}]}] Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-849931841 Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f5bcb46bb4b04d51ba36fd070f93e066 Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-849931841 Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestMultiTenantJSON-849931841-project Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 73f296f7d75241e69cada7bb3b62f1ce Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-849931841-project Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25'} Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:16:51.909521 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Returning 404 to user: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-41caa9b6-ec72-4272-8965-d9251aaf6e9c tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 404 len: 111 microversion: 2.1 time: 0.200356 Oct 11 04:16:51.916717 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 894/1727] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:16:51 2022] DELETE /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:16:51.918521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:51.918521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:51.925040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.929331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.929331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.929331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.929331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.929331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.965670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:51.967077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:51.967526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:51.967972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lazy-loading 'fault' on Instance uuid afa356b6-3b84-4022-b47c-35239eaeb5c3 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:16:52.041439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:52.063651 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e312357-ba48-45a2-bc68-a364b43f759d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 200 len: 1301 microversion: 2.1 time: 0.147782 Oct 11 04:16:52.066937 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 895/1728] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:51 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 1301 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:52.076345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-83548e9b-87f7-452a-b4cf-90829670decc tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:52.077029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-83548e9b-87f7-452a-b4cf-90829670decc tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:52.089852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83548e9b-87f7-452a-b4cf-90829670decc tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.090382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83548e9b-87f7-452a-b4cf-90829670decc tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.092078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83548e9b-87f7-452a-b4cf-90829670decc tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.092905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83548e9b-87f7-452a-b4cf-90829670decc tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.093309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83548e9b-87f7-452a-b4cf-90829670decc tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.094028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83548e9b-87f7-452a-b4cf-90829670decc tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.240105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-83548e9b-87f7-452a-b4cf-90829670decc tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:52.248496 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-83548e9b-87f7-452a-b4cf-90829670decc tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1528 microversion: 2.1 time: 0.180303 Oct 11 04:16:52.249076 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 896/1729] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:52 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1528 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:52.263860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-26286b71-734b-48ce-b8b1-fea2f2380399 req-364aa49d-d1e2-4839-9bc2-5e022ed2880a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b387b4-b392-4d20-90b2-588a989415d4", "name": "network-vif-plugged", "status": "completed", "tag": "b84a921c-9d36-40b5-b62d-04b068e7459d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:52.273574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-26286b71-734b-48ce-b8b1-fea2f2380399 req-364aa49d-d1e2-4839-9bc2-5e022ed2880a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.274047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-26286b71-734b-48ce-b8b1-fea2f2380399 req-364aa49d-d1e2-4839-9bc2-5e022ed2880a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.274537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-26286b71-734b-48ce-b8b1-fea2f2380399 req-364aa49d-d1e2-4839-9bc2-5e022ed2880a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.286498 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-26286b71-734b-48ce-b8b1-fea2f2380399 req-364aa49d-d1e2-4839-9bc2-5e022ed2880a service nova] Creating event network-vif-plugged:b84a921c-9d36-40b5-b62d-04b068e7459d for instance 58b387b4-b392-4d20-90b2-588a989415d4 on n-h2-860892-1 Oct 11 04:16:52.291640 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-26286b71-734b-48ce-b8b1-fea2f2380399 req-364aa49d-d1e2-4839-9bc2-5e022ed2880a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031865 Oct 11 04:16:52.292245 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 897/1730] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:52.297352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:52.298051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:52.304252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.304968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.310408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.310408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.310408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.310408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.336169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:52.446087 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-99c2b43d-fd6d-45a7-81cb-3c89aa16e12c tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/44d4b7d7-7f44-4fec-9c77-18920f1f9bf1" status: 202 len: 0 microversion: 2.1 time: 0.995549 Oct 11 04:16:52.451444 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 834/1731] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:16:51 2022] DELETE /compute/v2.1/os-floating-ips/44d4b7d7-7f44-4fec-9c77-18920f1f9bf1 => generated 0 bytes in 1001 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:16:52.457061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Action: 'update', calling method: >, body: {"server": {"name": "1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25_new"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:52.459546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:52.467893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.468395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.468902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.469562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.470014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.470463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.480152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:52.484533 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] HTTP exception thrown: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Request method failure captured: Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: request: PUT /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 HTTP/1.1 Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 64 Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO4QLILuMpfnS2lLN8OzVyMhnxJnl2TThpGyJGhRcTBI2cE7WK7BZYfYwRqhQaQWGvowJx0pptag_a8ZulVFfyu3pzCGuVh8ZnO2JV37yfVQd5XlxpLp7IazgkdPBsGl4I0v-GSVAOhI-KtFJAwS2PlJQAAEhCOKLARLo5t1sFppyh0 Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f5bcb46bb4b04d51ba36fd070f93e066 Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-849931841 Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5bcb46bb4b04d51ba36fd070f93e066"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5bcb46bb4b04d51ba36fd070f93e066"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5bcb46bb4b04d51ba36fd070f93e066"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5bcb46bb4b04d51ba36fd070f93e066"}]}] Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-849931841 Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f5bcb46bb4b04d51ba36fd070f93e066 Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-849931841 Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestMultiTenantJSON-849931841-project Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 73f296f7d75241e69cada7bb3b62f1ce Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-849931841-project Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25_new"}} Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25', 'body': {'server': {'name': '1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25_new'}}} Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:16:52.486263 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] Returning 404 to user: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df6c8c42-1eb9-4e5d-836e-79d569c15581 tempest-ServersNegativeTestMultiTenantJSON-849931841 tempest-ServersNegativeTestMultiTenantJSON-849931841-project] 10.222.0.26 "PUT /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 404 len: 111 microversion: 2.1 time: 0.035183 Oct 11 04:16:52.492050 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 835/1732] 10.222.0.26 () {60 vars in 1256 bytes} [Tue Oct 11 04:16:52 2022] PUT /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:16:52.496811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-73e3516b-2421-4c93-bc49-f412c03d96dd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:52.497429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73e3516b-2421-4c93-bc49-f412c03d96dd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:52.497612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:52.499126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:52.500262 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e7ead3ea-bd19-4393-886d-d7ffff07dda4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.206969 Oct 11 04:16:52.500816 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 898/1733] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:52 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:52.504543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e3516b-2421-4c93-bc49-f412c03d96dd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.505024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e3516b-2421-4c93-bc49-f412c03d96dd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.505461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e3516b-2421-4c93-bc49-f412c03d96dd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.505634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e54ad44c-08e8-4d7b-a16c-2ac4eee0c5b1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:52.506155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e3516b-2421-4c93-bc49-f412c03d96dd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.506433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e54ad44c-08e8-4d7b-a16c-2ac4eee0c5b1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:52.506677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e3516b-2421-4c93-bc49-f412c03d96dd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.507102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e3516b-2421-4c93-bc49-f412c03d96dd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.536988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ad44c-08e8-4d7b-a16c-2ac4eee0c5b1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.537611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ad44c-08e8-4d7b-a16c-2ac4eee0c5b1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.538052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ad44c-08e8-4d7b-a16c-2ac4eee0c5b1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.538783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ad44c-08e8-4d7b-a16c-2ac4eee0c5b1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.539234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ad44c-08e8-4d7b-a16c-2ac4eee0c5b1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.539654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ad44c-08e8-4d7b-a16c-2ac4eee0c5b1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.541388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73e3516b-2421-4c93-bc49-f412c03d96dd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:16:52.677420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e54ad44c-08e8-4d7b-a16c-2ac4eee0c5b1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:52.685559 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e54ad44c-08e8-4d7b-a16c-2ac4eee0c5b1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1320 microversion: 2.1 time: 0.183755 Oct 11 04:16:52.686126 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 899/1734] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:52 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1320 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:52.692807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f8bfa391-f28f-460e-96cd-95a1af588521 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:52.692807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f8bfa391-f28f-460e-96cd-95a1af588521 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:52.696909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8bfa391-f28f-460e-96cd-95a1af588521 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.697394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8bfa391-f28f-460e-96cd-95a1af588521 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.697819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8bfa391-f28f-460e-96cd-95a1af588521 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.698521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8bfa391-f28f-460e-96cd-95a1af588521 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.698965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8bfa391-f28f-460e-96cd-95a1af588521 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.699378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8bfa391-f28f-460e-96cd-95a1af588521 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.726005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f8bfa391-f28f-460e-96cd-95a1af588521 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:16:52.881212 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-73e3516b-2421-4c93-bc49-f412c03d96dd tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "DELETE /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 204 len: 0 microversion: 2.1 time: 0.391591 Oct 11 04:16:52.881984 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 836/1735] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:16:52 2022] DELETE /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:16:52.890269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-feadacb7-c82d-4405-a9c8-1de827677ec9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:52.891137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-feadacb7-c82d-4405-a9c8-1de827677ec9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:52.897058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feadacb7-c82d-4405-a9c8-1de827677ec9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.897602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feadacb7-c82d-4405-a9c8-1de827677ec9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.898103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feadacb7-c82d-4405-a9c8-1de827677ec9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.898904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feadacb7-c82d-4405-a9c8-1de827677ec9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.899412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feadacb7-c82d-4405-a9c8-1de827677ec9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.899911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feadacb7-c82d-4405-a9c8-1de827677ec9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.963159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-feadacb7-c82d-4405-a9c8-1de827677ec9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:52.971087 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-feadacb7-c82d-4405-a9c8-1de827677ec9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1223 microversion: 2.1 time: 0.087008 Oct 11 04:16:52.984353 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 837/1736] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:52 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:52.984353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f92dd31-3c1f-486c-9351-8661a9ebbb1e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:52.984353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9f92dd31-3c1f-486c-9351-8661a9ebbb1e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:52.984353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f92dd31-3c1f-486c-9351-8661a9ebbb1e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.984353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f92dd31-3c1f-486c-9351-8661a9ebbb1e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.984353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f92dd31-3c1f-486c-9351-8661a9ebbb1e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:52.985744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f92dd31-3c1f-486c-9351-8661a9ebbb1e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:52.985744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f92dd31-3c1f-486c-9351-8661a9ebbb1e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:52.985744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f92dd31-3c1f-486c-9351-8661a9ebbb1e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.103655 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f8bfa391-f28f-460e-96cd-95a1af588521 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 204 len: 0 microversion: 2.1 time: 0.416237 Oct 11 04:16:53.104244 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 900/1737] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:16:52 2022] DELETE /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:16:53.110358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:53.111191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: afa356b6-3b84-4022-b47c-35239eaeb5c3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:53.117065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.117559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.117978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.118689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.119126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.119548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.120776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9f92dd31-3c1f-486c-9351-8661a9ebbb1e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:53.129509 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9f92dd31-3c1f-486c-9351-8661a9ebbb1e tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1525 microversion: 2.1 time: 0.156523 Oct 11 04:16:53.134881 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 838/1738] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:52 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1525 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:53.134881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-59127ee3-89be-40a3-815a-6e6c737b9088 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:53.135078 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] HTTP exception thrown: Instance afa356b6-3b84-4022-b47c-35239eaeb5c3 could not be found. Oct 11 04:16:53.135200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-59127ee3-89be-40a3-815a-6e6c737b9088 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Request method failure captured: Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 HTTP/1.1 Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzVXK0zaVQbhEX1-cTggS_6AF670oSjUyaWqNRNZ0AKjB4jOp4UmqRnZrRxpvEJCRG8ESeEkSohR0vbNNez8eTdxgu5C3lz83-lIlmo46HncDthZwdU_l69djUs4QZxOD6JVN8v9luoPVncLFGWaloRCOIWL6Xi7vGVgFgMxw1FQ6o Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: bcce9ce30d3a4a15985192c8e12c040c Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcce9ce30d3a4a15985192c8e12c040c"}]}] Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: bcce9ce30d3a4a15985192c8e12c040c Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-MigrationsAdminTest-2070201961-project Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a1df373e8ec14e2a84f0b8a62e0b884a Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-MigrationsAdminTest-2070201961-project Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance afa356b6-3b84-4022-b47c-35239eaeb5c3 could not be found. Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'afa356b6-3b84-4022-b47c-35239eaeb5c3'} Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa356b6-3b84-4022-b47c-35239eaeb5c3 could not be found. Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa356b6-3b84-4022-b47c-35239eaeb5c3 could not be found. Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:53.136529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:53.140885 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:53.140885 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:53.140885 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:53.140885 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:16:53.140885 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:16:53.140885 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa356b6-3b84-4022-b47c-35239eaeb5c3 could not be found. Oct 11 04:16:53.140885 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:53.140885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Returning 404 to user: Instance afa356b6-3b84-4022-b47c-35239eaeb5c3 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:16:53.140885 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cbc0547e-4cba-4f08-aa86-e13b1b5ad440 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3" status: 404 len: 111 microversion: 2.1 time: 0.032600 Oct 11 04:16:53.140885 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 901/1739] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:53 2022] GET /compute/v2.1/servers/afa356b6-3b84-4022-b47c-35239eaeb5c3 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:16:53.141660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59127ee3-89be-40a3-815a-6e6c737b9088 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.141660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59127ee3-89be-40a3-815a-6e6c737b9088 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.141972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59127ee3-89be-40a3-815a-6e6c737b9088 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.142935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59127ee3-89be-40a3-815a-6e6c737b9088 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.143369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59127ee3-89be-40a3-815a-6e6c737b9088 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.143904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59127ee3-89be-40a3-815a-6e6c737b9088 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.147121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f4e333de-c23a-4e85-8c3b-940d56946199 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:53.148916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f4e333de-c23a-4e85-8c3b-940d56946199 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:53.149546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:53.154382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4e333de-c23a-4e85-8c3b-940d56946199 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.159281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4e333de-c23a-4e85-8c3b-940d56946199 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.159281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4e333de-c23a-4e85-8c3b-940d56946199 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.159281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4e333de-c23a-4e85-8c3b-940d56946199 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.159281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4e333de-c23a-4e85-8c3b-940d56946199 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.159281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4e333de-c23a-4e85-8c3b-940d56946199 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.185892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f4e333de-c23a-4e85-8c3b-940d56946199 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:16:53.278121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-59127ee3-89be-40a3-815a-6e6c737b9088 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:53.286655 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-59127ee3-89be-40a3-815a-6e6c737b9088 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1534 microversion: 2.1 time: 0.155526 Oct 11 04:16:53.287238 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 839/1740] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:53 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1534 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:53.529717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:53.530444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:53.534930 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f4e333de-c23a-4e85-8c3b-940d56946199 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 204 len: 0 microversion: 2.1 time: 0.388030 Oct 11 04:16:53.534930 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 902/1741] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:16:53 2022] DELETE /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:16:53.538678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.539167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.539606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.540342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.540798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.541245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.542386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-351b1902-6128-4fa6-9e8e-1e24be61e48d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:53.543142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-351b1902-6128-4fa6-9e8e-1e24be61e48d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:53.549490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351b1902-6128-4fa6-9e8e-1e24be61e48d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.549951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351b1902-6128-4fa6-9e8e-1e24be61e48d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.550509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351b1902-6128-4fa6-9e8e-1e24be61e48d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.551185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351b1902-6128-4fa6-9e8e-1e24be61e48d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.551672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351b1902-6128-4fa6-9e8e-1e24be61e48d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.557686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351b1902-6128-4fa6-9e8e-1e24be61e48d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.674960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:53.682822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-351b1902-6128-4fa6-9e8e-1e24be61e48d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:53.689917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:53.691250 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-351b1902-6128-4fa6-9e8e-1e24be61e48d tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1469 microversion: 2.1 time: 0.153298 Oct 11 04:16:53.691772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:53.691923 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 903/1742] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:53 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:53.693036 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c094491d-0640-4076-adfd-b14b3dcd8052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.168014 Oct 11 04:16:53.693768 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 840/1743] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:53 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:16:53.709445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a1145650-a9aa-44fb-9b62-7ad1c09009c1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:53.710176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a1145650-a9aa-44fb-9b62-7ad1c09009c1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:53.716914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1145650-a9aa-44fb-9b62-7ad1c09009c1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.717386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1145650-a9aa-44fb-9b62-7ad1c09009c1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.717817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1145650-a9aa-44fb-9b62-7ad1c09009c1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.718533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1145650-a9aa-44fb-9b62-7ad1c09009c1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:53.718976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1145650-a9aa-44fb-9b62-7ad1c09009c1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:53.719393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1145650-a9aa-44fb-9b62-7ad1c09009c1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:53.850802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a1145650-a9aa-44fb-9b62-7ad1c09009c1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:53.858409 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a1145650-a9aa-44fb-9b62-7ad1c09009c1 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1320 microversion: 2.1 time: 0.153414 Oct 11 04:16:53.858973 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 904/1744] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:53 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1320 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:53.993892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b03a1766-46e0-47e3-bca6-4c74f1780caf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:53.994528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b03a1766-46e0-47e3-bca6-4c74f1780caf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:54.001472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b03a1766-46e0-47e3-bca6-4c74f1780caf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.001950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b03a1766-46e0-47e3-bca6-4c74f1780caf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.003773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b03a1766-46e0-47e3-bca6-4c74f1780caf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:54.003773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b03a1766-46e0-47e3-bca6-4c74f1780caf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.003773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b03a1766-46e0-47e3-bca6-4c74f1780caf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.004352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b03a1766-46e0-47e3-bca6-4c74f1780caf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:54.067636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b03a1766-46e0-47e3-bca6-4c74f1780caf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:54.075801 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b03a1766-46e0-47e3-bca6-4c74f1780caf tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1223 microversion: 2.1 time: 0.085279 Oct 11 04:16:54.076397 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 841/1745] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:53 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:54.156479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25b05f4b-111d-4547-847c-4c7efe3a7016 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:54.157744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-25b05f4b-111d-4547-847c-4c7efe3a7016 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:54.164088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b05f4b-111d-4547-847c-4c7efe3a7016 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.164573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b05f4b-111d-4547-847c-4c7efe3a7016 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.165040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b05f4b-111d-4547-847c-4c7efe3a7016 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:54.165692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b05f4b-111d-4547-847c-4c7efe3a7016 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.166417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b05f4b-111d-4547-847c-4c7efe3a7016 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.166849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25b05f4b-111d-4547-847c-4c7efe3a7016 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:54.296542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25b05f4b-111d-4547-847c-4c7efe3a7016 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:54.304332 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-25b05f4b-111d-4547-847c-4c7efe3a7016 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1525 microversion: 2.1 time: 0.151787 Oct 11 04:16:54.304903 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 905/1746] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:54 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1525 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:54.308715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b6cd4244-877a-48a5-934e-1b6f36d188ce tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:54.309327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b6cd4244-877a-48a5-934e-1b6f36d188ce tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:54.315825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6cd4244-877a-48a5-934e-1b6f36d188ce tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.316247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6cd4244-877a-48a5-934e-1b6f36d188ce tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.316680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6cd4244-877a-48a5-934e-1b6f36d188ce tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:54.317358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6cd4244-877a-48a5-934e-1b6f36d188ce tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.317835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6cd4244-877a-48a5-934e-1b6f36d188ce tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.318251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6cd4244-877a-48a5-934e-1b6f36d188ce tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:54.446486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b6cd4244-877a-48a5-934e-1b6f36d188ce tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:54.454705 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b6cd4244-877a-48a5-934e-1b6f36d188ce tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1534 microversion: 2.1 time: 0.149812 Oct 11 04:16:54.455272 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 842/1747] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:54 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1534 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:54.715176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-399da6cd-e609-4e16-8b59-acc127c656e8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:54.715789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-399da6cd-e609-4e16-8b59-acc127c656e8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:54.719081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:54.719731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:54.722386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-399da6cd-e609-4e16-8b59-acc127c656e8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.722869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-399da6cd-e609-4e16-8b59-acc127c656e8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.723308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-399da6cd-e609-4e16-8b59-acc127c656e8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:54.724000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-399da6cd-e609-4e16-8b59-acc127c656e8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.724442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-399da6cd-e609-4e16-8b59-acc127c656e8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.724863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-399da6cd-e609-4e16-8b59-acc127c656e8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:54.725826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.726338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.726798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:54.727489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.727985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.728415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:54.869323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-399da6cd-e609-4e16-8b59-acc127c656e8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:54.874228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:54.882069 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-399da6cd-e609-4e16-8b59-acc127c656e8 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1469 microversion: 2.1 time: 0.166562 Oct 11 04:16:54.882069 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 906/1748] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:54 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1469 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:54.883848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:54.884481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e9cc885-d5e8-4772-b40a-35dc52518f28 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:54.885087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e9cc885-d5e8-4772-b40a-35dc52518f28 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:54.885870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:54.887302 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e662e796-93b3-4acf-874a-bb70d8cb8f21 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.172150 Oct 11 04:16:54.888054 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 843/1749] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:54 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:16:54.897887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e9cc885-d5e8-4772-b40a-35dc52518f28 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.898406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e9cc885-d5e8-4772-b40a-35dc52518f28 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.898843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e9cc885-d5e8-4772-b40a-35dc52518f28 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:54.899684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e9cc885-d5e8-4772-b40a-35dc52518f28 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:54.900222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e9cc885-d5e8-4772-b40a-35dc52518f28 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:54.900962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e9cc885-d5e8-4772-b40a-35dc52518f28 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.048068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e9cc885-d5e8-4772-b40a-35dc52518f28 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:55.056687 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e9cc885-d5e8-4772-b40a-35dc52518f28 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1469 microversion: 2.1 time: 0.175950 Oct 11 04:16:55.057255 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 907/1750] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:54 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:55.100184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c349d61c-fc69-4834-aa7b-3ab76862502c tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:55.101710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c349d61c-fc69-4834-aa7b-3ab76862502c tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:55.109567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c349d61c-fc69-4834-aa7b-3ab76862502c tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.110916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c349d61c-fc69-4834-aa7b-3ab76862502c tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.111485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c349d61c-fc69-4834-aa7b-3ab76862502c tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.112827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c349d61c-fc69-4834-aa7b-3ab76862502c tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.113439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c349d61c-fc69-4834-aa7b-3ab76862502c tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.113879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c349d61c-fc69-4834-aa7b-3ab76862502c tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.137852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-698e7c1d-5837-44fd-bdff-a793b9def30b tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:55.138451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-698e7c1d-5837-44fd-bdff-a793b9def30b tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] [instance: f3ac8447-d6b5-4d2d-9779-74e534af0d4b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:55.145254 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-698e7c1d-5837-44fd-bdff-a793b9def30b tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] HTTP exception thrown: Instance f3ac8447-d6b5-4d2d-9779-74e534af0d4b could not be found. Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-698e7c1d-5837-44fd-bdff-a793b9def30b tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Request method failure captured: Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/f3ac8447-d6b5-4d2d-9779-74e534af0d4b/action HTTP/1.1 Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 15 Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO4lEShPw5g-498ZWtqdCuIVqEtoh-aH4Nz_md1wAT8brohT0CE0pHozub5_Xr3iGqAzfyVlw8a9MZcFvGz75JWWpJt5rTnIi3cS1TsbVbl-4POAw2w52KBamrEO5OlCdEB1be8zytx6u2xpizVqyUpcgk_eYsbmcJq4YqMmHcVlZgw Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 3c0101d38ed249a3a2f830dbf63bc61b Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3c0101d38ed249a3a2f830dbf63bc61b"}]}] Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 3c0101d38ed249a3a2f830dbf63bc61b Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAdminNegativeTestJSON-1481559362-project-admin Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 278e057d38e3488fa89709fe062a7f8a Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1481559362-project-admin Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: {"migrate": {}} Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance f3ac8447-d6b5-4d2d-9779-74e534af0d4b could not be found. Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'f3ac8447-d6b5-4d2d-9779-74e534af0d4b', 'body': {'migrate': {}}} Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3ac8447-d6b5-4d2d-9779-74e534af0d4b could not be found. Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 47, in _migrate Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id, Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3ac8447-d6b5-4d2d-9779-74e534af0d4b could not be found. Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:55.146923 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:55.151554 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:55.151554 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:55.151554 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:16:55.151554 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:16:55.151554 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3ac8447-d6b5-4d2d-9779-74e534af0d4b could not be found. Oct 11 04:16:55.151554 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:16:55.151554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-698e7c1d-5837-44fd-bdff-a793b9def30b tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Returning 404 to user: Instance f3ac8447-d6b5-4d2d-9779-74e534af0d4b could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:16:55.151554 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-698e7c1d-5837-44fd-bdff-a793b9def30b tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f3ac8447-d6b5-4d2d-9779-74e534af0d4b/action" status: 404 len: 111 microversion: 2.1 time: 0.071581 Oct 11 04:16:55.157242 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 844/1751] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:16:55 2022] POST /compute/v2.1/servers/f3ac8447-d6b5-4d2d-9779-74e534af0d4b/action => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:16:55.194477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c349d61c-fc69-4834-aa7b-3ab76862502c tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:55.203583 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c349d61c-fc69-4834-aa7b-3ab76862502c tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1223 microversion: 2.1 time: 0.108261 Oct 11 04:16:55.204465 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 908/1752] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:55 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1223 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:55.206601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-295265878", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:55.260022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:16:55.329536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4e7c6a09-2b41-41ef-a9ed-eecf6271f3ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:55.330299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4e7c6a09-2b41-41ef-a9ed-eecf6271f3ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:55.338131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7c6a09-2b41-41ef-a9ed-eecf6271f3ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.340921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7c6a09-2b41-41ef-a9ed-eecf6271f3ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.340921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7c6a09-2b41-41ef-a9ed-eecf6271f3ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.341148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7c6a09-2b41-41ef-a9ed-eecf6271f3ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.341585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7c6a09-2b41-41ef-a9ed-eecf6271f3ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.342016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7c6a09-2b41-41ef-a9ed-eecf6271f3ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.499821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4e7c6a09-2b41-41ef-a9ed-eecf6271f3ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:55.508912 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4e7c6a09-2b41-41ef-a9ed-eecf6271f3ac tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1525 microversion: 2.1 time: 0.184518 Oct 11 04:16:55.509493 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 909/1753] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:55 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1525 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:55.514181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-64228f10-2a59-43ca-9ff3-d1da45ec911a tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:55.515028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-64228f10-2a59-43ca-9ff3-d1da45ec911a tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:55.541997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64228f10-2a59-43ca-9ff3-d1da45ec911a tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.542929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64228f10-2a59-43ca-9ff3-d1da45ec911a tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.542929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64228f10-2a59-43ca-9ff3-d1da45ec911a tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.544495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64228f10-2a59-43ca-9ff3-d1da45ec911a tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.544621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64228f10-2a59-43ca-9ff3-d1da45ec911a tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.544966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64228f10-2a59-43ca-9ff3-d1da45ec911a tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.570380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:16:55.570901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:16:55.571473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:16:55.571954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:16:55.572542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:16:55.584526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.586248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.586768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.587581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.588258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.588631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.609678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Getting quotas for project 702da37a766e4613bceb0f78bc71df56. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:16:55.620610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Getting quotas for user cfa9dc90efcf4ba9a1edcc5c19a8f3c6 and project 702da37a766e4613bceb0f78bc71df56. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:16:55.636355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:16:55.638866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:16:55.717343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-64228f10-2a59-43ca-9ff3-d1da45ec911a tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:55.725386 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-64228f10-2a59-43ca-9ff3-d1da45ec911a tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1534 microversion: 2.1 time: 0.214687 Oct 11 04:16:55.730633 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 910/1754] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:55 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1534 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:55.732182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-864d921f-04c2-40d4-aa17-139abdd5cffd req-5a3fe93b-ce9d-4c52-a1ad-e908ce9705ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "22fb89fb-a3af-4372-a794-e1583259b555", "name": "network-vif-deleted", "tag": "fe0d100a-b7c1-4434-9679-422de267ee5e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:55.742225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-864d921f-04c2-40d4-aa17-139abdd5cffd req-5a3fe93b-ce9d-4c52-a1ad-e908ce9705ab service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.742712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-864d921f-04c2-40d4-aa17-139abdd5cffd req-5a3fe93b-ce9d-4c52-a1ad-e908ce9705ab service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.744691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-864d921f-04c2-40d4-aa17-139abdd5cffd req-5a3fe93b-ce9d-4c52-a1ad-e908ce9705ab service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.755602 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-864d921f-04c2-40d4-aa17-139abdd5cffd req-5a3fe93b-ce9d-4c52-a1ad-e908ce9705ab service nova] Creating event network-vif-deleted:fe0d100a-b7c1-4434-9679-422de267ee5e for instance 22fb89fb-a3af-4372-a794-e1583259b555 on n-h2-860892-1 Oct 11 04:16:55.760585 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-864d921f-04c2-40d4-aa17-139abdd5cffd req-5a3fe93b-ce9d-4c52-a1ad-e908ce9705ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033512 Oct 11 04:16:55.761273 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 911/1755] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:55.824532 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dfd4018c-c1a7-4b4d-967b-4e3dc3137b37 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.621733 Oct 11 04:16:55.825321 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 845/1756] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:16:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 623 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:16:55.838381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04b52cf7-6b97-4da7-9298-27dbcaf16c6f tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:55.839136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-04b52cf7-6b97-4da7-9298-27dbcaf16c6f tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:55.900813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a0ee0d14-2b1c-494c-b567-b694b524b086 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:55.901711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a0ee0d14-2b1c-494c-b567-b694b524b086 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:55.909356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-04b52cf7-6b97-4da7-9298-27dbcaf16c6f tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:55.915471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0ee0d14-2b1c-494c-b567-b694b524b086 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.917121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0ee0d14-2b1c-494c-b567-b694b524b086 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.917747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0ee0d14-2b1c-494c-b567-b694b524b086 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.918444 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04b52cf7-6b97-4da7-9298-27dbcaf16c6f tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1221 microversion: 2.1 time: 0.084221 Oct 11 04:16:55.920225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0ee0d14-2b1c-494c-b567-b694b524b086 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.920883 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 912/1757] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:55 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1221 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:55.921693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0ee0d14-2b1c-494c-b567-b694b524b086 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.926807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0ee0d14-2b1c-494c-b567-b694b524b086 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.927814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:55.928600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:55.944600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.945441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.946374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:55.947628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:55.948491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:55.949119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:56.130454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a0ee0d14-2b1c-494c-b567-b694b524b086 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:56.138902 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a0ee0d14-2b1c-494c-b567-b694b524b086 tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1298 microversion: 2.1 time: 0.241929 Oct 11 04:16:56.147482 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 846/1758] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:55 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1298 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:56.167557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:56.178491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:56.180366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:56.181784 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72c460fe-1e83-4944-93c3-cf8c99543278 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.259795 Oct 11 04:16:56.190221 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 913/1759] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:55 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:56.232885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bce50fff-03c7-4a70-83b3-4b1d51b08cd1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:56.233837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bce50fff-03c7-4a70-83b3-4b1d51b08cd1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:56.240677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bce50fff-03c7-4a70-83b3-4b1d51b08cd1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:56.241407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bce50fff-03c7-4a70-83b3-4b1d51b08cd1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:56.242032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bce50fff-03c7-4a70-83b3-4b1d51b08cd1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:56.243105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bce50fff-03c7-4a70-83b3-4b1d51b08cd1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:56.244572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bce50fff-03c7-4a70-83b3-4b1d51b08cd1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:56.245531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bce50fff-03c7-4a70-83b3-4b1d51b08cd1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:56.402968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bce50fff-03c7-4a70-83b3-4b1d51b08cd1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:56.412838 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bce50fff-03c7-4a70-83b3-4b1d51b08cd1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1215 microversion: 2.1 time: 0.189372 Oct 11 04:16:56.413593 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 847/1760] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:56 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1215 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:56.533296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-355c4852-b212-43b4-8ab1-869747a45519 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:56.534201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-355c4852-b212-43b4-8ab1-869747a45519 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:56.541808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c4852-b212-43b4-8ab1-869747a45519 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:56.542132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c4852-b212-43b4-8ab1-869747a45519 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:56.542604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c4852-b212-43b4-8ab1-869747a45519 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:56.543298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c4852-b212-43b4-8ab1-869747a45519 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:56.544298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c4852-b212-43b4-8ab1-869747a45519 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:56.544721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-355c4852-b212-43b4-8ab1-869747a45519 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:56.549319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:56.720166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-355c4852-b212-43b4-8ab1-869747a45519 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:56.730432 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-355c4852-b212-43b4-8ab1-869747a45519 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1525 microversion: 2.1 time: 0.200846 Oct 11 04:16:56.747152 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 914/1761] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:56 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1525 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:56.755875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-234ab2c1-0e93-4bf1-b9c3-9d6edd67aa1e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:56.756753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-234ab2c1-0e93-4bf1-b9c3-9d6edd67aa1e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:56.764367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234ab2c1-0e93-4bf1-b9c3-9d6edd67aa1e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:56.765298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234ab2c1-0e93-4bf1-b9c3-9d6edd67aa1e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:56.766179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234ab2c1-0e93-4bf1-b9c3-9d6edd67aa1e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:56.767593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234ab2c1-0e93-4bf1-b9c3-9d6edd67aa1e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:56.768094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234ab2c1-0e93-4bf1-b9c3-9d6edd67aa1e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:56.768526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-234ab2c1-0e93-4bf1-b9c3-9d6edd67aa1e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:56.944263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5840c16e-0a6b-4e1f-9db1-bd779c63abe4 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:56.945241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5840c16e-0a6b-4e1f-9db1-bd779c63abe4 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:56.999813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5840c16e-0a6b-4e1f-9db1-bd779c63abe4 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:57.008127 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5840c16e-0a6b-4e1f-9db1-bd779c63abe4 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1221 microversion: 2.1 time: 0.067795 Oct 11 04:16:57.010058 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 915/1762] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:56 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1221 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:57.125465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-234ab2c1-0e93-4bf1-b9c3-9d6edd67aa1e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:57.138411 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-234ab2c1-0e93-4bf1-b9c3-9d6edd67aa1e tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1534 microversion: 2.1 time: 0.390090 Oct 11 04:16:57.139453 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 848/1763] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:56 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1534 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:57.170983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:57.171694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:57.182123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:57.182731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:57.183323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:57.184100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:57.184743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:57.185960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:57.210231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:57.211452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:57.225485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:57.226797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:57.228310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:57.231935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:57.233122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:57.234008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:57.236461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:57.237012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:57.237643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:57.238220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lazy-loading 'fault' on Instance uuid 22fb89fb-a3af-4372-a794-e1583259b555 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:16:57.299594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a1df373e8ec14e2a84f0b8a62e0b884a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bcce9ce30d3a4a15985192c8e12c040c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:57.310149 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bbc4a8d2-a8e5-4307-9f63-990b535b814c tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 200 len: 1303 microversion: 2.1 time: 0.145484 Oct 11 04:16:57.338038 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 916/1764] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:57 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 1303 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:57.440836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7cb301ef-2eee-4cc0-9b91-a09422c5ef91 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:57.448333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7cb301ef-2eee-4cc0-9b91-a09422c5ef91 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:57.458014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cb301ef-2eee-4cc0-9b91-a09422c5ef91 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:57.458647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cb301ef-2eee-4cc0-9b91-a09422c5ef91 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:57.459487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cb301ef-2eee-4cc0-9b91-a09422c5ef91 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:57.460429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cb301ef-2eee-4cc0-9b91-a09422c5ef91 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:57.461251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cb301ef-2eee-4cc0-9b91-a09422c5ef91 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:57.462536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cb301ef-2eee-4cc0-9b91-a09422c5ef91 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:57.478857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:57.503275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:57.505081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:57.506156 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b0d9976b-fffd-4dde-9b7a-1b3a64035e83 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.301151 Oct 11 04:16:57.525042 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 849/1765] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:57 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:16:57.547353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7cb301ef-2eee-4cc0-9b91-a09422c5ef91 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:57.555692 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7cb301ef-2eee-4cc0-9b91-a09422c5ef91 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1271 microversion: 2.1 time: 0.121467 Oct 11 04:16:57.556306 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 917/1766] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:57 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1271 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:57.759555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-36f5b8d5-0f89-4664-bbe5-9a9a5fb936a8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:57.763679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-36f5b8d5-0f89-4664-bbe5-9a9a5fb936a8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:57.777869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36f5b8d5-0f89-4664-bbe5-9a9a5fb936a8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:57.778884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-8cd5c6af-0252-48db-9de2-f9d00c5894cd req-2b465282-d57b-4357-9e5e-7df99dd76498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15e3c3e6-a98f-4e56-a548-439d14a51e92", "name": "network-vif-deleted", "tag": "9ada40c6-66d1-4d89-a451-50125c8dfce0"}, {"server_uuid": "1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25", "name": "network-vif-deleted", "tag": "05914072-748c-496b-8be4-c8a95fdb871f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:57.785536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36f5b8d5-0f89-4664-bbe5-9a9a5fb936a8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:57.786863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36f5b8d5-0f89-4664-bbe5-9a9a5fb936a8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:57.789184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36f5b8d5-0f89-4664-bbe5-9a9a5fb936a8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:57.789908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8cd5c6af-0252-48db-9de2-f9d00c5894cd req-2b465282-d57b-4357-9e5e-7df99dd76498 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:57.790087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36f5b8d5-0f89-4664-bbe5-9a9a5fb936a8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:57.790405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8cd5c6af-0252-48db-9de2-f9d00c5894cd req-2b465282-d57b-4357-9e5e-7df99dd76498 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:57.790831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8cd5c6af-0252-48db-9de2-f9d00c5894cd req-2b465282-d57b-4357-9e5e-7df99dd76498 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:57.809626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36f5b8d5-0f89-4664-bbe5-9a9a5fb936a8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:57.819768 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8cd5c6af-0252-48db-9de2-f9d00c5894cd req-2b465282-d57b-4357-9e5e-7df99dd76498 service nova] Creating event network-vif-deleted:9ada40c6-66d1-4d89-a451-50125c8dfce0 for instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 on n-h1-860892-1 Oct 11 04:16:57.820267 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8cd5c6af-0252-48db-9de2-f9d00c5894cd req-2b465282-d57b-4357-9e5e-7df99dd76498 service nova] Creating event network-vif-deleted:05914072-748c-496b-8be4-c8a95fdb871f for instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 on n-h1-860892-1 Oct 11 04:16:57.821309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:57.846975 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-8cd5c6af-0252-48db-9de2-f9d00c5894cd req-2b465282-d57b-4357-9e5e-7df99dd76498 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.064506 Oct 11 04:16:57.847937 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 918/1767] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:16:57.981751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-36f5b8d5-0f89-4664-bbe5-9a9a5fb936a8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:57.991850 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-36f5b8d5-0f89-4664-bbe5-9a9a5fb936a8 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1309 microversion: 2.1 time: 0.236088 Oct 11 04:16:57.992880 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 850/1768] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:57 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1309 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:58.033554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b496207-0653-4129-a2a2-4dad8efcf0d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:58.034402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b496207-0653-4129-a2a2-4dad8efcf0d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:58.042556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b496207-0653-4129-a2a2-4dad8efcf0d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:58.043487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b496207-0653-4129-a2a2-4dad8efcf0d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:58.044808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b496207-0653-4129-a2a2-4dad8efcf0d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:58.045758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b496207-0653-4129-a2a2-4dad8efcf0d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:58.046632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b496207-0653-4129-a2a2-4dad8efcf0d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:58.048455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b496207-0653-4129-a2a2-4dad8efcf0d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:58.131369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b496207-0653-4129-a2a2-4dad8efcf0d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:58.140904 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b496207-0653-4129-a2a2-4dad8efcf0d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1225 microversion: 2.1 time: 0.112781 Oct 11 04:16:58.145461 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 919/1769] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:58 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1225 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:58.163173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:58.163790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:58.171672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:58.172437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:58.173232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:58.173943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:58.174631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:58.181235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:58.206332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:16:58.210382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:58.210866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:58.215801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:58.215801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lazy-loading 'fault' on Instance uuid 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:16:58.273112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:58.281434 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8bd6bd68-5d72-4ca4-b8e6-8a7d0f904051 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1318 microversion: 2.1 time: 0.122440 Oct 11 04:16:58.282224 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 851/1770] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:58 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1318 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:58.347701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:58.349508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] [instance: 22fb89fb-a3af-4372-a794-e1583259b555] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:58.363931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:58.363931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:58.363931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:58.363931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:58.363931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:58.363931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:58.380962 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] HTTP exception thrown: Instance 22fb89fb-a3af-4372-a794-e1583259b555 could not be found. Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Request method failure captured: Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 HTTP/1.1 Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjROzVXK0zaVQbhEX1-cTggS_6AF670oSjUyaWqNRNZ0AKjB4jOp4UmqRnZrRxpvEJCRG8ESeEkSohR0vbNNez8eTdxgu5C3lz83-lIlmo46HncDthZwdU_l69djUs4QZxOD6JVN8v9luoPVncLFGWaloRCOIWL6Xi7vGVgFgMxw1FQ6o Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: bcce9ce30d3a4a15985192c8e12c040c Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcce9ce30d3a4a15985192c8e12c040c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bcce9ce30d3a4a15985192c8e12c040c"}]}] Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: bcce9ce30d3a4a15985192c8e12c040c Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-MigrationsAdminTest-2070201961 Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-MigrationsAdminTest-2070201961-project Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a1df373e8ec14e2a84f0b8a62e0b884a Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-MigrationsAdminTest-2070201961-project Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 22fb89fb-a3af-4372-a794-e1583259b555 could not be found. Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '22fb89fb-a3af-4372-a794-e1583259b555'} Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 22fb89fb-a3af-4372-a794-e1583259b555 could not be found. Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 22fb89fb-a3af-4372-a794-e1583259b555 could not be found. Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:16:58.382823 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:58.399051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:16:58.399051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:16:58.399051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:16:58.399051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:16:58.399051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:16:58.399051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 22fb89fb-a3af-4372-a794-e1583259b555 could not be found. Oct 11 04:16:58.399051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:16:58.399051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] Returning 404 to user: Instance 22fb89fb-a3af-4372-a794-e1583259b555 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:16:58.399051 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-20a1dc30-0584-492b-972f-fcb8759c717a tempest-MigrationsAdminTest-2070201961 tempest-MigrationsAdminTest-2070201961-project] 10.222.0.26 "GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555" status: 404 len: 111 microversion: 2.1 time: 0.042607 Oct 11 04:16:58.399051 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 920/1771] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:58 2022] GET /compute/v2.1/servers/22fb89fb-a3af-4372-a794-e1583259b555 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:16:58.535639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:58.536382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:58.543547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:58.544101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:58.544542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:58.545525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:58.546014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:58.546666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:58.579812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d723bf41-414b-438f-b67a-5fee7b3e8248 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:58.580850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d723bf41-414b-438f-b67a-5fee7b3e8248 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:58.587416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d723bf41-414b-438f-b67a-5fee7b3e8248 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:58.588039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d723bf41-414b-438f-b67a-5fee7b3e8248 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:58.588485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d723bf41-414b-438f-b67a-5fee7b3e8248 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:58.589197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d723bf41-414b-438f-b67a-5fee7b3e8248 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:58.589651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d723bf41-414b-438f-b67a-5fee7b3e8248 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:58.590077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d723bf41-414b-438f-b67a-5fee7b3e8248 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:58.657933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d723bf41-414b-438f-b67a-5fee7b3e8248 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:58.667853 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d723bf41-414b-438f-b67a-5fee7b3e8248 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1277 microversion: 2.1 time: 0.091877 Oct 11 04:16:58.668421 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 921/1772] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:58 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1277 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:58.953473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:58.963141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:58.964683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:58.966233 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8935e95b-01c5-4bc9-b522-8a06abb58920 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.436042 Oct 11 04:16:58.967013 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 852/1773] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:58 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:16:59.016282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:59.016885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:59.023654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:59.024367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:59.024856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:59.025638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:59.026088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:59.026720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:59.062284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:59.062770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:59.063207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:59.063649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lazy-loading 'fault' on Instance uuid 15e3c3e6-a98f-4e56-a548-439d14a51e92 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:16:59.116995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:59.140905 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7c6d9b50-7244-4b7d-ae25-41582d47818b tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1314 microversion: 2.1 time: 0.128703 Oct 11 04:16:59.160130 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 922/1774] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:59 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:59.167773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b6231c7-1c85-4a1e-8534-29b579e1ff89 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:59.168382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0b6231c7-1c85-4a1e-8534-29b579e1ff89 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:59.175730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b6231c7-1c85-4a1e-8534-29b579e1ff89 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:59.176283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b6231c7-1c85-4a1e-8534-29b579e1ff89 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:59.176709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b6231c7-1c85-4a1e-8534-29b579e1ff89 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:59.177610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b6231c7-1c85-4a1e-8534-29b579e1ff89 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:59.178056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b6231c7-1c85-4a1e-8534-29b579e1ff89 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:59.178505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b6231c7-1c85-4a1e-8534-29b579e1ff89 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:59.305155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b6231c7-1c85-4a1e-8534-29b579e1ff89 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:59.306590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:59.318523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:59.319528 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0b6231c7-1c85-4a1e-8534-29b579e1ff89 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1217 microversion: 2.1 time: 0.155497 Oct 11 04:16:59.320659 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 853/1775] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:59 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1217 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:16:59.343973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:59.344518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:59.344949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:59.345639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:59.346103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:59.346931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:59.381555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:59.382031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:59.382487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:59.383109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lazy-loading 'fault' on Instance uuid 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:16:59.458024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6a00d408c2d04fb1b049a3de25519993', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bdb29de9961945fe8091982e974bb494', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:59.467753 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea8a954d-d8e3-4d78-837c-eaa528aba246 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 200 len: 1318 microversion: 2.1 time: 0.165629 Oct 11 04:16:59.470853 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 923/1776] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:59 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:59.698978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-802f1ce1-4b26-45ec-8e5c-0fa5ef8ee388 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:59.698978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-802f1ce1-4b26-45ec-8e5c-0fa5ef8ee388 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:16:59.703553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802f1ce1-4b26-45ec-8e5c-0fa5ef8ee388 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:59.704033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802f1ce1-4b26-45ec-8e5c-0fa5ef8ee388 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:59.704469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802f1ce1-4b26-45ec-8e5c-0fa5ef8ee388 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:59.705160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802f1ce1-4b26-45ec-8e5c-0fa5ef8ee388 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:59.705663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802f1ce1-4b26-45ec-8e5c-0fa5ef8ee388 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:59.706090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802f1ce1-4b26-45ec-8e5c-0fa5ef8ee388 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:59.771125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-802f1ce1-4b26-45ec-8e5c-0fa5ef8ee388 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:16:59.781144 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-802f1ce1-4b26-45ec-8e5c-0fa5ef8ee388 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1277 microversion: 2.1 time: 0.089061 Oct 11 04:16:59.792666 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 854/1777] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:16:59 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:16:59.892164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-38ba2820-8114-42c9-8e9c-c04bfafc1b7d req-abc54ed5-5c11-40fd-af67-d40a33787c29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eba839a6-aa74-4b1a-9393-a9538ec7b2db", "tag": "ca73f004-92ba-4147-9499-25e95594a322"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:16:59.905394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-38ba2820-8114-42c9-8e9c-c04bfafc1b7d req-abc54ed5-5c11-40fd-af67-d40a33787c29 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:16:59.906129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-38ba2820-8114-42c9-8e9c-c04bfafc1b7d req-abc54ed5-5c11-40fd-af67-d40a33787c29 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:16:59.906775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-38ba2820-8114-42c9-8e9c-c04bfafc1b7d req-abc54ed5-5c11-40fd-af67-d40a33787c29 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:16:59.923143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-38ba2820-8114-42c9-8e9c-c04bfafc1b7d req-abc54ed5-5c11-40fd-af67-d40a33787c29 service nova] Creating event network-changed:ca73f004-92ba-4147-9499-25e95594a322 for instance eba839a6-aa74-4b1a-9393-a9538ec7b2db on n-h2-860892-1 Oct 11 04:16:59.939711 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-38ba2820-8114-42c9-8e9c-c04bfafc1b7d req-abc54ed5-5c11-40fd-af67-d40a33787c29 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052514 Oct 11 04:16:59.943268 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 924/1778] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:16:59.993894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:16:59.997135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:00.001633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:00.002122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:00.006055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:00.010114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:00.010924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:00.013023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:00.175995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:00.176807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:00.188133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:00.188947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:00.189740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:00.190648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:00.192324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:00.193020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:00.238995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:00.239731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:00.240373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:00.240995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lazy-loading 'fault' on Instance uuid 15e3c3e6-a98f-4e56-a548-439d14a51e92 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:17:00.328799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab384b5b9a1b484bb001a06b0998f680', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '26ea13948bbf479386c8b9ee5e1aa5cf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:00.339560 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f009b679-b6d6-4fae-b02d-c154f0fe9bca tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 200 len: 1314 microversion: 2.1 time: 0.172390 Oct 11 04:17:00.342333 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 925/1779] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:00 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:00.374522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-86f9dc01-fd32-4db0-a6e9-f3eda5e6cf45 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:00.375776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-86f9dc01-fd32-4db0-a6e9-f3eda5e6cf45 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:00.394545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f9dc01-fd32-4db0-a6e9-f3eda5e6cf45 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:00.395721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f9dc01-fd32-4db0-a6e9-f3eda5e6cf45 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:00.397548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f9dc01-fd32-4db0-a6e9-f3eda5e6cf45 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:00.398328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f9dc01-fd32-4db0-a6e9-f3eda5e6cf45 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:00.398800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f9dc01-fd32-4db0-a6e9-f3eda5e6cf45 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:00.403667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86f9dc01-fd32-4db0-a6e9-f3eda5e6cf45 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:00.484547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-86f9dc01-fd32-4db0-a6e9-f3eda5e6cf45 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:00.495007 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-86f9dc01-fd32-4db0-a6e9-f3eda5e6cf45 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1273 microversion: 2.1 time: 0.138143 Oct 11 04:17:00.495521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:00.499281 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 926/1780] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:00 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1273 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:00.505052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:00.506032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:00.506469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] [instance: 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:00.507511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:00.508688 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-765e1abe-058c-4ac2-9579-379fe7569423 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.519049 Oct 11 04:17:00.509239 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 855/1781] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:16:59 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:00.519354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:00.520168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:00.520851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:00.522613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:00.523699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:00.525004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:00.541083 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] HTTP exception thrown: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Request method failure captured: Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 HTTP/1.1 Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO4EeQNCNgVATJPY3QLNWiVuRACsGjQrCUiJT_vzP_UZkH05WT5gXRLkCZaqJ-0QVHShzy230Q58azLxqdmdoPSBFJtVXq06FPAUVToY9dS6pNdoW_5m8a3nZlE56bOrtC7ycqhSfdgeZ-_Ckiv5vaGEJg4uj3wWk-HYvyNhbbXseLg Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: bdb29de9961945fe8091982e974bb494 Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestMultiTenantJSON-546702842 Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bdb29de9961945fe8091982e974bb494"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bdb29de9961945fe8091982e974bb494"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bdb29de9961945fe8091982e974bb494"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bdb29de9961945fe8091982e974bb494"}]}] Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestMultiTenantJSON-546702842 Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: bdb29de9961945fe8091982e974bb494 Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestMultiTenantJSON-546702842 Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestMultiTenantJSON-546702842-project Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 6a00d408c2d04fb1b049a3de25519993 Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestMultiTenantJSON-546702842-project Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25'} Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:17:00.543329 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:00.547790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:00.547790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:00.547790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:00.547790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:00.547790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:00.547790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:00.547790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:00.547790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. Oct 11 04:17:00.547790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:00.550456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] Returning 404 to user: Instance 1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:00.551602 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d8926525-d224-40fe-baf5-ea05003f8798 tempest-ServersNegativeTestMultiTenantJSON-546702842 tempest-ServersNegativeTestMultiTenantJSON-546702842-project] 10.222.0.26 "GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25" status: 404 len: 111 microversion: 2.1 time: 0.050975 Oct 11 04:17:00.552586 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 927/1782] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:00 2022] GET /compute/v2.1/servers/1401c7fe-4f0d-4b0f-831f-f3a4a8d2fa25 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:17:00.814355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4cc24723-0043-45a2-9a2e-e08c83c7083f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:00.815272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4cc24723-0043-45a2-9a2e-e08c83c7083f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:00.823933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cc24723-0043-45a2-9a2e-e08c83c7083f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:00.824423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cc24723-0043-45a2-9a2e-e08c83c7083f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:00.833434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cc24723-0043-45a2-9a2e-e08c83c7083f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:00.834534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cc24723-0043-45a2-9a2e-e08c83c7083f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:00.835183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cc24723-0043-45a2-9a2e-e08c83c7083f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:00.835956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cc24723-0043-45a2-9a2e-e08c83c7083f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:01.138087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4cc24723-0043-45a2-9a2e-e08c83c7083f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:01.151044 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4cc24723-0043-45a2-9a2e-e08c83c7083f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1319 microversion: 2.1 time: 0.340772 Oct 11 04:17:01.154434 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 856/1783] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:00 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:01.367112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:01.368302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] [instance: 15e3c3e6-a98f-4e56-a548-439d14a51e92] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:01.378005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:01.380582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:01.381534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:01.383867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:01.385263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:01.386159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:01.386933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:01.407747 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] HTTP exception thrown: Instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 could not be found. Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Request method failure captured: Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 HTTP/1.1 Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO3eKPeAlPeermk_00UJNdtrMz_eqsC4Otf73nv-kJTdm9jlMNQEAhzTVerAMi-hvaFptUfoGK4TtLjOFdjyroIPYRMlzS_FCDfN3xSPUe15oVx0cIfYw5elFIb6puOQvJ3x1N369Wfdw-0ljsaa1fzRzAZySBt-M7EOC7FVdVem7_k Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 26ea13948bbf479386c8b9ee5e1aa5cf Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FloatingIPsAssociationTestJSON-1854621729 Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/26ea13948bbf479386c8b9ee5e1aa5cf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_26ea13948bbf479386c8b9ee5e1aa5cf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26ea13948bbf479386c8b9ee5e1aa5cf"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/26ea13948bbf479386c8b9ee5e1aa5cf"}]}] Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FloatingIPsAssociationTestJSON-1854621729 Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 26ea13948bbf479386c8b9ee5e1aa5cf Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FloatingIPsAssociationTestJSON-1854621729 Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FloatingIPsAssociationTestJSON-1854621729-project Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: ab384b5b9a1b484bb001a06b0998f680 Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FloatingIPsAssociationTestJSON-1854621729-project Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 could not be found. Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '15e3c3e6-a98f-4e56-a548-439d14a51e92'} Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 could not be found. Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 could not be found. Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:01.411193 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:01.416793 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:01.416793 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:01.416793 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:01.416793 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:01.416793 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:01.416793 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:01.416793 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 could not be found. Oct 11 04:17:01.416793 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:01.423464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] Returning 404 to user: Instance 15e3c3e6-a98f-4e56-a548-439d14a51e92 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:01.423464 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-abae7647-b00e-465d-8638-c85445b071b6 tempest-FloatingIPsAssociationTestJSON-1854621729 tempest-FloatingIPsAssociationTestJSON-1854621729-project] 10.222.0.26 "GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92" status: 404 len: 111 microversion: 2.1 time: 0.059478 Oct 11 04:17:01.423464 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 928/1784] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:01 2022] GET /compute/v2.1/servers/15e3c3e6-a98f-4e56-a548-439d14a51e92 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:17:01.525961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-172fbc3c-64bf-482b-99d2-85439bf735d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:01.528568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-172fbc3c-64bf-482b-99d2-85439bf735d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:01.547914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:01.548518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:01.556749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:01.557245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:01.557702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:01.558440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:01.558895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:01.559348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:01.564082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-172fbc3c-64bf-482b-99d2-85439bf735d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:01.564579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-172fbc3c-64bf-482b-99d2-85439bf735d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:01.565021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-172fbc3c-64bf-482b-99d2-85439bf735d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:01.565732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-172fbc3c-64bf-482b-99d2-85439bf735d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:01.566178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-172fbc3c-64bf-482b-99d2-85439bf735d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:01.571028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-172fbc3c-64bf-482b-99d2-85439bf735d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:01.793223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:01.805895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:01.807364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:01.815885 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d3ea3dcd-1d30-491d-b8eb-20ccb2b02691 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.271884 Oct 11 04:17:01.816468 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 929/1785] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:01 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:17:01.900380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-172fbc3c-64bf-482b-99d2-85439bf735d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:01.911480 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-172fbc3c-64bf-482b-99d2-85439bf735d8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1291 microversion: 2.1 time: 0.391136 Oct 11 04:17:01.929312 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 857/1786] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:01 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1291 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:02.179724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-325ae8a2-41c4-4b35-907d-3c99d4ec70c4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:02.182217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-325ae8a2-41c4-4b35-907d-3c99d4ec70c4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:02.203976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-325ae8a2-41c4-4b35-907d-3c99d4ec70c4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:02.206568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-325ae8a2-41c4-4b35-907d-3c99d4ec70c4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:02.206951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-325ae8a2-41c4-4b35-907d-3c99d4ec70c4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:02.208909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-325ae8a2-41c4-4b35-907d-3c99d4ec70c4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:02.209586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-325ae8a2-41c4-4b35-907d-3c99d4ec70c4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:02.210024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-325ae8a2-41c4-4b35-907d-3c99d4ec70c4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:02.380163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c1ceaa8f-bd8f-4453-9702-a35103a783bb req-5eac7143-1289-4ab9-a351-8dc2f186a2f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa898108-1d05-4df5-8ecb-400b392a7d9e", "tag": "3d8f37de-d817-40fe-825d-b0a5851f473e"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:02.397970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c1ceaa8f-bd8f-4453-9702-a35103a783bb req-5eac7143-1289-4ab9-a351-8dc2f186a2f3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:02.403647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c1ceaa8f-bd8f-4453-9702-a35103a783bb req-5eac7143-1289-4ab9-a351-8dc2f186a2f3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:02.403647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c1ceaa8f-bd8f-4453-9702-a35103a783bb req-5eac7143-1289-4ab9-a351-8dc2f186a2f3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:02.411840 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c1ceaa8f-bd8f-4453-9702-a35103a783bb req-5eac7143-1289-4ab9-a351-8dc2f186a2f3 service nova] Creating event network-changed:3d8f37de-d817-40fe-825d-b0a5851f473e for instance fa898108-1d05-4df5-8ecb-400b392a7d9e on n-h1-860892-1 Oct 11 04:17:02.417564 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c1ceaa8f-bd8f-4453-9702-a35103a783bb req-5eac7143-1289-4ab9-a351-8dc2f186a2f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043709 Oct 11 04:17:02.419446 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 858/1787] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:17:02.610130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-325ae8a2-41c4-4b35-907d-3c99d4ec70c4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:02.639139 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-325ae8a2-41c4-4b35-907d-3c99d4ec70c4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1319 microversion: 2.1 time: 0.464639 Oct 11 04:17:02.643100 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 930/1788] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:02 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1319 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:02.853045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:02.853747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:02.884308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:02.885026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:02.885558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:02.886722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:02.887466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:02.888117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:02.945764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f0cd10e5-b0a3-4864-874d-9cc782259bbf tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:02.947954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f0cd10e5-b0a3-4864-874d-9cc782259bbf tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:02.958084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0cd10e5-b0a3-4864-874d-9cc782259bbf tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:02.962386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0cd10e5-b0a3-4864-874d-9cc782259bbf tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:02.962846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0cd10e5-b0a3-4864-874d-9cc782259bbf tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:02.967786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0cd10e5-b0a3-4864-874d-9cc782259bbf tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:02.968351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0cd10e5-b0a3-4864-874d-9cc782259bbf tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:02.969403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0cd10e5-b0a3-4864-874d-9cc782259bbf tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:03.728465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:03.740898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:03.742979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:03.744548 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5c8584ae-6cda-4840-bf43-2a45fddab783 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.898952 Oct 11 04:17:03.754944 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 859/1789] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:02 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:03.765483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f0cd10e5-b0a3-4864-874d-9cc782259bbf tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:03.778942 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f0cd10e5-b0a3-4864-874d-9cc782259bbf tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1321 microversion: 2.1 time: 0.845696 Oct 11 04:17:03.783893 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 931/1790] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:02 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1321 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:03.786868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6629260f-f27f-4ee0-af34-ca8c1e590aa1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:03.790090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6629260f-f27f-4ee0-af34-ca8c1e590aa1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:03.806577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6629260f-f27f-4ee0-af34-ca8c1e590aa1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:03.808031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6629260f-f27f-4ee0-af34-ca8c1e590aa1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:03.810443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6629260f-f27f-4ee0-af34-ca8c1e590aa1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:03.811375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6629260f-f27f-4ee0-af34-ca8c1e590aa1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:03.815053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6629260f-f27f-4ee0-af34-ca8c1e590aa1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:03.815053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6629260f-f27f-4ee0-af34-ca8c1e590aa1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:03.968587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dd0c8d29-81b2-428e-a591-08dd49051e91 tempest-QuotaClassesAdmin257Test-263962196 tempest-QuotaClassesAdmin257Test-263962196-project-admin] Calling method '.version_select at 0x7fda1e026280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:03.998655 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dd0c8d29-81b2-428e-a591-08dd49051e91 tempest-QuotaClassesAdmin257Test-263962196 tempest-QuotaClassesAdmin257Test-263962196-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 172 microversion: 2.57 time: 0.251290 Oct 11 04:17:04.000214 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 860/1791] 10.222.0.26 () {60 vars in 1226 bytes} [Tue Oct 11 04:17:03 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 172 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:17:04.011603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c8d7fbb7-d7e0-4acc-ac45-bd4e376edae9 tempest-QuotaClassesAdmin257Test-263962196 tempest-QuotaClassesAdmin257Test-263962196-project-admin] Action: 'update', calling method: .version_select at 0x7fda1e026670>, body: {"quota_class_set": {"cores": 120, "instances": 110, "key_pairs": 200, "metadata_items": 228, "ram": 51300, "server_group_members": 110, "server_groups": 110}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:04.227073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6629260f-f27f-4ee0-af34-ca8c1e590aa1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:04.241198 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6629260f-f27f-4ee0-af34-ca8c1e590aa1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1319 microversion: 2.1 time: 0.460315 Oct 11 04:17:04.248535 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 932/1792] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:03 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1319 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:04.728991 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c8d7fbb7-d7e0-4acc-ac45-bd4e376edae9 tempest-QuotaClassesAdmin257Test-263962196 tempest-QuotaClassesAdmin257Test-263962196-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 159 microversion: 2.57 time: 0.721258 Oct 11 04:17:04.732211 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 861/1793] 10.222.0.26 () {62 vars in 1247 bytes} [Tue Oct 11 04:17:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 159 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:17:04.743735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5203ec79-ed44-43c4-b0ce-4e6b31309361 tempest-QuotaClassesAdmin257Test-263962196 tempest-QuotaClassesAdmin257Test-263962196-project-admin] Calling method '.version_select at 0x7fda1a059790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:04.759685 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5203ec79-ed44-43c4-b0ce-4e6b31309361 tempest-QuotaClassesAdmin257Test-263962196 tempest-QuotaClassesAdmin257Test-263962196-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-class-sets/default" status: 200 len: 176 microversion: 2.57 time: 0.020514 Oct 11 04:17:04.760917 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 933/1794] 10.222.0.26 () {60 vars in 1226 bytes} [Tue Oct 11 04:17:04 2022] GET /compute/v2.1/os-quota-class-sets/default => generated 176 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:17:04.779709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-378e5193-9830-4913-b4d9-83dc1babced3 tempest-QuotaClassesAdmin257Test-263962196 tempest-QuotaClassesAdmin257Test-263962196-project-admin] Action: 'update', calling method: .version_select at 0x7fda1e06c040>, body: {"quota_class_set": {"cores": 20, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "server_group_members": 10, "server_groups": 10}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:04.792697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:04.793386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:04.799657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:04.800465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:04.800892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:04.801666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:04.802056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:04.802531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:05.193862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:05.201627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:05.216682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:05.222054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:05.224886 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-706fdb14-4c86-4fba-bc17-9b60f9a205c5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.447142 Oct 11 04:17:05.226243 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 934/1795] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:04 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:05.242521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e5325eb-8fb0-4017-9f53-e7648f9328a5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:05.243386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e5325eb-8fb0-4017-9f53-e7648f9328a5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:05.254128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5325eb-8fb0-4017-9f53-e7648f9328a5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:05.254968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5325eb-8fb0-4017-9f53-e7648f9328a5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:05.255924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5325eb-8fb0-4017-9f53-e7648f9328a5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:05.256997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5325eb-8fb0-4017-9f53-e7648f9328a5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:05.258212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5325eb-8fb0-4017-9f53-e7648f9328a5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:05.258741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5325eb-8fb0-4017-9f53-e7648f9328a5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:05.484369 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-378e5193-9830-4913-b4d9-83dc1babced3 tempest-QuotaClassesAdmin257Test-263962196 tempest-QuotaClassesAdmin257Test-263962196-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-class-sets/default" status: 200 len: 155 microversion: 2.57 time: 0.712571 Oct 11 04:17:05.516266 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 862/1796] 10.222.0.26 () {62 vars in 1247 bytes} [Tue Oct 11 04:17:04 2022] PUT /compute/v2.1/os-quota-class-sets/default => generated 155 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:17:05.538563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ab10a725-1000-437e-baf8-784412a395dc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:05.539189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ab10a725-1000-437e-baf8-784412a395dc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:05.555864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab10a725-1000-437e-baf8-784412a395dc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:05.556701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab10a725-1000-437e-baf8-784412a395dc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:05.557341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab10a725-1000-437e-baf8-784412a395dc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:05.558267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab10a725-1000-437e-baf8-784412a395dc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:05.559431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab10a725-1000-437e-baf8-784412a395dc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:05.560039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab10a725-1000-437e-baf8-784412a395dc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:05.604422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:05.716459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e5325eb-8fb0-4017-9f53-e7648f9328a5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:05.725157 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e5325eb-8fb0-4017-9f53-e7648f9328a5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1321 microversion: 2.1 time: 0.497258 Oct 11 04:17:05.726107 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 935/1797] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:05 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1321 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:05.747648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-001c2361-43e5-476d-9448-6e0cfee4c045 req-00dc3919-9e88-4eb0-a566-e8bd6d75e1b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc", "tag": "c399ee2e-f46f-4457-ae42-b9fe637a2dbe"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:05.774486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-001c2361-43e5-476d-9448-6e0cfee4c045 req-00dc3919-9e88-4eb0-a566-e8bd6d75e1b5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:05.775220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-001c2361-43e5-476d-9448-6e0cfee4c045 req-00dc3919-9e88-4eb0-a566-e8bd6d75e1b5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:05.775899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-001c2361-43e5-476d-9448-6e0cfee4c045 req-00dc3919-9e88-4eb0-a566-e8bd6d75e1b5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:05.802239 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-001c2361-43e5-476d-9448-6e0cfee4c045 req-00dc3919-9e88-4eb0-a566-e8bd6d75e1b5 service nova] Creating event network-changed:c399ee2e-f46f-4457-ae42-b9fe637a2dbe for instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc on n-h1-860892-1 Oct 11 04:17:05.813792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab10a725-1000-437e-baf8-784412a395dc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:05.814302 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-001c2361-43e5-476d-9448-6e0cfee4c045 req-00dc3919-9e88-4eb0-a566-e8bd6d75e1b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086747 Oct 11 04:17:05.817085 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 936/1798] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:05.828946 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ab10a725-1000-437e-baf8-784412a395dc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1319 microversion: 2.1 time: 0.310620 Oct 11 04:17:05.843882 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 863/1799] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:05 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:06.165891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-9413d603-a063-4a96-b8e9-da29f765c4fa req-c738e1ce-b4a6-4a4f-a87f-06bc852c023f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba839a6-aa74-4b1a-9393-a9538ec7b2db", "name": "network-vif-plugged", "status": "completed", "tag": "ca73f004-92ba-4147-9499-25e95594a322"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:06.183477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9413d603-a063-4a96-b8e9-da29f765c4fa req-c738e1ce-b4a6-4a4f-a87f-06bc852c023f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:06.185862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9413d603-a063-4a96-b8e9-da29f765c4fa req-c738e1ce-b4a6-4a4f-a87f-06bc852c023f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:06.186561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9413d603-a063-4a96-b8e9-da29f765c4fa req-c738e1ce-b4a6-4a4f-a87f-06bc852c023f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:06.214211 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-9413d603-a063-4a96-b8e9-da29f765c4fa req-c738e1ce-b4a6-4a4f-a87f-06bc852c023f service nova] Creating event network-vif-plugged:ca73f004-92ba-4147-9499-25e95594a322 for instance eba839a6-aa74-4b1a-9393-a9538ec7b2db on n-h2-860892-1 Oct 11 04:17:06.220166 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-9413d603-a063-4a96-b8e9-da29f765c4fa req-c738e1ce-b4a6-4a4f-a87f-06bc852c023f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064656 Oct 11 04:17:06.221316 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 937/1800] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:06.265588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:06.266432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:06.285647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:06.288973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:06.289653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:06.290596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:06.293239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:06.294173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:06.726335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:06.748761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:06.748761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:06.748761 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bb635924-208b-49e6-937a-77b2990050cc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.490501 Oct 11 04:17:06.748761 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 864/1801] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:06 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:06.750962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33fa1882-6a7d-4f4b-95b8-a7e28af3ba6e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:06.752228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-33fa1882-6a7d-4f4b-95b8-a7e28af3ba6e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:06.760416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33fa1882-6a7d-4f4b-95b8-a7e28af3ba6e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:06.761476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33fa1882-6a7d-4f4b-95b8-a7e28af3ba6e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:06.763509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33fa1882-6a7d-4f4b-95b8-a7e28af3ba6e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:06.764324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33fa1882-6a7d-4f4b-95b8-a7e28af3ba6e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:06.764890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33fa1882-6a7d-4f4b-95b8-a7e28af3ba6e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:06.765753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33fa1882-6a7d-4f4b-95b8-a7e28af3ba6e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:06.856978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92489f9e-ac3a-49ce-92d0-0280f6e8058e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:06.858742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-92489f9e-ac3a-49ce-92d0-0280f6e8058e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:06.866456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92489f9e-ac3a-49ce-92d0-0280f6e8058e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:06.869405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92489f9e-ac3a-49ce-92d0-0280f6e8058e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:06.869405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92489f9e-ac3a-49ce-92d0-0280f6e8058e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:06.869405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92489f9e-ac3a-49ce-92d0-0280f6e8058e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:06.869405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92489f9e-ac3a-49ce-92d0-0280f6e8058e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:06.871795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92489f9e-ac3a-49ce-92d0-0280f6e8058e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:07.271359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-33fa1882-6a7d-4f4b-95b8-a7e28af3ba6e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:07.281312 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-33fa1882-6a7d-4f4b-95b8-a7e28af3ba6e tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1321 microversion: 2.1 time: 0.535618 Oct 11 04:17:07.290649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92489f9e-ac3a-49ce-92d0-0280f6e8058e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:07.292279 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 938/1802] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:06 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1321 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:07.304880 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92489f9e-ac3a-49ce-92d0-0280f6e8058e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1319 microversion: 2.1 time: 0.453042 Oct 11 04:17:07.305612 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 865/1803] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:06 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1319 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:07.776921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:07.781146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:07.796963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:07.805948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:07.807635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:07.809140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:07.809942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:07.810700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:08.039016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:08.055900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:08.055900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:08.057336 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab5a9d34-773e-49f4-bf9a-b5af2b081950 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.289427 Oct 11 04:17:08.059568 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 939/1804] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:07 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:08.307825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-107b4926-4c85-4706-a348-d22709fbfec9 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:08.308459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-107b4926-4c85-4706-a348-d22709fbfec9 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:08.317063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-107b4926-4c85-4706-a348-d22709fbfec9 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:08.317559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-107b4926-4c85-4706-a348-d22709fbfec9 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:08.317990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-107b4926-4c85-4706-a348-d22709fbfec9 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:08.319033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-107b4926-4c85-4706-a348-d22709fbfec9 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:08.319666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-107b4926-4c85-4706-a348-d22709fbfec9 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:08.320122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-107b4926-4c85-4706-a348-d22709fbfec9 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:08.328885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d6a6887-6ff1-49d8-ab00-738fc4214bc1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:08.336471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d6a6887-6ff1-49d8-ab00-738fc4214bc1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:08.336471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d6a6887-6ff1-49d8-ab00-738fc4214bc1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:08.337616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d6a6887-6ff1-49d8-ab00-738fc4214bc1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:08.338049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d6a6887-6ff1-49d8-ab00-738fc4214bc1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:08.339015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d6a6887-6ff1-49d8-ab00-738fc4214bc1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:08.339626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d6a6887-6ff1-49d8-ab00-738fc4214bc1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:08.340794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d6a6887-6ff1-49d8-ab00-738fc4214bc1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:08.540500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d6a6887-6ff1-49d8-ab00-738fc4214bc1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:08.551487 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d6a6887-6ff1-49d8-ab00-738fc4214bc1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1319 microversion: 2.1 time: 0.226437 Oct 11 04:17:08.566214 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 940/1805] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:08 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:08.782810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-107b4926-4c85-4706-a348-d22709fbfec9 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:08.791153 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-107b4926-4c85-4706-a348-d22709fbfec9 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1321 microversion: 2.1 time: 0.487275 Oct 11 04:17:08.791750 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 866/1806] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:08 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1321 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:09.085186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:09.085797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:09.092615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:09.093102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:09.093535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:09.094247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:09.094916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:09.095346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:09.253313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:09.262784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:09.270385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:09.270385 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b29c52f-e576-4885-9c8f-391f48b4978d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.185063 Oct 11 04:17:09.270385 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 941/1807] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:09 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:09.576946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2725f3dd-f5ca-42e2-ab1e-b5ba5a5753aa tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:09.578287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2725f3dd-f5ca-42e2-ab1e-b5ba5a5753aa tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:09.589374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2725f3dd-f5ca-42e2-ab1e-b5ba5a5753aa tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:09.590297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2725f3dd-f5ca-42e2-ab1e-b5ba5a5753aa tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:09.591713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2725f3dd-f5ca-42e2-ab1e-b5ba5a5753aa tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:09.597247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2725f3dd-f5ca-42e2-ab1e-b5ba5a5753aa tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:09.597247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2725f3dd-f5ca-42e2-ab1e-b5ba5a5753aa tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:09.597247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2725f3dd-f5ca-42e2-ab1e-b5ba5a5753aa tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:09.775623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2725f3dd-f5ca-42e2-ab1e-b5ba5a5753aa tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:09.784118 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2725f3dd-f5ca-42e2-ab1e-b5ba5a5753aa tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1319 microversion: 2.1 time: 0.212162 Oct 11 04:17:09.798747 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 867/1808] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:09 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1319 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:09.816167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b5f7fda-4a39-46ea-b5ac-f3af23a996a2 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:09.816951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b5f7fda-4a39-46ea-b5ac-f3af23a996a2 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:09.826859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5f7fda-4a39-46ea-b5ac-f3af23a996a2 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:09.827659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5f7fda-4a39-46ea-b5ac-f3af23a996a2 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:09.828096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5f7fda-4a39-46ea-b5ac-f3af23a996a2 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:09.828826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5f7fda-4a39-46ea-b5ac-f3af23a996a2 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:09.829279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5f7fda-4a39-46ea-b5ac-f3af23a996a2 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:09.830041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5f7fda-4a39-46ea-b5ac-f3af23a996a2 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:10.088731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b5f7fda-4a39-46ea-b5ac-f3af23a996a2 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:10.102906 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b5f7fda-4a39-46ea-b5ac-f3af23a996a2 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1321 microversion: 2.1 time: 0.291229 Oct 11 04:17:10.120777 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 942/1809] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:09 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1321 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:10.123990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-06da8078-e37c-4e67-8d8a-c3a821be0514 req-38ff1539-2f8a-4cde-899e-ab2703dad082 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa898108-1d05-4df5-8ecb-400b392a7d9e", "name": "network-vif-plugged", "status": "completed", "tag": "3d8f37de-d817-40fe-825d-b0a5851f473e"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:10.135502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-06da8078-e37c-4e67-8d8a-c3a821be0514 req-38ff1539-2f8a-4cde-899e-ab2703dad082 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:10.136264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-06da8078-e37c-4e67-8d8a-c3a821be0514 req-38ff1539-2f8a-4cde-899e-ab2703dad082 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:10.137602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-06da8078-e37c-4e67-8d8a-c3a821be0514 req-38ff1539-2f8a-4cde-899e-ab2703dad082 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:10.164333 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-06da8078-e37c-4e67-8d8a-c3a821be0514 req-38ff1539-2f8a-4cde-899e-ab2703dad082 service nova] Creating event network-vif-plugged:3d8f37de-d817-40fe-825d-b0a5851f473e for instance fa898108-1d05-4df5-8ecb-400b392a7d9e on n-h1-860892-1 Oct 11 04:17:10.171417 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-06da8078-e37c-4e67-8d8a-c3a821be0514 req-38ff1539-2f8a-4cde-899e-ab2703dad082 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054629 Oct 11 04:17:10.172295 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 868/1810] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:17:10.294952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:10.295984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:10.302957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:10.304773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:10.305368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:10.305911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:10.306934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:10.307732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:10.308568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:10.557323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:10.565362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:10.567455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:10.571251 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9df0e5f3-b0c5-4266-a6a6-d12a8a5aedd3 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.281018 Oct 11 04:17:10.571251 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 943/1811] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:10 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:10.808715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a95882ee-4914-43fe-98ad-022354a96d55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:10.809756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a95882ee-4914-43fe-98ad-022354a96d55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:10.818042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95882ee-4914-43fe-98ad-022354a96d55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:10.818819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95882ee-4914-43fe-98ad-022354a96d55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:10.819429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95882ee-4914-43fe-98ad-022354a96d55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:10.820538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95882ee-4914-43fe-98ad-022354a96d55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:10.821174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95882ee-4914-43fe-98ad-022354a96d55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:10.821752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a95882ee-4914-43fe-98ad-022354a96d55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:11.099667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a95882ee-4914-43fe-98ad-022354a96d55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:11.111616 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a95882ee-4914-43fe-98ad-022354a96d55 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1319 microversion: 2.1 time: 0.303534 Oct 11 04:17:11.111616 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 869/1812] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:10 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1319 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:11.131705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a884a72b-e98d-4880-aa99-9c943f9e4a19 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:11.133441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a884a72b-e98d-4880-aa99-9c943f9e4a19 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:11.141045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a884a72b-e98d-4880-aa99-9c943f9e4a19 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:11.144102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a884a72b-e98d-4880-aa99-9c943f9e4a19 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:11.144102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a884a72b-e98d-4880-aa99-9c943f9e4a19 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:11.144102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a884a72b-e98d-4880-aa99-9c943f9e4a19 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:11.144102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a884a72b-e98d-4880-aa99-9c943f9e4a19 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:11.144102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a884a72b-e98d-4880-aa99-9c943f9e4a19 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:11.389472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a884a72b-e98d-4880-aa99-9c943f9e4a19 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:11.397977 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a884a72b-e98d-4880-aa99-9c943f9e4a19 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1321 microversion: 2.1 time: 0.271008 Oct 11 04:17:11.413222 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 944/1813] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:11 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1321 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:11.595217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:11.596257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:11.603160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:11.603746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:11.604359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:11.605083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:11.606346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:11.606903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:12.051675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:12.055998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:12.063610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:12.065414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:12.066782 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f049cf3c-b03a-4a0c-ac5f-5d31955e3c9b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1813 microversion: 2.25 time: 0.475462 Oct 11 04:17:12.067558 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 870/1814] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:11 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1813 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:17:12.130971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a0942cb9-f41e-486d-9030-ab862458a841 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:12.131580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a0942cb9-f41e-486d-9030-ab862458a841 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:12.138667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0942cb9-f41e-486d-9030-ab862458a841 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:12.139848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0942cb9-f41e-486d-9030-ab862458a841 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:12.140288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0942cb9-f41e-486d-9030-ab862458a841 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:12.140994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0942cb9-f41e-486d-9030-ab862458a841 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:12.141438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0942cb9-f41e-486d-9030-ab862458a841 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:12.142042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0942cb9-f41e-486d-9030-ab862458a841 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:12.287833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a0942cb9-f41e-486d-9030-ab862458a841 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:12.296615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a0942cb9-f41e-486d-9030-ab862458a841 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1319 microversion: 2.1 time: 0.170119 Oct 11 04:17:12.297286 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 945/1815] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:12 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:12.423319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dc0a2c6d-167e-42e2-94c3-c1f8d8d66276 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:12.424664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dc0a2c6d-167e-42e2-94c3-c1f8d8d66276 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:12.430594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0a2c6d-167e-42e2-94c3-c1f8d8d66276 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:12.431077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0a2c6d-167e-42e2-94c3-c1f8d8d66276 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:12.431503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0a2c6d-167e-42e2-94c3-c1f8d8d66276 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:12.432376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0a2c6d-167e-42e2-94c3-c1f8d8d66276 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:12.432988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0a2c6d-167e-42e2-94c3-c1f8d8d66276 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:12.433613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0a2c6d-167e-42e2-94c3-c1f8d8d66276 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:12.817975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc0a2c6d-167e-42e2-94c3-c1f8d8d66276 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:12.825952 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dc0a2c6d-167e-42e2-94c3-c1f8d8d66276 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1321 microversion: 2.1 time: 0.406274 Oct 11 04:17:12.826527 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 871/1816] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:12 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1321 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:13.093899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:13.095002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:13.102609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.103285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.103914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.105111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.106764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.107413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.321859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e64b7d06-6d05-4beb-a93d-e21938afb66f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:13.322585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e64b7d06-6d05-4beb-a93d-e21938afb66f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:13.337045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e64b7d06-6d05-4beb-a93d-e21938afb66f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.339047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e64b7d06-6d05-4beb-a93d-e21938afb66f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.339906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e64b7d06-6d05-4beb-a93d-e21938afb66f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.341540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e64b7d06-6d05-4beb-a93d-e21938afb66f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.344922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e64b7d06-6d05-4beb-a93d-e21938afb66f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.345793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e64b7d06-6d05-4beb-a93d-e21938afb66f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.436731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:13.448523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:13.452455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:13.470689 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6bff68ba-bc45-4b52-90ac-4ba2a201e937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1803 microversion: 2.25 time: 0.381455 Oct 11 04:17:13.475164 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 946/1817] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:13 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1803 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:13.505894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b40c7ac0-1e88-4330-8809-7d73e95d663b tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '.version_select at 0x7fda1dfc9ca0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:13.524539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40c7ac0-1e88-4330-8809-7d73e95d663b tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.530101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40c7ac0-1e88-4330-8809-7d73e95d663b tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.531193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40c7ac0-1e88-4330-8809-7d73e95d663b tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.553448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b40c7ac0-1e88-4330-8809-7d73e95d663b tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1520 microversion: 2.25 time: 0.056326 Oct 11 04:17:13.565706 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 947/1818] 10.222.0.26 () {60 vars in 1184 bytes} [Tue Oct 11 04:17:13 2022] GET /compute/v2.1/os-migrations => generated 1520 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:13.572761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f68daf44-0cec-4058-905f-a2f04e9b897f tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:13.578325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f68daf44-0cec-4058-905f-a2f04e9b897f tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:13.592960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f68daf44-0cec-4058-905f-a2f04e9b897f tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.593772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f68daf44-0cec-4058-905f-a2f04e9b897f tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.594480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f68daf44-0cec-4058-905f-a2f04e9b897f tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.595453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f68daf44-0cec-4058-905f-a2f04e9b897f tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.596127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f68daf44-0cec-4058-905f-a2f04e9b897f tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.596787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f68daf44-0cec-4058-905f-a2f04e9b897f tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.658017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e64b7d06-6d05-4beb-a93d-e21938afb66f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:13.666072 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e64b7d06-6d05-4beb-a93d-e21938afb66f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1468 microversion: 2.1 time: 0.350414 Oct 11 04:17:13.669651 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 872/1819] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:13 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1468 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:13.692305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4ee17f74-095a-4983-8d61-95e54dfd8c2f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:13.692907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4ee17f74-095a-4983-8d61-95e54dfd8c2f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: eba839a6-aa74-4b1a-9393-a9538ec7b2db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:13.703769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ee17f74-095a-4983-8d61-95e54dfd8c2f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.704600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ee17f74-095a-4983-8d61-95e54dfd8c2f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.707484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ee17f74-095a-4983-8d61-95e54dfd8c2f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.707484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ee17f74-095a-4983-8d61-95e54dfd8c2f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.707839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ee17f74-095a-4983-8d61-95e54dfd8c2f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.708328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ee17f74-095a-4983-8d61-95e54dfd8c2f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.847140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-f68daf44-0cec-4058-905f-a2f04e9b897f tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid f4133104-80ff-4629-bf97-1d0c7441fbfd {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:17:13.876740 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f68daf44-0cec-4058-905f-a2f04e9b897f tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 2422 microversion: 2.25 time: 0.302929 Oct 11 04:17:13.877978 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 948/1820] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:13 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 2422 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:13.900430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-950eef12-02fa-43eb-9f6d-c2f9bc12a36a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:13.902754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-950eef12-02fa-43eb-9f6d-c2f9bc12a36a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:13.914717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-950eef12-02fa-43eb-9f6d-c2f9bc12a36a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.916044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-950eef12-02fa-43eb-9f6d-c2f9bc12a36a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.916720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-950eef12-02fa-43eb-9f6d-c2f9bc12a36a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.917785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-950eef12-02fa-43eb-9f6d-c2f9bc12a36a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.918473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-950eef12-02fa-43eb-9f6d-c2f9bc12a36a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.919231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-950eef12-02fa-43eb-9f6d-c2f9bc12a36a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.938296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ee17f74-095a-4983-8d61-95e54dfd8c2f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:13.949552 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4ee17f74-095a-4983-8d61-95e54dfd8c2f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db" status: 200 len: 1469 microversion: 2.1 time: 0.260723 Oct 11 04:17:13.951943 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 873/1821] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:13 2022] GET /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db => generated 1469 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:13.976738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d65a976d-48bd-4bb6-af44-990a0f9ce09a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:13.978276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d65a976d-48bd-4bb6-af44-990a0f9ce09a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:13.995380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d65a976d-48bd-4bb6-af44-990a0f9ce09a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:13.997758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d65a976d-48bd-4bb6-af44-990a0f9ce09a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:13.998475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d65a976d-48bd-4bb6-af44-990a0f9ce09a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:13.999371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d65a976d-48bd-4bb6-af44-990a0f9ce09a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:14.000831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d65a976d-48bd-4bb6-af44-990a0f9ce09a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:14.001690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d65a976d-48bd-4bb6-af44-990a0f9ce09a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:14.201894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-d65a976d-48bd-4bb6-af44-990a0f9ce09a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid f4133104-80ff-4629-bf97-1d0c7441fbfd {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:17:14.216515 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d65a976d-48bd-4bb6-af44-990a0f9ce09a tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 2422 microversion: 2.25 time: 0.263199 Oct 11 04:17:14.217106 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 874/1822] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:13 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 2422 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:14.221679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:14.226901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:14.227790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Searching by: {'reservation_id': 'r-xhy6iif7', 'deleted': False, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:17:14.233431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:14.233905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:14.234372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:14.235120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:14.235609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:14.236436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:14.351129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:17:14.436128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:14.451394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:14.451992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:14.452533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:14.625012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-950eef12-02fa-43eb-9f6d-c2f9bc12a36a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:14.633627 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-950eef12-02fa-43eb-9f6d-c2f9bc12a36a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1321 microversion: 2.1 time: 0.753749 Oct 11 04:17:14.650000 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 949/1823] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:13 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1321 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:14.655047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff22df49-68fe-4fdd-91c0-012114b00052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:14.655568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ff22df49-68fe-4fdd-91c0-012114b00052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:14.662293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff22df49-68fe-4fdd-91c0-012114b00052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:14.662293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff22df49-68fe-4fdd-91c0-012114b00052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:14.662758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff22df49-68fe-4fdd-91c0-012114b00052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:14.663717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff22df49-68fe-4fdd-91c0-012114b00052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:14.666687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff22df49-68fe-4fdd-91c0-012114b00052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:14.667465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff22df49-68fe-4fdd-91c0-012114b00052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:14.711944 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6faacec2-80b8-434c-8392-2d3765b16277 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?reservation_id=r-xhy6iif7" status: 200 len: 2930 microversion: 2.1 time: 0.493626 Oct 11 04:17:14.712522 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 875/1824] 10.222.0.26 () {58 vars in 1197 bytes} [Tue Oct 11 04:17:14 2022] GET /compute/v2.1/servers/detail?reservation_id=r-xhy6iif7 => generated 2930 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:14.741744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ecb4b29-b31a-4d50-98a2-e54fb24672bd tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:14.768501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.compute.server_groups [None req-5ecb4b29-b31a-4d50-98a2-e54fb24672bd tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Querying cell 7f919055-bb4c-4077-93f0-960b402ab88d(cell1) for 2 instances {{(pid=120993) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 04:17:14.769377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ecb4b29-b31a-4d50-98a2-e54fb24672bd tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:14.769854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ecb4b29-b31a-4d50-98a2-e54fb24672bd tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:14.770322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ecb4b29-b31a-4d50-98a2-e54fb24672bd tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:14.778554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=38 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:14.805889 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ecb4b29-b31a-4d50-98a2-e54fb24672bd tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/3ca432a7-1fef-4079-8b0f-d93548027b7b" status: 200 len: 271 microversion: 2.1 time: 0.067975 Oct 11 04:17:14.813318 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 876/1825] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:17:14 2022] GET /compute/v2.1/os-server-groups/3ca432a7-1fef-4079-8b0f-d93548027b7b => generated 271 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:17:14.818381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b8f87f8-d9f2-43cd-a3c8-65c7bc6057f8 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:14.819009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2b8f87f8-d9f2-43cd-a3c8-65c7bc6057f8 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] [instance: eba839a6-aa74-4b1a-9393-a9538ec7b2db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:14.826684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b8f87f8-d9f2-43cd-a3c8-65c7bc6057f8 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:14.827364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b8f87f8-d9f2-43cd-a3c8-65c7bc6057f8 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:14.827800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b8f87f8-d9f2-43cd-a3c8-65c7bc6057f8 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:14.828516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b8f87f8-d9f2-43cd-a3c8-65c7bc6057f8 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:14.828962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b8f87f8-d9f2-43cd-a3c8-65c7bc6057f8 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:14.829384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b8f87f8-d9f2-43cd-a3c8-65c7bc6057f8 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:14.876433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-ff22df49-68fe-4fdd-91c0-012114b00052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lazy-loading 'services' on Instance uuid f4133104-80ff-4629-bf97-1d0c7441fbfd {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:17:15.031714 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b8f87f8-d9f2-43cd-a3c8-65c7bc6057f8 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db" status: 200 len: 1620 microversion: 2.1 time: 0.217242 Oct 11 04:17:15.032363 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 877/1826] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:14 2022] GET /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db => generated 1620 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:15.054774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e4f9f3b8-5bc5-4ccf-b2f9-f6f514402b4d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:15.055403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e4f9f3b8-5bc5-4ccf-b2f9-f6f514402b4d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:15.062085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3b8-5bc5-4ccf-b2f9-f6f514402b4d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:15.062608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3b8-5bc5-4ccf-b2f9-f6f514402b4d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:15.063042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3b8-5bc5-4ccf-b2f9-f6f514402b4d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:15.063746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3b8-5bc5-4ccf-b2f9-f6f514402b4d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:15.064228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3b8-5bc5-4ccf-b2f9-f6f514402b4d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:15.064648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f9f3b8-5bc5-4ccf-b2f9-f6f514402b4d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:15.146612 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff22df49-68fe-4fdd-91c0-012114b00052 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments/e8df0063-ee71-484e-b291-c6033329188f" status: 202 len: 0 microversion: 2.25 time: 0.507083 Oct 11 04:17:15.147571 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 950/1827] 10.222.0.26 () {60 vars in 1457 bytes} [Tue Oct 11 04:17:14 2022] DELETE /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments/e8df0063-ee71-484e-b291-c6033329188f => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:17:15.159676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-fdb1d015-9e78-485a-81cc-7d8b8b11fdf4 req-3a64235d-ff21-4ae9-8072-4404b720206a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc", "name": "network-vif-plugged", "status": "completed", "tag": "c399ee2e-f46f-4457-ae42-b9fe637a2dbe"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:15.181705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fdb1d015-9e78-485a-81cc-7d8b8b11fdf4 req-3a64235d-ff21-4ae9-8072-4404b720206a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:15.185124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fdb1d015-9e78-485a-81cc-7d8b8b11fdf4 req-3a64235d-ff21-4ae9-8072-4404b720206a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:15.186391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fdb1d015-9e78-485a-81cc-7d8b8b11fdf4 req-3a64235d-ff21-4ae9-8072-4404b720206a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:15.223140 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-fdb1d015-9e78-485a-81cc-7d8b8b11fdf4 req-3a64235d-ff21-4ae9-8072-4404b720206a service nova] Creating event network-vif-plugged:c399ee2e-f46f-4457-ae42-b9fe637a2dbe for instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc on n-h1-860892-1 Oct 11 04:17:15.237917 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-fdb1d015-9e78-485a-81cc-7d8b8b11fdf4 req-3a64235d-ff21-4ae9-8072-4404b720206a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082720 Oct 11 04:17:15.241174 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 951/1828] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:15.250962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1bbb88d8-84d1-4142-abbe-fd4d96a2105f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:15.254174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1bbb88d8-84d1-4142-abbe-fd4d96a2105f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:15.263337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bbb88d8-84d1-4142-abbe-fd4d96a2105f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:15.264092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bbb88d8-84d1-4142-abbe-fd4d96a2105f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:15.264955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bbb88d8-84d1-4142-abbe-fd4d96a2105f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:15.265910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bbb88d8-84d1-4142-abbe-fd4d96a2105f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:15.267043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bbb88d8-84d1-4142-abbe-fd4d96a2105f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:15.268073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bbb88d8-84d1-4142-abbe-fd4d96a2105f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:15.343200 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1bbb88d8-84d1-4142-abbe-fd4d96a2105f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.100913 Oct 11 04:17:15.346467 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 952/1829] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:17:15 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments => generated 197 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:17:15.463345 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e4f9f3b8-5bc5-4ccf-b2f9-f6f514402b4d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1619 microversion: 2.1 time: 0.412045 Oct 11 04:17:15.464102 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 878/1830] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:15 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1619 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:15.660253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ebc39c47-b8ee-4946-83d0-d30f0e5ac2a8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:15.660253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ebc39c47-b8ee-4946-83d0-d30f0e5ac2a8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:15.670703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc39c47-b8ee-4946-83d0-d30f0e5ac2a8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:15.671216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc39c47-b8ee-4946-83d0-d30f0e5ac2a8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:15.671646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc39c47-b8ee-4946-83d0-d30f0e5ac2a8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:15.672352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc39c47-b8ee-4946-83d0-d30f0e5ac2a8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:15.672846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc39c47-b8ee-4946-83d0-d30f0e5ac2a8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:15.677673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc39c47-b8ee-4946-83d0-d30f0e5ac2a8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:15.690334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:15.693639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-524865472", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": "b997d21c-b814-4e0c-aba4-53ea4b3c590b"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:15.789107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:17:15.954399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ebc39c47-b8ee-4946-83d0-d30f0e5ac2a8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:15.962238 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ebc39c47-b8ee-4946-83d0-d30f0e5ac2a8 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1321 microversion: 2.1 time: 0.308445 Oct 11 04:17:15.968881 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 953/1831] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:15 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1321 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:16.359589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-08da147a-a456-4fe3-9756-33cbd5f34d5c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:16.361992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-08da147a-a456-4fe3-9756-33cbd5f34d5c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:16.388532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08da147a-a456-4fe3-9756-33cbd5f34d5c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:16.388532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08da147a-a456-4fe3-9756-33cbd5f34d5c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:16.388532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08da147a-a456-4fe3-9756-33cbd5f34d5c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:16.388532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08da147a-a456-4fe3-9756-33cbd5f34d5c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:16.388532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08da147a-a456-4fe3-9756-33cbd5f34d5c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:16.388532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08da147a-a456-4fe3-9756-33cbd5f34d5c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:16.446301 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-08da147a-a456-4fe3-9756-33cbd5f34d5c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.091998 Oct 11 04:17:16.448047 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 954/1832] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:17:16 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:17:16.881841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:17:16.882951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:17:16.883588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:17:16.884265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:17:16.884921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:17:16.926060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:16.929295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:16.931685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:16.939220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:16.939988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:16.940825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:16.995687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-651d38b4-e129-4332-9256-389b5c9e42f0 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:16.997065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-651d38b4-e129-4332-9256-389b5c9e42f0 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:17.009294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:17:17.013336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=14,nova_api:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:17.013653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-651d38b4-e129-4332-9256-389b5c9e42f0 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:17.014157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-651d38b4-e129-4332-9256-389b5c9e42f0 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:17.014623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-651d38b4-e129-4332-9256-389b5c9e42f0 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:17.015324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-651d38b4-e129-4332-9256-389b5c9e42f0 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:17.015771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-651d38b4-e129-4332-9256-389b5c9e42f0 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:17.016190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-651d38b4-e129-4332-9256-389b5c9e42f0 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:17.022595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:17:17.052364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:17:17.060028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:17:17.307659 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dacad3c7-fbcc-4951-9650-fc077f63f392 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.618269 Oct 11 04:17:17.309488 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 879/1833] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:17:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:17:17.320454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2e6e00f5-5a15-4902-9f63-604dcab5da60 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:17.321448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2e6e00f5-5a15-4902-9f63-604dcab5da60 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:17.478758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2e6e00f5-5a15-4902-9f63-604dcab5da60 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:17.490366 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2e6e00f5-5a15-4902-9f63-604dcab5da60 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1216 microversion: 2.1 time: 0.172813 Oct 11 04:17:17.491155 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 880/1834] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:17 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:17.508152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-58cbdb6b-de9f-4e54-9cf6-a31be0791f1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:17.511362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-58cbdb6b-de9f-4e54-9cf6-a31be0791f1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:17.527795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58cbdb6b-de9f-4e54-9cf6-a31be0791f1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:17.534169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58cbdb6b-de9f-4e54-9cf6-a31be0791f1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:17.535074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58cbdb6b-de9f-4e54-9cf6-a31be0791f1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:17.536931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58cbdb6b-de9f-4e54-9cf6-a31be0791f1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:17.537596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58cbdb6b-de9f-4e54-9cf6-a31be0791f1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:17.538345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58cbdb6b-de9f-4e54-9cf6-a31be0791f1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:17.621401 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-58cbdb6b-de9f-4e54-9cf6-a31be0791f1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.128088 Oct 11 04:17:17.627145 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 881/1835] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:17:17 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments => generated 197 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:17:17.730683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-651d38b4-e129-4332-9256-389b5c9e42f0 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:17.746656 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-651d38b4-e129-4332-9256-389b5c9e42f0 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1321 microversion: 2.1 time: 0.756471 Oct 11 04:17:17.750742 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 955/1836] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:16 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1321 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:18.520194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8680f2b3-c7e2-41d2-ba81-fe01444de892 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:18.521436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8680f2b3-c7e2-41d2-ba81-fe01444de892 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:18.637030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7ce33158-2132-45f5-afed-7f3c4a0b2bb1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:18.640300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7ce33158-2132-45f5-afed-7f3c4a0b2bb1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:18.671426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ce33158-2132-45f5-afed-7f3c4a0b2bb1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:18.671977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ce33158-2132-45f5-afed-7f3c4a0b2bb1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:18.672417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ce33158-2132-45f5-afed-7f3c4a0b2bb1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:18.673219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ce33158-2132-45f5-afed-7f3c4a0b2bb1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:18.673578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ce33158-2132-45f5-afed-7f3c4a0b2bb1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:18.673998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ce33158-2132-45f5-afed-7f3c4a0b2bb1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:18.777851 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7ce33158-2132-45f5-afed-7f3c4a0b2bb1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.146133 Oct 11 04:17:18.788412 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 956/1837] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:17:18 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments => generated 197 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:17:18.798854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a593a371-4344-4f98-9400-1ec3a53ce49b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:18.800059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a593a371-4344-4f98-9400-1ec3a53ce49b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:18.826074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a593a371-4344-4f98-9400-1ec3a53ce49b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:18.826074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a593a371-4344-4f98-9400-1ec3a53ce49b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:18.826074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a593a371-4344-4f98-9400-1ec3a53ce49b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:18.826074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a593a371-4344-4f98-9400-1ec3a53ce49b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:18.826074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a593a371-4344-4f98-9400-1ec3a53ce49b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:18.826074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a593a371-4344-4f98-9400-1ec3a53ce49b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:18.846532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8680f2b3-c7e2-41d2-ba81-fe01444de892 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:18.848886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=31,nova_cell0:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:18.854463 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8680f2b3-c7e2-41d2-ba81-fe01444de892 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1216 microversion: 2.1 time: 0.339864 Oct 11 04:17:18.861374 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 882/1838] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:18 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1216 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:19.268897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a593a371-4344-4f98-9400-1ec3a53ce49b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:19.277723 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a593a371-4344-4f98-9400-1ec3a53ce49b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1471 microversion: 2.1 time: 0.487615 Oct 11 04:17:19.293704 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 957/1839] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:18 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1471 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:19.302780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cfece146-07c0-4ab4-ac44-373aeba661a1 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:19.303348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cfece146-07c0-4ab4-ac44-373aeba661a1 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:19.329728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfece146-07c0-4ab4-ac44-373aeba661a1 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:19.332229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfece146-07c0-4ab4-ac44-373aeba661a1 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:19.332698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfece146-07c0-4ab4-ac44-373aeba661a1 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:19.333429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfece146-07c0-4ab4-ac44-373aeba661a1 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:19.333887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfece146-07c0-4ab4-ac44-373aeba661a1 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:19.334343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfece146-07c0-4ab4-ac44-373aeba661a1 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:19.384538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-cfece146-07c0-4ab4-ac44-373aeba661a1 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lazy-loading 'flavor' on Instance uuid e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:17:19.802709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d1f0f11-ea49-4916-8628-e1216704336e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:19.806327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d1f0f11-ea49-4916-8628-e1216704336e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:19.819674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d1f0f11-ea49-4916-8628-e1216704336e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:19.820548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d1f0f11-ea49-4916-8628-e1216704336e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:19.821232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d1f0f11-ea49-4916-8628-e1216704336e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:19.822468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d1f0f11-ea49-4916-8628-e1216704336e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:19.823156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d1f0f11-ea49-4916-8628-e1216704336e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:19.824522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d1f0f11-ea49-4916-8628-e1216704336e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:19.890255 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d1f0f11-ea49-4916-8628-e1216704336e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.091326 Oct 11 04:17:19.895413 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 958/1840] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:17:19 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:17:19.900866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ad6a215c-ca55-4c08-92dc-2841587b520d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:19.900866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ad6a215c-ca55-4c08-92dc-2841587b520d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:19.905645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6a215c-ca55-4c08-92dc-2841587b520d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:19.906425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6a215c-ca55-4c08-92dc-2841587b520d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:19.907042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6a215c-ca55-4c08-92dc-2841587b520d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:19.907896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6a215c-ca55-4c08-92dc-2841587b520d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:19.908507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6a215c-ca55-4c08-92dc-2841587b520d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:19.909101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6a215c-ca55-4c08-92dc-2841587b520d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:20.021707 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cfece146-07c0-4ab4-ac44-373aeba661a1 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc/action" status: 202 len: 0 microversion: 2.1 time: 0.722800 Oct 11 04:17:20.023056 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 883/1841] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:17:19 2022] POST /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:17:20.031689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ffc28eb4-46f7-4473-b623-58d3c48fd4c6 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:20.040487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ffc28eb4-46f7-4473-b623-58d3c48fd4c6 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:20.047714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ffc28eb4-46f7-4473-b623-58d3c48fd4c6 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:20.049337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ad6a215c-ca55-4c08-92dc-2841587b520d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:20.059383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ffc28eb4-46f7-4473-b623-58d3c48fd4c6 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:20.060104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ffc28eb4-46f7-4473-b623-58d3c48fd4c6 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:20.061028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ffc28eb4-46f7-4473-b623-58d3c48fd4c6 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:20.061163 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ad6a215c-ca55-4c08-92dc-2841587b520d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1212 microversion: 2.1 time: 0.167677 Oct 11 04:17:20.061712 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 959/1842] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:19 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1212 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:20.061924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ffc28eb4-46f7-4473-b623-58d3c48fd4c6 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:20.062619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ffc28eb4-46f7-4473-b623-58d3c48fd4c6 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:20.669192 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ffc28eb4-46f7-4473-b623-58d3c48fd4c6 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1630 microversion: 2.1 time: 0.628217 Oct 11 04:17:20.669851 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 884/1843] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:20 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1630 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:20.905809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5b68da14-a5dd-46b3-85b4-0f94d826fd54 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:20.909930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5b68da14-a5dd-46b3-85b4-0f94d826fd54 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:20.927615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b68da14-a5dd-46b3-85b4-0f94d826fd54 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:20.937423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b68da14-a5dd-46b3-85b4-0f94d826fd54 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:20.943930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b68da14-a5dd-46b3-85b4-0f94d826fd54 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:20.945563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b68da14-a5dd-46b3-85b4-0f94d826fd54 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:20.947266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b68da14-a5dd-46b3-85b4-0f94d826fd54 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:20.949723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b68da14-a5dd-46b3-85b4-0f94d826fd54 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:21.083524 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5b68da14-a5dd-46b3-85b4-0f94d826fd54 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.183988 Oct 11 04:17:21.089150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e232513b-b8af-4e9c-945f-3fd61feefab4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:21.090472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e232513b-b8af-4e9c-945f-3fd61feefab4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:21.091472 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 960/1844] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:17:20 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments => generated 197 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:17:21.103499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e232513b-b8af-4e9c-945f-3fd61feefab4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:21.104025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e232513b-b8af-4e9c-945f-3fd61feefab4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:21.104460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e232513b-b8af-4e9c-945f-3fd61feefab4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:21.107701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e232513b-b8af-4e9c-945f-3fd61feefab4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:21.110920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e232513b-b8af-4e9c-945f-3fd61feefab4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:21.113761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e232513b-b8af-4e9c-945f-3fd61feefab4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:21.297652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e232513b-b8af-4e9c-945f-3fd61feefab4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:21.311965 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e232513b-b8af-4e9c-945f-3fd61feefab4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1268 microversion: 2.1 time: 0.228447 Oct 11 04:17:21.312899 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 885/1845] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:21 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1268 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:21.700216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cb43168-6842-4ea5-8792-1a86951de0c9 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:21.700216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2cb43168-6842-4ea5-8792-1a86951de0c9 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:21.710477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cb43168-6842-4ea5-8792-1a86951de0c9 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:21.712303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cb43168-6842-4ea5-8792-1a86951de0c9 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:21.714218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cb43168-6842-4ea5-8792-1a86951de0c9 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:21.715775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cb43168-6842-4ea5-8792-1a86951de0c9 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:21.718735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cb43168-6842-4ea5-8792-1a86951de0c9 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:21.723615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cb43168-6842-4ea5-8792-1a86951de0c9 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.003235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57f38f39-cee1-48f5-bd44-767fb619c568 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:22.015440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-57f38f39-cee1-48f5-bd44-767fb619c568 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:22.017448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-57f38f39-cee1-48f5-bd44-767fb619c568 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Searching by: {'deleted': False, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:17:22.054440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57f38f39-cee1-48f5-bd44-767fb619c568 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.056474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57f38f39-cee1-48f5-bd44-767fb619c568 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.057117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57f38f39-cee1-48f5-bd44-767fb619c568 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.060240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57f38f39-cee1-48f5-bd44-767fb619c568 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.062887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57f38f39-cee1-48f5-bd44-767fb619c568 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.063545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57f38f39-cee1-48f5-bd44-767fb619c568 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.293318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-57f38f39-cee1-48f5-bd44-767fb619c568 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:17:22.416518 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2cb43168-6842-4ea5-8792-1a86951de0c9 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1613 microversion: 2.1 time: 0.720465 Oct 11 04:17:22.419922 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 961/1846] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:21 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1613 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:22.433383 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-57f38f39-cee1-48f5-bd44-767fb619c568 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.435118 Oct 11 04:17:22.441887 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 886/1847] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:17:21 2022] GET /compute/v2.1/servers => generated 339 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:22.450115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-10ebc476-f103-4e72-b982-d2d60b76fb99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:22.455393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-10ebc476-f103-4e72-b982-d2d60b76fb99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:22.457997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-00087dbf-0105-4bf6-bb29-0b6f1d5e1397 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:22.468042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-00087dbf-0105-4bf6-bb29-0b6f1d5e1397 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:22.470915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ebc476-f103-4e72-b982-d2d60b76fb99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.471787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ebc476-f103-4e72-b982-d2d60b76fb99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.472411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ebc476-f103-4e72-b982-d2d60b76fb99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.475376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ebc476-f103-4e72-b982-d2d60b76fb99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.476504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ebc476-f103-4e72-b982-d2d60b76fb99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.477102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ebc476-f103-4e72-b982-d2d60b76fb99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.486931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00087dbf-0105-4bf6-bb29-0b6f1d5e1397 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.489201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00087dbf-0105-4bf6-bb29-0b6f1d5e1397 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.489912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00087dbf-0105-4bf6-bb29-0b6f1d5e1397 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.490658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00087dbf-0105-4bf6-bb29-0b6f1d5e1397 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.491117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00087dbf-0105-4bf6-bb29-0b6f1d5e1397 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.491540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00087dbf-0105-4bf6-bb29-0b6f1d5e1397 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.511954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:22.548258 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-00087dbf-0105-4bf6-bb29-0b6f1d5e1397 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.126576 Oct 11 04:17:22.554085 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 962/1848] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:17:22 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:17:22.560331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:22.566590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:22.574487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.575934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.576707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.577642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.578428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.579139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.627432 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] HTTP exception thrown: Cannot 'migrate' instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc while it is in vm_state suspended Oct 11 04:17:22.627590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-10ebc476-f103-4e72-b982-d2d60b76fb99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Request method failure captured: Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc/action HTTP/1.1 Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 15 Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO4lEShPw5g-498ZWtqdCuIVqEtoh-aH4Nz_md1wAT8brohT0CE0pHozub5_Xr3iGqAzfyVlw8a9MZcFvGz75JWWpJt5rTnIi3cS1TsbVbl-4POAw2w52KBamrEO5OlCdEB1be8zytx6u2xpizVqyUpcgk_eYsbmcJq4YqMmHcVlZgw Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 3c0101d38ed249a3a2f830dbf63bc61b Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3c0101d38ed249a3a2f830dbf63bc61b"}]}] Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 3c0101d38ed249a3a2f830dbf63bc61b Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersAdminNegativeTestJSON-1481559362-project-admin Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 278e057d38e3488fa89709fe062a7f8a Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1481559362-project-admin Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: {"migrate": {}} Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: exception: Cannot 'migrate' instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc while it is in vm_state suspended Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc', 'body': {'migrate': {}}} Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 58, in _migrate Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.compute_api.resize(req.environ['nova.context'], instance, Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc in vm_state suspended. Cannot resize while the instance is in this state. Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:17:22.630373 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/migrate_server.py", line 69, in _migrate Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'migrate' instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc while it is in vm_state suspended Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'migrate' instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc while it is in vm_state suspended Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Returning 409 to user: Cannot 'migrate' instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc while it is in vm_state suspended {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e0933d05-9de1-471c-96c0-221d360b76b0 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc/action" status: 409 len: 148 microversion: 2.1 time: 0.076851 Oct 11 04:17:22.635344 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 963/1849] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:17:22 2022] POST /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc/action => generated 148 bytes in 78 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:17:22.642217 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-10ebc476-f103-4e72-b982-d2d60b76fb99 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1274 microversion: 2.1 time: 0.198697 Oct 11 04:17:22.642703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:22.652246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:22.653034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Searching by: {'deleted': False, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:17:22.653231 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 887/1850] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:22 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1274 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:22.664907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.665736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.666407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.667047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae4f5f0f-97dc-4b7f-872f-02e99129fd61 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "invalid"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:22.668585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.669253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.669680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae4f5f0f-97dc-4b7f-872f-02e99129fd61 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Request method failure captured: Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4/action HTTP/1.1 Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 39 Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO4lEShPw5g-498ZWtqdCuIVqEtoh-aH4Nz_md1wAT8brohT0CE0pHozub5_Xr3iGqAzfyVlw8a9MZcFvGz75JWWpJt5rTnIi3cS1TsbVbl-4POAw2w52KBamrEO5OlCdEB1be8zytx6u2xpizVqyUpcgk_eYsbmcJq4YqMmHcVlZgw Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 3c0101d38ed249a3a2f830dbf63bc61b Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3c0101d38ed249a3a2f830dbf63bc61b"}]}] Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 3c0101d38ed249a3a2f830dbf63bc61b Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAdminNegativeTestJSON-1481559362-project-admin Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 278e057d38e3488fa89709fe062a7f8a Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1481559362-project-admin Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: {"os-resetState": {"state": "invalid"}} Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '58b387b4-b392-4d20-90b2-588a989415d4', 'body': {'os-resetState': {'state': 'invalid'}}} Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['active', 'error'] Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['os-resetState']['properties']['state']: Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:17:22.671800 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:17:22.677311 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 04:17:22.677311 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.677311 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:22.677311 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.677311 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.677311 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:22.677311 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:22.677311 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:17:22.677311 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:17:22.677311 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] Oct 11 04:17:22.677311 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.687206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae4f5f0f-97dc-4b7f-872f-02e99129fd61 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: invalid. 'invalid' is not one of ['active', 'error'] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:22.689975 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ae4f5f0f-97dc-4b7f-872f-02e99129fd61 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4/action" status: 400 len: 144 microversion: 2.1 time: 0.035671 Oct 11 04:17:22.690694 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 888/1851] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:17:22 2022] POST /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4/action => generated 144 bytes in 37 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:17:22.717030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07c8615b-1bbd-4bce-82fa-9fae4e27ea88 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": 1}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:22.717194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07c8615b-1bbd-4bce-82fa-9fae4e27ea88 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Request method failure captured: Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4/action HTTP/1.1 Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 31 Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO4lEShPw5g-498ZWtqdCuIVqEtoh-aH4Nz_md1wAT8brohT0CE0pHozub5_Xr3iGqAzfyVlw8a9MZcFvGz75JWWpJt5rTnIi3cS1TsbVbl-4POAw2w52KBamrEO5OlCdEB1be8zytx6u2xpizVqyUpcgk_eYsbmcJq4YqMmHcVlZgw Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 3c0101d38ed249a3a2f830dbf63bc61b Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3c0101d38ed249a3a2f830dbf63bc61b"}]}] Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 3c0101d38ed249a3a2f830dbf63bc61b Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAdminNegativeTestJSON-1481559362-project-admin Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 278e057d38e3488fa89709fe062a7f8a Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1481559362-project-admin Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: {"os-resetState": {"state": 1}} Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '58b387b4-b392-4d20-90b2-588a989415d4', 'body': {'os-resetState': {'state': 1}}} Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 1 is not of type 'string' Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['os-resetState']['properties']['state']: Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'enum': ['active', 'error'], 'type': 'string'} Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['os-resetState']: Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 1 Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 04:17:22.722616 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.728204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:22.728204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.728204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.728204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:22.728204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:22.728204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:17:22.728204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:17:22.728204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' Oct 11 04:17:22.728204 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.734482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07c8615b-1bbd-4bce-82fa-9fae4e27ea88 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Returning 400 to user: Invalid input for field/attribute state. Value: 1. 1 is not of type 'string' {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:22.735981 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-07c8615b-1bbd-4bce-82fa-9fae4e27ea88 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4/action" status: 400 len: 120 microversion: 2.1 time: 0.039590 Oct 11 04:17:22.737739 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 889/1852] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:17:22 2022] POST /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4/action => generated 120 bytes in 42 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:17:22.752784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e123bf1-87c1-4989-96fa-534f3d83e2a8 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Action: 'action', calling method: >, body: {"os-resetState": {"state": "error"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:22.758267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8e123bf1-87c1-4989-96fa-534f3d83e2a8 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Failed to fetch instance by id 999 {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 04:17:22.759178 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-8e123bf1-87c1-4989-96fa-534f3d83e2a8 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] HTTP exception thrown: Instance 999 could not be found. Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e123bf1-87c1-4989-96fa-534f3d83e2a8 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Request method failure captured: Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/999/action HTTP/1.1 Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 37 Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO4lEShPw5g-498ZWtqdCuIVqEtoh-aH4Nz_md1wAT8brohT0CE0pHozub5_Xr3iGqAzfyVlw8a9MZcFvGz75JWWpJt5rTnIi3cS1TsbVbl-4POAw2w52KBamrEO5OlCdEB1be8zytx6u2xpizVqyUpcgk_eYsbmcJq4YqMmHcVlZgw Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 3c0101d38ed249a3a2f830dbf63bc61b Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3c0101d38ed249a3a2f830dbf63bc61b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3c0101d38ed249a3a2f830dbf63bc61b"}]}] Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 3c0101d38ed249a3a2f830dbf63bc61b Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1481559362 Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAdminNegativeTestJSON-1481559362-project-admin Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 278e057d38e3488fa89709fe062a7f8a Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1481559362-project-admin Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: {"os-resetState": {"state": "error"}} Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 999 could not be found. Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '999', 'body': {'os-resetState': {'state': 'error'}}} Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/admin_actions.py", line 66, in _reset_state Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:22.771138 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:22.777412 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:22.777412 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 11 04:17:22.777412 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:22.778606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e123bf1-87c1-4989-96fa-534f3d83e2a8 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] Returning 404 to user: Instance 999 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:22.782616 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8e123bf1-87c1-4989-96fa-534f3d83e2a8 tempest-ServersAdminNegativeTestJSON-1481559362 tempest-ServersAdminNegativeTestJSON-1481559362-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/999/action" status: 404 len: 78 microversion: 2.1 time: 0.036958 Oct 11 04:17:22.786507 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 890/1853] 10.222.0.26 () {60 vars in 1179 bytes} [Tue Oct 11 04:17:22 2022] POST /compute/v2.1/servers/999/action => generated 78 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:17:22.796950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-230bc616-3acc-40c3-9105-67bc3c581315 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:22.798960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-230bc616-3acc-40c3-9105-67bc3c581315 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:22.814560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230bc616-3acc-40c3-9105-67bc3c581315 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.815451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230bc616-3acc-40c3-9105-67bc3c581315 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.816154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230bc616-3acc-40c3-9105-67bc3c581315 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.817116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230bc616-3acc-40c3-9105-67bc3c581315 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.819594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230bc616-3acc-40c3-9105-67bc3c581315 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.820307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230bc616-3acc-40c3-9105-67bc3c581315 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:22.931935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-230bc616-3acc-40c3-9105-67bc3c581315 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:17:22.946545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:22.960096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:22.961175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:22.961778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:23.286526 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d5dc48c-8c0f-4521-a6f1-bc30ddbb7174 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1712 microversion: 2.1 time: 0.650758 Oct 11 04:17:23.287122 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 964/1854] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:17:22 2022] GET /compute/v2.1/servers/detail => generated 1712 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:23.314711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ac3ca108-5306-48d1-a42c-5f08daae939f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:23.330341 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ac3ca108-5306-48d1-a42c-5f08daae939f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019856 Oct 11 04:17:23.339894 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 965/1855] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:17:23 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:17:23.561719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e33c7b29-c95b-403b-8c80-876270ce6110 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:23.564482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e33c7b29-c95b-403b-8c80-876270ce6110 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:23.598001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e33c7b29-c95b-403b-8c80-876270ce6110 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:23.606681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e33c7b29-c95b-403b-8c80-876270ce6110 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:23.608795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e33c7b29-c95b-403b-8c80-876270ce6110 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:23.611800 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-230bc616-3acc-40c3-9105-67bc3c581315 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 204 len: 0 microversion: 2.1 time: 0.819706 Oct 11 04:17:23.615924 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 891/1856] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:17:22 2022] DELETE /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 0 bytes in 822 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:17:23.616276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e33c7b29-c95b-403b-8c80-876270ce6110 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:23.616276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e33c7b29-c95b-403b-8c80-876270ce6110 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:23.616276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e33c7b29-c95b-403b-8c80-876270ce6110 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:23.625471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6e2756a0-8b86-40bd-94b5-7eb85bb6ec87 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:23.626259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6e2756a0-8b86-40bd-94b5-7eb85bb6ec87 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:23.658344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2756a0-8b86-40bd-94b5-7eb85bb6ec87 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:23.660511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2756a0-8b86-40bd-94b5-7eb85bb6ec87 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:23.660977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2756a0-8b86-40bd-94b5-7eb85bb6ec87 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:23.668686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2756a0-8b86-40bd-94b5-7eb85bb6ec87 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:23.671626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2756a0-8b86-40bd-94b5-7eb85bb6ec87 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:23.672115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2756a0-8b86-40bd-94b5-7eb85bb6ec87 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:23.788983 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e33c7b29-c95b-403b-8c80-876270ce6110 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments" status: 200 len: 197 microversion: 2.25 time: 0.227798 Oct 11 04:17:23.791555 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 966/1857] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:17:23 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments => generated 197 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:17:23.811570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ac7b9fee-37ea-46d3-ab0a-ac1a165f3582 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:23.818657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ac7b9fee-37ea-46d3-ab0a-ac1a165f3582 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:23.835165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac7b9fee-37ea-46d3-ab0a-ac1a165f3582 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:23.837005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac7b9fee-37ea-46d3-ab0a-ac1a165f3582 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:23.838329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac7b9fee-37ea-46d3-ab0a-ac1a165f3582 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:23.839501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac7b9fee-37ea-46d3-ab0a-ac1a165f3582 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:23.842964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac7b9fee-37ea-46d3-ab0a-ac1a165f3582 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:23.843878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac7b9fee-37ea-46d3-ab0a-ac1a165f3582 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:23.947562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ac7b9fee-37ea-46d3-ab0a-ac1a165f3582 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:17:24.131648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6e2756a0-8b86-40bd-94b5-7eb85bb6ec87 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:24.146631 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6e2756a0-8b86-40bd-94b5-7eb85bb6ec87 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1468 microversion: 2.1 time: 0.526256 Oct 11 04:17:24.147621 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 892/1858] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:23 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1468 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:24.164619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4ad53dc-7192-479a-acf2-05f53c96123f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:24.165643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f4ad53dc-7192-479a-acf2-05f53c96123f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:24.174455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ad53dc-7192-479a-acf2-05f53c96123f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:24.175382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ad53dc-7192-479a-acf2-05f53c96123f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:24.176029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ad53dc-7192-479a-acf2-05f53c96123f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:24.177018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ad53dc-7192-479a-acf2-05f53c96123f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:24.177904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ad53dc-7192-479a-acf2-05f53c96123f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:24.178760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ad53dc-7192-479a-acf2-05f53c96123f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:24.512599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4ad53dc-7192-479a-acf2-05f53c96123f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:24.526000 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f4ad53dc-7192-479a-acf2-05f53c96123f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1316 microversion: 2.1 time: 0.377181 Oct 11 04:17:24.527681 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 893/1859] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:24 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1316 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:24.593798 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ac7b9fee-37ea-46d3-ab0a-ac1a165f3582 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "DELETE /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 204 len: 0 microversion: 2.1 time: 0.798884 Oct 11 04:17:24.595462 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 967/1860] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:17:23 2022] DELETE /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 0 bytes in 801 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:17:24.603820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-08d69a66-e822-4b8e-b9bc-83283292db57 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:24.604988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-08d69a66-e822-4b8e-b9bc-83283292db57 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:24.619395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d69a66-e822-4b8e-b9bc-83283292db57 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:24.624206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d69a66-e822-4b8e-b9bc-83283292db57 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:24.624915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d69a66-e822-4b8e-b9bc-83283292db57 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:24.627834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d69a66-e822-4b8e-b9bc-83283292db57 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:24.632022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d69a66-e822-4b8e-b9bc-83283292db57 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:24.634474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d69a66-e822-4b8e-b9bc-83283292db57 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:25.076676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e5d736ab-5a54-4813-a509-507d92e0d21c tempest-ExtensionsTest-1636911558 tempest-ExtensionsTest-1636911558-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:25.078405 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e5d736ab-5a54-4813-a509-507d92e0d21c tempest-ExtensionsTest-1636911558 tempest-ExtensionsTest-1636911558-project] 10.222.0.26 "GET /compute/v2.1/extensions/os-consoles" status: 200 len: 217 microversion: 2.1 time: 0.548587 Oct 11 04:17:25.079187 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 894/1861] 10.222.0.26 () {58 vars in 1170 bytes} [Tue Oct 11 04:17:24 2022] GET /compute/v2.1/extensions/os-consoles => generated 217 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:25.085360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5386cfec-2d5d-41fe-954d-552724bb8a7f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:25.094245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5386cfec-2d5d-41fe-954d-552724bb8a7f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:25.113072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386cfec-2d5d-41fe-954d-552724bb8a7f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:25.113552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386cfec-2d5d-41fe-954d-552724bb8a7f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:25.114661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386cfec-2d5d-41fe-954d-552724bb8a7f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:25.115552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386cfec-2d5d-41fe-954d-552724bb8a7f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:25.120872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386cfec-2d5d-41fe-954d-552724bb8a7f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:25.122101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386cfec-2d5d-41fe-954d-552724bb8a7f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:25.186858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-08d69a66-e822-4b8e-b9bc-83283292db57 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:25.191400 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5386cfec-2d5d-41fe-954d-552724bb8a7f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments" status: 200 len: 25 microversion: 2.25 time: 0.111156 Oct 11 04:17:25.192572 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 895/1862] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:17:25 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd/os-volume_attachments => generated 25 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:25.197322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb38462e-d050-404d-a7d9-63f12296ec28 tempest-ExtensionsTest-1636911558 tempest-ExtensionsTest-1636911558-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:25.200878 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb38462e-d050-404d-a7d9-63f12296ec28 tempest-ExtensionsTest-1636911558 tempest-ExtensionsTest-1636911558-project] 10.222.0.26 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.006644 Oct 11 04:17:25.214707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:25.214707 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-08d69a66-e822-4b8e-b9bc-83283292db57 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1715 microversion: 2.1 time: 0.607252 Oct 11 04:17:25.214707 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 968/1863] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:24 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1715 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:25.221374 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 896/1864] 10.222.0.26 () {58 vars in 1134 bytes} [Tue Oct 11 04:17:25 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:17:25.224633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ac2bfc56-299f-4a44-ab7a-9d8bdd55af24 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:25.225660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ac2bfc56-299f-4a44-ab7a-9d8bdd55af24 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:25.236825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac2bfc56-299f-4a44-ab7a-9d8bdd55af24 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:25.237382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac2bfc56-299f-4a44-ab7a-9d8bdd55af24 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:25.237897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac2bfc56-299f-4a44-ab7a-9d8bdd55af24 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:25.238687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac2bfc56-299f-4a44-ab7a-9d8bdd55af24 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:25.239144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac2bfc56-299f-4a44-ab7a-9d8bdd55af24 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:25.239573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac2bfc56-299f-4a44-ab7a-9d8bdd55af24 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:25.490119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ac2bfc56-299f-4a44-ab7a-9d8bdd55af24 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:25.499360 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ac2bfc56-299f-4a44-ab7a-9d8bdd55af24 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1468 microversion: 2.1 time: 0.290296 Oct 11 04:17:25.499966 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 969/1865] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:25 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1468 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:25.557296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3748b649-e3f3-4ea8-a77c-560e11d4b0c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:25.557771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3748b649-e3f3-4ea8-a77c-560e11d4b0c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:25.569270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3748b649-e3f3-4ea8-a77c-560e11d4b0c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:25.580554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3748b649-e3f3-4ea8-a77c-560e11d4b0c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:25.580554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3748b649-e3f3-4ea8-a77c-560e11d4b0c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:25.580554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3748b649-e3f3-4ea8-a77c-560e11d4b0c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:25.580554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3748b649-e3f3-4ea8-a77c-560e11d4b0c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:25.580554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3748b649-e3f3-4ea8-a77c-560e11d4b0c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:25.760342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3fa38c5-56fd-4c3f-9ad0-1291a344608b tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] Calling method '.version_select at 0x7fda1e032790>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:25.845668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3748b649-e3f3-4ea8-a77c-560e11d4b0c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:25.858831 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3748b649-e3f3-4ea8-a77c-560e11d4b0c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1316 microversion: 2.1 time: 0.304873 Oct 11 04:17:25.860876 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 970/1866] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:25 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:25.929576 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d3fa38c5-56fd-4c3f-9ad0-1291a344608b tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 20 microversion: 2.1 time: 0.424550 Oct 11 04:17:25.930023 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 897/1867] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:17:25 2022] GET /compute/v2.1/os-floating-ips => generated 20 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:17:25.945708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b07e4ed-0fa1-4eeb-9616-bcaf68997eca tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] Action: 'create', calling method: .version_select at 0x7fda1df74790>, body: {"pool": "non_exist_pool"} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:26.017219 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-3b07e4ed-0fa1-4eeb-9616-bcaf68997eca tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] HTTP exception thrown: Floating IP pool not found. Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b07e4ed-0fa1-4eeb-9616-bcaf68997eca tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] Request method failure captured: Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-floating-ips HTTP/1.1 Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 26 Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5VxGWaZKNGBQ4xHFwVTmQCWAk0aul7gdzsmJZk_N-K1ggttW5kxxPwPPm6sEAwUym-g1dDtMyrwHfYy-SxSZyODHai3TKSR_5A0UrKCqXXTudKV3eDKcKlTDZSY1wfb6iamIgGaRUV99kshTftI8GKOcAvehAu2VsJPzCovqm88uQ Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 471aec9857b3493aae5288f208d72e05 Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-736000521 Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/471aec9857b3493aae5288f208d72e05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_471aec9857b3493aae5288f208d72e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/471aec9857b3493aae5288f208d72e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/471aec9857b3493aae5288f208d72e05"}]}] Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-736000521 Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 471aec9857b3493aae5288f208d72e05 Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-736000521 Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FloatingIPsNegativeTestJSON-736000521-project Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 3916b3bb202e4e9fa7b8e258921f2490 Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-736000521-project Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: {"pool": "non_exist_pool"} Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: exception: Floating IP pool not found. Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'pool': 'non_exist_pool'}} Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 127, in create Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi address = self.network_api.allocate_floating_ip(context, pool) Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2972, in allocate_floating_ip Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi pool_id = self._get_floating_ip_pool_id_by_name_or_id(client, pool) Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2962, in _get_floating_ip_pool_id_by_name_or_id Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpPoolNotFound() Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpPoolNotFound: Floating IP pool not found. Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 142, in create Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP pool not found. Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:26.018914 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:26.023813 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP pool not found. Oct 11 04:17:26.023813 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.023813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b07e4ed-0fa1-4eeb-9616-bcaf68997eca tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] Returning 404 to user: Floating IP pool not found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:26.023813 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b07e4ed-0fa1-4eeb-9616-bcaf68997eca tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 404 len: 73 microversion: 2.1 time: 0.079113 Oct 11 04:17:26.027808 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 971/1868] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:17:25 2022] POST /compute/v2.1/os-floating-ips => generated 73 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:17:26.032691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6ba277a5-1ce8-4e40-87b8-b629ff619fbb tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] Calling method '.version_select at 0x7fda1dfa00d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:26.235156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-585f528e-2752-4535-9a6d-248840b0ad73 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:26.236528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-585f528e-2752-4535-9a6d-248840b0ad73 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:26.241869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-6ba277a5-1ce8-4e40-87b8-b629ff619fbb tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 7650b488-f6e0-4c6b-a6b9-abf471ef2d1c could not be found", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:17:26.244298 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-6ba277a5-1ce8-4e40-87b8-b629ff619fbb tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] HTTP exception thrown: Floating IP not found for ID 7650b488-f6e0-4c6b-a6b9-abf471ef2d1c Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6ba277a5-1ce8-4e40-87b8-b629ff619fbb tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] Request method failure captured: Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-floating-ips/7650b488-f6e0-4c6b-a6b9-abf471ef2d1c HTTP/1.1 Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO5VxGWaZKNGBQ4xHFwVTmQCWAk0aul7gdzsmJZk_N-K1ggttW5kxxPwPPm6sEAwUym-g1dDtMyrwHfYy-SxSZyODHai3TKSR_5A0UrKCqXXTudKV3eDKcKlTDZSY1wfb6iamIgGaRUV99kshTftI8GKOcAvehAu2VsJPzCovqm88uQ Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 471aec9857b3493aae5288f208d72e05 Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FloatingIPsNegativeTestJSON-736000521 Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/471aec9857b3493aae5288f208d72e05"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_471aec9857b3493aae5288f208d72e05"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/471aec9857b3493aae5288f208d72e05"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/471aec9857b3493aae5288f208d72e05"}]}] Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FloatingIPsNegativeTestJSON-736000521 Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 471aec9857b3493aae5288f208d72e05 Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FloatingIPsNegativeTestJSON-736000521 Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FloatingIPsNegativeTestJSON-736000521-project Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 3916b3bb202e4e9fa7b8e258921f2490 Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FloatingIPsNegativeTestJSON-736000521-project Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: exception: Floating IP not found for ID 7650b488-f6e0-4c6b-a6b9-abf471ef2d1c Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '7650b488-f6e0-4c6b-a6b9-abf471ef2d1c'} Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 7650b488-f6e0-4c6b-a6b9-abf471ef2d1c could not be found Oct 11 04:17:26.247329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b7e457f1-731b-440b-a479-1d8e705c9540'] Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 7650b488-f6e0-4c6b-a6b9-abf471ef2d1c. Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 7650b488-f6e0-4c6b-a6b9-abf471ef2d1c Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 7650b488-f6e0-4c6b-a6b9-abf471ef2d1c Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:26.257921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6ba277a5-1ce8-4e40-87b8-b629ff619fbb tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] Returning 404 to user: Floating IP not found for ID 7650b488-f6e0-4c6b-a6b9-abf471ef2d1c {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:26.262722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-585f528e-2752-4535-9a6d-248840b0ad73 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:26.262722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-585f528e-2752-4535-9a6d-248840b0ad73 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:26.262722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-585f528e-2752-4535-9a6d-248840b0ad73 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:26.263914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-585f528e-2752-4535-9a6d-248840b0ad73 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:26.263914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-585f528e-2752-4535-9a6d-248840b0ad73 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:26.265434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-585f528e-2752-4535-9a6d-248840b0ad73 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:26.265659 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6ba277a5-1ce8-4e40-87b8-b629ff619fbb tempest-FloatingIPsNegativeTestJSON-736000521 tempest-FloatingIPsNegativeTestJSON-736000521-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/7650b488-f6e0-4c6b-a6b9-abf471ef2d1c" status: 404 len: 111 microversion: 2.1 time: 0.236659 Oct 11 04:17:26.266639 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 898/1869] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:17:26 2022] DELETE /compute/v2.1/os-floating-ips/7650b488-f6e0-4c6b-a6b9-abf471ef2d1c => generated 111 bytes in 239 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:17:26.532859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f21741cd-ac07-419a-873c-fac1ffdc8de5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:26.535004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f21741cd-ac07-419a-873c-fac1ffdc8de5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:26.543677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f21741cd-ac07-419a-873c-fac1ffdc8de5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:26.544502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f21741cd-ac07-419a-873c-fac1ffdc8de5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:26.545154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f21741cd-ac07-419a-873c-fac1ffdc8de5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:26.546134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f21741cd-ac07-419a-873c-fac1ffdc8de5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:26.549638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f21741cd-ac07-419a-873c-fac1ffdc8de5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:26.550304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f21741cd-ac07-419a-873c-fac1ffdc8de5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:26.837240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-585f528e-2752-4535-9a6d-248840b0ad73 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:26.849171 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-585f528e-2752-4535-9a6d-248840b0ad73 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1715 microversion: 2.1 time: 0.615126 Oct 11 04:17:26.866743 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 972/1870] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:26 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1715 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:26.884403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c4d041d9-b789-4d45-87b9-cedec9ac384b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:26.885063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c4d041d9-b789-4d45-87b9-cedec9ac384b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:26.896562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4d041d9-b789-4d45-87b9-cedec9ac384b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:26.897071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4d041d9-b789-4d45-87b9-cedec9ac384b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:26.897509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4d041d9-b789-4d45-87b9-cedec9ac384b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:26.898256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4d041d9-b789-4d45-87b9-cedec9ac384b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:26.898716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4d041d9-b789-4d45-87b9-cedec9ac384b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:26.899141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4d041d9-b789-4d45-87b9-cedec9ac384b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:27.366931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c4d041d9-b789-4d45-87b9-cedec9ac384b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:27.377990 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c4d041d9-b789-4d45-87b9-cedec9ac384b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1316 microversion: 2.1 time: 0.495619 Oct 11 04:17:27.379872 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 973/1871] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:26 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1316 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:27.654680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f21741cd-ac07-419a-873c-fac1ffdc8de5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:27.666914 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f21741cd-ac07-419a-873c-fac1ffdc8de5 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1468 microversion: 2.1 time: 1.140419 Oct 11 04:17:27.684057 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 899/1872] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:26 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1468 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:27.875775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80b9c5b8-830b-408e-86c6-c670752dda24 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:27.877257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-80b9c5b8-830b-408e-86c6-c670752dda24 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:27.891141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80b9c5b8-830b-408e-86c6-c670752dda24 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:27.891905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80b9c5b8-830b-408e-86c6-c670752dda24 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:27.893676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80b9c5b8-830b-408e-86c6-c670752dda24 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:27.909963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80b9c5b8-830b-408e-86c6-c670752dda24 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:27.910857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80b9c5b8-830b-408e-86c6-c670752dda24 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:27.913046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80b9c5b8-830b-408e-86c6-c670752dda24 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:28.426631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5783f28a-b234-4773-9551-d10187949e58 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:28.426631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5783f28a-b234-4773-9551-d10187949e58 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:28.426631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5783f28a-b234-4773-9551-d10187949e58 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:28.426631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5783f28a-b234-4773-9551-d10187949e58 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:28.426631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5783f28a-b234-4773-9551-d10187949e58 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:28.426631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5783f28a-b234-4773-9551-d10187949e58 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:28.426631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5783f28a-b234-4773-9551-d10187949e58 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:28.426631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5783f28a-b234-4773-9551-d10187949e58 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:28.712953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5783f28a-b234-4773-9551-d10187949e58 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:28.726860 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5783f28a-b234-4773-9551-d10187949e58 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1316 microversion: 2.1 time: 0.325317 Oct 11 04:17:28.727584 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 900/1873] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:28 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1316 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:28.738852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ecb62ef6-c376-4610-a405-5c66524cb428 req-2ae356a4-767d-44a0-9ab6-500e6436120a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d9743668-8bc9-4d7e-8a99-c443ee982477", "tag": "867ccd69-2e5d-4d8e-9eab-bd210ae13cc7"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:28.795367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ecb62ef6-c376-4610-a405-5c66524cb428 req-2ae356a4-767d-44a0-9ab6-500e6436120a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:28.800238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ecb62ef6-c376-4610-a405-5c66524cb428 req-2ae356a4-767d-44a0-9ab6-500e6436120a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:28.809883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ecb62ef6-c376-4610-a405-5c66524cb428 req-2ae356a4-767d-44a0-9ab6-500e6436120a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:28.834836 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ecb62ef6-c376-4610-a405-5c66524cb428 req-2ae356a4-767d-44a0-9ab6-500e6436120a service nova] Creating event network-changed:867ccd69-2e5d-4d8e-9eab-bd210ae13cc7 for instance d9743668-8bc9-4d7e-8a99-c443ee982477 on n-h1-860892-1 Oct 11 04:17:28.841573 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ecb62ef6-c376-4610-a405-5c66524cb428 req-2ae356a4-767d-44a0-9ab6-500e6436120a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112275 Oct 11 04:17:28.843514 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 901/1874] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:28.849068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df41a1db-ae95-4fe9-b294-2fd3251dd008 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:28.867149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-df41a1db-ae95-4fe9-b294-2fd3251dd008 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:28.867149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df41a1db-ae95-4fe9-b294-2fd3251dd008 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:28.867149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df41a1db-ae95-4fe9-b294-2fd3251dd008 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:28.867149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df41a1db-ae95-4fe9-b294-2fd3251dd008 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:28.867149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df41a1db-ae95-4fe9-b294-2fd3251dd008 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:28.867149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df41a1db-ae95-4fe9-b294-2fd3251dd008 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:28.867149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df41a1db-ae95-4fe9-b294-2fd3251dd008 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:28.895962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80b9c5b8-830b-408e-86c6-c670752dda24 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:28.908836 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-80b9c5b8-830b-408e-86c6-c670752dda24 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1715 microversion: 2.1 time: 1.037229 Oct 11 04:17:28.913886 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 974/1875] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:27 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1715 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:29.016986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-df41a1db-ae95-4fe9-b294-2fd3251dd008 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:29.029579 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df41a1db-ae95-4fe9-b294-2fd3251dd008 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1426 microversion: 2.1 time: 0.181727 Oct 11 04:17:29.030474 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 902/1876] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:28 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1426 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:29.755340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-86bacbfc-5996-4dc7-94a0-bed2d3b50891 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:29.759314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-86bacbfc-5996-4dc7-94a0-bed2d3b50891 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:29.767594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86bacbfc-5996-4dc7-94a0-bed2d3b50891 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:29.768649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86bacbfc-5996-4dc7-94a0-bed2d3b50891 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:29.769264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86bacbfc-5996-4dc7-94a0-bed2d3b50891 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:29.770152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86bacbfc-5996-4dc7-94a0-bed2d3b50891 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:29.770786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86bacbfc-5996-4dc7-94a0-bed2d3b50891 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:29.771886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86bacbfc-5996-4dc7-94a0-bed2d3b50891 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:29.936815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6d845635-5764-41c9-bfa8-189012bbcd5e tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:29.937427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6d845635-5764-41c9-bfa8-189012bbcd5e tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:29.955770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d845635-5764-41c9-bfa8-189012bbcd5e tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:29.956121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d845635-5764-41c9-bfa8-189012bbcd5e tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:29.956751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d845635-5764-41c9-bfa8-189012bbcd5e tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:29.957821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d845635-5764-41c9-bfa8-189012bbcd5e tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:29.958542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d845635-5764-41c9-bfa8-189012bbcd5e tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:29.959183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d845635-5764-41c9-bfa8-189012bbcd5e tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:30.081514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6d845635-5764-41c9-bfa8-189012bbcd5e tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:30.097559 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6d845635-5764-41c9-bfa8-189012bbcd5e tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1647 microversion: 2.1 time: 0.164742 Oct 11 04:17:30.115928 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 903/1877] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:29 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1647 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:30.131346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:30.134644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:30.148553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:30.152446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:30.153970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:30.158271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:30.159751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:30.161420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:30.245896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:30.246616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:30.247326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:30.248108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lazy-loading 'fault' on Instance uuid e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:17:30.332629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:30.349206 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-063ab852-adbe-4d18-b24e-26e563edd8f7 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1311 microversion: 2.1 time: 0.222111 Oct 11 04:17:30.349834 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 904/1878] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:30 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1311 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:30.529147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-86bacbfc-5996-4dc7-94a0-bed2d3b50891 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:30.540537 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-86bacbfc-5996-4dc7-94a0-bed2d3b50891 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1316 microversion: 2.1 time: 0.791188 Oct 11 04:17:30.542884 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 975/1879] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:29 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1316 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:30.880865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c9f5dee3-da4d-427a-ae0e-cefb758fb61b req-bff09bea-8b56-48d6-b714-884cebe2a357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc", "name": "network-vif-deleted", "tag": "c399ee2e-f46f-4457-ae42-b9fe637a2dbe"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:30.901018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c9f5dee3-da4d-427a-ae0e-cefb758fb61b req-bff09bea-8b56-48d6-b714-884cebe2a357 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:30.901611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c9f5dee3-da4d-427a-ae0e-cefb758fb61b req-bff09bea-8b56-48d6-b714-884cebe2a357 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:30.901956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c9f5dee3-da4d-427a-ae0e-cefb758fb61b req-bff09bea-8b56-48d6-b714-884cebe2a357 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:30.926845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9402cc0b-1d25-4108-a75e-14b4161f26c4 tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Action: 'create', calling method: .version_select at 0x7fda1e07dc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-390712945", "metadata": {"Type": "work"}}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:30.946507 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c9f5dee3-da4d-427a-ae0e-cefb758fb61b req-bff09bea-8b56-48d6-b714-884cebe2a357 service nova] Creating event network-vif-deleted:c399ee2e-f46f-4457-ae42-b9fe637a2dbe for instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc on n-h1-860892-1 Oct 11 04:17:30.963660 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c9f5dee3-da4d-427a-ae0e-cefb758fb61b req-bff09bea-8b56-48d6-b714-884cebe2a357 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096391 Oct 11 04:17:30.964515 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 976/1880] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:31.129601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-96d86fc6-c927-4d71-8ef9-24ad4d94d64f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:31.130594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-96d86fc6-c927-4d71-8ef9-24ad4d94d64f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:31.145607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d86fc6-c927-4d71-8ef9-24ad4d94d64f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:31.147442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d86fc6-c927-4d71-8ef9-24ad4d94d64f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:31.152298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d86fc6-c927-4d71-8ef9-24ad4d94d64f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:31.154548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d86fc6-c927-4d71-8ef9-24ad4d94d64f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:31.154548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d86fc6-c927-4d71-8ef9-24ad4d94d64f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:31.154548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96d86fc6-c927-4d71-8ef9-24ad4d94d64f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:31.824290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-96d86fc6-c927-4d71-8ef9-24ad4d94d64f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:31.904458 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-96d86fc6-c927-4d71-8ef9-24ad4d94d64f tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1647 microversion: 2.1 time: 0.765864 Oct 11 04:17:31.906654 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 977/1881] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:31 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1647 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:31.926996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:31.929576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:31.952326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:31.953622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:31.956409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:31.958499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:31.959420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:31.962055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:32.019883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:32.020581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:32.021213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:32.022205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lazy-loading 'fault' on Instance uuid e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:17:32.071714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:32.191809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:32.228865 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9402cc0b-1d25-4108-a75e-14b4161f26c4 tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 1.602237 Oct 11 04:17:32.238880 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 905/1882] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 11 04:17:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 1613 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 11 04:17:32.244366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c041c72-e2d6-4579-835a-108fcd1ffa52 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:32.245303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c041c72-e2d6-4579-835a-108fcd1ffa52 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:32.271225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c041c72-e2d6-4579-835a-108fcd1ffa52 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:32.278290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c041c72-e2d6-4579-835a-108fcd1ffa52 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:32.279613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c041c72-e2d6-4579-835a-108fcd1ffa52 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:32.302442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c041c72-e2d6-4579-835a-108fcd1ffa52 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:32.302993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c041c72-e2d6-4579-835a-108fcd1ffa52 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:32.303446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c041c72-e2d6-4579-835a-108fcd1ffa52 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:32.386814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:32.399820 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b6fad687-392a-447d-8543-0e9efc7f0d4a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 200 len: 1311 microversion: 2.1 time: 0.490203 Oct 11 04:17:32.422513 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 978/1883] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:31 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 1311 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:32.439798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2383428d-d40b-4b72-8760-95eed6c1bb72 req-d9cc1087-ad2b-4db5-9fe3-125e4f26541a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf4d394b-f24d-4e16-9ba1-ea7258409ba1", "name": "network-vif-deleted", "tag": "0f2d4990-788c-41e8-a1d7-9dece272e13f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:32.464874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2383428d-d40b-4b72-8760-95eed6c1bb72 req-d9cc1087-ad2b-4db5-9fe3-125e4f26541a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:32.466908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2383428d-d40b-4b72-8760-95eed6c1bb72 req-d9cc1087-ad2b-4db5-9fe3-125e4f26541a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:32.467372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2383428d-d40b-4b72-8760-95eed6c1bb72 req-d9cc1087-ad2b-4db5-9fe3-125e4f26541a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:32.502009 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2383428d-d40b-4b72-8760-95eed6c1bb72 req-d9cc1087-ad2b-4db5-9fe3-125e4f26541a service nova] Creating event network-vif-deleted:0f2d4990-788c-41e8-a1d7-9dece272e13f for instance bf4d394b-f24d-4e16-9ba1-ea7258409ba1 on n-h1-860892-1 Oct 11 04:17:32.514813 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2383428d-d40b-4b72-8760-95eed6c1bb72 req-d9cc1087-ad2b-4db5-9fe3-125e4f26541a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090488 Oct 11 04:17:32.517888 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 979/1884] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:32.533684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-37fadc87-7fdd-477d-b038-4c20c65bab51 tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Calling method '.version_select at 0x7fda1dfd6af0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:32.652368 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-37fadc87-7fdd-477d-b038-4c20c65bab51 tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2" status: 200 len: 352 microversion: 2.1 time: 0.133373 Oct 11 04:17:32.654709 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 980/1885] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:17:32 2022] GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2 => generated 352 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:32.739494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8c041c72-e2d6-4579-835a-108fcd1ffa52 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:32.750692 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8c041c72-e2d6-4579-835a-108fcd1ffa52 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1316 microversion: 2.1 time: 0.510207 Oct 11 04:17:32.752254 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 906/1886] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:32 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1316 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:32.930469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:32.940417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:32.945334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:32.967196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:32.975100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:32.975517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:32.991441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:32.992596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:32.999623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:33.000092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:33.126040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:33.127903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:33.129266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:33.132365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lazy-loading 'fault' on Instance uuid bf4d394b-f24d-4e16-9ba1-ea7258409ba1 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:17:33.324695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6be7a47546714f65a31dcba5eb765185', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cfa2ff1f293640e6a2302bae4d10048e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:33.346678 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3b04704-2980-4a32-9ebb-504630e9ac29 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 200 len: 1366 microversion: 2.1 time: 0.408242 Oct 11 04:17:33.346678 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 981/1887] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:32 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 1366 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:33.425271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:33.425899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:33.437623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:33.442743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:33.442743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:33.445461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:33.449753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:33.452402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:33.497067 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] HTTP exception thrown: Instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc could not be found. Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Request method failure captured: Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc HTTP/1.1 Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO4krnesm6fvy-LqMLmy4WNy3rvbWrURTtwX_rmEpUPuWHRBv6gFtFCdvgHsUTnnTQoUeeR6j1_94yaI_sOTxTSNJGwSkhBbmXStGArD7m6BgSNhJvQIKVN3nrIzAEzL8hDgwcGJxy3Aio7Dwknen7u2F9Xc2VVqs8Zkgjd7LW5LSKQ Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 702da37a766e4613bceb0f78bc71df56 Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2097717110 Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/702da37a766e4613bceb0f78bc71df56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_702da37a766e4613bceb0f78bc71df56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/702da37a766e4613bceb0f78bc71df56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/702da37a766e4613bceb0f78bc71df56"}]}] Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2097717110 Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 702da37a766e4613bceb0f78bc71df56 Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2097717110 Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAdminNegativeTestJSON-2097717110-project Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: cfa9dc90efcf4ba9a1edcc5c19a8f3c6 Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2097717110-project Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc could not be found. Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc'} Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc could not be found. Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc could not be found. Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:33.500187 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:33.508460 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:33.508460 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:33.508460 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:33.508460 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:33.508460 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:33.508460 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:33.508460 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc could not be found. Oct 11 04:17:33.508460 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:33.515892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Returning 404 to user: Instance e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:33.518546 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2088fe4f-a2a2-45d6-a6f2-f2ddf0c0a646 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc" status: 404 len: 111 microversion: 2.1 time: 0.098175 Oct 11 04:17:33.524347 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 907/1888] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:33 2022] GET /compute/v2.1/servers/e30d94b5-40b3-4f28-9d56-6c48dd3ce0fc => generated 111 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:17:33.534100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6fe1a565-757e-46a3-aa7c-d3e3f7fee19a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:33.534959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6fe1a565-757e-46a3-aa7c-d3e3f7fee19a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:33.554139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fe1a565-757e-46a3-aa7c-d3e3f7fee19a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:33.554620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fe1a565-757e-46a3-aa7c-d3e3f7fee19a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:33.558000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fe1a565-757e-46a3-aa7c-d3e3f7fee19a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:33.558000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fe1a565-757e-46a3-aa7c-d3e3f7fee19a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:33.558000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fe1a565-757e-46a3-aa7c-d3e3f7fee19a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:33.558000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fe1a565-757e-46a3-aa7c-d3e3f7fee19a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:33.647087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6fe1a565-757e-46a3-aa7c-d3e3f7fee19a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:17:33.669127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3488b515-cad1-4004-b58b-d49f76ab9abf tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Calling method '.version_select at 0x7fda1938caf0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:33.795046 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3488b515-cad1-4004-b58b-d49f76ab9abf tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2" status: 200 len: 352 microversion: 2.1 time: 0.131184 Oct 11 04:17:33.795597 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 908/1889] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:17:33 2022] GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2 => generated 352 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:17:33.800655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-61e85cf5-f9b2-45e8-8ce5-fa4b83771153 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:33.801504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-61e85cf5-f9b2-45e8-8ce5-fa4b83771153 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:33.812172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61e85cf5-f9b2-45e8-8ce5-fa4b83771153 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:33.815646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61e85cf5-f9b2-45e8-8ce5-fa4b83771153 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:33.816086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61e85cf5-f9b2-45e8-8ce5-fa4b83771153 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:33.816806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61e85cf5-f9b2-45e8-8ce5-fa4b83771153 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:33.817255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61e85cf5-f9b2-45e8-8ce5-fa4b83771153 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:33.822852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61e85cf5-f9b2-45e8-8ce5-fa4b83771153 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:34.051269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-61e85cf5-f9b2-45e8-8ce5-fa4b83771153 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:34.071627 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-61e85cf5-f9b2-45e8-8ce5-fa4b83771153 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1316 microversion: 2.1 time: 0.274545 Oct 11 04:17:34.075232 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 909/1890] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:33 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1316 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:34.258083 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6fe1a565-757e-46a3-aa7c-d3e3f7fee19a tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "DELETE /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 204 len: 0 microversion: 2.1 time: 0.728448 Oct 11 04:17:34.261793 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 982/1891] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:17:33 2022] DELETE /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:17:34.267072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2acc2539-4841-41f7-9ff6-ab7b9c263601 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:34.267927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2acc2539-4841-41f7-9ff6-ab7b9c263601 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:34.283255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2acc2539-4841-41f7-9ff6-ab7b9c263601 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:34.283255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2acc2539-4841-41f7-9ff6-ab7b9c263601 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:34.283255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2acc2539-4841-41f7-9ff6-ab7b9c263601 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:34.283255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2acc2539-4841-41f7-9ff6-ab7b9c263601 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:34.286638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2acc2539-4841-41f7-9ff6-ab7b9c263601 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:34.287329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2acc2539-4841-41f7-9ff6-ab7b9c263601 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:34.370747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:34.374337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] [instance: bf4d394b-f24d-4e16-9ba1-ea7258409ba1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:34.405363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:34.407391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:34.408083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:34.411578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:34.412536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:34.414114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:34.474712 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] HTTP exception thrown: Instance bf4d394b-f24d-4e16-9ba1-ea7258409ba1 could not be found. Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Request method failure captured: Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 HTTP/1.1 Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO3nSC9xLuM_ytNUExuwFmDOlUh7G02R6UhVJayWudRBZb0xSWsW7u55yzVsH-yg0VN8HXKjmJcJtApTvBzACmMNmmfJACvHGHHZlSFa5W-bHW294aFuMbDRPboA3adS0tVYus50EauqWrtFpReDoHUAqkKqFGTytOFJF-Cc6TjnDtE Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: cfa2ff1f293640e6a2302bae4d10048e Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestManualDisk-906006463 Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cfa2ff1f293640e6a2302bae4d10048e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cfa2ff1f293640e6a2302bae4d10048e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cfa2ff1f293640e6a2302bae4d10048e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cfa2ff1f293640e6a2302bae4d10048e"}]}] Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestManualDisk-906006463 Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: cfa2ff1f293640e6a2302bae4d10048e Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestManualDisk-906006463 Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestManualDisk-906006463-project Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 6be7a47546714f65a31dcba5eb765185 Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestManualDisk-906006463-project Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance bf4d394b-f24d-4e16-9ba1-ea7258409ba1 could not be found. Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'bf4d394b-f24d-4e16-9ba1-ea7258409ba1'} Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf4d394b-f24d-4e16-9ba1-ea7258409ba1 could not be found. Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf4d394b-f24d-4e16-9ba1-ea7258409ba1 could not be found. Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:34.478575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:34.484575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:34.484575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:34.484575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:34.484575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:34.484575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:34.484575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf4d394b-f24d-4e16-9ba1-ea7258409ba1 could not be found. Oct 11 04:17:34.484575 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:34.484575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Returning 404 to user: Instance bf4d394b-f24d-4e16-9ba1-ea7258409ba1 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:34.484575 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ead3b6b6-e081-4221-a14f-d3180cc4a3c4 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1" status: 404 len: 111 microversion: 2.1 time: 0.121348 Oct 11 04:17:34.491188 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 983/1892] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:34 2022] GET /compute/v2.1/servers/bf4d394b-f24d-4e16-9ba1-ea7258409ba1 => generated 111 bytes in 133 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:17:34.512325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-05381a8f-655d-4ddd-8617-ea2a9a0b4c53 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] Calling method '.version_select at 0x7fda1df74550>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:34.641206 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-05381a8f-655d-4ddd-8617-ea2a9a0b4c53 tempest-ServersTestManualDisk-906006463 tempest-ServersTestManualDisk-906006463-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-298367566" status: 202 len: 0 microversion: 2.1 time: 0.148808 Oct 11 04:17:34.644797 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 984/1893] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:17:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-298367566 => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:17:34.814276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c284a987-3d51-450f-8ed7-4bf91a9c39ac tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Calling method '.version_select at 0x7fda1dfc95e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:34.829507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2acc2539-4841-41f7-9ff6-ab7b9c263601 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:34.837360 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2acc2539-4841-41f7-9ff6-ab7b9c263601 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1475 microversion: 2.1 time: 0.574058 Oct 11 04:17:34.837943 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 910/1894] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:34 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1475 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:34.926066 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c284a987-3d51-450f-8ed7-4bf91a9c39ac tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2" status: 200 len: 353 microversion: 2.1 time: 0.119669 Oct 11 04:17:34.926066 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 985/1895] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:17:34 2022] GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2 => generated 353 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:34.954443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-82104537-a732-4c9b-aafc-6991cb04febf tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Calling method '.version_select at 0x7fda19402a60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:35.032776 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-82104537-a732-4c9b-aafc-6991cb04febf tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2" status: 200 len: 353 microversion: 2.1 time: 0.085899 Oct 11 04:17:35.033948 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 911/1896] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:17:34 2022] GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2 => generated 353 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:35.048034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22eaf2ab-2eed-438a-88e7-adf68a59254a tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Calling method '.version_select at 0x7fda1dfdfd30>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:35.100305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d71a6d9a-a157-4038-86bc-196bf4e51f0f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:35.101350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d71a6d9a-a157-4038-86bc-196bf4e51f0f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:35.122055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71a6d9a-a157-4038-86bc-196bf4e51f0f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:35.122590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71a6d9a-a157-4038-86bc-196bf4e51f0f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:35.126413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71a6d9a-a157-4038-86bc-196bf4e51f0f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:35.127661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71a6d9a-a157-4038-86bc-196bf4e51f0f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:35.130448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71a6d9a-a157-4038-86bc-196bf4e51f0f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:35.131312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71a6d9a-a157-4038-86bc-196bf4e51f0f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:35.370536 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22eaf2ab-2eed-438a-88e7-adf68a59254a tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2" status: 202 len: 0 microversion: 2.1 time: 0.326915 Oct 11 04:17:35.376012 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 986/1897] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:17:35 2022] DELETE /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:17:35.388379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2850f336-d947-4531-8123-3b468dbe622a tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Calling method '.version_select at 0x7fda1a2f18b0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:35.459649 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2850f336-d947-4531-8123-3b468dbe622a tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2" status: 200 len: 352 microversion: 2.1 time: 0.082276 Oct 11 04:17:35.468433 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 987/1898] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:17:35 2022] GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2 => generated 352 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:35.721571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d71a6d9a-a157-4038-86bc-196bf4e51f0f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:35.735233 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d71a6d9a-a157-4038-86bc-196bf4e51f0f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1316 microversion: 2.1 time: 0.641961 Oct 11 04:17:35.754675 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 912/1899] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:35 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1316 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:35.864920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0132b060-3f18-4e97-92cd-1d6d9d9ddc05 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:35.867413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0132b060-3f18-4e97-92cd-1d6d9d9ddc05 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:35.879694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0132b060-3f18-4e97-92cd-1d6d9d9ddc05 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:35.880480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0132b060-3f18-4e97-92cd-1d6d9d9ddc05 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:35.881701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0132b060-3f18-4e97-92cd-1d6d9d9ddc05 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:35.883823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0132b060-3f18-4e97-92cd-1d6d9d9ddc05 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:35.884522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0132b060-3f18-4e97-92cd-1d6d9d9ddc05 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:35.921186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0132b060-3f18-4e97-92cd-1d6d9d9ddc05 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.036s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:36.222109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0132b060-3f18-4e97-92cd-1d6d9d9ddc05 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:36.230337 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0132b060-3f18-4e97-92cd-1d6d9d9ddc05 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1475 microversion: 2.1 time: 0.370141 Oct 11 04:17:36.246878 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 988/1900] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:35 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1475 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:36.475841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-938369b3-ee28-4ab6-9a92-ac773b68b33c tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Calling method '.version_select at 0x7fda19402670>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:36.544036 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-938369b3-ee28-4ab6-9a92-ac773b68b33c tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2" status: 200 len: 352 microversion: 2.1 time: 0.072088 Oct 11 04:17:36.545580 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 913/1901] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:17:36 2022] GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2 => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:36.765147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7abc1617-3d76-42ef-895b-707ccb98ed7a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:36.768390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7abc1617-3d76-42ef-895b-707ccb98ed7a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:36.776626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:36.778760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7abc1617-3d76-42ef-895b-707ccb98ed7a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:36.780074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7abc1617-3d76-42ef-895b-707ccb98ed7a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:36.784136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7abc1617-3d76-42ef-895b-707ccb98ed7a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:36.785981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7abc1617-3d76-42ef-895b-707ccb98ed7a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:36.786658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7abc1617-3d76-42ef-895b-707ccb98ed7a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:36.787288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7abc1617-3d76-42ef-895b-707ccb98ed7a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:36.870273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6760e98e-3c65-4723-bffb-bff381363204 req-3d579b07-5a49-4103-af27-5e989e334d59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9743668-8bc9-4d7e-8a99-c443ee982477", "name": "network-vif-plugged", "status": "completed", "tag": "867ccd69-2e5d-4d8e-9eab-bd210ae13cc7"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:36.884257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6760e98e-3c65-4723-bffb-bff381363204 req-3d579b07-5a49-4103-af27-5e989e334d59 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:36.896824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6760e98e-3c65-4723-bffb-bff381363204 req-3d579b07-5a49-4103-af27-5e989e334d59 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:36.897639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6760e98e-3c65-4723-bffb-bff381363204 req-3d579b07-5a49-4103-af27-5e989e334d59 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:36.914105 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6760e98e-3c65-4723-bffb-bff381363204 req-3d579b07-5a49-4103-af27-5e989e334d59 service nova] Creating event network-vif-plugged:867ccd69-2e5d-4d8e-9eab-bd210ae13cc7 for instance d9743668-8bc9-4d7e-8a99-c443ee982477 on n-h1-860892-1 Oct 11 04:17:36.930904 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6760e98e-3c65-4723-bffb-bff381363204 req-3d579b07-5a49-4103-af27-5e989e334d59 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055227 Oct 11 04:17:36.930904 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 914/1902] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:17:37.162563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7abc1617-3d76-42ef-895b-707ccb98ed7a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:37.183688 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7abc1617-3d76-42ef-895b-707ccb98ed7a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1316 microversion: 2.1 time: 0.423584 Oct 11 04:17:37.187348 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 989/1903] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:36 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1316 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:37.255866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-992c9634-4190-49cc-a72a-cdb34bce930b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:37.256867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-992c9634-4190-49cc-a72a-cdb34bce930b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:37.276145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992c9634-4190-49cc-a72a-cdb34bce930b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:37.276893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992c9634-4190-49cc-a72a-cdb34bce930b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:37.277444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992c9634-4190-49cc-a72a-cdb34bce930b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:37.278260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992c9634-4190-49cc-a72a-cdb34bce930b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:37.278786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992c9634-4190-49cc-a72a-cdb34bce930b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:37.279461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992c9634-4190-49cc-a72a-cdb34bce930b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:37.286730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:37.560537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cf62baa0-5e11-456b-8890-3318dbb45453 tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Calling method '.version_select at 0x7fda1dfdf550>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:37.670940 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cf62baa0-5e11-456b-8890-3318dbb45453 tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2" status: 200 len: 352 microversion: 2.1 time: 0.116340 Oct 11 04:17:37.678100 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 990/1904] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:17:37 2022] GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2 => generated 352 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:17:38.007175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-992c9634-4190-49cc-a72a-cdb34bce930b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:38.015650 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-992c9634-4190-49cc-a72a-cdb34bce930b tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1475 microversion: 2.1 time: 0.765863 Oct 11 04:17:38.031986 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 915/1905] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:37 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1475 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:38.232464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-98c32b1e-bf1f-4330-b696-2242d99ff7fc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:38.233107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-98c32b1e-bf1f-4330-b696-2242d99ff7fc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:38.272057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c32b1e-bf1f-4330-b696-2242d99ff7fc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:38.274850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c32b1e-bf1f-4330-b696-2242d99ff7fc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:38.277069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c32b1e-bf1f-4330-b696-2242d99ff7fc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:38.278802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c32b1e-bf1f-4330-b696-2242d99ff7fc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:38.282109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c32b1e-bf1f-4330-b696-2242d99ff7fc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:38.283167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c32b1e-bf1f-4330-b696-2242d99ff7fc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:38.507796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-febf4730-6830-4e9d-8f8a-694e670f288f req-8616ac1f-1356-4d6c-aa4c-d34e7e4975aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58b387b4-b392-4d20-90b2-588a989415d4", "name": "network-vif-deleted", "tag": "b84a921c-9d36-40b5-b62d-04b068e7459d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:38.528530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-febf4730-6830-4e9d-8f8a-694e670f288f req-8616ac1f-1356-4d6c-aa4c-d34e7e4975aa service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:38.528530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-febf4730-6830-4e9d-8f8a-694e670f288f req-8616ac1f-1356-4d6c-aa4c-d34e7e4975aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:38.528530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-febf4730-6830-4e9d-8f8a-694e670f288f req-8616ac1f-1356-4d6c-aa4c-d34e7e4975aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:38.556381 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-febf4730-6830-4e9d-8f8a-694e670f288f req-8616ac1f-1356-4d6c-aa4c-d34e7e4975aa service nova] Creating event network-vif-deleted:b84a921c-9d36-40b5-b62d-04b068e7459d for instance 58b387b4-b392-4d20-90b2-588a989415d4 on n-h2-860892-1 Oct 11 04:17:38.564375 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-febf4730-6830-4e9d-8f8a-694e670f288f req-8616ac1f-1356-4d6c-aa4c-d34e7e4975aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060650 Oct 11 04:17:38.565614 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 916/1906] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:38.633665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-98c32b1e-bf1f-4330-b696-2242d99ff7fc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:38.642060 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-98c32b1e-bf1f-4330-b696-2242d99ff7fc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1316 microversion: 2.1 time: 0.422219 Oct 11 04:17:38.642980 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 991/1907] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:38 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1316 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:38.690664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-594dd90e-334b-4a14-a353-a07be1a7534d tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Calling method '.version_select at 0x7fda19446c10>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:38.828309 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-594dd90e-334b-4a14-a353-a07be1a7534d tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2" status: 200 len: 352 microversion: 2.1 time: 0.146356 Oct 11 04:17:38.836263 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 917/1908] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:17:38 2022] GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2 => generated 352 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:39.056782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:39.058132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:39.069816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:39.070356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:39.070798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:39.072666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:39.073109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:39.078996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:39.132086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:39.153208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:39.154094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:39.155188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:39.155583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lazy-loading 'fault' on Instance uuid 58b387b4-b392-4d20-90b2-588a989415d4 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:17:39.572345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa9dc90efcf4ba9a1edcc5c19a8f3c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '702da37a766e4613bceb0f78bc71df56', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:39.589760 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e52c1e99-c5a4-4511-b7f1-ecb5d0130002 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 200 len: 1310 microversion: 2.1 time: 0.536979 Oct 11 04:17:39.594160 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 992/1909] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:39 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 1310 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:39.665240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8efa2d5-c49d-4e1c-9665-b8d53f6f7c71 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:39.666058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8efa2d5-c49d-4e1c-9665-b8d53f6f7c71 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:39.676885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8efa2d5-c49d-4e1c-9665-b8d53f6f7c71 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:39.678775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8efa2d5-c49d-4e1c-9665-b8d53f6f7c71 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:39.679444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8efa2d5-c49d-4e1c-9665-b8d53f6f7c71 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:39.680393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8efa2d5-c49d-4e1c-9665-b8d53f6f7c71 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:39.686576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8efa2d5-c49d-4e1c-9665-b8d53f6f7c71 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:39.687532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8efa2d5-c49d-4e1c-9665-b8d53f6f7c71 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:39.844132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d80e6710-f952-4ac2-b33f-24c996a193eb tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Calling method '.version_select at 0x7fda1df525e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:39.900084 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d80e6710-f952-4ac2-b33f-24c996a193eb tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] HTTP exception thrown: Volume 61226b83-5db8-4684-89b1-0b6d58934ec2 could not be found. Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d80e6710-f952-4ac2-b33f-24c996a193eb tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Request method failure captured: Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2 HTTP/1.1 Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5aowVWvorLuw03IIpBT4EQBj6b-PMKBj0QS1ulv96XrA0FICACqVvIFQxIoo73PZOBgtVbZnhgmEVcwBkMEZ_4BAJYQlWlbwIugs4nZOkPljgbkGZQit2RlLpcpQrLpSokQlRWJd2RDCD_jmsIFLM7QI0iTviUNlUIXoCeYlBlS4g Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f9ea6770dd5e4397ac92325c3d7f4ea5 Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesGetTestJSON-2001440822 Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f9ea6770dd5e4397ac92325c3d7f4ea5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f9ea6770dd5e4397ac92325c3d7f4ea5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ea6770dd5e4397ac92325c3d7f4ea5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f9ea6770dd5e4397ac92325c3d7f4ea5"}]}] Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesGetTestJSON-2001440822 Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f9ea6770dd5e4397ac92325c3d7f4ea5 Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesGetTestJSON-2001440822 Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesGetTestJSON-2001440822-project Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 2f7dcf174d91441bb8ef8f5efb0282a1 Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesGetTestJSON-2001440822-project Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: exception: Volume 61226b83-5db8-4684-89b1-0b6d58934ec2 could not be found. Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '61226b83-5db8-4684-89b1-0b6d58934ec2'} Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61226b83-5db8-4684-89b1-0b6d58934ec2 could not be found. (HTTP 404) (Request-ID: req-e65a3e6c-5956-43fb-b4fc-82ff1f5b2f51) Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 04:17:39.935082 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61226b83-5db8-4684-89b1-0b6d58934ec2 could not be found. Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61226b83-5db8-4684-89b1-0b6d58934ec2 could not be found. Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61226b83-5db8-4684-89b1-0b6d58934ec2 could not be found. Oct 11 04:17:39.940393 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:39.945945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d80e6710-f952-4ac2-b33f-24c996a193eb tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] Returning 404 to user: Volume 61226b83-5db8-4684-89b1-0b6d58934ec2 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:39.945945 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d80e6710-f952-4ac2-b33f-24c996a193eb tempest-VolumesGetTestJSON-2001440822 tempest-VolumesGetTestJSON-2001440822-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2" status: 404 len: 109 microversion: 2.1 time: 0.105584 Oct 11 04:17:39.946731 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 993/1910] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:17:39 2022] GET /compute/v2.1/os-volumes/61226b83-5db8-4684-89b1-0b6d58934ec2 => generated 109 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:17:40.122254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8efa2d5-c49d-4e1c-9665-b8d53f6f7c71 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:40.135489 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e8efa2d5-c49d-4e1c-9665-b8d53f6f7c71 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1466 microversion: 2.1 time: 0.473875 Oct 11 04:17:40.157349 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 918/1911] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:39 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1466 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:40.167120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb1f16ee-37eb-43bd-9583-271fb9cda72a tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:40.167733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb1f16ee-37eb-43bd-9583-271fb9cda72a tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:40.186891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb1f16ee-37eb-43bd-9583-271fb9cda72a tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:40.188648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb1f16ee-37eb-43bd-9583-271fb9cda72a tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:40.190700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb1f16ee-37eb-43bd-9583-271fb9cda72a tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:40.192635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb1f16ee-37eb-43bd-9583-271fb9cda72a tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:40.193990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb1f16ee-37eb-43bd-9583-271fb9cda72a tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:40.195286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb1f16ee-37eb-43bd-9583-271fb9cda72a tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:40.616232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:40.616807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] [instance: 58b387b4-b392-4d20-90b2-588a989415d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:40.635610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:40.640372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:40.640840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:40.641595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:40.642054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:40.642747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:40.720567 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] HTTP exception thrown: Instance 58b387b4-b392-4d20-90b2-588a989415d4 could not be found. Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Request method failure captured: Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 HTTP/1.1 Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO4krnesm6fvy-LqMLmy4WNy3rvbWrURTtwX_rmEpUPuWHRBv6gFtFCdvgHsUTnnTQoUeeR6j1_94yaI_sOTxTSNJGwSkhBbmXStGArD7m6BgSNhJvQIKVN3nrIzAEzL8hDgwcGJxy3Aio7Dwknen7u2F9Xc2VVqs8Zkgjd7LW5LSKQ Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 702da37a766e4613bceb0f78bc71df56 Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2097717110 Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/702da37a766e4613bceb0f78bc71df56"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_702da37a766e4613bceb0f78bc71df56"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/702da37a766e4613bceb0f78bc71df56"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/702da37a766e4613bceb0f78bc71df56"}]}] Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2097717110 Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 702da37a766e4613bceb0f78bc71df56 Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2097717110 Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAdminNegativeTestJSON-2097717110-project Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: cfa9dc90efcf4ba9a1edcc5c19a8f3c6 Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2097717110-project Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 58b387b4-b392-4d20-90b2-588a989415d4 could not be found. Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '58b387b4-b392-4d20-90b2-588a989415d4'} Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 58b387b4-b392-4d20-90b2-588a989415d4 could not be found. Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 58b387b4-b392-4d20-90b2-588a989415d4 could not be found. Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:40.731079 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:40.736423 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:40.736423 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:40.736423 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:40.736423 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:40.736423 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:40.736423 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:40.736423 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 58b387b4-b392-4d20-90b2-588a989415d4 could not be found. Oct 11 04:17:40.736423 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:17:40.736423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] Returning 404 to user: Instance 58b387b4-b392-4d20-90b2-588a989415d4 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:40.737718 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6407b83f-fc72-462f-8277-2014fa986ab3 tempest-ServersAdminNegativeTestJSON-2097717110 tempest-ServersAdminNegativeTestJSON-2097717110-project] 10.222.0.26 "GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4" status: 404 len: 111 microversion: 2.1 time: 0.125547 Oct 11 04:17:40.741654 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 919/1912] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:40 2022] GET /compute/v2.1/servers/58b387b4-b392-4d20-90b2-588a989415d4 => generated 111 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:17:40.947900 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb1f16ee-37eb-43bd-9583-271fb9cda72a tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1617 microversion: 2.1 time: 0.778309 Oct 11 04:17:40.949128 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 994/1913] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:40 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1617 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:41.531239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5fa8058-46cf-4137-81b2-cdfdd9b7915c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:41.542049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c5fa8058-46cf-4137-81b2-cdfdd9b7915c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:41.544112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c5fa8058-46cf-4137-81b2-cdfdd9b7915c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Searching by: {'deleted': False, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:17:41.567918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5fa8058-46cf-4137-81b2-cdfdd9b7915c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:41.589975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5fa8058-46cf-4137-81b2-cdfdd9b7915c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:41.589975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5fa8058-46cf-4137-81b2-cdfdd9b7915c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:41.589975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5fa8058-46cf-4137-81b2-cdfdd9b7915c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:41.589975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5fa8058-46cf-4137-81b2-cdfdd9b7915c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:41.589975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5fa8058-46cf-4137-81b2-cdfdd9b7915c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:41.650607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-c5fa8058-46cf-4137-81b2-cdfdd9b7915c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:17:41.675120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-245366750", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}, "os:scheduler_hints": {"different_host": ["b997d21c-b814-4e0c-aba4-53ea4b3c590b"]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:41.804966 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c5fa8058-46cf-4137-81b2-cdfdd9b7915c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 344 microversion: 2.1 time: 0.276506 Oct 11 04:17:41.807844 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 920/1914] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:17:41 2022] GET /compute/v2.1/servers => generated 344 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:41.855692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:17:42.295388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9ff2fea4-0d69-4080-ac16-40dad2aa10b2 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Action: 'create', calling method: .version_select at 0x7fda1934cc10>, body: {"keypair": {"name": "tempest-keypair-300026022", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKAzG191dqySeqaOOi2sIuDh7flqT7jZ0GLwHBHTKh9N9WxURmzbZ0d53rToNOafESBUNEd4KxtzaBiObE/c5+On8dce6ohM7hW1ojkHHksNe9NFkgiXey9Hz7lK9SfJ2Q=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:42.344203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-9ff2fea4-0d69-4080-ac16-40dad2aa10b2 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Getting quotas for project a3d48dc85fd64507b459034b67232052. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:17:42.362667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-9ff2fea4-0d69-4080-ac16-40dad2aa10b2 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Getting quotas for user 555865c5372246009bb223d5cbfb8b24 and project a3d48dc85fd64507b459034b67232052. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:17:42.546557 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9ff2fea4-0d69-4080-ac16-40dad2aa10b2 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.735594 Oct 11 04:17:42.551398 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 921/1915] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:17:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:42.571398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:42.586592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:17:42.587070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:17:42.587618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:42.587860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:17:42.589380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:17:42.589931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:17:42.592538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Searching by: {'deleted': False, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:17:42.609435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:42.609929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:42.610395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:42.611242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:42.614261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:42.614809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:42.620226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:42.620226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:42.620445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:42.620445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:42.620620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:42.620620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:42.673273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:17:42.688961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:17:42.714647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:17:42.740309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:17:42.740309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:17:42.866875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:42.922096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:42.923505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:42.923969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:43.168412 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-553a908d-410c-48fc-9e87-53a84819203d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.508232 Oct 11 04:17:43.172841 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 995/1916] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:17:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 1513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:17:43.198747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d1cfb0a-b3e9-436e-a4b2-505584127cca tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:43.198747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4d1cfb0a-b3e9-436e-a4b2-505584127cca tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:43.328142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4d1cfb0a-b3e9-436e-a4b2-505584127cca tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:43.345110 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4d1cfb0a-b3e9-436e-a4b2-505584127cca tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1216 microversion: 2.1 time: 0.161981 Oct 11 04:17:43.347866 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 996/1917] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:43 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1216 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:43.651517 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a5966891-fa4c-44c9-892d-2a97d09c55d8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1604 microversion: 2.1 time: 1.092235 Oct 11 04:17:43.652099 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 922/1918] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:17:42 2022] GET /compute/v2.1/servers/detail => generated 1604 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:43.677397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-77c0ba90-783e-4e30-9fa3-cd5eaa813bd1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:43.686441 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-77c0ba90-783e-4e30-9fa3-cd5eaa813bd1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.013002 Oct 11 04:17:43.692578 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 997/1919] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:17:43 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:44.032127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-915fe0db-da22-41c9-b6b6-5e8883548dd5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:44.032127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-915fe0db-da22-41c9-b6b6-5e8883548dd5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:44.045222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915fe0db-da22-41c9-b6b6-5e8883548dd5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:44.045739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915fe0db-da22-41c9-b6b6-5e8883548dd5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:44.047933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915fe0db-da22-41c9-b6b6-5e8883548dd5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:44.049358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915fe0db-da22-41c9-b6b6-5e8883548dd5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:44.049833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915fe0db-da22-41c9-b6b6-5e8883548dd5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:44.050294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915fe0db-da22-41c9-b6b6-5e8883548dd5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:44.167795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-915fe0db-da22-41c9-b6b6-5e8883548dd5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:17:44.378924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c798b36e-f3c6-412e-b0af-174efc0abbc0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:44.378924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c798b36e-f3c6-412e-b0af-174efc0abbc0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:44.496408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c798b36e-f3c6-412e-b0af-174efc0abbc0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:44.505483 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c798b36e-f3c6-412e-b0af-174efc0abbc0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1216 microversion: 2.1 time: 0.138973 Oct 11 04:17:44.506807 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 998/1920] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:44 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1216 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:44.575374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:44.661327 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-915fe0db-da22-41c9-b6b6-5e8883548dd5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "DELETE /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 204 len: 0 microversion: 2.1 time: 0.637248 Oct 11 04:17:44.669070 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 923/1921] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:17:44 2022] DELETE /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:17:44.673494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90445f67-dcc3-4f50-ba36-5b53cbe16648 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:44.674117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90445f67-dcc3-4f50-ba36-5b53cbe16648 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:44.693907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90445f67-dcc3-4f50-ba36-5b53cbe16648 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:44.695717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90445f67-dcc3-4f50-ba36-5b53cbe16648 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:44.695717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90445f67-dcc3-4f50-ba36-5b53cbe16648 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:44.695931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90445f67-dcc3-4f50-ba36-5b53cbe16648 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:44.698403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90445f67-dcc3-4f50-ba36-5b53cbe16648 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:44.698873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90445f67-dcc3-4f50-ba36-5b53cbe16648 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:44.953778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-90445f67-dcc3-4f50-ba36-5b53cbe16648 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:44.967859 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90445f67-dcc3-4f50-ba36-5b53cbe16648 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1607 microversion: 2.1 time: 0.295453 Oct 11 04:17:44.972199 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 999/1922] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:44 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1607 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:45.532682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a53779c6-4cf2-4e7c-bdb5-1691394b37ff tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:45.534057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a53779c6-4cf2-4e7c-bdb5-1691394b37ff tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:45.548741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a53779c6-4cf2-4e7c-bdb5-1691394b37ff tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:45.558090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a53779c6-4cf2-4e7c-bdb5-1691394b37ff tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:45.558817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a53779c6-4cf2-4e7c-bdb5-1691394b37ff tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:45.561060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a53779c6-4cf2-4e7c-bdb5-1691394b37ff tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:45.565959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a53779c6-4cf2-4e7c-bdb5-1691394b37ff tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:45.566457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a53779c6-4cf2-4e7c-bdb5-1691394b37ff tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:45.753908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a53779c6-4cf2-4e7c-bdb5-1691394b37ff tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:45.765134 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a53779c6-4cf2-4e7c-bdb5-1691394b37ff tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1212 microversion: 2.1 time: 0.237568 Oct 11 04:17:45.766316 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 924/1923] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:45 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1212 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:46.009428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bf3e08f8-35e6-4759-a9ea-bd9e30884ca8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:46.010254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bf3e08f8-35e6-4759-a9ea-bd9e30884ca8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:46.028026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf3e08f8-35e6-4759-a9ea-bd9e30884ca8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:46.028026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf3e08f8-35e6-4759-a9ea-bd9e30884ca8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:46.028523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf3e08f8-35e6-4759-a9ea-bd9e30884ca8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:46.029168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf3e08f8-35e6-4759-a9ea-bd9e30884ca8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:46.029607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf3e08f8-35e6-4759-a9ea-bd9e30884ca8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:46.030037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf3e08f8-35e6-4759-a9ea-bd9e30884ca8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:46.094094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9d4f136-9cf1-40c7-8928-0b135b28a391 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Action: 'create', calling method: .version_select at 0x7fda19569670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1848001320", "metadata": {"Type": "work"}}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9d4f136-9cf1-40c7-8928-0b135b28a391 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Request method failure captured: Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 122 Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5pN8J7XUQeyFdbaJVki6d2ffvhLBDJvN2xLLL_gT97SCxrnQoII9FdMNVgDqZJIIAvgtcLt0HsNhQI7yc_QvNfhjTTKd8NNDYZ43t2kdmQDshep2jXit4yiadqAQqyT_5_X6W_gCkyycMsErddj_kGS3Bc3KolWbgStpdn6-BzKzg Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}] Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c7a468ed3f540228759bfdab063d132 Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1848001320", "metadata": {"Type": "work"}}} Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1848001320', 'metadata': {'Type': 'work'}}}} Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi '#$%' Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:17:46.098755 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.103529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9d4f136-9cf1-40c7-8928-0b135b28a391 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:46.106208 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d9d4f136-9cf1-40c7-8928-0b135b28a391 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.400874 Oct 11 04:17:46.116080 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1000/1924] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 11 04:17:45 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 413 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:17:46.133210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7cffdeef-c37b-424d-b9e8-96b8dc2b146e tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Action: 'create', calling method: .version_select at 0x7fda195615e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1405084126", "metadata": {"Type": "work"}}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7cffdeef-c37b-424d-b9e8-96b8dc2b146e tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Request method failure captured: Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 120 Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5pN8J7XUQeyFdbaJVki6d2ffvhLBDJvN2xLLL_gT97SCxrnQoII9FdMNVgDqZJIIAvgtcLt0HsNhQI7yc_QvNfhjTTKd8NNDYZ43t2kdmQDshep2jXit4yiadqAQqyT_5_X6W_gCkyycMsErddj_kGS3Bc3KolWbgStpdn6-BzKzg Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}] Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c7a468ed3f540228759bfdab063d132 Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1405084126", "metadata": {"Type": "work"}}} Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1405084126', 'metadata': {'Type': 'work'}}}} Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi '0' Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:17:46.175001 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7cffdeef-c37b-424d-b9e8-96b8dc2b146e tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:46.180036 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7cffdeef-c37b-424d-b9e8-96b8dc2b146e tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.059019 Oct 11 04:17:46.182833 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1001/1925] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 11 04:17:46 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 66 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:17:46.211817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b40a842e-6391-4b43-8d76-6ba8367f6771 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Action: 'create', calling method: .version_select at 0x7fda195690d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-508525646", "metadata": {"Type": "work"}}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b40a842e-6391-4b43-8d76-6ba8367f6771 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Request method failure captured: Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 118 Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5pN8J7XUQeyFdbaJVki6d2ffvhLBDJvN2xLLL_gT97SCxrnQoII9FdMNVgDqZJIIAvgtcLt0HsNhQI7yc_QvNfhjTTKd8NNDYZ43t2kdmQDshep2jXit4yiadqAQqyT_5_X6W_gCkyycMsErddj_kGS3Bc3KolWbgStpdn6-BzKzg Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}] Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c7a468ed3f540228759bfdab063d132 Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-508525646", "metadata": {"Type": "work"}}} Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-508525646', 'metadata': {'Type': 'work'}}}} Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi '' Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:17:46.235502 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b40a842e-6391-4b43-8d76-6ba8367f6771 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:46.240711 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b40a842e-6391-4b43-8d76-6ba8367f6771 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.040551 Oct 11 04:17:46.246656 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1002/1926] 10.222.0.26 () {60 vars in 1156 bytes} [Tue Oct 11 04:17:46 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:17:46.257805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d6ec06a8-34c4-4ee9-abd3-1b6ae51bae0d tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Calling method '.version_select at 0x7fda19561f70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:46.315730 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d6ec06a8-34c4-4ee9-abd3-1b6ae51bae0d tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] HTTP exception thrown: Volume tempest-invalid-1847185408 could not be found. Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d6ec06a8-34c4-4ee9-abd3-1b6ae51bae0d tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Request method failure captured: Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1847185408 HTTP/1.1 Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5pN8J7XUQeyFdbaJVki6d2ffvhLBDJvN2xLLL_gT97SCxrnQoII9FdMNVgDqZJIIAvgtcLt0HsNhQI7yc_QvNfhjTTKd8NNDYZ43t2kdmQDshep2jXit4yiadqAQqyT_5_X6W_gCkyycMsErddj_kGS3Bc3KolWbgStpdn6-BzKzg Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}] Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c7a468ed3f540228759bfdab063d132 Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: exception: Volume tempest-invalid-1847185408 could not be found. Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'tempest-invalid-1847185408'} Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1847185408 could not be found. (HTTP 404) (Request-ID: req-9a76fb8e-3b5b-456a-a2b4-444b59930ee2) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 04:17:46.318652 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1847185408 could not be found. Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1847185408 could not be found. Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1847185408 could not be found. Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.325119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d6ec06a8-34c4-4ee9-abd3-1b6ae51bae0d tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Returning 404 to user: Volume tempest-invalid-1847185408 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:46.331391 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d6ec06a8-34c4-4ee9-abd3-1b6ae51bae0d tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1847185408" status: 404 len: 99 microversion: 2.1 time: 0.081904 Oct 11 04:17:46.332490 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1003/1927] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:17:46 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1847185408 => generated 99 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:17:46.345349 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1005e7d8-c357-46e7-8763-2d2748d9f8cf tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007575 Oct 11 04:17:46.346792 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1004/1928] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Oct 11 04:17:46 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 04:17:46.363325 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-62a1ea8f-9400-45e9-ad83-0ee7a0c3a621 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004900 Oct 11 04:17:46.365792 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1005/1929] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:17:46 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 11 04:17:46.381735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e54dec0e-3179-4d78-91b3-90cec116b2e3 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Calling method '.version_select at 0x7fda1df74280>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:46.494429 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e54dec0e-3179-4d78-91b3-90cec116b2e3 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] HTTP exception thrown: Volume 5bba8a9b-f159-4103-b23f-c350cc3646e2 could not be found. Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e54dec0e-3179-4d78-91b3-90cec116b2e3 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Request method failure captured: Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-volumes/5bba8a9b-f159-4103-b23f-c350cc3646e2 HTTP/1.1 Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5pN8J7XUQeyFdbaJVki6d2ffvhLBDJvN2xLLL_gT97SCxrnQoII9FdMNVgDqZJIIAvgtcLt0HsNhQI7yc_QvNfhjTTKd8NNDYZ43t2kdmQDshep2jXit4yiadqAQqyT_5_X6W_gCkyycMsErddj_kGS3Bc3KolWbgStpdn6-BzKzg Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}] Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c7a468ed3f540228759bfdab063d132 Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: exception: Volume 5bba8a9b-f159-4103-b23f-c350cc3646e2 could not be found. Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '5bba8a9b-f159-4103-b23f-c350cc3646e2'} Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5bba8a9b-f159-4103-b23f-c350cc3646e2 could not be found. (HTTP 404) (Request-ID: req-bb8e6d50-ecd7-4dbf-985b-dcd97d011aa9) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 04:17:46.497530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5bba8a9b-f159-4103-b23f-c350cc3646e2 could not be found. Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5bba8a9b-f159-4103-b23f-c350cc3646e2 could not be found. Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5bba8a9b-f159-4103-b23f-c350cc3646e2 could not be found. Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.502826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e54dec0e-3179-4d78-91b3-90cec116b2e3 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Returning 404 to user: Volume 5bba8a9b-f159-4103-b23f-c350cc3646e2 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:46.506619 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e54dec0e-3179-4d78-91b3-90cec116b2e3 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/5bba8a9b-f159-4103-b23f-c350cc3646e2" status: 404 len: 109 microversion: 2.1 time: 0.129787 Oct 11 04:17:46.507257 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1006/1930] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:17:46 2022] DELETE /compute/v2.1/os-volumes/5bba8a9b-f159-4103-b23f-c350cc3646e2 => generated 109 bytes in 136 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:17:46.554463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-634030f8-6eab-4866-9efe-065d3e5a5d87 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Calling method '.version_select at 0x7fda1df4a790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:46.643053 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-634030f8-6eab-4866-9efe-065d3e5a5d87 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] HTTP exception thrown: Volume 2dd85a63-9163-4747-b39d-2b3ce81c9ddf could not be found. Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-634030f8-6eab-4866-9efe-065d3e5a5d87 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Request method failure captured: Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-volumes/2dd85a63-9163-4747-b39d-2b3ce81c9ddf HTTP/1.1 Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5pN8J7XUQeyFdbaJVki6d2ffvhLBDJvN2xLLL_gT97SCxrnQoII9FdMNVgDqZJIIAvgtcLt0HsNhQI7yc_QvNfhjTTKd8NNDYZ43t2kdmQDshep2jXit4yiadqAQqyT_5_X6W_gCkyycMsErddj_kGS3Bc3KolWbgStpdn6-BzKzg Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4e44e411baed4c3d891547f4a555d3bc"}]}] Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4e44e411baed4c3d891547f4a555d3bc Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesNegativeTest-1732269979 Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c7a468ed3f540228759bfdab063d132 Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesNegativeTest-1732269979-project Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: exception: Volume 2dd85a63-9163-4747-b39d-2b3ce81c9ddf could not be found. Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '2dd85a63-9163-4747-b39d-2b3ce81c9ddf'} Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2dd85a63-9163-4747-b39d-2b3ce81c9ddf could not be found. (HTTP 404) (Request-ID: req-fe0f17d6-049a-446c-9a9f-544a8f38e11a) Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 04:17:46.655475 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2dd85a63-9163-4747-b39d-2b3ce81c9ddf could not be found. Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2dd85a63-9163-4747-b39d-2b3ce81c9ddf could not be found. Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2dd85a63-9163-4747-b39d-2b3ce81c9ddf could not be found. Oct 11 04:17:46.660597 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:17:46.666212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-634030f8-6eab-4866-9efe-065d3e5a5d87 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] Returning 404 to user: Volume 2dd85a63-9163-4747-b39d-2b3ce81c9ddf could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:17:46.666212 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-634030f8-6eab-4866-9efe-065d3e5a5d87 tempest-VolumesNegativeTest-1732269979 tempest-VolumesNegativeTest-1732269979-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/2dd85a63-9163-4747-b39d-2b3ce81c9ddf" status: 404 len: 109 microversion: 2.1 time: 0.126964 Oct 11 04:17:46.674537 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1007/1931] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:17:46 2022] GET /compute/v2.1/os-volumes/2dd85a63-9163-4747-b39d-2b3ce81c9ddf => generated 109 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:17:46.793379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e0610f73-2c73-4cdd-8574-85c9e9137da6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:46.794095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e0610f73-2c73-4cdd-8574-85c9e9137da6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:46.814098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0610f73-2c73-4cdd-8574-85c9e9137da6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:46.815615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0610f73-2c73-4cdd-8574-85c9e9137da6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:46.819622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0610f73-2c73-4cdd-8574-85c9e9137da6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:46.820765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0610f73-2c73-4cdd-8574-85c9e9137da6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:46.821766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0610f73-2c73-4cdd-8574-85c9e9137da6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:46.823721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0610f73-2c73-4cdd-8574-85c9e9137da6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:47.009107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e0610f73-2c73-4cdd-8574-85c9e9137da6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:47.009107 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e0610f73-2c73-4cdd-8574-85c9e9137da6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1268 microversion: 2.1 time: 0.165728 Oct 11 04:17:47.009107 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1008/1932] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:46 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1268 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:47.832456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf3e08f8-35e6-4759-a9ea-bd9e30884ca8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:47.844924 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bf3e08f8-35e6-4759-a9ea-bd9e30884ca8 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1607 microversion: 2.1 time: 1.843580 Oct 11 04:17:47.859257 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 925/1933] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:46 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1607 bytes in 1858 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:48.022408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4f225b8f-2606-45f8-8b52-d385e9927250 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:48.024435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4f225b8f-2606-45f8-8b52-d385e9927250 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:48.039928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f225b8f-2606-45f8-8b52-d385e9927250 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:48.040726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f225b8f-2606-45f8-8b52-d385e9927250 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:48.041858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f225b8f-2606-45f8-8b52-d385e9927250 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:48.042798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f225b8f-2606-45f8-8b52-d385e9927250 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:48.046005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f225b8f-2606-45f8-8b52-d385e9927250 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:48.046690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f225b8f-2606-45f8-8b52-d385e9927250 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:48.167424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4f225b8f-2606-45f8-8b52-d385e9927250 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:48.179340 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4f225b8f-2606-45f8-8b52-d385e9927250 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1286 microversion: 2.1 time: 0.160902 Oct 11 04:17:48.183446 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1009/1934] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:48 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:48.298011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-9f53e7c9-e428-4454-a7c0-d424f1c4d97d req-ca1a05b3-173a-41c3-8dc8-b22a6c5baf41 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b55166-b6c5-400e-b0c6-f1a04c595b75", "name": "network-vif-unplugged", "status": "completed", "tag": "5db01fd1-2d11-42b1-a3c9-a52cca1b8138"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:48.333464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9f53e7c9-e428-4454-a7c0-d424f1c4d97d req-ca1a05b3-173a-41c3-8dc8-b22a6c5baf41 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:48.333464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9f53e7c9-e428-4454-a7c0-d424f1c4d97d req-ca1a05b3-173a-41c3-8dc8-b22a6c5baf41 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:48.333464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9f53e7c9-e428-4454-a7c0-d424f1c4d97d req-ca1a05b3-173a-41c3-8dc8-b22a6c5baf41 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:48.363587 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-9f53e7c9-e428-4454-a7c0-d424f1c4d97d req-ca1a05b3-173a-41c3-8dc8-b22a6c5baf41 service nova] Creating event network-vif-unplugged:5db01fd1-2d11-42b1-a3c9-a52cca1b8138 for instance 75b55166-b6c5-400e-b0c6-f1a04c595b75 on n-h2-860892-1 Oct 11 04:17:48.376068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-9f53e7c9-e428-4454-a7c0-d424f1c4d97d req-ca1a05b3-173a-41c3-8dc8-b22a6c5baf41 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.084318 Oct 11 04:17:48.382730 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 926/1935] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:48.869919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a566a3d-7b7b-478c-897b-cb630b0b5a4a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:48.870547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a566a3d-7b7b-478c-897b-cb630b0b5a4a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:48.880570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a566a3d-7b7b-478c-897b-cb630b0b5a4a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:48.887271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a566a3d-7b7b-478c-897b-cb630b0b5a4a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:48.887271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a566a3d-7b7b-478c-897b-cb630b0b5a4a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:48.887271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a566a3d-7b7b-478c-897b-cb630b0b5a4a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:48.887271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a566a3d-7b7b-478c-897b-cb630b0b5a4a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:48.887271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a566a3d-7b7b-478c-897b-cb630b0b5a4a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:49.192090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a566a3d-7b7b-478c-897b-cb630b0b5a4a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:49.207673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb624632-e17f-4225-905a-449487e49d54 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:49.208448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cb624632-e17f-4225-905a-449487e49d54 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:49.219826 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a566a3d-7b7b-478c-897b-cb630b0b5a4a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1607 microversion: 2.1 time: 0.353240 Oct 11 04:17:49.226400 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1010/1936] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:48 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1607 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:49.226532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb624632-e17f-4225-905a-449487e49d54 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:49.226532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb624632-e17f-4225-905a-449487e49d54 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:49.226532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb624632-e17f-4225-905a-449487e49d54 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:49.226532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb624632-e17f-4225-905a-449487e49d54 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:49.226532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb624632-e17f-4225-905a-449487e49d54 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:49.226953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb624632-e17f-4225-905a-449487e49d54 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:49.339249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-412298447", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "331d8dc4-11af-4aab-8523-7e72106c91b8"}], "security_groups": [{"name": "tempest-securitygroup--1196183262"}], "key_name": "tempest-keypair-300026022", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:49.784326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb624632-e17f-4225-905a-449487e49d54 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:49.807294 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cb624632-e17f-4225-905a-449487e49d54 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 0.604646 Oct 11 04:17:49.809009 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 927/1937] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:49 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:49.848396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0e529803-5157-4972-bb5b-2e2203a2bd66 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19380c10>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:49.962891 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0e529803-5157-4972-bb5b-2e2203a2bd66 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/40e4c98e-d1db-40e4-b7d5-a1fb20273f90" status: 200 len: 662 microversion: 2.1 time: 0.134025 Oct 11 04:17:49.964006 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 928/1938] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:17:49 2022] GET /compute/v2.1/images/40e4c98e-d1db-40e4-b7d5-a1fb20273f90 => generated 662 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:49.987552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3c9265d2-d78d-453a-b489-ba34ceeb5ec2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19380550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:50.093050 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3c9265d2-d78d-453a-b489-ba34ceeb5ec2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/40e4c98e-d1db-40e4-b7d5-a1fb20273f90" status: 200 len: 662 microversion: 2.1 time: 0.110873 Oct 11 04:17:50.098236 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 929/1939] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:17:49 2022] GET /compute/v2.1/images/40e4c98e-d1db-40e4-b7d5-a1fb20273f90 => generated 662 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:50.129660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-73bd3cd2-deb1-405f-8805-ab0a9b6406f8 req-3ab5ed6b-c459-4774-8251-eeb70dd8e9b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "75b55166-b6c5-400e-b0c6-f1a04c595b75", "name": "network-vif-deleted", "tag": "5db01fd1-2d11-42b1-a3c9-a52cca1b8138"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:50.181031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-73bd3cd2-deb1-405f-8805-ab0a9b6406f8 req-3ab5ed6b-c459-4774-8251-eeb70dd8e9b6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:50.187631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-73bd3cd2-deb1-405f-8805-ab0a9b6406f8 req-3ab5ed6b-c459-4774-8251-eeb70dd8e9b6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:50.190534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-73bd3cd2-deb1-405f-8805-ab0a9b6406f8 req-3ab5ed6b-c459-4774-8251-eeb70dd8e9b6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:50.241080 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-73bd3cd2-deb1-405f-8805-ab0a9b6406f8 req-3ab5ed6b-c459-4774-8251-eeb70dd8e9b6 service nova] Creating event network-vif-deleted:5db01fd1-2d11-42b1-a3c9-a52cca1b8138 for instance 75b55166-b6c5-400e-b0c6-f1a04c595b75 on n-h2-860892-1 Oct 11 04:17:50.254648 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-73bd3cd2-deb1-405f-8805-ab0a9b6406f8 req-3ab5ed6b-c459-4774-8251-eeb70dd8e9b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129791 Oct 11 04:17:50.261462 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 930/1940] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:17:50.276638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-43a71f41-ed81-4b61-9439-37c330d11673 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:50.278106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-43a71f41-ed81-4b61-9439-37c330d11673 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:50.294112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43a71f41-ed81-4b61-9439-37c330d11673 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:50.294837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43a71f41-ed81-4b61-9439-37c330d11673 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:50.295659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43a71f41-ed81-4b61-9439-37c330d11673 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:50.296843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43a71f41-ed81-4b61-9439-37c330d11673 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:50.300954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43a71f41-ed81-4b61-9439-37c330d11673 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:50.301648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43a71f41-ed81-4b61-9439-37c330d11673 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:50.355932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] validate_networks() for [('331d8dc4-11af-4aab-8523-7e72106c91b8', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:17:50.513149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-43a71f41-ed81-4b61-9439-37c330d11673 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:50.527347 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-43a71f41-ed81-4b61-9439-37c330d11673 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1540 microversion: 2.1 time: 0.264516 Oct 11 04:17:50.531667 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 931/1941] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:50 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1540 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:50.836196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-06e93f94-246b-4a87-b8ce-52cf95477512 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:50.837359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-06e93f94-246b-4a87-b8ce-52cf95477512 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:50.849797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e93f94-246b-4a87-b8ce-52cf95477512 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:50.850354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e93f94-246b-4a87-b8ce-52cf95477512 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:50.850808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e93f94-246b-4a87-b8ce-52cf95477512 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:50.856357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e93f94-246b-4a87-b8ce-52cf95477512 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:50.856758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e93f94-246b-4a87-b8ce-52cf95477512 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:50.857371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e93f94-246b-4a87-b8ce-52cf95477512 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:51.068274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-06e93f94-246b-4a87-b8ce-52cf95477512 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:51.078948 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-06e93f94-246b-4a87-b8ce-52cf95477512 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 0.246868 Oct 11 04:17:51.079885 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 932/1942] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:50 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:51.176573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:17:51.176573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:17:51.178725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:17:51.179696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:17:51.180976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:17:51.191937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:51.192637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:51.193556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:51.194164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:51.196430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:51.196430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:51.220496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Getting quotas for project a3d48dc85fd64507b459034b67232052. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:17:51.226773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Getting quotas for user 555865c5372246009bb223d5cbfb8b24 and project a3d48dc85fd64507b459034b67232052. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:17:51.243146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:17:51.246329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:17:51.557506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0ae3a4a9-1815-41ba-83cf-0c78bc90c87a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:51.558109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0ae3a4a9-1815-41ba-83cf-0c78bc90c87a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:51.565669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ae3a4a9-1815-41ba-83cf-0c78bc90c87a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:51.566157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ae3a4a9-1815-41ba-83cf-0c78bc90c87a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:51.566643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ae3a4a9-1815-41ba-83cf-0c78bc90c87a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:51.567358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ae3a4a9-1815-41ba-83cf-0c78bc90c87a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:51.567811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ae3a4a9-1815-41ba-83cf-0c78bc90c87a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:51.568291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ae3a4a9-1815-41ba-83cf-0c78bc90c87a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:51.683219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0ae3a4a9-1815-41ba-83cf-0c78bc90c87a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:51.696566 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0ae3a4a9-1815-41ba-83cf-0c78bc90c87a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1253 microversion: 2.1 time: 0.143503 Oct 11 04:17:51.697710 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 933/1943] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:51 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1253 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:51.992930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6262d67c-cb8d-4a58-85c5-7d356bc3bf1e req-61fb53f8-8899-4c16-907a-e768c2c63742 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08774d29-93f3-4d89-9b47-1c6fa3a54f25", "tag": "ee2a41e5-8279-4d39-acb5-4a1ef74b1b9f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:51.998605 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2eacb811-5930-4100-b5e1-fdacd6850fa1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.664460 Oct 11 04:17:52.001770 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1011/1944] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:17:49 2022] POST /compute/v2.1/servers => generated 406 bytes in 2666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:17:52.012667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f65725e8-5087-4fbf-9068-6496148a2cb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:52.013289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f65725e8-5087-4fbf-9068-6496148a2cb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:52.033874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6262d67c-cb8d-4a58-85c5-7d356bc3bf1e req-61fb53f8-8899-4c16-907a-e768c2c63742 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:52.034852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6262d67c-cb8d-4a58-85c5-7d356bc3bf1e req-61fb53f8-8899-4c16-907a-e768c2c63742 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:52.035296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6262d67c-cb8d-4a58-85c5-7d356bc3bf1e req-61fb53f8-8899-4c16-907a-e768c2c63742 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:52.064755 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6262d67c-cb8d-4a58-85c5-7d356bc3bf1e req-61fb53f8-8899-4c16-907a-e768c2c63742 service nova] Creating event network-changed:ee2a41e5-8279-4d39-acb5-4a1ef74b1b9f for instance 08774d29-93f3-4d89-9b47-1c6fa3a54f25 on n-h1-860892-1 Oct 11 04:17:52.071763 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6262d67c-cb8d-4a58-85c5-7d356bc3bf1e req-61fb53f8-8899-4c16-907a-e768c2c63742 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088184 Oct 11 04:17:52.076945 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 934/1945] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:52.108205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0538a42e-3902-4f04-99a6-fc514a1fb9d1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:52.109303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0538a42e-3902-4f04-99a6-fc514a1fb9d1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:52.133118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0538a42e-3902-4f04-99a6-fc514a1fb9d1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:52.136175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0538a42e-3902-4f04-99a6-fc514a1fb9d1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:52.137903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0538a42e-3902-4f04-99a6-fc514a1fb9d1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:52.142768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0538a42e-3902-4f04-99a6-fc514a1fb9d1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:52.148548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0538a42e-3902-4f04-99a6-fc514a1fb9d1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:52.148548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0538a42e-3902-4f04-99a6-fc514a1fb9d1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:52.190652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f65725e8-5087-4fbf-9068-6496148a2cb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:52.200375 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f65725e8-5087-4fbf-9068-6496148a2cb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1240 microversion: 2.1 time: 0.192183 Oct 11 04:17:52.218351 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1012/1946] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:52 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1240 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:52.417552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0538a42e-3902-4f04-99a6-fc514a1fb9d1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:52.436262 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0538a42e-3902-4f04-99a6-fc514a1fb9d1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 0.331074 Oct 11 04:17:52.438055 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 935/1947] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:52 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:52.731548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7a19aa80-7cbc-43f9-9b74-c96da075dac5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:52.731548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7a19aa80-7cbc-43f9-9b74-c96da075dac5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:52.731548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a19aa80-7cbc-43f9-9b74-c96da075dac5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:52.731548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a19aa80-7cbc-43f9-9b74-c96da075dac5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:52.731548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a19aa80-7cbc-43f9-9b74-c96da075dac5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:52.744912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a19aa80-7cbc-43f9-9b74-c96da075dac5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:52.745538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a19aa80-7cbc-43f9-9b74-c96da075dac5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:52.745991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a19aa80-7cbc-43f9-9b74-c96da075dac5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:53.048820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7a19aa80-7cbc-43f9-9b74-c96da075dac5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:53.069011 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7a19aa80-7cbc-43f9-9b74-c96da075dac5 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1253 microversion: 2.1 time: 0.351858 Oct 11 04:17:53.078577 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1013/1948] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:52 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1253 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:53.188131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-58b79f6f-03a9-473b-bbe7-e28a20571491 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19402430>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:53.199451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:53.200775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:53.225350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-52700707-d331-4ba6-8830-f9927a1f1b85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:53.226022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-52700707-d331-4ba6-8830-f9927a1f1b85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:53.271958 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-58b79f6f-03a9-473b-bbe7-e28a20571491 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/4b3b0af6-6f9c-4611-b66d-575c9d6bea7a" status: 200 len: 662 microversion: 2.1 time: 0.088533 Oct 11 04:17:53.282291 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 936/1949] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:17:53 2022] GET /compute/v2.1/images/4b3b0af6-6f9c-4611-b66d-575c9d6bea7a => generated 662 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:53.297822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9026e90f-38ee-40bc-a0c5-d3ead0ed8413 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda193bd280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:53.361062 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9026e90f-38ee-40bc-a0c5-d3ead0ed8413 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/4b3b0af6-6f9c-4611-b66d-575c9d6bea7a" status: 200 len: 662 microversion: 2.1 time: 0.075151 Oct 11 04:17:53.381838 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 937/1950] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:17:53 2022] GET /compute/v2.1/images/4b3b0af6-6f9c-4611-b66d-575c9d6bea7a => generated 662 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:53.478122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00d0fa47-e62a-4655-b8e2-34177f22705a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:53.478122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00d0fa47-e62a-4655-b8e2-34177f22705a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:53.484736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d0fa47-e62a-4655-b8e2-34177f22705a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:53.487993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d0fa47-e62a-4655-b8e2-34177f22705a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:53.488599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d0fa47-e62a-4655-b8e2-34177f22705a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:53.489668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d0fa47-e62a-4655-b8e2-34177f22705a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:53.492417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d0fa47-e62a-4655-b8e2-34177f22705a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:53.492970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d0fa47-e62a-4655-b8e2-34177f22705a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:53.531085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-52700707-d331-4ba6-8830-f9927a1f1b85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:53.543866 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-52700707-d331-4ba6-8830-f9927a1f1b85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1240 microversion: 2.1 time: 0.322599 Oct 11 04:17:53.547260 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1014/1951] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:53 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1240 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:53.877125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:54.080526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-00d0fa47-e62a-4655-b8e2-34177f22705a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:54.090721 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00d0fa47-e62a-4655-b8e2-34177f22705a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 0.623548 Oct 11 04:17:54.092618 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 938/1952] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:53 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:54.100219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b8f2ed77-56e3-460d-9579-9264aeeaa72c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:54.101051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b8f2ed77-56e3-460d-9579-9264aeeaa72c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:54.109442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f2ed77-56e3-460d-9579-9264aeeaa72c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:54.110167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f2ed77-56e3-460d-9579-9264aeeaa72c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:54.110821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f2ed77-56e3-460d-9579-9264aeeaa72c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:54.113208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f2ed77-56e3-460d-9579-9264aeeaa72c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:54.114343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f2ed77-56e3-460d-9579-9264aeeaa72c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:54.115335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8f2ed77-56e3-460d-9579-9264aeeaa72c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:54.196046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b8f2ed77-56e3-460d-9579-9264aeeaa72c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:54.208177 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b8f2ed77-56e3-460d-9579-9264aeeaa72c tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1253 microversion: 2.1 time: 0.114095 Oct 11 04:17:54.209588 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 939/1953] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:54 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1253 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:54.263318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-UnshelveToHostMultiNodesTest-server-3223110", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": "none"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:54.352694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:17:54.353141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:17:54.361205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:17:54.361728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:17:54.364066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:17:54.379927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:54.380410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:54.380840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:54.381562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:54.382001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:54.382922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:54.411236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Getting quotas for project ca25756f13cd4be3ab31de2251b7fb42. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:17:54.416411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Getting quotas for user dce2afc8ece647a2a2666861f7ad6775 and project ca25756f13cd4be3ab31de2251b7fb42. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:17:54.458126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:17:54.458126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:17:54.578932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75ced0c1-c727-43f9-aeff-c424de9a2962 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:54.579562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-75ced0c1-c727-43f9-aeff-c424de9a2962 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:54.590391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ced0c1-c727-43f9-aeff-c424de9a2962 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:54.593733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ced0c1-c727-43f9-aeff-c424de9a2962 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:54.594461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ced0c1-c727-43f9-aeff-c424de9a2962 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:54.595866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ced0c1-c727-43f9-aeff-c424de9a2962 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:54.595866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ced0c1-c727-43f9-aeff-c424de9a2962 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:54.598886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75ced0c1-c727-43f9-aeff-c424de9a2962 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:54.654974 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-338d0e4c-8d93-4b3a-b39d-768bab7a006a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.91 time: 0.814411 Oct 11 04:17:54.654974 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1015/1954] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:17:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 818 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:17:54.660667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d8c3cae-189d-4f8c-9186-f684a0072d41 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:54.661370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d8c3cae-189d-4f8c-9186-f684a0072d41 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:54.799088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75ced0c1-c727-43f9-aeff-c424de9a2962 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:54.814432 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-75ced0c1-c727-43f9-aeff-c424de9a2962 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1292 microversion: 2.1 time: 0.243462 Oct 11 04:17:54.837329 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 940/1955] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:54 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1292 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:54.919037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d8c3cae-189d-4f8c-9186-f684a0072d41 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:54.929668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d8c3cae-189d-4f8c-9186-f684a0072d41 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:54.935378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d8c3cae-189d-4f8c-9186-f684a0072d41 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:54.966296 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d8c3cae-189d-4f8c-9186-f684a0072d41 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1448 microversion: 2.91 time: 0.301737 Oct 11 04:17:54.990167 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1016/1956] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:54 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1448 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:55.113561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8a238048-97de-4696-a41f-5286c1061ac2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:55.114857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8a238048-97de-4696-a41f-5286c1061ac2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:55.126378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a238048-97de-4696-a41f-5286c1061ac2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:55.130533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a238048-97de-4696-a41f-5286c1061ac2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:55.131457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a238048-97de-4696-a41f-5286c1061ac2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:55.132922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a238048-97de-4696-a41f-5286c1061ac2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:55.136500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a238048-97de-4696-a41f-5286c1061ac2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:55.138137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a238048-97de-4696-a41f-5286c1061ac2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:55.237148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9bba7cc7-2ab3-41ce-adef-40384f01c65a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:55.237759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9bba7cc7-2ab3-41ce-adef-40384f01c65a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:55.252403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bba7cc7-2ab3-41ce-adef-40384f01c65a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:55.255809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bba7cc7-2ab3-41ce-adef-40384f01c65a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:55.256282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bba7cc7-2ab3-41ce-adef-40384f01c65a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:55.258226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bba7cc7-2ab3-41ce-adef-40384f01c65a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:55.261725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bba7cc7-2ab3-41ce-adef-40384f01c65a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:55.262118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bba7cc7-2ab3-41ce-adef-40384f01c65a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:55.400539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9bba7cc7-2ab3-41ce-adef-40384f01c65a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:55.403900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8a238048-97de-4696-a41f-5286c1061ac2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:55.410644 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9bba7cc7-2ab3-41ce-adef-40384f01c65a tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1253 microversion: 2.1 time: 0.177957 Oct 11 04:17:55.411312 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1017/1957] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:55 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1253 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:17:55.411731 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8a238048-97de-4696-a41f-5286c1061ac2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 0.302700 Oct 11 04:17:55.412577 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 941/1958] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:55 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:55.841626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2708405a-7b89-468e-aaf3-c51e66afab1d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:55.842313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2708405a-7b89-468e-aaf3-c51e66afab1d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:55.848307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2708405a-7b89-468e-aaf3-c51e66afab1d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:55.848773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2708405a-7b89-468e-aaf3-c51e66afab1d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:55.849211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2708405a-7b89-468e-aaf3-c51e66afab1d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:55.849896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2708405a-7b89-468e-aaf3-c51e66afab1d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:55.850379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2708405a-7b89-468e-aaf3-c51e66afab1d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:55.850803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2708405a-7b89-468e-aaf3-c51e66afab1d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:55.956543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2708405a-7b89-468e-aaf3-c51e66afab1d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:55.958421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8894b3b6-2845-4ec1-8ff5-40b23ad4cfe0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda194021f0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:55.966845 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2708405a-7b89-468e-aaf3-c51e66afab1d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1300 microversion: 2.1 time: 0.129090 Oct 11 04:17:55.967603 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1018/1959] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:55 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1300 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:56.008231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d98ad0c4-73b6-49b2-8146-ee9ff1a80e55 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:56.014101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d98ad0c4-73b6-49b2-8146-ee9ff1a80e55 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:56.062348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:17:56.078163 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8894b3b6-2845-4ec1-8ff5-40b23ad4cfe0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/5260f29f-d0fe-457b-87da-2d24bd113321" status: 200 len: 661 microversion: 2.1 time: 0.124425 Oct 11 04:17:56.079894 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 942/1960] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:17:55 2022] GET /compute/v2.1/images/5260f29f-d0fe-457b-87da-2d24bd113321 => generated 661 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:17:56.101451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5bdf4f6-f7bc-4684-9056-327440e711fc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1df58c10>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:56.136789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d98ad0c4-73b6-49b2-8146-ee9ff1a80e55 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:56.148103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d98ad0c4-73b6-49b2-8146-ee9ff1a80e55 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:56.150045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d98ad0c4-73b6-49b2-8146-ee9ff1a80e55 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:56.158751 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d98ad0c4-73b6-49b2-8146-ee9ff1a80e55 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1448 microversion: 2.91 time: 0.157999 Oct 11 04:17:56.160352 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1019/1961] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:55 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1448 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:17:56.190319 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c5bdf4f6-f7bc-4684-9056-327440e711fc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/5260f29f-d0fe-457b-87da-2d24bd113321" status: 200 len: 661 microversion: 2.1 time: 0.098093 Oct 11 04:17:56.191589 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 943/1962] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:17:56 2022] GET /compute/v2.1/images/5260f29f-d0fe-457b-87da-2d24bd113321 => generated 661 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:17:56.383046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-565353388", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:56.434423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-783b6642-12ff-496d-9f87-ebbee3010b46 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:56.435183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-783b6642-12ff-496d-9f87-ebbee3010b46 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:56.451508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-783b6642-12ff-496d-9f87-ebbee3010b46 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:56.456169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-783b6642-12ff-496d-9f87-ebbee3010b46 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:56.456750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-783b6642-12ff-496d-9f87-ebbee3010b46 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:56.460784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-783b6642-12ff-496d-9f87-ebbee3010b46 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:56.461278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-783b6642-12ff-496d-9f87-ebbee3010b46 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:56.461722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-783b6642-12ff-496d-9f87-ebbee3010b46 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:56.489637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:17:56.703261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-783b6642-12ff-496d-9f87-ebbee3010b46 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:56.711512 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-783b6642-12ff-496d-9f87-ebbee3010b46 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1253 microversion: 2.1 time: 0.281821 Oct 11 04:17:56.712091 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 944/1963] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:56 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1253 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:56.720166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cfcdf9c7-454e-49eb-98f4-5058c8d6e63a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:56.720781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cfcdf9c7-454e-49eb-98f4-5058c8d6e63a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:56.749710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfcdf9c7-454e-49eb-98f4-5058c8d6e63a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:56.750228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfcdf9c7-454e-49eb-98f4-5058c8d6e63a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:56.758896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfcdf9c7-454e-49eb-98f4-5058c8d6e63a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:56.763827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfcdf9c7-454e-49eb-98f4-5058c8d6e63a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:56.763827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfcdf9c7-454e-49eb-98f4-5058c8d6e63a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:56.763827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfcdf9c7-454e-49eb-98f4-5058c8d6e63a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:57.058754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:17:57.059178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:17:57.059656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:17:57.060066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:17:57.060481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:17:57.086624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:57.088859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:57.091515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:57.092737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:57.095608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:57.096333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:57.145762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Getting quotas for project 55a807026da64676b9e63cb20df73d7f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:17:57.159724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Getting quotas for user 42cf24cec7b0443a874b543734e0b296 and project 55a807026da64676b9e63cb20df73d7f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:17:57.182328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cfcdf9c7-454e-49eb-98f4-5058c8d6e63a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:57.193267 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cfcdf9c7-454e-49eb-98f4-5058c8d6e63a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 0.476731 Oct 11 04:17:57.204666 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 945/1964] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:56 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:57.224886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:17:57.226564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a93dfa1-190e-4d53-93dd-7a87476c5e03 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:57.227213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7a93dfa1-190e-4d53-93dd-7a87476c5e03 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:57.231219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:17:57.244788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a93dfa1-190e-4d53-93dd-7a87476c5e03 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:57.245435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a93dfa1-190e-4d53-93dd-7a87476c5e03 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:57.245878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a93dfa1-190e-4d53-93dd-7a87476c5e03 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:57.246612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a93dfa1-190e-4d53-93dd-7a87476c5e03 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:57.247074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a93dfa1-190e-4d53-93dd-7a87476c5e03 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:57.247502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a93dfa1-190e-4d53-93dd-7a87476c5e03 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:57.378099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7a93dfa1-190e-4d53-93dd-7a87476c5e03 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:57.389726 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7a93dfa1-190e-4d53-93dd-7a87476c5e03 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1298 microversion: 2.1 time: 0.183503 Oct 11 04:17:57.395977 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 946/1965] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:57 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1298 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:57.406877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:57.407883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:57.420066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:57.420818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:57.423101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:57.424082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:57.428951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:57.429649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:57.456691 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-824721da-e9ad-42f0-bcb5-01b6801272bc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.077226 Oct 11 04:17:57.476417 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1020/1966] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:17:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1093 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:17:57.557704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListImageFiltersTestJSON-server-451061302", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:17:57.669845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:17:57.715079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:57.723373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:57.724808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:57.740843 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e0f080af-81f3-427d-b1e2-f82e35f9620b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1452 microversion: 2.91 time: 0.343398 Oct 11 04:17:57.763377 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 947/1967] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:57 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1452 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:57.771053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f8dce15-0ddf-4e29-bec2-881d26c9a718 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:57.772058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3f8dce15-0ddf-4e29-bec2-881d26c9a718 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:57.778822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f8dce15-0ddf-4e29-bec2-881d26c9a718 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:57.798824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f8dce15-0ddf-4e29-bec2-881d26c9a718 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:57.799363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f8dce15-0ddf-4e29-bec2-881d26c9a718 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:57.800163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f8dce15-0ddf-4e29-bec2-881d26c9a718 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:57.800537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f8dce15-0ddf-4e29-bec2-881d26c9a718 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:57.800965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f8dce15-0ddf-4e29-bec2-881d26c9a718 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:58.045990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3f8dce15-0ddf-4e29-bec2-881d26c9a718 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:58.053130 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3f8dce15-0ddf-4e29-bec2-881d26c9a718 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1253 microversion: 2.1 time: 0.287512 Oct 11 04:17:58.053915 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 948/1968] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:57 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1253 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:58.223316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e6442810-cef2-465a-8534-cc7cd604e736 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:58.224286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e6442810-cef2-465a-8534-cc7cd604e736 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:58.234801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6442810-cef2-465a-8534-cc7cd604e736 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:58.235454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6442810-cef2-465a-8534-cc7cd604e736 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:58.236011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6442810-cef2-465a-8534-cc7cd604e736 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:58.252513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6442810-cef2-465a-8534-cc7cd604e736 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:58.254692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6442810-cef2-465a-8534-cc7cd604e736 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:58.256551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6442810-cef2-465a-8534-cc7cd604e736 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:58.415934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:17:58.416282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:17:58.416755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:17:58.417160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:17:58.417571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:17:58.430165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:58.435330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:58.436747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:58.437654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:58.440675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:58.441419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:58.486280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Getting quotas for project 55a807026da64676b9e63cb20df73d7f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:17:58.502478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Getting quotas for user 42cf24cec7b0443a874b543734e0b296 and project 55a807026da64676b9e63cb20df73d7f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:17:58.543784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:17:58.548619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:17:58.730213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e6442810-cef2-465a-8534-cc7cd604e736 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:58.739089 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e6442810-cef2-465a-8534-cc7cd604e736 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 0.521407 Oct 11 04:17:58.743915 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 949/1969] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:58 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:58.767961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-700ca116-26a3-45a3-b401-5a22d7fd209c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:58.771416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-700ca116-26a3-45a3-b401-5a22d7fd209c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:58.786683 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-88654205-d649-4705-8c97-5f4a70d82394 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.236966 Oct 11 04:17:58.787931 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1021/1970] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:17:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 1241 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:17:58.795841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-700ca116-26a3-45a3-b401-5a22d7fd209c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:58.796801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-700ca116-26a3-45a3-b401-5a22d7fd209c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:58.798000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-700ca116-26a3-45a3-b401-5a22d7fd209c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:58.800762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-700ca116-26a3-45a3-b401-5a22d7fd209c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:58.807834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-700ca116-26a3-45a3-b401-5a22d7fd209c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:58.807834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-700ca116-26a3-45a3-b401-5a22d7fd209c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:58.811371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:58.812008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:58.846378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:58.848088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:58.848427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:58.849155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:58.856160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:58.856782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:59.063245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:59.080844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:59.091808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:59.110647 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-be03aa64-7dfe-41f2-bd1b-62ed59ef7eb4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1500 microversion: 2.91 time: 0.306036 Oct 11 04:17:59.111314 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1022/1971] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:17:58 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1500 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:17:59.123121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d7244d8-bb70-4985-b56a-a471aaec3a4b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:59.123970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d7244d8-bb70-4985-b56a-a471aaec3a4b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:59.335169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-700ca116-26a3-45a3-b401-5a22d7fd209c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:59.346798 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-700ca116-26a3-45a3-b401-5a22d7fd209c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1366 microversion: 2.1 time: 0.601527 Oct 11 04:17:59.347383 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 950/1972] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:58 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1366 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:59.366999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:59.368337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:59.380920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:59.383166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:59.383836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:59.385816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:59.388769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:59.389423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:59.401266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d7244d8-bb70-4985-b56a-a471aaec3a4b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:59.409472 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d7244d8-bb70-4985-b56a-a471aaec3a4b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1217 microversion: 2.1 time: 0.294029 Oct 11 04:17:59.433566 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1023/1973] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:59 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1217 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:59.456980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:59.457596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:59.458108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:59.458731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lazy-loading 'fault' on Instance uuid 75b55166-b6c5-400e-b0c6-f1a04c595b75 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:17:59.581318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '12aa2047c1ec47f6b6594e9109f8ec6c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7dcd9cbd3fbe4c24add13c912979deb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:17:59.593709 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9588cd8f-863a-41dd-aba2-b1a505f0d942 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 200 len: 1258 microversion: 2.1 time: 0.230746 Oct 11 04:17:59.598064 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 951/1974] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:59 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 1258 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:17:59.766106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-70892787-04e8-4119-9213-b438713fcde1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:17:59.767336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-70892787-04e8-4119-9213-b438713fcde1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:17:59.785386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70892787-04e8-4119-9213-b438713fcde1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:59.785758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70892787-04e8-4119-9213-b438713fcde1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:59.786179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70892787-04e8-4119-9213-b438713fcde1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:17:59.793011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70892787-04e8-4119-9213-b438713fcde1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:17:59.793617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70892787-04e8-4119-9213-b438713fcde1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:17:59.796603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70892787-04e8-4119-9213-b438713fcde1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:00.149021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:00.151410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:00.161977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:00.163238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:00.163945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:00.169884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:00.169884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:00.169884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:00.268293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-70892787-04e8-4119-9213-b438713fcde1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:00.288248 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-70892787-04e8-4119-9213-b438713fcde1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 0.524031 Oct 11 04:18:00.322986 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1024/1975] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:17:59 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:00.348110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:00.360823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:00.372519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f4ebc0ca-c4de-433f-9682-77446fa90634 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:00.373292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f4ebc0ca-c4de-433f-9682-77446fa90634 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:00.387842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:00.392507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ebc0ca-c4de-433f-9682-77446fa90634 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:00.395834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ebc0ca-c4de-433f-9682-77446fa90634 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:00.396316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ebc0ca-c4de-433f-9682-77446fa90634 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:00.397066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ebc0ca-c4de-433f-9682-77446fa90634 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:00.397526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ebc0ca-c4de-433f-9682-77446fa90634 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:00.397951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ebc0ca-c4de-433f-9682-77446fa90634 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:00.405653 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e8f33091-3438-4d3b-b56b-dfeb7540fdea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1518 microversion: 2.91 time: 0.263060 Oct 11 04:18:00.418904 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 952/1976] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:00 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1518 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:00.444200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce7c1263-fb02-4d72-b372-6b3cb82ab895 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:00.445156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce7c1263-fb02-4d72-b372-6b3cb82ab895 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:00.556044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce7c1263-fb02-4d72-b372-6b3cb82ab895 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:00.567568 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce7c1263-fb02-4d72-b372-6b3cb82ab895 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1217 microversion: 2.1 time: 0.128302 Oct 11 04:18:00.568159 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 953/1977] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:00 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1217 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:00.620926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:00.621558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] [instance: 75b55166-b6c5-400e-b0c6-f1a04c595b75] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:00.630495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:00.630990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:00.631433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:00.632139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:00.632596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:00.633024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:00.707493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f4ebc0ca-c4de-433f-9682-77446fa90634 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:00.717493 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] HTTP exception thrown: Instance 75b55166-b6c5-400e-b0c6-f1a04c595b75 could not be found. Oct 11 04:18:00.723234 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f4ebc0ca-c4de-433f-9682-77446fa90634 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1366 microversion: 2.1 time: 0.353082 Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Request method failure captured: Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 HTTP/1.1 Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO2_7L0uItjBF3C5sB4I-ca-_IJmVpxZ1m6x4tGq_Y5DEG0dDiVrGtSIxZ0y4WBm6c3HPQUdJPUcalzwrzGFngefCzYW3Fq6TtHQM7ACAa5iSyl5dI39Dh8LaQtkFY_SmVin85mYEA9ii3JW9pod7fKqXkUUgGTcP5cmLXL93xQwkwI Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 7dcd9cbd3fbe4c24add13c912979deb7 Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestBootFromVolume-1277585135 Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7dcd9cbd3fbe4c24add13c912979deb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7dcd9cbd3fbe4c24add13c912979deb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7dcd9cbd3fbe4c24add13c912979deb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7dcd9cbd3fbe4c24add13c912979deb7"}]}] Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestBootFromVolume-1277585135 Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 7dcd9cbd3fbe4c24add13c912979deb7 Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestBootFromVolume-1277585135 Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestBootFromVolume-1277585135-project Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 12aa2047c1ec47f6b6594e9109f8ec6c Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestBootFromVolume-1277585135-project Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 75b55166-b6c5-400e-b0c6-f1a04c595b75 could not be found. Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '75b55166-b6c5-400e-b0c6-f1a04c595b75'} Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 75b55166-b6c5-400e-b0c6-f1a04c595b75 could not be found. Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 75b55166-b6c5-400e-b0c6-f1a04c595b75 could not be found. Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:18:00.724342 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:18:00.732317 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:00.732317 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:18:00.732317 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:18:00.732317 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:18:00.732317 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:18:00.732317 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 75b55166-b6c5-400e-b0c6-f1a04c595b75 could not be found. Oct 11 04:18:00.732317 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:18:00.732317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Returning 404 to user: Instance 75b55166-b6c5-400e-b0c6-f1a04c595b75 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:18:00.732970 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1025/1978] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:00 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1366 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:00.743502 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2cb875ff-64ed-432d-9553-a924c03898e1 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75" status: 404 len: 111 microversion: 2.1 time: 0.112466 Oct 11 04:18:00.751389 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 954/1979] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:00 2022] GET /compute/v2.1/servers/75b55166-b6c5-400e-b0c6-f1a04c595b75 => generated 111 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:18:00.752943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-02d8432d-d5c3-4a88-b342-396dbf35ac33 req-eb690278-f6eb-4e51-95a5-ee31dd801461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "244c7407-4845-4274-aa34-493231a9d453", "tag": "70d1eee9-350e-496b-a14b-0cf2729018d5"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:00.770072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e32b325a-c617-4186-aee7-da209d763d01 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] Calling method '.version_select at 0x7fda1e0c4f70>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:00.780153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-02d8432d-d5c3-4a88-b342-396dbf35ac33 req-eb690278-f6eb-4e51-95a5-ee31dd801461 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:00.780994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-02d8432d-d5c3-4a88-b342-396dbf35ac33 req-eb690278-f6eb-4e51-95a5-ee31dd801461 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:00.781806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-02d8432d-d5c3-4a88-b342-396dbf35ac33 req-eb690278-f6eb-4e51-95a5-ee31dd801461 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:00.828794 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-02d8432d-d5c3-4a88-b342-396dbf35ac33 req-eb690278-f6eb-4e51-95a5-ee31dd801461 service nova] Creating event network-changed:70d1eee9-350e-496b-a14b-0cf2729018d5 for instance 244c7407-4845-4274-aa34-493231a9d453 on n-h2-860892-1 Oct 11 04:18:00.871189 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-02d8432d-d5c3-4a88-b342-396dbf35ac33 req-eb690278-f6eb-4e51-95a5-ee31dd801461 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127512 Oct 11 04:18:00.880448 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1026/1980] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:01.003101 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e32b325a-c617-4186-aee7-da209d763d01 tempest-ServersTestBootFromVolume-1277585135 tempest-ServersTestBootFromVolume-1277585135-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804752598" status: 202 len: 0 microversion: 2.1 time: 0.248285 Oct 11 04:18:01.014566 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 955/1981] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:18:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1804752598 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:18:01.321090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb2a02ac-74a7-4392-99d5-5d7715bbe143 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:01.325962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb2a02ac-74a7-4392-99d5-5d7715bbe143 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:01.363687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb2a02ac-74a7-4392-99d5-5d7715bbe143 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:01.370335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb2a02ac-74a7-4392-99d5-5d7715bbe143 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:01.372153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb2a02ac-74a7-4392-99d5-5d7715bbe143 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:01.382712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb2a02ac-74a7-4392-99d5-5d7715bbe143 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:01.386735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb2a02ac-74a7-4392-99d5-5d7715bbe143 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:01.387196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb2a02ac-74a7-4392-99d5-5d7715bbe143 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:01.444179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:01.446408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:01.487919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:01.488729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:01.489187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:01.490626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:01.491096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:01.491529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:01.746759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb2a02ac-74a7-4392-99d5-5d7715bbe143 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:01.756433 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb2a02ac-74a7-4392-99d5-5d7715bbe143 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 0.443520 Oct 11 04:18:01.761877 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1027/1982] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:01 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:01.791550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-06ba70da-6ae2-4ec9-9b63-2358f45c6c9b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:01.791550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-06ba70da-6ae2-4ec9-9b63-2358f45c6c9b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:01.803898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06ba70da-6ae2-4ec9-9b63-2358f45c6c9b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:01.804426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06ba70da-6ae2-4ec9-9b63-2358f45c6c9b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:01.804899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06ba70da-6ae2-4ec9-9b63-2358f45c6c9b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:01.805641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06ba70da-6ae2-4ec9-9b63-2358f45c6c9b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:01.806162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06ba70da-6ae2-4ec9-9b63-2358f45c6c9b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:01.819029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06ba70da-6ae2-4ec9-9b63-2358f45c6c9b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:01.923663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-06ba70da-6ae2-4ec9-9b63-2358f45c6c9b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:01.936542 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-06ba70da-6ae2-4ec9-9b63-2358f45c6c9b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1213 microversion: 2.1 time: 0.155202 Oct 11 04:18:01.939054 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1028/1983] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:01 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1213 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:01.944770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-95ff9ede-0fb0-4905-88c6-1f5e1f677e58 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:01.945794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-95ff9ede-0fb0-4905-88c6-1f5e1f677e58 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:01.961852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95ff9ede-0fb0-4905-88c6-1f5e1f677e58 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:01.962775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95ff9ede-0fb0-4905-88c6-1f5e1f677e58 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:01.963814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95ff9ede-0fb0-4905-88c6-1f5e1f677e58 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:01.964673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95ff9ede-0fb0-4905-88c6-1f5e1f677e58 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:01.965805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95ff9ede-0fb0-4905-88c6-1f5e1f677e58 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:01.966431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95ff9ede-0fb0-4905-88c6-1f5e1f677e58 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:02.000168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:02.232043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-95ff9ede-0fb0-4905-88c6-1f5e1f677e58 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:02.241170 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-95ff9ede-0fb0-4905-88c6-1f5e1f677e58 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1366 microversion: 2.1 time: 0.302592 Oct 11 04:18:02.244454 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1029/1984] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:01 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1366 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:02.555774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:02.567956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:02.569819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:02.581329 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3a0c238-ab73-4669-a74f-bec1e958137d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1506 microversion: 2.91 time: 1.147109 Oct 11 04:18:02.583020 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 956/1985] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:01 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1506 bytes in 1150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:02.787121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-148bd4f6-1c63-4027-8e81-8d61183e3725 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:02.787763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-148bd4f6-1c63-4027-8e81-8d61183e3725 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:02.794357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-148bd4f6-1c63-4027-8e81-8d61183e3725 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:02.795191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-148bd4f6-1c63-4027-8e81-8d61183e3725 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:02.795813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-148bd4f6-1c63-4027-8e81-8d61183e3725 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:02.796678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-148bd4f6-1c63-4027-8e81-8d61183e3725 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:02.797292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-148bd4f6-1c63-4027-8e81-8d61183e3725 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:02.797878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-148bd4f6-1c63-4027-8e81-8d61183e3725 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:02.962730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-b0e7329f-68ab-4d31-a433-183241c6264e req-5b9de18f-e351-47d3-9811-26de03ea9a72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08774d29-93f3-4d89-9b47-1c6fa3a54f25", "name": "network-vif-plugged", "status": "completed", "tag": "ee2a41e5-8279-4d39-acb5-4a1ef74b1b9f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:02.991492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b0e7329f-68ab-4d31-a433-183241c6264e req-5b9de18f-e351-47d3-9811-26de03ea9a72 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:02.996280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b0e7329f-68ab-4d31-a433-183241c6264e req-5b9de18f-e351-47d3-9811-26de03ea9a72 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:02.996980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b0e7329f-68ab-4d31-a433-183241c6264e req-5b9de18f-e351-47d3-9811-26de03ea9a72 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:03.024334 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-b0e7329f-68ab-4d31-a433-183241c6264e req-5b9de18f-e351-47d3-9811-26de03ea9a72 service nova] Creating event network-vif-plugged:ee2a41e5-8279-4d39-acb5-4a1ef74b1b9f for instance 08774d29-93f3-4d89-9b47-1c6fa3a54f25 on n-h1-860892-1 Oct 11 04:18:03.033016 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-b0e7329f-68ab-4d31-a433-183241c6264e req-5b9de18f-e351-47d3-9811-26de03ea9a72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076904 Oct 11 04:18:03.034210 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 957/1986] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:18:03.045866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b06c1e09-fc4e-4d69-a56f-58bdf2209ef2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:03.046883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b06c1e09-fc4e-4d69-a56f-58bdf2209ef2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:03.053482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06c1e09-fc4e-4d69-a56f-58bdf2209ef2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:03.054329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06c1e09-fc4e-4d69-a56f-58bdf2209ef2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:03.055480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06c1e09-fc4e-4d69-a56f-58bdf2209ef2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:03.057330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06c1e09-fc4e-4d69-a56f-58bdf2209ef2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:03.058599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06c1e09-fc4e-4d69-a56f-58bdf2209ef2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:03.060924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-148bd4f6-1c63-4027-8e81-8d61183e3725 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:03.069896 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-148bd4f6-1c63-4027-8e81-8d61183e3725 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 0.286554 Oct 11 04:18:03.070455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06c1e09-fc4e-4d69-a56f-58bdf2209ef2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:03.074384 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1030/1987] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:02 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:03.267897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-912299d8-bc70-45b4-8712-c2c05f3c9dee tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:03.268823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-912299d8-bc70-45b4-8712-c2c05f3c9dee tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:03.289866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912299d8-bc70-45b4-8712-c2c05f3c9dee tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:03.290431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912299d8-bc70-45b4-8712-c2c05f3c9dee tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:03.291363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912299d8-bc70-45b4-8712-c2c05f3c9dee tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:03.292095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912299d8-bc70-45b4-8712-c2c05f3c9dee tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:03.300308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912299d8-bc70-45b4-8712-c2c05f3c9dee tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:03.300308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912299d8-bc70-45b4-8712-c2c05f3c9dee tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:03.329272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b06c1e09-fc4e-4d69-a56f-58bdf2209ef2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:03.338435 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b06c1e09-fc4e-4d69-a56f-58bdf2209ef2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1269 microversion: 2.1 time: 0.302620 Oct 11 04:18:03.339392 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 958/1988] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:03 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1269 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:03.612134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:03.612782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:03.621937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:03.622449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:03.626291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:03.637191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:03.637805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:03.638337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:03.796457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:03.810110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:03.812111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:03.819171 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09420a64-a001-434c-b64e-1aa03da6193f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1527 microversion: 2.91 time: 0.211147 Oct 11 04:18:03.823023 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 959/1989] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:03 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1527 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:03.897137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-912299d8-bc70-45b4-8712-c2c05f3c9dee tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:03.910944 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-912299d8-bc70-45b4-8712-c2c05f3c9dee tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1366 microversion: 2.1 time: 0.647210 Oct 11 04:18:03.911843 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1031/1990] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:03 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1366 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:04.099732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-17e9b685-d369-4219-92ed-fb784cf0c47d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:04.100344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-17e9b685-d369-4219-92ed-fb784cf0c47d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:04.107744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17e9b685-d369-4219-92ed-fb784cf0c47d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.108236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17e9b685-d369-4219-92ed-fb784cf0c47d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.108669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17e9b685-d369-4219-92ed-fb784cf0c47d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.109399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17e9b685-d369-4219-92ed-fb784cf0c47d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.114963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17e9b685-d369-4219-92ed-fb784cf0c47d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.115484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17e9b685-d369-4219-92ed-fb784cf0c47d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.235955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7eea3a39-8d34-4f4f-9b67-8ef701243b43 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:04.237165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7eea3a39-8d34-4f4f-9b67-8ef701243b43 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:04.245597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7eea3a39-8d34-4f4f-9b67-8ef701243b43 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.246535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7eea3a39-8d34-4f4f-9b67-8ef701243b43 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.248551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7eea3a39-8d34-4f4f-9b67-8ef701243b43 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.249558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7eea3a39-8d34-4f4f-9b67-8ef701243b43 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.250515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7eea3a39-8d34-4f4f-9b67-8ef701243b43 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.251190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7eea3a39-8d34-4f4f-9b67-8ef701243b43 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.258449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:04.505567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-17e9b685-d369-4219-92ed-fb784cf0c47d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:04.537939 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-17e9b685-d369-4219-92ed-fb784cf0c47d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 0.441911 Oct 11 04:18:04.541637 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1032/1991] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:04 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:04.548158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-55418172-a773-41a0-a07f-c4aaf8447609 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:04.549043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-55418172-a773-41a0-a07f-c4aaf8447609 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:04.556455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55418172-a773-41a0-a07f-c4aaf8447609 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.557245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55418172-a773-41a0-a07f-c4aaf8447609 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.557969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55418172-a773-41a0-a07f-c4aaf8447609 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.559270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55418172-a773-41a0-a07f-c4aaf8447609 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.566571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-7eea3a39-8d34-4f4f-9b67-8ef701243b43 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lazy-loading 'services' on Instance uuid 08029265-88c6-4b4a-bbff-1dc995bd902f {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:18:04.571099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55418172-a773-41a0-a07f-c4aaf8447609 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.572536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55418172-a773-41a0-a07f-c4aaf8447609 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.603814 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7eea3a39-8d34-4f4f-9b67-8ef701243b43 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1932 microversion: 2.91 time: 0.756457 Oct 11 04:18:04.610822 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 960/1992] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:03 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1932 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:04.635660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-193633e8-0d72-4dd2-bc3f-16fc01db8649 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:04.636999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-193633e8-0d72-4dd2-bc3f-16fc01db8649 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:04.645082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193633e8-0d72-4dd2-bc3f-16fc01db8649 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.645854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193633e8-0d72-4dd2-bc3f-16fc01db8649 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.646534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193633e8-0d72-4dd2-bc3f-16fc01db8649 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.647446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193633e8-0d72-4dd2-bc3f-16fc01db8649 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.648110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193633e8-0d72-4dd2-bc3f-16fc01db8649 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.648788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193633e8-0d72-4dd2-bc3f-16fc01db8649 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.819424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-55418172-a773-41a0-a07f-c4aaf8447609 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:04.838863 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-55418172-a773-41a0-a07f-c4aaf8447609 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1275 microversion: 2.1 time: 0.295157 Oct 11 04:18:04.840966 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1033/1993] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:04 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1275 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:04.870526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-193633e8-0d72-4dd2-bc3f-16fc01db8649 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lazy-loading 'services' on Instance uuid 08029265-88c6-4b4a-bbff-1dc995bd902f {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:18:04.891748 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-193633e8-0d72-4dd2-bc3f-16fc01db8649 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1932 microversion: 2.91 time: 0.260028 Oct 11 04:18:04.906417 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 961/1994] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:04 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1932 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:04.923060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-57c80bbe-341c-4c59-8d84-4ab7ce57713a tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:04.926851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57c80bbe-341c-4c59-8d84-4ab7ce57713a tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.927344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57c80bbe-341c-4c59-8d84-4ab7ce57713a tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.927784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57c80bbe-341c-4c59-8d84-4ab7ce57713a tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.928520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57c80bbe-341c-4c59-8d84-4ab7ce57713a tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.928972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57c80bbe-341c-4c59-8d84-4ab7ce57713a tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.929397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57c80bbe-341c-4c59-8d84-4ab7ce57713a tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.938206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=11 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:04.940691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-37d62a44-7b22-45e4-86cb-79cd2aff3285 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:04.941350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-37d62a44-7b22-45e4-86cb-79cd2aff3285 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:04.959429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37d62a44-7b22-45e4-86cb-79cd2aff3285 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.960562 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-57c80bbe-341c-4c59-8d84-4ab7ce57713a tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 498 microversion: 2.91 time: 0.041139 Oct 11 04:18:04.961523 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1034/1995] 10.222.0.26 () {60 vars in 1217 bytes} [Tue Oct 11 04:18:04 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 498 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:18:04.961847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37d62a44-7b22-45e4-86cb-79cd2aff3285 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.964438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37d62a44-7b22-45e4-86cb-79cd2aff3285 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.972511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37d62a44-7b22-45e4-86cb-79cd2aff3285 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.972511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37d62a44-7b22-45e4-86cb-79cd2aff3285 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.972511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37d62a44-7b22-45e4-86cb-79cd2aff3285 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.978251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d6b00a9-93ad-43d8-9ad5-ff320467983e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:04.979243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4d6b00a9-93ad-43d8-9ad5-ff320467983e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:04.987328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d6b00a9-93ad-43d8-9ad5-ff320467983e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.988203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d6b00a9-93ad-43d8-9ad5-ff320467983e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.988879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d6b00a9-93ad-43d8-9ad5-ff320467983e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:04.989832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d6b00a9-93ad-43d8-9ad5-ff320467983e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:04.990631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d6b00a9-93ad-43d8-9ad5-ff320467983e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:04.994110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d6b00a9-93ad-43d8-9ad5-ff320467983e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:05.028018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-4d6b00a9-93ad-43d8-9ad5-ff320467983e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lazy-loading 'flavor' on Instance uuid 08029265-88c6-4b4a-bbff-1dc995bd902f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:18:05.474111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-37d62a44-7b22-45e4-86cb-79cd2aff3285 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:05.487813 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-37d62a44-7b22-45e4-86cb-79cd2aff3285 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1366 microversion: 2.1 time: 0.553959 Oct 11 04:18:05.492160 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 962/1996] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:04 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1366 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:05.571763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e4d47054-c82a-4951-a171-cda70b059efc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:05.572665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e4d47054-c82a-4951-a171-cda70b059efc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:05.580162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d47054-c82a-4951-a171-cda70b059efc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:05.581017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d47054-c82a-4951-a171-cda70b059efc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:05.581723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d47054-c82a-4951-a171-cda70b059efc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:05.582757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d47054-c82a-4951-a171-cda70b059efc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:05.583444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d47054-c82a-4951-a171-cda70b059efc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:05.584187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d47054-c82a-4951-a171-cda70b059efc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:05.828594 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4d6b00a9-93ad-43d8-9ad5-ff320467983e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "POST /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f/action" status: 202 len: 0 microversion: 2.91 time: 0.857589 Oct 11 04:18:05.830042 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1035/1997] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:18:04 2022] POST /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f/action => generated 0 bytes in 861 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:18:05.844542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:05.845905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:05.857039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:05.857876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:05.858607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:05.859565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:05.860284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:05.860942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:05.945051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:05.958035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:05.963836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:05.972048 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c14c7c0-453e-4083-b5f2-0f3720e7c318 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.137074 Oct 11 04:18:05.973480 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1036/1998] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:05 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:05.985121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-24e07974-2e64-411f-a281-aff70e4292b9 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:05.985121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-24e07974-2e64-411f-a281-aff70e4292b9 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:05.989063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24e07974-2e64-411f-a281-aff70e4292b9 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:05.989885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24e07974-2e64-411f-a281-aff70e4292b9 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:05.990584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24e07974-2e64-411f-a281-aff70e4292b9 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:05.991666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24e07974-2e64-411f-a281-aff70e4292b9 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:05.993471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24e07974-2e64-411f-a281-aff70e4292b9 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:05.994180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24e07974-2e64-411f-a281-aff70e4292b9 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:06.075730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-24e07974-2e64-411f-a281-aff70e4292b9 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:06.085518 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-24e07974-2e64-411f-a281-aff70e4292b9 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1275 microversion: 2.1 time: 0.110435 Oct 11 04:18:06.088063 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1037/1999] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:05 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1275 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:06.535474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea7ba91f-ca04-4c39-a974-7561a1ac56ce tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:06.536833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea7ba91f-ca04-4c39-a974-7561a1ac56ce tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:06.543341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7ba91f-ca04-4c39-a974-7561a1ac56ce tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:06.543900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7ba91f-ca04-4c39-a974-7561a1ac56ce tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:06.555195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7ba91f-ca04-4c39-a974-7561a1ac56ce tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:06.555195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7ba91f-ca04-4c39-a974-7561a1ac56ce tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:06.555195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7ba91f-ca04-4c39-a974-7561a1ac56ce tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:06.555195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7ba91f-ca04-4c39-a974-7561a1ac56ce tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:06.590487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e4d47054-c82a-4951-a171-cda70b059efc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:06.603065 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e4d47054-c82a-4951-a171-cda70b059efc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1316 microversion: 2.1 time: 1.039594 Oct 11 04:18:06.603650 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 963/2000] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:05 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1316 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:06.760758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ea7ba91f-ca04-4c39-a974-7561a1ac56ce tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:06.771060 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea7ba91f-ca04-4c39-a974-7561a1ac56ce tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1366 microversion: 2.1 time: 0.251301 Oct 11 04:18:06.773237 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1038/2001] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:06 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:07.008036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:07.008665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:07.016805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:07.016805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:07.017104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:07.017815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:07.018479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:07.019080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:07.112898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b241e975-1e34-4dee-836b-1332e9d05b7a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:07.117132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b241e975-1e34-4dee-836b-1332e9d05b7a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:07.127245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b241e975-1e34-4dee-836b-1332e9d05b7a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:07.127995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b241e975-1e34-4dee-836b-1332e9d05b7a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:07.129158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b241e975-1e34-4dee-836b-1332e9d05b7a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:07.130460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b241e975-1e34-4dee-836b-1332e9d05b7a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:07.131573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b241e975-1e34-4dee-836b-1332e9d05b7a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:07.132338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b241e975-1e34-4dee-836b-1332e9d05b7a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:07.181562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:07.191855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:07.193402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:07.202247 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ad042812-2555-40de-8749-2c262b768136 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.199402 Oct 11 04:18:07.206233 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 964/2002] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:07 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:07.214833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b241e975-1e34-4dee-836b-1332e9d05b7a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:07.223483 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b241e975-1e34-4dee-836b-1332e9d05b7a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1275 microversion: 2.1 time: 0.116582 Oct 11 04:18:07.224064 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1039/2003] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:07 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1275 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:07.630311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f73512b-b9c0-470a-96f2-3653177511b2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:07.631946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f73512b-b9c0-470a-96f2-3653177511b2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:07.641942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f73512b-b9c0-470a-96f2-3653177511b2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:07.642459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f73512b-b9c0-470a-96f2-3653177511b2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:07.642905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f73512b-b9c0-470a-96f2-3653177511b2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:07.643826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f73512b-b9c0-470a-96f2-3653177511b2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:07.644283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f73512b-b9c0-470a-96f2-3653177511b2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:07.645182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f73512b-b9c0-470a-96f2-3653177511b2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:07.795167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cb62c7a9-e76b-401e-9fa4-ca699261161b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:07.795802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cb62c7a9-e76b-401e-9fa4-ca699261161b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:07.803002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb62c7a9-e76b-401e-9fa4-ca699261161b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:07.803991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb62c7a9-e76b-401e-9fa4-ca699261161b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:07.804605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb62c7a9-e76b-401e-9fa4-ca699261161b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:07.805491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb62c7a9-e76b-401e-9fa4-ca699261161b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:07.806514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb62c7a9-e76b-401e-9fa4-ca699261161b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:07.807120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb62c7a9-e76b-401e-9fa4-ca699261161b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:07.961617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cb62c7a9-e76b-401e-9fa4-ca699261161b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:07.979112 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cb62c7a9-e76b-401e-9fa4-ca699261161b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1366 microversion: 2.1 time: 0.187747 Oct 11 04:18:07.980036 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1040/2004] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:07 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1366 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:08.190531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f73512b-b9c0-470a-96f2-3653177511b2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:08.193333 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f73512b-b9c0-470a-96f2-3653177511b2 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1466 microversion: 2.1 time: 0.569412 Oct 11 04:18:08.193924 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 965/2005] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:07 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1466 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:08.217240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7441d03d-4313-4f27-a02c-fbfe05fe0604 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:08.219012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7441d03d-4313-4f27-a02c-fbfe05fe0604 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:08.225456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7441d03d-4313-4f27-a02c-fbfe05fe0604 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:08.230417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7441d03d-4313-4f27-a02c-fbfe05fe0604 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:08.230644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:08.230936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7441d03d-4313-4f27-a02c-fbfe05fe0604 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:08.231138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:08.232029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7441d03d-4313-4f27-a02c-fbfe05fe0604 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:08.232685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7441d03d-4313-4f27-a02c-fbfe05fe0604 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:08.233279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7441d03d-4313-4f27-a02c-fbfe05fe0604 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:08.238842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:08.239335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:08.244397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:08.245187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:08.246102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:08.247225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:08.436605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:08.444778 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7441d03d-4313-4f27-a02c-fbfe05fe0604 tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1617 microversion: 2.1 time: 0.230709 Oct 11 04:18:08.447638 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1041/2006] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:08 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1617 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:08.453321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6caaa301-d2fe-4845-93e5-74e44dbc7c85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:08.453961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6caaa301-d2fe-4845-93e5-74e44dbc7c85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:08.462639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaa301-d2fe-4845-93e5-74e44dbc7c85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:08.463450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaa301-d2fe-4845-93e5-74e44dbc7c85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:08.464379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaa301-d2fe-4845-93e5-74e44dbc7c85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:08.465338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaa301-d2fe-4845-93e5-74e44dbc7c85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:08.466134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaa301-d2fe-4845-93e5-74e44dbc7c85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:08.466785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaa301-d2fe-4845-93e5-74e44dbc7c85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:08.468515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:08.470633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:08.495583 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2a5e849c-2482-4337-bb3a-d18b51e86288 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.255163 Oct 11 04:18:08.495583 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 966/2007] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:08 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:08.504570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-50a48489-cef7-4f7d-a83a-76f7b5f46bb3 req-2f002f3b-f451-4b23-86aa-cd274f6c895a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "244c7407-4845-4274-aa34-493231a9d453", "name": "network-vif-plugged", "status": "completed", "tag": "70d1eee9-350e-496b-a14b-0cf2729018d5"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:08.515056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:UPDATE=1,nova_api:SELECT=98,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:08.520557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-50a48489-cef7-4f7d-a83a-76f7b5f46bb3 req-2f002f3b-f451-4b23-86aa-cd274f6c895a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:08.521551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-50a48489-cef7-4f7d-a83a-76f7b5f46bb3 req-2f002f3b-f451-4b23-86aa-cd274f6c895a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:08.546648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-50a48489-cef7-4f7d-a83a-76f7b5f46bb3 req-2f002f3b-f451-4b23-86aa-cd274f6c895a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:08.566128 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-50a48489-cef7-4f7d-a83a-76f7b5f46bb3 req-2f002f3b-f451-4b23-86aa-cd274f6c895a service nova] Creating event network-vif-plugged:70d1eee9-350e-496b-a14b-0cf2729018d5 for instance 244c7407-4845-4274-aa34-493231a9d453 on n-h2-860892-1 Oct 11 04:18:08.584761 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-50a48489-cef7-4f7d-a83a-76f7b5f46bb3 req-2f002f3b-f451-4b23-86aa-cd274f6c895a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096425 Oct 11 04:18:08.585628 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 967/2008] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:08.674088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersOnMultiNodesTest-server-499231280", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}, "os:scheduler_hints": {"same_host": "b997d21c-b814-4e0c-aba4-53ea4b3c590b"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:08.770703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:18:08.811599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6caaa301-d2fe-4845-93e5-74e44dbc7c85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:08.825766 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6caaa301-d2fe-4845-93e5-74e44dbc7c85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.376154 Oct 11 04:18:08.826768 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1042/2009] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:08 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:09.001059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2be48823-e3b0-436e-8791-0ced7076c26e tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:09.002070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2be48823-e3b0-436e-8791-0ced7076c26e tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:09.011139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2be48823-e3b0-436e-8791-0ced7076c26e tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:09.011892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2be48823-e3b0-436e-8791-0ced7076c26e tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:09.012322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2be48823-e3b0-436e-8791-0ced7076c26e tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:09.013191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2be48823-e3b0-436e-8791-0ced7076c26e tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:09.013640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2be48823-e3b0-436e-8791-0ced7076c26e tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:09.014063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2be48823-e3b0-436e-8791-0ced7076c26e tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:09.177744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2be48823-e3b0-436e-8791-0ced7076c26e tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:09.188058 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2be48823-e3b0-436e-8791-0ced7076c26e tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1366 microversion: 2.1 time: 0.190877 Oct 11 04:18:09.189029 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1043/2010] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:08 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:09.523060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:09.523699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:09.526771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=44 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:09.531916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:09.532410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:09.532856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:09.533567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:09.534019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:09.534478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:09.602874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:09.606490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:09.612292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:09.613802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:09.620138 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4fd79dec-97ae-494a-8bc9-f9be01c30512 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.101375 Oct 11 04:18:09.620720 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1044/2011] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:09 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:09.848777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9edbcf98-7280-40e3-8e55-e9accaa9b74b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:09.849381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9edbcf98-7280-40e3-8e55-e9accaa9b74b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:09.855359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9edbcf98-7280-40e3-8e55-e9accaa9b74b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:09.855838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9edbcf98-7280-40e3-8e55-e9accaa9b74b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:09.856363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9edbcf98-7280-40e3-8e55-e9accaa9b74b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:09.857048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9edbcf98-7280-40e3-8e55-e9accaa9b74b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:09.857494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9edbcf98-7280-40e3-8e55-e9accaa9b74b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:09.857915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9edbcf98-7280-40e3-8e55-e9accaa9b74b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:09.980382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:18:09.981180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:18:09.981937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:18:09.982355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:18:09.982873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:18:10.014707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:10.015498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:10.016192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:10.017306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:10.017988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:10.018819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:10.093969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:18:10.108180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Getting quotas for user db33edccb2504185928613257e64cdb4 and project 89c92233d372409b9c1ce4ae94eeeab7. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:18:10.122642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9edbcf98-7280-40e3-8e55-e9accaa9b74b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:10.132280 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9edbcf98-7280-40e3-8e55-e9accaa9b74b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.287323 Oct 11 04:18:10.135491 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1045/2012] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:09 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:10.147594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:18:10.154331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:18:10.212995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-45d26c61-560f-4262-a429-cda2aed26119 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:10.213607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45d26c61-560f-4262-a429-cda2aed26119 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:10.219845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45d26c61-560f-4262-a429-cda2aed26119 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:10.220562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45d26c61-560f-4262-a429-cda2aed26119 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:10.221196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45d26c61-560f-4262-a429-cda2aed26119 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:10.222146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45d26c61-560f-4262-a429-cda2aed26119 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:10.222793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45d26c61-560f-4262-a429-cda2aed26119 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:10.223457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45d26c61-560f-4262-a429-cda2aed26119 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:10.441637 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41f425a8-361d-49f1-a163-0d61ab18e871 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.770808 Oct 11 04:18:10.444447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45d26c61-560f-4262-a429-cda2aed26119 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:10.453549 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-45d26c61-560f-4262-a429-cda2aed26119 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1366 microversion: 2.1 time: 0.244503 Oct 11 04:18:10.455722 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1046/2013] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:10 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:10.465894 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 968/2014] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:18:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1799 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:18:10.478551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56e04224-8a1a-45ba-af17-c1af3aded068 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:10.479720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-56e04224-8a1a-45ba-af17-c1af3aded068 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:10.624375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-56e04224-8a1a-45ba-af17-c1af3aded068 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:10.631712 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-56e04224-8a1a-45ba-af17-c1af3aded068 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1216 microversion: 2.1 time: 0.158697 Oct 11 04:18:10.632304 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1047/2015] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:10 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1216 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:10.647908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:10.648867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:10.657725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:10.660976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:10.662400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:10.669679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:10.670480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:10.671277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:10.906107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:10.923784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:10.927015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:10.935907 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a887fa93-c7e8-4400-b2e8-a22b1aacb680 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.291398 Oct 11 04:18:10.950225 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 969/2016] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:10 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:11.161812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4238ea39-cf00-466d-83ae-92a622d1130c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:11.162456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4238ea39-cf00-466d-83ae-92a622d1130c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:11.167087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:11.177984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4238ea39-cf00-466d-83ae-92a622d1130c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:11.181558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4238ea39-cf00-466d-83ae-92a622d1130c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:11.183687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4238ea39-cf00-466d-83ae-92a622d1130c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:11.184944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4238ea39-cf00-466d-83ae-92a622d1130c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:11.188001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4238ea39-cf00-466d-83ae-92a622d1130c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:11.188757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4238ea39-cf00-466d-83ae-92a622d1130c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:11.451356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4238ea39-cf00-466d-83ae-92a622d1130c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:11.464582 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4238ea39-cf00-466d-83ae-92a622d1130c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.307464 Oct 11 04:18:11.465503 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1048/2017] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:11 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:11.480480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2567d101-48ec-486d-b20f-48bdcd12b6d6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:11.482965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2567d101-48ec-486d-b20f-48bdcd12b6d6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:11.499295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2567d101-48ec-486d-b20f-48bdcd12b6d6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:11.499295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2567d101-48ec-486d-b20f-48bdcd12b6d6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:11.499295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2567d101-48ec-486d-b20f-48bdcd12b6d6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:11.499295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2567d101-48ec-486d-b20f-48bdcd12b6d6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:11.499295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2567d101-48ec-486d-b20f-48bdcd12b6d6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:11.499295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2567d101-48ec-486d-b20f-48bdcd12b6d6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:11.618984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-98fd432a-70f3-4adf-b5c3-b5d86f1ce7ac req-e1a08436-4799-4443-a96e-900585833127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93bf3c01-c65e-4a62-ac8f-352bc8246a2d", "tag": "d0bb2ff8-d0fd-4843-b947-a32edd7bb015"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:11.640820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-98fd432a-70f3-4adf-b5c3-b5d86f1ce7ac req-e1a08436-4799-4443-a96e-900585833127 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:11.642407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-98fd432a-70f3-4adf-b5c3-b5d86f1ce7ac req-e1a08436-4799-4443-a96e-900585833127 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:11.643103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-98fd432a-70f3-4adf-b5c3-b5d86f1ce7ac req-e1a08436-4799-4443-a96e-900585833127 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:11.660588 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-98fd432a-70f3-4adf-b5c3-b5d86f1ce7ac req-e1a08436-4799-4443-a96e-900585833127 service nova] Creating event network-changed:d0bb2ff8-d0fd-4843-b947-a32edd7bb015 for instance 93bf3c01-c65e-4a62-ac8f-352bc8246a2d on n-h1-860892-1 Oct 11 04:18:11.667282 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-98fd432a-70f3-4adf-b5c3-b5d86f1ce7ac req-e1a08436-4799-4443-a96e-900585833127 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053129 Oct 11 04:18:11.669060 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1049/2018] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:11.678556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-24987ca1-d398-4bf8-875d-1e4d92a8302b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:11.684977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-24987ca1-d398-4bf8-875d-1e4d92a8302b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:11.763217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-24987ca1-d398-4bf8-875d-1e4d92a8302b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:11.771717 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-24987ca1-d398-4bf8-875d-1e4d92a8302b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1216 microversion: 2.1 time: 0.101588 Oct 11 04:18:11.782616 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1050/2019] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:11 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:11.954117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2567d101-48ec-486d-b20f-48bdcd12b6d6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:11.972208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:11.974311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:11.999872 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2567d101-48ec-486d-b20f-48bdcd12b6d6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1557 microversion: 2.1 time: 0.526563 Oct 11 04:18:12.014837 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 970/2020] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:11 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1557 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:12.015079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:12.015079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:12.015079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:12.015079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:12.015079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:12.015079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:12.026996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2200eb5a-d77a-4283-9d00-5d567b1b7e85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:12.028449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2200eb5a-d77a-4283-9d00-5d567b1b7e85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:12.057499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2200eb5a-d77a-4283-9d00-5d567b1b7e85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:12.065863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2200eb5a-d77a-4283-9d00-5d567b1b7e85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:12.066387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2200eb5a-d77a-4283-9d00-5d567b1b7e85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:12.068364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2200eb5a-d77a-4283-9d00-5d567b1b7e85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:12.068364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2200eb5a-d77a-4283-9d00-5d567b1b7e85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:12.071834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2200eb5a-d77a-4283-9d00-5d567b1b7e85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:12.215497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:12.224647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:12.226097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:12.239276 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d427019-fcde-4b88-b28a-9e3f6ca4b1bb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.271604 Oct 11 04:18:12.239276 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1051/2021] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:11 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:12.239557 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2200eb5a-d77a-4283-9d00-5d567b1b7e85 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.211164 Oct 11 04:18:12.239557 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 971/2022] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:18:12 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-interface => generated 285 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:12.492186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef756ee3-00d3-4ff7-a383-8e21115f8621 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:12.493214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef756ee3-00d3-4ff7-a383-8e21115f8621 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:12.504299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef756ee3-00d3-4ff7-a383-8e21115f8621 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:12.505065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef756ee3-00d3-4ff7-a383-8e21115f8621 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:12.505676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef756ee3-00d3-4ff7-a383-8e21115f8621 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:12.506676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef756ee3-00d3-4ff7-a383-8e21115f8621 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:12.507138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef756ee3-00d3-4ff7-a383-8e21115f8621 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:12.507584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef756ee3-00d3-4ff7-a383-8e21115f8621 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:12.732216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef756ee3-00d3-4ff7-a383-8e21115f8621 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:12.740345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef756ee3-00d3-4ff7-a383-8e21115f8621 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.251986 Oct 11 04:18:12.740925 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1052/2023] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:12 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:12.796135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ea3009f-5f8e-4775-8c3d-9f33c2ab9581 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:12.796670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5ea3009f-5f8e-4775-8c3d-9f33c2ab9581 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:12.804306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea3009f-5f8e-4775-8c3d-9f33c2ab9581 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:12.804910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea3009f-5f8e-4775-8c3d-9f33c2ab9581 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:12.806032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea3009f-5f8e-4775-8c3d-9f33c2ab9581 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:12.806890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea3009f-5f8e-4775-8c3d-9f33c2ab9581 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:12.807448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea3009f-5f8e-4775-8c3d-9f33c2ab9581 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:12.808157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea3009f-5f8e-4775-8c3d-9f33c2ab9581 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:13.261429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:13.262152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:13.270432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:13.270924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:13.271364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:13.272075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:13.272619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:13.273050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:13.361619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:13.364053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5ea3009f-5f8e-4775-8c3d-9f33c2ab9581 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:13.373958 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ea3009f-5f8e-4775-8c3d-9f33c2ab9581 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1212 microversion: 2.1 time: 0.581944 Oct 11 04:18:13.375349 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 972/2024] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:12 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1212 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:13.379381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:13.381073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:13.387948 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ada9b7e-5ca7-41f9-85a4-2c8fa6cbd31b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.131686 Oct 11 04:18:13.388839 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1053/2025] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:13 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:13.703716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-3a579c3b-8ae2-4d33-81a0-852314a01d63 req-89533714-801f-4b99-bd50-fb239bc904f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4aaae530-25a0-46f6-9df0-bb21d130a0f7", "tag": "39669b5c-b616-41c2-a28c-282c3da17d8d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:13.729925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3a579c3b-8ae2-4d33-81a0-852314a01d63 req-89533714-801f-4b99-bd50-fb239bc904f8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:13.730917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3a579c3b-8ae2-4d33-81a0-852314a01d63 req-89533714-801f-4b99-bd50-fb239bc904f8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:13.731854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3a579c3b-8ae2-4d33-81a0-852314a01d63 req-89533714-801f-4b99-bd50-fb239bc904f8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:13.765692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a964a0a0-6457-4e61-932f-dc47be0a9232 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:13.766385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a964a0a0-6457-4e61-932f-dc47be0a9232 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:13.776139 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-3a579c3b-8ae2-4d33-81a0-852314a01d63 req-89533714-801f-4b99-bd50-fb239bc904f8 service nova] Creating event network-changed:39669b5c-b616-41c2-a28c-282c3da17d8d for instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 on n-h2-860892-1 Oct 11 04:18:13.781990 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-3a579c3b-8ae2-4d33-81a0-852314a01d63 req-89533714-801f-4b99-bd50-fb239bc904f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083068 Oct 11 04:18:13.783525 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 973/2026] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:13.790522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a964a0a0-6457-4e61-932f-dc47be0a9232 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:13.791156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a964a0a0-6457-4e61-932f-dc47be0a9232 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:13.791612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a964a0a0-6457-4e61-932f-dc47be0a9232 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:13.792369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a964a0a0-6457-4e61-932f-dc47be0a9232 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:13.792838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a964a0a0-6457-4e61-932f-dc47be0a9232 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:13.793252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a964a0a0-6457-4e61-932f-dc47be0a9232 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:14.404713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12d83c65-59b4-4d35-85d5-050ff50918d0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:14.405647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-12d83c65-59b4-4d35-85d5-050ff50918d0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:14.440607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12d83c65-59b4-4d35-85d5-050ff50918d0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:14.441155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12d83c65-59b4-4d35-85d5-050ff50918d0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:14.441611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12d83c65-59b4-4d35-85d5-050ff50918d0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:14.442372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12d83c65-59b4-4d35-85d5-050ff50918d0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:14.443014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12d83c65-59b4-4d35-85d5-050ff50918d0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:14.443648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12d83c65-59b4-4d35-85d5-050ff50918d0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:14.565124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a964a0a0-6457-4e61-932f-dc47be0a9232 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:14.595802 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a964a0a0-6457-4e61-932f-dc47be0a9232 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.834022 Oct 11 04:18:14.610411 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1054/2027] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:13 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:14.620821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:14.621772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:14.630461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:14.631203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:14.631824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:14.632761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:14.633488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:14.634117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:14.713005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-12d83c65-59b4-4d35-85d5-050ff50918d0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:14.736275 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-12d83c65-59b4-4d35-85d5-050ff50918d0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1276 microversion: 2.1 time: 0.338549 Oct 11 04:18:14.739204 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 974/2028] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:14 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1276 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:14.771925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:14.789783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:14.797665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:14.807492 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5920cdf0-ef06-4d16-b3a7-b73c158050b2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.195005 Oct 11 04:18:14.814499 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1055/2029] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:14 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:15.623998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c9a4cd2f-5c11-467a-8c2a-cdaeee74dde4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:15.624624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c9a4cd2f-5c11-467a-8c2a-cdaeee74dde4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:15.637604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a4cd2f-5c11-467a-8c2a-cdaeee74dde4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:15.638102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a4cd2f-5c11-467a-8c2a-cdaeee74dde4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:15.638578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a4cd2f-5c11-467a-8c2a-cdaeee74dde4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:15.642526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a4cd2f-5c11-467a-8c2a-cdaeee74dde4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:15.642526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a4cd2f-5c11-467a-8c2a-cdaeee74dde4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:15.642526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a4cd2f-5c11-467a-8c2a-cdaeee74dde4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:15.766041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3826fb63-4b33-4206-9420-39b65166f340 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:15.768825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3826fb63-4b33-4206-9420-39b65166f340 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:15.802023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3826fb63-4b33-4206-9420-39b65166f340 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:15.803282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3826fb63-4b33-4206-9420-39b65166f340 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:15.803897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3826fb63-4b33-4206-9420-39b65166f340 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:15.804796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3826fb63-4b33-4206-9420-39b65166f340 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:15.818138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3826fb63-4b33-4206-9420-39b65166f340 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:15.818860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3826fb63-4b33-4206-9420-39b65166f340 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:15.986677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c9a4cd2f-5c11-467a-8c2a-cdaeee74dde4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:16.020036 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c9a4cd2f-5c11-467a-8c2a-cdaeee74dde4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.390448 Oct 11 04:18:16.020036 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 975/2030] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:15 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:16.030999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:16.031615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:16.047816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:16.051465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:16.051961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:16.052756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:16.053642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:16.054272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:16.074294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3826fb63-4b33-4206-9420-39b65166f340 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:16.087952 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3826fb63-4b33-4206-9420-39b65166f340 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1274 microversion: 2.1 time: 0.328545 Oct 11 04:18:16.091222 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1056/2031] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:15 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1274 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:16.103288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b5a3ee09-7174-4088-904f-4c638d9b513f req-b95e47ea-cb11-46fb-a6e0-1be0f225c903 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "244c7407-4845-4274-aa34-493231a9d453", "tag": "70d1eee9-350e-496b-a14b-0cf2729018d5"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:16.132655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b5a3ee09-7174-4088-904f-4c638d9b513f req-b95e47ea-cb11-46fb-a6e0-1be0f225c903 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:16.141044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b5a3ee09-7174-4088-904f-4c638d9b513f req-b95e47ea-cb11-46fb-a6e0-1be0f225c903 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:16.141044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b5a3ee09-7174-4088-904f-4c638d9b513f req-b95e47ea-cb11-46fb-a6e0-1be0f225c903 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:16.181936 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b5a3ee09-7174-4088-904f-4c638d9b513f req-b95e47ea-cb11-46fb-a6e0-1be0f225c903 service nova] Creating event network-changed:70d1eee9-350e-496b-a14b-0cf2729018d5 for instance 244c7407-4845-4274-aa34-493231a9d453 on n-h2-860892-1 Oct 11 04:18:16.183595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:16.187950 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b5a3ee09-7174-4088-904f-4c638d9b513f req-b95e47ea-cb11-46fb-a6e0-1be0f225c903 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092121 Oct 11 04:18:16.191063 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1057/2032] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:16.199589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-1834513811", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "2fa7d0b9-5517-40e9-b330-4166ed6eb6c9"}, {"uuid": "6ac61603-0fe0-40c3-a4cd-ace6874a9a93"}, {"uuid": "2fa7d0b9-5517-40e9-b330-4166ed6eb6c9"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:16.201132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:16.205119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:16.232524 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ea947d8e-b877-4b23-b8d1-b5c4ab23252e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.213082 Oct 11 04:18:16.242658 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 976/2033] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:16 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:16.343745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] validate_networks() for [('2fa7d0b9-5517-40e9-b330-4166ed6eb6c9', None, None, None, None, None), ('6ac61603-0fe0-40c3-a4cd-ace6874a9a93', None, None, None, None, None), ('2fa7d0b9-5517-40e9-b330-4166ed6eb6c9', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:18:16.462545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveAutoBlockMigrationV225Test-server-516036034", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "89a2a2aa-9a7e-4acc-b86b-af482eea703c"}], "block_device_mapping_v2": [{"uuid": "ae1b35fb-a75d-4137-99aa-6e017776a923", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:16.629583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] validate_networks() for [('89a2a2aa-9a7e-4acc-b86b-af482eea703c', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:18:17.608632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:18:17.609822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:18:17.610791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:18:17.611768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:18:17.612424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:18:17.653752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:17.662023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:17.668715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:17.668715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:17.670400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:17.671525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:17.734239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Getting quotas for project daa8ad03685c4b59b3274fc6407c9eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:18:17.744067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Getting quotas for user 917dab915f7d4303989abb47a33f47df and project daa8ad03685c4b59b3274fc6407c9eb7. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:18:17.808735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:17.864525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:18:17.866730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae1b35fb-a75d-4137-99aa-6e017776a923',volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:18:18.479837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:18:18.480401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:18:18.481172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:18:18.485877 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-460d39b7-95af-4643-b403-8422ace28cfd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.25 time: 2.027303 Oct 11 04:18:18.486624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:18:18.489166 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 977/2034] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:18:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2032 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:18:18.489800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:18:18.496160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e7997009-5331-432f-b1d1-1a70bba4582a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:18.497845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e7997009-5331-432f-b1d1-1a70bba4582a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:18.507703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7997009-5331-432f-b1d1-1a70bba4582a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:18.509191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7997009-5331-432f-b1d1-1a70bba4582a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:18.510381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7997009-5331-432f-b1d1-1a70bba4582a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:18.511495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7997009-5331-432f-b1d1-1a70bba4582a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:18.512696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7997009-5331-432f-b1d1-1a70bba4582a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:18.513462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7997009-5331-432f-b1d1-1a70bba4582a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:18.522824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:18.526458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:18.527037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:18.527803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:18.528265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:18.528697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:18.605464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Getting quotas for project 35648419af8f47b49dd4dfb75115d2e1. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:18:18.616622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Getting quotas for user 2bc397bbbb204dfd9494ec2a6ee020a8 and project 35648419af8f47b49dd4dfb75115d2e1. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:18:18.669534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:18:18.691146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:18:18.829951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e7997009-5331-432f-b1d1-1a70bba4582a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:18.841591 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e7997009-5331-432f-b1d1-1a70bba4582a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.349802 Oct 11 04:18:18.847323 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 978/2035] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:18 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:18.855067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3e9ec081-1980-4991-96f4-b7de1f9f735b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:18.855067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3e9ec081-1980-4991-96f4-b7de1f9f735b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:18.862137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e9ec081-1980-4991-96f4-b7de1f9f735b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:18.862886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e9ec081-1980-4991-96f4-b7de1f9f735b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:18.863334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e9ec081-1980-4991-96f4-b7de1f9f735b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:18.864039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e9ec081-1980-4991-96f4-b7de1f9f735b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:18.864494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e9ec081-1980-4991-96f4-b7de1f9f735b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:18.864918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e9ec081-1980-4991-96f4-b7de1f9f735b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:18.870395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:18.964722 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-05f0493b-0880-4f08-86af-9a36380ab1e0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.771682 Oct 11 04:18:18.966962 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1058/2036] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:18:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 2775 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:18:19.000411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:19.001809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:19.026829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:19.028447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:19.030781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:19.033531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:19.035149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:19.035847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:19.222042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:19.232005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:19.233505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:19.243158 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-91496643-0b75-4b91-87ab-419ec12ca793 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.273732 Oct 11 04:18:19.244010 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1059/2037] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:18 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:19.250043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27eee257-a1cb-45d0-b243-df21b5ce1c4c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:19.251042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-27eee257-a1cb-45d0-b243-df21b5ce1c4c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:19.331109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-27eee257-a1cb-45d0-b243-df21b5ce1c4c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:19.340198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-27eee257-a1cb-45d0-b243-df21b5ce1c4c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:19.341167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-27eee257-a1cb-45d0-b243-df21b5ce1c4c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:19.342312 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-27eee257-a1cb-45d0-b243-df21b5ce1c4c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1103 microversion: 2.25 time: 0.096474 Oct 11 04:18:19.342877 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1060/2038] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:19 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1103 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:19.365984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca1751fb-5fc6-4642-9645-9f4a96dab761 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:19.368600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ca1751fb-5fc6-4642-9645-9f4a96dab761 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:19.463560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ca1751fb-5fc6-4642-9645-9f4a96dab761 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:19.472852 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ca1751fb-5fc6-4642-9645-9f4a96dab761 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1213 microversion: 2.1 time: 0.128865 Oct 11 04:18:19.473812 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1061/2039] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:19 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1213 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:19.499087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-76eb6098-14f4-49ec-924c-4038f32a10fd req-c5a3fa46-1626-451b-8bc7-3261980d99e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07ea3eea-d4bc-410e-904b-78a7d9db6df3", "tag": "60d40530-cc0b-4eee-a401-3edf071c8c91"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:19.510971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-76eb6098-14f4-49ec-924c-4038f32a10fd req-c5a3fa46-1626-451b-8bc7-3261980d99e5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:19.512250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-76eb6098-14f4-49ec-924c-4038f32a10fd req-c5a3fa46-1626-451b-8bc7-3261980d99e5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:19.512932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-76eb6098-14f4-49ec-924c-4038f32a10fd req-c5a3fa46-1626-451b-8bc7-3261980d99e5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:19.531595 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-76eb6098-14f4-49ec-924c-4038f32a10fd req-c5a3fa46-1626-451b-8bc7-3261980d99e5 service nova] Creating event network-changed:60d40530-cc0b-4eee-a401-3edf071c8c91 for instance 07ea3eea-d4bc-410e-904b-78a7d9db6df3 on n-h2-860892-1 Oct 11 04:18:19.537691 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-76eb6098-14f4-49ec-924c-4038f32a10fd req-c5a3fa46-1626-451b-8bc7-3261980d99e5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048843 Oct 11 04:18:19.539494 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1062/2040] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:19.612832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3e9ec081-1980-4991-96f4-b7de1f9f735b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:19.625001 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3e9ec081-1980-4991-96f4-b7de1f9f735b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1316 microversion: 2.1 time: 0.776233 Oct 11 04:18:19.625700 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 979/2041] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:18 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1316 bytes in 778 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:19.869297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-66584d1f-bea4-43fa-bed7-68b819a54c0b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:19.869894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-66584d1f-bea4-43fa-bed7-68b819a54c0b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:19.882801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66584d1f-bea4-43fa-bed7-68b819a54c0b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:19.883891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66584d1f-bea4-43fa-bed7-68b819a54c0b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:19.896206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66584d1f-bea4-43fa-bed7-68b819a54c0b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:19.897508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66584d1f-bea4-43fa-bed7-68b819a54c0b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:19.899328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66584d1f-bea4-43fa-bed7-68b819a54c0b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:19.901469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66584d1f-bea4-43fa-bed7-68b819a54c0b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:20.213628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-66584d1f-bea4-43fa-bed7-68b819a54c0b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:20.221551 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-66584d1f-bea4-43fa-bed7-68b819a54c0b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.357936 Oct 11 04:18:20.222483 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1063/2042] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:19 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:20.278843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:20.279453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:20.286527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:20.287046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:20.287740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:20.288442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:20.289088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:20.290045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:20.367281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:20.371137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:20.371887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:20.379531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:20.380557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:20.381263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:20.382181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:20.384797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:20.395663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:20.398506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:20.404410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:20.415638 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f89a6f00-37fa-49b9-8f34-b5d6ac137090 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.140594 Oct 11 04:18:20.419393 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 980/2043] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:20 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:20.501702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:20.511786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0dbb74fb-ed0e-461d-8f93-dcf2571a6f3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:20.515366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0dbb74fb-ed0e-461d-8f93-dcf2571a6f3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:20.528674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:20.533234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:20.554371 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-524480af-9581-4325-b3c9-b3df18b9556b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1184 microversion: 2.25 time: 0.168486 Oct 11 04:18:20.554371 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1064/2044] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:20 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1184 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:20.658839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0dbb74fb-ed0e-461d-8f93-dcf2571a6f3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:20.663448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-efd9223a-3eea-473d-96bc-8b9825a448c1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:20.666942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-efd9223a-3eea-473d-96bc-8b9825a448c1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:20.670201 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0dbb74fb-ed0e-461d-8f93-dcf2571a6f3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1213 microversion: 2.1 time: 0.171315 Oct 11 04:18:20.670986 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 981/2045] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:20 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1213 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:20.688956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd9223a-3eea-473d-96bc-8b9825a448c1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:20.689821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd9223a-3eea-473d-96bc-8b9825a448c1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:20.691811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd9223a-3eea-473d-96bc-8b9825a448c1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:20.694468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd9223a-3eea-473d-96bc-8b9825a448c1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:20.698335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd9223a-3eea-473d-96bc-8b9825a448c1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:20.700051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd9223a-3eea-473d-96bc-8b9825a448c1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:20.930868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-efd9223a-3eea-473d-96bc-8b9825a448c1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:20.938807 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-efd9223a-3eea-473d-96bc-8b9825a448c1 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1316 microversion: 2.1 time: 0.292625 Oct 11 04:18:20.939597 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1065/2046] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:20 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:21.247783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5e8ce49a-a742-45cc-8e78-a87aa223a321 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:21.248701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5e8ce49a-a742-45cc-8e78-a87aa223a321 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:21.256294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8ce49a-a742-45cc-8e78-a87aa223a321 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:21.256848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8ce49a-a742-45cc-8e78-a87aa223a321 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:21.257353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8ce49a-a742-45cc-8e78-a87aa223a321 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:21.258109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8ce49a-a742-45cc-8e78-a87aa223a321 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:21.259081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8ce49a-a742-45cc-8e78-a87aa223a321 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:21.259507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8ce49a-a742-45cc-8e78-a87aa223a321 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:21.416216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e8ce49a-a742-45cc-8e78-a87aa223a321 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:21.426032 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5e8ce49a-a742-45cc-8e78-a87aa223a321 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.184472 Oct 11 04:18:21.426944 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 982/2047] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:21 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:21.449830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:21.451724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:21.459869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:21.460456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:21.461268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:21.462159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:21.462788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:21.463184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:21.559348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:21.567623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:21.568542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:21.572754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:21.575294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:21.575979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:21.576147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:21.576747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:21.577655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:21.578303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:21.578896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:21.585245 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-97ab52c1-539b-4335-95c3-3934239cd962 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.140110 Oct 11 04:18:21.586987 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1066/2048] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:21 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:21.644989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:21.654167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:21.655861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:21.656994 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c24f9be3-b7dd-4d46-8c7c-df2345c5b275 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1232 microversion: 2.25 time: 0.093297 Oct 11 04:18:21.657981 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 983/2049] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:21 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1232 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:21.696208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a7be0709-7c7d-4d0c-a3ac-df29c5bde015 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:21.697255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a7be0709-7c7d-4d0c-a3ac-df29c5bde015 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:21.705249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7be0709-7c7d-4d0c-a3ac-df29c5bde015 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:21.707077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7be0709-7c7d-4d0c-a3ac-df29c5bde015 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:21.707077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7be0709-7c7d-4d0c-a3ac-df29c5bde015 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:21.707743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7be0709-7c7d-4d0c-a3ac-df29c5bde015 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:21.708572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7be0709-7c7d-4d0c-a3ac-df29c5bde015 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:21.709202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7be0709-7c7d-4d0c-a3ac-df29c5bde015 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:21.825355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a7be0709-7c7d-4d0c-a3ac-df29c5bde015 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:21.835685 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a7be0709-7c7d-4d0c-a3ac-df29c5bde015 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1209 microversion: 2.1 time: 0.144174 Oct 11 04:18:21.838248 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1067/2050] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:21 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1209 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:21.963973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-892f6748-3803-43b0-9e08-c6d993e6a34f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:21.964608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-892f6748-3803-43b0-9e08-c6d993e6a34f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:21.975408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-892f6748-3803-43b0-9e08-c6d993e6a34f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:21.975909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-892f6748-3803-43b0-9e08-c6d993e6a34f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:21.976574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-892f6748-3803-43b0-9e08-c6d993e6a34f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:21.977760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-892f6748-3803-43b0-9e08-c6d993e6a34f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:21.978243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-892f6748-3803-43b0-9e08-c6d993e6a34f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:21.978857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-892f6748-3803-43b0-9e08-c6d993e6a34f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:22.245647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-892f6748-3803-43b0-9e08-c6d993e6a34f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:22.255070 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-892f6748-3803-43b0-9e08-c6d993e6a34f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1316 microversion: 2.1 time: 0.296526 Oct 11 04:18:22.255659 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 984/2051] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:21 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:22.452161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b295e3b3-e001-468f-920e-2685b14e021c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:22.452161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b295e3b3-e001-468f-920e-2685b14e021c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:22.456743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b295e3b3-e001-468f-920e-2685b14e021c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:22.457231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b295e3b3-e001-468f-920e-2685b14e021c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:22.457768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b295e3b3-e001-468f-920e-2685b14e021c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:22.458638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b295e3b3-e001-468f-920e-2685b14e021c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:22.459099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b295e3b3-e001-468f-920e-2685b14e021c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:22.459524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b295e3b3-e001-468f-920e-2685b14e021c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:22.465351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:22.617163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:22.620795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:22.631953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:22.632441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:22.632884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:22.634155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:22.634639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:22.635067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:22.647352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b295e3b3-e001-468f-920e-2685b14e021c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:22.652163 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b295e3b3-e001-468f-920e-2685b14e021c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.207058 Oct 11 04:18:22.652774 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1068/2052] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:22 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:22.686951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:22.688013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:22.694305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:22.695074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:22.695551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:22.696266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:22.696717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:22.697284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:22.736333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:22.745270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:22.746860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:22.752658 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b96faa76-8379-41fc-89d0-ac98ff50c80a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.139266 Oct 11 04:18:22.753859 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 985/2053] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:22 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:22.774618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:22.794248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:22.796352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:22.801046 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3d9dbd77-efac-4f22-9dc8-6b8431db7ed5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1240 microversion: 2.25 time: 0.117700 Oct 11 04:18:22.803716 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1069/2054] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:22 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1240 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:22.864066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1bd46221-6131-4e5f-b5aa-1aa23543ba1b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:22.874350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1bd46221-6131-4e5f-b5aa-1aa23543ba1b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:22.874350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bd46221-6131-4e5f-b5aa-1aa23543ba1b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:22.874350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bd46221-6131-4e5f-b5aa-1aa23543ba1b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:22.874350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bd46221-6131-4e5f-b5aa-1aa23543ba1b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:22.874350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bd46221-6131-4e5f-b5aa-1aa23543ba1b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:22.874350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bd46221-6131-4e5f-b5aa-1aa23543ba1b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:22.874350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bd46221-6131-4e5f-b5aa-1aa23543ba1b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:22.969498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7110c1c7-5e3f-419b-b7b1-0f2b241cd0ad req-cfe2ee6a-a0c8-4054-95e2-0195e4ed0db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaae530-25a0-46f6-9df0-bb21d130a0f7", "name": "network-vif-plugged", "status": "completed", "tag": "39669b5c-b616-41c2-a28c-282c3da17d8d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:23.011138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7110c1c7-5e3f-419b-b7b1-0f2b241cd0ad req-cfe2ee6a-a0c8-4054-95e2-0195e4ed0db4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:23.011138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7110c1c7-5e3f-419b-b7b1-0f2b241cd0ad req-cfe2ee6a-a0c8-4054-95e2-0195e4ed0db4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:23.011138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7110c1c7-5e3f-419b-b7b1-0f2b241cd0ad req-cfe2ee6a-a0c8-4054-95e2-0195e4ed0db4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:23.011138 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7110c1c7-5e3f-419b-b7b1-0f2b241cd0ad req-cfe2ee6a-a0c8-4054-95e2-0195e4ed0db4 service nova] Creating event network-vif-plugged:39669b5c-b616-41c2-a28c-282c3da17d8d for instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 on n-h2-860892-1 Oct 11 04:18:23.011138 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7110c1c7-5e3f-419b-b7b1-0f2b241cd0ad req-cfe2ee6a-a0c8-4054-95e2-0195e4ed0db4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036335 Oct 11 04:18:23.011138 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1070/2055] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:18:23.012014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1bd46221-6131-4e5f-b5aa-1aa23543ba1b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:23.020108 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1bd46221-6131-4e5f-b5aa-1aa23543ba1b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1265 microversion: 2.1 time: 0.162325 Oct 11 04:18:23.021330 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 986/2056] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:22 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:23.280485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-390b5f7c-87af-4154-be25-d56f7787a3c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:23.281120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-390b5f7c-87af-4154-be25-d56f7787a3c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:23.293404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390b5f7c-87af-4154-be25-d56f7787a3c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:23.294103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390b5f7c-87af-4154-be25-d56f7787a3c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:23.295335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390b5f7c-87af-4154-be25-d56f7787a3c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:23.297484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390b5f7c-87af-4154-be25-d56f7787a3c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:23.299302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390b5f7c-87af-4154-be25-d56f7787a3c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:23.299966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390b5f7c-87af-4154-be25-d56f7787a3c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:23.528387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-390b5f7c-87af-4154-be25-d56f7787a3c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:23.538160 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-390b5f7c-87af-4154-be25-d56f7787a3c7 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1316 microversion: 2.1 time: 0.262049 Oct 11 04:18:23.539232 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1071/2057] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:23 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1316 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:23.678777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67aeba2c-1dba-4224-ba17-ae4203d3adb0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:23.679568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67aeba2c-1dba-4224-ba17-ae4203d3adb0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:23.705903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67aeba2c-1dba-4224-ba17-ae4203d3adb0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:23.707017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67aeba2c-1dba-4224-ba17-ae4203d3adb0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:23.708559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67aeba2c-1dba-4224-ba17-ae4203d3adb0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:23.709952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67aeba2c-1dba-4224-ba17-ae4203d3adb0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:23.710820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67aeba2c-1dba-4224-ba17-ae4203d3adb0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:23.711694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67aeba2c-1dba-4224-ba17-ae4203d3adb0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:23.786380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:23.786927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:23.805858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:23.806394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:23.806860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:23.807570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:23.808038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:23.808470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:24.030107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:24.039786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:24.048207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:24.074555 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8b951f26-48b5-40fc-937b-8609ee73285d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.281015 Oct 11 04:18:24.074555 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1072/2058] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:23 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:24.079844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:24.080730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:24.087964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:24.091250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:24.091930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:24.093591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:24.095858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:24.099417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:24.207274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-67aeba2c-1dba-4224-ba17-ae4203d3adb0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:24.218601 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-67aeba2c-1dba-4224-ba17-ae4203d3adb0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.545268 Oct 11 04:18:24.220466 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 987/2059] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:23 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:24.231632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52232892-99c6-443f-b87d-a9d757c63909 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:24.235548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-52232892-99c6-443f-b87d-a9d757c63909 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:24.276799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52232892-99c6-443f-b87d-a9d757c63909 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:24.280413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52232892-99c6-443f-b87d-a9d757c63909 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:24.280413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52232892-99c6-443f-b87d-a9d757c63909 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:24.289002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52232892-99c6-443f-b87d-a9d757c63909 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:24.290857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52232892-99c6-443f-b87d-a9d757c63909 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:24.295675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52232892-99c6-443f-b87d-a9d757c63909 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:24.471353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-52232892-99c6-443f-b87d-a9d757c63909 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:24.494392 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-52232892-99c6-443f-b87d-a9d757c63909 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1283 microversion: 2.1 time: 0.270716 Oct 11 04:18:24.494998 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 988/2060] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:24 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1283 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:24.565098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07455161-4116-436e-8a8c-56cad2ffabae tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:24.565796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-07455161-4116-436e-8a8c-56cad2ffabae tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:24.575111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07455161-4116-436e-8a8c-56cad2ffabae tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:24.575612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07455161-4116-436e-8a8c-56cad2ffabae tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:24.578539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07455161-4116-436e-8a8c-56cad2ffabae tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:24.579376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07455161-4116-436e-8a8c-56cad2ffabae tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:24.579849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07455161-4116-436e-8a8c-56cad2ffabae tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:24.583929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07455161-4116-436e-8a8c-56cad2ffabae tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:25.007273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:25.030444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-07455161-4116-436e-8a8c-56cad2ffabae tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:25.036992 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-07455161-4116-436e-8a8c-56cad2ffabae tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1316 microversion: 2.1 time: 0.475898 Oct 11 04:18:25.038976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:25.041072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:25.046935 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 989/2061] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:24 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1316 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:25.050598 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-272b785e-ed09-4f4d-ab6b-3154ceff55cb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1292 microversion: 2.25 time: 0.977561 Oct 11 04:18:25.069086 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1073/2062] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:24 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1292 bytes in 1005 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:25.073586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e59d780e-4044-4ab2-94d0-23942bd3700b req-f7961cad-f73d-4ec2-aa8f-c0dd2b5379b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93bf3c01-c65e-4a62-ac8f-352bc8246a2d", "name": "network-vif-plugged", "status": "completed", "tag": "d0bb2ff8-d0fd-4843-b947-a32edd7bb015"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:25.085555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e59d780e-4044-4ab2-94d0-23942bd3700b req-f7961cad-f73d-4ec2-aa8f-c0dd2b5379b1 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:25.087531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e59d780e-4044-4ab2-94d0-23942bd3700b req-f7961cad-f73d-4ec2-aa8f-c0dd2b5379b1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:25.087531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e59d780e-4044-4ab2-94d0-23942bd3700b req-f7961cad-f73d-4ec2-aa8f-c0dd2b5379b1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:25.095819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:25.096860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:25.109852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:25.110725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:25.111422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:25.112377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:25.113037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:25.114713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:25.125232 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e59d780e-4044-4ab2-94d0-23942bd3700b req-f7961cad-f73d-4ec2-aa8f-c0dd2b5379b1 service nova] Creating event network-vif-plugged:d0bb2ff8-d0fd-4843-b947-a32edd7bb015 for instance 93bf3c01-c65e-4a62-ac8f-352bc8246a2d on n-h1-860892-1 Oct 11 04:18:25.137425 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e59d780e-4044-4ab2-94d0-23942bd3700b req-f7961cad-f73d-4ec2-aa8f-c0dd2b5379b1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089121 Oct 11 04:18:25.150498 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 990/2063] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:25.242236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3d8dda86-badb-4e96-a616-f7ecf8a06a85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:25.243514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3d8dda86-badb-4e96-a616-f7ecf8a06a85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:25.260077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8dda86-badb-4e96-a616-f7ecf8a06a85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:25.261677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8dda86-badb-4e96-a616-f7ecf8a06a85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:25.263691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8dda86-badb-4e96-a616-f7ecf8a06a85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:25.267918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8dda86-badb-4e96-a616-f7ecf8a06a85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:25.268497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8dda86-badb-4e96-a616-f7ecf8a06a85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:25.269463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8dda86-badb-4e96-a616-f7ecf8a06a85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:25.344677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:25.357832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:25.369218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:25.377021 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6b2bcb6-f0fd-4433-b31f-8aa12b02f19a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.285062 Oct 11 04:18:25.377719 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1074/2064] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:25 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:25.528127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-963ae73d-50fa-4530-8b0f-82866cd19364 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:25.528955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-963ae73d-50fa-4530-8b0f-82866cd19364 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:25.542572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-963ae73d-50fa-4530-8b0f-82866cd19364 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:25.543370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-963ae73d-50fa-4530-8b0f-82866cd19364 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:25.544034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-963ae73d-50fa-4530-8b0f-82866cd19364 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:25.544977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-963ae73d-50fa-4530-8b0f-82866cd19364 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:25.546404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-963ae73d-50fa-4530-8b0f-82866cd19364 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:25.547034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-963ae73d-50fa-4530-8b0f-82866cd19364 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:25.579473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d8dda86-badb-4e96-a616-f7ecf8a06a85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:25.595969 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3d8dda86-badb-4e96-a616-f7ecf8a06a85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.358552 Oct 11 04:18:25.599206 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 991/2065] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:25 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:25.657596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-963ae73d-50fa-4530-8b0f-82866cd19364 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:25.692611 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-963ae73d-50fa-4530-8b0f-82866cd19364 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1271 microversion: 2.1 time: 0.170301 Oct 11 04:18:25.695508 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1075/2066] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:25 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1271 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:25.949063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a7edbbf4-acd8-49b1-bd36-7ca1fbf545ff req-de59f39f-6d9d-465b-b0b1-fe2eee6b444b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d993e3f-2858-478c-941e-7d874a4fcb5e", "tag": "0d27cdb1-7b14-44cb-b024-b149b4ec43ab"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:25.972522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a7edbbf4-acd8-49b1-bd36-7ca1fbf545ff req-de59f39f-6d9d-465b-b0b1-fe2eee6b444b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:25.972522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a7edbbf4-acd8-49b1-bd36-7ca1fbf545ff req-de59f39f-6d9d-465b-b0b1-fe2eee6b444b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:25.975795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a7edbbf4-acd8-49b1-bd36-7ca1fbf545ff req-de59f39f-6d9d-465b-b0b1-fe2eee6b444b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:25.997301 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a7edbbf4-acd8-49b1-bd36-7ca1fbf545ff req-de59f39f-6d9d-465b-b0b1-fe2eee6b444b service nova] Creating event network-changed:0d27cdb1-7b14-44cb-b024-b149b4ec43ab for instance 7d993e3f-2858-478c-941e-7d874a4fcb5e on n-h1-860892-1 Oct 11 04:18:26.009827 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a7edbbf4-acd8-49b1-bd36-7ca1fbf545ff req-de59f39f-6d9d-465b-b0b1-fe2eee6b444b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065348 Oct 11 04:18:26.011030 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 992/2067] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:26.062806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-439d3ce6-5f40-40ce-aa5c-313c21342abc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:26.064062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-439d3ce6-5f40-40ce-aa5c-313c21342abc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:26.078116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:26.078847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:26.081752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-439d3ce6-5f40-40ce-aa5c-313c21342abc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:26.082514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-439d3ce6-5f40-40ce-aa5c-313c21342abc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:26.086754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-439d3ce6-5f40-40ce-aa5c-313c21342abc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:26.087892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-439d3ce6-5f40-40ce-aa5c-313c21342abc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:26.088499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-439d3ce6-5f40-40ce-aa5c-313c21342abc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:26.088933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-439d3ce6-5f40-40ce-aa5c-313c21342abc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:26.090083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:26.092120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:26.092781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:26.101652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:26.102429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:26.103067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:26.289605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:26.302221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:26.304850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:26.306263 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-48676d99-ffa6-460c-b8d9-e4e82e3ab794 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1292 microversion: 2.25 time: 0.233415 Oct 11 04:18:26.325888 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 993/2068] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:26 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1292 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:26.407286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:26.411056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:26.414006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:26.414727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:26.415164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:26.416013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:26.416519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:26.416943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:26.498277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:26.514179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:26.514179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:26.518409 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5eb6f24c-243f-4dd1-867d-5c27d3cc71cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.115170 Oct 11 04:18:26.530641 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 994/2069] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:26 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:26.546999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-439d3ce6-5f40-40ce-aa5c-313c21342abc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:26.557528 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-439d3ce6-5f40-40ce-aa5c-313c21342abc tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1316 microversion: 2.1 time: 0.500091 Oct 11 04:18:26.558821 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1076/2070] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:26 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1316 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:26.626792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-847f30fe-bc2a-473d-8241-eda71ec953c8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:26.627610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-847f30fe-bc2a-473d-8241-eda71ec953c8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:26.635915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f30fe-bc2a-473d-8241-eda71ec953c8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:26.645875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f30fe-bc2a-473d-8241-eda71ec953c8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:26.645875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f30fe-bc2a-473d-8241-eda71ec953c8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:26.645875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f30fe-bc2a-473d-8241-eda71ec953c8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:26.645875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f30fe-bc2a-473d-8241-eda71ec953c8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:26.645875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f30fe-bc2a-473d-8241-eda71ec953c8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:26.719047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d27a09c-fe3e-4c1c-b268-f071cf819f09 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:26.719739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d27a09c-fe3e-4c1c-b268-f071cf819f09 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:26.731153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d27a09c-fe3e-4c1c-b268-f071cf819f09 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:26.732133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d27a09c-fe3e-4c1c-b268-f071cf819f09 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:26.734636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d27a09c-fe3e-4c1c-b268-f071cf819f09 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:26.735489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d27a09c-fe3e-4c1c-b268-f071cf819f09 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:26.736034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d27a09c-fe3e-4c1c-b268-f071cf819f09 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:26.736588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d27a09c-fe3e-4c1c-b268-f071cf819f09 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:26.855715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-847f30fe-bc2a-473d-8241-eda71ec953c8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:26.864437 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-847f30fe-bc2a-473d-8241-eda71ec953c8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1317 microversion: 2.1 time: 0.241738 Oct 11 04:18:26.867815 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 995/2071] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:26 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1317 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:26.907695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d27a09c-fe3e-4c1c-b268-f071cf819f09 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:26.924746 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d27a09c-fe3e-4c1c-b268-f071cf819f09 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1271 microversion: 2.1 time: 0.209184 Oct 11 04:18:26.928281 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1077/2072] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:26 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1271 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:27.173581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-11b1c111-b794-4604-8831-64af2982d0d7 req-a401acca-3f49-4dac-8b72-8171d82b2383 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ea3eea-d4bc-410e-904b-78a7d9db6df3", "name": "network-vif-plugged", "status": "completed", "tag": "60d40530-cc0b-4eee-a401-3edf071c8c91"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:27.180218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-11b1c111-b794-4604-8831-64af2982d0d7 req-a401acca-3f49-4dac-8b72-8171d82b2383 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:27.181116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-11b1c111-b794-4604-8831-64af2982d0d7 req-a401acca-3f49-4dac-8b72-8171d82b2383 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:27.181799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-11b1c111-b794-4604-8831-64af2982d0d7 req-a401acca-3f49-4dac-8b72-8171d82b2383 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:27.196894 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-11b1c111-b794-4604-8831-64af2982d0d7 req-a401acca-3f49-4dac-8b72-8171d82b2383 service nova] Creating event network-vif-plugged:60d40530-cc0b-4eee-a401-3edf071c8c91 for instance 07ea3eea-d4bc-410e-904b-78a7d9db6df3 on n-h2-860892-1 Oct 11 04:18:27.202878 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-11b1c111-b794-4604-8831-64af2982d0d7 req-a401acca-3f49-4dac-8b72-8171d82b2383 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039659 Oct 11 04:18:27.204322 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 996/2073] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:27.335196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:27.336346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:27.343139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:27.343863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:27.344502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:27.345523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:27.346146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:27.346945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:27.549582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:27.551478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:27.556983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:27.563514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:27.565024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:27.568043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:27.574018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:27.574634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:27.576481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:27.713980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:27.716608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:27.724516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:27.727887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:27.733813 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e1d02a93-7402-431f-8d34-ba7a6bfb6444 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.188888 Oct 11 04:18:27.734823 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 997/2074] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:27 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:27.739644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b659fd6-7fc1-4684-b59e-fc330c47ba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:27.740266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b659fd6-7fc1-4684-b59e-fc330c47ba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:27.746621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b659fd6-7fc1-4684-b59e-fc330c47ba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:27.746969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b659fd6-7fc1-4684-b59e-fc330c47ba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:27.752427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b659fd6-7fc1-4684-b59e-fc330c47ba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:27.752427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b659fd6-7fc1-4684-b59e-fc330c47ba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:27.752427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b659fd6-7fc1-4684-b59e-fc330c47ba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:27.752427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b659fd6-7fc1-4684-b59e-fc330c47ba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:27.786884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:27.795876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:27.800534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:27.803270 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a54e0c73-f007-40f1-9486-2897db93dc0f tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1292 microversion: 2.25 time: 0.472149 Oct 11 04:18:27.803842 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1078/2075] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:27 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1292 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:27.889187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab943daf-c8e5-4f32-8104-1a10a063272f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:27.889799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab943daf-c8e5-4f32-8104-1a10a063272f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:27.916017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab943daf-c8e5-4f32-8104-1a10a063272f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:27.917201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab943daf-c8e5-4f32-8104-1a10a063272f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:27.917852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab943daf-c8e5-4f32-8104-1a10a063272f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:27.920023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab943daf-c8e5-4f32-8104-1a10a063272f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:27.921920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab943daf-c8e5-4f32-8104-1a10a063272f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:27.924938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab943daf-c8e5-4f32-8104-1a10a063272f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:27.928661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b659fd6-7fc1-4684-b59e-fc330c47ba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:27.934523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:27.958507 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b659fd6-7fc1-4684-b59e-fc330c47ba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1316 microversion: 2.1 time: 0.204045 Oct 11 04:18:27.958507 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 998/2076] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:27 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1316 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:27.958507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fd044c6e-7ecc-478c-9c1e-a7b6f8bb29f8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:27.958507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fd044c6e-7ecc-478c-9c1e-a7b6f8bb29f8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:27.958507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd044c6e-7ecc-478c-9c1e-a7b6f8bb29f8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:27.958507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd044c6e-7ecc-478c-9c1e-a7b6f8bb29f8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:27.966528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd044c6e-7ecc-478c-9c1e-a7b6f8bb29f8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:27.967089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd044c6e-7ecc-478c-9c1e-a7b6f8bb29f8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:27.981631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd044c6e-7ecc-478c-9c1e-a7b6f8bb29f8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:27.982276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd044c6e-7ecc-478c-9c1e-a7b6f8bb29f8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:28.241070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab943daf-c8e5-4f32-8104-1a10a063272f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:28.248611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fd044c6e-7ecc-478c-9c1e-a7b6f8bb29f8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:28.249213 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab943daf-c8e5-4f32-8104-1a10a063272f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1467 microversion: 2.1 time: 0.363877 Oct 11 04:18:28.257331 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fd044c6e-7ecc-478c-9c1e-a7b6f8bb29f8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1313 microversion: 2.1 time: 0.312336 Oct 11 04:18:28.258843 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 999/2077] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:27 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1313 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:28.263962 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1079/2078] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:27 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1467 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:28.277518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6189e511-d75b-402a-9b0e-e3e089bfecd5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:28.278980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6189e511-d75b-402a-9b0e-e3e089bfecd5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:28.285442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6189e511-d75b-402a-9b0e-e3e089bfecd5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:28.286151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6189e511-d75b-402a-9b0e-e3e089bfecd5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:28.287277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6189e511-d75b-402a-9b0e-e3e089bfecd5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:28.288203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6189e511-d75b-402a-9b0e-e3e089bfecd5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:28.288841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6189e511-d75b-402a-9b0e-e3e089bfecd5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:28.290092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6189e511-d75b-402a-9b0e-e3e089bfecd5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:28.506990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6189e511-d75b-402a-9b0e-e3e089bfecd5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:28.518773 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6189e511-d75b-402a-9b0e-e3e089bfecd5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7" status: 200 len: 1467 microversion: 2.1 time: 0.247005 Oct 11 04:18:28.519598 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1000/2079] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:28 2022] GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7 => generated 1467 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:28.542138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-00ac5b20-bfed-41c1-a118-b650029b7829 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-953616962"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:28.545624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-00ac5b20-bfed-41c1-a118-b650029b7829 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:28.552641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00ac5b20-bfed-41c1-a118-b650029b7829 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:28.553448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00ac5b20-bfed-41c1-a118-b650029b7829 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:28.554088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00ac5b20-bfed-41c1-a118-b650029b7829 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:28.555278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00ac5b20-bfed-41c1-a118-b650029b7829 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:28.555957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00ac5b20-bfed-41c1-a118-b650029b7829 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:28.556593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00ac5b20-bfed-41c1-a118-b650029b7829 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:28.768272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:28.769183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:28.799541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:28.800189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:28.800647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:28.801438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:28.801902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:28.810496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:28.977603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:28.989630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:28.993304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:29.009506 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dddbab91-56fa-4c6a-8f82-2e258aa90e92 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.246511 Oct 11 04:18:29.012460 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1001/2080] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:28 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:29.018532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:29.019881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:29.027408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:29.028180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:29.028788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:29.030167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:29.046786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:29.046786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:29.121694 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-00ac5b20-bfed-41c1-a118-b650029b7829 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "POST /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7/action" status: 202 len: 0 microversion: 2.1 time: 0.583089 Oct 11 04:18:29.129864 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1080/2081] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:18:28 2022] POST /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 04:18:29.144739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5f760272-4fcf-4e6d-aa9f-003e23d9f004 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:29.146956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5f760272-4fcf-4e6d-aa9f-003e23d9f004 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:29.154043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:29.166322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f760272-4fcf-4e6d-aa9f-003e23d9f004 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:29.169732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f760272-4fcf-4e6d-aa9f-003e23d9f004 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:29.170411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f760272-4fcf-4e6d-aa9f-003e23d9f004 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:29.171461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f760272-4fcf-4e6d-aa9f-003e23d9f004 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:29.172107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f760272-4fcf-4e6d-aa9f-003e23d9f004 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:29.173489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f760272-4fcf-4e6d-aa9f-003e23d9f004 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:29.279307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:29.288226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:29.297285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:29.297646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:29.297771 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8eb497e6-dd87-4829-b45f-65a0a5fd5a8a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1292 microversion: 2.25 time: 0.281343 Oct 11 04:18:29.297771 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1002/2082] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:29 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1292 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:29.310513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-20fa8362-6036-4505-b6dc-11440d8ba926 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1e144160>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:29.371506 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-20fa8362-6036-4505-b6dc-11440d8ba926 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 200 len: 1452 microversion: 2.1 time: 0.073744 Oct 11 04:18:29.372481 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1003/2083] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:18:29 2022] GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 1452 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:29.377365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c0d997e9-c462-496c-9856-32810a514395 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:29.391592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c0d997e9-c462-496c-9856-32810a514395 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:29.398095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0d997e9-c462-496c-9856-32810a514395 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:29.399736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0d997e9-c462-496c-9856-32810a514395 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:29.400360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0d997e9-c462-496c-9856-32810a514395 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:29.401366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0d997e9-c462-496c-9856-32810a514395 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:29.401977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0d997e9-c462-496c-9856-32810a514395 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:29.402611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0d997e9-c462-496c-9856-32810a514395 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:29.445981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5f760272-4fcf-4e6d-aa9f-003e23d9f004 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:29.455135 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5f760272-4fcf-4e6d-aa9f-003e23d9f004 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1316 microversion: 2.1 time: 0.320662 Oct 11 04:18:29.456088 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1081/2084] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:29 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1316 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:29.738758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c0d997e9-c462-496c-9856-32810a514395 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:29.755034 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c0d997e9-c462-496c-9856-32810a514395 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1313 microversion: 2.1 time: 0.375209 Oct 11 04:18:29.782481 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1004/2085] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:29 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1313 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:30.038640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:30.041227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:30.050629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=14 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:30.065305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:30.069880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:30.071096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:30.076431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:30.076431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:30.076431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:30.255103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:30.265233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:30.267873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:30.274613 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-45de6530-b303-4fb5-bdb1-cda635d96cee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.241020 Oct 11 04:18:30.275878 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1082/2086] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:30 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:30.323308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:30.324688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:30.336711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:30.338206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:30.339556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:30.340677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:30.341339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:30.342464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:30.389672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9783bf0b-a5a8-42f3-8905-72fb5dffae9a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1deec280>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:30.451915 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9783bf0b-a5a8-42f3-8905-72fb5dffae9a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 200 len: 1452 microversion: 2.1 time: 0.067180 Oct 11 04:18:30.452502 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1083/2087] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:18:30 2022] GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 1452 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:30.478152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-84cdc7c6-95f9-46ac-ad9c-dd40e50ab35f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:30.478940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-84cdc7c6-95f9-46ac-ad9c-dd40e50ab35f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:30.489958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84cdc7c6-95f9-46ac-ad9c-dd40e50ab35f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:30.493154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84cdc7c6-95f9-46ac-ad9c-dd40e50ab35f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:30.493620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84cdc7c6-95f9-46ac-ad9c-dd40e50ab35f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:30.494378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84cdc7c6-95f9-46ac-ad9c-dd40e50ab35f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:30.495091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84cdc7c6-95f9-46ac-ad9c-dd40e50ab35f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:30.495682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84cdc7c6-95f9-46ac-ad9c-dd40e50ab35f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:30.666535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=16 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:30.720829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-84cdc7c6-95f9-46ac-ad9c-dd40e50ab35f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:30.736043 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-84cdc7c6-95f9-46ac-ad9c-dd40e50ab35f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1466 microversion: 2.1 time: 0.262682 Oct 11 04:18:30.737084 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1084/2088] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:30 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1466 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:30.766278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8a8839f5-85aa-453c-99de-daabb3257f6d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:30.768847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8a8839f5-85aa-453c-99de-daabb3257f6d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:30.781914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a8839f5-85aa-453c-99de-daabb3257f6d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:30.781914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a8839f5-85aa-453c-99de-daabb3257f6d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:30.781914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a8839f5-85aa-453c-99de-daabb3257f6d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:30.786440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a8839f5-85aa-453c-99de-daabb3257f6d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:30.787005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a8839f5-85aa-453c-99de-daabb3257f6d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:30.794370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a8839f5-85aa-453c-99de-daabb3257f6d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:30.794370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:30.890271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:30.900834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:30.902410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:30.903611 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b410eb04-288f-4608-895c-9677bc79a7fc tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1292 microversion: 2.25 time: 0.585796 Oct 11 04:18:30.914856 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1005/2089] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:30 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1292 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:30.923476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-54fb1ca6-d9fb-4513-a2ce-70725ab64f03 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:30.932496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-54fb1ca6-d9fb-4513-a2ce-70725ab64f03 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:30.945504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54fb1ca6-d9fb-4513-a2ce-70725ab64f03 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:30.956841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54fb1ca6-d9fb-4513-a2ce-70725ab64f03 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:30.962873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54fb1ca6-d9fb-4513-a2ce-70725ab64f03 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:30.962873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54fb1ca6-d9fb-4513-a2ce-70725ab64f03 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:30.962873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54fb1ca6-d9fb-4513-a2ce-70725ab64f03 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:30.962873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54fb1ca6-d9fb-4513-a2ce-70725ab64f03 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:31.093574 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8a8839f5-85aa-453c-99de-daabb3257f6d tempest-ServersOnMultiNodesTest-1276810709 tempest-ServersOnMultiNodesTest-1276810709-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1617 microversion: 2.1 time: 0.335656 Oct 11 04:18:31.094793 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1085/2090] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:30 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1617 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:31.122629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef3b501f-442a-4d5d-8eff-adb6ce7502e8 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:31.123131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef3b501f-442a-4d5d-8eff-adb6ce7502e8 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:31.130353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3b501f-442a-4d5d-8eff-adb6ce7502e8 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:31.130838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3b501f-442a-4d5d-8eff-adb6ce7502e8 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:31.131470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3b501f-442a-4d5d-8eff-adb6ce7502e8 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:31.132172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3b501f-442a-4d5d-8eff-adb6ce7502e8 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:31.132705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3b501f-442a-4d5d-8eff-adb6ce7502e8 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:31.133123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3b501f-442a-4d5d-8eff-adb6ce7502e8 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:31.165379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef3b501f-442a-4d5d-8eff-adb6ce7502e8 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:18:31.752448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef3b501f-442a-4d5d-8eff-adb6ce7502e8 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 204 len: 0 microversion: 2.1 time: 0.628628 Oct 11 04:18:31.752448 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1086/2091] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:18:31 2022] DELETE /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:18:31.756077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:31.756783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:31.769265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:31.769754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:31.770222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:31.770957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:31.771424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:31.771846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:31.807778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-54fb1ca6-d9fb-4513-a2ce-70725ab64f03 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:31.822151 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-54fb1ca6-d9fb-4513-a2ce-70725ab64f03 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1334 microversion: 2.1 time: 0.897102 Oct 11 04:18:31.822894 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1006/2092] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:30 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1334 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:31.833125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce8b3e24-3993-4639-bcb9-5d55e886b9c1 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1e0c4dc0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:31.897674 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce8b3e24-3993-4639-bcb9-5d55e886b9c1 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 200 len: 1452 microversion: 2.1 time: 0.073425 Oct 11 04:18:31.898897 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1007/2093] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:18:31 2022] GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:31.911511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:31.929130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:31.935578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:31.936810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9d83a980-2f1d-48ac-b494-5ab37d774d00 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:31.937727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9d83a980-2f1d-48ac-b494-5ab37d774d00 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:31.943504 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0d96a011-77e1-48cd-90f0-c8fd15318399 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.194211 Oct 11 04:18:31.944116 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1087/2094] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:31 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:31.948879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d83a980-2f1d-48ac-b494-5ab37d774d00 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:31.950231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d83a980-2f1d-48ac-b494-5ab37d774d00 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:31.952453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d83a980-2f1d-48ac-b494-5ab37d774d00 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:31.954377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d83a980-2f1d-48ac-b494-5ab37d774d00 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:31.954377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d83a980-2f1d-48ac-b494-5ab37d774d00 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:31.954377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d83a980-2f1d-48ac-b494-5ab37d774d00 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:31.958774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:31.959392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:31.969878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:31.970651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:31.971192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:31.972362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:31.972918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:31.973847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:32.224383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9d83a980-2f1d-48ac-b494-5ab37d774d00 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:32.227657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:32.233221 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9d83a980-2f1d-48ac-b494-5ab37d774d00 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1472 microversion: 2.1 time: 0.333081 Oct 11 04:18:32.234755 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1008/2095] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:31 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1472 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:32.236575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:32.238019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:32.239188 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0c3bc670-3392-4327-817a-e2c95c46cefb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1292 microversion: 2.25 time: 0.294202 Oct 11 04:18:32.239731 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1088/2096] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:31 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1292 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:32.427476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b89bcab-1386-40cd-a8b4-a975feec7431 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Action: 'create', calling method: .version_select at 0x7fda194461f0>, body: {"keypair": {"name": "tempest-keypair-1756943681", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpn+J1j6jxsPP8AQHUBBWTxkWZB3VBi6Cv5X1uuuiy1RoSPzs9n52d+mOBzCnI8Fxt9BrGu6zoqC0xBqDeUddEEY2xSxYtY1yGp+1KU+U/u84sMuxh1MoQ26e1f9alLUw=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:32.443295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-2b89bcab-1386-40cd-a8b4-a975feec7431 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Getting quotas for project a6a0c312aeff4ec2a9ca6d62d8e8f094. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:18:32.450690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-2b89bcab-1386-40cd-a8b4-a975feec7431 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Getting quotas for user 57f84e9b7d8d4f54821b258152a91b43 and project a6a0c312aeff4ec2a9ca6d62d8e8f094. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:18:32.560836 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b89bcab-1386-40cd-a8b4-a975feec7431 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.260130 Oct 11 04:18:32.576022 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1009/2097] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:18:32 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:32.775306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c9653359-a790-4f8e-87a3-41bacda96174 req-e4f1462b-b1ca-43e2-b574-083ce3157eeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61736a99-889e-47c3-a550-c4d48a359d38", "tag": "f5dd1ecd-f19a-4800-b863-7e7cfe9bc66c"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:32.785133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c9653359-a790-4f8e-87a3-41bacda96174 req-e4f1462b-b1ca-43e2-b574-083ce3157eeb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:32.786119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c9653359-a790-4f8e-87a3-41bacda96174 req-e4f1462b-b1ca-43e2-b574-083ce3157eeb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:32.786755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c9653359-a790-4f8e-87a3-41bacda96174 req-e4f1462b-b1ca-43e2-b574-083ce3157eeb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:32.801013 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c9653359-a790-4f8e-87a3-41bacda96174 req-e4f1462b-b1ca-43e2-b574-083ce3157eeb service nova] Creating event network-changed:f5dd1ecd-f19a-4800-b863-7e7cfe9bc66c for instance 61736a99-889e-47c3-a550-c4d48a359d38 on n-h1-860892-1 Oct 11 04:18:32.807539 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c9653359-a790-4f8e-87a3-41bacda96174 req-e4f1462b-b1ca-43e2-b574-083ce3157eeb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035980 Oct 11 04:18:32.808678 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1089/2098] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:32.845531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e385f240-a425-4a3a-a9ed-65e8f31962d0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:32.847061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e385f240-a425-4a3a-a9ed-65e8f31962d0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:32.859898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e385f240-a425-4a3a-a9ed-65e8f31962d0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:32.860399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e385f240-a425-4a3a-a9ed-65e8f31962d0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:32.860840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e385f240-a425-4a3a-a9ed-65e8f31962d0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:32.866043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e385f240-a425-4a3a-a9ed-65e8f31962d0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:32.866584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e385f240-a425-4a3a-a9ed-65e8f31962d0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:32.867597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e385f240-a425-4a3a-a9ed-65e8f31962d0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:32.915391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7a72cc5e-a806-4ef3-b65c-baac5614d902 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1dfdf280>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:32.982569 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7a72cc5e-a806-4ef3-b65c-baac5614d902 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 200 len: 1452 microversion: 2.1 time: 0.071441 Oct 11 04:18:32.983177 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1090/2099] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:18:32 2022] GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 1452 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:33.000621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:33.002639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:33.014774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:33.015325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:33.015767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:33.016512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:33.017068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:33.017370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:33.095714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e385f240-a425-4a3a-a9ed-65e8f31962d0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:33.105959 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e385f240-a425-4a3a-a9ed-65e8f31962d0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.264745 Oct 11 04:18:33.107023 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1010/2100] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:32 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:33.126064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:33.140177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:33.141749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:33.151344 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4d5374fe-34a0-4c88-ad7e-04251d6a2d28 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.166236 Oct 11 04:18:33.153137 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1091/2101] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:32 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:33.257122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2e34726e-3c79-4ae3-b469-d04366be9656 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:33.258148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2e34726e-3c79-4ae3-b469-d04366be9656 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:33.264046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:33.268587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:33.274091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:33.274599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:33.275360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:33.275572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e34726e-3c79-4ae3-b469-d04366be9656 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:33.276058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:33.276338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e34726e-3c79-4ae3-b469-d04366be9656 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:33.276510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:33.276933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:33.277053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e34726e-3c79-4ae3-b469-d04366be9656 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:33.277870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e34726e-3c79-4ae3-b469-d04366be9656 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:33.278530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e34726e-3c79-4ae3-b469-d04366be9656 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:33.279085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e34726e-3c79-4ae3-b469-d04366be9656 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:33.433520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2e34726e-3c79-4ae3-b469-d04366be9656 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:33.444858 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2e34726e-3c79-4ae3-b469-d04366be9656 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1472 microversion: 2.1 time: 0.191539 Oct 11 04:18:33.449221 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1011/2102] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:33 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1472 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:33.471110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:33.484309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:33.486485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:33.487243 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2ef9790c-29dc-41d5-a2b6-5691013ca5c2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1280 microversion: 2.25 time: 0.227077 Oct 11 04:18:33.499106 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1092/2103] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:33 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1280 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:33.998455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-569fbab9-5d77-4e57-bf45-ce2143e947e0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda199b41f0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:34.069619 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-569fbab9-5d77-4e57-bf45-ce2143e947e0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 200 len: 1452 microversion: 2.1 time: 0.073908 Oct 11 04:18:34.069619 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1012/2104] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:18:33 2022] GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 1452 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:34.132542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7908d526-8a1a-4966-9ac0-a80975582a01 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:34.133251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7908d526-8a1a-4966-9ac0-a80975582a01 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:34.145672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7908d526-8a1a-4966-9ac0-a80975582a01 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:34.146433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7908d526-8a1a-4966-9ac0-a80975582a01 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:34.147120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7908d526-8a1a-4966-9ac0-a80975582a01 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:34.148621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7908d526-8a1a-4966-9ac0-a80975582a01 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:34.149326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7908d526-8a1a-4966-9ac0-a80975582a01 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:34.150075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7908d526-8a1a-4966-9ac0-a80975582a01 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:34.182478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:34.183418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:34.198975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:34.200498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:34.203637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:34.207571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:34.208298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:34.209086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:34.298837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:34.318238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:34.320419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:34.326510 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d483c7d5-0989-4303-a2fd-7d824861839b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.150598 Oct 11 04:18:34.327382 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1013/2105] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:34 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:34.446645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7908d526-8a1a-4966-9ac0-a80975582a01 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:34.457150 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7908d526-8a1a-4966-9ac0-a80975582a01 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.329014 Oct 11 04:18:34.458052 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1093/2106] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:34 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:34.475226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-725a208d-0489-4fde-87e7-a0341414e7fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:34.475963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-725a208d-0489-4fde-87e7-a0341414e7fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:34.494864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-725a208d-0489-4fde-87e7-a0341414e7fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:34.494864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-725a208d-0489-4fde-87e7-a0341414e7fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:34.496333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-725a208d-0489-4fde-87e7-a0341414e7fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:34.497064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-725a208d-0489-4fde-87e7-a0341414e7fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:34.497777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-725a208d-0489-4fde-87e7-a0341414e7fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:34.498508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-725a208d-0489-4fde-87e7-a0341414e7fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:34.512919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:34.513934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:34.522065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:34.524396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:34.526138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:34.527247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:34.529231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:34.530660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:34.712347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-725a208d-0489-4fde-87e7-a0341414e7fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:34.743437 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-725a208d-0489-4fde-87e7-a0341414e7fe tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1430 microversion: 2.1 time: 0.272099 Oct 11 04:18:34.744337 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1014/2107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:34 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1430 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:34.954457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-db9f99dc-be99-426e-9dab-e5b753f1845a req-b4e27a7f-96cf-4e16-b3d0-4908834fcbee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07ea3eea-d4bc-410e-904b-78a7d9db6df3", "name": "network-vif-deleted", "tag": "60d40530-cc0b-4eee-a401-3edf071c8c91"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:34.980037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-db9f99dc-be99-426e-9dab-e5b753f1845a req-b4e27a7f-96cf-4e16-b3d0-4908834fcbee service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:34.981027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-db9f99dc-be99-426e-9dab-e5b753f1845a req-b4e27a7f-96cf-4e16-b3d0-4908834fcbee service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:34.982331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-db9f99dc-be99-426e-9dab-e5b753f1845a req-b4e27a7f-96cf-4e16-b3d0-4908834fcbee service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:35.007055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:35.009757 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-db9f99dc-be99-426e-9dab-e5b753f1845a req-b4e27a7f-96cf-4e16-b3d0-4908834fcbee service nova] Creating event network-vif-deleted:60d40530-cc0b-4eee-a401-3edf071c8c91 for instance 07ea3eea-d4bc-410e-904b-78a7d9db6df3 on n-h2-860892-1 Oct 11 04:18:35.020211 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-db9f99dc-be99-426e-9dab-e5b753f1845a req-b4e27a7f-96cf-4e16-b3d0-4908834fcbee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065995 Oct 11 04:18:35.022679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:35.025285 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1015/2108] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:35.031745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:35.033361 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-71b0abcf-a834-48cf-bcb8-6c10bbc3ad79 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1280 microversion: 2.25 time: 0.524252 Oct 11 04:18:35.034547 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1094/2109] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:34 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1280 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:35.085843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68b860dd-e153-45bd-8748-46bb6847238f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda193f9b80>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:35.204238 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68b860dd-e153-45bd-8748-46bb6847238f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 200 len: 1452 microversion: 2.1 time: 0.124040 Oct 11 04:18:35.206762 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1016/2110] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:18:35 2022] GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 1452 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:35.357722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:35.358733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:35.369001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:35.370387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:35.371028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:35.371969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:35.372609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:35.379220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-af598027-0a21-4c68-977c-a3ed88970e9e req-f3e1fb0f-3d99-4dd8-ba0e-3d59e8da5137 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61736a99-889e-47c3-a550-c4d48a359d38", "tag": "7b0473ce-6e96-4d38-a5fb-767e4cf4c5b4"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:35.384107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:35.412905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af598027-0a21-4c68-977c-a3ed88970e9e req-f3e1fb0f-3d99-4dd8-ba0e-3d59e8da5137 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:35.414670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af598027-0a21-4c68-977c-a3ed88970e9e req-f3e1fb0f-3d99-4dd8-ba0e-3d59e8da5137 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:35.415819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af598027-0a21-4c68-977c-a3ed88970e9e req-f3e1fb0f-3d99-4dd8-ba0e-3d59e8da5137 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:35.460068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-af598027-0a21-4c68-977c-a3ed88970e9e req-f3e1fb0f-3d99-4dd8-ba0e-3d59e8da5137 service nova] Creating event network-changed:7b0473ce-6e96-4d38-a5fb-767e4cf4c5b4 for instance 61736a99-889e-47c3-a550-c4d48a359d38 on n-h1-860892-1 Oct 11 04:18:35.491636 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-af598027-0a21-4c68-977c-a3ed88970e9e req-f3e1fb0f-3d99-4dd8-ba0e-3d59e8da5137 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091259 Oct 11 04:18:35.497083 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1017/2111] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:35.511479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:35.512964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2bcdbd23-3ad3-4abd-bc19-f5b8a575b2f3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:35.515219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2bcdbd23-3ad3-4abd-bc19-f5b8a575b2f3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:35.531555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:35.538973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bcdbd23-3ad3-4abd-bc19-f5b8a575b2f3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:35.538973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bcdbd23-3ad3-4abd-bc19-f5b8a575b2f3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:35.538973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bcdbd23-3ad3-4abd-bc19-f5b8a575b2f3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:35.539309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:35.539971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bcdbd23-3ad3-4abd-bc19-f5b8a575b2f3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:35.540552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bcdbd23-3ad3-4abd-bc19-f5b8a575b2f3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:35.541288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bcdbd23-3ad3-4abd-bc19-f5b8a575b2f3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:35.552996 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-92b94c31-f425-4648-a2c7-95d9f092e6cc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.200347 Oct 11 04:18:35.573511 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1095/2112] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:35 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:35.770122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:35.770958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:35.792580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:35.794317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:35.794996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:35.800503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:35.801019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:35.803873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:35.912155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:35.912721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:35.913155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:35.913637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lazy-loading 'fault' on Instance uuid 07ea3eea-d4bc-410e-904b-78a7d9db6df3 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:18:36.086950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:36.099204 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-491d6f5f-348e-4823-91b0-440b25d588b0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 200 len: 1306 microversion: 2.1 time: 0.334245 Oct 11 04:18:36.102387 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1096/2113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:35 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 1306 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:36.112986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:36.115718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:36.136007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:36.138579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:36.140754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:36.144661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:36.146791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:36.147412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:36.197451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2bcdbd23-3ad3-4abd-bc19-f5b8a575b2f3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:36.238031 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2bcdbd23-3ad3-4abd-bc19-f5b8a575b2f3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.734721 Oct 11 04:18:36.239011 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1018/2114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:35 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:36.249725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5f5679f2-d7b4-4baf-88af-9bcb73fc5261 req-70875603-cc44-4ba8-b41b-6d505cdff4e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaae530-25a0-46f6-9df0-bb21d130a0f7", "name": "network-vif-plugged", "status": "completed", "tag": "39669b5c-b616-41c2-a28c-282c3da17d8d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:36.284939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5f5679f2-d7b4-4baf-88af-9bcb73fc5261 req-70875603-cc44-4ba8-b41b-6d505cdff4e6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:36.286951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5f5679f2-d7b4-4baf-88af-9bcb73fc5261 req-70875603-cc44-4ba8-b41b-6d505cdff4e6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:36.287828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5f5679f2-d7b4-4baf-88af-9bcb73fc5261 req-70875603-cc44-4ba8-b41b-6d505cdff4e6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:36.335198 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5f5679f2-d7b4-4baf-88af-9bcb73fc5261 req-70875603-cc44-4ba8-b41b-6d505cdff4e6 service nova] Creating event network-vif-plugged:39669b5c-b616-41c2-a28c-282c3da17d8d for instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 on n-h2-860892-1 Oct 11 04:18:36.341941 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5f5679f2-d7b4-4baf-88af-9bcb73fc5261 req-70875603-cc44-4ba8-b41b-6d505cdff4e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101418 Oct 11 04:18:36.342805 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1019/2115] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:36.348619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e4c45aa-2ba1-4987-8973-f3fcae284e60 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1df42550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:36.419332 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4e4c45aa-2ba1-4987-8973-f3fcae284e60 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 200 len: 1452 microversion: 2.1 time: 0.074996 Oct 11 04:18:36.420379 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1020/2116] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:18:36 2022] GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 1452 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:36.449197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:36.458115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:36.464959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:36.466409 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d18354b-52ff-4c7a-8e5e-7662a4958e0d tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1280 microversion: 2.25 time: 0.362681 Oct 11 04:18:36.469592 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1097/2117] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:36 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1280 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:36.584637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:36.585481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:36.609844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:36.610436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:36.610945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:36.616130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:36.616236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:36.617241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:36.811494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:36.820974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:36.825499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:36.839839 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef6828e6-55fb-4dbe-84f6-deba90441d40 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.255350 Oct 11 04:18:36.850418 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1021/2118] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:36 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:37.127339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:37.128203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 07ea3eea-d4bc-410e-904b-78a7d9db6df3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:37.137099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.139944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.141236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:37.142860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.145941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.148438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:37.166527 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] HTTP exception thrown: Instance 07ea3eea-d4bc-410e-904b-78a7d9db6df3 could not be found. Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Request method failure captured: Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 HTTP/1.1 Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO3xJXCBhEGz9pquTeHR3Z4uPzScU9Bl2FfbCNjHEtjlF80EOUSHIxN0oNgNxYRHiHvNBPZ-LEU09Z_ToTUzi6jAb29jy8QXDKpNRY9vBfE3J97u5PqmcxSvRwRtzleSINQtHli-jTadjh2DKl2QS3gYb5ZfaH6limXNvfwfaps0JgA Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}] Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: db33edccb2504185928613257e64cdb4 Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 07ea3eea-d4bc-410e-904b-78a7d9db6df3 could not be found. Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '07ea3eea-d4bc-410e-904b-78a7d9db6df3'} Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07ea3eea-d4bc-410e-904b-78a7d9db6df3 could not be found. Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07ea3eea-d4bc-410e-904b-78a7d9db6df3 could not be found. Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:18:37.168803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:37.173762 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:37.173762 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:18:37.173762 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:18:37.173762 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:18:37.173762 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:18:37.173762 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07ea3eea-d4bc-410e-904b-78a7d9db6df3 could not be found. Oct 11 04:18:37.173762 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:37.176523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Returning 404 to user: Instance 07ea3eea-d4bc-410e-904b-78a7d9db6df3 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:18:37.176899 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d2c0040b-fd8f-4009-bec3-932a5ee26ec5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3" status: 404 len: 111 microversion: 2.1 time: 0.053303 Oct 11 04:18:37.178804 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1098/2119] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:37 2022] GET /compute/v2.1/servers/07ea3eea-d4bc-410e-904b-78a7d9db6df3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:18:37.186766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-47342b27-9559-440c-b1af-839878a36a45 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:37.187541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-47342b27-9559-440c-b1af-839878a36a45 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:37.193732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47342b27-9559-440c-b1af-839878a36a45 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.194245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47342b27-9559-440c-b1af-839878a36a45 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.195208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47342b27-9559-440c-b1af-839878a36a45 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:37.198836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47342b27-9559-440c-b1af-839878a36a45 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.199425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47342b27-9559-440c-b1af-839878a36a45 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.200803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47342b27-9559-440c-b1af-839878a36a45 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:37.265792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cd4280c9-0ee5-485c-880a-c44c698b338e tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:37.266436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cd4280c9-0ee5-485c-880a-c44c698b338e tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:37.278853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd4280c9-0ee5-485c-880a-c44c698b338e tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.279927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd4280c9-0ee5-485c-880a-c44c698b338e tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.280777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd4280c9-0ee5-485c-880a-c44c698b338e tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:37.281697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd4280c9-0ee5-485c-880a-c44c698b338e tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.282166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd4280c9-0ee5-485c-880a-c44c698b338e tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.282675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd4280c9-0ee5-485c-880a-c44c698b338e tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:37.287939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-47342b27-9559-440c-b1af-839878a36a45 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:18:37.357759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:37.524627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cd4280c9-0ee5-485c-880a-c44c698b338e tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:37.539438 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cd4280c9-0ee5-485c-880a-c44c698b338e tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.276995 Oct 11 04:18:37.555771 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1099/2120] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:37 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:37.562345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-16107810-78ae-41f7-8006-3ead8461b151 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda194b1430>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:37.638754 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-16107810-78ae-41f7-8006-3ead8461b151 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 200 len: 1452 microversion: 2.1 time: 0.081339 Oct 11 04:18:37.648592 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1100/2121] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:18:37 2022] GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 1452 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:37.648592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:37.648592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:37.656883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.657820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.658674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:37.659870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.660818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.661580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:37.753105 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-47342b27-9559-440c-b1af-839878a36a45 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 204 len: 0 microversion: 2.1 time: 0.568439 Oct 11 04:18:37.755913 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1022/2122] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:18:37 2022] DELETE /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:18:37.764677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-88908a1a-a7d4-4d1d-b770-7c9418ddba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:37.765657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-88908a1a-a7d4-4d1d-b770-7c9418ddba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:37.775809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88908a1a-a7d4-4d1d-b770-7c9418ddba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.778828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88908a1a-a7d4-4d1d-b770-7c9418ddba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.787935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88908a1a-a7d4-4d1d-b770-7c9418ddba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:37.787935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88908a1a-a7d4-4d1d-b770-7c9418ddba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.787935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88908a1a-a7d4-4d1d-b770-7c9418ddba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.787935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88908a1a-a7d4-4d1d-b770-7c9418ddba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:37.879935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:37.896344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:37.898564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:37.915338 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-42a05be7-dee8-4b54-b58e-f16dbbd43dc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1280 microversion: 2.25 time: 0.271069 Oct 11 04:18:37.915338 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1101/2123] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:37 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1280 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:37.918976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:37.919591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:37.951354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.951354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.951725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:37.960565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:37.963012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:37.963670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:38.062496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:38.081023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:38.083492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:38.091426 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-89cb3ca0-e0b8-453f-a612-af7422336885 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1554 microversion: 2.91 time: 0.176159 Oct 11 04:18:38.111237 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1102/2124] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:37 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:38.169752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-88908a1a-a7d4-4d1d-b770-7c9418ddba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:38.176850 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-88908a1a-a7d4-4d1d-b770-7c9418ddba6f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1472 microversion: 2.1 time: 0.417034 Oct 11 04:18:38.197524 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1023/2125] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:37 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1472 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:38.308054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Action: 'create', calling method: >, body: {"server": {"name": "guest-instance-1.domain.com", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "accessIPv4": "2.2.2.2", "networks": [{"uuid": "0eda684f-23fe-46c3-ad0b-9b5f3ed7e4cc"}], "security_groups": [{"name": "tempest-securitygroup--1316722072"}], "key_name": "tempest-keypair-1756943681", "user_data": "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:38.365596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e5489379-c89f-4d4b-a062-5d52a34e73c4 req-17e50cd6-6048-4366-aac4-08809ec65ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61736a99-889e-47c3-a550-c4d48a359d38", "tag": "9cc3530c-ee2c-44b8-8d71-a9d5d999dfd1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:38.375822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e5489379-c89f-4d4b-a062-5d52a34e73c4 req-17e50cd6-6048-4366-aac4-08809ec65ff0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:38.376870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e5489379-c89f-4d4b-a062-5d52a34e73c4 req-17e50cd6-6048-4366-aac4-08809ec65ff0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:38.377316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e5489379-c89f-4d4b-a062-5d52a34e73c4 req-17e50cd6-6048-4366-aac4-08809ec65ff0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:38.394010 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e5489379-c89f-4d4b-a062-5d52a34e73c4 req-17e50cd6-6048-4366-aac4-08809ec65ff0 service nova] Creating event network-changed:9cc3530c-ee2c-44b8-8d71-a9d5d999dfd1 for instance 61736a99-889e-47c3-a550-c4d48a359d38 on n-h1-860892-1 Oct 11 04:18:38.399652 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e5489379-c89f-4d4b-a062-5d52a34e73c4 req-17e50cd6-6048-4366-aac4-08809ec65ff0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038164 Oct 11 04:18:38.400580 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1024/2126] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:18:38.411997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] validate_networks() for [('0eda684f-23fe-46c3-ad0b-9b5f3ed7e4cc', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:18:38.572860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ab31430b-dbd6-4ba4-86a7-b28b09690f18 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:38.573720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ab31430b-dbd6-4ba4-86a7-b28b09690f18 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:38.590428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab31430b-dbd6-4ba4-86a7-b28b09690f18 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:38.602368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab31430b-dbd6-4ba4-86a7-b28b09690f18 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:38.602368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab31430b-dbd6-4ba4-86a7-b28b09690f18 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:38.602368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab31430b-dbd6-4ba4-86a7-b28b09690f18 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:38.602368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab31430b-dbd6-4ba4-86a7-b28b09690f18 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:38.602368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab31430b-dbd6-4ba4-86a7-b28b09690f18 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:38.782618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab31430b-dbd6-4ba4-86a7-b28b09690f18 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:38.793225 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ab31430b-dbd6-4ba4-86a7-b28b09690f18 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.226799 Oct 11 04:18:38.794387 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1025/2127] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:38 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:38.799413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ea607d5-f426-404e-90df-3e326911bf07 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19446700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:38.871981 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ea607d5-f426-404e-90df-3e326911bf07 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 200 len: 1452 microversion: 2.1 time: 0.076288 Oct 11 04:18:38.872816 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1026/2128] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:18:38 2022] GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 1452 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:38.939046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:38.943275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:38.964467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:38.965092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:38.965624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:38.967900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:38.968486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:38.969453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:38.976355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:18:38.976819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:18:38.977582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:18:38.978156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:18:38.978713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:18:38.990237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:38.990906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:38.992333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:38.993295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:38.993939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:38.998942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:39.015338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:39.027747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Getting quotas for project a6a0c312aeff4ec2a9ca6d62d8e8f094. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:18:39.034605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Getting quotas for user 57f84e9b7d8d4f54821b258152a91b43 and project a6a0c312aeff4ec2a9ca6d62d8e8f094. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:18:39.057229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:18:39.060146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:18:39.172373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:39.182998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:39.185070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:39.186843 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b9f599b9-2fe2-4e6a-b232-5cd3956573ac tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1280 microversion: 2.25 time: 0.253310 Oct 11 04:18:39.199013 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1027/2129] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:38 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1280 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:39.217939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:39.220062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:39.228570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:39.232295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:39.232295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:39.232295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:39.232295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:39.232295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:39.322151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:39.331333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:39.333898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:39.355509 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-746d2467-8821-47f3-b9e3-efbfb1cb45cb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.139912 Oct 11 04:18:39.356171 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1028/2130] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:39 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:39.365104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3781f0a1-7061-4ede-a621-f57d341c1f70 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:39.365841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3781f0a1-7061-4ede-a621-f57d341c1f70 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:39.369171 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fe3eb086-17b1-4a93-bcb1-27513cb61581 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.066044 Oct 11 04:18:39.370434 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1103/2131] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:18:38 2022] POST /compute/v2.1/servers => generated 409 bytes in 1068 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:18:39.379088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3781f0a1-7061-4ede-a621-f57d341c1f70 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:39.379913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3781f0a1-7061-4ede-a621-f57d341c1f70 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:39.380578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3781f0a1-7061-4ede-a621-f57d341c1f70 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:39.381737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3781f0a1-7061-4ede-a621-f57d341c1f70 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:39.382557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-58fef4df-b74f-4fa7-994b-520f52385dd6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:39.383173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-58fef4df-b74f-4fa7-994b-520f52385dd6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:39.387193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3781f0a1-7061-4ede-a621-f57d341c1f70 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:39.389469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3781f0a1-7061-4ede-a621-f57d341c1f70 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:39.561766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-58fef4df-b74f-4fa7-994b-520f52385dd6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:39.572665 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-58fef4df-b74f-4fa7-994b-520f52385dd6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1226 microversion: 2.1 time: 0.193140 Oct 11 04:18:39.575269 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1104/2132] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:39 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1226 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:39.580331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3781f0a1-7061-4ede-a621-f57d341c1f70 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:39.589003 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3781f0a1-7061-4ede-a621-f57d341c1f70 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1472 microversion: 2.1 time: 0.231559 Oct 11 04:18:39.590492 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1029/2133] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:39 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1472 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:39.820342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0cf1e48f-c6e5-4145-8576-0851b36bec16 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:39.821353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0cf1e48f-c6e5-4145-8576-0851b36bec16 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:39.838002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf1e48f-c6e5-4145-8576-0851b36bec16 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:39.838828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf1e48f-c6e5-4145-8576-0851b36bec16 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:39.839276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf1e48f-c6e5-4145-8576-0851b36bec16 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:39.843661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf1e48f-c6e5-4145-8576-0851b36bec16 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:39.844152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf1e48f-c6e5-4145-8576-0851b36bec16 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:39.847057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf1e48f-c6e5-4145-8576-0851b36bec16 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:39.889329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0ecbbeb6-879c-44da-8150-2c2e718805a6 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19a608b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:40.072705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0cf1e48f-c6e5-4145-8576-0851b36bec16 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:40.091025 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0cf1e48f-c6e5-4145-8576-0851b36bec16 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.268153 Oct 11 04:18:40.113638 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1105/2134] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:39 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:40.215678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:40.216444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:40.223020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:40.223810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:40.224629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:40.225519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:40.226693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:40.227111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:40.655352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:40.664745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:40.668689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:40.685452 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f0e6c4ca-13cb-4a01-a560-b533313093f6 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1280 microversion: 2.25 time: 0.474521 Oct 11 04:18:40.686498 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1106/2135] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:40 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1280 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:18:40.713210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:40.713985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:40.720853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:40.721708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:40.722442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:40.723437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:40.724118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:40.724815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:40.842654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:40.853311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:40.868277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:40.881482 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-767f8b94-0ba5-436c-a298-3ee3f29ae2df tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.193667 Oct 11 04:18:40.882633 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1107/2136] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:40 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:40.917860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27c1f01d-2f3a-4ce7-91c5-e1ede64a7c14 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:40.918144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-27c1f01d-2f3a-4ce7-91c5-e1ede64a7c14 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:41.050830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-27c1f01d-2f3a-4ce7-91c5-e1ede64a7c14 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:41.060450 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-27c1f01d-2f3a-4ce7-91c5-e1ede64a7c14 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1226 microversion: 2.1 time: 0.161190 Oct 11 04:18:41.080434 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1108/2137] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:40 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1226 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:41.088937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8819dc0e-ac22-4938-b048-787e5b787953 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:41.089574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8819dc0e-ac22-4938-b048-787e5b787953 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:41.111285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8819dc0e-ac22-4938-b048-787e5b787953 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:41.113095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8819dc0e-ac22-4938-b048-787e5b787953 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:41.115941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8819dc0e-ac22-4938-b048-787e5b787953 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:41.118563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8819dc0e-ac22-4938-b048-787e5b787953 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:41.119437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8819dc0e-ac22-4938-b048-787e5b787953 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:41.120095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8819dc0e-ac22-4938-b048-787e5b787953 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:41.503138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8819dc0e-ac22-4938-b048-787e5b787953 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:41.537399 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8819dc0e-ac22-4938-b048-787e5b787953 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1472 microversion: 2.1 time: 0.443880 Oct 11 04:18:41.541118 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1109/2138] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:41 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1472 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:41.551190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f72cdfdd-95a8-4042-a6f8-89ece294191c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:41.567816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f72cdfdd-95a8-4042-a6f8-89ece294191c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:41.592604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f72cdfdd-95a8-4042-a6f8-89ece294191c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:41.593127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f72cdfdd-95a8-4042-a6f8-89ece294191c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:41.595556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f72cdfdd-95a8-4042-a6f8-89ece294191c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:41.596365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f72cdfdd-95a8-4042-a6f8-89ece294191c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:41.596841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f72cdfdd-95a8-4042-a6f8-89ece294191c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:41.597295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f72cdfdd-95a8-4042-a6f8-89ece294191c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:42.119809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f72cdfdd-95a8-4042-a6f8-89ece294191c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:42.146283 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f72cdfdd-95a8-4042-a6f8-89ece294191c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.600334 Oct 11 04:18:42.158226 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1110/2139] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:41 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:42.158226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:42.158226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:42.168038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:42.172197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:42.172197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:42.172197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:42.172197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:42.172197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:42.483386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:42.578988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:42.588234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:42.589689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:42.590854 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2aed8f1a-aa0c-4b79-8792-891931008cc4 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1280 microversion: 2.25 time: 0.442224 Oct 11 04:18:42.591678 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1111/2140] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:42 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1280 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:42.604922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2ee3f3c6-748f-47e6-aded-fcccfabbd444 req-8f958a41-beb4-4bfc-8594-896669df0730 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08774d29-93f3-4d89-9b47-1c6fa3a54f25", "name": "network-vif-deleted", "tag": "ee2a41e5-8279-4d39-acb5-4a1ef74b1b9f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:42.630391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ee3f3c6-748f-47e6-aded-fcccfabbd444 req-8f958a41-beb4-4bfc-8594-896669df0730 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:42.630874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ee3f3c6-748f-47e6-aded-fcccfabbd444 req-8f958a41-beb4-4bfc-8594-896669df0730 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:42.631305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ee3f3c6-748f-47e6-aded-fcccfabbd444 req-8f958a41-beb4-4bfc-8594-896669df0730 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:42.682433 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2ee3f3c6-748f-47e6-aded-fcccfabbd444 req-8f958a41-beb4-4bfc-8594-896669df0730 service nova] Creating event network-vif-deleted:ee2a41e5-8279-4d39-acb5-4a1ef74b1b9f for instance 08774d29-93f3-4d89-9b47-1c6fa3a54f25 on n-h1-860892-1 Oct 11 04:18:42.701964 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2ee3f3c6-748f-47e6-aded-fcccfabbd444 req-8f958a41-beb4-4bfc-8594-896669df0730 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100920 Oct 11 04:18:42.710372 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1112/2141] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:42.718685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:42.722437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:42.742812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:42.743992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:42.745166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:42.746108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:42.746748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:42.747369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:42.993571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:43.015125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:43.018664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:43.025260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:43.026968 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e7536334-844d-443f-a957-72c8fbf58125 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.313970 Oct 11 04:18:43.028753 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1113/2142] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:42 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:43.061815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-587bc373-a4da-4efc-9006-19cb18aa39df tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:43.062637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-587bc373-a4da-4efc-9006-19cb18aa39df tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:43.072921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-587bc373-a4da-4efc-9006-19cb18aa39df tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:43.073411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-587bc373-a4da-4efc-9006-19cb18aa39df tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:43.073841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-587bc373-a4da-4efc-9006-19cb18aa39df tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:43.074739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-587bc373-a4da-4efc-9006-19cb18aa39df tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:43.075518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-587bc373-a4da-4efc-9006-19cb18aa39df tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:43.075881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-587bc373-a4da-4efc-9006-19cb18aa39df tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:43.165371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-587bc373-a4da-4efc-9006-19cb18aa39df tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:43.176550 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-587bc373-a4da-4efc-9006-19cb18aa39df tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1278 microversion: 2.1 time: 0.124023 Oct 11 04:18:43.190243 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1114/2143] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:43 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:43.190243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:43.190243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:43.190664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:43.191896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:43.192280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:43.192984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:43.195378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:43.200694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:43.245419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:43.245958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:43.246553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:43.246999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lazy-loading 'fault' on Instance uuid 08774d29-93f3-4d89-9b47-1c6fa3a54f25 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:18:43.316201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:43.328558 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6e17e7d-3bc7-4051-a23f-abbdc9f9e34b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 200 len: 1306 microversion: 2.1 time: 0.149774 Oct 11 04:18:43.344327 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1115/2144] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:43 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 1306 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:43.362581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e938892-8394-4406-adf3-2c72ac4994d6 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:43.364244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e938892-8394-4406-adf3-2c72ac4994d6 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:43.375977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e938892-8394-4406-adf3-2c72ac4994d6 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:43.378722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e938892-8394-4406-adf3-2c72ac4994d6 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:43.380929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e938892-8394-4406-adf3-2c72ac4994d6 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:43.382335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e938892-8394-4406-adf3-2c72ac4994d6 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:43.384130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e938892-8394-4406-adf3-2c72ac4994d6 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:43.385164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e938892-8394-4406-adf3-2c72ac4994d6 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:43.702561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e938892-8394-4406-adf3-2c72ac4994d6 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:43.716531 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e938892-8394-4406-adf3-2c72ac4994d6 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.379290 Oct 11 04:18:43.717350 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1116/2145] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:43 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:43.733068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:43.733739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:43.740231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:43.740727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:43.741169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:43.742440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:43.742895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:43.743324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:44.082288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:44.101499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:44.102735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:44.103871 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-32b6e257-ec4f-4a2f-9131-9b7541469e56 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1280 microversion: 2.25 time: 0.385259 Oct 11 04:18:44.104746 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1117/2146] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:43 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1280 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:44.109664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:44.128944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:44.145491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:44.145983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:44.146460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:44.147201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:44.147726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:44.148200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:44.519623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:44.551057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:44.557252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:44.578751 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dcb51763-6c6f-4b7e-bfe7-b4c013aee4e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.472512 Oct 11 04:18:44.595554 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1118/2147] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:44 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:44.612402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb4a0ce6-4221-42a6-a2a5-b1c7e3845461 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:44.613043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bb4a0ce6-4221-42a6-a2a5-b1c7e3845461 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:44.622124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb4a0ce6-4221-42a6-a2a5-b1c7e3845461 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:44.622632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb4a0ce6-4221-42a6-a2a5-b1c7e3845461 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:44.623066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb4a0ce6-4221-42a6-a2a5-b1c7e3845461 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:44.623764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb4a0ce6-4221-42a6-a2a5-b1c7e3845461 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:44.624211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb4a0ce6-4221-42a6-a2a5-b1c7e3845461 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:44.624626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb4a0ce6-4221-42a6-a2a5-b1c7e3845461 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:44.780768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb4a0ce6-4221-42a6-a2a5-b1c7e3845461 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:44.793102 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb4a0ce6-4221-42a6-a2a5-b1c7e3845461 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1296 microversion: 2.1 time: 0.196499 Oct 11 04:18:44.810338 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1119/2148] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:44 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1296 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:44.810977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:44.812146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 08774d29-93f3-4d89-9b47-1c6fa3a54f25] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:44.846154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:44.846701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:44.855745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:44.855745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:44.855745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:44.855745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:44.899955 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] HTTP exception thrown: Instance 08774d29-93f3-4d89-9b47-1c6fa3a54f25 could not be found. Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Request method failure captured: Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 HTTP/1.1 Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO3xJXCBhEGz9pquTeHR3Z4uPzScU9Bl2FfbCNjHEtjlF80EOUSHIxN0oNgNxYRHiHvNBPZ-LEU09Z_ToTUzi6jAb29jy8QXDKpNRY9vBfE3J97u5PqmcxSvRwRtzleSINQtHli-jTadjh2DKl2QS3gYb5ZfaH6limXNvfwfaps0JgA Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}] Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: db33edccb2504185928613257e64cdb4 Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 08774d29-93f3-4d89-9b47-1c6fa3a54f25 could not be found. Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '08774d29-93f3-4d89-9b47-1c6fa3a54f25'} Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08774d29-93f3-4d89-9b47-1c6fa3a54f25 could not be found. Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08774d29-93f3-4d89-9b47-1c6fa3a54f25 could not be found. Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:18:44.901654 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:44.908901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:44.908901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:18:44.908901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:18:44.908901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:18:44.908901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:18:44.908901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08774d29-93f3-4d89-9b47-1c6fa3a54f25 could not be found. Oct 11 04:18:44.908901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:44.908901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Returning 404 to user: Instance 08774d29-93f3-4d89-9b47-1c6fa3a54f25 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:18:44.908901 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-db3edaf2-57e5-48b3-a23e-c4b18f16ff66 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25" status: 404 len: 111 microversion: 2.1 time: 0.103005 Oct 11 04:18:44.918551 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1120/2149] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:44 2022] GET /compute/v2.1/servers/08774d29-93f3-4d89-9b47-1c6fa3a54f25 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:18:44.923462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-83e4a627-0eb1-4c95-9b26-e0bb2680b6be tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:44.924089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-83e4a627-0eb1-4c95-9b26-e0bb2680b6be tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:44.938443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e4a627-0eb1-4c95-9b26-e0bb2680b6be tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:44.938443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e4a627-0eb1-4c95-9b26-e0bb2680b6be tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:44.938934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e4a627-0eb1-4c95-9b26-e0bb2680b6be tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:44.939391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e4a627-0eb1-4c95-9b26-e0bb2680b6be tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:44.939846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e4a627-0eb1-4c95-9b26-e0bb2680b6be tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:44.940272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e4a627-0eb1-4c95-9b26-e0bb2680b6be tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:45.285012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-83e4a627-0eb1-4c95-9b26-e0bb2680b6be tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:45.310335 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-83e4a627-0eb1-4c95-9b26-e0bb2680b6be tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.390508 Oct 11 04:18:45.311448 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1121/2150] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:44 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:45.338420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9885014b-ee9f-4cdf-a84f-b23e3df1a01d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:45.457521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9885014b-ee9f-4cdf-a84f-b23e3df1a01d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:45.457521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9885014b-ee9f-4cdf-a84f-b23e3df1a01d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:45.457521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9885014b-ee9f-4cdf-a84f-b23e3df1a01d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:45.457521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9885014b-ee9f-4cdf-a84f-b23e3df1a01d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:45.457521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9885014b-ee9f-4cdf-a84f-b23e3df1a01d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:45.457521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9885014b-ee9f-4cdf-a84f-b23e3df1a01d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:45.457521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9885014b-ee9f-4cdf-a84f-b23e3df1a01d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:45.457521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9885014b-ee9f-4cdf-a84f-b23e3df1a01d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:18:45.457521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:45.913758 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9885014b-ee9f-4cdf-a84f-b23e3df1a01d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 204 len: 0 microversion: 2.1 time: 0.584368 Oct 11 04:18:45.914960 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1122/2151] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:18:45 2022] DELETE /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:18:45.981086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:45.982483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:45.989152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:45.989638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:45.990075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:45.990916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:45.992002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:45.993402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:46.199797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:46.208661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:46.211772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:46.212894 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aca29d97-2b8b-4abe-9468-06f24f208d9e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1280 microversion: 2.25 time: 0.296774 Oct 11 04:18:46.213457 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1123/2152] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:45 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1280 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:46.218418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-644182fc-7d2e-46d5-b39c-0c90b77ba272 req-a23f132b-328e-492c-a3c3-412ba086cf40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d993e3f-2858-478c-941e-7d874a4fcb5e", "name": "network-vif-plugged", "status": "completed", "tag": "0d27cdb1-7b14-44cb-b024-b149b4ec43ab"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:46.228838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-644182fc-7d2e-46d5-b39c-0c90b77ba272 req-a23f132b-328e-492c-a3c3-412ba086cf40 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:46.229326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-644182fc-7d2e-46d5-b39c-0c90b77ba272 req-a23f132b-328e-492c-a3c3-412ba086cf40 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:46.229761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-644182fc-7d2e-46d5-b39c-0c90b77ba272 req-a23f132b-328e-492c-a3c3-412ba086cf40 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:46.247033 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-644182fc-7d2e-46d5-b39c-0c90b77ba272 req-a23f132b-328e-492c-a3c3-412ba086cf40 service nova] Creating event network-vif-plugged:0d27cdb1-7b14-44cb-b024-b149b4ec43ab for instance 7d993e3f-2858-478c-941e-7d874a4fcb5e on n-h1-860892-1 Oct 11 04:18:46.252844 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-644182fc-7d2e-46d5-b39c-0c90b77ba272 req-a23f132b-328e-492c-a3c3-412ba086cf40 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038230 Oct 11 04:18:46.254336 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1124/2153] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:46.261539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:46.263605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:46.270915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:46.271473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:46.272070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:46.273441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:46.273977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:46.274437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:46.346808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:46.356271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:46.357999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:46.370613 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-24de0be6-efbc-41d2-8c68-b550221d0f0d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.114437 Oct 11 04:18:46.372546 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1125/2154] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:46 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:46.377295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32de5202-f71f-44a3-b110-c7dae5f2ce7c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:46.377673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-32de5202-f71f-44a3-b110-c7dae5f2ce7c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:46.408635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32de5202-f71f-44a3-b110-c7dae5f2ce7c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:46.408635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32de5202-f71f-44a3-b110-c7dae5f2ce7c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:46.408635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32de5202-f71f-44a3-b110-c7dae5f2ce7c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:46.408635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32de5202-f71f-44a3-b110-c7dae5f2ce7c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:46.408635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32de5202-f71f-44a3-b110-c7dae5f2ce7c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:46.408635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32de5202-f71f-44a3-b110-c7dae5f2ce7c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:47.185615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-32de5202-f71f-44a3-b110-c7dae5f2ce7c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:47.198104 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-32de5202-f71f-44a3-b110-c7dae5f2ce7c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1352 microversion: 2.1 time: 0.824441 Oct 11 04:18:47.210713 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1126/2155] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:46 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1352 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:47.232890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-16f75756-9279-4878-b62f-dc3efcea674e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:47.233521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-16f75756-9279-4878-b62f-dc3efcea674e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:47.239846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16f75756-9279-4878-b62f-dc3efcea674e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:47.240600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16f75756-9279-4878-b62f-dc3efcea674e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:47.241273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16f75756-9279-4878-b62f-dc3efcea674e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:47.253995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16f75756-9279-4878-b62f-dc3efcea674e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:47.266970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16f75756-9279-4878-b62f-dc3efcea674e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:47.267724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16f75756-9279-4878-b62f-dc3efcea674e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:47.599007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-16f75756-9279-4878-b62f-dc3efcea674e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:47.607790 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-16f75756-9279-4878-b62f-dc3efcea674e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1472 microversion: 2.1 time: 0.395939 Oct 11 04:18:47.618944 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1127/2156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:47 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1472 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:47.623984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7b9ebc5c-90b7-4d23-88c0-2265ee1b429d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:47.624788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7b9ebc5c-90b7-4d23-88c0-2265ee1b429d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:47.636943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b9ebc5c-90b7-4d23-88c0-2265ee1b429d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:47.637697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b9ebc5c-90b7-4d23-88c0-2265ee1b429d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:47.641285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b9ebc5c-90b7-4d23-88c0-2265ee1b429d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:47.641285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b9ebc5c-90b7-4d23-88c0-2265ee1b429d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:47.641285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b9ebc5c-90b7-4d23-88c0-2265ee1b429d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:47.641285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b9ebc5c-90b7-4d23-88c0-2265ee1b429d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:47.979309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7b9ebc5c-90b7-4d23-88c0-2265ee1b429d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:48.005626 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7b9ebc5c-90b7-4d23-88c0-2265ee1b429d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.385143 Oct 11 04:18:48.008987 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1128/2157] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:47 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:48.020833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:48.022565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:48.038570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:48.039332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:48.039932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:48.041865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:48.043868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:48.045140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:48.396822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:48.413580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:48.415156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:48.419883 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-776fc7a7-072f-4d6c-b50f-5c4998724ca5 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1280 microversion: 2.25 time: 0.409594 Oct 11 04:18:48.434727 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1129/2158] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:48 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1280 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:48.447841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:48.452508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:48.455953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:48.456498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:48.456933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:48.457637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:48.458144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:48.458619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:48.617934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:48.634118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:48.635731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:48.644842 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a508fa7e-0c18-4428-9156-8589fad530ef tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.209035 Oct 11 04:18:48.662561 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1130/2159] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:48 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:48.672829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-67b9741f-b417-41c4-8f8f-6b4a5adc3af8 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:48.678763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-67b9741f-b417-41c4-8f8f-6b4a5adc3af8 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:48.680404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67b9741f-b417-41c4-8f8f-6b4a5adc3af8 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:48.680893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67b9741f-b417-41c4-8f8f-6b4a5adc3af8 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:48.681323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67b9741f-b417-41c4-8f8f-6b4a5adc3af8 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:48.682163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67b9741f-b417-41c4-8f8f-6b4a5adc3af8 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:48.682809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67b9741f-b417-41c4-8f8f-6b4a5adc3af8 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:48.683229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67b9741f-b417-41c4-8f8f-6b4a5adc3af8 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:48.955617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-67b9741f-b417-41c4-8f8f-6b4a5adc3af8 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:48.967639 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-67b9741f-b417-41c4-8f8f-6b4a5adc3af8 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1352 microversion: 2.1 time: 0.303792 Oct 11 04:18:48.968448 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1131/2160] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:48 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1352 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:49.017129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ce20660-fe99-4403-b49d-db004fef6b62 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:49.017736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3ce20660-fe99-4403-b49d-db004fef6b62 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:49.035190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:49.037061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ce20660-fe99-4403-b49d-db004fef6b62 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:49.038767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ce20660-fe99-4403-b49d-db004fef6b62 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:49.040874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ce20660-fe99-4403-b49d-db004fef6b62 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:49.041864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ce20660-fe99-4403-b49d-db004fef6b62 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:49.044086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ce20660-fe99-4403-b49d-db004fef6b62 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:49.046636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ce20660-fe99-4403-b49d-db004fef6b62 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:49.377208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:49.470932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3ce20660-fe99-4403-b49d-db004fef6b62 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:49.481893 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3ce20660-fe99-4403-b49d-db004fef6b62 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1472 microversion: 2.1 time: 0.494939 Oct 11 04:18:49.490876 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1132/2161] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:48 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1472 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:49.496217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0aaf6a21-07b6-4132-85de-bc6330ca24ca tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:49.496889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0aaf6a21-07b6-4132-85de-bc6330ca24ca tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:49.530472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aaf6a21-07b6-4132-85de-bc6330ca24ca tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:49.533585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aaf6a21-07b6-4132-85de-bc6330ca24ca tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:49.548926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aaf6a21-07b6-4132-85de-bc6330ca24ca tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:49.556173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aaf6a21-07b6-4132-85de-bc6330ca24ca tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:49.556173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aaf6a21-07b6-4132-85de-bc6330ca24ca tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:49.556173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aaf6a21-07b6-4132-85de-bc6330ca24ca tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:49.588522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:50.134772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0aaf6a21-07b6-4132-85de-bc6330ca24ca tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:50.160058 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0aaf6a21-07b6-4132-85de-bc6330ca24ca tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.670092 Oct 11 04:18:50.160803 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1133/2162] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:49 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:50.171826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-38ffe04e-c2d2-442d-aa31-f3f084cded18 req-a5f97a3f-60bb-4bfb-a36b-60cf05a8390a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c20dc0-ffa3-498c-be2b-a8311c1face7", "tag": "32cb4580-f042-48a2-b372-b09a2ba049ab"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:50.218960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-38ffe04e-c2d2-442d-aa31-f3f084cded18 req-a5f97a3f-60bb-4bfb-a36b-60cf05a8390a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:50.219498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-38ffe04e-c2d2-442d-aa31-f3f084cded18 req-a5f97a3f-60bb-4bfb-a36b-60cf05a8390a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:50.222520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-38ffe04e-c2d2-442d-aa31-f3f084cded18 req-a5f97a3f-60bb-4bfb-a36b-60cf05a8390a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:50.264449 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-38ffe04e-c2d2-442d-aa31-f3f084cded18 req-a5f97a3f-60bb-4bfb-a36b-60cf05a8390a service nova] Creating event network-changed:32cb4580-f042-48a2-b372-b09a2ba049ab for instance 88c20dc0-ffa3-498c-be2b-a8311c1face7 on n-h2-860892-1 Oct 11 04:18:50.278934 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-38ffe04e-c2d2-442d-aa31-f3f084cded18 req-a5f97a3f-60bb-4bfb-a36b-60cf05a8390a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110587 Oct 11 04:18:50.281637 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1134/2163] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:50.303358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:50.306453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:50.319399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:50.334086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:50.338079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:50.341068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:50.341555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:50.347355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:50.895712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:50.906100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:50.908451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:50.909856 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d108072-a000-4456-b3ea-af594dda451e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1475 microversion: 2.25 time: 0.626978 Oct 11 04:18:50.914738 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1135/2164] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:50 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1475 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:50.920364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:50.926266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:50.948125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:50.948945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:50.949673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:50.950823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:50.951500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:50.952160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:51.030764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:51.041425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:51.043487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:51.049029 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-55e45659-cb63-4b13-90b4-c4fbd909bae1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.132962 Oct 11 04:18:51.062240 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1136/2165] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:50 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:51.062240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bef25763-8d47-4cdc-ae29-408fcd43ae4d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:51.062240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bef25763-8d47-4cdc-ae29-408fcd43ae4d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:51.073494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=10 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:51.079139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bef25763-8d47-4cdc-ae29-408fcd43ae4d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:51.079807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bef25763-8d47-4cdc-ae29-408fcd43ae4d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:51.081860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bef25763-8d47-4cdc-ae29-408fcd43ae4d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:51.082708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bef25763-8d47-4cdc-ae29-408fcd43ae4d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:51.083325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bef25763-8d47-4cdc-ae29-408fcd43ae4d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:51.083888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bef25763-8d47-4cdc-ae29-408fcd43ae4d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:51.269670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bef25763-8d47-4cdc-ae29-408fcd43ae4d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:51.283183 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bef25763-8d47-4cdc-ae29-408fcd43ae4d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1352 microversion: 2.1 time: 0.227712 Oct 11 04:18:51.283864 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1137/2166] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:51 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1352 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:51.288654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f872afa1-ef9c-4254-9c87-2686adece9ac req-ba6e6a2d-3de9-44b6-a032-b65626c12e2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d9743668-8bc9-4d7e-8a99-c443ee982477", "name": "network-vif-deleted", "tag": "867ccd69-2e5d-4d8e-9eab-bd210ae13cc7"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:51.299022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f872afa1-ef9c-4254-9c87-2686adece9ac req-ba6e6a2d-3de9-44b6-a032-b65626c12e2e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:51.299580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f872afa1-ef9c-4254-9c87-2686adece9ac req-ba6e6a2d-3de9-44b6-a032-b65626c12e2e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:51.300081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f872afa1-ef9c-4254-9c87-2686adece9ac req-ba6e6a2d-3de9-44b6-a032-b65626c12e2e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:51.312015 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-f872afa1-ef9c-4254-9c87-2686adece9ac req-ba6e6a2d-3de9-44b6-a032-b65626c12e2e service nova] Creating event network-vif-deleted:867ccd69-2e5d-4d8e-9eab-bd210ae13cc7 for instance d9743668-8bc9-4d7e-8a99-c443ee982477 on n-h1-860892-1 Oct 11 04:18:51.317518 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f872afa1-ef9c-4254-9c87-2686adece9ac req-ba6e6a2d-3de9-44b6-a032-b65626c12e2e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032478 Oct 11 04:18:51.319788 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1138/2167] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:51.325083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:51.325846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:51.336407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:51.337091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:51.337928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:51.338979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:51.339485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:51.339917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:51.397595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:51.398442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:51.399210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:51.399965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lazy-loading 'fault' on Instance uuid d9743668-8bc9-4d7e-8a99-c443ee982477 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:18:51.488981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:51.500319 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e4a8c46-6aca-4025-9e46-0715e2350e5f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 200 len: 1306 microversion: 2.1 time: 0.180804 Oct 11 04:18:51.500892 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1139/2168] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:51 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 1306 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:51.849937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d59cddf7-be9b-4956-853d-77962a961df9 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:51.851509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d59cddf7-be9b-4956-853d-77962a961df9 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:51.857663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d59cddf7-be9b-4956-853d-77962a961df9 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:51.858460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d59cddf7-be9b-4956-853d-77962a961df9 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:51.862218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d59cddf7-be9b-4956-853d-77962a961df9 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:51.862218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d59cddf7-be9b-4956-853d-77962a961df9 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:51.862218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d59cddf7-be9b-4956-853d-77962a961df9 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:51.862218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d59cddf7-be9b-4956-853d-77962a961df9 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:51.866263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:52.017383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-d59cddf7-be9b-4956-853d-77962a961df9 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid 7d993e3f-2858-478c-941e-7d874a4fcb5e {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:18:52.034387 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d59cddf7-be9b-4956-853d-77962a961df9 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1967 microversion: 2.25 time: 0.531960 Oct 11 04:18:52.046739 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1140/2169] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:51 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1967 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:52.059977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5065fd5c-476a-4e6d-bf28-4f1d444ab0c2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:52.060602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5065fd5c-476a-4e6d-bf28-4f1d444ab0c2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:52.068104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5065fd5c-476a-4e6d-bf28-4f1d444ab0c2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:52.068799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5065fd5c-476a-4e6d-bf28-4f1d444ab0c2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:52.069840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5065fd5c-476a-4e6d-bf28-4f1d444ab0c2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:52.070830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5065fd5c-476a-4e6d-bf28-4f1d444ab0c2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:52.071032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5065fd5c-476a-4e6d-bf28-4f1d444ab0c2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:52.071462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5065fd5c-476a-4e6d-bf28-4f1d444ab0c2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:52.302878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5065fd5c-476a-4e6d-bf28-4f1d444ab0c2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:52.312789 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5065fd5c-476a-4e6d-bf28-4f1d444ab0c2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.264890 Oct 11 04:18:52.313572 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1141/2170] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:52 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:52.321921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-95dc5b45-0380-4b71-88f2-03d77a914738 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:52.322066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-95dc5b45-0380-4b71-88f2-03d77a914738 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:52.329580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95dc5b45-0380-4b71-88f2-03d77a914738 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:52.330535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95dc5b45-0380-4b71-88f2-03d77a914738 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:52.331153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95dc5b45-0380-4b71-88f2-03d77a914738 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:52.332044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95dc5b45-0380-4b71-88f2-03d77a914738 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:52.334842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95dc5b45-0380-4b71-88f2-03d77a914738 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:52.335492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95dc5b45-0380-4b71-88f2-03d77a914738 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:52.970143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-95dc5b45-0380-4b71-88f2-03d77a914738 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid 7d993e3f-2858-478c-941e-7d874a4fcb5e {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:18:52.991639 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-95dc5b45-0380-4b71-88f2-03d77a914738 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1967 microversion: 2.25 time: 0.672472 Oct 11 04:18:52.994177 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1142/2171] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:52 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1967 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:53.002868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:53.004443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:53.016475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:53.027092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:53.028934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:53.030305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:53.031137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:53.037770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:53.195973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:53.208598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:53.214554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:53.230602 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4beb10d3-c847-4c17-b922-6625553372d3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.231662 Oct 11 04:18:53.236192 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1143/2172] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:52 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:53.242707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-12b98494-5f6e-491c-a441-c9b6d72de6d7 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:53.243615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-12b98494-5f6e-491c-a441-c9b6d72de6d7 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:53.265211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12b98494-5f6e-491c-a441-c9b6d72de6d7 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:53.266115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12b98494-5f6e-491c-a441-c9b6d72de6d7 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:53.269972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12b98494-5f6e-491c-a441-c9b6d72de6d7 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:53.273815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12b98494-5f6e-491c-a441-c9b6d72de6d7 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:53.274557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12b98494-5f6e-491c-a441-c9b6d72de6d7 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:53.279479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12b98494-5f6e-491c-a441-c9b6d72de6d7 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:53.683939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-12b98494-5f6e-491c-a441-c9b6d72de6d7 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:53.698062 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-12b98494-5f6e-491c-a441-c9b6d72de6d7 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1352 microversion: 2.1 time: 0.464436 Oct 11 04:18:53.714214 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1144/2173] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:53 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1352 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:53.714214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:53.714214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: d9743668-8bc9-4d7e-8a99-c443ee982477] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:53.732992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:53.734416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:53.735630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:53.738216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:53.738794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:53.740903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:53.762060 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] HTTP exception thrown: Instance d9743668-8bc9-4d7e-8a99-c443ee982477 could not be found. Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Request method failure captured: Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 HTTP/1.1 Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO3xJXCBhEGz9pquTeHR3Z4uPzScU9Bl2FfbCNjHEtjlF80EOUSHIxN0oNgNxYRHiHvNBPZ-LEU09Z_ToTUzi6jAb29jy8QXDKpNRY9vBfE3J97u5PqmcxSvRwRtzleSINQtHli-jTadjh2DKl2QS3gYb5ZfaH6limXNvfwfaps0JgA Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}] Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: db33edccb2504185928613257e64cdb4 Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance d9743668-8bc9-4d7e-8a99-c443ee982477 could not be found. Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'd9743668-8bc9-4d7e-8a99-c443ee982477'} Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d9743668-8bc9-4d7e-8a99-c443ee982477 could not be found. Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d9743668-8bc9-4d7e-8a99-c443ee982477 could not be found. Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:18:53.764355 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:53.774616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:18:53.774616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:18:53.774616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:18:53.774616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:18:53.774616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:18:53.774616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d9743668-8bc9-4d7e-8a99-c443ee982477 could not be found. Oct 11 04:18:53.774616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:18:53.774616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Returning 404 to user: Instance d9743668-8bc9-4d7e-8a99-c443ee982477 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:18:53.774616 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7575851e-f14c-47c8-bc02-5a7411e35159 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477" status: 404 len: 111 microversion: 2.1 time: 0.064477 Oct 11 04:18:53.774616 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1145/2174] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:53 2022] GET /compute/v2.1/servers/d9743668-8bc9-4d7e-8a99-c443ee982477 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:18:53.782021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ca289a8-a169-46bd-bfd2-43c51a5782f1 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:53.794109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ca289a8-a169-46bd-bfd2-43c51a5782f1 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:53.795748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ca289a8-a169-46bd-bfd2-43c51a5782f1 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:53.797266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ca289a8-a169-46bd-bfd2-43c51a5782f1 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:53.806231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ca289a8-a169-46bd-bfd2-43c51a5782f1 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:53.806231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ca289a8-a169-46bd-bfd2-43c51a5782f1 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:53.806231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ca289a8-a169-46bd-bfd2-43c51a5782f1 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:53.866675 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ca289a8-a169-46bd-bfd2-43c51a5782f1 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 424 microversion: 2.25 time: 0.095266 Oct 11 04:18:53.871809 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1146/2175] 10.222.0.26 () {60 vars in 1217 bytes} [Tue Oct 11 04:18:53 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 424 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:18:53.900575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f7aa6124-64e1-415d-b6c9-faf1b3ae2339 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:53.900575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f7aa6124-64e1-415d-b6c9-faf1b3ae2339 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:53.907823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aa6124-64e1-415d-b6c9-faf1b3ae2339 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:53.908581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aa6124-64e1-415d-b6c9-faf1b3ae2339 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:53.909235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aa6124-64e1-415d-b6c9-faf1b3ae2339 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:53.910137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aa6124-64e1-415d-b6c9-faf1b3ae2339 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:53.910808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aa6124-64e1-415d-b6c9-faf1b3ae2339 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:53.912253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aa6124-64e1-415d-b6c9-faf1b3ae2339 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:54.102712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f7aa6124-64e1-415d-b6c9-faf1b3ae2339 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:54.116621 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f7aa6124-64e1-415d-b6c9-faf1b3ae2339 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.246935 Oct 11 04:18:54.118417 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1147/2176] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:53 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:54.123359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9157c350-62eb-41c4-b407-de7b819785ad tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:54.124141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9157c350-62eb-41c4-b407-de7b819785ad tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: eba839a6-aa74-4b1a-9393-a9538ec7b2db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:54.133567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9157c350-62eb-41c4-b407-de7b819785ad tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:54.136275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9157c350-62eb-41c4-b407-de7b819785ad tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:54.141852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9157c350-62eb-41c4-b407-de7b819785ad tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:54.141852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9157c350-62eb-41c4-b407-de7b819785ad tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:54.141852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9157c350-62eb-41c4-b407-de7b819785ad tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:54.141852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9157c350-62eb-41c4-b407-de7b819785ad tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:54.177471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9157c350-62eb-41c4-b407-de7b819785ad tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: eba839a6-aa74-4b1a-9393-a9538ec7b2db] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:18:54.260162 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0ecbbeb6-879c-44da-8150-2c2e718805a6 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 200 len: 1461 microversion: 2.1 time: 14.375429 Oct 11 04:18:54.260746 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1030/2177] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:18:39 2022] GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 1461 bytes in 14377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:18:54.276826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-804ed980-1477-4bb6-9b5b-039f4476e289 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860892-1", "block_migration": "auto"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:54.279550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-804ed980-1477-4bb6-9b5b-039f4476e289 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:54.291041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-804ed980-1477-4bb6-9b5b-039f4476e289 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:54.291836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-804ed980-1477-4bb6-9b5b-039f4476e289 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:54.292542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-804ed980-1477-4bb6-9b5b-039f4476e289 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:54.293526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-804ed980-1477-4bb6-9b5b-039f4476e289 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:54.294166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-804ed980-1477-4bb6-9b5b-039f4476e289 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:54.294617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-804ed980-1477-4bb6-9b5b-039f4476e289 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:54.321811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-804ed980-1477-4bb6-9b5b-039f4476e289 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'flavor' on Instance uuid 7d993e3f-2858-478c-941e-7d874a4fcb5e {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:18:54.338257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-804ed980-1477-4bb6-9b5b-039f4476e289 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Going to try to live migrate instance to n-h2-860892-1 {{(pid=120993) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 04:18:54.719024 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9157c350-62eb-41c4-b407-de7b819785ad tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db" status: 204 len: 0 microversion: 2.1 time: 0.598032 Oct 11 04:18:54.720836 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1148/2178] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:18:54 2022] DELETE /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db => generated 0 bytes in 602 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:18:54.740314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4a7399ff-9e97-43f3-bbd6-1df93b9f1c54 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a40fbd2f-60e1-4b67-ba10-2aab10ca5b70"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:54.743774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4a7399ff-9e97-43f3-bbd6-1df93b9f1c54 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:54.746778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:54.750123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7399ff-9e97-43f3-bbd6-1df93b9f1c54 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:54.750642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7399ff-9e97-43f3-bbd6-1df93b9f1c54 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:54.751083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7399ff-9e97-43f3-bbd6-1df93b9f1c54 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:54.751926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7399ff-9e97-43f3-bbd6-1df93b9f1c54 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:54.752561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7399ff-9e97-43f3-bbd6-1df93b9f1c54 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:54.753165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7399ff-9e97-43f3-bbd6-1df93b9f1c54 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:57.961617 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4a7399ff-9e97-43f3-bbd6-1df93b9f1c54 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "POST /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.237939 Oct 11 04:18:57.962394 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1149/2179] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:18:54 2022] POST /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments => generated 194 bytes in 3241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:57.978125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:57.978974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:57.990160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:57.991098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:57.991643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:57.992752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:57.993491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:57.994054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:58.071512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:58.080038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:58.081591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:58.089288 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a5768854-a3f1-4b59-af8d-1581b7b4892c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1531 microversion: 2.91 time: 0.125714 Oct 11 04:18:58.089866 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1150/2180] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:57 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1531 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:58.094753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31344984-be61-43c0-8336-58ccb6e61690 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19414d30>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:58.178452 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31344984-be61-43c0-8336-58ccb6e61690 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 200 len: 1461 microversion: 2.1 time: 0.087118 Oct 11 04:18:58.182631 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1151/2181] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:18:58 2022] GET /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 1461 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:58.214025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d653ee77-3c89-4144-81e7-19adf474e83e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:58.214025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d653ee77-3c89-4144-81e7-19adf474e83e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:58.249238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d653ee77-3c89-4144-81e7-19adf474e83e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:58.249832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d653ee77-3c89-4144-81e7-19adf474e83e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:58.258218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d653ee77-3c89-4144-81e7-19adf474e83e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:58.260652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d653ee77-3c89-4144-81e7-19adf474e83e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:58.260652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d653ee77-3c89-4144-81e7-19adf474e83e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:58.260652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d653ee77-3c89-4144-81e7-19adf474e83e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:58.491482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d653ee77-3c89-4144-81e7-19adf474e83e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:58.500594 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d653ee77-3c89-4144-81e7-19adf474e83e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1352 microversion: 2.1 time: 0.304859 Oct 11 04:18:58.501884 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1152/2182] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:58 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1352 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:58.531110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f4ddfe6d-8b46-4b8c-8649-9955741fdca0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:58.531110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f4ddfe6d-8b46-4b8c-8649-9955741fdca0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:58.534738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ddfe6d-8b46-4b8c-8649-9955741fdca0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:58.535502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ddfe6d-8b46-4b8c-8649-9955741fdca0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:58.536170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ddfe6d-8b46-4b8c-8649-9955741fdca0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:58.537106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ddfe6d-8b46-4b8c-8649-9955741fdca0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:58.538355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ddfe6d-8b46-4b8c-8649-9955741fdca0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:58.538996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4ddfe6d-8b46-4b8c-8649-9955741fdca0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:58.586920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f4ddfe6d-8b46-4b8c-8649-9955741fdca0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:18:58.789529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:18:59.052835 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f4ddfe6d-8b46-4b8c-8649-9955741fdca0 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 204 len: 0 microversion: 2.1 time: 0.548805 Oct 11 04:18:59.053531 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1153/2183] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:18:58 2022] DELETE /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 0 bytes in 551 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:18:59.058633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8b1892d2-989f-4e4a-b4a1-10eeea682975 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:59.059331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8b1892d2-989f-4e4a-b4a1-10eeea682975 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:59.065292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b1892d2-989f-4e4a-b4a1-10eeea682975 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.065890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b1892d2-989f-4e4a-b4a1-10eeea682975 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.066224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b1892d2-989f-4e4a-b4a1-10eeea682975 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.066906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b1892d2-989f-4e4a-b4a1-10eeea682975 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.067346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b1892d2-989f-4e4a-b4a1-10eeea682975 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.067764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b1892d2-989f-4e4a-b4a1-10eeea682975 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.228726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8b1892d2-989f-4e4a-b4a1-10eeea682975 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:59.236904 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8b1892d2-989f-4e4a-b4a1-10eeea682975 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.182378 Oct 11 04:18:59.237466 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1154/2184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:59 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:59.241838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c0e7a331-52ca-4b79-8633-40c86d5b47d4 req-df87ed68-fb62-4fab-ab11-f7c4a87ef6a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c20dc0-ffa3-498c-be2b-a8311c1face7", "name": "network-vif-plugged", "status": "completed", "tag": "32cb4580-f042-48a2-b372-b09a2ba049ab"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:59.252433 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-804ed980-1477-4bb6-9b5b-039f4476e289 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e/action" status: 202 len: 0 microversion: 2.25 time: 4.990049 Oct 11 04:18:59.255493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c0e7a331-52ca-4b79-8633-40c86d5b47d4 req-df87ed68-fb62-4fab-ab11-f7c4a87ef6a7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.256769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c0e7a331-52ca-4b79-8633-40c86d5b47d4 req-df87ed68-fb62-4fab-ab11-f7c4a87ef6a7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.257545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c0e7a331-52ca-4b79-8633-40c86d5b47d4 req-df87ed68-fb62-4fab-ab11-f7c4a87ef6a7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.258501 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1031/2185] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:18:54 2022] POST /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e/action => generated 0 bytes in 4997 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:18:59.263637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2e21135a-b1aa-49af-953d-e507fedd4f77 req-5cc6f072-94f3-4ec9-a014-ffbaccc44b0a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eba839a6-aa74-4b1a-9393-a9538ec7b2db", "name": "network-vif-deleted", "tag": "ca73f004-92ba-4147-9499-25e95594a322"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:59.269848 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c0e7a331-52ca-4b79-8633-40c86d5b47d4 req-df87ed68-fb62-4fab-ab11-f7c4a87ef6a7 service nova] Creating event network-vif-plugged:32cb4580-f042-48a2-b372-b09a2ba049ab for instance 88c20dc0-ffa3-498c-be2b-a8311c1face7 on n-h2-860892-1 Oct 11 04:18:59.275324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2e21135a-b1aa-49af-953d-e507fedd4f77 req-5cc6f072-94f3-4ec9-a014-ffbaccc44b0a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.275806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2e21135a-b1aa-49af-953d-e507fedd4f77 req-5cc6f072-94f3-4ec9-a014-ffbaccc44b0a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.276193 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c0e7a331-52ca-4b79-8633-40c86d5b47d4 req-df87ed68-fb62-4fab-ab11-f7c4a87ef6a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037176 Oct 11 04:18:59.276337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2e21135a-b1aa-49af-953d-e507fedd4f77 req-5cc6f072-94f3-4ec9-a014-ffbaccc44b0a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.285941 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1155/2186] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:59.289374 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2e21135a-b1aa-49af-953d-e507fedd4f77 req-5cc6f072-94f3-4ec9-a014-ffbaccc44b0a service nova] Creating event network-vif-deleted:ca73f004-92ba-4147-9499-25e95594a322 for instance eba839a6-aa74-4b1a-9393-a9538ec7b2db on n-h2-860892-1 Oct 11 04:18:59.289543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e1ae3d1-d842-429b-9f79-f7a086217882 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:59.290637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e1ae3d1-d842-429b-9f79-f7a086217882 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:59.294943 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2e21135a-b1aa-49af-953d-e507fedd4f77 req-5cc6f072-94f3-4ec9-a014-ffbaccc44b0a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034998 Oct 11 04:18:59.295547 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1032/2187] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:18:59.299533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e1ae3d1-d842-429b-9f79-f7a086217882 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.299970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e1ae3d1-d842-429b-9f79-f7a086217882 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.300639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e1ae3d1-d842-429b-9f79-f7a086217882 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.301734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e1ae3d1-d842-429b-9f79-f7a086217882 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.302373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e1ae3d1-d842-429b-9f79-f7a086217882 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.302813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e1ae3d1-d842-429b-9f79-f7a086217882 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.307837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:59.309054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: eba839a6-aa74-4b1a-9393-a9538ec7b2db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:59.316045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.316707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.320289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.320289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.320289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.320289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.357252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.357832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.358378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.358837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lazy-loading 'fault' on Instance uuid eba839a6-aa74-4b1a-9393-a9538ec7b2db {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:18:59.404192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:59.413135 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-38d0b9a5-dfb9-4d48-941f-cf2c2fbcf99e tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db" status: 200 len: 1309 microversion: 2.1 time: 0.113065 Oct 11 04:18:59.413989 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1033/2188] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:59 2022] GET /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db => generated 1309 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:59.432286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:59.432907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:59.439222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.439928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.440592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.441292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.441743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.442166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.460826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e1ae3d1-d842-429b-9f79-f7a086217882 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:59.471351 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e1ae3d1-d842-429b-9f79-f7a086217882 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7" status: 200 len: 1467 microversion: 2.1 time: 0.185739 Oct 11 04:18:59.471351 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1156/2189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:59 2022] GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7 => generated 1467 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:18:59.476819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:59.477379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:59.483956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.484462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.485145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.485846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.486442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.487217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.550748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:59.566248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:59.566248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:59.571788 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8028d5bd-c01d-427e-b364-34bedcbe708c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1531 microversion: 2.91 time: 0.156426 Oct 11 04:18:59.572543 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1034/2190] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:59 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1531 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:59.582947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f3801ada-230a-45c5-82e6-672477bc2513 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1417787280"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:18:59.586214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f3801ada-230a-45c5-82e6-672477bc2513 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:59.595820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3801ada-230a-45c5-82e6-672477bc2513 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.597124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3801ada-230a-45c5-82e6-672477bc2513 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.597760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3801ada-230a-45c5-82e6-672477bc2513 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.598936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3801ada-230a-45c5-82e6-672477bc2513 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.599600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3801ada-230a-45c5-82e6-672477bc2513 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.600396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3801ada-230a-45c5-82e6-672477bc2513 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.670654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:59.680593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:59.682097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:59.683304 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0e68914a-56af-4027-8328-39f3ebf3dc1e tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.211252 Oct 11 04:18:59.684168 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1157/2191] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:18:59 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:18:59.688619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-233bb3bf-68b1-4a84-9a49-3f4e299ef51e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:18:59.689227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-233bb3bf-68b1-4a84-9a49-3f4e299ef51e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:18:59.699212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-233bb3bf-68b1-4a84-9a49-3f4e299ef51e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.699747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-233bb3bf-68b1-4a84-9a49-3f4e299ef51e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.700527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-233bb3bf-68b1-4a84-9a49-3f4e299ef51e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.701414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-233bb3bf-68b1-4a84-9a49-3f4e299ef51e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:18:59.702074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-233bb3bf-68b1-4a84-9a49-3f4e299ef51e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:18:59.702536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-233bb3bf-68b1-4a84-9a49-3f4e299ef51e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:18:59.849275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-233bb3bf-68b1-4a84-9a49-3f4e299ef51e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:18:59.858237 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-233bb3bf-68b1-4a84-9a49-3f4e299ef51e tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1352 microversion: 2.1 time: 0.173021 Oct 11 04:18:59.863044 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1158/2192] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:18:59 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1352 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:00.254200 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f3801ada-230a-45c5-82e6-672477bc2513 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "POST /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d/action" status: 202 len: 0 microversion: 2.1 time: 0.679917 Oct 11 04:19:00.255108 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1035/2193] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:18:59 2022] POST /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d/action => generated 0 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 04:19:00.265125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e6eda547-45f0-4d1b-b3b1-d72358fe415b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:00.266780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6d7fe81-ff31-4b5f-a12f-1c965d9f2483 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19fd9310>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:00.269212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e6eda547-45f0-4d1b-b3b1-d72358fe415b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:00.281200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6eda547-45f0-4d1b-b3b1-d72358fe415b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:00.281894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6eda547-45f0-4d1b-b3b1-d72358fe415b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:00.282452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6eda547-45f0-4d1b-b3b1-d72358fe415b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:00.283355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6eda547-45f0-4d1b-b3b1-d72358fe415b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:00.283879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6eda547-45f0-4d1b-b3b1-d72358fe415b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:00.284374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6eda547-45f0-4d1b-b3b1-d72358fe415b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:00.321173 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f6d7fe81-ff31-4b5f-a12f-1c965d9f2483 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.058462 Oct 11 04:19:00.322429 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1036/2194] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:00 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:00.438285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:00.441391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: eba839a6-aa74-4b1a-9393-a9538ec7b2db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:00.463964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:00.464776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:00.465387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:00.466322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:00.467143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:00.467749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:00.478982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e6eda547-45f0-4d1b-b3b1-d72358fe415b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:00.487259 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e6eda547-45f0-4d1b-b3b1-d72358fe415b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.226496 Oct 11 04:19:00.488195 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1159/2195] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:00 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:00.530688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:00.531193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:00.531713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:00.532177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lazy-loading 'fault' on Instance uuid eba839a6-aa74-4b1a-9393-a9538ec7b2db {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:00.583405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:00.591957 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eb59c49b-4abd-49eb-8212-4669d274363b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db" status: 200 len: 1309 microversion: 2.1 time: 0.160232 Oct 11 04:19:00.592459 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1037/2196] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:00 2022] GET /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:00.613438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:00.614400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:00.621418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:00.622261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:00.622979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:00.623927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:00.624720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:00.625365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:00.699565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:00.710012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:00.711805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:00.716587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:00.717331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:00.718570 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a4c78abf-c1a5-4f7c-beaf-590bcc125ca8 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1531 microversion: 2.91 time: 0.110244 Oct 11 04:19:00.728307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:00.728805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:00.729246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:00.729970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:00.730462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:00.731859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:00.734759 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1160/2197] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:00 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1531 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:00.886296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-592c9933-5466-4f15-b08d-b3216931e262 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:00.887280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-592c9933-5466-4f15-b08d-b3216931e262 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:00.898089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-592c9933-5466-4f15-b08d-b3216931e262 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:00.898927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-592c9933-5466-4f15-b08d-b3216931e262 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:00.899765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-592c9933-5466-4f15-b08d-b3216931e262 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:00.900607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-592c9933-5466-4f15-b08d-b3216931e262 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:00.901064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-592c9933-5466-4f15-b08d-b3216931e262 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:00.902052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-592c9933-5466-4f15-b08d-b3216931e262 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:01.031561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:01.041204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:01.043672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:01.045154 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-306899aa-8ea9-4aef-b375-437ccf88709a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.339948 Oct 11 04:19:01.046013 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1038/2198] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:00 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:19:01.268854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-592c9933-5466-4f15-b08d-b3216931e262 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:01.277790 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-592c9933-5466-4f15-b08d-b3216931e262 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1352 microversion: 2.1 time: 0.398955 Oct 11 04:19:01.280025 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1161/2199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:00 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1352 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:01.310299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-cf790553-031d-4dcc-b804-531f2f56ba82 req-89061196-f737-4b63-a354-c99b432ef3d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61736a99-889e-47c3-a550-c4d48a359d38", "name": "network-vif-plugged", "status": "completed", "tag": "7b0473ce-6e96-4d38-a5fb-767e4cf4c5b4"}, {"server_uuid": "61736a99-889e-47c3-a550-c4d48a359d38", "name": "network-vif-plugged", "status": "completed", "tag": "9cc3530c-ee2c-44b8-8d71-a9d5d999dfd1"}, {"server_uuid": "61736a99-889e-47c3-a550-c4d48a359d38", "name": "network-vif-plugged", "status": "completed", "tag": "f5dd1ecd-f19a-4800-b863-7e7cfe9bc66c"}, {"server_uuid": "4aaae530-25a0-46f6-9df0-bb21d130a0f7", "name": "network-vif-unplugged", "status": "completed", "tag": "39669b5c-b616-41c2-a28c-282c3da17d8d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:01.321958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cf790553-031d-4dcc-b804-531f2f56ba82 req-89061196-f737-4b63-a354-c99b432ef3d2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:01.322458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cf790553-031d-4dcc-b804-531f2f56ba82 req-89061196-f737-4b63-a354-c99b432ef3d2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:01.323096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cf790553-031d-4dcc-b804-531f2f56ba82 req-89061196-f737-4b63-a354-c99b432ef3d2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:01.337574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25f144b1-6535-4192-a22a-29c155870f4c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1942e040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:01.367552 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-cf790553-031d-4dcc-b804-531f2f56ba82 req-89061196-f737-4b63-a354-c99b432ef3d2 service nova] Creating event network-vif-plugged:7b0473ce-6e96-4d38-a5fb-767e4cf4c5b4 for instance 61736a99-889e-47c3-a550-c4d48a359d38 on n-h1-860892-1 Oct 11 04:19:01.368255 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-cf790553-031d-4dcc-b804-531f2f56ba82 req-89061196-f737-4b63-a354-c99b432ef3d2 service nova] Creating event network-vif-plugged:9cc3530c-ee2c-44b8-8d71-a9d5d999dfd1 for instance 61736a99-889e-47c3-a550-c4d48a359d38 on n-h1-860892-1 Oct 11 04:19:01.368935 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-cf790553-031d-4dcc-b804-531f2f56ba82 req-89061196-f737-4b63-a354-c99b432ef3d2 service nova] Creating event network-vif-plugged:f5dd1ecd-f19a-4800-b863-7e7cfe9bc66c for instance 61736a99-889e-47c3-a550-c4d48a359d38 on n-h1-860892-1 Oct 11 04:19:01.369610 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-cf790553-031d-4dcc-b804-531f2f56ba82 req-89061196-f737-4b63-a354-c99b432ef3d2 service nova] Creating event network-vif-unplugged:39669b5c-b616-41c2-a28c-282c3da17d8d for instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 on n-h2-860892-1 Oct 11 04:19:01.417022 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-cf790553-031d-4dcc-b804-531f2f56ba82 req-89061196-f737-4b63-a354-c99b432ef3d2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.110348 Oct 11 04:19:01.419341 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1039/2200] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:19:01.479448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-25f144b1-6535-4192-a22a-29c155870f4c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.143027 Oct 11 04:19:01.480082 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1162/2201] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:01 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:01.519535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7edf1a3f-089b-4a25-a828-ed084795c28d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:01.526068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7edf1a3f-089b-4a25-a828-ed084795c28d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:01.561310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1e338447-27dc-40b2-a0bc-b38bad64fa10 req-70c6ae02-c1f4-47ae-9a9a-a1cdadf67712 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa898108-1d05-4df5-8ecb-400b392a7d9e", "name": "network-vif-deleted", "tag": "3d8f37de-d817-40fe-825d-b0a5851f473e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:01.574954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7edf1a3f-089b-4a25-a828-ed084795c28d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:01.580163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7edf1a3f-089b-4a25-a828-ed084795c28d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:01.582388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7edf1a3f-089b-4a25-a828-ed084795c28d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:01.585671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7edf1a3f-089b-4a25-a828-ed084795c28d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:01.587343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7edf1a3f-089b-4a25-a828-ed084795c28d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:01.590577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7edf1a3f-089b-4a25-a828-ed084795c28d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:01.608127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1e338447-27dc-40b2-a0bc-b38bad64fa10 req-70c6ae02-c1f4-47ae-9a9a-a1cdadf67712 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:01.610116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1e338447-27dc-40b2-a0bc-b38bad64fa10 req-70c6ae02-c1f4-47ae-9a9a-a1cdadf67712 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:01.611325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1e338447-27dc-40b2-a0bc-b38bad64fa10 req-70c6ae02-c1f4-47ae-9a9a-a1cdadf67712 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:01.662134 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1e338447-27dc-40b2-a0bc-b38bad64fa10 req-70c6ae02-c1f4-47ae-9a9a-a1cdadf67712 service nova] Creating event network-vif-deleted:3d8f37de-d817-40fe-825d-b0a5851f473e for instance fa898108-1d05-4df5-8ecb-400b392a7d9e on n-h1-860892-1 Oct 11 04:19:01.680628 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1e338447-27dc-40b2-a0bc-b38bad64fa10 req-70c6ae02-c1f4-47ae-9a9a-a1cdadf67712 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.130069 Oct 11 04:19:01.682399 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1163/2202] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:19:01.694273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:01.696277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: eba839a6-aa74-4b1a-9393-a9538ec7b2db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:01.706050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:01.707227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:01.707966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:01.709020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:01.709923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:01.711178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:01.751814 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] HTTP exception thrown: Instance eba839a6-aa74-4b1a-9393-a9538ec7b2db could not be found. Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Request method failure captured: Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db HTTP/1.1 Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO3xJXCBhEGz9pquTeHR3Z4uPzScU9Bl2FfbCNjHEtjlF80EOUSHIxN0oNgNxYRHiHvNBPZ-LEU09Z_ToTUzi6jAb29jy8QXDKpNRY9vBfE3J97u5PqmcxSvRwRtzleSINQtHli-jTadjh2DKl2QS3gYb5ZfaH6limXNvfwfaps0JgA Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}] Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: db33edccb2504185928613257e64cdb4 Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance eba839a6-aa74-4b1a-9393-a9538ec7b2db could not be found. Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'eba839a6-aa74-4b1a-9393-a9538ec7b2db'} Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eba839a6-aa74-4b1a-9393-a9538ec7b2db could not be found. Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eba839a6-aa74-4b1a-9393-a9538ec7b2db could not be found. Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:01.757339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:01.765919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:01.765919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:01.765919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:01.765919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:19:01.765919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:19:01.765919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eba839a6-aa74-4b1a-9393-a9538ec7b2db could not be found. Oct 11 04:19:01.765919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:01.777133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Returning 404 to user: Instance eba839a6-aa74-4b1a-9393-a9538ec7b2db could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:01.777133 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6f88bbbb-adf0-47f9-acbd-a7e8d7f42465 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db" status: 404 len: 111 microversion: 2.1 time: 0.091069 Oct 11 04:19:01.777133 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1164/2203] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:01 2022] GET /compute/v2.1/servers/eba839a6-aa74-4b1a-9393-a9538ec7b2db => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:19:01.785222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:01.788343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:01.797622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:01.798170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:01.798663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:01.799737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:01.801047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:01.802298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:01.978971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:01.988722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:01.989520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7edf1a3f-089b-4a25-a828-ed084795c28d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:01.995143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:02.008959 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7edf1a3f-089b-4a25-a828-ed084795c28d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.494152 Oct 11 04:19:02.010062 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c1a89485-e83a-443c-adf0-eafb15227b51 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1534 microversion: 2.91 time: 0.232837 Oct 11 04:19:02.022374 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1165/2205] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:01 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1534 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:02.026225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fd78e3a9-f6bd-403d-944f-aae7fd9f1812 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:02.027217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fd78e3a9-f6bd-403d-944f-aae7fd9f1812 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:02.027693 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1040/2205] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:01 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:02.041365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd78e3a9-f6bd-403d-944f-aae7fd9f1812 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.042237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd78e3a9-f6bd-403d-944f-aae7fd9f1812 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.042851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd78e3a9-f6bd-403d-944f-aae7fd9f1812 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.043737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd78e3a9-f6bd-403d-944f-aae7fd9f1812 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.044353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd78e3a9-f6bd-403d-944f-aae7fd9f1812 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.049866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-83521017-52d2-4019-9a88-7f99219036e3 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:02.050710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd78e3a9-f6bd-403d-944f-aae7fd9f1812 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.055290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-83521017-52d2-4019-9a88-7f99219036e3 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:02.098986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83521017-52d2-4019-9a88-7f99219036e3 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.099880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83521017-52d2-4019-9a88-7f99219036e3 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.104057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83521017-52d2-4019-9a88-7f99219036e3 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.104057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83521017-52d2-4019-9a88-7f99219036e3 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.104598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83521017-52d2-4019-9a88-7f99219036e3 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.106495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83521017-52d2-4019-9a88-7f99219036e3 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.195749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fd78e3a9-f6bd-403d-944f-aae7fd9f1812 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:02.205342 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fd78e3a9-f6bd-403d-944f-aae7fd9f1812 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1304 microversion: 2.1 time: 0.190270 Oct 11 04:19:02.214645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-83521017-52d2-4019-9a88-7f99219036e3 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h2-860892-1". {{(pid=120993) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 04:19:02.220652 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1166/2206] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:02 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1304 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:02.227540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:02.228258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:02.234992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.237677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.237677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.237677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.237677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.237677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.464770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:02.473271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:02.475405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:02.476615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3f94dd61-67d2-43c7-bcad-1787ae8af134 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.254664 Oct 11 04:19:02.478210 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1167/2207] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:02 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:02.482878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13adde9c-03e2-4d7f-9948-90523da491a5 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:02.483603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-13adde9c-03e2-4d7f-9948-90523da491a5 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:02.489775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13adde9c-03e2-4d7f-9948-90523da491a5 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.490665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13adde9c-03e2-4d7f-9948-90523da491a5 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.491351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13adde9c-03e2-4d7f-9948-90523da491a5 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.492404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13adde9c-03e2-4d7f-9948-90523da491a5 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.492961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13adde9c-03e2-4d7f-9948-90523da491a5 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.493585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13adde9c-03e2-4d7f-9948-90523da491a5 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.663261 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-83521017-52d2-4019-9a88-7f99219036e3 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f/action" status: 202 len: 0 microversion: 2.91 time: 0.619400 Oct 11 04:19:02.665877 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1041/2208] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:19:02 2022] POST /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:19:02.679134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f9bedc9-5efb-4540-9d12-0bf339716ad0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19f9fa60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:02.703962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-13adde9c-03e2-4d7f-9948-90523da491a5 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:02.718451 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-13adde9c-03e2-4d7f-9948-90523da491a5 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1543 microversion: 2.1 time: 0.236955 Oct 11 04:19:02.719041 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1168/2209] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:02 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1543 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:02.725765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:02.726802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:02.735704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.741885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.741885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.748345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.748610 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f9bedc9-5efb-4540-9d12-0bf339716ad0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.077620 Oct 11 04:19:02.748836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.748984 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1042/2210] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:02 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:02.750918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.758563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d9361c4d-6eda-47c6-a5e6-92327fdbc498 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:02.759136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d9361c4d-6eda-47c6-a5e6-92327fdbc498 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:02.767280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9361c4d-6eda-47c6-a5e6-92327fdbc498 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.767770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9361c4d-6eda-47c6-a5e6-92327fdbc498 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.768551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9361c4d-6eda-47c6-a5e6-92327fdbc498 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.769440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9361c4d-6eda-47c6-a5e6-92327fdbc498 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:02.769896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9361c4d-6eda-47c6-a5e6-92327fdbc498 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:02.770548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9361c4d-6eda-47c6-a5e6-92327fdbc498 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:02.845138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:02.868864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:02.870880 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d9361c4d-6eda-47c6-a5e6-92327fdbc498 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120832 Oct 11 04:19:02.871683 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1043/2211] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:19:02 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7/os-interface => generated 285 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:02.873958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:02.882580 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fd07700b-3ebe-4a57-8065-8687b18a6b0e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1482 microversion: 2.91 time: 0.162468 Oct 11 04:19:02.887043 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1169/2212] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:02 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1482 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:03.039209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df3fa0ab-0773-475d-8dab-b499781f6376 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:03.040768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-df3fa0ab-0773-475d-8dab-b499781f6376 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:03.051285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df3fa0ab-0773-475d-8dab-b499781f6376 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:03.051807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df3fa0ab-0773-475d-8dab-b499781f6376 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:03.052276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df3fa0ab-0773-475d-8dab-b499781f6376 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:03.053155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df3fa0ab-0773-475d-8dab-b499781f6376 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:03.053643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df3fa0ab-0773-475d-8dab-b499781f6376 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:03.054117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df3fa0ab-0773-475d-8dab-b499781f6376 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:03.229507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:03.230129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:03.248737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:03.249242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:03.249691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:03.250445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:03.252819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:03.253304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:03.292338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:03.293149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:03.293786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:03.294521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lazy-loading 'fault' on Instance uuid fa898108-1d05-4df5-8ecb-400b392a7d9e {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:03.363301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:03.372721 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-940e1e56-2463-4b9c-ada6-71bb7ac8068b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1309 microversion: 2.1 time: 0.147873 Oct 11 04:19:03.376579 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1170/2213] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:03 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1309 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:03.509695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:03.511121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:03.522720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:03.525090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:03.526671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:03.529724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:03.530865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:03.534504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:03.561342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-df3fa0ab-0773-475d-8dab-b499781f6376 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:03.579463 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df3fa0ab-0773-475d-8dab-b499781f6376 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1355 microversion: 2.1 time: 0.544388 Oct 11 04:19:03.581464 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1044/2214] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:03 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1355 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:03.766086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0a7c6833-ceb7-4393-9c13-929d8e7235f8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1a27dd30>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:03.823039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:03.830419 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0a7c6833-ceb7-4393-9c13-929d8e7235f8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.068738 Oct 11 04:19:03.831013 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1045/2215] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:03 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:03.914038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:03.914719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:03.921480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:03.922179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:03.922642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:03.923510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:03.924137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:03.924561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:04.025304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:04.029380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:04.041142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:04.043024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:04.056023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:04.057940 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6fcf6127-7677-4c3d-8cbb-b55078e98336 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1482 microversion: 2.91 time: 0.148896 Oct 11 04:19:04.068122 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1046/2216] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:03 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1482 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:04.070225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:04.071584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:04.075851 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-542aaba4-d792-473d-9d09-88f3654d023b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.571572 Oct 11 04:19:04.082330 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1171/2217] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:03 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:04.397765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:04.398842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:04.405377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:04.406004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:04.406743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:04.407556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:04.408327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:04.408859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:04.475675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:04.476330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:04.476904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:04.477459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lazy-loading 'fault' on Instance uuid fa898108-1d05-4df5-8ecb-400b392a7d9e {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:04.533834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:04.555898 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ffa6cd8-1e37-4542-843f-45a795adca94 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 200 len: 1309 microversion: 2.1 time: 0.163203 Oct 11 04:19:04.557792 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1047/2218] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:04 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 1309 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:04.608356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d221869b-4302-481a-b370-ef35e072b693 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:04.609591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d221869b-4302-481a-b370-ef35e072b693 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:04.619962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d221869b-4302-481a-b370-ef35e072b693 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:04.622740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d221869b-4302-481a-b370-ef35e072b693 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:04.624242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d221869b-4302-481a-b370-ef35e072b693 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:04.625136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d221869b-4302-481a-b370-ef35e072b693 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:04.626124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d221869b-4302-481a-b370-ef35e072b693 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:04.626745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d221869b-4302-481a-b370-ef35e072b693 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:04.714539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-05ff80a8-665e-4657-80b5-e5c8401fa423 req-0567f40c-42a8-49e5-b468-03c055a6ec05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88c20dc0-ffa3-498c-be2b-a8311c1face7", "tag": "32cb4580-f042-48a2-b372-b09a2ba049ab"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:04.734121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-05ff80a8-665e-4657-80b5-e5c8401fa423 req-0567f40c-42a8-49e5-b468-03c055a6ec05 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:04.734633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-05ff80a8-665e-4657-80b5-e5c8401fa423 req-0567f40c-42a8-49e5-b468-03c055a6ec05 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:04.735071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-05ff80a8-665e-4657-80b5-e5c8401fa423 req-0567f40c-42a8-49e5-b468-03c055a6ec05 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:04.759276 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-05ff80a8-665e-4657-80b5-e5c8401fa423 req-0567f40c-42a8-49e5-b468-03c055a6ec05 service nova] Creating event network-changed:32cb4580-f042-48a2-b372-b09a2ba049ab for instance 88c20dc0-ffa3-498c-be2b-a8311c1face7 on n-h2-860892-1 Oct 11 04:19:04.764248 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-05ff80a8-665e-4657-80b5-e5c8401fa423 req-0567f40c-42a8-49e5-b468-03c055a6ec05 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053363 Oct 11 04:19:04.765383 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1048/2219] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:19:04.847862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b9a059f-51e3-4e51-abcb-f81338614276 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1a1900d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:04.915012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d221869b-4302-481a-b370-ef35e072b693 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:04.928528 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d221869b-4302-481a-b370-ef35e072b693 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1803 microversion: 2.1 time: 0.323524 Oct 11 04:19:04.929231 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1172/2220] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:04 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1803 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:04.960570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1483fc6f-a6e6-4a93-a81d-e4d3d42d3430 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:04.961305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1483fc6f-a6e6-4a93-a81d-e4d3d42d3430 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:04.963202 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b9a059f-51e3-4e51-abcb-f81338614276 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.121213 Oct 11 04:19:04.966648 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1049/2221] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:04 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:04.975397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1483fc6f-a6e6-4a93-a81d-e4d3d42d3430 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:04.976218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1483fc6f-a6e6-4a93-a81d-e4d3d42d3430 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:04.976827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1483fc6f-a6e6-4a93-a81d-e4d3d42d3430 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:04.978772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1483fc6f-a6e6-4a93-a81d-e4d3d42d3430 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:04.980878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1483fc6f-a6e6-4a93-a81d-e4d3d42d3430 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:04.984866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1483fc6f-a6e6-4a93-a81d-e4d3d42d3430 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:04.993360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:05.047281 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1483fc6f-a6e6-4a93-a81d-e4d3d42d3430 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38/ips" status: 200 len: 216 microversion: 2.1 time: 0.088336 Oct 11 04:19:05.050911 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1173/2222] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:19:04 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38/ips => generated 216 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:05.062602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7e65b74d-6ca6-4a06-836c-357e6e2befe2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:05.064254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7e65b74d-6ca6-4a06-836c-357e6e2befe2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:05.074252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e65b74d-6ca6-4a06-836c-357e6e2befe2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:05.079684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e65b74d-6ca6-4a06-836c-357e6e2befe2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:05.079684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e65b74d-6ca6-4a06-836c-357e6e2befe2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:05.079684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e65b74d-6ca6-4a06-836c-357e6e2befe2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:05.079684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e65b74d-6ca6-4a06-836c-357e6e2befe2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:05.079684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e65b74d-6ca6-4a06-836c-357e6e2befe2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:05.088658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:05.089276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:05.097299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:05.098162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:05.098924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:05.100082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:05.100986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:05.102433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:05.128176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7e65b74d-6ca6-4a06-836c-357e6e2befe2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:19:05.219261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:05.230197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:05.231641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:05.237887 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eccad605-ec05-4ffb-aa5b-055e054805b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1484 microversion: 2.91 time: 0.154655 Oct 11 04:19:05.250987 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1174/2223] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:05 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1484 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:05.280254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:05.281255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:05.288789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:05.289567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:05.290178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:05.291070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:05.291714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:05.292747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:05.654180 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7e65b74d-6ca6-4a06-836c-357e6e2befe2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 204 len: 0 microversion: 2.1 time: 0.597758 Oct 11 04:19:05.654804 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1050/2224] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:19:05 2022] DELETE /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:19:05.664205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:05.664909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: fa898108-1d05-4df5-8ecb-400b392a7d9e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:05.691172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:05.691700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:05.692144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:05.696653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:05.697199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:05.698107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:05.737835 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] HTTP exception thrown: Instance fa898108-1d05-4df5-8ecb-400b392a7d9e could not be found. Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Request method failure captured: Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e HTTP/1.1 Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO3xJXCBhEGz9pquTeHR3Z4uPzScU9Bl2FfbCNjHEtjlF80EOUSHIxN0oNgNxYRHiHvNBPZ-LEU09Z_ToTUzi6jAb29jy8QXDKpNRY9vBfE3J97u5PqmcxSvRwRtzleSINQtHli-jTadjh2DKl2QS3gYb5ZfaH6limXNvfwfaps0JgA Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}] Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: db33edccb2504185928613257e64cdb4 Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance fa898108-1d05-4df5-8ecb-400b392a7d9e could not be found. Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'fa898108-1d05-4df5-8ecb-400b392a7d9e'} Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa898108-1d05-4df5-8ecb-400b392a7d9e could not be found. Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa898108-1d05-4df5-8ecb-400b392a7d9e could not be found. Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:05.741807 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:05.748166 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:05.748166 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:05.748166 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:05.748166 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:19:05.748166 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:19:05.748166 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa898108-1d05-4df5-8ecb-400b392a7d9e could not be found. Oct 11 04:19:05.748166 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:05.748166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Returning 404 to user: Instance fa898108-1d05-4df5-8ecb-400b392a7d9e could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:05.748166 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f6f48a6c-7901-4b1d-a123-fa0ddfe8765f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e" status: 404 len: 111 microversion: 2.1 time: 0.086959 Oct 11 04:19:05.752491 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1051/2225] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:05 2022] GET /compute/v2.1/servers/fa898108-1d05-4df5-8ecb-400b392a7d9e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:19:05.769081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ad09e804-4961-49c2-9750-fc394b23959a tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:05.770430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ad09e804-4961-49c2-9750-fc394b23959a tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:05.777138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad09e804-4961-49c2-9750-fc394b23959a tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:05.777631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad09e804-4961-49c2-9750-fc394b23959a tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:05.778632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad09e804-4961-49c2-9750-fc394b23959a tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:05.779415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad09e804-4961-49c2-9750-fc394b23959a tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:05.779796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad09e804-4961-49c2-9750-fc394b23959a tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:05.780218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad09e804-4961-49c2-9750-fc394b23959a tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:05.930965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:05.941758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:05.944263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:05.945804 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-611c0c3e-e570-4b5c-bd12-db02047b9692 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.693494 Oct 11 04:19:05.955650 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1175/2226] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:05 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:05.966935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-467c9af5-8530-4695-b853-8affb423106b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:06.012892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ad09e804-4961-49c2-9750-fc394b23959a tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:06.023918 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ad09e804-4961-49c2-9750-fc394b23959a tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1809 microversion: 2.1 time: 0.270265 Oct 11 04:19:06.025491 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1052/2227] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:05 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1809 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:06.061738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e1718908-7d61-4563-9fa1-7b1fa3c4e86f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19fd9ca0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:06.146837 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e1718908-7d61-4563-9fa1-7b1fa3c4e86f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.119003 Oct 11 04:19:06.149415 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1053/2228] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:06 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:06.188442 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-467c9af5-8530-4695-b853-8affb423106b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/3ca432a7-1fef-4079-8b0f-d93548027b7b" status: 204 len: 0 microversion: 2.1 time: 0.231420 Oct 11 04:19:06.189012 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1176/2229] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:19:05 2022] DELETE /compute/v2.1/os-server-groups/3ca432a7-1fef-4079-8b0f-d93548027b7b => generated 0 bytes in 233 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:19:06.197822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02edce50-de44-4cd4-8797-6086cc1b3bcb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:06.198352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-02edce50-de44-4cd4-8797-6086cc1b3bcb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:06.205767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02edce50-de44-4cd4-8797-6086cc1b3bcb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:06.206303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02edce50-de44-4cd4-8797-6086cc1b3bcb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:06.206744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02edce50-de44-4cd4-8797-6086cc1b3bcb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:06.207450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02edce50-de44-4cd4-8797-6086cc1b3bcb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:06.207909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02edce50-de44-4cd4-8797-6086cc1b3bcb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:06.208335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02edce50-de44-4cd4-8797-6086cc1b3bcb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:06.265482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-02edce50-de44-4cd4-8797-6086cc1b3bcb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:19:06.277687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:06.278154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:06.287139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:06.289034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:06.289890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:06.290905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:06.291575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:06.292210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:06.403226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:06.431882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:06.433909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:06.442851 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ecca02f1-6a49-4b9c-9499-17fdd87b80e3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.169519 Oct 11 04:19:06.444534 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1177/2230] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:06 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:19:06.707036 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02edce50-de44-4cd4-8797-6086cc1b3bcb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3" status: 204 len: 0 microversion: 2.1 time: 0.513369 Oct 11 04:19:06.707744 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1054/2231] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:19:06 2022] DELETE /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3 => generated 0 bytes in 515 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:19:06.717781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fdee4d12-e001-4592-ae5a-9326f0487c02 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:06.718620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fdee4d12-e001-4592-ae5a-9326f0487c02 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:06.729119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdee4d12-e001-4592-ae5a-9326f0487c02 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:06.731363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdee4d12-e001-4592-ae5a-9326f0487c02 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:06.733440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdee4d12-e001-4592-ae5a-9326f0487c02 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:06.735774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdee4d12-e001-4592-ae5a-9326f0487c02 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:06.737502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdee4d12-e001-4592-ae5a-9326f0487c02 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:06.738490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdee4d12-e001-4592-ae5a-9326f0487c02 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:06.807142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fdee4d12-e001-4592-ae5a-9326f0487c02 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:19:06.980548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:06.987394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:07.002496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:07.003716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:07.004569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:07.005768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:07.014697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:07.015271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:07.442903 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fdee4d12-e001-4592-ae5a-9326f0487c02 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 204 len: 0 microversion: 2.1 time: 0.730432 Oct 11 04:19:07.447358 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1178/2232] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:19:06 2022] DELETE /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 0 bytes in 733 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:19:07.451065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bcb534f9-d05d-452b-a802-60633e1529d5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:07.451841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bcb534f9-d05d-452b-a802-60633e1529d5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:07.457772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:07.467197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb534f9-d05d-452b-a802-60633e1529d5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:07.467698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb534f9-d05d-452b-a802-60633e1529d5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:07.468195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb534f9-d05d-452b-a802-60633e1529d5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:07.468910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb534f9-d05d-452b-a802-60633e1529d5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:07.469581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb534f9-d05d-452b-a802-60633e1529d5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:07.470024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb534f9-d05d-452b-a802-60633e1529d5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:07.480708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:07.482448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:07.487320 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f4beb111-f865-4a52-9b8c-d94ad3cc5740 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.518179 Oct 11 04:19:07.489608 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1055/2233] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:06 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:19:07.498484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6859d626-15a7-48b8-8a4e-a46c6749aa34 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1a190e50>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:07.590620 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6859d626-15a7-48b8-8a4e-a46c6749aa34 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.098967 Oct 11 04:19:07.601501 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1056/2234] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:07 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:07.609243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-128d9c99-badb-4907-bad8-7e2198e5fd9d req-98fb2777-5a87-4b11-a9d6-c19293ebbe60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93bf3c01-c65e-4a62-ac8f-352bc8246a2d", "name": "network-vif-plugged", "status": "completed", "tag": "d0bb2ff8-d0fd-4843-b947-a32edd7bb015"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:07.627689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-128d9c99-badb-4907-bad8-7e2198e5fd9d req-98fb2777-5a87-4b11-a9d6-c19293ebbe60 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:07.628293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-128d9c99-badb-4907-bad8-7e2198e5fd9d req-98fb2777-5a87-4b11-a9d6-c19293ebbe60 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:07.629248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-128d9c99-badb-4907-bad8-7e2198e5fd9d req-98fb2777-5a87-4b11-a9d6-c19293ebbe60 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:07.644312 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-128d9c99-badb-4907-bad8-7e2198e5fd9d req-98fb2777-5a87-4b11-a9d6-c19293ebbe60 service nova] Creating event network-vif-plugged:d0bb2ff8-d0fd-4843-b947-a32edd7bb015 for instance 93bf3c01-c65e-4a62-ac8f-352bc8246a2d on n-h1-860892-1 Oct 11 04:19:07.653043 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-128d9c99-badb-4907-bad8-7e2198e5fd9d req-98fb2777-5a87-4b11-a9d6-c19293ebbe60 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049625 Oct 11 04:19:07.656756 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1057/2235] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:07.667603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-acaec6c0-e44a-4c98-bf15-efa4c1ed68da tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:07.669672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-acaec6c0-e44a-4c98-bf15-efa4c1ed68da tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:07.689271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acaec6c0-e44a-4c98-bf15-efa4c1ed68da tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:07.689271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acaec6c0-e44a-4c98-bf15-efa4c1ed68da tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:07.689271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acaec6c0-e44a-4c98-bf15-efa4c1ed68da tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:07.696438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acaec6c0-e44a-4c98-bf15-efa4c1ed68da tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:07.697096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acaec6c0-e44a-4c98-bf15-efa4c1ed68da tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:07.697640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acaec6c0-e44a-4c98-bf15-efa4c1ed68da tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:07.852987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bcb534f9-d05d-452b-a802-60633e1529d5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:07.862271 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bcb534f9-d05d-452b-a802-60633e1529d5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1809 microversion: 2.1 time: 0.415304 Oct 11 04:19:07.862857 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1179/2236] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:07 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1809 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:07.878285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:07.886605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:07.894827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:07.896841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:07.897492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:07.898839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:07.899502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:07.900377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:07.936299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-acaec6c0-e44a-4c98-bf15-efa4c1ed68da tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:07.959305 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-acaec6c0-e44a-4c98-bf15-efa4c1ed68da tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3" status: 200 len: 1474 microversion: 2.1 time: 0.286554 Oct 11 04:19:07.959305 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1058/2237] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:07 2022] GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3 => generated 1474 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:08.030609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:08.041946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:08.043922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:08.051805 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c422c131-bcf6-44f0-84be-4f7fcd15df7e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.187608 Oct 11 04:19:08.064493 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1180/2238] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:07 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:08.516850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:08.518251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:08.526970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:08.528017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:08.529178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:08.530123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:08.530829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:08.531637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:08.607351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9d6b3f1-3a7f-4918-8a63-44392b75fe53 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1949e5e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:08.691580 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d9d6b3f1-3a7f-4918-8a63-44392b75fe53 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.087854 Oct 11 04:19:08.692656 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1181/2239] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:08 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:08.746605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:08.759705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:08.761906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:08.764134 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c0de91f8-b111-4416-a916-cba673dfb349 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.251233 Oct 11 04:19:08.764746 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1059/2240] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:08 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:08.892284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-347f63ee-d4ac-46d0-a18b-f9cbab4d34e2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:08.893401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-347f63ee-d4ac-46d0-a18b-f9cbab4d34e2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:08.913654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-347f63ee-d4ac-46d0-a18b-f9cbab4d34e2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:08.914582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-347f63ee-d4ac-46d0-a18b-f9cbab4d34e2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:08.915307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-347f63ee-d4ac-46d0-a18b-f9cbab4d34e2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:08.916279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-347f63ee-d4ac-46d0-a18b-f9cbab4d34e2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:08.916957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-347f63ee-d4ac-46d0-a18b-f9cbab4d34e2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:08.917609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-347f63ee-d4ac-46d0-a18b-f9cbab4d34e2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:08.972879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0accfae8-863d-4e67-a170-11331473b30f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:08.973489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0accfae8-863d-4e67-a170-11331473b30f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:08.985621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0accfae8-863d-4e67-a170-11331473b30f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:08.986146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0accfae8-863d-4e67-a170-11331473b30f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:08.986710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0accfae8-863d-4e67-a170-11331473b30f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:08.987437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0accfae8-863d-4e67-a170-11331473b30f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:08.987920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0accfae8-863d-4e67-a170-11331473b30f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:08.988342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0accfae8-863d-4e67-a170-11331473b30f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:09.270735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-347f63ee-d4ac-46d0-a18b-f9cbab4d34e2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:09.281214 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-347f63ee-d4ac-46d0-a18b-f9cbab4d34e2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1809 microversion: 2.1 time: 0.393505 Oct 11 04:19:09.287715 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1182/2241] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:08 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1809 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:09.298841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0accfae8-863d-4e67-a170-11331473b30f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:09.299357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:09.300205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:09.313584 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0accfae8-863d-4e67-a170-11331473b30f tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3" status: 200 len: 1474 microversion: 2.1 time: 0.338876 Oct 11 04:19:09.313584 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1060/2242] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:08 2022] GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3 => generated 1474 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:09.314788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:09.314788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:09.314788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:09.314788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:09.314788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:09.314788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:09.446811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:09.455957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:09.462532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:09.473031 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4eed40a8-fa34-4a74-8ce6-18fb57ef7ceb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.189685 Oct 11 04:19:09.497023 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1183/2243] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:09 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:09.711359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-685005fd-e83e-48f2-a4c3-54cd272e5a93 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1a4d5700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:09.794801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:09.795762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:09.799824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:09.814985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:09.836076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:09.836076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:09.836076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:09.836076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:09.836076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:09.836998 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-685005fd-e83e-48f2-a4c3-54cd272e5a93 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.118576 Oct 11 04:19:09.836998 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1061/2244] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:09 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:10.080813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:10.092306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:10.094670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:10.096351 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-39f25e23-965e-4b4d-867d-6d2fc41f2b89 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.311371 Oct 11 04:19:10.097198 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1184/2245] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:09 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:19:10.310091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35ee411a-a7e2-4b5e-a4b1-adfabf310529 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:10.311205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-35ee411a-a7e2-4b5e-a4b1-adfabf310529 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:10.328178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ee411a-a7e2-4b5e-a4b1-adfabf310529 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:10.329061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ee411a-a7e2-4b5e-a4b1-adfabf310529 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:10.335152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6ff9d5ac-a409-49f1-aa20-e14733cd2ca9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:10.336011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6ff9d5ac-a409-49f1-aa20-e14733cd2ca9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:10.342689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ee411a-a7e2-4b5e-a4b1-adfabf310529 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:10.344425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ee411a-a7e2-4b5e-a4b1-adfabf310529 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:10.347272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ee411a-a7e2-4b5e-a4b1-adfabf310529 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:10.348817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ee411a-a7e2-4b5e-a4b1-adfabf310529 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:10.349791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ff9d5ac-a409-49f1-aa20-e14733cd2ca9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:10.352008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ff9d5ac-a409-49f1-aa20-e14733cd2ca9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:10.358212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ff9d5ac-a409-49f1-aa20-e14733cd2ca9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:10.358212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ff9d5ac-a409-49f1-aa20-e14733cd2ca9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:10.358212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ff9d5ac-a409-49f1-aa20-e14733cd2ca9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:10.358645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ff9d5ac-a409-49f1-aa20-e14733cd2ca9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:10.694602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6ff9d5ac-a409-49f1-aa20-e14733cd2ca9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:10.704989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6ff9d5ac-a409-49f1-aa20-e14733cd2ca9 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3" status: 200 len: 1474 microversion: 2.1 time: 0.374395 Oct 11 04:19:10.712366 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1185/2246] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:10 2022] GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3 => generated 1474 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:10.717469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:10.718983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:10.734544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:10.734809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:10.735450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:10.740945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:10.741493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:10.741855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:10.896565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35ee411a-a7e2-4b5e-a4b1-adfabf310529 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:10.897148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:10.907307 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35ee411a-a7e2-4b5e-a4b1-adfabf310529 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1809 microversion: 2.1 time: 0.603248 Oct 11 04:19:10.909130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:10.909349 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1062/2247] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:10 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1809 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:10.924907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:10.925112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bc07ed18-9ec0-4380-8e50-aa51989ec4d1 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1a4d51f0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:10.925868 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-35786b16-5854-4a36-a78a-5231c57679a0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.214294 Oct 11 04:19:10.934270 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1186/2248] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:10 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:11.128340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:11.129880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:11.139992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:11.140534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:11.140974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:11.146128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:11.146658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:11.147097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:11.536007 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bc07ed18-9ec0-4380-8e50-aa51989ec4d1 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.625406 Oct 11 04:19:11.547845 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1063/2249] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:10 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:11.554206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a7a41212-d93f-4fee-ac79-fdbd0cd6e5b8 req-dbd2266d-d0bd-4407-a925-cb8213fa8b71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61736a99-889e-47c3-a550-c4d48a359d38", "name": "network-vif-unplugged", "status": "completed", "tag": "7b0473ce-6e96-4d38-a5fb-767e4cf4c5b4"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:11.570333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a7a41212-d93f-4fee-ac79-fdbd0cd6e5b8 req-dbd2266d-d0bd-4407-a925-cb8213fa8b71 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:11.571152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a7a41212-d93f-4fee-ac79-fdbd0cd6e5b8 req-dbd2266d-d0bd-4407-a925-cb8213fa8b71 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:11.571755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a7a41212-d93f-4fee-ac79-fdbd0cd6e5b8 req-dbd2266d-d0bd-4407-a925-cb8213fa8b71 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:11.588728 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a7a41212-d93f-4fee-ac79-fdbd0cd6e5b8 req-dbd2266d-d0bd-4407-a925-cb8213fa8b71 service nova] Creating event network-vif-unplugged:7b0473ce-6e96-4d38-a5fb-767e4cf4c5b4 for instance 61736a99-889e-47c3-a550-c4d48a359d38 on n-h1-860892-1 Oct 11 04:19:11.598160 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a7a41212-d93f-4fee-ac79-fdbd0cd6e5b8 req-dbd2266d-d0bd-4407-a925-cb8213fa8b71 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048083 Oct 11 04:19:11.600172 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1064/2250] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:11.607524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-1f970cea-4e26-4c0d-af72-e88072235334 req-58f97b17-7c74-40b0-9f33-81b6de01296a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61736a99-889e-47c3-a550-c4d48a359d38", "name": "network-vif-deleted", "tag": "9cc3530c-ee2c-44b8-8d71-a9d5d999dfd1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:11.637971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1f970cea-4e26-4c0d-af72-e88072235334 req-58f97b17-7c74-40b0-9f33-81b6de01296a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:11.639307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1f970cea-4e26-4c0d-af72-e88072235334 req-58f97b17-7c74-40b0-9f33-81b6de01296a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:11.641029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1f970cea-4e26-4c0d-af72-e88072235334 req-58f97b17-7c74-40b0-9f33-81b6de01296a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:11.673150 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-1f970cea-4e26-4c0d-af72-e88072235334 req-58f97b17-7c74-40b0-9f33-81b6de01296a service nova] Creating event network-vif-deleted:9cc3530c-ee2c-44b8-8d71-a9d5d999dfd1 for instance 61736a99-889e-47c3-a550-c4d48a359d38 on n-h1-860892-1 Oct 11 04:19:11.680428 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-1f970cea-4e26-4c0d-af72-e88072235334 req-58f97b17-7c74-40b0-9f33-81b6de01296a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078574 Oct 11 04:19:11.681939 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1065/2251] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:11.741689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-884c5ddb-e648-4335-ae8a-4686d5e22f88 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:11.742359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-884c5ddb-e648-4335-ae8a-4686d5e22f88 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:11.760346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-884c5ddb-e648-4335-ae8a-4686d5e22f88 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:11.761329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-884c5ddb-e648-4335-ae8a-4686d5e22f88 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:11.761945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-884c5ddb-e648-4335-ae8a-4686d5e22f88 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:11.762902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-884c5ddb-e648-4335-ae8a-4686d5e22f88 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:11.763616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-884c5ddb-e648-4335-ae8a-4686d5e22f88 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:11.764412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-884c5ddb-e648-4335-ae8a-4686d5e22f88 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:11.783140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:11.792221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:11.793665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:11.794856 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-16b1c72c-6ac0-4735-81c4-fa3e33a91394 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.671222 Oct 11 04:19:11.802174 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1187/2252] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:11 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:19:12.076430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-884c5ddb-e648-4335-ae8a-4686d5e22f88 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:12.085500 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-884c5ddb-e648-4335-ae8a-4686d5e22f88 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3" status: 200 len: 1474 microversion: 2.1 time: 0.357526 Oct 11 04:19:12.087313 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1066/2253] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:11 2022] GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3 => generated 1474 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:12.096570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c2a7afa4-13b1-4fbf-ab71-b5e2d5f0a62d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:12.101852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c2a7afa4-13b1-4fbf-ab71-b5e2d5f0a62d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:12.129985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a7afa4-13b1-4fbf-ab71-b5e2d5f0a62d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:12.141527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a7afa4-13b1-4fbf-ab71-b5e2d5f0a62d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:12.143237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a7afa4-13b1-4fbf-ab71-b5e2d5f0a62d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:12.144934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a7afa4-13b1-4fbf-ab71-b5e2d5f0a62d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:12.147267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a7afa4-13b1-4fbf-ab71-b5e2d5f0a62d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:12.147776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2a7afa4-13b1-4fbf-ab71-b5e2d5f0a62d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:12.526811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "0c8e573c-9acd-43e8-9644-2e5a4f526b5c"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:12.539982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:12.575910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:12.588619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:12.589363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:12.596436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:12.602866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:12.604625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:12.816435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c2a7afa4-13b1-4fbf-ab71-b5e2d5f0a62d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:12.838810 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c2a7afa4-13b1-4fbf-ab71-b5e2d5f0a62d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1675 microversion: 2.1 time: 0.734797 Oct 11 04:19:12.843726 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1067/2254] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:12 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1675 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:12.867488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:12.877487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:12.905386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:12.905938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:12.908271 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] HTTP exception thrown: Volume 0c8e573c-9acd-43e8-9644-2e5a4f526b5c could not be found. Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Request method failure captured: Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments/a40fbd2f-60e1-4b67-ba10-2aab10ca5b70 HTTP/1.1 Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 74 Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5ls00C43WuMxynuWXqJVCZam86oolrL8KgsKtyCagylBlfqfDTgf5RyJN22Frzm_6nnVzg1WiskTys9CFbZJFt7HuR937zP2yDklUZzKRJzexinvdyobRWQz_IZTn201EOBTO55n9ya4Is6rzMGfWeWeRrPVN45S6TUq3ztKaAstk Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4adf4a31b1f8424eb8678c056e79f76f Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesAdminNegativeTest-924255475 Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4adf4a31b1f8424eb8678c056e79f76f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4adf4a31b1f8424eb8678c056e79f76f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4adf4a31b1f8424eb8678c056e79f76f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4adf4a31b1f8424eb8678c056e79f76f"}]}] Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesAdminNegativeTest-924255475 Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4adf4a31b1f8424eb8678c056e79f76f Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-924255475 Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesAdminNegativeTest-924255475-project-admin Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: d47d177636994e9f98d929b77c0ea5c7 Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesAdminNegativeTest-924255475-project-admin Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: {"volumeAttachment": {"volumeId": "0c8e573c-9acd-43e8-9644-2e5a4f526b5c"}} Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: exception: Volume 0c8e573c-9acd-43e8-9644-2e5a4f526b5c could not be found. Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'server_id': '244c7407-4845-4274-aa34-493231a9d453', 'id': 'a40fbd2f-60e1-4b67-ba10-2aab10ca5b70', 'body': {'volumeAttachment': {'volumeId': '0c8e573c-9acd-43e8-9644-2e5a4f526b5c'}}} Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0c8e573c-9acd-43e8-9644-2e5a4f526b5c could not be found. (HTTP 404) (Request-ID: req-cacb4efe-6e5f-4237-b60b-b0b4c3c755df) Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 04:19:12.911022 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0c8e573c-9acd-43e8-9644-2e5a4f526b5c could not be found. Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 0c8e573c-9acd-43e8-9644-2e5a4f526b5c could not be found. Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0c8e573c-9acd-43e8-9644-2e5a4f526b5c could not be found. Oct 11 04:19:12.916406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:12.925968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:12.925968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:12.925968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:12.925968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:12.929692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Returning 400 to user: Volume 0c8e573c-9acd-43e8-9644-2e5a4f526b5c could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:12.930907 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7dbb6c00-9819-41c2-b477-91293a92e2d3 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments/a40fbd2f-60e1-4b67-ba10-2aab10ca5b70" status: 400 len: 107 microversion: 2.1 time: 1.080440 Oct 11 04:19:12.935406 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1188/2255] 10.222.0.26 () {60 vars in 1433 bytes} [Tue Oct 11 04:19:11 2022] PUT /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments/a40fbd2f-60e1-4b67-ba10-2aab10ca5b70 => generated 107 bytes in 1086 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:19:12.946492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fdb4cdc7-2e2a-4bda-94df-556c145e6d29 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19414430>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:12.949397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:13.264724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:13.274836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:13.276292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:13.307159 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9bcb1a39-9717-4e2e-a750-cbb6a691df9b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.459573 Oct 11 04:19:13.309920 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1068/2256] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:12 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:13.327998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:13.333064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:13.355800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:13.357680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:13.361675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:13.361675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:13.361675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:13.368168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:13.738128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:13.759672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:13.767078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:13.769101 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eecc205f-d36f-4677-9028-5181b2725abd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.457665 Oct 11 04:19:13.792948 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1069/2257] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:13 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:13.801004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d9e32bec-511a-4f6d-8af5-461b7e35a98b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:13.805023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d9e32bec-511a-4f6d-8af5-461b7e35a98b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:13.820854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9e32bec-511a-4f6d-8af5-461b7e35a98b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:13.821854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9e32bec-511a-4f6d-8af5-461b7e35a98b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:13.822602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9e32bec-511a-4f6d-8af5-461b7e35a98b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:13.823521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9e32bec-511a-4f6d-8af5-461b7e35a98b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:13.826813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9e32bec-511a-4f6d-8af5-461b7e35a98b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:13.827682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9e32bec-511a-4f6d-8af5-461b7e35a98b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:14.094470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-d9e32bec-511a-4f6d-8af5-461b7e35a98b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lazy-loading 'services' on Instance uuid 244c7407-4845-4274-aa34-493231a9d453 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:14.695746 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d9e32bec-511a-4f6d-8af5-461b7e35a98b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "DELETE /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments/a40fbd2f-60e1-4b67-ba10-2aab10ca5b70" status: 202 len: 0 microversion: 2.1 time: 0.784519 Oct 11 04:19:14.695746 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1070/2258] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:19:13 2022] DELETE /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments/a40fbd2f-60e1-4b67-ba10-2aab10ca5b70 => generated 0 bytes in 786 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:19:14.695746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:14.695746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:14.695746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:14.695746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:14.695746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:14.695746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:14.695746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:14.695746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:14.754654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:14.756597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:14.757338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:14.757803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lazy-loading 'fault' on Instance uuid 50866ec2-e637-49e6-a467-926c4fc44ab3 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:14.889092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:14.929779 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c0869c8b-aa51-4a5b-9164-18278145a173 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3" status: 200 len: 1309 microversion: 2.1 time: 0.345124 Oct 11 04:19:14.930433 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1071/2259] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:14 2022] GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3 => generated 1309 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:14.950258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c90ff38b-0d18-46f2-8de0-c90c3bff43ef req-6d9f5257-561f-4644-bc9f-2fce2dae4d52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b31eca0-f0fd-4aee-bbc8-f337cf296ea0", "name": "network-vif-deleted", "tag": "643bc099-b3db-4c14-80a2-6176e9969a13"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:14.975844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:15.000304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c90ff38b-0d18-46f2-8de0-c90c3bff43ef req-6d9f5257-561f-4644-bc9f-2fce2dae4d52 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:15.008251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c90ff38b-0d18-46f2-8de0-c90c3bff43ef req-6d9f5257-561f-4644-bc9f-2fce2dae4d52 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:15.010714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c90ff38b-0d18-46f2-8de0-c90c3bff43ef req-6d9f5257-561f-4644-bc9f-2fce2dae4d52 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:15.077447 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c90ff38b-0d18-46f2-8de0-c90c3bff43ef req-6d9f5257-561f-4644-bc9f-2fce2dae4d52 service nova] Creating event network-vif-deleted:643bc099-b3db-4c14-80a2-6176e9969a13 for instance 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 on n-h1-860892-1 Oct 11 04:19:15.096761 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c90ff38b-0d18-46f2-8de0-c90c3bff43ef req-6d9f5257-561f-4644-bc9f-2fce2dae4d52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.160410 Oct 11 04:19:15.107216 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1072/2260] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:15.123434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-bb667a55-6303-48c4-a39c-d72561156f4c req-6ab0f13b-6c71-4303-93cc-036f9e516327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61736a99-889e-47c3-a550-c4d48a359d38", "name": "network-vif-unplugged", "status": "completed", "tag": "f5dd1ecd-f19a-4800-b863-7e7cfe9bc66c"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:15.166060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bb667a55-6303-48c4-a39c-d72561156f4c req-6ab0f13b-6c71-4303-93cc-036f9e516327 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:15.168695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bb667a55-6303-48c4-a39c-d72561156f4c req-6ab0f13b-6c71-4303-93cc-036f9e516327 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:15.169363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bb667a55-6303-48c4-a39c-d72561156f4c req-6ab0f13b-6c71-4303-93cc-036f9e516327 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:15.291026 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-bb667a55-6303-48c4-a39c-d72561156f4c req-6ab0f13b-6c71-4303-93cc-036f9e516327 service nova] Creating event network-vif-unplugged:f5dd1ecd-f19a-4800-b863-7e7cfe9bc66c for instance 61736a99-889e-47c3-a550-c4d48a359d38 on n-h1-860892-1 Oct 11 04:19:15.427912 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-bb667a55-6303-48c4-a39c-d72561156f4c req-6ab0f13b-6c71-4303-93cc-036f9e516327 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.193587 Oct 11 04:19:15.427912 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1073/2261] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:15.427912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef7bb5c0-00dc-4e74-af25-b1c11cbe0b85 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:15.427912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef7bb5c0-00dc-4e74-af25-b1c11cbe0b85 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:15.427912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7bb5c0-00dc-4e74-af25-b1c11cbe0b85 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:15.427912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7bb5c0-00dc-4e74-af25-b1c11cbe0b85 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:15.427912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7bb5c0-00dc-4e74-af25-b1c11cbe0b85 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:15.427912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7bb5c0-00dc-4e74-af25-b1c11cbe0b85 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:15.427912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7bb5c0-00dc-4e74-af25-b1c11cbe0b85 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:15.427912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef7bb5c0-00dc-4e74-af25-b1c11cbe0b85 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:15.455655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef7bb5c0-00dc-4e74-af25-b1c11cbe0b85 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:15.464859 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef7bb5c0-00dc-4e74-af25-b1c11cbe0b85 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1298 microversion: 2.1 time: 0.144373 Oct 11 04:19:15.482876 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1074/2262] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:15 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1298 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:15.491983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-1cb2f95e-99b1-4947-b63c-74ec143def12 req-87b097a7-7fc8-446a-8fc8-f7755a8838f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61736a99-889e-47c3-a550-c4d48a359d38", "name": "network-vif-deleted", "tag": "7b0473ce-6e96-4d38-a5fb-767e4cf4c5b4"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:15.503332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1cb2f95e-99b1-4947-b63c-74ec143def12 req-87b097a7-7fc8-446a-8fc8-f7755a8838f5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:15.504583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1cb2f95e-99b1-4947-b63c-74ec143def12 req-87b097a7-7fc8-446a-8fc8-f7755a8838f5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:15.505260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1cb2f95e-99b1-4947-b63c-74ec143def12 req-87b097a7-7fc8-446a-8fc8-f7755a8838f5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:15.519399 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-1cb2f95e-99b1-4947-b63c-74ec143def12 req-87b097a7-7fc8-446a-8fc8-f7755a8838f5 service nova] Creating event network-vif-deleted:7b0473ce-6e96-4d38-a5fb-767e4cf4c5b4 for instance 61736a99-889e-47c3-a550-c4d48a359d38 on n-h1-860892-1 Oct 11 04:19:15.525145 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-1cb2f95e-99b1-4947-b63c-74ec143def12 req-87b097a7-7fc8-446a-8fc8-f7755a8838f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040297 Oct 11 04:19:15.528663 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1075/2263] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:15.536324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:15.538310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:15.545474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:15.546504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:15.547341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:15.548506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:15.549219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:15.549958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:15.656312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:15.697792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:15.704598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:15.723682 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f2cba56a-71bd-4807-8709-915f50e44dc6 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.193181 Oct 11 04:19:15.726209 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1076/2264] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:15 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:15.734182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6848de85-3ef8-4621-abcf-6bba2ade6e8c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:15.737500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6848de85-3ef8-4621-abcf-6bba2ade6e8c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:15.754603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6848de85-3ef8-4621-abcf-6bba2ade6e8c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:15.759157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6848de85-3ef8-4621-abcf-6bba2ade6e8c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:15.759893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6848de85-3ef8-4621-abcf-6bba2ade6e8c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:15.760845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6848de85-3ef8-4621-abcf-6bba2ade6e8c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:15.761628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6848de85-3ef8-4621-abcf-6bba2ade6e8c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:15.762477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6848de85-3ef8-4621-abcf-6bba2ade6e8c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:15.903262 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6848de85-3ef8-4621-abcf-6bba2ade6e8c tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091569 Oct 11 04:19:15.903262 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1077/2265] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:19:15 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:15.903262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:15.903262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:15.903262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:15.903262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:15.903262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:15.903262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:15.903262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:15.903262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:15.993188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:16.002670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:16.004513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:16.005914 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-42f106ce-4b80-4968-b37e-15d918c01e42 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.183803 Oct 11 04:19:16.024651 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1078/2266] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:15 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:16.034554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:16.035297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:16.043891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:16.044918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:16.049346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:16.051068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:16.052077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:16.053064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:16.148264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:16.148767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:16.149207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:16.149670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lazy-loading 'fault' on Instance uuid 50866ec2-e637-49e6-a467-926c4fc44ab3 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:16.235183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:16.243444 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-beb9de98-6c9d-4293-8427-ab9969dc204d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3" status: 200 len: 1309 microversion: 2.1 time: 0.235288 Oct 11 04:19:16.258657 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1079/2267] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:16 2022] GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3 => generated 1309 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:16.496076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:16.497489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:16.510371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:16.510797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:16.511239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:16.511947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:16.512403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:16.512829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:16.610673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:16.616181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:16.616907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:16.620665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lazy-loading 'fault' on Instance uuid 61736a99-889e-47c3-a550-c4d48a359d38 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:16.773444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:16.795364 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a51212fa-3a5c-470a-a55f-3a1a89e959ae tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 200 len: 1303 microversion: 2.1 time: 0.302230 Oct 11 04:19:16.798143 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1080/2268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:16 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 1303 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:16.820431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:16.824962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:16.848832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:16.849508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:16.850081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:16.851868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:16.855254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:16.855934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.009657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:17.020774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:17.032906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:17.058461 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-16ac290a-698b-4d5b-bf0a-17b20816d24f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.257710 Oct 11 04:19:17.059289 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1081/2269] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:16 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:17.080008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8191ed3-2cff-4bf8-8fc7-fbc40fb11a7b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:17.082269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d8191ed3-2cff-4bf8-8fc7-fbc40fb11a7b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:17.102018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8191ed3-2cff-4bf8-8fc7-fbc40fb11a7b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.102018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8191ed3-2cff-4bf8-8fc7-fbc40fb11a7b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.102018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8191ed3-2cff-4bf8-8fc7-fbc40fb11a7b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.102765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8191ed3-2cff-4bf8-8fc7-fbc40fb11a7b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.103236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8191ed3-2cff-4bf8-8fc7-fbc40fb11a7b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.103689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8191ed3-2cff-4bf8-8fc7-fbc40fb11a7b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.165933 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8191ed3-2cff-4bf8-8fc7-fbc40fb11a7b tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.101488 Oct 11 04:19:17.171820 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1082/2270] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:19:17 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:17.175748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:17.176361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:17.189491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.189988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.191686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.192500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.193213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.193412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.506717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:17.516297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:17.525042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:17.529146 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9af82fd4-c43a-4482-b708-e6728b9af0d2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.361184 Oct 11 04:19:17.532654 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1083/2271] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:17 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:17.544365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ae307447-07f7-4295-b387-5d951f881605 req-f4f91d05-f400-478b-b1d5-c92fc75677ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50866ec2-e637-49e6-a467-926c4fc44ab3", "name": "network-vif-deleted", "tag": "7921604d-afba-4e2c-8179-da186a45915f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:17.567528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ae307447-07f7-4295-b387-5d951f881605 req-f4f91d05-f400-478b-b1d5-c92fc75677ae service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.568573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ae307447-07f7-4295-b387-5d951f881605 req-f4f91d05-f400-478b-b1d5-c92fc75677ae service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.569001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ae307447-07f7-4295-b387-5d951f881605 req-f4f91d05-f400-478b-b1d5-c92fc75677ae service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.605590 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ae307447-07f7-4295-b387-5d951f881605 req-f4f91d05-f400-478b-b1d5-c92fc75677ae service nova] Creating event network-vif-deleted:7921604d-afba-4e2c-8179-da186a45915f for instance 50866ec2-e637-49e6-a467-926c4fc44ab3 on n-h1-860892-1 Oct 11 04:19:17.615035 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ae307447-07f7-4295-b387-5d951f881605 req-f4f91d05-f400-478b-b1d5-c92fc75677ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079767 Oct 11 04:19:17.615712 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1084/2272] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:17.630672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:17.639181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 50866ec2-e637-49e6-a467-926c4fc44ab3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:17.645811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.648070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.648514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.649232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.652046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.652506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.680664 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] HTTP exception thrown: Instance 50866ec2-e637-49e6-a467-926c4fc44ab3 could not be found. Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Request method failure captured: Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3 HTTP/1.1 Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO3xJXCBhEGz9pquTeHR3Z4uPzScU9Bl2FfbCNjHEtjlF80EOUSHIxN0oNgNxYRHiHvNBPZ-LEU09Z_ToTUzi6jAb29jy8QXDKpNRY9vBfE3J97u5PqmcxSvRwRtzleSINQtHli-jTadjh2DKl2QS3gYb5ZfaH6limXNvfwfaps0JgA Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}] Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: db33edccb2504185928613257e64cdb4 Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 50866ec2-e637-49e6-a467-926c4fc44ab3 could not be found. Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '50866ec2-e637-49e6-a467-926c4fc44ab3'} Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50866ec2-e637-49e6-a467-926c4fc44ab3 could not be found. Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50866ec2-e637-49e6-a467-926c4fc44ab3 could not be found. Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:17.684808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:17.688388 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:17.688388 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:17.688388 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:17.688388 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:19:17.688388 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:19:17.688388 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50866ec2-e637-49e6-a467-926c4fc44ab3 could not be found. Oct 11 04:19:17.688388 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:17.688388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Returning 404 to user: Instance 50866ec2-e637-49e6-a467-926c4fc44ab3 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:17.688388 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-550d59ab-df3f-4684-8188-3c4b8eb06df6 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3" status: 404 len: 111 microversion: 2.1 time: 0.066277 Oct 11 04:19:17.688388 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1085/2273] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:17 2022] GET /compute/v2.1/servers/50866ec2-e637-49e6-a467-926c4fc44ab3 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:19:17.705564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-920d37a0-0cf1-491c-a6e9-7688ede61819 req-5e1ef48b-c1bb-4547-ac7b-6d30309c7b1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61736a99-889e-47c3-a550-c4d48a359d38", "name": "network-vif-deleted", "tag": "f5dd1ecd-f19a-4800-b863-7e7cfe9bc66c"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:17.717528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-920d37a0-0cf1-491c-a6e9-7688ede61819 req-5e1ef48b-c1bb-4547-ac7b-6d30309c7b1e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.718025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-920d37a0-0cf1-491c-a6e9-7688ede61819 req-5e1ef48b-c1bb-4547-ac7b-6d30309c7b1e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.718518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-920d37a0-0cf1-491c-a6e9-7688ede61819 req-5e1ef48b-c1bb-4547-ac7b-6d30309c7b1e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.731910 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-920d37a0-0cf1-491c-a6e9-7688ede61819 req-5e1ef48b-c1bb-4547-ac7b-6d30309c7b1e service nova] Creating event network-vif-deleted:f5dd1ecd-f19a-4800-b863-7e7cfe9bc66c for instance 61736a99-889e-47c3-a550-c4d48a359d38 on n-h1-860892-1 Oct 11 04:19:17.737014 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-920d37a0-0cf1-491c-a6e9-7688ede61819 req-5e1ef48b-c1bb-4547-ac7b-6d30309c7b1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042580 Oct 11 04:19:17.737988 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1086/2274] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:17.743296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:17.744143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:17.751144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.751628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.752177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.755189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.755189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.755189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.772652 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] HTTP exception thrown: Instance 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 could not be found. Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Request method failure captured: Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 HTTP/1.1 Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO3xJXCBhEGz9pquTeHR3Z4uPzScU9Bl2FfbCNjHEtjlF80EOUSHIxN0oNgNxYRHiHvNBPZ-LEU09Z_ToTUzi6jAb29jy8QXDKpNRY9vBfE3J97u5PqmcxSvRwRtzleSINQtHli-jTadjh2DKl2QS3gYb5ZfaH6limXNvfwfaps0JgA Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}] Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: db33edccb2504185928613257e64cdb4 Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 could not be found. Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '6b31eca0-f0fd-4aee-bbc8-f337cf296ea0'} Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 could not be found. Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 could not be found. Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:17.774338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:17.777786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:17.777786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:17.777786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:17.777786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:19:17.777786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:19:17.777786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 could not be found. Oct 11 04:19:17.777786 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:17.777786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Returning 404 to user: Instance 6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:17.777786 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-859ee8a4-b367-4642-87a1-9bd84d52578b tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0" status: 404 len: 111 microversion: 2.1 time: 0.036673 Oct 11 04:19:17.777786 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1087/2275] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:17 2022] GET /compute/v2.1/servers/6b31eca0-f0fd-4aee-bbc8-f337cf296ea0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:19:17.792533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7298c558-029d-445e-a2b2-4e4c6f52c0b4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:17.927832 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7298c558-029d-445e-a2b2-4e4c6f52c0b4 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/9ca972c2-753f-4d2d-a1a6-2b819b624a49" status: 204 len: 0 microversion: 2.1 time: 0.144808 Oct 11 04:19:17.928433 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1088/2276] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:19:17 2022] DELETE /compute/v2.1/os-server-groups/9ca972c2-753f-4d2d-a1a6-2b819b624a49 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:19:17.933310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:17.937393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:17.951703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.952254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.953883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.954967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:17.955432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:17.955854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:17.987120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:18.017037 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] HTTP exception thrown: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Request method failure captured: Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 HTTP/1.1 Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO6BApuWzfdKAuDVL54_c4Bu9f3S9gCDTpDqpflazWKUNVKZRP4JYeUhkI1X1UAEtdvraTJDaIjXYDnqRq7a-VfHg3hPMqyDlwU0k1En-E2Tg1Zwa28RSmMMuGtBchyXal8PHLPSeWx7S3K2MKDmCxHfWmWKv-t0tyyIW1XzbW7bwh8 Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}] Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestMultiNic-1320793675 Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 2bc397bbbb204dfd9494ec2a6ee020a8 Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '61736a99-889e-47c3-a550-c4d48a359d38'} Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:18.019105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Returning 404 to user: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4386cc54-ac76-474d-8a28-9c3e9c4ac5f0 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 404 len: 111 microversion: 2.1 time: 0.092579 Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1089/2277] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:17 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eef02a5a-80d7-4653-9688-e975f1f183ed tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eef02a5a-80d7-4653-9688-e975f1f183ed tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eef02a5a-80d7-4653-9688-e975f1f183ed tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eef02a5a-80d7-4653-9688-e975f1f183ed tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eef02a5a-80d7-4653-9688-e975f1f183ed tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eef02a5a-80d7-4653-9688-e975f1f183ed tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eef02a5a-80d7-4653-9688-e975f1f183ed tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:18.099679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eef02a5a-80d7-4653-9688-e975f1f183ed tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:18.148356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eef02a5a-80d7-4653-9688-e975f1f183ed tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:19:19.040351 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eef02a5a-80d7-4653-9688-e975f1f183ed tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 204 len: 0 microversion: 2.1 time: 1.015577 Oct 11 04:19:19.041785 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1090/2278] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:19:18 2022] DELETE /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 0 bytes in 1017 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:19:19.050301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:19.051012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:19.084135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:19.084563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:19.085009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:19.085749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:19.086219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:19.086646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:20.043290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:20.049711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:20.053243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:20.065866 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ab5b74bc-3857-4526-b144-8a40077c74fb tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 1.022808 Oct 11 04:19:20.066805 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1091/2279] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:19 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 1024 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:20.071760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-315e4e2f-b47c-4c83-a873-1bc9e3b789de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:20.083866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-315e4e2f-b47c-4c83-a873-1bc9e3b789de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:20.104386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315e4e2f-b47c-4c83-a873-1bc9e3b789de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:20.105746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315e4e2f-b47c-4c83-a873-1bc9e3b789de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:20.106388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315e4e2f-b47c-4c83-a873-1bc9e3b789de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:20.107252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315e4e2f-b47c-4c83-a873-1bc9e3b789de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:20.109260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315e4e2f-b47c-4c83-a873-1bc9e3b789de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:20.109848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315e4e2f-b47c-4c83-a873-1bc9e3b789de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:20.231072 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-315e4e2f-b47c-4c83-a873-1bc9e3b789de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.162951 Oct 11 04:19:20.239557 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1092/2280] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:19:20 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments => generated 197 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:20.252753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:20.254689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:20.270646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:20.274563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:20.274563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:20.274563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:20.274563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:20.274563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:21.785707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:21.804898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:21.816136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:21.818490 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dfb37546-01e0-4906-ac7e-87388c25b30c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 1.576503 Oct 11 04:19:21.819083 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1093/2281] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:20 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 1579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:21.867490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-137a12f7-b078-4bd6-8586-60629664235d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:21.870025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-137a12f7-b078-4bd6-8586-60629664235d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:21.899720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-137a12f7-b078-4bd6-8586-60629664235d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:21.902913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-137a12f7-b078-4bd6-8586-60629664235d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:21.904410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-137a12f7-b078-4bd6-8586-60629664235d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:21.905167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-137a12f7-b078-4bd6-8586-60629664235d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:21.905682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-137a12f7-b078-4bd6-8586-60629664235d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:21.906081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-137a12f7-b078-4bd6-8586-60629664235d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:22.473048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-137a12f7-b078-4bd6-8586-60629664235d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:22.482177 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-137a12f7-b078-4bd6-8586-60629664235d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1472 microversion: 2.1 time: 0.639467 Oct 11 04:19:22.504540 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1094/2282] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:21 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1472 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:22.537728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c7899bce-e6bb-4efd-b28f-530e5f202cd8 req-0b1ce345-983f-4b71-811c-9bd044614c29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d993e3f-2858-478c-941e-7d874a4fcb5e", "name": "network-vif-unplugged", "status": "completed", "tag": "0d27cdb1-7b14-44cb-b024-b149b4ec43ab"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:22.589017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c7899bce-e6bb-4efd-b28f-530e5f202cd8 req-0b1ce345-983f-4b71-811c-9bd044614c29 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:22.594832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c7899bce-e6bb-4efd-b28f-530e5f202cd8 req-0b1ce345-983f-4b71-811c-9bd044614c29 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:22.595283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c7899bce-e6bb-4efd-b28f-530e5f202cd8 req-0b1ce345-983f-4b71-811c-9bd044614c29 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:22.628677 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c7899bce-e6bb-4efd-b28f-530e5f202cd8 req-0b1ce345-983f-4b71-811c-9bd044614c29 service nova] Creating event network-vif-unplugged:0d27cdb1-7b14-44cb-b024-b149b4ec43ab for instance 7d993e3f-2858-478c-941e-7d874a4fcb5e on n-h1-860892-1 Oct 11 04:19:22.642165 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c7899bce-e6bb-4efd-b28f-530e5f202cd8 req-0b1ce345-983f-4b71-811c-9bd044614c29 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.135500 Oct 11 04:19:22.645293 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1095/2283] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:22.660613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:22.661356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:22.672132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:22.672637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:22.673076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:22.673957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:22.674527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:22.674998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:22.709938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:22.759448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:22.770362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:22.771861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:22.777887 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f3f9bb8-31db-4671-bdfd-f3b274a2170e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.126800 Oct 11 04:19:22.778492 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1096/2284] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:22 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:22.794237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-59a84bcb-6824-4e35-a36d-f2d91d312cb6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:22.796556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-59a84bcb-6824-4e35-a36d-f2d91d312cb6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:22.805895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59a84bcb-6824-4e35-a36d-f2d91d312cb6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:22.809672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59a84bcb-6824-4e35-a36d-f2d91d312cb6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:22.810177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59a84bcb-6824-4e35-a36d-f2d91d312cb6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:22.810947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59a84bcb-6824-4e35-a36d-f2d91d312cb6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:22.811432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59a84bcb-6824-4e35-a36d-f2d91d312cb6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:22.811849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59a84bcb-6824-4e35-a36d-f2d91d312cb6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:22.900553 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-59a84bcb-6824-4e35-a36d-f2d91d312cb6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.120687 Oct 11 04:19:22.901983 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1097/2285] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:19:22 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments => generated 197 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:22.924551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:22.925619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:22.959261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:22.959829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:22.960339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:22.961030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:22.961491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:22.961920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:23.119089 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fdb4cdc7-2e2a-4bda-94df-556c145e6d29 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 10.181955 Oct 11 04:19:23.139668 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1189/2286] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:12 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 10203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:23.321083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=11 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:23.327188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2a78b81f-47c4-4c31-a89d-cd4cdb94ab21 req-afb6f183-4195-488c-b175-7e0e35d71e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b997d21c-b814-4e0c-aba4-53ea4b3c590b", "name": "network-vif-deleted", "tag": "dd60a4e4-6300-4a22-a81f-9f24c68978fb"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:23.343420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2a78b81f-47c4-4c31-a89d-cd4cdb94ab21 req-afb6f183-4195-488c-b175-7e0e35d71e97 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:23.347704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2a78b81f-47c4-4c31-a89d-cd4cdb94ab21 req-afb6f183-4195-488c-b175-7e0e35d71e97 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:23.348442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2a78b81f-47c4-4c31-a89d-cd4cdb94ab21 req-afb6f183-4195-488c-b175-7e0e35d71e97 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:23.383904 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2a78b81f-47c4-4c31-a89d-cd4cdb94ab21 req-afb6f183-4195-488c-b175-7e0e35d71e97 service nova] Creating event network-vif-deleted:dd60a4e4-6300-4a22-a81f-9f24c68978fb for instance b997d21c-b814-4e0c-aba4-53ea4b3c590b on n-h2-860892-1 Oct 11 04:19:23.397668 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2a78b81f-47c4-4c31-a89d-cd4cdb94ab21 req-afb6f183-4195-488c-b175-7e0e35d71e97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076971 Oct 11 04:19:23.398630 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1190/2287] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:19:23.454290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:23.467020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:23.472165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:23.472165 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-61fc31ad-f602-4766-865e-55e2a5349470 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.568582 Oct 11 04:19:23.486770 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1098/2288] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:22 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:23.517237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d149b921-6fd4-40b2-9097-a26560bb453d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:23.518063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d149b921-6fd4-40b2-9097-a26560bb453d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:23.536967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d149b921-6fd4-40b2-9097-a26560bb453d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:23.541285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d149b921-6fd4-40b2-9097-a26560bb453d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:23.541285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d149b921-6fd4-40b2-9097-a26560bb453d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:23.545973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d149b921-6fd4-40b2-9097-a26560bb453d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:23.546912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d149b921-6fd4-40b2-9097-a26560bb453d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:23.547670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d149b921-6fd4-40b2-9097-a26560bb453d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:23.730049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d149b921-6fd4-40b2-9097-a26560bb453d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:23.740354 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d149b921-6fd4-40b2-9097-a26560bb453d tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1430 microversion: 2.1 time: 0.227837 Oct 11 04:19:23.740904 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1191/2289] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:23 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1430 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:23.840121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:23.840696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:23.854590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:23.857516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:23.858071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:23.859238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:23.861789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:23.862342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:23.917351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8750d6ce-f10c-4627-8c14-a2fd4a56cefe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:23.924083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8750d6ce-f10c-4627-8c14-a2fd4a56cefe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:23.940140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8750d6ce-f10c-4627-8c14-a2fd4a56cefe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:23.942799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8750d6ce-f10c-4627-8c14-a2fd4a56cefe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:23.943387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8750d6ce-f10c-4627-8c14-a2fd4a56cefe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:23.949920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8750d6ce-f10c-4627-8c14-a2fd4a56cefe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:23.950730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8750d6ce-f10c-4627-8c14-a2fd4a56cefe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:23.951498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8750d6ce-f10c-4627-8c14-a2fd4a56cefe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:23.989058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:24.002705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:24.005662 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8750d6ce-f10c-4627-8c14-a2fd4a56cefe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093018 Oct 11 04:19:24.005972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:24.007055 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1192/2290] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:19:23 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:24.019156 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f1e08f7-4228-4faf-9fe1-ea33d3c7eb07 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.183744 Oct 11 04:19:24.023125 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1099/2291] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:23 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:24.148508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ed3322b5-948e-4de1-8028-f3df6440b849 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda194ac0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:24.234615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ed3322b5-948e-4de1-8028-f3df6440b849 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.088681 Oct 11 04:19:24.242814 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1193/2292] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:24 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:24.510591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:24.516066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:24.550270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:24.551859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:24.557980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:24.561763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:24.565677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:24.569179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:24.689018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b1fe191b-c747-4972-88d1-25500dfccb05 req-b9fcad4b-6efe-49cd-8aba-d6a3c31bcac2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d993e3f-2858-478c-941e-7d874a4fcb5e", "tag": "0d27cdb1-7b14-44cb-b024-b149b4ec43ab"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:24.716391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b1fe191b-c747-4972-88d1-25500dfccb05 req-b9fcad4b-6efe-49cd-8aba-d6a3c31bcac2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:24.716887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b1fe191b-c747-4972-88d1-25500dfccb05 req-b9fcad4b-6efe-49cd-8aba-d6a3c31bcac2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:24.717315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b1fe191b-c747-4972-88d1-25500dfccb05 req-b9fcad4b-6efe-49cd-8aba-d6a3c31bcac2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:24.747953 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b1fe191b-c747-4972-88d1-25500dfccb05 req-b9fcad4b-6efe-49cd-8aba-d6a3c31bcac2 service nova] Creating event network-changed:0d27cdb1-7b14-44cb-b024-b149b4ec43ab for instance 7d993e3f-2858-478c-941e-7d874a4fcb5e on n-h1-860892-1 Oct 11 04:19:24.758931 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b1fe191b-c747-4972-88d1-25500dfccb05 req-b9fcad4b-6efe-49cd-8aba-d6a3c31bcac2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075400 Oct 11 04:19:24.762955 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1194/2293] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:19:24.776683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:24.780369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:24.797343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:24.798097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:24.798799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:24.799730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:24.802298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:24.802980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:24.816928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:24.826965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:24.836763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:24.838521 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cac87ef2-3077-46b0-b440-e89a7ebd006b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.344080 Oct 11 04:19:24.839674 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1100/2294] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:24 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:24.892558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:24.894005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:24.894587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:24.895421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lazy-loading 'fault' on Instance uuid b997d21c-b814-4e0c-aba4-53ea4b3c590b {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:25.017475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:25.018752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb1c2141-f8c3-42b4-a940-ee52aeea47cd tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:25.021686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cb1c2141-f8c3-42b4-a940-ee52aeea47cd tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:25.029270 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bf4fe870-a4a4-4e8b-9ccd-666b00c54ddb tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1307 microversion: 2.1 time: 0.264807 Oct 11 04:19:25.029850 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1195/2295] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:24 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1307 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:25.035649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1c2141-f8c3-42b4-a940-ee52aeea47cd tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:25.039654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1c2141-f8c3-42b4-a940-ee52aeea47cd tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:25.040237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1c2141-f8c3-42b4-a940-ee52aeea47cd tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:25.041485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1c2141-f8c3-42b4-a940-ee52aeea47cd tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:25.042105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1c2141-f8c3-42b4-a940-ee52aeea47cd tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:25.043672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1c2141-f8c3-42b4-a940-ee52aeea47cd tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:25.048697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:25.049490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:25.062579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:25.065756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:25.066416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:25.069189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:25.075186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:25.076725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:25.141454 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cb1c2141-f8c3-42b4-a940-ee52aeea47cd tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.126687 Oct 11 04:19:25.147296 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1101/2296] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:19:25 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453/os-volume_attachments => generated 25 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:19:25.266387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9cdde354-c358-4d28-8c28-2aa44d75df2e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19a880d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:25.342214 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9cdde354-c358-4d28-8c28-2aa44d75df2e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.085379 Oct 11 04:19:25.342949 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1102/2297] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:25 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:25.437516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-66767320", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "331d8dc4-11af-4aab-8523-7e72106c91b8"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:25.539780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] validate_networks() for [('331d8dc4-11af-4aab-8523-7e72106c91b8', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:19:25.669532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:25.688685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:25.690241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:25.706538 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d0fac2c-0ef3-4f62-b716-3a4bc09f912f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.661210 Oct 11 04:19:25.723213 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1196/2298] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:25 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:25.866648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:25.867640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:25.879756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:25.881263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:25.881761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:25.882595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:25.883248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:25.883744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:26.261049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:26.281271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:26.289078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:26.290064 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f4d955bc-3dc7-4548-bea9-8295ab6bbda2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.429717 Oct 11 04:19:26.290785 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1197/2299] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:25 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:19:26.296277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:26.297209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:26.335920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:26.336443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:26.337196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:26.337737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:26.338453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:26.339022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:26.410604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:26.416822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:26.417471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:26.418549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lazy-loading 'fault' on Instance uuid b997d21c-b814-4e0c-aba4-53ea4b3c590b {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:26.651792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'db33edccb2504185928613257e64cdb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '89c92233d372409b9c1ce4ae94eeeab7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:26.670301 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9355d78c-22aa-4c52-a181-27787909178a tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 200 len: 1307 microversion: 2.1 time: 0.377866 Oct 11 04:19:26.674120 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1198/2300] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:26 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 1307 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:26.687150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bf7d8b3f-5652-426d-b590-9a431866aecd tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1df59700>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:26.904389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:19:26.905473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:19:26.906254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:19:26.906869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:19:26.907502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:19:26.929208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:26.935117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:26.935911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:26.937345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:26.939552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:26.940269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:27.004687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Getting quotas for project a3d48dc85fd64507b459034b67232052. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:19:27.014931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Getting quotas for user 555865c5372246009bb223d5cbfb8b24 and project a3d48dc85fd64507b459034b67232052. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:19:27.062880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:19:27.066088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:19:27.117284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=3,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:27.292400 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-81fcbe1f-9469-4ef3-b507-cdef0678e5f6 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.859199 Oct 11 04:19:27.293049 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1103/2301] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:19:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:19:27.304032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:27.304648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:27.328227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:27.328724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:27.329160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:27.350324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:27.350324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:27.350324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:27.675887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:27.694863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:27.697905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:27.758511 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b90e68f-16bc-4dcb-aa97-879a742bba16 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.453940 Oct 11 04:19:27.762046 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1104/2302] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:27 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:27.785554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b2b4e02b-1fce-4ffa-8e13-7bc7e07896a8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:27.788281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b2b4e02b-1fce-4ffa-8e13-7bc7e07896a8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:27.917562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b2b4e02b-1fce-4ffa-8e13-7bc7e07896a8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:27.930025 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b2b4e02b-1fce-4ffa-8e13-7bc7e07896a8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1216 microversion: 2.1 time: 0.164868 Oct 11 04:19:27.935800 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1105/2303] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:27 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1216 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:27.955552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:27.956309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:28.011970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:28.016233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:28.018847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:28.023009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:28.023500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:28.028279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:28.527866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:28.537103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:28.541089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:28.544412 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-afbd11a8-2957-4f86-8c5e-f03801f1f753 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.606575 Oct 11 04:19:28.570231 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1106/2304] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:27 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:28.584255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:28.584255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] [instance: b997d21c-b814-4e0c-aba4-53ea4b3c590b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:28.603220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:28.603900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:28.606548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:28.607633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:28.608244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:28.610757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:28.637534 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] HTTP exception thrown: Instance b997d21c-b814-4e0c-aba4-53ea4b3c590b could not be found. Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Request method failure captured: Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b HTTP/1.1 Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO3xJXCBhEGz9pquTeHR3Z4uPzScU9Bl2FfbCNjHEtjlF80EOUSHIxN0oNgNxYRHiHvNBPZ-LEU09Z_ToTUzi6jAb29jy8QXDKpNRY9vBfE3J97u5PqmcxSvRwRtzleSINQtHli-jTadjh2DKl2QS3gYb5ZfaH6limXNvfwfaps0JgA Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/89c92233d372409b9c1ce4ae94eeeab7"}]}] Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 89c92233d372409b9c1ce4ae94eeeab7 Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersOnMultiNodesTest-632422533 Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: db33edccb2504185928613257e64cdb4 Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersOnMultiNodesTest-632422533-project Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance b997d21c-b814-4e0c-aba4-53ea4b3c590b could not be found. Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'b997d21c-b814-4e0c-aba4-53ea4b3c590b'} Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b997d21c-b814-4e0c-aba4-53ea4b3c590b could not be found. Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b997d21c-b814-4e0c-aba4-53ea4b3c590b could not be found. Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:28.650390 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:28.656564 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:28.656564 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:28.656564 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:28.656564 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:19:28.656564 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:19:28.656564 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b997d21c-b814-4e0c-aba4-53ea4b3c590b could not be found. Oct 11 04:19:28.656564 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:28.656564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] Returning 404 to user: Instance b997d21c-b814-4e0c-aba4-53ea4b3c590b could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:28.658830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-06dd9114-2a83-450d-b03f-a45aa38176c5 tempest-ServersOnMultiNodesTest-632422533 tempest-ServersOnMultiNodesTest-632422533-project] 10.222.0.26 "GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b" status: 404 len: 111 microversion: 2.1 time: 0.081823 Oct 11 04:19:28.660171 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1107/2305] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:28 2022] GET /compute/v2.1/servers/b997d21c-b814-4e0c-aba4-53ea4b3c590b => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:19:28.792551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:28.793176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:28.809726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:28.810262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:28.810706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:28.817391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:28.817976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:28.818449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:28.829178 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bf7d8b3f-5652-426d-b590-9a431866aecd tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 2.153871 Oct 11 04:19:28.845776 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1199/2306] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:26 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 2171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:28.863693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:28.931841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:28.941446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:28.950090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:28.961562 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bd80ba63-5e94-42c2-8c35-6bad09d1a43e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.172489 Oct 11 04:19:28.963677 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1108/2307] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:28 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:19:28.964516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-111fe1bc-f154-4797-b454-cdfe50b0a3b5 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:28.965149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-111fe1bc-f154-4797-b454-cdfe50b0a3b5 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:29.109616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-111fe1bc-f154-4797-b454-cdfe50b0a3b5 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:29.116268 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-111fe1bc-f154-4797-b454-cdfe50b0a3b5 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1216 microversion: 2.1 time: 0.159179 Oct 11 04:19:29.119677 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1200/2308] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:28 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1216 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:29.576954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:29.577565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:29.609515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:29.611104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:29.612236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:29.620531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:29.626990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:29.630849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:29.852862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e859d282-1e82-408e-b33a-d5ac5fe4ba67 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19414550>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:29.936498 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e859d282-1e82-408e-b33a-d5ac5fe4ba67 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.091487 Oct 11 04:19:29.945185 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1201/2309] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:29 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:29.995461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:29.996064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:30.005939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:30.010750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:30.011565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:30.012731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:30.015575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:30.016329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:30.072795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:30.091513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:30.093288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:30.110571 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4ca53153-de1f-4d3e-b59d-e49df7b2f244 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.537457 Oct 11 04:19:30.118869 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1109/2310] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:29 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:30.146797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31c87d2f-9d07-4025-90dd-ea083310e395 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:30.146797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-31c87d2f-9d07-4025-90dd-ea083310e395 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:30.155579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31c87d2f-9d07-4025-90dd-ea083310e395 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:30.170007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31c87d2f-9d07-4025-90dd-ea083310e395 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:30.171951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31c87d2f-9d07-4025-90dd-ea083310e395 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:30.172825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31c87d2f-9d07-4025-90dd-ea083310e395 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:30.177894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31c87d2f-9d07-4025-90dd-ea083310e395 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:30.181632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31c87d2f-9d07-4025-90dd-ea083310e395 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:30.247785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:30.257095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:30.270062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:30.283794 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-68bad35d-c302-49c2-a2ad-2c37f6c7ed18 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1527 microversion: 2.91 time: 0.292603 Oct 11 04:19:30.286561 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1202/2311] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:29 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1527 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:19:30.315624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef47c2c2-3abe-4276-91b6-2aa0d0e0109f tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:30.316320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef47c2c2-3abe-4276-91b6-2aa0d0e0109f tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:30.331205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef47c2c2-3abe-4276-91b6-2aa0d0e0109f tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:30.331903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef47c2c2-3abe-4276-91b6-2aa0d0e0109f tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:30.332612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef47c2c2-3abe-4276-91b6-2aa0d0e0109f tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:30.334273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef47c2c2-3abe-4276-91b6-2aa0d0e0109f tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:30.334963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef47c2c2-3abe-4276-91b6-2aa0d0e0109f tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:30.335683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef47c2c2-3abe-4276-91b6-2aa0d0e0109f tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:30.465495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-ef47c2c2-3abe-4276-91b6-2aa0d0e0109f tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lazy-loading 'services' on Instance uuid 08029265-88c6-4b4a-bbff-1dc995bd902f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:30.490479 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef47c2c2-3abe-4276-91b6-2aa0d0e0109f tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1932 microversion: 2.91 time: 0.178739 Oct 11 04:19:30.491720 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1203/2312] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:30 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1932 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:30.521487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5be9895c-098d-4a7a-955a-332cffdc0d0c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:30.522842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5be9895c-098d-4a7a-955a-332cffdc0d0c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:30.537141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5be9895c-098d-4a7a-955a-332cffdc0d0c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:30.537926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5be9895c-098d-4a7a-955a-332cffdc0d0c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:30.539101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5be9895c-098d-4a7a-955a-332cffdc0d0c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:30.540012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-31c87d2f-9d07-4025-90dd-ea083310e395 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:30.540700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5be9895c-098d-4a7a-955a-332cffdc0d0c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:30.542001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5be9895c-098d-4a7a-955a-332cffdc0d0c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:30.542707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5be9895c-098d-4a7a-955a-332cffdc0d0c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:30.550256 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-31c87d2f-9d07-4025-90dd-ea083310e395 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1212 microversion: 2.1 time: 0.407343 Oct 11 04:19:30.550924 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1110/2313] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:30 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1212 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:30.596426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-5be9895c-098d-4a7a-955a-332cffdc0d0c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lazy-loading 'flavor' on Instance uuid 08029265-88c6-4b4a-bbff-1dc995bd902f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:30.953821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dab002f5-5df6-456a-aef6-b978b5631edd tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b6be50>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:31.043573 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dab002f5-5df6-456a-aef6-b978b5631edd tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.094450 Oct 11 04:19:31.089550 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1111/2314] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:30 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:31.152395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:31.153112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:31.162234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:31.163774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:31.164532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:31.165604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:31.166460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:31.167145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:31.516404 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5be9895c-098d-4a7a-955a-332cffdc0d0c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "POST /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f/action" status: 202 len: 0 microversion: 2.91 time: 0.998588 Oct 11 04:19:31.517933 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1204/2315] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:19:30 2022] POST /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f/action => generated 0 bytes in 1001 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:19:31.533004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:31.535655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:31.567417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:31.568090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:31.570465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:31.573143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:31.574903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:31.575573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:31.757628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:31.773689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:31.775506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:31.781419 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fbc882c4-c184-474e-b33a-038f5a987497 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.629558 Oct 11 04:19:31.799236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:31.807260 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1112/2316] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:31 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:31.819484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:31.822339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-be52fbb7-8f66-443c-87cf-e005fc38cb52 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:31.824040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:31.831298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-be52fbb7-8f66-443c-87cf-e005fc38cb52 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:31.846348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52fbb7-8f66-443c-87cf-e005fc38cb52 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:31.848981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52fbb7-8f66-443c-87cf-e005fc38cb52 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:31.850676 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c0e31e85-e503-4840-a4ca-ae8b0b0186a3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.328238 Oct 11 04:19:31.852082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52fbb7-8f66-443c-87cf-e005fc38cb52 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:31.853123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52fbb7-8f66-443c-87cf-e005fc38cb52 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:31.854557 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1205/2317] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:31 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:31.855212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52fbb7-8f66-443c-87cf-e005fc38cb52 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:31.855873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52fbb7-8f66-443c-87cf-e005fc38cb52 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:32.060518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a162eb6b-cd1a-4cfd-9291-84a8162ea5db tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1df64670>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:32.087357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be52fbb7-8f66-443c-87cf-e005fc38cb52 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:32.101011 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-be52fbb7-8f66-443c-87cf-e005fc38cb52 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1276 microversion: 2.1 time: 0.288453 Oct 11 04:19:32.103273 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1113/2318] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:31 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1276 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:32.158040 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a162eb6b-cd1a-4cfd-9291-84a8162ea5db tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.101686 Oct 11 04:19:32.163417 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1206/2319] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:32 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:32.831889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:32.834442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:32.841432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:32.842089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:32.842642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:32.843663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:32.844333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:32.844987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:32.881941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:32.882590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:32.904652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:32.905341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:32.905786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:32.906554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:32.907200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:32.907639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:33.069675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:33.102246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:33.105031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:33.119814 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2079eea6-56ec-4d99-b882-3f0cff1d29f3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.242062 Oct 11 04:19:33.126974 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1207/2320] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:32 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:19:33.138453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b7a94e3b-d992-4b85-9fe2-9e591fdf5ace tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:33.141951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b7a94e3b-d992-4b85-9fe2-9e591fdf5ace tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:33.158505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a94e3b-d992-4b85-9fe2-9e591fdf5ace tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:33.159006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a94e3b-d992-4b85-9fe2-9e591fdf5ace tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:33.159458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a94e3b-d992-4b85-9fe2-9e591fdf5ace tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:33.163094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a94e3b-d992-4b85-9fe2-9e591fdf5ace tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:33.165925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a94e3b-d992-4b85-9fe2-9e591fdf5ace tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:33.168191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a94e3b-d992-4b85-9fe2-9e591fdf5ace tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:33.286736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b7a94e3b-d992-4b85-9fe2-9e591fdf5ace tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:33.295742 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b7a94e3b-d992-4b85-9fe2-9e591fdf5ace tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1274 microversion: 2.1 time: 0.172071 Oct 11 04:19:33.296347 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1208/2321] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:33 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1274 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:33.306124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ead5ca82-24b5-47d7-b492-8c6c3f433823 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1df6a0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:33.360098 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ead5ca82-24b5-47d7-b492-8c6c3f433823 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1453 microversion: 2.1 time: 0.062389 Oct 11 04:19:33.360917 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1209/2322] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:33 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1453 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:33.366167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:33.367638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestMultiNic-server-849393262", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "0f3d7bc9-f870-4266-9af2-91331afe9b39"}, {"uuid": "26a60df3-7e29-49b0-9548-834901e2a499"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:33.376459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:33.378729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:33.380804 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-12e56b25-d99d-481a-8a03-2412d77e4baa tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.553219 Oct 11 04:19:33.383329 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1114/2323] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:32 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:33.437947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] validate_networks() for [('0f3d7bc9-f870-4266-9af2-91331afe9b39', None, None, None, None, None), ('26a60df3-7e29-49b0-9548-834901e2a499', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:19:34.155005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:34.155005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:34.171780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:34.173522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:34.175394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:34.178575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:34.179779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:34.184276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:34.484097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:34.550580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:34.550580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:34.571993 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c589d4f1-4710-4980-992a-19c1489d186e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.416378 Oct 11 04:19:34.572681 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1115/2324] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:34 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:34.594966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5add8e24-1361-4725-8fdf-cbf80261fe90 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:34.606996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5add8e24-1361-4725-8fdf-cbf80261fe90 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:34.614889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5add8e24-1361-4725-8fdf-cbf80261fe90 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:34.615195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5add8e24-1361-4725-8fdf-cbf80261fe90 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:34.615699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5add8e24-1361-4725-8fdf-cbf80261fe90 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:34.617370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5add8e24-1361-4725-8fdf-cbf80261fe90 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:34.619155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5add8e24-1361-4725-8fdf-cbf80261fe90 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:34.620915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5add8e24-1361-4725-8fdf-cbf80261fe90 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:35.093394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5add8e24-1361-4725-8fdf-cbf80261fe90 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:35.102940 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5add8e24-1361-4725-8fdf-cbf80261fe90 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1316 microversion: 2.1 time: 0.513303 Oct 11 04:19:35.103610 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1116/2325] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:34 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1316 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:35.108507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b84c6e7a-ca2f-41d7-85bd-d029f5dbbfd2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19ea6af0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:35.147263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:19:35.147791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:19:35.148276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:19:35.148699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:19:35.149162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:19:35.158866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:35.159822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:35.161215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:35.162095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:35.162723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:35.163295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:35.167132 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b84c6e7a-ca2f-41d7-85bd-d029f5dbbfd2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1462 microversion: 2.1 time: 0.062121 Oct 11 04:19:35.177323 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1117/2326] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:35 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1462 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:35.183783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:35.185417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:35.187252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Getting quotas for project 35648419af8f47b49dd4dfb75115d2e1. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:19:35.194621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Getting quotas for user 2bc397bbbb204dfd9494ec2a6ee020a8 and project 35648419af8f47b49dd4dfb75115d2e1. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:19:35.195435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:35.195935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:35.196373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:35.197907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:35.198520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:35.199248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:35.212512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:19:35.214958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:19:35.375083 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0923f19e-661e-4ec3-ba01-b2acdd67d8b7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.012941 Oct 11 04:19:35.376313 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1210/2327] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:19:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 2015 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:19:35.381978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-493f9634-72b7-493a-ab11-1fd489b78696 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19439ee0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:35.467412 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-493f9634-72b7-493a-ab11-1fd489b78696 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 200 len: 1462 microversion: 2.1 time: 0.089651 Oct 11 04:19:35.477510 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1211/2328] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:35 2022] GET /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:35.477510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43fab614-c2b0-4108-a5ca-37e0d75cfdd1 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:35.477510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-43fab614-c2b0-4108-a5ca-37e0d75cfdd1 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:35.636553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-43fab614-c2b0-4108-a5ca-37e0d75cfdd1 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:35.644933 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-43fab614-c2b0-4108-a5ca-37e0d75cfdd1 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1212 microversion: 2.1 time: 0.175335 Oct 11 04:19:35.645779 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1212/2329] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:35 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1212 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:35.663524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc4da0d4-a225-4263-a0f3-5b5190c0337c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:35.664448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bc4da0d4-a225-4263-a0f3-5b5190c0337c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:35.671742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc4da0d4-a225-4263-a0f3-5b5190c0337c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:35.672301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc4da0d4-a225-4263-a0f3-5b5190c0337c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:35.672860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc4da0d4-a225-4263-a0f3-5b5190c0337c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:35.673641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc4da0d4-a225-4263-a0f3-5b5190c0337c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:35.674325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc4da0d4-a225-4263-a0f3-5b5190c0337c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:35.674952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc4da0d4-a225-4263-a0f3-5b5190c0337c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:35.698256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:35.876550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:35.889866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:35.892245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:35.893983 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-db655eee-74cb-4af3-b111-eaccb7fbc38c tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1485 microversion: 2.25 time: 0.715552 Oct 11 04:19:35.897269 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1118/2330] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:35 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1485 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:35.904839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:35.905785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:35.913784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:35.923934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:35.923934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:35.925829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:35.928397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:35.934101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:35.942021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc4da0d4-a225-4263-a0f3-5b5190c0337c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:35.958382 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bc4da0d4-a225-4263-a0f3-5b5190c0337c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1480 microversion: 2.1 time: 0.295277 Oct 11 04:19:35.958770 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1213/2331] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:35 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1480 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:35.975075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6f93afe7-9ec4-4961-8d5f-a37799b19f8a req-cf638e02-f053-444f-8106-e1d9a0584fd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3", "tag": "dc2a5f1b-dccb-4cf0-b76a-31816c72e68a"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:35.991882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6f93afe7-9ec4-4961-8d5f-a37799b19f8a req-cf638e02-f053-444f-8106-e1d9a0584fd8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:35.992379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6f93afe7-9ec4-4961-8d5f-a37799b19f8a req-cf638e02-f053-444f-8106-e1d9a0584fd8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:35.992815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6f93afe7-9ec4-4961-8d5f-a37799b19f8a req-cf638e02-f053-444f-8106-e1d9a0584fd8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:36.007891 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6f93afe7-9ec4-4961-8d5f-a37799b19f8a req-cf638e02-f053-444f-8106-e1d9a0584fd8 service nova] Creating event network-changed:dc2a5f1b-dccb-4cf0-b76a-31816c72e68a for instance 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 on n-h1-860892-1 Oct 11 04:19:36.013004 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6f93afe7-9ec4-4961-8d5f-a37799b19f8a req-cf638e02-f053-444f-8106-e1d9a0584fd8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052684 Oct 11 04:19:36.014068 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1214/2332] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:36.056641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:36.065541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:36.067193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:36.072574 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8a928584-b5eb-4755-a437-57359d84fc9c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.173414 Oct 11 04:19:36.075343 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1119/2333] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:35 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:36.138515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a9bba7ae-9921-49ff-a3f1-8146711dd8b7 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:36.138515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a9bba7ae-9921-49ff-a3f1-8146711dd8b7 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:36.146736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9bba7ae-9921-49ff-a3f1-8146711dd8b7 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:36.147435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9bba7ae-9921-49ff-a3f1-8146711dd8b7 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:36.148463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9bba7ae-9921-49ff-a3f1-8146711dd8b7 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:36.149341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9bba7ae-9921-49ff-a3f1-8146711dd8b7 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:36.150869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9bba7ae-9921-49ff-a3f1-8146711dd8b7 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:36.151590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9bba7ae-9921-49ff-a3f1-8146711dd8b7 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:36.575259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a9bba7ae-9921-49ff-a3f1-8146711dd8b7 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:36.586602 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a9bba7ae-9921-49ff-a3f1-8146711dd8b7 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1316 microversion: 2.1 time: 0.463163 Oct 11 04:19:36.588087 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1215/2334] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:36 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1316 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:36.679444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d63fd4ab-c207-4c10-aa3f-bbd59e81b421 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:36.679444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d63fd4ab-c207-4c10-aa3f-bbd59e81b421 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:36.963520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a3912487-2a2a-4229-817f-4f0e4aa55690 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:36.967179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:36.968462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3912487-2a2a-4229-817f-4f0e4aa55690 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:36.969018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3912487-2a2a-4229-817f-4f0e4aa55690 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:36.969527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3912487-2a2a-4229-817f-4f0e4aa55690 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:36.970434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3912487-2a2a-4229-817f-4f0e4aa55690 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:36.971122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3912487-2a2a-4229-817f-4f0e4aa55690 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:36.971611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3912487-2a2a-4229-817f-4f0e4aa55690 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:36.999699 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a3912487-2a2a-4229-817f-4f0e4aa55690 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.169620 Oct 11 04:19:37.000696 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1216/2335] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:19:36 2022] GET /compute/v2.1/os-services => generated 944 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:19:37.009727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:37.011372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:37.019522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.020169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.020929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.022253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.022965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.023545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.076848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d63fd4ab-c207-4c10-aa3f-bbd59e81b421 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:37.088756 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d63fd4ab-c207-4c10-aa3f-bbd59e81b421 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1212 microversion: 2.1 time: 0.421208 Oct 11 04:19:37.109691 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1120/2336] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:36 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1212 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:37.118099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-081971ea-62b0-4579-b48d-8efbbe9f8af4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:37.118752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-081971ea-62b0-4579-b48d-8efbbe9f8af4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:37.127609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-081971ea-62b0-4579-b48d-8efbbe9f8af4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.128103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-081971ea-62b0-4579-b48d-8efbbe9f8af4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.128978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-081971ea-62b0-4579-b48d-8efbbe9f8af4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.130601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-081971ea-62b0-4579-b48d-8efbbe9f8af4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.131331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-081971ea-62b0-4579-b48d-8efbbe9f8af4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.131975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-081971ea-62b0-4579-b48d-8efbbe9f8af4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.227141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:37.237010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:37.239770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:37.241578 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dbcb2496-9593-4252-ac62-16c471878337 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1475 microversion: 2.25 time: 0.239711 Oct 11 04:19:37.242716 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1217/2337] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:37 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1475 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:37.258784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-759c3b97-d83c-4334-a365-22f3112c1e77 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:37.267173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-759c3b97-d83c-4334-a365-22f3112c1e77 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.267655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-759c3b97-d83c-4334-a365-22f3112c1e77 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.271300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-759c3b97-d83c-4334-a365-22f3112c1e77 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.272115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-759c3b97-d83c-4334-a365-22f3112c1e77 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.272581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-759c3b97-d83c-4334-a365-22f3112c1e77 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.273008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-759c3b97-d83c-4334-a365-22f3112c1e77 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.301144 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-759c3b97-d83c-4334-a365-22f3112c1e77 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-860892-1" status: 200 len: 578 microversion: 2.1 time: 0.056869 Oct 11 04:19:37.306377 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1218/2338] 10.222.0.26 () {58 vars in 1172 bytes} [Tue Oct 11 04:19:37 2022] GET /compute/v2.1/os-services?host=n-d-860892-1 => generated 578 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:37.311964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:37.312863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:37.320879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.321403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.321847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.322607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.323241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.323692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.337082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-081971ea-62b0-4579-b48d-8efbbe9f8af4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:37.346380 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-081971ea-62b0-4579-b48d-8efbbe9f8af4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1467 microversion: 2.1 time: 0.235423 Oct 11 04:19:37.347283 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1121/2339] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:37 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1467 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:37.352819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c82669ae-05be-444c-80d9-e6176fc81abf tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '.version_select at 0x7fda199b6f70>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:37.357224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c82669ae-05be-444c-80d9-e6176fc81abf tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.359519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c82669ae-05be-444c-80d9-e6176fc81abf tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.360240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c82669ae-05be-444c-80d9-e6176fc81abf tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.370541 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c82669ae-05be-444c-80d9-e6176fc81abf tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1940 microversion: 2.25 time: 0.021424 Oct 11 04:19:37.381615 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1122/2340] 10.222.0.26 () {60 vars in 1184 bytes} [Tue Oct 11 04:19:37 2022] GET /compute/v2.1/os-migrations => generated 1940 bytes in 23 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:37.389908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0ecf3379-0f22-4f09-8e98-ed6f9c277915 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:37.391614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecf3379-0f22-4f09-8e98-ed6f9c277915 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.392424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecf3379-0f22-4f09-8e98-ed6f9c277915 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.393011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecf3379-0f22-4f09-8e98-ed6f9c277915 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.393914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecf3379-0f22-4f09-8e98-ed6f9c277915 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.395713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecf3379-0f22-4f09-8e98-ed6f9c277915 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.396293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecf3379-0f22-4f09-8e98-ed6f9c277915 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.402087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:37.410864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:37.412564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:37.418409 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0146bb0d-d74b-4b5c-8cc9-7205186230fe tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.110407 Oct 11 04:19:37.419484 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1219/2341] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:37 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:37.421421 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0ecf3379-0f22-4f09-8e98-ed6f9c277915 tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.037986 Oct 11 04:19:37.422104 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1123/2342] 10.222.0.26 () {58 vars in 1176 bytes} [Tue Oct 11 04:19:37 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:37.426989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-84926575-616c-47e8-9d7f-b35c2498e017 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:37.429447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-84926575-616c-47e8-9d7f-b35c2498e017 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:37.433892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d04c65a-21cf-485c-b943-2d9bd44aa920 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ListImageFiltersTestJSON-image-1050425675"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:37.436577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d04c65a-21cf-485c-b943-2d9bd44aa920 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:37.437181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84926575-616c-47e8-9d7f-b35c2498e017 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.437867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84926575-616c-47e8-9d7f-b35c2498e017 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.438528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84926575-616c-47e8-9d7f-b35c2498e017 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.439431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84926575-616c-47e8-9d7f-b35c2498e017 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.440056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84926575-616c-47e8-9d7f-b35c2498e017 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.440685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84926575-616c-47e8-9d7f-b35c2498e017 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.447866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d04c65a-21cf-485c-b943-2d9bd44aa920 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.452932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d04c65a-21cf-485c-b943-2d9bd44aa920 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.453728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d04c65a-21cf-485c-b943-2d9bd44aa920 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.454378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d04c65a-21cf-485c-b943-2d9bd44aa920 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.456326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d04c65a-21cf-485c-b943-2d9bd44aa920 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.456961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d04c65a-21cf-485c-b943-2d9bd44aa920 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.634209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-84926575-616c-47e8-9d7f-b35c2498e017 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] Lazy-loading 'services' on Instance uuid 7d993e3f-2858-478c-941e-7d874a4fcb5e {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:37.647752 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-84926575-616c-47e8-9d7f-b35c2498e017 tempest-LiveAutoBlockMigrationV225Test-1515898732 tempest-LiveAutoBlockMigrationV225Test-1515898732-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1967 microversion: 2.25 time: 0.224393 Oct 11 04:19:37.648367 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1124/2343] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:37 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1967 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:37.652789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5b4bdff4-cc66-4907-a243-df3c26c16fbd tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:37.656270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b4bdff4-cc66-4907-a243-df3c26c16fbd tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.656742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b4bdff4-cc66-4907-a243-df3c26c16fbd tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.657180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b4bdff4-cc66-4907-a243-df3c26c16fbd tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.657895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b4bdff4-cc66-4907-a243-df3c26c16fbd tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.658595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b4bdff4-cc66-4907-a243-df3c26c16fbd tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.659019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b4bdff4-cc66-4907-a243-df3c26c16fbd tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.710282 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5b4bdff4-cc66-4907-a243-df3c26c16fbd tempest-ServicesAdminTestJSON-1234959682 tempest-ServicesAdminTestJSON-1234959682-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 944 microversion: 2.1 time: 0.060772 Oct 11 04:19:37.711315 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1125/2344] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:19:37 2022] GET /compute/v2.1/os-services => generated 944 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:37.717830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1feb8e6d-6da5-4228-921f-e5ffc4b198d3 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:37.718775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1feb8e6d-6da5-4228-921f-e5ffc4b198d3 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:37.730633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1feb8e6d-6da5-4228-921f-e5ffc4b198d3 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.731818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1feb8e6d-6da5-4228-921f-e5ffc4b198d3 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.732726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1feb8e6d-6da5-4228-921f-e5ffc4b198d3 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.733642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1feb8e6d-6da5-4228-921f-e5ffc4b198d3 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.734588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1feb8e6d-6da5-4228-921f-e5ffc4b198d3 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.735233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1feb8e6d-6da5-4228-921f-e5ffc4b198d3 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.909261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1feb8e6d-6da5-4228-921f-e5ffc4b198d3 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:37.920944 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1feb8e6d-6da5-4228-921f-e5ffc4b198d3 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1316 microversion: 2.1 time: 0.207879 Oct 11 04:19:37.922101 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1126/2345] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:37 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1316 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:37.928451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-235ebbea-1ff2-4241-98dd-c3c781e7b7bb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:37.936428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-235ebbea-1ff2-4241-98dd-c3c781e7b7bb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:37.946860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235ebbea-1ff2-4241-98dd-c3c781e7b7bb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.947520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235ebbea-1ff2-4241-98dd-c3c781e7b7bb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.948291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235ebbea-1ff2-4241-98dd-c3c781e7b7bb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.949639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235ebbea-1ff2-4241-98dd-c3c781e7b7bb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:37.950301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235ebbea-1ff2-4241-98dd-c3c781e7b7bb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:37.950899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235ebbea-1ff2-4241-98dd-c3c781e7b7bb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:37.995237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-235ebbea-1ff2-4241-98dd-c3c781e7b7bb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:19:38.010162 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d04c65a-21cf-485c-b943-2d9bd44aa920 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "POST /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7/action" status: 202 len: 0 microversion: 2.1 time: 0.589168 Oct 11 04:19:38.013667 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1220/2346] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:19:37 2022] POST /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 04:19:38.028167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0c16869-d5ba-4ff1-a194-cd638d06b8d2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1df599d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:38.103316 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d0c16869-d5ba-4ff1-a194-cd638d06b8d2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.083023 Oct 11 04:19:38.105225 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1221/2347] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:38 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:38.117089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7533f41d-8380-44f0-8783-fb0540debefe tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:38.118041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7533f41d-8380-44f0-8783-fb0540debefe tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:38.142091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7533f41d-8380-44f0-8783-fb0540debefe tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:38.142656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7533f41d-8380-44f0-8783-fb0540debefe tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:38.143076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7533f41d-8380-44f0-8783-fb0540debefe tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:38.143793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7533f41d-8380-44f0-8783-fb0540debefe tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:38.153562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7533f41d-8380-44f0-8783-fb0540debefe tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:38.153562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7533f41d-8380-44f0-8783-fb0540debefe tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:38.284281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7533f41d-8380-44f0-8783-fb0540debefe tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:38.293383 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7533f41d-8380-44f0-8783-fb0540debefe tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1264 microversion: 2.1 time: 0.180134 Oct 11 04:19:38.294032 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1222/2348] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:38 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1264 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:38.450504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:38.452113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:38.458458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:38.459203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:38.459796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:38.460839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:38.461364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:38.461884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:38.564041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:38.569443 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-235ebbea-1ff2-4241-98dd-c3c781e7b7bb tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 204 len: 0 microversion: 2.25 time: 0.644604 Oct 11 04:19:38.570055 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1127/2349] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:19:37 2022] DELETE /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:19:38.583896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:38.585335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:38.589011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:38.590933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:38.591045 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb722d81-4b02-4ca7-9bbe-454fb2367e60 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.145426 Oct 11 04:19:38.592521 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1223/2350] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:38 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:38.598294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:38.598897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:38.599744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:38.600580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:38.601164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:38.601731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:38.606771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:38.826870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:38.840616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:38.843161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:38.844452 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-549c9acc-2189-4de4-8a1a-57962d892d66 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1481 microversion: 2.25 time: 0.269315 Oct 11 04:19:38.845566 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1128/2351] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:38 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1481 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:38.948386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1f34a62b-4ece-428f-94b4-c9f162f82d11 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:38.949005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1f34a62b-4ece-428f-94b4-c9f162f82d11 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:38.955255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f34a62b-4ece-428f-94b4-c9f162f82d11 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:38.955740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f34a62b-4ece-428f-94b4-c9f162f82d11 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:38.956178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f34a62b-4ece-428f-94b4-c9f162f82d11 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:38.956870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f34a62b-4ece-428f-94b4-c9f162f82d11 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:38.957337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f34a62b-4ece-428f-94b4-c9f162f82d11 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:38.957773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f34a62b-4ece-428f-94b4-c9f162f82d11 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:39.123438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0a78e0d1-e930-49ce-b5e7-47e5033d3c82 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19ea60d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:39.226937 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0a78e0d1-e930-49ce-b5e7-47e5033d3c82 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.108602 Oct 11 04:19:39.229238 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1129/2352] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:39 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:39.317900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-beba1960-57a7-4947-8bf5-8b04841d1aa3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:39.318890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-beba1960-57a7-4947-8bf5-8b04841d1aa3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:39.331661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beba1960-57a7-4947-8bf5-8b04841d1aa3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:39.332077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beba1960-57a7-4947-8bf5-8b04841d1aa3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:39.339965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beba1960-57a7-4947-8bf5-8b04841d1aa3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:39.343960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beba1960-57a7-4947-8bf5-8b04841d1aa3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:39.346283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beba1960-57a7-4947-8bf5-8b04841d1aa3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:39.349420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beba1960-57a7-4947-8bf5-8b04841d1aa3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:39.559447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1f34a62b-4ece-428f-94b4-c9f162f82d11 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:39.572217 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1f34a62b-4ece-428f-94b4-c9f162f82d11 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1316 microversion: 2.1 time: 0.627267 Oct 11 04:19:39.573395 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1224/2353] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:38 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1316 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:39.592276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-beba1960-57a7-4947-8bf5-8b04841d1aa3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:39.613110 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-beba1960-57a7-4947-8bf5-8b04841d1aa3 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1272 microversion: 2.1 time: 0.296219 Oct 11 04:19:39.617586 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1130/2354] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:39 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1272 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:39.623470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:39.624824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:39.638356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:39.639355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:39.640026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:39.640847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:39.650875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:39.651483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:39.685650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-b2312b2e-ce8a-4863-a90e-be8f50c13329 req-db8f2913-4e78-4c65-b80e-e410a77d4975 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93bf3c01-c65e-4a62-ac8f-352bc8246a2d", "name": "network-vif-unplugged", "status": "completed", "tag": "d0bb2ff8-d0fd-4843-b947-a32edd7bb015"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:39.707142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b2312b2e-ce8a-4863-a90e-be8f50c13329 req-db8f2913-4e78-4c65-b80e-e410a77d4975 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:39.708469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b2312b2e-ce8a-4863-a90e-be8f50c13329 req-db8f2913-4e78-4c65-b80e-e410a77d4975 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:39.709077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b2312b2e-ce8a-4863-a90e-be8f50c13329 req-db8f2913-4e78-4c65-b80e-e410a77d4975 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:39.745643 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-b2312b2e-ce8a-4863-a90e-be8f50c13329 req-db8f2913-4e78-4c65-b80e-e410a77d4975 service nova] Creating event network-vif-unplugged:d0bb2ff8-d0fd-4843-b947-a32edd7bb015 for instance 93bf3c01-c65e-4a62-ac8f-352bc8246a2d on n-h1-860892-1 Oct 11 04:19:39.751642 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-b2312b2e-ce8a-4863-a90e-be8f50c13329 req-db8f2913-4e78-4c65-b80e-e410a77d4975 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069542 Oct 11 04:19:39.752281 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1131/2355] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:19:39.772958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:39.781709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:39.783456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:39.786930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:39.792280 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2df102a-a3fd-49e3-b947-85350a4aa36d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.175238 Oct 11 04:19:39.799286 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1225/2356] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:39 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:39.875959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:39.877007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:39.890919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:39.893784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:39.894997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:39.896165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:39.898086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:39.900165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:40.173571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:40.189067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:40.190512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:40.192306 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-be52f47b-6fb5-4ed0-97fc-472107297949 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1481 microversion: 2.25 time: 0.323309 Oct 11 04:19:40.192883 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1132/2357] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:39 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1481 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:40.244642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9a081e8-0964-4599-8328-046bf3879252 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1df6aca0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:40.308165 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e9a081e8-0964-4599-8328-046bf3879252 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.068271 Oct 11 04:19:40.309028 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1226/2358] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:40 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:40.596975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b3feca3d-0052-4b2f-9516-fd518bb23ebe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:40.597631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b3feca3d-0052-4b2f-9516-fd518bb23ebe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:40.607288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3feca3d-0052-4b2f-9516-fd518bb23ebe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:40.607779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3feca3d-0052-4b2f-9516-fd518bb23ebe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:40.608202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3feca3d-0052-4b2f-9516-fd518bb23ebe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:40.608947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3feca3d-0052-4b2f-9516-fd518bb23ebe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:40.609434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3feca3d-0052-4b2f-9516-fd518bb23ebe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:40.609797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3feca3d-0052-4b2f-9516-fd518bb23ebe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:40.620716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-956ef23c-96c6-4240-bb0f-1a014a5f4fc2 req-24d4f0ce-4e5a-41e5-974d-4f80321f18a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d993e3f-2858-478c-941e-7d874a4fcb5e", "name": "network-vif-deleted", "tag": "0d27cdb1-7b14-44cb-b024-b149b4ec43ab"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:40.632125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-956ef23c-96c6-4240-bb0f-1a014a5f4fc2 req-24d4f0ce-4e5a-41e5-974d-4f80321f18a3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:40.633770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-956ef23c-96c6-4240-bb0f-1a014a5f4fc2 req-24d4f0ce-4e5a-41e5-974d-4f80321f18a3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:40.633770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-956ef23c-96c6-4240-bb0f-1a014a5f4fc2 req-24d4f0ce-4e5a-41e5-974d-4f80321f18a3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:40.646598 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-956ef23c-96c6-4240-bb0f-1a014a5f4fc2 req-24d4f0ce-4e5a-41e5-974d-4f80321f18a3 service nova] Creating event network-vif-deleted:0d27cdb1-7b14-44cb-b024-b149b4ec43ab for instance 7d993e3f-2858-478c-941e-7d874a4fcb5e on n-h2-860892-1 Oct 11 04:19:40.665873 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-956ef23c-96c6-4240-bb0f-1a014a5f4fc2 req-24d4f0ce-4e5a-41e5-974d-4f80321f18a3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048771 Oct 11 04:19:40.667313 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1227/2359] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:19:40.682287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2efc52ba-8130-46c4-b9d7-5fa8cead89ce tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:40.683718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2efc52ba-8130-46c4-b9d7-5fa8cead89ce tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:40.690538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2efc52ba-8130-46c4-b9d7-5fa8cead89ce tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:40.691487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2efc52ba-8130-46c4-b9d7-5fa8cead89ce tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:40.692099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2efc52ba-8130-46c4-b9d7-5fa8cead89ce tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:40.693098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2efc52ba-8130-46c4-b9d7-5fa8cead89ce tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:40.693741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2efc52ba-8130-46c4-b9d7-5fa8cead89ce tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:40.694355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2efc52ba-8130-46c4-b9d7-5fa8cead89ce tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:40.818851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b3feca3d-0052-4b2f-9516-fd518bb23ebe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:40.830781 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b3feca3d-0052-4b2f-9516-fd518bb23ebe tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1316 microversion: 2.1 time: 0.234878 Oct 11 04:19:40.830781 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1133/2360] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:40 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:40.835208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:40.836665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:40.842912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:40.843402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:40.843841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:40.844546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:40.845002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:40.845585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:40.965224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2efc52ba-8130-46c4-b9d7-5fa8cead89ce tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:40.975181 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2efc52ba-8130-46c4-b9d7-5fa8cead89ce tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1312 microversion: 2.1 time: 0.306026 Oct 11 04:19:40.979730 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1228/2361] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:40 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1312 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:41.026627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:41.042714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:41.044735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:41.064635 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6daa15af-febe-4b1b-bd0a-5912c958982c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.233715 Oct 11 04:19:41.092861 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1134/2362] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:40 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:41.219318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:41.220119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:41.230821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:41.231344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:41.231837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:41.232653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:41.233158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:41.233585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:41.304520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:41.314872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:41.319213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:41.319213 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2247a2d2-56b2-4809-9abb-993e8247f507 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1265 microversion: 2.25 time: 0.103285 Oct 11 04:19:41.323642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-83282099-c551-4e96-9ce4-7ca70d383c7e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19c73af0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:41.338015 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1229/2363] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:41 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1265 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:41.392806 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-83282099-c551-4e96-9ce4-7ca70d383c7e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.072882 Oct 11 04:19:41.393718 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1135/2364] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:41 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:41.746492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9989d44e-c44f-4a62-9f1a-dd5152e55958 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:41.747453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9989d44e-c44f-4a62-9f1a-dd5152e55958 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:41.755599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9989d44e-c44f-4a62-9f1a-dd5152e55958 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:41.756278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9989d44e-c44f-4a62-9f1a-dd5152e55958 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:41.757320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9989d44e-c44f-4a62-9f1a-dd5152e55958 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:41.758237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9989d44e-c44f-4a62-9f1a-dd5152e55958 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:41.758847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9989d44e-c44f-4a62-9f1a-dd5152e55958 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:41.759817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9989d44e-c44f-4a62-9f1a-dd5152e55958 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:41.801435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-7f726bc2-7a93-4c0a-a2b3-9f39374a93dc req-4a8dd93a-8302-4286-a29c-e94966ff8eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3", "name": "network-vif-plugged", "status": "completed", "tag": "dc2a5f1b-dccb-4cf0-b76a-31816c72e68a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:41.801642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9989d44e-c44f-4a62-9f1a-dd5152e55958 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:19:41.813138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7f726bc2-7a93-4c0a-a2b3-9f39374a93dc req-4a8dd93a-8302-4286-a29c-e94966ff8eb0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:41.813972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7f726bc2-7a93-4c0a-a2b3-9f39374a93dc req-4a8dd93a-8302-4286-a29c-e94966ff8eb0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:41.814594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7f726bc2-7a93-4c0a-a2b3-9f39374a93dc req-4a8dd93a-8302-4286-a29c-e94966ff8eb0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:41.847565 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7f726bc2-7a93-4c0a-a2b3-9f39374a93dc req-4a8dd93a-8302-4286-a29c-e94966ff8eb0 service nova] Creating event network-vif-plugged:dc2a5f1b-dccb-4cf0-b76a-31816c72e68a for instance 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 on n-h1-860892-1 Oct 11 04:19:41.854882 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-7f726bc2-7a93-4c0a-a2b3-9f39374a93dc req-4a8dd93a-8302-4286-a29c-e94966ff8eb0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063948 Oct 11 04:19:41.856031 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1136/2365] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:19:41.866582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8cacf359-875d-4d12-a754-47c066172bd1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:41.867699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8cacf359-875d-4d12-a754-47c066172bd1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:41.877726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cacf359-875d-4d12-a754-47c066172bd1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:41.878814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cacf359-875d-4d12-a754-47c066172bd1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:41.880044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cacf359-875d-4d12-a754-47c066172bd1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:41.881561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cacf359-875d-4d12-a754-47c066172bd1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:41.882275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cacf359-875d-4d12-a754-47c066172bd1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:41.882854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cacf359-875d-4d12-a754-47c066172bd1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:42.202344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8cacf359-875d-4d12-a754-47c066172bd1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:42.218796 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8cacf359-875d-4d12-a754-47c066172bd1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1316 microversion: 2.1 time: 0.359392 Oct 11 04:19:42.220229 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1137/2366] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:41 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1316 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:42.228831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-91d6aeb9-9eb5-4fa0-9c07-6784f5fcfb13 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:42.229576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-91d6aeb9-9eb5-4fa0-9c07-6784f5fcfb13 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:42.237492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91d6aeb9-9eb5-4fa0-9c07-6784f5fcfb13 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:42.238930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91d6aeb9-9eb5-4fa0-9c07-6784f5fcfb13 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:42.239541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91d6aeb9-9eb5-4fa0-9c07-6784f5fcfb13 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:42.240538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91d6aeb9-9eb5-4fa0-9c07-6784f5fcfb13 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:42.241185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91d6aeb9-9eb5-4fa0-9c07-6784f5fcfb13 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:42.241750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91d6aeb9-9eb5-4fa0-9c07-6784f5fcfb13 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:42.293709 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9989d44e-c44f-4a62-9f1a-dd5152e55958 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 204 len: 0 microversion: 2.1 time: 0.557286 Oct 11 04:19:42.302285 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1230/2367] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:19:41 2022] DELETE /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 0 bytes in 564 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:19:42.305500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:42.309086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:42.319739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:42.324602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:42.325168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:42.326144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:42.326705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:42.327207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:42.434417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:42.438252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:42.451391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:42.453222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:42.459324 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e6adf010-fad1-4a6d-850b-1dacab3e8fba tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.158473 Oct 11 04:19:42.460412 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1231/2368] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:42 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:42.465329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ba8c126f-058b-447d-84a4-81b3b12b42f6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:42.466108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ba8c126f-058b-447d-84a4-81b3b12b42f6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:42.477257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba8c126f-058b-447d-84a4-81b3b12b42f6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:42.477970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba8c126f-058b-447d-84a4-81b3b12b42f6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:42.480073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba8c126f-058b-447d-84a4-81b3b12b42f6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:42.480930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba8c126f-058b-447d-84a4-81b3b12b42f6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:42.482826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba8c126f-058b-447d-84a4-81b3b12b42f6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:42.483454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba8c126f-058b-447d-84a4-81b3b12b42f6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:42.502383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-91d6aeb9-9eb5-4fa0-9c07-6784f5fcfb13 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:42.514252 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-91d6aeb9-9eb5-4fa0-9c07-6784f5fcfb13 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.292268 Oct 11 04:19:42.515281 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1138/2369] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:42 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:42.539172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:42.540210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:42.571898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:42.572692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:42.576783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:42.578547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:42.580048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:42.581838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:42.672678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:42.682825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:42.684541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:42.686089 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b3cdd22f-7928-4b3f-a5a9-a9cc4ad9a8ee tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1265 microversion: 2.25 time: 0.169726 Oct 11 04:19:42.686798 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1139/2370] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:42 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:42.691611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-17c46591-5256-4419-9e91-fed6124301b5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19bc5a60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:42.707235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ba8c126f-058b-447d-84a4-81b3b12b42f6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:42.715265 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ba8c126f-058b-447d-84a4-81b3b12b42f6 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1667 microversion: 2.1 time: 0.253534 Oct 11 04:19:42.716161 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1232/2371] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:42 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1667 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:42.768607 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-17c46591-5256-4419-9e91-fed6124301b5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.080019 Oct 11 04:19:42.770493 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1140/2372] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:42 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:43.248626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d45b99fe-3012-4c97-bebd-f806beae4189 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:43.249600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d45b99fe-3012-4c97-bebd-f806beae4189 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:43.258225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d45b99fe-3012-4c97-bebd-f806beae4189 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:43.258955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d45b99fe-3012-4c97-bebd-f806beae4189 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:43.259644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d45b99fe-3012-4c97-bebd-f806beae4189 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:43.260425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d45b99fe-3012-4c97-bebd-f806beae4189 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:43.260883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d45b99fe-3012-4c97-bebd-f806beae4189 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:43.261466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d45b99fe-3012-4c97-bebd-f806beae4189 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:43.399041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d45b99fe-3012-4c97-bebd-f806beae4189 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:43.409562 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d45b99fe-3012-4c97-bebd-f806beae4189 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1316 microversion: 2.1 time: 0.166557 Oct 11 04:19:43.422341 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1233/2373] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:43 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1316 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:43.493308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:43.494010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:43.520955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:43.521599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:43.523262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:43.524797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:43.525447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:43.526735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:43.545039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1b0a77d-2baf-4060-94fd-686c69f3deab tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:43.545765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b1b0a77d-2baf-4060-94fd-686c69f3deab tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:43.557372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1b0a77d-2baf-4060-94fd-686c69f3deab tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:43.563357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1b0a77d-2baf-4060-94fd-686c69f3deab tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:43.564131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1b0a77d-2baf-4060-94fd-686c69f3deab tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:43.565003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1b0a77d-2baf-4060-94fd-686c69f3deab tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:43.565616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1b0a77d-2baf-4060-94fd-686c69f3deab tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:43.566045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1b0a77d-2baf-4060-94fd-686c69f3deab tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:43.644548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:43.656019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:43.657469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:43.669898 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e966e66d-c7ff-4a9e-9f3e-d2959d7d39aa tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.183362 Oct 11 04:19:43.670526 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1141/2374] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:43 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:43.714271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:43.715351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:43.726284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:43.726957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:43.728731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:43.729753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:43.732897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:43.733346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:43.811439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b1b0a77d-2baf-4060-94fd-686c69f3deab tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:43.821743 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b1b0a77d-2baf-4060-94fd-686c69f3deab tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.280478 Oct 11 04:19:43.823179 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1234/2375] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:43 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:43.835306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7950f487-1afe-4875-a973-3ef2157e0a0d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:43.844144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7950f487-1afe-4875-a973-3ef2157e0a0d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:43.844144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7950f487-1afe-4875-a973-3ef2157e0a0d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:43.844636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7950f487-1afe-4875-a973-3ef2157e0a0d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:43.845226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7950f487-1afe-4875-a973-3ef2157e0a0d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:43.846390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7950f487-1afe-4875-a973-3ef2157e0a0d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:43.846990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7950f487-1afe-4875-a973-3ef2157e0a0d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:43.847561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7950f487-1afe-4875-a973-3ef2157e0a0d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:43.946143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:43.970924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:43.977341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:43.978866 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-987d668c-5b9c-4f96-bb1c-420606fa01f2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1265 microversion: 2.25 time: 0.270748 Oct 11 04:19:43.980009 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1142/2376] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:43 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1265 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:19:43.987542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d55ae8c2-c341-48ac-80d1-07873e725e5b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19bc5160>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:44.088720 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d55ae8c2-c341-48ac-80d1-07873e725e5b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.105486 Oct 11 04:19:44.094354 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1143/2377] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:43 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:44.178685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-af6437cc-a7a6-4c51-8894-ed23dbd5ebf7 req-70f3cdb4-7c3d-41bb-b8a4-6b7556d240c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaae530-25a0-46f6-9df0-bb21d130a0f7", "name": "network-vif-plugged", "status": "completed", "tag": "39669b5c-b616-41c2-a28c-282c3da17d8d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:44.198322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af6437cc-a7a6-4c51-8894-ed23dbd5ebf7 req-70f3cdb4-7c3d-41bb-b8a4-6b7556d240c5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:44.202288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af6437cc-a7a6-4c51-8894-ed23dbd5ebf7 req-70f3cdb4-7c3d-41bb-b8a4-6b7556d240c5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:44.202288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af6437cc-a7a6-4c51-8894-ed23dbd5ebf7 req-70f3cdb4-7c3d-41bb-b8a4-6b7556d240c5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:44.227640 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-af6437cc-a7a6-4c51-8894-ed23dbd5ebf7 req-70f3cdb4-7c3d-41bb-b8a4-6b7556d240c5 service nova] Creating event network-vif-plugged:39669b5c-b616-41c2-a28c-282c3da17d8d for instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 on n-h2-860892-1 Oct 11 04:19:44.236553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7950f487-1afe-4875-a973-3ef2157e0a0d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:44.238791 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-af6437cc-a7a6-4c51-8894-ed23dbd5ebf7 req-70f3cdb4-7c3d-41bb-b8a4-6b7556d240c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071723 Oct 11 04:19:44.243970 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1144/2378] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:19:44.248807 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7950f487-1afe-4875-a973-3ef2157e0a0d tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1667 microversion: 2.1 time: 0.422880 Oct 11 04:19:44.249916 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1235/2379] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:43 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1667 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:44.436952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b9cca5a1-178a-4de7-82e1-c769c79f106a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:44.437712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b9cca5a1-178a-4de7-82e1-c769c79f106a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:44.452905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9cca5a1-178a-4de7-82e1-c769c79f106a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:44.462135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9cca5a1-178a-4de7-82e1-c769c79f106a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:44.466086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9cca5a1-178a-4de7-82e1-c769c79f106a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:44.466931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9cca5a1-178a-4de7-82e1-c769c79f106a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:44.467460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9cca5a1-178a-4de7-82e1-c769c79f106a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:44.468074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9cca5a1-178a-4de7-82e1-c769c79f106a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:44.592731 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02d1ebb5-9c4d-4a8b-b4e8-d514ecf32634 tempest-TenantUsagesNegativeTestJSON-1422695620 tempest-TenantUsagesNegativeTestJSON-1422695620-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-10T04%3A19%3A44.288223&end=2022-10-12T04%3A19%3A44.288223" status: 404 len: 112 microversion: - time: 0.300715 Oct 11 04:19:44.599048 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1145/2380] 10.222.0.26 () {58 vars in 1316 bytes} [Tue Oct 11 04:19:44 2022] GET /compute/v2.1/os-simple-tenant-usage/?start=2022-10-10T04%3A19%3A44.288223&end=2022-10-12T04%3A19%3A44.288223 => generated 112 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 04:19:44.604375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f000ade-1ff7-4004-84b3-91032fbb7bb3 tempest-TenantUsagesNegativeTestJSON-1422695620 tempest-TenantUsagesNegativeTestJSON-1422695620-project-admin] Calling method '.version_select at 0x7fda19acbf70>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:44.611678 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-3f000ade-1ff7-4004-84b3-91032fbb7bb3 tempest-TenantUsagesNegativeTestJSON-1422695620 tempest-TenantUsagesNegativeTestJSON-1422695620-project-admin] HTTP exception thrown: Invalid start time. The start time cannot occur after the end time. Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f000ade-1ff7-4004-84b3-91032fbb7bb3 tempest-TenantUsagesNegativeTestJSON-1422695620 tempest-TenantUsagesNegativeTestJSON-1422695620-project-admin] Request method failure captured: Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-simple-tenant-usage/b70be24157a44f19945a48d0c3ab358f?start=2022-10-12T04%3A19%3A44.288223&end=2022-10-10T04%3A19%3A44.288223 HTTP/1.1 Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO7gi0NzcIO4ce80SVCkb_joJJ8AM8vHsr9H1b9nbdlwkMpwEhIizxNbf0bpOkJmpEES54x7FUTH9uGwe0Yw6a9YUvTxNQH_OYBC1uscN6QtfopcSh8SoSLZ0n3M5F4QDmwg3UA16l-Cfrs25KAwIhoqw9G8BKFHG2NSro5fwAq120Y Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 4be436f969e54ab9a88138c057d9a515 Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-1422695620 Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4be436f969e54ab9a88138c057d9a515"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4be436f969e54ab9a88138c057d9a515"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4be436f969e54ab9a88138c057d9a515"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4be436f969e54ab9a88138c057d9a515"}]}] Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-1422695620 Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 4be436f969e54ab9a88138c057d9a515 Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-1422695620 Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TenantUsagesNegativeTestJSON-1422695620-project-admin Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fa92bbf9e87d4c13a54bb3c8b06b7c2c Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-1422695620-project-admin Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid start time. The start time cannot occur after the end time. Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'b70be24157a44f19945a48d0c3ab358f'} Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 292, in show Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._show(req, id) Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 338, in _show Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi (period_start, period_stop, ignore) = self._get_datetime_range( Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 259, in _get_datetime_range Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid start time. The start time cannot occur after the end time. Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid start time. The start time cannot occur after the end time. Oct 11 04:19:44.615481 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:44.622852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f000ade-1ff7-4004-84b3-91032fbb7bb3 tempest-TenantUsagesNegativeTestJSON-1422695620 tempest-TenantUsagesNegativeTestJSON-1422695620-project-admin] Returning 400 to user: Invalid start time. The start time cannot occur after the end time. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:44.624202 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3f000ade-1ff7-4004-84b3-91032fbb7bb3 tempest-TenantUsagesNegativeTestJSON-1422695620 tempest-TenantUsagesNegativeTestJSON-1422695620-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/b70be24157a44f19945a48d0c3ab358f?start=2022-10-12T04%3A19%3A44.288223&end=2022-10-10T04%3A19%3A44.288223" status: 400 len: 111 microversion: 2.1 time: 0.024004 Oct 11 04:19:44.630973 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1146/2381] 10.222.0.26 () {58 vars in 1412 bytes} [Tue Oct 11 04:19:44 2022] GET /compute/v2.1/os-simple-tenant-usage/b70be24157a44f19945a48d0c3ab358f?start=2022-10-12T04%3A19%3A44.288223&end=2022-10-10T04%3A19%3A44.288223 => generated 111 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:19:44.881645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-342e7668-3497-41d0-a00e-d5cdf0426171 tempest-TenantUsagesNegativeTestJSON-216408221 tempest-TenantUsagesNegativeTestJSON-216408221-project] Calling method '.version_select at 0x7fda1a1b9280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:44.886549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-342e7668-3497-41d0-a00e-d5cdf0426171 tempest-TenantUsagesNegativeTestJSON-216408221 tempest-TenantUsagesNegativeTestJSON-216408221-project] Policy check for os_compute_api:os-simple-tenant-usage:list failed with credentials {'is_admin': False, 'user_id': '8b98d3afaa1c44a683f63f3ede83c977', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b70be24157a44f19945a48d0c3ab358f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-342e7668-3497-41d0-a00e-d5cdf0426171 tempest-TenantUsagesNegativeTestJSON-216408221 tempest-TenantUsagesNegativeTestJSON-216408221-project] Request method failure captured: Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T04%3A19%3A44.288223&end=2022-10-12T04%3A19%3A44.288223&detailed=1 HTTP/1.1 Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO7fUoVqNEY_PjZSZj3xvhe8IBmsJ06iBaMxk0L_-u2UYzG_sEfPi5_i4sS1dPUvqMyhDYHeSDcm-fIohNRXA_HDNt7L4Oic71CYDzCXUzzird6__tyPWwYMV-s45v7olP-jLXxoR1ZGYLe9WXQ3bHBYzFsgavvc2wFKfxSy8GUMk_Y Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: b70be24157a44f19945a48d0c3ab358f Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TenantUsagesNegativeTestJSON-216408221 Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b70be24157a44f19945a48d0c3ab358f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b70be24157a44f19945a48d0c3ab358f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b70be24157a44f19945a48d0c3ab358f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b70be24157a44f19945a48d0c3ab358f"}]}] Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TenantUsagesNegativeTestJSON-216408221 Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: b70be24157a44f19945a48d0c3ab358f Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TenantUsagesNegativeTestJSON-216408221 Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TenantUsagesNegativeTestJSON-216408221-project Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 8b98d3afaa1c44a683f63f3ede83c977 Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TenantUsagesNegativeTestJSON-216408221-project Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: action_args: {} Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 277, in index Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._index(req) Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/simple_tenant_usage.py", line 297, in _index Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(stu_policies.POLICY_ROOT % 'list') Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:19:44.890024 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:19:44.893828 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 04:19:44.893828 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:44.893828 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:44.893828 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:44.893828 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:44.893828 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:44.893828 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:44.893828 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:19:44.893828 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:19:44.893828 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. Oct 11 04:19:44.893828 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:44.896588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-342e7668-3497-41d0-a00e-d5cdf0426171 tempest-TenantUsagesNegativeTestJSON-216408221 tempest-TenantUsagesNegativeTestJSON-216408221-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-simple-tenant-usage:list to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:44.902266 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-342e7668-3497-41d0-a00e-d5cdf0426171 tempest-TenantUsagesNegativeTestJSON-216408221 tempest-TenantUsagesNegativeTestJSON-216408221-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T04%3A19%3A44.288223&end=2022-10-12T04%3A19%3A44.288223&detailed=1" status: 403 len: 123 microversion: 2.1 time: 0.266708 Oct 11 04:19:44.903714 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1147/2382] 10.222.0.26 () {58 vars in 1335 bytes} [Tue Oct 11 04:19:44 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T04%3A19%3A44.288223&end=2022-10-12T04%3A19%3A44.288223&detailed=1 => generated 123 bytes in 272 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:19:44.918597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:44.924581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:44.942724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:44.946788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:44.946788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:44.946788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:44.949374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:44.951291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:45.068794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b9cca5a1-178a-4de7-82e1-c769c79f106a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:45.076890 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b9cca5a1-178a-4de7-82e1-c769c79f106a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1507 microversion: 2.1 time: 0.643534 Oct 11 04:19:45.078054 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1236/2383] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:44 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1507 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:45.084628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-06b617c3-4219-4f84-a864-02980254b539 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:45.085355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-06b617c3-4219-4f84-a864-02980254b539 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:45.121644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b617c3-4219-4f84-a864-02980254b539 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:45.122209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b617c3-4219-4f84-a864-02980254b539 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:45.126853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b617c3-4219-4f84-a864-02980254b539 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:45.127701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b617c3-4219-4f84-a864-02980254b539 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:45.128186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b617c3-4219-4f84-a864-02980254b539 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:45.128876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b617c3-4219-4f84-a864-02980254b539 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:45.201483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:45.232050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:45.241440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:45.257967 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-61ae5a6c-5156-419a-9225-b09001e49ed0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.352696 Oct 11 04:19:45.264411 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1148/2384] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:44 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:45.283376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-618d46c1-b107-4b1c-8572-a49e2dd7c0a0 req-f1a0066a-829d-4f52-bb53-36f9e4a0f88f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c0e847-3028-4c23-9883-c46359435888", "tag": "c09c8b68-1867-4894-b401-c8c8585be179"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:45.290256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:45.319407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-618d46c1-b107-4b1c-8572-a49e2dd7c0a0 req-f1a0066a-829d-4f52-bb53-36f9e4a0f88f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:45.320395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-618d46c1-b107-4b1c-8572-a49e2dd7c0a0 req-f1a0066a-829d-4f52-bb53-36f9e4a0f88f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:45.321105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-618d46c1-b107-4b1c-8572-a49e2dd7c0a0 req-f1a0066a-829d-4f52-bb53-36f9e4a0f88f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:45.353886 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-618d46c1-b107-4b1c-8572-a49e2dd7c0a0 req-f1a0066a-829d-4f52-bb53-36f9e4a0f88f service nova] Creating event network-changed:c09c8b68-1867-4894-b401-c8c8585be179 for instance 94c0e847-3028-4c23-9883-c46359435888 on n-h2-860892-1 Oct 11 04:19:45.359198 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-618d46c1-b107-4b1c-8572-a49e2dd7c0a0 req-f1a0066a-829d-4f52-bb53-36f9e4a0f88f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092040 Oct 11 04:19:45.360014 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1149/2385] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:45.366128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:45.366874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:45.384966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:45.385440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:45.386068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:45.386948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:45.387538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:45.388411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:45.506328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:45.684188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:45.684188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:45.684188 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9da1db93-4e75-423b-82a1-c2f19d049664 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1265 microversion: 2.25 time: 0.182494 Oct 11 04:19:45.684188 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1150/2386] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:45 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:45.684188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9ca7052-45db-4213-9084-7782ef3cb5c3 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19c733a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:45.686959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=10 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:45.686959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-06b617c3-4219-4f84-a864-02980254b539 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:45.736585 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-06b617c3-4219-4f84-a864-02980254b539 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.623754 Oct 11 04:19:45.736585 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1237/2387] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:45 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:45.739766 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9ca7052-45db-4213-9084-7782ef3cb5c3 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.177490 Oct 11 04:19:45.740426 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1151/2388] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:45 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:45.744709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae8cb71b-ae44-4fbb-9cfa-3e263ca9c911 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:45.753020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae8cb71b-ae44-4fbb-9cfa-3e263ca9c911 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:45.754759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae8cb71b-ae44-4fbb-9cfa-3e263ca9c911 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:45.757655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae8cb71b-ae44-4fbb-9cfa-3e263ca9c911 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:45.758295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae8cb71b-ae44-4fbb-9cfa-3e263ca9c911 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:45.759166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae8cb71b-ae44-4fbb-9cfa-3e263ca9c911 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:45.759768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae8cb71b-ae44-4fbb-9cfa-3e263ca9c911 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:45.760370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae8cb71b-ae44-4fbb-9cfa-3e263ca9c911 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:46.026551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae8cb71b-ae44-4fbb-9cfa-3e263ca9c911 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:46.037685 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae8cb71b-ae44-4fbb-9cfa-3e263ca9c911 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1599 microversion: 2.1 time: 0.303967 Oct 11 04:19:46.044397 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1238/2389] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:45 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1599 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:46.292518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:46.293149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:46.308456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:46.314276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:46.315107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:46.319144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:46.323830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:46.325618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:46.352131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-fb49ac92-024d-4fd4-b55f-af8da0ff9598 req-fe009ee1-1745-4c8d-b436-bbd0285a89f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88c20dc0-ffa3-498c-be2b-a8311c1face7", "name": "network-vif-deleted", "tag": "32cb4580-f042-48a2-b372-b09a2ba049ab"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:46.380645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb49ac92-024d-4fd4-b55f-af8da0ff9598 req-fe009ee1-1745-4c8d-b436-bbd0285a89f8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:46.383629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb49ac92-024d-4fd4-b55f-af8da0ff9598 req-fe009ee1-1745-4c8d-b436-bbd0285a89f8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:46.384878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb49ac92-024d-4fd4-b55f-af8da0ff9598 req-fe009ee1-1745-4c8d-b436-bbd0285a89f8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:46.434796 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-fb49ac92-024d-4fd4-b55f-af8da0ff9598 req-fe009ee1-1745-4c8d-b436-bbd0285a89f8 service nova] Creating event network-vif-deleted:32cb4580-f042-48a2-b372-b09a2ba049ab for instance 88c20dc0-ffa3-498c-be2b-a8311c1face7 on n-h2-860892-1 Oct 11 04:19:46.442225 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-fb49ac92-024d-4fd4-b55f-af8da0ff9598 req-fe009ee1-1745-4c8d-b436-bbd0285a89f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094395 Oct 11 04:19:46.448991 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1239/2390] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:46.569447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:46.571105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:46.579029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:46.580577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:46.581646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:46.587730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:46.588469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:46.589140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:46.691923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:46.706295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:46.709424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:46.721093 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0c3f6deb-bae6-45fa-bc20-3c27dde7cc6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.432433 Oct 11 04:19:46.724478 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1152/2391] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:46 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:46.734407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3c9a2eef-15a4-4b0d-90f4-0d7cbe04cd9d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:46.736352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3c9a2eef-15a4-4b0d-90f4-0d7cbe04cd9d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:46.752674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c9a2eef-15a4-4b0d-90f4-0d7cbe04cd9d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:46.753796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c9a2eef-15a4-4b0d-90f4-0d7cbe04cd9d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:46.754497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c9a2eef-15a4-4b0d-90f4-0d7cbe04cd9d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:46.755401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c9a2eef-15a4-4b0d-90f4-0d7cbe04cd9d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:46.756087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c9a2eef-15a4-4b0d-90f4-0d7cbe04cd9d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:46.756707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c9a2eef-15a4-4b0d-90f4-0d7cbe04cd9d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:47.007872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:47.031954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:47.036976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:47.039187 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c998305d-f0b6-4804-b531-1bb8f0b3bf9a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1265 microversion: 2.25 time: 0.473263 Oct 11 04:19:47.041512 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1240/2392] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:46 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1265 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:47.050368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6008a32-151b-4a0d-878f-08d1eee7753b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19414550>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:47.083421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=10 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:47.138902 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6008a32-151b-4a0d-878f-08d1eee7753b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.095924 Oct 11 04:19:47.140861 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1241/2393] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:47 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:47.151863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:47.153502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:47.170415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:47.171234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:47.172276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:47.174644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:47.175356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:47.180721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:47.221410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3c9a2eef-15a4-4b0d-90f4-0d7cbe04cd9d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:47.236233 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3c9a2eef-15a4-4b0d-90f4-0d7cbe04cd9d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.510446 Oct 11 04:19:47.258510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:47.260810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:47.261467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:47.262447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lazy-loading 'fault' on Instance uuid 88c20dc0-ffa3-498c-be2b-a8311c1face7 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:19:47.266572 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1153/2394] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:46 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:47.286659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:47.467219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f84e9b7d8d4f54821b258152a91b43', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6a0c312aeff4ec2a9ca6d62d8e8f094', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:47.481865 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-49c6128b-1911-412f-b017-cca97e7e3b15 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 200 len: 1316 microversion: 2.1 time: 0.338920 Oct 11 04:19:47.489829 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1242/2395] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:47 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:47.757238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:47.757911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:47.779482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:47.779922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:47.782491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:47.784681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:47.785225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:47.785672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:48.024112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:48.057018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:48.066966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:48.068476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:48.084447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:48.093478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:48.094035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:48.095278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:48.096771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:48.100789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:48.105626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:48.105626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:48.117322 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-49466c7c-6073-425e-bd9a-a556c72416e7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.362116 Oct 11 04:19:48.121383 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1154/2396] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:47 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:48.156397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-87d2d6b7-c585-4dcb-bd44-0dba87ade332 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b4d9d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:48.258666 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-87d2d6b7-c585-4dcb-bd44-0dba87ade332 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.104495 Oct 11 04:19:48.260130 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1155/2397] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:48 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:48.271769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-74e3515f-8db9-4d71-b78e-92ceb64f73aa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:48.272915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-74e3515f-8db9-4d71-b78e-92ceb64f73aa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:48.289120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74e3515f-8db9-4d71-b78e-92ceb64f73aa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:48.291449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74e3515f-8db9-4d71-b78e-92ceb64f73aa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:48.292072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74e3515f-8db9-4d71-b78e-92ceb64f73aa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:48.296915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74e3515f-8db9-4d71-b78e-92ceb64f73aa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:48.297862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74e3515f-8db9-4d71-b78e-92ceb64f73aa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:48.298621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74e3515f-8db9-4d71-b78e-92ceb64f73aa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:48.353451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:48.484056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:48.499531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:48.504785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:48.506872 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bc8f1e62-c33f-4134-b0b5-3e2cc8286434 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 200 len: 1265 microversion: 2.25 time: 0.447046 Oct 11 04:19:48.524707 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1243/2398] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:48 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 1265 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:48.541345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a1e902d6-df6f-4b8b-8afe-491479713e80 req-d296f4d8-c120-4b89-a728-0eebddd65e9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "94c0e847-3028-4c23-9883-c46359435888", "tag": "816b46ee-3ec3-4c2d-b97f-8d8214dcc49f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:48.589906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a1e902d6-df6f-4b8b-8afe-491479713e80 req-d296f4d8-c120-4b89-a728-0eebddd65e9d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:48.593274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a1e902d6-df6f-4b8b-8afe-491479713e80 req-d296f4d8-c120-4b89-a728-0eebddd65e9d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:48.595282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a1e902d6-df6f-4b8b-8afe-491479713e80 req-d296f4d8-c120-4b89-a728-0eebddd65e9d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:48.630078 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a1e902d6-df6f-4b8b-8afe-491479713e80 req-d296f4d8-c120-4b89-a728-0eebddd65e9d service nova] Creating event network-changed:816b46ee-3ec3-4c2d-b97f-8d8214dcc49f for instance 94c0e847-3028-4c23-9883-c46359435888 on n-h2-860892-1 Oct 11 04:19:48.650038 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a1e902d6-df6f-4b8b-8afe-491479713e80 req-d296f4d8-c120-4b89-a728-0eebddd65e9d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.123914 Oct 11 04:19:48.666760 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1244/2399] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:48.673892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:48.676530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] [instance: 88c20dc0-ffa3-498c-be2b-a8311c1face7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:48.694837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:48.695588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:48.698506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:48.702871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:48.702871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:48.702871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:48.751871 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] HTTP exception thrown: Instance 88c20dc0-ffa3-498c-be2b-a8311c1face7 could not be found. Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Request method failure captured: Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 HTTP/1.1 Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO6YJqNRsLE_7hMlTN6t8R15Ts3Bd9ZJ5_on0z9TKUvVZ2sv1deJLn0lkmNpMgTzYnQqPXGUBJzjZLC9IWnvsrYXY5bHpugJCcpxfEA4RLaPpoC30f1pwC2Gc0ggxSh-yzpt0jvnk1h-07oJsPg64e1wxs4lbkkjE2z_bQi7HUnVf8o Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: a6a0c312aeff4ec2a9ca6d62d8e8f094 Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestFqdnHostnames-1283103641 Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a6a0c312aeff4ec2a9ca6d62d8e8f094"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a6a0c312aeff4ec2a9ca6d62d8e8f094"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a6a0c312aeff4ec2a9ca6d62d8e8f094"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a6a0c312aeff4ec2a9ca6d62d8e8f094"}]}] Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestFqdnHostnames-1283103641 Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: a6a0c312aeff4ec2a9ca6d62d8e8f094 Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestFqdnHostnames-1283103641 Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestFqdnHostnames-1283103641-project Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 57f84e9b7d8d4f54821b258152a91b43 Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestFqdnHostnames-1283103641-project Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 88c20dc0-ffa3-498c-be2b-a8311c1face7 could not be found. Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '88c20dc0-ffa3-498c-be2b-a8311c1face7'} Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88c20dc0-ffa3-498c-be2b-a8311c1face7 could not be found. Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88c20dc0-ffa3-498c-be2b-a8311c1face7 could not be found. Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:48.763586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:48.768257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:48.768257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:48.768257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:48.768257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:19:48.768257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:19:48.768257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88c20dc0-ffa3-498c-be2b-a8311c1face7 could not be found. Oct 11 04:19:48.768257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:48.775600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Returning 404 to user: Instance 88c20dc0-ffa3-498c-be2b-a8311c1face7 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:48.778437 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b36524ce-e40b-4c2f-b08a-c8a64e6bd333 tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7" status: 404 len: 111 microversion: 2.1 time: 0.117474 Oct 11 04:19:48.781950 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1245/2400] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:48 2022] GET /compute/v2.1/servers/88c20dc0-ffa3-498c-be2b-a8311c1face7 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:19:48.800489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6b7f7428-5e4f-407a-88a0-ef48c28c9f8c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] Calling method '.version_select at 0x7fda193cc040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:48.941495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-74e3515f-8db9-4d71-b78e-92ceb64f73aa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:48.955999 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6b7f7428-5e4f-407a-88a0-ef48c28c9f8c tempest-ServersTestFqdnHostnames-1283103641 tempest-ServersTestFqdnHostnames-1283103641-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756943681" status: 202 len: 0 microversion: 2.1 time: 0.169250 Oct 11 04:19:48.959885 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1246/2401] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:19:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1756943681 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:19:48.978915 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-74e3515f-8db9-4d71-b78e-92ceb64f73aa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.717424 Oct 11 04:19:49.004814 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1156/2402] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:48 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:49.153811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:49.155245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:49.187242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:49.192016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:49.194037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:49.195043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:49.199862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:49.200623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:49.280701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae281404-ac82-4922-bf2c-0721d7a74d08 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19e84e50>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:49.358540 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ae281404-ac82-4922-bf2c-0721d7a74d08 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.086648 Oct 11 04:19:49.359255 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1157/2403] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:49 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:49.469484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:49.483996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:49.487893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:49.498683 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cea9e6ca-7a74-4006-b35e-ee132e18845f tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.349529 Oct 11 04:19:49.502542 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1247/2404] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:49 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:49.541958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:49.541958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 7d993e3f-2858-478c-941e-7d874a4fcb5e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:49.557802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:49.558573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:49.559352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:49.560237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:49.563737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:49.566161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:49.599155 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] HTTP exception thrown: Instance 7d993e3f-2858-478c-941e-7d874a4fcb5e could not be found. Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Request method failure captured: Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e HTTP/1.1 Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO02Jp3ZmOnkaOP3BcJZr1vU8zlnGbIhsrUEF9N-AsihPNARfhojxnPEwYqOwWDvFgRxbnlCh0bs1DdCYV0k0HRzOQ9DPb5dc2Znjrnvkid3wNRAuz4yBRuoLh0ra1BS7QtRnVlW-f_58X6h_UnduJ33HntzEeDVAxLgPtDbepmZ6Xc Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: daa8ad03685c4b59b3274fc6407c9eb7 Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/daa8ad03685c4b59b3274fc6407c9eb7"}]}] Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: daa8ad03685c4b59b3274fc6407c9eb7 Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-LiveAutoBlockMigrationV225Test-2006568427-project Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 917dab915f7d4303989abb47a33f47df Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427-project Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 7d993e3f-2858-478c-941e-7d874a4fcb5e could not be found. Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '7d993e3f-2858-478c-941e-7d874a4fcb5e'} Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d993e3f-2858-478c-941e-7d874a4fcb5e could not be found. Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d993e3f-2858-478c-941e-7d874a4fcb5e could not be found. Oct 11 04:19:49.606059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.609406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:49.609406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.609406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:49.609406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:49.609406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:49.609406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:19:49.609406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:19:49.609406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d993e3f-2858-478c-941e-7d874a4fcb5e could not be found. Oct 11 04:19:49.609406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.609406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Returning 404 to user: Instance 7d993e3f-2858-478c-941e-7d874a4fcb5e could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:49.609406 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cec7adfa-834c-47c7-8976-d9bc1f9438c0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e" status: 404 len: 111 microversion: 2.25 time: 0.071713 Oct 11 04:19:49.623506 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1158/2405] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:49 2022] GET /compute/v2.1/servers/7d993e3f-2858-478c-941e-7d874a4fcb5e => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:19:49.641977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "67f35395-aa69-4f1f-b3eb-9e4ee0370fc5"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:49.645519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:49.654857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:49.656384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:49.656384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:49.658336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:49.659016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:49.659616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:49.741387 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] HTTP exception thrown: Volume 52b280d8-b889-4bb9-9c83-fb49b1714d99 could not be found. Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Request method failure captured: Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3/os-volume_attachments/52b280d8-b889-4bb9-9c83-fb49b1714d99 HTTP/1.1 Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 74 Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5ls00C43WuMxynuWXqJVCZam86oolrL8KgsKtyCagylBlfqfDTgf5RyJN22Frzm_6nnVzg1WiskTys9CFbZJFt7HuR937zP2yDklUZzKRJzexinvdyobRWQz_IZTn201EOBTO55n9ya4Is6rzMGfWeWeRrPVN45S6TUq3ztKaAstk Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4adf4a31b1f8424eb8678c056e79f76f Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesAdminNegativeTest-924255475 Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4adf4a31b1f8424eb8678c056e79f76f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4adf4a31b1f8424eb8678c056e79f76f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4adf4a31b1f8424eb8678c056e79f76f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4adf4a31b1f8424eb8678c056e79f76f"}]}] Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesAdminNegativeTest-924255475 Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4adf4a31b1f8424eb8678c056e79f76f Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-924255475 Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesAdminNegativeTest-924255475-project-admin Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: d47d177636994e9f98d929b77c0ea5c7 Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesAdminNegativeTest-924255475-project-admin Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: {"volumeAttachment": {"volumeId": "67f35395-aa69-4f1f-b3eb-9e4ee0370fc5"}} Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: exception: Volume 52b280d8-b889-4bb9-9c83-fb49b1714d99 could not be found. Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'server_id': '6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3', 'id': '52b280d8-b889-4bb9-9c83-fb49b1714d99', 'body': {'volumeAttachment': {'volumeId': '67f35395-aa69-4f1f-b3eb-9e4ee0370fc5'}}} Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52b280d8-b889-4bb9-9c83-fb49b1714d99 could not be found. (HTTP 404) (Request-ID: req-3581b15a-1a43-4bca-a3c4-a0a4afe754c2) Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 04:19:49.744307 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52b280d8-b889-4bb9-9c83-fb49b1714d99 could not be found. Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52b280d8-b889-4bb9-9c83-fb49b1714d99 could not be found. Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52b280d8-b889-4bb9-9c83-fb49b1714d99 could not be found. Oct 11 04:19:49.748517 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:19:49.757316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] Returning 404 to user: Volume 52b280d8-b889-4bb9-9c83-fb49b1714d99 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:19:49.760106 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-56cbc965-216f-4499-8e3d-e4333ba8db28 tempest-VolumesAdminNegativeTest-924255475 tempest-VolumesAdminNegativeTest-924255475-project-admin] 10.222.0.26 "PUT /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3/os-volume_attachments/52b280d8-b889-4bb9-9c83-fb49b1714d99" status: 404 len: 109 microversion: 2.1 time: 0.123165 Oct 11 04:19:49.767185 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1248/2406] 10.222.0.26 () {60 vars in 1433 bytes} [Tue Oct 11 04:19:49 2022] PUT /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3/os-volume_attachments/52b280d8-b889-4bb9-9c83-fb49b1714d99 => generated 109 bytes in 131 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:19:50.012944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c53d6a0d-c513-44ea-bdb1-65c69d1b5cd5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:50.013677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c53d6a0d-c513-44ea-bdb1-65c69d1b5cd5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:50.041370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c53d6a0d-c513-44ea-bdb1-65c69d1b5cd5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:50.046373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c53d6a0d-c513-44ea-bdb1-65c69d1b5cd5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:50.046840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c53d6a0d-c513-44ea-bdb1-65c69d1b5cd5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:50.047593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c53d6a0d-c513-44ea-bdb1-65c69d1b5cd5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:50.054961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c53d6a0d-c513-44ea-bdb1-65c69d1b5cd5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:50.058029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c53d6a0d-c513-44ea-bdb1-65c69d1b5cd5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:50.390928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b36aec2-9313-4ee6-a05b-4f9b0012e005 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1e0f7ca0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:50.530392 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b36aec2-9313-4ee6-a05b-4f9b0012e005 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.157019 Oct 11 04:19:50.539560 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1249/2407] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:50 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:50.541848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c53d6a0d-c513-44ea-bdb1-65c69d1b5cd5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:50.551780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:50.553219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:50.560359 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c53d6a0d-c513-44ea-bdb1-65c69d1b5cd5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.544649 Oct 11 04:19:50.560359 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1159/2408] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:50 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:50.609662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:50.614844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:50.616168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:50.619642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:50.623040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:50.623830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:50.915152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:50.928549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:50.947129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:50.961381 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce175e6a-805c-4fe7-9681-d7990ef01acc tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.418825 Oct 11 04:19:50.962594 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1250/2409] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:50 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:51.544070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f32986b9-b655-4a1f-9d0a-6299b51fc491 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1a4355e0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:51.581957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8a265c7a-0481-42ab-85f9-e48a69a9e2fd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:51.583196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8a265c7a-0481-42ab-85f9-e48a69a9e2fd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:51.593911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a265c7a-0481-42ab-85f9-e48a69a9e2fd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:51.599589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a265c7a-0481-42ab-85f9-e48a69a9e2fd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:51.600291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a265c7a-0481-42ab-85f9-e48a69a9e2fd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:51.601033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a265c7a-0481-42ab-85f9-e48a69a9e2fd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:51.601492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a265c7a-0481-42ab-85f9-e48a69a9e2fd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:51.601916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a265c7a-0481-42ab-85f9-e48a69a9e2fd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:51.652278 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f32986b9-b655-4a1f-9d0a-6299b51fc491 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.111321 Oct 11 04:19:51.653919 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1160/2410] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:51 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:51.999298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:52.000175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:52.013931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:52.015571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:52.016187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:52.017074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:52.022551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:52.022551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:52.230992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:52.244351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:52.263570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:52.280858 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f0c7de9-7578-4e2b-a0c1-1afd668589b3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.290364 Oct 11 04:19:52.284952 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1161/2411] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:51 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:19:52.383232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8a265c7a-0481-42ab-85f9-e48a69a9e2fd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:52.392903 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8a265c7a-0481-42ab-85f9-e48a69a9e2fd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.815722 Oct 11 04:19:52.398006 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1251/2412] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:51 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 821 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:52.669550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f20be2e-1f9b-4e95-86a8-709a552a5fb5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19bc5820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:52.757796 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f20be2e-1f9b-4e95-86a8-709a552a5fb5 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.092710 Oct 11 04:19:52.759069 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1162/2413] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:52 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:53.329198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:53.330362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:53.342929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:53.346118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:53.348329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:53.349218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:53.354405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:53.355035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:53.424964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bf857cd4-0e06-44aa-8e67-777b926a8285 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:53.426000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bf857cd4-0e06-44aa-8e67-777b926a8285 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:53.441008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf857cd4-0e06-44aa-8e67-777b926a8285 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:53.445245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf857cd4-0e06-44aa-8e67-777b926a8285 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:53.449081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf857cd4-0e06-44aa-8e67-777b926a8285 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:53.454868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf857cd4-0e06-44aa-8e67-777b926a8285 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:53.455545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf857cd4-0e06-44aa-8e67-777b926a8285 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:53.457252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf857cd4-0e06-44aa-8e67-777b926a8285 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:53.625605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:53.640413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:53.642215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:53.656023 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb36868a-e4d0-46d2-ba97-a5b3713a8668 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.331371 Oct 11 04:19:53.661433 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1252/2414] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:53 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:53.773867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2527f45a-4e2a-44e6-8470-8d5744e7d331 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1e0f7040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:53.850318 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2527f45a-4e2a-44e6-8470-8d5744e7d331 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.081263 Oct 11 04:19:53.862461 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1253/2415] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:53 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:54.308585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf857cd4-0e06-44aa-8e67-777b926a8285 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:54.323228 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bf857cd4-0e06-44aa-8e67-777b926a8285 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.900815 Oct 11 04:19:54.342260 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1163/2416] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:53 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:54.692406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:54.693153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:54.705496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:54.707932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:54.715874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:54.715874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:54.715874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:54.715874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:54.767860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:54.868425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a4e7250a-36c4-4d4f-b69e-c0479c4453e6 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda199dfee0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:54.875301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:54.892214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:54.896828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:54.928848 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a4e7250a-36c4-4d4f-b69e-c0479c4453e6 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.066777 Oct 11 04:19:54.938651 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1164/2417] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:54 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:19:54.983540 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-09eee651-9e4a-4a5f-bf07-3da0cead4c7b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.234158 Oct 11 04:19:55.002289 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1254/2418] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:54 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:55.358361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-671f41b0-3375-4795-8ce5-b4d33f8436fa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:55.358361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-671f41b0-3375-4795-8ce5-b4d33f8436fa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:55.375809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-671f41b0-3375-4795-8ce5-b4d33f8436fa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:55.376645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-671f41b0-3375-4795-8ce5-b4d33f8436fa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:55.377244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-671f41b0-3375-4795-8ce5-b4d33f8436fa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:55.379899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-671f41b0-3375-4795-8ce5-b4d33f8436fa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:55.380512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-671f41b0-3375-4795-8ce5-b4d33f8436fa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:55.381131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-671f41b0-3375-4795-8ce5-b4d33f8436fa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:55.692722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5775c51c-9b39-49e0-bef3-ba869994edb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:55.693757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5775c51c-9b39-49e0-bef3-ba869994edb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:55.701203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5775c51c-9b39-49e0-bef3-ba869994edb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:55.701872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5775c51c-9b39-49e0-bef3-ba869994edb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:55.702500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5775c51c-9b39-49e0-bef3-ba869994edb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:55.703356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5775c51c-9b39-49e0-bef3-ba869994edb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:55.703958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5775c51c-9b39-49e0-bef3-ba869994edb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:55.704535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5775c51c-9b39-49e0-bef3-ba869994edb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:55.790024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5775c51c-9b39-49e0-bef3-ba869994edb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:19:56.236994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-671f41b0-3375-4795-8ce5-b4d33f8436fa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:56.251845 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-671f41b0-3375-4795-8ce5-b4d33f8436fa tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.898536 Oct 11 04:19:56.272908 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1165/2419] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:55 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:56.288157 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5775c51c-9b39-49e0-bef3-ba869994edb9 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 204 len: 0 microversion: 2.1 time: 0.599603 Oct 11 04:19:56.291909 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1255/2420] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:19:55 2022] DELETE /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:19:56.300016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-455a7a9c-34e5-4129-8103-56d5ba20723c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19a07550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:56.300170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:56.300170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:56.328828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:56.330579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:56.336921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:56.336921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:56.336921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:56.336921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:56.397621 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-455a7a9c-34e5-4129-8103-56d5ba20723c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.123141 Oct 11 04:19:56.399690 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1166/2421] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:56 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:56.420755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b43f6115-e97f-4057-bb65-2a1a78162a5f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:56.421718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b43f6115-e97f-4057-bb65-2a1a78162a5f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:56.440809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b43f6115-e97f-4057-bb65-2a1a78162a5f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:56.446701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b43f6115-e97f-4057-bb65-2a1a78162a5f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:56.447375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b43f6115-e97f-4057-bb65-2a1a78162a5f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:56.449785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b43f6115-e97f-4057-bb65-2a1a78162a5f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:56.450535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b43f6115-e97f-4057-bb65-2a1a78162a5f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:56.451151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b43f6115-e97f-4057-bb65-2a1a78162a5f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:56.591072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:56.608023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:56.609451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:56.636649 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fd797e8f-24aa-4760-87b1-d9491c539a59 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.343412 Oct 11 04:19:56.657743 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1256/2422] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:56 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:57.012598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-94aa8bab-9fa5-45f3-a4f5-113ea28057e0 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:57.041128 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-94aa8bab-9fa5-45f3-a4f5-113ea28057e0 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.378216 Oct 11 04:19:57.042916 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1257/2423] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:19:56 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:57.069265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90d4153d-7bdd-4436-a31e-0d2e85707da0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:57.078228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90d4153d-7bdd-4436-a31e-0d2e85707da0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:57.130403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d4153d-7bdd-4436-a31e-0d2e85707da0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:57.135448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d4153d-7bdd-4436-a31e-0d2e85707da0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:57.135912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d4153d-7bdd-4436-a31e-0d2e85707da0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:57.136675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d4153d-7bdd-4436-a31e-0d2e85707da0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:57.137139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d4153d-7bdd-4436-a31e-0d2e85707da0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:57.137563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d4153d-7bdd-4436-a31e-0d2e85707da0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:57.263533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90d4153d-7bdd-4436-a31e-0d2e85707da0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:19:57.691317 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90d4153d-7bdd-4436-a31e-0d2e85707da0 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 204 len: 0 microversion: 2.25 time: 0.640459 Oct 11 04:19:57.692475 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1258/2424] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:19:57 2022] DELETE /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 0 bytes in 649 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:19:57.700379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7fcbe99b-b22f-41ab-b3a6-7f83af6c2f54 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:57.793348 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7fcbe99b-b22f-41ab-b3a6-7f83af6c2f54 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors" status: 200 len: 2594 microversion: 2.1 time: 0.089580 Oct 11 04:19:57.793348 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1259/2425] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:19:57 2022] GET /compute/v2.1/flavors => generated 2594 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:57.810536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4fcb5822-4943-4eb3-9c28-c23d089d10a5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:57.811291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4fcb5822-4943-4eb3-9c28-c23d089d10a5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:57.831279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fcb5822-4943-4eb3-9c28-c23d089d10a5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:57.844572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fcb5822-4943-4eb3-9c28-c23d089d10a5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:57.845035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fcb5822-4943-4eb3-9c28-c23d089d10a5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:57.845799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fcb5822-4943-4eb3-9c28-c23d089d10a5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:57.846295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fcb5822-4943-4eb3-9c28-c23d089d10a5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:57.846723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fcb5822-4943-4eb3-9c28-c23d089d10a5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:57.944792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b43f6115-e97f-4057-bb65-2a1a78162a5f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:57.955610 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b43f6115-e97f-4057-bb65-2a1a78162a5f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1513 microversion: 2.1 time: 1.554612 Oct 11 04:19:57.965071 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1167/2426] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:56 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1513 bytes in 1564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:57.984384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-58c416df-8295-4c23-b248-dab5f549d0af tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b5d1f0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:58.080956 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-58c416df-8295-4c23-b248-dab5f549d0af tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.111594 Oct 11 04:19:58.088356 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1168/2427] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:57 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:58.101403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:58.105035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:58.122523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:58.127378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:58.128199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:58.131512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:58.132238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:58.133538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:58.349291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:58.376985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:58.381261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:58.394375 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9c55696-5ed3-42c6-969d-f98f7d1433a1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1554 microversion: 2.91 time: 0.303756 Oct 11 04:19:58.397545 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1169/2428] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:58 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1554 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:58.416136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:58.417901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:58.434642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:58.435341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:58.437439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:58.439857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:58.442503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:58.443071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:58.932442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:58.946565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:58.948952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:58.952286 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2d9fbb4c-6a6b-47ab-9a01-102c99be8fa2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1731 microversion: 2.25 time: 0.551430 Oct 11 04:19:58.971441 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1170/2429] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:58 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1731 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:19:58.983722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a563775-5bfa-47bf-b552-2a52f03df1c1 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:59.003984 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5a563775-5bfa-47bf-b552-2a52f03df1c1 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028023 Oct 11 04:19:59.005232 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1171/2430] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:19:58 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:59.010116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a485bb91-040c-40d1-85f4-dfa6913eb55f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:59.020007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a485bb91-040c-40d1-85f4-dfa6913eb55f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:59.029497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a485bb91-040c-40d1-85f4-dfa6913eb55f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:59.038426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a485bb91-040c-40d1-85f4-dfa6913eb55f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:59.044289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a485bb91-040c-40d1-85f4-dfa6913eb55f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:59.044289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a485bb91-040c-40d1-85f4-dfa6913eb55f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:59.044289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a485bb91-040c-40d1-85f4-dfa6913eb55f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:59.044289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a485bb91-040c-40d1-85f4-dfa6913eb55f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:59.509389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a485bb91-040c-40d1-85f4-dfa6913eb55f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:59.542403 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a485bb91-040c-40d1-85f4-dfa6913eb55f tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1471 microversion: 2.1 time: 0.529142 Oct 11 04:19:59.567447 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1172/2431] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:59 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1471 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:59.595260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4fcb5822-4943-4eb3-9c28-c23d089d10a5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:19:59.605521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-506839b4-efae-48c2-88f6-1b57f5a82c04 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:59.606321 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4fcb5822-4943-4eb3-9c28-c23d089d10a5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 1.811006 Oct 11 04:19:59.606918 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1260/2432] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:19:57 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 1816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:59.627740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-703d1d1a-5e99-4138-81f2-1a21a2df3d82 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1a050a60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:59.634589 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-506839b4-efae-48c2-88f6-1b57f5a82c04 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.064307 Oct 11 04:19:59.636984 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1173/2433] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:19:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:59.653684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-d1afce4d-0ad1-4f1f-9a22-d62f754bcbf0 req-b2b976e9-d3fa-4b97-8347-598e6ddef6e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3", "name": "network-vif-deleted", "tag": "dc2a5f1b-dccb-4cf0-b76a-31816c72e68a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:19:59.669440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d1afce4d-0ad1-4f1f-9a22-d62f754bcbf0 req-b2b976e9-d3fa-4b97-8347-598e6ddef6e2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:59.669948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d1afce4d-0ad1-4f1f-9a22-d62f754bcbf0 req-b2b976e9-d3fa-4b97-8347-598e6ddef6e2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:59.670538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d1afce4d-0ad1-4f1f-9a22-d62f754bcbf0 req-b2b976e9-d3fa-4b97-8347-598e6ddef6e2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:59.703352 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-d1afce4d-0ad1-4f1f-9a22-d62f754bcbf0 req-b2b976e9-d3fa-4b97-8347-598e6ddef6e2 service nova] Creating event network-vif-deleted:dc2a5f1b-dccb-4cf0-b76a-31816c72e68a for instance 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 on n-h1-860892-1 Oct 11 04:19:59.715004 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-d1afce4d-0ad1-4f1f-9a22-d62f754bcbf0 req-b2b976e9-d3fa-4b97-8347-598e6ddef6e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072946 Oct 11 04:19:59.717339 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1174/2434] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:19:59.733514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:59.734913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:19:59.757310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:59.760731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:59.761778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:59.762556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:19:59.763016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:19:59.763437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:19:59.775484 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-703d1d1a-5e99-4138-81f2-1a21a2df3d82 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1453 microversion: 2.1 time: 0.165807 Oct 11 04:19:59.776061 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1261/2435] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:19:59 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:59.795455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-398d0c8b-f0f3-4b96-97ba-5edf21feead8 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:59.884022 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-398d0c8b-f0f3-4b96-97ba-5edf21feead8 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minDisk=2" status: 200 len: 3209 microversion: 2.1 time: 0.105320 Oct 11 04:19:59.891820 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1262/2436] 10.222.0.26 () {58 vars in 1165 bytes} [Tue Oct 11 04:19:59 2022] GET /compute/v2.1/flavors/detail?minDisk=2 => generated 3209 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:19:59.920038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c8d08007-4c5e-4a28-a1c1-f2505901a095 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:19:59.931958 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c8d08007-4c5e-4a28-a1c1-f2505901a095 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.016841 Oct 11 04:19:59.935743 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1263/2437] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:19:59 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:19:59.944630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:19:59.955870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33b70aee-28bc-44ba-8288-efd44bb3cd17 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:00.025689 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-33b70aee-28bc-44ba-8288-efd44bb3cd17 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?minRam=1025" status: 200 len: 2145 microversion: 2.1 time: 0.081758 Oct 11 04:20:00.026296 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1264/2438] 10.222.0.26 () {58 vars in 1169 bytes} [Tue Oct 11 04:19:59 2022] GET /compute/v2.1/flavors/detail?minRam=1025 => generated 2145 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:00.057521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:00.058169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:00.077022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:00.078074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:00.078822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:00.079950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:00.080619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:00.082670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:00.128699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:00.149990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:00.152907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:00.158835 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c66fdd2-e3ab-4555-b70c-e2da26bf3648 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.439391 Oct 11 04:20:00.160704 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1175/2439] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:19:59 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:00.165802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31a61bb5-00f1-4636-910f-fccc6311adad tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:00.180750 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-31a61bb5-00f1-4636-910f-fccc6311adad tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?limit=1" status: 200 len: 476 microversion: 2.1 time: 0.018691 Oct 11 04:20:00.193112 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1176/2440] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:20:00 2022] GET /compute/v2.1/flavors/detail?limit=1 => generated 476 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:00.220663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1854c81c-c3b7-42e3-a4f6-a97d6c9743a4 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:00.235288 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1854c81c-c3b7-42e3-a4f6-a97d6c9743a4 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.019881 Oct 11 04:20:00.236167 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1177/2441] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:20:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:00.248953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aa793d3f-7bf9-4eeb-8afb-dba8c89af99b tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:00.361594 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aa793d3f-7bf9-4eeb-8afb-dba8c89af99b tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail?marker=452" status: 200 len: 2500 microversion: 2.1 time: 0.116413 Oct 11 04:20:00.369249 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1178/2442] 10.222.0.26 () {58 vars in 1167 bytes} [Tue Oct 11 04:20:00 2022] GET /compute/v2.1/flavors/detail?marker=452 => generated 2500 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:20:00.383360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a0b0aeb5-e62d-488f-9c1d-a8f14525e0bd tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:00.396554 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a0b0aeb5-e62d-488f-9c1d-a8f14525e0bd tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.017306 Oct 11 04:20:00.399924 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1179/2443] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:20:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:00.428932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8d2c9dbd-f721-4ab8-b21b-2a415e018980 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:00.531609 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8d2c9dbd-f721-4ab8-b21b-2a415e018980 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors?minDisk=2" status: 200 len: 1663 microversion: 2.1 time: 0.112841 Oct 11 04:20:00.539801 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1180/2444] 10.222.0.26 () {58 vars in 1144 bytes} [Tue Oct 11 04:20:00 2022] GET /compute/v2.1/flavors?minDisk=2 => generated 1663 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:00.554626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-af02e232-a49c-432c-918c-e984b306ce5a req-54ea76f8-c5a4-483a-b98f-ae8ff581cf81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c0e847-3028-4c23-9883-c46359435888", "name": "network-vif-plugged", "status": "completed", "tag": "c09c8b68-1867-4894-b401-c8c8585be179"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:00.569435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af02e232-a49c-432c-918c-e984b306ce5a req-54ea76f8-c5a4-483a-b98f-ae8ff581cf81 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:00.569435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af02e232-a49c-432c-918c-e984b306ce5a req-54ea76f8-c5a4-483a-b98f-ae8ff581cf81 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:00.569435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af02e232-a49c-432c-918c-e984b306ce5a req-54ea76f8-c5a4-483a-b98f-ae8ff581cf81 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:00.591142 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-af02e232-a49c-432c-918c-e984b306ce5a req-54ea76f8-c5a4-483a-b98f-ae8ff581cf81 service nova] Creating event network-vif-plugged:c09c8b68-1867-4894-b401-c8c8585be179 for instance 94c0e847-3028-4c23-9883-c46359435888 on n-h2-860892-1 Oct 11 04:20:00.599601 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-af02e232-a49c-432c-918c-e984b306ce5a req-54ea76f8-c5a4-483a-b98f-ae8ff581cf81 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055184 Oct 11 04:20:00.600394 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1181/2445] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:00.612170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ee99ed32-b62f-43d7-bf70-a1976053a3f5 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:00.621302 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ee99ed32-b62f-43d7-bf70-a1976053a3f5 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.014578 Oct 11 04:20:00.621856 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1182/2446] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:20:00 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 17 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:00.633487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:00.634231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:00.671136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:00.675380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:00.676003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:00.681055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:00.681564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:00.686340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:00.735204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:00.737799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:00.737799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:00.737799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lazy-loading 'fault' on Instance uuid 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:20:00.772345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:00.782264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:00.792791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:00.796547 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef02ee08-919c-46e2-be13-c99d9b3fbd86 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1731 microversion: 2.25 time: 0.768267 Oct 11 04:20:00.799120 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1265/2447] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:00 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1731 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:00.810333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3fbcffa5-7187-447d-a0e2-5c5380b74495 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:00.857093 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3fbcffa5-7187-447d-a0e2-5c5380b74495 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors?minRam=1025" status: 200 len: 1111 microversion: 2.1 time: 0.056614 Oct 11 04:20:00.859251 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1266/2448] 10.222.0.26 () {58 vars in 1148 bytes} [Tue Oct 11 04:20:00 2022] GET /compute/v2.1/flavors?minRam=1025 => generated 1111 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:00.865963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5b928330-5a8b-473f-97cc-d1af95c6a13c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:00.867164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5b928330-5a8b-473f-97cc-d1af95c6a13c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:00.889838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b928330-5a8b-473f-97cc-d1af95c6a13c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:00.893289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b928330-5a8b-473f-97cc-d1af95c6a13c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:00.894019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b928330-5a8b-473f-97cc-d1af95c6a13c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:00.896524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b928330-5a8b-473f-97cc-d1af95c6a13c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:00.899786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b928330-5a8b-473f-97cc-d1af95c6a13c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:00.901379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b928330-5a8b-473f-97cc-d1af95c6a13c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:00.901897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:00.938535 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-63187b6c-2fb1-4185-a171-3d636631fb67 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 200 len: 1306 microversion: 2.1 time: 0.315575 Oct 11 04:20:00.954776 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1183/2449] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:00 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 1306 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:00.970983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-edadab24-1b82-4690-98a9-a87d453935d6 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19a07430>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:01.329507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5b928330-5a8b-473f-97cc-d1af95c6a13c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:01.340570 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5b928330-5a8b-473f-97cc-d1af95c6a13c tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.479967 Oct 11 04:20:01.344284 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1267/2450] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:00 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:01.364961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-044ad968-2b9e-46c1-b6b5-23379039dbae tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:01.394408 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-044ad968-2b9e-46c1-b6b5-23379039dbae tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors?limit=1" status: 200 len: 299 microversion: 2.1 time: 0.043887 Oct 11 04:20:01.396009 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1268/2451] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Oct 11 04:20:01 2022] GET /compute/v2.1/flavors?limit=1 => generated 299 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:01.410398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:01.411377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:01.430086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:01.430757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:01.436697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:01.438957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:01.443592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:01.443899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:02.264983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:02.275112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:02.282598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:02.314964 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f36ec3d2-a5af-4292-b18d-d8322ef9dec0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.915893 Oct 11 04:20:02.340566 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1269/2452] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:01 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:02.354210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c9b5c104-9958-4269-861b-a9596c922837 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:02.374144 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c9b5c104-9958-4269-861b-a9596c922837 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.028993 Oct 11 04:20:02.387773 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1270/2453] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:20:02 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:02.397190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-bd156a29-0ab7-4b5c-a47f-fd4273dced3c req-df6ca787-6f32-477b-860f-ad5eb309c4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4133104-80ff-4629-bf97-1d0c7441fbfd", "name": "network-vif-deleted", "tag": "a2a973b4-1299-427e-947a-59fb8153c4c0"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:02.422179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bd156a29-0ab7-4b5c-a47f-fd4273dced3c req-df6ca787-6f32-477b-860f-ad5eb309c4c7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:02.424206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bd156a29-0ab7-4b5c-a47f-fd4273dced3c req-df6ca787-6f32-477b-860f-ad5eb309c4c7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:02.424801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bd156a29-0ab7-4b5c-a47f-fd4273dced3c req-df6ca787-6f32-477b-860f-ad5eb309c4c7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:02.451576 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-bd156a29-0ab7-4b5c-a47f-fd4273dced3c req-df6ca787-6f32-477b-860f-ad5eb309c4c7 service nova] Creating event network-vif-deleted:a2a973b4-1299-427e-947a-59fb8153c4c0 for instance f4133104-80ff-4629-bf97-1d0c7441fbfd on n-h1-860892-1 Oct 11 04:20:02.465270 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-bd156a29-0ab7-4b5c-a47f-fd4273dced3c req-df6ca787-6f32-477b-860f-ad5eb309c4c7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074823 Oct 11 04:20:02.469254 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1271/2454] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:02.480705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:02.482694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:02.497895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:02.498677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:02.499543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:02.502789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:02.502789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:02.502789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:02.542581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:02.543407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:02.544125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:02.545121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lazy-loading 'fault' on Instance uuid f4133104-80ff-4629-bf97-1d0c7441fbfd {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:20:02.985182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:02.999401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:03.006686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:03.008750 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1b21cea0-3c85-4954-9979-565a121c87d9 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 200 len: 1375 microversion: 2.25 time: 0.538054 Oct 11 04:20:03.014532 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1272/2455] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:02 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 1375 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:03.036981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:03.040825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:03.054973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:03.056442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:03.058927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:03.059717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:03.063232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:03.064814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:03.130223 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] HTTP exception thrown: Instance 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 could not be found. Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Request method failure captured: Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 HTTP/1.1 Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5RxjNA06r5o-sUSrTe1-EIKL8455221XTUxy8T4GmIoucO-k3i6MjFyqVCZT2PdVgrw2LZsYHoJP-Q24s_B3teQRDS4MkAxS-YCvWtYEcgyg1wYYFyoqWjbtC0K9V_LEalYQvrNbE24PSNlSLpjKbuO4KHIyenQcV_pWmxePdLOQI Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: a3d48dc85fd64507b459034b67232052 Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesAdminNegativeTest-389311750 Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a3d48dc85fd64507b459034b67232052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a3d48dc85fd64507b459034b67232052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a3d48dc85fd64507b459034b67232052"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a3d48dc85fd64507b459034b67232052"}]}] Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesAdminNegativeTest-389311750 Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: a3d48dc85fd64507b459034b67232052 Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-389311750 Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesAdminNegativeTest-389311750-project Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 555865c5372246009bb223d5cbfb8b24 Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesAdminNegativeTest-389311750-project Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 could not be found. Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3'} Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 could not be found. Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 could not be found. Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:03.137566 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:03.141340 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:03.141340 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:03.141340 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:03.141340 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:03.141340 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:03.141340 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 could not be found. Oct 11 04:20:03.141340 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:03.144947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Returning 404 to user: Instance 6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:03.146968 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-efd2e718-93b5-40f4-87bc-254a0bc6b0df tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3" status: 404 len: 111 microversion: 2.1 time: 0.130729 Oct 11 04:20:03.150267 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1273/2456] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:03 2022] GET /compute/v2.1/servers/6d00ddb2-8bc6-4e06-a72e-6ff1ca90b7b3 => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:20:03.163433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c8b1a296-4b05-4d06-b853-655d7403762d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:03.165319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c8b1a296-4b05-4d06-b853-655d7403762d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:03.190125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8b1a296-4b05-4d06-b853-655d7403762d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:03.191793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8b1a296-4b05-4d06-b853-655d7403762d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:03.195937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8b1a296-4b05-4d06-b853-655d7403762d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:03.197306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8b1a296-4b05-4d06-b853-655d7403762d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:03.203154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8b1a296-4b05-4d06-b853-655d7403762d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:03.203868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8b1a296-4b05-4d06-b853-655d7403762d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:03.742447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c8b1a296-4b05-4d06-b853-655d7403762d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:03.742447 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c8b1a296-4b05-4d06-b853-655d7403762d tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.551227 Oct 11 04:20:03.742447 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1274/2457] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:03 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:03.742447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a8fe93a0-1779-42df-9e28-c4d53a029ac9 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:03.766225 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a8fe93a0-1779-42df-9e28-c4d53a029ac9 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors?marker=452" status: 200 len: 1300 microversion: 2.1 time: 0.060810 Oct 11 04:20:03.767535 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1275/2458] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:20:03 2022] GET /compute/v2.1/flavors?marker=452 => generated 1300 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:03.772471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4b1d0763-7a32-4d1d-94cd-942f292719ac req-aa23f10f-dc2a-4335-9e9f-022dc4f3c862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c0e847-3028-4c23-9883-c46359435888", "name": "network-vif-plugged", "status": "completed", "tag": "816b46ee-3ec3-4c2d-b97f-8d8214dcc49f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:03.785705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4b1d0763-7a32-4d1d-94cd-942f292719ac req-aa23f10f-dc2a-4335-9e9f-022dc4f3c862 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:03.786502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4b1d0763-7a32-4d1d-94cd-942f292719ac req-aa23f10f-dc2a-4335-9e9f-022dc4f3c862 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:03.786924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4b1d0763-7a32-4d1d-94cd-942f292719ac req-aa23f10f-dc2a-4335-9e9f-022dc4f3c862 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:03.809684 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4b1d0763-7a32-4d1d-94cd-942f292719ac req-aa23f10f-dc2a-4335-9e9f-022dc4f3c862 service nova] Creating event network-vif-plugged:816b46ee-3ec3-4c2d-b97f-8d8214dcc49f for instance 94c0e847-3028-4c23-9883-c46359435888 on n-h2-860892-1 Oct 11 04:20:03.821828 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4b1d0763-7a32-4d1d-94cd-942f292719ac req-aa23f10f-dc2a-4335-9e9f-022dc4f3c862 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052819 Oct 11 04:20:03.822964 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1276/2459] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:03.841937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:03.842955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:03.852864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:03.853633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:03.854281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:03.855153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:03.855803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:03.856405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:03.943082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:03.959974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:03.959974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:03.961882 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-97bbdea4-fe96-44e2-a375-b1ee3c616d72 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.135537 Oct 11 04:20:03.962745 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1277/2460] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:03 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:03.967838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f875d648-8d5f-4503-9e7f-ec756ca90195 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:03.989895 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f875d648-8d5f-4503-9e7f-ec756ca90195 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.025696 Oct 11 04:20:03.990669 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1278/2461] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:20:03 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:04.010229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2ddf37e8-d890-4b26-a6cb-3319ed5e0460 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:04.018123 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2ddf37e8-d890-4b26-a6cb-3319ed5e0460 tempest-FlavorsV2TestJSON-495931754 tempest-FlavorsV2TestJSON-495931754-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.011846 Oct 11 04:20:04.027031 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1279/2462] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:20:04 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:20:04.044489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:04.045408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: f4133104-80ff-4629-bf97-1d0c7441fbfd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:04.052349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:04.052969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:04.053501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:04.054419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:04.055018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:04.055876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:04.080497 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] HTTP exception thrown: Instance f4133104-80ff-4629-bf97-1d0c7441fbfd could not be found. Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Request method failure captured: Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd HTTP/1.1 Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO02Jp3ZmOnkaOP3BcJZr1vU8zlnGbIhsrUEF9N-AsihPNARfhojxnPEwYqOwWDvFgRxbnlCh0bs1DdCYV0k0HRzOQ9DPb5dc2Znjrnvkid3wNRAuz4yBRuoLh0ra1BS7QtRnVlW-f_58X6h_UnduJ33HntzEeDVAxLgPtDbepmZ6Xc Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: daa8ad03685c4b59b3274fc6407c9eb7 Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/daa8ad03685c4b59b3274fc6407c9eb7"}]}] Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: daa8ad03685c4b59b3274fc6407c9eb7 Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-LiveAutoBlockMigrationV225Test-2006568427-project Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 917dab915f7d4303989abb47a33f47df Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427-project Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance f4133104-80ff-4629-bf97-1d0c7441fbfd could not be found. Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'f4133104-80ff-4629-bf97-1d0c7441fbfd'} Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4133104-80ff-4629-bf97-1d0c7441fbfd could not be found. Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4133104-80ff-4629-bf97-1d0c7441fbfd could not be found. Oct 11 04:20:04.083114 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:04.087137 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:04.087137 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:04.087137 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:04.087137 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:04.087137 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:04.087137 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:04.087137 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:04.087137 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4133104-80ff-4629-bf97-1d0c7441fbfd could not be found. Oct 11 04:20:04.087137 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:04.091686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Returning 404 to user: Instance f4133104-80ff-4629-bf97-1d0c7441fbfd could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:04.092686 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e5bb671f-fe8c-4318-a7de-f369f0fcc937 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd" status: 404 len: 111 microversion: 2.25 time: 0.053588 Oct 11 04:20:04.099017 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1280/2463] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:04 2022] GET /compute/v2.1/servers/f4133104-80ff-4629-bf97-1d0c7441fbfd => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:20:04.106551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92a82ca2-a819-4737-acf9-d7b2237c56c1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '.version_select at 0x7fda19df1e50>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:04.220507 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-92a82ca2-a819-4737-acf9-d7b2237c56c1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-208254070" status: 204 len: 0 microversion: 2.25 time: 0.119160 Oct 11 04:20:04.225280 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1281/2464] 10.222.0.26 () {60 vars in 1259 bytes} [Tue Oct 11 04:20:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-208254070 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:20:04.808653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5bc6805-6d2d-40b1-99c2-baea83758fd8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:04.810098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5bc6805-6d2d-40b1-99c2-baea83758fd8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:04.841708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6805-6d2d-40b1-99c2-baea83758fd8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:04.842616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6805-6d2d-40b1-99c2-baea83758fd8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:04.843218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6805-6d2d-40b1-99c2-baea83758fd8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:04.844129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6805-6d2d-40b1-99c2-baea83758fd8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:04.844745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6805-6d2d-40b1-99c2-baea83758fd8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:04.846707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6805-6d2d-40b1-99c2-baea83758fd8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:05.481248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5bc6805-6d2d-40b1-99c2-baea83758fd8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:05.537242 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5bc6805-6d2d-40b1-99c2-baea83758fd8 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1333 microversion: 2.1 time: 0.733459 Oct 11 04:20:05.541736 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1282/2465] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:04 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1333 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:05.568918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:05.569481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:05.586992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:05.589063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:05.589063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:05.591531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:05.592109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:05.595375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:05.601510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:06.163682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:06.188446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:06.189294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:06.209989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a790f182-d190-46d6-948f-1d0736f89d6a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.662268 Oct 11 04:20:06.210756 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1283/2466] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:05 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:06.215458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5f5f03fc-7fea-4fbf-808c-0293e916bd01 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:06.221543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5f5f03fc-7fea-4fbf-808c-0293e916bd01 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:06.239990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f5f03fc-7fea-4fbf-808c-0293e916bd01 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:06.240488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f5f03fc-7fea-4fbf-808c-0293e916bd01 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:06.240967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f5f03fc-7fea-4fbf-808c-0293e916bd01 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:06.241707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f5f03fc-7fea-4fbf-808c-0293e916bd01 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:06.242174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f5f03fc-7fea-4fbf-808c-0293e916bd01 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:06.242664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f5f03fc-7fea-4fbf-808c-0293e916bd01 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:06.344467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5f5f03fc-7fea-4fbf-808c-0293e916bd01 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:20:07.148748 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5f5f03fc-7fea-4fbf-808c-0293e916bd01 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 204 len: 0 microversion: 2.25 time: 0.936568 Oct 11 04:20:07.153433 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1284/2467] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:20:06 2022] DELETE /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 0 bytes in 938 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:20:07.156229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-39633ebf-91c8-40ae-add6-47c1e49460a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:07.157106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-39633ebf-91c8-40ae-add6-47c1e49460a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:07.176167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39633ebf-91c8-40ae-add6-47c1e49460a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:07.192971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39633ebf-91c8-40ae-add6-47c1e49460a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:07.192971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39633ebf-91c8-40ae-add6-47c1e49460a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:07.192971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39633ebf-91c8-40ae-add6-47c1e49460a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:07.192971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39633ebf-91c8-40ae-add6-47c1e49460a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:07.192971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39633ebf-91c8-40ae-add6-47c1e49460a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:07.691360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39633ebf-91c8-40ae-add6-47c1e49460a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:07.718123 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-39633ebf-91c8-40ae-add6-47c1e49460a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1668 microversion: 2.1 time: 0.567251 Oct 11 04:20:07.743564 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1285/2468] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:07 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1668 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:07.807347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:07.815816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:07.856947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:07.858882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:07.861491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:07.864615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:07.869322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:07.870422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:08.688027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:08.700868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:08.707637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:08.714349 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-35b96d7c-2f9a-4796-9904-f9419581b5d7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1549 microversion: 2.25 time: 0.960226 Oct 11 04:20:08.720902 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1286/2469] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:07 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1549 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:08.727253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:08.727872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:08.736654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:08.738138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:08.739274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:08.740023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:08.740489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:08.740921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:08.837084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:08.859110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:08.871552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:08.909626 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f3f8f0e-a885-4e61-97fc-f741714fa943 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.185648 Oct 11 04:20:08.920804 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1287/2470] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:08 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:08.945349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-96fafe3a-4ad9-4b66-92dd-fd5446c890f5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:08.953104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-96fafe3a-4ad9-4b66-92dd-fd5446c890f5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:08.977062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96fafe3a-4ad9-4b66-92dd-fd5446c890f5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:08.980429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96fafe3a-4ad9-4b66-92dd-fd5446c890f5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:08.981156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96fafe3a-4ad9-4b66-92dd-fd5446c890f5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:08.987148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96fafe3a-4ad9-4b66-92dd-fd5446c890f5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:08.988058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96fafe3a-4ad9-4b66-92dd-fd5446c890f5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:08.995594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96fafe3a-4ad9-4b66-92dd-fd5446c890f5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:09.090937 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-96fafe3a-4ad9-4b66-92dd-fd5446c890f5 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888/ips" status: 200 len: 179 microversion: 2.1 time: 0.163713 Oct 11 04:20:09.096594 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1288/2471] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:20:08 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888/ips => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:09.119046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-45f651a2-37fc-43e8-a1c7-fbc5f660b1bd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:09.124189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45f651a2-37fc-43e8-a1c7-fbc5f660b1bd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:09.153078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45f651a2-37fc-43e8-a1c7-fbc5f660b1bd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:09.154951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45f651a2-37fc-43e8-a1c7-fbc5f660b1bd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:09.158323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45f651a2-37fc-43e8-a1c7-fbc5f660b1bd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:09.163182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45f651a2-37fc-43e8-a1c7-fbc5f660b1bd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:09.164755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45f651a2-37fc-43e8-a1c7-fbc5f660b1bd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:09.165349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45f651a2-37fc-43e8-a1c7-fbc5f660b1bd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:09.295314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45f651a2-37fc-43e8-a1c7-fbc5f660b1bd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:20:09.850820 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-45f651a2-37fc-43e8-a1c7-fbc5f660b1bd tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "DELETE /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 204 len: 0 microversion: 2.1 time: 0.744105 Oct 11 04:20:09.856074 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1289/2472] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:20:09 2022] DELETE /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 0 bytes in 748 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:20:09.869366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-ae3e12a4-be76-4728-a2eb-2ebfebc6acd5 req-98ad8fff-efe5-42ed-bfff-a2cac493fcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0263254c-1383-4f74-8505-d1402be4bd56", "name": "network-vif-deleted", "tag": "a2a80df7-c7d4-450b-bd19-d4a1c38a2015"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:09.883017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ae3e12a4-be76-4728-a2eb-2ebfebc6acd5 req-98ad8fff-efe5-42ed-bfff-a2cac493fcab service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:09.883420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ae3e12a4-be76-4728-a2eb-2ebfebc6acd5 req-98ad8fff-efe5-42ed-bfff-a2cac493fcab service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:09.884794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ae3e12a4-be76-4728-a2eb-2ebfebc6acd5 req-98ad8fff-efe5-42ed-bfff-a2cac493fcab service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:09.905844 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-ae3e12a4-be76-4728-a2eb-2ebfebc6acd5 req-98ad8fff-efe5-42ed-bfff-a2cac493fcab service nova] Creating event network-vif-deleted:a2a80df7-c7d4-450b-bd19-d4a1c38a2015 for instance 0263254c-1383-4f74-8505-d1402be4bd56 on n-h2-860892-1 Oct 11 04:20:09.911771 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-ae3e12a4-be76-4728-a2eb-2ebfebc6acd5 req-98ad8fff-efe5-42ed-bfff-a2cac493fcab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057193 Oct 11 04:20:09.916626 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1290/2473] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:09.922218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:09.923135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:09.933603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:09.934116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:09.934698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:09.936967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:09.937562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:09.937994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:09.998027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:09.998539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:09.999399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:09.999601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lazy-loading 'fault' on Instance uuid 0263254c-1383-4f74-8505-d1402be4bd56 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:20:10.096323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:10.111537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:10.117979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:10.117979 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-76079931-33f7-4b79-88e9-9e7792fe7c0b tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1352 microversion: 2.25 time: 0.199451 Oct 11 04:20:10.136194 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1291/2474] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:09 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1352 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:10.153631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7561b95b-d691-4f09-b7e6-6aa4e89c2ae7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:10.158211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7561b95b-d691-4f09-b7e6-6aa4e89c2ae7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:10.161810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7561b95b-d691-4f09-b7e6-6aa4e89c2ae7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:10.162390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7561b95b-d691-4f09-b7e6-6aa4e89c2ae7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:10.163051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7561b95b-d691-4f09-b7e6-6aa4e89c2ae7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:10.164763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7561b95b-d691-4f09-b7e6-6aa4e89c2ae7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:10.164763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7561b95b-d691-4f09-b7e6-6aa4e89c2ae7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:10.164763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7561b95b-d691-4f09-b7e6-6aa4e89c2ae7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:10.650293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7561b95b-d691-4f09-b7e6-6aa4e89c2ae7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:10.667061 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7561b95b-d691-4f09-b7e6-6aa4e89c2ae7 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1674 microversion: 2.1 time: 0.522624 Oct 11 04:20:10.668188 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1292/2475] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:10 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1674 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:10.676017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:10.679028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:10.699367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:10.703316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:10.704335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:10.705313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:10.708227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:10.708947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:10.734954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=66 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:10.937504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=70 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:10.974333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:10.983903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:10.987049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:10.993352 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6c00e521-ab9c-48d2-9e0f-fd247b8680b1 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.323852 Oct 11 04:20:11.004658 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1293/2476] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:10 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:11.156968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:11.157516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:11.178509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:11.179042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:11.179499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:11.186638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:11.190599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:11.192021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:11.290018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:11.296119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:11.301329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:11.301329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lazy-loading 'fault' on Instance uuid 0263254c-1383-4f74-8505-d1402be4bd56 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:20:11.432371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:11.443831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:11.445268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:11.455858 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b77c2320-cf13-45bf-b34d-0e0b0a360e5a tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 200 len: 1352 microversion: 2.25 time: 0.296285 Oct 11 04:20:11.470338 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1294/2477] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:11 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 1352 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:11.692229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab12ee9d-aea1-47c2-9590-6a4fb8606072 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:11.692841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab12ee9d-aea1-47c2-9590-6a4fb8606072 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:11.705924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab12ee9d-aea1-47c2-9590-6a4fb8606072 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:11.710792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab12ee9d-aea1-47c2-9590-6a4fb8606072 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:11.712059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab12ee9d-aea1-47c2-9590-6a4fb8606072 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:11.714041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab12ee9d-aea1-47c2-9590-6a4fb8606072 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:11.724455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab12ee9d-aea1-47c2-9590-6a4fb8606072 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:11.725103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab12ee9d-aea1-47c2-9590-6a4fb8606072 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:12.157044 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-edadab24-1b82-4690-98a9-a87d453935d6 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1462 microversion: 2.1 time: 11.194817 Oct 11 04:20:12.157534 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1184/2478] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:20:00 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1462 bytes in 11202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:12.178485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e07f4d56-f549-4382-bf37-04a3fae80216 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:12.179090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e07f4d56-f549-4382-bf37-04a3fae80216 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:12.202473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e07f4d56-f549-4382-bf37-04a3fae80216 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:12.203292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e07f4d56-f549-4382-bf37-04a3fae80216 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:12.203865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e07f4d56-f549-4382-bf37-04a3fae80216 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:12.207231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e07f4d56-f549-4382-bf37-04a3fae80216 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:12.208919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e07f4d56-f549-4382-bf37-04a3fae80216 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:12.209669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e07f4d56-f549-4382-bf37-04a3fae80216 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:12.269712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e07f4d56-f549-4382-bf37-04a3fae80216 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:20:12.602051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab12ee9d-aea1-47c2-9590-6a4fb8606072 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:12.614914 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab12ee9d-aea1-47c2-9590-6a4fb8606072 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1674 microversion: 2.1 time: 0.923412 Oct 11 04:20:12.620381 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1295/2479] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:11 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1674 bytes in 933 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:12.648842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:12.654132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:12.669583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:12.674469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:12.675237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:12.676211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:12.678737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:12.679419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:12.743856 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e07f4d56-f549-4382-bf37-04a3fae80216 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "DELETE /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 204 len: 0 microversion: 2.1 time: 0.579662 Oct 11 04:20:12.744688 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1185/2480] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:20:12 2022] DELETE /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:20:12.756507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-efa9b645-c4bb-4155-804f-efde93ee6949 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1a435820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:12.875105 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-efa9b645-c4bb-4155-804f-efde93ee6949 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 200 len: 1462 microversion: 2.1 time: 0.126891 Oct 11 04:20:12.879884 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1186/2481] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:20:12 2022] GET /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 1462 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:12.896921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:12.899064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 0263254c-1383-4f74-8505-d1402be4bd56] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:12.920388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:12.922917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:12.923697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:12.928995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:12.931642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:12.932482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:12.978342 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] HTTP exception thrown: Instance 0263254c-1383-4f74-8505-d1402be4bd56 could not be found. Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Request method failure captured: Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 HTTP/1.1 Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO02Jp3ZmOnkaOP3BcJZr1vU8zlnGbIhsrUEF9N-AsihPNARfhojxnPEwYqOwWDvFgRxbnlCh0bs1DdCYV0k0HRzOQ9DPb5dc2Znjrnvkid3wNRAuz4yBRuoLh0ra1BS7QtRnVlW-f_58X6h_UnduJ33HntzEeDVAxLgPtDbepmZ6Xc Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: daa8ad03685c4b59b3274fc6407c9eb7 Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/daa8ad03685c4b59b3274fc6407c9eb7"}]}] Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: daa8ad03685c4b59b3274fc6407c9eb7 Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-LiveAutoBlockMigrationV225Test-2006568427-project Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 917dab915f7d4303989abb47a33f47df Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427-project Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 0263254c-1383-4f74-8505-d1402be4bd56 could not be found. Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '0263254c-1383-4f74-8505-d1402be4bd56'} Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0263254c-1383-4f74-8505-d1402be4bd56 could not be found. Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0263254c-1383-4f74-8505-d1402be4bd56 could not be found. Oct 11 04:20:12.982065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:12.985551 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:12.985551 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:12.985551 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:12.985551 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:12.985551 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:12.985551 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:12.985551 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:12.985551 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0263254c-1383-4f74-8505-d1402be4bd56 could not be found. Oct 11 04:20:12.985551 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:12.994593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Returning 404 to user: Instance 0263254c-1383-4f74-8505-d1402be4bd56 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:12.994593 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ecfb444-379f-4940-b0f6-e1f71bb6d6a1 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56" status: 404 len: 111 microversion: 2.25 time: 0.111434 Oct 11 04:20:12.997836 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1187/2482] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:12 2022] GET /compute/v2.1/servers/0263254c-1383-4f74-8505-d1402be4bd56 => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:20:13.001270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:13.005810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:13.014662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a0c0bcc9-a856-400a-b1a9-6fa0221bf3de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:13.017085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a0c0bcc9-a856-400a-b1a9-6fa0221bf3de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:13.027321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:13.033392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:13.034806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0c0bcc9-a856-400a-b1a9-6fa0221bf3de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:13.036436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0c0bcc9-a856-400a-b1a9-6fa0221bf3de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:13.038790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0c0bcc9-a856-400a-b1a9-6fa0221bf3de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:13.039967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0c0bcc9-a856-400a-b1a9-6fa0221bf3de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:13.043168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0c0bcc9-a856-400a-b1a9-6fa0221bf3de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:13.044128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0c0bcc9-a856-400a-b1a9-6fa0221bf3de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:13.046995 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04bfb4b1-70f4-4888-842c-f1f6143211fd tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.425467 Oct 11 04:20:13.055594 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1296/2483] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:12 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:13.069484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b74b5dd4-2f8b-4ede-8be2-150aae8a2ea8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:13.074283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b74b5dd4-2f8b-4ede-8be2-150aae8a2ea8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:13.092423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:13.095277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b74b5dd4-2f8b-4ede-8be2-150aae8a2ea8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:13.101015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b74b5dd4-2f8b-4ede-8be2-150aae8a2ea8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:13.101657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b74b5dd4-2f8b-4ede-8be2-150aae8a2ea8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:13.103848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b74b5dd4-2f8b-4ede-8be2-150aae8a2ea8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:13.107243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b74b5dd4-2f8b-4ede-8be2-150aae8a2ea8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:13.112723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b74b5dd4-2f8b-4ede-8be2-150aae8a2ea8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:13.323122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a0c0bcc9-a856-400a-b1a9-6fa0221bf3de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:13.345454 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a0c0bcc9-a856-400a-b1a9-6fa0221bf3de tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1682 microversion: 2.1 time: 0.341829 Oct 11 04:20:13.347243 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1188/2484] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:12 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1682 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:13.355010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-cee185e8-5679-4d51-befe-1f9866edd12c req-4f42d9c9-a20e-4bd0-941c-41a261797b70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c0e847-3028-4c23-9883-c46359435888", "name": "network-vif-deleted", "tag": "816b46ee-3ec3-4c2d-b97f-8d8214dcc49f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:13.388133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cee185e8-5679-4d51-befe-1f9866edd12c req-4f42d9c9-a20e-4bd0-941c-41a261797b70 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:13.389611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cee185e8-5679-4d51-befe-1f9866edd12c req-4f42d9c9-a20e-4bd0-941c-41a261797b70 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:13.390699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cee185e8-5679-4d51-befe-1f9866edd12c req-4f42d9c9-a20e-4bd0-941c-41a261797b70 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:13.408071 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-cee185e8-5679-4d51-befe-1f9866edd12c req-4f42d9c9-a20e-4bd0-941c-41a261797b70 service nova] Creating event network-vif-deleted:816b46ee-3ec3-4c2d-b97f-8d8214dcc49f for instance 94c0e847-3028-4c23-9883-c46359435888 on n-h2-860892-1 Oct 11 04:20:13.414475 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-cee185e8-5679-4d51-befe-1f9866edd12c req-4f42d9c9-a20e-4bd0-941c-41a261797b70 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066025 Oct 11 04:20:13.415562 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1189/2485] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:13.421946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c0ce0eb-ff2d-420e-9848-c89dc07ce823 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:13.422844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c0ce0eb-ff2d-420e-9848-c89dc07ce823 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:13.431703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c0ce0eb-ff2d-420e-9848-c89dc07ce823 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:13.432507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c0ce0eb-ff2d-420e-9848-c89dc07ce823 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:13.433171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c0ce0eb-ff2d-420e-9848-c89dc07ce823 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:13.434110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c0ce0eb-ff2d-420e-9848-c89dc07ce823 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:13.434746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c0ce0eb-ff2d-420e-9848-c89dc07ce823 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:13.435651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c0ce0eb-ff2d-420e-9848-c89dc07ce823 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:13.479751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c0ce0eb-ff2d-420e-9848-c89dc07ce823 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:20:13.563679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b74b5dd4-2f8b-4ede-8be2-150aae8a2ea8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:13.573334 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b74b5dd4-2f8b-4ede-8be2-150aae8a2ea8 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7" status: 200 len: 1467 microversion: 2.1 time: 0.515753 Oct 11 04:20:13.576925 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1297/2486] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:13 2022] GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7 => generated 1467 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:13.604718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-76f670ff-9310-44fa-95f1-c8e72cd7ee08 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1a059430>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:13.811723 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-76f670ff-9310-44fa-95f1-c8e72cd7ee08 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images?changes-since=2022-10-11T04%3A17%3A53Z" status: 200 len: 2375 microversion: 2.1 time: 0.211059 Oct 11 04:20:13.814082 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1298/2487] 10.222.0.26 () {58 vars in 1199 bytes} [Tue Oct 11 04:20:13 2022] GET /compute/v2.1/images?changes-since=2022-10-11T04%3A17%3A53Z => generated 2375 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:13.825800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4c44120d-bb44-42e0-a9c3-cd247ffef0a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:13.827100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4c44120d-bb44-42e0-a9c3-cd247ffef0a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:13.843344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c44120d-bb44-42e0-a9c3-cd247ffef0a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:13.845363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c44120d-bb44-42e0-a9c3-cd247ffef0a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:13.847176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c44120d-bb44-42e0-a9c3-cd247ffef0a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:13.849556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c44120d-bb44-42e0-a9c3-cd247ffef0a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:13.853377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c44120d-bb44-42e0-a9c3-cd247ffef0a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:13.853899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c44120d-bb44-42e0-a9c3-cd247ffef0a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:13.908679 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8c0ce0eb-ff2d-420e-9848-c89dc07ce823 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "DELETE /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 204 len: 0 microversion: 2.25 time: 0.491316 Oct 11 04:20:13.909724 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1190/2488] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:20:13 2022] DELETE /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:20:13.916662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ba9ec4e4-5f16-4b04-acfa-cd22f0903db7 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19eb9d30>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:14.072260 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ba9ec4e4-5f16-4b04-acfa-cd22f0903db7 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2084974013" status: 200 len: 485 microversion: 2.1 time: 0.160959 Oct 11 04:20:14.076546 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1191/2489] 10.222.0.26 () {58 vars in 1231 bytes} [Tue Oct 11 04:20:13 2022] GET /compute/v2.1/images?name=tempest-ListImageFiltersTestJSON-image-2084974013 => generated 485 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:14.087309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:14.092051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:14.107345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:14.107836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:14.108356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:14.109069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:14.109697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:14.110307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:14.437734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4c44120d-bb44-42e0-a9c3-cd247ffef0a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:14.447239 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4c44120d-bb44-42e0-a9c3-cd247ffef0a2 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1653 microversion: 2.1 time: 0.631717 Oct 11 04:20:14.447826 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1299/2490] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:13 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1653 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:14.468344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e2bc9838-05b0-4b8c-9406-5b93d81a5e3e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1a059ee0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:14.641441 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e2bc9838-05b0-4b8c-9406-5b93d81a5e3e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images?server=4aaae530-25a0-46f6-9df0-bb21d130a0f7" status: 200 len: 957 microversion: 2.1 time: 0.192526 Oct 11 04:20:14.642033 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1300/2491] 10.222.0.26 () {58 vars in 1209 bytes} [Tue Oct 11 04:20:14 2022] GET /compute/v2.1/images?server=4aaae530-25a0-46f6-9df0-bb21d130a0f7 => generated 957 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:14.675007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:14.676192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:14.683256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:14.683751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:14.684194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:14.686037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:14.686546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:14.687043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:14.882915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:14.895355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:14.902472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:14.910300 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f2343ada-d1d5-40d0-a54f-8ca3bb413cd3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.242260 Oct 11 04:20:14.911886 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1301/2492] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:14 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:14.912522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:14.919207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f89b09be-5517-4f1d-8b87-9b5796c051b8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:14.920349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f89b09be-5517-4f1d-8b87-9b5796c051b8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:14.926094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:14.929966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89b09be-5517-4f1d-8b87-9b5796c051b8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:14.931512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89b09be-5517-4f1d-8b87-9b5796c051b8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:14.931627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:14.932397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89b09be-5517-4f1d-8b87-9b5796c051b8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:14.933710 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e47ca593-66a5-47ff-a0d3-22263e5b1676 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1563 microversion: 2.25 time: 0.855959 Oct 11 04:20:14.933945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89b09be-5517-4f1d-8b87-9b5796c051b8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:14.938424 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1192/2493] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:14 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1563 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:14.948286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89b09be-5517-4f1d-8b87-9b5796c051b8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:14.948286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89b09be-5517-4f1d-8b87-9b5796c051b8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:14.948511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-45e55717-7430-42a7-a5d8-ca8f16f39fb4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b6baf0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:15.090297 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-45e55717-7430-42a7-a5d8-ca8f16f39fb4 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 485 microversion: 2.1 time: 0.150519 Oct 11 04:20:15.103348 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1193/2494] 10.222.0.26 () {58 vars in 1317 bytes} [Tue Oct 11 04:20:14 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 485 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:15.117268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-121d8d91-30cf-4667-bebb-56c0e1c7a03f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19a06b80>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:15.211297 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-121d8d91-30cf-4667-bebb-56c0e1c7a03f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 485 microversion: 2.1 time: 0.102005 Oct 11 04:20:15.211905 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1194/2495] 10.222.0.26 () {58 vars in 1303 bytes} [Tue Oct 11 04:20:15 2022] GET /compute/v2.1/images?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 485 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:15.232207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0a53ef89-7497-46a2-9176-dc7ad020275a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b6b700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:15.449550 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0a53ef89-7497-46a2-9176-dc7ad020275a tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images?status=ACTIVE" status: 200 len: 3281 microversion: 2.1 time: 0.225972 Oct 11 04:20:15.450639 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1195/2496] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:20:15 2022] GET /compute/v2.1/images?status=ACTIVE => generated 3281 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:15.473146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b99a3d3a-7f9d-408c-b611-f14a87c50d6c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda199dfe50>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:15.544196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f89b09be-5517-4f1d-8b87-9b5796c051b8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:15.577136 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f89b09be-5517-4f1d-8b87-9b5796c051b8 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1682 microversion: 2.1 time: 0.662989 Oct 11 04:20:15.594630 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1302/2497] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:14 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1682 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:15.607717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cf0015ee-3796-43d4-a975-25a66e05c819 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:15.608390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cf0015ee-3796-43d4-a975-25a66e05c819 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:15.610868 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b99a3d3a-7f9d-408c-b611-f14a87c50d6c tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images?type=snapshot" status: 200 len: 1430 microversion: 2.1 time: 0.148381 Oct 11 04:20:15.612549 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1196/2498] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:20:15 2022] GET /compute/v2.1/images?type=snapshot => generated 1430 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:15.624557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf0015ee-3796-43d4-a975-25a66e05c819 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:15.627440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-795e720a-95ab-4ac1-8419-ec1a6355e146 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b2ff70>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:15.630035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf0015ee-3796-43d4-a975-25a66e05c819 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:15.631290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf0015ee-3796-43d4-a975-25a66e05c819 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:15.633916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf0015ee-3796-43d4-a975-25a66e05c819 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:15.634434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf0015ee-3796-43d4-a975-25a66e05c819 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:15.634873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf0015ee-3796-43d4-a975-25a66e05c819 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:15.710581 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-795e720a-95ab-4ac1-8419-ec1a6355e146 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images?limit=1" status: 200 len: 622 microversion: 2.1 time: 0.088707 Oct 11 04:20:15.712387 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1197/2499] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:20:15 2022] GET /compute/v2.1/images?limit=1 => generated 622 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:20:15.726349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-519987e3-9ba7-42d2-8065-5046cb8a7287 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b5d310>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:15.844048 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-519987e3-9ba7-42d2-8065-5046cb8a7287 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/detail?changes-since=2022-10-11T04%3A17%3A47Z" status: 200 len: 6328 microversion: 2.1 time: 0.122272 Oct 11 04:20:15.844815 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1198/2500] 10.222.0.26 () {58 vars in 1220 bytes} [Tue Oct 11 04:20:15 2022] GET /compute/v2.1/images/detail?changes-since=2022-10-11T04%3A17%3A47Z => generated 6328 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:20:15.870258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-001339f4-f336-41ce-ae8b-63d1f800bba0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19a7d4c0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:15.972178 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-001339f4-f336-41ce-ae8b-63d1f800bba0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2084974013" status: 200 len: 665 microversion: 2.1 time: 0.108557 Oct 11 04:20:15.974406 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1199/2501] 10.222.0.26 () {58 vars in 1252 bytes} [Tue Oct 11 04:20:15 2022] GET /compute/v2.1/images/detail?name=tempest-ListImageFiltersTestJSON-image-2084974013 => generated 665 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:15.986623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:15.990514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:16.005076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:16.008652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:16.009307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:16.011416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:16.015135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:16.015947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:16.087858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cf0015ee-3796-43d4-a975-25a66e05c819 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:16.102777 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cf0015ee-3796-43d4-a975-25a66e05c819 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1495 microversion: 2.1 time: 0.505243 Oct 11 04:20:16.103388 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1303/2502] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:15 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1495 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:16.110384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:16.122131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:16.137926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:16.138725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:16.139321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:16.140294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:16.144574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:16.145280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:16.485031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:16.499754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:16.501229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:16.522049 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f6f3e70-323d-439d-8f03-580df000759d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.546410 Oct 11 04:20:16.536108 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1200/2503] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:15 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:16.541098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7f03a960-972e-4502-835f-36a170726350 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b2f8b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:16.648625 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7f03a960-972e-4502-835f-36a170726350 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1465 microversion: 2.1 time: 0.110997 Oct 11 04:20:16.659546 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1201/2504] 10.222.0.26 () {58 vars in 1338 bytes} [Tue Oct 11 04:20:16 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fv2.1%2Fservers%2F93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1465 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:16.659546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1549bd49-6adc-40fd-b102-012485b5357a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:16.659546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1549bd49-6adc-40fd-b102-012485b5357a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:16.666755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1549bd49-6adc-40fd-b102-012485b5357a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:16.667518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1549bd49-6adc-40fd-b102-012485b5357a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:16.667957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1549bd49-6adc-40fd-b102-012485b5357a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:16.668869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1549bd49-6adc-40fd-b102-012485b5357a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:16.669327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1549bd49-6adc-40fd-b102-012485b5357a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:16.669818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1549bd49-6adc-40fd-b102-012485b5357a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:17.069775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1549bd49-6adc-40fd-b102-012485b5357a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:17.085384 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1549bd49-6adc-40fd-b102-012485b5357a tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1614 microversion: 2.1 time: 0.432642 Oct 11 04:20:17.087199 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1202/2505] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:16 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1614 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:17.098079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-458b6322-c8b3-4af6-a9f0-db37f2dde7ab tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b2f940>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:17.181980 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-458b6322-c8b3-4af6-a9f0-db37f2dde7ab tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1465 microversion: 2.1 time: 0.093275 Oct 11 04:20:17.182887 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1203/2506] 10.222.0.26 () {58 vars in 1324 bytes} [Tue Oct 11 04:20:17 2022] GET /compute/v2.1/images/detail?server=http%3A%2F%2F10.222.0.26%2Fcompute%2Fservers%2F93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1465 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:17.189619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6114725b-1f33-4da8-9cee-e0584f121e0f req-cbc266f4-206d-4e2c-9f2c-0e879c843bcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "94c0e847-3028-4c23-9883-c46359435888", "name": "network-vif-deleted", "tag": "c09c8b68-1867-4894-b401-c8c8585be179"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:17.206600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6114725b-1f33-4da8-9cee-e0584f121e0f req-cbc266f4-206d-4e2c-9f2c-0e879c843bcc service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:17.207321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6114725b-1f33-4da8-9cee-e0584f121e0f req-cbc266f4-206d-4e2c-9f2c-0e879c843bcc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:17.208359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6114725b-1f33-4da8-9cee-e0584f121e0f req-cbc266f4-206d-4e2c-9f2c-0e879c843bcc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:17.224450 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6114725b-1f33-4da8-9cee-e0584f121e0f req-cbc266f4-206d-4e2c-9f2c-0e879c843bcc service nova] Creating event network-vif-deleted:c09c8b68-1867-4894-b401-c8c8585be179 for instance 94c0e847-3028-4c23-9883-c46359435888 on n-h2-860892-1 Oct 11 04:20:17.233436 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6114725b-1f33-4da8-9cee-e0584f121e0f req-cbc266f4-206d-4e2c-9f2c-0e879c843bcc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048864 Oct 11 04:20:17.234778 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1204/2507] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:17.244831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-19e514c3-c54c-4fb0-a5d2-52ab81a67356 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:17.246654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-19e514c3-c54c-4fb0-a5d2-52ab81a67356 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:17.255936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19e514c3-c54c-4fb0-a5d2-52ab81a67356 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:17.256983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19e514c3-c54c-4fb0-a5d2-52ab81a67356 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:17.257613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19e514c3-c54c-4fb0-a5d2-52ab81a67356 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:17.258516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19e514c3-c54c-4fb0-a5d2-52ab81a67356 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:17.259112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19e514c3-c54c-4fb0-a5d2-52ab81a67356 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:17.259758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19e514c3-c54c-4fb0-a5d2-52ab81a67356 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:17.383557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-19e514c3-c54c-4fb0-a5d2-52ab81a67356 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:17.393572 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-19e514c3-c54c-4fb0-a5d2-52ab81a67356 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1297 microversion: 2.1 time: 0.156317 Oct 11 04:20:17.398105 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1205/2508] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:17 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1297 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:17.410265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca80d556-c638-4d9c-8664-86cbabd78120 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b2f0d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:17.639115 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ca80d556-c638-4d9c-8664-86cbabd78120 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/detail?status=ACTIVE" status: 200 len: 7103 microversion: 2.1 time: 0.238493 Oct 11 04:20:17.639879 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1206/2509] 10.222.0.26 () {58 vars in 1170 bytes} [Tue Oct 11 04:20:17 2022] GET /compute/v2.1/images/detail?status=ACTIVE => generated 7103 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:17.662128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:17.663715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:17.672898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:17.673514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:17.674050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:17.674909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:17.675464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:17.675984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:17.678970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:17.698180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:17.708575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:17.709805 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3c27ecdf-1665-45f6-a34d-8cac5dd8e8a2 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1563 microversion: 2.25 time: 1.603118 Oct 11 04:20:17.712138 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1304/2510] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:16 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1563 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:17.723705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-565c47ad-02fc-4eb9-a08c-c4bd58416431 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19d80940>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:17.779794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:17.789155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:17.790615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:17.797675 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd413358-e18e-4d54-b829-4d92e2e4ccc2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.145624 Oct 11 04:20:17.812909 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1207/2511] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:17 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:17.888668 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-565c47ad-02fc-4eb9-a08c-c4bd58416431 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/detail?type=snapshot" status: 200 len: 4370 microversion: 2.1 time: 0.170827 Oct 11 04:20:17.889391 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1305/2512] 10.222.0.26 () {58 vars in 1170 bytes} [Tue Oct 11 04:20:17 2022] GET /compute/v2.1/images/detail?type=snapshot => generated 4370 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:17.907378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-61195091-72eb-4f4b-ac9b-ccac129b14fa tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b2f160>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:17.969986 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-61195091-72eb-4f4b-ac9b-ccac129b14fa tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/f5e997ff-e5de-4be2-9fc9-af1f070d3e55" status: 200 len: 784 microversion: 2.1 time: 0.066203 Oct 11 04:20:17.970928 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1208/2513] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:20:17 2022] GET /compute/v2.1/images/f5e997ff-e5de-4be2-9fc9-af1f070d3e55 => generated 784 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:17.987987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-499505cb-2242-41d9-9096-d7fbe725246e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19fe7ee0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:18.067277 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-499505cb-2242-41d9-9096-d7fbe725246e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/images/detail?limit=1" status: 200 len: 1609 microversion: 2.1 time: 0.084114 Oct 11 04:20:18.078649 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1306/2514] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:20:17 2022] GET /compute/v2.1/images/detail?limit=1 => generated 1609 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:18.096358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90edb813-a8c6-47c1-98a6-1699615baccd tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19c73430>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:18.124450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bbdc80e3-4462-441e-b2bf-493c190f2f66 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:18.128826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bbdc80e3-4462-441e-b2bf-493c190f2f66 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:18.158266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbdc80e3-4462-441e-b2bf-493c190f2f66 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:18.158891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbdc80e3-4462-441e-b2bf-493c190f2f66 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:18.162513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbdc80e3-4462-441e-b2bf-493c190f2f66 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:18.163309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbdc80e3-4462-441e-b2bf-493c190f2f66 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:18.163783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbdc80e3-4462-441e-b2bf-493c190f2f66 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:18.171620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bbdc80e3-4462-441e-b2bf-493c190f2f66 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:18.508988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bbdc80e3-4462-441e-b2bf-493c190f2f66 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:18.521815 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bbdc80e3-4462-441e-b2bf-493c190f2f66 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1614 microversion: 2.1 time: 0.411881 Oct 11 04:20:18.523746 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1307/2515] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:18 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1614 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:18.544136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-8f17509b-062a-43e5-9e66-849b544b6bc6 req-abd34d24-6803-43ba-9556-56381bb194ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaae530-25a0-46f6-9df0-bb21d130a0f7", "name": "network-vif-unplugged", "status": "completed", "tag": "39669b5c-b616-41c2-a28c-282c3da17d8d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:18.586700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8f17509b-062a-43e5-9e66-849b544b6bc6 req-abd34d24-6803-43ba-9556-56381bb194ee service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:18.587355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8f17509b-062a-43e5-9e66-849b544b6bc6 req-abd34d24-6803-43ba-9556-56381bb194ee service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:18.587803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8f17509b-062a-43e5-9e66-849b544b6bc6 req-abd34d24-6803-43ba-9556-56381bb194ee service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:18.632357 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8f17509b-062a-43e5-9e66-849b544b6bc6 req-abd34d24-6803-43ba-9556-56381bb194ee service nova] Creating event network-vif-unplugged:39669b5c-b616-41c2-a28c-282c3da17d8d for instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 on n-h2-860892-1 Oct 11 04:20:18.649788 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-8f17509b-062a-43e5-9e66-849b544b6bc6 req-abd34d24-6803-43ba-9556-56381bb194ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.122726 Oct 11 04:20:18.660889 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1308/2516] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:18.666887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:18.667649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:18.691040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:18.691719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:18.691969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:18.692695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:18.693155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:18.693583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:18.801685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:18.802265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:18.802701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:18.803166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lazy-loading 'fault' on Instance uuid 94c0e847-3028-4c23-9883-c46359435888 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:20:19.244757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2bc397bbbb204dfd9494ec2a6ee020a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35648419af8f47b49dd4dfb75115d2e1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:19.252218 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-faa7481d-48ff-4df9-aec6-5a7e53523f73 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 200 len: 1302 microversion: 2.1 time: 0.589617 Oct 11 04:20:19.258514 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1309/2517] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:18 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 1302 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:19.277806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:19.282623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:19.302419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:19.302963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:19.308680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:19.309608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:19.310394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:19.310907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:19.405381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:19.408206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:19.413851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:19.414803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lazy-loading 'fault' on Instance uuid 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:20:19.825631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:19.844456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:19.852161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '917dab915f7d4303989abb47a33f47df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'daa8ad03685c4b59b3274fc6407c9eb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:19.854874 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a843ca27-166b-4bd5-8575-3decd274afc7 tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 200 len: 1352 microversion: 2.25 time: 0.595299 Oct 11 04:20:19.893168 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1310/2518] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:19 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 1352 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:19.906489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:19.909307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:19.927952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:19.928736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:19.931960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:19.932921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:19.937720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:19.939954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:20.167322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:20.193246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:20.199605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:20.228979 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ad70ee2-a60c-4e0f-b0d1-1cf2c7cd5f2a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.333116 Oct 11 04:20:20.232178 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1311/2519] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:19 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:20.250014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-18290019-d15d-4f3e-8942-cee2278218fb req-acede241-0cae-4a21-9f8a-c85bc1576650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63a565eb-1de8-4b6b-bd27-ba53e0d9a821", "name": "network-vif-deleted", "tag": "4d8dc49c-bed9-4a3b-8d71-e5f1ed05cb39"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:20.272248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-18290019-d15d-4f3e-8942-cee2278218fb req-acede241-0cae-4a21-9f8a-c85bc1576650 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:20.272643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-18290019-d15d-4f3e-8942-cee2278218fb req-acede241-0cae-4a21-9f8a-c85bc1576650 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:20.273078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-18290019-d15d-4f3e-8942-cee2278218fb req-acede241-0cae-4a21-9f8a-c85bc1576650 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:20.304085 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-18290019-d15d-4f3e-8942-cee2278218fb req-acede241-0cae-4a21-9f8a-c85bc1576650 service nova] Creating event network-vif-deleted:4d8dc49c-bed9-4a3b-8d71-e5f1ed05cb39 for instance 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 on n-h2-860892-1 Oct 11 04:20:20.318209 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-18290019-d15d-4f3e-8942-cee2278218fb req-acede241-0cae-4a21-9f8a-c85bc1576650 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083135 Oct 11 04:20:20.321467 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1312/2520] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:20.345245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:20.349143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:20.363359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:20.366543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:20.367008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:20.370914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:20.374532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:20.374532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:20.458388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:20.461688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:20.462329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:20.466785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lazy-loading 'fault' on Instance uuid 244c7407-4845-4274-aa34-493231a9d453 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:20:20.553510 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90edb813-a8c6-47c1-98a6-1699615baccd tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "DELETE /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc" status: 204 len: 0 microversion: 2.1 time: 2.461494 Oct 11 04:20:20.554603 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1209/2521] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:18 2022] DELETE /compute/v2.1/images/a0f328e5-c0b0-41d1-98cd-58cb8fd05afc => generated 0 bytes in 2463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:20:20.563559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-d7942e75-9d72-4c45-b4bf-b89ffaa3bb43 req-51dc1046-a4d6-480f-99cd-a1ea2b39735f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "244c7407-4845-4274-aa34-493231a9d453", "name": "network-vif-deleted", "tag": "70d1eee9-350e-496b-a14b-0cf2729018d5"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:20.587231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d7942e75-9d72-4c45-b4bf-b89ffaa3bb43 req-51dc1046-a4d6-480f-99cd-a1ea2b39735f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:20.589122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d7942e75-9d72-4c45-b4bf-b89ffaa3bb43 req-51dc1046-a4d6-480f-99cd-a1ea2b39735f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:20.589946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d7942e75-9d72-4c45-b4bf-b89ffaa3bb43 req-51dc1046-a4d6-480f-99cd-a1ea2b39735f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:20.592825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '555865c5372246009bb223d5cbfb8b24', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d48dc85fd64507b459034b67232052', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:20.606287 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-35d7b06d-2a30-412f-a1cf-f5e1864a2ed1 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 200 len: 1330 microversion: 2.1 time: 0.279313 Oct 11 04:20:20.607086 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1313/2522] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:20 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 1330 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:20.618103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:20.622539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:20.623223 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-d7942e75-9d72-4c45-b4bf-b89ffaa3bb43 req-51dc1046-a4d6-480f-99cd-a1ea2b39735f service nova] Creating event network-vif-deleted:70d1eee9-350e-496b-a14b-0cf2729018d5 for instance 244c7407-4845-4274-aa34-493231a9d453 on n-h2-860892-1 Oct 11 04:20:20.636539 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-d7942e75-9d72-4c45-b4bf-b89ffaa3bb43 req-51dc1046-a4d6-480f-99cd-a1ea2b39735f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079957 Oct 11 04:20:20.639571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:20.639749 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1210/2523] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:20.641791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:20.644834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:20.646080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:20.646080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:20.646546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:20.653768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b377081-1b31-4e96-a2d8-5319dfd57656 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19c73d30>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:20.687301 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] HTTP exception thrown: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Request method failure captured: Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 HTTP/1.1 Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO6BApuWzfdKAuDVL54_c4Bu9f3S9gCDTpDqpflazWKUNVKZRP4JYeUhkI1X1UAEtdvraTJDaIjXYDnqRq7a-VfHg3hPMqyDlwU0k1En-E2Tg1Zwa28RSmMMuGtBchyXal8PHLPSeWx7S3K2MKDmCxHfWmWKv-t0tyyIW1XzbW7bwh8 Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}] Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 2bc397bbbb204dfd9494ec2a6ee020a8 Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '94c0e847-3028-4c23-9883-c46359435888'} Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:20.689610 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:20.694618 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:20.694618 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:20.694618 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:20.694618 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:20.694618 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:20.694618 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:20.694618 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:20.694618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Returning 404 to user: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:20.694618 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6f833250-7c54-416d-8a2d-b613ba181956 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 404 len: 111 microversion: 2.1 time: 0.083710 Oct 11 04:20:20.694618 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1314/2524] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:20 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:20:20.891225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:20.897081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] [instance: 63a565eb-1de8-4b6b-bd27-ba53e0d9a821] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:20.932258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:20.937592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:20.947760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:20.948820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:20.949994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:20.951207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:20.989792 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] HTTP exception thrown: Instance 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 could not be found. Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Request method failure captured: Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 HTTP/1.1 Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO02Jp3ZmOnkaOP3BcJZr1vU8zlnGbIhsrUEF9N-AsihPNARfhojxnPEwYqOwWDvFgRxbnlCh0bs1DdCYV0k0HRzOQ9DPb5dc2Znjrnvkid3wNRAuz4yBRuoLh0ra1BS7QtRnVlW-f_58X6h_UnduJ33HntzEeDVAxLgPtDbepmZ6Xc Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.25 Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: daa8ad03685c4b59b3274fc6407c9eb7 Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/daa8ad03685c4b59b3274fc6407c9eb7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/daa8ad03685c4b59b3274fc6407c9eb7"}]}] Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: daa8ad03685c4b59b3274fc6407c9eb7 Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427 Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-LiveAutoBlockMigrationV225Test-2006568427-project Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 917dab915f7d4303989abb47a33f47df Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-LiveAutoBlockMigrationV225Test-2006568427-project Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 could not be found. Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '63a565eb-1de8-4b6b-bd27-ba53e0d9a821'} Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 could not be found. Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 could not be found. Oct 11 04:20:20.995418 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:21.000865 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:21.000865 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:21.000865 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:21.000865 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:21.000865 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:21.000865 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:21.000865 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:21.000865 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 could not be found. Oct 11 04:20:21.000865 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:21.004283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] Returning 404 to user: Instance 63a565eb-1de8-4b6b-bd27-ba53e0d9a821 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:21.006853 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ffbe9af5-2daf-4e7a-8884-74683f25c7cd tempest-LiveAutoBlockMigrationV225Test-2006568427 tempest-LiveAutoBlockMigrationV225Test-2006568427-project] 10.222.0.26 "GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821" status: 404 len: 111 microversion: 2.25 time: 0.119714 Oct 11 04:20:21.016794 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1315/2525] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:20 2022] GET /compute/v2.1/servers/63a565eb-1de8-4b6b-bd27-ba53e0d9a821 => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:20:21.263326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:21.265459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:21.309151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:21.309151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:21.310069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:21.310299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:21.310654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:21.311082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:21.460932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:21.472517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:21.474970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:21.484900 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-91aec1ca-3724-405a-bfab-13254104a1e4 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.226830 Oct 11 04:20:21.499198 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1316/2526] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:21 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:20:21.631936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:21.632515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] [instance: 244c7407-4845-4274-aa34-493231a9d453] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:21.643553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:21.648578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:21.651185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:21.651185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:21.651185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:21.651185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:21.690502 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] HTTP exception thrown: Instance 244c7407-4845-4274-aa34-493231a9d453 could not be found. Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Request method failure captured: Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 HTTP/1.1 Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5RxjNA06r5o-sUSrTe1-EIKL8455221XTUxy8T4GmIoucO-k3i6MjFyqVCZT2PdVgrw2LZsYHoJP-Q24s_B3teQRDS4MkAxS-YCvWtYEcgyg1wYYFyoqWjbtC0K9V_LEalYQvrNbE24PSNlSLpjKbuO4KHIyenQcV_pWmxePdLOQI Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: a3d48dc85fd64507b459034b67232052 Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesAdminNegativeTest-389311750 Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a3d48dc85fd64507b459034b67232052"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a3d48dc85fd64507b459034b67232052"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a3d48dc85fd64507b459034b67232052"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a3d48dc85fd64507b459034b67232052"}]}] Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesAdminNegativeTest-389311750 Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: a3d48dc85fd64507b459034b67232052 Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-389311750 Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesAdminNegativeTest-389311750-project Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 555865c5372246009bb223d5cbfb8b24 Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesAdminNegativeTest-389311750-project Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 244c7407-4845-4274-aa34-493231a9d453 could not be found. Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '244c7407-4845-4274-aa34-493231a9d453'} Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 244c7407-4845-4274-aa34-493231a9d453 could not be found. Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 244c7407-4845-4274-aa34-493231a9d453 could not be found. Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:21.696196 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:21.700328 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:21.700328 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:21.700328 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:21.700328 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:21.700328 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:21.700328 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 244c7407-4845-4274-aa34-493231a9d453 could not be found. Oct 11 04:20:21.700328 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:21.700328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Returning 404 to user: Instance 244c7407-4845-4274-aa34-493231a9d453 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:21.700328 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d16ffcd-15d8-4326-938d-93da23419f7d tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453" status: 404 len: 111 microversion: 2.1 time: 0.071689 Oct 11 04:20:21.701732 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1317/2527] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:21 2022] GET /compute/v2.1/servers/244c7407-4845-4274-aa34-493231a9d453 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:20:21.711572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e0afdd69-796e-4a5d-9941-e3d933486275 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] Calling method '.version_select at 0x7fda19dc1b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:21.873329 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e0afdd69-796e-4a5d-9941-e3d933486275 tempest-VolumesAdminNegativeTest-389311750 tempest-VolumesAdminNegativeTest-389311750-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-300026022" status: 202 len: 0 microversion: 2.1 time: 0.168632 Oct 11 04:20:21.874076 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1318/2528] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:20:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-300026022 => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:20:22.516308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:22.517682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:22.541898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:22.543601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:22.544214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:22.546258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:22.549524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:22.551805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:22.796013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:22.817004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:22.826703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:22.854574 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-367df853-2aa0-4351-95c4-cc4e78565d49 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.344533 Oct 11 04:20:22.875225 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1319/2529] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:22 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:23.045716 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b377081-1b31-4e96-a2d8-5319dfd57656 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "DELETE /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8" status: 204 len: 0 microversion: 2.1 time: 2.404522 Oct 11 04:20:23.046300 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1211/2530] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:20 2022] DELETE /compute/v2.1/images/c8d1c97b-be16-4aa3-a114-2e48fe26a0e8 => generated 0 bytes in 2406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:20:23.057280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a97c1c53-af00-4a2b-9e73-479c962a251f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda1dfc6b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:23.885759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:23.885759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:23.898779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:23.902860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:23.903486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:23.904385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:23.909859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:23.910582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:24.395767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:24.408109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:24.426490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:24.432787 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3336b735-0a12-44ce-af8a-dc15e03d01ea tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.554400 Oct 11 04:20:24.433951 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1212/2531] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:23 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:25.027890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsNegativeTestJSON-server-1338461162", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "f4298bde-e3a4-4a0f-9430-15bb8de6e007"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:25.913641 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a97c1c53-af00-4a2b-9e73-479c962a251f tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "DELETE /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54" status: 204 len: 0 microversion: 2.1 time: 2.862612 Oct 11 04:20:25.917500 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1320/2532] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:23 2022] DELETE /compute/v2.1/images/8dad5320-072e-4886-a3cb-1b7fc580ae54 => generated 0 bytes in 2864 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:20:25.923771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:25.925209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:25.943589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:25.944283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:25.946721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:25.949776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:25.950642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:25.951280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:25.976534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] validate_networks() for [('f4298bde-e3a4-4a0f-9430-15bb8de6e007', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:20:26.480221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:26.484045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:26.495153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:26.509004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:26.534825 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2a8895f5-c34f-497a-a180-8a9406618c1c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1549 microversion: 2.91 time: 0.616063 Oct 11 04:20:26.535462 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1321/2533] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:25 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1549 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:26.555105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f394b3b5-69f7-4c2a-b2ed-35172cb9a294 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:26.555971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f394b3b5-69f7-4c2a-b2ed-35172cb9a294 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:26.567581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f394b3b5-69f7-4c2a-b2ed-35172cb9a294 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:26.568260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f394b3b5-69f7-4c2a-b2ed-35172cb9a294 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:26.568984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f394b3b5-69f7-4c2a-b2ed-35172cb9a294 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:26.569762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f394b3b5-69f7-4c2a-b2ed-35172cb9a294 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:26.570167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f394b3b5-69f7-4c2a-b2ed-35172cb9a294 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:26.570629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f394b3b5-69f7-4c2a-b2ed-35172cb9a294 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:26.637134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f394b3b5-69f7-4c2a-b2ed-35172cb9a294 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:20:27.063859 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f394b3b5-69f7-4c2a-b2ed-35172cb9a294 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "DELETE /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 204 len: 0 microversion: 2.1 time: 0.524543 Oct 11 04:20:27.064478 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1322/2534] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:20:26 2022] DELETE /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:20:27.073878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f762f3a5-9660-4875-8aa7-64bdc09692a2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:27.074652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f762f3a5-9660-4875-8aa7-64bdc09692a2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:27.088029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f762f3a5-9660-4875-8aa7-64bdc09692a2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:27.088770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f762f3a5-9660-4875-8aa7-64bdc09692a2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:27.089369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f762f3a5-9660-4875-8aa7-64bdc09692a2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:27.090341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f762f3a5-9660-4875-8aa7-64bdc09692a2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:27.090953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f762f3a5-9660-4875-8aa7-64bdc09692a2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:27.091637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f762f3a5-9660-4875-8aa7-64bdc09692a2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:27.200384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:20:27.200887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:20:27.201270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:20:27.202739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:20:27.202739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:20:27.223360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:27.223854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:27.224292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:27.225510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:27.226360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:27.229022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:27.264824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Getting quotas for project d24fdcc8532f4b72b6e4acda76107070. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:20:27.272168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Getting quotas for user a929a7aa51a449d798464c2ee2f36c2c and project d24fdcc8532f4b72b6e4acda76107070. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:20:27.289730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:20:27.294818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:20:27.445303 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f63a3e64-e539-4498-94f5-bc533a7623bc tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.698642 Oct 11 04:20:27.449055 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1213/2535] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:20:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 2703 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:20:27.460595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-45e6b22e-e462-48cc-9e48-8b7d8a93ca43 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:27.462828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-45e6b22e-e462-48cc-9e48-8b7d8a93ca43 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:27.707964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f762f3a5-9660-4875-8aa7-64bdc09692a2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:27.719965 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f762f3a5-9660-4875-8aa7-64bdc09692a2 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1473 microversion: 2.1 time: 0.650077 Oct 11 04:20:27.723372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-45e6b22e-e462-48cc-9e48-8b7d8a93ca43 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:27.734678 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-45e6b22e-e462-48cc-9e48-8b7d8a93ca43 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1225 microversion: 2.1 time: 0.278744 Oct 11 04:20:27.736967 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1323/2536] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:27 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1473 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:20:27.750277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:27.750575 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1214/2537] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:27 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1225 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:20:27.753729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:27.771363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:27.772043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:27.772885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:27.773792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:27.777059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:27.777803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:28.085247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:28.099172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:28.101781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:28.114551 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f7777cfd-0aaf-4176-86ca-a91f10c383bf tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1531 microversion: 2.91 time: 0.372864 Oct 11 04:20:28.117939 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1324/2538] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:27 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1531 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:28.744126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-10aa3536-1ad7-4352-9ed0-ee74c333e5fb tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:28.744828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-10aa3536-1ad7-4352-9ed0-ee74c333e5fb tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:28.760932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6ae38f7f-76ec-4d93-b6dd-10664e419264 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:28.761858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6ae38f7f-76ec-4d93-b6dd-10664e419264 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:28.781490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10aa3536-1ad7-4352-9ed0-ee74c333e5fb tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:28.782518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10aa3536-1ad7-4352-9ed0-ee74c333e5fb tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:28.783196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10aa3536-1ad7-4352-9ed0-ee74c333e5fb tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:28.784680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10aa3536-1ad7-4352-9ed0-ee74c333e5fb tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:28.786882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10aa3536-1ad7-4352-9ed0-ee74c333e5fb tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:28.787485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10aa3536-1ad7-4352-9ed0-ee74c333e5fb tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:28.928603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6ae38f7f-76ec-4d93-b6dd-10664e419264 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:28.936063 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6ae38f7f-76ec-4d93-b6dd-10664e419264 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1225 microversion: 2.1 time: 0.178923 Oct 11 04:20:28.943055 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1325/2539] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:28 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1225 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:20:29.150049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:29.151382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:29.168674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:29.169384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:29.170046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:29.171023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:29.171698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:29.172345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:29.433638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:29.461459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:29.469872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:29.498117 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-300d5e63-feba-47c7-8a2f-6e72f9d5a334 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1531 microversion: 2.91 time: 0.351999 Oct 11 04:20:29.500962 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1326/2540] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:29 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1531 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:20:29.503645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-10aa3536-1ad7-4352-9ed0-ee74c333e5fb tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:29.533990 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-10aa3536-1ad7-4352-9ed0-ee74c333e5fb tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1473 microversion: 2.1 time: 0.793603 Oct 11 04:20:29.536072 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1215/2541] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:28 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1473 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:29.968168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c88fa639-cf13-4a2d-b6ca-019117cd684f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:29.972381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c88fa639-cf13-4a2d-b6ca-019117cd684f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:29.979307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c88fa639-cf13-4a2d-b6ca-019117cd684f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:29.979801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c88fa639-cf13-4a2d-b6ca-019117cd684f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:29.980242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c88fa639-cf13-4a2d-b6ca-019117cd684f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:29.980964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c88fa639-cf13-4a2d-b6ca-019117cd684f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:29.981415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c88fa639-cf13-4a2d-b6ca-019117cd684f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:29.981844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c88fa639-cf13-4a2d-b6ca-019117cd684f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:30.398722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c88fa639-cf13-4a2d-b6ca-019117cd684f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:30.408987 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c88fa639-cf13-4a2d-b6ca-019117cd684f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1229 microversion: 2.1 time: 0.444438 Oct 11 04:20:30.415978 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1327/2542] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:29 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1229 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:30.486029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e1322091-b2b4-4861-b9ce-f0940ea18a2e req-800b2b13-415f-4cd6-a74a-f477e7999275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93bf3c01-c65e-4a62-ac8f-352bc8246a2d", "name": "network-vif-deleted", "tag": "d0bb2ff8-d0fd-4843-b947-a32edd7bb015"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:30.519321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e1322091-b2b4-4861-b9ce-f0940ea18a2e req-800b2b13-415f-4cd6-a74a-f477e7999275 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:30.521317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e1322091-b2b4-4861-b9ce-f0940ea18a2e req-800b2b13-415f-4cd6-a74a-f477e7999275 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:30.527276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e1322091-b2b4-4861-b9ce-f0940ea18a2e req-800b2b13-415f-4cd6-a74a-f477e7999275 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:30.536427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:30.538488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:30.552698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:30.582568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:30.593691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:30.598885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:30.599665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:30.601499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:30.618448 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e1322091-b2b4-4861-b9ce-f0940ea18a2e req-800b2b13-415f-4cd6-a74a-f477e7999275 service nova] Creating event network-vif-deleted:d0bb2ff8-d0fd-4843-b947-a32edd7bb015 for instance 93bf3c01-c65e-4a62-ac8f-352bc8246a2d on n-h1-860892-1 Oct 11 04:20:30.634557 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e1322091-b2b4-4861-b9ce-f0940ea18a2e req-800b2b13-415f-4cd6-a74a-f477e7999275 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.155856 Oct 11 04:20:30.635800 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1216/2543] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:30.655368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ea913f83-2a3c-4f4a-a545-9fb21de0030e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:30.656315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ea913f83-2a3c-4f4a-a545-9fb21de0030e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:30.666624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea913f83-2a3c-4f4a-a545-9fb21de0030e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:30.667412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea913f83-2a3c-4f4a-a545-9fb21de0030e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:30.682416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea913f83-2a3c-4f4a-a545-9fb21de0030e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:30.683624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea913f83-2a3c-4f4a-a545-9fb21de0030e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:30.684266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea913f83-2a3c-4f4a-a545-9fb21de0030e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:30.685095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea913f83-2a3c-4f4a-a545-9fb21de0030e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:30.928217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:30.950380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:30.954021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:30.972995 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7ffa0b33-e806-465d-a44c-70774ec11ded tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1534 microversion: 2.91 time: 0.440369 Oct 11 04:20:30.973901 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1328/2544] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:30 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1534 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:30.980951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:30.981761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:31.010162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.010953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.011444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.012436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.012960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.013456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.029926 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] HTTP exception thrown: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Request method failure captured: Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 HTTP/1.1 Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO6BApuWzfdKAuDVL54_c4Bu9f3S9gCDTpDqpflazWKUNVKZRP4JYeUhkI1X1UAEtdvraTJDaIjXYDnqRq7a-VfHg3hPMqyDlwU0k1En-E2Tg1Zwa28RSmMMuGtBchyXal8PHLPSeWx7S3K2MKDmCxHfWmWKv-t0tyyIW1XzbW7bwh8 Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}] Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 2bc397bbbb204dfd9494ec2a6ee020a8 Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '94c0e847-3028-4c23-9883-c46359435888'} Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:31.032136 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:31.036544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:31.036544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.036544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:31.036544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.036544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.036544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:31.036544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:31.036544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:31.036544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:31.036544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:31.036544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.038290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Returning 404 to user: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:31.039685 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-13e48cb7-5b91-4acc-b234-29bda8deb035 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "DELETE /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 404 len: 111 microversion: 2.1 time: 0.064454 Oct 11 04:20:31.040497 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1329/2545] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:20:30 2022] DELETE /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:20:31.045467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6238979-f980-429f-930e-a8d087313d10 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Action: 'action', calling method: >, body: {"unshelve": {"host": "n-h1-860892-1"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:31.049345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6238979-f980-429f-930e-a8d087313d10 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:31.056836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6238979-f980-429f-930e-a8d087313d10 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.058067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6238979-f980-429f-930e-a8d087313d10 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.058614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6238979-f980-429f-930e-a8d087313d10 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.059584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6238979-f980-429f-930e-a8d087313d10 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.060259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6238979-f980-429f-930e-a8d087313d10 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.060921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6238979-f980-429f-930e-a8d087313d10 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.305255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6238979-f980-429f-930e-a8d087313d10 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "n-h1-860892-1". {{(pid=120994) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 04:20:31.456524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea913f83-2a3c-4f4a-a545-9fb21de0030e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:31.471453 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ea913f83-2a3c-4f4a-a545-9fb21de0030e tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 200 len: 1431 microversion: 2.1 time: 0.824299 Oct 11 04:20:31.474829 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1217/2546] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:30 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 1431 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:31.488176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:31.488893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 94c0e847-3028-4c23-9883-c46359435888] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:31.527944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.528474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.528917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.533939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.534527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.534972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.555588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:31.577549 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] HTTP exception thrown: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Request method failure captured: Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 HTTP/1.1 Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO6BApuWzfdKAuDVL54_c4Bu9f3S9gCDTpDqpflazWKUNVKZRP4JYeUhkI1X1UAEtdvraTJDaIjXYDnqRq7a-VfHg3hPMqyDlwU0k1En-E2Tg1Zwa28RSmMMuGtBchyXal8PHLPSeWx7S3K2MKDmCxHfWmWKv-t0tyyIW1XzbW7bwh8 Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}] Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 2bc397bbbb204dfd9494ec2a6ee020a8 Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '94c0e847-3028-4c23-9883-c46359435888'} Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:31.587458 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.592424 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.592424 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:31.592424 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:31.592424 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:31.592424 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:31.592424 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. Oct 11 04:20:31.592424 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.599191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Returning 404 to user: Instance 94c0e847-3028-4c23-9883-c46359435888 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:31.600385 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-db0370d8-00bd-4815-94d9-c89c8892dea9 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888" status: 404 len: 111 microversion: 2.1 time: 0.124330 Oct 11 04:20:31.601138 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1218/2547] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:31 2022] GET /compute/v2.1/servers/94c0e847-3028-4c23-9883-c46359435888 => generated 111 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:20:31.608183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-89fff2a5-d181-4d33-8807-7f5fe639df25 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:31.615332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-89fff2a5-d181-4d33-8807-7f5fe639df25 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:31.626306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89fff2a5-d181-4d33-8807-7f5fe639df25 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.635434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89fff2a5-d181-4d33-8807-7f5fe639df25 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.636226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89fff2a5-d181-4d33-8807-7f5fe639df25 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.637164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89fff2a5-d181-4d33-8807-7f5fe639df25 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.637807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89fff2a5-d181-4d33-8807-7f5fe639df25 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.638507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89fff2a5-d181-4d33-8807-7f5fe639df25 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.710796 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6238979-f980-429f-930e-a8d087313d10 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f/action" status: 202 len: 0 microversion: 2.91 time: 0.668803 Oct 11 04:20:31.714486 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1330/2548] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:20:31 2022] POST /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f/action => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:20:31.726056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:31.726593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:31.749175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.749666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.750100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.750830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.761808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.762535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.818587 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] HTTP exception thrown: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Request method failure captured: Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 HTTP/1.1 Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO6BApuWzfdKAuDVL54_c4Bu9f3S9gCDTpDqpflazWKUNVKZRP4JYeUhkI1X1UAEtdvraTJDaIjXYDnqRq7a-VfHg3hPMqyDlwU0k1En-E2Tg1Zwa28RSmMMuGtBchyXal8PHLPSeWx7S3K2MKDmCxHfWmWKv-t0tyyIW1XzbW7bwh8 Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}] Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 2bc397bbbb204dfd9494ec2a6ee020a8 Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '61736a99-889e-47c3-a550-c4d48a359d38'} Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:31.820184 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Returning 404 to user: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:31.824614 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a5bf2c68-3e4e-4b33-9385-549777676b3b tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "DELETE /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 404 len: 111 microversion: 2.1 time: 0.104799 Oct 11 04:20:31.827821 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1331/2549] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:20:31 2022] DELETE /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:20:31.833284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:31.833895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:31.856222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-89fff2a5-d181-4d33-8807-7f5fe639df25 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:31.859512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.860090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.860543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.862352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.862848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.863256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.874530 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-89fff2a5-d181-4d33-8807-7f5fe639df25 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1285 microversion: 2.1 time: 0.271694 Oct 11 04:20:31.881956 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1219/2550] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:31 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1285 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:31.890265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:31.894368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] [instance: 61736a99-889e-47c3-a550-c4d48a359d38] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:31.915994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.916645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.917169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.918144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:31.920087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:31.920718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:31.969986 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] HTTP exception thrown: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Request method failure captured: Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 HTTP/1.1 Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO6BApuWzfdKAuDVL54_c4Bu9f3S9gCDTpDqpflazWKUNVKZRP4JYeUhkI1X1UAEtdvraTJDaIjXYDnqRq7a-VfHg3hPMqyDlwU0k1En-E2Tg1Zwa28RSmMMuGtBchyXal8PHLPSeWx7S3K2MKDmCxHfWmWKv-t0tyyIW1XzbW7bwh8 Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/35648419af8f47b49dd4dfb75115d2e1"}]}] Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 35648419af8f47b49dd4dfb75115d2e1 Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestMultiNic-1320793675 Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 2bc397bbbb204dfd9494ec2a6ee020a8 Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestMultiNic-1320793675-project Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '61736a99-889e-47c3-a550-c4d48a359d38'} Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:31.971882 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.975582 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:31.975582 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:31.975582 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:31.975582 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:31.975582 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:31.975582 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. Oct 11 04:20:31.975582 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:31.977629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] Returning 404 to user: Instance 61736a99-889e-47c3-a550-c4d48a359d38 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:31.981567 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ecc50d82-2c6e-4244-a7a2-effae556e119 tempest-ServersTestMultiNic-1320793675 tempest-ServersTestMultiNic-1320793675-project] 10.222.0.26 "GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38" status: 404 len: 111 microversion: 2.1 time: 0.095784 Oct 11 04:20:31.983571 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1220/2551] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:31 2022] GET /compute/v2.1/servers/61736a99-889e-47c3-a550-c4d48a359d38 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:20:32.305739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:32.319882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:32.322858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:32.336255 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0c6c7047-27d9-4fe7-9fd8-18c102ccd9b7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1482 microversion: 2.91 time: 0.507176 Oct 11 04:20:32.350060 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1332/2552] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:31 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1482 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:32.499110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:32.500529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 93bf3c01-c65e-4a62-ac8f-352bc8246a2d] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:32.515058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:32.515841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:32.517663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:32.517663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:32.518012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:32.518891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:32.538684 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] HTTP exception thrown: Instance 93bf3c01-c65e-4a62-ac8f-352bc8246a2d could not be found. Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Request method failure captured: Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d HTTP/1.1 Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO5qC-KlVdZ88Oeqh3Ibhr5Qjq8scbsTXEUYL8HyDVByIfTp5MHekLXRH-LPAAPhoTHz7hEfLd77gplBuHeZPRqnki__ObuAS75-4Tc55IXI2ijcRpnflUbmr8fRr8S9VDz6R0rEN6TaToSsHgyUaD-HOpSrQai7dw6vWQCT1QEhsmM Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 55a807026da64676b9e63cb20df73d7f Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ListImageFiltersTestJSON-752020617 Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55a807026da64676b9e63cb20df73d7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55a807026da64676b9e63cb20df73d7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55a807026da64676b9e63cb20df73d7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55a807026da64676b9e63cb20df73d7f"}]}] Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ListImageFiltersTestJSON-752020617 Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 55a807026da64676b9e63cb20df73d7f Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-752020617 Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ListImageFiltersTestJSON-752020617-project Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 42cf24cec7b0443a874b543734e0b296 Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ListImageFiltersTestJSON-752020617-project Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 93bf3c01-c65e-4a62-ac8f-352bc8246a2d could not be found. Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '93bf3c01-c65e-4a62-ac8f-352bc8246a2d'} Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93bf3c01-c65e-4a62-ac8f-352bc8246a2d could not be found. Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93bf3c01-c65e-4a62-ac8f-352bc8246a2d could not be found. Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:32.542074 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:32.546101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:32.546101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:32.546101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:32.546101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:32.546101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:32.546101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93bf3c01-c65e-4a62-ac8f-352bc8246a2d could not be found. Oct 11 04:20:32.546101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:32.550886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Returning 404 to user: Instance 93bf3c01-c65e-4a62-ac8f-352bc8246a2d could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:32.553265 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cc928d25-c22a-460c-882f-c95b880ec445 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d" status: 404 len: 111 microversion: 2.1 time: 0.059149 Oct 11 04:20:32.557411 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1221/2553] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:32 2022] GET /compute/v2.1/servers/93bf3c01-c65e-4a62-ac8f-352bc8246a2d => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:20:32.562369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-006ff3b0-b4bd-479b-b814-31f80232c388 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:32.563142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-006ff3b0-b4bd-479b-b814-31f80232c388 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:32.565862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:32.577785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-006ff3b0-b4bd-479b-b814-31f80232c388 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:32.585387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-006ff3b0-b4bd-479b-b814-31f80232c388 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:32.586091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-006ff3b0-b4bd-479b-b814-31f80232c388 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:32.586932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-006ff3b0-b4bd-479b-b814-31f80232c388 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:32.587408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-006ff3b0-b4bd-479b-b814-31f80232c388 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:32.588455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-006ff3b0-b4bd-479b-b814-31f80232c388 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:32.691712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-006ff3b0-b4bd-479b-b814-31f80232c388 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:20:32.901052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9316f22a-ca1d-404a-ac92-a501fc670906 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:32.901982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9316f22a-ca1d-404a-ac92-a501fc670906 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:32.912955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9316f22a-ca1d-404a-ac92-a501fc670906 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:32.913637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9316f22a-ca1d-404a-ac92-a501fc670906 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:32.916652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9316f22a-ca1d-404a-ac92-a501fc670906 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:32.917771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9316f22a-ca1d-404a-ac92-a501fc670906 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:32.920535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9316f22a-ca1d-404a-ac92-a501fc670906 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:32.921167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9316f22a-ca1d-404a-ac92-a501fc670906 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:33.098623 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-006ff3b0-b4bd-479b-b814-31f80232c388 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7" status: 204 len: 0 microversion: 2.1 time: 0.539786 Oct 11 04:20:33.101507 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1333/2554] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:20:32 2022] DELETE /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:20:33.109695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6fab12e9-2239-433a-8939-87701edd2938 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:33.110536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6fab12e9-2239-433a-8939-87701edd2938 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:33.126119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fab12e9-2239-433a-8939-87701edd2938 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:33.126729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fab12e9-2239-433a-8939-87701edd2938 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:33.127834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fab12e9-2239-433a-8939-87701edd2938 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:33.128869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fab12e9-2239-433a-8939-87701edd2938 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:33.129404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fab12e9-2239-433a-8939-87701edd2938 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:33.129892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fab12e9-2239-433a-8939-87701edd2938 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:33.215082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9316f22a-ca1d-404a-ac92-a501fc670906 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:33.222896 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9316f22a-ca1d-404a-ac92-a501fc670906 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1283 microversion: 2.1 time: 0.325602 Oct 11 04:20:33.227215 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1222/2555] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:32 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1283 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:33.367865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:33.368470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:33.386009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:33.386911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:33.387524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:33.388813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:33.389525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:33.390281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:33.632022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:33.664705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:33.671547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:33.688579 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d765a5bb-2f66-4344-a285-afc6435c804a tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1482 microversion: 2.91 time: 0.324518 Oct 11 04:20:33.692873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6fab12e9-2239-433a-8939-87701edd2938 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:33.706758 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6fab12e9-2239-433a-8939-87701edd2938 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7" status: 200 len: 1473 microversion: 2.1 time: 0.600775 Oct 11 04:20:33.707577 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1334/2556] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:33 2022] GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7 => generated 1473 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:33.712214 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1223/2557] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:33 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1482 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:20:34.262295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d01e405-bd97-41ff-a4ca-df14ee6d0db3 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:34.262948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d01e405-bd97-41ff-a4ca-df14ee6d0db3 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:34.278751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d01e405-bd97-41ff-a4ca-df14ee6d0db3 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:34.279254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d01e405-bd97-41ff-a4ca-df14ee6d0db3 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:34.279695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d01e405-bd97-41ff-a4ca-df14ee6d0db3 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:34.280403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d01e405-bd97-41ff-a4ca-df14ee6d0db3 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:34.280884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d01e405-bd97-41ff-a4ca-df14ee6d0db3 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:34.281313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d01e405-bd97-41ff-a4ca-df14ee6d0db3 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:34.440422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d01e405-bd97-41ff-a4ca-df14ee6d0db3 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:34.454046 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d01e405-bd97-41ff-a4ca-df14ee6d0db3 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1283 microversion: 2.1 time: 0.207942 Oct 11 04:20:34.454665 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1335/2558] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:34 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1283 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:20:34.754104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d1e3117-d8b2-475d-9345-140c5f245b85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:34.754770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d1e3117-d8b2-475d-9345-140c5f245b85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:34.757328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:34.757954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:34.768987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1e3117-d8b2-475d-9345-140c5f245b85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:34.772715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:34.773644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1e3117-d8b2-475d-9345-140c5f245b85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:34.774332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1e3117-d8b2-475d-9345-140c5f245b85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:34.776072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1e3117-d8b2-475d-9345-140c5f245b85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:34.776729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1e3117-d8b2-475d-9345-140c5f245b85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:34.776962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:34.777714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:34.779021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:34.779371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1e3117-d8b2-475d-9345-140c5f245b85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:34.783743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:34.784447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:34.827677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:35.338774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:35.349049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:35.351315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:35.365816 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d0d421d6-21a8-4ff6-a393-4acd13c91b06 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.628327 Oct 11 04:20:35.366720 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1224/2559] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:34 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:35.380400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d1e3117-d8b2-475d-9345-140c5f245b85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:35.402725 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d1e3117-d8b2-475d-9345-140c5f245b85 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7" status: 200 len: 1473 microversion: 2.1 time: 0.660717 Oct 11 04:20:35.403471 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1336/2560] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:34 2022] GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7 => generated 1473 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:35.481539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2fde3db6-760b-47d0-8521-dc2650bd0746 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:35.483206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2fde3db6-760b-47d0-8521-dc2650bd0746 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:35.501343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fde3db6-760b-47d0-8521-dc2650bd0746 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:35.502685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fde3db6-760b-47d0-8521-dc2650bd0746 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:35.510154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fde3db6-760b-47d0-8521-dc2650bd0746 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:35.510154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fde3db6-760b-47d0-8521-dc2650bd0746 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:35.510154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fde3db6-760b-47d0-8521-dc2650bd0746 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:35.510154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fde3db6-760b-47d0-8521-dc2650bd0746 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:36.011561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2fde3db6-760b-47d0-8521-dc2650bd0746 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:36.034885 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2fde3db6-760b-47d0-8521-dc2650bd0746 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1325 microversion: 2.1 time: 0.557823 Oct 11 04:20:36.038957 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1225/2561] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:35 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1325 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:36.405138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:36.406365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:36.430994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3328c7cc-8cdf-4091-83d2-69b6affe74c0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:36.432126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3328c7cc-8cdf-4091-83d2-69b6affe74c0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:36.444160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3328c7cc-8cdf-4091-83d2-69b6affe74c0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:36.444160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3328c7cc-8cdf-4091-83d2-69b6affe74c0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:36.445513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3328c7cc-8cdf-4091-83d2-69b6affe74c0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:36.447128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3328c7cc-8cdf-4091-83d2-69b6affe74c0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:36.450890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3328c7cc-8cdf-4091-83d2-69b6affe74c0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:36.451537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3328c7cc-8cdf-4091-83d2-69b6affe74c0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:36.452324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:36.453360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:36.453807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:36.454563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:36.455589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:36.456017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:37.252858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:37.384265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:37.405728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:37.408387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:37.436675 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d1084496-bed9-4d81-bb89-739dd06d8fe3 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 1.035452 Oct 11 04:20:37.454203 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1337/2562] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:36 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:37.660705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3328c7cc-8cdf-4091-83d2-69b6affe74c0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:37.660705 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3328c7cc-8cdf-4091-83d2-69b6affe74c0 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7" status: 200 len: 1473 microversion: 2.1 time: 1.085144 Oct 11 04:20:37.660705 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1226/2563] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:36 2022] GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7 => generated 1473 bytes in 1091 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:37.660705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f19947b-de72-4b8c-a09a-ef72a49174f5 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:37.660705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f19947b-de72-4b8c-a09a-ef72a49174f5 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:37.660705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f19947b-de72-4b8c-a09a-ef72a49174f5 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:37.660705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f19947b-de72-4b8c-a09a-ef72a49174f5 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:37.660705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f19947b-de72-4b8c-a09a-ef72a49174f5 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:37.660705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f19947b-de72-4b8c-a09a-ef72a49174f5 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:37.660705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f19947b-de72-4b8c-a09a-ef72a49174f5 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:37.660705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f19947b-de72-4b8c-a09a-ef72a49174f5 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:37.662358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1684121901", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "f32d817c-0e21-4ee5-826c-45c41a058063"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:37.662358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] validate_networks() for [('f32d817c-0e21-4ee5-826c-45c41a058063', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:20:37.727601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:37.889221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f19947b-de72-4b8c-a09a-ef72a49174f5 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:37.917463 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f19947b-de72-4b8c-a09a-ef72a49174f5 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1325 microversion: 2.1 time: 0.393738 Oct 11 04:20:37.918389 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1227/2564] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:37 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1325 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:37.930795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f97b78a9-3a90-49b6-9088-7463ccab75bb req-d5ad5b82-e5b9-45d8-9db1-27b5b7c701cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4aaae530-25a0-46f6-9df0-bb21d130a0f7", "name": "network-vif-deleted", "tag": "39669b5c-b616-41c2-a28c-282c3da17d8d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:37.960505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f97b78a9-3a90-49b6-9088-7463ccab75bb req-d5ad5b82-e5b9-45d8-9db1-27b5b7c701cd service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:37.963034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f97b78a9-3a90-49b6-9088-7463ccab75bb req-d5ad5b82-e5b9-45d8-9db1-27b5b7c701cd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:37.963034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f97b78a9-3a90-49b6-9088-7463ccab75bb req-d5ad5b82-e5b9-45d8-9db1-27b5b7c701cd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:37.994105 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f97b78a9-3a90-49b6-9088-7463ccab75bb req-d5ad5b82-e5b9-45d8-9db1-27b5b7c701cd service nova] Creating event network-vif-deleted:39669b5c-b616-41c2-a28c-282c3da17d8d for instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 on n-h2-860892-1 Oct 11 04:20:38.011266 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f97b78a9-3a90-49b6-9088-7463ccab75bb req-d5ad5b82-e5b9-45d8-9db1-27b5b7c701cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091424 Oct 11 04:20:38.012249 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1228/2565] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:38.469560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:38.471045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:38.486449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:38.492520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:38.497312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:38.497312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:38.497312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:38.497312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:38.669589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:38.704388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:38.708703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:38.733191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:38.737410 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b799852-3ab0-4b99-8711-e064f5e1ac2d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.272088 Oct 11 04:20:38.755701 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1229/2566] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:38 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:20:38.755701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:38.756177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:38.778692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:38.786577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:38.787359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:38.788283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:38.788981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:38.789620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:38.888267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:38.894952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:38.895732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:38.896422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lazy-loading 'fault' on Instance uuid 4aaae530-25a0-46f6-9df0-bb21d130a0f7 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:20:38.936129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:39.396316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:20:39.397168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:20:39.397804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:20:39.398422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:20:39.399015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:20:39.413771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:39.417628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:39.418086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:39.418914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:39.419367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:39.419787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:39.460629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Getting quotas for project 9db178c528264083bfd30875291a1797. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:20:39.468906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Getting quotas for user 7c3e365e46be4bc2b83f09bf0ebd8efc and project 9db178c528264083bfd30875291a1797. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:20:39.493766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:20:39.496520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:20:39.585439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '42cf24cec7b0443a874b543734e0b296', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '55a807026da64676b9e63cb20df73d7f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:39.594555 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d2b32270-6e13-4c91-b37e-f0fdc9fe3702 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7" status: 200 len: 1307 microversion: 2.1 time: 0.848278 Oct 11 04:20:39.595959 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1230/2567] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:38 2022] GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7 => generated 1307 bytes in 852 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:39.600889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd8244fa-51d0-4707-bd40-1bcf9291d59d tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:39.605811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd8244fa-51d0-4707-bd40-1bcf9291d59d tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:39.627812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8244fa-51d0-4707-bd40-1bcf9291d59d tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:39.629463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8244fa-51d0-4707-bd40-1bcf9291d59d tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:39.629463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8244fa-51d0-4707-bd40-1bcf9291d59d tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:39.629758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8244fa-51d0-4707-bd40-1bcf9291d59d tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:39.640882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8244fa-51d0-4707-bd40-1bcf9291d59d tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:39.641637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8244fa-51d0-4707-bd40-1bcf9291d59d tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:39.747622 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ed5135b9-77c8-450e-b6ed-30af80fcea19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.301189 Oct 11 04:20:39.752625 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1338/2568] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:20:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 2305 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:20:39.760618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c343ca12-5854-4788-bdad-aa873c1045b6 req-06776379-f031-4bfa-bc4b-a205c337e18f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "685f9ada-1e79-427b-abf0-a86090495d6e", "tag": "c42f6c2a-ece1-4f94-bfaf-e4f3d7a04efe"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:39.815386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c343ca12-5854-4788-bdad-aa873c1045b6 req-06776379-f031-4bfa-bc4b-a205c337e18f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:39.816201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c343ca12-5854-4788-bdad-aa873c1045b6 req-06776379-f031-4bfa-bc4b-a205c337e18f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:39.816927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c343ca12-5854-4788-bdad-aa873c1045b6 req-06776379-f031-4bfa-bc4b-a205c337e18f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:39.852173 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c343ca12-5854-4788-bdad-aa873c1045b6 req-06776379-f031-4bfa-bc4b-a205c337e18f service nova] Creating event network-changed:c42f6c2a-ece1-4f94-bfaf-e4f3d7a04efe for instance 685f9ada-1e79-427b-abf0-a86090495d6e on n-h1-860892-1 Oct 11 04:20:39.864031 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c343ca12-5854-4788-bdad-aa873c1045b6 req-06776379-f031-4bfa-bc4b-a205c337e18f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111029 Oct 11 04:20:39.870522 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1339/2569] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:39.883840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82f31507-2a9e-4694-89ef-45ae05bf2527 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:39.886323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82f31507-2a9e-4694-89ef-45ae05bf2527 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:40.124857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82f31507-2a9e-4694-89ef-45ae05bf2527 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:40.150248 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82f31507-2a9e-4694-89ef-45ae05bf2527 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1225 microversion: 2.1 time: 0.277086 Oct 11 04:20:40.166034 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1340/2570] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:39 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1225 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:40.177142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:40.178130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:40.194607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:40.194607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:40.194607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:40.201596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:40.202554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:40.205194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:40.647369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd8244fa-51d0-4707-bd40-1bcf9291d59d tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:40.661376 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd8244fa-51d0-4707-bd40-1bcf9291d59d tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1325 microversion: 2.1 time: 1.060552 Oct 11 04:20:40.662724 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1231/2571] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:39 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1325 bytes in 1066 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:40.675100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:40.676014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] [instance: 4aaae530-25a0-46f6-9df0-bb21d130a0f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:40.687964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:40.691072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:40.691610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:40.692548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:40.694718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:40.695338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:40.732612 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] HTTP exception thrown: Instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 could not be found. Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Request method failure captured: Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7 HTTP/1.1 Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO5qC-KlVdZ88Oeqh3Ibhr5Qjq8scbsTXEUYL8HyDVByIfTp5MHekLXRH-LPAAPhoTHz7hEfLd77gplBuHeZPRqnki__ObuAS75-4Tc55IXI2ijcRpnflUbmr8fRr8S9VDz6R0rEN6TaToSsHgyUaD-HOpSrQai7dw6vWQCT1QEhsmM Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 55a807026da64676b9e63cb20df73d7f Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ListImageFiltersTestJSON-752020617 Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/55a807026da64676b9e63cb20df73d7f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_55a807026da64676b9e63cb20df73d7f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55a807026da64676b9e63cb20df73d7f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/55a807026da64676b9e63cb20df73d7f"}]}] Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ListImageFiltersTestJSON-752020617 Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 55a807026da64676b9e63cb20df73d7f Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ListImageFiltersTestJSON-752020617 Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ListImageFiltersTestJSON-752020617-project Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 42cf24cec7b0443a874b543734e0b296 Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ListImageFiltersTestJSON-752020617-project Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 could not be found. Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '4aaae530-25a0-46f6-9df0-bb21d130a0f7'} Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 could not be found. Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 could not be found. Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:40.737260 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:40.747394 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:40.747394 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:40.747394 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:40.747394 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:40.747394 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:40.747394 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 could not be found. Oct 11 04:20:40.747394 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:40.747394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Returning 404 to user: Instance 4aaae530-25a0-46f6-9df0-bb21d130a0f7 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:40.747394 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d967be3-ba26-4e9a-a69d-eaec023e920d tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7" status: 404 len: 111 microversion: 2.1 time: 0.072478 Oct 11 04:20:40.748689 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1232/2572] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:40 2022] GET /compute/v2.1/servers/4aaae530-25a0-46f6-9df0-bb21d130a0f7 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:20:40.762724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fc6ad82b-82ff-494c-9640-4e2be9e3af52 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda199df550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:41.432542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:41.452677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:41.454847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:41.464321 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7fee0dce-deaf-403c-b716-bccd11d15d99 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 1.296829 Oct 11 04:20:41.465532 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1341/2573] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:40 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:41.470665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab6ee231-14c9-44f3-9448-780df87d10cc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:41.473418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab6ee231-14c9-44f3-9448-780df87d10cc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:41.795220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab6ee231-14c9-44f3-9448-780df87d10cc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:41.803189 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab6ee231-14c9-44f3-9448-780df87d10cc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1225 microversion: 2.1 time: 0.336317 Oct 11 04:20:41.804221 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1342/2574] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:41 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1225 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:41.823450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72713013-80f2-46da-b2eb-9b424f8e843f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:41.824056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72713013-80f2-46da-b2eb-9b424f8e843f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:41.831872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72713013-80f2-46da-b2eb-9b424f8e843f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:41.832463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72713013-80f2-46da-b2eb-9b424f8e843f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:41.832965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72713013-80f2-46da-b2eb-9b424f8e843f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:41.833739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72713013-80f2-46da-b2eb-9b424f8e843f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:41.834306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72713013-80f2-46da-b2eb-9b424f8e843f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:41.834809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72713013-80f2-46da-b2eb-9b424f8e843f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:42.015605 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fc6ad82b-82ff-494c-9640-4e2be9e3af52 tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "DELETE /compute/v2.1/images/5260f29f-d0fe-457b-87da-2d24bd113321" status: 204 len: 0 microversion: 2.1 time: 1.256422 Oct 11 04:20:42.015605 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1233/2575] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:40 2022] DELETE /compute/v2.1/images/5260f29f-d0fe-457b-87da-2d24bd113321 => generated 0 bytes in 1258 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:20:42.015605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52c7576f-9631-49f3-a957-886f06f933fc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19a02310>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:42.312982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72713013-80f2-46da-b2eb-9b424f8e843f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:42.330833 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72713013-80f2-46da-b2eb-9b424f8e843f tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1325 microversion: 2.1 time: 0.511111 Oct 11 04:20:42.335442 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1343/2576] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:41 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1325 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:42.499952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:42.500633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:42.520804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:42.522783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:42.526732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:42.530059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:42.533860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:42.535184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:42.776197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:42.786171 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-52c7576f-9631-49f3-a957-886f06f933fc tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "DELETE /compute/v2.1/images/4b3b0af6-6f9c-4611-b66d-575c9d6bea7a" status: 204 len: 0 microversion: 2.1 time: 0.774690 Oct 11 04:20:42.788288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:42.790324 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1234/2577] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:42 2022] DELETE /compute/v2.1/images/4b3b0af6-6f9c-4611-b66d-575c9d6bea7a => generated 0 bytes in 777 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:20:42.795676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:42.797443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8bc341cd-b363-4e96-85f9-876c40d29c4b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] Calling method '.version_select at 0x7fda19b6b940>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:42.807762 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4010b791-6231-446c-806c-23a9988164ee tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.311653 Oct 11 04:20:42.808923 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1344/2578] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:42 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:42.835037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df0d687b-942b-43d5-827f-a8a8f0851cdc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:42.835878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-df0d687b-942b-43d5-827f-a8a8f0851cdc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:42.848792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df0d687b-942b-43d5-827f-a8a8f0851cdc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:42.849457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df0d687b-942b-43d5-827f-a8a8f0851cdc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:42.850059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df0d687b-942b-43d5-827f-a8a8f0851cdc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:42.861359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df0d687b-942b-43d5-827f-a8a8f0851cdc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:42.861359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df0d687b-942b-43d5-827f-a8a8f0851cdc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:42.861359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df0d687b-942b-43d5-827f-a8a8f0851cdc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:43.053660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-df0d687b-942b-43d5-827f-a8a8f0851cdc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:43.075350 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-df0d687b-942b-43d5-827f-a8a8f0851cdc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1221 microversion: 2.1 time: 0.243646 Oct 11 04:20:43.086694 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1345/2579] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:42 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1221 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:43.363452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3af1b26d-bf25-40f3-b27f-054dca8b3d0b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:43.364187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3af1b26d-bf25-40f3-b27f-054dca8b3d0b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:43.370563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3af1b26d-bf25-40f3-b27f-054dca8b3d0b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:43.371310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3af1b26d-bf25-40f3-b27f-054dca8b3d0b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:43.371924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3af1b26d-bf25-40f3-b27f-054dca8b3d0b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:43.373418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3af1b26d-bf25-40f3-b27f-054dca8b3d0b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:43.374031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3af1b26d-bf25-40f3-b27f-054dca8b3d0b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:43.374645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3af1b26d-bf25-40f3-b27f-054dca8b3d0b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:43.766296 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8bc341cd-b363-4e96-85f9-876c40d29c4b tempest-ListImageFiltersTestJSON-752020617 tempest-ListImageFiltersTestJSON-752020617-project] 10.222.0.26 "DELETE /compute/v2.1/images/40e4c98e-d1db-40e4-b7d5-a1fb20273f90" status: 204 len: 0 microversion: 2.1 time: 0.974531 Oct 11 04:20:43.767967 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1235/2580] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:42 2022] DELETE /compute/v2.1/images/40e4c98e-d1db-40e4-b7d5-a1fb20273f90 => generated 0 bytes in 977 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:20:43.844220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:43.845134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:43.853385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:43.854035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:43.854666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:43.855590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:43.856196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:43.856962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:43.978127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:43.987330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:43.993471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:44.010992 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8dde1df8-de64-4212-a457-525f63d346e0 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.171446 Oct 11 04:20:44.016999 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1236/2581] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:43 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:44.125045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bd75b0b2-a542-404f-bbe3-62909567bb72 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:44.138042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bd75b0b2-a542-404f-bbe3-62909567bb72 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:44.151103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd75b0b2-a542-404f-bbe3-62909567bb72 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:44.157645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd75b0b2-a542-404f-bbe3-62909567bb72 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:44.160220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd75b0b2-a542-404f-bbe3-62909567bb72 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:44.161323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd75b0b2-a542-404f-bbe3-62909567bb72 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:44.162252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd75b0b2-a542-404f-bbe3-62909567bb72 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:44.163174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd75b0b2-a542-404f-bbe3-62909567bb72 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:44.432990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd75b0b2-a542-404f-bbe3-62909567bb72 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:44.443565 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bd75b0b2-a542-404f-bbe3-62909567bb72 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1285 microversion: 2.1 time: 0.325242 Oct 11 04:20:44.469484 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1237/2582] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:44 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1285 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:20:44.627591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3af1b26d-bf25-40f3-b27f-054dca8b3d0b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:44.654350 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3af1b26d-bf25-40f3-b27f-054dca8b3d0b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1325 microversion: 2.1 time: 1.283848 Oct 11 04:20:44.660125 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1346/2583] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:43 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1325 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:45.045998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:45.049267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:45.067860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:45.069966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:45.072297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:45.072297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:45.072297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:45.072791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:45.474791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92caebe8-98cc-444a-a1b5-12602879a982 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:45.475836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-92caebe8-98cc-444a-a1b5-12602879a982 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:45.491038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92caebe8-98cc-444a-a1b5-12602879a982 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:45.492894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92caebe8-98cc-444a-a1b5-12602879a982 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:45.494984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92caebe8-98cc-444a-a1b5-12602879a982 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:45.497509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92caebe8-98cc-444a-a1b5-12602879a982 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:45.498921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92caebe8-98cc-444a-a1b5-12602879a982 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:45.500758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92caebe8-98cc-444a-a1b5-12602879a982 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:45.709823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-92caebe8-98cc-444a-a1b5-12602879a982 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:45.725460 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-92caebe8-98cc-444a-a1b5-12602879a982 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1283 microversion: 2.1 time: 0.258510 Oct 11 04:20:45.743665 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1347/2584] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:45 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1283 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:45.750277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3c80324-dec2-473d-b7b9-c4f0539032eb tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:45.751184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3c80324-dec2-473d-b7b9-c4f0539032eb tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:45.769720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c80324-dec2-473d-b7b9-c4f0539032eb tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:45.771580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c80324-dec2-473d-b7b9-c4f0539032eb tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:45.773534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c80324-dec2-473d-b7b9-c4f0539032eb tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:45.775741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c80324-dec2-473d-b7b9-c4f0539032eb tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:45.776977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c80324-dec2-473d-b7b9-c4f0539032eb tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:45.778292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c80324-dec2-473d-b7b9-c4f0539032eb tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:45.917300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:45.934974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:45.939426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:45.951975 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2190297f-1823-4b2b-b681-652c21fdbcd7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.911141 Oct 11 04:20:45.959629 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1238/2585] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:45 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:46.749414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d348bf2-98f6-4e5a-a0c2-a3d87be5d80b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:46.750988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7d348bf2-98f6-4e5a-a0c2-a3d87be5d80b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:46.772930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d348bf2-98f6-4e5a-a0c2-a3d87be5d80b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:46.773792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d348bf2-98f6-4e5a-a0c2-a3d87be5d80b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:46.775171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d348bf2-98f6-4e5a-a0c2-a3d87be5d80b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:46.776059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d348bf2-98f6-4e5a-a0c2-a3d87be5d80b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:46.776535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d348bf2-98f6-4e5a-a0c2-a3d87be5d80b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:46.780102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d348bf2-98f6-4e5a-a0c2-a3d87be5d80b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:47.108972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d348bf2-98f6-4e5a-a0c2-a3d87be5d80b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:47.133676 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d348bf2-98f6-4e5a-a0c2-a3d87be5d80b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1283 microversion: 2.1 time: 0.388462 Oct 11 04:20:47.134364 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1239/2586] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:46 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1283 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:20:47.156346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:47.156970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:47.176907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:47.187088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:47.187088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:47.187088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:47.187088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:47.187088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:47.337233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:47.340988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:47.374508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:47.380934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:47.399130 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-109e9163-ac2f-4cb5-8ae0-23fcb7e7a706 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.262887 Oct 11 04:20:47.399994 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1240/2587] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:47 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:47.448829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3c80324-dec2-473d-b7b9-c4f0539032eb tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:47.470880 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3c80324-dec2-473d-b7b9-c4f0539032eb tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1325 microversion: 2.1 time: 1.714892 Oct 11 04:20:47.473902 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1348/2588] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:45 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1325 bytes in 1729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:48.162119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f30898c5-7bd1-4ff2-bfa8-00ca27b6e5d8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:48.163454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f30898c5-7bd1-4ff2-bfa8-00ca27b6e5d8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:48.171628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30898c5-7bd1-4ff2-bfa8-00ca27b6e5d8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:48.182880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30898c5-7bd1-4ff2-bfa8-00ca27b6e5d8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:48.185628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30898c5-7bd1-4ff2-bfa8-00ca27b6e5d8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:48.187691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30898c5-7bd1-4ff2-bfa8-00ca27b6e5d8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:48.194371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30898c5-7bd1-4ff2-bfa8-00ca27b6e5d8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:48.196194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30898c5-7bd1-4ff2-bfa8-00ca27b6e5d8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:48.447647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:48.454814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:48.486783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:48.488333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:48.490646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:48.526874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:48.527472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:48.527919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:48.556833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f30898c5-7bd1-4ff2-bfa8-00ca27b6e5d8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:48.566683 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f30898c5-7bd1-4ff2-bfa8-00ca27b6e5d8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1283 microversion: 2.1 time: 0.408885 Oct 11 04:20:48.586379 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1241/2589] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:48 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1283 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:48.596819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8a652020-b886-4a87-b38e-444c20b370e4 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:48.596819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8a652020-b886-4a87-b38e-444c20b370e4 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:48.624206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a652020-b886-4a87-b38e-444c20b370e4 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:48.625285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a652020-b886-4a87-b38e-444c20b370e4 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:48.626886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a652020-b886-4a87-b38e-444c20b370e4 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:48.627895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a652020-b886-4a87-b38e-444c20b370e4 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:48.631174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a652020-b886-4a87-b38e-444c20b370e4 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:48.631794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a652020-b886-4a87-b38e-444c20b370e4 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:48.783853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:48.801545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:48.801545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:48.801545 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-10e31f9e-80ee-42bc-8b70-a9d8377ffd08 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.372725 Oct 11 04:20:48.801545 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1349/2590] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:48 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:49.391279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8a652020-b886-4a87-b38e-444c20b370e4 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:49.402673 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8a652020-b886-4a87-b38e-444c20b370e4 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1325 microversion: 2.1 time: 0.814934 Oct 11 04:20:49.406678 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1242/2591] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:48 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1325 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:49.591031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af044d21-b624-4ddd-8696-8236ce9df6a5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:49.592369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af044d21-b624-4ddd-8696-8236ce9df6a5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:49.603900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:49.623275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af044d21-b624-4ddd-8696-8236ce9df6a5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:49.625484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af044d21-b624-4ddd-8696-8236ce9df6a5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:49.627027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af044d21-b624-4ddd-8696-8236ce9df6a5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:49.629660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af044d21-b624-4ddd-8696-8236ce9df6a5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:49.631240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af044d21-b624-4ddd-8696-8236ce9df6a5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:49.632693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af044d21-b624-4ddd-8696-8236ce9df6a5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:49.832418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:49.833161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:49.849120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:49.849630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:49.850054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:49.858179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:49.858700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:49.862844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:50.023368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:50.032256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:50.033787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:50.039960 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bd3091d7-c38f-4f58-8fbc-ad767ceb1b8d tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.212025 Oct 11 04:20:50.040331 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1243/2592] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:49 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:50.044716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-d6bca4b9-7056-4c58-9454-fb899b1de0f5 req-85fd9a26-ff7e-4f38-a38b-3041499083ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685f9ada-1e79-427b-abf0-a86090495d6e", "name": "network-vif-plugged", "status": "completed", "tag": "c42f6c2a-ece1-4f94-bfaf-e4f3d7a04efe"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:50.055534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d6bca4b9-7056-4c58-9454-fb899b1de0f5 req-85fd9a26-ff7e-4f38-a38b-3041499083ba service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:50.056294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d6bca4b9-7056-4c58-9454-fb899b1de0f5 req-85fd9a26-ff7e-4f38-a38b-3041499083ba service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:50.056958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d6bca4b9-7056-4c58-9454-fb899b1de0f5 req-85fd9a26-ff7e-4f38-a38b-3041499083ba service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:50.080303 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-d6bca4b9-7056-4c58-9454-fb899b1de0f5 req-85fd9a26-ff7e-4f38-a38b-3041499083ba service nova] Creating event network-vif-plugged:c42f6c2a-ece1-4f94-bfaf-e4f3d7a04efe for instance 685f9ada-1e79-427b-abf0-a86090495d6e on n-h1-860892-1 Oct 11 04:20:50.087223 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-d6bca4b9-7056-4c58-9454-fb899b1de0f5 req-85fd9a26-ff7e-4f38-a38b-3041499083ba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045700 Oct 11 04:20:50.088156 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1244/2593] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:50.436657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bdb83e42-a3cf-48c8-b531-83f3652b56ea tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:50.438232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bdb83e42-a3cf-48c8-b531-83f3652b56ea tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:50.467736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb83e42-a3cf-48c8-b531-83f3652b56ea tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:50.468566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb83e42-a3cf-48c8-b531-83f3652b56ea tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:50.469314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb83e42-a3cf-48c8-b531-83f3652b56ea tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:50.475377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb83e42-a3cf-48c8-b531-83f3652b56ea tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:50.476158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb83e42-a3cf-48c8-b531-83f3652b56ea tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:50.479578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdb83e42-a3cf-48c8-b531-83f3652b56ea tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:50.553238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-af044d21-b624-4ddd-8696-8236ce9df6a5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:50.565726 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af044d21-b624-4ddd-8696-8236ce9df6a5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1325 microversion: 2.1 time: 0.978983 Oct 11 04:20:50.582598 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1350/2594] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:49 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1325 bytes in 996 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:20:51.074281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:51.076302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:51.101438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:51.102995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:51.103665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:51.104602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:51.106618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:51.107295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:51.167100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bdb83e42-a3cf-48c8-b531-83f3652b56ea tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:51.178506 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bdb83e42-a3cf-48c8-b531-83f3652b56ea tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1325 microversion: 2.1 time: 0.750411 Oct 11 04:20:51.181510 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1245/2595] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:50 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1325 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:51.362624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:51.374783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:51.376266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:51.395785 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-52af3a1e-9200-4c33-a69d-ce5b3d3d26a5 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.326612 Oct 11 04:20:51.396402 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1351/2596] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:51 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:51.589339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ea634ef4-1d97-4a6f-9726-8b892c5670dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:51.590792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ea634ef4-1d97-4a6f-9726-8b892c5670dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:51.607353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea634ef4-1d97-4a6f-9726-8b892c5670dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:51.608119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea634ef4-1d97-4a6f-9726-8b892c5670dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:51.608712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea634ef4-1d97-4a6f-9726-8b892c5670dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:51.609572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea634ef4-1d97-4a6f-9726-8b892c5670dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:51.610157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea634ef4-1d97-4a6f-9726-8b892c5670dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:51.612774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea634ef4-1d97-4a6f-9726-8b892c5670dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:51.979224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea634ef4-1d97-4a6f-9726-8b892c5670dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:51.992072 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ea634ef4-1d97-4a6f-9726-8b892c5670dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1325 microversion: 2.1 time: 0.406530 Oct 11 04:20:51.999690 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1246/2597] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:51 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1325 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:52.201016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4b0067bd-0d9e-42cc-b2d6-fda987a41cba tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:52.201648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4b0067bd-0d9e-42cc-b2d6-fda987a41cba tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:52.203606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=10 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:52.223190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b0067bd-0d9e-42cc-b2d6-fda987a41cba tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:52.223590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b0067bd-0d9e-42cc-b2d6-fda987a41cba tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:52.224036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b0067bd-0d9e-42cc-b2d6-fda987a41cba tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:52.224716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b0067bd-0d9e-42cc-b2d6-fda987a41cba tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:52.225171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b0067bd-0d9e-42cc-b2d6-fda987a41cba tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:52.225595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b0067bd-0d9e-42cc-b2d6-fda987a41cba tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:52.428126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:52.428777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:52.437592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:52.437592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:52.437890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:52.438597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:52.439061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:52.439486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:52.539378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4b0067bd-0d9e-42cc-b2d6-fda987a41cba tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:52.545894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:52.554617 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4b0067bd-0d9e-42cc-b2d6-fda987a41cba tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1325 microversion: 2.1 time: 0.357704 Oct 11 04:20:52.558099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:52.558644 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1352/2598] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:52 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1325 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:52.558745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:52.562255 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5d03664d-b4a8-4f91-b4de-a53f482e59b9 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.138057 Oct 11 04:20:52.562817 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1247/2599] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:52 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:52.980382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-149a88dd-3868-45c5-bb84-c864bed4e48d req-d39155ff-2321-4696-8c82-8baf4bd969f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "431a0a90-2f88-49fb-bf06-b292938d2258", "tag": "84317dc1-349f-48b2-8f9f-0cba797f33c5"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:20:53.002611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-149a88dd-3868-45c5-bb84-c864bed4e48d req-d39155ff-2321-4696-8c82-8baf4bd969f4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:53.003102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-149a88dd-3868-45c5-bb84-c864bed4e48d req-d39155ff-2321-4696-8c82-8baf4bd969f4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:53.003830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-149a88dd-3868-45c5-bb84-c864bed4e48d req-d39155ff-2321-4696-8c82-8baf4bd969f4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:53.019573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31d9ccf9-5d06-4dc5-a9d5-c5ca4fd95c19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:53.020756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-31d9ccf9-5d06-4dc5-a9d5-c5ca4fd95c19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:53.029117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31d9ccf9-5d06-4dc5-a9d5-c5ca4fd95c19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:53.029958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31d9ccf9-5d06-4dc5-a9d5-c5ca4fd95c19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:53.030652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31d9ccf9-5d06-4dc5-a9d5-c5ca4fd95c19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:53.031738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31d9ccf9-5d06-4dc5-a9d5-c5ca4fd95c19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:53.032455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31d9ccf9-5d06-4dc5-a9d5-c5ca4fd95c19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:53.033093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31d9ccf9-5d06-4dc5-a9d5-c5ca4fd95c19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:53.041061 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-149a88dd-3868-45c5-bb84-c864bed4e48d req-d39155ff-2321-4696-8c82-8baf4bd969f4 service nova] Creating event network-changed:84317dc1-349f-48b2-8f9f-0cba797f33c5 for instance 431a0a90-2f88-49fb-bf06-b292938d2258 on n-h2-860892-1 Oct 11 04:20:53.061966 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-149a88dd-3868-45c5-bb84-c864bed4e48d req-d39155ff-2321-4696-8c82-8baf4bd969f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077422 Oct 11 04:20:53.061966 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1353/2600] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:20:53.592537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-31d9ccf9-5d06-4dc5-a9d5-c5ca4fd95c19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:53.612105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b395e486-da9e-40b4-a20b-f93cf8a81a1e tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:53.614504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b395e486-da9e-40b4-a20b-f93cf8a81a1e tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:53.637333 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-31d9ccf9-5d06-4dc5-a9d5-c5ca4fd95c19 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1325 microversion: 2.1 time: 0.619528 Oct 11 04:20:53.638355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1248/2601] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:53 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1325 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:20:53.639925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b395e486-da9e-40b4-a20b-f93cf8a81a1e tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:53.639925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b395e486-da9e-40b4-a20b-f93cf8a81a1e tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:53.643815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b395e486-da9e-40b4-a20b-f93cf8a81a1e tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:53.645700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b395e486-da9e-40b4-a20b-f93cf8a81a1e tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:53.646438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b395e486-da9e-40b4-a20b-f93cf8a81a1e tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:53.647271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b395e486-da9e-40b4-a20b-f93cf8a81a1e tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:53.655770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:53.656679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:53.679135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:53.680090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:53.680799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:53.683910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:53.684645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:53.686055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:53.782861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:53.798540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:53.803423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:53.805728 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2cef6137-d7b1-4c7d-b0cd-7589fe88f996 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.162768 Oct 11 04:20:53.806326 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1249/2602] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:53 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:54.027182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b395e486-da9e-40b4-a20b-f93cf8a81a1e tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:54.038480 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b395e486-da9e-40b4-a20b-f93cf8a81a1e tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1325 microversion: 2.1 time: 0.460805 Oct 11 04:20:54.039661 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1354/2603] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:53 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1325 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:54.666960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-14b9c526-d058-44b1-b1ec-761558c35547 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:54.667572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-14b9c526-d058-44b1-b1ec-761558c35547 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:54.681238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14b9c526-d058-44b1-b1ec-761558c35547 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:54.681728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14b9c526-d058-44b1-b1ec-761558c35547 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:54.682222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14b9c526-d058-44b1-b1ec-761558c35547 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:54.682940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14b9c526-d058-44b1-b1ec-761558c35547 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:54.683388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14b9c526-d058-44b1-b1ec-761558c35547 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:54.687580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14b9c526-d058-44b1-b1ec-761558c35547 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:54.836055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:54.836830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:54.850222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:54.851840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:54.856292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:54.857512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:54.859263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:54.862905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:54.985940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:54.994813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:54.996128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:55.014171 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-27624d8e-31f0-4560-b5e8-c950db4e328e tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.177588 Oct 11 04:20:55.014850 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1355/2604] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:54 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:20:55.061398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90b137ef-e666-4a98-a356-be69a2858fab tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:55.062095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90b137ef-e666-4a98-a356-be69a2858fab tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:55.069031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b137ef-e666-4a98-a356-be69a2858fab tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:55.076252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b137ef-e666-4a98-a356-be69a2858fab tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:55.076708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b137ef-e666-4a98-a356-be69a2858fab tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:55.077545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b137ef-e666-4a98-a356-be69a2858fab tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:55.083096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b137ef-e666-4a98-a356-be69a2858fab tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:55.083548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b137ef-e666-4a98-a356-be69a2858fab tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:55.114356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-14b9c526-d058-44b1-b1ec-761558c35547 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:55.126922 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-14b9c526-d058-44b1-b1ec-761558c35547 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1325 microversion: 2.1 time: 0.464609 Oct 11 04:20:55.128217 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1250/2605] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:54 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1325 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:55.437973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-90b137ef-e666-4a98-a356-be69a2858fab tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:55.450408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:55.463359 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90b137ef-e666-4a98-a356-be69a2858fab tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1523 microversion: 2.1 time: 0.401895 Oct 11 04:20:55.463359 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1356/2606] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:55 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1523 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:55.493581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:55.494136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:55.505166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:55.505669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:55.506116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:55.506871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:55.507356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:55.507787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:55.576990 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] HTTP exception thrown: Action 999 not found Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Request method failure captured: Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e/os-instance-actions/999 HTTP/1.1 Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO8Iyw2V74zBdoplxxbBq5baWznVqN0Nz2cXoijCXgKLQX4fIoSaLqTybuKptqu_-i1FziCSWsUwmSt4Y9nh1YZNudM7BHagNJqBefb_IdSf74_Q27eIMcQQyMaxVSAidytwUIzOo6Qa6k2cT6drWyeqf9XCu8vPwL7NgdoR4tG34Js Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d24fdcc8532f4b72b6e4acda76107070 Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1895604979 Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d24fdcc8532f4b72b6e4acda76107070"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d24fdcc8532f4b72b6e4acda76107070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24fdcc8532f4b72b6e4acda76107070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24fdcc8532f4b72b6e4acda76107070"}]}] Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1895604979 Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d24fdcc8532f4b72b6e4acda76107070 Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1895604979 Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-InstanceActionsNegativeTestJSON-1895604979-project Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a929a7aa51a449d798464c2ee2f36c2c Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1895604979-project Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: exception: Action 999 not found Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': '685f9ada-1e79-427b-abf0-a86090495d6e', 'id': '999'} Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 152, in show Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Action 999 not found Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Action 999 not found Oct 11 04:20:55.583941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:20:55.588004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Returning 404 to user: Action 999 not found {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:55.588004 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ac516f2a-c5f1-47be-a79b-3dcf2df9adfa tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e/os-instance-actions/999" status: 404 len: 66 microversion: 2.1 time: 0.101044 Oct 11 04:20:55.588004 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1251/2607] 10.222.0.26 () {58 vars in 1308 bytes} [Tue Oct 11 04:20:55 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e/os-instance-actions/999 => generated 66 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:20:55.597572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ac943d7b-e886-410f-82ac-2ec384130c03 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '.version_select at 0x7fda19b039d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:55.598146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ac943d7b-e886-410f-82ac-2ec384130c03 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: d81b1e62-0cd6-43f3-8e26-482f5ed3a0a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:55.603824 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ac943d7b-e886-410f-82ac-2ec384130c03 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] HTTP exception thrown: Instance d81b1e62-0cd6-43f3-8e26-482f5ed3a0a0 could not be found. Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ac943d7b-e886-410f-82ac-2ec384130c03 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Request method failure captured: Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/d81b1e62-0cd6-43f3-8e26-482f5ed3a0a0/os-instance-actions HTTP/1.1 Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO8Iyw2V74zBdoplxxbBq5baWznVqN0Nz2cXoijCXgKLQX4fIoSaLqTybuKptqu_-i1FziCSWsUwmSt4Y9nh1YZNudM7BHagNJqBefb_IdSf74_Q27eIMcQQyMaxVSAidytwUIzOo6Qa6k2cT6drWyeqf9XCu8vPwL7NgdoR4tG34Js Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d24fdcc8532f4b72b6e4acda76107070 Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1895604979 Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d24fdcc8532f4b72b6e4acda76107070"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d24fdcc8532f4b72b6e4acda76107070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24fdcc8532f4b72b6e4acda76107070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24fdcc8532f4b72b6e4acda76107070"}]}] Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1895604979 Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d24fdcc8532f4b72b6e4acda76107070 Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1895604979 Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-InstanceActionsNegativeTestJSON-1895604979-project Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a929a7aa51a449d798464c2ee2f36c2c Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1895604979-project Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance d81b1e62-0cd6-43f3-8e26-482f5ed3a0a0 could not be found. Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'server_id': 'd81b1e62-0cd6-43f3-8e26-482f5ed3a0a0'} Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d81b1e62-0cd6-43f3-8e26-482f5ed3a0a0 could not be found. Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 89, in index Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(req, context, server_id) Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/instance_actions.py", line 77, in _get_instance Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return common.get_instance(self.compute_api, context, server_id) Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:20:55.605744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d81b1e62-0cd6-43f3-8e26-482f5ed3a0a0 could not be found. Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d81b1e62-0cd6-43f3-8e26-482f5ed3a0a0 could not be found. Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ac943d7b-e886-410f-82ac-2ec384130c03 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Returning 404 to user: Instance d81b1e62-0cd6-43f3-8e26-482f5ed3a0a0 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:20:55.610613 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ac943d7b-e886-410f-82ac-2ec384130c03 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/d81b1e62-0cd6-43f3-8e26-482f5ed3a0a0/os-instance-actions" status: 404 len: 111 microversion: 2.1 time: 0.014886 Oct 11 04:20:55.612517 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1357/2608] 10.222.0.26 () {58 vars in 1296 bytes} [Tue Oct 11 04:20:55 2022] GET /compute/v2.1/servers/d81b1e62-0cd6-43f3-8e26-482f5ed3a0a0/os-instance-actions => generated 111 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:20:55.618365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8bd2c95d-2b72-4ab2-b36b-a7b35cdea197 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:55.618960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8bd2c95d-2b72-4ab2-b36b-a7b35cdea197 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:55.625143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd2c95d-2b72-4ab2-b36b-a7b35cdea197 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:55.626936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd2c95d-2b72-4ab2-b36b-a7b35cdea197 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:55.627043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd2c95d-2b72-4ab2-b36b-a7b35cdea197 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:55.627916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd2c95d-2b72-4ab2-b36b-a7b35cdea197 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:55.628702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd2c95d-2b72-4ab2-b36b-a7b35cdea197 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:55.629560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd2c95d-2b72-4ab2-b36b-a7b35cdea197 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:55.657678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8bd2c95d-2b72-4ab2-b36b-a7b35cdea197 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:20:56.052970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:56.053590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:56.065333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:56.066076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:56.066714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:56.067607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:56.069791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:56.077328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:56.082129 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8bd2c95d-2b72-4ab2-b36b-a7b35cdea197 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "DELETE /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 204 len: 0 microversion: 2.1 time: 0.468200 Oct 11 04:20:56.097777 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1252/2609] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:20:55 2022] DELETE /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 0 bytes in 477 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:20:56.107522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c02967c9-e6b8-40ca-9753-abe3326fb39b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:56.108465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c02967c9-e6b8-40ca-9753-abe3326fb39b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:56.117503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c02967c9-e6b8-40ca-9753-abe3326fb39b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:56.117990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c02967c9-e6b8-40ca-9753-abe3326fb39b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:56.121131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c02967c9-e6b8-40ca-9753-abe3326fb39b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:56.122663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c02967c9-e6b8-40ca-9753-abe3326fb39b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:56.123749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c02967c9-e6b8-40ca-9753-abe3326fb39b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:56.125344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c02967c9-e6b8-40ca-9753-abe3326fb39b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:56.275735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:56.296356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:56.297843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:56.309077 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-478245f3-221b-45a8-b7fe-5596984b0035 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.263870 Oct 11 04:20:56.314020 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1358/2610] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:56 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:56.338580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eba0ce2a-0ea1-4c38-8de4-d1337de91d11 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:56.342233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eba0ce2a-0ea1-4c38-8de4-d1337de91d11 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:56.348629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eba0ce2a-0ea1-4c38-8de4-d1337de91d11 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:56.349773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eba0ce2a-0ea1-4c38-8de4-d1337de91d11 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:56.350727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eba0ce2a-0ea1-4c38-8de4-d1337de91d11 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:56.351625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eba0ce2a-0ea1-4c38-8de4-d1337de91d11 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:56.352230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eba0ce2a-0ea1-4c38-8de4-d1337de91d11 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:56.352804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eba0ce2a-0ea1-4c38-8de4-d1337de91d11 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:56.621482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eba0ce2a-0ea1-4c38-8de4-d1337de91d11 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:56.636777 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eba0ce2a-0ea1-4c38-8de4-d1337de91d11 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1325 microversion: 2.1 time: 0.320749 Oct 11 04:20:56.638752 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1359/2611] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:56 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1325 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:57.027893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c02967c9-e6b8-40ca-9753-abe3326fb39b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:57.036621 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c02967c9-e6b8-40ca-9753-abe3326fb39b tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1529 microversion: 2.1 time: 0.936001 Oct 11 04:20:57.037590 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1253/2612] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:56 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1529 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:20:57.344662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:57.345292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:57.352902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:57.353397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:57.354023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:57.354798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:57.355445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:57.355878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:57.437546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:57.448557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:57.450375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:57.457083 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-218966f7-2c2e-418f-8502-3f271d1cea21 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.116859 Oct 11 04:20:57.457680 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1360/2613] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:57 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:57.662806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-83adaab2-df4c-441c-906f-fdf63c01971d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:57.663518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-83adaab2-df4c-441c-906f-fdf63c01971d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:57.669976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83adaab2-df4c-441c-906f-fdf63c01971d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:57.670487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83adaab2-df4c-441c-906f-fdf63c01971d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:57.670929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83adaab2-df4c-441c-906f-fdf63c01971d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:57.671622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83adaab2-df4c-441c-906f-fdf63c01971d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:57.672103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83adaab2-df4c-441c-906f-fdf63c01971d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:57.673120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83adaab2-df4c-441c-906f-fdf63c01971d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:57.801903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-83adaab2-df4c-441c-906f-fdf63c01971d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:57.809647 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-83adaab2-df4c-441c-906f-fdf63c01971d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1325 microversion: 2.1 time: 0.150691 Oct 11 04:20:57.810281 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1254/2614] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:57 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1325 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:58.067882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9faeefdb-e21c-4e6a-90a7-d0d740cb7c54 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:58.070889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9faeefdb-e21c-4e6a-90a7-d0d740cb7c54 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:58.099031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9faeefdb-e21c-4e6a-90a7-d0d740cb7c54 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:58.100765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9faeefdb-e21c-4e6a-90a7-d0d740cb7c54 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:58.102332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9faeefdb-e21c-4e6a-90a7-d0d740cb7c54 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:58.103296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9faeefdb-e21c-4e6a-90a7-d0d740cb7c54 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:58.103981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9faeefdb-e21c-4e6a-90a7-d0d740cb7c54 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:58.105137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9faeefdb-e21c-4e6a-90a7-d0d740cb7c54 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:58.389729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9faeefdb-e21c-4e6a-90a7-d0d740cb7c54 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:58.403811 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9faeefdb-e21c-4e6a-90a7-d0d740cb7c54 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1529 microversion: 2.1 time: 0.343085 Oct 11 04:20:58.406218 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1361/2615] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:58 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1529 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:58.486296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:58.487165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:58.495817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:58.496549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:58.497134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:58.498736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:58.499363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:58.499990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:58.658352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:58.674852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:58.679370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:58.705073 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ad719261-87ae-47c7-87bb-34bfdd53b33b tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.222580 Oct 11 04:20:58.708553 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1255/2616] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:58 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:20:58.834447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31e21741-e36a-41a1-b26a-e746e18802c1 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:58.835594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31e21741-e36a-41a1-b26a-e746e18802c1 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:58.843073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e21741-e36a-41a1-b26a-e746e18802c1 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:58.844016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e21741-e36a-41a1-b26a-e746e18802c1 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:58.844782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e21741-e36a-41a1-b26a-e746e18802c1 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:58.845853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e21741-e36a-41a1-b26a-e746e18802c1 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:58.846620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e21741-e36a-41a1-b26a-e746e18802c1 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:58.847382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e21741-e36a-41a1-b26a-e746e18802c1 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:59.080453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-31e21741-e36a-41a1-b26a-e746e18802c1 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:59.090908 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31e21741-e36a-41a1-b26a-e746e18802c1 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1325 microversion: 2.1 time: 0.261670 Oct 11 04:20:59.091478 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1362/2617] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:58 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1325 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:20:59.433931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-50cbb9a1-bd22-48db-99c8-e51a37f7801a tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:59.435127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-50cbb9a1-bd22-48db-99c8-e51a37f7801a tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:59.459253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50cbb9a1-bd22-48db-99c8-e51a37f7801a tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:59.461257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50cbb9a1-bd22-48db-99c8-e51a37f7801a tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:59.462443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50cbb9a1-bd22-48db-99c8-e51a37f7801a tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:59.464595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50cbb9a1-bd22-48db-99c8-e51a37f7801a tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:59.466065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50cbb9a1-bd22-48db-99c8-e51a37f7801a tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:59.469051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50cbb9a1-bd22-48db-99c8-e51a37f7801a tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:59.506606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:59.734946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:20:59.736198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:20:59.743040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:20:59.745149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:59.745855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:59.746841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:59.747734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:20:59.748390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:20:59.748966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:20:59.907616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:59.917301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:59.923452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:20:59.931786 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fae36913-8367-4822-95be-a1b998bedd82 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.201171 Oct 11 04:20:59.946884 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1363/2618] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:20:59 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:21:00.119746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90065027-2dbb-4fc1-8381-96fe2493f25a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:00.120717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90065027-2dbb-4fc1-8381-96fe2493f25a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:00.137405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90065027-2dbb-4fc1-8381-96fe2493f25a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:00.137658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90065027-2dbb-4fc1-8381-96fe2493f25a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:00.138329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90065027-2dbb-4fc1-8381-96fe2493f25a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:00.139042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90065027-2dbb-4fc1-8381-96fe2493f25a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:00.139667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90065027-2dbb-4fc1-8381-96fe2493f25a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:00.140101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90065027-2dbb-4fc1-8381-96fe2493f25a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:00.408805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-90065027-2dbb-4fc1-8381-96fe2493f25a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:00.430285 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90065027-2dbb-4fc1-8381-96fe2493f25a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1325 microversion: 2.1 time: 0.302515 Oct 11 04:21:00.431304 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1364/2619] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:00 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1325 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:00.520415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-50cbb9a1-bd22-48db-99c8-e51a37f7801a tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:00.529973 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-50cbb9a1-bd22-48db-99c8-e51a37f7801a tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1529 microversion: 2.1 time: 1.102839 Oct 11 04:21:00.530638 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1256/2620] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:20:59 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1529 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:00.804077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f610586b-7a4f-4070-963b-2daf97ea640c req-54f2927a-2093-4b10-92af-4ef9823415e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431a0a90-2f88-49fb-bf06-b292938d2258", "name": "network-vif-plugged", "status": "completed", "tag": "84317dc1-349f-48b2-8f9f-0cba797f33c5"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:00.814706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f610586b-7a4f-4070-963b-2daf97ea640c req-54f2927a-2093-4b10-92af-4ef9823415e7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:00.815161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f610586b-7a4f-4070-963b-2daf97ea640c req-54f2927a-2093-4b10-92af-4ef9823415e7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:00.815768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f610586b-7a4f-4070-963b-2daf97ea640c req-54f2927a-2093-4b10-92af-4ef9823415e7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:00.827659 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-f610586b-7a4f-4070-963b-2daf97ea640c req-54f2927a-2093-4b10-92af-4ef9823415e7 service nova] Creating event network-vif-plugged:84317dc1-349f-48b2-8f9f-0cba797f33c5 for instance 431a0a90-2f88-49fb-bf06-b292938d2258 on n-h2-860892-1 Oct 11 04:21:00.833505 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f610586b-7a4f-4070-963b-2daf97ea640c req-54f2927a-2093-4b10-92af-4ef9823415e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033541 Oct 11 04:21:00.834135 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1365/2621] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:00.960959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:00.961850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:00.975959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:00.976455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:00.976897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:00.977670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:00.978118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:00.978731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:01.226120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:01.236413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:01.238889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:01.248032 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-819056b5-a72e-43c5-a2ce-77e23a9e6385 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1540 microversion: 2.91 time: 0.289683 Oct 11 04:21:01.248551 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1257/2622] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:21:00 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1540 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:21:01.443046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-22155887-48bf-45e0-a70e-ad2435daeff2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:01.443665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-22155887-48bf-45e0-a70e-ad2435daeff2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:01.457860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22155887-48bf-45e0-a70e-ad2435daeff2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:01.458284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22155887-48bf-45e0-a70e-ad2435daeff2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:01.458723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22155887-48bf-45e0-a70e-ad2435daeff2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:01.459427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22155887-48bf-45e0-a70e-ad2435daeff2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:01.459874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22155887-48bf-45e0-a70e-ad2435daeff2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:01.460578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22155887-48bf-45e0-a70e-ad2435daeff2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:01.771352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-68daf8b2-d40d-4c31-8019-beb148f60637 req-cf4b4b40-bb8b-4972-a3a9-f992afa30f74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "685f9ada-1e79-427b-abf0-a86090495d6e", "name": "network-vif-deleted", "tag": "c42f6c2a-ece1-4f94-bfaf-e4f3d7a04efe"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:01.804843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-68daf8b2-d40d-4c31-8019-beb148f60637 req-cf4b4b40-bb8b-4972-a3a9-f992afa30f74 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:01.805491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-68daf8b2-d40d-4c31-8019-beb148f60637 req-cf4b4b40-bb8b-4972-a3a9-f992afa30f74 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:01.805764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-68daf8b2-d40d-4c31-8019-beb148f60637 req-cf4b4b40-bb8b-4972-a3a9-f992afa30f74 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:01.840401 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-68daf8b2-d40d-4c31-8019-beb148f60637 req-cf4b4b40-bb8b-4972-a3a9-f992afa30f74 service nova] Creating event network-vif-deleted:c42f6c2a-ece1-4f94-bfaf-e4f3d7a04efe for instance 685f9ada-1e79-427b-abf0-a86090495d6e on n-h1-860892-1 Oct 11 04:21:01.850421 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-68daf8b2-d40d-4c31-8019-beb148f60637 req-cf4b4b40-bb8b-4972-a3a9-f992afa30f74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.460120 Oct 11 04:21:01.853158 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1366/2623] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:01.867481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:01.868193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:01.891543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:01.892050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:01.892496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:01.902566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:01.903296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:01.903896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:01.987299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:01.988000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:01.988600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:01.989237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lazy-loading 'fault' on Instance uuid 685f9ada-1e79-427b-abf0-a86090495d6e {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:21:02.148180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-22155887-48bf-45e0-a70e-ad2435daeff2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:02.167663 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-22155887-48bf-45e0-a70e-ad2435daeff2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1325 microversion: 2.1 time: 0.728573 Oct 11 04:21:02.182620 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1258/2624] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:01 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1325 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:02.192397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a929a7aa51a449d798464c2ee2f36c2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd24fdcc8532f4b72b6e4acda76107070', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:02.223946 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-14908922-c541-42aa-821c-635e08a49ebe tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 200 len: 1315 microversion: 2.1 time: 0.358279 Oct 11 04:21:02.230525 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1367/2625] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:01 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 1315 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:02.280043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:02.280673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:02.295946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:02.296446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:02.296884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:02.298142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:02.298613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:02.299034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:02.553352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:02.567310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:02.586397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:02.605378 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-985dc373-cd1a-46d1-9760-0a71c8cb3d8c tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1527 microversion: 2.91 time: 0.330549 Oct 11 04:21:02.609111 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1259/2626] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:21:02 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1527 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:21:02.637898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-548fd2fb-6b69-4126-b3f4-aff31ec98d59 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:02.638604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-548fd2fb-6b69-4126-b3f4-aff31ec98d59 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:02.655733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-548fd2fb-6b69-4126-b3f4-aff31ec98d59 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:02.658230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-548fd2fb-6b69-4126-b3f4-aff31ec98d59 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:02.658230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-548fd2fb-6b69-4126-b3f4-aff31ec98d59 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:02.659382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-548fd2fb-6b69-4126-b3f4-aff31ec98d59 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:02.661353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-548fd2fb-6b69-4126-b3f4-aff31ec98d59 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:02.661857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-548fd2fb-6b69-4126-b3f4-aff31ec98d59 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:03.204936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f5df31f1-06f3-49f8-bc98-9c6476e19095 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:03.206422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f5df31f1-06f3-49f8-bc98-9c6476e19095 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:03.214019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5df31f1-06f3-49f8-bc98-9c6476e19095 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:03.214875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5df31f1-06f3-49f8-bc98-9c6476e19095 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:03.215527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5df31f1-06f3-49f8-bc98-9c6476e19095 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:03.216612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5df31f1-06f3-49f8-bc98-9c6476e19095 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:03.217281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5df31f1-06f3-49f8-bc98-9c6476e19095 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:03.218064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5df31f1-06f3-49f8-bc98-9c6476e19095 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:03.312527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-548fd2fb-6b69-4126-b3f4-aff31ec98d59 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] Lazy-loading 'services' on Instance uuid 08029265-88c6-4b4a-bbff-1dc995bd902f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:21:03.351148 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-548fd2fb-6b69-4126-b3f4-aff31ec98d59 tempest-UnshelveToHostMultiNodesTest-1521680170 tempest-UnshelveToHostMultiNodesTest-1521680170-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1932 microversion: 2.91 time: 0.717064 Oct 11 04:21:03.352920 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1368/2627] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:21:02 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1932 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:21:03.363578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:03.364490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] [instance: 685f9ada-1e79-427b-abf0-a86090495d6e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:03.374704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:03.376512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:03.377170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:03.378129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:03.379378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:03.380874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:03.416273 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] HTTP exception thrown: Instance 685f9ada-1e79-427b-abf0-a86090495d6e could not be found. Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Request method failure captured: Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e HTTP/1.1 Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO8Iyw2V74zBdoplxxbBq5baWznVqN0Nz2cXoijCXgKLQX4fIoSaLqTybuKptqu_-i1FziCSWsUwmSt4Y9nh1YZNudM7BHagNJqBefb_IdSf74_Q27eIMcQQyMaxVSAidytwUIzOo6Qa6k2cT6drWyeqf9XCu8vPwL7NgdoR4tG34Js Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d24fdcc8532f4b72b6e4acda76107070 Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-InstanceActionsNegativeTestJSON-1895604979 Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d24fdcc8532f4b72b6e4acda76107070"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d24fdcc8532f4b72b6e4acda76107070"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24fdcc8532f4b72b6e4acda76107070"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d24fdcc8532f4b72b6e4acda76107070"}]}] Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-InstanceActionsNegativeTestJSON-1895604979 Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d24fdcc8532f4b72b6e4acda76107070 Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-InstanceActionsNegativeTestJSON-1895604979 Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-InstanceActionsNegativeTestJSON-1895604979-project Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a929a7aa51a449d798464c2ee2f36c2c Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-InstanceActionsNegativeTestJSON-1895604979-project Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 685f9ada-1e79-427b-abf0-a86090495d6e could not be found. Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '685f9ada-1e79-427b-abf0-a86090495d6e'} Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 685f9ada-1e79-427b-abf0-a86090495d6e could not be found. Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 685f9ada-1e79-427b-abf0-a86090495d6e could not be found. Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:03.419250 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:03.426051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:03.426051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:03.426051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:03.426051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:03.426051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:21:03.426051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:21:03.426051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 685f9ada-1e79-427b-abf0-a86090495d6e could not be found. Oct 11 04:21:03.426051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:03.426051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] Returning 404 to user: Instance 685f9ada-1e79-427b-abf0-a86090495d6e could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:03.426051 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3c37203e-d6f1-400e-8cb9-7523f0acbf27 tempest-InstanceActionsNegativeTestJSON-1895604979 tempest-InstanceActionsNegativeTestJSON-1895604979-project] 10.222.0.26 "GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e" status: 404 len: 111 microversion: 2.1 time: 0.066985 Oct 11 04:21:03.432667 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1369/2628] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:03 2022] GET /compute/v2.1/servers/685f9ada-1e79-427b-abf0-a86090495d6e => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:21:03.442349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-313eb023-d4b8-4e78-93da-f5695adedf64 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:03.443516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-313eb023-d4b8-4e78-93da-f5695adedf64 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:03.453507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-313eb023-d4b8-4e78-93da-f5695adedf64 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:03.454843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-313eb023-d4b8-4e78-93da-f5695adedf64 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:03.461943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-313eb023-d4b8-4e78-93da-f5695adedf64 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:03.461943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-313eb023-d4b8-4e78-93da-f5695adedf64 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:03.461943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-313eb023-d4b8-4e78-93da-f5695adedf64 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:03.461943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-313eb023-d4b8-4e78-93da-f5695adedf64 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:03.537617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-313eb023-d4b8-4e78-93da-f5695adedf64 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:21:03.548453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5df31f1-06f3-49f8-bc98-9c6476e19095 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:03.565118 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f5df31f1-06f3-49f8-bc98-9c6476e19095 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1521 microversion: 2.1 time: 0.364078 Oct 11 04:21:03.567360 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1260/2629] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:03 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:03.590440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-14802067-91c3-46c5-926c-e4ed1ade58e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:03.591064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-14802067-91c3-46c5-926c-e4ed1ade58e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:03.615714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14802067-91c3-46c5-926c-e4ed1ade58e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:03.616269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14802067-91c3-46c5-926c-e4ed1ade58e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:03.616713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14802067-91c3-46c5-926c-e4ed1ade58e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:03.618962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14802067-91c3-46c5-926c-e4ed1ade58e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:03.619660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14802067-91c3-46c5-926c-e4ed1ade58e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:03.622866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14802067-91c3-46c5-926c-e4ed1ade58e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:04.131934 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-313eb023-d4b8-4e78-93da-f5695adedf64 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "DELETE /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 204 len: 0 microversion: 2.91 time: 0.697593 Oct 11 04:21:04.134308 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1370/2630] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:21:03 2022] DELETE /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 0 bytes in 699 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:21:04.151331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-14802067-91c3-46c5-926c-e4ed1ade58e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:04.163052 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-14802067-91c3-46c5-926c-e4ed1ade58e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1521 microversion: 2.1 time: 0.576516 Oct 11 04:21:04.164403 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1261/2631] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:03 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1521 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:04.166301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:04.169295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:04.189388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:04.190161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b30bc529-e52b-4338-b688-a867be856f3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1014271815", "metadata": {"": ""}}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:04.194751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:04.195577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:04.196557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b30bc529-e52b-4338-b688-a867be856f3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action HTTP/1.1 Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 107 Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1014271815", "metadata": {"": ""}}} Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '431a0a90-2f88-49fb-bf06-b292938d2258', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1014271815', 'metadata': {'': ''}}}} Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'': ''} Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:04.197157 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b30bc529-e52b-4338-b688-a867be856f3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': ''}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:04.201326 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b30bc529-e52b-4338-b688-a867be856f3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action" status: 400 len: 170 microversion: 2.1 time: 0.013119 Oct 11 04:21:04.203130 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1262/2632] 10.222.0.26 () {60 vars in 1279 bytes} [Tue Oct 11 04:21:04 2022] POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action => generated 170 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:21:04.204203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:04.205730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:04.207481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1a804993-103a-49e9-a6d6-1e150d20d785 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:04.208098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1a804993-103a-49e9-a6d6-1e150d20d785 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:04.224047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a804993-103a-49e9-a6d6-1e150d20d785 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:04.224473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a804993-103a-49e9-a6d6-1e150d20d785 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:04.225109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a804993-103a-49e9-a6d6-1e150d20d785 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:04.229525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a804993-103a-49e9-a6d6-1e150d20d785 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:04.230391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a804993-103a-49e9-a6d6-1e150d20d785 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:04.231012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a804993-103a-49e9-a6d6-1e150d20d785 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:04.399933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:04.415149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:04.418019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:04.430439 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-030148a1-90cc-4f8c-89a0-df57e72a2c81 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.291361 Oct 11 04:21:04.446226 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1371/2633] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:21:04 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:21:05.053426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1a804993-103a-49e9-a6d6-1e150d20d785 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:05.065839 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1a804993-103a-49e9-a6d6-1e150d20d785 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1521 microversion: 2.1 time: 0.860577 Oct 11 04:21:05.083607 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1263/2634] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:04 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1521 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:05.096636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e2e6938-acc2-47bc-9574-91eb538c28ac tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:05.097382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e2e6938-acc2-47bc-9574-91eb538c28ac tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:05.124748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2e6938-acc2-47bc-9574-91eb538c28ac tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:05.131197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2e6938-acc2-47bc-9574-91eb538c28ac tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:05.134662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2e6938-acc2-47bc-9574-91eb538c28ac tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:05.136302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2e6938-acc2-47bc-9574-91eb538c28ac tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:05.137819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2e6938-acc2-47bc-9574-91eb538c28ac tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:05.142257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2e6938-acc2-47bc-9574-91eb538c28ac tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:05.467749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:05.469628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:05.482152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:05.483439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:05.484125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:05.485768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:05.490647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:05.491492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:05.693344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:05.705176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:05.707193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:05.713313 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-71323890-0a22-4ebb-94bf-81449224a0e2 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1533 microversion: 2.91 time: 0.252167 Oct 11 04:21:05.714693 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1264/2635] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:21:05 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1533 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:21:06.144339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e2e6938-acc2-47bc-9574-91eb538c28ac tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:06.152255 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e2e6938-acc2-47bc-9574-91eb538c28ac tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1521 microversion: 2.1 time: 1.060490 Oct 11 04:21:06.152828 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1372/2636] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:05 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1521 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:06.183215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-51d0c2e9-0a0e-47f0-9448-a6a539afdd1f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-887356524", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-51d0c2e9-0a0e-47f0-9448-a6a539afdd1f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action HTTP/1.1 Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 618 Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-887356524", "metadata": {"aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}}} Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '431a0a90-2f88-49fb-bf06-b292938d2258', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-887356524', 'metadata': {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}}}} Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:21:06.188189 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['createImage']['properties']['metadata']: Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'} Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:21:06.191002 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:06.195618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-51d0c2e9-0a0e-47f0-9448-a6a539afdd1f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:06.196677 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-51d0c2e9-0a0e-47f0-9448-a6a539afdd1f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action" status: 400 len: 938 microversion: 2.1 time: 0.023299 Oct 11 04:21:06.197892 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1265/2637] 10.222.0.26 () {60 vars in 1279 bytes} [Tue Oct 11 04:21:06 2022] POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action => generated 938 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:21:06.208175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f8aedf7d-260b-4820-a763-d01690e542e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:06.209040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f8aedf7d-260b-4820-a763-d01690e542e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:06.218681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8aedf7d-260b-4820-a763-d01690e542e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:06.219898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8aedf7d-260b-4820-a763-d01690e542e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:06.220535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8aedf7d-260b-4820-a763-d01690e542e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:06.221411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8aedf7d-260b-4820-a763-d01690e542e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:06.222008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8aedf7d-260b-4820-a763-d01690e542e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:06.222681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8aedf7d-260b-4820-a763-d01690e542e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:06.741461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:06.747557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:06.762003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:06.762518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:06.762954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:06.763653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:06.764100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:06.764520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:06.857857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:06.859164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:06.860818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:06.861636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lazy-loading 'fault' on Instance uuid 08029265-88c6-4b4a-bbff-1dc995bd902f {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:21:06.906862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f8aedf7d-260b-4820-a763-d01690e542e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:06.918664 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f8aedf7d-260b-4820-a763-d01690e542e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1521 microversion: 2.1 time: 0.715111 Oct 11 04:21:06.920649 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1373/2638] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:06 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1521 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:06.949019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c84e39de-7e94-4cb8-9d6d-f829a096bc23 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:06.950369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c84e39de-7e94-4cb8-9d6d-f829a096bc23 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:06.957984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c84e39de-7e94-4cb8-9d6d-f829a096bc23 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:06.959198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c84e39de-7e94-4cb8-9d6d-f829a096bc23 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:06.960117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c84e39de-7e94-4cb8-9d6d-f829a096bc23 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:06.961107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c84e39de-7e94-4cb8-9d6d-f829a096bc23 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:06.961728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c84e39de-7e94-4cb8-9d6d-f829a096bc23 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:06.962335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c84e39de-7e94-4cb8-9d6d-f829a096bc23 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:06.968088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:07.056254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:07.080457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:07.084076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dce2afc8ece647a2a2666861f7ad6775', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ca25756f13cd4be3ab31de2251b7fb42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:07.092069 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-feff14cc-7c77-4dfa-afc0-94c108305513 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 200 len: 1538 microversion: 2.91 time: 0.354115 Oct 11 04:21:07.093525 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1266/2639] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:21:06 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 1538 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:21:07.416222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c84e39de-7e94-4cb8-9d6d-f829a096bc23 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:07.439586 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c84e39de-7e94-4cb8-9d6d-f829a096bc23 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1521 microversion: 2.1 time: 0.495020 Oct 11 04:21:07.443968 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1374/2640] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:06 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:07.467175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f6a9493-e787-462a-aa4b-dae777f7719f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Action: 'action', calling method: >, body: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f6a9493-e787-462a-aa4b-dae777f7719f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action HTTP/1.1 Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 285 Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: {"createImage": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '431a0a90-2f88-49fb-bf06-b292938d2258', 'body': {'createImage': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['createImage']['properties']['name']: Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['createImage']: Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:07.472871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:21:07.475821 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:07.482694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f6a9493-e787-462a-aa4b-dae777f7719f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:07.486899 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5f6a9493-e787-462a-aa4b-dae777f7719f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action" status: 400 len: 619 microversion: 2.1 time: 0.024694 Oct 11 04:21:07.487767 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1267/2641] 10.222.0.26 () {60 vars in 1279 bytes} [Tue Oct 11 04:21:07 2022] POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action => generated 619 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:21:07.499721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1ac42120-b5a1-4c7f-8989-e992fd5f58ee tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:07.500486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1ac42120-b5a1-4c7f-8989-e992fd5f58ee tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:07.533963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ac42120-b5a1-4c7f-8989-e992fd5f58ee tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:07.534580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ac42120-b5a1-4c7f-8989-e992fd5f58ee tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:07.535018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ac42120-b5a1-4c7f-8989-e992fd5f58ee tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:07.535723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ac42120-b5a1-4c7f-8989-e992fd5f58ee tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:07.536173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ac42120-b5a1-4c7f-8989-e992fd5f58ee tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:07.536590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ac42120-b5a1-4c7f-8989-e992fd5f58ee tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:08.008569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1ac42120-b5a1-4c7f-8989-e992fd5f58ee tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:08.017180 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1ac42120-b5a1-4c7f-8989-e992fd5f58ee tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1521 microversion: 2.1 time: 0.524679 Oct 11 04:21:08.022533 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1375/2642] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:07 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:08.048242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-25ac193b-3758-4b45-9fb2-a589efe3c2db tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:08.049399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-25ac193b-3758-4b45-9fb2-a589efe3c2db tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:08.057257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ac193b-3758-4b45-9fb2-a589efe3c2db tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:08.057968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ac193b-3758-4b45-9fb2-a589efe3c2db tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:08.058588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ac193b-3758-4b45-9fb2-a589efe3c2db tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:08.060049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ac193b-3758-4b45-9fb2-a589efe3c2db tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:08.060661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ac193b-3758-4b45-9fb2-a589efe3c2db tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:08.061238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ac193b-3758-4b45-9fb2-a589efe3c2db tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:08.128935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:08.129905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] [instance: 08029265-88c6-4b4a-bbff-1dc995bd902f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:08.148248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:08.151353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:08.153533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:08.154587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:08.156576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:08.158235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:08.176827 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] HTTP exception thrown: Instance 08029265-88c6-4b4a-bbff-1dc995bd902f could not be found. Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Request method failure captured: Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f HTTP/1.1 Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO5tZFht0uGpvvhpRksjD3NlctTTowWsmCD_IXIbAVoWAljwj7a-8i4VPxoqQxzGndrD-mphP2TkxG8Y2tVgPPxzUhdxSpdCopwnjWEdDP7hX-gkwFy6OV0Cz825KuVgn3Iu5aw1ybJ_GdKC8-oY1GPTVBVAhX8xgCkE6WPiW-JqfDI Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.91 Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ca25756f13cd4be3ab31de2251b7fb42 Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-UnshelveToHostMultiNodesTest-1830385144 Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ca25756f13cd4be3ab31de2251b7fb42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ca25756f13cd4be3ab31de2251b7fb42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca25756f13cd4be3ab31de2251b7fb42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ca25756f13cd4be3ab31de2251b7fb42"}]}] Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-UnshelveToHostMultiNodesTest-1830385144 Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ca25756f13cd4be3ab31de2251b7fb42 Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-UnshelveToHostMultiNodesTest-1830385144 Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-UnshelveToHostMultiNodesTest-1830385144-project Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: dce2afc8ece647a2a2666861f7ad6775 Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-UnshelveToHostMultiNodesTest-1830385144-project Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 08029265-88c6-4b4a-bbff-1dc995bd902f could not be found. Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '08029265-88c6-4b4a-bbff-1dc995bd902f'} Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08029265-88c6-4b4a-bbff-1dc995bd902f could not be found. Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08029265-88c6-4b4a-bbff-1dc995bd902f could not be found. Oct 11 04:21:08.182512 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:08.187091 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:08.187091 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:08.187091 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:08.187091 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:08.187091 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:08.187091 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:21:08.187091 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:21:08.187091 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08029265-88c6-4b4a-bbff-1dc995bd902f could not be found. Oct 11 04:21:08.187091 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:08.188883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] Returning 404 to user: Instance 08029265-88c6-4b4a-bbff-1dc995bd902f could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:08.189755 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b2d13f4-1b72-41fb-80a7-f603c9e13de7 tempest-UnshelveToHostMultiNodesTest-1830385144 tempest-UnshelveToHostMultiNodesTest-1830385144-project] 10.222.0.26 "GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f" status: 404 len: 111 microversion: 2.91 time: 0.068606 Oct 11 04:21:08.191212 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1376/2643] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:21:08 2022] GET /compute/v2.1/servers/08029265-88c6-4b4a-bbff-1dc995bd902f => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:21:08.673447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-25ac193b-3758-4b45-9fb2-a589efe3c2db tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:08.691493 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-25ac193b-3758-4b45-9fb2-a589efe3c2db tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1521 microversion: 2.1 time: 0.648221 Oct 11 04:21:08.692095 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1268/2644] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:08 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1521 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:08.721167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-514d744f-bd52-4d4b-a0a1-85a4568ffe22 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-926244382"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:08.722920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-514d744f-bd52-4d4b-a0a1-85a4568ffe22 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:08.743246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-514d744f-bd52-4d4b-a0a1-85a4568ffe22 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:08.743743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-514d744f-bd52-4d4b-a0a1-85a4568ffe22 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:08.744183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-514d744f-bd52-4d4b-a0a1-85a4568ffe22 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:08.744895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-514d744f-bd52-4d4b-a0a1-85a4568ffe22 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:08.745346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-514d744f-bd52-4d4b-a0a1-85a4568ffe22 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:08.747469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-514d744f-bd52-4d4b-a0a1-85a4568ffe22 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:09.491809 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-514d744f-bd52-4d4b-a0a1-85a4568ffe22 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action" status: 202 len: 0 microversion: 2.1 time: 0.777337 Oct 11 04:21:09.505205 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1377/2645] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:21:08 2022] POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action => generated 0 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 04:21:09.525491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1467425669"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:09.530864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:09.552967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:09.558392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:09.558392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:09.558392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:09.558392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:09.558392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:09.558392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:09.618355 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] HTTP exception thrown: Cannot 'createImage' instance 431a0a90-2f88-49fb-bf06-b292938d2258 while it is in task_state image_snapshot_pending Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action HTTP/1.1 Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 85 Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1467425669"}} Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: exception: Cannot 'createImage' instance 431a0a90-2f88-49fb-bf06-b292938d2258 while it is in task_state image_snapshot_pending Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '431a0a90-2f88-49fb-bf06-b292938d2258', 'body': {'createImage': {'name': 'tempest-ImagesOneServerNegativeTestJSON-image-1467425669'}}} Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1349, in _action_create_image Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self.compute_api.snapshot(context, Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 155, in inner Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 in task_state image_snapshot_pending. Cannot snapshot while the instance is in this state. Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1354, in _action_create_image Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:21:09.621003 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'createImage' instance 431a0a90-2f88-49fb-bf06-b292938d2258 while it is in task_state image_snapshot_pending Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'createImage' instance 431a0a90-2f88-49fb-bf06-b292938d2258 while it is in task_state image_snapshot_pending Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 409 to user: Cannot 'createImage' instance 431a0a90-2f88-49fb-bf06-b292938d2258 while it is in task_state image_snapshot_pending {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-686cee07-972a-4bb7-9c96-50b5458eb129 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action" status: 409 len: 167 microversion: 2.1 time: 0.118850 Oct 11 04:21:09.632358 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1269/2646] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:21:09 2022] POST /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258/action => generated 167 bytes in 120 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:21:09.638827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-834e5767-46fd-45de-a801-409f9e267666 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '.version_select at 0x7fda19500b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:10.150118 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-834e5767-46fd-45de-a801-409f9e267666 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "DELETE /compute/v2.1/images/b212c483-b54b-4c5f-b1f4-6a758827c8d4" status: 204 len: 0 microversion: 2.1 time: 0.522279 Oct 11 04:21:10.151755 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1378/2647] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:09 2022] DELETE /compute/v2.1/images/b212c483-b54b-4c5f-b1f4-6a758827c8d4 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:21:10.161046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a6c3d737-3f7e-4311-b085-b9963733ac07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:10.161750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a6c3d737-3f7e-4311-b085-b9963733ac07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:10.167860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6c3d737-3f7e-4311-b085-b9963733ac07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:10.168343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6c3d737-3f7e-4311-b085-b9963733ac07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:10.168776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6c3d737-3f7e-4311-b085-b9963733ac07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:10.169467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6c3d737-3f7e-4311-b085-b9963733ac07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:10.169917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6c3d737-3f7e-4311-b085-b9963733ac07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:10.170400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6c3d737-3f7e-4311-b085-b9963733ac07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:10.539657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a6c3d737-3f7e-4311-b085-b9963733ac07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:10.570823 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a6c3d737-3f7e-4311-b085-b9963733ac07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1533 microversion: 2.1 time: 0.414572 Oct 11 04:21:10.572327 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1270/2648] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:10 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1533 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:11.599628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31721a80-d8fc-48d6-a20d-f1393880a9f7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:11.601183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31721a80-d8fc-48d6-a20d-f1393880a9f7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:11.633077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31721a80-d8fc-48d6-a20d-f1393880a9f7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:11.638023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31721a80-d8fc-48d6-a20d-f1393880a9f7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:11.638859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31721a80-d8fc-48d6-a20d-f1393880a9f7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:11.641330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31721a80-d8fc-48d6-a20d-f1393880a9f7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:11.642750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31721a80-d8fc-48d6-a20d-f1393880a9f7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:11.646052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31721a80-d8fc-48d6-a20d-f1393880a9f7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:12.302833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-31721a80-d8fc-48d6-a20d-f1393880a9f7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:12.316834 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31721a80-d8fc-48d6-a20d-f1393880a9f7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1539 microversion: 2.1 time: 0.722872 Oct 11 04:21:12.323990 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1379/2649] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:11 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1539 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:13.291253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c6fbcbcc-369d-4838-8045-5ff34f69410b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Action: 'create', calling method: .version_select at 0x7fda19b15c10>, body: {"keypair": {"name": "tempest-keypair-1524069730", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD92xGJngD+lUtg1JFy0DR0NxKlu1T0ggYrv8p45pbAqBOlKrDJv3Ax61ard5tcQ869Mk68vGgbvOfzwXsFTvFtxDz99bik/2Muf1NLUo3thDUBlPn58uV7P7BW/55aO1Q=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:13.348336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c6fbcbcc-369d-4838-8045-5ff34f69410b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Getting quotas for project 37f9f0f6eef640cf926169521c02a36d. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:21:13.353113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-690a52bb-34be-4dbd-a569-3e0aefb2ae0a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:13.353732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-690a52bb-34be-4dbd-a569-3e0aefb2ae0a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:13.368512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c6fbcbcc-369d-4838-8045-5ff34f69410b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Getting quotas for user 0667b04f93364fcda7e456013e541dba and project 37f9f0f6eef640cf926169521c02a36d. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:21:13.389025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-690a52bb-34be-4dbd-a569-3e0aefb2ae0a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:13.389519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-690a52bb-34be-4dbd-a569-3e0aefb2ae0a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:13.392036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-690a52bb-34be-4dbd-a569-3e0aefb2ae0a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:13.392782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-690a52bb-34be-4dbd-a569-3e0aefb2ae0a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:13.393244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-690a52bb-34be-4dbd-a569-3e0aefb2ae0a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:13.393666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-690a52bb-34be-4dbd-a569-3e0aefb2ae0a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:13.584071 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c6fbcbcc-369d-4838-8045-5ff34f69410b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.028086 Oct 11 04:21:13.584801 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1271/2650] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:21:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1031 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:13.996920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-209966553", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "eb00258c-33f3-4e50-9b19-bfa956507201"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:14.071323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] validate_networks() for [('eb00258c-33f3-4e50-9b19-bfa956507201', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:21:14.113699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-690a52bb-34be-4dbd-a569-3e0aefb2ae0a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:14.134801 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-690a52bb-34be-4dbd-a569-3e0aefb2ae0a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1521 microversion: 2.1 time: 0.785970 Oct 11 04:21:14.151559 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1380/2651] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:13 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1521 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:14.164939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-03e24e79-18f6-472c-a646-9894fcf93bba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:14.165442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-03e24e79-18f6-472c-a646-9894fcf93bba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:14.182596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e24e79-18f6-472c-a646-9894fcf93bba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:14.184887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e24e79-18f6-472c-a646-9894fcf93bba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:14.186668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e24e79-18f6-472c-a646-9894fcf93bba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:14.189517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e24e79-18f6-472c-a646-9894fcf93bba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:14.190940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e24e79-18f6-472c-a646-9894fcf93bba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:14.191684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e24e79-18f6-472c-a646-9894fcf93bba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:14.252641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-03e24e79-18f6-472c-a646-9894fcf93bba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:21:14.810229 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-03e24e79-18f6-472c-a646-9894fcf93bba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "DELETE /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 204 len: 0 microversion: 2.1 time: 0.652510 Oct 11 04:21:14.820140 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1381/2652] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:21:14 2022] DELETE /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 0 bytes in 659 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:21:14.825044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a8d254d4-5b5e-427c-83dc-018a4f0eb897 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:14.825760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a8d254d4-5b5e-427c-83dc-018a4f0eb897 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:14.843288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8d254d4-5b5e-427c-83dc-018a4f0eb897 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:14.844313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8d254d4-5b5e-427c-83dc-018a4f0eb897 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:14.844937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8d254d4-5b5e-427c-83dc-018a4f0eb897 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:14.845838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8d254d4-5b5e-427c-83dc-018a4f0eb897 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:14.846702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8d254d4-5b5e-427c-83dc-018a4f0eb897 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:14.847438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8d254d4-5b5e-427c-83dc-018a4f0eb897 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:15.291434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8d254d4-5b5e-427c-83dc-018a4f0eb897 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:15.301918 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a8d254d4-5b5e-427c-83dc-018a4f0eb897 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1527 microversion: 2.1 time: 0.481123 Oct 11 04:21:15.302750 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1382/2653] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:14 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1527 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:15.482268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:21:15.483340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:21:15.484147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:21:15.485524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:21:15.486422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:21:15.499736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:15.501696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:15.502390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:15.506603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:15.522225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:15.524546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:15.556546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:21:15.563261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for user 99027798dcba4d52a9efc682ccc973d3 and project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:21:15.580246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:21:15.584161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:21:15.795566 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-70f2acdd-f278-456b-a8c6-2144be36a7a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.029827 Oct 11 04:21:15.798637 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1272/2654] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 2034 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:21:15.812146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d23bb828-4ba3-4bc9-b5fb-9e77be047a79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:15.814607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d23bb828-4ba3-4bc9-b5fb-9e77be047a79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:16.036248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d23bb828-4ba3-4bc9-b5fb-9e77be047a79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:16.053729 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d23bb828-4ba3-4bc9-b5fb-9e77be047a79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1214 microversion: 2.1 time: 0.246828 Oct 11 04:21:16.056754 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1383/2655] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:15 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1214 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:16.325791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-27ee1021-5608-4168-b78b-05288487f0a6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:16.327001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-27ee1021-5608-4168-b78b-05288487f0a6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:16.345361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27ee1021-5608-4168-b78b-05288487f0a6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:16.352431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27ee1021-5608-4168-b78b-05288487f0a6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:16.352431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27ee1021-5608-4168-b78b-05288487f0a6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:16.354900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27ee1021-5608-4168-b78b-05288487f0a6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:16.355599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27ee1021-5608-4168-b78b-05288487f0a6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:16.357697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27ee1021-5608-4168-b78b-05288487f0a6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:17.174440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-67a69f90-cb05-483e-9433-ab718e190214 req-82351025-8105-496b-9c66-2e57ce7a7cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431a0a90-2f88-49fb-bf06-b292938d2258", "name": "network-vif-plugged", "status": "completed", "tag": "84317dc1-349f-48b2-8f9f-0cba797f33c5"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:17.237255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-67a69f90-cb05-483e-9433-ab718e190214 req-82351025-8105-496b-9c66-2e57ce7a7cc3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:17.238606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-67a69f90-cb05-483e-9433-ab718e190214 req-82351025-8105-496b-9c66-2e57ce7a7cc3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:17.243446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-67a69f90-cb05-483e-9433-ab718e190214 req-82351025-8105-496b-9c66-2e57ce7a7cc3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:17.275621 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-67a69f90-cb05-483e-9433-ab718e190214 req-82351025-8105-496b-9c66-2e57ce7a7cc3 service nova] Creating event network-vif-plugged:84317dc1-349f-48b2-8f9f-0cba797f33c5 for instance 431a0a90-2f88-49fb-bf06-b292938d2258 on n-h2-860892-1 Oct 11 04:21:17.290843 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-67a69f90-cb05-483e-9433-ab718e190214 req-82351025-8105-496b-9c66-2e57ce7a7cc3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.637291 Oct 11 04:21:17.294510 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1384/2656] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:21:17.316371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e94c2c5-39e2-469a-95e2-dc0d40ef3322 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:17.317119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e94c2c5-39e2-469a-95e2-dc0d40ef3322 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:17.469044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-27ee1021-5608-4168-b78b-05288487f0a6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:17.505910 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-27ee1021-5608-4168-b78b-05288487f0a6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1527 microversion: 2.1 time: 1.181724 Oct 11 04:21:17.514012 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1273/2657] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:16 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1527 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:17.590005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e94c2c5-39e2-469a-95e2-dc0d40ef3322 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:17.600213 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e94c2c5-39e2-469a-95e2-dc0d40ef3322 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1214 microversion: 2.1 time: 0.303189 Oct 11 04:21:17.605317 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1385/2658] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:17 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1214 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:18.115383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8701cfd-6c7a-481a-bced-bc4d117a9490 tempest-FlavorsV2NegativeTest-1233325755 tempest-FlavorsV2NegativeTest-1233325755-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:18.133421 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8701cfd-6c7a-481a-bced-bc4d117a9490 tempest-FlavorsV2NegativeTest-1233325755 tempest-FlavorsV2NegativeTest-1233325755-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.571088 Oct 11 04:21:18.146835 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1274/2659] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:21:17 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:18.537227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-37db35ee-b18c-40fd-9abf-a17a91f3c660 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:18.537841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-37db35ee-b18c-40fd-9abf-a17a91f3c660 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:18.559654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37db35ee-b18c-40fd-9abf-a17a91f3c660 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:18.560150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37db35ee-b18c-40fd-9abf-a17a91f3c660 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:18.560590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37db35ee-b18c-40fd-9abf-a17a91f3c660 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:18.564685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37db35ee-b18c-40fd-9abf-a17a91f3c660 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:18.571157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37db35ee-b18c-40fd-9abf-a17a91f3c660 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:18.571622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37db35ee-b18c-40fd-9abf-a17a91f3c660 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:18.630439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92f36e9f-9158-486f-9bb8-f4e7319f8249 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:18.631054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-92f36e9f-9158-486f-9bb8-f4e7319f8249 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:18.641258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f36e9f-9158-486f-9bb8-f4e7319f8249 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:18.653430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f36e9f-9158-486f-9bb8-f4e7319f8249 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:18.654176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f36e9f-9158-486f-9bb8-f4e7319f8249 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:18.655099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f36e9f-9158-486f-9bb8-f4e7319f8249 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:18.655712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f36e9f-9158-486f-9bb8-f4e7319f8249 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:18.656331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f36e9f-9158-486f-9bb8-f4e7319f8249 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:18.776938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92f36e9f-9158-486f-9bb8-f4e7319f8249 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:18.786276 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92f36e9f-9158-486f-9bb8-f4e7319f8249 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1218 microversion: 2.1 time: 0.159757 Oct 11 04:21:18.800676 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1275/2660] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:18 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1218 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:19.821035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-126dd0ec-3785-45e3-8602-d62794e348ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:19.821661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-126dd0ec-3785-45e3-8602-d62794e348ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:19.836221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-126dd0ec-3785-45e3-8602-d62794e348ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:19.838744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-126dd0ec-3785-45e3-8602-d62794e348ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:19.840667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-126dd0ec-3785-45e3-8602-d62794e348ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:19.842835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-126dd0ec-3785-45e3-8602-d62794e348ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:19.846745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-126dd0ec-3785-45e3-8602-d62794e348ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:19.847371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-126dd0ec-3785-45e3-8602-d62794e348ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:20.025414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-37db35ee-b18c-40fd-9abf-a17a91f3c660 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:20.054956 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-37db35ee-b18c-40fd-9abf-a17a91f3c660 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1527 microversion: 2.1 time: 1.519864 Oct 11 04:21:20.055601 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1386/2661] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:18 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1527 bytes in 1523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:20.153411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-23dfb52b-2576-4cea-8d67-c5fe970328d3 tempest-FlavorsV2NegativeTest-1233325755 tempest-FlavorsV2NegativeTest-1233325755-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1199046585", "imageRef": "5ff45e25-cb85-421f-89d7-c359c94dda4d", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:20.284187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-23dfb52b-2576-4cea-8d67-c5fe970328d3 tempest-FlavorsV2NegativeTest-1233325755 tempest-FlavorsV2NegativeTest-1233325755-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:21:20.291648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-126dd0ec-3785-45e3-8602-d62794e348ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:20.309218 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-126dd0ec-3785-45e3-8602-d62794e348ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1266 microversion: 2.1 time: 0.493897 Oct 11 04:21:20.337595 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1276/2662] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:19 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1266 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:21.035403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a6b710e7-9d42-4cb4-94fb-958051be8742 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Action: 'create', calling method: .version_select at 0x7fda19a020d0>, body: {"pool": null} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:21.319595 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-23dfb52b-2576-4cea-8d67-c5fe970328d3 tempest-FlavorsV2NegativeTest-1233325755 tempest-FlavorsV2NegativeTest-1233325755-project] HTTP exception thrown: Flavor's memory is too small for requested image. Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-23dfb52b-2576-4cea-8d67-c5fe970328d3 tempest-FlavorsV2NegativeTest-1233325755 tempest-FlavorsV2NegativeTest-1233325755-project] Request method failure captured: Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 143 Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO89HPDtWXpPu8Ysvda2k1NWoOa808lPh7M9HZV-EZ_aq9nBgJ6A4WyAGQ6X4fUFGFjNnV5XCMDr4_hDdHSMVTw1447jopDpLpag_2_ylxRh96Gur1SUCP3tfU1q9v8EbeA-7GhPa7KnunSpKRMJCZnsj5nUJMyTL4oJbnofNxJpKco Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 1557d326eb9f41b4b831117034c3c496 Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-FlavorsV2NegativeTest-1233325755 Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1557d326eb9f41b4b831117034c3c496"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1557d326eb9f41b4b831117034c3c496"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1557d326eb9f41b4b831117034c3c496"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1557d326eb9f41b4b831117034c3c496"}]}] Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-FlavorsV2NegativeTest-1233325755 Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 1557d326eb9f41b4b831117034c3c496 Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-FlavorsV2NegativeTest-1233325755 Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-FlavorsV2NegativeTest-1233325755-project Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 28000f6c09f44d8890fb442445c630f9 Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-FlavorsV2NegativeTest-1233325755-project Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-FlavorsV2NegativeTest-server-1199046585", "imageRef": "5ff45e25-cb85-421f-89d7-c359c94dda4d", "flavorRef": "452"}} Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: exception: Flavor's memory is too small for requested image. Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-FlavorsV2NegativeTest-server-1199046585', 'imageRef': '5ff45e25-cb85-421f-89d7-c359c94dda4d', 'flavorRef': '452'}}} Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1019, in _checks_for_create_and_rebuild Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._validate_flavor_image(context, image_id, image, Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 683, in _validate_flavor_image Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._validate_flavor_image_nostatus( Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 751, in _validate_flavor_image_nostatus Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.FlavorMemoryTooSmall() Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.FlavorMemoryTooSmall: Flavor's memory is too small for requested image. Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:21.321473 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 868, in create Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor's memory is too small for requested image. Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor's memory is too small for requested image. Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-23dfb52b-2576-4cea-8d67-c5fe970328d3 tempest-FlavorsV2NegativeTest-1233325755 tempest-FlavorsV2NegativeTest-1233325755-project] Returning 400 to user: Flavor's memory is too small for requested image. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-23dfb52b-2576-4cea-8d67-c5fe970328d3 tempest-FlavorsV2NegativeTest-1233325755 tempest-FlavorsV2NegativeTest-1233325755-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 93 microversion: 2.1 time: 1.174210 Oct 11 04:21:21.325119 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1387/2663] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:20 2022] POST /compute/v2.1/servers => generated 93 bytes in 1176 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:21:21.350819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-87c17373-ed2e-4f68-90e0-5072c79a5af3 req-61e1efde-8962-45c5-9d00-893274648584 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "431a0a90-2f88-49fb-bf06-b292938d2258", "name": "network-vif-deleted", "tag": "84317dc1-349f-48b2-8f9f-0cba797f33c5"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:21.398145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-87c17373-ed2e-4f68-90e0-5072c79a5af3 req-61e1efde-8962-45c5-9d00-893274648584 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:21.399324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-87c17373-ed2e-4f68-90e0-5072c79a5af3 req-61e1efde-8962-45c5-9d00-893274648584 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:21.399949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-87c17373-ed2e-4f68-90e0-5072c79a5af3 req-61e1efde-8962-45c5-9d00-893274648584 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:21.435094 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-87c17373-ed2e-4f68-90e0-5072c79a5af3 req-61e1efde-8962-45c5-9d00-893274648584 service nova] Creating event network-vif-deleted:84317dc1-349f-48b2-8f9f-0cba797f33c5 for instance 431a0a90-2f88-49fb-bf06-b292938d2258 on n-h2-860892-1 Oct 11 04:21:21.446055 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-87c17373-ed2e-4f68-90e0-5072c79a5af3 req-61e1efde-8962-45c5-9d00-893274648584 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.120662 Oct 11 04:21:21.449171 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1388/2664] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:21.458881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:21.460862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:21.475869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:21.481227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:21.481998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:21.483034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:21.483714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:21.484396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:21.559217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:21.560049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:21.561018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:21.561808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lazy-loading 'fault' on Instance uuid 431a0a90-2f88-49fb-bf06-b292938d2258 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:21:21.691770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:21.703439 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab5b4dd6-c29d-493e-8830-dbada20f0703 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 200 len: 1315 microversion: 2.1 time: 0.247854 Oct 11 04:21:21.704140 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1389/2665] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:21 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:21.712166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-969b75b2-94f0-460a-8283-26ba93d9547e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:21.727049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-969b75b2-94f0-460a-8283-26ba93d9547e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:21.745817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-969b75b2-94f0-460a-8283-26ba93d9547e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:21.747461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-969b75b2-94f0-460a-8283-26ba93d9547e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:21.750909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-969b75b2-94f0-460a-8283-26ba93d9547e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:21.754924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-969b75b2-94f0-460a-8283-26ba93d9547e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:21.755442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-969b75b2-94f0-460a-8283-26ba93d9547e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:21.755882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-969b75b2-94f0-460a-8283-26ba93d9547e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:22.089673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-969b75b2-94f0-460a-8283-26ba93d9547e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:22.110877 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-969b75b2-94f0-460a-8283-26ba93d9547e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1272 microversion: 2.1 time: 0.400635 Oct 11 04:21:22.111816 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1390/2666] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:21 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1272 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:22.731693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:22.733758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:22.752454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:22.752454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:22.752454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:22.753902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:22.756711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:22.757324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:22.864150 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] HTTP exception thrown: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 HTTP/1.1 Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '431a0a90-2f88-49fb-bf06-b292938d2258'} Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:22.870639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:22.874982 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:22.874982 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:22.874982 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:22.874982 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:22.874982 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:21:22.874982 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:21:22.874982 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:21:22.874982 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:22.877187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 404 to user: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:22.879573 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a9dd188c-5afb-4e25-95f9-2b7dda22ef38 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 404 len: 111 microversion: 2.1 time: 0.151764 Oct 11 04:21:22.881034 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1391/2667] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:22 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 111 bytes in 155 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:21:22.895054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22fe299a-4c9a-4a15-bb0e-d6998ba5dada tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Action: 'create', calling method: .version_select at 0x7fda19fe70d0>, body: {"keypair": {"name": "tempest-keypair-1070715433", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF8F5XqF9Yeb+RVI00dCEUpy6hnRe0TnoFGs5Nn1p4nT3eqRLlALVAbI+D6hHKxYR1D7DR0+fGHTl/KzkXRrHHy5V8c/+KXHMh9a6pFFpKyGCCaSDPwzFSHivKp4yRK2Qw=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:22.932351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-22fe299a-4c9a-4a15-bb0e-d6998ba5dada tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Getting quotas for project 9db178c528264083bfd30875291a1797. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:21:22.956596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-22fe299a-4c9a-4a15-bb0e-d6998ba5dada tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Getting quotas for user 7c3e365e46be4bc2b83f09bf0ebd8efc and project 9db178c528264083bfd30875291a1797. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:21:23.326247 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22fe299a-4c9a-4a15-bb0e-d6998ba5dada tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.437466 Oct 11 04:21:23.329114 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1392/2668] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:21:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:21:23.349960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-55cc7730-89ce-4458-8910-2b0afaeeabc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:23.349960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-55cc7730-89ce-4458-8910-2b0afaeeabc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:23.363313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55cc7730-89ce-4458-8910-2b0afaeeabc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:23.364949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55cc7730-89ce-4458-8910-2b0afaeeabc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:23.365450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55cc7730-89ce-4458-8910-2b0afaeeabc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:23.366745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55cc7730-89ce-4458-8910-2b0afaeeabc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:23.367438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55cc7730-89ce-4458-8910-2b0afaeeabc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:23.368155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55cc7730-89ce-4458-8910-2b0afaeeabc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:23.754951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-55cc7730-89ce-4458-8910-2b0afaeeabc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:23.772696 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-55cc7730-89ce-4458-8910-2b0afaeeabc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1314 microversion: 2.1 time: 0.433609 Oct 11 04:21:23.772696 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1393/2669] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:23 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:23.781589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-341889375", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"hello": "world"}, "accessIPv4": "1.1.1.1", "accessIPv6": "0000:0000:0000:0000:0000:babe:220.12.22.2", "adminPass": "***", "networks": [{"uuid": "b5e3f3e6-a0c4-408d-b663-8e5f7b4f39c0"}], "security_groups": [{"name": "tempest-securitygroup--286346684"}], "key_name": "tempest-keypair-1524069730", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "OS-DCF:diskConfig": "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:23.920207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] validate_networks() for [('b5e3f3e6-a0c4-408d-b663-8e5f7b4f39c0', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:21:25.534942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:25.574798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=10 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:25.833055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:25.847283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Getting quotas for project 37f9f0f6eef640cf926169521c02a36d. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:21:25.856850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Getting quotas for user 0667b04f93364fcda7e456013e541dba and project 37f9f0f6eef640cf926169521c02a36d. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:21:25.899567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:21:25.899986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:21:25.903416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:21:25.903848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:21:25.904271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:21:25.925204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:25.925716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:25.937806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:25.937806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:25.937806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:25.937806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:25.960128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Getting quotas for project 37f9f0f6eef640cf926169521c02a36d. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:21:25.967795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Getting quotas for user 0667b04f93364fcda7e456013e541dba and project 37f9f0f6eef640cf926169521c02a36d. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:21:25.986020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:21:25.988770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:21:25.998913 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a6b710e7-9d42-4cb4-94fb-958051be8742 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 5.367231 Oct 11 04:21:26.001424 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1277/2670] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:21:20 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 5371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:26.176074 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-74665206-4729-4044-a8c7-d15ae1d62869 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.406542 Oct 11 04:21:26.197230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e92aa4ed-2666-4043-a4ef-03d8175a3152 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1053832388", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "min_count": 3, "max_count": 2}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:26.198691 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1394/2671] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 2430 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:21:26.216229 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-e92aa4ed-2666-4043-a4ef-03d8175a3152 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] HTTP exception thrown: min_count must be <= max_count Oct 11 04:21:26.216581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-60dba731-5992-45bf-89ab-ba80167b3028 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:26.221100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-60dba731-5992-45bf-89ab-ba80167b3028 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e92aa4ed-2666-4043-a4ef-03d8175a3152 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Request method failure captured: Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 184 Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9ErqlNYOeC32TqMX2rPlYRu1UZsC5KOnoeCt23dGKzHajYMkNUyZCcnaWoUK1kCKTj5dqUiqsO0gdLfIlvqTezquo8zWJSSc63Pwv0jOOV7crce2khglVqv1E1XUCbdYguMAds67_ZG7rjBXawHsanGEP5csm44nG7RHwwLv4MR5A Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9bdf4d1f471b43bfa7197057615049c6 Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bdf4d1f471b43bfa7197057615049c6"}]}] Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9bdf4d1f471b43bfa7197057615049c6 Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-MultipleCreateNegativeTestJSON-957200068-project Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: b4663f4191fd4d7eb2222023d7351999 Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-957200068-project Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1053832388", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "min_count": 3, "max_count": 2}} Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: exception: min_count must be <= max_count Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1053832388', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'min_count': 3, 'max_count': 2}}} Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 726, in create Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: min_count must be <= max_count Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: min_count must be <= max_count Oct 11 04:21:26.221845 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:26.226174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e92aa4ed-2666-4043-a4ef-03d8175a3152 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Returning 400 to user: min_count must be <= max_count {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:26.226174 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e92aa4ed-2666-4043-a4ef-03d8175a3152 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 74 microversion: 2.1 time: 0.223399 Oct 11 04:21:26.233934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60dba731-5992-45bf-89ab-ba80167b3028 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:26.234783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60dba731-5992-45bf-89ab-ba80167b3028 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:26.235188 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1278/2672] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:26 2022] POST /compute/v2.1/servers => generated 74 bytes in 233 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:21:26.235551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60dba731-5992-45bf-89ab-ba80167b3028 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:26.236572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60dba731-5992-45bf-89ab-ba80167b3028 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:26.237176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60dba731-5992-45bf-89ab-ba80167b3028 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:26.239755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60dba731-5992-45bf-89ab-ba80167b3028 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:26.279284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0325d43e-d04d-490e-a93d-6ceceb529cd4 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Calling method '.version_select at 0x7fda19a02040>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:26.681920 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0325d43e-d04d-490e-a93d-6ceceb529cd4 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/099e214c-be14-48d3-a608-4fab4364afcc" status: 200 len: 141 microversion: 2.1 time: 0.445601 Oct 11 04:21:26.682884 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1279/2673] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:21:26 2022] GET /compute/v2.1/os-floating-ips/099e214c-be14-48d3-a608-4fab4364afcc => generated 141 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:26.690891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3b5ad054-5fb1-481b-95a8-7ec8be4f9dcc tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:26.703504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3b5ad054-5fb1-481b-95a8-7ec8be4f9dcc tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:26.728996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-60dba731-5992-45bf-89ab-ba80167b3028 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:26.735828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:26.746314 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-60dba731-5992-45bf-89ab-ba80167b3028 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1314 microversion: 2.1 time: 0.533988 Oct 11 04:21:26.747324 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1395/2674] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:26 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:26.758948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8533ef1-2519-4a31-b397-2220a29e91a8 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1006618056", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "max_count": 0}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8533ef1-2519-4a31-b397-2220a29e91a8 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Request method failure captured: Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 168 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO9ErqlNYOeC32TqMX2rPlYRu1UZsC5KOnoeCt23dGKzHajYMkNUyZCcnaWoUK1kCKTj5dqUiqsO0gdLfIlvqTezquo8zWJSSc63Pwv0jOOV7crce2khglVqv1E1XUCbdYguMAds67_ZG7rjBXawHsanGEP5csm44nG7RHwwLv4MR5A Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9bdf4d1f471b43bfa7197057615049c6 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bdf4d1f471b43bfa7197057615049c6"}]}] Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9bdf4d1f471b43bfa7197057615049c6 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-MultipleCreateNegativeTestJSON-957200068-project Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: b4663f4191fd4d7eb2222023d7351999 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-957200068-project Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1006618056", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "max_count": 0}} Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1006618056', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'max_count': 0}}} Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['max_count']: Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 0 Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:21:26.783468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8533ef1-2519-4a31-b397-2220a29e91a8 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:26.796978 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e8533ef1-2519-4a31-b397-2220a29e91a8 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.043609 Oct 11 04:21:26.799319 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1396/2675] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:26 2022] POST /compute/v2.1/servers => generated 130 bytes in 51 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:21:26.806455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-18a3571f-7537-4276-b853-ff2a23f91b7a req-b9abbe35-7ba3-4afd-9890-d52828847b86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e48b394-ab48-46ff-803a-0f353c0fb99f", "tag": "d77b5617-1733-4606-b8bb-0c24ae6ead67"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:26.828729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-18a3571f-7537-4276-b853-ff2a23f91b7a req-b9abbe35-7ba3-4afd-9890-d52828847b86 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:26.828729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-18a3571f-7537-4276-b853-ff2a23f91b7a req-b9abbe35-7ba3-4afd-9890-d52828847b86 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:26.828729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-18a3571f-7537-4276-b853-ff2a23f91b7a req-b9abbe35-7ba3-4afd-9890-d52828847b86 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:26.839248 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-18a3571f-7537-4276-b853-ff2a23f91b7a req-b9abbe35-7ba3-4afd-9890-d52828847b86 service nova] Creating event network-changed:d77b5617-1733-4606-b8bb-0c24ae6ead67 for instance 5e48b394-ab48-46ff-803a-0f353c0fb99f on n-h1-860892-1 Oct 11 04:21:26.845028 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-18a3571f-7537-4276-b853-ff2a23f91b7a req-b9abbe35-7ba3-4afd-9890-d52828847b86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044003 Oct 11 04:21:26.849844 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1397/2676] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:26.858615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49ebb099-7463-44dc-b179-3345b62b577a tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Calling method '.version_select at 0x7fda195001f0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:26.977935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3b5ad054-5fb1-481b-95a8-7ec8be4f9dcc tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:27.002963 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3b5ad054-5fb1-481b-95a8-7ec8be4f9dcc tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1269 microversion: 2.1 time: 0.316544 Oct 11 04:21:27.006562 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1280/2677] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:26 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1269 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:27.017195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8d115ecc-2ace-4c6d-b780-3a3d9faacce9 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1038755434", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "max_count": 2.5}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8d115ecc-2ace-4c6d-b780-3a3d9faacce9 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Request method failure captured: Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 170 Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9ErqlNYOeC32TqMX2rPlYRu1UZsC5KOnoeCt23dGKzHajYMkNUyZCcnaWoUK1kCKTj5dqUiqsO0gdLfIlvqTezquo8zWJSSc63Pwv0jOOV7crce2khglVqv1E1XUCbdYguMAds67_ZG7rjBXawHsanGEP5csm44nG7RHwwLv4MR5A Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9bdf4d1f471b43bfa7197057615049c6 Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bdf4d1f471b43bfa7197057615049c6"}]}] Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9bdf4d1f471b43bfa7197057615049c6 Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-MultipleCreateNegativeTestJSON-957200068-project Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: b4663f4191fd4d7eb2222023d7351999 Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-957200068-project Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-1038755434", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "max_count": 2.5}} Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-1038755434', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'max_count': 2.5}}} Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['max_count']: Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 2.5 Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:21:27.028816 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.033303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8d115ecc-2ace-4c6d-b780-3a3d9faacce9 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Returning 400 to user: Invalid input for field/attribute max_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:27.042548 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8d115ecc-2ace-4c6d-b780-3a3d9faacce9 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.026714 Oct 11 04:21:27.043204 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1281/2678] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:27 2022] POST /compute/v2.1/servers => generated 139 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:21:27.147642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98a40f7c-bc45-4031-b527-6c7d0e78a6eb tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-940541609", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "min_count": 0}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98a40f7c-bc45-4031-b527-6c7d0e78a6eb tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Request method failure captured: Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 167 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9ErqlNYOeC32TqMX2rPlYRu1UZsC5KOnoeCt23dGKzHajYMkNUyZCcnaWoUK1kCKTj5dqUiqsO0gdLfIlvqTezquo8zWJSSc63Pwv0jOOV7crce2khglVqv1E1XUCbdYguMAds67_ZG7rjBXawHsanGEP5csm44nG7RHwwLv4MR5A Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9bdf4d1f471b43bfa7197057615049c6 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bdf4d1f471b43bfa7197057615049c6"}]}] Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9bdf4d1f471b43bfa7197057615049c6 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-MultipleCreateNegativeTestJSON-957200068-project Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: b4663f4191fd4d7eb2222023d7351999 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-957200068-project Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-940541609", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "min_count": 0}} Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-940541609', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'min_count': 0}}} Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['server']['properties']['min_count']: Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 0 Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:21:27.151826 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98a40f7c-bc45-4031-b527-6c7d0e78a6eb tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 0. 0 is less than the minimum of 1 {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98a40f7c-bc45-4031-b527-6c7d0e78a6eb tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 130 microversion: 2.1 time: 0.010328 Oct 11 04:21:27.172615 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1282/2679] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:27 2022] POST /compute/v2.1/servers => generated 130 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:21:27.225128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52be9193-2e6d-468d-8cd6-1815f88333b2 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-530824415", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "min_count": 2.5}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52be9193-2e6d-468d-8cd6-1815f88333b2 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Request method failure captured: Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 169 Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9ErqlNYOeC32TqMX2rPlYRu1UZsC5KOnoeCt23dGKzHajYMkNUyZCcnaWoUK1kCKTj5dqUiqsO0gdLfIlvqTezquo8zWJSSc63Pwv0jOOV7crce2khglVqv1E1XUCbdYguMAds67_ZG7rjBXawHsanGEP5csm44nG7RHwwLv4MR5A Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9bdf4d1f471b43bfa7197057615049c6 Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bdf4d1f471b43bfa7197057615049c6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9bdf4d1f471b43bfa7197057615049c6"}]}] Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9bdf4d1f471b43bfa7197057615049c6 Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-MultipleCreateNegativeTestJSON-957200068 Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-MultipleCreateNegativeTestJSON-957200068-project Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: b4663f4191fd4d7eb2222023d7351999 Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-MultipleCreateNegativeTestJSON-957200068-project Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-MultipleCreateNegativeTestJSON-server-530824415", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "min_count": 2.5}} Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-MultipleCreateNegativeTestJSON-server-530824415', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'min_count': 2.5}}} Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 2.5 is not of type 'integer', 'string' Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['min_count']: Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'minimum': 1, Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 2.5 Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:21:27.229184 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52be9193-2e6d-468d-8cd6-1815f88333b2 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] Returning 400 to user: Invalid input for field/attribute min_count. Value: 2.5. 2.5 is not of type 'integer', 'string' {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-52be9193-2e6d-468d-8cd6-1815f88333b2 tempest-MultipleCreateNegativeTestJSON-957200068 tempest-MultipleCreateNegativeTestJSON-957200068-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.009482 Oct 11 04:21:27.237538 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1283/2680] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:27 2022] POST /compute/v2.1/servers => generated 139 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:21:27.575673 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-49ebb099-7463-44dc-b179-3345b62b577a tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 144 microversion: 2.1 time: 0.720162 Oct 11 04:21:27.578597 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1398/2681] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:21:26 2022] GET /compute/v2.1/os-floating-ips => generated 144 bytes in 728 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:27.592316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a49abb06-a893-4e88-983b-280c3af565d3 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Calling method '.version_select at 0x7fda19258d30>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:27.776011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-29abc1fe-d132-411c-9ee2-4faeff522a0c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:27.776961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-29abc1fe-d132-411c-9ee2-4faeff522a0c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:27.803526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29abc1fe-d132-411c-9ee2-4faeff522a0c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:27.804858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29abc1fe-d132-411c-9ee2-4faeff522a0c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:27.805547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29abc1fe-d132-411c-9ee2-4faeff522a0c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:27.808592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29abc1fe-d132-411c-9ee2-4faeff522a0c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:27.809805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29abc1fe-d132-411c-9ee2-4faeff522a0c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:27.812277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29abc1fe-d132-411c-9ee2-4faeff522a0c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:28.656568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-29abc1fe-d132-411c-9ee2-4faeff522a0c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:28.677757 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-29abc1fe-d132-411c-9ee2-4faeff522a0c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1314 microversion: 2.1 time: 0.905865 Oct 11 04:21:28.680285 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1399/2682] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:27 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1314 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:28.690664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2834a3f0-06de-4aad-85de-b1b4bb33bd61 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:28.691577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2834a3f0-06de-4aad-85de-b1b4bb33bd61 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:28.701173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2834a3f0-06de-4aad-85de-b1b4bb33bd61 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:28.702895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2834a3f0-06de-4aad-85de-b1b4bb33bd61 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:28.705293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2834a3f0-06de-4aad-85de-b1b4bb33bd61 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:28.706766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2834a3f0-06de-4aad-85de-b1b4bb33bd61 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:28.707713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2834a3f0-06de-4aad-85de-b1b4bb33bd61 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:28.708351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2834a3f0-06de-4aad-85de-b1b4bb33bd61 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:29.016639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2834a3f0-06de-4aad-85de-b1b4bb33bd61 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:29.039477 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2834a3f0-06de-4aad-85de-b1b4bb33bd61 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1273 microversion: 2.1 time: 0.357379 Oct 11 04:21:29.040474 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1400/2683] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:28 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1273 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:29.251836 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a49abb06-a893-4e88-983b-280c3af565d3 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/099e214c-be14-48d3-a608-4fab4364afcc" status: 202 len: 0 microversion: 2.1 time: 1.666035 Oct 11 04:21:29.252619 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1284/2684] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:21:27 2022] DELETE /compute/v2.1/os-floating-ips/099e214c-be14-48d3-a608-4fab4364afcc => generated 0 bytes in 1668 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:21:29.262746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04931823-eb4c-4e3c-a4e8-2be652052cae tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Action: 'create', calling method: .version_select at 0x7fda19f48670>, body: {"pool": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:29.706011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f59d7246-8159-448c-805e-8eda74928331 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:29.707062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f59d7246-8159-448c-805e-8eda74928331 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:29.730327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f59d7246-8159-448c-805e-8eda74928331 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:29.731043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f59d7246-8159-448c-805e-8eda74928331 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:29.731558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f59d7246-8159-448c-805e-8eda74928331 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:29.735301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f59d7246-8159-448c-805e-8eda74928331 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:29.736272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f59d7246-8159-448c-805e-8eda74928331 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:29.736912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f59d7246-8159-448c-805e-8eda74928331 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:29.979104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f59d7246-8159-448c-805e-8eda74928331 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:29.992566 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f59d7246-8159-448c-805e-8eda74928331 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1314 microversion: 2.1 time: 0.289307 Oct 11 04:21:29.995094 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1285/2685] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:29 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:30.065252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4b153e86-0768-4e26-8ee8-c16cb751b2e9 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:30.066012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4b153e86-0768-4e26-8ee8-c16cb751b2e9 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:30.081284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b153e86-0768-4e26-8ee8-c16cb751b2e9 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:30.081980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b153e86-0768-4e26-8ee8-c16cb751b2e9 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:30.084088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b153e86-0768-4e26-8ee8-c16cb751b2e9 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:30.084911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b153e86-0768-4e26-8ee8-c16cb751b2e9 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:30.088491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b153e86-0768-4e26-8ee8-c16cb751b2e9 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:30.089069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b153e86-0768-4e26-8ee8-c16cb751b2e9 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:30.135331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:30.287633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4b153e86-0768-4e26-8ee8-c16cb751b2e9 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:30.300449 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4b153e86-0768-4e26-8ee8-c16cb751b2e9 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1329 microversion: 2.1 time: 0.239662 Oct 11 04:21:30.301764 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1286/2686] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:30 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1329 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:31.019270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-50bb0183-659f-463a-b97e-88411f0c0a94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:31.020236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-50bb0183-659f-463a-b97e-88411f0c0a94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:31.035742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50bb0183-659f-463a-b97e-88411f0c0a94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:31.036226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50bb0183-659f-463a-b97e-88411f0c0a94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:31.036661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50bb0183-659f-463a-b97e-88411f0c0a94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:31.039944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50bb0183-659f-463a-b97e-88411f0c0a94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:31.040612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50bb0183-659f-463a-b97e-88411f0c0a94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:31.041374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50bb0183-659f-463a-b97e-88411f0c0a94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:31.233279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-50bb0183-659f-463a-b97e-88411f0c0a94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:31.251445 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-50bb0183-659f-463a-b97e-88411f0c0a94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1314 microversion: 2.1 time: 0.236508 Oct 11 04:21:31.254977 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1287/2687] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:31 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:31.341250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ed9cbd14-7fb3-4beb-8ad3-730bc2c66923 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:31.343410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ed9cbd14-7fb3-4beb-8ad3-730bc2c66923 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:31.360996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed9cbd14-7fb3-4beb-8ad3-730bc2c66923 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:31.361924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed9cbd14-7fb3-4beb-8ad3-730bc2c66923 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:31.362915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed9cbd14-7fb3-4beb-8ad3-730bc2c66923 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:31.363626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed9cbd14-7fb3-4beb-8ad3-730bc2c66923 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:31.364079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed9cbd14-7fb3-4beb-8ad3-730bc2c66923 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:31.364500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed9cbd14-7fb3-4beb-8ad3-730bc2c66923 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:31.585080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ed9cbd14-7fb3-4beb-8ad3-730bc2c66923 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:31.601632 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ed9cbd14-7fb3-4beb-8ad3-730bc2c66923 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1327 microversion: 2.1 time: 0.260858 Oct 11 04:21:31.603811 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1288/2688] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:31 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1327 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:32.279166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1abc1ace-7dea-4daf-97f0-2f271e99cd2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:32.279748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1abc1ace-7dea-4daf-97f0-2f271e99cd2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:32.289947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1abc1ace-7dea-4daf-97f0-2f271e99cd2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:32.290756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1abc1ace-7dea-4daf-97f0-2f271e99cd2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:32.291446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1abc1ace-7dea-4daf-97f0-2f271e99cd2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:32.292916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1abc1ace-7dea-4daf-97f0-2f271e99cd2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:32.293634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1abc1ace-7dea-4daf-97f0-2f271e99cd2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:32.294457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1abc1ace-7dea-4daf-97f0-2f271e99cd2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:32.852020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1abc1ace-7dea-4daf-97f0-2f271e99cd2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:32.866995 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1abc1ace-7dea-4daf-97f0-2f271e99cd2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1314 microversion: 2.1 time: 0.591625 Oct 11 04:21:32.871680 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1289/2689] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:32 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1314 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:32.879212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dacff018-6aec-43af-b6d4-0786e30c72c2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:32.880259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dacff018-6aec-43af-b6d4-0786e30c72c2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:32.887414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacff018-6aec-43af-b6d4-0786e30c72c2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:32.888329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacff018-6aec-43af-b6d4-0786e30c72c2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:32.889346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacff018-6aec-43af-b6d4-0786e30c72c2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:32.891148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacff018-6aec-43af-b6d4-0786e30c72c2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:32.891826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacff018-6aec-43af-b6d4-0786e30c72c2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:32.892467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacff018-6aec-43af-b6d4-0786e30c72c2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:33.006798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dacff018-6aec-43af-b6d4-0786e30c72c2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:33.026742 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dacff018-6aec-43af-b6d4-0786e30c72c2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1327 microversion: 2.1 time: 0.153184 Oct 11 04:21:33.028012 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1290/2690] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:32 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1327 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:33.058721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-1085565417", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:33.119606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] validate_networks() for [('f32d817c-0e21-4ee5-826c-45c41a058063', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:21:34.875783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:21:34.878428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:21:34.878428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:21:34.878428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:21:34.878428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:21:34.897531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:34.898052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:34.898533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:34.899260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:34.899741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:34.900158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:34.981866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Getting quotas for project 9db178c528264083bfd30875291a1797. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:21:34.981866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Getting quotas for user 7c3e365e46be4bc2b83f09bf0ebd8efc and project 9db178c528264083bfd30875291a1797. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:21:34.981866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:21:34.981866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:21:35.142890 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6593cb68-a11e-4553-93ac-a612f114050e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.113332 Oct 11 04:21:35.144270 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1291/2691] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 2115 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:21:35.149309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ef40fa5-3713-4665-a09f-87e2cc7852ab tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:35.150317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5ef40fa5-3713-4665-a09f-87e2cc7852ab tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:35.160215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef40fa5-3713-4665-a09f-87e2cc7852ab tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:35.161142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef40fa5-3713-4665-a09f-87e2cc7852ab tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:35.161657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef40fa5-3713-4665-a09f-87e2cc7852ab tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:35.175735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef40fa5-3713-4665-a09f-87e2cc7852ab tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:35.175735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef40fa5-3713-4665-a09f-87e2cc7852ab tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:35.175735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ef40fa5-3713-4665-a09f-87e2cc7852ab tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:35.677565 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04931823-eb4c-4e3c-a4e8-2be652052cae tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 6.419470 Oct 11 04:21:35.679125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5ef40fa5-3713-4665-a09f-87e2cc7852ab tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:35.680184 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1401/2692] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:21:29 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 6422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:35.685852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc25a476-0e0c-4d7d-993a-d6d54ae44a6b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:35.689051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bc25a476-0e0c-4d7d-993a-d6d54ae44a6b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:35.695925 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ef40fa5-3713-4665-a09f-87e2cc7852ab tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1314 microversion: 2.1 time: 0.550423 Oct 11 04:21:35.696727 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1292/2693] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:35 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1314 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:35.705417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc25a476-0e0c-4d7d-993a-d6d54ae44a6b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:35.706177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc25a476-0e0c-4d7d-993a-d6d54ae44a6b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:35.707959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc25a476-0e0c-4d7d-993a-d6d54ae44a6b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:35.708849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f517c8c6-54a5-4d8d-a631-d0de9c4e98cf req-8cc3a8e1-f1de-465a-ad88-45f6abbe4a6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e48b394-ab48-46ff-803a-0f353c0fb99f", "name": "network-vif-plugged", "status": "completed", "tag": "d77b5617-1733-4606-b8bb-0c24ae6ead67"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:35.711180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc25a476-0e0c-4d7d-993a-d6d54ae44a6b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:35.711876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc25a476-0e0c-4d7d-993a-d6d54ae44a6b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:35.714230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc25a476-0e0c-4d7d-993a-d6d54ae44a6b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:35.733008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f517c8c6-54a5-4d8d-a631-d0de9c4e98cf req-8cc3a8e1-f1de-465a-ad88-45f6abbe4a6b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:35.737857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f517c8c6-54a5-4d8d-a631-d0de9c4e98cf req-8cc3a8e1-f1de-465a-ad88-45f6abbe4a6b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:35.738334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f517c8c6-54a5-4d8d-a631-d0de9c4e98cf req-8cc3a8e1-f1de-465a-ad88-45f6abbe4a6b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:35.787959 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f517c8c6-54a5-4d8d-a631-d0de9c4e98cf req-8cc3a8e1-f1de-465a-ad88-45f6abbe4a6b service nova] Creating event network-vif-plugged:d77b5617-1733-4606-b8bb-0c24ae6ead67 for instance 5e48b394-ab48-46ff-803a-0f353c0fb99f on n-h1-860892-1 Oct 11 04:21:35.808997 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f517c8c6-54a5-4d8d-a631-d0de9c4e98cf req-8cc3a8e1-f1de-465a-ad88-45f6abbe4a6b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109577 Oct 11 04:21:35.812658 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1293/2694] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:35.825770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b2266c4-e812-4feb-bae1-5a445028ff07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:35.826560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b2266c4-e812-4feb-bae1-5a445028ff07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:35.937124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b2266c4-e812-4feb-bae1-5a445028ff07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:35.942328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:35.953912 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b2266c4-e812-4feb-bae1-5a445028ff07 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1225 microversion: 2.1 time: 0.139847 Oct 11 04:21:35.958255 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1294/2695] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:35 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1225 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:35.971191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2319145a-e85e-4044-870a-fa723f609195 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] Calling method '.version_select at 0x7fda19b158b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:35.980111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=18 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:36.058519 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2319145a-e85e-4044-870a-fa723f609195 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/586580c6-e299-400a-bb70-dc4f0ff3207d" status: 200 len: 350 microversion: 2.1 time: 0.098544 Oct 11 04:21:36.069540 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1295/2696] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:21:35 2022] GET /compute/v2.1/os-volumes/586580c6-e299-400a-bb70-dc4f0ff3207d => generated 350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:36.082571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7857f432-3a0d-45db-ab1a-42cada5cf28c tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Calling method '.version_select at 0x7fda19a02160>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:36.310562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc25a476-0e0c-4d7d-993a-d6d54ae44a6b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:36.346395 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bc25a476-0e0c-4d7d-993a-d6d54ae44a6b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1394 microversion: 2.1 time: 0.660573 Oct 11 04:21:36.349081 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1402/2697] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:35 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1394 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:36.721037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-01c477c5-45cb-4efd-a966-9033f7ecf6a2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:36.721991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-01c477c5-45cb-4efd-a966-9033f7ecf6a2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:36.732058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c477c5-45cb-4efd-a966-9033f7ecf6a2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:36.733169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c477c5-45cb-4efd-a966-9033f7ecf6a2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:36.734412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c477c5-45cb-4efd-a966-9033f7ecf6a2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:36.735344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c477c5-45cb-4efd-a966-9033f7ecf6a2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:36.735996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c477c5-45cb-4efd-a966-9033f7ecf6a2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:36.736864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c477c5-45cb-4efd-a966-9033f7ecf6a2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:37.010044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-01c477c5-45cb-4efd-a966-9033f7ecf6a2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:37.022433 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-01c477c5-45cb-4efd-a966-9033f7ecf6a2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1314 microversion: 2.1 time: 0.304170 Oct 11 04:21:37.024002 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1403/2698] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:36 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1314 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:37.356663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-07241e33-dae4-4298-a92c-85f954a75c52 req-1230dec5-eb53-4ae9-8e54-a48860ed5638 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991871b9-cf55-45c9-8140-6e9e3b5c3ea1", "tag": "980ebd8a-8dff-4169-93c7-dda5438c46fa"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:37.389334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-07241e33-dae4-4298-a92c-85f954a75c52 req-1230dec5-eb53-4ae9-8e54-a48860ed5638 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:37.392549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-07241e33-dae4-4298-a92c-85f954a75c52 req-1230dec5-eb53-4ae9-8e54-a48860ed5638 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:37.395449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-07241e33-dae4-4298-a92c-85f954a75c52 req-1230dec5-eb53-4ae9-8e54-a48860ed5638 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:37.438236 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-07241e33-dae4-4298-a92c-85f954a75c52 req-1230dec5-eb53-4ae9-8e54-a48860ed5638 service nova] Creating event network-changed:980ebd8a-8dff-4169-93c7-dda5438c46fa for instance 991871b9-cf55-45c9-8140-6e9e3b5c3ea1 on n-h2-860892-1 Oct 11 04:21:37.463112 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-07241e33-dae4-4298-a92c-85f954a75c52 req-1230dec5-eb53-4ae9-8e54-a48860ed5638 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.428257 Oct 11 04:21:37.467176 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1404/2699] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:37.486512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7852ce11-3248-4221-b2f1-65bce9623807 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:37.500914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7852ce11-3248-4221-b2f1-65bce9623807 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:37.510364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7852ce11-3248-4221-b2f1-65bce9623807 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:37.511602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7852ce11-3248-4221-b2f1-65bce9623807 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:37.512784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7852ce11-3248-4221-b2f1-65bce9623807 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:37.514108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7852ce11-3248-4221-b2f1-65bce9623807 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:37.517666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7852ce11-3248-4221-b2f1-65bce9623807 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:37.518405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7852ce11-3248-4221-b2f1-65bce9623807 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:37.884082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7852ce11-3248-4221-b2f1-65bce9623807 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:37.900357 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7852ce11-3248-4221-b2f1-65bce9623807 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1221 microversion: 2.1 time: 0.430103 Oct 11 04:21:37.901200 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1405/2700] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:37 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1221 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:37.906259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c9ccc9f1-26f4-4961-8c9a-f9210dd1aa7f tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:37.908141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c9ccc9f1-26f4-4961-8c9a-f9210dd1aa7f tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:37.924345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ccc9f1-26f4-4961-8c9a-f9210dd1aa7f tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:37.925292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ccc9f1-26f4-4961-8c9a-f9210dd1aa7f tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:37.925979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ccc9f1-26f4-4961-8c9a-f9210dd1aa7f tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:37.926925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ccc9f1-26f4-4961-8c9a-f9210dd1aa7f tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:37.929466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ccc9f1-26f4-4961-8c9a-f9210dd1aa7f tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:37.930152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9ccc9f1-26f4-4961-8c9a-f9210dd1aa7f tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:38.677104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c9ccc9f1-26f4-4961-8c9a-f9210dd1aa7f tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:38.698939 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c9ccc9f1-26f4-4961-8c9a-f9210dd1aa7f tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1394 microversion: 2.1 time: 0.785271 Oct 11 04:21:38.701057 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1406/2701] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:37 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1394 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:38.795534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1987025707", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "5ff9bcca-b89a-450b-98cb-6e2aeae348c3"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:38.888917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] validate_networks() for [('5ff9bcca-b89a-450b-98cb-6e2aeae348c3', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:21:39.148992 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7857f432-3a0d-45db-ab1a-42cada5cf28c tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/37d9fc25-55f0-4dec-8b1a-5a51c71a028f" status: 202 len: 0 microversion: 2.1 time: 3.077352 Oct 11 04:21:39.155799 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1296/2702] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:21:36 2022] DELETE /compute/v2.1/os-floating-ips/37d9fc25-55f0-4dec-8b1a-5a51c71a028f => generated 0 bytes in 3086 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:21:39.167448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0980a1f4-0ed9-4a71-82b9-7eea05aa318c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:39.168492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0980a1f4-0ed9-4a71-82b9-7eea05aa318c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:39.178636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0980a1f4-0ed9-4a71-82b9-7eea05aa318c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:39.179453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0980a1f4-0ed9-4a71-82b9-7eea05aa318c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:39.180075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0980a1f4-0ed9-4a71-82b9-7eea05aa318c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:39.181098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0980a1f4-0ed9-4a71-82b9-7eea05aa318c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:39.181887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0980a1f4-0ed9-4a71-82b9-7eea05aa318c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:39.182675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0980a1f4-0ed9-4a71-82b9-7eea05aa318c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:39.393876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0980a1f4-0ed9-4a71-82b9-7eea05aa318c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:39.411334 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0980a1f4-0ed9-4a71-82b9-7eea05aa318c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1501 microversion: 2.1 time: 0.253515 Oct 11 04:21:39.414017 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1297/2703] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:39 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1501 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:39.418798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aa5214d4-d2b2-4f7a-be46-13c1bbc2142e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:39.421781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aa5214d4-d2b2-4f7a-be46-13c1bbc2142e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:39.439257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5214d4-d2b2-4f7a-be46-13c1bbc2142e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:39.439257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5214d4-d2b2-4f7a-be46-13c1bbc2142e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:39.439257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5214d4-d2b2-4f7a-be46-13c1bbc2142e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:39.440697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5214d4-d2b2-4f7a-be46-13c1bbc2142e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:39.441154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5214d4-d2b2-4f7a-be46-13c1bbc2142e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:39.441598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5214d4-d2b2-4f7a-be46-13c1bbc2142e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:39.586547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aa5214d4-d2b2-4f7a-be46-13c1bbc2142e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:39.595019 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aa5214d4-d2b2-4f7a-be46-13c1bbc2142e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1295 microversion: 2.1 time: 0.179728 Oct 11 04:21:39.597316 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1298/2704] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:39 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1295 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:39.603342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-861491c7-27a4-4f88-bb80-654bb10c680b tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Calling method '.version_select at 0x7fda19a025e0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:39.683627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-861491c7-27a4-4f88-bb80-654bb10c680b tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 37d9fc25-55f0-4dec-8b1a-5a51c71a028f could not be found", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:21:39.684324 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-861491c7-27a4-4f88-bb80-654bb10c680b tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] HTTP exception thrown: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-861491c7-27a4-4f88-bb80-654bb10c680b tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Request method failure captured: Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-floating-ips/37d9fc25-55f0-4dec-8b1a-5a51c71a028f HTTP/1.1 Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9A0o9CranKi8Da-zpNL7oG5EzpL3JWRF-ht_-WTf3E44hSok0vH5HVDe5kCfVWxvoDHJaBsGlvpKmlPfMtzpBeQuO90bCKXrGbvui01U7SfeAvQ6l19afTgu6JNe8IHcHTW01M5wMa-D-SsdQnlMEpu0UPSVaJ9TVTRjivFImiWBQ Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f35917382a4946e0b322fd6327715934 Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FloatingIPsTestJSON-670638058 Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f35917382a4946e0b322fd6327715934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f35917382a4946e0b322fd6327715934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f35917382a4946e0b322fd6327715934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f35917382a4946e0b322fd6327715934"}]}] Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FloatingIPsTestJSON-670638058 Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f35917382a4946e0b322fd6327715934 Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FloatingIPsTestJSON-670638058 Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FloatingIPsTestJSON-670638058-project Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 1245754e08cd4c65883c0488f8ab9c26 Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FloatingIPsTestJSON-670638058-project Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: exception: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '37d9fc25-55f0-4dec-8b1a-5a51c71a028f'} Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 37d9fc25-55f0-4dec-8b1a-5a51c71a028f could not be found Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-099e985d-3d8c-4946-a7a5-268ae0c56ca3'] Oct 11 04:21:39.686316 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 94, in show Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f. Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 97, in show Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f Oct 11 04:21:39.690666 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:39.695587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-861491c7-27a4-4f88-bb80-654bb10c680b tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Returning 404 to user: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:39.696846 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-861491c7-27a4-4f88-bb80-654bb10c680b tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/37d9fc25-55f0-4dec-8b1a-5a51c71a028f" status: 404 len: 111 microversion: 2.1 time: 0.098072 Oct 11 04:21:39.701241 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1299/2705] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:21:39 2022] GET /compute/v2.1/os-floating-ips/37d9fc25-55f0-4dec-8b1a-5a51c71a028f => generated 111 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:21:39.705960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd2b4090-dbf3-4af9-8da5-fca06ea97725 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:39.711885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd2b4090-dbf3-4af9-8da5-fca06ea97725 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:39.724231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b4090-dbf3-4af9-8da5-fca06ea97725 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:39.734822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b4090-dbf3-4af9-8da5-fca06ea97725 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:39.736291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b4090-dbf3-4af9-8da5-fca06ea97725 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:39.737488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b4090-dbf3-4af9-8da5-fca06ea97725 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:39.742153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b4090-dbf3-4af9-8da5-fca06ea97725 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:39.742854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b4090-dbf3-4af9-8da5-fca06ea97725 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:39.776854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd2b4090-dbf3-4af9-8da5-fca06ea97725 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:21:40.019465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:21:40.020007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:21:40.020434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:21:40.025378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:21:40.025378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:21:40.035846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:40.039042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:40.040518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:40.043912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:40.044443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:40.044892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:40.110562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Getting quotas for project 15b90becc5a545f0965359b05561721f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:21:40.125001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Getting quotas for user ea114683a3754c8197b61fc5ef04fe0d and project 15b90becc5a545f0965359b05561721f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:21:40.161480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:21:40.169880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:21:40.287589 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd2b4090-dbf3-4af9-8da5-fca06ea97725 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 204 len: 0 microversion: 2.1 time: 0.583998 Oct 11 04:21:40.291081 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1300/2706] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:21:39 2022] DELETE /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 0 bytes in 586 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:21:40.302129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f45ebd9-95bf-41a8-8a2e-5b3618b87d26 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Calling method '.version_select at 0x7fda19a02040>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:40.419205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-9f45ebd9-95bf-41a8-8a2e-5b3618b87d26 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Error message: {"NeutronError": {"type": "FloatingIPNotFound", "message": "Floating IP 37d9fc25-55f0-4dec-8b1a-5a51c71a028f could not be found", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:21:40.419968 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-9f45ebd9-95bf-41a8-8a2e-5b3618b87d26 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] HTTP exception thrown: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f45ebd9-95bf-41a8-8a2e-5b3618b87d26 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Request method failure captured: Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-floating-ips/37d9fc25-55f0-4dec-8b1a-5a51c71a028f HTTP/1.1 Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9A0o9CranKi8Da-zpNL7oG5EzpL3JWRF-ht_-WTf3E44hSok0vH5HVDe5kCfVWxvoDHJaBsGlvpKmlPfMtzpBeQuO90bCKXrGbvui01U7SfeAvQ6l19afTgu6JNe8IHcHTW01M5wMa-D-SsdQnlMEpu0UPSVaJ9TVTRjivFImiWBQ Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f35917382a4946e0b322fd6327715934 Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-FloatingIPsTestJSON-670638058 Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f35917382a4946e0b322fd6327715934"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f35917382a4946e0b322fd6327715934"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f35917382a4946e0b322fd6327715934"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f35917382a4946e0b322fd6327715934"}]}] Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-FloatingIPsTestJSON-670638058 Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f35917382a4946e0b322fd6327715934 Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-FloatingIPsTestJSON-670638058 Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-FloatingIPsTestJSON-670638058-project Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 1245754e08cd4c65883c0488f8ab9c26 Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-FloatingIPsTestJSON-670638058-project Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: exception: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '37d9fc25-55f0-4dec-8b1a-5a51c71a028f'} Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2824, in get_floating_ip Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi fip = client.show_floatingip(id)['floatingip'] Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1008, in show_floatingip Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.get(self.floatingip_path % (floatingip), params=_params) Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Floating IP 37d9fc25-55f0-4dec-8b1a-5a51c71a028f could not be found Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-54e4051b-a424-4783-bbb5-aa8fd97bbed1'] Oct 11 04:21:40.423598 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 158, in delete Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi floating_ip = self.network_api.get_floating_ip(context, id) Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 2827, in get_floating_ip Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.FloatingIpNotFound(id=id) Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.FloatingIpNotFound: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f. Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/floating_ips.py", line 161, in delete Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=msg) Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f45ebd9-95bf-41a8-8a2e-5b3618b87d26 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] Returning 404 to user: Floating IP not found for ID 37d9fc25-55f0-4dec-8b1a-5a51c71a028f {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:40.428202 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9f45ebd9-95bf-41a8-8a2e-5b3618b87d26 tempest-FloatingIPsTestJSON-670638058 tempest-FloatingIPsTestJSON-670638058-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/37d9fc25-55f0-4dec-8b1a-5a51c71a028f" status: 404 len: 111 microversion: 2.1 time: 0.132042 Oct 11 04:21:40.430491 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1301/2707] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:21:40 2022] DELETE /compute/v2.1/os-floating-ips/37d9fc25-55f0-4dec-8b1a-5a51c71a028f => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:21:40.445120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6d1e471f-cda7-41d5-aa5a-e64fac89adf7 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:40.447948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6d1e471f-cda7-41d5-aa5a-e64fac89adf7 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:40.448076 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-10d0d442-2f5a-4943-96d9-6c983597dd8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.743685 Oct 11 04:21:40.451715 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1407/2708] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 1750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:21:40.463877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f3bf0b0c-a36b-4cc9-8a2c-820013a9fc79 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] Calling method '.version_select at 0x7fda1df525e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:40.473171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d1e471f-cda7-41d5-aa5a-e64fac89adf7 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:40.473914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d1e471f-cda7-41d5-aa5a-e64fac89adf7 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:40.474555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d1e471f-cda7-41d5-aa5a-e64fac89adf7 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:40.475553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d1e471f-cda7-41d5-aa5a-e64fac89adf7 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:40.476157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d1e471f-cda7-41d5-aa5a-e64fac89adf7 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:40.477768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d1e471f-cda7-41d5-aa5a-e64fac89adf7 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:40.584677 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f3bf0b0c-a36b-4cc9-8a2c-820013a9fc79 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/8c9c5285-1ac9-4e06-b81f-e26d0fbf366d" status: 200 len: 350 microversion: 2.1 time: 0.126393 Oct 11 04:21:40.585258 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1408/2709] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:21:40 2022] GET /compute/v2.1/os-volumes/8c9c5285-1ac9-4e06-b81f-e26d0fbf366d => generated 350 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:40.590265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4fe67748-a94c-42ab-8c62-91508dd1e253 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:40.591065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4fe67748-a94c-42ab-8c62-91508dd1e253 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:40.609177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fe67748-a94c-42ab-8c62-91508dd1e253 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:40.609685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fe67748-a94c-42ab-8c62-91508dd1e253 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:40.610124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fe67748-a94c-42ab-8c62-91508dd1e253 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:40.610876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fe67748-a94c-42ab-8c62-91508dd1e253 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:40.611336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fe67748-a94c-42ab-8c62-91508dd1e253 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:40.611937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fe67748-a94c-42ab-8c62-91508dd1e253 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:41.194939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4fe67748-a94c-42ab-8c62-91508dd1e253 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:41.211068 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4fe67748-a94c-42ab-8c62-91508dd1e253 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1507 microversion: 2.1 time: 0.624531 Oct 11 04:21:41.211658 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1409/2710] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:40 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1507 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:41.216531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ac717cd6-297c-4688-8744-866314b0c302 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:41.217355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ac717cd6-297c-4688-8744-866314b0c302 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:41.324249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ac717cd6-297c-4688-8744-866314b0c302 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:41.337407 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ac717cd6-297c-4688-8744-866314b0c302 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1211 microversion: 2.1 time: 0.122043 Oct 11 04:21:41.340969 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1410/2711] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:41 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:41.351321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-61fc4a83-e5ba-4937-a421-f7699ab81250 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:41.352948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-61fc4a83-e5ba-4937-a421-f7699ab81250 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:41.396376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61fc4a83-e5ba-4937-a421-f7699ab81250 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:41.404015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61fc4a83-e5ba-4937-a421-f7699ab81250 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:41.409768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61fc4a83-e5ba-4937-a421-f7699ab81250 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:41.410660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61fc4a83-e5ba-4937-a421-f7699ab81250 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:41.411141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61fc4a83-e5ba-4937-a421-f7699ab81250 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:41.411577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61fc4a83-e5ba-4937-a421-f7699ab81250 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:41.795111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-61fc4a83-e5ba-4937-a421-f7699ab81250 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:41.819565 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-61fc4a83-e5ba-4937-a421-f7699ab81250 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1325 microversion: 2.1 time: 0.477193 Oct 11 04:21:41.831053 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1411/2712] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:41 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1325 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:42.096057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6d1e471f-cda7-41d5-aa5a-e64fac89adf7 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:42.112843 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6d1e471f-cda7-41d5-aa5a-e64fac89adf7 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1394 microversion: 2.1 time: 1.670746 Oct 11 04:21:42.113310 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1302/2713] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:40 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1394 bytes in 1683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:42.243711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72f4089f-a687-4558-b918-51aa618d77cd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:42.243711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72f4089f-a687-4558-b918-51aa618d77cd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:42.259714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72f4089f-a687-4558-b918-51aa618d77cd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:42.260288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72f4089f-a687-4558-b918-51aa618d77cd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:42.260741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72f4089f-a687-4558-b918-51aa618d77cd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:42.261474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72f4089f-a687-4558-b918-51aa618d77cd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:42.261928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72f4089f-a687-4558-b918-51aa618d77cd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:42.262568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72f4089f-a687-4558-b918-51aa618d77cd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:42.367654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9ffef667-a8b7-4ba4-9a19-977e137af365 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:42.368590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9ffef667-a8b7-4ba4-9a19-977e137af365 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:42.537188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9ffef667-a8b7-4ba4-9a19-977e137af365 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:42.566504 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9ffef667-a8b7-4ba4-9a19-977e137af365 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1211 microversion: 2.1 time: 0.186443 Oct 11 04:21:42.570659 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1303/2714] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:42 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1211 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:42.657344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72f4089f-a687-4558-b918-51aa618d77cd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:42.668842 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72f4089f-a687-4558-b918-51aa618d77cd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1507 microversion: 2.1 time: 0.431967 Oct 11 04:21:42.669957 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1412/2715] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:42 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1507 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:42.855375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a49fd082-a8f6-4652-b386-cf34353dd038 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:42.856293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a49fd082-a8f6-4652-b386-cf34353dd038 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:42.861015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:42.869758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a49fd082-a8f6-4652-b386-cf34353dd038 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:42.870286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a49fd082-a8f6-4652-b386-cf34353dd038 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:42.870733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a49fd082-a8f6-4652-b386-cf34353dd038 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:42.871447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a49fd082-a8f6-4652-b386-cf34353dd038 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:42.871906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a49fd082-a8f6-4652-b386-cf34353dd038 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:42.872335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a49fd082-a8f6-4652-b386-cf34353dd038 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:43.129859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4767a14d-2437-4a23-b0fa-740f3d2699e8 req-1be40f94-2b62-4fb6-a795-73184ec84dba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871b9-cf55-45c9-8140-6e9e3b5c3ea1", "name": "network-vif-plugged", "status": "completed", "tag": "980ebd8a-8dff-4169-93c7-dda5438c46fa"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:43.152312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4767a14d-2437-4a23-b0fa-740f3d2699e8 req-1be40f94-2b62-4fb6-a795-73184ec84dba service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:43.153290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4767a14d-2437-4a23-b0fa-740f3d2699e8 req-1be40f94-2b62-4fb6-a795-73184ec84dba service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:43.154074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4767a14d-2437-4a23-b0fa-740f3d2699e8 req-1be40f94-2b62-4fb6-a795-73184ec84dba service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:43.198958 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4767a14d-2437-4a23-b0fa-740f3d2699e8 req-1be40f94-2b62-4fb6-a795-73184ec84dba service nova] Creating event network-vif-plugged:980ebd8a-8dff-4169-93c7-dda5438c46fa for instance 991871b9-cf55-45c9-8140-6e9e3b5c3ea1 on n-h2-860892-1 Oct 11 04:21:43.206078 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4767a14d-2437-4a23-b0fa-740f3d2699e8 req-1be40f94-2b62-4fb6-a795-73184ec84dba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080028 Oct 11 04:21:43.207569 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1413/2716] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:21:43.255866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-612f02ef-d3df-4825-ae72-c9f1bdb5df75 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:43.258386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-612f02ef-d3df-4825-ae72-c9f1bdb5df75 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:43.280765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-612f02ef-d3df-4825-ae72-c9f1bdb5df75 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:43.299019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-612f02ef-d3df-4825-ae72-c9f1bdb5df75 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:43.302474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-612f02ef-d3df-4825-ae72-c9f1bdb5df75 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:43.303445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-612f02ef-d3df-4825-ae72-c9f1bdb5df75 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:43.304073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-612f02ef-d3df-4825-ae72-c9f1bdb5df75 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:43.307399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-612f02ef-d3df-4825-ae72-c9f1bdb5df75 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:43.705622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-612f02ef-d3df-4825-ae72-c9f1bdb5df75 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:43.723094 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-612f02ef-d3df-4825-ae72-c9f1bdb5df75 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1394 microversion: 2.1 time: 0.512559 Oct 11 04:21:43.725039 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1414/2717] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:43 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1394 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:43.748799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6c5a5a3-179d-486b-99e4-0ada0b991c8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:43.749594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6c5a5a3-179d-486b-99e4-0ada0b991c8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:43.757129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c5a5a3-179d-486b-99e4-0ada0b991c8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:43.757870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c5a5a3-179d-486b-99e4-0ada0b991c8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:43.758532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c5a5a3-179d-486b-99e4-0ada0b991c8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:43.759854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c5a5a3-179d-486b-99e4-0ada0b991c8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:43.760900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c5a5a3-179d-486b-99e4-0ada0b991c8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:43.761576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c5a5a3-179d-486b-99e4-0ada0b991c8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:43.872298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a49fd082-a8f6-4652-b386-cf34353dd038 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:43.884329 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a49fd082-a8f6-4652-b386-cf34353dd038 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1325 microversion: 2.1 time: 1.032988 Oct 11 04:21:43.886791 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1304/2718] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:42 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1325 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:43.894085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f9b17d32-2778-46da-bd93-d5a60024a744 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:43.895151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f9b17d32-2778-46da-bd93-d5a60024a744 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:43.911647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9b17d32-2778-46da-bd93-d5a60024a744 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:43.912475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9b17d32-2778-46da-bd93-d5a60024a744 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:43.913130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9b17d32-2778-46da-bd93-d5a60024a744 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:43.914178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9b17d32-2778-46da-bd93-d5a60024a744 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:43.915007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9b17d32-2778-46da-bd93-d5a60024a744 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:43.915779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9b17d32-2778-46da-bd93-d5a60024a744 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:44.223022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6c5a5a3-179d-486b-99e4-0ada0b991c8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:44.225393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f9b17d32-2778-46da-bd93-d5a60024a744 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:44.232081 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6c5a5a3-179d-486b-99e4-0ada0b991c8a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1263 microversion: 2.1 time: 0.488132 Oct 11 04:21:44.238156 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f9b17d32-2778-46da-bd93-d5a60024a744 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1465 microversion: 2.1 time: 0.348678 Oct 11 04:21:44.239022 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1305/2719] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:43 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1465 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:44.258345 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1415/2720] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:43 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1263 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:44.258345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5470b848-43fc-433b-ac4f-8bb4ee2073cc tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] Calling method '.version_select at 0x7fda193ceb80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:44.279911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-027fed4b-af8f-45c5-97ea-7ad01cc2447f req-6d819f11-9302-4a79-9712-fd77810b98f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e48b394-ab48-46ff-803a-0f353c0fb99f", "name": "network-vif-deleted", "tag": "d77b5617-1733-4606-b8bb-0c24ae6ead67"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:44.298454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-027fed4b-af8f-45c5-97ea-7ad01cc2447f req-6d819f11-9302-4a79-9712-fd77810b98f8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:44.298932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-027fed4b-af8f-45c5-97ea-7ad01cc2447f req-6d819f11-9302-4a79-9712-fd77810b98f8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:44.299388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-027fed4b-af8f-45c5-97ea-7ad01cc2447f req-6d819f11-9302-4a79-9712-fd77810b98f8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:44.314399 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-027fed4b-af8f-45c5-97ea-7ad01cc2447f req-6d819f11-9302-4a79-9712-fd77810b98f8 service nova] Creating event network-vif-deleted:d77b5617-1733-4606-b8bb-0c24ae6ead67 for instance 5e48b394-ab48-46ff-803a-0f353c0fb99f on n-h1-860892-1 Oct 11 04:21:44.320321 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-027fed4b-af8f-45c5-97ea-7ad01cc2447f req-6d819f11-9302-4a79-9712-fd77810b98f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067119 Oct 11 04:21:44.325806 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1306/2721] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:44.326254 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5470b848-43fc-433b-ac4f-8bb4ee2073cc tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/dc0e29b3-23e1-4c87-9af0-1b5fb624bbf1" status: 200 len: 350 microversion: 2.1 time: 0.085382 Oct 11 04:21:44.326950 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1416/2722] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:21:44 2022] GET /compute/v2.1/os-volumes/dc0e29b3-23e1-4c87-9af0-1b5fb624bbf1 => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:44.341049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3e76d2a8-ac4b-4eb2-a778-1e4d8e54c9fa tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] Calling method '.version_select at 0x7fda19266430>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:44.444841 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3e76d2a8-ac4b-4eb2-a778-1e4d8e54c9fa tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.108097 Oct 11 04:21:44.445415 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1307/2723] 10.222.0.26 () {58 vars in 1134 bytes} [Tue Oct 11 04:21:44 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:44.461779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90f96d73-cb93-4bda-b304-8f05627b882b tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] Calling method '.version_select at 0x7fda194ef5e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:44.586148 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90f96d73-cb93-4bda-b304-8f05627b882b tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.129977 Oct 11 04:21:44.586764 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1417/2724] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:21:44 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:44.611745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-789e69ae-9d33-488e-a06f-b17a6f9cef60 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] Calling method '.version_select at 0x7fda192c7430>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:44.747266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4e60a0b2-910f-434b-90de-6f6f449d024a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:44.748019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4e60a0b2-910f-434b-90de-6f6f449d024a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:44.756902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e60a0b2-910f-434b-90de-6f6f449d024a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:44.757401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e60a0b2-910f-434b-90de-6f6f449d024a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:44.757842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e60a0b2-910f-434b-90de-6f6f449d024a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:44.764063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e60a0b2-910f-434b-90de-6f6f449d024a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:44.764591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e60a0b2-910f-434b-90de-6f6f449d024a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:44.765246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e60a0b2-910f-434b-90de-6f6f449d024a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:44.790313 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-789e69ae-9d33-488e-a06f-b17a6f9cef60 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.192812 Oct 11 04:21:44.800508 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1308/2725] 10.222.0.26 () {58 vars in 1134 bytes} [Tue Oct 11 04:21:44 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:44.821036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92710998-228d-438e-b988-e5ea5bf2f195 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] Calling method '.version_select at 0x7fda19380040>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:44.912206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:44.970307 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92710998-228d-438e-b988-e5ea5bf2f195 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.167675 Oct 11 04:21:44.971452 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1309/2726] 10.222.0.26 () {58 vars in 1167 bytes} [Tue Oct 11 04:21:44 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:21:44.980510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c4025b40-7b5f-4ea8-857c-428aacb2091f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:44.988782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c4025b40-7b5f-4ea8-857c-428aacb2091f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:45.009264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4025b40-7b5f-4ea8-857c-428aacb2091f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:45.009798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4025b40-7b5f-4ea8-857c-428aacb2091f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:45.016619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4025b40-7b5f-4ea8-857c-428aacb2091f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:45.019227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4025b40-7b5f-4ea8-857c-428aacb2091f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:45.019775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4025b40-7b5f-4ea8-857c-428aacb2091f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:45.020218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4025b40-7b5f-4ea8-857c-428aacb2091f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:45.078005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4e60a0b2-910f-434b-90de-6f6f449d024a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:45.090241 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4e60a0b2-910f-434b-90de-6f6f449d024a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1394 microversion: 2.1 time: 0.346794 Oct 11 04:21:45.102631 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1418/2727] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:44 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1394 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:45.112711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee207d33-42bf-4f18-aea6-881f34a6086a tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] Calling method '.version_select at 0x7fda194ef8b0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:45.212392 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee207d33-42bf-4f18-aea6-881f34a6086a tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.108286 Oct 11 04:21:45.213452 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1419/2728] 10.222.0.26 () {58 vars in 1170 bytes} [Tue Oct 11 04:21:45 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:45.228397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f2b8342d-84d6-48a4-a3c0-b7dcce5a9fbb tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] Calling method '.version_select at 0x7fda1a0bd0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:45.365583 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f2b8342d-84d6-48a4-a3c0-b7dcce5a9fbb tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.141181 Oct 11 04:21:45.366786 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1420/2729] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:21:45 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:45.371795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:45.380987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:45.424881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:45.425920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:45.426610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:45.429438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:45.429924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:45.430422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:45.484963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:45.487304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:45.487304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:45.488007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lazy-loading 'fault' on Instance uuid 5e48b394-ab48-46ff-803a-0f353c0fb99f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:21:45.708037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:45.720110 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-09814edb-f5e0-4cbb-a2fd-1214a3f9cb39 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 200 len: 1304 microversion: 2.1 time: 0.351880 Oct 11 04:21:45.721029 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1421/2730] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:45 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 1304 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:45.726466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-968aae8a-9513-4333-a6a8-4131044a94e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:45.727750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-968aae8a-9513-4333-a6a8-4131044a94e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:45.735728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-968aae8a-9513-4333-a6a8-4131044a94e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:45.736554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-968aae8a-9513-4333-a6a8-4131044a94e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:45.737599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-968aae8a-9513-4333-a6a8-4131044a94e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:45.738594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-968aae8a-9513-4333-a6a8-4131044a94e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:45.739287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-968aae8a-9513-4333-a6a8-4131044a94e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:45.741058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-968aae8a-9513-4333-a6a8-4131044a94e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:45.867692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-968aae8a-9513-4333-a6a8-4131044a94e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:45.885180 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-968aae8a-9513-4333-a6a8-4131044a94e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1269 microversion: 2.1 time: 0.160310 Oct 11 04:21:45.886079 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1422/2731] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:45 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:45.901287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9fd260ca-de2e-4592-aa03-136766e94c08 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] Calling method '.version_select at 0x7fda193cef70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:46.037321 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9fd260ca-de2e-4592-aa03-136766e94c08 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.149957 Oct 11 04:21:46.037897 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1423/2732] 10.222.0.26 () {58 vars in 1188 bytes} [Tue Oct 11 04:21:45 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:46.054321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-357b83fc-196c-4963-b7d7-7dff82bee0a9 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] Calling method '.version_select at 0x7fda19411b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:46.204250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c4025b40-7b5f-4ea8-857c-428aacb2091f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:46.223273 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c4025b40-7b5f-4ea8-857c-428aacb2091f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1325 microversion: 2.1 time: 1.248448 Oct 11 04:21:46.241372 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1310/2733] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:44 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1325 bytes in 1263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:46.241536 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-357b83fc-196c-4963-b7d7-7dff82bee0a9 tempest-VolumesTestJSON-1780263178 tempest-VolumesTestJSON-1780263178-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.189942 Oct 11 04:21:46.241536 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1424/2734] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:21:46 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:46.245459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-61558d1c-3df4-46f5-bb29-856a55f5534e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:46.246068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-61558d1c-3df4-46f5-bb29-856a55f5534e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:46.281905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61558d1c-3df4-46f5-bb29-856a55f5534e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:46.284055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61558d1c-3df4-46f5-bb29-856a55f5534e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:46.287142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61558d1c-3df4-46f5-bb29-856a55f5534e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:46.288097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61558d1c-3df4-46f5-bb29-856a55f5534e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:46.289257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61558d1c-3df4-46f5-bb29-856a55f5534e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:46.290507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61558d1c-3df4-46f5-bb29-856a55f5534e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:46.601426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-61558d1c-3df4-46f5-bb29-856a55f5534e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:46.606939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:46.613634 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-61558d1c-3df4-46f5-bb29-856a55f5534e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1575 microversion: 2.1 time: 0.371542 Oct 11 04:21:46.622263 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1425/2735] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:46 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1575 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:46.645271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6164b6a9-d5e2-4c12-9913-b0ae028e1c6a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:46.645778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6164b6a9-d5e2-4c12-9913-b0ae028e1c6a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:46.662888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6164b6a9-d5e2-4c12-9913-b0ae028e1c6a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:46.664586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6164b6a9-d5e2-4c12-9913-b0ae028e1c6a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:46.666471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6164b6a9-d5e2-4c12-9913-b0ae028e1c6a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:46.670751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6164b6a9-d5e2-4c12-9913-b0ae028e1c6a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:46.671949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6164b6a9-d5e2-4c12-9913-b0ae028e1c6a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:46.673354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6164b6a9-d5e2-4c12-9913-b0ae028e1c6a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:46.730436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-8babb68a-32ce-453a-9115-16aa858c70cf req-eb1e0b59-ff7e-4f92-8af9-e2e2d2266459 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe7a86c0-79fe-4793-a20f-c2c2f7872228", "tag": "6ff409cf-6662-4dac-a448-46e41118ee89"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:46.758804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8babb68a-32ce-453a-9115-16aa858c70cf req-eb1e0b59-ff7e-4f92-8af9-e2e2d2266459 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:46.759562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8babb68a-32ce-453a-9115-16aa858c70cf req-eb1e0b59-ff7e-4f92-8af9-e2e2d2266459 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:46.761551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8babb68a-32ce-453a-9115-16aa858c70cf req-eb1e0b59-ff7e-4f92-8af9-e2e2d2266459 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:46.784826 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8babb68a-32ce-453a-9115-16aa858c70cf req-eb1e0b59-ff7e-4f92-8af9-e2e2d2266459 service nova] Creating event network-changed:6ff409cf-6662-4dac-a448-46e41118ee89 for instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 on n-h2-860892-1 Oct 11 04:21:46.791336 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-8babb68a-32ce-453a-9115-16aa858c70cf req-eb1e0b59-ff7e-4f92-8af9-e2e2d2266459 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065382 Oct 11 04:21:46.792276 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1426/2736] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:21:46.802363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:46.803166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:46.811139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:46.811556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:46.811992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:46.812767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:46.813290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:46.813717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:46.833104 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f HTTP/1.1 Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '5e48b394-ab48-46ff-803a-0f353c0fb99f'} Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:46.835857 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:46.840319 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:46.840319 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:46.840319 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:46.840319 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:21:46.840319 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:21:46.840319 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:21:46.840319 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:21:46.840319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:46.840319 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-98c152fd-2a99-4c28-bc55-764022850107 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 404 len: 111 microversion: 2.1 time: 0.043997 Oct 11 04:21:46.846877 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1427/2737] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:46 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:21:46.910566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-339473d0-4b32-4849-8d77-cf0835830c3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:46.911705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-339473d0-4b32-4849-8d77-cf0835830c3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:46.924789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-339473d0-4b32-4849-8d77-cf0835830c3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:46.925657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-339473d0-4b32-4849-8d77-cf0835830c3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:46.926794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-339473d0-4b32-4849-8d77-cf0835830c3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:46.929355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-339473d0-4b32-4849-8d77-cf0835830c3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:46.930818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-339473d0-4b32-4849-8d77-cf0835830c3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:46.931484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-339473d0-4b32-4849-8d77-cf0835830c3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:47.072455 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6164b6a9-d5e2-4c12-9913-b0ae028e1c6a tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.432019 Oct 11 04:21:47.074030 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1311/2738] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:21:46 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1/os-interface => generated 285 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:47.080064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-944108148", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "eb00258c-33f3-4e50-9b19-bfa956507201"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:47.178703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] validate_networks() for [('eb00258c-33f3-4e50-9b19-bfa956507201', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:21:47.205705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-339473d0-4b32-4849-8d77-cf0835830c3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:47.215164 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-339473d0-4b32-4849-8d77-cf0835830c3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1269 microversion: 2.1 time: 0.309124 Oct 11 04:21:47.232564 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1428/2739] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:46 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1269 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:47.249664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b78215e-a155-4227-9a8d-4fd25c7e291d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:47.250310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b78215e-a155-4227-9a8d-4fd25c7e291d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:47.265039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b78215e-a155-4227-9a8d-4fd25c7e291d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:47.265679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b78215e-a155-4227-9a8d-4fd25c7e291d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:47.266128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b78215e-a155-4227-9a8d-4fd25c7e291d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:47.267023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b78215e-a155-4227-9a8d-4fd25c7e291d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:47.267484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b78215e-a155-4227-9a8d-4fd25c7e291d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:47.267921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b78215e-a155-4227-9a8d-4fd25c7e291d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:48.081368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b78215e-a155-4227-9a8d-4fd25c7e291d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:48.150886 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b78215e-a155-4227-9a8d-4fd25c7e291d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1325 microversion: 2.1 time: 0.901860 Oct 11 04:21:48.172631 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1429/2740] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:47 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1325 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:48.241475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c883a753-6c87-4c2b-8694-40251b5f9e2b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:48.242344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c883a753-6c87-4c2b-8694-40251b5f9e2b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:48.257118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c883a753-6c87-4c2b-8694-40251b5f9e2b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:48.259224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c883a753-6c87-4c2b-8694-40251b5f9e2b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:48.260152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c883a753-6c87-4c2b-8694-40251b5f9e2b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:48.261035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c883a753-6c87-4c2b-8694-40251b5f9e2b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:48.263204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c883a753-6c87-4c2b-8694-40251b5f9e2b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:48.270135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c883a753-6c87-4c2b-8694-40251b5f9e2b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:49.013147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c883a753-6c87-4c2b-8694-40251b5f9e2b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:49.026489 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c883a753-6c87-4c2b-8694-40251b5f9e2b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1311 microversion: 2.1 time: 0.790458 Oct 11 04:21:49.027094 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1430/2741] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:48 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1311 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:49.181446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ef0d3dd-0302-46a8-82ca-9e39e65e9d86 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:49.183225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4ef0d3dd-0302-46a8-82ca-9e39e65e9d86 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:49.194233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ef0d3dd-0302-46a8-82ca-9e39e65e9d86 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:49.197285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:21:49.197757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:21:49.198161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:21:49.198602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:21:49.199015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:21:49.199402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ef0d3dd-0302-46a8-82ca-9e39e65e9d86 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:49.200080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ef0d3dd-0302-46a8-82ca-9e39e65e9d86 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:49.201632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ef0d3dd-0302-46a8-82ca-9e39e65e9d86 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:49.203971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ef0d3dd-0302-46a8-82ca-9e39e65e9d86 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:49.204479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ef0d3dd-0302-46a8-82ca-9e39e65e9d86 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:49.213903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:49.215151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:49.215892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:49.216938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:49.218061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:49.219707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:49.247817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:21:49.255741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for user 99027798dcba4d52a9efc682ccc973d3 and project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:21:49.272682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:21:49.275266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:21:49.617432 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dd2a53ad-a0d4-4ce7-9b24-a11ed8b1a258 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.541952 Oct 11 04:21:49.618092 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1312/2742] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 2543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:21:49.634354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ed72b9f8-d789-40a0-b575-133860409112 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:49.641866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ed72b9f8-d789-40a0-b575-133860409112 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:49.683317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ef0d3dd-0302-46a8-82ca-9e39e65e9d86 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:49.692448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ef0d3dd-0302-46a8-82ca-9e39e65e9d86 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1325 microversion: 2.1 time: 0.515704 Oct 11 04:21:49.703700 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1431/2743] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:49 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1325 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:49.979941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ed72b9f8-d789-40a0-b575-133860409112 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:49.995254 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ed72b9f8-d789-40a0-b575-133860409112 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1214 microversion: 2.1 time: 0.363935 Oct 11 04:21:49.996512 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1313/2744] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:49 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1214 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:50.052695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1da8744-2723-49c4-8ee1-266f586c3a98 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:50.053411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b1da8744-2723-49c4-8ee1-266f586c3a98 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:50.066218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1da8744-2723-49c4-8ee1-266f586c3a98 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:50.068367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1da8744-2723-49c4-8ee1-266f586c3a98 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:50.069030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1da8744-2723-49c4-8ee1-266f586c3a98 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:50.071555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1da8744-2723-49c4-8ee1-266f586c3a98 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:50.076226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1da8744-2723-49c4-8ee1-266f586c3a98 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:50.076226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1da8744-2723-49c4-8ee1-266f586c3a98 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:50.083788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:50.418328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-109637117", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "0a59a6a9-e422-43ce-a186-e7294a4957eb"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:50.562072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] validate_networks() for [('0a59a6a9-e422-43ce-a186-e7294a4957eb', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:21:51.047903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b1da8744-2723-49c4-8ee1-266f586c3a98 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:51.066731 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b1da8744-2723-49c4-8ee1-266f586c3a98 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1311 microversion: 2.1 time: 1.008160 Oct 11 04:21:51.067412 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1432/2745] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:50 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1311 bytes in 1019 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:51.080802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-84f39eb6-ed0a-4e71-9075-3a1bd66c544d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:51.085916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-84f39eb6-ed0a-4e71-9075-3a1bd66c544d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:51.117306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84f39eb6-ed0a-4e71-9075-3a1bd66c544d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:51.118462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84f39eb6-ed0a-4e71-9075-3a1bd66c544d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:51.119488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84f39eb6-ed0a-4e71-9075-3a1bd66c544d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:51.121672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84f39eb6-ed0a-4e71-9075-3a1bd66c544d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:51.125257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84f39eb6-ed0a-4e71-9075-3a1bd66c544d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:51.129191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84f39eb6-ed0a-4e71-9075-3a1bd66c544d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:51.330030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:51.627667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:21:51.628281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:21:51.629170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:21:51.629693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:21:51.630277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:21:51.641118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:51.641776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:51.642346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:51.643286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:51.643863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:51.644426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:51.716028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Getting quotas for project 8a50d14bbe2e4b71ac79bc37ac0ed812. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:21:51.727457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Getting quotas for user 7ade698487d7495d9e10cd7ab92d62a5 and project 8a50d14bbe2e4b71ac79bc37ac0ed812. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:21:51.772532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:21:51.778415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:21:51.969704 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-07f0a441-e043-4aa8-a7c5-2eb552bff180 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.651690 Oct 11 04:21:51.979924 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1314/2746] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:21:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:21:51.997277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6fdf2a27-b315-4252-887f-e387c43bfdad tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:52.015110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6fdf2a27-b315-4252-887f-e387c43bfdad tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:52.028346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fdf2a27-b315-4252-887f-e387c43bfdad tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:52.029683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fdf2a27-b315-4252-887f-e387c43bfdad tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:52.030427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fdf2a27-b315-4252-887f-e387c43bfdad tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:52.034250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fdf2a27-b315-4252-887f-e387c43bfdad tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:52.034250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fdf2a27-b315-4252-887f-e387c43bfdad tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:52.034250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fdf2a27-b315-4252-887f-e387c43bfdad tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:52.068269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:52.217868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6fdf2a27-b315-4252-887f-e387c43bfdad tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:52.229891 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6fdf2a27-b315-4252-887f-e387c43bfdad tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1210 microversion: 2.1 time: 0.248412 Oct 11 04:21:52.239639 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1315/2747] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:51 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1210 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:52.248165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2c823516-dd22-4260-93e6-16833499b868 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:52.249070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2c823516-dd22-4260-93e6-16833499b868 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:52.252125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-84f39eb6-ed0a-4e71-9075-3a1bd66c544d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:52.262849 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-84f39eb6-ed0a-4e71-9075-3a1bd66c544d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1325 microversion: 2.1 time: 1.193837 Oct 11 04:21:52.263675 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1433/2748] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:51 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1325 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:52.269441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c823516-dd22-4260-93e6-16833499b868 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:52.282330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c823516-dd22-4260-93e6-16833499b868 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:52.282330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c823516-dd22-4260-93e6-16833499b868 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:52.282330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c823516-dd22-4260-93e6-16833499b868 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:52.282330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c823516-dd22-4260-93e6-16833499b868 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:52.282330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c823516-dd22-4260-93e6-16833499b868 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:52.309959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-74d6b286-2a21-4e06-beab-6315530406a1 req-b84b7a4e-a1bd-4b90-866a-28b97ad0cde9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "991871b9-cf55-45c9-8140-6e9e3b5c3ea1", "tag": "980ebd8a-8dff-4169-93c7-dda5438c46fa"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:52.348382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-74d6b286-2a21-4e06-beab-6315530406a1 req-b84b7a4e-a1bd-4b90-866a-28b97ad0cde9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:52.349945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-74d6b286-2a21-4e06-beab-6315530406a1 req-b84b7a4e-a1bd-4b90-866a-28b97ad0cde9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:52.351032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-74d6b286-2a21-4e06-beab-6315530406a1 req-b84b7a4e-a1bd-4b90-866a-28b97ad0cde9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:52.385658 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-74d6b286-2a21-4e06-beab-6315530406a1 req-b84b7a4e-a1bd-4b90-866a-28b97ad0cde9 service nova] Creating event network-changed:980ebd8a-8dff-4169-93c7-dda5438c46fa for instance 991871b9-cf55-45c9-8140-6e9e3b5c3ea1 on n-h2-860892-1 Oct 11 04:21:52.398579 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-74d6b286-2a21-4e06-beab-6315530406a1 req-b84b7a4e-a1bd-4b90-866a-28b97ad0cde9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.131666 Oct 11 04:21:52.405335 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1434/2749] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:52.421549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-0d35b60f-ba2f-42f0-be29-4aee7a5a6571 req-5534e169-7451-4e71-ab09-afa622df4230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec21f97-4e31-411a-90c9-19c8ad94693f", "tag": "bf241d38-0545-4589-afea-60551eb1c3e1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:52.445580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:52.449921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0d35b60f-ba2f-42f0-be29-4aee7a5a6571 req-5534e169-7451-4e71-ab09-afa622df4230 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:52.453878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0d35b60f-ba2f-42f0-be29-4aee7a5a6571 req-5534e169-7451-4e71-ab09-afa622df4230 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:52.455635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0d35b60f-ba2f-42f0-be29-4aee7a5a6571 req-5534e169-7451-4e71-ab09-afa622df4230 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:52.493899 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-0d35b60f-ba2f-42f0-be29-4aee7a5a6571 req-5534e169-7451-4e71-ab09-afa622df4230 service nova] Creating event network-changed:bf241d38-0545-4589-afea-60551eb1c3e1 for instance 7ec21f97-4e31-411a-90c9-19c8ad94693f on n-h1-860892-1 Oct 11 04:21:52.505477 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-0d35b60f-ba2f-42f0-be29-4aee7a5a6571 req-5534e169-7451-4e71-ab09-afa622df4230 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098331 Oct 11 04:21:52.508297 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1435/2750] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:52.523354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7c13b3f9-518d-42e3-938e-6d8651fad4d1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:52.526359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7c13b3f9-518d-42e3-938e-6d8651fad4d1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:52.766382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7c13b3f9-518d-42e3-938e-6d8651fad4d1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:52.774364 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7c13b3f9-518d-42e3-938e-6d8651fad4d1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1207 microversion: 2.1 time: 0.263694 Oct 11 04:21:52.778860 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1436/2751] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:52 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1207 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:52.788576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e722a8c3-b5e8-4875-83d4-86d13a19703a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:52.791845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e722a8c3-b5e8-4875-83d4-86d13a19703a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:52.808079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e722a8c3-b5e8-4875-83d4-86d13a19703a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:52.808963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e722a8c3-b5e8-4875-83d4-86d13a19703a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:52.810781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e722a8c3-b5e8-4875-83d4-86d13a19703a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:52.812017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e722a8c3-b5e8-4875-83d4-86d13a19703a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:52.818319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e722a8c3-b5e8-4875-83d4-86d13a19703a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:52.819036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e722a8c3-b5e8-4875-83d4-86d13a19703a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:52.846939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c823516-dd22-4260-93e6-16833499b868 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:52.856645 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2c823516-dd22-4260-93e6-16833499b868 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1575 microversion: 2.1 time: 0.619043 Oct 11 04:21:52.857828 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1316/2752] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:52 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1575 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:53.260954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2c2749df-52c7-4a77-856a-0f31b2099561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:53.261948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2c2749df-52c7-4a77-856a-0f31b2099561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:53.295990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c2749df-52c7-4a77-856a-0f31b2099561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:53.295990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c2749df-52c7-4a77-856a-0f31b2099561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:53.295990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c2749df-52c7-4a77-856a-0f31b2099561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:53.296416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c2749df-52c7-4a77-856a-0f31b2099561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:53.298350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c2749df-52c7-4a77-856a-0f31b2099561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:53.298825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c2749df-52c7-4a77-856a-0f31b2099561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:53.408258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e722a8c3-b5e8-4875-83d4-86d13a19703a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:53.416684 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e722a8c3-b5e8-4875-83d4-86d13a19703a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1311 microversion: 2.1 time: 0.635885 Oct 11 04:21:53.421803 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1437/2753] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:52 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1311 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:53.433697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49a40fec-1020-49af-b881-71e304d4a70b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:53.437042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-49a40fec-1020-49af-b881-71e304d4a70b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:53.452346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49a40fec-1020-49af-b881-71e304d4a70b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:53.455664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49a40fec-1020-49af-b881-71e304d4a70b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:53.456347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49a40fec-1020-49af-b881-71e304d4a70b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:53.460591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49a40fec-1020-49af-b881-71e304d4a70b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:53.461440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49a40fec-1020-49af-b881-71e304d4a70b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:53.463118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49a40fec-1020-49af-b881-71e304d4a70b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:53.465934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c2749df-52c7-4a77-856a-0f31b2099561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:53.476670 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2c2749df-52c7-4a77-856a-0f31b2099561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1274 microversion: 2.1 time: 0.220220 Oct 11 04:21:53.483325 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1317/2754] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:53 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1274 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:53.808065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2a590eaa-dd86-4a36-9ec8-a42aa3185887 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:53.808696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2a590eaa-dd86-4a36-9ec8-a42aa3185887 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:54.081875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-49a40fec-1020-49af-b881-71e304d4a70b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:54.090769 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-49a40fec-1020-49af-b881-71e304d4a70b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1325 microversion: 2.1 time: 0.667416 Oct 11 04:21:54.091761 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1438/2755] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:53 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1325 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:54.385533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2a590eaa-dd86-4a36-9ec8-a42aa3185887 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:54.406487 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2a590eaa-dd86-4a36-9ec8-a42aa3185887 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1207 microversion: 2.1 time: 0.599552 Oct 11 04:21:54.407527 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1318/2756] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:53 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1207 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:54.444844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0560df61-fb61-4cb7-bfcb-8f21671e5b66 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:54.446119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0560df61-fb61-4cb7-bfcb-8f21671e5b66 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:54.462124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0560df61-fb61-4cb7-bfcb-8f21671e5b66 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:54.462833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0560df61-fb61-4cb7-bfcb-8f21671e5b66 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:54.466952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0560df61-fb61-4cb7-bfcb-8f21671e5b66 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:54.467948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0560df61-fb61-4cb7-bfcb-8f21671e5b66 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:54.468571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0560df61-fb61-4cb7-bfcb-8f21671e5b66 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:54.469219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0560df61-fb61-4cb7-bfcb-8f21671e5b66 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:54.513226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-905a7ab3-d209-47c5-81dc-2ce27ef76dd4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:54.513226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-905a7ab3-d209-47c5-81dc-2ce27ef76dd4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:54.528942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-905a7ab3-d209-47c5-81dc-2ce27ef76dd4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:54.529627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-905a7ab3-d209-47c5-81dc-2ce27ef76dd4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:54.530176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-905a7ab3-d209-47c5-81dc-2ce27ef76dd4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:54.532424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-905a7ab3-d209-47c5-81dc-2ce27ef76dd4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:54.534720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-905a7ab3-d209-47c5-81dc-2ce27ef76dd4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:54.535274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-905a7ab3-d209-47c5-81dc-2ce27ef76dd4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:54.653070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-905a7ab3-d209-47c5-81dc-2ce27ef76dd4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:54.666469 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-905a7ab3-d209-47c5-81dc-2ce27ef76dd4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1284 microversion: 2.1 time: 0.163525 Oct 11 04:21:54.667719 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1319/2757] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:54 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:54.787885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0560df61-fb61-4cb7-bfcb-8f21671e5b66 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:54.804441 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0560df61-fb61-4cb7-bfcb-8f21671e5b66 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1311 microversion: 2.1 time: 0.363580 Oct 11 04:21:54.822882 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1439/2758] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:54 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1311 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:55.128017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09ceda15-5c84-4075-bb20-c2965be31f8f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:55.128921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09ceda15-5c84-4075-bb20-c2965be31f8f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:55.145560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09ceda15-5c84-4075-bb20-c2965be31f8f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:55.146204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09ceda15-5c84-4075-bb20-c2965be31f8f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:55.149078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09ceda15-5c84-4075-bb20-c2965be31f8f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:55.156081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09ceda15-5c84-4075-bb20-c2965be31f8f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:55.159330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09ceda15-5c84-4075-bb20-c2965be31f8f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:55.161186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09ceda15-5c84-4075-bb20-c2965be31f8f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:55.306371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c5235db5-d639-4856-a91b-0e2474d2ec02 req-a134ba17-b979-4881-a36c-946d6326cb66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7a86c0-79fe-4793-a20f-c2c2f7872228", "name": "network-vif-plugged", "status": "completed", "tag": "6ff409cf-6662-4dac-a448-46e41118ee89"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:55.320255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c5235db5-d639-4856-a91b-0e2474d2ec02 req-a134ba17-b979-4881-a36c-946d6326cb66 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:55.320975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c5235db5-d639-4856-a91b-0e2474d2ec02 req-a134ba17-b979-4881-a36c-946d6326cb66 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:55.321583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c5235db5-d639-4856-a91b-0e2474d2ec02 req-a134ba17-b979-4881-a36c-946d6326cb66 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:55.365222 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c5235db5-d639-4856-a91b-0e2474d2ec02 req-a134ba17-b979-4881-a36c-946d6326cb66 service nova] Creating event network-vif-plugged:6ff409cf-6662-4dac-a448-46e41118ee89 for instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 on n-h2-860892-1 Oct 11 04:21:55.384845 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c5235db5-d639-4856-a91b-0e2474d2ec02 req-a134ba17-b979-4881-a36c-946d6326cb66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082723 Oct 11 04:21:55.388392 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1440/2759] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:21:55.431715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cdf66fe4-6866-4196-a58c-16992146bade tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:55.432415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cdf66fe4-6866-4196-a58c-16992146bade tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:55.446628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf66fe4-6866-4196-a58c-16992146bade tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:55.447186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf66fe4-6866-4196-a58c-16992146bade tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:55.447540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf66fe4-6866-4196-a58c-16992146bade tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:55.453564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf66fe4-6866-4196-a58c-16992146bade tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:55.454169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf66fe4-6866-4196-a58c-16992146bade tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:55.454773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf66fe4-6866-4196-a58c-16992146bade tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:55.547415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09ceda15-5c84-4075-bb20-c2965be31f8f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:55.558796 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09ceda15-5c84-4075-bb20-c2965be31f8f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1325 microversion: 2.1 time: 0.436012 Oct 11 04:21:55.565367 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1320/2760] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:55 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1325 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:55.697371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c9ee13ae-4d2e-4c42-8bec-a41b2ffccbcf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:55.698826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c9ee13ae-4d2e-4c42-8bec-a41b2ffccbcf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:55.713861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9ee13ae-4d2e-4c42-8bec-a41b2ffccbcf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:55.714719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9ee13ae-4d2e-4c42-8bec-a41b2ffccbcf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:55.715350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9ee13ae-4d2e-4c42-8bec-a41b2ffccbcf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:55.723261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9ee13ae-4d2e-4c42-8bec-a41b2ffccbcf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:55.724036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9ee13ae-4d2e-4c42-8bec-a41b2ffccbcf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:55.724667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9ee13ae-4d2e-4c42-8bec-a41b2ffccbcf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:56.011536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c9ee13ae-4d2e-4c42-8bec-a41b2ffccbcf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:56.031068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c9ee13ae-4d2e-4c42-8bec-a41b2ffccbcf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1272 microversion: 2.1 time: 0.337900 Oct 11 04:21:56.047442 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1321/2761] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:55 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1272 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:56.064060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b8d129a7-fe01-4ba4-b3e4-121cdf592825 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:56.065361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b8d129a7-fe01-4ba4-b3e4-121cdf592825 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:56.080174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cdf66fe4-6866-4196-a58c-16992146bade tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:56.092523 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cdf66fe4-6866-4196-a58c-16992146bade tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1211 microversion: 2.1 time: 0.664338 Oct 11 04:21:56.092731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8d129a7-fe01-4ba4-b3e4-121cdf592825 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:56.093231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8d129a7-fe01-4ba4-b3e4-121cdf592825 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:56.093671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8d129a7-fe01-4ba4-b3e4-121cdf592825 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:56.094414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8d129a7-fe01-4ba4-b3e4-121cdf592825 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:56.095041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8d129a7-fe01-4ba4-b3e4-121cdf592825 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:56.095569 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1441/2762] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:55 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1211 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:56.112525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8d129a7-fe01-4ba4-b3e4-121cdf592825 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:56.596013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c686dd3-e589-4b4c-92fc-8e48d68aa7f4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:56.601004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2c686dd3-e589-4b4c-92fc-8e48d68aa7f4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:56.610922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c686dd3-e589-4b4c-92fc-8e48d68aa7f4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:56.611845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c686dd3-e589-4b4c-92fc-8e48d68aa7f4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:56.612493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c686dd3-e589-4b4c-92fc-8e48d68aa7f4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:56.613580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c686dd3-e589-4b4c-92fc-8e48d68aa7f4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:56.614484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c686dd3-e589-4b4c-92fc-8e48d68aa7f4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:56.615069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c686dd3-e589-4b4c-92fc-8e48d68aa7f4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:56.674616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b8d129a7-fe01-4ba4-b3e4-121cdf592825 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:56.688223 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b8d129a7-fe01-4ba4-b3e4-121cdf592825 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1311 microversion: 2.1 time: 0.638841 Oct 11 04:21:56.689059 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1322/2763] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:56 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1311 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:57.022119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2c686dd3-e589-4b4c-92fc-8e48d68aa7f4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:57.030528 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c686dd3-e589-4b4c-92fc-8e48d68aa7f4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1325 microversion: 2.1 time: 0.440398 Oct 11 04:21:57.031103 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1442/2764] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:56 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1325 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:57.065106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce30e7b0-fcad-43c4-9015-94058b3c4beb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:57.065730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce30e7b0-fcad-43c4-9015-94058b3c4beb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:57.085510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce30e7b0-fcad-43c4-9015-94058b3c4beb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:57.088380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce30e7b0-fcad-43c4-9015-94058b3c4beb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:57.090659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce30e7b0-fcad-43c4-9015-94058b3c4beb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:57.091835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce30e7b0-fcad-43c4-9015-94058b3c4beb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:57.092650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce30e7b0-fcad-43c4-9015-94058b3c4beb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:57.093707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce30e7b0-fcad-43c4-9015-94058b3c4beb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:57.120562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92cfdad0-05f0-48ee-8547-87c9a6795ac7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:57.121175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-92cfdad0-05f0-48ee-8547-87c9a6795ac7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:57.130947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92cfdad0-05f0-48ee-8547-87c9a6795ac7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:57.131445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92cfdad0-05f0-48ee-8547-87c9a6795ac7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:57.141790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92cfdad0-05f0-48ee-8547-87c9a6795ac7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:57.141790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92cfdad0-05f0-48ee-8547-87c9a6795ac7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:57.141790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92cfdad0-05f0-48ee-8547-87c9a6795ac7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:57.141790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92cfdad0-05f0-48ee-8547-87c9a6795ac7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:57.212421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce30e7b0-fcad-43c4-9015-94058b3c4beb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:57.222930 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce30e7b0-fcad-43c4-9015-94058b3c4beb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1272 microversion: 2.1 time: 0.167398 Oct 11 04:21:57.238861 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1323/2765] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:57 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1272 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:57.322008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-92cfdad0-05f0-48ee-8547-87c9a6795ac7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:57.328665 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-92cfdad0-05f0-48ee-8547-87c9a6795ac7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1267 microversion: 2.1 time: 0.212679 Oct 11 04:21:57.342217 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1443/2766] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:57 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1267 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:57.711573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e1edaaf9-bfdf-41e6-95b1-1791313dcf20 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:57.712922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e1edaaf9-bfdf-41e6-95b1-1791313dcf20 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:57.720418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edaaf9-bfdf-41e6-95b1-1791313dcf20 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:57.721289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edaaf9-bfdf-41e6-95b1-1791313dcf20 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:57.722065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edaaf9-bfdf-41e6-95b1-1791313dcf20 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:57.723025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edaaf9-bfdf-41e6-95b1-1791313dcf20 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:57.723686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edaaf9-bfdf-41e6-95b1-1791313dcf20 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:57.724318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edaaf9-bfdf-41e6-95b1-1791313dcf20 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:58.058879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2997f791-7d23-4aa5-8341-f54a2031d1d2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:58.060233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2997f791-7d23-4aa5-8341-f54a2031d1d2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:58.072385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2997f791-7d23-4aa5-8341-f54a2031d1d2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:58.072385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2997f791-7d23-4aa5-8341-f54a2031d1d2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:58.072385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2997f791-7d23-4aa5-8341-f54a2031d1d2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:58.072385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2997f791-7d23-4aa5-8341-f54a2031d1d2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:58.072385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2997f791-7d23-4aa5-8341-f54a2031d1d2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:58.072385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2997f791-7d23-4aa5-8341-f54a2031d1d2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:58.094451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e1edaaf9-bfdf-41e6-95b1-1791313dcf20 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:58.117040 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e1edaaf9-bfdf-41e6-95b1-1791313dcf20 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1311 microversion: 2.1 time: 0.409210 Oct 11 04:21:58.118505 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1324/2767] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:57 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1311 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:58.249383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef33f038-2791-42ca-bdc6-1439dceceeee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:58.251604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef33f038-2791-42ca-bdc6-1439dceceeee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:58.261270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef33f038-2791-42ca-bdc6-1439dceceeee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:58.262232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef33f038-2791-42ca-bdc6-1439dceceeee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:58.262867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef33f038-2791-42ca-bdc6-1439dceceeee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:58.263847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef33f038-2791-42ca-bdc6-1439dceceeee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:58.264496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef33f038-2791-42ca-bdc6-1439dceceeee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:58.265652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef33f038-2791-42ca-bdc6-1439dceceeee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:58.573920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2997f791-7d23-4aa5-8341-f54a2031d1d2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:58.582969 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2997f791-7d23-4aa5-8341-f54a2031d1d2 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1521 microversion: 2.1 time: 0.527822 Oct 11 04:21:58.584602 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1444/2768] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:58 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1521 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:58.589232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bcd36180-2819-416d-aa51-2679e770af96 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:58.589848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bcd36180-2819-416d-aa51-2679e770af96 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:58.618149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcd36180-2819-416d-aa51-2679e770af96 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:58.618680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcd36180-2819-416d-aa51-2679e770af96 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:58.619176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcd36180-2819-416d-aa51-2679e770af96 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:58.619911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcd36180-2819-416d-aa51-2679e770af96 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:58.620343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcd36180-2819-416d-aa51-2679e770af96 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:58.620775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcd36180-2819-416d-aa51-2679e770af96 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:58.667351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef33f038-2791-42ca-bdc6-1439dceceeee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:58.678820 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef33f038-2791-42ca-bdc6-1439dceceeee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1314 microversion: 2.1 time: 0.433205 Oct 11 04:21:58.682843 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1325/2769] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:58 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1314 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:58.690822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-4db701fb-a7da-4296-b576-9655aee484b8 req-a955eb67-5bbf-4bad-89f0-4e5eccf0f762 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec21f97-4e31-411a-90c9-19c8ad94693f", "name": "network-vif-plugged", "status": "completed", "tag": "bf241d38-0545-4589-afea-60551eb1c3e1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:58.726497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4db701fb-a7da-4296-b576-9655aee484b8 req-a955eb67-5bbf-4bad-89f0-4e5eccf0f762 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:58.727136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4db701fb-a7da-4296-b576-9655aee484b8 req-a955eb67-5bbf-4bad-89f0-4e5eccf0f762 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:58.727439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4db701fb-a7da-4296-b576-9655aee484b8 req-a955eb67-5bbf-4bad-89f0-4e5eccf0f762 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:58.756757 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-4db701fb-a7da-4296-b576-9655aee484b8 req-a955eb67-5bbf-4bad-89f0-4e5eccf0f762 service nova] Creating event network-vif-plugged:bf241d38-0545-4589-afea-60551eb1c3e1 for instance 7ec21f97-4e31-411a-90c9-19c8ad94693f on n-h1-860892-1 Oct 11 04:21:58.762965 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-4db701fb-a7da-4296-b576-9655aee484b8 req-a955eb67-5bbf-4bad-89f0-4e5eccf0f762 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078136 Oct 11 04:21:58.764685 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1326/2770] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:21:58.772910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46529112-eecd-4d77-af71-320c37943e3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:58.774113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-46529112-eecd-4d77-af71-320c37943e3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:58.781728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46529112-eecd-4d77-af71-320c37943e3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:58.782503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46529112-eecd-4d77-af71-320c37943e3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:58.783138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46529112-eecd-4d77-af71-320c37943e3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:58.784305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46529112-eecd-4d77-af71-320c37943e3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:58.785000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46529112-eecd-4d77-af71-320c37943e3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:58.785620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46529112-eecd-4d77-af71-320c37943e3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:59.034556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bcd36180-2819-416d-aa51-2679e770af96 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:59.046719 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bcd36180-2819-416d-aa51-2679e770af96 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1307 microversion: 2.1 time: 0.457033 Oct 11 04:21:59.052413 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1445/2771] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:58 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1307 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:59.150426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d605b05a-c3f1-499f-b062-fbd176ce2a2d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:59.152062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d605b05a-c3f1-499f-b062-fbd176ce2a2d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:59.170880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d605b05a-c3f1-499f-b062-fbd176ce2a2d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:59.171669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d605b05a-c3f1-499f-b062-fbd176ce2a2d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:59.172268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d605b05a-c3f1-499f-b062-fbd176ce2a2d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:59.173311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d605b05a-c3f1-499f-b062-fbd176ce2a2d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:59.174039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d605b05a-c3f1-499f-b062-fbd176ce2a2d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:59.174816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d605b05a-c3f1-499f-b062-fbd176ce2a2d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:59.195487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-46529112-eecd-4d77-af71-320c37943e3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:59.210134 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-46529112-eecd-4d77-af71-320c37943e3e tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1521 microversion: 2.1 time: 0.443928 Oct 11 04:21:59.212129 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1327/2772] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:58 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:21:59.234622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0fa16981-ecea-4053-b3f9-66b9afd5f440 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesOneServerNegativeTestJSON-image-1849999807"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:21:59.237300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0fa16981-ecea-4053-b3f9-66b9afd5f440 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:59.248463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa16981-ecea-4053-b3f9-66b9afd5f440 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:59.252489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa16981-ecea-4053-b3f9-66b9afd5f440 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:59.253123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa16981-ecea-4053-b3f9-66b9afd5f440 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:59.257032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa16981-ecea-4053-b3f9-66b9afd5f440 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:59.257512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa16981-ecea-4053-b3f9-66b9afd5f440 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:59.258118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fa16981-ecea-4053-b3f9-66b9afd5f440 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:59.684878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d605b05a-c3f1-499f-b062-fbd176ce2a2d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:21:59.688979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:21:59.693617 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d605b05a-c3f1-499f-b062-fbd176ce2a2d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1311 microversion: 2.1 time: 0.554520 Oct 11 04:21:59.700194 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1446/2773] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:59 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1311 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:21:59.710275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fe325a81-b09d-4e38-9ec1-c9e121f29dc2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:59.711090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fe325a81-b09d-4e38-9ec1-c9e121f29dc2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:21:59.726120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe325a81-b09d-4e38-9ec1-c9e121f29dc2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:59.726622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe325a81-b09d-4e38-9ec1-c9e121f29dc2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:59.727062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe325a81-b09d-4e38-9ec1-c9e121f29dc2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:59.727805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe325a81-b09d-4e38-9ec1-c9e121f29dc2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:21:59.737341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe325a81-b09d-4e38-9ec1-c9e121f29dc2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:21:59.737828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe325a81-b09d-4e38-9ec1-c9e121f29dc2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:21:59.812718 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0fa16981-ecea-4053-b3f9-66b9afd5f440 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "POST /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228/action" status: 202 len: 0 microversion: 2.1 time: 0.582858 Oct 11 04:21:59.814688 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1328/2774] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:21:59 2022] POST /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228/action => generated 0 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Oct 11 04:21:59.960367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-80781cc3-5dc7-48c4-a18d-8e9ea0c877f5 tempest-ListImageFiltersNegativeTestJSON-1175649141 tempest-ListImageFiltersNegativeTestJSON-1175649141-project] Calling method '.version_select at 0x7fda19211a60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-80781cc3-5dc7-48c4-a18d-8e9ea0c877f5 tempest-ListImageFiltersNegativeTestJSON-1175649141 tempest-ListImageFiltersNegativeTestJSON-1175649141-project] HTTP exception thrown: Image not found. Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-80781cc3-5dc7-48c4-a18d-8e9ea0c877f5 tempest-ListImageFiltersNegativeTestJSON-1175649141 tempest-ListImageFiltersNegativeTestJSON-1175649141-project] Request method failure captured: Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/images/ef67f514-6bbe-4c18-ba07-218ad1179105 HTTP/1.1 Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9nZeKC8AJh1kE5-3kkvKVqjvJwGERYZZGn_rBQKWccKV17Z4ZHZenEOpp0wt0JXiYCRvE_E1HTjcoMYAGr6OwZ93SRNLj8KcnnosT6BTUdrbMeToScLGCPcxLlHR5_N663GvkrNZwAuNQN1LNeL_H3_zyPo4RQfxR0ANVun194DfA Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: a0128b236cee49fbb665b2961510e045 Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ListImageFiltersNegativeTestJSON-1175649141 Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a0128b236cee49fbb665b2961510e045"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a0128b236cee49fbb665b2961510e045"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0128b236cee49fbb665b2961510e045"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a0128b236cee49fbb665b2961510e045"}]}] Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ListImageFiltersNegativeTestJSON-1175649141 Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: a0128b236cee49fbb665b2961510e045 Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ListImageFiltersNegativeTestJSON-1175649141 Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ListImageFiltersNegativeTestJSON-1175649141-project Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5296f843115c42619acbf3293d8592d9 Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ListImageFiltersNegativeTestJSON-1175649141-project Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'ef67f514-6bbe-4c18-ba07-218ad1179105'} Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID ef67f514-6bbe-4c18-ba07-218ad1179105 Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 04:21:59.992332 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image ef67f514-6bbe-4c18-ba07-218ad1179105 could not be found. Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-80781cc3-5dc7-48c4-a18d-8e9ea0c877f5 tempest-ListImageFiltersNegativeTestJSON-1175649141 tempest-ListImageFiltersNegativeTestJSON-1175649141-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-80781cc3-5dc7-48c4-a18d-8e9ea0c877f5 tempest-ListImageFiltersNegativeTestJSON-1175649141 tempest-ListImageFiltersNegativeTestJSON-1175649141-project] 10.222.0.26 "GET /compute/v2.1/images/ef67f514-6bbe-4c18-ba07-218ad1179105" status: 404 len: 62 microversion: 2.1 time: 0.177125 Oct 11 04:21:59.997165 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1329/2775] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:21:59 2022] GET /compute/v2.1/images/ef67f514-6bbe-4c18-ba07-218ad1179105 => generated 62 bytes in 178 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:22:00.017463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5fc60346-33f7-42f2-b9c5-2a67e5abb404 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '.version_select at 0x7fda192a5b80>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:00.059870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fe325a81-b09d-4e38-9ec1-c9e121f29dc2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:00.084231 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fe325a81-b09d-4e38-9ec1-c9e121f29dc2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1314 microversion: 2.1 time: 0.382710 Oct 11 04:22:00.113600 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1447/2776] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:59 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:00.125624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ad98ec58-ffab-41b5-bcea-e24700c3368f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:00.130604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ad98ec58-ffab-41b5-bcea-e24700c3368f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:00.163729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad98ec58-ffab-41b5-bcea-e24700c3368f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:00.163729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad98ec58-ffab-41b5-bcea-e24700c3368f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:00.163729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad98ec58-ffab-41b5-bcea-e24700c3368f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:00.163729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad98ec58-ffab-41b5-bcea-e24700c3368f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:00.163729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad98ec58-ffab-41b5-bcea-e24700c3368f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:00.163729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad98ec58-ffab-41b5-bcea-e24700c3368f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:00.466286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ad98ec58-ffab-41b5-bcea-e24700c3368f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:00.478788 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ad98ec58-ffab-41b5-bcea-e24700c3368f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1307 microversion: 2.1 time: 0.361330 Oct 11 04:22:00.481530 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1448/2777] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:00 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1307 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:00.496416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-88a121e6-2be2-4d35-83bb-76a8eaa4998d req-ae215c49-0bad-46b9-a9f9-b52adb328e46 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a99ecc72-094d-4756-a9b3-fc9d374b440e", "tag": "1bcba2d7-91a1-41e1-9f49-4319b6515cef"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:00.504801 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5fc60346-33f7-42f2-b9c5-2a67e5abb404 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "DELETE /compute/v2.1/images/fab94f1c-d725-4249-959e-e11e08457be5" status: 204 len: 0 microversion: 2.1 time: 0.509710 Oct 11 04:22:00.511067 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1330/2778] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:21:59 2022] DELETE /compute/v2.1/images/fab94f1c-d725-4249-959e-e11e08457be5 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:22:00.519408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35abaa84-5ce7-4125-b9a9-466ce72a1ba9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '.version_select at 0x7fda19211ee0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:00.564340 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-35abaa84-5ce7-4125-b9a9-466ce72a1ba9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] HTTP exception thrown: Image not found. Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35abaa84-5ce7-4125-b9a9-466ce72a1ba9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/images/fab94f1c-d725-4249-959e-e11e08457be5 HTTP/1.1 Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'fab94f1c-d725-4249-959e-e11e08457be5'} Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID fab94f1c-d725-4249-959e-e11e08457be5 Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 04:22:00.566669 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fab94f1c-d725-4249-959e-e11e08457be5 could not be found. Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:00.571213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35abaa84-5ce7-4125-b9a9-466ce72a1ba9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:00.574638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-88a121e6-2be2-4d35-83bb-76a8eaa4998d req-ae215c49-0bad-46b9-a9f9-b52adb328e46 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:00.574638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-88a121e6-2be2-4d35-83bb-76a8eaa4998d req-ae215c49-0bad-46b9-a9f9-b52adb328e46 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:00.574638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-88a121e6-2be2-4d35-83bb-76a8eaa4998d req-ae215c49-0bad-46b9-a9f9-b52adb328e46 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:00.580179 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35abaa84-5ce7-4125-b9a9-466ce72a1ba9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/images/fab94f1c-d725-4249-959e-e11e08457be5" status: 404 len: 62 microversion: 2.1 time: 0.057580 Oct 11 04:22:00.580179 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1331/2779] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:00 2022] GET /compute/v2.1/images/fab94f1c-d725-4249-959e-e11e08457be5 => generated 62 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 04:22:00.593596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b1b0eb97-d201-439c-ae74-5b1f09481442 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:00.601010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b1b0eb97-d201-439c-ae74-5b1f09481442 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:00.615266 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-88a121e6-2be2-4d35-83bb-76a8eaa4998d req-ae215c49-0bad-46b9-a9f9-b52adb328e46 service nova] Creating event network-changed:1bcba2d7-91a1-41e1-9f49-4319b6515cef for instance a99ecc72-094d-4756-a9b3-fc9d374b440e on n-h1-860892-1 Oct 11 04:22:00.620781 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-88a121e6-2be2-4d35-83bb-76a8eaa4998d req-ae215c49-0bad-46b9-a9f9-b52adb328e46 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.137233 Oct 11 04:22:00.621893 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1449/2780] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:00.635149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b0eb97-d201-439c-ae74-5b1f09481442 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:00.635975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b0eb97-d201-439c-ae74-5b1f09481442 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:00.636428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b0eb97-d201-439c-ae74-5b1f09481442 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:00.637149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b0eb97-d201-439c-ae74-5b1f09481442 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:00.639532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b0eb97-d201-439c-ae74-5b1f09481442 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:00.640145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1b0eb97-d201-439c-ae74-5b1f09481442 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:00.718228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8507776b-931c-4ce4-b8ed-344f1fa8a7f6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:00.719329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8507776b-931c-4ce4-b8ed-344f1fa8a7f6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:00.735037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8507776b-931c-4ce4-b8ed-344f1fa8a7f6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:00.735037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8507776b-931c-4ce4-b8ed-344f1fa8a7f6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:00.735037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8507776b-931c-4ce4-b8ed-344f1fa8a7f6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:00.735037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8507776b-931c-4ce4-b8ed-344f1fa8a7f6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:00.736520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8507776b-931c-4ce4-b8ed-344f1fa8a7f6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:00.738251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8507776b-931c-4ce4-b8ed-344f1fa8a7f6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:01.076466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b1b0eb97-d201-439c-ae74-5b1f09481442 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:01.085214 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b1b0eb97-d201-439c-ae74-5b1f09481442 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1533 microversion: 2.1 time: 0.502007 Oct 11 04:22:01.089065 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1332/2781] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:00 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1533 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:01.121532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4b9fda95-d3c9-4d22-b7a8-11b857e29d60 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:01.121532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4b9fda95-d3c9-4d22-b7a8-11b857e29d60 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:01.125536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b9fda95-d3c9-4d22-b7a8-11b857e29d60 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:01.126224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b9fda95-d3c9-4d22-b7a8-11b857e29d60 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:01.126848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b9fda95-d3c9-4d22-b7a8-11b857e29d60 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:01.127552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b9fda95-d3c9-4d22-b7a8-11b857e29d60 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:01.128125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b9fda95-d3c9-4d22-b7a8-11b857e29d60 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:01.128567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b9fda95-d3c9-4d22-b7a8-11b857e29d60 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:01.136373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8507776b-931c-4ce4-b8ed-344f1fa8a7f6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:01.147513 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8507776b-931c-4ce4-b8ed-344f1fa8a7f6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1311 microversion: 2.1 time: 0.434509 Oct 11 04:22:01.148840 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1450/2782] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:00 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1311 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:01.395875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b8d92938-d1c1-4014-8b54-d22a19a4f437 req-a90d7e14-b2a4-4785-9eeb-feb4d2de7303 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "557ba8ab-6c3d-4794-95ad-0dd362e8f43c", "tag": "2b360fd2-c9ae-4f42-a38f-64fea173e759"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:01.409401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4b9fda95-d3c9-4d22-b7a8-11b857e29d60 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:01.418392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b8d92938-d1c1-4014-8b54-d22a19a4f437 req-a90d7e14-b2a4-4785-9eeb-feb4d2de7303 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:01.419266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b8d92938-d1c1-4014-8b54-d22a19a4f437 req-a90d7e14-b2a4-4785-9eeb-feb4d2de7303 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:01.424995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b8d92938-d1c1-4014-8b54-d22a19a4f437 req-a90d7e14-b2a4-4785-9eeb-feb4d2de7303 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:01.428236 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4b9fda95-d3c9-4d22-b7a8-11b857e29d60 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1314 microversion: 2.1 time: 0.314080 Oct 11 04:22:01.429385 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1333/2783] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:01 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:01.441974 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b8d92938-d1c1-4014-8b54-d22a19a4f437 req-a90d7e14-b2a4-4785-9eeb-feb4d2de7303 service nova] Creating event network-changed:2b360fd2-c9ae-4f42-a38f-64fea173e759 for instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c on n-h1-860892-1 Oct 11 04:22:01.448090 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b8d92938-d1c1-4014-8b54-d22a19a4f437 req-a90d7e14-b2a4-4785-9eeb-feb4d2de7303 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058535 Oct 11 04:22:01.449813 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1451/2784] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:22:01.506269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a0bbc5c-ddd0-4a09-a2ad-8a0966624586 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:01.507304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5a0bbc5c-ddd0-4a09-a2ad-8a0966624586 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:01.527757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc5c-ddd0-4a09-a2ad-8a0966624586 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:01.528176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc5c-ddd0-4a09-a2ad-8a0966624586 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:01.529954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc5c-ddd0-4a09-a2ad-8a0966624586 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:01.531053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc5c-ddd0-4a09-a2ad-8a0966624586 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:01.531654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc5c-ddd0-4a09-a2ad-8a0966624586 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:01.532224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a0bbc5c-ddd0-4a09-a2ad-8a0966624586 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:01.678776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:01.757427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5a0bbc5c-ddd0-4a09-a2ad-8a0966624586 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:01.766281 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5a0bbc5c-ddd0-4a09-a2ad-8a0966624586 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1307 microversion: 2.1 time: 0.266057 Oct 11 04:22:01.767072 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1334/2785] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:01 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1307 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:02.112278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-17a546d5-45ed-4a07-9a86-a09219ddc89f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:02.112992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-17a546d5-45ed-4a07-9a86-a09219ddc89f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:02.119156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17a546d5-45ed-4a07-9a86-a09219ddc89f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.119898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17a546d5-45ed-4a07-9a86-a09219ddc89f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.120264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17a546d5-45ed-4a07-9a86-a09219ddc89f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.120961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17a546d5-45ed-4a07-9a86-a09219ddc89f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.121416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17a546d5-45ed-4a07-9a86-a09219ddc89f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.121847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17a546d5-45ed-4a07-9a86-a09219ddc89f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.171020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-475ce283-36e9-41e6-9c05-f51554e81254 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:02.171638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-475ce283-36e9-41e6-9c05-f51554e81254 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:02.177949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-475ce283-36e9-41e6-9c05-f51554e81254 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.178542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-475ce283-36e9-41e6-9c05-f51554e81254 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.178904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-475ce283-36e9-41e6-9c05-f51554e81254 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.179695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-475ce283-36e9-41e6-9c05-f51554e81254 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.180149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-475ce283-36e9-41e6-9c05-f51554e81254 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.180611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-475ce283-36e9-41e6-9c05-f51554e81254 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.186246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:02.360137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-17a546d5-45ed-4a07-9a86-a09219ddc89f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:02.374741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-475ce283-36e9-41e6-9c05-f51554e81254 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:02.378173 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-17a546d5-45ed-4a07-9a86-a09219ddc89f tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1539 microversion: 2.1 time: 0.262856 Oct 11 04:22:02.379381 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1452/2786] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:02 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1539 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:02.384948 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-475ce283-36e9-41e6-9c05-f51554e81254 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1495 microversion: 2.1 time: 0.217968 Oct 11 04:22:02.385688 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1335/2787] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:02 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1495 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:02.459547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e716480-9132-4f9a-9bef-56f6600adf08 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:02.460782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8e716480-9132-4f9a-9bef-56f6600adf08 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:02.469737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e716480-9132-4f9a-9bef-56f6600adf08 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.470559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e716480-9132-4f9a-9bef-56f6600adf08 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.471332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e716480-9132-4f9a-9bef-56f6600adf08 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.472288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e716480-9132-4f9a-9bef-56f6600adf08 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.472921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e716480-9132-4f9a-9bef-56f6600adf08 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.473523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e716480-9132-4f9a-9bef-56f6600adf08 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.722482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8e716480-9132-4f9a-9bef-56f6600adf08 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:02.730571 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8e716480-9132-4f9a-9bef-56f6600adf08 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1314 microversion: 2.1 time: 0.277825 Oct 11 04:22:02.731148 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1336/2788] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:02 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:02.761536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fbdf77a4-83df-463c-b76e-143f7f3b2def tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:02.761536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fbdf77a4-83df-463c-b76e-143f7f3b2def tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:02.765644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbdf77a4-83df-463c-b76e-143f7f3b2def tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.766606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbdf77a4-83df-463c-b76e-143f7f3b2def tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.767239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbdf77a4-83df-463c-b76e-143f7f3b2def tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.768516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbdf77a4-83df-463c-b76e-143f7f3b2def tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.769737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbdf77a4-83df-463c-b76e-143f7f3b2def tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.770536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbdf77a4-83df-463c-b76e-143f7f3b2def tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.771288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:02.789914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1057fd44-8fd2-4bc0-99de-20b4f71ae812 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:02.790559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1057fd44-8fd2-4bc0-99de-20b4f71ae812 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:02.798873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1057fd44-8fd2-4bc0-99de-20b4f71ae812 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.799362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1057fd44-8fd2-4bc0-99de-20b4f71ae812 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.800812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1057fd44-8fd2-4bc0-99de-20b4f71ae812 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.802165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1057fd44-8fd2-4bc0-99de-20b4f71ae812 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.802753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1057fd44-8fd2-4bc0-99de-20b4f71ae812 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.803195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1057fd44-8fd2-4bc0-99de-20b4f71ae812 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.947506 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fbdf77a4-83df-463c-b76e-143f7f3b2def tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1646 microversion: 2.1 time: 0.543999 Oct 11 04:22:02.958236 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1453/2789] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:02 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1646 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:02.972916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e66e9d6b-99d2-4331-9595-3e213cb6b38c tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:02.973716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1057fd44-8fd2-4bc0-99de-20b4f71ae812 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:02.974024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e66e9d6b-99d2-4331-9595-3e213cb6b38c tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:02.983671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66e9d6b-99d2-4331-9595-3e213cb6b38c tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.984550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66e9d6b-99d2-4331-9595-3e213cb6b38c tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.985587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66e9d6b-99d2-4331-9595-3e213cb6b38c tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.986538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66e9d6b-99d2-4331-9595-3e213cb6b38c tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:02.987342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66e9d6b-99d2-4331-9595-3e213cb6b38c tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:02.987926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66e9d6b-99d2-4331-9595-3e213cb6b38c tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:02.991819 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1057fd44-8fd2-4bc0-99de-20b4f71ae812 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1307 microversion: 2.1 time: 0.195949 Oct 11 04:22:03.004349 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1337/2790] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:02 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1307 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:03.172132 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e66e9d6b-99d2-4331-9595-3e213cb6b38c tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1646 microversion: 2.1 time: 0.204016 Oct 11 04:22:03.174982 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1454/2791] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:02 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1646 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:03.199716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6da69d57-8d7e-4c2a-9f00-7b6d2ec5561a tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:03.205022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da69d57-8d7e-4c2a-9f00-7b6d2ec5561a tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:03.205508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da69d57-8d7e-4c2a-9f00-7b6d2ec5561a tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:03.205942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da69d57-8d7e-4c2a-9f00-7b6d2ec5561a tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:03.206706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da69d57-8d7e-4c2a-9f00-7b6d2ec5561a tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:03.207268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da69d57-8d7e-4c2a-9f00-7b6d2ec5561a tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:03.207702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da69d57-8d7e-4c2a-9f00-7b6d2ec5561a tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:03.241491 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6da69d57-8d7e-4c2a-9f00-7b6d2ec5561a tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.045644 Oct 11 04:22:03.242422 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1338/2792] 10.222.0.26 () {58 vars in 1176 bytes} [Tue Oct 11 04:22:03 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:03.254675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7ffd3dd0-98b6-4d76-b398-69573db8cea2 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860892-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:03.257790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7ffd3dd0-98b6-4d76-b398-69573db8cea2 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:03.265630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffd3dd0-98b6-4d76-b398-69573db8cea2 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:03.266320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffd3dd0-98b6-4d76-b398-69573db8cea2 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:03.266759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffd3dd0-98b6-4d76-b398-69573db8cea2 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:03.267451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffd3dd0-98b6-4d76-b398-69573db8cea2 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:03.267896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffd3dd0-98b6-4d76-b398-69573db8cea2 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:03.268316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ffd3dd0-98b6-4d76-b398-69573db8cea2 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:03.381976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-7ffd3dd0-98b6-4d76-b398-69573db8cea2 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lazy-loading 'flavor' on Instance uuid 7ec21f97-4e31-411a-90c9-19c8ad94693f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:22:03.395964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7ffd3dd0-98b6-4d76-b398-69573db8cea2 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Going to try to live migrate instance to n-h2-860892-1 {{(pid=120994) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 04:22:03.407859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ccba9056-2051-4261-9691-c66013984de5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:03.408963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ccba9056-2051-4261-9691-c66013984de5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:03.421518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccba9056-2051-4261-9691-c66013984de5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:03.422230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccba9056-2051-4261-9691-c66013984de5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:03.423573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccba9056-2051-4261-9691-c66013984de5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:03.424666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccba9056-2051-4261-9691-c66013984de5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:03.425503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccba9056-2051-4261-9691-c66013984de5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:03.426225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccba9056-2051-4261-9691-c66013984de5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:04.056632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ccba9056-2051-4261-9691-c66013984de5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:04.071437 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ccba9056-2051-4261-9691-c66013984de5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1534 microversion: 2.1 time: 0.669273 Oct 11 04:22:04.082210 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1339/2793] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:03 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1534 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:04.082210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-23dcc29e-2626-42e7-b402-ed677bb940d4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:04.082210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-23dcc29e-2626-42e7-b402-ed677bb940d4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:04.095074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23dcc29e-2626-42e7-b402-ed677bb940d4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:04.095576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23dcc29e-2626-42e7-b402-ed677bb940d4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:04.096021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23dcc29e-2626-42e7-b402-ed677bb940d4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:04.096727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23dcc29e-2626-42e7-b402-ed677bb940d4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:04.097182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23dcc29e-2626-42e7-b402-ed677bb940d4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:04.097615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23dcc29e-2626-42e7-b402-ed677bb940d4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:04.393433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=28 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:04.476959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-23dcc29e-2626-42e7-b402-ed677bb940d4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:04.485994 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-23dcc29e-2626-42e7-b402-ed677bb940d4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1314 microversion: 2.1 time: 0.412040 Oct 11 04:22:04.486634 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1340/2794] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:04 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:04.498602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eb918a50-ff6e-40b8-9471-d5edc593ab29 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:04.500555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eb918a50-ff6e-40b8-9471-d5edc593ab29 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:04.508725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb918a50-ff6e-40b8-9471-d5edc593ab29 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:04.509229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb918a50-ff6e-40b8-9471-d5edc593ab29 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:04.509663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb918a50-ff6e-40b8-9471-d5edc593ab29 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:04.510394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb918a50-ff6e-40b8-9471-d5edc593ab29 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:04.510900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb918a50-ff6e-40b8-9471-d5edc593ab29 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:04.511334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb918a50-ff6e-40b8-9471-d5edc593ab29 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:04.892643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eb918a50-ff6e-40b8-9471-d5edc593ab29 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:04.905542 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eb918a50-ff6e-40b8-9471-d5edc593ab29 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1307 microversion: 2.1 time: 0.417847 Oct 11 04:22:04.910109 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1341/2795] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:04 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1307 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:05.103441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b75f476-06cb-4ea1-b985-6477032027b8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:05.104252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6b75f476-06cb-4ea1-b985-6477032027b8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:05.112420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b75f476-06cb-4ea1-b985-6477032027b8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:05.116251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b75f476-06cb-4ea1-b985-6477032027b8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:05.116251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b75f476-06cb-4ea1-b985-6477032027b8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:05.116251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b75f476-06cb-4ea1-b985-6477032027b8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:05.116251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b75f476-06cb-4ea1-b985-6477032027b8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:05.116251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b75f476-06cb-4ea1-b985-6477032027b8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:05.428938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b75f476-06cb-4ea1-b985-6477032027b8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:05.441723 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b75f476-06cb-4ea1-b985-6477032027b8 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1521 microversion: 2.1 time: 0.344929 Oct 11 04:22:05.442600 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1342/2796] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:05 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:05.465676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-79b8efe8-5d24-4e3f-a7bf-839fab08c557 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:05.466172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-79b8efe8-5d24-4e3f-a7bf-839fab08c557 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:05.470977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:05.472724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79b8efe8-5d24-4e3f-a7bf-839fab08c557 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:05.473206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79b8efe8-5d24-4e3f-a7bf-839fab08c557 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:05.473700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79b8efe8-5d24-4e3f-a7bf-839fab08c557 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:05.474416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79b8efe8-5d24-4e3f-a7bf-839fab08c557 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:05.474881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79b8efe8-5d24-4e3f-a7bf-839fab08c557 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:05.475284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79b8efe8-5d24-4e3f-a7bf-839fab08c557 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:05.504618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-79b8efe8-5d24-4e3f-a7bf-839fab08c557 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:22:05.863031 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-79b8efe8-5d24-4e3f-a7bf-839fab08c557 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 204 len: 0 microversion: 2.1 time: 0.399318 Oct 11 04:22:05.863963 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1343/2797] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:22:05 2022] DELETE /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:22:05.871083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fdc72c9b-e6b7-4c6f-83b0-1130d8756e29 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:05.871795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fdc72c9b-e6b7-4c6f-83b0-1130d8756e29 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:05.878122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdc72c9b-e6b7-4c6f-83b0-1130d8756e29 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:05.878880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdc72c9b-e6b7-4c6f-83b0-1130d8756e29 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:05.879802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdc72c9b-e6b7-4c6f-83b0-1130d8756e29 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:05.880049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdc72c9b-e6b7-4c6f-83b0-1130d8756e29 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:05.880533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdc72c9b-e6b7-4c6f-83b0-1130d8756e29 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:05.880956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdc72c9b-e6b7-4c6f-83b0-1130d8756e29 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:06.136565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fdc72c9b-e6b7-4c6f-83b0-1130d8756e29 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:06.148809 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fdc72c9b-e6b7-4c6f-83b0-1130d8756e29 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1314 microversion: 2.1 time: 0.282789 Oct 11 04:22:06.152325 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1344/2798] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:05 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:06.171341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-edb9153a-53ec-4458-8a37-acc9b248b1dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:06.175653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-edb9153a-53ec-4458-8a37-acc9b248b1dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:06.193200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb9153a-53ec-4458-8a37-acc9b248b1dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:06.196873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb9153a-53ec-4458-8a37-acc9b248b1dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:06.198518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb9153a-53ec-4458-8a37-acc9b248b1dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:06.200393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb9153a-53ec-4458-8a37-acc9b248b1dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:06.203152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb9153a-53ec-4458-8a37-acc9b248b1dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:06.203607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb9153a-53ec-4458-8a37-acc9b248b1dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:06.474726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-edb9153a-53ec-4458-8a37-acc9b248b1dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:06.491372 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-edb9153a-53ec-4458-8a37-acc9b248b1dc tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1527 microversion: 2.1 time: 0.336628 Oct 11 04:22:06.495148 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1345/2799] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:06 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1527 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:06.504800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3ca207b-4b56-40f7-9bbf-f034d792fe07 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:06.506422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d3ca207b-4b56-40f7-9bbf-f034d792fe07 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:06.530239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ca207b-4b56-40f7-9bbf-f034d792fe07 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:06.530942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ca207b-4b56-40f7-9bbf-f034d792fe07 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:06.534330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ca207b-4b56-40f7-9bbf-f034d792fe07 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:06.535256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ca207b-4b56-40f7-9bbf-f034d792fe07 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:06.535797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ca207b-4b56-40f7-9bbf-f034d792fe07 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:06.536560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ca207b-4b56-40f7-9bbf-f034d792fe07 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:06.881082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d3ca207b-4b56-40f7-9bbf-f034d792fe07 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:06.890163 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d3ca207b-4b56-40f7-9bbf-f034d792fe07 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1307 microversion: 2.1 time: 0.393649 Oct 11 04:22:06.893676 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1346/2800] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:06 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1307 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:06.908620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-cdf9dee2-ce65-4cc0-8a85-df12fc3832c3 req-28e9ab57-b8c2-4313-81d8-7efc7657f2f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99ecc72-094d-4756-a9b3-fc9d374b440e", "name": "network-vif-plugged", "status": "completed", "tag": "1bcba2d7-91a1-41e1-9f49-4319b6515cef"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:06.920130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cdf9dee2-ce65-4cc0-8a85-df12fc3832c3 req-28e9ab57-b8c2-4313-81d8-7efc7657f2f4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:06.920615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cdf9dee2-ce65-4cc0-8a85-df12fc3832c3 req-28e9ab57-b8c2-4313-81d8-7efc7657f2f4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:06.921126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cdf9dee2-ce65-4cc0-8a85-df12fc3832c3 req-28e9ab57-b8c2-4313-81d8-7efc7657f2f4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:06.936625 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-cdf9dee2-ce65-4cc0-8a85-df12fc3832c3 req-28e9ab57-b8c2-4313-81d8-7efc7657f2f4 service nova] Creating event network-vif-plugged:1bcba2d7-91a1-41e1-9f49-4319b6515cef for instance a99ecc72-094d-4756-a9b3-fc9d374b440e on n-h1-860892-1 Oct 11 04:22:06.942749 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-cdf9dee2-ce65-4cc0-8a85-df12fc3832c3 req-28e9ab57-b8c2-4313-81d8-7efc7657f2f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046433 Oct 11 04:22:06.943676 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1347/2801] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:07.176454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a9ed92fd-6164-42ba-a848-134c00036693 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:07.177163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a9ed92fd-6164-42ba-a848-134c00036693 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:07.185749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9ed92fd-6164-42ba-a848-134c00036693 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:07.186496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9ed92fd-6164-42ba-a848-134c00036693 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:07.187111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9ed92fd-6164-42ba-a848-134c00036693 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:07.187974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9ed92fd-6164-42ba-a848-134c00036693 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:07.188794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9ed92fd-6164-42ba-a848-134c00036693 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:07.189942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9ed92fd-6164-42ba-a848-134c00036693 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:07.350465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a9ed92fd-6164-42ba-a848-134c00036693 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:07.364674 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a9ed92fd-6164-42ba-a848-134c00036693 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1314 microversion: 2.1 time: 0.189186 Oct 11 04:22:07.364674 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1348/2802] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:07 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:07.539288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d741330d-d2df-4b82-84f0-edc2b46d12b9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:07.540048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d741330d-d2df-4b82-84f0-edc2b46d12b9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:07.567462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d741330d-d2df-4b82-84f0-edc2b46d12b9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:07.569117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d741330d-d2df-4b82-84f0-edc2b46d12b9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:07.572367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d741330d-d2df-4b82-84f0-edc2b46d12b9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:07.577546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d741330d-d2df-4b82-84f0-edc2b46d12b9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:07.579685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d741330d-d2df-4b82-84f0-edc2b46d12b9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:07.580628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d741330d-d2df-4b82-84f0-edc2b46d12b9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:08.750734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d741330d-d2df-4b82-84f0-edc2b46d12b9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:08.855351 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d741330d-d2df-4b82-84f0-edc2b46d12b9 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1527 microversion: 2.1 time: 1.277134 Oct 11 04:22:08.858663 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1349/2803] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:07 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1527 bytes in 1339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:08.883973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dc0e4eda-499d-4ba5-ae72-027f4e1fadc0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:08.893102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dc0e4eda-499d-4ba5-ae72-027f4e1fadc0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:08.914395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0e4eda-499d-4ba5-ae72-027f4e1fadc0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:08.918687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0e4eda-499d-4ba5-ae72-027f4e1fadc0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:08.920973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0e4eda-499d-4ba5-ae72-027f4e1fadc0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:08.925224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0e4eda-499d-4ba5-ae72-027f4e1fadc0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:08.931760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0e4eda-499d-4ba5-ae72-027f4e1fadc0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:08.933792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0e4eda-499d-4ba5-ae72-027f4e1fadc0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:09.227096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc0e4eda-499d-4ba5-ae72-027f4e1fadc0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:09.242899 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dc0e4eda-499d-4ba5-ae72-027f4e1fadc0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1307 microversion: 2.1 time: 0.382851 Oct 11 04:22:09.261281 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1350/2804] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:08 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1307 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:09.266835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dbcd27f6-3360-40b0-904a-722fff080dbc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:09.267596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dbcd27f6-3360-40b0-904a-722fff080dbc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:09.274020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbcd27f6-3360-40b0-904a-722fff080dbc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:09.274832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbcd27f6-3360-40b0-904a-722fff080dbc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:09.275730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbcd27f6-3360-40b0-904a-722fff080dbc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:09.276599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbcd27f6-3360-40b0-904a-722fff080dbc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:09.277220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbcd27f6-3360-40b0-904a-722fff080dbc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:09.277852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbcd27f6-3360-40b0-904a-722fff080dbc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:09.302565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:09.436946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dbcd27f6-3360-40b0-904a-722fff080dbc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:09.445455 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dbcd27f6-3360-40b0-904a-722fff080dbc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1314 microversion: 2.1 time: 0.187498 Oct 11 04:22:09.446036 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1351/2805] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:09 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1314 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:09.600358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a7e3f794-3525-4be5-aae3-2b9e70ef7d12 req-f9551684-69ee-432f-8e0c-b8d7af732318 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe7a86c0-79fe-4793-a20f-c2c2f7872228", "name": "network-vif-deleted", "tag": "6ff409cf-6662-4dac-a448-46e41118ee89"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:09.613032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a7e3f794-3525-4be5-aae3-2b9e70ef7d12 req-f9551684-69ee-432f-8e0c-b8d7af732318 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:09.614079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a7e3f794-3525-4be5-aae3-2b9e70ef7d12 req-f9551684-69ee-432f-8e0c-b8d7af732318 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:09.614759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a7e3f794-3525-4be5-aae3-2b9e70ef7d12 req-f9551684-69ee-432f-8e0c-b8d7af732318 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:09.630755 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a7e3f794-3525-4be5-aae3-2b9e70ef7d12 req-f9551684-69ee-432f-8e0c-b8d7af732318 service nova] Creating event network-vif-deleted:6ff409cf-6662-4dac-a448-46e41118ee89 for instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 on n-h2-860892-1 Oct 11 04:22:09.636930 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a7e3f794-3525-4be5-aae3-2b9e70ef7d12 req-f9551684-69ee-432f-8e0c-b8d7af732318 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041120 Oct 11 04:22:09.654672 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1352/2806] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:22:09.680098 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7ffd3dd0-98b6-4d76-b398-69573db8cea2 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f/action" status: 202 len: 0 microversion: 2.1 time: 6.428128 Oct 11 04:22:09.688884 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1455/2807] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:22:03 2022] POST /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f/action => generated 0 bytes in 6433 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:09.693049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f03905e-2425-4811-b560-587b92f535b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:09.693755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2f03905e-2425-4811-b560-587b92f535b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:09.701728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f03905e-2425-4811-b560-587b92f535b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:09.702259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f03905e-2425-4811-b560-587b92f535b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:09.702704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f03905e-2425-4811-b560-587b92f535b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:09.703437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f03905e-2425-4811-b560-587b92f535b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:09.703888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f03905e-2425-4811-b560-587b92f535b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:09.704428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f03905e-2425-4811-b560-587b92f535b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:09.887917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-24c2150e-ab69-4ea1-9530-40b3ef99522b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:09.888076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f03905e-2425-4811-b560-587b92f535b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:09.888533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-24c2150e-ab69-4ea1-9530-40b3ef99522b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:09.894353 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f03905e-2425-4811-b560-587b92f535b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1505 microversion: 2.1 time: 0.210111 Oct 11 04:22:09.896103 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1353/2808] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:09 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1505 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:09.904024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24c2150e-ab69-4ea1-9530-40b3ef99522b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:09.904538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24c2150e-ab69-4ea1-9530-40b3ef99522b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:09.904983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24c2150e-ab69-4ea1-9530-40b3ef99522b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:09.905850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24c2150e-ab69-4ea1-9530-40b3ef99522b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:09.907038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24c2150e-ab69-4ea1-9530-40b3ef99522b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:09.907629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24c2150e-ab69-4ea1-9530-40b3ef99522b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:10.017239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-24c2150e-ab69-4ea1-9530-40b3ef99522b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:10.029915 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-24c2150e-ab69-4ea1-9530-40b3ef99522b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1310 microversion: 2.1 time: 0.149290 Oct 11 04:22:10.030600 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1456/2809] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:09 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1310 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:10.267624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8752b18e-0d0d-4eb2-a2da-01c5e4996c21 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:10.269404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8752b18e-0d0d-4eb2-a2da-01c5e4996c21 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:10.285995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8752b18e-0d0d-4eb2-a2da-01c5e4996c21 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:10.291325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8752b18e-0d0d-4eb2-a2da-01c5e4996c21 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:10.292318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8752b18e-0d0d-4eb2-a2da-01c5e4996c21 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:10.295956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8752b18e-0d0d-4eb2-a2da-01c5e4996c21 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:10.296620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8752b18e-0d0d-4eb2-a2da-01c5e4996c21 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:10.298370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8752b18e-0d0d-4eb2-a2da-01c5e4996c21 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:10.442644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-8b9a8c2f-e12e-4142-a008-7d4335f2e27e req-4ac963af-372f-4b85-96de-0ced3631fa94 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "557ba8ab-6c3d-4794-95ad-0dd362e8f43c", "name": "network-vif-plugged", "status": "completed", "tag": "2b360fd2-c9ae-4f42-a38f-64fea173e759"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:10.454116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8b9a8c2f-e12e-4142-a008-7d4335f2e27e req-4ac963af-372f-4b85-96de-0ced3631fa94 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:10.454911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8b9a8c2f-e12e-4142-a008-7d4335f2e27e req-4ac963af-372f-4b85-96de-0ced3631fa94 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:10.455504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8b9a8c2f-e12e-4142-a008-7d4335f2e27e req-4ac963af-372f-4b85-96de-0ced3631fa94 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:10.477756 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8b9a8c2f-e12e-4142-a008-7d4335f2e27e req-4ac963af-372f-4b85-96de-0ced3631fa94 service nova] Creating event network-vif-plugged:2b360fd2-c9ae-4f42-a38f-64fea173e759 for instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c on n-h1-860892-1 Oct 11 04:22:10.485295 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-8b9a8c2f-e12e-4142-a008-7d4335f2e27e req-4ac963af-372f-4b85-96de-0ced3631fa94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047227 Oct 11 04:22:10.486723 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1457/2810] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:22:10.493287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cda1ac85-6077-45dd-931b-67a27a07c33d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:10.494409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cda1ac85-6077-45dd-931b-67a27a07c33d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:10.502061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cda1ac85-6077-45dd-931b-67a27a07c33d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:10.502759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cda1ac85-6077-45dd-931b-67a27a07c33d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:10.503509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cda1ac85-6077-45dd-931b-67a27a07c33d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:10.504834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cda1ac85-6077-45dd-931b-67a27a07c33d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:10.505478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cda1ac85-6077-45dd-931b-67a27a07c33d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:10.506143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cda1ac85-6077-45dd-931b-67a27a07c33d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:10.581178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8752b18e-0d0d-4eb2-a2da-01c5e4996c21 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:10.592628 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8752b18e-0d0d-4eb2-a2da-01c5e4996c21 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1307 microversion: 2.1 time: 0.329356 Oct 11 04:22:10.594401 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1354/2811] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:10 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1307 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:10.802769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cda1ac85-6077-45dd-931b-67a27a07c33d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:10.816642 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cda1ac85-6077-45dd-931b-67a27a07c33d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1314 microversion: 2.1 time: 0.325821 Oct 11 04:22:10.818048 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1458/2812] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:10 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:10.927623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2aa8cf00-3ce2-4a6c-8ffc-524bd40eaba5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:10.927623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2aa8cf00-3ce2-4a6c-8ffc-524bd40eaba5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:10.961357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aa8cf00-3ce2-4a6c-8ffc-524bd40eaba5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:10.962271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aa8cf00-3ce2-4a6c-8ffc-524bd40eaba5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:10.962967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aa8cf00-3ce2-4a6c-8ffc-524bd40eaba5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:10.974605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aa8cf00-3ce2-4a6c-8ffc-524bd40eaba5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:10.984032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aa8cf00-3ce2-4a6c-8ffc-524bd40eaba5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:11.004637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aa8cf00-3ce2-4a6c-8ffc-524bd40eaba5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:11.059068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:11.059689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:11.072140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:11.073244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:11.074811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:11.079255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:11.080218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:11.081601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:11.152975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:11.157185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:11.158172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:11.162947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lazy-loading 'fault' on Instance uuid fe7a86c0-79fe-4793-a20f-c2c2f7872228 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:22:11.309025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:11.324028 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb9934b9-70b3-428a-bf66-33ddf68a2b91 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 200 len: 1315 microversion: 2.1 time: 0.269965 Oct 11 04:22:11.324668 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1459/2813] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:11 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:11.472726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2aa8cf00-3ce2-4a6c-8ffc-524bd40eaba5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:11.484549 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2aa8cf00-3ce2-4a6c-8ffc-524bd40eaba5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1505 microversion: 2.1 time: 0.568026 Oct 11 04:22:11.485950 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1355/2814] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:10 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1505 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:11.619341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a1d25c9c-d3f6-465a-a71e-18ce6e98aac1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:11.619341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a1d25c9c-d3f6-465a-a71e-18ce6e98aac1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:11.632696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1d25c9c-d3f6-465a-a71e-18ce6e98aac1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:11.634901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1d25c9c-d3f6-465a-a71e-18ce6e98aac1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:11.636905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1d25c9c-d3f6-465a-a71e-18ce6e98aac1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:11.639638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1d25c9c-d3f6-465a-a71e-18ce6e98aac1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:11.641543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1d25c9c-d3f6-465a-a71e-18ce6e98aac1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:11.643788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1d25c9c-d3f6-465a-a71e-18ce6e98aac1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:11.840107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dacba192-7e58-42b3-b94f-b561c5f90643 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:11.840820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dacba192-7e58-42b3-b94f-b561c5f90643 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:11.852498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacba192-7e58-42b3-b94f-b561c5f90643 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:11.853278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacba192-7e58-42b3-b94f-b561c5f90643 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:11.853903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacba192-7e58-42b3-b94f-b561c5f90643 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:11.862148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacba192-7e58-42b3-b94f-b561c5f90643 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:11.862148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacba192-7e58-42b3-b94f-b561c5f90643 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:11.862148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacba192-7e58-42b3-b94f-b561c5f90643 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:12.055708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a1d25c9c-d3f6-465a-a71e-18ce6e98aac1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:12.071894 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a1d25c9c-d3f6-465a-a71e-18ce6e98aac1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1488 microversion: 2.1 time: 0.459866 Oct 11 04:22:12.072759 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1460/2815] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:11 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1488 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:12.098155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a73a14cd-4713-4637-86c7-b918700e5418 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:12.098810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a73a14cd-4713-4637-86c7-b918700e5418 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:12.124938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a73a14cd-4713-4637-86c7-b918700e5418 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:12.126343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a73a14cd-4713-4637-86c7-b918700e5418 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:12.127780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a73a14cd-4713-4637-86c7-b918700e5418 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:12.129162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a73a14cd-4713-4637-86c7-b918700e5418 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:12.135775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a73a14cd-4713-4637-86c7-b918700e5418 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:12.137352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a73a14cd-4713-4637-86c7-b918700e5418 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:12.202745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dacba192-7e58-42b3-b94f-b561c5f90643 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:12.213986 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dacba192-7e58-42b3-b94f-b561c5f90643 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1314 microversion: 2.1 time: 0.377637 Oct 11 04:22:12.218596 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1356/2816] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:11 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1314 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:12.358845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:12.359744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:12.371616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:12.372113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:12.373110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:12.373855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:12.374359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:12.375018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:12.391838 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] HTTP exception thrown: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 HTTP/1.1 Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'fe7a86c0-79fe-4793-a20f-c2c2f7872228'} Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:12.393853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:12.397810 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:12.397810 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:12.397810 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:12.397810 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:12.397810 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:12.397810 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:12.397810 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:12.397810 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:12.400127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 404 to user: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:12.401259 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5b71b472-6e1f-4ab9-bfac-c4d51a612aed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 404 len: 111 microversion: 2.1 time: 0.056382 Oct 11 04:22:12.402439 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1357/2817] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:12 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:22:12.504427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a27c15c1-ecda-407f-942f-986438630f41 req-c09ce77f-2e35-4a0c-b436-7eceb0737112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec21f97-4e31-411a-90c9-19c8ad94693f", "name": "network-vif-unplugged", "status": "completed", "tag": "bf241d38-0545-4589-afea-60551eb1c3e1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:12.510421 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a73a14cd-4713-4637-86c7-b918700e5418 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "POST /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e/action" status: 202 len: 0 microversion: 2.1 time: 0.415756 Oct 11 04:22:12.522370 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1461/2818] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:22:12 2022] POST /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e/action => generated 0 bytes in 429 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:12.522601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a27c15c1-ecda-407f-942f-986438630f41 req-c09ce77f-2e35-4a0c-b436-7eceb0737112 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:12.523031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a27c15c1-ecda-407f-942f-986438630f41 req-c09ce77f-2e35-4a0c-b436-7eceb0737112 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:12.523898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a27c15c1-ecda-407f-942f-986438630f41 req-c09ce77f-2e35-4a0c-b436-7eceb0737112 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:12.542274 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a27c15c1-ecda-407f-942f-986438630f41 req-c09ce77f-2e35-4a0c-b436-7eceb0737112 service nova] Creating event network-vif-unplugged:bf241d38-0545-4589-afea-60551eb1c3e1 for instance 7ec21f97-4e31-411a-90c9-19c8ad94693f on n-h1-860892-1 Oct 11 04:22:12.547954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-84584849-098d-4587-a895-2b698132596d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:12.549865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-84584849-098d-4587-a895-2b698132596d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:12.552584 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a27c15c1-ecda-407f-942f-986438630f41 req-c09ce77f-2e35-4a0c-b436-7eceb0737112 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052597 Oct 11 04:22:12.553434 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1358/2819] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:22:12.562767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c7d97fb1-1829-4280-9723-ab872b1adeec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:12.563759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c7d97fb1-1829-4280-9723-ab872b1adeec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:12.567947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84584849-098d-4587-a895-2b698132596d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:12.570339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84584849-098d-4587-a895-2b698132596d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:12.571392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84584849-098d-4587-a895-2b698132596d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:12.576141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84584849-098d-4587-a895-2b698132596d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:12.577457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84584849-098d-4587-a895-2b698132596d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:12.581426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84584849-098d-4587-a895-2b698132596d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:12.584696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7d97fb1-1829-4280-9723-ab872b1adeec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:12.591796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7d97fb1-1829-4280-9723-ab872b1adeec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:12.591796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7d97fb1-1829-4280-9723-ab872b1adeec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:12.591796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7d97fb1-1829-4280-9723-ab872b1adeec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:12.591796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7d97fb1-1829-4280-9723-ab872b1adeec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:12.591796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7d97fb1-1829-4280-9723-ab872b1adeec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:12.600266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:12.917596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c7d97fb1-1829-4280-9723-ab872b1adeec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:12.925895 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c7d97fb1-1829-4280-9723-ab872b1adeec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1493 microversion: 2.1 time: 0.368180 Oct 11 04:22:12.926778 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1359/2820] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:12 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1493 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:12.932113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesOneServerNegativeTestJSON-server-92558209", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:12.995751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] validate_networks() for [('f32d817c-0e21-4ee5-826c-45c41a058063', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:22:13.211237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-84584849-098d-4587-a895-2b698132596d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:13.219362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:13.230832 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-84584849-098d-4587-a895-2b698132596d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1505 microversion: 2.1 time: 0.704762 Oct 11 04:22:13.233765 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1462/2821] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:12 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1505 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:13.248094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92a75a6a-2dc7-4920-add6-54f8ac9abec1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:13.248094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-92a75a6a-2dc7-4920-add6-54f8ac9abec1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:13.251558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92a75a6a-2dc7-4920-add6-54f8ac9abec1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:13.252033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92a75a6a-2dc7-4920-add6-54f8ac9abec1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:13.252468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92a75a6a-2dc7-4920-add6-54f8ac9abec1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:13.253168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92a75a6a-2dc7-4920-add6-54f8ac9abec1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:13.254051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92a75a6a-2dc7-4920-add6-54f8ac9abec1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:13.254502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92a75a6a-2dc7-4920-add6-54f8ac9abec1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:13.479337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-92a75a6a-2dc7-4920-add6-54f8ac9abec1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:13.491456 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-92a75a6a-2dc7-4920-add6-54f8ac9abec1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1500 microversion: 2.1 time: 0.256367 Oct 11 04:22:13.494238 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1463/2822] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:13 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1500 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:13.768336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:22:13.769024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:22:13.769667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:22:13.770248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:22:13.770873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:22:13.782314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:13.783050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:13.783642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:13.784531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:13.785123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:13.785721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:13.806328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Getting quotas for project 9db178c528264083bfd30875291a1797. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:22:13.812922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Getting quotas for user 7c3e365e46be4bc2b83f09bf0ebd8efc and project 9db178c528264083bfd30875291a1797. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:22:13.830000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:22:13.832355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:22:13.973708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3aba3d32-842d-42b0-ba7c-a8dd2cfd0922 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda193d7ee0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1288519318", "description": "tempest-description-1027841628"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:13.980717 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1f869fb0-3134-4722-85ae-83d715d49854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.052345 Oct 11 04:22:13.999408 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1360/2823] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:22:12 2022] POST /compute/v2.1/servers => generated 383 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:22:14.010476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ed4683bb-11ba-49c7-b5cf-f104b5625324 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:14.011100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ed4683bb-11ba-49c7-b5cf-f104b5625324 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:14.032490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed4683bb-11ba-49c7-b5cf-f104b5625324 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:14.033769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed4683bb-11ba-49c7-b5cf-f104b5625324 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:14.034443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed4683bb-11ba-49c7-b5cf-f104b5625324 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:14.035423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed4683bb-11ba-49c7-b5cf-f104b5625324 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:14.036240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed4683bb-11ba-49c7-b5cf-f104b5625324 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:14.037283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed4683bb-11ba-49c7-b5cf-f104b5625324 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:14.245319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ed4683bb-11ba-49c7-b5cf-f104b5625324 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:14.256057 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ed4683bb-11ba-49c7-b5cf-f104b5625324 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 200 len: 1473 microversion: 2.1 time: 0.255512 Oct 11 04:22:14.258016 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1361/2824] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:13 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 1473 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:14.264862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7c1da6b6-04fd-4d0e-acb1-0aead6afb356 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:14.265640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7c1da6b6-04fd-4d0e-acb1-0aead6afb356 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:14.379942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7c1da6b6-04fd-4d0e-acb1-0aead6afb356 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:14.387398 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7c1da6b6-04fd-4d0e-acb1-0aead6afb356 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1223 microversion: 2.1 time: 0.128072 Oct 11 04:22:14.388472 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1362/2825] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:14 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1223 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:14.398311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1f7edb5-6961-4173-8da3-cf97100ed152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:14.399343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f1f7edb5-6961-4173-8da3-cf97100ed152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:14.407105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f7edb5-6961-4173-8da3-cf97100ed152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:14.407589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f7edb5-6961-4173-8da3-cf97100ed152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:14.408099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f7edb5-6961-4173-8da3-cf97100ed152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:14.408967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f7edb5-6961-4173-8da3-cf97100ed152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:14.409471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f7edb5-6961-4173-8da3-cf97100ed152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:14.409899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f7edb5-6961-4173-8da3-cf97100ed152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:14.607334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f1f7edb5-6961-4173-8da3-cf97100ed152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:14.617081 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f1f7edb5-6961-4173-8da3-cf97100ed152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1505 microversion: 2.1 time: 0.227411 Oct 11 04:22:14.617877 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1363/2826] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:14 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1505 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:14.627418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d4d6bb5a-8808-4963-aeed-89ea0ac04851 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-1849358087"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:14.630467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d4d6bb5a-8808-4963-aeed-89ea0ac04851 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:14.639761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb5a-8808-4963-aeed-89ea0ac04851 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:14.641607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb5a-8808-4963-aeed-89ea0ac04851 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:14.642122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb5a-8808-4963-aeed-89ea0ac04851 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:14.642928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb5a-8808-4963-aeed-89ea0ac04851 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:14.643417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb5a-8808-4963-aeed-89ea0ac04851 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:14.643849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4d6bb5a-8808-4963-aeed-89ea0ac04851 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:14.747408 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3aba3d32-842d-42b0-ba7c-a8dd2cfd0922 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 248 microversion: 2.1 time: 1.250664 Oct 11 04:22:14.748552 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1464/2827] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:22:13 2022] POST /compute/v2.1/os-security-groups => generated 248 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:14.766786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-64f4d50c-50ef-4bd1-9af9-b9175d35cf59 req-456647cc-a741-491d-a315-62e0d0824265 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec21f97-4e31-411a-90c9-19c8ad94693f", "tag": "bf241d38-0545-4589-afea-60551eb1c3e1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:14.793989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-64f4d50c-50ef-4bd1-9af9-b9175d35cf59 req-456647cc-a741-491d-a315-62e0d0824265 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:14.795357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-64f4d50c-50ef-4bd1-9af9-b9175d35cf59 req-456647cc-a741-491d-a315-62e0d0824265 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:14.795979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-64f4d50c-50ef-4bd1-9af9-b9175d35cf59 req-456647cc-a741-491d-a315-62e0d0824265 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:14.811802 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-64f4d50c-50ef-4bd1-9af9-b9175d35cf59 req-456647cc-a741-491d-a315-62e0d0824265 service nova] Creating event network-changed:bf241d38-0545-4589-afea-60551eb1c3e1 for instance 7ec21f97-4e31-411a-90c9-19c8ad94693f on n-h1-860892-1 Oct 11 04:22:14.819665 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-64f4d50c-50ef-4bd1-9af9-b9175d35cf59 req-456647cc-a741-491d-a315-62e0d0824265 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058906 Oct 11 04:22:14.820825 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1465/2828] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:14.829025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f35b24f1-aedd-4ff9-8be2-7404583cc917 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda19411310>, body: {"security_group_rule": {"parent_group_id": "187b1f31-5293-4c1c-b602-b7c1be15be5b", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:15.349283 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d4d6bb5a-8808-4963-aeed-89ea0ac04851 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "POST /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e/action" status: 202 len: 0 microversion: 2.1 time: 0.729933 Oct 11 04:22:15.357251 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1364/2829] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:22:14 2022] POST /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e/action => generated 0 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 04:22:15.380002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2683dbb8-2f87-4e35-8a14-1e62aa9be07a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19246670>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:15.453448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f35b24f1-aedd-4ff9-8be2-7404583cc917 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 0.627883 Oct 11 04:22:15.455115 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1466/2830] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:22:14 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:15.480541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-93352829-f552-4c4c-a77e-c3773c8e6f46 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:15.482599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-93352829-f552-4c4c-a77e-c3773c8e6f46 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:15.487790 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2683dbb8-2f87-4e35-8a14-1e62aa9be07a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.129191 Oct 11 04:22:15.495972 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1365/2831] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:15 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:15.508111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a3aa7b1-e37b-4231-918d-883ec861646b tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda19246550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-713277408", "description": "tempest-description-635188108"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:15.627008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-93352829-f552-4c4c-a77e-c3773c8e6f46 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:15.639320 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-93352829-f552-4c4c-a77e-c3773c8e6f46 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1223 microversion: 2.1 time: 0.171911 Oct 11 04:22:15.643631 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1467/2832] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:15 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1223 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:15.655220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36f347d8-e39b-48f8-ac6d-fd7c4a95fe47 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:15.655848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-36f347d8-e39b-48f8-ac6d-fd7c4a95fe47 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:15.667535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36f347d8-e39b-48f8-ac6d-fd7c4a95fe47 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:15.670442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36f347d8-e39b-48f8-ac6d-fd7c4a95fe47 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:15.672014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36f347d8-e39b-48f8-ac6d-fd7c4a95fe47 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:15.672915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36f347d8-e39b-48f8-ac6d-fd7c4a95fe47 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:15.673371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36f347d8-e39b-48f8-ac6d-fd7c4a95fe47 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:15.676080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36f347d8-e39b-48f8-ac6d-fd7c4a95fe47 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:15.876482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-36f347d8-e39b-48f8-ac6d-fd7c4a95fe47 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:15.892191 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-36f347d8-e39b-48f8-ac6d-fd7c4a95fe47 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1505 microversion: 2.1 time: 0.246636 Oct 11 04:22:15.893996 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1468/2833] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:15 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1505 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:16.199104 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5a3aa7b1-e37b-4231-918d-883ec861646b tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 0.702019 Oct 11 04:22:16.199701 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1366/2834] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:22:15 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:16.247069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d4fd4437-0b0e-42bc-9941-8376d479134c tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda1a80daf0>, body: {"security_group_rule": {"parent_group_id": "45291c2a-76bf-4624-9fb1-7cac54c80ab0", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "cidr": "10.2.3.124/24"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:16.519887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aacc3c8d-6cb8-43c7-80d2-27811469b987 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19211c10>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:16.583679 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aacc3c8d-6cb8-43c7-80d2-27811469b987 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.074563 Oct 11 04:22:16.585141 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1367/2835] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:16 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:16.687099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bea2694e-c84a-439f-8010-9ea0c96d98d6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:16.689647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bea2694e-c84a-439f-8010-9ea0c96d98d6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:16.699943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea2694e-c84a-439f-8010-9ea0c96d98d6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:16.706381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea2694e-c84a-439f-8010-9ea0c96d98d6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:16.706381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea2694e-c84a-439f-8010-9ea0c96d98d6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:16.706381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea2694e-c84a-439f-8010-9ea0c96d98d6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:16.706381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea2694e-c84a-439f-8010-9ea0c96d98d6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:16.706381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bea2694e-c84a-439f-8010-9ea0c96d98d6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:16.820028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bea2694e-c84a-439f-8010-9ea0c96d98d6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:16.833186 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bea2694e-c84a-439f-8010-9ea0c96d98d6 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1275 microversion: 2.1 time: 0.172155 Oct 11 04:22:16.841531 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1368/2836] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:16 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1275 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:16.845619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02cd6a9d-11bb-4203-9d99-e08ba04a0561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae931f19-085a-45a9-bc84-5323485c11d4"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:16.848387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-02cd6a9d-11bb-4203-9d99-e08ba04a0561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:16.859431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02cd6a9d-11bb-4203-9d99-e08ba04a0561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:16.860439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02cd6a9d-11bb-4203-9d99-e08ba04a0561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:16.861127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02cd6a9d-11bb-4203-9d99-e08ba04a0561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:16.862046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02cd6a9d-11bb-4203-9d99-e08ba04a0561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:16.862735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02cd6a9d-11bb-4203-9d99-e08ba04a0561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:16.863389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02cd6a9d-11bb-4203-9d99-e08ba04a0561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:17.051506 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d4fd4437-0b0e-42bc-9941-8376d479134c tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 236 microversion: 2.1 time: 0.839593 Oct 11 04:22:17.053707 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1469/2837] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:22:16 2022] POST /compute/v2.1/os-security-group-rules => generated 236 bytes in 844 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:17.061859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fe69a6e0-4865-48f1-b19d-a1555bc55902 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:17.063167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fe69a6e0-4865-48f1-b19d-a1555bc55902 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:17.069643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe69a6e0-4865-48f1-b19d-a1555bc55902 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:17.070135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe69a6e0-4865-48f1-b19d-a1555bc55902 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:17.070609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe69a6e0-4865-48f1-b19d-a1555bc55902 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:17.071476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe69a6e0-4865-48f1-b19d-a1555bc55902 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:17.072098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe69a6e0-4865-48f1-b19d-a1555bc55902 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:17.072531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe69a6e0-4865-48f1-b19d-a1555bc55902 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:17.252622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fe69a6e0-4865-48f1-b19d-a1555bc55902 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:17.261358 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fe69a6e0-4865-48f1-b19d-a1555bc55902 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1505 microversion: 2.1 time: 0.205906 Oct 11 04:22:17.261937 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1470/2838] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:17 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1505 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:17.267472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5f8725da-9805-4022-b137-366731e317b5 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda1e0eadc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1270395310", "description": "tempest-description-755353332"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:17.863315 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5f8725da-9805-4022-b137-366731e317b5 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.599990 Oct 11 04:22:17.864914 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1471/2839] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:22:17 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:17.870449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-444acfad-ef21-4f40-a27a-bee2bdf1a7be tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193d7e50>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:17.916511 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-444acfad-ef21-4f40-a27a-bee2bdf1a7be tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.050307 Oct 11 04:22:17.917073 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1472/2840] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:17 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:17.922468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30f87718-0c18-43cc-a057-06783ad5c2ad tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:17.923391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30f87718-0c18-43cc-a057-06783ad5c2ad tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:17.930296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f87718-0c18-43cc-a057-06783ad5c2ad tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:17.930975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f87718-0c18-43cc-a057-06783ad5c2ad tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:17.931593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f87718-0c18-43cc-a057-06783ad5c2ad tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:17.932451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f87718-0c18-43cc-a057-06783ad5c2ad tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:17.933062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f87718-0c18-43cc-a057-06783ad5c2ad tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:17.933755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f87718-0c18-43cc-a057-06783ad5c2ad tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:18.005940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30f87718-0c18-43cc-a057-06783ad5c2ad tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:18.016526 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30f87718-0c18-43cc-a057-06783ad5c2ad tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1283 microversion: 2.1 time: 0.098051 Oct 11 04:22:18.021847 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1473/2841] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:17 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:18.040390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9a0b2360-9d21-468d-abc1-435f71eaf276 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda194ef5e0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-309145195", "description": "tempest-description-1166415328"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:18.254994 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02cd6a9d-11bb-4203-9d99-e08ba04a0561 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.414564 Oct 11 04:22:18.259373 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1369/2842] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:22:16 2022] POST /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c/os-volume_attachments => generated 194 bytes in 1420 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:18.291578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bf1608c1-26a3-4778-a2d5-bff771340ef3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:18.292736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bf1608c1-26a3-4778-a2d5-bff771340ef3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:18.300894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1608c1-26a3-4778-a2d5-bff771340ef3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:18.307560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1608c1-26a3-4778-a2d5-bff771340ef3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:18.308129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1608c1-26a3-4778-a2d5-bff771340ef3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:18.309102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1608c1-26a3-4778-a2d5-bff771340ef3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:18.310990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1608c1-26a3-4778-a2d5-bff771340ef3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:18.311550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1608c1-26a3-4778-a2d5-bff771340ef3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:18.566618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf1608c1-26a3-4778-a2d5-bff771340ef3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:18.589229 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bf1608c1-26a3-4778-a2d5-bff771340ef3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1505 microversion: 2.1 time: 0.302233 Oct 11 04:22:18.589831 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1370/2843] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:18 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1505 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:18.630586 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9a0b2360-9d21-468d-abc1-435f71eaf276 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 0.607320 Oct 11 04:22:18.634416 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1474/2844] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:22:18 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:18.653830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6f6280fb-6007-4d5d-baaa-57c6ce422038 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda199b6820>, body: {"security_group_rule": {"parent_group_id": "340914c9-db4a-4b64-b3c9-11cca796d34a", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "fe890550-26c7-420f-a517-8d7b9d0d43a3"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:18.942152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-725efbcb-3a07-483e-896e-c03b0315a0b8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193d7f70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:19.024640 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-725efbcb-3a07-483e-896e-c03b0315a0b8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.091521 Oct 11 04:22:19.026634 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1475/2845] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:18 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:19.057382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a9b0e58-19de-4d45-b1b3-63ac8add81f5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:19.059880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a9b0e58-19de-4d45-b1b3-63ac8add81f5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:19.078490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a9b0e58-19de-4d45-b1b3-63ac8add81f5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:19.079360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a9b0e58-19de-4d45-b1b3-63ac8add81f5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:19.080066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a9b0e58-19de-4d45-b1b3-63ac8add81f5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:19.081386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a9b0e58-19de-4d45-b1b3-63ac8add81f5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:19.082293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a9b0e58-19de-4d45-b1b3-63ac8add81f5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:19.083440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a9b0e58-19de-4d45-b1b3-63ac8add81f5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:19.358631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a9b0e58-19de-4d45-b1b3-63ac8add81f5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:19.391050 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a9b0e58-19de-4d45-b1b3-63ac8add81f5 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1323 microversion: 2.1 time: 0.344446 Oct 11 04:22:19.391768 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1476/2846] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:19 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1323 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:19.617199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bf661186-1a0a-45d1-829b-3987450efd63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:19.626638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bf661186-1a0a-45d1-829b-3987450efd63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:19.643320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf661186-1a0a-45d1-829b-3987450efd63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:19.644513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf661186-1a0a-45d1-829b-3987450efd63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:19.645735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf661186-1a0a-45d1-829b-3987450efd63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:19.646726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf661186-1a0a-45d1-829b-3987450efd63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:19.647716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf661186-1a0a-45d1-829b-3987450efd63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:19.648314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf661186-1a0a-45d1-829b-3987450efd63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:19.838791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf661186-1a0a-45d1-829b-3987450efd63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:19.871165 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bf661186-1a0a-45d1-829b-3987450efd63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1505 microversion: 2.1 time: 0.259629 Oct 11 04:22:19.874028 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1477/2847] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:19 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1505 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:20.049125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8a4a3bc8-0aa6-4038-abdf-8dd381f23e0a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193fc8b0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:20.052030 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6f6280fb-6007-4d5d-baaa-57c6ce422038 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 330 microversion: 2.1 time: 1.409342 Oct 11 04:22:20.052640 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1371/2848] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:22:18 2022] POST /compute/v2.1/os-security-group-rules => generated 330 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:20.072503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-04f98368-6c09-4917-9c2c-b51f3083c107 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda191d0dc0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1369741805", "description": "tempest-description-60573607"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:20.142658 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8a4a3bc8-0aa6-4038-abdf-8dd381f23e0a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.100037 Oct 11 04:22:20.151084 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1478/2849] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:20 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:20.415381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-19e32c3c-cc35-4fe8-912e-0c2611362759 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:20.416097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-19e32c3c-cc35-4fe8-912e-0c2611362759 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:20.432260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e32c3c-cc35-4fe8-912e-0c2611362759 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:20.432770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e32c3c-cc35-4fe8-912e-0c2611362759 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:20.433208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e32c3c-cc35-4fe8-912e-0c2611362759 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:20.434100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e32c3c-cc35-4fe8-912e-0c2611362759 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:20.435152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e32c3c-cc35-4fe8-912e-0c2611362759 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:20.435730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e32c3c-cc35-4fe8-912e-0c2611362759 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:20.782507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-19e32c3c-cc35-4fe8-912e-0c2611362759 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:20.796421 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-19e32c3c-cc35-4fe8-912e-0c2611362759 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1323 microversion: 2.1 time: 0.385227 Oct 11 04:22:20.797590 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1479/2850] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:20 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1323 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:20.900603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e1000093-d28a-4f46-90f7-6e07d2c98616 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:20.902829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e1000093-d28a-4f46-90f7-6e07d2c98616 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:20.912109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1000093-d28a-4f46-90f7-6e07d2c98616 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:20.912887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1000093-d28a-4f46-90f7-6e07d2c98616 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:20.913557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1000093-d28a-4f46-90f7-6e07d2c98616 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:20.914422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1000093-d28a-4f46-90f7-6e07d2c98616 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:20.915119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1000093-d28a-4f46-90f7-6e07d2c98616 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:20.915781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1000093-d28a-4f46-90f7-6e07d2c98616 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:21.262596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e1000093-d28a-4f46-90f7-6e07d2c98616 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:21.278648 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e1000093-d28a-4f46-90f7-6e07d2c98616 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1505 microversion: 2.1 time: 0.378605 Oct 11 04:22:21.279340 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1480/2851] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:20 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1505 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:21.308716 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-04f98368-6c09-4917-9c2c-b51f3083c107 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 246 microversion: 2.1 time: 1.237817 Oct 11 04:22:21.308716 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1372/2852] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:22:20 2022] POST /compute/v2.1/os-security-groups => generated 246 bytes in 1240 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:22:21.314761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-70ea1685-531c-4248-bd5a-21b21afe9f00 req-740d6811-08ed-4c46-87d7-934cee14135a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d1605cf-ca80-4a18-80fb-a0315a1134cc", "tag": "147c82d2-c4d8-4899-9099-0dea6c0adde0"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:21.327989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c97c18cf-fe38-4c42-9144-d61a62f66c5f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193fcb80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:21.344829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-70ea1685-531c-4248-bd5a-21b21afe9f00 req-740d6811-08ed-4c46-87d7-934cee14135a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:21.345147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-70ea1685-531c-4248-bd5a-21b21afe9f00 req-740d6811-08ed-4c46-87d7-934cee14135a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:21.345588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-70ea1685-531c-4248-bd5a-21b21afe9f00 req-740d6811-08ed-4c46-87d7-934cee14135a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:21.369728 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-70ea1685-531c-4248-bd5a-21b21afe9f00 req-740d6811-08ed-4c46-87d7-934cee14135a service nova] Creating event network-changed:147c82d2-c4d8-4899-9099-0dea6c0adde0 for instance 6d1605cf-ca80-4a18-80fb-a0315a1134cc on n-h2-860892-1 Oct 11 04:22:21.387264 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-70ea1685-531c-4248-bd5a-21b21afe9f00 req-740d6811-08ed-4c46-87d7-934cee14135a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078389 Oct 11 04:22:21.388379 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1373/2853] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:21.393866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-84163faa-c8e8-4ebc-9db4-498744c4d65c tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda192a2af0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-2690484", "description": "tempest-description-1567318904"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:21.400441 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c97c18cf-fe38-4c42-9144-d61a62f66c5f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.099713 Oct 11 04:22:21.402759 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1481/2854] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:21 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:21.820587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-85a699df-5946-4d86-80ed-22844cd855fa tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:21.822110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-85a699df-5946-4d86-80ed-22844cd855fa tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:21.840422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85a699df-5946-4d86-80ed-22844cd855fa tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:21.840784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85a699df-5946-4d86-80ed-22844cd855fa tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:21.841988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85a699df-5946-4d86-80ed-22844cd855fa tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:21.845672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85a699df-5946-4d86-80ed-22844cd855fa tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:21.848970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85a699df-5946-4d86-80ed-22844cd855fa tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:21.849692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85a699df-5946-4d86-80ed-22844cd855fa tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:22.202461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-85a699df-5946-4d86-80ed-22844cd855fa tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:22.216000 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-85a699df-5946-4d86-80ed-22844cd855fa tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1323 microversion: 2.1 time: 0.398668 Oct 11 04:22:22.232623 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1482/2855] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:21 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1323 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:22.305965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d5bdd7aa-6b04-4638-bd35-1ccd1985e176 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:22.306959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d5bdd7aa-6b04-4638-bd35-1ccd1985e176 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:22.320430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5bdd7aa-6b04-4638-bd35-1ccd1985e176 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:22.322700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5bdd7aa-6b04-4638-bd35-1ccd1985e176 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:22.324841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5bdd7aa-6b04-4638-bd35-1ccd1985e176 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:22.326515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5bdd7aa-6b04-4638-bd35-1ccd1985e176 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:22.328626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5bdd7aa-6b04-4638-bd35-1ccd1985e176 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:22.329747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5bdd7aa-6b04-4638-bd35-1ccd1985e176 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:22.461355 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-84163faa-c8e8-4ebc-9db4-498744c4d65c tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 245 microversion: 2.1 time: 1.071199 Oct 11 04:22:22.462555 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1374/2856] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:22:21 2022] POST /compute/v2.1/os-security-groups => generated 245 bytes in 1073 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:22.475904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-57931055-cf3c-43fd-a681-16f647a428bf req-907ebde1-8412-423d-a411-1c28a24aa463 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99ecc72-094d-4756-a9b3-fc9d374b440e", "name": "network-vif-plugged", "status": "completed", "tag": "1bcba2d7-91a1-41e1-9f49-4319b6515cef"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:22.501882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-57931055-cf3c-43fd-a681-16f647a428bf req-907ebde1-8412-423d-a411-1c28a24aa463 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:22.502913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-57931055-cf3c-43fd-a681-16f647a428bf req-907ebde1-8412-423d-a411-1c28a24aa463 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:22.503571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-57931055-cf3c-43fd-a681-16f647a428bf req-907ebde1-8412-423d-a411-1c28a24aa463 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:22.536767 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-57931055-cf3c-43fd-a681-16f647a428bf req-907ebde1-8412-423d-a411-1c28a24aa463 service nova] Creating event network-vif-plugged:1bcba2d7-91a1-41e1-9f49-4319b6515cef for instance a99ecc72-094d-4756-a9b3-fc9d374b440e on n-h1-860892-1 Oct 11 04:22:22.568936 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-57931055-cf3c-43fd-a681-16f647a428bf req-907ebde1-8412-423d-a411-1c28a24aa463 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102283 Oct 11 04:22:22.571476 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1375/2857] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:22.593493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-86430202-7ffe-4202-888a-60aceb7c7731 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda191e9b80>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:22.713236 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-86430202-7ffe-4202-888a-60aceb7c7731 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.139681 Oct 11 04:22:22.714139 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1376/2858] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:22 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:22.719392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e4319bec-36ff-4b5c-8b0c-a01fe7d9d287 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda192a23a0>, body: {"security_group_rule": {"parent_group_id": "0593a45b-d2c3-4df2-9b68-a85b95ed7675", "ip_protocol": "tcp", "from_port": 22, "to_port": 22, "group_id": "02a82d58-c21b-4b58-bf6a-01334777763c"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:22.914214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d5bdd7aa-6b04-4638-bd35-1ccd1985e176 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:22.922083 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d5bdd7aa-6b04-4638-bd35-1ccd1985e176 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1505 microversion: 2.1 time: 0.620313 Oct 11 04:22:22.954268 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1483/2859] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:22 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1505 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:23.239804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b183fe46-6f40-49b6-a454-4318397b7bed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:23.240730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b183fe46-6f40-49b6-a454-4318397b7bed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:23.251386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b183fe46-6f40-49b6-a454-4318397b7bed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:23.252248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b183fe46-6f40-49b6-a454-4318397b7bed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:23.254887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b183fe46-6f40-49b6-a454-4318397b7bed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:23.254887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b183fe46-6f40-49b6-a454-4318397b7bed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:23.256424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b183fe46-6f40-49b6-a454-4318397b7bed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:23.257236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b183fe46-6f40-49b6-a454-4318397b7bed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:23.615907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b183fe46-6f40-49b6-a454-4318397b7bed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:23.644240 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b183fe46-6f40-49b6-a454-4318397b7bed tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1323 microversion: 2.1 time: 0.408886 Oct 11 04:22:23.645483 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1484/2860] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:23 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1323 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:23.670958 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e4319bec-36ff-4b5c-8b0c-a01fe7d9d287 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 328 microversion: 2.1 time: 0.955536 Oct 11 04:22:23.671605 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1377/2861] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:22:22 2022] POST /compute/v2.1/os-security-group-rules => generated 328 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:23.685314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-baf9e638-aa25-464a-b3d1-04a9e855eab4 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Calling method '.version_select at 0x7fda19f48820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:23.729918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-38bd8c5b-3555-41da-9771-5b1a1e08fbc5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda191ecca0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:23.829309 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-38bd8c5b-3555-41da-9771-5b1a1e08fbc5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.104238 Oct 11 04:22:23.833341 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1378/2862] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:23 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:23.949844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68b20b59-b5aa-405c-b63f-150fd852087c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:23.950989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68b20b59-b5aa-405c-b63f-150fd852087c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:23.960374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68b20b59-b5aa-405c-b63f-150fd852087c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:23.961458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68b20b59-b5aa-405c-b63f-150fd852087c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:23.962154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68b20b59-b5aa-405c-b63f-150fd852087c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:23.963200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68b20b59-b5aa-405c-b63f-150fd852087c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:23.963855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68b20b59-b5aa-405c-b63f-150fd852087c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:23.965212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68b20b59-b5aa-405c-b63f-150fd852087c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:23.997044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:24.195985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68b20b59-b5aa-405c-b63f-150fd852087c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:24.208187 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68b20b59-b5aa-405c-b63f-150fd852087c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1495 microversion: 2.1 time: 0.262267 Oct 11 04:22:24.219484 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1379/2863] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:23 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1495 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:24.235396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-280c4c4c-bfb6-4176-b2d4-f97da81d38ca tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '.version_select at 0x7fda191e9b80>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:24.240460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-280c4c4c-bfb6-4176-b2d4-f97da81d38ca tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:24.241304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-280c4c4c-bfb6-4176-b2d4-f97da81d38ca tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:24.242140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-280c4c4c-bfb6-4176-b2d4-f97da81d38ca tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:24.251616 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-280c4c4c-bfb6-4176-b2d4-f97da81d38ca tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 398 microversion: 2.1 time: 0.018690 Oct 11 04:22:24.276662 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1380/2864] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:22:24 2022] GET /compute/v2.1/os-migrations => generated 398 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:24.282773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0a4f2479-3318-4040-ac7f-6d0aac5fa4ec tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:24.284108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0a4f2479-3318-4040-ac7f-6d0aac5fa4ec tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:24.293501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4f2479-3318-4040-ac7f-6d0aac5fa4ec tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:24.294418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4f2479-3318-4040-ac7f-6d0aac5fa4ec tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:24.295142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4f2479-3318-4040-ac7f-6d0aac5fa4ec tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:24.296227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4f2479-3318-4040-ac7f-6d0aac5fa4ec tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:24.296952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4f2479-3318-4040-ac7f-6d0aac5fa4ec tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:24.297748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4f2479-3318-4040-ac7f-6d0aac5fa4ec tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:24.384485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:24.490985 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0a4f2479-3318-4040-ac7f-6d0aac5fa4ec tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1646 microversion: 2.1 time: 0.218240 Oct 11 04:22:24.491932 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1381/2865] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:24 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1646 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:24.579937 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-baf9e638-aa25-464a-b3d1-04a9e855eab4 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/02a82d58-c21b-4b58-bf6a-01334777763c" status: 202 len: 0 microversion: 2.1 time: 0.899134 Oct 11 04:22:24.581781 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1485/2866] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:22:23 2022] DELETE /compute/v2.1/os-security-groups/02a82d58-c21b-4b58-bf6a-01334777763c => generated 0 bytes in 903 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:24.589423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-378e28a6-4f7f-4e1e-9145-d6d75f1a92a0 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Calling method '.version_select at 0x7fda19b2f790>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:24.614782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:24.668625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5495fc02-684f-4b96-a306-d772818c5b2d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:24.670158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5495fc02-684f-4b96-a306-d772818c5b2d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:24.680114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5495fc02-684f-4b96-a306-d772818c5b2d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:24.683049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5495fc02-684f-4b96-a306-d772818c5b2d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:24.683768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5495fc02-684f-4b96-a306-d772818c5b2d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:24.687444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5495fc02-684f-4b96-a306-d772818c5b2d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:24.689981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5495fc02-684f-4b96-a306-d772818c5b2d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:24.692393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5495fc02-684f-4b96-a306-d772818c5b2d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:24.780979 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-378e28a6-4f7f-4e1e-9145-d6d75f1a92a0 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/0593a45b-d2c3-4df2-9b68-a85b95ed7675" status: 200 len: 246 microversion: 2.1 time: 0.195198 Oct 11 04:22:24.781944 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1382/2867] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:22:24 2022] GET /compute/v2.1/os-security-groups/0593a45b-d2c3-4df2-9b68-a85b95ed7675 => generated 246 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:24.787566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1352565219", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "5ff9bcca-b89a-450b-98cb-6e2aeae348c3"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:24.915902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] validate_networks() for [('5ff9bcca-b89a-450b-98cb-6e2aeae348c3', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:22:25.410732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5495fc02-684f-4b96-a306-d772818c5b2d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:25.440447 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5495fc02-684f-4b96-a306-d772818c5b2d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1323 microversion: 2.1 time: 0.776305 Oct 11 04:22:25.462072 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1486/2868] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:24 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1323 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:25.476932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9523c97e-18df-4f36-9422-a48177dd9be1 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda1942eca0>, body: {"security_group": {"name": "tempest-SecurityGroupRulesTestJSON-securitygroup-1584989590", "description": "tempest-description-930037987"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:25.633133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:26.029493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:22:26.030081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:22:26.030435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:22:26.030851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:22:26.031266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:22:26.085935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:26.091200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:26.093229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:26.096257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:26.096828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:26.097270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:26.152250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Getting quotas for project 15b90becc5a545f0965359b05561721f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:22:26.168561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Getting quotas for user ea114683a3754c8197b61fc5ef04fe0d and project 15b90becc5a545f0965359b05561721f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:22:26.203560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:22:26.211046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:22:26.495927 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-67ae448b-12b6-451f-88b2-d0ccb1a29fe4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.712288 Oct 11 04:22:26.505978 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1383/2869] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:22:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 1723 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:22:26.537022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3245147-98c3-4ba6-a043-adef819b075a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda191e99d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:26.633382 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3245147-98c3-4ba6-a043-adef819b075a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.125583 Oct 11 04:22:26.635731 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1384/2870] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:26 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:26.644827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02213c7a-9d76-4cb3-8c82-4882bc810c8b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:26.658468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02213c7a-9d76-4cb3-8c82-4882bc810c8b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:26.660273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-02213c7a-9d76-4cb3-8c82-4882bc810c8b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Searching by: {'deleted': False, 'project_id': '37f9f0f6eef640cf926169521c02a36d'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:22:26.667869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02213c7a-9d76-4cb3-8c82-4882bc810c8b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:26.668722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02213c7a-9d76-4cb3-8c82-4882bc810c8b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:26.669364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02213c7a-9d76-4cb3-8c82-4882bc810c8b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:26.671463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02213c7a-9d76-4cb3-8c82-4882bc810c8b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:26.672786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02213c7a-9d76-4cb3-8c82-4882bc810c8b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:26.673422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02213c7a-9d76-4cb3-8c82-4882bc810c8b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:26.715637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-02213c7a-9d76-4cb3-8c82-4882bc810c8b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:22:26.797264 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02213c7a-9d76-4cb3-8c82-4882bc810c8b tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 333 microversion: 2.1 time: 0.147899 Oct 11 04:22:26.797264 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1385/2871] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:22:26 2022] GET /compute/v2.1/servers => generated 333 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:26.800823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ac87820f-e1b6-43a3-8468-117ff5e84530 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:26.802313 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9523c97e-18df-4f36-9422-a48177dd9be1 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 247 microversion: 2.1 time: 1.338284 Oct 11 04:22:26.803390 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1487/2872] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:22:25 2022] POST /compute/v2.1/os-security-groups => generated 247 bytes in 1341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:26.809161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1ca310fe-9e1c-4653-91f2-d27fc334db26 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:26.810665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1ca310fe-9e1c-4653-91f2-d27fc334db26 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:26.812910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ac87820f-e1b6-43a3-8468-117ff5e84530 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:26.817467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=92 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:26.822773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac87820f-e1b6-43a3-8468-117ff5e84530 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:26.823922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac87820f-e1b6-43a3-8468-117ff5e84530 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:26.825453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac87820f-e1b6-43a3-8468-117ff5e84530 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:26.826444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac87820f-e1b6-43a3-8468-117ff5e84530 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:26.827453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac87820f-e1b6-43a3-8468-117ff5e84530 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:26.828111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac87820f-e1b6-43a3-8468-117ff5e84530 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:26.967800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1ca310fe-9e1c-4653-91f2-d27fc334db26 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:26.976445 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1ca310fe-9e1c-4653-91f2-d27fc334db26 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1211 microversion: 2.1 time: 0.171612 Oct 11 04:22:26.980762 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1488/2873] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:26 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1211 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:26.997885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:27.006513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:27.014498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Searching by: {'deleted': False, 'project_id': '37f9f0f6eef640cf926169521c02a36d'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:22:27.033679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:27.034732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:27.035357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:27.036376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:27.036979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:27.039291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:27.105583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:22:27.211112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:27.225454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:27.226402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:27.227335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:27.378108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ac87820f-e1b6-43a3-8468-117ff5e84530 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:27.394941 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ac87820f-e1b6-43a3-8468-117ff5e84530 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1323 microversion: 2.1 time: 0.604380 Oct 11 04:22:27.399294 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1386/2874] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:26 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1323 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:27.410870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c3affe9d-89bf-4839-a625-aa00ca3a563b tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda191d24c0>, body: {"security_group_rule": {"parent_group_id": "14f8ccbc-f8c5-4e89-b94d-e0c373ec6a05", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:27.595349 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-74747c44-4a3f-4dea-aac8-b1a9ca5588d8 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 1697 microversion: 2.1 time: 0.612531 Oct 11 04:22:27.596126 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1489/2875] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:22:26 2022] GET /compute/v2.1/servers/detail => generated 1697 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:27.624263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f83ce444-bc57-47b2-a5d5-5450ceb1378e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:27.701902 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f83ce444-bc57-47b2-a5d5-5450ceb1378e tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/flavors/452" status: 200 len: 370 microversion: 2.1 time: 0.077998 Oct 11 04:22:27.726322 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1490/2876] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:22:27 2022] GET /compute/v2.1/flavors/452 => generated 370 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:27.731635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-271d36a0-6c97-4f0f-8045-5f964a794ded tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19404790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:27.813751 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-271d36a0-6c97-4f0f-8045-5f964a794ded tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.093363 Oct 11 04:22:27.822848 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1491/2877] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:27 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:28.006835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4c51affd-fc1e-41fc-8441-19b2a98dfb62 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:28.007701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4c51affd-fc1e-41fc-8441-19b2a98dfb62 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:28.104988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4c51affd-fc1e-41fc-8441-19b2a98dfb62 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:28.113512 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4c51affd-fc1e-41fc-8441-19b2a98dfb62 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1211 microversion: 2.1 time: 0.111075 Oct 11 04:22:28.138577 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1492/2878] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:28 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1211 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:28.143905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-85bba95f-3798-44dc-a0f3-2497991b6856 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:28.144670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-85bba95f-3798-44dc-a0f3-2497991b6856 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:28.151362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bba95f-3798-44dc-a0f3-2497991b6856 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:28.152124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bba95f-3798-44dc-a0f3-2497991b6856 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:28.152775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bba95f-3798-44dc-a0f3-2497991b6856 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:28.154326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bba95f-3798-44dc-a0f3-2497991b6856 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:28.154993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bba95f-3798-44dc-a0f3-2497991b6856 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:28.155629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85bba95f-3798-44dc-a0f3-2497991b6856 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:28.204071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-85bba95f-3798-44dc-a0f3-2497991b6856 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:22:28.259816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:28.792560 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-85bba95f-3798-44dc-a0f3-2497991b6856 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "DELETE /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 204 len: 0 microversion: 2.1 time: 0.651629 Oct 11 04:22:28.794837 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1493/2879] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:22:28 2022] DELETE /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 0 bytes in 655 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:22:28.804684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-45dc4b05-1f2d-4ecb-8044-c4da3128c03a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:28.809469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45dc4b05-1f2d-4ecb-8044-c4da3128c03a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:28.819783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc4b05-1f2d-4ecb-8044-c4da3128c03a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:28.820952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc4b05-1f2d-4ecb-8044-c4da3128c03a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:28.821629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc4b05-1f2d-4ecb-8044-c4da3128c03a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:28.822570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc4b05-1f2d-4ecb-8044-c4da3128c03a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:28.823181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc4b05-1f2d-4ecb-8044-c4da3128c03a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:28.824004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc4b05-1f2d-4ecb-8044-c4da3128c03a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:28.840136 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c3affe9d-89bf-4839-a625-aa00ca3a563b tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.436690 Oct 11 04:22:28.840136 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1387/2880] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:22:27 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:28.857926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35b25036-5bae-4dd2-a685-5c767dc6dec2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:28.859971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-35b25036-5bae-4dd2-a685-5c767dc6dec2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:28.880440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:28.891610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35b25036-5bae-4dd2-a685-5c767dc6dec2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:28.892385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35b25036-5bae-4dd2-a685-5c767dc6dec2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:28.893015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35b25036-5bae-4dd2-a685-5c767dc6dec2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:28.894508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35b25036-5bae-4dd2-a685-5c767dc6dec2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:28.895220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35b25036-5bae-4dd2-a685-5c767dc6dec2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:28.895659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35b25036-5bae-4dd2-a685-5c767dc6dec2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:29.069842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45dc4b05-1f2d-4ecb-8044-c4da3128c03a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:29.100157 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-45dc4b05-1f2d-4ecb-8044-c4da3128c03a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1323 microversion: 2.1 time: 0.303292 Oct 11 04:22:29.103823 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1494/2881] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:28 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1323 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:29.117901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b5b0f60-fac7-409f-8707-e3a9874352dc tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19404550>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:29.179052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35b25036-5bae-4dd2-a685-5c767dc6dec2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:29.187894 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35b25036-5bae-4dd2-a685-5c767dc6dec2 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1700 microversion: 2.1 time: 0.347417 Oct 11 04:22:29.188632 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1388/2882] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:28 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1700 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:29.196300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b47ca659-9feb-426d-b511-e9e10830da64 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Action: 'create', calling method: .version_select at 0x7fda192a2f70>, body: {"security_group_rule": {"parent_group_id": "14f8ccbc-f8c5-4e89-b94d-e0c373ec6a05", "ip_protocol": "icmp", "from_port": -1, "to_port": -1}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:29.208682 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b5b0f60-fac7-409f-8707-e3a9874352dc tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.104499 Oct 11 04:22:29.212982 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1495/2883] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:29 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:29.218620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5b35dc8d-6537-4066-8544-4d8f43bce152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:29.219492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5b35dc8d-6537-4066-8544-4d8f43bce152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:29.234548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b35dc8d-6537-4066-8544-4d8f43bce152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:29.235328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b35dc8d-6537-4066-8544-4d8f43bce152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:29.236463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b35dc8d-6537-4066-8544-4d8f43bce152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:29.248412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b35dc8d-6537-4066-8544-4d8f43bce152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:29.250745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b35dc8d-6537-4066-8544-4d8f43bce152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:29.254069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b35dc8d-6537-4066-8544-4d8f43bce152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:29.368936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5b35dc8d-6537-4066-8544-4d8f43bce152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:29.380409 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5b35dc8d-6537-4066-8544-4d8f43bce152 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1207 microversion: 2.1 time: 0.169986 Oct 11 04:22:29.381467 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1496/2884] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:29 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1207 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:29.803829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6012d25f-9882-420e-8958-34bc14bb77d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:29.804330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6012d25f-9882-420e-8958-34bc14bb77d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:29.815957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6012d25f-9882-420e-8958-34bc14bb77d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:29.816455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6012d25f-9882-420e-8958-34bc14bb77d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:29.816893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6012d25f-9882-420e-8958-34bc14bb77d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:29.817598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6012d25f-9882-420e-8958-34bc14bb77d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:29.818051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6012d25f-9882-420e-8958-34bc14bb77d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:29.818519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6012d25f-9882-420e-8958-34bc14bb77d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:29.932133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6012d25f-9882-420e-8958-34bc14bb77d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:22:29.971422 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b47ca659-9feb-426d-b511-e9e10830da64 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 233 microversion: 2.1 time: 0.781087 Oct 11 04:22:29.972725 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1389/2885] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:22:29 2022] POST /compute/v2.1/os-security-group-rules => generated 233 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:29.984475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-603c2494-d1e3-4813-ac5f-6c8cb58b5186 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Calling method '.version_select at 0x7fda19246670>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:30.073071 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-603c2494-d1e3-4813-ac5f-6c8cb58b5186 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/14f8ccbc-f8c5-4e89-b94d-e0c373ec6a05" status: 200 len: 664 microversion: 2.1 time: 0.092388 Oct 11 04:22:30.074271 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1390/2886] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:22:29 2022] GET /compute/v2.1/os-security-groups/14f8ccbc-f8c5-4e89-b94d-e0c373ec6a05 => generated 664 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:22:30.092487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f0dd899-fa92-49c6-8427-0fc6e8a18068 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Calling method '.version_select at 0x7fda1921b430>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:30.577825 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3f0dd899-fa92-49c6-8427-0fc6e8a18068 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/629e7b89-bf7f-48a1-abcd-704bd5e9030e" status: 202 len: 0 microversion: 2.1 time: 0.492880 Oct 11 04:22:30.585127 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1391/2887] 10.222.0.26 () {58 vars in 1287 bytes} [Tue Oct 11 04:22:30 2022] DELETE /compute/v2.1/os-security-group-rules/629e7b89-bf7f-48a1-abcd-704bd5e9030e => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:30.603739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4da328d1-f5aa-4bce-afb4-510b3b5f4c0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:30.604777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4da328d1-f5aa-4bce-afb4-510b3b5f4c0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:30.623599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4da328d1-f5aa-4bce-afb4-510b3b5f4c0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:30.624499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4da328d1-f5aa-4bce-afb4-510b3b5f4c0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:30.628287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4da328d1-f5aa-4bce-afb4-510b3b5f4c0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:30.630991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4da328d1-f5aa-4bce-afb4-510b3b5f4c0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:30.632205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4da328d1-f5aa-4bce-afb4-510b3b5f4c0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:30.634452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4da328d1-f5aa-4bce-afb4-510b3b5f4c0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:30.663834 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6012d25f-9882-420e-8958-34bc14bb77d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 204 len: 0 microversion: 2.1 time: 0.863645 Oct 11 04:22:30.664582 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1497/2888] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:22:29 2022] DELETE /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 0 bytes in 865 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:22:30.672441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-345125d8-0e13-4c8e-8c3a-5d2315267712 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:30.674591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-345125d8-0e13-4c8e-8c3a-5d2315267712 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:30.714241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-345125d8-0e13-4c8e-8c3a-5d2315267712 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:30.717902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-345125d8-0e13-4c8e-8c3a-5d2315267712 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:30.725851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-345125d8-0e13-4c8e-8c3a-5d2315267712 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:30.729358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-345125d8-0e13-4c8e-8c3a-5d2315267712 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:30.741784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-345125d8-0e13-4c8e-8c3a-5d2315267712 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:30.741784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-345125d8-0e13-4c8e-8c3a-5d2315267712 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:31.041836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4da328d1-f5aa-4bce-afb4-510b3b5f4c0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:31.051485 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4da328d1-f5aa-4bce-afb4-510b3b5f4c0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1323 microversion: 2.1 time: 0.464272 Oct 11 04:22:31.066285 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1392/2889] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:30 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1323 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:31.076469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a5f55d1-22e7-4911-88c4-851a95b6675a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1921b280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:31.149045 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5a5f55d1-22e7-4911-88c4-851a95b6675a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.081168 Oct 11 04:22:31.152577 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1393/2890] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:31 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:31.155939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9a348c0-a585-4015-b9dc-96e56ea137d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:31.156852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9a348c0-a585-4015-b9dc-96e56ea137d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:31.164344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a348c0-a585-4015-b9dc-96e56ea137d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:31.164671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a348c0-a585-4015-b9dc-96e56ea137d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:31.165176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a348c0-a585-4015-b9dc-96e56ea137d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:31.166122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a348c0-a585-4015-b9dc-96e56ea137d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:31.166671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a348c0-a585-4015-b9dc-96e56ea137d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:31.167163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a348c0-a585-4015-b9dc-96e56ea137d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:31.277657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b9a348c0-a585-4015-b9dc-96e56ea137d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:31.287111 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b9a348c0-a585-4015-b9dc-96e56ea137d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1281 microversion: 2.1 time: 0.136060 Oct 11 04:22:31.287996 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1394/2891] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:31 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:31.293949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35eeb04c-bcc6-47a5-b46b-0a23e90a82d4 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Calling method '.version_select at 0x7fda19a02d30>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:31.530802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-345125d8-0e13-4c8e-8c3a-5d2315267712 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:31.544153 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-345125d8-0e13-4c8e-8c3a-5d2315267712 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1700 microversion: 2.1 time: 0.876993 Oct 11 04:22:31.545359 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1498/2892] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:30 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1700 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:31.551337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fc7e62ae-facf-44a0-814c-7b3fc93a9df3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:31.553006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fc7e62ae-facf-44a0-814c-7b3fc93a9df3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:31.560927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc7e62ae-facf-44a0-814c-7b3fc93a9df3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:31.563135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc7e62ae-facf-44a0-814c-7b3fc93a9df3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:31.563954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc7e62ae-facf-44a0-814c-7b3fc93a9df3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:31.564932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc7e62ae-facf-44a0-814c-7b3fc93a9df3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:31.568056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc7e62ae-facf-44a0-814c-7b3fc93a9df3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:31.574038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc7e62ae-facf-44a0-814c-7b3fc93a9df3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:31.894121 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35eeb04c-bcc6-47a5-b46b-0a23e90a82d4 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/14f8ccbc-f8c5-4e89-b94d-e0c373ec6a05" status: 202 len: 0 microversion: 2.1 time: 0.603833 Oct 11 04:22:31.895368 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1395/2893] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:22:31 2022] DELETE /compute/v2.1/os-security-groups/14f8ccbc-f8c5-4e89-b94d-e0c373ec6a05 => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:31.901170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-03961fca-1e76-4f97-924b-da57d016091e req-57cd8ee4-1fef-49d4-ae56-a3c3a5f9838b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1605cf-ca80-4a18-80fb-a0315a1134cc", "name": "network-vif-plugged", "status": "completed", "tag": "147c82d2-c4d8-4899-9099-0dea6c0adde0"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:31.955639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fc7e62ae-facf-44a0-814c-7b3fc93a9df3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:31.964241 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fc7e62ae-facf-44a0-814c-7b3fc93a9df3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1552 microversion: 2.1 time: 0.417224 Oct 11 04:22:31.967455 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1499/2894] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:31 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1552 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:31.972749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-03961fca-1e76-4f97-924b-da57d016091e req-57cd8ee4-1fef-49d4-ae56-a3c3a5f9838b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:31.978520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-03961fca-1e76-4f97-924b-da57d016091e req-57cd8ee4-1fef-49d4-ae56-a3c3a5f9838b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:31.980827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-03961fca-1e76-4f97-924b-da57d016091e req-57cd8ee4-1fef-49d4-ae56-a3c3a5f9838b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:31.983034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cb1fa733-2196-4da9-8b53-6bca1c7c9d8a tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Calling method '.version_select at 0x7fda193921f0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:32.030073 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-03961fca-1e76-4f97-924b-da57d016091e req-57cd8ee4-1fef-49d4-ae56-a3c3a5f9838b service nova] Creating event network-vif-plugged:147c82d2-c4d8-4899-9099-0dea6c0adde0 for instance 6d1605cf-ca80-4a18-80fb-a0315a1134cc on n-h2-860892-1 Oct 11 04:22:32.043365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-03961fca-1e76-4f97-924b-da57d016091e req-57cd8ee4-1fef-49d4-ae56-a3c3a5f9838b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.145414 Oct 11 04:22:32.045606 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1396/2895] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:32.075148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b4b79760-74db-4010-b240-cbd110ced816 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:32.078884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b4b79760-74db-4010-b240-cbd110ced816 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:32.079246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG neutronclient.v2_0.client [None req-cb1fa733-2196-4da9-8b53-6bca1c7c9d8a tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 02a82d58-c21b-4b58-bf6a-01334777763c does not exist", "detail": ""}} {{(pid=120994) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:22:32.079866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.security_group_api [None req-cb1fa733-2196-4da9-8b53-6bca1c7c9d8a tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Neutron security group 02a82d58-c21b-4b58-bf6a-01334777763c not found {{(pid=120994) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:22:32.080611 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-cb1fa733-2196-4da9-8b53-6bca1c7c9d8a tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] HTTP exception thrown: Security group 02a82d58-c21b-4b58-bf6a-01334777763c does not exist Oct 11 04:22:32.080611 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-dfe2b774-55df-40d7-8576-8dd11cfae98a'] Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cb1fa733-2196-4da9-8b53-6bca1c7c9d8a tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Request method failure captured: Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-security-groups/02a82d58-c21b-4b58-bf6a-01334777763c HTTP/1.1 Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO91NpaSwrU8QJ7_Lt_dAJ8efG6vSFgSTLK1TvmAB6BZUqMCkLhxGWTaHO7GQ6b1Yy5RHggL_lu7D-dVbOYScM1i24MzamJJE8WyoSgYlvM9PjP8YKnl28-Ijl7LFYEm9eIgPJk3BmHykK3FiyskJo-VMN7kmpK03_TagSEY1XZJqsY Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 987ad51eb1914b8a93cd146fcf8e4075 Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupRulesTestJSON-227660699 Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/987ad51eb1914b8a93cd146fcf8e4075"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_987ad51eb1914b8a93cd146fcf8e4075"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/987ad51eb1914b8a93cd146fcf8e4075"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/987ad51eb1914b8a93cd146fcf8e4075"}]}] Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupRulesTestJSON-227660699 Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 987ad51eb1914b8a93cd146fcf8e4075 Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupRulesTestJSON-227660699 Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupRulesTestJSON-227660699-project Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 481efec24c72480d8533eec954d97985 Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupRulesTestJSON-227660699-project Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: exception: Security group 02a82d58-c21b-4b58-bf6a-01334777763c does not exist Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-dfe2b774-55df-40d7-8576-8dd11cfae98a'] Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '02a82d58-c21b-4b58-bf6a-01334777763c'} Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:22:32.082877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 02a82d58-c21b-4b58-bf6a-01334777763c does not exist Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfe2b774-55df-40d7-8576-8dd11cfae98a'] Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 02a82d58-c21b-4b58-bf6a-01334777763c does not exist Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfe2b774-55df-40d7-8576-8dd11cfae98a'] Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 02a82d58-c21b-4b58-bf6a-01334777763c does not exist Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfe2b774-55df-40d7-8576-8dd11cfae98a'] Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 02a82d58-c21b-4b58-bf6a-01334777763c does not exist Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-dfe2b774-55df-40d7-8576-8dd11cfae98a'] Oct 11 04:22:32.086879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:32.092302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cb1fa733-2196-4da9-8b53-6bca1c7c9d8a tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Returning 404 to user: Security group 02a82d58-c21b-4b58-bf6a-01334777763c does not exist Oct 11 04:22:32.092302 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-dfe2b774-55df-40d7-8576-8dd11cfae98a'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:32.093510 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cb1fa733-2196-4da9-8b53-6bca1c7c9d8a tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/02a82d58-c21b-4b58-bf6a-01334777763c" status: 404 len: 194 microversion: 2.1 time: 0.124333 Oct 11 04:22:32.094296 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1500/2896] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:22:31 2022] DELETE /compute/v2.1/os-security-groups/02a82d58-c21b-4b58-bf6a-01334777763c => generated 194 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:22:32.107113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea4c2067-2bce-4110-b4b2-e5e042463335 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Calling method '.version_select at 0x7fda193fcd30>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:32.147585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4b79760-74db-4010-b240-cbd110ced816 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:32.152336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4b79760-74db-4010-b240-cbd110ced816 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:32.153986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4b79760-74db-4010-b240-cbd110ced816 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:32.160435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4b79760-74db-4010-b240-cbd110ced816 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:32.162419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4b79760-74db-4010-b240-cbd110ced816 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:32.165070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4b79760-74db-4010-b240-cbd110ced816 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:33.105290 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea4c2067-2bce-4110-b4b2-e5e042463335 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/0593a45b-d2c3-4df2-9b68-a85b95ed7675" status: 202 len: 0 microversion: 2.1 time: 1.003913 Oct 11 04:22:33.107209 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1501/2897] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:22:32 2022] DELETE /compute/v2.1/os-security-groups/0593a45b-d2c3-4df2-9b68-a85b95ed7675 => generated 0 bytes in 1007 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:33.114267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a3d4c33d-28d0-401f-ad0d-abccaea51b7b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1a0c3af0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:33.208290 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a3d4c33d-28d0-401f-ad0d-abccaea51b7b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.097800 Oct 11 04:22:33.218847 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1502/2898] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:33 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:33.227122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8d69c335-a25e-4d1d-9d0a-61caf2839dd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:33.231888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8d69c335-a25e-4d1d-9d0a-61caf2839dd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:33.269666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d69c335-a25e-4d1d-9d0a-61caf2839dd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:33.277001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d69c335-a25e-4d1d-9d0a-61caf2839dd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:33.279578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d69c335-a25e-4d1d-9d0a-61caf2839dd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:33.280667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d69c335-a25e-4d1d-9d0a-61caf2839dd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:33.283688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d69c335-a25e-4d1d-9d0a-61caf2839dd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:33.286342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d69c335-a25e-4d1d-9d0a-61caf2839dd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:33.671590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8d69c335-a25e-4d1d-9d0a-61caf2839dd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:33.679867 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8d69c335-a25e-4d1d-9d0a-61caf2839dd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1269 microversion: 2.1 time: 0.469717 Oct 11 04:22:33.680439 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1503/2899] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:33 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1269 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:33.696165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-52381eac-37d2-4018-bbef-ae4639a78819 req-c7176ea3-18d3-4354-9cf4-1d77dc52a52e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "991871b9-cf55-45c9-8140-6e9e3b5c3ea1", "name": "network-vif-deleted", "tag": "980ebd8a-8dff-4169-93c7-dda5438c46fa"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:33.723597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-52381eac-37d2-4018-bbef-ae4639a78819 req-c7176ea3-18d3-4354-9cf4-1d77dc52a52e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:33.724522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-52381eac-37d2-4018-bbef-ae4639a78819 req-c7176ea3-18d3-4354-9cf4-1d77dc52a52e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:33.729144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-52381eac-37d2-4018-bbef-ae4639a78819 req-c7176ea3-18d3-4354-9cf4-1d77dc52a52e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:33.765199 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-52381eac-37d2-4018-bbef-ae4639a78819 req-c7176ea3-18d3-4354-9cf4-1d77dc52a52e service nova] Creating event network-vif-deleted:980ebd8a-8dff-4169-93c7-dda5438c46fa for instance 991871b9-cf55-45c9-8140-6e9e3b5c3ea1 on n-h2-860892-1 Oct 11 04:22:33.774015 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-52381eac-37d2-4018-bbef-ae4639a78819 req-c7176ea3-18d3-4354-9cf4-1d77dc52a52e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089715 Oct 11 04:22:33.780564 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1504/2900] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:33.782450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b4b79760-74db-4010-b240-cbd110ced816 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:33.797490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:33.797490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:33.798311 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b4b79760-74db-4010-b240-cbd110ced816 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1323 microversion: 2.1 time: 1.722584 Oct 11 04:22:33.800481 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1397/2901] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:32 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1323 bytes in 1731 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:33.807547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:33.811179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:33.812233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:33.813887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:33.815616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0445f84a-6fbc-4dd7-bd0c-a2f3da2815d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:33.816390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:33.816990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:33.817601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0445f84a-6fbc-4dd7-bd0c-a2f3da2815d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:33.841461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0445f84a-6fbc-4dd7-bd0c-a2f3da2815d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:33.841978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0445f84a-6fbc-4dd7-bd0c-a2f3da2815d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:33.842458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0445f84a-6fbc-4dd7-bd0c-a2f3da2815d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:33.843219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0445f84a-6fbc-4dd7-bd0c-a2f3da2815d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:33.848761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0445f84a-6fbc-4dd7-bd0c-a2f3da2815d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:33.849297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0445f84a-6fbc-4dd7-bd0c-a2f3da2815d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:33.909787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:33.911862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:33.918042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:33.923553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lazy-loading 'fault' on Instance uuid 991871b9-cf55-45c9-8140-6e9e3b5c3ea1 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:22:34.114598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0667b04f93364fcda7e456013e541dba', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37f9f0f6eef640cf926169521c02a36d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:34.124489 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-98fe6993-e042-4a5c-bd93-f81f77f9d762 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 200 len: 1359 microversion: 2.1 time: 0.342470 Oct 11 04:22:34.134009 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1505/2902] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:33 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:34.145255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5b20b08d-8544-4c86-b139-290d65a27d67 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Calling method '.version_select at 0x7fda19392a60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:34.585223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0445f84a-6fbc-4dd7-bd0c-a2f3da2815d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:34.604098 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0445f84a-6fbc-4dd7-bd0c-a2f3da2815d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1552 microversion: 2.1 time: 0.798114 Oct 11 04:22:34.604098 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1398/2903] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:33 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1552 bytes in 801 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:34.613450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ed1251ce-0956-4ae2-9bbe-9c2159270e30 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1921b4c0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:34.688511 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ed1251ce-0956-4ae2-9bbe-9c2159270e30 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.084157 Oct 11 04:22:34.696949 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1399/2904] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:34 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:34.719970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c8301fb2-73ef-43da-8396-f2bda216311c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:34.720870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c8301fb2-73ef-43da-8396-f2bda216311c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:34.745347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8301fb2-73ef-43da-8396-f2bda216311c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:34.748020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8301fb2-73ef-43da-8396-f2bda216311c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:34.748644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8301fb2-73ef-43da-8396-f2bda216311c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:34.749894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8301fb2-73ef-43da-8396-f2bda216311c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:34.751741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8301fb2-73ef-43da-8396-f2bda216311c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:34.752857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8301fb2-73ef-43da-8396-f2bda216311c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:34.963925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c8301fb2-73ef-43da-8396-f2bda216311c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:34.995818 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c8301fb2-73ef-43da-8396-f2bda216311c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1269 microversion: 2.1 time: 0.287030 Oct 11 04:22:34.998712 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1400/2905] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:34 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1269 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:35.023903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2dd13afc-52b0-455e-8498-3a51de715499 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:35.026005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2dd13afc-52b0-455e-8498-3a51de715499 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:35.039468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2dd13afc-52b0-455e-8498-3a51de715499 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:35.040931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2dd13afc-52b0-455e-8498-3a51de715499 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:35.040931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2dd13afc-52b0-455e-8498-3a51de715499 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:35.042412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2dd13afc-52b0-455e-8498-3a51de715499 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:35.044768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2dd13afc-52b0-455e-8498-3a51de715499 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:35.045513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2dd13afc-52b0-455e-8498-3a51de715499 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:35.315741 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5b20b08d-8544-4c86-b139-290d65a27d67 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/fe890550-26c7-420f-a517-8d7b9d0d43a3" status: 202 len: 0 microversion: 2.1 time: 1.180298 Oct 11 04:22:35.316334 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1506/2906] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:22:34 2022] DELETE /compute/v2.1/os-security-groups/fe890550-26c7-420f-a517-8d7b9d0d43a3 => generated 0 bytes in 1182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:35.321947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f12e40f6-ba20-4144-b41c-9a61e1c4ec7e req-a0a2ba40-3072-48eb-9aab-8f7a09eef1c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "557ba8ab-6c3d-4794-95ad-0dd362e8f43c", "name": "network-vif-deleted", "tag": "2b360fd2-c9ae-4f42-a38f-64fea173e759"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:35.348787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f12e40f6-ba20-4144-b41c-9a61e1c4ec7e req-a0a2ba40-3072-48eb-9aab-8f7a09eef1c7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:35.351211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f12e40f6-ba20-4144-b41c-9a61e1c4ec7e req-a0a2ba40-3072-48eb-9aab-8f7a09eef1c7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:35.360994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f12e40f6-ba20-4144-b41c-9a61e1c4ec7e req-a0a2ba40-3072-48eb-9aab-8f7a09eef1c7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:35.389371 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-f12e40f6-ba20-4144-b41c-9a61e1c4ec7e req-a0a2ba40-3072-48eb-9aab-8f7a09eef1c7 service nova] Creating event network-vif-deleted:2b360fd2-c9ae-4f42-a38f-64fea173e759 for instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c on n-h1-860892-1 Oct 11 04:22:35.396932 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f12e40f6-ba20-4144-b41c-9a61e1c4ec7e req-a0a2ba40-3072-48eb-9aab-8f7a09eef1c7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078647 Oct 11 04:22:35.398451 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1507/2907] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:35.412705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:35.416585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] [instance: 991871b9-cf55-45c9-8140-6e9e3b5c3ea1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:35.422375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:35.423215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:35.424453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:35.426317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:35.427499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:35.428161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:35.444424 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] HTTP exception thrown: Instance 991871b9-cf55-45c9-8140-6e9e3b5c3ea1 could not be found. Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Request method failure captured: Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 HTTP/1.1 Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO84bN9_rnSZE--N6KZJIe7hAa7E_Ttx453JhMlAsJe43OZHdzKBWxz0OtuZOyLS60x24ybdfaTqzev_kYRYm6FTUuvQcnVvkfcqNQ5CioXJduwITjjH6jnWM0cK-4T0_gntfHpapQfLqyRPV6bz2sl-L2YbBRUykE-h205XiiEQmTI Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 37f9f0f6eef640cf926169521c02a36d Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-4829944 Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37f9f0f6eef640cf926169521c02a36d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37f9f0f6eef640cf926169521c02a36d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37f9f0f6eef640cf926169521c02a36d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37f9f0f6eef640cf926169521c02a36d"}]}] Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-4829944 Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 37f9f0f6eef640cf926169521c02a36d Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-4829944 Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-4829944-project Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0667b04f93364fcda7e456013e541dba Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-4829944-project Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 991871b9-cf55-45c9-8140-6e9e3b5c3ea1 could not be found. Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '991871b9-cf55-45c9-8140-6e9e3b5c3ea1'} Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 991871b9-cf55-45c9-8140-6e9e3b5c3ea1 could not be found. Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 991871b9-cf55-45c9-8140-6e9e3b5c3ea1 could not be found. Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:35.448801 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:35.454210 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:35.454210 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:35.454210 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:35.454210 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:35.454210 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 991871b9-cf55-45c9-8140-6e9e3b5c3ea1 could not be found. Oct 11 04:22:35.454210 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:35.454210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Returning 404 to user: Instance 991871b9-cf55-45c9-8140-6e9e3b5c3ea1 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:35.463643 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0109c0ef-01de-4622-8be5-ee25ceb16e17 tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1" status: 404 len: 111 microversion: 2.1 time: 0.055737 Oct 11 04:22:35.469796 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1508/2908] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:35 2022] GET /compute/v2.1/servers/991871b9-cf55-45c9-8140-6e9e3b5c3ea1 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:22:35.476355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1cad1c96-9a56-4162-b694-13dd82a5ebb2 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Calling method '.version_select at 0x7fda19392790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:35.542016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2dd13afc-52b0-455e-8498-3a51de715499 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:35.556854 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2dd13afc-52b0-455e-8498-3a51de715499 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1323 microversion: 2.1 time: 0.544109 Oct 11 04:22:35.570214 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1401/2909] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:34 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1323 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:35.579799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b88009b8-b155-4a1c-8453-c9818505736c tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] Calling method '.version_select at 0x7fda19246280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:35.721536 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b88009b8-b155-4a1c-8453-c9818505736c tempest-ServersTestJSON-4829944 tempest-ServersTestJSON-4829944-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524069730" status: 202 len: 0 microversion: 2.1 time: 0.154655 Oct 11 04:22:35.721536 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1402/2910] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:22:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1524069730 => generated 0 bytes in 158 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:35.724976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c4af67cb-6edf-4d98-8f71-e3b00ade27aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:35.725680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c4af67cb-6edf-4d98-8f71-e3b00ade27aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:35.734434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4af67cb-6edf-4d98-8f71-e3b00ade27aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:35.735075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4af67cb-6edf-4d98-8f71-e3b00ade27aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:35.735789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4af67cb-6edf-4d98-8f71-e3b00ade27aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:35.737020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4af67cb-6edf-4d98-8f71-e3b00ade27aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:35.737381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4af67cb-6edf-4d98-8f71-e3b00ade27aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:35.738100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4af67cb-6edf-4d98-8f71-e3b00ade27aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:35.917654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c4af67cb-6edf-4d98-8f71-e3b00ade27aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:35.928880 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c4af67cb-6edf-4d98-8f71-e3b00ade27aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1345 microversion: 2.1 time: 0.207730 Oct 11 04:22:35.930268 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1403/2911] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:35 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1345 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:35.946349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1fad5002-cb23-474d-864d-8f88f88cf34b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda192469d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:36.020074 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1fad5002-cb23-474d-864d-8f88f88cf34b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.088688 Oct 11 04:22:36.021498 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1404/2912] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:35 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:36.043839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f97ddef0-73bc-4990-8d2b-8a6f3e98f35b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:36.046083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f97ddef0-73bc-4990-8d2b-8a6f3e98f35b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:36.060860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f97ddef0-73bc-4990-8d2b-8a6f3e98f35b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:36.062766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f97ddef0-73bc-4990-8d2b-8a6f3e98f35b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:36.065505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f97ddef0-73bc-4990-8d2b-8a6f3e98f35b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:36.066478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f97ddef0-73bc-4990-8d2b-8a6f3e98f35b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:36.068147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f97ddef0-73bc-4990-8d2b-8a6f3e98f35b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:36.068782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f97ddef0-73bc-4990-8d2b-8a6f3e98f35b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:36.192031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:36.227568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f97ddef0-73bc-4990-8d2b-8a6f3e98f35b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:36.241160 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f97ddef0-73bc-4990-8d2b-8a6f3e98f35b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1269 microversion: 2.1 time: 0.218369 Oct 11 04:22:36.248998 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1405/2913] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:36 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1269 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:36.586806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-70aee43b-32f5-46dd-bf0d-5f038b3ed92a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:36.587214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-70aee43b-32f5-46dd-bf0d-5f038b3ed92a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:36.604013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70aee43b-32f5-46dd-bf0d-5f038b3ed92a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:36.607777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70aee43b-32f5-46dd-bf0d-5f038b3ed92a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:36.607777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70aee43b-32f5-46dd-bf0d-5f038b3ed92a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:36.608418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70aee43b-32f5-46dd-bf0d-5f038b3ed92a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:36.608876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70aee43b-32f5-46dd-bf0d-5f038b3ed92a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:36.609301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70aee43b-32f5-46dd-bf0d-5f038b3ed92a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:36.699539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:37.071012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:37.080827 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1cad1c96-9a56-4162-b694-13dd82a5ebb2 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/340914c9-db4a-4b64-b3c9-11cca796d34a" status: 202 len: 0 microversion: 2.1 time: 1.609501 Oct 11 04:22:37.082060 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1509/2914] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:22:35 2022] DELETE /compute/v2.1/os-security-groups/340914c9-db4a-4b64-b3c9-11cca796d34a => generated 0 bytes in 1611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:37.090109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-404cd593-f4ab-4a4e-8e84-34280931fac5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:37.103034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-404cd593-f4ab-4a4e-8e84-34280931fac5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:37.126014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-404cd593-f4ab-4a4e-8e84-34280931fac5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:37.126845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-404cd593-f4ab-4a4e-8e84-34280931fac5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:37.127504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-404cd593-f4ab-4a4e-8e84-34280931fac5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:37.128407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-404cd593-f4ab-4a4e-8e84-34280931fac5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:37.129308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-404cd593-f4ab-4a4e-8e84-34280931fac5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:37.129960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-404cd593-f4ab-4a4e-8e84-34280931fac5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:37.379709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-404cd593-f4ab-4a4e-8e84-34280931fac5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:37.384207 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-404cd593-f4ab-4a4e-8e84-34280931fac5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1345 microversion: 2.1 time: 0.300757 Oct 11 04:22:37.397945 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1510/2915] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:37 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1345 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:37.414557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-76cb6e64-7a06-4741-b57e-f8c38db36000 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193fce50>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:37.561797 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-76cb6e64-7a06-4741-b57e-f8c38db36000 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.157137 Oct 11 04:22:37.571936 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1511/2916] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:37 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:37.579881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-519d420a-53d5-442c-bacd-8132ae776ac5 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Calling method '.version_select at 0x7fda1e0ead30>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:37.936871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-70aee43b-32f5-46dd-bf0d-5f038b3ed92a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:37.954431 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-70aee43b-32f5-46dd-bf0d-5f038b3ed92a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1519 microversion: 2.1 time: 1.371028 Oct 11 04:22:37.957614 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1406/2917] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:36 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1519 bytes in 1377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:37.968618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ea5de654-09bd-4f5b-9aae-446768262cc3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:37.969535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ea5de654-09bd-4f5b-9aae-446768262cc3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:37.991491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea5de654-09bd-4f5b-9aae-446768262cc3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:37.999824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea5de654-09bd-4f5b-9aae-446768262cc3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:38.000790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea5de654-09bd-4f5b-9aae-446768262cc3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:38.001849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea5de654-09bd-4f5b-9aae-446768262cc3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:38.003270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea5de654-09bd-4f5b-9aae-446768262cc3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:38.004812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea5de654-09bd-4f5b-9aae-446768262cc3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:38.109768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:38.436206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea5de654-09bd-4f5b-9aae-446768262cc3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:38.446524 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ea5de654-09bd-4f5b-9aae-446768262cc3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1311 microversion: 2.1 time: 0.486997 Oct 11 04:22:38.462231 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-519d420a-53d5-442c-bacd-8132ae776ac5 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/45291c2a-76bf-4624-9fb1-7cac54c80ab0" status: 202 len: 0 microversion: 2.1 time: 0.875701 Oct 11 04:22:38.462231 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1512/2918] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:22:37 2022] DELETE /compute/v2.1/os-security-groups/45291c2a-76bf-4624-9fb1-7cac54c80ab0 => generated 0 bytes in 878 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:38.462532 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1407/2919] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:37 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1311 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:38.462619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e37bfb4-282d-4144-adc3-7260b9354025 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:38.462619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e37bfb4-282d-4144-adc3-7260b9354025 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:38.470212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ffe2b39-d662-4341-b6f9-5808031e7a78 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:38.470212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5ffe2b39-d662-4341-b6f9-5808031e7a78 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:38.485434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e37bfb4-282d-4144-adc3-7260b9354025 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:38.491003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e37bfb4-282d-4144-adc3-7260b9354025 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:38.499598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e37bfb4-282d-4144-adc3-7260b9354025 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:38.499598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e37bfb4-282d-4144-adc3-7260b9354025 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:38.501627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e37bfb4-282d-4144-adc3-7260b9354025 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:38.502498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e37bfb4-282d-4144-adc3-7260b9354025 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:38.502729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffe2b39-d662-4341-b6f9-5808031e7a78 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:38.504689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffe2b39-d662-4341-b6f9-5808031e7a78 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:38.509387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffe2b39-d662-4341-b6f9-5808031e7a78 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:38.517970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffe2b39-d662-4341-b6f9-5808031e7a78 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:38.518680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffe2b39-d662-4341-b6f9-5808031e7a78 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:38.519141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ffe2b39-d662-4341-b6f9-5808031e7a78 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:38.623994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e37bfb4-282d-4144-adc3-7260b9354025 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:22:38.961545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5ffe2b39-d662-4341-b6f9-5808031e7a78 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:38.969345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:38.972320 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ffe2b39-d662-4341-b6f9-5808031e7a78 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1345 microversion: 2.1 time: 0.515416 Oct 11 04:22:38.973287 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1408/2920] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:38 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1345 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:38.979299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff8a6a12-bad5-4f57-8323-c382bf3389a7 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] Calling method '.version_select at 0x7fda191d0700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:39.384563 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e37bfb4-282d-4144-adc3-7260b9354025 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 204 len: 0 microversion: 2.1 time: 0.932452 Oct 11 04:22:39.385698 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1513/2921] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:22:38 2022] DELETE /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 0 bytes in 934 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:22:39.400153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65bd3488-791a-4534-8ac8-18b6c56ee6e1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1938e0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:39.502853 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-65bd3488-791a-4534-8ac8-18b6c56ee6e1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.110475 Oct 11 04:22:39.514449 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1514/2922] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:39 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:39.530840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c972d47-89bb-47f0-9c93-5977696368d7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:39.536499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2c972d47-89bb-47f0-9c93-5977696368d7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:39.564511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c972d47-89bb-47f0-9c93-5977696368d7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:39.565136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c972d47-89bb-47f0-9c93-5977696368d7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:39.569067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c972d47-89bb-47f0-9c93-5977696368d7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:39.573390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c972d47-89bb-47f0-9c93-5977696368d7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:39.573390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c972d47-89bb-47f0-9c93-5977696368d7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:39.574523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c972d47-89bb-47f0-9c93-5977696368d7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:39.715690 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff8a6a12-bad5-4f57-8323-c382bf3389a7 tempest-SecurityGroupRulesTestJSON-227660699 tempest-SecurityGroupRulesTestJSON-227660699-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/187b1f31-5293-4c1c-b602-b7c1be15be5b" status: 202 len: 0 microversion: 2.1 time: 0.741166 Oct 11 04:22:39.716580 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1409/2923] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:22:38 2022] DELETE /compute/v2.1/os-security-groups/187b1f31-5293-4c1c-b602-b7c1be15be5b => generated 0 bytes in 742 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:39.723964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e45fddf0-fbfa-4708-8aa4-ef15f306c520 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:39.724762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e45fddf0-fbfa-4708-8aa4-ef15f306c520 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:39.743799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45fddf0-fbfa-4708-8aa4-ef15f306c520 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:39.747152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45fddf0-fbfa-4708-8aa4-ef15f306c520 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:39.748357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45fddf0-fbfa-4708-8aa4-ef15f306c520 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:39.751157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45fddf0-fbfa-4708-8aa4-ef15f306c520 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:39.752532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45fddf0-fbfa-4708-8aa4-ef15f306c520 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:39.753277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45fddf0-fbfa-4708-8aa4-ef15f306c520 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:39.956368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2c972d47-89bb-47f0-9c93-5977696368d7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:39.968382 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c972d47-89bb-47f0-9c93-5977696368d7 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1525 microversion: 2.1 time: 0.452305 Oct 11 04:22:39.971606 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1515/2924] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:39 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1525 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:40.022456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b02d717e-9196-4c7a-bcb2-ef99f3b7e446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:40.023007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b02d717e-9196-4c7a-bcb2-ef99f3b7e446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:40.029963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b02d717e-9196-4c7a-bcb2-ef99f3b7e446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:40.030511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b02d717e-9196-4c7a-bcb2-ef99f3b7e446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:40.030950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b02d717e-9196-4c7a-bcb2-ef99f3b7e446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:40.031645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b02d717e-9196-4c7a-bcb2-ef99f3b7e446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:40.044546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b02d717e-9196-4c7a-bcb2-ef99f3b7e446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:40.045034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b02d717e-9196-4c7a-bcb2-ef99f3b7e446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:40.220540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b02d717e-9196-4c7a-bcb2-ef99f3b7e446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:40.240769 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b02d717e-9196-4c7a-bcb2-ef99f3b7e446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1345 microversion: 2.1 time: 0.221963 Oct 11 04:22:40.241632 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1516/2925] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:40 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1345 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:40.439980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e45fddf0-fbfa-4708-8aa4-ef15f306c520 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:40.450941 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e45fddf0-fbfa-4708-8aa4-ef15f306c520 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1311 microversion: 2.1 time: 0.732265 Oct 11 04:22:40.451824 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1410/2926] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:39 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1311 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:40.530035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-51fdfa27-6179-4d7e-9448-07b8996c91f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193ceb80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:40.623238 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-51fdfa27-6179-4d7e-9448-07b8996c91f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.098055 Oct 11 04:22:40.624508 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1517/2927] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:40 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:40.997646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d7076b68-7be2-4ac8-a029-33bd5789d394 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:40.998602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d7076b68-7be2-4ac8-a029-33bd5789d394 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:41.017554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7076b68-7be2-4ac8-a029-33bd5789d394 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:41.021893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7076b68-7be2-4ac8-a029-33bd5789d394 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:41.024440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7076b68-7be2-4ac8-a029-33bd5789d394 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:41.025644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7076b68-7be2-4ac8-a029-33bd5789d394 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:41.027814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7076b68-7be2-4ac8-a029-33bd5789d394 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:41.031213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7076b68-7be2-4ac8-a029-33bd5789d394 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:41.267376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22b52cdf-4616-4c6f-ad75-d37031c2deac tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:41.267988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22b52cdf-4616-4c6f-ad75-d37031c2deac tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:41.281326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22b52cdf-4616-4c6f-ad75-d37031c2deac tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:41.281986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22b52cdf-4616-4c6f-ad75-d37031c2deac tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:41.282346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22b52cdf-4616-4c6f-ad75-d37031c2deac tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:41.283051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22b52cdf-4616-4c6f-ad75-d37031c2deac tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:41.283501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22b52cdf-4616-4c6f-ad75-d37031c2deac tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:41.283924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22b52cdf-4616-4c6f-ad75-d37031c2deac tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:41.311577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:41.504490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22b52cdf-4616-4c6f-ad75-d37031c2deac tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:41.521555 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22b52cdf-4616-4c6f-ad75-d37031c2deac tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1345 microversion: 2.1 time: 0.257513 Oct 11 04:22:41.522542 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1518/2928] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:41 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1345 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:41.534503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bddca081-d76d-41dd-86fb-2cdcd2fb3779 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:41.535038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bddca081-d76d-41dd-86fb-2cdcd2fb3779 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:41.576117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddca081-d76d-41dd-86fb-2cdcd2fb3779 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:41.576615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddca081-d76d-41dd-86fb-2cdcd2fb3779 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:41.577046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddca081-d76d-41dd-86fb-2cdcd2fb3779 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:41.580888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddca081-d76d-41dd-86fb-2cdcd2fb3779 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:41.581567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddca081-d76d-41dd-86fb-2cdcd2fb3779 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:41.582269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddca081-d76d-41dd-86fb-2cdcd2fb3779 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:41.942788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d7076b68-7be2-4ac8-a029-33bd5789d394 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:41.946436 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d7076b68-7be2-4ac8-a029-33bd5789d394 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1525 microversion: 2.1 time: 0.953302 Oct 11 04:22:41.948032 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1411/2929] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:40 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1525 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:41.952632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ffaeb3a6-d041-4f09-ac78-4421e453f629 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda192820d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:42.057989 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ffaeb3a6-d041-4f09-ac78-4421e453f629 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.108843 Oct 11 04:22:42.061006 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1412/2930] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:41 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:42.080157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-401822f5-76ed-425c-b343-fbf47a887d7c req-518ac6b3-a1b0-447f-8f80-f30ac95547ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be377902-7acc-4ab8-b89e-c308d4c41a9c", "tag": "e1b10a47-b8c3-4f1e-b4a6-24338cc309de"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:42.113620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-401822f5-76ed-425c-b343-fbf47a887d7c req-518ac6b3-a1b0-447f-8f80-f30ac95547ac service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:42.114107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-401822f5-76ed-425c-b343-fbf47a887d7c req-518ac6b3-a1b0-447f-8f80-f30ac95547ac service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:42.118131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bddca081-d76d-41dd-86fb-2cdcd2fb3779 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:42.123979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-401822f5-76ed-425c-b343-fbf47a887d7c req-518ac6b3-a1b0-447f-8f80-f30ac95547ac service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:42.131393 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bddca081-d76d-41dd-86fb-2cdcd2fb3779 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1311 microversion: 2.1 time: 0.604976 Oct 11 04:22:42.134046 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1519/2931] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:41 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1311 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:42.139742 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-401822f5-76ed-425c-b343-fbf47a887d7c req-518ac6b3-a1b0-447f-8f80-f30ac95547ac service nova] Creating event network-changed:e1b10a47-b8c3-4f1e-b4a6-24338cc309de for instance be377902-7acc-4ab8-b89e-c308d4c41a9c on n-h1-860892-1 Oct 11 04:22:42.156727 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-401822f5-76ed-425c-b343-fbf47a887d7c req-518ac6b3-a1b0-447f-8f80-f30ac95547ac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093002 Oct 11 04:22:42.158128 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1413/2932] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:42.545051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca091f1e-e3b9-4d79-92fc-3bd73808a5ca tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:42.545655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ca091f1e-e3b9-4d79-92fc-3bd73808a5ca tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:42.560419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca091f1e-e3b9-4d79-92fc-3bd73808a5ca tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:42.575160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca091f1e-e3b9-4d79-92fc-3bd73808a5ca tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:42.578607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca091f1e-e3b9-4d79-92fc-3bd73808a5ca tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:42.580719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca091f1e-e3b9-4d79-92fc-3bd73808a5ca tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:42.582688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca091f1e-e3b9-4d79-92fc-3bd73808a5ca tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:42.585719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca091f1e-e3b9-4d79-92fc-3bd73808a5ca tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:42.894101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ca091f1e-e3b9-4d79-92fc-3bd73808a5ca tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:42.911999 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ca091f1e-e3b9-4d79-92fc-3bd73808a5ca tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1345 microversion: 2.1 time: 0.368891 Oct 11 04:22:42.931111 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1520/2933] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:42 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1345 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:42.975372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3a9de4e1-e0fc-4456-91b0-f557480e7854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:42.976074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3a9de4e1-e0fc-4456-91b0-f557480e7854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:42.985703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9de4e1-e0fc-4456-91b0-f557480e7854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:42.986286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9de4e1-e0fc-4456-91b0-f557480e7854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:42.986768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9de4e1-e0fc-4456-91b0-f557480e7854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:42.987470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9de4e1-e0fc-4456-91b0-f557480e7854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:43.001249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9de4e1-e0fc-4456-91b0-f557480e7854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:43.002080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9de4e1-e0fc-4456-91b0-f557480e7854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:43.076879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4b747b2e-b5ab-433b-9d04-b3f234c3d0ed tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda194f9310>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:43.162639 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4b747b2e-b5ab-433b-9d04-b3f234c3d0ed tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.086605 Oct 11 04:22:43.166617 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1521/2934] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:43 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:43.185544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6ec0d33b-863d-4967-9dd1-71d28ae900b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:43.191600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6ec0d33b-863d-4967-9dd1-71d28ae900b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:43.208378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ec0d33b-863d-4967-9dd1-71d28ae900b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:43.208874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ec0d33b-863d-4967-9dd1-71d28ae900b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:43.213789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ec0d33b-863d-4967-9dd1-71d28ae900b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:43.217887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ec0d33b-863d-4967-9dd1-71d28ae900b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:43.220547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ec0d33b-863d-4967-9dd1-71d28ae900b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:43.221532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ec0d33b-863d-4967-9dd1-71d28ae900b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:43.360790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3a9de4e1-e0fc-4456-91b0-f557480e7854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:43.374351 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3a9de4e1-e0fc-4456-91b0-f557480e7854 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1483 microversion: 2.1 time: 0.399986 Oct 11 04:22:43.398568 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1414/2935] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:42 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1483 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:43.844323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6ec0d33b-863d-4967-9dd1-71d28ae900b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:43.866370 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6ec0d33b-863d-4967-9dd1-71d28ae900b9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1311 microversion: 2.1 time: 0.689954 Oct 11 04:22:43.866370 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1522/2936] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:43 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1311 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:43.941369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0cf22b11-48b2-452f-ad7d-641d7154db2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:43.941982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0cf22b11-48b2-452f-ad7d-641d7154db2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:43.954370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0cf22b11-48b2-452f-ad7d-641d7154db2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:43.954905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0cf22b11-48b2-452f-ad7d-641d7154db2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:43.955357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0cf22b11-48b2-452f-ad7d-641d7154db2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:43.956058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0cf22b11-48b2-452f-ad7d-641d7154db2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:43.961735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0cf22b11-48b2-452f-ad7d-641d7154db2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:43.962435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0cf22b11-48b2-452f-ad7d-641d7154db2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:44.180364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eeb2014d-2c87-4772-9c56-cafde4c3be1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda194f9d30>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:44.243376 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eeb2014d-2c87-4772-9c56-cafde4c3be1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.067174 Oct 11 04:22:44.250780 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1523/2937] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:44 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:44.263075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2f5e7565-76a3-4b92-9a80-fb4a8c8d1b28 req-77cc176c-2d67-4e08-908b-acddc0c9cc90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d1605cf-ca80-4a18-80fb-a0315a1134cc", "name": "network-vif-deleted", "tag": "147c82d2-c4d8-4899-9099-0dea6c0adde0"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:44.275951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2f5e7565-76a3-4b92-9a80-fb4a8c8d1b28 req-77cc176c-2d67-4e08-908b-acddc0c9cc90 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:44.276692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2f5e7565-76a3-4b92-9a80-fb4a8c8d1b28 req-77cc176c-2d67-4e08-908b-acddc0c9cc90 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:44.277814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2f5e7565-76a3-4b92-9a80-fb4a8c8d1b28 req-77cc176c-2d67-4e08-908b-acddc0c9cc90 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:44.292197 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2f5e7565-76a3-4b92-9a80-fb4a8c8d1b28 req-77cc176c-2d67-4e08-908b-acddc0c9cc90 service nova] Creating event network-vif-deleted:147c82d2-c4d8-4899-9099-0dea6c0adde0 for instance 6d1605cf-ca80-4a18-80fb-a0315a1134cc on n-h2-860892-1 Oct 11 04:22:44.298582 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2f5e7565-76a3-4b92-9a80-fb4a8c8d1b28 req-77cc176c-2d67-4e08-908b-acddc0c9cc90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046124 Oct 11 04:22:44.300093 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1524/2938] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:44.323541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0cf22b11-48b2-452f-ad7d-641d7154db2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:44.356324 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0cf22b11-48b2-452f-ad7d-641d7154db2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1345 microversion: 2.1 time: 0.418572 Oct 11 04:22:44.377057 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1415/2939] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:43 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1345 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:44.399254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:44.399954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:44.426518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:44.427029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:44.427468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:44.435065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:44.435745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:44.436203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:44.549517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:44.550886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:44.551496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:44.552070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lazy-loading 'fault' on Instance uuid 6d1605cf-ca80-4a18-80fb-a0315a1134cc {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:22:44.681212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c3e365e46be4bc2b83f09bf0ebd8efc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9db178c528264083bfd30875291a1797', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:44.692300 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-94dba82a-946a-4404-a8c5-528b57e5ef0b tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 200 len: 1313 microversion: 2.1 time: 0.298331 Oct 11 04:22:44.697698 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1525/2940] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:44 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:44.890571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6e2b099e-94a4-437d-97fa-5c055ee64f7c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:44.893003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6e2b099e-94a4-437d-97fa-5c055ee64f7c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:44.908775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2b099e-94a4-437d-97fa-5c055ee64f7c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:44.931610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2b099e-94a4-437d-97fa-5c055ee64f7c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:44.937348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2b099e-94a4-437d-97fa-5c055ee64f7c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:44.943438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2b099e-94a4-437d-97fa-5c055ee64f7c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:44.944607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2b099e-94a4-437d-97fa-5c055ee64f7c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:44.949689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2b099e-94a4-437d-97fa-5c055ee64f7c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:45.270911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b50f692e-954a-45ed-aaa7-87b46302479e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193ce4c0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:45.401171 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b50f692e-954a-45ed-aaa7-87b46302479e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.145317 Oct 11 04:22:45.418349 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1526/2941] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:45 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:45.424545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:45.425162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:45.445074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:45.445568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:45.446002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:45.446728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:45.447174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:45.461728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:45.543278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:45.544066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:45.545278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:45.546815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lazy-loading 'fault' on Instance uuid 557ba8ab-6c3d-4794-95ad-0dd362e8f43c {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:22:45.681953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:45.699879 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c9db2d44-d75c-44d4-a62b-115f9ef17e18 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1350 microversion: 2.1 time: 0.275021 Oct 11 04:22:45.747450 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1527/2942] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:45 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1350 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:45.763645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:45.767146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 6d1605cf-ca80-4a18-80fb-a0315a1134cc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:45.787168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:45.788018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:45.788652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:45.789611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:45.790758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:45.791362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:45.827140 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] HTTP exception thrown: Instance 6d1605cf-ca80-4a18-80fb-a0315a1134cc could not be found. Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc HTTP/1.1 Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 6d1605cf-ca80-4a18-80fb-a0315a1134cc could not be found. Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '6d1605cf-ca80-4a18-80fb-a0315a1134cc'} Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d1605cf-ca80-4a18-80fb-a0315a1134cc could not be found. Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d1605cf-ca80-4a18-80fb-a0315a1134cc could not be found. Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.836419 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:45.841089 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.841089 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:45.841089 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:45.841089 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:45.841089 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:45.841089 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:45.841089 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d1605cf-ca80-4a18-80fb-a0315a1134cc could not be found. Oct 11 04:22:45.841089 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.845099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 404 to user: Instance 6d1605cf-ca80-4a18-80fb-a0315a1134cc could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:45.849098 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-36375573-5f13-4f0e-a7fa-c4e0c90b7380 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc" status: 404 len: 111 microversion: 2.1 time: 0.100385 Oct 11 04:22:45.851923 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1528/2943] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:45 2022] GET /compute/v2.1/servers/6d1605cf-ca80-4a18-80fb-a0315a1134cc => generated 111 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:22:45.870769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a59bda1a-dd94-475e-8662-b2e2402b080a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '.version_select at 0x7fda193c54c0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:45.946765 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-a59bda1a-dd94-475e-8662-b2e2402b080a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] HTTP exception thrown: Image not found. Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a59bda1a-dd94-475e-8662-b2e2402b080a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/images/fab94f1c-d725-4249-959e-e11e08457be5 HTTP/1.1 Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: exception: Image not found. Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'fab94f1c-d725-4249-959e-e11e08457be5'} Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image fab94f1c-d725-4249-959e-e11e08457be5 to delete Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image fab94f1c-d725-4249-959e-e11e08457be5 could not be found. Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:45.949226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:22:45.953901 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:45.957142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a59bda1a-dd94-475e-8662-b2e2402b080a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 404 to user: Image not found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:45.958213 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a59bda1a-dd94-475e-8662-b2e2402b080a tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "DELETE /compute/v2.1/images/fab94f1c-d725-4249-959e-e11e08457be5" status: 404 len: 62 microversion: 2.1 time: 0.103676 Oct 11 04:22:45.959649 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1529/2944] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:45 2022] DELETE /compute/v2.1/images/fab94f1c-d725-4249-959e-e11e08457be5 => generated 62 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:22:45.971635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:45.974382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:46.003676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:46.004742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:46.005480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:46.011549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:46.012596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:46.017810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:46.057118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6e2b099e-94a4-437d-97fa-5c055ee64f7c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:46.057655 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] HTTP exception thrown: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 HTTP/1.1 Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'fe7a86c0-79fe-4793-a20f-c2c2f7872228'} Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:22:46.062286 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:22:46.066811 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:46.066811 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:46.066811 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:46.066811 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:46.066811 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:46.066811 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:46.066811 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:46.066811 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:46.066811 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:46.066811 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:46.066811 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:46.068540 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6e2b099e-94a4-437d-97fa-5c055ee64f7c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1311 microversion: 2.1 time: 1.183243 Oct 11 04:22:46.070885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 404 to user: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:46.072778 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4d769f30-deba-4654-894f-5618017de060 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 404 len: 111 microversion: 2.1 time: 0.108939 Oct 11 04:22:46.074453 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1530/2945] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:22:45 2022] DELETE /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:22:46.078801 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1416/2946] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:44 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1311 bytes in 1196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:46.096114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:46.097006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: fe7a86c0-79fe-4793-a20f-c2c2f7872228] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:46.109391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:46.110248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:46.110970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:46.111899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:46.112997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:46.114071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:46.166430 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] HTTP exception thrown: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 HTTP/1.1 Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'fe7a86c0-79fe-4793-a20f-c2c2f7872228'} Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:46.168530 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:46.172940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:46.172940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:46.172940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:46.172940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:46.172940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:46.172940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:46.172940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. Oct 11 04:22:46.172940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:46.172940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 404 to user: Instance fe7a86c0-79fe-4793-a20f-c2c2f7872228 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:46.172940 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-95698225-4816-4844-b6cc-7256c0b9331d tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228" status: 404 len: 111 microversion: 2.1 time: 0.078065 Oct 11 04:22:46.185356 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1531/2947] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:46 2022] GET /compute/v2.1/servers/fe7a86c0-79fe-4793-a20f-c2c2f7872228 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:22:46.190250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6429ca2-aa1f-44f6-800f-82d591e11dba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '.version_select at 0x7fda1924adc0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:46.368646 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f6429ca2-aa1f-44f6-800f-82d591e11dba tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070715433" status: 202 len: 0 microversion: 2.1 time: 0.182135 Oct 11 04:22:46.371076 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1417/2948] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:22:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1070715433 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:46.421625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f3506655-3977-46f7-ac18-1599d8a20232 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193ceca0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:46.546456 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f3506655-3977-46f7-ac18-1599d8a20232 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.131382 Oct 11 04:22:46.555914 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1532/2949] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:46 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:46.730125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:46.730936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:46.744371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:46.748690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:46.752640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:46.755133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:46.757038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:46.760037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:46.934217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:46.934712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:46.951467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:46.951843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lazy-loading 'fault' on Instance uuid 557ba8ab-6c3d-4794-95ad-0dd362e8f43c {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:22:47.105127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a00357c-63e1-4946-a66c-99103aaf2192 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:47.111250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6a00357c-63e1-4946-a66c-99103aaf2192 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:47.123324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a00357c-63e1-4946-a66c-99103aaf2192 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:47.125194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a00357c-63e1-4946-a66c-99103aaf2192 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:47.125911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a00357c-63e1-4946-a66c-99103aaf2192 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:47.130970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a00357c-63e1-4946-a66c-99103aaf2192 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:47.131875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a00357c-63e1-4946-a66c-99103aaf2192 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:47.132462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a00357c-63e1-4946-a66c-99103aaf2192 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:47.347974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a00357c-63e1-4946-a66c-99103aaf2192 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:47.361392 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a00357c-63e1-4946-a66c-99103aaf2192 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1311 microversion: 2.1 time: 0.264318 Oct 11 04:22:47.364051 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1533/2950] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:47 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1311 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:47.574892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea54d94c-ea2b-49a9-a515-50d8e2be55f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193d7dc0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:47.699980 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea54d94c-ea2b-49a9-a515-50d8e2be55f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.130565 Oct 11 04:22:47.708404 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1534/2951] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:47 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:47.878653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:47.888786 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f9a1ec3-4ff7-4e0e-97b8-576e9d018316 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 200 len: 1304 microversion: 2.1 time: 1.162482 Oct 11 04:22:47.889431 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1418/2952] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:46 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 1304 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:48.396168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-71dacd37-7074-4030-b726-5e13e781f129 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:48.397277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-71dacd37-7074-4030-b726-5e13e781f129 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:48.416446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71dacd37-7074-4030-b726-5e13e781f129 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:48.418413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71dacd37-7074-4030-b726-5e13e781f129 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:48.419689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71dacd37-7074-4030-b726-5e13e781f129 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:48.422429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71dacd37-7074-4030-b726-5e13e781f129 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:48.424910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71dacd37-7074-4030-b726-5e13e781f129 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:48.426162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71dacd37-7074-4030-b726-5e13e781f129 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:48.716812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-516c3db7-d4bf-43e1-9dc9-3c6d954eb657 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda191d05e0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:48.835551 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-516c3db7-d4bf-43e1-9dc9-3c6d954eb657 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.122934 Oct 11 04:22:48.845401 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1419/2953] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:48 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:48.930695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:48.932030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:48.959778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:48.966715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:48.966715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:48.966715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:48.966715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:48.966715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:49.029627 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c HTTP/1.1 Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '557ba8ab-6c3d-4794-95ad-0dd362e8f43c'} Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:49.033948 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:49.046475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:49.046475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:49.046475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:49.046475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:49.046475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:49.046475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:22:49.046475 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:49.046475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:49.046475 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cac55a9c-e770-4dc3-a0b2-686b79a754c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 404 len: 111 microversion: 2.1 time: 0.124828 Oct 11 04:22:49.057070 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1420/2954] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:48 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:22:49.324051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:49.324294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-71dacd37-7074-4030-b726-5e13e781f129 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:49.326669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:49.337877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:49.338064 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-71dacd37-7074-4030-b726-5e13e781f129 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1311 microversion: 2.1 time: 0.951513 Oct 11 04:22:49.340941 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1535/2955] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:48 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1311 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:49.341870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:49.346106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:49.346874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:49.347339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:49.347936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:49.375972 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c/os-volume_attachments HTTP/1.1 Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': '557ba8ab-6c3d-4794-95ad-0dd362e8f43c'} Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:22:49.384008 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:49.388450 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1316db77-cc04-4925-9dc1-23cb6b82c523 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.065567 Oct 11 04:22:49.390813 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1421/2956] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:22:49 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c/os-volume_attachments => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:22:49.687746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-555986587", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "eb00258c-33f3-4e50-9b19-bfa956507201"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:49.789208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] validate_networks() for [('eb00258c-33f3-4e50-9b19-bfa956507201', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:22:49.853721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-38a6bb49-6f03-4570-821e-b2d94fbd8d1c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda191d34c0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:49.908969 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-38a6bb49-6f03-4570-821e-b2d94fbd8d1c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1414 microversion: 2.1 time: 0.060056 Oct 11 04:22:49.909809 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1422/2957] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:49 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1414 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:50.365351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7381b154-7296-4b7b-8046-d30823f56888 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:50.366997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7381b154-7296-4b7b-8046-d30823f56888 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:50.379297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7381b154-7296-4b7b-8046-d30823f56888 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:50.385639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7381b154-7296-4b7b-8046-d30823f56888 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:50.385639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7381b154-7296-4b7b-8046-d30823f56888 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:50.386624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7381b154-7296-4b7b-8046-d30823f56888 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:50.387690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7381b154-7296-4b7b-8046-d30823f56888 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:50.389681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7381b154-7296-4b7b-8046-d30823f56888 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:50.702943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7381b154-7296-4b7b-8046-d30823f56888 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:50.722243 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7381b154-7296-4b7b-8046-d30823f56888 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1311 microversion: 2.1 time: 0.360852 Oct 11 04:22:50.723702 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1423/2958] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:50 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1311 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:50.731962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-68be793b-2363-48ab-8dba-1aafbf5b3422 req-8369e758-ffd7-4bf3-a1df-f4f315412de5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be377902-7acc-4ab8-b89e-c308d4c41a9c", "name": "network-vif-plugged", "status": "completed", "tag": "e1b10a47-b8c3-4f1e-b4a6-24338cc309de"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:50.766568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-68be793b-2363-48ab-8dba-1aafbf5b3422 req-8369e758-ffd7-4bf3-a1df-f4f315412de5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:50.768804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-68be793b-2363-48ab-8dba-1aafbf5b3422 req-8369e758-ffd7-4bf3-a1df-f4f315412de5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:50.770409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-68be793b-2363-48ab-8dba-1aafbf5b3422 req-8369e758-ffd7-4bf3-a1df-f4f315412de5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:50.789347 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-68be793b-2363-48ab-8dba-1aafbf5b3422 req-8369e758-ffd7-4bf3-a1df-f4f315412de5 service nova] Creating event network-vif-plugged:e1b10a47-b8c3-4f1e-b4a6-24338cc309de for instance be377902-7acc-4ab8-b89e-c308d4c41a9c on n-h1-860892-1 Oct 11 04:22:50.797669 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-68be793b-2363-48ab-8dba-1aafbf5b3422 req-8369e758-ffd7-4bf3-a1df-f4f315412de5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072369 Oct 11 04:22:50.798811 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1424/2959] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:50.925266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-abb8aa50-c617-40ea-a991-ba615ebee8ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda192a2820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:50.978140 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-abb8aa50-c617-40ea-a991-ba615ebee8ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1423 microversion: 2.1 time: 0.057055 Oct 11 04:22:50.978899 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1425/2960] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:50 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1423 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:50.994415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cf09e8c-4026-4e71-a3a1-5ab14bd94d22 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda192469d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:51.060870 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2cf09e8c-4026-4e71-a3a1-5ab14bd94d22 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 200 len: 1423 microversion: 2.1 time: 0.071142 Oct 11 04:22:51.061587 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1426/2961] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:22:50 2022] GET /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 1423 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:51.075137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-add41db7-de1a-4735-b0db-83790efa384c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda192a2e50>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:51.143382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:22:51.143890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:22:51.144403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:22:51.144809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:22:51.145394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:22:51.154449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:51.154932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:51.155561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:51.156276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:51.156733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:51.157165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:51.192113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:22:51.192113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for user 99027798dcba4d52a9efc682ccc973d3 and project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:22:51.192113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:51.199311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:22:51.201704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 8ce11d80-6a85-4926-8d11-058fd0bc6697] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:22:51.385220 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-97ee779c-4acb-4aac-90a8-627177baa3ed tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.701289 Oct 11 04:22:51.392959 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1536/2962] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:22:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:22:51.397889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-96e48c85-7b69-4e1a-b146-7df69912ab04 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '.version_select at 0x7fda193fc550>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:51.427962 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-96e48c85-7b69-4e1a-b146-7df69912ab04 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] HTTP exception thrown: Image not found. Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-96e48c85-7b69-4e1a-b146-7df69912ab04 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/images/b212c483-b54b-4c5f-b1f4-6a758827c8d4 HTTP/1.1 Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: exception: Image not found. Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'b212c483-b54b-4c5f-b1f4-6a758827c8d4'} Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image b212c483-b54b-4c5f-b1f4-6a758827c8d4 to delete Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image b212c483-b54b-4c5f-b1f4-6a758827c8d4 could not be found. Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:51.429744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:22:51.434556 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.438283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-96e48c85-7b69-4e1a-b146-7df69912ab04 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 404 to user: Image not found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:51.439346 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-96e48c85-7b69-4e1a-b146-7df69912ab04 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "DELETE /compute/v2.1/images/b212c483-b54b-4c5f-b1f4-6a758827c8d4" status: 404 len: 62 microversion: 2.1 time: 0.045260 Oct 11 04:22:51.440451 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1537/2963] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:51 2022] DELETE /compute/v2.1/images/b212c483-b54b-4c5f-b1f4-6a758827c8d4 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:22:51.446681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b812e577-3088-43c9-95b7-ac0a28c99b2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:51.447959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b812e577-3088-43c9-95b7-ac0a28c99b2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 8ce11d80-6a85-4926-8d11-058fd0bc6697] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:51.536784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b812e577-3088-43c9-95b7-ac0a28c99b2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:51.549089 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b812e577-3088-43c9-95b7-ac0a28c99b2b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697" status: 200 len: 1214 microversion: 2.1 time: 0.107023 Oct 11 04:22:51.549684 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1538/2964] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:51 2022] GET /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697 => generated 1214 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:51.590383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:51.590909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:51.612462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:51.612873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:51.613316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:51.614030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:51.614510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:51.614934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:51.629835 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] HTTP exception thrown: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 HTTP/1.1 Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '431a0a90-2f88-49fb-bf06-b292938d2258'} Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:22:51.631935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 404 to user: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:51.635981 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4629d887-8442-4708-865c-686aac5500e3 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "DELETE /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 404 len: 111 microversion: 2.1 time: 0.058332 Oct 11 04:22:51.647274 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1539/2965] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:22:51 2022] DELETE /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:22:51.649120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c6c23d3f-97fe-4f45-8018-d3dc5c3446ae tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:51.649632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c6c23d3f-97fe-4f45-8018-d3dc5c3446ae tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 8ce11d80-6a85-4926-8d11-058fd0bc6697] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:51.673960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c6c23d3f-97fe-4f45-8018-d3dc5c3446ae tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 8ce11d80-6a85-4926-8d11-058fd0bc6697] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:22:52.506027 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.scheduler.client.report [None req-c6c23d3f-97fe-4f45-8018-d3dc5c3446ae tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Deleted allocations for instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 Oct 11 04:22:52.511771 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.api [None req-c6c23d3f-97fe-4f45-8018-d3dc5c3446ae tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 8ce11d80-6a85-4926-8d11-058fd0bc6697] Instance Mapping does not exist while attempting local delete cleanup. Oct 11 04:22:52.512966 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c6c23d3f-97fe-4f45-8018-d3dc5c3446ae tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697" status: 204 len: 0 microversion: 2.1 time: 0.868268 Oct 11 04:22:52.513739 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1540/2966] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:22:51 2022] DELETE /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697 => generated 0 bytes in 870 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:22:52.527394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:52.535412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] [instance: 431a0a90-2f88-49fb-bf06-b292938d2258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:52.543994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:52.544885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:52.548273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:52.549374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:52.550063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:52.550889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:52.575096 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] HTTP exception thrown: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Request method failure captured: Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 HTTP/1.1 Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO8UR5jrtnsG0A_-ToRfG4rSgE6dpDj-TxZt7P_G1ZvZBOtzf_MzSm0AJuK6EQG-4m_h2TTyMDjIyvAOJdvapHgHPLwzVXJDlNqXFPy-kVCb84PegnDVN2GLskAeD1bIRPAwUKzC_d_XKW975UqPEPS9pwWw0kVxVS3gmIL0_3KDzoI Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9db178c528264083bfd30875291a1797"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9db178c528264083bfd30875291a1797"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9db178c528264083bfd30875291a1797"}]}] Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9db178c528264083bfd30875291a1797 Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477 Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7c3e365e46be4bc2b83f09bf0ebd8efc Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesOneServerNegativeTestJSON-1386587477-project Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '431a0a90-2f88-49fb-bf06-b292938d2258'} Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:52.577204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:52.581366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:52.581366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:52.581366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:52.581366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:52.581366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:52.581366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:52.581366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. Oct 11 04:22:52.581366 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:22:52.583474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] Returning 404 to user: Instance 431a0a90-2f88-49fb-bf06-b292938d2258 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:52.588346 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef4f0d61-4589-470f-ada5-8ed6e9d60ca4 tempest-ImagesOneServerNegativeTestJSON-1386587477 tempest-ImagesOneServerNegativeTestJSON-1386587477-project] 10.222.0.26 "GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258" status: 404 len: 111 microversion: 2.1 time: 0.071315 Oct 11 04:22:52.594722 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1541/2967] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:52 2022] GET /compute/v2.1/servers/431a0a90-2f88-49fb-bf06-b292938d2258 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:22:52.599808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b814e04-3ed7-4969-a562-106e9271fb79 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:52.600806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b814e04-3ed7-4969-a562-106e9271fb79 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:52.612979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b814e04-3ed7-4969-a562-106e9271fb79 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:52.613881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b814e04-3ed7-4969-a562-106e9271fb79 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:52.614589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b814e04-3ed7-4969-a562-106e9271fb79 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:52.615591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b814e04-3ed7-4969-a562-106e9271fb79 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:52.616258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b814e04-3ed7-4969-a562-106e9271fb79 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:52.617090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b814e04-3ed7-4969-a562-106e9271fb79 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:52.958844 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-add41db7-de1a-4735-b0db-83790efa384c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 204 len: 0 microversion: 2.1 time: 1.887417 Oct 11 04:22:52.960670 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1427/2968] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:51 2022] DELETE /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 0 bytes in 1889 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:22:52.967799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c8ea9e1-c42b-4e3c-8386-0322934f3c0e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:52.968819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1c8ea9e1-c42b-4e3c-8386-0322934f3c0e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 8ce11d80-6a85-4926-8d11-058fd0bc6697] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:52.981589 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-1c8ea9e1-c42b-4e3c-8386-0322934f3c0e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c8ea9e1-c42b-4e3c-8386-0322934f3c0e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697 HTTP/1.1 Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '8ce11d80-6a85-4926-8d11-058fd0bc6697'} Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:22:52.988306 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:22:52.992775 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:22:52.992775 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:22:52.992775 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:22:52.992775 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:22:52.992775 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:22:52.993892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c8ea9e1-c42b-4e3c-8386-0322934f3c0e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:22:52.997836 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c8ea9e1-c42b-4e3c-8386-0322934f3c0e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697" status: 404 len: 111 microversion: 2.1 time: 0.035670 Oct 11 04:22:52.998749 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1428/2969] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:52 2022] GET /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:22:53.003579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46bb146f-8d3e-4546-90f6-1324d9f4263f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:53.004299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-46bb146f-8d3e-4546-90f6-1324d9f4263f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:53.026609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46bb146f-8d3e-4546-90f6-1324d9f4263f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:53.027274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46bb146f-8d3e-4546-90f6-1324d9f4263f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:53.027691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46bb146f-8d3e-4546-90f6-1324d9f4263f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:53.028384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46bb146f-8d3e-4546-90f6-1324d9f4263f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:53.036208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46bb146f-8d3e-4546-90f6-1324d9f4263f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:53.036935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46bb146f-8d3e-4546-90f6-1324d9f4263f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:53.105920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-46bb146f-8d3e-4546-90f6-1324d9f4263f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:22:53.221630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b814e04-3ed7-4969-a562-106e9271fb79 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:53.238270 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b814e04-3ed7-4969-a562-106e9271fb79 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1311 microversion: 2.1 time: 0.638155 Oct 11 04:22:53.238270 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1542/2970] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:52 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1311 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:53.239298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-202322663", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "eb00258c-33f3-4e50-9b19-bfa956507201"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:53.327070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] validate_networks() for [('eb00258c-33f3-4e50-9b19-bfa956507201', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:22:53.656156 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-46bb146f-8d3e-4546-90f6-1324d9f4263f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 204 len: 0 microversion: 2.1 time: 0.655868 Oct 11 04:22:53.657448 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1429/2971] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:22:52 2022] DELETE /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 0 bytes in 658 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:22:53.842564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1429324399", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "0a59a6a9-e422-43ce-a186-e7294a4957eb"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:53.930767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] validate_networks() for [('0a59a6a9-e422-43ce-a186-e7294a4957eb', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:22:54.414755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:22:54.416073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:22:54.416611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:22:54.417273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:22:54.417919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:22:54.428702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:54.429503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:54.430367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:54.431358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:54.432052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:54.432540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:54.465076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:22:54.472432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for user 99027798dcba4d52a9efc682ccc973d3 and project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:22:54.490016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:22:54.492924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:22:54.675235 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-571c6789-7a9b-411a-a432-3e0336fead4c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.440615 Oct 11 04:22:54.679262 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1543/2972] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:22:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1445 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:22:54.687953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-62164aff-d5d6-4c47-9c1d-14ec5dcb2a51 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:54.689866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-62164aff-d5d6-4c47-9c1d-14ec5dcb2a51 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:54.704204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62164aff-d5d6-4c47-9c1d-14ec5dcb2a51 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:54.705765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62164aff-d5d6-4c47-9c1d-14ec5dcb2a51 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:54.725491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62164aff-d5d6-4c47-9c1d-14ec5dcb2a51 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:54.726348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62164aff-d5d6-4c47-9c1d-14ec5dcb2a51 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:54.726838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62164aff-d5d6-4c47-9c1d-14ec5dcb2a51 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:54.734447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62164aff-d5d6-4c47-9c1d-14ec5dcb2a51 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:54.815521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:22:54.816605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:22:54.817309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:22:54.818292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:22:54.819484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:22:54.846868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:54.847686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:54.851307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:54.856979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:54.856979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:54.856979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:54.915944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Getting quotas for project 8a50d14bbe2e4b71ac79bc37ac0ed812. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:22:54.918162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Getting quotas for user 7ade698487d7495d9e10cd7ab92d62a5 and project 8a50d14bbe2e4b71ac79bc37ac0ed812. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:22:54.947598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:22:54.950437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:22:55.126404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-62164aff-d5d6-4c47-9c1d-14ec5dcb2a51 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:55.136269 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-62164aff-d5d6-4c47-9c1d-14ec5dcb2a51 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1494 microversion: 2.1 time: 0.455376 Oct 11 04:22:55.137713 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1544/2973] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:54 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1494 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:55.144851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-cd51d7e0-629a-451d-a19f-ee6da4362c01 req-691159c6-dee6-4349-bbf9-6f2a4dd97f60 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99ecc72-094d-4756-a9b3-fc9d374b440e", "name": "network-vif-unplugged", "status": "completed", "tag": "1bcba2d7-91a1-41e1-9f49-4319b6515cef"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:55.169169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cd51d7e0-629a-451d-a19f-ee6da4362c01 req-691159c6-dee6-4349-bbf9-6f2a4dd97f60 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:55.169658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cd51d7e0-629a-451d-a19f-ee6da4362c01 req-691159c6-dee6-4349-bbf9-6f2a4dd97f60 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:55.185566 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef1c7bfa-5131-45c0-801a-8605d46c5024 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.349127 Oct 11 04:22:55.193272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cd51d7e0-629a-451d-a19f-ee6da4362c01 req-691159c6-dee6-4349-bbf9-6f2a4dd97f60 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:55.194003 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1430/2974] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:22:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1359 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:22:55.200516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a9d114fc-d988-4b40-afe5-fbba49f0dab2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:55.202941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a9d114fc-d988-4b40-afe5-fbba49f0dab2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:55.224767 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-cd51d7e0-629a-451d-a19f-ee6da4362c01 req-691159c6-dee6-4349-bbf9-6f2a4dd97f60 service nova] Creating event network-vif-unplugged:1bcba2d7-91a1-41e1-9f49-4319b6515cef for instance a99ecc72-094d-4756-a9b3-fc9d374b440e on n-h1-860892-1 Oct 11 04:22:55.242352 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-cd51d7e0-629a-451d-a19f-ee6da4362c01 req-691159c6-dee6-4349-bbf9-6f2a4dd97f60 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.096973 Oct 11 04:22:55.247063 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1545/2975] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:55.249901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d6794964-b8e4-4b75-b940-4fe17ce5c981 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:55.250816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d6794964-b8e4-4b75-b940-4fe17ce5c981 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:55.262992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6794964-b8e4-4b75-b940-4fe17ce5c981 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:55.265102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6794964-b8e4-4b75-b940-4fe17ce5c981 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:55.265837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6794964-b8e4-4b75-b940-4fe17ce5c981 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:55.269610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6794964-b8e4-4b75-b940-4fe17ce5c981 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:55.270641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6794964-b8e4-4b75-b940-4fe17ce5c981 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:55.271098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6794964-b8e4-4b75-b940-4fe17ce5c981 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:55.713472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a9d114fc-d988-4b40-afe5-fbba49f0dab2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:55.725421 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a9d114fc-d988-4b40-afe5-fbba49f0dab2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1214 microversion: 2.1 time: 0.530065 Oct 11 04:22:55.726090 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1431/2976] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:55 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1214 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:55.740531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-774ac917-e2cb-4172-b0e8-2b9e191c22e8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:55.741156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-774ac917-e2cb-4172-b0e8-2b9e191c22e8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:55.747745 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d6794964-b8e4-4b75-b940-4fe17ce5c981 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1645 microversion: 2.1 time: 0.503375 Oct 11 04:22:55.751399 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1546/2977] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:55 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1645 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:55.780879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b578957a-0c6a-4f21-bb44-37bd01015d17 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:55.781817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b578957a-0c6a-4f21-bb44-37bd01015d17 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:55.794737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b578957a-0c6a-4f21-bb44-37bd01015d17 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:55.802601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b578957a-0c6a-4f21-bb44-37bd01015d17 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:55.805245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b578957a-0c6a-4f21-bb44-37bd01015d17 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:55.806694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b578957a-0c6a-4f21-bb44-37bd01015d17 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:55.809060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b578957a-0c6a-4f21-bb44-37bd01015d17 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:55.811213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b578957a-0c6a-4f21-bb44-37bd01015d17 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:56.059940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-774ac917-e2cb-4172-b0e8-2b9e191c22e8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:56.071723 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-774ac917-e2cb-4172-b0e8-2b9e191c22e8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1208 microversion: 2.1 time: 0.343995 Oct 11 04:22:56.076798 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1432/2978] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:55 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1208 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:56.156660 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b578957a-0c6a-4f21-bb44-37bd01015d17 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1645 microversion: 2.1 time: 0.379746 Oct 11 04:22:56.158329 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1547/2979] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:55 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1645 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:56.185926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7e4ec8ad-753d-4c4b-9614-d0ec04c03312 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:56.189821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e4ec8ad-753d-4c4b-9614-d0ec04c03312 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:56.190686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e4ec8ad-753d-4c4b-9614-d0ec04c03312 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:56.192839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e4ec8ad-753d-4c4b-9614-d0ec04c03312 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:56.195606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e4ec8ad-753d-4c4b-9614-d0ec04c03312 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:56.196245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e4ec8ad-753d-4c4b-9614-d0ec04c03312 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:56.197315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e4ec8ad-753d-4c4b-9614-d0ec04c03312 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:56.299378 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7e4ec8ad-753d-4c4b-9614-d0ec04c03312 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.118710 Oct 11 04:22:56.300081 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1433/2980] 10.222.0.26 () {58 vars in 1176 bytes} [Tue Oct 11 04:22:56 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:56.324692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0d40bb1-d594-4a5c-b6d6-1b4e49466655 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:56.326209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d0d40bb1-d594-4a5c-b6d6-1b4e49466655 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:56.338684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d40bb1-d594-4a5c-b6d6-1b4e49466655 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:56.342094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d40bb1-d594-4a5c-b6d6-1b4e49466655 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:56.343712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d40bb1-d594-4a5c-b6d6-1b4e49466655 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:56.345479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d40bb1-d594-4a5c-b6d6-1b4e49466655 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:56.349493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d40bb1-d594-4a5c-b6d6-1b4e49466655 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:56.350050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d40bb1-d594-4a5c-b6d6-1b4e49466655 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:56.426992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:56.752811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ab2ccc2c-893b-4920-8c7f-7f3850401b98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:56.753338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ab2ccc2c-893b-4920-8c7f-7f3850401b98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:56.763278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab2ccc2c-893b-4920-8c7f-7f3850401b98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:56.763774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab2ccc2c-893b-4920-8c7f-7f3850401b98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:56.764305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab2ccc2c-893b-4920-8c7f-7f3850401b98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:56.765573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab2ccc2c-893b-4920-8c7f-7f3850401b98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:56.766033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab2ccc2c-893b-4920-8c7f-7f3850401b98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:56.766482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab2ccc2c-893b-4920-8c7f-7f3850401b98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:56.780992 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d0d40bb1-d594-4a5c-b6d6-1b4e49466655 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c/action" status: 202 len: 0 microversion: 2.1 time: 0.468938 Oct 11 04:22:56.792631 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1548/2981] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:22:56 2022] POST /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c/action => generated 0 bytes in 474 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:22:56.801993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ac1feb9-0ba8-4d17-9575-2974e52d5065 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:56.804665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3ac1feb9-0ba8-4d17-9575-2974e52d5065 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:56.833186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1feb9-0ba8-4d17-9575-2974e52d5065 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:56.842137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1feb9-0ba8-4d17-9575-2974e52d5065 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:56.842137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1feb9-0ba8-4d17-9575-2974e52d5065 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:56.842137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1feb9-0ba8-4d17-9575-2974e52d5065 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:56.842137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1feb9-0ba8-4d17-9575-2974e52d5065 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:56.842137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1feb9-0ba8-4d17-9575-2974e52d5065 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:56.928199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab2ccc2c-893b-4920-8c7f-7f3850401b98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:56.953787 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ab2ccc2c-893b-4920-8c7f-7f3850401b98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1218 microversion: 2.1 time: 0.208509 Oct 11 04:22:56.955304 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1434/2982] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:56 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1218 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:57.114477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-699b294f-afda-45c9-999e-32e9cc57a5f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:57.114477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-699b294f-afda-45c9-999e-32e9cc57a5f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:57.121212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-699b294f-afda-45c9-999e-32e9cc57a5f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:57.122823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-699b294f-afda-45c9-999e-32e9cc57a5f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:57.124930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-699b294f-afda-45c9-999e-32e9cc57a5f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:57.126290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-699b294f-afda-45c9-999e-32e9cc57a5f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:57.126764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-699b294f-afda-45c9-999e-32e9cc57a5f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:57.127197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-699b294f-afda-45c9-999e-32e9cc57a5f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:57.369714 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3ac1feb9-0ba8-4d17-9575-2974e52d5065 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1650 microversion: 2.1 time: 0.575485 Oct 11 04:22:57.370325 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1549/2983] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:56 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1650 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:57.399182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-699b294f-afda-45c9-999e-32e9cc57a5f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:57.409534 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-699b294f-afda-45c9-999e-32e9cc57a5f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1212 microversion: 2.1 time: 0.305920 Oct 11 04:22:57.410699 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1435/2984] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:57 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1212 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:57.979230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3fc5085d-7792-4267-ac25-501a56939bd9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:57.980373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3fc5085d-7792-4267-ac25-501a56939bd9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:58.004482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fc5085d-7792-4267-ac25-501a56939bd9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:58.005151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fc5085d-7792-4267-ac25-501a56939bd9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:58.005604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fc5085d-7792-4267-ac25-501a56939bd9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:58.006380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fc5085d-7792-4267-ac25-501a56939bd9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:58.010135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fc5085d-7792-4267-ac25-501a56939bd9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:58.010685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fc5085d-7792-4267-ac25-501a56939bd9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:58.205970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3fc5085d-7792-4267-ac25-501a56939bd9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:58.217380 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3fc5085d-7792-4267-ac25-501a56939bd9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1266 microversion: 2.1 time: 0.243250 Oct 11 04:22:58.230421 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1550/2985] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:57 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1266 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:58.401091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-25d73352-15d8-4b98-9f18-9f51648bc92b req-74470ed7-9e2a-4b44-b8fd-02bad38e7012 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a99ecc72-094d-4756-a9b3-fc9d374b440e", "name": "network-vif-deleted", "tag": "1bcba2d7-91a1-41e1-9f49-4319b6515cef"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:58.403106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a567848-aed1-4e79-b6a8-cd07e3290f88 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:58.403578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a567848-aed1-4e79-b6a8-cd07e3290f88 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:58.417068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a567848-aed1-4e79-b6a8-cd07e3290f88 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:58.418483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a567848-aed1-4e79-b6a8-cd07e3290f88 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:58.434365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:58.436374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a567848-aed1-4e79-b6a8-cd07e3290f88 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:58.437217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a567848-aed1-4e79-b6a8-cd07e3290f88 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:58.437696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a567848-aed1-4e79-b6a8-cd07e3290f88 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:58.438168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a567848-aed1-4e79-b6a8-cd07e3290f88 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:58.445853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-25d73352-15d8-4b98-9f18-9f51648bc92b req-74470ed7-9e2a-4b44-b8fd-02bad38e7012 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:58.446356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-25d73352-15d8-4b98-9f18-9f51648bc92b req-74470ed7-9e2a-4b44-b8fd-02bad38e7012 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:58.446783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-25d73352-15d8-4b98-9f18-9f51648bc92b req-74470ed7-9e2a-4b44-b8fd-02bad38e7012 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:58.512654 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-25d73352-15d8-4b98-9f18-9f51648bc92b req-74470ed7-9e2a-4b44-b8fd-02bad38e7012 service nova] Creating event network-vif-deleted:1bcba2d7-91a1-41e1-9f49-4319b6515cef for instance a99ecc72-094d-4756-a9b3-fc9d374b440e on n-h1-860892-1 Oct 11 04:22:58.526485 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-25d73352-15d8-4b98-9f18-9f51648bc92b req-74470ed7-9e2a-4b44-b8fd-02bad38e7012 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134629 Oct 11 04:22:58.531610 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1436/2986] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:22:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:22:58.562650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f404f48-848c-4dd5-beac-1d04ad3859f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:58.562650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2f404f48-848c-4dd5-beac-1d04ad3859f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:58.577372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f404f48-848c-4dd5-beac-1d04ad3859f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:58.577943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f404f48-848c-4dd5-beac-1d04ad3859f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:58.578570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f404f48-848c-4dd5-beac-1d04ad3859f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:58.579274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f404f48-848c-4dd5-beac-1d04ad3859f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:58.579730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f404f48-848c-4dd5-beac-1d04ad3859f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:58.580163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f404f48-848c-4dd5-beac-1d04ad3859f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:58.704106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f404f48-848c-4dd5-beac-1d04ad3859f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:58.715088 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f404f48-848c-4dd5-beac-1d04ad3859f8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1260 microversion: 2.1 time: 0.171080 Oct 11 04:22:58.731209 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1437/2987] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:58 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:59.000930 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a567848-aed1-4e79-b6a8-cd07e3290f88 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1630 microversion: 2.1 time: 0.605228 Oct 11 04:22:59.001987 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1551/2988] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:58 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1630 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:22:59.021653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8564e07-2bd9-4489-b532-bca1e67352f0 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860892-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:22:59.026326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8564e07-2bd9-4489-b532-bca1e67352f0 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:59.044996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8564e07-2bd9-4489-b532-bca1e67352f0 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:59.054802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8564e07-2bd9-4489-b532-bca1e67352f0 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:59.056530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8564e07-2bd9-4489-b532-bca1e67352f0 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:59.057650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8564e07-2bd9-4489-b532-bca1e67352f0 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:59.063235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8564e07-2bd9-4489-b532-bca1e67352f0 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:59.063844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8564e07-2bd9-4489-b532-bca1e67352f0 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:59.197831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-e8564e07-2bd9-4489-b532-bca1e67352f0 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lazy-loading 'flavor' on Instance uuid be377902-7acc-4ab8-b89e-c308d4c41a9c {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:22:59.213017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8564e07-2bd9-4489-b532-bca1e67352f0 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Going to try to live migrate instance to n-h2-860892-1 {{(pid=120993) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 04:22:59.219404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:22:59.241346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d27b4398-9720-4fa2-9af9-83e2b1a1f7f4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:59.241961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d27b4398-9720-4fa2-9af9-83e2b1a1f7f4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:59.251984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d27b4398-9720-4fa2-9af9-83e2b1a1f7f4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:59.252477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d27b4398-9720-4fa2-9af9-83e2b1a1f7f4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:59.252929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d27b4398-9720-4fa2-9af9-83e2b1a1f7f4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:59.253610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d27b4398-9720-4fa2-9af9-83e2b1a1f7f4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:59.260003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d27b4398-9720-4fa2-9af9-83e2b1a1f7f4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:59.260762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d27b4398-9720-4fa2-9af9-83e2b1a1f7f4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:59.417552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d27b4398-9720-4fa2-9af9-83e2b1a1f7f4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:22:59.431097 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d27b4398-9720-4fa2-9af9-83e2b1a1f7f4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1272 microversion: 2.1 time: 0.192094 Oct 11 04:22:59.432847 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1552/2989] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:59 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:22:59.743930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22f27146-a813-4781-a0af-cb2fec62a966 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:22:59.757458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22f27146-a813-4781-a0af-cb2fec62a966 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:22:59.769529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f27146-a813-4781-a0af-cb2fec62a966 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:59.770638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f27146-a813-4781-a0af-cb2fec62a966 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:59.771864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f27146-a813-4781-a0af-cb2fec62a966 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:22:59.774531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f27146-a813-4781-a0af-cb2fec62a966 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:22:59.775478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f27146-a813-4781-a0af-cb2fec62a966 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:22:59.776654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f27146-a813-4781-a0af-cb2fec62a966 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:00.318484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22f27146-a813-4781-a0af-cb2fec62a966 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:00.350784 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22f27146-a813-4781-a0af-cb2fec62a966 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1268 microversion: 2.1 time: 0.616431 Oct 11 04:23:00.358743 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1553/2990] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:22:59 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1268 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:00.455154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b042171a-04f7-453b-b69e-84286e2f238e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:00.455760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b042171a-04f7-453b-b69e-84286e2f238e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:00.466838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b042171a-04f7-453b-b69e-84286e2f238e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:00.467511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b042171a-04f7-453b-b69e-84286e2f238e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:00.468150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b042171a-04f7-453b-b69e-84286e2f238e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:00.469020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b042171a-04f7-453b-b69e-84286e2f238e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:00.478322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b042171a-04f7-453b-b69e-84286e2f238e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:00.484231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b042171a-04f7-453b-b69e-84286e2f238e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:00.678585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b042171a-04f7-453b-b69e-84286e2f238e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:00.702105 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b042171a-04f7-453b-b69e-84286e2f238e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1272 microversion: 2.1 time: 0.240683 Oct 11 04:23:00.702105 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1554/2991] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:00 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:01.382037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49255d26-8d75-461a-a142-7ed873d1f636 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:01.382708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-49255d26-8d75-461a-a142-7ed873d1f636 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:01.396648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49255d26-8d75-461a-a142-7ed873d1f636 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:01.397434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49255d26-8d75-461a-a142-7ed873d1f636 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:01.409706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49255d26-8d75-461a-a142-7ed873d1f636 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:01.411274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49255d26-8d75-461a-a142-7ed873d1f636 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:01.413879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49255d26-8d75-461a-a142-7ed873d1f636 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:01.413879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49255d26-8d75-461a-a142-7ed873d1f636 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:02.215093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-49255d26-8d75-461a-a142-7ed873d1f636 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:02.229253 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-49255d26-8d75-461a-a142-7ed873d1f636 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1308 microversion: 2.1 time: 0.851497 Oct 11 04:23:02.245888 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1555/2992] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:01 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1308 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:02.252616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f30ae1b-d5a0-4840-907b-5dfc551054d3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:02.253436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f30ae1b-d5a0-4840-907b-5dfc551054d3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:02.263217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f30ae1b-d5a0-4840-907b-5dfc551054d3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:02.264379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f30ae1b-d5a0-4840-907b-5dfc551054d3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:02.266678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f30ae1b-d5a0-4840-907b-5dfc551054d3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:02.273374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f30ae1b-d5a0-4840-907b-5dfc551054d3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:02.274054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f30ae1b-d5a0-4840-907b-5dfc551054d3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:02.275345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f30ae1b-d5a0-4840-907b-5dfc551054d3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:02.800740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2f30ae1b-d5a0-4840-907b-5dfc551054d3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:02.811276 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f30ae1b-d5a0-4840-907b-5dfc551054d3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1314 microversion: 2.1 time: 0.564026 Oct 11 04:23:02.828066 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1556/2993] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:02 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:03.274449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90505939-9a13-4bf7-813d-5139d3ef84bf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:03.275080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90505939-9a13-4bf7-813d-5139d3ef84bf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:03.291320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90505939-9a13-4bf7-813d-5139d3ef84bf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:03.292242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90505939-9a13-4bf7-813d-5139d3ef84bf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:03.295821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90505939-9a13-4bf7-813d-5139d3ef84bf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:03.300870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90505939-9a13-4bf7-813d-5139d3ef84bf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:03.302922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90505939-9a13-4bf7-813d-5139d3ef84bf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:03.304708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90505939-9a13-4bf7-813d-5139d3ef84bf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:03.753739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-90505939-9a13-4bf7-813d-5139d3ef84bf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:03.780813 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90505939-9a13-4bf7-813d-5139d3ef84bf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1308 microversion: 2.1 time: 0.509513 Oct 11 04:23:03.784155 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1557/2994] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:03 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1308 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:03.838710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d4a0c6fe-1019-4221-84c5-0ad0a4c1294f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:03.842105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d4a0c6fe-1019-4221-84c5-0ad0a4c1294f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:03.860575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4a0c6fe-1019-4221-84c5-0ad0a4c1294f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:03.860575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4a0c6fe-1019-4221-84c5-0ad0a4c1294f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:03.860575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4a0c6fe-1019-4221-84c5-0ad0a4c1294f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:03.866360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4a0c6fe-1019-4221-84c5-0ad0a4c1294f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:03.867444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4a0c6fe-1019-4221-84c5-0ad0a4c1294f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:03.872551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4a0c6fe-1019-4221-84c5-0ad0a4c1294f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:04.240077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d4a0c6fe-1019-4221-84c5-0ad0a4c1294f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:04.259312 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d4a0c6fe-1019-4221-84c5-0ad0a4c1294f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1314 microversion: 2.1 time: 0.426420 Oct 11 04:23:04.261757 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1558/2995] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:03 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1314 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:04.395055 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e8564e07-2bd9-4489-b532-bca1e67352f0 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c/action" status: 202 len: 0 microversion: 2.1 time: 5.377368 Oct 11 04:23:04.395724 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1438/2996] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:22:59 2022] POST /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c/action => generated 0 bytes in 5379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:23:04.408831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2ec4262f-8162-4625-89aa-d4b38d943f10 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:04.409055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2ec4262f-8162-4625-89aa-d4b38d943f10 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:04.418715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ec4262f-8162-4625-89aa-d4b38d943f10 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:04.419898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ec4262f-8162-4625-89aa-d4b38d943f10 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:04.420425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ec4262f-8162-4625-89aa-d4b38d943f10 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:04.421034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ec4262f-8162-4625-89aa-d4b38d943f10 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:04.422811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ec4262f-8162-4625-89aa-d4b38d943f10 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:04.423287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ec4262f-8162-4625-89aa-d4b38d943f10 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:04.464810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:04.494681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=16 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:04.725098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2ec4262f-8162-4625-89aa-d4b38d943f10 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:04.748424 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2ec4262f-8162-4625-89aa-d4b38d943f10 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.348044 Oct 11 04:23:04.749011 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1559/2997] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:04 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:04.793948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ab2e2b56-91bd-49b2-80b8-b9d1f9b77d33 req-b5e58a73-47b8-44f4-a678-2f727ab38127 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "597b08ac-2ff7-485c-9ccc-cc37c67817df", "tag": "1a26991b-531a-4238-9366-bb99758b06be"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:04.814967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-28da4cda-ca4d-4977-9e7a-224e122a6762 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:04.815389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ab2e2b56-91bd-49b2-80b8-b9d1f9b77d33 req-b5e58a73-47b8-44f4-a678-2f727ab38127 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:04.815562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-28da4cda-ca4d-4977-9e7a-224e122a6762 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:04.816169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ab2e2b56-91bd-49b2-80b8-b9d1f9b77d33 req-b5e58a73-47b8-44f4-a678-2f727ab38127 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:04.816865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ab2e2b56-91bd-49b2-80b8-b9d1f9b77d33 req-b5e58a73-47b8-44f4-a678-2f727ab38127 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:04.827792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28da4cda-ca4d-4977-9e7a-224e122a6762 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:04.828637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28da4cda-ca4d-4977-9e7a-224e122a6762 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:04.830604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28da4cda-ca4d-4977-9e7a-224e122a6762 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:04.833704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28da4cda-ca4d-4977-9e7a-224e122a6762 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:04.834836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28da4cda-ca4d-4977-9e7a-224e122a6762 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:04.836305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28da4cda-ca4d-4977-9e7a-224e122a6762 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:04.840393 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ab2e2b56-91bd-49b2-80b8-b9d1f9b77d33 req-b5e58a73-47b8-44f4-a678-2f727ab38127 service nova] Creating event network-changed:1a26991b-531a-4238-9366-bb99758b06be for instance 597b08ac-2ff7-485c-9ccc-cc37c67817df on n-h2-860892-1 Oct 11 04:23:04.852004 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ab2e2b56-91bd-49b2-80b8-b9d1f9b77d33 req-b5e58a73-47b8-44f4-a678-2f727ab38127 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064735 Oct 11 04:23:04.855457 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1439/2998] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:05.284260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6d2139e1-f504-4142-a4c5-2c3a0ce8369e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:05.285365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6d2139e1-f504-4142-a4c5-2c3a0ce8369e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:05.306862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d2139e1-f504-4142-a4c5-2c3a0ce8369e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:05.307781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d2139e1-f504-4142-a4c5-2c3a0ce8369e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:05.308488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d2139e1-f504-4142-a4c5-2c3a0ce8369e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:05.309611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d2139e1-f504-4142-a4c5-2c3a0ce8369e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:05.310111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d2139e1-f504-4142-a4c5-2c3a0ce8369e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:05.310788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d2139e1-f504-4142-a4c5-2c3a0ce8369e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:05.910430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-28da4cda-ca4d-4977-9e7a-224e122a6762 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:05.936434 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-28da4cda-ca4d-4977-9e7a-224e122a6762 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1308 microversion: 2.1 time: 1.119894 Oct 11 04:23:05.941705 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1560/2999] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:04 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1308 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:05.969483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d3a8385a-b7d4-4057-88c5-545a7a444132 req-72d2183e-8265-4208-82f0-bd53b06f039e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7", "tag": "e4245ebf-4f68-4188-ac3d-3c00b2f56dd2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:05.983289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d3a8385a-b7d4-4057-88c5-545a7a444132 req-72d2183e-8265-4208-82f0-bd53b06f039e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:05.983769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d3a8385a-b7d4-4057-88c5-545a7a444132 req-72d2183e-8265-4208-82f0-bd53b06f039e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:05.984399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d3a8385a-b7d4-4057-88c5-545a7a444132 req-72d2183e-8265-4208-82f0-bd53b06f039e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:05.998333 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d3a8385a-b7d4-4057-88c5-545a7a444132 req-72d2183e-8265-4208-82f0-bd53b06f039e service nova] Creating event network-changed:e4245ebf-4f68-4188-ac3d-3c00b2f56dd2 for instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 on n-h2-860892-1 Oct 11 04:23:06.003736 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d3a8385a-b7d4-4057-88c5-545a7a444132 req-72d2183e-8265-4208-82f0-bd53b06f039e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060083 Oct 11 04:23:06.004652 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1561/3000] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:06.012133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-edbb3795-8556-4c25-8535-90e3a13033b3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:06.013073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-edbb3795-8556-4c25-8535-90e3a13033b3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:06.020985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edbb3795-8556-4c25-8535-90e3a13033b3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:06.021869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edbb3795-8556-4c25-8535-90e3a13033b3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:06.023023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edbb3795-8556-4c25-8535-90e3a13033b3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:06.023926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edbb3795-8556-4c25-8535-90e3a13033b3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:06.025700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edbb3795-8556-4c25-8535-90e3a13033b3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:06.026370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edbb3795-8556-4c25-8535-90e3a13033b3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:06.069813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=10 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:06.245655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:06.424955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-edbb3795-8556-4c25-8535-90e3a13033b3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:06.446462 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-edbb3795-8556-4c25-8535-90e3a13033b3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.426908 Oct 11 04:23:06.446462 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1562/3001] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:06 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:06.968257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-361dba18-be4d-48bc-afbd-814894cc2870 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:06.968892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-361dba18-be4d-48bc-afbd-814894cc2870 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:06.987860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-361dba18-be4d-48bc-afbd-814894cc2870 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:06.997004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-361dba18-be4d-48bc-afbd-814894cc2870 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:06.997004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-361dba18-be4d-48bc-afbd-814894cc2870 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:06.999985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6d2139e1-f504-4142-a4c5-2c3a0ce8369e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:07.011224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-361dba18-be4d-48bc-afbd-814894cc2870 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:07.015370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-361dba18-be4d-48bc-afbd-814894cc2870 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:07.017149 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6d2139e1-f504-4142-a4c5-2c3a0ce8369e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1314 microversion: 2.1 time: 1.737093 Oct 11 04:23:07.018234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-361dba18-be4d-48bc-afbd-814894cc2870 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:07.022226 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1440/3002] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:05 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1314 bytes in 1743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:07.241402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-361dba18-be4d-48bc-afbd-814894cc2870 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:07.256112 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-361dba18-be4d-48bc-afbd-814894cc2870 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1308 microversion: 2.1 time: 0.293391 Oct 11 04:23:07.257405 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1563/3003] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:06 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1308 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:07.461923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-66c12bb4-3c97-4ba1-a21c-d00127a925af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:07.463228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-66c12bb4-3c97-4ba1-a21c-d00127a925af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:07.479110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66c12bb4-3c97-4ba1-a21c-d00127a925af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:07.480417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66c12bb4-3c97-4ba1-a21c-d00127a925af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:07.481032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66c12bb4-3c97-4ba1-a21c-d00127a925af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:07.481915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66c12bb4-3c97-4ba1-a21c-d00127a925af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:07.482580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66c12bb4-3c97-4ba1-a21c-d00127a925af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:07.483160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66c12bb4-3c97-4ba1-a21c-d00127a925af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:08.048545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5da74852-e550-4029-8bd5-275916acda6e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:08.049060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5da74852-e550-4029-8bd5-275916acda6e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:08.070446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5da74852-e550-4029-8bd5-275916acda6e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:08.071944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5da74852-e550-4029-8bd5-275916acda6e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:08.072409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5da74852-e550-4029-8bd5-275916acda6e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:08.075763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5da74852-e550-4029-8bd5-275916acda6e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:08.076249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5da74852-e550-4029-8bd5-275916acda6e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:08.076691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5da74852-e550-4029-8bd5-275916acda6e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:08.315169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5da74852-e550-4029-8bd5-275916acda6e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:08.325099 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5da74852-e550-4029-8bd5-275916acda6e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1314 microversion: 2.1 time: 0.282759 Oct 11 04:23:08.326280 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1564/3004] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:08 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:08.355045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e1846fd0-40ba-4b1f-9c70-e8a9a3bb801d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:08.355045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e1846fd0-40ba-4b1f-9c70-e8a9a3bb801d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:08.359461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1846fd0-40ba-4b1f-9c70-e8a9a3bb801d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:08.360161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1846fd0-40ba-4b1f-9c70-e8a9a3bb801d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:08.361260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1846fd0-40ba-4b1f-9c70-e8a9a3bb801d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:08.362238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1846fd0-40ba-4b1f-9c70-e8a9a3bb801d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:08.363046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1846fd0-40ba-4b1f-9c70-e8a9a3bb801d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:08.363760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1846fd0-40ba-4b1f-9c70-e8a9a3bb801d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:08.372729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-66c12bb4-3c97-4ba1-a21c-d00127a925af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:08.384140 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-66c12bb4-3c97-4ba1-a21c-d00127a925af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.926126 Oct 11 04:23:08.387616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:08.390616 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1441/3005] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:07 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:08.829171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e1846fd0-40ba-4b1f-9c70-e8a9a3bb801d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:08.836846 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e1846fd0-40ba-4b1f-9c70-e8a9a3bb801d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1308 microversion: 2.1 time: 0.509169 Oct 11 04:23:08.844864 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1565/3006] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:08 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1308 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:09.361491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d5862551-4bf0-4733-9ebf-ac80e9edbac3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:09.369524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d5862551-4bf0-4733-9ebf-ac80e9edbac3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:09.396952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5862551-4bf0-4733-9ebf-ac80e9edbac3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:09.398086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5862551-4bf0-4733-9ebf-ac80e9edbac3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:09.400235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5862551-4bf0-4733-9ebf-ac80e9edbac3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:09.402122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5862551-4bf0-4733-9ebf-ac80e9edbac3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:09.407680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5862551-4bf0-4733-9ebf-ac80e9edbac3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:09.408665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5862551-4bf0-4733-9ebf-ac80e9edbac3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:09.579838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bf810f7a-1f8e-4e57-ba35-c70aa45ba965 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Action: 'create', calling method: .version_select at 0x7fda191f5d30>, body: {"keypair": {"name": "tempest-keypair-1597348109", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHKcuHzwkTTwfdBIsevl/3sELhAN1PjYqAVc/J9FySu3L2p4rqivC4Be/ntDfKasGtXbc3ESIzaweWTLNYgEeUoWZkEMkADMMFP8TnP1DzqAdgHyTe+MjfccwIkItb6jkg=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:09.607544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-bf810f7a-1f8e-4e57-ba35-c70aa45ba965 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:09.618830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-bf810f7a-1f8e-4e57-ba35-c70aa45ba965 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for user c5f8f12dff23400296765fb0d9c597e2 and project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:09.647708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d5862551-4bf0-4733-9ebf-ac80e9edbac3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:09.658433 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d5862551-4bf0-4733-9ebf-ac80e9edbac3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1314 microversion: 2.1 time: 0.310615 Oct 11 04:23:09.659943 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1566/3007] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:09 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:09.665427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49ff2a2b-1d37-4007-beaf-5d3f93b50ded tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:09.666345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-49ff2a2b-1d37-4007-beaf-5d3f93b50ded tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:09.673476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ff2a2b-1d37-4007-beaf-5d3f93b50ded tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:09.674766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ff2a2b-1d37-4007-beaf-5d3f93b50ded tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:09.675442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ff2a2b-1d37-4007-beaf-5d3f93b50ded tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:09.676361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ff2a2b-1d37-4007-beaf-5d3f93b50ded tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:09.677022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ff2a2b-1d37-4007-beaf-5d3f93b50ded tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:09.677638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ff2a2b-1d37-4007-beaf-5d3f93b50ded tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:09.800772 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bf810f7a-1f8e-4e57-ba35-c70aa45ba965 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.636076 Oct 11 04:23:09.801704 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1442/3008] 10.222.0.26 () {62 vars in 1199 bytes} [Tue Oct 11 04:23:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 638 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 04:23:09.814270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9aa249fe-e4cb-4fcf-a0a0-de4b48360d8a tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda191e9ee0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:09.839328 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9aa249fe-e4cb-4fcf-a0a0-de4b48360d8a tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-1597348109" status: 200 len: 513 microversion: 2.2 time: 0.029291 Oct 11 04:23:09.844136 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1443/3009] 10.222.0.26 () {60 vars in 1258 bytes} [Tue Oct 11 04:23:09 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1597348109 => generated 513 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:23:09.863166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bdaded3-4164-4cd7-ae20-c85b7533e2eb tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda191f5550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:09.890838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-49ff2a2b-1d37-4007-beaf-5d3f93b50ded tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:09.919595 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-49ff2a2b-1d37-4007-beaf-5d3f93b50ded tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.256471 Oct 11 04:23:09.920224 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1567/3010] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:09 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:09.929567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ed34a074-ac0c-4a64-a474-c637ccdfa08d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:09.930178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ed34a074-ac0c-4a64-a474-c637ccdfa08d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:09.937177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed34a074-ac0c-4a64-a474-c637ccdfa08d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:09.937992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed34a074-ac0c-4a64-a474-c637ccdfa08d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:09.938510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed34a074-ac0c-4a64-a474-c637ccdfa08d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:09.939570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed34a074-ac0c-4a64-a474-c637ccdfa08d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:09.940218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed34a074-ac0c-4a64-a474-c637ccdfa08d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:09.941530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed34a074-ac0c-4a64-a474-c637ccdfa08d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:09.999608 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0bdaded3-4164-4cd7-ae20-c85b7533e2eb tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597348109" status: 204 len: 0 microversion: 2.2 time: 0.146619 Oct 11 04:23:10.003231 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1444/3011] 10.222.0.26 () {60 vars in 1261 bytes} [Tue Oct 11 04:23:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1597348109 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:23:10.018154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-65e9ea20-2711-4c28-8ce2-631b47826f6d tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Action: 'create', calling method: .version_select at 0x7fda192a2430>, body: {"keypair": {"name": "tempest-keypair-1350369937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCOeLx0E6rJhSF9xfqTxe/TRrpAOXe0uHAzcvJtPesoGpSaXDWZqbtJJuL4c6xx50XYrQCFqev7zpOkw5x1qVSr2oh6OnIhjMMA06AOvtwudGm0IiFt8Kt0R1la5Ktthg=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:10.049573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-65e9ea20-2711-4c28-8ce2-631b47826f6d tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:10.060411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-65e9ea20-2711-4c28-8ce2-631b47826f6d tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for user c5f8f12dff23400296765fb0d9c597e2 and project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:10.183297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ed34a074-ac0c-4a64-a474-c637ccdfa08d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:10.186732 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-65e9ea20-2711-4c28-8ce2-631b47826f6d tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.172735 Oct 11 04:23:10.188218 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1445/3012] 10.222.0.26 () {62 vars in 1199 bytes} [Tue Oct 11 04:23:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 175 msecs (HTTP/1.1 201) 9 headers in 362 bytes (2 switches on core 0) Oct 11 04:23:10.199925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d15e9756-facb-4781-9f9f-a7a0a413b46e tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda192a2670>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:10.200081 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ed34a074-ac0c-4a64-a474-c637ccdfa08d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1308 microversion: 2.1 time: 0.274415 Oct 11 04:23:10.230436 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1568/3013] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:09 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1308 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:10.327806 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d15e9756-facb-4781-9f9f-a7a0a413b46e tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350369937" status: 204 len: 0 microversion: 2.2 time: 0.132328 Oct 11 04:23:10.332635 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1446/3014] 10.222.0.26 () {60 vars in 1261 bytes} [Tue Oct 11 04:23:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1350369937 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:23:10.343647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b0decaf-920a-4685-8a79-35c3e9fc62e7 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Action: 'create', calling method: .version_select at 0x7fda19327550>, body: {"keypair": {"name": "tempest-keypair-487624410", "public_key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsNe3/1ILNCqFyfYWDeTKLD6jEXC2OQHLmietMWW+/vdaZq7KZEwO0jhglaFjU1mpqq4Gz5RX156sCTNM9vRbwKAxfsdF9laBYVsex3m3Wmui3uYrKyumsoJn2g9GNnG1PI1mrVjZ61i0GY3khna+wzlTpCCmy5HNlrmbj3XLqBUpipTOXmsnr4sChzC53KCd8LXuwc1i/CZPvF+3XipvAgFSE53pCtLOeB1kYMOBaiUPLQTWXR3JpckqFIQwhIH0zoHlJvZE8hh90XcPojYN56tI0OlrGqojbediJYD0rUsJu4weZpbn8vilb3JuDY+jwssnSA8wzBx3A/8y9Pp1B nova@ubuntu"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:10.376569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-1b0decaf-920a-4685-8a79-35c3e9fc62e7 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:10.381372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:10.389316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-1b0decaf-920a-4685-8a79-35c3e9fc62e7 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for user c5f8f12dff23400296765fb0d9c597e2 and project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:10.544428 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1b0decaf-920a-4685-8a79-35c3e9fc62e7 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 588 microversion: 2.2 time: 0.205110 Oct 11 04:23:10.547779 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1569/3015] 10.222.0.26 () {62 vars in 1199 bytes} [Tue Oct 11 04:23:10 2022] POST /compute/v2.1/os-keypairs => generated 588 bytes in 209 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 04:23:10.559497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fab681ba-16b2-4733-91ca-dbe492521ef7 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda191f55e0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:10.659238 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fab681ba-16b2-4733-91ca-dbe492521ef7 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-487624410" status: 204 len: 0 microversion: 2.2 time: 0.104733 Oct 11 04:23:10.659887 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1447/3016] 10.222.0.26 () {60 vars in 1258 bytes} [Tue Oct 11 04:23:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-487624410 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:23:10.672510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b8acf763-8507-493d-b9be-f929c6878b03 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Action: 'create', calling method: .version_select at 0x7fda19341ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-20321748", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9SoSUEXST3us7VV141TLzxJoHg4NatZTsyobVVk1YjQG+p2G4d/b1pn2btl2nGZ4JxfkapM0R1hjzR/ETwA2fk/oHIi/Nnm8q0snw+N2hkYSG4WCnqOSuWsTbCw0kiYQ=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:10.685943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df419b1e-afc5-4d05-80ca-68ed08f5caf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:10.686995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-df419b1e-afc5-4d05-80ca-68ed08f5caf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:10.698897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b8acf763-8507-493d-b9be-f929c6878b03 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:10.699117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df419b1e-afc5-4d05-80ca-68ed08f5caf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:10.699117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df419b1e-afc5-4d05-80ca-68ed08f5caf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:10.699117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df419b1e-afc5-4d05-80ca-68ed08f5caf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:10.699117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df419b1e-afc5-4d05-80ca-68ed08f5caf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:10.699117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df419b1e-afc5-4d05-80ca-68ed08f5caf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:10.709475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df419b1e-afc5-4d05-80ca-68ed08f5caf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:10.716872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b8acf763-8507-493d-b9be-f929c6878b03 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for user c5f8f12dff23400296765fb0d9c597e2 and project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:10.828005 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b8acf763-8507-493d-b9be-f929c6878b03 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 419 microversion: 2.2 time: 0.157192 Oct 11 04:23:10.828005 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1570/3017] 10.222.0.26 () {62 vars in 1199 bytes} [Tue Oct 11 04:23:10 2022] POST /compute/v2.1/os-keypairs => generated 419 bytes in 159 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 04:23:10.841506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6ec9612f-db8c-43b8-b2ed-9832b20cee5d tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Action: 'create', calling method: .version_select at 0x7fda1938e790>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-395135062", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpexcPtuCA/apWMUaO+ZXLGabmnLyhAgibXUobHiaICpDZoXVXZM3iTHM4nNuHnxd5I+h+UsBmEh5u5LIgGgPipn5tfc4Wa1jN5Lfcyfms0iUuTE4PSx9yAxw+qHIUVqw=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:10.866784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6ec9612f-db8c-43b8-b2ed-9832b20cee5d tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:10.873218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6ec9612f-db8c-43b8-b2ed-9832b20cee5d tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for user c5f8f12dff23400296765fb0d9c597e2 and project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:11.041115 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6ec9612f-db8c-43b8-b2ed-9832b20cee5d tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.2 time: 0.204614 Oct 11 04:23:11.042376 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1571/3018] 10.222.0.26 () {62 vars in 1199 bytes} [Tue Oct 11 04:23:10 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 207 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 04:23:11.060875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7ebeadc0-80da-4b0d-bbda-b04186eef494 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:11.066643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7ebeadc0-80da-4b0d-bbda-b04186eef494 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:11.077886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ebeadc0-80da-4b0d-bbda-b04186eef494 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:11.079439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ebeadc0-80da-4b0d-bbda-b04186eef494 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:11.085032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ebeadc0-80da-4b0d-bbda-b04186eef494 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:11.086152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ebeadc0-80da-4b0d-bbda-b04186eef494 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:11.086887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ebeadc0-80da-4b0d-bbda-b04186eef494 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:11.087466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ebeadc0-80da-4b0d-bbda-b04186eef494 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:11.360941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-df419b1e-afc5-4d05-80ca-68ed08f5caf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:11.373127 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df419b1e-afc5-4d05-80ca-68ed08f5caf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1314 microversion: 2.1 time: 0.692019 Oct 11 04:23:11.375380 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1448/3019] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:10 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1314 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:11.383613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7ebeadc0-80da-4b0d-bbda-b04186eef494 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:11.388491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e957b5b1-ba54-424e-bc45-ed62066d7c7a tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Action: 'create', calling method: .version_select at 0x7fda19148ee0>, body: {"keypair": {"name": "tempest-KeyPairsV22TestJSON-keypair-2010510396", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMbHdUUjz0n21Tura+xwjaOKNxg7ByqaYdGyvMZlR0OM+rSlm2XWZ04ZxSvMGGOV2Hx4s8E3x5Uw7auBs3r+CvBKDJOg79ylWulEnvpemSdQIeAHr/4c3nsXiuCI0KrOyQ=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:11.395547 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7ebeadc0-80da-4b0d-bbda-b04186eef494 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.341773 Oct 11 04:23:11.396431 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1572/3020] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:11 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:11.413219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-77ecebc4-349b-4199-98b8-2432f9ed87f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:11.414327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-77ecebc4-349b-4199-98b8-2432f9ed87f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:11.433643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77ecebc4-349b-4199-98b8-2432f9ed87f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:11.439721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77ecebc4-349b-4199-98b8-2432f9ed87f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:11.444011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77ecebc4-349b-4199-98b8-2432f9ed87f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:11.444887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77ecebc4-349b-4199-98b8-2432f9ed87f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:11.450929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77ecebc4-349b-4199-98b8-2432f9ed87f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:11.451531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77ecebc4-349b-4199-98b8-2432f9ed87f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:11.455379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-e957b5b1-ba54-424e-bc45-ed62066d7c7a tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:11.478383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-e957b5b1-ba54-424e-bc45-ed62066d7c7a tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for user c5f8f12dff23400296765fb0d9c597e2 and project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:11.671793 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e957b5b1-ba54-424e-bc45-ed62066d7c7a tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 421 microversion: 2.2 time: 0.294947 Oct 11 04:23:11.673865 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1449/3021] 10.222.0.26 () {62 vars in 1199 bytes} [Tue Oct 11 04:23:11 2022] POST /compute/v2.1/os-keypairs => generated 421 bytes in 298 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 04:23:11.679799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5b68c7fe-f509-478f-9d9d-0620aaa2e01d req-22458b43-5ad4-42db-a9a1-63f25e81c0d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "597b08ac-2ff7-485c-9ccc-cc37c67817df", "name": "network-vif-plugged", "status": "completed", "tag": "1a26991b-531a-4238-9366-bb99758b06be"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:11.709339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5b68c7fe-f509-478f-9d9d-0620aaa2e01d req-22458b43-5ad4-42db-a9a1-63f25e81c0d8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:11.714572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5b68c7fe-f509-478f-9d9d-0620aaa2e01d req-22458b43-5ad4-42db-a9a1-63f25e81c0d8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:11.718967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5b68c7fe-f509-478f-9d9d-0620aaa2e01d req-22458b43-5ad4-42db-a9a1-63f25e81c0d8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:11.775399 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5b68c7fe-f509-478f-9d9d-0620aaa2e01d req-22458b43-5ad4-42db-a9a1-63f25e81c0d8 service nova] Creating event network-vif-plugged:1a26991b-531a-4238-9366-bb99758b06be for instance 597b08ac-2ff7-485c-9ccc-cc37c67817df on n-h2-860892-1 Oct 11 04:23:11.785668 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5b68c7fe-f509-478f-9d9d-0620aaa2e01d req-22458b43-5ad4-42db-a9a1-63f25e81c0d8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108851 Oct 11 04:23:11.787994 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1450/3022] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:11.797750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-50b56184-8cc6-48ec-a941-e7f451f18050 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda191b7820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:11.803255 n-d-860892-1 devstack@n-api.service[120993]: WARNING oslo_db.sqlalchemy.utils [None req-50b56184-8cc6-48ec-a941-e7f451f18050 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 04:23:11.831632 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-50b56184-8cc6-48ec-a941-e7f451f18050 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1139 microversion: 2.2 time: 0.040024 Oct 11 04:23:11.832375 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1451/3023] 10.222.0.26 () {60 vars in 1177 bytes} [Tue Oct 11 04:23:11 2022] GET /compute/v2.1/os-keypairs => generated 1139 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:11.843449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-113de7ff-ffa0-4ccf-9302-26b4e8c4e379 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda191e98b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:11.948846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-77ecebc4-349b-4199-98b8-2432f9ed87f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:11.956950 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-77ecebc4-349b-4199-98b8-2432f9ed87f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1308 microversion: 2.1 time: 0.559296 Oct 11 04:23:11.957785 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1573/3024] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:11 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1308 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:11.984953 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-113de7ff-ffa0-4ccf-9302-26b4e8c4e379 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2010510396" status: 204 len: 0 microversion: 2.2 time: 0.145310 Oct 11 04:23:11.986342 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1452/3025] 10.222.0.26 () {60 vars in 1321 bytes} [Tue Oct 11 04:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-2010510396 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:23:12.014876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc02bacc-1b47-4fb4-928e-7108cd0f6279 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda19327a60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:12.020660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-7712f515-000d-4f4b-a599-f2cb9388ed72 req-c482cee3-e9d7-4259-8953-b08a25cc23f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be377902-7acc-4ab8-b89e-c308d4c41a9c", "name": "network-vif-unplugged", "status": "completed", "tag": "e1b10a47-b8c3-4f1e-b4a6-24338cc309de"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:12.048958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7712f515-000d-4f4b-a599-f2cb9388ed72 req-c482cee3-e9d7-4259-8953-b08a25cc23f1 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:12.050281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7712f515-000d-4f4b-a599-f2cb9388ed72 req-c482cee3-e9d7-4259-8953-b08a25cc23f1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:12.050927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7712f515-000d-4f4b-a599-f2cb9388ed72 req-c482cee3-e9d7-4259-8953-b08a25cc23f1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:12.069366 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7712f515-000d-4f4b-a599-f2cb9388ed72 req-c482cee3-e9d7-4259-8953-b08a25cc23f1 service nova] Creating event network-vif-unplugged:e1b10a47-b8c3-4f1e-b4a6-24338cc309de for instance be377902-7acc-4ab8-b89e-c308d4c41a9c on n-h1-860892-1 Oct 11 04:23:12.075455 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-7712f515-000d-4f4b-a599-f2cb9388ed72 req-c482cee3-e9d7-4259-8953-b08a25cc23f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.068350 Oct 11 04:23:12.076615 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1453/3026] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:12.183079 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bc02bacc-1b47-4fb4-928e-7108cd0f6279 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-395135062" status: 204 len: 0 microversion: 2.2 time: 0.190906 Oct 11 04:23:12.193206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02396db1-a2ab-450e-812b-bede320c5515 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda1a5f03a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:12.194595 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1574/3027] 10.222.0.26 () {60 vars in 1318 bytes} [Tue Oct 11 04:23:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-395135062 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:23:12.319904 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02396db1-a2ab-450e-812b-bede320c5515 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-20321748" status: 204 len: 0 microversion: 2.2 time: 0.130801 Oct 11 04:23:12.328249 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1454/3028] 10.222.0.26 () {60 vars in 1315 bytes} [Tue Oct 11 04:23:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-KeyPairsV22TestJSON-keypair-20321748 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:23:12.333459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-faafbc90-1f92-4ec6-9d8d-5549cce601c1 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Action: 'create', calling method: .version_select at 0x7fda19383430>, body: {"keypair": {"name": "tempest-keypair-2001497341", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQlrzqwI7WghVLCnaiMljw512K//lnOOwUDslXLmyG+ZEz6eZJQB6mw8T5z4U9G/g/cJUQDJtsryDWsbLiNtR4LraQqgUswPdTee9AQCQ/VYJ7yOi+dlfLogaeC41erDg=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:12.356264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-faafbc90-1f92-4ec6-9d8d-5549cce601c1 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:12.363984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-faafbc90-1f92-4ec6-9d8d-5549cce601c1 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for user c5f8f12dff23400296765fb0d9c597e2 and project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:12.397822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e80d1333-bc7a-4fb6-a5ed-90d0915bd546 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:12.398674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e80d1333-bc7a-4fb6-a5ed-90d0915bd546 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:12.408351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e80d1333-bc7a-4fb6-a5ed-90d0915bd546 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:12.409100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e80d1333-bc7a-4fb6-a5ed-90d0915bd546 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:12.409785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e80d1333-bc7a-4fb6-a5ed-90d0915bd546 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:12.410750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e80d1333-bc7a-4fb6-a5ed-90d0915bd546 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:12.411409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e80d1333-bc7a-4fb6-a5ed-90d0915bd546 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:12.412152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e80d1333-bc7a-4fb6-a5ed-90d0915bd546 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:12.481180 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-faafbc90-1f92-4ec6-9d8d-5549cce601c1 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.2 time: 0.151476 Oct 11 04:23:12.483193 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1575/3029] 10.222.0.26 () {62 vars in 1199 bytes} [Tue Oct 11 04:23:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 153 msecs (HTTP/1.1 201) 9 headers in 362 bytes (1 switches on core 0) Oct 11 04:23:12.490976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8b7115db-e9ff-40ac-9b40-8df522800f91 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:12.491798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8b7115db-e9ff-40ac-9b40-8df522800f91 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:12.498658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b7115db-e9ff-40ac-9b40-8df522800f91 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:12.499400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b7115db-e9ff-40ac-9b40-8df522800f91 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:12.499842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b7115db-e9ff-40ac-9b40-8df522800f91 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:12.500553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b7115db-e9ff-40ac-9b40-8df522800f91 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:12.501013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b7115db-e9ff-40ac-9b40-8df522800f91 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:12.501441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b7115db-e9ff-40ac-9b40-8df522800f91 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:12.730109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8b7115db-e9ff-40ac-9b40-8df522800f91 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:12.745263 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8b7115db-e9ff-40ac-9b40-8df522800f91 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.261303 Oct 11 04:23:12.764872 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1576/3030] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:12 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:12.773611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-11e1381d-775d-42ef-a37e-3bddb6e11b4c tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda193e1c10>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:12.785230 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-11e1381d-775d-42ef-a37e-3bddb6e11b4c tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-2001497341" status: 200 len: 513 microversion: 2.2 time: 0.018870 Oct 11 04:23:12.786722 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1577/3031] 10.222.0.26 () {60 vars in 1258 bytes} [Tue Oct 11 04:23:12 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-2001497341 => generated 513 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:12.802905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bccc6431-b960-46ad-957e-6d501f579acf tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda19374040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:12.811514 n-d-860892-1 devstack@n-api.service[120994]: WARNING oslo_db.sqlalchemy.utils [None req-bccc6431-b960-46ad-957e-6d501f579acf tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 04:23:12.818543 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bccc6431-b960-46ad-957e-6d501f579acf tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 370 microversion: 2.2 time: 0.019415 Oct 11 04:23:12.836311 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1578/3032] 10.222.0.26 () {60 vars in 1177 bytes} [Tue Oct 11 04:23:12 2022] GET /compute/v2.1/os-keypairs => generated 370 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:12.844812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a2a391d-cc86-4b69-8114-b78fb6ba6584 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda19325ca0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:12.966583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e80d1333-bc7a-4fb6-a5ed-90d0915bd546 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:12.984437 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e80d1333-bc7a-4fb6-a5ed-90d0915bd546 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1314 microversion: 2.1 time: 0.591351 Oct 11 04:23:12.985130 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1455/3033] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:12 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1314 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:12.999947 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a2a391d-cc86-4b69-8114-b78fb6ba6584 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001497341" status: 204 len: 0 microversion: 2.2 time: 0.162374 Oct 11 04:23:13.001715 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1579/3034] 10.222.0.26 () {60 vars in 1261 bytes} [Tue Oct 11 04:23:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2001497341 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:23:13.006894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d2055c3c-06f4-4395-a6c1-22fe0a37b0da tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:13.007837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d2055c3c-06f4-4395-a6c1-22fe0a37b0da tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:13.016676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3efefd60-9621-4556-a196-749ec6d6a0fc tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Action: 'create', calling method: .version_select at 0x7fda19341940>, body: {"keypair": {"name": "tempest-keypair-1617901607", "type": "x509"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:13.029978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2055c3c-06f4-4395-a6c1-22fe0a37b0da tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:13.035901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2055c3c-06f4-4395-a6c1-22fe0a37b0da tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:13.036557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2055c3c-06f4-4395-a6c1-22fe0a37b0da tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:13.037582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2055c3c-06f4-4395-a6c1-22fe0a37b0da tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:13.039376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2055c3c-06f4-4395-a6c1-22fe0a37b0da tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:13.040002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2055c3c-06f4-4395-a6c1-22fe0a37b0da tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:13.054130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-3efefd60-9621-4556-a196-749ec6d6a0fc tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:13.071104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-3efefd60-9621-4556-a196-749ec6d6a0fc tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for user c5f8f12dff23400296765fb0d9c597e2 and project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:13.112304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.processutils [None req-3efefd60-9621-4556-a196-749ec6d6a0fc tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Running cmd (subprocess): openssl req -x509 -nodes -days 3650 -config /tmp/tmpsxwvwygf/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpsxwvwygf/temp.key -subj /CN=c5f8f12dff23400296765fb0d9c597e2 -extensions v3_req_client {{(pid=120994) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 11 04:23:13.439352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.processutils [None req-3efefd60-9621-4556-a196-749ec6d6a0fc tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] CMD "openssl req -x509 -nodes -days 3650 -config /tmp/tmpsxwvwygf/temp.conf -newkey rsa:2048 -outform PEM -keyout /tmp/tmpsxwvwygf/temp.key -subj /CN=c5f8f12dff23400296765fb0d9c597e2 -extensions v3_req_client" returned: 0 in 0.325s {{(pid=120994) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 11 04:23:13.443228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.processutils [None req-3efefd60-9621-4556-a196-749ec6d6a0fc tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Running cmd (subprocess): openssl pkcs12 -export -inkey /tmp/tmpsxwvwygf/temp.key -password pass: {{(pid=120994) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:384}} Oct 11 04:23:13.492778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.processutils [None req-3efefd60-9621-4556-a196-749ec6d6a0fc tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] CMD "openssl pkcs12 -export -inkey /tmp/tmpsxwvwygf/temp.key -password pass:" returned: 0 in 0.048s {{(pid=120994) execute /usr/local/lib/python3.8/dist-packages/oslo_concurrency/processutils.py:422}} Oct 11 04:23:13.555159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d2055c3c-06f4-4395-a6c1-22fe0a37b0da tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:13.565817 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d2055c3c-06f4-4395-a6c1-22fe0a37b0da tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1308 microversion: 2.1 time: 0.579373 Oct 11 04:23:13.566450 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1456/3035] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:12 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1308 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:13.700677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-3efefd60-9621-4556-a196-749ec6d6a0fc tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:13.718168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-3efefd60-9621-4556-a196-749ec6d6a0fc tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Getting quotas for user c5f8f12dff23400296765fb0d9c597e2 and project f658956f5ae144128c147cdb6f53fb29. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:13.767313 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3efefd60-9621-4556-a196-749ec6d6a0fc tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 4693 microversion: 2.2 time: 0.755121 Oct 11 04:23:13.773319 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1580/3036] 10.222.0.26 () {62 vars in 1198 bytes} [Tue Oct 11 04:23:13 2022] POST /compute/v2.1/os-keypairs => generated 4693 bytes in 763 msecs (HTTP/1.1 201) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:23:13.775927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2d820119-e978-46f2-a4db-f04a22689fac tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:13.776757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2d820119-e978-46f2-a4db-f04a22689fac tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:13.785338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d820119-e978-46f2-a4db-f04a22689fac tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:13.785832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d820119-e978-46f2-a4db-f04a22689fac tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:13.786303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d820119-e978-46f2-a4db-f04a22689fac tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:13.787161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d820119-e978-46f2-a4db-f04a22689fac tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:13.787506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f265736-4be2-43bd-9f7e-bfbdabdf9006 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda192e3160>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:13.787628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d820119-e978-46f2-a4db-f04a22689fac tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:13.788017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d820119-e978-46f2-a4db-f04a22689fac tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:13.812271 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f265736-4be2-43bd-9f7e-bfbdabdf9006 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs/tempest-keypair-1617901607" status: 200 len: 1534 microversion: 2.2 time: 0.037345 Oct 11 04:23:13.819327 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1581/3037] 10.222.0.26 () {60 vars in 1258 bytes} [Tue Oct 11 04:23:13 2022] GET /compute/v2.1/os-keypairs/tempest-keypair-1617901607 => generated 1534 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:13.824631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04698d02-51ef-4321-bf52-2873effa7461 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda19325c10>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:13.828792 n-d-860892-1 devstack@n-api.service[120994]: WARNING oslo_db.sqlalchemy.utils [None req-04698d02-51ef-4321-bf52-2873effa7461 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 04:23:13.834825 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04698d02-51ef-4321-bf52-2873effa7461 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 1391 microversion: 2.2 time: 0.014188 Oct 11 04:23:13.838247 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1582/3038] 10.222.0.26 () {60 vars in 1177 bytes} [Tue Oct 11 04:23:13 2022] GET /compute/v2.1/os-keypairs => generated 1391 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:13.851096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-890638a6-1b1d-4bc4-b028-eca0813d1736 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] Calling method '.version_select at 0x7fda19374940>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:13.958722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2d820119-e978-46f2-a4db-f04a22689fac tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:13.970261 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2d820119-e978-46f2-a4db-f04a22689fac tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.198670 Oct 11 04:23:13.990230 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-890638a6-1b1d-4bc4-b028-eca0813d1736 tempest-KeyPairsV22TestJSON-1707752266 tempest-KeyPairsV22TestJSON-1707752266-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617901607" status: 204 len: 0 microversion: 2.2 time: 0.145980 Oct 11 04:23:13.991378 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1583/3039] 10.222.0.26 () {60 vars in 1261 bytes} [Tue Oct 11 04:23:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617901607 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:23:13.998454 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1457/3040] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:13 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:14.012531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e30c15ef-eaa8-4b19-bec4-61e96e3c66ea tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:14.015593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e30c15ef-eaa8-4b19-bec4-61e96e3c66ea tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:14.035762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c15ef-eaa8-4b19-bec4-61e96e3c66ea tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:14.038600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c15ef-eaa8-4b19-bec4-61e96e3c66ea tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:14.043184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c15ef-eaa8-4b19-bec4-61e96e3c66ea tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:14.045748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c15ef-eaa8-4b19-bec4-61e96e3c66ea tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:14.046512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c15ef-eaa8-4b19-bec4-61e96e3c66ea tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:14.048422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c15ef-eaa8-4b19-bec4-61e96e3c66ea tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:14.111903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ba82c2f8-c95d-4114-bd43-1c2660fcdbe2 req-a2d8f614-39d7-4b9c-a94f-830bee5868e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be377902-7acc-4ab8-b89e-c308d4c41a9c", "tag": "e1b10a47-b8c3-4f1e-b4a6-24338cc309de"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:14.128381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ba82c2f8-c95d-4114-bd43-1c2660fcdbe2 req-a2d8f614-39d7-4b9c-a94f-830bee5868e6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:14.129387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ba82c2f8-c95d-4114-bd43-1c2660fcdbe2 req-a2d8f614-39d7-4b9c-a94f-830bee5868e6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:14.129969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ba82c2f8-c95d-4114-bd43-1c2660fcdbe2 req-a2d8f614-39d7-4b9c-a94f-830bee5868e6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:14.159292 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ba82c2f8-c95d-4114-bd43-1c2660fcdbe2 req-a2d8f614-39d7-4b9c-a94f-830bee5868e6 service nova] Creating event network-changed:e1b10a47-b8c3-4f1e-b4a6-24338cc309de for instance be377902-7acc-4ab8-b89e-c308d4c41a9c on n-h1-860892-1 Oct 11 04:23:14.174454 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ba82c2f8-c95d-4114-bd43-1c2660fcdbe2 req-a2d8f614-39d7-4b9c-a94f-830bee5868e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065104 Oct 11 04:23:14.177715 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1458/3041] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:14.523061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e30c15ef-eaa8-4b19-bec4-61e96e3c66ea tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:14.533649 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e30c15ef-eaa8-4b19-bec4-61e96e3c66ea tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1314 microversion: 2.1 time: 0.528256 Oct 11 04:23:14.535137 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1584/3042] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:14 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1314 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:14.594436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6314d406-2868-4028-9660-791f1746e98c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:14.595141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6314d406-2868-4028-9660-791f1746e98c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:14.603860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6314d406-2868-4028-9660-791f1746e98c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:14.605235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6314d406-2868-4028-9660-791f1746e98c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:14.605891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6314d406-2868-4028-9660-791f1746e98c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:14.607044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6314d406-2868-4028-9660-791f1746e98c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:14.607723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6314d406-2868-4028-9660-791f1746e98c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:14.608431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6314d406-2868-4028-9660-791f1746e98c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:14.828416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6314d406-2868-4028-9660-791f1746e98c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:14.844290 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6314d406-2868-4028-9660-791f1746e98c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1488 microversion: 2.1 time: 0.254658 Oct 11 04:23:14.859496 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1459/3043] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:14 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1488 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:14.872283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e980d34b-f46a-437d-8f4b-cfae5468fcb1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:14.880507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e980d34b-f46a-437d-8f4b-cfae5468fcb1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:14.881292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e980d34b-f46a-437d-8f4b-cfae5468fcb1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:14.882422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e980d34b-f46a-437d-8f4b-cfae5468fcb1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:14.961207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e980d34b-f46a-437d-8f4b-cfae5468fcb1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Going to try to stop instance {{(pid=120994) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 04:23:14.999649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cfabdf77-ee72-4cd8-975d-fc16b7a13549 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:15.001801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cfabdf77-ee72-4cd8-975d-fc16b7a13549 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:15.009221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfabdf77-ee72-4cd8-975d-fc16b7a13549 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:15.010100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfabdf77-ee72-4cd8-975d-fc16b7a13549 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:15.011032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfabdf77-ee72-4cd8-975d-fc16b7a13549 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:15.012654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfabdf77-ee72-4cd8-975d-fc16b7a13549 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:15.013376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfabdf77-ee72-4cd8-975d-fc16b7a13549 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:15.014107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfabdf77-ee72-4cd8-975d-fc16b7a13549 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:15.298050 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e980d34b-f46a-437d-8f4b-cfae5468fcb1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "POST /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df/action" status: 202 len: 0 microversion: 2.1 time: 0.426713 Oct 11 04:23:15.314744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cfabdf77-ee72-4cd8-975d-fc16b7a13549 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:15.327217 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1585/3044] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:23:14 2022] POST /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:23:15.329159 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cfabdf77-ee72-4cd8-975d-fc16b7a13549 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.334369 Oct 11 04:23:15.330370 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1460/3045] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:14 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:15.356362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-27a7e1f5-f325-4f9a-826d-eb441f2ea9a5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:15.356974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-27a7e1f5-f325-4f9a-826d-eb441f2ea9a5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:15.372715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-614c6327-320d-41e4-8703-86f0a55c4b2d req-cb36c208-d273-45b2-b59f-59460fa68630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7", "name": "network-vif-plugged", "status": "completed", "tag": "e4245ebf-4f68-4188-ac3d-3c00b2f56dd2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:15.372888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27a7e1f5-f325-4f9a-826d-eb441f2ea9a5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:15.375006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27a7e1f5-f325-4f9a-826d-eb441f2ea9a5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:15.377221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27a7e1f5-f325-4f9a-826d-eb441f2ea9a5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:15.380376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27a7e1f5-f325-4f9a-826d-eb441f2ea9a5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:15.382339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27a7e1f5-f325-4f9a-826d-eb441f2ea9a5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:15.382955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27a7e1f5-f325-4f9a-826d-eb441f2ea9a5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:15.419500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-614c6327-320d-41e4-8703-86f0a55c4b2d req-cb36c208-d273-45b2-b59f-59460fa68630 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:15.420935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-614c6327-320d-41e4-8703-86f0a55c4b2d req-cb36c208-d273-45b2-b59f-59460fa68630 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:15.421601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-614c6327-320d-41e4-8703-86f0a55c4b2d req-cb36c208-d273-45b2-b59f-59460fa68630 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:15.439200 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-614c6327-320d-41e4-8703-86f0a55c4b2d req-cb36c208-d273-45b2-b59f-59460fa68630 service nova] Creating event network-vif-plugged:e4245ebf-4f68-4188-ac3d-3c00b2f56dd2 for instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 on n-h2-860892-1 Oct 11 04:23:15.465090 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-614c6327-320d-41e4-8703-86f0a55c4b2d req-cb36c208-d273-45b2-b59f-59460fa68630 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.137509 Oct 11 04:23:15.467356 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1586/3046] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:15.563910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-110ecf77-688a-4e30-98b7-496b47e66261 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:15.569447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-110ecf77-688a-4e30-98b7-496b47e66261 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:15.585849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-110ecf77-688a-4e30-98b7-496b47e66261 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:15.586269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-110ecf77-688a-4e30-98b7-496b47e66261 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:15.605928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-110ecf77-688a-4e30-98b7-496b47e66261 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:15.609294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-110ecf77-688a-4e30-98b7-496b47e66261 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:15.609680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-110ecf77-688a-4e30-98b7-496b47e66261 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:15.610134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-110ecf77-688a-4e30-98b7-496b47e66261 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:15.806895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-27a7e1f5-f325-4f9a-826d-eb441f2ea9a5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:15.817090 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-27a7e1f5-f325-4f9a-826d-eb441f2ea9a5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.485641 Oct 11 04:23:15.821563 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1461/3047] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:15 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:16.368011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-101dc39f-d50a-4b53-a7c0-6b9b0462e70d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:16.370139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-101dc39f-d50a-4b53-a7c0-6b9b0462e70d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:16.388470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101dc39f-d50a-4b53-a7c0-6b9b0462e70d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:16.389558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101dc39f-d50a-4b53-a7c0-6b9b0462e70d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:16.390405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101dc39f-d50a-4b53-a7c0-6b9b0462e70d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:16.393254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101dc39f-d50a-4b53-a7c0-6b9b0462e70d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:16.393993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101dc39f-d50a-4b53-a7c0-6b9b0462e70d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:16.395130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101dc39f-d50a-4b53-a7c0-6b9b0462e70d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:16.588485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-110ecf77-688a-4e30-98b7-496b47e66261 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:16.600521 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-110ecf77-688a-4e30-98b7-496b47e66261 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1314 microversion: 2.1 time: 1.037337 Oct 11 04:23:16.600908 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1587/3048] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:15 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1314 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:16.721810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-101dc39f-d50a-4b53-a7c0-6b9b0462e70d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:16.734982 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-101dc39f-d50a-4b53-a7c0-6b9b0462e70d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.374281 Oct 11 04:23:16.738301 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1462/3049] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:16 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:16.857680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-73b144cc-b2cb-4a4b-9df8-184cae5305ff tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:16.860371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-73b144cc-b2cb-4a4b-9df8-184cae5305ff tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:16.862511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=5,nova_api:DELETE=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:16.868988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73b144cc-b2cb-4a4b-9df8-184cae5305ff tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:16.869614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73b144cc-b2cb-4a4b-9df8-184cae5305ff tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:16.870663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73b144cc-b2cb-4a4b-9df8-184cae5305ff tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:16.875501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73b144cc-b2cb-4a4b-9df8-184cae5305ff tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:16.875501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73b144cc-b2cb-4a4b-9df8-184cae5305ff tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:16.875501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73b144cc-b2cb-4a4b-9df8-184cae5305ff tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:17.342350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-73b144cc-b2cb-4a4b-9df8-184cae5305ff tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:17.351290 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-73b144cc-b2cb-4a4b-9df8-184cae5305ff tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.501855 Oct 11 04:23:17.366351 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1588/3050] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:16 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:17.627829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4bacd521-7c7d-4a9b-8f13-fe433acacc37 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:17.629351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4bacd521-7c7d-4a9b-8f13-fe433acacc37 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:17.638073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bacd521-7c7d-4a9b-8f13-fe433acacc37 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:17.645458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bacd521-7c7d-4a9b-8f13-fe433acacc37 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:17.646107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bacd521-7c7d-4a9b-8f13-fe433acacc37 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:17.647030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bacd521-7c7d-4a9b-8f13-fe433acacc37 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:17.647474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bacd521-7c7d-4a9b-8f13-fe433acacc37 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:17.648087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bacd521-7c7d-4a9b-8f13-fe433acacc37 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:17.767370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae4fc5eb-b773-4203-8a64-4b9d56e61d3c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:17.768627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae4fc5eb-b773-4203-8a64-4b9d56e61d3c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:17.786809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae4fc5eb-b773-4203-8a64-4b9d56e61d3c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:17.787592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae4fc5eb-b773-4203-8a64-4b9d56e61d3c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:17.788195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae4fc5eb-b773-4203-8a64-4b9d56e61d3c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:17.789970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae4fc5eb-b773-4203-8a64-4b9d56e61d3c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:17.792732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae4fc5eb-b773-4203-8a64-4b9d56e61d3c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:17.793527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae4fc5eb-b773-4203-8a64-4b9d56e61d3c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:18.281489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae4fc5eb-b773-4203-8a64-4b9d56e61d3c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:18.289043 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae4fc5eb-b773-4203-8a64-4b9d56e61d3c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.530786 Oct 11 04:23:18.295072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4bacd521-7c7d-4a9b-8f13-fe433acacc37 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:18.299852 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1589/3051] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:17 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:18.310818 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4bacd521-7c7d-4a9b-8f13-fe433acacc37 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1501 microversion: 2.1 time: 0.685357 Oct 11 04:23:18.310818 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1463/3052] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:17 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1501 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:18.344539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-79678de4-dc3b-4dac-9582-3cbf5ce5bc94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:18.349010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-79678de4-dc3b-4dac-9582-3cbf5ce5bc94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:18.359050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79678de4-dc3b-4dac-9582-3cbf5ce5bc94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:18.360141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79678de4-dc3b-4dac-9582-3cbf5ce5bc94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:18.361698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79678de4-dc3b-4dac-9582-3cbf5ce5bc94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:18.362846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79678de4-dc3b-4dac-9582-3cbf5ce5bc94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:18.363676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79678de4-dc3b-4dac-9582-3cbf5ce5bc94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:18.364556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79678de4-dc3b-4dac-9582-3cbf5ce5bc94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:18.380337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-964f7ad1-4fa5-437f-b547-801cee49cecd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:18.385002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-964f7ad1-4fa5-437f-b547-801cee49cecd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:18.395210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-964f7ad1-4fa5-437f-b547-801cee49cecd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:18.396874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-964f7ad1-4fa5-437f-b547-801cee49cecd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:18.398369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-964f7ad1-4fa5-437f-b547-801cee49cecd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:18.402323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-964f7ad1-4fa5-437f-b547-801cee49cecd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:18.403085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-964f7ad1-4fa5-437f-b547-801cee49cecd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:18.403532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-964f7ad1-4fa5-437f-b547-801cee49cecd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:18.818560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-964f7ad1-4fa5-437f-b547-801cee49cecd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:18.830172 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-964f7ad1-4fa5-437f-b547-801cee49cecd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.454057 Oct 11 04:23:18.831509 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-79678de4-dc3b-4dac-9582-3cbf5ce5bc94 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7/action" status: 202 len: 0 microversion: 2.1 time: 0.498161 Oct 11 04:23:18.832432 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1590/3053] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:23:18 2022] POST /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7/action => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:23:18.845153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44c5f444-87af-4098-b6fd-529746b81458 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:18.845863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44c5f444-87af-4098-b6fd-529746b81458 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:18.847654 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1464/3054] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:18 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:18.853332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c5f444-87af-4098-b6fd-529746b81458 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:18.854657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c5f444-87af-4098-b6fd-529746b81458 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:18.858313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c5f444-87af-4098-b6fd-529746b81458 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:18.858313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c5f444-87af-4098-b6fd-529746b81458 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:18.858313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c5f444-87af-4098-b6fd-529746b81458 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:18.858313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c5f444-87af-4098-b6fd-529746b81458 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:19.161498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44c5f444-87af-4098-b6fd-529746b81458 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:19.170846 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44c5f444-87af-4098-b6fd-529746b81458 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1506 microversion: 2.1 time: 0.330103 Oct 11 04:23:19.178380 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1591/3055] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:18 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1506 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:19.334150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fff2ce7c-675b-4377-a951-edb279f51919 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:19.334150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fff2ce7c-675b-4377-a951-edb279f51919 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:19.334150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:DELETE=5 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:19.334150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fff2ce7c-675b-4377-a951-edb279f51919 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:19.334150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fff2ce7c-675b-4377-a951-edb279f51919 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:19.334150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fff2ce7c-675b-4377-a951-edb279f51919 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:19.337586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fff2ce7c-675b-4377-a951-edb279f51919 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:19.338122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fff2ce7c-675b-4377-a951-edb279f51919 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:19.341130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fff2ce7c-675b-4377-a951-edb279f51919 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:19.904213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fff2ce7c-675b-4377-a951-edb279f51919 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:19.915744 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fff2ce7c-675b-4377-a951-edb279f51919 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.600528 Oct 11 04:23:19.916871 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1465/3056] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:19 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:19.927987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9aa95c2a-2bea-485a-a3d0-b24cf62b951a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:19.933776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9aa95c2a-2bea-485a-a3d0-b24cf62b951a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:19.947048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aa95c2a-2bea-485a-a3d0-b24cf62b951a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:19.947887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aa95c2a-2bea-485a-a3d0-b24cf62b951a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:19.949623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aa95c2a-2bea-485a-a3d0-b24cf62b951a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:19.952840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aa95c2a-2bea-485a-a3d0-b24cf62b951a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:19.954493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aa95c2a-2bea-485a-a3d0-b24cf62b951a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:19.954924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aa95c2a-2bea-485a-a3d0-b24cf62b951a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:20.045123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-722e2624-5a9b-47fc-bbf6-1a301973f4bd tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda19341a60>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1016187306", "description": "tempest-description-1608912973"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:20.572427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:20.862335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9aa95c2a-2bea-485a-a3d0-b24cf62b951a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:20.875908 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9aa95c2a-2bea-485a-a3d0-b24cf62b951a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.956270 Oct 11 04:23:20.876867 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1466/3057] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:19 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:20.881904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b526172a-257b-41ec-8484-2551608f23d1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:20.882819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b526172a-257b-41ec-8484-2551608f23d1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:20.890793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b526172a-257b-41ec-8484-2551608f23d1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:20.891807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b526172a-257b-41ec-8484-2551608f23d1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:20.892480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b526172a-257b-41ec-8484-2551608f23d1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:20.893406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b526172a-257b-41ec-8484-2551608f23d1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:20.894065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b526172a-257b-41ec-8484-2551608f23d1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:20.894728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b526172a-257b-41ec-8484-2551608f23d1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:21.222712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b526172a-257b-41ec-8484-2551608f23d1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:21.235185 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b526172a-257b-41ec-8484-2551608f23d1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1486 microversion: 2.1 time: 0.357007 Oct 11 04:23:21.235940 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1467/3058] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:20 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1486 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:21.262448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-722e2624-5a9b-47fc-bbf6-1a301973f4bd tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 256 microversion: 2.1 time: 1.766464 Oct 11 04:23:21.264190 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1592/3059] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:23:19 2022] POST /compute/v2.1/os-security-groups => generated 256 bytes in 1769 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:21.269787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d94172a7-13b2-4492-a6ce-e4ae22d8dbbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:21.270565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d94172a7-13b2-4492-a6ce-e4ae22d8dbbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:21.280138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d94172a7-13b2-4492-a6ce-e4ae22d8dbbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:21.281498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d94172a7-13b2-4492-a6ce-e4ae22d8dbbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:21.282227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d94172a7-13b2-4492-a6ce-e4ae22d8dbbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:21.283177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d94172a7-13b2-4492-a6ce-e4ae22d8dbbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:21.284399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d94172a7-13b2-4492-a6ce-e4ae22d8dbbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:21.285094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d94172a7-13b2-4492-a6ce-e4ae22d8dbbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:21.449261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6ddda55b-b76a-474b-b98f-ae4eb1f0485d tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Calling method '.version_select at 0x7fda191d08b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:21.468389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ddda55b-b76a-474b-b98f-ae4eb1f0485d tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:21.473485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ddda55b-b76a-474b-b98f-ae4eb1f0485d tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:21.473930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ddda55b-b76a-474b-b98f-ae4eb1f0485d tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:21.474754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ddda55b-b76a-474b-b98f-ae4eb1f0485d tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:21.475212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ddda55b-b76a-474b-b98f-ae4eb1f0485d tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:21.475633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ddda55b-b76a-474b-b98f-ae4eb1f0485d tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:21.528266 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6ddda55b-b76a-474b-b98f-ae4eb1f0485d tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.268039 Oct 11 04:23:21.529561 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1468/3060] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Oct 11 04:23:21 2022] GET /compute/v2.1/limits => generated 511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:21.535903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5338c46-d75d-4daa-b687-5dd43e0dca3e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:21.536561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d5338c46-d75d-4daa-b687-5dd43e0dca3e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:21.544591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5338c46-d75d-4daa-b687-5dd43e0dca3e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:21.545206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5338c46-d75d-4daa-b687-5dd43e0dca3e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:21.545740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5338c46-d75d-4daa-b687-5dd43e0dca3e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:21.565894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d94172a7-13b2-4492-a6ce-e4ae22d8dbbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:21.571925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5338c46-d75d-4daa-b687-5dd43e0dca3e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:21.572561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5338c46-d75d-4daa-b687-5dd43e0dca3e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:21.573024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5338c46-d75d-4daa-b687-5dd43e0dca3e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:21.592158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:21.630597 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d94172a7-13b2-4492-a6ce-e4ae22d8dbbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1504 microversion: 2.1 time: 0.350980 Oct 11 04:23:21.633925 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1593/3061] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:21 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1504 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:21.644081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d5338c46-d75d-4daa-b687-5dd43e0dca3e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:23:21.651464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-70d6eed3-a2be-46ba-a441-2cd78c626830 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda1df525e0>, body: {"security_group_rule": {"parent_group_id": "912c73bf-7992-448f-a0cd-6c708f9d746c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:22.330177 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d5338c46-d75d-4daa-b687-5dd43e0dca3e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 204 len: 0 microversion: 2.1 time: 0.789893 Oct 11 04:23:22.331639 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1469/3062] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:23:21 2022] DELETE /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 0 bytes in 802 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:23:22.340098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-047453e0-b14a-4539-9c17-84ff9d3beaf7 tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1090339137", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:22.453799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-047453e0-b14a-4539-9c17-84ff9d3beaf7 tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:23:22.808795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-047453e0-b14a-4539-9c17-84ff9d3beaf7 tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Getting quotas for project 41a863a8d4c14365b48e96045d933cc9. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:22.814369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-047453e0-b14a-4539-9c17-84ff9d3beaf7 tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Getting quotas for user a3470153cef949468c8116123a8c94fa and project 41a863a8d4c14365b48e96045d933cc9. Resources: dict_keys(['metadata_items']) {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:22.828832 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-047453e0-b14a-4539-9c17-84ff9d3beaf7 tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] HTTP exception thrown: Maximum number of metadata items exceeds 128 Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-047453e0-b14a-4539-9c17-84ff9d3beaf7 tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Request method failure captured: Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 1752 Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO-4WLGsPB2TwOVouFfIHLWLcr913LS6giUyqECYuuY0cJanVaV8q49O6AmGmcsccMDBIrveTHQyI04UDPcZjaiLnb1_cGlofESTRoChhT8KYj5n2tDsjAEZ6QY4yxt6k6vJdxgJM92AwVoQwUy0K5uzZ9TCQxLdtElsoSYcRqV9O3Q Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 41a863a8d4c14365b48e96045d933cc9 Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AbsoluteLimitsNegativeTestJSON-623741929 Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/41a863a8d4c14365b48e96045d933cc9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_41a863a8d4c14365b48e96045d933cc9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41a863a8d4c14365b48e96045d933cc9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/41a863a8d4c14365b48e96045d933cc9"}]}] Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AbsoluteLimitsNegativeTestJSON-623741929 Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 41a863a8d4c14365b48e96045d933cc9 Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AbsoluteLimitsNegativeTestJSON-623741929 Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AbsoluteLimitsNegativeTestJSON-623741929-project Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a3470153cef949468c8116123a8c94fa Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AbsoluteLimitsNegativeTestJSON-623741929-project Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-AbsoluteLimitsNegativeTestJSON-server-1090339137", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"0": "0", "1": "1", "2": "2", "3": "3", "4": "4", "5": "5", "6": "6", "7": "7", "8": "8", "9": "9", "10": "10", "11": "11", "12": "12", "13": "13", "14": "14", "15": "15", "16": "16", "17": "17", "18": "18", "19": "19", "20": "20", "21": "21", "22": "22", "23": "23", "24": "24", "25": "25", "26": "26", "27": "27", "28": "28", "29": "29", "30": "30", "31": "31", "32": "32", "33": "33", "34": "34", "35": "35", "36": "36", "37": "37", "38": "38", "39": "39", "40": "40", "41": "41", "42": "42", "43": "43", "44": "44", "45": "45", "46": "46", "47": "47", "48": "48", "49": "49", "50": "50", "51": "51", "52": "52", "53": "53", "54": "54", "55": "55", "56": "56", "57": "57", "58": "58", "59": "59", "60": "60", "61": "61", "62": "62", "63": "63", "64": "64", "65": "65", "66": "66", "67": "67", "68": "68", "69": "69", "70": "70", "71": "71", "72": "72", "73": "73", "74": "74", "75": "75", "76": "76", "77": "77", "78": "78", "79": "79", "80": "80", "81": "81", "82": "82", "83": "83", "84": "84", "85": "85", "86": "86", "87": "87", "88": "88", "89": "89", "90": "90", "91": "91", "92": "92", "93": "93", "94": "94", "95": "95", "96": "96", "97": "97", "98": "98", "99": "99", "100": "100", "101": "101", "102": "102", "103": "103", "104": "104", "105": "105", "106": "106", "107": "107", "108": "108", "109": "109", "110": "110", "111": "111", "112": "112", "113": "113", "114": "114", "115": "115", "116": "116", "117": "117", "118": "118", "119": "119", "120": "120", "121": "121", "122": "122", "123": "123", "124": "124", "125": "125", "126": "126", "127": "127", "128": "128"}}} Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:23:22.848594 n-d-860892-1 devstack@n-api.service[120993]: exception: Maximum number of metadata items exceeds 128 Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-AbsoluteLimitsNegativeTestJSON-server-1090339137', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'metadata': {'0': '0', '1': '1', '2': '2', '3': '3', '4': '4', '5': '5', '6': '6', '7': '7', '8': '8', '9': '9', '10': '10', '11': '11', '12': '12', '13': '13', '14': '14', '15': '15', '16': '16', '17': '17', '18': '18', '19': '19', '20': '20', '21': '21', '22': '22', '23': '23', '24': '24', '25': '25', '26': '26', '27': '27', '28': '28', '29': '29', '30': '30', '31': '31', '32': '32', '33': '33', '34': '34', '35': '35', '36': '36', '37': '37', '38': '38', '39': '39', '40': '40', '41': '41', '42': '42', '43': '43', '44': '44', '45': '45', '46': '46', '47': '47', '48': '48', '49': '49', '50': '50', '51': '51', '52': '52', '53': '53', '54': '54', '55': '55', '56': '56', '57': '57', '58': '58', '59': '59', '60': '60', '61': '61', '62': '62', '63': '63', '64': '64', '65': '65', '66': '66', '67': '67', '68': '68', '69': '69', '70': '70', '71': '71', '72': '72', '73': '73', '74': '74', '75': '75', '76': '76', '77': '77', '78': '78', '79': '79', '80': '80', '81': '81', '82': '82', '83': '83', '84': '84', '85': '85', '86': '86', '87': '87', '88': '88', '89': '89', '90': '90', '91': '91', '92': '92', '93': '93', '94': '94', '95': '95', '96': '96', '97': '97', '98': '98', '99': '99', '100': '100', '101': '101', '102': '102', '103': '103', '104': '104', '105': '105', '106': '106', '107': '107', '108': '108', '109': '109', '110': '110', '111': '111', '112': '112', '113': '113', '114': '114', '115': '115', '116': '116', '117': '117', '118': '118', '119': '119', '120': '120', '121': '121', '122': '122', '123': '123', '124': '124', '125': '125', '126': '126', '127': '127', '128': '128'}}}} Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 476, in _check_metadata_properties_quota Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi objects.Quotas.limit_check(context, metadata_items=num_metadata) Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 290, in limit_check Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check( Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1118, in limit_check Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._driver.limit_check(context, self._resources, values, Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 468, in limit_check Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), quotas=quotas, Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['metadata_items'] Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1724, in _create_instance Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._checks_for_create_and_rebuild(context, image_id, boot_meta, Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1016, in _checks_for_create_and_rebuild Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._check_metadata_properties_quota(context, metadata) Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 483, in _check_metadata_properties_quota Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.MetadataLimitExceeded(allowed=quota_metadata) Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.MetadataLimitExceeded: Maximum number of metadata items exceeds 128 Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:23:22.851150 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Maximum number of metadata items exceeds 128 Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Maximum number of metadata items exceeds 128 Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-047453e0-b14a-4539-9c17-84ff9d3beaf7 tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] Returning 403 to user: Maximum number of metadata items exceeds 128 {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-047453e0-b14a-4539-9c17-84ff9d3beaf7 tempest-AbsoluteLimitsNegativeTestJSON-623741929 tempest-AbsoluteLimitsNegativeTestJSON-623741929-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 87 microversion: 2.1 time: 0.516700 Oct 11 04:23:22.854450 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1470/3063] 10.222.0.26 () {60 vars in 1148 bytes} [Tue Oct 11 04:23:22 2022] POST /compute/v2.1/servers => generated 87 bytes in 518 msecs (HTTP/1.1 403) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:23:22.864229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6160c491-9f05-41d1-8b67-fe5e2a3b2516 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:22.868351 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-70d6eed3-a2be-46ba-a441-2cd78c626830 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 200 len: 232 microversion: 2.1 time: 1.233028 Oct 11 04:23:22.881627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6160c491-9f05-41d1-8b67-fe5e2a3b2516 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:22.881778 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1594/3064] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:23:21 2022] POST /compute/v2.1/os-security-group-rules => generated 232 bytes in 1237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:22.884000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6160c491-9f05-41d1-8b67-fe5e2a3b2516 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:22.884913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6160c491-9f05-41d1-8b67-fe5e2a3b2516 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:22.885334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2658ade9-00ec-489f-8020-0b7497644965 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:22.885718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6160c491-9f05-41d1-8b67-fe5e2a3b2516 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:22.886094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2658ade9-00ec-489f-8020-0b7497644965 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:22.886482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6160c491-9f05-41d1-8b67-fe5e2a3b2516 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:22.887159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6160c491-9f05-41d1-8b67-fe5e2a3b2516 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:22.887800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6160c491-9f05-41d1-8b67-fe5e2a3b2516 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:22.893771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2658ade9-00ec-489f-8020-0b7497644965 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:22.894570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2658ade9-00ec-489f-8020-0b7497644965 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:22.895089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2658ade9-00ec-489f-8020-0b7497644965 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:22.895982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2658ade9-00ec-489f-8020-0b7497644965 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:22.896656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2658ade9-00ec-489f-8020-0b7497644965 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:22.897212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2658ade9-00ec-489f-8020-0b7497644965 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:23.123061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6160c491-9f05-41d1-8b67-fe5e2a3b2516 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:23.138995 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6160c491-9f05-41d1-8b67-fe5e2a3b2516 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.286922 Oct 11 04:23:23.144090 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1471/3065] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:22 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:23.144538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb8194a4-21fa-411e-be6d-a98ddb76a553 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:23.145319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cb8194a4-21fa-411e-be6d-a98ddb76a553 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:23.156025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8194a4-21fa-411e-be6d-a98ddb76a553 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:23.156827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8194a4-21fa-411e-be6d-a98ddb76a553 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:23.157623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8194a4-21fa-411e-be6d-a98ddb76a553 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:23.158536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8194a4-21fa-411e-be6d-a98ddb76a553 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:23.159158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8194a4-21fa-411e-be6d-a98ddb76a553 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:23.159741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb8194a4-21fa-411e-be6d-a98ddb76a553 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:23.241619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2658ade9-00ec-489f-8020-0b7497644965 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:23.248329 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2658ade9-00ec-489f-8020-0b7497644965 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1492 microversion: 2.1 time: 0.375215 Oct 11 04:23:23.248927 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1595/3066] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:22 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1492 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:23.256173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1546a5b8-c397-477e-9180-5102cbca4ac6 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda193c5af0>, body: {"security_group_rule": {"parent_group_id": "912c73bf-7992-448f-a0cd-6c708f9d746c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:23.366475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb8194a4-21fa-411e-be6d-a98ddb76a553 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:23.377699 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cb8194a4-21fa-411e-be6d-a98ddb76a553 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1479 microversion: 2.1 time: 0.236797 Oct 11 04:23:23.378508 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1472/3067] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:23 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1479 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:23.400823 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-1546a5b8-c397-477e-9180-5102cbca4ac6 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] HTTP exception thrown: This rule already exists in group 912c73bf-7992-448f-a0cd-6c708f9d746c Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1546a5b8-c397-477e-9180-5102cbca4ac6 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Request method failure captured: Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 138 Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO-3PzK0FeepP1fWi27MQyx7Iasx9anrtNPDfBSisEVQGGvT7m1r9zsL90fyFf81D8qIex1Y6TY9kkg5Pf9LFJQRjuTqqkdaEmWcR3vZBG6CVGFwdNAqpVcvVJZEwIF2wySWqMtocqyGfyHjb69n4l5CDCk13vAF1odIVa8ybGWpkgQ Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}] Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 95b5d326c4274a0ebd222a59b21d336c Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: {"security_group_rule": {"parent_group_id": "912c73bf-7992-448f-a0cd-6c708f9d746c", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: exception: This rule already exists in group 912c73bf-7992-448f-a0cd-6c708f9d746c Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'security_group_rule': {'parent_group_id': '912c73bf-7992-448f-a0cd-6c708f9d746c', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 324, in create Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi security_group_api.create_security_group_rule( Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 186, in create_security_group_rule Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: This rule already exists in group 912c73bf-7992-448f-a0cd-6c708f9d746c Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 327, in create Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: This rule already exists in group 912c73bf-7992-448f-a0cd-6c708f9d746c Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:23.405479 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:23.410059 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:23:23.410059 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:23:23.410059 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: This rule already exists in group 912c73bf-7992-448f-a0cd-6c708f9d746c Oct 11 04:23:23.410059 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:23.413133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6c35fae6-9709-4ccc-b462-bc56eef7bff9 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '.version_select at 0x7fda19ab83a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:23.414165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1546a5b8-c397-477e-9180-5102cbca4ac6 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Returning 400 to user: This rule already exists in group 912c73bf-7992-448f-a0cd-6c708f9d746c {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:23:23.415078 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1546a5b8-c397-477e-9180-5102cbca4ac6 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 114 microversion: 2.1 time: 0.164337 Oct 11 04:23:23.415675 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1596/3068] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:23:23 2022] POST /compute/v2.1/os-security-group-rules => generated 114 bytes in 166 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:23:23.420405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c35fae6-9709-4ccc-b462-bc56eef7bff9 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:23.420930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c35fae6-9709-4ccc-b462-bc56eef7bff9 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:23.421377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c35fae6-9709-4ccc-b462-bc56eef7bff9 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:23.431664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-16b80b8a-3f1b-4ab6-b514-270d11c86d99 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Calling method '.version_select at 0x7fda193163a0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:23.451459 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6c35fae6-9709-4ccc-b462-bc56eef7bff9 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 783 microversion: 2.1 time: 0.052980 Oct 11 04:23:23.452417 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1473/3069] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:23:23 2022] GET /compute/v2.1/os-migrations => generated 783 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:23.468671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4248274e-3f65-48b1-99ee-1821e3554264 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:23.468671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4248274e-3f65-48b1-99ee-1821e3554264 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:23.476921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4248274e-3f65-48b1-99ee-1821e3554264 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:23.477962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4248274e-3f65-48b1-99ee-1821e3554264 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:23.478607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4248274e-3f65-48b1-99ee-1821e3554264 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:23.480091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4248274e-3f65-48b1-99ee-1821e3554264 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:23.480710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4248274e-3f65-48b1-99ee-1821e3554264 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:23.481297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4248274e-3f65-48b1-99ee-1821e3554264 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:23.710627 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4248274e-3f65-48b1-99ee-1821e3554264 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1630 microversion: 2.1 time: 0.247246 Oct 11 04:23:23.711816 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1474/3070] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:23 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1630 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:23.741147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=24 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:23.748747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a65dcc27-8f68-4bb9-ad87-19cded2e7212 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Action: 'create', calling method: .version_select at 0x7fda19ab8ee0>, body: {"keypair": {"name": "tempest-keypair-1862756183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAXB7NdAzmWWUbHmYnmV4iaIQxe/V38jxbLa5MehXiZtx0aYhnP86VKFLMLJgHfi+kErkDTjILn1okaX9duqCE/1oNtRBkGGzs+Dj06kfbINoAcVfkXTxQBSkY6gUJOjaA=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:23.808454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a65dcc27-8f68-4bb9-ad87-19cded2e7212 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Getting quotas for project 15b90becc5a545f0965359b05561721f. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:23.824214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a65dcc27-8f68-4bb9-ad87-19cded2e7212 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Getting quotas for user ea114683a3754c8197b61fc5ef04fe0d and project 15b90becc5a545f0965359b05561721f. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:24.010750 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a65dcc27-8f68-4bb9-ad87-19cded2e7212 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.267349 Oct 11 04:23:24.013531 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1475/3071] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:23:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:23:24.177196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ccc0067a-faa5-412a-84fa-86c828903c32 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:24.177661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ccc0067a-faa5-412a-84fa-86c828903c32 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:24.195213 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-16b80b8a-3f1b-4ab6-b514-270d11c86d99 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/56a765de-fa47-414c-9f41-e82df2dd0533" status: 202 len: 0 microversion: 2.1 time: 0.771835 Oct 11 04:23:24.196205 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1597/3072] 10.222.0.26 () {58 vars in 1287 bytes} [Tue Oct 11 04:23:23 2022] DELETE /compute/v2.1/os-security-group-rules/56a765de-fa47-414c-9f41-e82df2dd0533 => generated 0 bytes in 773 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:23:24.200286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccc0067a-faa5-412a-84fa-86c828903c32 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:24.204520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccc0067a-faa5-412a-84fa-86c828903c32 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:24.205124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8ccaf6eb-e929-4f4f-a7a0-b8ce829ec891 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda192e3940>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-629131196", "description": "tempest-description-375999616"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:24.206503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccc0067a-faa5-412a-84fa-86c828903c32 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:24.210321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccc0067a-faa5-412a-84fa-86c828903c32 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:24.210826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccc0067a-faa5-412a-84fa-86c828903c32 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:24.211275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccc0067a-faa5-412a-84fa-86c828903c32 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:24.770492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ccc0067a-faa5-412a-84fa-86c828903c32 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:24.784620 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ccc0067a-faa5-412a-84fa-86c828903c32 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.618892 Oct 11 04:23:24.785426 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1476/3073] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:24 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:24.807532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4281ecd8-23dc-42a0-955b-ea012133695a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:24.819209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4281ecd8-23dc-42a0-955b-ea012133695a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:24.828844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4281ecd8-23dc-42a0-955b-ea012133695a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:24.829557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4281ecd8-23dc-42a0-955b-ea012133695a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:24.830213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4281ecd8-23dc-42a0-955b-ea012133695a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:24.831145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4281ecd8-23dc-42a0-955b-ea012133695a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:24.832125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4281ecd8-23dc-42a0-955b-ea012133695a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:24.832782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4281ecd8-23dc-42a0-955b-ea012133695a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:24.946656 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8ccaf6eb-e929-4f4f-a7a0-b8ce829ec891 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 254 microversion: 2.1 time: 0.744720 Oct 11 04:23:24.947154 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1598/3074] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:23:24 2022] POST /compute/v2.1/os-security-groups => generated 254 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:24.961293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c21a4ffe-8808-4d3b-8c0a-8679c0579032 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda19316940>, body: {"security_group_rule": {"parent_group_id": "22c99374-53db-4a22-8fbe-71fc8c66f250", "ip_protocol": "tcp", "from_port": 798343062, "to_port": 22}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:25.066125 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-c21a4ffe-8808-4d3b-8c0a-8679c0579032 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] HTTP exception thrown: Invalid port range 798343062:22. Former value cannot be greater than the later Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c21a4ffe-8808-4d3b-8c0a-8679c0579032 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Request method failure captured: Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 145 Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO-3PzK0FeepP1fWi27MQyx7Iasx9anrtNPDfBSisEVQGGvT7m1r9zsL90fyFf81D8qIex1Y6TY9kkg5Pf9LFJQRjuTqqkdaEmWcR3vZBG6CVGFwdNAqpVcvVJZEwIF2wySWqMtocqyGfyHjb69n4l5CDCk13vAF1odIVa8ybGWpkgQ Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}] Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 95b5d326c4274a0ebd222a59b21d336c Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: {"security_group_rule": {"parent_group_id": "22c99374-53db-4a22-8fbe-71fc8c66f250", "ip_protocol": "tcp", "from_port": 798343062, "to_port": 22}} Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid port range 798343062:22. Former value cannot be greater than the later Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'security_group_rule': {'parent_group_id': '22c99374-53db-4a22-8fbe-71fc8c66f250', 'ip_protocol': 'tcp', 'from_port': 798343062, 'to_port': 22}}} Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 798343062:22. Former value cannot be greater than the later Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 798343062:22. Former value cannot be greater than the later Oct 11 04:23:25.067695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:25.072198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:25.072198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:25.072198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:25.072198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:25.072198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:25.072198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:23:25.072198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:23:25.072198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 798343062:22. Former value cannot be greater than the later Oct 11 04:23:25.072198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:25.074226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c21a4ffe-8808-4d3b-8c0a-8679c0579032 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Returning 400 to user: Invalid port range 798343062:22. Former value cannot be greater than the later {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:23:25.080258 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c21a4ffe-8808-4d3b-8c0a-8679c0579032 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 122 microversion: 2.1 time: 0.118086 Oct 11 04:23:25.080258 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1599/3075] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:23:24 2022] POST /compute/v2.1/os-security-group-rules => generated 122 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:23:25.085554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab6c1085-3e6b-44e2-b11e-c455bbf8ecc1 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda192679d0>, body: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-460241279", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:25.092929 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ab6c1085-3e6b-44e2-b11e-c455bbf8ecc1 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] HTTP exception thrown: Security group id should be uuid Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab6c1085-3e6b-44e2-b11e-c455bbf8ecc1 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Request method failure captured: Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 130 Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO-3PzK0FeepP1fWi27MQyx7Iasx9anrtNPDfBSisEVQGGvT7m1r9zsL90fyFf81D8qIex1Y6TY9kkg5Pf9LFJQRjuTqqkdaEmWcR3vZBG6CVGFwdNAqpVcvVJZEwIF2wySWqMtocqyGfyHjb69n4l5CDCk13vAF1odIVa8ybGWpkgQ Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}] Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 95b5d326c4274a0ebd222a59b21d336c Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: {"security_group_rule": {"parent_group_id": "tempest-non_int_id-460241279", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: exception: Security group id should be uuid Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'tempest-non_int_id-460241279', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 285, in create Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi parent_group_id = security_group_api.validate_id( Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 51, in validate_id Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.Invalid(msg) Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security group id should be uuid Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security group id should be uuid Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:23:25.097676 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:23:25.101687 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group id should be uuid Oct 11 04:23:25.101687 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:25.107889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab6c1085-3e6b-44e2-b11e-c455bbf8ecc1 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Returning 400 to user: Security group id should be uuid {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:23:25.109021 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab6c1085-3e6b-44e2-b11e-c455bbf8ecc1 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 76 microversion: 2.1 time: 0.027361 Oct 11 04:23:25.110146 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1600/3076] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:23:25 2022] POST /compute/v2.1/os-security-group-rules => generated 76 bytes in 29 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 11 04:23:25.131306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-05b9c283-36a2-4ac3-9d00-5db4823ee220 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda19383e50>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-936359839", "description": "tempest-description-1886628012"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:25.331054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4281ecd8-23dc-42a0-955b-ea012133695a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:25.339924 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4281ecd8-23dc-42a0-955b-ea012133695a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1492 microversion: 2.1 time: 0.538449 Oct 11 04:23:25.341159 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1477/3077] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:24 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1492 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:25.575815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a66b007e-4256-4906-9ddf-3b7c0ba0cb85 req-7b096edd-bd3d-4048-95b4-03f3658fc3ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7", "name": "network-vif-deleted", "tag": "e4245ebf-4f68-4188-ac3d-3c00b2f56dd2"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:25.601589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a66b007e-4256-4906-9ddf-3b7c0ba0cb85 req-7b096edd-bd3d-4048-95b4-03f3658fc3ca service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:25.606775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a66b007e-4256-4906-9ddf-3b7c0ba0cb85 req-7b096edd-bd3d-4048-95b4-03f3658fc3ca service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:25.607338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a66b007e-4256-4906-9ddf-3b7c0ba0cb85 req-7b096edd-bd3d-4048-95b4-03f3658fc3ca service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:25.627669 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a66b007e-4256-4906-9ddf-3b7c0ba0cb85 req-7b096edd-bd3d-4048-95b4-03f3658fc3ca service nova] Creating event network-vif-deleted:e4245ebf-4f68-4188-ac3d-3c00b2f56dd2 for instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 on n-h2-860892-1 Oct 11 04:23:25.635262 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a66b007e-4256-4906-9ddf-3b7c0ba0cb85 req-7b096edd-bd3d-4048-95b4-03f3658fc3ca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065258 Oct 11 04:23:25.636364 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1478/3078] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:23:25.815578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d71bf7ff-0ef4-4768-9312-b014fac5e86b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:25.816310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d71bf7ff-0ef4-4768-9312-b014fac5e86b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:25.834568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71bf7ff-0ef4-4768-9312-b014fac5e86b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:25.840064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71bf7ff-0ef4-4768-9312-b014fac5e86b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:25.841746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71bf7ff-0ef4-4768-9312-b014fac5e86b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:25.844780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71bf7ff-0ef4-4768-9312-b014fac5e86b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:25.848773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71bf7ff-0ef4-4768-9312-b014fac5e86b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:25.874810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d71bf7ff-0ef4-4768-9312-b014fac5e86b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:25.962291 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-05b9c283-36a2-4ac3-9d00-5db4823ee220 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.836515 Oct 11 04:23:25.963475 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1601/3079] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:23:25 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:25.983463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f15f534b-2b69-44a7-9193-9a861a7db0e4 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda1a31df70>, body: {"security_group_rule": {"parent_group_id": "34c896f7-4e10-46a1-86ce-9c72aef63178", "ip_protocol": "tempest-999-1514512932", "from_port": 22, "to_port": 22}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:26.189078 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-f15f534b-2b69-44a7-9193-9a861a7db0e4 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] HTTP exception thrown: Invalid IP protocol tempest-999-1514512932. Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f15f534b-2b69-44a7-9193-9a861a7db0e4 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Request method failure captured: Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 157 Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO-3PzK0FeepP1fWi27MQyx7Iasx9anrtNPDfBSisEVQGGvT7m1r9zsL90fyFf81D8qIex1Y6TY9kkg5Pf9LFJQRjuTqqkdaEmWcR3vZBG6CVGFwdNAqpVcvVJZEwIF2wySWqMtocqyGfyHjb69n4l5CDCk13vAF1odIVa8ybGWpkgQ Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}] Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 95b5d326c4274a0ebd222a59b21d336c Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: {"security_group_rule": {"parent_group_id": "34c896f7-4e10-46a1-86ce-9c72aef63178", "ip_protocol": "tempest-999-1514512932", "from_port": 22, "to_port": 22}} Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid IP protocol tempest-999-1514512932. Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'security_group_rule': {'parent_group_id': '34c896f7-4e10-46a1-86ce-9c72aef63178', 'ip_protocol': 'tempest-999-1514512932', 'from_port': 22, 'to_port': 22}}} Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 144, in _new_ingress_rule Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InvalidIpProtocol(protocol=ip_protocol) Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidIpProtocol: Invalid IP protocol tempest-999-1514512932. Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid IP protocol tempest-999-1514512932. Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:26.194049 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:26.199935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:26.199935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:26.199935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:26.199935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:26.199935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:23:26.199935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:23:26.199935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid IP protocol tempest-999-1514512932. Oct 11 04:23:26.199935 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:26.202719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f15f534b-2b69-44a7-9193-9a861a7db0e4 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Returning 400 to user: Invalid IP protocol tempest-999-1514512932. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:23:26.203769 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f15f534b-2b69-44a7-9193-9a861a7db0e4 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 87 microversion: 2.1 time: 0.227311 Oct 11 04:23:26.204514 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1602/3080] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:23:25 2022] POST /compute/v2.1/os-security-group-rules => generated 87 bytes in 229 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:23:26.219503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-29cd0d58-5769-4a15-89fb-e6c6a76674f4 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda192ac550>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-551757116", "description": "tempest-description-1524991380"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:26.347487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d71bf7ff-0ef4-4768-9312-b014fac5e86b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:26.362407 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d71bf7ff-0ef4-4768-9312-b014fac5e86b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.550127 Oct 11 04:23:26.365644 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1479/3081] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:25 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:26.382866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:26.383819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:26.399734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:26.400506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:26.413761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:26.419143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:26.419861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:26.420175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:26.482823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:26.483764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:26.484920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:26.486229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lazy-loading 'fault' on Instance uuid 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:23:26.625749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:26.642249 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-66fd6756-49bb-458b-b409-ebadd0ec753e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 200 len: 1304 microversion: 2.1 time: 0.266389 Oct 11 04:23:26.642918 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1480/3082] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:26 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 1304 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:26.933123 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-29cd0d58-5769-4a15-89fb-e6c6a76674f4 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.723156 Oct 11 04:23:26.934912 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1603/3083] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:23:26 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:26.949905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-422f458e-519b-4e91-9367-38933689e207 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda191d0b80>, body: {"security_group_rule": {"parent_group_id": "14187878-e490-4787-8049-21f581338892", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:27.216979 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-422f458e-519b-4e91-9367-38933689e207 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] HTTP exception thrown: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-422f458e-519b-4e91-9367-38933689e207 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Request method failure captured: Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 138 Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO-3PzK0FeepP1fWi27MQyx7Iasx9anrtNPDfBSisEVQGGvT7m1r9zsL90fyFf81D8qIex1Y6TY9kkg5Pf9LFJQRjuTqqkdaEmWcR3vZBG6CVGFwdNAqpVcvVJZEwIF2wySWqMtocqyGfyHjb69n4l5CDCk13vAF1odIVa8ybGWpkgQ Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}] Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 95b5d326c4274a0ebd222a59b21d336c Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: {"security_group_rule": {"parent_group_id": "14187878-e490-4787-8049-21f581338892", "ip_protocol": "tcp", "from_port": 22, "to_port": 21}} Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'security_group_rule': {'parent_group_id': '14187878-e490-4787-8049-21f581338892', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 21}}} Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 150, in _new_ingress_rule Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 04:23:27.219371 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:21. Former value cannot be greater than the later Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-422f458e-519b-4e91-9367-38933689e207 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Returning 400 to user: Invalid port range 22:21. Former value cannot be greater than the later {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-422f458e-519b-4e91-9367-38933689e207 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 115 microversion: 2.1 time: 0.277055 Oct 11 04:23:27.231355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1481/3084] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:23:26 2022] POST /compute/v2.1/os-security-group-rules => generated 115 bytes in 278 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:23:27.232597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-37c909ef-0363-4f14-b6f4-9ae808b5a866 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda19316820>, body: {"security_group": {"name": "tempest-SecurityGroupRulesNegativeTestJSON-securitygroup-1297550507", "description": "tempest-description-266213496"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:27.403100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c130b3c9-42e5-4c0f-b781-95cd80ad05ec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:27.403100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c130b3c9-42e5-4c0f-b781-95cd80ad05ec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:27.409142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c130b3c9-42e5-4c0f-b781-95cd80ad05ec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:27.409636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c130b3c9-42e5-4c0f-b781-95cd80ad05ec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:27.410068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c130b3c9-42e5-4c0f-b781-95cd80ad05ec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:27.419771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c130b3c9-42e5-4c0f-b781-95cd80ad05ec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:27.420250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c130b3c9-42e5-4c0f-b781-95cd80ad05ec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:27.422740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c130b3c9-42e5-4c0f-b781-95cd80ad05ec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:27.808794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c130b3c9-42e5-4c0f-b781-95cd80ad05ec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:27.821378 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c130b3c9-42e5-4c0f-b781-95cd80ad05ec tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.432586 Oct 11 04:23:27.841519 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1482/3085] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:27 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:27.841519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:27.841519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:27.859617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:27.860382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:27.860994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:27.861862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:27.866234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:27.866896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:27.902156 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 HTTP/1.1 Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7'} Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:27.910078 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:27.914087 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:27.914087 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:27.914087 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:27.914087 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:23:27.914087 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:23:27.914087 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:23:27.914087 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:23:27.916824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:23:27.917950 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cb077b55-0e21-462a-b6d6-af6da2c73b79 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 404 len: 111 microversion: 2.1 time: 0.086893 Oct 11 04:23:27.919134 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1483/3086] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:27 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:23:28.138178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1755953717", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "eb00258c-33f3-4e50-9b19-bfa956507201"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:28.190166 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-37c909ef-0363-4f14-b6f4-9ae808b5a866 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 255 microversion: 2.1 time: 0.963284 Oct 11 04:23:28.191177 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1604/3087] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:23:27 2022] POST /compute/v2.1/os-security-groups => generated 255 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:28.205018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80124908-2666-409c-8205-69b3ebe77f3e tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda192ac4c0>, body: {"security_group_rule": {"parent_group_id": "8bbf5179-d96a-4c73-95b3-52807dc348e6", "ip_protocol": "tcp", "from_port": 22, "to_port": 1359498482}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:28.292388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] validate_networks() for [('eb00258c-33f3-4e50-9b19-bfa956507201', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:23:28.311672 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-80124908-2666-409c-8205-69b3ebe77f3e tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] HTTP exception thrown: Invalid port range 22:1359498482. Valid TCP ports should be between 1-65535 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80124908-2666-409c-8205-69b3ebe77f3e tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Request method failure captured: Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 146 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO-3PzK0FeepP1fWi27MQyx7Iasx9anrtNPDfBSisEVQGGvT7m1r9zsL90fyFf81D8qIex1Y6TY9kkg5Pf9LFJQRjuTqqkdaEmWcR3vZBG6CVGFwdNAqpVcvVJZEwIF2wySWqMtocqyGfyHjb69n4l5CDCk13vAF1odIVa8ybGWpkgQ Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}] Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 95b5d326c4274a0ebd222a59b21d336c Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: {"security_group_rule": {"parent_group_id": "8bbf5179-d96a-4c73-95b3-52807dc348e6", "ip_protocol": "tcp", "from_port": 22, "to_port": 1359498482}} Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid port range 22:1359498482. Valid TCP ports should be between 1-65535 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'security_group_rule': {'parent_group_id': '8bbf5179-d96a-4c73-95b3-52807dc348e6', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 1359498482}}} Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 294, in create Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi new_rule = self._rule_args_to_dict(context, Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 346, in _rule_args_to_dict Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return security_group_api.new_cidr_ingress_rule( Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 103, in new_cidr_ingress_rule Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return _new_ingress_rule( Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 157, in _new_ingress_rule Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InvalidPortRange(from_port=from_port, Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidPortRange: Invalid port range 22:1359498482. Valid TCP ports should be between 1-65535 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 301, in create Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid port range 22:1359498482. Valid TCP ports should be between 1-65535 Oct 11 04:23:28.313245 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.317180 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:28.317180 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.317180 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:28.317180 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:28.317180 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:28.317180 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:23:28.317180 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:23:28.317180 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid port range 22:1359498482. Valid TCP ports should be between 1-65535 Oct 11 04:23:28.317180 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.317180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80124908-2666-409c-8205-69b3ebe77f3e tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Returning 400 to user: Invalid port range 22:1359498482. Valid TCP ports should be between 1-65535 {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:23:28.319999 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-80124908-2666-409c-8205-69b3ebe77f3e tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 400 len: 119 microversion: 2.1 time: 0.119443 Oct 11 04:23:28.322934 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1605/3088] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:23:28 2022] POST /compute/v2.1/os-security-group-rules => generated 119 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:23:28.371087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f4848087-62c4-4dc3-8c84-857f6932e370 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Action: 'create', calling method: .version_select at 0x7fda192ac790>, body: {"security_group_rule": {"parent_group_id": "ba4eb0a3-b52a-4522-bdc3-db646f8a708e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:28.456253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG neutronclient.v2_0.client [None req-f4848087-62c4-4dc3-8c84-857f6932e370 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group ba4eb0a3-b52a-4522-bdc3-db646f8a708e does not exist", "detail": ""}} {{(pid=120994) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:23:28.457108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.security_group_api [None req-f4848087-62c4-4dc3-8c84-857f6932e370 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Neutron security group ba4eb0a3-b52a-4522-bdc3-db646f8a708e not found {{(pid=120994) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:23:28.457909 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-f4848087-62c4-4dc3-8c84-857f6932e370 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] HTTP exception thrown: Security group ba4eb0a3-b52a-4522-bdc3-db646f8a708e does not exist Oct 11 04:23:28.457909 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-6a201f62-5364-4737-907f-59d38a261b1d'] Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f4848087-62c4-4dc3-8c84-857f6932e370 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Request method failure captured: Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/os-security-group-rules HTTP/1.1 Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 138 Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO-3PzK0FeepP1fWi27MQyx7Iasx9anrtNPDfBSisEVQGGvT7m1r9zsL90fyFf81D8qIex1Y6TY9kkg5Pf9LFJQRjuTqqkdaEmWcR3vZBG6CVGFwdNAqpVcvVJZEwIF2wySWqMtocqyGfyHjb69n4l5CDCk13vAF1odIVa8ybGWpkgQ Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}] Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 95b5d326c4274a0ebd222a59b21d336c Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: {"security_group_rule": {"parent_group_id": "ba4eb0a3-b52a-4522-bdc3-db646f8a708e", "ip_protocol": "tcp", "from_port": 22, "to_port": 22}} Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: exception: Security group ba4eb0a3-b52a-4522-bdc3-db646f8a708e does not exist Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-6a201f62-5364-4737-907f-59d38a261b1d'] Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'security_group_rule': {'parent_group_id': 'ba4eb0a3-b52a-4522-bdc3-db646f8a708e', 'ip_protocol': 'tcp', 'from_port': 22, 'to_port': 22}}} Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:23:28.460224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group ba4eb0a3-b52a-4522-bdc3-db646f8a708e does not exist Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a201f62-5364-4737-907f-59d38a261b1d'] Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 287, in create Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get( Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group ba4eb0a3-b52a-4522-bdc3-db646f8a708e does not exist Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a201f62-5364-4737-907f-59d38a261b1d'] Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 303, in create Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group ba4eb0a3-b52a-4522-bdc3-db646f8a708e does not exist Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a201f62-5364-4737-907f-59d38a261b1d'] Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group ba4eb0a3-b52a-4522-bdc3-db646f8a708e does not exist Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-6a201f62-5364-4737-907f-59d38a261b1d'] Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f4848087-62c4-4dc3-8c84-857f6932e370 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Returning 404 to user: Security group ba4eb0a3-b52a-4522-bdc3-db646f8a708e does not exist Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-6a201f62-5364-4737-907f-59d38a261b1d'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f4848087-62c4-4dc3-8c84-857f6932e370 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "POST /compute/v2.1/os-security-group-rules" status: 404 len: 194 microversion: 2.1 time: 0.135115 Oct 11 04:23:28.466265 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1606/3089] 10.222.0.26 () {60 vars in 1195 bytes} [Tue Oct 11 04:23:28 2022] POST /compute/v2.1/os-security-group-rules => generated 194 bytes in 137 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:23:28.488316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72e9c6c2-55d5-43a0-a41f-834d2f633c7b tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Calling method '.version_select at 0x7fda19316670>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:28.525241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG neutronclient.v2_0.client [None req-72e9c6c2-55d5-43a0-a41f-834d2f633c7b tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Error message: {"NeutronError": {"type": "SecurityGroupRuleNotFound", "message": "Security group rule d2fae3c1-84cb-428f-baca-f6ac6286f7fe does not exist", "detail": ""}} {{(pid=120994) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:23:28.526538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.security_group_api [None req-72e9c6c2-55d5-43a0-a41f-834d2f633c7b tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Neutron security group rule d2fae3c1-84cb-428f-baca-f6ac6286f7fe not found {{(pid=120994) get_rule /opt/stack/nova/nova/network/security_group_api.py:463}} Oct 11 04:23:28.529890 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-72e9c6c2-55d5-43a0-a41f-834d2f633c7b tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] HTTP exception thrown: Security group rule d2fae3c1-84cb-428f-baca-f6ac6286f7fe does not exist Oct 11 04:23:28.529890 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-86590e6f-31e5-4cfa-baa9-e57f36b97b46'] Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72e9c6c2-55d5-43a0-a41f-834d2f633c7b tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Request method failure captured: Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-security-group-rules/d2fae3c1-84cb-428f-baca-f6ac6286f7fe HTTP/1.1 Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO-3PzK0FeepP1fWi27MQyx7Iasx9anrtNPDfBSisEVQGGvT7m1r9zsL90fyFf81D8qIex1Y6TY9kkg5Pf9LFJQRjuTqqkdaEmWcR3vZBG6CVGFwdNAqpVcvVJZEwIF2wySWqMtocqyGfyHjb69n4l5CDCk13vAF1odIVa8ybGWpkgQ Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5301c43d108f4e4cadcf9b4f5dc2a295"}]}] Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5301c43d108f4e4cadcf9b4f5dc2a295 Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404 Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 95b5d326c4274a0ebd222a59b21d336c Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: exception: Security group rule d2fae3c1-84cb-428f-baca-f6ac6286f7fe does not exist Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-86590e6f-31e5-4cfa-baa9-e57f36b97b46'] Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'd2fae3c1-84cb-428f-baca-f6ac6286f7fe'} Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 459, in get_rule Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi rule = neutron.show_security_group_rule( Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1092, in show_security_group_rule Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_rule_path % (security_group_rule), Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:23:28.533482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group rule d2fae3c1-84cb-428f-baca-f6ac6286f7fe does not exist Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86590e6f-31e5-4cfa-baa9-e57f36b97b46'] Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 359, in delete Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi rule = security_group_api.get_rule(context, id) Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 464, in get_rule Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group rule d2fae3c1-84cb-428f-baca-f6ac6286f7fe does not exist Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86590e6f-31e5-4cfa-baa9-e57f36b97b46'] Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 365, in delete Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group rule d2fae3c1-84cb-428f-baca-f6ac6286f7fe does not exist Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86590e6f-31e5-4cfa-baa9-e57f36b97b46'] Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group rule d2fae3c1-84cb-428f-baca-f6ac6286f7fe does not exist Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-86590e6f-31e5-4cfa-baa9-e57f36b97b46'] Oct 11 04:23:28.538000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:23:28.547352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72e9c6c2-55d5-43a0-a41f-834d2f633c7b tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Returning 404 to user: Security group rule d2fae3c1-84cb-428f-baca-f6ac6286f7fe does not exist Oct 11 04:23:28.547352 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-86590e6f-31e5-4cfa-baa9-e57f36b97b46'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:23:28.549640 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72e9c6c2-55d5-43a0-a41f-834d2f633c7b tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-group-rules/d2fae3c1-84cb-428f-baca-f6ac6286f7fe" status: 404 len: 199 microversion: 2.1 time: 0.072748 Oct 11 04:23:28.552540 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1607/3090] 10.222.0.26 () {58 vars in 1287 bytes} [Tue Oct 11 04:23:28 2022] DELETE /compute/v2.1/os-security-group-rules/d2fae3c1-84cb-428f-baca-f6ac6286f7fe => generated 199 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:23:28.569814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8641e22-9386-495f-8eee-62176059410d tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Calling method '.version_select at 0x7fda19316040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:28.972010 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e8641e22-9386-495f-8eee-62176059410d tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/8bbf5179-d96a-4c73-95b3-52807dc348e6" status: 202 len: 0 microversion: 2.1 time: 0.414894 Oct 11 04:23:28.977048 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1608/3091] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:23:28 2022] DELETE /compute/v2.1/os-security-groups/8bbf5179-d96a-4c73-95b3-52807dc348e6 => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:23:28.984335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-662e41e6-df6b-4cb3-9836-6a0155088650 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:28.986534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-662e41e6-df6b-4cb3-9836-6a0155088650 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:29.003824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662e41e6-df6b-4cb3-9836-6a0155088650 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:29.005027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662e41e6-df6b-4cb3-9836-6a0155088650 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:29.006560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662e41e6-df6b-4cb3-9836-6a0155088650 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:29.022542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662e41e6-df6b-4cb3-9836-6a0155088650 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:29.022542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662e41e6-df6b-4cb3-9836-6a0155088650 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:29.022542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662e41e6-df6b-4cb3-9836-6a0155088650 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:29.211972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-662e41e6-df6b-4cb3-9836-6a0155088650 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:29.227173 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-662e41e6-df6b-4cb3-9836-6a0155088650 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.246441 Oct 11 04:23:29.228242 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1609/3092] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:28 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:29.234091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-64d862d1-fe89-49cf-8461-c57eff0ca447 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Calling method '.version_select at 0x7fda194ef820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:29.302133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:23:29.303334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:23:29.305809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:23:29.305809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:23:29.305809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:23:29.317064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:29.318113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:29.319058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:29.320227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:29.321106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:29.321711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:29.343937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:29.351940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for user 99027798dcba4d52a9efc682ccc973d3 and project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:29.367435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:23:29.370483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:23:29.565932 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ac155fe-4f9c-4c3d-971e-340fe47c0565 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.432258 Oct 11 04:23:29.568374 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1484/3093] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:23:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1435 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:23:29.585882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-34afab8d-fffd-4986-88cf-75a41c3ecae8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:29.587876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-34afab8d-fffd-4986-88cf-75a41c3ecae8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:29.629354 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-64d862d1-fe89-49cf-8461-c57eff0ca447 tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/14187878-e490-4787-8049-21f581338892" status: 202 len: 0 microversion: 2.1 time: 0.397167 Oct 11 04:23:29.629354 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1610/3094] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:23:29 2022] DELETE /compute/v2.1/os-security-groups/14187878-e490-4787-8049-21f581338892 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:23:29.639239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1de6fe0f-abd8-4c89-97c5-fdad137a4d9e tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Calling method '.version_select at 0x7fda192ac940>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:29.747226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-34afab8d-fffd-4986-88cf-75a41c3ecae8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:29.757515 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-34afab8d-fffd-4986-88cf-75a41c3ecae8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1215 microversion: 2.1 time: 0.181839 Oct 11 04:23:29.758097 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1485/3095] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:29 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1215 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:30.215773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-215229986", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "5ff9bcca-b89a-450b-98cb-6e2aeae348c3"}], "security_groups": [{"name": "tempest-securitygroup--1185788132"}], "key_name": "tempest-keypair-1862756183", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:30.379519 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1de6fe0f-abd8-4c89-97c5-fdad137a4d9e tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/34c896f7-4e10-46a1-86ce-9c72aef63178" status: 202 len: 0 microversion: 2.1 time: 0.745607 Oct 11 04:23:30.379767 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1611/3096] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:23:29 2022] DELETE /compute/v2.1/os-security-groups/34c896f7-4e10-46a1-86ce-9c72aef63178 => generated 0 bytes in 747 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:23:30.393569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-46d3139a-9c38-490d-add0-2615a40b1f95 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:30.394830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-46d3139a-9c38-490d-add0-2615a40b1f95 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:30.423326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46d3139a-9c38-490d-add0-2615a40b1f95 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:30.424873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46d3139a-9c38-490d-add0-2615a40b1f95 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:30.426257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46d3139a-9c38-490d-add0-2615a40b1f95 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:30.427866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46d3139a-9c38-490d-add0-2615a40b1f95 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:30.432492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46d3139a-9c38-490d-add0-2615a40b1f95 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:30.433257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46d3139a-9c38-490d-add0-2615a40b1f95 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:30.676393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-46d3139a-9c38-490d-add0-2615a40b1f95 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:30.686850 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-46d3139a-9c38-490d-add0-2615a40b1f95 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.305031 Oct 11 04:23:30.702585 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1612/3097] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:30 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:30.708262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc0b2b63-5f37-4402-9940-3a8afd354c9b tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Calling method '.version_select at 0x7fda192ace50>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:30.805344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] validate_networks() for [('5ff9bcca-b89a-450b-98cb-6e2aeae348c3', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:23:31.271606 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc0b2b63-5f37-4402-9940-3a8afd354c9b tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/22c99374-53db-4a22-8fbe-71fc8c66f250" status: 202 len: 0 microversion: 2.1 time: 0.567174 Oct 11 04:23:31.272874 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1613/3098] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:23:30 2022] DELETE /compute/v2.1/os-security-groups/22c99374-53db-4a22-8fbe-71fc8c66f250 => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:23:31.278812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-281c26ac-d29d-4085-a5c1-ee5b3c0932c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:31.279947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-281c26ac-d29d-4085-a5c1-ee5b3c0932c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:31.290264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-281c26ac-d29d-4085-a5c1-ee5b3c0932c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:31.290766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-281c26ac-d29d-4085-a5c1-ee5b3c0932c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:31.292934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-281c26ac-d29d-4085-a5c1-ee5b3c0932c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:31.292934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-281c26ac-d29d-4085-a5c1-ee5b3c0932c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:31.292934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-281c26ac-d29d-4085-a5c1-ee5b3c0932c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:31.293343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-281c26ac-d29d-4085-a5c1-ee5b3c0932c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:31.414165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-281c26ac-d29d-4085-a5c1-ee5b3c0932c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:31.428649 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-281c26ac-d29d-4085-a5c1-ee5b3c0932c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1219 microversion: 2.1 time: 0.154098 Oct 11 04:23:31.430562 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1614/3099] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:31 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:31.445134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-71393a4e-b333-42a1-8d58-f1094538cfbb tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] Calling method '.version_select at 0x7fda192ac8b0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:31.598208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:23:31.598799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:23:31.599306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:23:31.599999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:23:31.600423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:23:31.614787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:31.616021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:31.616021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:31.617470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:31.618058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:31.619556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:31.643610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Getting quotas for project 15b90becc5a545f0965359b05561721f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:31.649639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Getting quotas for user ea114683a3754c8197b61fc5ef04fe0d and project 15b90becc5a545f0965359b05561721f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:31.665549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:23:31.668298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:23:31.690254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:31.784433 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff225d37-f20f-4a55-979f-179953905c99 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.581508 Oct 11 04:23:31.791654 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1486/3100] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:23:30 2022] POST /compute/v2.1/servers => generated 406 bytes in 1590 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:23:31.796738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aeaa2580-5378-4b86-aed5-fd459ccb499b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:31.797543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aeaa2580-5378-4b86-aed5-fd459ccb499b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:31.837477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeaa2580-5378-4b86-aed5-fd459ccb499b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:31.840032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeaa2580-5378-4b86-aed5-fd459ccb499b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:31.840478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeaa2580-5378-4b86-aed5-fd459ccb499b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:31.841202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeaa2580-5378-4b86-aed5-fd459ccb499b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:31.843758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeaa2580-5378-4b86-aed5-fd459ccb499b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:31.847021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeaa2580-5378-4b86-aed5-fd459ccb499b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:31.881497 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-71393a4e-b333-42a1-8d58-f1094538cfbb tempest-SecurityGroupRulesNegativeTestJSON-1824146404 tempest-SecurityGroupRulesNegativeTestJSON-1824146404-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/912c73bf-7992-448f-a0cd-6c708f9d746c" status: 202 len: 0 microversion: 2.1 time: 0.447449 Oct 11 04:23:31.886337 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1615/3101] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:23:31 2022] DELETE /compute/v2.1/os-security-groups/912c73bf-7992-448f-a0cd-6c708f9d746c => generated 0 bytes in 455 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:23:31.892198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-deaffbbe-cee9-48b5-bacc-6fa694141c2c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:31.893443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-deaffbbe-cee9-48b5-bacc-6fa694141c2c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:32.125480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-deaffbbe-cee9-48b5-bacc-6fa694141c2c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:32.152393 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-deaffbbe-cee9-48b5-bacc-6fa694141c2c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1234 microversion: 2.1 time: 0.250735 Oct 11 04:23:32.154995 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1616/3102] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:31 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1234 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:32.457271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d0241d3-a85f-4747-b922-71b9cb2b597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:32.459595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d0241d3-a85f-4747-b922-71b9cb2b597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:32.471884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aeaa2580-5378-4b86-aed5-fd459ccb499b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:32.474928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d0241d3-a85f-4747-b922-71b9cb2b597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:32.485322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d0241d3-a85f-4747-b922-71b9cb2b597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:32.485322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d0241d3-a85f-4747-b922-71b9cb2b597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:32.485322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d0241d3-a85f-4747-b922-71b9cb2b597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:32.485322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d0241d3-a85f-4747-b922-71b9cb2b597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:32.485322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d0241d3-a85f-4747-b922-71b9cb2b597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:32.492282 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aeaa2580-5378-4b86-aed5-fd459ccb499b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.699241 Oct 11 04:23:32.493063 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1487/3103] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:31 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:32.606583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d0241d3-a85f-4747-b922-71b9cb2b597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:32.623376 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d0241d3-a85f-4747-b922-71b9cb2b597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1267 microversion: 2.1 time: 0.169738 Oct 11 04:23:32.626236 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1617/3104] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:32 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:33.231752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-18750042-c29c-4f78-b5d3-79520efd8199 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:33.231752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-18750042-c29c-4f78-b5d3-79520efd8199 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:33.248380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18750042-c29c-4f78-b5d3-79520efd8199 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:33.257748 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-18750042-c29c-4f78-b5d3-79520efd8199 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1234 microversion: 2.1 time: 0.082397 Oct 11 04:23:33.258983 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1488/3105] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:33 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1234 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:33.519973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1fdd9e81-198d-4b90-9132-9e7e20b4e58b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:33.520595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1fdd9e81-198d-4b90-9132-9e7e20b4e58b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:33.529436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fdd9e81-198d-4b90-9132-9e7e20b4e58b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:33.530111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fdd9e81-198d-4b90-9132-9e7e20b4e58b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:33.537719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fdd9e81-198d-4b90-9132-9e7e20b4e58b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:33.537719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fdd9e81-198d-4b90-9132-9e7e20b4e58b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:33.537719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fdd9e81-198d-4b90-9132-9e7e20b4e58b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:33.537719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fdd9e81-198d-4b90-9132-9e7e20b4e58b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:33.648562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-731b2538-ad87-48b9-a31e-c797b7e10fb8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:33.649855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-731b2538-ad87-48b9-a31e-c797b7e10fb8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:33.657829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-731b2538-ad87-48b9-a31e-c797b7e10fb8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:33.663782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-731b2538-ad87-48b9-a31e-c797b7e10fb8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:33.663782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-731b2538-ad87-48b9-a31e-c797b7e10fb8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:33.663782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-731b2538-ad87-48b9-a31e-c797b7e10fb8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:33.663782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-731b2538-ad87-48b9-a31e-c797b7e10fb8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:33.663782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-731b2538-ad87-48b9-a31e-c797b7e10fb8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:33.670858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1fdd9e81-198d-4b90-9132-9e7e20b4e58b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:33.679665 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1fdd9e81-198d-4b90-9132-9e7e20b4e58b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.163928 Oct 11 04:23:33.680246 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1618/3106] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:33 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:34.021397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-731b2538-ad87-48b9-a31e-c797b7e10fb8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:34.036744 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-731b2538-ad87-48b9-a31e-c797b7e10fb8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1267 microversion: 2.1 time: 0.392120 Oct 11 04:23:34.038421 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1489/3107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:33 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1267 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:34.286503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82c18630-387a-406a-b628-e696f602169d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:34.287476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82c18630-387a-406a-b628-e696f602169d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:34.297254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82c18630-387a-406a-b628-e696f602169d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:34.299121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82c18630-387a-406a-b628-e696f602169d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:34.299816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82c18630-387a-406a-b628-e696f602169d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:34.300622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82c18630-387a-406a-b628-e696f602169d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:34.301303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82c18630-387a-406a-b628-e696f602169d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:34.301941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82c18630-387a-406a-b628-e696f602169d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:34.674244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82c18630-387a-406a-b628-e696f602169d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:34.686832 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82c18630-387a-406a-b628-e696f602169d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1238 microversion: 2.1 time: 0.405095 Oct 11 04:23:34.688285 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1619/3108] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:34 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1238 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:34.709495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7c4ee4ce-3b1a-46a2-aa94-2e7ed4de32ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:34.714114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7c4ee4ce-3b1a-46a2-aa94-2e7ed4de32ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:34.726146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c4ee4ce-3b1a-46a2-aa94-2e7ed4de32ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:34.726674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c4ee4ce-3b1a-46a2-aa94-2e7ed4de32ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:34.727119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c4ee4ce-3b1a-46a2-aa94-2e7ed4de32ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:34.730492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c4ee4ce-3b1a-46a2-aa94-2e7ed4de32ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:34.742881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c4ee4ce-3b1a-46a2-aa94-2e7ed4de32ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:34.744854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c4ee4ce-3b1a-46a2-aa94-2e7ed4de32ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:34.762647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:35.065375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0cb2dbb0-f417-428e-b7f9-b068e947d58f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:35.066233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0cb2dbb0-f417-428e-b7f9-b068e947d58f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:35.075612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cb2dbb0-f417-428e-b7f9-b068e947d58f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:35.077162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cb2dbb0-f417-428e-b7f9-b068e947d58f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:35.078723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cb2dbb0-f417-428e-b7f9-b068e947d58f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:35.080715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cb2dbb0-f417-428e-b7f9-b068e947d58f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:35.081320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cb2dbb0-f417-428e-b7f9-b068e947d58f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:35.082868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cb2dbb0-f417-428e-b7f9-b068e947d58f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:35.236615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0cb2dbb0-f417-428e-b7f9-b068e947d58f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:35.240382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7c4ee4ce-3b1a-46a2-aa94-2e7ed4de32ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:35.245915 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0cb2dbb0-f417-428e-b7f9-b068e947d58f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1273 microversion: 2.1 time: 0.184751 Oct 11 04:23:35.246541 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1620/3109] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:35 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1273 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:35.254470 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7c4ee4ce-3b1a-46a2-aa94-2e7ed4de32ad tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.543540 Oct 11 04:23:35.267812 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1490/3110] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:34 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:35.722569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3e06cfaf-a2b8-4227-8df1-dc9e994d82e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:35.729931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3e06cfaf-a2b8-4227-8df1-dc9e994d82e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:35.748582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e06cfaf-a2b8-4227-8df1-dc9e994d82e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:35.750176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e06cfaf-a2b8-4227-8df1-dc9e994d82e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:35.751660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e06cfaf-a2b8-4227-8df1-dc9e994d82e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:35.752525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e06cfaf-a2b8-4227-8df1-dc9e994d82e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:35.753095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e06cfaf-a2b8-4227-8df1-dc9e994d82e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:35.757030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e06cfaf-a2b8-4227-8df1-dc9e994d82e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:35.945120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3e06cfaf-a2b8-4227-8df1-dc9e994d82e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:35.967132 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3e06cfaf-a2b8-4227-8df1-dc9e994d82e7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1286 microversion: 2.1 time: 0.255511 Oct 11 04:23:35.979631 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1621/3111] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:35 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1286 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:36.274758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e5dfb371-6cf4-41b6-9ba8-963c6f48e5cf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:36.275673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e5dfb371-6cf4-41b6-9ba8-963c6f48e5cf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:36.276818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6220fffc-79da-409f-a2c1-33030b734212 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:36.278041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6220fffc-79da-409f-a2c1-33030b734212 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:36.284363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5dfb371-6cf4-41b6-9ba8-963c6f48e5cf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:36.284866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5dfb371-6cf4-41b6-9ba8-963c6f48e5cf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:36.285312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5dfb371-6cf4-41b6-9ba8-963c6f48e5cf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:36.286635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6220fffc-79da-409f-a2c1-33030b734212 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:36.286786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5dfb371-6cf4-41b6-9ba8-963c6f48e5cf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:36.286887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6220fffc-79da-409f-a2c1-33030b734212 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:36.287269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6220fffc-79da-409f-a2c1-33030b734212 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:36.288456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6220fffc-79da-409f-a2c1-33030b734212 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:36.289326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6220fffc-79da-409f-a2c1-33030b734212 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:36.289978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6220fffc-79da-409f-a2c1-33030b734212 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:36.298339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5dfb371-6cf4-41b6-9ba8-963c6f48e5cf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:36.298968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5dfb371-6cf4-41b6-9ba8-963c6f48e5cf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:36.468755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e5dfb371-6cf4-41b6-9ba8-963c6f48e5cf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:36.477972 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e5dfb371-6cf4-41b6-9ba8-963c6f48e5cf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.206925 Oct 11 04:23:36.479113 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1622/3112] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:36 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:36.852531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6220fffc-79da-409f-a2c1-33030b734212 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:36.863961 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6220fffc-79da-409f-a2c1-33030b734212 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1273 microversion: 2.1 time: 0.592863 Oct 11 04:23:36.865411 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1491/3113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:36 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1273 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:37.003368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8f165ebc-1dd2-48d3-94f3-6c2cf3b803e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:37.005518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8f165ebc-1dd2-48d3-94f3-6c2cf3b803e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:37.015662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f165ebc-1dd2-48d3-94f3-6c2cf3b803e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:37.016240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f165ebc-1dd2-48d3-94f3-6c2cf3b803e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:37.016776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f165ebc-1dd2-48d3-94f3-6c2cf3b803e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:37.017564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f165ebc-1dd2-48d3-94f3-6c2cf3b803e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:37.018410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f165ebc-1dd2-48d3-94f3-6c2cf3b803e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:37.019217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f165ebc-1dd2-48d3-94f3-6c2cf3b803e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:37.092617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8f165ebc-1dd2-48d3-94f3-6c2cf3b803e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:37.106207 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8f165ebc-1dd2-48d3-94f3-6c2cf3b803e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1292 microversion: 2.1 time: 0.106928 Oct 11 04:23:37.107064 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1623/3114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:36 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1292 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:37.528481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b2c9230-225c-4508-8fbc-b06a99d1f864 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:37.528481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0b2c9230-225c-4508-8fbc-b06a99d1f864 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:37.534884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2c9230-225c-4508-8fbc-b06a99d1f864 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:37.535396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2c9230-225c-4508-8fbc-b06a99d1f864 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:37.535825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2c9230-225c-4508-8fbc-b06a99d1f864 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:37.536730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2c9230-225c-4508-8fbc-b06a99d1f864 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:37.537183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2c9230-225c-4508-8fbc-b06a99d1f864 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:37.537788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2c9230-225c-4508-8fbc-b06a99d1f864 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:37.888718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-077e6380-c2c1-4d47-9147-7147c742e5a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:37.889524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-077e6380-c2c1-4d47-9147-7147c742e5a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:37.897938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-077e6380-c2c1-4d47-9147-7147c742e5a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:37.913625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-077e6380-c2c1-4d47-9147-7147c742e5a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:37.913625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-077e6380-c2c1-4d47-9147-7147c742e5a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:37.913625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-077e6380-c2c1-4d47-9147-7147c742e5a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:37.913625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-077e6380-c2c1-4d47-9147-7147c742e5a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:37.913625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-077e6380-c2c1-4d47-9147-7147c742e5a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:38.165909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-077e6380-c2c1-4d47-9147-7147c742e5a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:38.174456 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-077e6380-c2c1-4d47-9147-7147c742e5a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 0.290646 Oct 11 04:23:38.175044 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1624/3115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:37 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:38.180026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48fcee07-94c4-4322-8ed7-5e5bd7611d6f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:38.180942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-48fcee07-94c4-4322-8ed7-5e5bd7611d6f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:38.189681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcee07-94c4-4322-8ed7-5e5bd7611d6f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:38.190497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcee07-94c4-4322-8ed7-5e5bd7611d6f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:38.191173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcee07-94c4-4322-8ed7-5e5bd7611d6f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:38.192547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcee07-94c4-4322-8ed7-5e5bd7611d6f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:38.193188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcee07-94c4-4322-8ed7-5e5bd7611d6f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:38.193838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcee07-94c4-4322-8ed7-5e5bd7611d6f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:38.269104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b2c9230-225c-4508-8fbc-b06a99d1f864 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:38.292061 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0b2c9230-225c-4508-8fbc-b06a99d1f864 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.788467 Oct 11 04:23:38.297908 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1492/3116] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:37 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:38.369750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48fcee07-94c4-4322-8ed7-5e5bd7611d6f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:38.386935 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48fcee07-94c4-4322-8ed7-5e5bd7611d6f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1292 microversion: 2.1 time: 0.206209 Oct 11 04:23:38.387982 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1625/3117] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:38 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1292 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:39.199451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ec9c529-0fbb-4476-b922-824b3f9a0417 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:39.199451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ec9c529-0fbb-4476-b922-824b3f9a0417 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:39.213331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ec9c529-0fbb-4476-b922-824b3f9a0417 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:39.213867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ec9c529-0fbb-4476-b922-824b3f9a0417 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:39.214342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ec9c529-0fbb-4476-b922-824b3f9a0417 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:39.215327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ec9c529-0fbb-4476-b922-824b3f9a0417 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:39.216020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ec9c529-0fbb-4476-b922-824b3f9a0417 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:39.216725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ec9c529-0fbb-4476-b922-824b3f9a0417 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:39.319607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b630b783-3acf-4798-99e2-de04b86a3b5e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:39.321327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b630b783-3acf-4798-99e2-de04b86a3b5e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:39.337110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b630b783-3acf-4798-99e2-de04b86a3b5e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:39.338222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b630b783-3acf-4798-99e2-de04b86a3b5e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:39.339144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b630b783-3acf-4798-99e2-de04b86a3b5e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:39.340331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b630b783-3acf-4798-99e2-de04b86a3b5e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:39.341433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b630b783-3acf-4798-99e2-de04b86a3b5e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:39.342162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b630b783-3acf-4798-99e2-de04b86a3b5e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:39.678058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b630b783-3acf-4798-99e2-de04b86a3b5e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:39.691512 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b630b783-3acf-4798-99e2-de04b86a3b5e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.378872 Oct 11 04:23:39.706554 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1626/3118] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:39 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:39.710910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-301f7793-5eed-4079-990d-ae7378c1b3a4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:39.711817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-301f7793-5eed-4079-990d-ae7378c1b3a4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:39.724436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301f7793-5eed-4079-990d-ae7378c1b3a4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:39.725162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301f7793-5eed-4079-990d-ae7378c1b3a4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:39.725781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301f7793-5eed-4079-990d-ae7378c1b3a4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:39.726981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301f7793-5eed-4079-990d-ae7378c1b3a4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:39.727603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301f7793-5eed-4079-990d-ae7378c1b3a4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:39.728227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301f7793-5eed-4079-990d-ae7378c1b3a4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:39.735935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3ec9c529-0fbb-4476-b922-824b3f9a0417 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:39.745838 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ec9c529-0fbb-4476-b922-824b3f9a0417 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 0.552615 Oct 11 04:23:39.761272 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1493/3119] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:39 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:40.135444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-301f7793-5eed-4079-990d-ae7378c1b3a4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:40.158613 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-301f7793-5eed-4079-990d-ae7378c1b3a4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1360 microversion: 2.1 time: 0.464918 Oct 11 04:23:40.172647 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1627/3120] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:39 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1360 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:40.730960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-181dc9e6-0a75-485c-bb72-34bdecfacf76 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:40.733314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-181dc9e6-0a75-485c-bb72-34bdecfacf76 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:40.741773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181dc9e6-0a75-485c-bb72-34bdecfacf76 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:40.742534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181dc9e6-0a75-485c-bb72-34bdecfacf76 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:40.743136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181dc9e6-0a75-485c-bb72-34bdecfacf76 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:40.744178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181dc9e6-0a75-485c-bb72-34bdecfacf76 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:40.744799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181dc9e6-0a75-485c-bb72-34bdecfacf76 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:40.746684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-181dc9e6-0a75-485c-bb72-34bdecfacf76 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:40.772653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-788709b4-8a5f-4c0d-919b-04c205059f41 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:40.773359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-788709b4-8a5f-4c0d-919b-04c205059f41 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:40.805950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-788709b4-8a5f-4c0d-919b-04c205059f41 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:40.806511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-788709b4-8a5f-4c0d-919b-04c205059f41 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:40.812089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-788709b4-8a5f-4c0d-919b-04c205059f41 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:40.813989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-788709b4-8a5f-4c0d-919b-04c205059f41 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:40.814537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-788709b4-8a5f-4c0d-919b-04c205059f41 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:40.816999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-788709b4-8a5f-4c0d-919b-04c205059f41 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:41.149519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-788709b4-8a5f-4c0d-919b-04c205059f41 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:41.158602 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-788709b4-8a5f-4c0d-919b-04c205059f41 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 0.390458 Oct 11 04:23:41.160126 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1628/3121] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:40 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:41.201983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-181dc9e6-0a75-485c-bb72-34bdecfacf76 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:41.220875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5de16dba-4e69-4fde-99ca-9afef8cd5dde tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:41.221026 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-181dc9e6-0a75-485c-bb72-34bdecfacf76 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1498 microversion: 2.1 time: 0.505039 Oct 11 04:23:41.221588 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1494/3122] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:40 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1498 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:41.228559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5de16dba-4e69-4fde-99ca-9afef8cd5dde tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:41.256936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5de16dba-4e69-4fde-99ca-9afef8cd5dde tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:41.257533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5de16dba-4e69-4fde-99ca-9afef8cd5dde tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:41.257985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5de16dba-4e69-4fde-99ca-9afef8cd5dde tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:41.263082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5de16dba-4e69-4fde-99ca-9afef8cd5dde tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:41.265218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5de16dba-4e69-4fde-99ca-9afef8cd5dde tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:41.266794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5de16dba-4e69-4fde-99ca-9afef8cd5dde tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:41.350784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:41.849279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-83f956a8-bd40-4852-954a-9c7e68d86b33 req-776f5c78-390c-4daf-833f-a6031b01c7e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f905c4dd-c9f6-452d-bc51-696256de0b36", "tag": "5dec51fb-6f29-4e7f-aeb9-d6572fc4d1e2"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:41.858499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:41.869765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-83f956a8-bd40-4852-954a-9c7e68d86b33 req-776f5c78-390c-4daf-833f-a6031b01c7e0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:41.875209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-83f956a8-bd40-4852-954a-9c7e68d86b33 req-776f5c78-390c-4daf-833f-a6031b01c7e0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:41.875869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-83f956a8-bd40-4852-954a-9c7e68d86b33 req-776f5c78-390c-4daf-833f-a6031b01c7e0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:41.894676 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-83f956a8-bd40-4852-954a-9c7e68d86b33 req-776f5c78-390c-4daf-833f-a6031b01c7e0 service nova] Creating event network-changed:5dec51fb-6f29-4e7f-aeb9-d6572fc4d1e2 for instance f905c4dd-c9f6-452d-bc51-696256de0b36 on n-h1-860892-1 Oct 11 04:23:41.905202 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-83f956a8-bd40-4852-954a-9c7e68d86b33 req-776f5c78-390c-4daf-833f-a6031b01c7e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059449 Oct 11 04:23:41.922910 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1495/3123] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:23:42.131044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:42.187269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3bdab6eb-ffba-4c22-96ce-c5bb22d9d6cb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:42.188376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3bdab6eb-ffba-4c22-96ce-c5bb22d9d6cb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:42.196773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bdab6eb-ffba-4c22-96ce-c5bb22d9d6cb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:42.197647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bdab6eb-ffba-4c22-96ce-c5bb22d9d6cb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:42.198362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bdab6eb-ffba-4c22-96ce-c5bb22d9d6cb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:42.199483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bdab6eb-ffba-4c22-96ce-c5bb22d9d6cb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:42.200153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bdab6eb-ffba-4c22-96ce-c5bb22d9d6cb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:42.200793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3bdab6eb-ffba-4c22-96ce-c5bb22d9d6cb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:42.226503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5de16dba-4e69-4fde-99ca-9afef8cd5dde tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:42.241686 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5de16dba-4e69-4fde-99ca-9afef8cd5dde tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1360 microversion: 2.1 time: 1.028675 Oct 11 04:23:42.248624 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1629/3124] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:41 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1360 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:42.260029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e1f202db-df53-4dd8-a757-06ee6cfdb4b5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:42.276854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e1f202db-df53-4dd8-a757-06ee6cfdb4b5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:42.276854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1f202db-df53-4dd8-a757-06ee6cfdb4b5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:42.276854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1f202db-df53-4dd8-a757-06ee6cfdb4b5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:42.276854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1f202db-df53-4dd8-a757-06ee6cfdb4b5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:42.276854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1f202db-df53-4dd8-a757-06ee6cfdb4b5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:42.276854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1f202db-df53-4dd8-a757-06ee6cfdb4b5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:42.276854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1f202db-df53-4dd8-a757-06ee6cfdb4b5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:42.667246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3bdab6eb-ffba-4c22-96ce-c5bb22d9d6cb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:42.677721 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3bdab6eb-ffba-4c22-96ce-c5bb22d9d6cb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 0.498035 Oct 11 04:23:42.704726 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1496/3125] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:42 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:43.062789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e1f202db-df53-4dd8-a757-06ee6cfdb4b5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:43.073926 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e1f202db-df53-4dd8-a757-06ee6cfdb4b5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 200 len: 1475 microversion: 2.1 time: 0.823810 Oct 11 04:23:43.075728 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1630/3126] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:42 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 1475 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:43.098785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8da7b05-08d0-4e73-b5f5-e21af6df96fa tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-415648896"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:43.101178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f8da7b05-08d0-4e73-b5f5-e21af6df96fa tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:43.130868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8da7b05-08d0-4e73-b5f5-e21af6df96fa tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:43.131383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8da7b05-08d0-4e73-b5f5-e21af6df96fa tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:43.131836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8da7b05-08d0-4e73-b5f5-e21af6df96fa tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:43.132600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8da7b05-08d0-4e73-b5f5-e21af6df96fa tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:43.133066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8da7b05-08d0-4e73-b5f5-e21af6df96fa tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:43.133507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8da7b05-08d0-4e73-b5f5-e21af6df96fa tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:43.272143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b0ce7d48-dff1-4df3-ba9f-969988474120 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:43.273518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b0ce7d48-dff1-4df3-ba9f-969988474120 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:43.276455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=38 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:43.283584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce7d48-dff1-4df3-ba9f-969988474120 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:43.286641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce7d48-dff1-4df3-ba9f-969988474120 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:43.287081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce7d48-dff1-4df3-ba9f-969988474120 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:43.287802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce7d48-dff1-4df3-ba9f-969988474120 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:43.306810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce7d48-dff1-4df3-ba9f-969988474120 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:43.307513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce7d48-dff1-4df3-ba9f-969988474120 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:43.774433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b0ce7d48-dff1-4df3-ba9f-969988474120 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:43.784897 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b0ce7d48-dff1-4df3-ba9f-969988474120 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1360 microversion: 2.1 time: 0.516747 Oct 11 04:23:43.789498 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1631/3127] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:43 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1360 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:43.798662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a26a00d9-ff05-405f-8af3-a6afe4b7808e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:43.799562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a26a00d9-ff05-405f-8af3-a6afe4b7808e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:43.817316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a26a00d9-ff05-405f-8af3-a6afe4b7808e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:43.818341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a26a00d9-ff05-405f-8af3-a6afe4b7808e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:43.819024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a26a00d9-ff05-405f-8af3-a6afe4b7808e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:43.820223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a26a00d9-ff05-405f-8af3-a6afe4b7808e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:43.820897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a26a00d9-ff05-405f-8af3-a6afe4b7808e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:43.822111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a26a00d9-ff05-405f-8af3-a6afe4b7808e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:44.026928 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f8da7b05-08d0-4e73-b5f5-e21af6df96fa tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "POST /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df/action" status: 202 len: 0 microversion: 2.1 time: 0.928515 Oct 11 04:23:44.037099 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1497/3128] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:23:43 2022] POST /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df/action => generated 0 bytes in 943 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 04:23:44.050814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8b714676-d0fd-46be-a85f-a9f3f18de29b req-6ee3aed7-6e58-4dd2-8c76-ac375fc60197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f355e5e4-e6af-4b85-9dd8-99b495b0d5a8", "tag": "ff3eb7a3-fcc1-45dc-94d9-930423c9496a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:44.084726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8b714676-d0fd-46be-a85f-a9f3f18de29b req-6ee3aed7-6e58-4dd2-8c76-ac375fc60197 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:44.085323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8b714676-d0fd-46be-a85f-a9f3f18de29b req-6ee3aed7-6e58-4dd2-8c76-ac375fc60197 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:44.086253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8b714676-d0fd-46be-a85f-a9f3f18de29b req-6ee3aed7-6e58-4dd2-8c76-ac375fc60197 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:44.123888 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8b714676-d0fd-46be-a85f-a9f3f18de29b req-6ee3aed7-6e58-4dd2-8c76-ac375fc60197 service nova] Creating event network-changed:ff3eb7a3-fcc1-45dc-94d9-930423c9496a for instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 on n-h1-860892-1 Oct 11 04:23:44.137138 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8b714676-d0fd-46be-a85f-a9f3f18de29b req-6ee3aed7-6e58-4dd2-8c76-ac375fc60197 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096853 Oct 11 04:23:44.138853 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1498/3129] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:44.153086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-953b07df-129b-4bea-a17e-a465b6b31b16 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda191d0b80>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:44.268204 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-953b07df-129b-4bea-a17e-a465b6b31b16 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.127547 Oct 11 04:23:44.269731 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1499/3130] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:44 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:44.479769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a26a00d9-ff05-405f-8af3-a6afe4b7808e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:44.495185 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a26a00d9-ff05-405f-8af3-a6afe4b7808e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 0.702584 Oct 11 04:23:44.522688 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1632/3131] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:43 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:44.816942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-232fd5fa-0e78-4ce9-8740-d4052080ab0e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:44.818353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-232fd5fa-0e78-4ce9-8740-d4052080ab0e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:44.827424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-232fd5fa-0e78-4ce9-8740-d4052080ab0e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:44.828117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-232fd5fa-0e78-4ce9-8740-d4052080ab0e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:44.828736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-232fd5fa-0e78-4ce9-8740-d4052080ab0e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:44.829603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-232fd5fa-0e78-4ce9-8740-d4052080ab0e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:44.830059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-232fd5fa-0e78-4ce9-8740-d4052080ab0e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:44.830515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-232fd5fa-0e78-4ce9-8740-d4052080ab0e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:45.248033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-232fd5fa-0e78-4ce9-8740-d4052080ab0e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:45.269943 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-232fd5fa-0e78-4ce9-8740-d4052080ab0e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1360 microversion: 2.1 time: 0.448814 Oct 11 04:23:45.275650 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1500/3132] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:44 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1360 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:45.284288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5da2d5c2-228c-4888-a76c-69851b438617 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19277c10>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:45.365218 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5da2d5c2-228c-4888-a76c-69851b438617 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.085342 Oct 11 04:23:45.366392 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1633/3133] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:45 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:45.546002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-24a12155-f94a-40ef-8084-f1cc905d6fe5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:45.546699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-24a12155-f94a-40ef-8084-f1cc905d6fe5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:45.560655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24a12155-f94a-40ef-8084-f1cc905d6fe5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:45.561175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24a12155-f94a-40ef-8084-f1cc905d6fe5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:45.561599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24a12155-f94a-40ef-8084-f1cc905d6fe5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:45.568129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24a12155-f94a-40ef-8084-f1cc905d6fe5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:45.569809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24a12155-f94a-40ef-8084-f1cc905d6fe5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:45.570533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24a12155-f94a-40ef-8084-f1cc905d6fe5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:45.714084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b6ca14a-d41c-4bfa-9361-a1cb166c1772 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'create', calling method: .version_select at 0x7fda19246310>, body: {"keypair": {"name": "tempest-keypair-427074894", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMTekOSDdwJI89y8oGWoCMRx0UJJJhzkm8TyT+c5lasnLhaGmWSqLjNvKf5S9DzhHrGFPPMuZhioLYrZG0Y74WSN5zPWBu0xAzE4doXN1e390j08D9mBSGHIMHUqAjqgVA=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:45.764221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6b6ca14a-d41c-4bfa-9361-a1cb166c1772 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for project 9a2974866e964ca2864c978d2270bd77. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:45.775460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6b6ca14a-d41c-4bfa-9361-a1cb166c1772 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for user 5feceb4a60434064a4fd08f7cc637f32 and project 9a2974866e964ca2864c978d2270bd77. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:45.863325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-24a12155-f94a-40ef-8084-f1cc905d6fe5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:45.873457 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-24a12155-f94a-40ef-8084-f1cc905d6fe5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 0.330228 Oct 11 04:23:45.875486 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1634/3134] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:45 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:45.903357 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b6ca14a-d41c-4bfa-9361-a1cb166c1772 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.566543 Oct 11 04:23:45.905012 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1501/3135] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:23:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:46.300310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2bd0c188-c256-484d-bed2-9830fd369552 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:46.300971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2bd0c188-c256-484d-bed2-9830fd369552 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:46.320894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bd0c188-c256-484d-bed2-9830fd369552 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:46.323886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bd0c188-c256-484d-bed2-9830fd369552 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:46.324574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bd0c188-c256-484d-bed2-9830fd369552 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:46.325457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bd0c188-c256-484d-bed2-9830fd369552 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:46.328044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bd0c188-c256-484d-bed2-9830fd369552 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:46.328984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bd0c188-c256-484d-bed2-9830fd369552 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:46.384916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8d44f7b3-b5e7-436c-badf-88c1294150ea tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda192664c0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:46.462136 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8d44f7b3-b5e7-436c-badf-88c1294150ea tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.082772 Oct 11 04:23:46.462795 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1502/3136] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:46 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:46.558735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2bd0c188-c256-484d-bed2-9830fd369552 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:46.573318 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2bd0c188-c256-484d-bed2-9830fd369552 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1360 microversion: 2.1 time: 0.278012 Oct 11 04:23:46.589838 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1635/3137] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:46 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1360 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:46.904121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-76863331-fa08-4130-a505-033e02d50bb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:46.905037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-76863331-fa08-4130-a505-033e02d50bb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:46.911571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76863331-fa08-4130-a505-033e02d50bb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:46.912262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76863331-fa08-4130-a505-033e02d50bb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:46.912865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76863331-fa08-4130-a505-033e02d50bb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:46.913756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76863331-fa08-4130-a505-033e02d50bb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:46.914398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76863331-fa08-4130-a505-033e02d50bb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:46.915030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76863331-fa08-4130-a505-033e02d50bb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:47.254935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-76863331-fa08-4130-a505-033e02d50bb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:47.344744 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-76863331-fa08-4130-a505-033e02d50bb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 0.432451 Oct 11 04:23:47.345491 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1503/3138] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:46 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:47.477223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43b286db-01a3-4dc6-8347-b406eaeef739 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda192a51f0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:47.597123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a239b2e9-313c-4689-9e08-57ff3d6ad330 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:47.597817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a239b2e9-313c-4689-9e08-57ff3d6ad330 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:47.605090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a239b2e9-313c-4689-9e08-57ff3d6ad330 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:47.623806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a239b2e9-313c-4689-9e08-57ff3d6ad330 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:47.624115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a239b2e9-313c-4689-9e08-57ff3d6ad330 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:47.624944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a239b2e9-313c-4689-9e08-57ff3d6ad330 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:47.625493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a239b2e9-313c-4689-9e08-57ff3d6ad330 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:47.625999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a239b2e9-313c-4689-9e08-57ff3d6ad330 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:47.711579 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-43b286db-01a3-4dc6-8347-b406eaeef739 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.238064 Oct 11 04:23:47.717623 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1636/3139] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:47 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:47.910954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a239b2e9-313c-4689-9e08-57ff3d6ad330 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:47.920909 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a239b2e9-313c-4689-9e08-57ff3d6ad330 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1360 microversion: 2.1 time: 0.327460 Oct 11 04:23:47.945337 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1504/3140] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:47 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1360 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:48.375801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-83f344d5-6979-405b-8325-358259bac163 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:48.376721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-83f344d5-6979-405b-8325-358259bac163 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:48.396120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83f344d5-6979-405b-8325-358259bac163 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:48.396857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83f344d5-6979-405b-8325-358259bac163 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:48.397284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83f344d5-6979-405b-8325-358259bac163 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:48.398072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83f344d5-6979-405b-8325-358259bac163 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:48.398621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83f344d5-6979-405b-8325-358259bac163 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:48.399110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83f344d5-6979-405b-8325-358259bac163 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:48.595795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-83f344d5-6979-405b-8325-358259bac163 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:48.604860 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-83f344d5-6979-405b-8325-358259bac163 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 0.232903 Oct 11 04:23:48.605412 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1637/3141] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:48 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:48.731952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-abd2ebaf-d819-4c31-9114-f8537514e574 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1e07d5e0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:48.809803 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-abd2ebaf-d819-4c31-9114-f8537514e574 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.082185 Oct 11 04:23:48.810459 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1505/3142] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:48 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:48.952806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e942d35-95af-41a9-bb54-2c6c13a0e6ab tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:48.953419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e942d35-95af-41a9-bb54-2c6c13a0e6ab tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:48.960330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e942d35-95af-41a9-bb54-2c6c13a0e6ab tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:48.960963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e942d35-95af-41a9-bb54-2c6c13a0e6ab tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:48.961619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e942d35-95af-41a9-bb54-2c6c13a0e6ab tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:48.963037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e942d35-95af-41a9-bb54-2c6c13a0e6ab tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:48.963590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e942d35-95af-41a9-bb54-2c6c13a0e6ab tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:48.964084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e942d35-95af-41a9-bb54-2c6c13a0e6ab tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:49.628800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5fd73371-4c83-478c-91f8-5cb96ac1537d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:49.630034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5fd73371-4c83-478c-91f8-5cb96ac1537d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:49.638374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fd73371-4c83-478c-91f8-5cb96ac1537d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:49.639495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fd73371-4c83-478c-91f8-5cb96ac1537d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:49.643625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fd73371-4c83-478c-91f8-5cb96ac1537d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:49.646603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fd73371-4c83-478c-91f8-5cb96ac1537d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:49.647246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fd73371-4c83-478c-91f8-5cb96ac1537d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:49.648178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fd73371-4c83-478c-91f8-5cb96ac1537d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:50.335774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5fd73371-4c83-478c-91f8-5cb96ac1537d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:50.350049 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5fd73371-4c83-478c-91f8-5cb96ac1537d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 0.721264 Oct 11 04:23:50.357613 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1506/3143] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:49 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:50.363737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fab0c5d5-8e1c-4b17-aafd-936450d8094c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19b159d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:50.460098 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fab0c5d5-8e1c-4b17-aafd-936450d8094c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.100005 Oct 11 04:23:50.490918 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1507/3144] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:50 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:50.643838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6954704d-fdb0-4e20-bf58-d2476ea1291d req-217552e7-ac7b-4e58-95af-f393da500563 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "597b08ac-2ff7-485c-9ccc-cc37c67817df", "name": "network-vif-plugged", "status": "completed", "tag": "1a26991b-531a-4238-9366-bb99758b06be"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:50.704732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6954704d-fdb0-4e20-bf58-d2476ea1291d req-217552e7-ac7b-4e58-95af-f393da500563 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:50.705206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6954704d-fdb0-4e20-bf58-d2476ea1291d req-217552e7-ac7b-4e58-95af-f393da500563 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:50.709710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6954704d-fdb0-4e20-bf58-d2476ea1291d req-217552e7-ac7b-4e58-95af-f393da500563 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:50.744075 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6954704d-fdb0-4e20-bf58-d2476ea1291d req-217552e7-ac7b-4e58-95af-f393da500563 service nova] Creating event network-vif-plugged:1a26991b-531a-4238-9366-bb99758b06be for instance 597b08ac-2ff7-485c-9ccc-cc37c67817df on n-h2-860892-1 Oct 11 04:23:50.761341 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6954704d-fdb0-4e20-bf58-d2476ea1291d req-217552e7-ac7b-4e58-95af-f393da500563 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124877 Oct 11 04:23:50.767292 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1508/3145] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:23:50.857122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e942d35-95af-41a9-bb54-2c6c13a0e6ab tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:50.871840 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e942d35-95af-41a9-bb54-2c6c13a0e6ab tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1360 microversion: 2.1 time: 1.919332 Oct 11 04:23:50.872885 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1638/3146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:48 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1360 bytes in 1925 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:51.378567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9a1f026-1a4a-4731-8941-e4afb4a3754d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:51.379669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e9a1f026-1a4a-4731-8941-e4afb4a3754d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:51.414030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9a1f026-1a4a-4731-8941-e4afb4a3754d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:51.414546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9a1f026-1a4a-4731-8941-e4afb4a3754d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:51.414986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9a1f026-1a4a-4731-8941-e4afb4a3754d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:51.415734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9a1f026-1a4a-4731-8941-e4afb4a3754d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:51.433675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9a1f026-1a4a-4731-8941-e4afb4a3754d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:51.435618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9a1f026-1a4a-4731-8941-e4afb4a3754d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:51.476177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e468191-1c19-4713-87f6-8ea4064b5751 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19316ca0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:51.700925 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e468191-1c19-4713-87f6-8ea4064b5751 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.228476 Oct 11 04:23:51.709323 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1639/3147] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:51 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:51.899219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b90a2624-40f1-490d-87ee-9a219aead89e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:51.902854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b90a2624-40f1-490d-87ee-9a219aead89e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:51.909225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=62 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:51.912553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90a2624-40f1-490d-87ee-9a219aead89e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:51.913274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90a2624-40f1-490d-87ee-9a219aead89e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:51.914246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90a2624-40f1-490d-87ee-9a219aead89e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:51.915792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90a2624-40f1-490d-87ee-9a219aead89e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:51.916765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90a2624-40f1-490d-87ee-9a219aead89e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:51.917406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90a2624-40f1-490d-87ee-9a219aead89e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:52.255527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b90a2624-40f1-490d-87ee-9a219aead89e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:52.269321 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b90a2624-40f1-490d-87ee-9a219aead89e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1360 microversion: 2.1 time: 0.372914 Oct 11 04:23:52.275160 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1640/3148] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:51 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1360 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:52.589026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9a1f026-1a4a-4731-8941-e4afb4a3754d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:52.624825 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9a1f026-1a4a-4731-8941-e4afb4a3754d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 1.242317 Oct 11 04:23:52.625464 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1509/3149] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:51 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 1253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:52.723436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b9c3355f-806d-4710-8d08-789b0f3fdb2f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193168b0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:52.819610 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b9c3355f-806d-4710-8d08-789b0f3fdb2f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.106017 Oct 11 04:23:52.824366 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1641/3150] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:52 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:52.982665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-160598348", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "30252624-67f7-4bbb-9346-39722e0301e1"}], "security_groups": [{"name": "tempest-securitygroup--1738823454"}], "key_name": "tempest-keypair-427074894", "user_data": "}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:53.218155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] validate_networks() for [('30252624-67f7-4bbb-9346-39722e0301e1', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:23:53.297811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1547eacf-abf0-4e47-adc2-32ed12062ec4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:53.305844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1547eacf-abf0-4e47-adc2-32ed12062ec4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:53.306997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1547eacf-abf0-4e47-adc2-32ed12062ec4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:53.307699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1547eacf-abf0-4e47-adc2-32ed12062ec4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:53.308141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1547eacf-abf0-4e47-adc2-32ed12062ec4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:53.308845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1547eacf-abf0-4e47-adc2-32ed12062ec4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:53.309295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1547eacf-abf0-4e47-adc2-32ed12062ec4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:53.309720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1547eacf-abf0-4e47-adc2-32ed12062ec4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:53.932721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1547eacf-abf0-4e47-adc2-32ed12062ec4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:53.947224 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1547eacf-abf0-4e47-adc2-32ed12062ec4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1360 microversion: 2.1 time: 0.650314 Oct 11 04:23:53.947224 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1642/3151] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:53 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1360 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:53.960271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-16e98a38-9cf3-4446-b8bd-9ac9d1fe4324 req-b26c0a3d-37ac-47d7-92ce-9f641603262e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f905c4dd-c9f6-452d-bc51-696256de0b36", "name": "network-vif-plugged", "status": "completed", "tag": "5dec51fb-6f29-4e7f-aeb9-d6572fc4d1e2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:54.009541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-16e98a38-9cf3-4446-b8bd-9ac9d1fe4324 req-b26c0a3d-37ac-47d7-92ce-9f641603262e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:54.010033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-16e98a38-9cf3-4446-b8bd-9ac9d1fe4324 req-b26c0a3d-37ac-47d7-92ce-9f641603262e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:54.010495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-16e98a38-9cf3-4446-b8bd-9ac9d1fe4324 req-b26c0a3d-37ac-47d7-92ce-9f641603262e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:54.055359 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-16e98a38-9cf3-4446-b8bd-9ac9d1fe4324 req-b26c0a3d-37ac-47d7-92ce-9f641603262e service nova] Creating event network-vif-plugged:5dec51fb-6f29-4e7f-aeb9-d6572fc4d1e2 for instance f905c4dd-c9f6-452d-bc51-696256de0b36 on n-h1-860892-1 Oct 11 04:23:54.076306 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-16e98a38-9cf3-4446-b8bd-9ac9d1fe4324 req-b26c0a3d-37ac-47d7-92ce-9f641603262e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.131772 Oct 11 04:23:54.077651 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1643/3152] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:54.156330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0b334b1-2478-4e01-bda4-8f1f92078884 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:54.158324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c0b334b1-2478-4e01-bda4-8f1f92078884 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:54.177105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0b334b1-2478-4e01-bda4-8f1f92078884 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:54.177841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0b334b1-2478-4e01-bda4-8f1f92078884 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:54.178507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0b334b1-2478-4e01-bda4-8f1f92078884 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:54.179468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0b334b1-2478-4e01-bda4-8f1f92078884 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:54.184964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0b334b1-2478-4e01-bda4-8f1f92078884 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:54.185722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0b334b1-2478-4e01-bda4-8f1f92078884 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:54.528113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:23:54.530914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:23:54.530914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:23:54.530914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:23:54.532371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:23:54.562968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:54.563805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:54.564270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:54.571812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:54.571812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:54.571812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:54.617405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for project 9a2974866e964ca2864c978d2270bd77. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:23:54.624537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for user 5feceb4a60434064a4fd08f7cc637f32 and project 9a2974866e964ca2864c978d2270bd77. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:23:54.644903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:23:54.647482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:23:54.680292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0b334b1-2478-4e01-bda4-8f1f92078884 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:54.698055 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c0b334b1-2478-4e01-bda4-8f1f92078884 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 0.618789 Oct 11 04:23:54.703428 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1644/3153] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:54 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:54.718931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-19cff5af-dfb3-4335-8dfb-fa74265a38f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19390790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:54.792656 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-19cff5af-dfb3-4335-8dfb-fa74265a38f2 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.087864 Oct 11 04:23:54.793502 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1645/3154] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:54 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:54.876044 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b609a375-b5b0-4e84-9f52-6973a8a08d66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.893253 Oct 11 04:23:54.876835 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1510/3155] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:23:52 2022] POST /compute/v2.1/servers => generated 409 bytes in 1900 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:23:54.888247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9e29d905-8d3b-4013-a825-036794a199ba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:54.889280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9e29d905-8d3b-4013-a825-036794a199ba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:54.967866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-80b0a2dc-e4c2-4fad-ae8b-df39d82c4c33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:54.969358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-80b0a2dc-e4c2-4fad-ae8b-df39d82c4c33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:54.980569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80b0a2dc-e4c2-4fad-ae8b-df39d82c4c33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:54.981070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80b0a2dc-e4c2-4fad-ae8b-df39d82c4c33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:54.981525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80b0a2dc-e4c2-4fad-ae8b-df39d82c4c33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:54.997523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80b0a2dc-e4c2-4fad-ae8b-df39d82c4c33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:54.998432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80b0a2dc-e4c2-4fad-ae8b-df39d82c4c33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:54.999034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80b0a2dc-e4c2-4fad-ae8b-df39d82c4c33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:55.115443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9e29d905-8d3b-4013-a825-036794a199ba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:55.130692 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9e29d905-8d3b-4013-a825-036794a199ba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1237 microversion: 2.1 time: 0.241116 Oct 11 04:23:55.133269 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1646/3156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:54 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1237 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:55.504119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-80b0a2dc-e4c2-4fad-ae8b-df39d82c4c33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:55.526608 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-80b0a2dc-e4c2-4fad-ae8b-df39d82c4c33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1360 microversion: 2.1 time: 0.548506 Oct 11 04:23:55.526608 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1511/3157] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:54 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1360 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:55.730809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1f38643c-4d3b-44fc-a679-34e32db5b3c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:55.731501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1f38643c-4d3b-44fc-a679-34e32db5b3c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:55.748340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f38643c-4d3b-44fc-a679-34e32db5b3c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:55.750183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f38643c-4d3b-44fc-a679-34e32db5b3c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:55.750183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f38643c-4d3b-44fc-a679-34e32db5b3c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:55.761075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f38643c-4d3b-44fc-a679-34e32db5b3c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:55.766399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f38643c-4d3b-44fc-a679-34e32db5b3c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:55.768913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f38643c-4d3b-44fc-a679-34e32db5b3c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:55.809181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-22790928-d704-4e5e-a299-41a4126db65f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda194314c0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:55.875976 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-22790928-d704-4e5e-a299-41a4126db65f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.070972 Oct 11 04:23:55.888973 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1512/3158] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:55 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:56.134606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-80909998-cbde-4e0b-ab72-5c18e92183e1 req-91f2739a-8e67-4d8c-930a-f3854d30d614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f355e5e4-e6af-4b85-9dd8-99b495b0d5a8", "name": "network-vif-plugged", "status": "completed", "tag": "ff3eb7a3-fcc1-45dc-94d9-930423c9496a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:56.158011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-80909998-cbde-4e0b-ab72-5c18e92183e1 req-91f2739a-8e67-4d8c-930a-f3854d30d614 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:56.158984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-80909998-cbde-4e0b-ab72-5c18e92183e1 req-91f2739a-8e67-4d8c-930a-f3854d30d614 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:56.159663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-80909998-cbde-4e0b-ab72-5c18e92183e1 req-91f2739a-8e67-4d8c-930a-f3854d30d614 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:56.197515 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-80909998-cbde-4e0b-ab72-5c18e92183e1 req-91f2739a-8e67-4d8c-930a-f3854d30d614 service nova] Creating event network-vif-plugged:ff3eb7a3-fcc1-45dc-94d9-930423c9496a for instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 on n-h1-860892-1 Oct 11 04:23:56.215933 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-80909998-cbde-4e0b-ab72-5c18e92183e1 req-91f2739a-8e67-4d8c-930a-f3854d30d614 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086784 Oct 11 04:23:56.217014 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1513/3159] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:23:56.250544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1f38643c-4d3b-44fc-a679-34e32db5b3c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:56.269466 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1f38643c-4d3b-44fc-a679-34e32db5b3c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1315 microversion: 2.1 time: 0.541076 Oct 11 04:23:56.272969 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1647/3160] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:55 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1315 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:56.297257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-af439b4e-cce5-4ef9-8034-fdb0eda4501f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:56.310653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-af439b4e-cce5-4ef9-8034-fdb0eda4501f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:56.519026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-af439b4e-cce5-4ef9-8034-fdb0eda4501f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:56.529762 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-af439b4e-cce5-4ef9-8034-fdb0eda4501f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1237 microversion: 2.1 time: 0.258543 Oct 11 04:23:56.536430 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1514/3161] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:56 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1237 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:56.557364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0c843dd5-514a-4be1-984f-be8113e6015e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:56.570708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0c843dd5-514a-4be1-984f-be8113e6015e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:56.599281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c843dd5-514a-4be1-984f-be8113e6015e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:56.604505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c843dd5-514a-4be1-984f-be8113e6015e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:56.604505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c843dd5-514a-4be1-984f-be8113e6015e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:56.604505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c843dd5-514a-4be1-984f-be8113e6015e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:56.604505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c843dd5-514a-4be1-984f-be8113e6015e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:56.604505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c843dd5-514a-4be1-984f-be8113e6015e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:56.900204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3dd14e0-f109-4916-a55b-1dc1ca98eff9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1a4355e0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:56.973669 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3dd14e0-f109-4916-a55b-1dc1ca98eff9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.078942 Oct 11 04:23:56.974499 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1515/3162] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:56 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:57.008248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0c843dd5-514a-4be1-984f-be8113e6015e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:57.017582 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0c843dd5-514a-4be1-984f-be8113e6015e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1360 microversion: 2.1 time: 0.468206 Oct 11 04:23:57.019111 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1648/3163] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:56 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1360 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:57.319584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f57b82b3-8268-41a7-ae48-a2cc0a382d01 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:57.319584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f57b82b3-8268-41a7-ae48-a2cc0a382d01 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:57.346865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57b82b3-8268-41a7-ae48-a2cc0a382d01 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:57.346865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57b82b3-8268-41a7-ae48-a2cc0a382d01 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:57.346865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57b82b3-8268-41a7-ae48-a2cc0a382d01 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:57.346865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57b82b3-8268-41a7-ae48-a2cc0a382d01 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:57.346865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57b82b3-8268-41a7-ae48-a2cc0a382d01 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:57.346865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57b82b3-8268-41a7-ae48-a2cc0a382d01 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:57.492555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f57b82b3-8268-41a7-ae48-a2cc0a382d01 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:57.500512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:23:57.504389 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f57b82b3-8268-41a7-ae48-a2cc0a382d01 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1501 microversion: 2.1 time: 0.206642 Oct 11 04:23:57.505720 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1516/3164] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:57 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1501 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:57.529082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b6650316-8015-474a-9f4d-9fd5d59f7e96 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:23:57.530077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b6650316-8015-474a-9f4d-9fd5d59f7e96 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:57.537743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6650316-8015-474a-9f4d-9fd5d59f7e96 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:57.538328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6650316-8015-474a-9f4d-9fd5d59f7e96 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:57.538815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6650316-8015-474a-9f4d-9fd5d59f7e96 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:57.539682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6650316-8015-474a-9f4d-9fd5d59f7e96 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:57.541254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6650316-8015-474a-9f4d-9fd5d59f7e96 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:57.541856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6650316-8015-474a-9f4d-9fd5d59f7e96 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:57.557256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d813378d-615a-4a7c-9639-47c3895fc688 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:57.558279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d813378d-615a-4a7c-9639-47c3895fc688 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:57.566870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d813378d-615a-4a7c-9639-47c3895fc688 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:57.567577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d813378d-615a-4a7c-9639-47c3895fc688 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:57.568383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d813378d-615a-4a7c-9639-47c3895fc688 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:57.569320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d813378d-615a-4a7c-9639-47c3895fc688 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:57.569998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d813378d-615a-4a7c-9639-47c3895fc688 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:57.570803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d813378d-615a-4a7c-9639-47c3895fc688 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:57.595490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-b6650316-8015-474a-9f4d-9fd5d59f7e96 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lazy-loading 'flavor' on Instance uuid f905c4dd-c9f6-452d-bc51-696256de0b36 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:23:57.650474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d813378d-615a-4a7c-9639-47c3895fc688 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:57.663804 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d813378d-615a-4a7c-9639-47c3895fc688 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1241 microversion: 2.1 time: 0.110130 Oct 11 04:23:57.665660 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1517/3165] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:57 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1241 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:23:57.997207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-410a9730-a3c6-49fd-b5d3-e3859cd61bba tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19b5da60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:59.196463 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-410a9730-a3c6-49fd-b5d3-e3859cd61bba tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 1.211215 Oct 11 04:23:59.197999 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1518/3166] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:23:57 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:59.207477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98f5dcb6-3159-4271-9044-6e21a3ec5db2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:59.208470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98f5dcb6-3159-4271-9044-6e21a3ec5db2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:59.248779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98f5dcb6-3159-4271-9044-6e21a3ec5db2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:59.250460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98f5dcb6-3159-4271-9044-6e21a3ec5db2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:59.253894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98f5dcb6-3159-4271-9044-6e21a3ec5db2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:59.256238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98f5dcb6-3159-4271-9044-6e21a3ec5db2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:59.257015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98f5dcb6-3159-4271-9044-6e21a3ec5db2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:59.260365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98f5dcb6-3159-4271-9044-6e21a3ec5db2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:59.635356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-98f5dcb6-3159-4271-9044-6e21a3ec5db2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:59.646308 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98f5dcb6-3159-4271-9044-6e21a3ec5db2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1544 microversion: 2.1 time: 0.446098 Oct 11 04:23:59.667131 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1519/3167] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:59 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1544 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:59.705320 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b6650316-8015-474a-9f4d-9fd5d59f7e96 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36/action" status: 202 len: 0 microversion: 2.1 time: 2.180644 Oct 11 04:23:59.713292 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1649/3168] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:23:57 2022] POST /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36/action => generated 0 bytes in 2190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:23:59.726629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d9c6419-a33f-42d6-99c9-1e84510e552b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:59.727733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d9c6419-a33f-42d6-99c9-1e84510e552b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:59.729943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-64ebc51e-0d6a-46ca-ac4f-cafe21950282 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:59.736603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-64ebc51e-0d6a-46ca-ac4f-cafe21950282 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:23:59.747544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d9c6419-a33f-42d6-99c9-1e84510e552b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:59.748328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d9c6419-a33f-42d6-99c9-1e84510e552b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:59.750133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d9c6419-a33f-42d6-99c9-1e84510e552b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:59.751137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d9c6419-a33f-42d6-99c9-1e84510e552b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:59.753625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d9c6419-a33f-42d6-99c9-1e84510e552b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:59.757551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d9c6419-a33f-42d6-99c9-1e84510e552b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:59.764657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64ebc51e-0d6a-46ca-ac4f-cafe21950282 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:59.766377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64ebc51e-0d6a-46ca-ac4f-cafe21950282 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:59.769972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64ebc51e-0d6a-46ca-ac4f-cafe21950282 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:59.779096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64ebc51e-0d6a-46ca-ac4f-cafe21950282 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:23:59.780123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64ebc51e-0d6a-46ca-ac4f-cafe21950282 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:23:59.780655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64ebc51e-0d6a-46ca-ac4f-cafe21950282 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:23:59.956556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-64ebc51e-0d6a-46ca-ac4f-cafe21950282 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:23:59.965740 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-64ebc51e-0d6a-46ca-ac4f-cafe21950282 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1297 microversion: 2.1 time: 0.295669 Oct 11 04:23:59.966369 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1520/3169] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:59 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1297 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:23:59.981389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4b38030f-5760-4b22-81ae-67acfb49176f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:23:59.982901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4b38030f-5760-4b22-81ae-67acfb49176f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:00.000205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b38030f-5760-4b22-81ae-67acfb49176f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:00.000707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b38030f-5760-4b22-81ae-67acfb49176f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:00.001126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b38030f-5760-4b22-81ae-67acfb49176f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:00.002027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b38030f-5760-4b22-81ae-67acfb49176f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:00.002686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b38030f-5760-4b22-81ae-67acfb49176f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:00.004926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b38030f-5760-4b22-81ae-67acfb49176f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:00.039345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d9c6419-a33f-42d6-99c9-1e84510e552b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.321718 Oct 11 04:24:00.040987 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1650/3170] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:23:59 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-interface => generated 285 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:00.215556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-971b4f00-5d99-408a-96e1-6843cafa40d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda192a5280>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:00.682509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4b38030f-5760-4b22-81ae-67acfb49176f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:00.696653 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4b38030f-5760-4b22-81ae-67acfb49176f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.728906 Oct 11 04:24:00.698656 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1521/3171] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:23:59 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:00.979312 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-971b4f00-5d99-408a-96e1-6843cafa40d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.768709 Oct 11 04:24:00.979966 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1651/3172] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:00 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:00.992273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-60764cda-6685-407d-abaf-702793ae6d04 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:00.993296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-60764cda-6685-407d-abaf-702793ae6d04 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:01.002519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60764cda-6685-407d-abaf-702793ae6d04 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:01.002940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60764cda-6685-407d-abaf-702793ae6d04 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:01.003387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60764cda-6685-407d-abaf-702793ae6d04 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:01.004113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60764cda-6685-407d-abaf-702793ae6d04 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:01.004835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60764cda-6685-407d-abaf-702793ae6d04 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:01.005271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60764cda-6685-407d-abaf-702793ae6d04 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:01.205920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-60764cda-6685-407d-abaf-702793ae6d04 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:01.214439 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-60764cda-6685-407d-abaf-702793ae6d04 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1295 microversion: 2.1 time: 0.226731 Oct 11 04:24:01.237514 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1522/3173] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:00 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1295 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:01.722730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-422a8b25-0d23-4401-959a-8c2651647351 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:01.723364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-422a8b25-0d23-4401-959a-8c2651647351 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:01.745964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422a8b25-0d23-4401-959a-8c2651647351 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:01.755234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422a8b25-0d23-4401-959a-8c2651647351 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:01.755704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422a8b25-0d23-4401-959a-8c2651647351 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:01.756463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422a8b25-0d23-4401-959a-8c2651647351 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:01.761110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422a8b25-0d23-4401-959a-8c2651647351 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:01.765311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-422a8b25-0d23-4401-959a-8c2651647351 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:01.770502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:01.996445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-502c8848-b877-482b-aa5d-473d9946620e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19ab83a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:02.101263 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-502c8848-b877-482b-aa5d-473d9946620e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.109406 Oct 11 04:24:02.106566 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1523/3174] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:01 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:02.238337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6920aa8e-7f74-41c6-9d6f-6fd70adb25fc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:02.238968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6920aa8e-7f74-41c6-9d6f-6fd70adb25fc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:02.257757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6920aa8e-7f74-41c6-9d6f-6fd70adb25fc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:02.259440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6920aa8e-7f74-41c6-9d6f-6fd70adb25fc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:02.260075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6920aa8e-7f74-41c6-9d6f-6fd70adb25fc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:02.263532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6920aa8e-7f74-41c6-9d6f-6fd70adb25fc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:02.264185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6920aa8e-7f74-41c6-9d6f-6fd70adb25fc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:02.264799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6920aa8e-7f74-41c6-9d6f-6fd70adb25fc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:02.416683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6920aa8e-7f74-41c6-9d6f-6fd70adb25fc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:02.428082 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6920aa8e-7f74-41c6-9d6f-6fd70adb25fc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1295 microversion: 2.1 time: 0.194884 Oct 11 04:24:02.444017 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1524/3175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:02 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1295 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:02.613149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-422a8b25-0d23-4401-959a-8c2651647351 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:02.626256 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-422a8b25-0d23-4401-959a-8c2651647351 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.908152 Oct 11 04:24:02.628038 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1652/3176] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:01 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 910 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:02.678438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-88815bde-939c-424f-b96e-c389b7c3796a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'create', calling method: .version_select at 0x7fda19a02ee0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-837359537", "description": "tempest-description-864157991"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:03.121062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0fa3a75d-707c-4862-a88c-4a268e67fb9c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19327d30>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:03.217317 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0fa3a75d-707c-4862-a88c-4a268e67fb9c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.103823 Oct 11 04:24:03.219810 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1653/3177] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:03 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:03.248264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-91eacc67-df24-49c5-a777-4dbd0da51542 req-50e3d4b0-94d4-4add-b32e-b93affd9bbc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f355e5e4-e6af-4b85-9dd8-99b495b0d5a8", "tag": "ff3eb7a3-fcc1-45dc-94d9-930423c9496a"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:03.279623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-91eacc67-df24-49c5-a777-4dbd0da51542 req-50e3d4b0-94d4-4add-b32e-b93affd9bbc2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:03.286340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-91eacc67-df24-49c5-a777-4dbd0da51542 req-50e3d4b0-94d4-4add-b32e-b93affd9bbc2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:03.286952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-91eacc67-df24-49c5-a777-4dbd0da51542 req-50e3d4b0-94d4-4add-b32e-b93affd9bbc2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:03.323992 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-91eacc67-df24-49c5-a777-4dbd0da51542 req-50e3d4b0-94d4-4add-b32e-b93affd9bbc2 service nova] Creating event network-changed:ff3eb7a3-fcc1-45dc-94d9-930423c9496a for instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 on n-h1-860892-1 Oct 11 04:24:03.330321 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-91eacc67-df24-49c5-a777-4dbd0da51542 req-50e3d4b0-94d4-4add-b32e-b93affd9bbc2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085432 Oct 11 04:24:03.331682 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1654/3178] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:03.468641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f1cd9041-dc06-483c-953a-f3841dc36d9f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:03.469909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f1cd9041-dc06-483c-953a-f3841dc36d9f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:03.488561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1cd9041-dc06-483c-953a-f3841dc36d9f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:03.495562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1cd9041-dc06-483c-953a-f3841dc36d9f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:03.495562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1cd9041-dc06-483c-953a-f3841dc36d9f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:03.495562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1cd9041-dc06-483c-953a-f3841dc36d9f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:03.495562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1cd9041-dc06-483c-953a-f3841dc36d9f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:03.495562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1cd9041-dc06-483c-953a-f3841dc36d9f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:03.844485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f1cd9041-dc06-483c-953a-f3841dc36d9f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:03.861429 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f1cd9041-dc06-483c-953a-f3841dc36d9f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1363 microversion: 2.1 time: 0.399584 Oct 11 04:24:03.862271 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1655/3179] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:03 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:03.868767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-01fadaa6-68e8-4b3d-993a-20f198372bda tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:03.869939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-01fadaa6-68e8-4b3d-993a-20f198372bda tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:03.878569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fadaa6-68e8-4b3d-993a-20f198372bda tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:03.880897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fadaa6-68e8-4b3d-993a-20f198372bda tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:03.887512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fadaa6-68e8-4b3d-993a-20f198372bda tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:03.889592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fadaa6-68e8-4b3d-993a-20f198372bda tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:03.895855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fadaa6-68e8-4b3d-993a-20f198372bda tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:03.897090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fadaa6-68e8-4b3d-993a-20f198372bda tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:04.354307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-01fadaa6-68e8-4b3d-993a-20f198372bda tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:04.363731 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-01fadaa6-68e8-4b3d-993a-20f198372bda tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.499026 Oct 11 04:24:04.364314 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1656/3180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:03 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:04.384399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2dc1ba81-2cf2-4bd2-87cd-55331e9dec83 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19267820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:04.508661 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2dc1ba81-2cf2-4bd2-87cd-55331e9dec83 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.142999 Oct 11 04:24:04.509265 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1657/3181] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:04 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:04.598042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:04.888352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f315a0e9-343b-474b-9ddb-c461c9101bf3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:04.889064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f315a0e9-343b-474b-9ddb-c461c9101bf3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:04.895881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f315a0e9-343b-474b-9ddb-c461c9101bf3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:04.896974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f315a0e9-343b-474b-9ddb-c461c9101bf3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:04.897631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f315a0e9-343b-474b-9ddb-c461c9101bf3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:04.898447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f315a0e9-343b-474b-9ddb-c461c9101bf3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:04.899601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f315a0e9-343b-474b-9ddb-c461c9101bf3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:04.900128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f315a0e9-343b-474b-9ddb-c461c9101bf3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:05.121085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:05.205122 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-88815bde-939c-424f-b96e-c389b7c3796a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 2.746430 Oct 11 04:24:05.205722 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1525/3182] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:24:02 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 2748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:05.214397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f315a0e9-343b-474b-9ddb-c461c9101bf3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:05.224364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d770f6d8-f9a7-4024-bf5e-a47432de0ea4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'create', calling method: .version_select at 0x7fda19ae34c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1406258185", "description": "tempest-description-72972092"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:05.232593 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f315a0e9-343b-474b-9ddb-c461c9101bf3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1363 microversion: 2.1 time: 0.349128 Oct 11 04:24:05.233402 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1658/3183] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:04 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:05.386858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-42f0bf0e-285e-42eb-8320-6257cbd0a615 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:05.387717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-42f0bf0e-285e-42eb-8320-6257cbd0a615 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:05.404578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42f0bf0e-285e-42eb-8320-6257cbd0a615 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:05.407055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42f0bf0e-285e-42eb-8320-6257cbd0a615 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:05.410062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42f0bf0e-285e-42eb-8320-6257cbd0a615 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:05.419939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42f0bf0e-285e-42eb-8320-6257cbd0a615 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:05.419939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42f0bf0e-285e-42eb-8320-6257cbd0a615 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:05.419939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42f0bf0e-285e-42eb-8320-6257cbd0a615 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:05.622486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-42f0bf0e-285e-42eb-8320-6257cbd0a615 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:05.633580 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-42f0bf0e-285e-42eb-8320-6257cbd0a615 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.250549 Oct 11 04:24:05.647941 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1659/3184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:05 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:05.662383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c71ae531-6c40-435d-b7dd-5293891cadef tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda192e3af0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:05.729243 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c71ae531-6c40-435d-b7dd-5293891cadef tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.071694 Oct 11 04:24:05.731554 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1660/3185] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:05 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:05.843313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-32a730b0-a8f6-4e6c-b073-79a7d2015693 req-f58967e6-d772-4c3b-b042-fa0e0d3fd45f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d32f0ab1-346d-487a-aa08-ebd1656142a7", "tag": "6993adde-be55-4ee5-a441-ab52e2f48759"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:05.864488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-32a730b0-a8f6-4e6c-b073-79a7d2015693 req-f58967e6-d772-4c3b-b042-fa0e0d3fd45f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:05.867147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-32a730b0-a8f6-4e6c-b073-79a7d2015693 req-f58967e6-d772-4c3b-b042-fa0e0d3fd45f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:05.867958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-32a730b0-a8f6-4e6c-b073-79a7d2015693 req-f58967e6-d772-4c3b-b042-fa0e0d3fd45f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:05.894844 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-32a730b0-a8f6-4e6c-b073-79a7d2015693 req-f58967e6-d772-4c3b-b042-fa0e0d3fd45f service nova] Creating event network-changed:6993adde-be55-4ee5-a441-ab52e2f48759 for instance d32f0ab1-346d-487a-aa08-ebd1656142a7 on n-h2-860892-1 Oct 11 04:24:05.905984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-32a730b0-a8f6-4e6c-b073-79a7d2015693 req-f58967e6-d772-4c3b-b042-fa0e0d3fd45f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067678 Oct 11 04:24:05.911642 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1661/3186] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:06.222490 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d770f6d8-f9a7-4024-bf5e-a47432de0ea4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 1.006324 Oct 11 04:24:06.223603 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1526/3187] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:24:05 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 1008 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:06.264260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-753582ae-6486-4cb1-b4e6-6760595dd84f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:06.268163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-753582ae-6486-4cb1-b4e6-6760595dd84f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:06.343723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753582ae-6486-4cb1-b4e6-6760595dd84f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:06.349267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753582ae-6486-4cb1-b4e6-6760595dd84f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:06.349267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753582ae-6486-4cb1-b4e6-6760595dd84f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:06.349267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753582ae-6486-4cb1-b4e6-6760595dd84f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:06.357891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753582ae-6486-4cb1-b4e6-6760595dd84f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:06.361325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753582ae-6486-4cb1-b4e6-6760595dd84f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:06.631781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=12 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:06.641457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-334731282", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "a2440285-7102-45ef-9ea2-a8f1a613870d"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:06.664921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=87 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:06.766362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-753582ae-6486-4cb1-b4e6-6760595dd84f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:06.778483 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-753582ae-6486-4cb1-b4e6-6760595dd84f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1363 microversion: 2.1 time: 0.519401 Oct 11 04:24:06.780851 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1662/3188] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:06 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1363 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:06.786744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b13c97ce-0ef1-4a7b-a527-2e35744982a7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:06.788134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b13c97ce-0ef1-4a7b-a527-2e35744982a7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:06.811367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13c97ce-0ef1-4a7b-a527-2e35744982a7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:06.814224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13c97ce-0ef1-4a7b-a527-2e35744982a7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:06.814960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13c97ce-0ef1-4a7b-a527-2e35744982a7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:06.830724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] validate_networks() for [('a2440285-7102-45ef-9ea2-a8f1a613870d', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:24:06.831679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13c97ce-0ef1-4a7b-a527-2e35744982a7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:06.832188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13c97ce-0ef1-4a7b-a527-2e35744982a7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:06.832641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13c97ce-0ef1-4a7b-a527-2e35744982a7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:07.116396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b13c97ce-0ef1-4a7b-a527-2e35744982a7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:07.134131 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b13c97ce-0ef1-4a7b-a527-2e35744982a7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.351236 Oct 11 04:24:07.136909 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1663/3189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:06 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:07.156195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3fa690e0-d5c3-41f7-a344-0d370a8b087d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19327a60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:07.382472 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3fa690e0-d5c3-41f7-a344-0d370a8b087d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.231211 Oct 11 04:24:07.383070 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1664/3190] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:07 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:07.801681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b486101d-2548-403e-9ed5-b4baed93d251 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:07.802353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b486101d-2548-403e-9ed5-b4baed93d251 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:07.822543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b486101d-2548-403e-9ed5-b4baed93d251 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:07.823053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b486101d-2548-403e-9ed5-b4baed93d251 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:07.823498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b486101d-2548-403e-9ed5-b4baed93d251 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:07.824453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b486101d-2548-403e-9ed5-b4baed93d251 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:07.824914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b486101d-2548-403e-9ed5-b4baed93d251 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:07.825442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b486101d-2548-403e-9ed5-b4baed93d251 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:08.143325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:24:08.143830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:24:08.144272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:24:08.144689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:24:08.145103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:24:08.161320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:08.161842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:08.162481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:08.163404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:08.163862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:08.164410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:08.177966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b486101d-2548-403e-9ed5-b4baed93d251 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:08.189675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Getting quotas for project 5a9d56ebae03424f9f9892abf32b7579. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:24:08.194269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Getting quotas for user 47f8ee8bc00840c99abafb15e9d32b84 and project 5a9d56ebae03424f9f9892abf32b7579. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:24:08.208458 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b486101d-2548-403e-9ed5-b4baed93d251 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1363 microversion: 2.1 time: 0.410346 Oct 11 04:24:08.212714 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1665/3191] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:07 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1363 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:08.214531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:24:08.219640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:24:08.232524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f15baa40-361a-4376-97de-74d590e11ba1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:08.233553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f15baa40-361a-4376-97de-74d590e11ba1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:08.251256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f15baa40-361a-4376-97de-74d590e11ba1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:08.253623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f15baa40-361a-4376-97de-74d590e11ba1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:08.255146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f15baa40-361a-4376-97de-74d590e11ba1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:08.256761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f15baa40-361a-4376-97de-74d590e11ba1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:08.257971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f15baa40-361a-4376-97de-74d590e11ba1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:08.259927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f15baa40-361a-4376-97de-74d590e11ba1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:08.515479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f15baa40-361a-4376-97de-74d590e11ba1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:08.538074 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f15baa40-361a-4376-97de-74d590e11ba1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.323819 Oct 11 04:24:08.539146 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1666/3192] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:08 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:08.547872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9389b13e-5b6e-44cf-a159-337756ac76c5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193c5280>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:08.562179 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c8d6a1cd-0127-4712-a596-fc67c058ad5e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.930661 Oct 11 04:24:08.563678 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1527/3193] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:24:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1933 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:24:08.582359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9b7ca9c-9657-42af-b04c-957a25812282 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:08.583829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e9b7ca9c-9657-42af-b04c-957a25812282 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:08.626737 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9389b13e-5b6e-44cf-a159-337756ac76c5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.085331 Oct 11 04:24:08.630534 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1667/3194] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:08 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:08.755299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9b7ca9c-9657-42af-b04c-957a25812282 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:08.771922 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9b7ca9c-9657-42af-b04c-957a25812282 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1215 microversion: 2.1 time: 0.197967 Oct 11 04:24:08.779110 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1528/3195] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:08 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1215 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:09.263760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65a2674c-b9c5-4b1e-bf48-ffca076f2336 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:09.263760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-65a2674c-b9c5-4b1e-bf48-ffca076f2336 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:09.263760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65a2674c-b9c5-4b1e-bf48-ffca076f2336 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:09.263760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65a2674c-b9c5-4b1e-bf48-ffca076f2336 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:09.263760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65a2674c-b9c5-4b1e-bf48-ffca076f2336 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:09.263760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65a2674c-b9c5-4b1e-bf48-ffca076f2336 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:09.263760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65a2674c-b9c5-4b1e-bf48-ffca076f2336 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:09.263760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65a2674c-b9c5-4b1e-bf48-ffca076f2336 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:09.453107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-65a2674c-b9c5-4b1e-bf48-ffca076f2336 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:09.462793 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-65a2674c-b9c5-4b1e-bf48-ffca076f2336 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1363 microversion: 2.1 time: 0.231126 Oct 11 04:24:09.469752 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1668/3196] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:09 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1363 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:09.568919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b0de788a-dc88-4e0b-9254-787639964268 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:09.578378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b0de788a-dc88-4e0b-9254-787639964268 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:09.605854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0de788a-dc88-4e0b-9254-787639964268 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:09.606395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0de788a-dc88-4e0b-9254-787639964268 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:09.606854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0de788a-dc88-4e0b-9254-787639964268 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:09.607569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0de788a-dc88-4e0b-9254-787639964268 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:09.608023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0de788a-dc88-4e0b-9254-787639964268 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:09.615300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0de788a-dc88-4e0b-9254-787639964268 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:09.647955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a8ba63bb-6f7c-46dd-9671-1e0d6e636b5f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda194ef160>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:09.753069 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a8ba63bb-6f7c-46dd-9671-1e0d6e636b5f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.108623 Oct 11 04:24:09.754078 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1669/3197] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:09 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:09.804060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-42a036de-f2c4-423c-ac5a-78dfe39c3533 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:09.806401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-42a036de-f2c4-423c-ac5a-78dfe39c3533 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:09.920674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-42a036de-f2c4-423c-ac5a-78dfe39c3533 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:09.949075 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-42a036de-f2c4-423c-ac5a-78dfe39c3533 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1215 microversion: 2.1 time: 0.152490 Oct 11 04:24:09.949950 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1670/3198] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:09 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:10.088937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b0de788a-dc88-4e0b-9254-787639964268 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:10.101353 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b0de788a-dc88-4e0b-9254-787639964268 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.535676 Oct 11 04:24:10.121205 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1529/3199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:09 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:10.492862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-09a21860-9606-4677-9ed5-76b53ed450a2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:10.493487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-09a21860-9606-4677-9ed5-76b53ed450a2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:10.500840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a21860-9606-4677-9ed5-76b53ed450a2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:10.501335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a21860-9606-4677-9ed5-76b53ed450a2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:10.501785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a21860-9606-4677-9ed5-76b53ed450a2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:10.502516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a21860-9606-4677-9ed5-76b53ed450a2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:10.502978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a21860-9606-4677-9ed5-76b53ed450a2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:10.503409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a21860-9606-4677-9ed5-76b53ed450a2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:10.717311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-09a21860-9606-4677-9ed5-76b53ed450a2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:10.729234 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-09a21860-9606-4677-9ed5-76b53ed450a2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1363 microversion: 2.1 time: 0.240147 Oct 11 04:24:10.731069 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1671/3200] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:10 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1363 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:10.776570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ebccc1a9-0502-4f9e-97fb-7ff8d2214ebc tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda191d3790>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:10.841442 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ebccc1a9-0502-4f9e-97fb-7ff8d2214ebc tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.069147 Oct 11 04:24:10.842307 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1530/3201] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:10 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:10.993538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c73ff6e9-494e-44ad-870c-ecaa0f40350c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:10.997914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c73ff6e9-494e-44ad-870c-ecaa0f40350c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:11.145966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e4f92dc1-7f40-422f-9606-aac02cb28eb9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:11.146977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c73ff6e9-494e-44ad-870c-ecaa0f40350c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:11.149297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e4f92dc1-7f40-422f-9606-aac02cb28eb9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:11.155806 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c73ff6e9-494e-44ad-870c-ecaa0f40350c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1215 microversion: 2.1 time: 0.165898 Oct 11 04:24:11.161582 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1672/3202] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:10 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1215 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:11.212653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f92dc1-7f40-422f-9606-aac02cb28eb9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:11.215312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f92dc1-7f40-422f-9606-aac02cb28eb9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:11.217305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f92dc1-7f40-422f-9606-aac02cb28eb9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:11.218987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f92dc1-7f40-422f-9606-aac02cb28eb9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:11.223583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f92dc1-7f40-422f-9606-aac02cb28eb9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:11.224245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4f92dc1-7f40-422f-9606-aac02cb28eb9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:11.443407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e4f92dc1-7f40-422f-9606-aac02cb28eb9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:11.472829 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e4f92dc1-7f40-422f-9606-aac02cb28eb9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.341672 Oct 11 04:24:11.489495 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1531/3203] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:11 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:11.756374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35a1c3bd-eddf-4766-a1bd-0a4f5cbb0c08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:11.757136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-35a1c3bd-eddf-4766-a1bd-0a4f5cbb0c08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:11.766171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a1c3bd-eddf-4766-a1bd-0a4f5cbb0c08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:11.766841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a1c3bd-eddf-4766-a1bd-0a4f5cbb0c08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:11.767380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a1c3bd-eddf-4766-a1bd-0a4f5cbb0c08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:11.768151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a1c3bd-eddf-4766-a1bd-0a4f5cbb0c08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:11.768676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a1c3bd-eddf-4766-a1bd-0a4f5cbb0c08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:11.769286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35a1c3bd-eddf-4766-a1bd-0a4f5cbb0c08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:11.865337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-70d9fd0a-0552-4998-aa5d-bd08fcde6afc tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19b2f790>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:11.931573 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-70d9fd0a-0552-4998-aa5d-bd08fcde6afc tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1413 microversion: 2.1 time: 0.078501 Oct 11 04:24:11.932895 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1532/3204] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:11 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1413 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:12.002531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35a1c3bd-eddf-4766-a1bd-0a4f5cbb0c08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:12.014740 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-35a1c3bd-eddf-4766-a1bd-0a4f5cbb0c08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1363 microversion: 2.1 time: 0.262500 Oct 11 04:24:12.018240 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1673/3205] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:11 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:12.181573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-24367849-9626-4c3b-82fb-a43d1cae415d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:12.182698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-24367849-9626-4c3b-82fb-a43d1cae415d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:12.191346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24367849-9626-4c3b-82fb-a43d1cae415d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:12.192013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24367849-9626-4c3b-82fb-a43d1cae415d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:12.192655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24367849-9626-4c3b-82fb-a43d1cae415d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:12.193511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24367849-9626-4c3b-82fb-a43d1cae415d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:12.194310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24367849-9626-4c3b-82fb-a43d1cae415d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:12.194980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24367849-9626-4c3b-82fb-a43d1cae415d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:12.308189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-24367849-9626-4c3b-82fb-a43d1cae415d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:12.316287 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-24367849-9626-4c3b-82fb-a43d1cae415d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1267 microversion: 2.1 time: 0.139528 Oct 11 04:24:12.316848 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1533/3206] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:12 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:12.498624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a2219a1-f7e3-4010-bdb5-429dd118fd3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:12.499260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a2219a1-f7e3-4010-bdb5-429dd118fd3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:12.505662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a2219a1-f7e3-4010-bdb5-429dd118fd3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:12.506156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a2219a1-f7e3-4010-bdb5-429dd118fd3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:12.506643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a2219a1-f7e3-4010-bdb5-429dd118fd3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:12.507323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a2219a1-f7e3-4010-bdb5-429dd118fd3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:12.507775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a2219a1-f7e3-4010-bdb5-429dd118fd3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:12.508433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a2219a1-f7e3-4010-bdb5-429dd118fd3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:12.663315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a2219a1-f7e3-4010-bdb5-429dd118fd3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:12.672039 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a2219a1-f7e3-4010-bdb5-429dd118fd3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.177294 Oct 11 04:24:12.672950 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1674/3207] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:12 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:12.948691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-45b0cfd1-f48c-44c5-bbe1-baef06a0bf72 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda191f5ca0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:12.995910 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-45b0cfd1-f48c-44c5-bbe1-baef06a0bf72 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1422 microversion: 2.1 time: 0.051655 Oct 11 04:24:13.005787 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1534/3208] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:12 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1422 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:13.011724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f92ed1d6-1af2-478f-9341-ae347edb75dd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193ce1f0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:13.040794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b60e3522-4e78-4c02-9ec6-ec068ffd7679 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:13.041433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b60e3522-4e78-4c02-9ec6-ec068ffd7679 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:13.058587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b60e3522-4e78-4c02-9ec6-ec068ffd7679 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:13.058587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b60e3522-4e78-4c02-9ec6-ec068ffd7679 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:13.058587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b60e3522-4e78-4c02-9ec6-ec068ffd7679 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:13.058587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b60e3522-4e78-4c02-9ec6-ec068ffd7679 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:13.058587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b60e3522-4e78-4c02-9ec6-ec068ffd7679 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:13.059049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b60e3522-4e78-4c02-9ec6-ec068ffd7679 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:13.089254 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f92ed1d6-1af2-478f-9341-ae347edb75dd tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 200 len: 1422 microversion: 2.1 time: 0.081743 Oct 11 04:24:13.099145 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1675/3209] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:13 2022] GET /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 1422 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:13.104335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9e472c85-fc93-4240-9474-b9f8458973c5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda193fc8b0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:13.491131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b60e3522-4e78-4c02-9ec6-ec068ffd7679 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:13.500851 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b60e3522-4e78-4c02-9ec6-ec068ffd7679 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1363 microversion: 2.1 time: 0.463814 Oct 11 04:24:13.501541 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1535/3210] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:13 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1363 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:13.542728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f294d112-9d1f-430c-9a1a-23364623a5d6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:13.543590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f294d112-9d1f-430c-9a1a-23364623a5d6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:13.551522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f294d112-9d1f-430c-9a1a-23364623a5d6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:13.551522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f294d112-9d1f-430c-9a1a-23364623a5d6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:13.551834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f294d112-9d1f-430c-9a1a-23364623a5d6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:13.552577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f294d112-9d1f-430c-9a1a-23364623a5d6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:13.553235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f294d112-9d1f-430c-9a1a-23364623a5d6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:13.553860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f294d112-9d1f-430c-9a1a-23364623a5d6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:13.637308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f294d112-9d1f-430c-9a1a-23364623a5d6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:13.646060 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f294d112-9d1f-430c-9a1a-23364623a5d6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1285 microversion: 2.1 time: 0.108371 Oct 11 04:24:13.646674 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1536/3211] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:13 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:13.654488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-de63805e-17ee-4b2e-884e-f045e9736eee req-66ce089d-5718-4d95-b72b-5f004499376f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32f0ab1-346d-487a-aa08-ebd1656142a7", "name": "network-vif-plugged", "status": "completed", "tag": "6993adde-be55-4ee5-a441-ab52e2f48759"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:13.666633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-de63805e-17ee-4b2e-884e-f045e9736eee req-66ce089d-5718-4d95-b72b-5f004499376f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:13.667168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-de63805e-17ee-4b2e-884e-f045e9736eee req-66ce089d-5718-4d95-b72b-5f004499376f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:13.667577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-de63805e-17ee-4b2e-884e-f045e9736eee req-66ce089d-5718-4d95-b72b-5f004499376f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:13.682917 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-de63805e-17ee-4b2e-884e-f045e9736eee req-66ce089d-5718-4d95-b72b-5f004499376f service nova] Creating event network-vif-plugged:6993adde-be55-4ee5-a441-ab52e2f48759 for instance d32f0ab1-346d-487a-aa08-ebd1656142a7 on n-h2-860892-1 Oct 11 04:24:13.687459 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-de63805e-17ee-4b2e-884e-f045e9736eee req-66ce089d-5718-4d95-b72b-5f004499376f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039663 Oct 11 04:24:13.688173 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1537/3212] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:13.697417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-43b8ea54-e1b8-4b28-9307-fcb07131b5fe tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:13.698146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-43b8ea54-e1b8-4b28-9307-fcb07131b5fe tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:13.704998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43b8ea54-e1b8-4b28-9307-fcb07131b5fe tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:13.709344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43b8ea54-e1b8-4b28-9307-fcb07131b5fe tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:13.709344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43b8ea54-e1b8-4b28-9307-fcb07131b5fe tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:13.709344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43b8ea54-e1b8-4b28-9307-fcb07131b5fe tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:13.709344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43b8ea54-e1b8-4b28-9307-fcb07131b5fe tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:13.709344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-43b8ea54-e1b8-4b28-9307-fcb07131b5fe tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:13.998615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-43b8ea54-e1b8-4b28-9307-fcb07131b5fe tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:14.009450 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-43b8ea54-e1b8-4b28-9307-fcb07131b5fe tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.316600 Oct 11 04:24:14.032026 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1538/3213] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:13 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:14.527967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-caa1c0a5-3a5f-4456-9e11-dc4bfe14e5ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:14.528623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-caa1c0a5-3a5f-4456-9e11-dc4bfe14e5ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:14.536079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa1c0a5-3a5f-4456-9e11-dc4bfe14e5ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:14.536586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa1c0a5-3a5f-4456-9e11-dc4bfe14e5ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:14.537022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa1c0a5-3a5f-4456-9e11-dc4bfe14e5ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:14.537735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa1c0a5-3a5f-4456-9e11-dc4bfe14e5ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:14.538225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa1c0a5-3a5f-4456-9e11-dc4bfe14e5ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:14.542918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa1c0a5-3a5f-4456-9e11-dc4bfe14e5ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:15.078692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-caa1c0a5-3a5f-4456-9e11-dc4bfe14e5ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:15.094888 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9e472c85-fc93-4240-9474-b9f8458973c5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 204 len: 0 microversion: 2.1 time: 1.994349 Oct 11 04:24:15.095465 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1676/3214] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:13 2022] DELETE /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 0 bytes in 1996 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:24:15.119083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1341a62f-6087-458d-a93a-2138646fbd9a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:15.119083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1341a62f-6087-458d-a93a-2138646fbd9a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:15.121407 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-caa1c0a5-3a5f-4456-9e11-dc4bfe14e5ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1363 microversion: 2.1 time: 0.564534 Oct 11 04:24:15.125018 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1539/3215] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:14 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1363 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:15.141553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1341a62f-6087-458d-a93a-2138646fbd9a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:15.143149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09bd787a-da05-4011-a90b-5a2e7e99d651 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:15.145672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09bd787a-da05-4011-a90b-5a2e7e99d651 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:15.146533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1341a62f-6087-458d-a93a-2138646fbd9a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:15.151815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1341a62f-6087-458d-a93a-2138646fbd9a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:15.153306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1341a62f-6087-458d-a93a-2138646fbd9a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:15.155471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1341a62f-6087-458d-a93a-2138646fbd9a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:15.161547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1341a62f-6087-458d-a93a-2138646fbd9a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:15.180045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd787a-da05-4011-a90b-5a2e7e99d651 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:15.180984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd787a-da05-4011-a90b-5a2e7e99d651 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:15.181671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd787a-da05-4011-a90b-5a2e7e99d651 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:15.184293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd787a-da05-4011-a90b-5a2e7e99d651 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:15.185280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd787a-da05-4011-a90b-5a2e7e99d651 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:15.187798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd787a-da05-4011-a90b-5a2e7e99d651 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:15.678655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1341a62f-6087-458d-a93a-2138646fbd9a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:15.695361 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1341a62f-6087-458d-a93a-2138646fbd9a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1315 microversion: 2.1 time: 0.598380 Oct 11 04:24:15.712097 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1677/3216] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:15 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1315 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:15.717893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0d42cb3-8d75-4688-896d-ab9bc223b9b1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:15.731902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d0d42cb3-8d75-4688-896d-ab9bc223b9b1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:15.741005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d42cb3-8d75-4688-896d-ab9bc223b9b1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:15.741504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d42cb3-8d75-4688-896d-ab9bc223b9b1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:15.741943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d42cb3-8d75-4688-896d-ab9bc223b9b1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:15.742787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d42cb3-8d75-4688-896d-ab9bc223b9b1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:15.743240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d42cb3-8d75-4688-896d-ab9bc223b9b1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:15.743662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0d42cb3-8d75-4688-896d-ab9bc223b9b1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:15.812320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d0d42cb3-8d75-4688-896d-ab9bc223b9b1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:24:16.002994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:16.094467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09bd787a-da05-4011-a90b-5a2e7e99d651 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:16.109610 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09bd787a-da05-4011-a90b-5a2e7e99d651 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.981197 Oct 11 04:24:16.111754 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1540/3217] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:15 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 986 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:16.126887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-79725016-81b1-4b60-aff5-0754ee5dd3b7 req-9cf7dc7f-e9c2-4acd-87b0-5eb95bb4017c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "597b08ac-2ff7-485c-9ccc-cc37c67817df", "name": "network-vif-unplugged", "status": "completed", "tag": "1a26991b-531a-4238-9366-bb99758b06be"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:16.148603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-79725016-81b1-4b60-aff5-0754ee5dd3b7 req-9cf7dc7f-e9c2-4acd-87b0-5eb95bb4017c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:16.153627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-79725016-81b1-4b60-aff5-0754ee5dd3b7 req-9cf7dc7f-e9c2-4acd-87b0-5eb95bb4017c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:16.154353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-79725016-81b1-4b60-aff5-0754ee5dd3b7 req-9cf7dc7f-e9c2-4acd-87b0-5eb95bb4017c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:16.195133 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-79725016-81b1-4b60-aff5-0754ee5dd3b7 req-9cf7dc7f-e9c2-4acd-87b0-5eb95bb4017c service nova] Creating event network-vif-unplugged:1a26991b-531a-4238-9366-bb99758b06be for instance 597b08ac-2ff7-485c-9ccc-cc37c67817df on n-h2-860892-1 Oct 11 04:24:16.202474 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-79725016-81b1-4b60-aff5-0754ee5dd3b7 req-9cf7dc7f-e9c2-4acd-87b0-5eb95bb4017c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087815 Oct 11 04:24:16.209764 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1541/3218] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:16.219150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd449d7b-dd16-47ef-a3fe-a272a38c6776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:16.220153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd449d7b-dd16-47ef-a3fe-a272a38c6776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:16.228280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd449d7b-dd16-47ef-a3fe-a272a38c6776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:16.231432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd449d7b-dd16-47ef-a3fe-a272a38c6776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:16.231432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd449d7b-dd16-47ef-a3fe-a272a38c6776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:16.231432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd449d7b-dd16-47ef-a3fe-a272a38c6776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:16.231432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd449d7b-dd16-47ef-a3fe-a272a38c6776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:16.231432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd449d7b-dd16-47ef-a3fe-a272a38c6776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:16.261038 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d0d42cb3-8d75-4688-896d-ab9bc223b9b1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 204 len: 0 microversion: 2.1 time: 0.547507 Oct 11 04:24:16.262787 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1678/3219] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:24:15 2022] DELETE /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 0 bytes in 550 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:24:16.464476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-333022516", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "0a59a6a9-e422-43ce-a186-e7294a4957eb"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:16.598133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] validate_networks() for [('0a59a6a9-e422-43ce-a186-e7294a4957eb', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:24:16.610029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd449d7b-dd16-47ef-a3fe-a272a38c6776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:16.618405 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd449d7b-dd16-47ef-a3fe-a272a38c6776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1550 microversion: 2.1 time: 0.404256 Oct 11 04:24:16.624394 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1542/3220] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:16 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1550 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:16.644013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d88184b5-555b-4dd6-a78e-9c3c05cdd6cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:16.644786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d88184b5-555b-4dd6-a78e-9c3c05cdd6cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:16.651688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88184b5-555b-4dd6-a78e-9c3c05cdd6cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:16.652186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88184b5-555b-4dd6-a78e-9c3c05cdd6cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:16.652817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88184b5-555b-4dd6-a78e-9c3c05cdd6cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:16.653834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88184b5-555b-4dd6-a78e-9c3c05cdd6cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:16.654405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88184b5-555b-4dd6-a78e-9c3c05cdd6cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:16.655024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88184b5-555b-4dd6-a78e-9c3c05cdd6cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:16.693934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:16.839662 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d88184b5-555b-4dd6-a78e-9c3c05cdd6cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.199712 Oct 11 04:24:16.840625 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1543/3221] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:24:16 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/os-interface => generated 284 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:24:16.849402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8a60b5f4-6daf-4818-8101-0909686c9489 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:16.849402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8a60b5f4-6daf-4818-8101-0909686c9489 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:16.866874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a60b5f4-6daf-4818-8101-0909686c9489 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:16.868743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a60b5f4-6daf-4818-8101-0909686c9489 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:16.870964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a60b5f4-6daf-4818-8101-0909686c9489 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:16.872071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a60b5f4-6daf-4818-8101-0909686c9489 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:16.873835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a60b5f4-6daf-4818-8101-0909686c9489 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:16.875052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a60b5f4-6daf-4818-8101-0909686c9489 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:17.376470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8a60b5f4-6daf-4818-8101-0909686c9489 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:17.387262 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8a60b5f4-6daf-4818-8101-0909686c9489 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1315 microversion: 2.1 time: 0.543626 Oct 11 04:24:17.387598 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1544/3222] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:16 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1315 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:17.405006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4d8971c6-1820-425d-a466-56e11f675e52 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:17.405995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4d8971c6-1820-425d-a466-56e11f675e52 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:17.412560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d8971c6-1820-425d-a466-56e11f675e52 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:17.415745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d8971c6-1820-425d-a466-56e11f675e52 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:17.416395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d8971c6-1820-425d-a466-56e11f675e52 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:17.418341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d8971c6-1820-425d-a466-56e11f675e52 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:17.420634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d8971c6-1820-425d-a466-56e11f675e52 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:17.421262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d8971c6-1820-425d-a466-56e11f675e52 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:17.598671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:24:17.599784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:24:17.600841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:24:17.601349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:24:17.602461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:24:17.617173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:17.618136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:17.627771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:17.631553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:17.632940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:17.633736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:17.662508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Getting quotas for project 8a50d14bbe2e4b71ac79bc37ac0ed812. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:24:17.669193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Getting quotas for user 7ade698487d7495d9e10cd7ab92d62a5 and project 8a50d14bbe2e4b71ac79bc37ac0ed812. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:24:17.685893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:24:17.689562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:24:17.943345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ccce1d3f-1e4a-4edf-959d-e2b8c0bcbdf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.484018 Oct 11 04:24:17.952343 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1679/3223] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:24:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:24:17.957309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-db26bb5a-d0d0-4da4-97ad-560d7114ebd4 req-402a74d8-0eb2-423e-bf12-9bf6d53daba9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a95c5f-658f-4a48-97c8-8786b3e9de1a", "tag": "8e3c2050-0798-4c5e-9af5-1cfbf9783ef1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:18.013681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-db26bb5a-d0d0-4da4-97ad-560d7114ebd4 req-402a74d8-0eb2-423e-bf12-9bf6d53daba9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:18.014163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-db26bb5a-d0d0-4da4-97ad-560d7114ebd4 req-402a74d8-0eb2-423e-bf12-9bf6d53daba9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:18.015640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-db26bb5a-d0d0-4da4-97ad-560d7114ebd4 req-402a74d8-0eb2-423e-bf12-9bf6d53daba9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:18.044390 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-db26bb5a-d0d0-4da4-97ad-560d7114ebd4 req-402a74d8-0eb2-423e-bf12-9bf6d53daba9 service nova] Creating event network-changed:8e3c2050-0798-4c5e-9af5-1cfbf9783ef1 for instance b8a95c5f-658f-4a48-97c8-8786b3e9de1a on n-h2-860892-1 Oct 11 04:24:18.053624 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-db26bb5a-d0d0-4da4-97ad-560d7114ebd4 req-402a74d8-0eb2-423e-bf12-9bf6d53daba9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099948 Oct 11 04:24:18.058279 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1680/3224] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:18.069224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d42eae5a-c660-444b-91a6-b472d038c152 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:18.071650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d42eae5a-c660-444b-91a6-b472d038c152 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:18.171756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4d8971c6-1820-425d-a466-56e11f675e52 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:18.177720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:18.183269 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4d8971c6-1820-425d-a466-56e11f675e52 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.791414 Oct 11 04:24:18.199232 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1545/3225] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:17 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 803 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:18.308132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d42eae5a-c660-444b-91a6-b472d038c152 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:18.330562 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d42eae5a-c660-444b-91a6-b472d038c152 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1207 microversion: 2.1 time: 0.270723 Oct 11 04:24:18.334083 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1681/3226] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:18 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1207 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:18.411174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-091b1f64-51c1-4162-acbb-ed2e94630e10 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:18.411878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-091b1f64-51c1-4162-acbb-ed2e94630e10 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:18.418660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-091b1f64-51c1-4162-acbb-ed2e94630e10 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:18.419731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-091b1f64-51c1-4162-acbb-ed2e94630e10 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:18.420369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-091b1f64-51c1-4162-acbb-ed2e94630e10 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:18.421416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-091b1f64-51c1-4162-acbb-ed2e94630e10 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:18.422058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-091b1f64-51c1-4162-acbb-ed2e94630e10 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:18.422665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-091b1f64-51c1-4162-acbb-ed2e94630e10 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:18.767161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:18.855009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-091b1f64-51c1-4162-acbb-ed2e94630e10 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:18.865100 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-091b1f64-51c1-4162-acbb-ed2e94630e10 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1315 microversion: 2.1 time: 0.458378 Oct 11 04:24:18.865745 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1546/3227] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:18 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1315 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:19.213536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9c5f1ed5-3031-4c6e-b902-5aabb174b689 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:19.214145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9c5f1ed5-3031-4c6e-b902-5aabb174b689 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:19.223129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c5f1ed5-3031-4c6e-b902-5aabb174b689 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:19.224017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c5f1ed5-3031-4c6e-b902-5aabb174b689 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:19.225624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c5f1ed5-3031-4c6e-b902-5aabb174b689 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:19.227544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c5f1ed5-3031-4c6e-b902-5aabb174b689 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:19.228925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c5f1ed5-3031-4c6e-b902-5aabb174b689 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:19.229521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c5f1ed5-3031-4c6e-b902-5aabb174b689 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:19.356383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62a86016-0791-47b3-9a89-6e182a8fd6e0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:19.357670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-62a86016-0791-47b3-9a89-6e182a8fd6e0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:19.519420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62a86016-0791-47b3-9a89-6e182a8fd6e0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:19.528779 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-62a86016-0791-47b3-9a89-6e182a8fd6e0 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1207 microversion: 2.1 time: 0.178274 Oct 11 04:24:19.529670 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1547/3228] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:19 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1207 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:19.533890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9c5f1ed5-3031-4c6e-b902-5aabb174b689 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:19.547349 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9c5f1ed5-3031-4c6e-b902-5aabb174b689 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.338468 Oct 11 04:24:19.548058 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1682/3229] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:19 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:19.890030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff6d0127-2717-47c6-ab9d-6d1d5b729b60 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:19.891101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff6d0127-2717-47c6-ab9d-6d1d5b729b60 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:19.907951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff6d0127-2717-47c6-ab9d-6d1d5b729b60 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:19.908680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff6d0127-2717-47c6-ab9d-6d1d5b729b60 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:19.910046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff6d0127-2717-47c6-ab9d-6d1d5b729b60 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:19.910990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff6d0127-2717-47c6-ab9d-6d1d5b729b60 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:19.911749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff6d0127-2717-47c6-ab9d-6d1d5b729b60 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:19.912773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff6d0127-2717-47c6-ab9d-6d1d5b729b60 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:20.073235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff6d0127-2717-47c6-ab9d-6d1d5b729b60 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:20.096082 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff6d0127-2717-47c6-ab9d-6d1d5b729b60 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1315 microversion: 2.1 time: 0.208030 Oct 11 04:24:20.097684 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1548/3230] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:19 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:20.117267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2430853c-cf5e-4513-99e2-0809acd10e5c req-7f2b3545-8ef7-4642-9174-a5afb53f4742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "597b08ac-2ff7-485c-9ccc-cc37c67817df", "name": "network-vif-deleted", "tag": "1a26991b-531a-4238-9366-bb99758b06be"}, {"name": "network-changed", "server_uuid": "d32f0ab1-346d-487a-aa08-ebd1656142a7", "tag": "6993adde-be55-4ee5-a441-ab52e2f48759"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:20.152388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2430853c-cf5e-4513-99e2-0809acd10e5c req-7f2b3545-8ef7-4642-9174-a5afb53f4742 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:20.152796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2430853c-cf5e-4513-99e2-0809acd10e5c req-7f2b3545-8ef7-4642-9174-a5afb53f4742 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:20.153232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2430853c-cf5e-4513-99e2-0809acd10e5c req-7f2b3545-8ef7-4642-9174-a5afb53f4742 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:20.195231 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2430853c-cf5e-4513-99e2-0809acd10e5c req-7f2b3545-8ef7-4642-9174-a5afb53f4742 service nova] Creating event network-vif-deleted:1a26991b-531a-4238-9366-bb99758b06be for instance 597b08ac-2ff7-485c-9ccc-cc37c67817df on n-h2-860892-1 Oct 11 04:24:20.195835 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2430853c-cf5e-4513-99e2-0809acd10e5c req-7f2b3545-8ef7-4642-9174-a5afb53f4742 service nova] Creating event network-changed:6993adde-be55-4ee5-a441-ab52e2f48759 for instance d32f0ab1-346d-487a-aa08-ebd1656142a7 on n-h2-860892-1 Oct 11 04:24:20.212404 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2430853c-cf5e-4513-99e2-0809acd10e5c req-7f2b3545-8ef7-4642-9174-a5afb53f4742 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.111320 Oct 11 04:24:20.214358 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1683/3231] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:20.556674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90a1ffeb-a117-442f-86b3-f9d3fe8c63c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:20.557890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90a1ffeb-a117-442f-86b3-f9d3fe8c63c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:20.568878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a1ffeb-a117-442f-86b3-f9d3fe8c63c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:20.569446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a1ffeb-a117-442f-86b3-f9d3fe8c63c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:20.569981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a1ffeb-a117-442f-86b3-f9d3fe8c63c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:20.570821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a1ffeb-a117-442f-86b3-f9d3fe8c63c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:20.571588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a1ffeb-a117-442f-86b3-f9d3fe8c63c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:20.572311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a1ffeb-a117-442f-86b3-f9d3fe8c63c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:20.573083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1049dad4-b5a3-4212-90bb-e6bc5477ecb5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:20.573795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1049dad4-b5a3-4212-90bb-e6bc5477ecb5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:20.585988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1049dad4-b5a3-4212-90bb-e6bc5477ecb5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:20.586891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1049dad4-b5a3-4212-90bb-e6bc5477ecb5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:20.587499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1049dad4-b5a3-4212-90bb-e6bc5477ecb5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:20.588826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1049dad4-b5a3-4212-90bb-e6bc5477ecb5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:20.590781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1049dad4-b5a3-4212-90bb-e6bc5477ecb5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:20.591428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1049dad4-b5a3-4212-90bb-e6bc5477ecb5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:21.010797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90a1ffeb-a117-442f-86b3-f9d3fe8c63c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:21.018821 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90a1ffeb-a117-442f-86b3-f9d3fe8c63c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1203 microversion: 2.1 time: 0.469600 Oct 11 04:24:21.019397 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1549/3232] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:20 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1203 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:21.120753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a357e15-cb11-4133-88c5-901e3eaff693 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:21.121415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9a357e15-cb11-4133-88c5-901e3eaff693 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:21.131254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a357e15-cb11-4133-88c5-901e3eaff693 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:21.132203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a357e15-cb11-4133-88c5-901e3eaff693 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:21.133313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a357e15-cb11-4133-88c5-901e3eaff693 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:21.134922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a357e15-cb11-4133-88c5-901e3eaff693 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:21.135574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a357e15-cb11-4133-88c5-901e3eaff693 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:21.136014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a357e15-cb11-4133-88c5-901e3eaff693 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:21.438056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9a357e15-cb11-4133-88c5-901e3eaff693 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:21.453199 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9a357e15-cb11-4133-88c5-901e3eaff693 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1315 microversion: 2.1 time: 0.336646 Oct 11 04:24:21.460580 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1550/3233] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:21 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1315 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:21.512843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1049dad4-b5a3-4212-90bb-e6bc5477ecb5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:21.525894 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1049dad4-b5a3-4212-90bb-e6bc5477ecb5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.956408 Oct 11 04:24:21.527742 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1684/3234] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:20 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:22.051283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef4b8f1a-ff3f-47bb-8d03-dc43d4096ab7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:22.052433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef4b8f1a-ff3f-47bb-8d03-dc43d4096ab7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:22.089400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4b8f1a-ff3f-47bb-8d03-dc43d4096ab7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:22.108220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4b8f1a-ff3f-47bb-8d03-dc43d4096ab7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:22.108220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4b8f1a-ff3f-47bb-8d03-dc43d4096ab7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:22.108885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4b8f1a-ff3f-47bb-8d03-dc43d4096ab7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:22.109344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4b8f1a-ff3f-47bb-8d03-dc43d4096ab7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:22.120553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4b8f1a-ff3f-47bb-8d03-dc43d4096ab7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:22.294659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef4b8f1a-ff3f-47bb-8d03-dc43d4096ab7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:22.306076 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef4b8f1a-ff3f-47bb-8d03-dc43d4096ab7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1267 microversion: 2.1 time: 0.258577 Oct 11 04:24:22.311353 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1551/3235] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:22 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1267 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:22.486790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fe9bf0fe-c727-402a-902e-dfd4482e7c13 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:22.487467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fe9bf0fe-c727-402a-902e-dfd4482e7c13 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:22.494398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe9bf0fe-c727-402a-902e-dfd4482e7c13 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:22.495141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe9bf0fe-c727-402a-902e-dfd4482e7c13 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:22.495920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe9bf0fe-c727-402a-902e-dfd4482e7c13 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:22.497002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe9bf0fe-c727-402a-902e-dfd4482e7c13 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:22.498019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe9bf0fe-c727-402a-902e-dfd4482e7c13 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:22.498688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe9bf0fe-c727-402a-902e-dfd4482e7c13 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:22.562543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-99741f6d-195d-44b9-afe6-e14b58000597 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:22.563265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-99741f6d-195d-44b9-afe6-e14b58000597 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:22.569569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99741f6d-195d-44b9-afe6-e14b58000597 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:22.570758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99741f6d-195d-44b9-afe6-e14b58000597 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:22.571293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99741f6d-195d-44b9-afe6-e14b58000597 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:22.572084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99741f6d-195d-44b9-afe6-e14b58000597 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:22.572716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99741f6d-195d-44b9-afe6-e14b58000597 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:22.573409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99741f6d-195d-44b9-afe6-e14b58000597 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:22.658057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fe9bf0fe-c727-402a-902e-dfd4482e7c13 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:22.666541 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fe9bf0fe-c727-402a-902e-dfd4482e7c13 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1315 microversion: 2.1 time: 0.185422 Oct 11 04:24:22.667112 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1685/3236] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:22 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:22.711914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-99741f6d-195d-44b9-afe6-e14b58000597 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:22.719560 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-99741f6d-195d-44b9-afe6-e14b58000597 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.160895 Oct 11 04:24:22.720124 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1552/3237] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:22 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:23.341505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4f61a2ec-02ad-4721-b8da-f0d725c1692f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:23.342294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4f61a2ec-02ad-4721-b8da-f0d725c1692f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:23.344531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:23.359722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f61a2ec-02ad-4721-b8da-f0d725c1692f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:23.360799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f61a2ec-02ad-4721-b8da-f0d725c1692f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:23.362219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f61a2ec-02ad-4721-b8da-f0d725c1692f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:23.363559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f61a2ec-02ad-4721-b8da-f0d725c1692f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:23.364182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f61a2ec-02ad-4721-b8da-f0d725c1692f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:23.364920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f61a2ec-02ad-4721-b8da-f0d725c1692f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:23.610572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4f61a2ec-02ad-4721-b8da-f0d725c1692f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:23.619028 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4f61a2ec-02ad-4721-b8da-f0d725c1692f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1307 microversion: 2.1 time: 0.282032 Oct 11 04:24:23.639118 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1686/3238] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:23 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1307 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:23.703488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e19775e-fdb1-403d-b863-799c888866ee tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:23.703488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9e19775e-fdb1-403d-b863-799c888866ee tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:23.707372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e19775e-fdb1-403d-b863-799c888866ee tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:23.709606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e19775e-fdb1-403d-b863-799c888866ee tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:23.710080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e19775e-fdb1-403d-b863-799c888866ee tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:23.711018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e19775e-fdb1-403d-b863-799c888866ee tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:23.711488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e19775e-fdb1-403d-b863-799c888866ee tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:23.711933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e19775e-fdb1-403d-b863-799c888866ee tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:23.744195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e193b10e-7554-48b6-8131-3966462f793e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:23.744760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e193b10e-7554-48b6-8131-3966462f793e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:23.753632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e193b10e-7554-48b6-8131-3966462f793e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:23.754128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e193b10e-7554-48b6-8131-3966462f793e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:23.754852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e193b10e-7554-48b6-8131-3966462f793e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:23.755555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e193b10e-7554-48b6-8131-3966462f793e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:23.756009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e193b10e-7554-48b6-8131-3966462f793e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:23.756437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e193b10e-7554-48b6-8131-3966462f793e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:23.915181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e193b10e-7554-48b6-8131-3966462f793e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:23.925550 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e193b10e-7554-48b6-8131-3966462f793e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.185963 Oct 11 04:24:23.926685 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1687/3239] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:23 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:23.933133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5f0997e6-008d-4853-a57f-79adfc71f0dd req-d8c8a288-c75f-4246-accf-139cfe8d6393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a95c5f-658f-4a48-97c8-8786b3e9de1a", "name": "network-vif-plugged", "status": "completed", "tag": "8e3c2050-0798-4c5e-9af5-1cfbf9783ef1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:23.945984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5f0997e6-008d-4853-a57f-79adfc71f0dd req-d8c8a288-c75f-4246-accf-139cfe8d6393 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:23.946781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5f0997e6-008d-4853-a57f-79adfc71f0dd req-d8c8a288-c75f-4246-accf-139cfe8d6393 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:23.947425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5f0997e6-008d-4853-a57f-79adfc71f0dd req-d8c8a288-c75f-4246-accf-139cfe8d6393 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:23.961387 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5f0997e6-008d-4853-a57f-79adfc71f0dd req-d8c8a288-c75f-4246-accf-139cfe8d6393 service nova] Creating event network-vif-plugged:8e3c2050-0798-4c5e-9af5-1cfbf9783ef1 for instance b8a95c5f-658f-4a48-97c8-8786b3e9de1a on n-h2-860892-1 Oct 11 04:24:23.966882 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5f0997e6-008d-4853-a57f-79adfc71f0dd req-d8c8a288-c75f-4246-accf-139cfe8d6393 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038822 Oct 11 04:24:23.968005 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1688/3240] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:24.204054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9e19775e-fdb1-403d-b863-799c888866ee tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:24.212325 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9e19775e-fdb1-403d-b863-799c888866ee tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1315 microversion: 2.1 time: 0.526499 Oct 11 04:24:24.212890 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1553/3241] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:23 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:24.653981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6945d3f-1e48-415a-96f6-d7cfa6e6ad9b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:24.654784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6945d3f-1e48-415a-96f6-d7cfa6e6ad9b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:24.664032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6945d3f-1e48-415a-96f6-d7cfa6e6ad9b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:24.665561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6945d3f-1e48-415a-96f6-d7cfa6e6ad9b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:24.666292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6945d3f-1e48-415a-96f6-d7cfa6e6ad9b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:24.667284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6945d3f-1e48-415a-96f6-d7cfa6e6ad9b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:24.667764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6945d3f-1e48-415a-96f6-d7cfa6e6ad9b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:24.675830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6945d3f-1e48-415a-96f6-d7cfa6e6ad9b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:24.953794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75f89a60-db07-4c51-bb10-71ba2f06dce3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:24.957107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-75f89a60-db07-4c51-bb10-71ba2f06dce3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:24.979179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f89a60-db07-4c51-bb10-71ba2f06dce3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:24.979857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f89a60-db07-4c51-bb10-71ba2f06dce3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:24.985417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f89a60-db07-4c51-bb10-71ba2f06dce3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:24.985417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f89a60-db07-4c51-bb10-71ba2f06dce3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:24.985417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f89a60-db07-4c51-bb10-71ba2f06dce3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:24.985417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f89a60-db07-4c51-bb10-71ba2f06dce3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:24.988482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6945d3f-1e48-415a-96f6-d7cfa6e6ad9b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:25.000735 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6945d3f-1e48-415a-96f6-d7cfa6e6ad9b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1307 microversion: 2.1 time: 0.351994 Oct 11 04:24:25.002060 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1689/3242] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:24 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1307 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:25.239801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75f89a60-db07-4c51-bb10-71ba2f06dce3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:25.243732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b59b2bf-a50d-45de-a07a-226a4547ca17 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:25.244394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b59b2bf-a50d-45de-a07a-226a4547ca17 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:25.259352 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-75f89a60-db07-4c51-bb10-71ba2f06dce3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1507 microversion: 2.1 time: 0.311230 Oct 11 04:24:25.259884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b59b2bf-a50d-45de-a07a-226a4547ca17 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:25.278682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b59b2bf-a50d-45de-a07a-226a4547ca17 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:25.279350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b59b2bf-a50d-45de-a07a-226a4547ca17 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:25.280036 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1554/3243] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:24 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1507 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:25.280496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b59b2bf-a50d-45de-a07a-226a4547ca17 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:25.281210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b59b2bf-a50d-45de-a07a-226a4547ca17 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:25.281651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b59b2bf-a50d-45de-a07a-226a4547ca17 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:25.691095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b59b2bf-a50d-45de-a07a-226a4547ca17 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:25.706873 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b59b2bf-a50d-45de-a07a-226a4547ca17 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1315 microversion: 2.1 time: 0.472558 Oct 11 04:24:25.707564 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1690/3244] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:25 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:25.772509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-978b7144-e903-42a6-aab2-e35654d8d3cd req-21da2b68-ab65-46a8-8db3-bbe22f9134f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a701828-9b98-4469-af1d-969d4eae10e6", "tag": "ccebd3f9-3f22-4ca4-9e98-ada82780b131"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:25.793886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-978b7144-e903-42a6-aab2-e35654d8d3cd req-21da2b68-ab65-46a8-8db3-bbe22f9134f4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:25.798497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-978b7144-e903-42a6-aab2-e35654d8d3cd req-21da2b68-ab65-46a8-8db3-bbe22f9134f4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:25.799200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-978b7144-e903-42a6-aab2-e35654d8d3cd req-21da2b68-ab65-46a8-8db3-bbe22f9134f4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:25.818065 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-978b7144-e903-42a6-aab2-e35654d8d3cd req-21da2b68-ab65-46a8-8db3-bbe22f9134f4 service nova] Creating event network-changed:ccebd3f9-3f22-4ca4-9e98-ada82780b131 for instance 1a701828-9b98-4469-af1d-969d4eae10e6 on n-h1-860892-1 Oct 11 04:24:25.825406 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-978b7144-e903-42a6-aab2-e35654d8d3cd req-21da2b68-ab65-46a8-8db3-bbe22f9134f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060452 Oct 11 04:24:25.826830 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1555/3245] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:26.026082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6b4bff1-80d4-4910-911f-0d58aa43e602 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:26.027547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6b4bff1-80d4-4910-911f-0d58aa43e602 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:26.044216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b4bff1-80d4-4910-911f-0d58aa43e602 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:26.045913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b4bff1-80d4-4910-911f-0d58aa43e602 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:26.047612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b4bff1-80d4-4910-911f-0d58aa43e602 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:26.052009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b4bff1-80d4-4910-911f-0d58aa43e602 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:26.052581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b4bff1-80d4-4910-911f-0d58aa43e602 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:26.062695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b4bff1-80d4-4910-911f-0d58aa43e602 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:26.308604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c6a9378-9f07-4706-82ab-2f7a041feaf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:26.309310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1c6a9378-9f07-4706-82ab-2f7a041feaf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:26.323138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6a9378-9f07-4706-82ab-2f7a041feaf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:26.326207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6a9378-9f07-4706-82ab-2f7a041feaf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:26.329020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6a9378-9f07-4706-82ab-2f7a041feaf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:26.330112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6a9378-9f07-4706-82ab-2f7a041feaf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:26.330836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6a9378-9f07-4706-82ab-2f7a041feaf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:26.332711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6a9378-9f07-4706-82ab-2f7a041feaf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:26.373825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6b4bff1-80d4-4910-911f-0d58aa43e602 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:26.383710 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6b4bff1-80d4-4910-911f-0d58aa43e602 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1307 microversion: 2.1 time: 0.362669 Oct 11 04:24:26.398235 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1691/3246] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:26 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1307 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:26.733753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b6a2d79-4fcc-4c37-b59d-fb4df175072a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:26.734702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b6a2d79-4fcc-4c37-b59d-fb4df175072a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:26.744373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b6a2d79-4fcc-4c37-b59d-fb4df175072a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:26.745346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b6a2d79-4fcc-4c37-b59d-fb4df175072a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:26.746054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b6a2d79-4fcc-4c37-b59d-fb4df175072a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:26.747064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b6a2d79-4fcc-4c37-b59d-fb4df175072a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:26.747801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b6a2d79-4fcc-4c37-b59d-fb4df175072a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:26.748456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b6a2d79-4fcc-4c37-b59d-fb4df175072a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:27.177536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1c6a9378-9f07-4706-82ab-2f7a041feaf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:27.195432 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c6a9378-9f07-4706-82ab-2f7a041feaf6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1528 microversion: 2.1 time: 0.892849 Oct 11 04:24:27.202239 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1556/3247] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:26 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1528 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:27.219583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b6a2d79-4fcc-4c37-b59d-fb4df175072a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:27.232797 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b6a2d79-4fcc-4c37-b59d-fb4df175072a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1503 microversion: 2.1 time: 0.502564 Oct 11 04:24:27.233732 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1692/3248] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:26 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1503 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:27.272253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e2a1f0f-3db5-405d-b515-0ca383b2122f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-837359537"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:27.273097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4e2a1f0f-3db5-405d-b515-0ca383b2122f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:27.282702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e2a1f0f-3db5-405d-b515-0ca383b2122f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:27.297230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e2a1f0f-3db5-405d-b515-0ca383b2122f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:27.298581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e2a1f0f-3db5-405d-b515-0ca383b2122f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:27.302534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e2a1f0f-3db5-405d-b515-0ca383b2122f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:27.303259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e2a1f0f-3db5-405d-b515-0ca383b2122f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:27.303905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e2a1f0f-3db5-405d-b515-0ca383b2122f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:27.415252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-98d37896-4d94-4111-8408-65300e627a37 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:27.416408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-98d37896-4d94-4111-8408-65300e627a37 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:27.428743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98d37896-4d94-4111-8408-65300e627a37 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:27.457543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98d37896-4d94-4111-8408-65300e627a37 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:27.458560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98d37896-4d94-4111-8408-65300e627a37 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:27.463811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98d37896-4d94-4111-8408-65300e627a37 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:27.471724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98d37896-4d94-4111-8408-65300e627a37 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:27.472953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-98d37896-4d94-4111-8408-65300e627a37 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:27.648924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:27.662700 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.network.security_group_api [None req-4e2a1f0f-3db5-405d-b515-0ca383b2122f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Adding security group 2d8a00e5-f869-48b1-96d2-fa604f9cd45e to port 8e3c2050-0798-4c5e-9af5-1cfbf9783ef1 Oct 11 04:24:27.982705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-98d37896-4d94-4111-8408-65300e627a37 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:27.999747 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-98d37896-4d94-4111-8408-65300e627a37 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1307 microversion: 2.1 time: 0.592365 Oct 11 04:24:28.001057 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1693/3249] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:27 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1307 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:28.223716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-981f1d06-107a-4f44-b5f5-cab7c29e56ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:28.224344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-981f1d06-107a-4f44-b5f5-cab7c29e56ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:28.233149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-981f1d06-107a-4f44-b5f5-cab7c29e56ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:28.236755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-981f1d06-107a-4f44-b5f5-cab7c29e56ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:28.237444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-981f1d06-107a-4f44-b5f5-cab7c29e56ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:28.238636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-981f1d06-107a-4f44-b5f5-cab7c29e56ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:28.238972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-981f1d06-107a-4f44-b5f5-cab7c29e56ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:28.239402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-981f1d06-107a-4f44-b5f5-cab7c29e56ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:28.322855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=12 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:28.505821 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4e2a1f0f-3db5-405d-b515-0ca383b2122f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a/action" status: 202 len: 0 microversion: 2.1 time: 1.249913 Oct 11 04:24:28.506903 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1557/3250] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:24:27 2022] POST /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a/action => generated 0 bytes in 1252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:24:28.530162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c948f6a-4135-4d93-8803-bc1df236699c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1406258185"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:28.530828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5c948f6a-4135-4d93-8803-bc1df236699c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:28.542042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c948f6a-4135-4d93-8803-bc1df236699c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:28.542600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c948f6a-4135-4d93-8803-bc1df236699c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:28.543038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c948f6a-4135-4d93-8803-bc1df236699c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:28.549365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c948f6a-4135-4d93-8803-bc1df236699c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:28.550064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c948f6a-4135-4d93-8803-bc1df236699c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:28.550681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c948f6a-4135-4d93-8803-bc1df236699c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:28.758276 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.network.security_group_api [None req-5c948f6a-4135-4d93-8803-bc1df236699c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Adding security group 73edb22e-cc6c-411a-ad29-bfe822d30ea2 to port 8e3c2050-0798-4c5e-9af5-1cfbf9783ef1 Oct 11 04:24:28.769392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-981f1d06-107a-4f44-b5f5-cab7c29e56ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:28.784900 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-981f1d06-107a-4f44-b5f5-cab7c29e56ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1528 microversion: 2.1 time: 0.561841 Oct 11 04:24:28.786182 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1694/3251] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:28 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1528 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:28.799741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-3e6418e8-16d7-4422-839e-8475a19ead60 req-37126eb8-5602-450b-8203-de41698af529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a95c5f-658f-4a48-97c8-8786b3e9de1a", "tag": "8e3c2050-0798-4c5e-9af5-1cfbf9783ef1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:28.823976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3e6418e8-16d7-4422-839e-8475a19ead60 req-37126eb8-5602-450b-8203-de41698af529 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:28.824491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3e6418e8-16d7-4422-839e-8475a19ead60 req-37126eb8-5602-450b-8203-de41698af529 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:28.825074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3e6418e8-16d7-4422-839e-8475a19ead60 req-37126eb8-5602-450b-8203-de41698af529 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:28.838048 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-3e6418e8-16d7-4422-839e-8475a19ead60 req-37126eb8-5602-450b-8203-de41698af529 service nova] Creating event network-changed:8e3c2050-0798-4c5e-9af5-1cfbf9783ef1 for instance b8a95c5f-658f-4a48-97c8-8786b3e9de1a on n-h2-860892-1 Oct 11 04:24:28.848735 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-3e6418e8-16d7-4422-839e-8475a19ead60 req-37126eb8-5602-450b-8203-de41698af529 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057579 Oct 11 04:24:28.848735 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1695/3252] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:29.025808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a2fe4f70-0afa-46fe-b0c7-66db08e8d75b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:29.026541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a2fe4f70-0afa-46fe-b0c7-66db08e8d75b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:29.061648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2fe4f70-0afa-46fe-b0c7-66db08e8d75b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:29.073469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2fe4f70-0afa-46fe-b0c7-66db08e8d75b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:29.074148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2fe4f70-0afa-46fe-b0c7-66db08e8d75b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:29.075866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2fe4f70-0afa-46fe-b0c7-66db08e8d75b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:29.079666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2fe4f70-0afa-46fe-b0c7-66db08e8d75b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:29.080290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2fe4f70-0afa-46fe-b0c7-66db08e8d75b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:29.506660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a2fe4f70-0afa-46fe-b0c7-66db08e8d75b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:29.546775 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a2fe4f70-0afa-46fe-b0c7-66db08e8d75b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1307 microversion: 2.1 time: 0.525032 Oct 11 04:24:29.547879 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1696/3253] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:29 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1307 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:29.638157 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5c948f6a-4135-4d93-8803-bc1df236699c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a/action" status: 202 len: 0 microversion: 2.1 time: 1.118336 Oct 11 04:24:29.642468 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1558/3254] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:24:28 2022] POST /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a/action => generated 0 bytes in 1124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:24:29.651964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ba6477b6-ecb8-43f4-87b2-8d1f0b372195 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:29.652462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ba6477b6-ecb8-43f4-87b2-8d1f0b372195 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:29.662358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba6477b6-ecb8-43f4-87b2-8d1f0b372195 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:29.664072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba6477b6-ecb8-43f4-87b2-8d1f0b372195 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:29.666965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba6477b6-ecb8-43f4-87b2-8d1f0b372195 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:29.667887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba6477b6-ecb8-43f4-87b2-8d1f0b372195 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:29.669019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba6477b6-ecb8-43f4-87b2-8d1f0b372195 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:29.671416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba6477b6-ecb8-43f4-87b2-8d1f0b372195 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:29.809183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ace8494-6f6b-4633-bdae-f507b2b4c7c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:29.810436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5ace8494-6f6b-4633-bdae-f507b2b4c7c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:29.819069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ace8494-6f6b-4633-bdae-f507b2b4c7c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:29.819854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ace8494-6f6b-4633-bdae-f507b2b4c7c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:29.820668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ace8494-6f6b-4633-bdae-f507b2b4c7c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:29.821833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ace8494-6f6b-4633-bdae-f507b2b4c7c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:29.822476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ace8494-6f6b-4633-bdae-f507b2b4c7c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:29.823062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ace8494-6f6b-4633-bdae-f507b2b4c7c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:29.915610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:30.086374 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ba6477b6-ecb8-43f4-87b2-8d1f0b372195 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.437401 Oct 11 04:24:30.087199 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1697/3255] 10.222.0.26 () {58 vars in 1293 bytes} [Tue Oct 11 04:24:29 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a/os-security-groups => generated 1155 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:30.106232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-67441058-7902-46aa-8a97-9c141ed77482 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'create', calling method: .version_select at 0x7fda193fc940>, body: {"security_group": {"name": " tempest-securitygroup -233579542 ", "description": "tempest-description-996226457"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:30.236760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5ace8494-6f6b-4633-bdae-f507b2b4c7c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:30.245076 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ace8494-6f6b-4633-bdae-f507b2b4c7c7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1528 microversion: 2.1 time: 0.439976 Oct 11 04:24:30.247111 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1559/3256] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:29 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1528 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:30.265904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c8118007-9349-4fb6-bced-c64a8a14c0f9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Action: 'create', calling method: .version_select at 0x7fda191d0f70>, body: {"keypair": {"name": "tempest-keypair-512300577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLaRdUWYmnQZX7ZioxNMk8ZLNxvhcCjR9TiC82/3iQurQrXO4LjhXy8HxMF6gbxO/AZWfRBTOT1fNdyF/JUaiMFRmdh2k/3/ybSAntE/YaaRQQU53/YHP3kmBGLS2SSlRg=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:30.287548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c8118007-9349-4fb6-bced-c64a8a14c0f9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Getting quotas for project 529357092c6e404e982f968263d41eae. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:24:30.293751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c8118007-9349-4fb6-bced-c64a8a14c0f9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Getting quotas for user 1f75f519f7b44fc8b81d281cf0d3f502 and project 529357092c6e404e982f968263d41eae. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:24:30.427327 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c8118007-9349-4fb6-bced-c64a8a14c0f9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.178111 Oct 11 04:24:30.428235 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1560/3257] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 11 04:24:30 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 04:24:30.573485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-22f2d8bd-4e20-4821-9bbc-7882253efe80 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:30.578380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-22f2d8bd-4e20-4821-9bbc-7882253efe80 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:30.587957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f2d8bd-4e20-4821-9bbc-7882253efe80 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:30.588777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f2d8bd-4e20-4821-9bbc-7882253efe80 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:30.589698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f2d8bd-4e20-4821-9bbc-7882253efe80 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:30.591356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f2d8bd-4e20-4821-9bbc-7882253efe80 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:30.604743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f2d8bd-4e20-4821-9bbc-7882253efe80 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:30.609960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f2d8bd-4e20-4821-9bbc-7882253efe80 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:30.791100 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-67441058-7902-46aa-8a97-9c141ed77482 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 222 microversion: 2.1 time: 0.689440 Oct 11 04:24:30.792007 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1698/3258] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:24:30 2022] POST /compute/v2.1/os-security-groups => generated 222 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:24:30.806165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b0fb57d4-eded-42a7-bef0-f0c0c741372b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19316b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:31.037219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-22f2d8bd-4e20-4821-9bbc-7882253efe80 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:31.047239 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-22f2d8bd-4e20-4821-9bbc-7882253efe80 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1307 microversion: 2.1 time: 0.479623 Oct 11 04:24:31.047834 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1561/3259] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:30 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1307 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:31.053611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5c1b94ed-ca7c-498c-841a-787345c29b43 req-0e484c8d-6b87-4511-9ada-d670eaf9665d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8a95c5f-658f-4a48-97c8-8786b3e9de1a", "tag": "8e3c2050-0798-4c5e-9af5-1cfbf9783ef1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:31.066247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5c1b94ed-ca7c-498c-841a-787345c29b43 req-0e484c8d-6b87-4511-9ada-d670eaf9665d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:31.066716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5c1b94ed-ca7c-498c-841a-787345c29b43 req-0e484c8d-6b87-4511-9ada-d670eaf9665d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:31.067148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5c1b94ed-ca7c-498c-841a-787345c29b43 req-0e484c8d-6b87-4511-9ada-d670eaf9665d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:31.106589 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5c1b94ed-ca7c-498c-841a-787345c29b43 req-0e484c8d-6b87-4511-9ada-d670eaf9665d service nova] Creating event network-changed:8e3c2050-0798-4c5e-9af5-1cfbf9783ef1 for instance b8a95c5f-658f-4a48-97c8-8786b3e9de1a on n-h2-860892-1 Oct 11 04:24:31.112729 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5c1b94ed-ca7c-498c-841a-787345c29b43 req-0e484c8d-6b87-4511-9ada-d670eaf9665d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063081 Oct 11 04:24:31.113763 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1562/3260] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:31.271411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8502a0b7-0efb-4e2b-8a92-cab1991ba132 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:31.274786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8502a0b7-0efb-4e2b-8a92-cab1991ba132 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:31.283001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8502a0b7-0efb-4e2b-8a92-cab1991ba132 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:31.284137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8502a0b7-0efb-4e2b-8a92-cab1991ba132 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:31.285264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8502a0b7-0efb-4e2b-8a92-cab1991ba132 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:31.286274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8502a0b7-0efb-4e2b-8a92-cab1991ba132 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:31.286957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8502a0b7-0efb-4e2b-8a92-cab1991ba132 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:31.288197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8502a0b7-0efb-4e2b-8a92-cab1991ba132 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:31.360167 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b0fb57d4-eded-42a7-bef0-f0c0c741372b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/6c088360-944b-425b-9fd7-a7bfefc1fe96" status: 200 len: 222 microversion: 2.1 time: 0.558298 Oct 11 04:24:31.368702 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1699/3261] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:24:30 2022] GET /compute/v2.1/os-security-groups/6c088360-944b-425b-9fd7-a7bfefc1fe96 => generated 222 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:31.374152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-abd62c02-1db1-4cad-861e-91de22e541fe tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19411700>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:31.738551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8502a0b7-0efb-4e2b-8a92-cab1991ba132 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:31.748848 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-abd62c02-1db1-4cad-861e-91de22e541fe tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/6c088360-944b-425b-9fd7-a7bfefc1fe96" status: 202 len: 0 microversion: 2.1 time: 0.373466 Oct 11 04:24:31.748848 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1700/3262] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:24:31 2022] DELETE /compute/v2.1/os-security-groups/6c088360-944b-425b-9fd7-a7bfefc1fe96 => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:24:31.753736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b527b440-855e-4b9f-9622-150f4609ca34 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19411ee0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:31.757989 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8502a0b7-0efb-4e2b-8a92-cab1991ba132 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1528 microversion: 2.1 time: 0.490463 Oct 11 04:24:31.758724 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1563/3263] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:31 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1528 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:31.842168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG neutronclient.v2_0.client [None req-b527b440-855e-4b9f-9622-150f4609ca34 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist", "detail": ""}} {{(pid=120994) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:24:31.843396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.security_group_api [None req-b527b440-855e-4b9f-9622-150f4609ca34 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Neutron security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 not found {{(pid=120994) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:24:31.844374 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-b527b440-855e-4b9f-9622-150f4609ca34 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:24:31.844374 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-77d74f12-0304-489d-91f6-66abfb063992'] Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b527b440-855e-4b9f-9622-150f4609ca34 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-security-groups/6c088360-944b-425b-9fd7-a7bfefc1fe96 HTTP/1.1 Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: exception: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-77d74f12-0304-489d-91f6-66abfb063992'] Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '6c088360-944b-425b-9fd7-a7bfefc1fe96'} Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:24:31.847830 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d74f12-0304-489d-91f6-66abfb063992'] Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d74f12-0304-489d-91f6-66abfb063992'] Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d74f12-0304-489d-91f6-66abfb063992'] Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-77d74f12-0304-489d-91f6-66abfb063992'] Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b527b440-855e-4b9f-9622-150f4609ca34 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:24:31.854543 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-77d74f12-0304-489d-91f6-66abfb063992'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:24:31.858818 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b527b440-855e-4b9f-9622-150f4609ca34 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/6c088360-944b-425b-9fd7-a7bfefc1fe96" status: 404 len: 194 microversion: 2.1 time: 0.104155 Oct 11 04:24:31.859709 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1701/3264] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:24:31 2022] GET /compute/v2.1/os-security-groups/6c088360-944b-425b-9fd7-a7bfefc1fe96 => generated 194 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:24:31.870889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-45949580-2902-4b27-94f9-8c4f622b5a42 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'create', calling method: .version_select at 0x7fda19a7d940>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-265305136", "description": "tempest-description-1239435458"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:32.074514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a332715b-a043-42f6-89cd-43adfa51a0d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:32.075782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a332715b-a043-42f6-89cd-43adfa51a0d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:32.100331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a332715b-a043-42f6-89cd-43adfa51a0d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:32.100331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a332715b-a043-42f6-89cd-43adfa51a0d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:32.100331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a332715b-a043-42f6-89cd-43adfa51a0d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:32.100331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a332715b-a043-42f6-89cd-43adfa51a0d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:32.100331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a332715b-a043-42f6-89cd-43adfa51a0d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:32.100331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a332715b-a043-42f6-89cd-43adfa51a0d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:32.287265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a332715b-a043-42f6-89cd-43adfa51a0d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:32.300841 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a332715b-a043-42f6-89cd-43adfa51a0d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1307 microversion: 2.1 time: 0.232760 Oct 11 04:24:32.302090 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1702/3265] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:32 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1307 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:32.783346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d065814e-730c-416c-bc34-e763d828ab1e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:32.784163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d065814e-730c-416c-bc34-e763d828ab1e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:32.792303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d065814e-730c-416c-bc34-e763d828ab1e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:32.792802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d065814e-730c-416c-bc34-e763d828ab1e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:32.793249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d065814e-730c-416c-bc34-e763d828ab1e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:32.793999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d065814e-730c-416c-bc34-e763d828ab1e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:32.794514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d065814e-730c-416c-bc34-e763d828ab1e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:32.795118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d065814e-730c-416c-bc34-e763d828ab1e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:32.804491 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-45949580-2902-4b27-94f9-8c4f622b5a42 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.938423 Oct 11 04:24:32.805486 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1564/3266] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:24:31 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:32.819836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3791d6d5-6f59-4682-ba77-266580957aa5 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'create', calling method: .version_select at 0x7fda19c73af0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-448912149", "description": "tempest-description-1896841493"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:33.117379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d065814e-730c-416c-bc34-e763d828ab1e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:33.129255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:33.146754 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d065814e-730c-416c-bc34-e763d828ab1e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1528 microversion: 2.1 time: 0.367164 Oct 11 04:24:33.147348 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1703/3267] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:32 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1528 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:33.278325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-50ac3591-a27f-452f-bcd8-ca2ff46952cc req-423268e3-e1a7-432a-b0a8-6c8006780fc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f905c4dd-c9f6-452d-bc51-696256de0b36", "name": "network-vif-plugged", "status": "completed", "tag": "5dec51fb-6f29-4e7f-aeb9-d6572fc4d1e2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:33.289381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-50ac3591-a27f-452f-bcd8-ca2ff46952cc req-423268e3-e1a7-432a-b0a8-6c8006780fc5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:33.289952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-50ac3591-a27f-452f-bcd8-ca2ff46952cc req-423268e3-e1a7-432a-b0a8-6c8006780fc5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:33.290425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-50ac3591-a27f-452f-bcd8-ca2ff46952cc req-423268e3-e1a7-432a-b0a8-6c8006780fc5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:33.301776 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-50ac3591-a27f-452f-bcd8-ca2ff46952cc req-423268e3-e1a7-432a-b0a8-6c8006780fc5 service nova] Creating event network-vif-plugged:5dec51fb-6f29-4e7f-aeb9-d6572fc4d1e2 for instance f905c4dd-c9f6-452d-bc51-696256de0b36 on n-h1-860892-1 Oct 11 04:24:33.306779 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-50ac3591-a27f-452f-bcd8-ca2ff46952cc req-423268e3-e1a7-432a-b0a8-6c8006780fc5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032040 Oct 11 04:24:33.307628 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1704/3268] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:33.329398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8f806688-b03e-4476-aff9-aca8d1959c3e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:33.330099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8f806688-b03e-4476-aff9-aca8d1959c3e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:33.338557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f806688-b03e-4476-aff9-aca8d1959c3e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:33.339515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f806688-b03e-4476-aff9-aca8d1959c3e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:33.340160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f806688-b03e-4476-aff9-aca8d1959c3e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:33.341268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f806688-b03e-4476-aff9-aca8d1959c3e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:33.341959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f806688-b03e-4476-aff9-aca8d1959c3e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:33.342845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f806688-b03e-4476-aff9-aca8d1959c3e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:33.596011 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3791d6d5-6f59-4682-ba77-266580957aa5 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 243 microversion: 2.1 time: 0.781222 Oct 11 04:24:33.596671 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1565/3269] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:24:32 2022] POST /compute/v2.1/os-security-groups => generated 243 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:33.609775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1a6f08d6-f8df-4fca-ac0d-220332748cac tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'create', calling method: .version_select at 0x7fda19a7d4c0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-743660452", "description": "tempest-description-556089636"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:33.722463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8f806688-b03e-4476-aff9-aca8d1959c3e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:33.739622 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8f806688-b03e-4476-aff9-aca8d1959c3e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1307 microversion: 2.1 time: 0.414304 Oct 11 04:24:33.742481 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1705/3270] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:33 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1307 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:34.102435 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1a6f08d6-f8df-4fca-ac0d-220332748cac tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.496745 Oct 11 04:24:34.103809 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1566/3271] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:24:33 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:24:34.122669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3346ae35-5c18-4b60-b623-a20725eea67f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda193c53a0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:34.173760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e609b0ee-9044-4fcc-af68-0254a4737446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:34.174483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e609b0ee-9044-4fcc-af68-0254a4737446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:34.181720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e609b0ee-9044-4fcc-af68-0254a4737446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:34.185260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e609b0ee-9044-4fcc-af68-0254a4737446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:34.185260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e609b0ee-9044-4fcc-af68-0254a4737446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:34.185260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e609b0ee-9044-4fcc-af68-0254a4737446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:34.185260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e609b0ee-9044-4fcc-af68-0254a4737446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:34.185260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e609b0ee-9044-4fcc-af68-0254a4737446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:34.204927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:34.348372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e609b0ee-9044-4fcc-af68-0254a4737446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:34.354769 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e609b0ee-9044-4fcc-af68-0254a4737446 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.185534 Oct 11 04:24:34.370214 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1567/3272] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:34 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:34.769308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-693621b0-6d03-41ec-9a36-5bd6086ce27f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:34.769794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-693621b0-6d03-41ec-9a36-5bd6086ce27f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:34.781043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-693621b0-6d03-41ec-9a36-5bd6086ce27f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:34.781547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-693621b0-6d03-41ec-9a36-5bd6086ce27f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:34.781997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-693621b0-6d03-41ec-9a36-5bd6086ce27f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:34.785563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-693621b0-6d03-41ec-9a36-5bd6086ce27f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:34.791476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-693621b0-6d03-41ec-9a36-5bd6086ce27f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:34.792107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-693621b0-6d03-41ec-9a36-5bd6086ce27f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:34.818807 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3346ae35-5c18-4b60-b623-a20725eea67f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1829 microversion: 2.1 time: 0.705888 Oct 11 04:24:34.820626 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1706/3273] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:24:34 2022] GET /compute/v2.1/os-security-groups => generated 1829 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:34.836185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0ab40d7-ae58-44d0-b70d-ad208cd751d3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19316790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:35.088423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-693621b0-6d03-41ec-9a36-5bd6086ce27f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:35.096778 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-693621b0-6d03-41ec-9a36-5bd6086ce27f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1307 microversion: 2.1 time: 0.331948 Oct 11 04:24:35.101676 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1568/3274] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:34 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1307 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:35.142058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-245551041", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "bd2c78a6-97b9-452a-9119-faf2e8c08b5b"}, {"port": "cb8530f1-3a71-44d5-9c2f-f4252591ccc9", "tag": "port-1"}, {"port": "19904f71-1cd6-4db1-9e7e-42cc6e25cf8d", "tag": "port-2"}, {"uuid": "1e595a71-21f6-48d9-abf2-2247d03c837b", "tag": "net-1"}, {"uuid": "1e595a71-21f6-48d9-abf2-2247d03c837b"}, {"uuid": "d704349a-22d0-40bf-a8ae-c94fcf1b3701", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "d704349a-22d0-40bf-a8ae-c94fcf1b3701", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "d8b9cbdf-ec6f-46f6-b2a6-928da8623d0d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "87224978-6262-4fb2-b052-bfd3a7390aee", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c27d9736-83a8-454c-ba82-054d5ea35bc7", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--829768207"}], "key_name": "tempest-keypair-512300577", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:35.154750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:35.360573 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c0ab40d7-ae58-44d0-b70d-ad208cd751d3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/a7243cb9-4b72-4d6a-af8d-0a43d178b02b" status: 202 len: 0 microversion: 2.1 time: 0.528672 Oct 11 04:24:35.362223 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1707/3275] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:24:34 2022] DELETE /compute/v2.1/os-security-groups/a7243cb9-4b72-4d6a-af8d-0a43d178b02b => generated 0 bytes in 531 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:24:35.368611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b6e121b5-3174-4807-8768-49e27d7ccafe req-beb48142-8224-4fd3-84dc-e330a592d58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a701828-9b98-4469-af1d-969d4eae10e6", "name": "network-vif-plugged", "status": "completed", "tag": "ccebd3f9-3f22-4ca4-9e98-ada82780b131"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:35.384987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6e121b5-3174-4807-8768-49e27d7ccafe req-beb48142-8224-4fd3-84dc-e330a592d58f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:35.385770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6e121b5-3174-4807-8768-49e27d7ccafe req-beb48142-8224-4fd3-84dc-e330a592d58f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:35.386507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6e121b5-3174-4807-8768-49e27d7ccafe req-beb48142-8224-4fd3-84dc-e330a592d58f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:35.403356 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b6e121b5-3174-4807-8768-49e27d7ccafe req-beb48142-8224-4fd3-84dc-e330a592d58f service nova] Creating event network-vif-plugged:ccebd3f9-3f22-4ca4-9e98-ada82780b131 for instance 1a701828-9b98-4469-af1d-969d4eae10e6 on n-h1-860892-1 Oct 11 04:24:35.432157 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b6e121b5-3174-4807-8768-49e27d7ccafe req-beb48142-8224-4fd3-84dc-e330a592d58f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053420 Oct 11 04:24:35.434059 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1708/3276] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:35.447448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48b5dd26-8432-409e-9781-b45c7940654c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda1df52700>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:35.536441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG neutronclient.v2_0.client [None req-48b5dd26-8432-409e-9781-b45c7940654c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist", "detail": ""}} {{(pid=120994) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:24:35.537675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.security_group_api [None req-48b5dd26-8432-409e-9781-b45c7940654c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Neutron security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b not found {{(pid=120994) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:24:35.538879 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-48b5dd26-8432-409e-9781-b45c7940654c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:24:35.538879 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-c342be7d-87af-4f72-99f2-de33350ce666'] Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48b5dd26-8432-409e-9781-b45c7940654c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-security-groups/a7243cb9-4b72-4d6a-af8d-0a43d178b02b HTTP/1.1 Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: exception: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-c342be7d-87af-4f72-99f2-de33350ce666'] Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'a7243cb9-4b72-4d6a-af8d-0a43d178b02b'} Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:24:35.541439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c342be7d-87af-4f72-99f2-de33350ce666'] Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c342be7d-87af-4f72-99f2-de33350ce666'] Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c342be7d-87af-4f72-99f2-de33350ce666'] Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-c342be7d-87af-4f72-99f2-de33350ce666'] Oct 11 04:24:35.545301 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:35.552261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48b5dd26-8432-409e-9781-b45c7940654c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:24:35.552261 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-c342be7d-87af-4f72-99f2-de33350ce666'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:24:35.553461 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48b5dd26-8432-409e-9781-b45c7940654c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/a7243cb9-4b72-4d6a-af8d-0a43d178b02b" status: 404 len: 194 microversion: 2.1 time: 0.116539 Oct 11 04:24:35.555200 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1709/3277] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:24:35 2022] GET /compute/v2.1/os-security-groups/a7243cb9-4b72-4d6a-af8d-0a43d178b02b => generated 194 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:24:35.560524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e47e922-9f9a-46f5-b87d-147b2e19ea9f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:35.561392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e47e922-9f9a-46f5-b87d-147b2e19ea9f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:35.575328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e47e922-9f9a-46f5-b87d-147b2e19ea9f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:35.578505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e47e922-9f9a-46f5-b87d-147b2e19ea9f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:35.579139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e47e922-9f9a-46f5-b87d-147b2e19ea9f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:35.580077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e47e922-9f9a-46f5-b87d-147b2e19ea9f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:35.580717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e47e922-9f9a-46f5-b87d-147b2e19ea9f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:35.581397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e47e922-9f9a-46f5-b87d-147b2e19ea9f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:35.899649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e47e922-9f9a-46f5-b87d-147b2e19ea9f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:35.922904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] validate_networks() for [('bd2c78a6-97b9-452a-9119-faf2e8c08b5b', None, None, None, None, None), (None, None, 'cb8530f1-3a71-44d5-9c2f-f4252591ccc9', None, None, None), (None, None, '19904f71-1cd6-4db1-9e7e-42cc6e25cf8d', None, None, None), ('1e595a71-21f6-48d9-abf2-2247d03c837b', None, None, None, None, None), ('1e595a71-21f6-48d9-abf2-2247d03c837b', None, None, None, None, None), ('d704349a-22d0-40bf-a8ae-c94fcf1b3701', '10.2.2.100', None, None, None, None), ('d704349a-22d0-40bf-a8ae-c94fcf1b3701', '10.2.2.200', None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:24:35.928571 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e47e922-9f9a-46f5-b87d-147b2e19ea9f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.361603 Oct 11 04:24:35.929693 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1710/3278] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:35 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:35.942861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7f36a7d4-1a87-4a93-8bd9-3dc03605f1a2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19316b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:36.436416 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7f36a7d4-1a87-4a93-8bd9-3dc03605f1a2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c7cdda8a-ae7c-41fd-90a3-405571d5d503" status: 202 len: 0 microversion: 2.1 time: 0.504803 Oct 11 04:24:36.440037 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1711/3279] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:24:35 2022] DELETE /compute/v2.1/os-security-groups/c7cdda8a-ae7c-41fd-90a3-405571d5d503 => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:24:36.442642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-726d8532-676f-473f-8a85-591dd1f9d6d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:36.443289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-726d8532-676f-473f-8a85-591dd1f9d6d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:36.459234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-726d8532-676f-473f-8a85-591dd1f9d6d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:36.459741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-726d8532-676f-473f-8a85-591dd1f9d6d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:36.461676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-726d8532-676f-473f-8a85-591dd1f9d6d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:36.462405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-726d8532-676f-473f-8a85-591dd1f9d6d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:36.462867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-726d8532-676f-473f-8a85-591dd1f9d6d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:36.465439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-726d8532-676f-473f-8a85-591dd1f9d6d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:36.810510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-726d8532-676f-473f-8a85-591dd1f9d6d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:36.820515 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-726d8532-676f-473f-8a85-591dd1f9d6d3 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1307 microversion: 2.1 time: 0.381822 Oct 11 04:24:36.827360 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1712/3280] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:36 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1307 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:36.832535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e110e82-71b0-4aa5-b29b-51efed7a7230 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19316b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:36.888633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG neutronclient.v2_0.client [None req-6e110e82-71b0-4aa5-b29b-51efed7a7230 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist", "detail": ""}} {{(pid=120994) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:24:36.889827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.security_group_api [None req-6e110e82-71b0-4aa5-b29b-51efed7a7230 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Neutron security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 not found {{(pid=120994) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:24:36.890614 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-6e110e82-71b0-4aa5-b29b-51efed7a7230 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:24:36.890614 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-b6c5e095-7430-47cd-bfa2-993eeaa1e67b'] Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e110e82-71b0-4aa5-b29b-51efed7a7230 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-security-groups/c7cdda8a-ae7c-41fd-90a3-405571d5d503 HTTP/1.1 Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: exception: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-b6c5e095-7430-47cd-bfa2-993eeaa1e67b'] Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'c7cdda8a-ae7c-41fd-90a3-405571d5d503'} Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:24:36.892798 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6c5e095-7430-47cd-bfa2-993eeaa1e67b'] Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6c5e095-7430-47cd-bfa2-993eeaa1e67b'] Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6c5e095-7430-47cd-bfa2-993eeaa1e67b'] Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b6c5e095-7430-47cd-bfa2-993eeaa1e67b'] Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e110e82-71b0-4aa5-b29b-51efed7a7230 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-b6c5e095-7430-47cd-bfa2-993eeaa1e67b'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e110e82-71b0-4aa5-b29b-51efed7a7230 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/c7cdda8a-ae7c-41fd-90a3-405571d5d503" status: 404 len: 194 microversion: 2.1 time: 0.067974 Oct 11 04:24:36.901327 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1713/3281] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:24:36 2022] GET /compute/v2.1/os-security-groups/c7cdda8a-ae7c-41fd-90a3-405571d5d503 => generated 194 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:24:36.911539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0cd38a19-4956-46d6-9b44-b59826adf1c7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda193ceee0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:37.581630 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0cd38a19-4956-46d6-9b44-b59826adf1c7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/59c58922-e4e6-4546-b4fa-15ea618cef92" status: 202 len: 0 microversion: 2.1 time: 0.674640 Oct 11 04:24:37.582613 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1714/3282] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:24:36 2022] DELETE /compute/v2.1/os-security-groups/59c58922-e4e6-4546-b4fa-15ea618cef92 => generated 0 bytes in 676 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:24:37.589390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6ae665e6-6c7c-4f58-8ed4-e6fc1b9718c3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:37.590480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6ae665e6-6c7c-4f58-8ed4-e6fc1b9718c3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:37.600105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ae665e6-6c7c-4f58-8ed4-e6fc1b9718c3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:37.602435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ae665e6-6c7c-4f58-8ed4-e6fc1b9718c3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:37.603116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ae665e6-6c7c-4f58-8ed4-e6fc1b9718c3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:37.604246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ae665e6-6c7c-4f58-8ed4-e6fc1b9718c3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:37.604928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ae665e6-6c7c-4f58-8ed4-e6fc1b9718c3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:37.605641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ae665e6-6c7c-4f58-8ed4-e6fc1b9718c3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:37.902727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6ae665e6-6c7c-4f58-8ed4-e6fc1b9718c3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:37.923965 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6ae665e6-6c7c-4f58-8ed4-e6fc1b9718c3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.333328 Oct 11 04:24:37.926119 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1715/3283] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:37 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:37.937947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8787cd5e-eaf7-4b90-a717-a038af1300d2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda194d0280>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:37.980938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG neutronclient.v2_0.client [None req-8787cd5e-eaf7-4b90-a717-a038af1300d2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist", "detail": ""}} {{(pid=120994) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:24:37.982040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.security_group_api [None req-8787cd5e-eaf7-4b90-a717-a038af1300d2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Neutron security group 59c58922-e4e6-4546-b4fa-15ea618cef92 not found {{(pid=120994) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:24:37.982994 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-8787cd5e-eaf7-4b90-a717-a038af1300d2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:24:37.982994 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-12e49792-b843-432a-9bde-e85417d41be4'] Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8787cd5e-eaf7-4b90-a717-a038af1300d2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/os-security-groups/59c58922-e4e6-4546-b4fa-15ea618cef92 HTTP/1.1 Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: exception: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-12e49792-b843-432a-9bde-e85417d41be4'] Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '59c58922-e4e6-4546-b4fa-15ea618cef92'} Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:24:37.985316 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12e49792-b843-432a-9bde-e85417d41be4'] Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 158, in show Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12e49792-b843-432a-9bde-e85417d41be4'] Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 160, in show Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12e49792-b843-432a-9bde-e85417d41be4'] Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-12e49792-b843-432a-9bde-e85417d41be4'] Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8787cd5e-eaf7-4b90-a717-a038af1300d2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-12e49792-b843-432a-9bde-e85417d41be4'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8787cd5e-eaf7-4b90-a717-a038af1300d2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/59c58922-e4e6-4546-b4fa-15ea618cef92" status: 404 len: 194 microversion: 2.1 time: 0.052850 Oct 11 04:24:37.990378 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1716/3284] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:24:37 2022] GET /compute/v2.1/os-security-groups/59c58922-e4e6-4546-b4fa-15ea618cef92 => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:24:38.001266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a2953015-07e5-4ab6-8d21-7153b8fad1c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:38.004956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a2953015-07e5-4ab6-8d21-7153b8fad1c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:38.021112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2953015-07e5-4ab6-8d21-7153b8fad1c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:38.021761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2953015-07e5-4ab6-8d21-7153b8fad1c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:38.022366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2953015-07e5-4ab6-8d21-7153b8fad1c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:38.023685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2953015-07e5-4ab6-8d21-7153b8fad1c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:38.025006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2953015-07e5-4ab6-8d21-7153b8fad1c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:38.026107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2953015-07e5-4ab6-8d21-7153b8fad1c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:38.199479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a2953015-07e5-4ab6-8d21-7153b8fad1c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:38.211625 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a2953015-07e5-4ab6-8d21-7153b8fad1c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1488 microversion: 2.1 time: 0.221041 Oct 11 04:24:38.212777 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1717/3285] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:37 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1488 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:38.219256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d7add163-79dd-4c5e-82de-12a0d1658890 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda193c5e50>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:38.436382 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d7add163-79dd-4c5e-82de-12a0d1658890 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups" status: 200 len: 1155 microversion: 2.1 time: 0.222369 Oct 11 04:24:38.437242 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1718/3286] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:24:38 2022] GET /compute/v2.1/os-security-groups => generated 1155 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:38.442062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ad7b4988-664e-4c80-a63f-0c761c867d66 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:38.442757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ad7b4988-664e-4c80-a63f-0c761c867d66 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:38.455422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad7b4988-664e-4c80-a63f-0c761c867d66 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:38.456126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad7b4988-664e-4c80-a63f-0c761c867d66 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:38.456754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad7b4988-664e-4c80-a63f-0c761c867d66 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:38.457621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad7b4988-664e-4c80-a63f-0c761c867d66 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:38.458249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad7b4988-664e-4c80-a63f-0c761c867d66 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:38.458919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad7b4988-664e-4c80-a63f-0c761c867d66 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:38.490009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-ad7b4988-664e-4c80-a63f-0c761c867d66 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lazy-loading 'flavor' on Instance uuid 1a701828-9b98-4469-af1d-969d4eae10e6 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:24:38.831792 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ad7b4988-664e-4c80-a63f-0c761c867d66 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "POST /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6/action" status: 202 len: 0 microversion: 2.1 time: 0.392773 Oct 11 04:24:38.833707 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1719/3287] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:24:38 2022] POST /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6/action => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:24:38.846841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbecfb99-37df-4be2-bc4d-1f405e35cf7d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'create', calling method: .version_select at 0x7fda192a5040>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1797971679", "description": "tempest-description-1262554609"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:39.561205 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cbecfb99-37df-4be2-bc4d-1f405e35cf7d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.725044 Oct 11 04:24:39.562817 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1720/3288] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:24:38 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:39.569274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-865669e2-efc6-4a8f-8333-01ca362c0a0b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:39.572158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-865669e2-efc6-4a8f-8333-01ca362c0a0b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:39.596025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-865669e2-efc6-4a8f-8333-01ca362c0a0b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:39.596688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-865669e2-efc6-4a8f-8333-01ca362c0a0b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:39.597282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-865669e2-efc6-4a8f-8333-01ca362c0a0b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:39.598653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-865669e2-efc6-4a8f-8333-01ca362c0a0b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:39.599323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-865669e2-efc6-4a8f-8333-01ca362c0a0b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:39.600006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-865669e2-efc6-4a8f-8333-01ca362c0a0b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:39.639045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:24:39.639598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:24:39.640101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:24:39.640586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:24:39.641070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:24:39.671398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:39.676056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:39.676589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:39.677471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:39.683948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:39.684502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:39.714045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Getting quotas for project 529357092c6e404e982f968263d41eae. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:24:39.720429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Getting quotas for user 1f75f519f7b44fc8b81d281cf0d3f502 and project 529357092c6e404e982f968263d41eae. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:24:39.781398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-865669e2-efc6-4a8f-8333-01ca362c0a0b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:39.790887 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-865669e2-efc6-4a8f-8333-01ca362c0a0b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1496 microversion: 2.1 time: 0.226496 Oct 11 04:24:39.791680 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1721/3289] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:39 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1496 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:39.799061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40be98eb-060a-45a0-a93b-ac4b15ddf20b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:39.800101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-40be98eb-060a-45a0-a93b-ac4b15ddf20b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:39.808270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40be98eb-060a-45a0-a93b-ac4b15ddf20b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:39.809034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40be98eb-060a-45a0-a93b-ac4b15ddf20b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:39.809248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40be98eb-060a-45a0-a93b-ac4b15ddf20b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:39.810013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40be98eb-060a-45a0-a93b-ac4b15ddf20b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:39.810628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40be98eb-060a-45a0-a93b-ac4b15ddf20b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:39.811109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40be98eb-060a-45a0-a93b-ac4b15ddf20b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:39.907596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:24:39.910511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='d8b9cbdf-ec6f-46f6-b2a6-928da8623d0d',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='87224978-6262-4fb2-b052-bfd3a7390aee',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c27d9736-83a8-454c-ba82-054d5ea35bc7',volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:24:39.979433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40be98eb-060a-45a0-a93b-ac4b15ddf20b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:39.992115 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40be98eb-060a-45a0-a93b-ac4b15ddf20b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.194127 Oct 11 04:24:39.992115 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1722/3290] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:39 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:39.993505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e255a50d-23fc-4e13-a961-b24e56b48dba tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'create', calling method: .version_select at 0x7fda1a80daf0>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-659897356", "description": "tempest-description-306063030"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:40.613468 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e255a50d-23fc-4e13-a961-b24e56b48dba tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 242 microversion: 2.1 time: 0.624187 Oct 11 04:24:40.615446 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1723/3291] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:24:39 2022] POST /compute/v2.1/os-security-groups => generated 242 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:40.746698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SecurityGroupsTestJSON-server-1489616434", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "a2440285-7102-45ef-9ea2-a8f1a613870d"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:40.810290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] validate_networks() for [('a2440285-7102-45ef-9ea2-a8f1a613870d', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:24:41.302108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:24:41.302867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:24:41.303068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:24:41.303477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:24:41.303894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:24:41.312864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:41.313329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:41.314001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:41.314933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:41.315536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:41.319919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:41.338102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Getting quotas for project 5a9d56ebae03424f9f9892abf32b7579. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:24:41.344389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Getting quotas for user 47f8ee8bc00840c99abafb15e9d32b84 and project 5a9d56ebae03424f9f9892abf32b7579. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:24:41.360022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:24:41.362497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:24:41.558707 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c2fbddc0-904d-42cd-97ae-cc8ad5db3c37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.817981 Oct 11 04:24:41.559934 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1724/3292] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:24:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:24:41.565533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bf966a45-9ac8-46a6-8f79-02163bec4ba5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:41.568510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bf966a45-9ac8-46a6-8f79-02163bec4ba5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:41.578523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf966a45-9ac8-46a6-8f79-02163bec4ba5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:41.579289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf966a45-9ac8-46a6-8f79-02163bec4ba5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:41.579893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf966a45-9ac8-46a6-8f79-02163bec4ba5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:41.580951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf966a45-9ac8-46a6-8f79-02163bec4ba5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:41.581560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf966a45-9ac8-46a6-8f79-02163bec4ba5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:41.582136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf966a45-9ac8-46a6-8f79-02163bec4ba5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:41.733936 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-17e8e825-b0fc-4e4a-b407-a000976e377f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.32 time: 6.598995 Oct 11 04:24:41.744132 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1569/3293] 10.222.0.26 () {62 vars in 1189 bytes} [Tue Oct 11 04:24:35 2022] POST /compute/v2.1/servers => generated 405 bytes in 6605 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:24:41.747723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cff2c448-f68d-4553-b6f4-3f2b28a1948f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:41.748423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cff2c448-f68d-4553-b6f4-3f2b28a1948f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:41.755739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff2c448-f68d-4553-b6f4-3f2b28a1948f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:41.763712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff2c448-f68d-4553-b6f4-3f2b28a1948f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:41.763712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff2c448-f68d-4553-b6f4-3f2b28a1948f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:41.763712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff2c448-f68d-4553-b6f4-3f2b28a1948f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:41.763712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff2c448-f68d-4553-b6f4-3f2b28a1948f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:41.763712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cff2c448-f68d-4553-b6f4-3f2b28a1948f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:41.806736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf966a45-9ac8-46a6-8f79-02163bec4ba5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:41.819913 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bf966a45-9ac8-46a6-8f79-02163bec4ba5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 200 len: 1479 microversion: 2.1 time: 0.257705 Oct 11 04:24:41.823748 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1725/3294] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:41 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 1479 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:41.839407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-398b489e-1162-42be-8104-1aa1e82ce182 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:41.840391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-398b489e-1162-42be-8104-1aa1e82ce182 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:41.940831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-398b489e-1162-42be-8104-1aa1e82ce182 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:41.954039 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-398b489e-1162-42be-8104-1aa1e82ce182 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1216 microversion: 2.1 time: 0.131439 Oct 11 04:24:41.970285 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1726/3295] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:41 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1216 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:41.981247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef176c56-f2f3-4b93-8369-63311a4f9b3f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:41.983115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef176c56-f2f3-4b93-8369-63311a4f9b3f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:42.059793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef176c56-f2f3-4b93-8369-63311a4f9b3f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:42.079239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef176c56-f2f3-4b93-8369-63311a4f9b3f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:42.085962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef176c56-f2f3-4b93-8369-63311a4f9b3f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:42.089460 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef176c56-f2f3-4b93-8369-63311a4f9b3f tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1284 microversion: 2.32 time: 0.129639 Oct 11 04:24:42.091864 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1727/3296] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:41 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1284 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:24:42.114091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b8461344-dcb8-428d-afe3-fbfe5fa50501 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-53997561"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:42.118831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b8461344-dcb8-428d-afe3-fbfe5fa50501 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:42.127122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8461344-dcb8-428d-afe3-fbfe5fa50501 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:42.127888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8461344-dcb8-428d-afe3-fbfe5fa50501 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:42.128490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8461344-dcb8-428d-afe3-fbfe5fa50501 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:42.129377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8461344-dcb8-428d-afe3-fbfe5fa50501 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:42.130089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8461344-dcb8-428d-afe3-fbfe5fa50501 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:42.130546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8461344-dcb8-428d-afe3-fbfe5fa50501 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:42.187009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cff2c448-f68d-4553-b6f4-3f2b28a1948f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:42.195431 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cff2c448-f68d-4553-b6f4-3f2b28a1948f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.454958 Oct 11 04:24:42.196020 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1570/3297] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:41 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:42.911901 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b8461344-dcb8-428d-afe3-fbfe5fa50501 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "POST /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6/action" status: 202 len: 0 microversion: 2.1 time: 0.806292 Oct 11 04:24:42.912568 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1728/3298] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:24:42 2022] POST /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6/action => generated 0 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 04:24:42.923165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5eadab12-767d-4ac8-b41d-87dff33acf9d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1a829310>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:42.982215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f405be82-38ab-4b83-b9e4-6d977e3d56e8 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:42.982924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f405be82-38ab-4b83-b9e4-6d977e3d56e8 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:42.994677 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5eadab12-767d-4ac8-b41d-87dff33acf9d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 0.075199 Oct 11 04:24:42.995271 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1571/3299] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:42 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:43.117590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c38f5735-a207-454d-bcd0-4e40e21d23ea tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:43.118701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c38f5735-a207-454d-bcd0-4e40e21d23ea tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:43.119272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f405be82-38ab-4b83-b9e4-6d977e3d56e8 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:43.129301 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f405be82-38ab-4b83-b9e4-6d977e3d56e8 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1216 microversion: 2.1 time: 0.153537 Oct 11 04:24:43.150067 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1729/3300] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:42 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1216 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:43.193881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c38f5735-a207-454d-bcd0-4e40e21d23ea tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:43.202909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c38f5735-a207-454d-bcd0-4e40e21d23ea tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:43.204796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c38f5735-a207-454d-bcd0-4e40e21d23ea tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:43.206501 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c38f5735-a207-454d-bcd0-4e40e21d23ea tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1284 microversion: 2.32 time: 0.093539 Oct 11 04:24:43.207612 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1572/3301] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:43 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:24:43.224727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5072bcc6-f619-4989-86c6-86469fc072a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:43.225801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5072bcc6-f619-4989-86c6-86469fc072a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:43.239761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5072bcc6-f619-4989-86c6-86469fc072a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:43.250890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5072bcc6-f619-4989-86c6-86469fc072a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:43.250890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5072bcc6-f619-4989-86c6-86469fc072a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:43.250890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5072bcc6-f619-4989-86c6-86469fc072a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:43.250890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5072bcc6-f619-4989-86c6-86469fc072a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:43.250890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5072bcc6-f619-4989-86c6-86469fc072a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:43.469011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5072bcc6-f619-4989-86c6-86469fc072a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:43.478420 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5072bcc6-f619-4989-86c6-86469fc072a4 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.257860 Oct 11 04:24:43.495372 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1730/3302] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:43 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:44.010583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4886c4d6-5acd-4c33-a93b-edb064380f16 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19b6ba60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:44.056203 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4886c4d6-5acd-4c33-a93b-edb064380f16 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 0.050128 Oct 11 04:24:44.056885 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1573/3303] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:44 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:44.158414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1cabc6dc-2338-4b20-9568-65e7dfacb83b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:44.162863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1cabc6dc-2338-4b20-9568-65e7dfacb83b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:44.166819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cabc6dc-2338-4b20-9568-65e7dfacb83b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:44.167433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cabc6dc-2338-4b20-9568-65e7dfacb83b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:44.167872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cabc6dc-2338-4b20-9568-65e7dfacb83b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:44.168664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cabc6dc-2338-4b20-9568-65e7dfacb83b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:44.169120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cabc6dc-2338-4b20-9568-65e7dfacb83b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:44.169540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cabc6dc-2338-4b20-9568-65e7dfacb83b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:44.240952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8943b4d-147c-4aa8-893d-662a7b682d13 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:44.241189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1cabc6dc-2338-4b20-9568-65e7dfacb83b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:44.243153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a8943b4d-147c-4aa8-893d-662a7b682d13 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:44.253641 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1cabc6dc-2338-4b20-9568-65e7dfacb83b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1212 microversion: 2.1 time: 0.099130 Oct 11 04:24:44.254256 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1731/3304] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:44 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1212 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:44.307631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a8943b4d-147c-4aa8-893d-662a7b682d13 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:44.317351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a8943b4d-147c-4aa8-893d-662a7b682d13 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:44.318372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a8943b4d-147c-4aa8-893d-662a7b682d13 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:44.319920 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a8943b4d-147c-4aa8-893d-662a7b682d13 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1284 microversion: 2.32 time: 0.084603 Oct 11 04:24:44.326758 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1574/3305] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:44 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:24:44.502612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b22fe2d-2953-481d-9d55-6c573a0dde22 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:44.503220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1b22fe2d-2953-481d-9d55-6c573a0dde22 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:44.521773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b22fe2d-2953-481d-9d55-6c573a0dde22 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:44.525025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b22fe2d-2953-481d-9d55-6c573a0dde22 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:44.525781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b22fe2d-2953-481d-9d55-6c573a0dde22 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:44.526213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b22fe2d-2953-481d-9d55-6c573a0dde22 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:44.527031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b22fe2d-2953-481d-9d55-6c573a0dde22 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:44.527161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b22fe2d-2953-481d-9d55-6c573a0dde22 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:44.574715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:44.804230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1b22fe2d-2953-481d-9d55-6c573a0dde22 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:44.814110 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1b22fe2d-2953-481d-9d55-6c573a0dde22 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.315918 Oct 11 04:24:44.815582 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1732/3306] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:44 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:45.075503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ac5a7f24-03a6-43a5-a8eb-5c19029a2ae4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19bc5550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:45.147846 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ac5a7f24-03a6-43a5-a8eb-5c19029a2ae4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 0.076518 Oct 11 04:24:45.149760 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1575/3307] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:45 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:45.285941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6fcec2ce-da1b-4e7b-9476-fb3eaf1e8af2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:45.287556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6fcec2ce-da1b-4e7b-9476-fb3eaf1e8af2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:45.302061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fcec2ce-da1b-4e7b-9476-fb3eaf1e8af2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:45.303091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fcec2ce-da1b-4e7b-9476-fb3eaf1e8af2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:45.305123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fcec2ce-da1b-4e7b-9476-fb3eaf1e8af2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:45.306091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fcec2ce-da1b-4e7b-9476-fb3eaf1e8af2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:45.310663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fcec2ce-da1b-4e7b-9476-fb3eaf1e8af2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:45.311383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fcec2ce-da1b-4e7b-9476-fb3eaf1e8af2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:45.347830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:45.348778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:45.366664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:45.368033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:45.369572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:45.369572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:45.374115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:45.374839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:45.448857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6fcec2ce-da1b-4e7b-9476-fb3eaf1e8af2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:45.463700 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6fcec2ce-da1b-4e7b-9476-fb3eaf1e8af2 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1276 microversion: 2.1 time: 0.181741 Oct 11 04:24:45.465293 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1733/3308] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:45 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1276 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:45.687377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:45.687377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:45.687377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:45.687377 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-709ca02d-8436-4078-a360-5bab133fc03c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1574 microversion: 2.32 time: 0.291437 Oct 11 04:24:45.687377 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1576/3309] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:45 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1574 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:24:45.841717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e2f81c8f-6c98-4c76-955d-fda87e41e8ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:45.842384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e2f81c8f-6c98-4c76-955d-fda87e41e8ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:45.876091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2f81c8f-6c98-4c76-955d-fda87e41e8ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:45.876091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2f81c8f-6c98-4c76-955d-fda87e41e8ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:45.876091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2f81c8f-6c98-4c76-955d-fda87e41e8ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:45.876091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2f81c8f-6c98-4c76-955d-fda87e41e8ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:45.876091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2f81c8f-6c98-4c76-955d-fda87e41e8ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:45.876091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2f81c8f-6c98-4c76-955d-fda87e41e8ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:46.102815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e2f81c8f-6c98-4c76-955d-fda87e41e8ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:46.111731 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e2f81c8f-6c98-4c76-955d-fda87e41e8ee tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.276842 Oct 11 04:24:46.112327 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1734/3310] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:45 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:46.165316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e0ab4aa-69d7-4ab5-9d10-03c23efc0598 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19ba53a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:46.248800 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8e0ab4aa-69d7-4ab5-9d10-03c23efc0598 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 0.088107 Oct 11 04:24:46.262722 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1577/3311] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:46 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:46.487837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f3dbf25e-dd7d-48c1-a3f1-4be1e0468a74 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:46.488745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f3dbf25e-dd7d-48c1-a3f1-4be1e0468a74 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:46.502957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3dbf25e-dd7d-48c1-a3f1-4be1e0468a74 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:46.503495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3dbf25e-dd7d-48c1-a3f1-4be1e0468a74 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:46.503953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3dbf25e-dd7d-48c1-a3f1-4be1e0468a74 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:46.504932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3dbf25e-dd7d-48c1-a3f1-4be1e0468a74 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:46.505396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3dbf25e-dd7d-48c1-a3f1-4be1e0468a74 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:46.505828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3dbf25e-dd7d-48c1-a3f1-4be1e0468a74 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:46.673789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f3dbf25e-dd7d-48c1-a3f1-4be1e0468a74 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:46.675920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:46.678788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:46.683093 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f3dbf25e-dd7d-48c1-a3f1-4be1e0468a74 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1274 microversion: 2.1 time: 0.199501 Oct 11 04:24:46.703895 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1735/3312] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:46 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1274 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:46.704053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:46.704053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:46.704053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:46.704053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:46.704053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:46.704478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:47.084020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:47.097208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:47.098672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:47.110721 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-78198509-7560-4546-a822-e34dc1cd7476 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1582 microversion: 2.32 time: 0.438550 Oct 11 04:24:47.134225 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1578/3313] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:46 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1582 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:24:47.144335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7c77be83-67a6-4e4a-ab8b-9a7bd1b76c72 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:47.144335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7c77be83-67a6-4e4a-ab8b-9a7bd1b76c72 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:47.153738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c77be83-67a6-4e4a-ab8b-9a7bd1b76c72 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:47.156680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c77be83-67a6-4e4a-ab8b-9a7bd1b76c72 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:47.163365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c77be83-67a6-4e4a-ab8b-9a7bd1b76c72 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:47.165957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c77be83-67a6-4e4a-ab8b-9a7bd1b76c72 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:47.166679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c77be83-67a6-4e4a-ab8b-9a7bd1b76c72 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:47.168019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c77be83-67a6-4e4a-ab8b-9a7bd1b76c72 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:47.266043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29f55f4d-3fe3-49b4-80b5-8f25d94a5121 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19ba5820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:47.394873 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-29f55f4d-3fe3-49b4-80b5-8f25d94a5121 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 0.133772 Oct 11 04:24:47.396072 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1579/3314] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:47 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:47.512884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7c77be83-67a6-4e4a-ab8b-9a7bd1b76c72 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:47.522924 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7c77be83-67a6-4e4a-ab8b-9a7bd1b76c72 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.389901 Oct 11 04:24:47.535118 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1736/3315] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:47 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:47.712215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a1a4271-f2a6-423d-a886-392e1fa6b378 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:47.712848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5a1a4271-f2a6-423d-a886-392e1fa6b378 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:47.743135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a1a4271-f2a6-423d-a886-392e1fa6b378 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:47.745655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a1a4271-f2a6-423d-a886-392e1fa6b378 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:47.745655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a1a4271-f2a6-423d-a886-392e1fa6b378 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:47.752297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a1a4271-f2a6-423d-a886-392e1fa6b378 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:47.755681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a1a4271-f2a6-423d-a886-392e1fa6b378 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:47.756626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a1a4271-f2a6-423d-a886-392e1fa6b378 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:48.155148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:48.156065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:48.176093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:48.177085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:48.183764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:48.184855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:48.185504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:48.186109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:48.362095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:48.374520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:48.377238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:48.393291 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f3654c38-23c7-4b71-8a5b-0cf84f319258 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1592 microversion: 2.32 time: 0.228999 Oct 11 04:24:48.394309 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1737/3316] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:48 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1592 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:24:48.423531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbb58901-ffa1-48ca-8e30-9df31a1414eb tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1e0ea160>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:48.535054 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cbb58901-ffa1-48ca-8e30-9df31a1414eb tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 0.120397 Oct 11 04:24:48.543705 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1738/3317] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:48 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:48.559675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ad634ba1-a732-42e0-a244-939d1be49d04 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:48.560617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ad634ba1-a732-42e0-a244-939d1be49d04 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:48.573143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad634ba1-a732-42e0-a244-939d1be49d04 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:48.573863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad634ba1-a732-42e0-a244-939d1be49d04 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:48.577958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad634ba1-a732-42e0-a244-939d1be49d04 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:48.577958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad634ba1-a732-42e0-a244-939d1be49d04 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:48.577958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad634ba1-a732-42e0-a244-939d1be49d04 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:48.577958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad634ba1-a732-42e0-a244-939d1be49d04 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:48.788239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ad634ba1-a732-42e0-a244-939d1be49d04 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:48.802284 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ad634ba1-a732-42e0-a244-939d1be49d04 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.246563 Oct 11 04:24:48.803876 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1739/3318] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:48 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:48.840898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5a1a4271-f2a6-423d-a886-392e1fa6b378 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:48.850422 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5a1a4271-f2a6-423d-a886-392e1fa6b378 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1316 microversion: 2.1 time: 1.142561 Oct 11 04:24:48.856079 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1580/3319] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:47 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1316 bytes in 1144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:49.027327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-26240011-60db-405b-b592-7618b63f8903 req-8f5a19a4-04a9-430a-bebe-b8ccfa73247e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a701828-9b98-4469-af1d-969d4eae10e6", "name": "network-vif-plugged", "status": "completed", "tag": "ccebd3f9-3f22-4ca4-9e98-ada82780b131"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:49.047138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-26240011-60db-405b-b592-7618b63f8903 req-8f5a19a4-04a9-430a-bebe-b8ccfa73247e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:49.049448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-26240011-60db-405b-b592-7618b63f8903 req-8f5a19a4-04a9-430a-bebe-b8ccfa73247e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:49.050510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-26240011-60db-405b-b592-7618b63f8903 req-8f5a19a4-04a9-430a-bebe-b8ccfa73247e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:49.101412 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-26240011-60db-405b-b592-7618b63f8903 req-8f5a19a4-04a9-430a-bebe-b8ccfa73247e service nova] Creating event network-vif-plugged:ccebd3f9-3f22-4ca4-9e98-ada82780b131 for instance 1a701828-9b98-4469-af1d-969d4eae10e6 on n-h1-860892-1 Oct 11 04:24:49.119761 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-26240011-60db-405b-b592-7618b63f8903 req-8f5a19a4-04a9-430a-bebe-b8ccfa73247e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096417 Oct 11 04:24:49.123075 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1740/3320] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:24:49.428045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:49.433750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:49.440261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:49.440754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:49.441195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:49.441914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:49.442404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:49.442837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:49.575538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3c9a9543-9601-49ba-8c7f-200596969283 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19316dc0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:49.677954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:49.690788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:49.692246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:49.693403 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fa82785e-1880-463a-bb24-cc49fb1281d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1592 microversion: 2.32 time: 0.269885 Oct 11 04:24:49.702541 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1581/3321] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:49 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1592 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:24:49.830598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ecb5487f-ba2a-4b10-9982-76e5dd48312d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:49.831222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ecb5487f-ba2a-4b10-9982-76e5dd48312d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:49.833902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:49.841946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb5487f-ba2a-4b10-9982-76e5dd48312d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:49.848042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb5487f-ba2a-4b10-9982-76e5dd48312d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:49.848901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb5487f-ba2a-4b10-9982-76e5dd48312d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:49.860910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb5487f-ba2a-4b10-9982-76e5dd48312d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:49.865341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb5487f-ba2a-4b10-9982-76e5dd48312d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:49.866016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb5487f-ba2a-4b10-9982-76e5dd48312d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:50.142796 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3c9a9543-9601-49ba-8c7f-200596969283 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 0.585523 Oct 11 04:24:50.143651 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1741/3322] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:49 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:50.150639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-daa4811b-b451-4da7-944b-4dc41aca570b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:50.151650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-daa4811b-b451-4da7-944b-4dc41aca570b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:50.162788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:50.171320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-daa4811b-b451-4da7-944b-4dc41aca570b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:50.172073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-daa4811b-b451-4da7-944b-4dc41aca570b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:50.172746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-daa4811b-b451-4da7-944b-4dc41aca570b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:50.173645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-daa4811b-b451-4da7-944b-4dc41aca570b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:50.174343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-daa4811b-b451-4da7-944b-4dc41aca570b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:50.174931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-daa4811b-b451-4da7-944b-4dc41aca570b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:50.352658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-daa4811b-b451-4da7-944b-4dc41aca570b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:50.363254 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-daa4811b-b451-4da7-944b-4dc41aca570b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1316 microversion: 2.1 time: 0.217097 Oct 11 04:24:50.363628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ecb5487f-ba2a-4b10-9982-76e5dd48312d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:50.364838 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1742/3323] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:50 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1316 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:50.398310 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ecb5487f-ba2a-4b10-9982-76e5dd48312d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.570666 Oct 11 04:24:50.400074 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1582/3324] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:49 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:50.730705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:50.732706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:50.754088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:50.757382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:50.759709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:50.763136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:50.766346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:50.767349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:51.192649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c036b391-9749-4439-be49-591bf32b39ea req-b6cda381-0ad5-42e9-935d-91eb18d80bf5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4c9df1-6017-4456-ab2e-69ad499d5f42", "tag": "08cc1bfa-756c-4b18-b1c5-b1d74ea2e257"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:51.192649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c036b391-9749-4439-be49-591bf32b39ea req-b6cda381-0ad5-42e9-935d-91eb18d80bf5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:51.192649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c036b391-9749-4439-be49-591bf32b39ea req-b6cda381-0ad5-42e9-935d-91eb18d80bf5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:51.192649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c036b391-9749-4439-be49-591bf32b39ea req-b6cda381-0ad5-42e9-935d-91eb18d80bf5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:51.192649 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c036b391-9749-4439-be49-591bf32b39ea req-b6cda381-0ad5-42e9-935d-91eb18d80bf5 service nova] Creating event network-changed:08cc1bfa-756c-4b18-b1c5-b1d74ea2e257 for instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 on n-h2-860892-1 Oct 11 04:24:51.216612 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c036b391-9749-4439-be49-591bf32b39ea req-b6cda381-0ad5-42e9-935d-91eb18d80bf5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084658 Oct 11 04:24:51.218133 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1583/3325] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:24:51.225625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a5d18836-ca5e-4b89-8979-477239dd47a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19a7da60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:51.329602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:52.027822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:52.047011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:52.049493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:52.051058 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-69af4912-17ee-4438-b337-eb15b89e31c0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1659 microversion: 2.32 time: 1.327303 Oct 11 04:24:52.051972 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1743/3326] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:50 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1659 bytes in 1329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:24:52.067134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e982fcb-30be-48b6-93e2-355365b5408e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:52.068011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e982fcb-30be-48b6-93e2-355365b5408e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:52.077824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e982fcb-30be-48b6-93e2-355365b5408e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:52.084444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e982fcb-30be-48b6-93e2-355365b5408e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:52.085202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e982fcb-30be-48b6-93e2-355365b5408e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:52.086791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e982fcb-30be-48b6-93e2-355365b5408e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:52.087428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e982fcb-30be-48b6-93e2-355365b5408e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:52.088054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e982fcb-30be-48b6-93e2-355365b5408e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:52.537343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e982fcb-30be-48b6-93e2-355365b5408e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:52.547039 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e982fcb-30be-48b6-93e2-355365b5408e tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1316 microversion: 2.1 time: 0.493852 Oct 11 04:24:52.551727 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1744/3327] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:52 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1316 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:52.561153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff35b463-0afc-4c66-aee1-dad46a5be510 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:52.562059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ff35b463-0afc-4c66-aee1-dad46a5be510 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:52.587489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff35b463-0afc-4c66-aee1-dad46a5be510 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:52.588333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff35b463-0afc-4c66-aee1-dad46a5be510 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:52.589002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff35b463-0afc-4c66-aee1-dad46a5be510 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:52.590381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff35b463-0afc-4c66-aee1-dad46a5be510 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:52.591109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff35b463-0afc-4c66-aee1-dad46a5be510 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:52.591739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff35b463-0afc-4c66-aee1-dad46a5be510 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:52.943590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ff35b463-0afc-4c66-aee1-dad46a5be510 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:52.960219 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff35b463-0afc-4c66-aee1-dad46a5be510 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1523 microversion: 2.1 time: 0.404657 Oct 11 04:24:52.961917 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1745/3328] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:52 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1523 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:52.975065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b820e559-81c0-42c3-94af-2bcdc8ee062a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:52.976759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b820e559-81c0-42c3-94af-2bcdc8ee062a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:52.988487 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a5d18836-ca5e-4b89-8979-477239dd47a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 1.768787 Oct 11 04:24:52.990652 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1584/3329] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:51 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 1771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:53.009649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b820e559-81c0-42c3-94af-2bcdc8ee062a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:53.012390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b820e559-81c0-42c3-94af-2bcdc8ee062a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:53.012842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b820e559-81c0-42c3-94af-2bcdc8ee062a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:53.014174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b820e559-81c0-42c3-94af-2bcdc8ee062a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:53.019284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b820e559-81c0-42c3-94af-2bcdc8ee062a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:53.019284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b820e559-81c0-42c3-94af-2bcdc8ee062a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:53.081030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:53.082168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:53.091084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:53.101814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:53.102594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:53.107108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:53.107823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:53.108977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:53.124606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=12 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:53.325515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b820e559-81c0-42c3-94af-2bcdc8ee062a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:53.333651 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b820e559-81c0-42c3-94af-2bcdc8ee062a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.370497 Oct 11 04:24:53.334425 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1746/3330] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:52 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:53.370148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4e7a7647-a1fe-4a50-ade5-97fcc7551ca2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:53.371875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4e7a7647-a1fe-4a50-ade5-97fcc7551ca2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:53.400322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7a7647-a1fe-4a50-ade5-97fcc7551ca2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:53.400942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7a7647-a1fe-4a50-ade5-97fcc7551ca2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:53.401374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7a7647-a1fe-4a50-ade5-97fcc7551ca2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:53.402818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7a7647-a1fe-4a50-ade5-97fcc7551ca2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:53.404449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7a7647-a1fe-4a50-ade5-97fcc7551ca2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:53.406039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7a7647-a1fe-4a50-ade5-97fcc7551ca2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:53.743272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:53.780801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:53.788725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:53.806710 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3d69a498-11c0-42d0-95b9-26f408bff07a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1659 microversion: 2.32 time: 0.715698 Oct 11 04:24:53.813646 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1585/3331] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:53 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1659 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:24:53.841740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-da7a7d1c-65ed-4cb7-aee6-8faa3814785f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:53.841740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-da7a7d1c-65ed-4cb7-aee6-8faa3814785f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:53.856421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da7a7d1c-65ed-4cb7-aee6-8faa3814785f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:53.858716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da7a7d1c-65ed-4cb7-aee6-8faa3814785f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:53.859862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da7a7d1c-65ed-4cb7-aee6-8faa3814785f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:53.863402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da7a7d1c-65ed-4cb7-aee6-8faa3814785f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:53.865928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da7a7d1c-65ed-4cb7-aee6-8faa3814785f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:53.867713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-da7a7d1c-65ed-4cb7-aee6-8faa3814785f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:54.235535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4e7a7647-a1fe-4a50-ade5-97fcc7551ca2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:54.246697 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4e7a7647-a1fe-4a50-ade5-97fcc7551ca2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.889885 Oct 11 04:24:54.254098 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1747/3332] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:53 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:54.282141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82b43564-fe9b-4d49-accf-312e5845ee2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:54.286729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82b43564-fe9b-4d49-accf-312e5845ee2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:54.293303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b43564-fe9b-4d49-accf-312e5845ee2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:54.294119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b43564-fe9b-4d49-accf-312e5845ee2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:54.294799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b43564-fe9b-4d49-accf-312e5845ee2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:54.295725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b43564-fe9b-4d49-accf-312e5845ee2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:54.296438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b43564-fe9b-4d49-accf-312e5845ee2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:54.297063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82b43564-fe9b-4d49-accf-312e5845ee2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:54.315554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=14 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:54.386170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-da7a7d1c-65ed-4cb7-aee6-8faa3814785f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:54.395345 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-da7a7d1c-65ed-4cb7-aee6-8faa3814785f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1316 microversion: 2.1 time: 0.579989 Oct 11 04:24:54.399058 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1586/3333] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:53 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1316 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:54.426514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-634afe9e-40a0-4b92-8e43-af97897f0313 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda192a2790>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:54.513346 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-634afe9e-40a0-4b92-8e43-af97897f0313 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 0.108965 Oct 11 04:24:54.516779 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1587/3334] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:54 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:54.525195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-623153c8-3b4c-4b48-8530-6518a8c149cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:54.536285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-623153c8-3b4c-4b48-8530-6518a8c149cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:54.556465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623153c8-3b4c-4b48-8530-6518a8c149cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:54.557258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623153c8-3b4c-4b48-8530-6518a8c149cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:54.557866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623153c8-3b4c-4b48-8530-6518a8c149cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:54.558786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623153c8-3b4c-4b48-8530-6518a8c149cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:54.559928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623153c8-3b4c-4b48-8530-6518a8c149cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:54.560535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623153c8-3b4c-4b48-8530-6518a8c149cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:54.901812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82b43564-fe9b-4d49-accf-312e5845ee2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:54.917255 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82b43564-fe9b-4d49-accf-312e5845ee2a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1505 microversion: 2.1 time: 0.639852 Oct 11 04:24:54.920264 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1748/3335] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:54 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1505 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:54.933666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:54.935132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:54.953584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:54.955707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:54.955707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:54.957708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:54.960088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:54.960785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:55.187169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-623153c8-3b4c-4b48-8530-6518a8c149cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:55.199807 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-623153c8-3b4c-4b48-8530-6518a8c149cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.678072 Oct 11 04:24:55.204682 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1588/3336] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:54 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:55.232884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00c18bba-8b1a-4345-86bb-80689e4ed816 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-1-2108530231"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:55.235701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00c18bba-8b1a-4345-86bb-80689e4ed816 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:55.254160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c18bba-8b1a-4345-86bb-80689e4ed816 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:55.255534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c18bba-8b1a-4345-86bb-80689e4ed816 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:55.258376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c18bba-8b1a-4345-86bb-80689e4ed816 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:55.259453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c18bba-8b1a-4345-86bb-80689e4ed816 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:55.260086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c18bba-8b1a-4345-86bb-80689e4ed816 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:55.260684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c18bba-8b1a-4345-86bb-80689e4ed816 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:55.586230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:55.602599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:55.604131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:55.605326 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fccffff5-5bad-4e57-b4ea-b80d4898ec97 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1705 microversion: 2.32 time: 0.681811 Oct 11 04:24:55.610487 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1749/3337] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:54 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1705 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:24:55.627919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f298ce6-bbe8-40de-b4ec-5f4003e4a4e0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:55.628776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f298ce6-bbe8-40de-b4ec-5f4003e4a4e0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:55.639629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f298ce6-bbe8-40de-b4ec-5f4003e4a4e0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:55.640987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f298ce6-bbe8-40de-b4ec-5f4003e4a4e0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:55.641884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f298ce6-bbe8-40de-b4ec-5f4003e4a4e0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:55.642928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f298ce6-bbe8-40de-b4ec-5f4003e4a4e0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:55.644356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f298ce6-bbe8-40de-b4ec-5f4003e4a4e0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:55.645297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f298ce6-bbe8-40de-b4ec-5f4003e4a4e0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:55.858625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2f298ce6-bbe8-40de-b4ec-5f4003e4a4e0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:55.870513 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f298ce6-bbe8-40de-b4ec-5f4003e4a4e0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1316 microversion: 2.1 time: 0.255620 Oct 11 04:24:55.876286 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1750/3338] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:55 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:55.886550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31a71587-09ee-4f52-9e60-79eebb044fd4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1957da60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:55.999381 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31a71587-09ee-4f52-9e60-79eebb044fd4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 0.121773 Oct 11 04:24:56.009428 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1751/3339] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:55 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:56.014666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3333241b-5355-4186-96ee-b431bb3aae88 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:56.015565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3333241b-5355-4186-96ee-b431bb3aae88 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:56.036125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3333241b-5355-4186-96ee-b431bb3aae88 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:56.036971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3333241b-5355-4186-96ee-b431bb3aae88 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:56.037613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3333241b-5355-4186-96ee-b431bb3aae88 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:56.038593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3333241b-5355-4186-96ee-b431bb3aae88 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:56.039251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3333241b-5355-4186-96ee-b431bb3aae88 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:56.039883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3333241b-5355-4186-96ee-b431bb3aae88 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:56.093129 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00c18bba-8b1a-4345-86bb-80689e4ed816 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.858791 Oct 11 04:24:56.093129 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1589/3340] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:24:55 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 11 04:24:56.265910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3333241b-5355-4186-96ee-b431bb3aae88 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:56.270055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:56.277523 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3333241b-5355-4186-96ee-b431bb3aae88 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1505 microversion: 2.1 time: 0.266444 Oct 11 04:24:56.278490 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1752/3341] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:56 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:56.637964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:56.638651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:56.645167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:56.651891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:56.651891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:56.651891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:56.651891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:56.651891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:56.898933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43ca97a7-c2a7-4ef6-81d5-a8de17811207 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:56.900679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-43ca97a7-c2a7-4ef6-81d5-a8de17811207 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:56.915405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43ca97a7-c2a7-4ef6-81d5-a8de17811207 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:56.916897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43ca97a7-c2a7-4ef6-81d5-a8de17811207 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:56.920101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43ca97a7-c2a7-4ef6-81d5-a8de17811207 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:56.921254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43ca97a7-c2a7-4ef6-81d5-a8de17811207 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:56.924600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43ca97a7-c2a7-4ef6-81d5-a8de17811207 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:56.925379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43ca97a7-c2a7-4ef6-81d5-a8de17811207 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:56.969571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:56.988688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:56.990428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:56.996301 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4ef9b0dc-7f6d-4eb6-a5d9-e231543c9793 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1751 microversion: 2.32 time: 0.363396 Oct 11 04:24:57.023145 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1590/3342] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:56 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1751 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:24:57.049040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-722b28bb-3bd5-4709-82b9-578d1aa2a153 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19b5dd30>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:57.172507 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-722b28bb-3bd5-4709-82b9-578d1aa2a153 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 0.144520 Oct 11 04:24:57.173872 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1591/3343] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:57 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:57.247165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-868c1e32-18e7-4f92-b5ac-00b5ac84e1f3 req-b5ff71bd-d907-4eb4-b4b4-c039e5cf10d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f905c4dd-c9f6-452d-bc51-696256de0b36", "name": "network-vif-unplugged", "status": "completed", "tag": "5dec51fb-6f29-4e7f-aeb9-d6572fc4d1e2"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:24:57.268500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-868c1e32-18e7-4f92-b5ac-00b5ac84e1f3 req-b5ff71bd-d907-4eb4-b4b4-c039e5cf10d0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:57.268988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-868c1e32-18e7-4f92-b5ac-00b5ac84e1f3 req-b5ff71bd-d907-4eb4-b4b4-c039e5cf10d0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:57.269448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-868c1e32-18e7-4f92-b5ac-00b5ac84e1f3 req-b5ff71bd-d907-4eb4-b4b4-c039e5cf10d0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:57.298381 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-868c1e32-18e7-4f92-b5ac-00b5ac84e1f3 req-b5ff71bd-d907-4eb4-b4b4-c039e5cf10d0 service nova] Creating event network-vif-unplugged:5dec51fb-6f29-4e7f-aeb9-d6572fc4d1e2 for instance f905c4dd-c9f6-452d-bc51-696256de0b36 on n-h1-860892-1 Oct 11 04:24:57.310564 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-868c1e32-18e7-4f92-b5ac-00b5ac84e1f3 req-b5ff71bd-d907-4eb4-b4b4-c039e5cf10d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.072996 Oct 11 04:24:57.317869 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1592/3344] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:24:57.326414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8404d22a-af4c-497a-b091-553ddbdfa59e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:57.326414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8404d22a-af4c-497a-b091-553ddbdfa59e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:57.340218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8404d22a-af4c-497a-b091-553ddbdfa59e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:57.340714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8404d22a-af4c-497a-b091-553ddbdfa59e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:57.341153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8404d22a-af4c-497a-b091-553ddbdfa59e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:57.352397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8404d22a-af4c-497a-b091-553ddbdfa59e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:57.352993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8404d22a-af4c-497a-b091-553ddbdfa59e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:57.353446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8404d22a-af4c-497a-b091-553ddbdfa59e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:57.406909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-43ca97a7-c2a7-4ef6-81d5-a8de17811207 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:57.414931 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-43ca97a7-c2a7-4ef6-81d5-a8de17811207 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1316 microversion: 2.1 time: 0.521799 Oct 11 04:24:57.415518 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1753/3345] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:56 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1316 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:57.630665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8404d22a-af4c-497a-b091-553ddbdfa59e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:57.639843 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8404d22a-af4c-497a-b091-553ddbdfa59e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1505 microversion: 2.1 time: 0.320424 Oct 11 04:24:57.657831 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1593/3346] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:57 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1505 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:58.029845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:58.030475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:58.040049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:58.051542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:58.052454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:58.053376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:58.053840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:58.061409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:58.195306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aac946de-e77e-4d08-ac01-0a0a66190499 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19b5d040>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:58.317777 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aac946de-e77e-4d08-ac01-0a0a66190499 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 0.128301 Oct 11 04:24:58.317777 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1594/3347] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:58 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:24:58.421124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:58.440732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce656b7f-0b05-4ae0-ae09-d06e8b443e55 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:58.440999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:58.441336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce656b7f-0b05-4ae0-ae09-d06e8b443e55 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:58.446873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:58.453212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce656b7f-0b05-4ae0-ae09-d06e8b443e55 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:58.453915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce656b7f-0b05-4ae0-ae09-d06e8b443e55 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:58.454576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce656b7f-0b05-4ae0-ae09-d06e8b443e55 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:58.455450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce656b7f-0b05-4ae0-ae09-d06e8b443e55 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:58.455696 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-80cf0254-6789-4d60-822f-9f1a13e780d2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1751 microversion: 2.32 time: 0.429609 Oct 11 04:24:58.456237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce656b7f-0b05-4ae0-ae09-d06e8b443e55 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:58.456357 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1754/3348] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:24:58 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1751 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:24:58.456997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce656b7f-0b05-4ae0-ae09-d06e8b443e55 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:58.670341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-52af0d67-2e1f-45b3-8096-387c6ca15cd8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:58.671323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-52af0d67-2e1f-45b3-8096-387c6ca15cd8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:58.677923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af0d67-2e1f-45b3-8096-387c6ca15cd8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:58.678734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af0d67-2e1f-45b3-8096-387c6ca15cd8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:58.680118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af0d67-2e1f-45b3-8096-387c6ca15cd8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:58.681090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af0d67-2e1f-45b3-8096-387c6ca15cd8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:58.681777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af0d67-2e1f-45b3-8096-387c6ca15cd8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:58.682441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52af0d67-2e1f-45b3-8096-387c6ca15cd8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:58.930161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-52af0d67-2e1f-45b3-8096-387c6ca15cd8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:58.941576 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-52af0d67-2e1f-45b3-8096-387c6ca15cd8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 200 len: 1508 microversion: 2.1 time: 0.275491 Oct 11 04:24:58.942797 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1755/3349] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:58 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 1508 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:58.967921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:24:58.968629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:24:58.978761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:58.979506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:58.980138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:58.981028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:24:58.981642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:24:58.982383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:24:59.070287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:24:59.083324 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.api [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Working on deleting snapshot 8871fb13-eee6-4d44-a17a-30435f996b10 from shelved instance... Oct 11 04:24:59.459523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce656b7f-0b05-4ae0-ae09-d06e8b443e55 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:24:59.471388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:24:59.495034 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce656b7f-0b05-4ae0-ae09-d06e8b443e55 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1316 microversion: 2.1 time: 1.046832 Oct 11 04:24:59.495034 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1595/3350] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:24:58 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1316 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:24:59.499924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-427d1487-1659-4b8d-91e0-25608c74c5b6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19b6b1f0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:02.245778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Doing local delete in cell 7f919055-bb4c-4077-93f0-960b402ab88d(cell1) {{(pid=120994) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 11 04:25:02.246686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:02.247780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:02.248536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:02.250153 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.api [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 11 04:25:02.259459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] deallocate_for_instance() {{(pid=120994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 11 04:25:02.291083 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-427d1487-1659-4b8d-91e0-25608c74c5b6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1438 microversion: 2.1 time: 2.800177 Oct 11 04:25:02.293944 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1596/3351] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:24:59 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1438 bytes in 2804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:02.299366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-91efe918-5d30-4c83-b992-7d7551505d0e req-63590b21-272a-483b-ba20-e34433ca2cec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4c9df1-6017-4456-ab2e-69ad499d5f42", "name": "network-vif-plugged", "status": "completed", "tag": "08cc1bfa-756c-4b18-b1c5-b1d74ea2e257"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:02.326823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-91efe918-5d30-4c83-b992-7d7551505d0e req-63590b21-272a-483b-ba20-e34433ca2cec service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:02.328635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-91efe918-5d30-4c83-b992-7d7551505d0e req-63590b21-272a-483b-ba20-e34433ca2cec service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:02.330457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-91efe918-5d30-4c83-b992-7d7551505d0e req-63590b21-272a-483b-ba20-e34433ca2cec service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:02.357930 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-91efe918-5d30-4c83-b992-7d7551505d0e req-63590b21-272a-483b-ba20-e34433ca2cec service nova] Creating event network-vif-plugged:08cc1bfa-756c-4b18-b1c5-b1d74ea2e257 for instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 on n-h2-860892-1 Oct 11 04:25:02.374346 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-91efe918-5d30-4c83-b992-7d7551505d0e req-63590b21-272a-483b-ba20-e34433ca2cec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076837 Oct 11 04:25:02.374346 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1597/3352] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:02.443124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:02.450051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:02.482182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:02.522964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:02.543574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:02.552836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:02.553355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:02.554468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:03.111646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:03.135898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:03.145277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:03.146788 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a517d528-4b54-4519-adbc-319d1d6ff8ed tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1843 microversion: 2.32 time: 0.731410 Oct 11 04:25:03.162990 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1598/3353] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:02 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1843 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:03.184129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-333a8a96-b741-42e4-bb8a-3995d887245d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:03.194177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-333a8a96-b741-42e4-bb8a-3995d887245d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:03.206990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333a8a96-b741-42e4-bb8a-3995d887245d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:03.217715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333a8a96-b741-42e4-bb8a-3995d887245d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:03.218455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333a8a96-b741-42e4-bb8a-3995d887245d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:03.236257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333a8a96-b741-42e4-bb8a-3995d887245d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:03.236257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333a8a96-b741-42e4-bb8a-3995d887245d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:03.236257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333a8a96-b741-42e4-bb8a-3995d887245d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:03.771828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-333a8a96-b741-42e4-bb8a-3995d887245d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:03.788821 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-333a8a96-b741-42e4-bb8a-3995d887245d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1316 microversion: 2.1 time: 0.623281 Oct 11 04:25:03.789756 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1599/3354] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:03 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1316 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:03.810435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-578d1047-640e-4ac5-a2fd-5d1f420b3513 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda191b7820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:04.852504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Updating instance_info_cache with network_info: [] {{(pid=120994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:25:05.707478 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aaf172c8-90d6-4745-8fa1-30ca3abdf2d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 204 len: 0 microversion: 2.1 time: 6.744813 Oct 11 04:25:05.709069 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1756/3355] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:24:58 2022] DELETE /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 0 bytes in 6747 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:25:05.738134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:05.742671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:05.773362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:05.773362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:05.773362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:05.773793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:05.774232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:05.774670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:06.224395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:06.247363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:06.249562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:06.251182 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-394e3caa-dc5e-4fe5-aa97-78315c9296ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1843 microversion: 2.32 time: 0.540438 Oct 11 04:25:06.252280 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1757/3356] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:05 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1843 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:06.259682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-8c397e07-33a8-4f3d-be5b-eb1723247b7f req-4b66e1e0-a4c5-4087-a3ef-12fd39c2bf5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32f0ab1-346d-487a-aa08-ebd1656142a7", "name": "network-vif-plugged", "status": "completed", "tag": "6993adde-be55-4ee5-a441-ab52e2f48759"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:06.291586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8c397e07-33a8-4f3d-be5b-eb1723247b7f req-4b66e1e0-a4c5-4087-a3ef-12fd39c2bf5e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:06.292457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8c397e07-33a8-4f3d-be5b-eb1723247b7f req-4b66e1e0-a4c5-4087-a3ef-12fd39c2bf5e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:06.296816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8c397e07-33a8-4f3d-be5b-eb1723247b7f req-4b66e1e0-a4c5-4087-a3ef-12fd39c2bf5e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:06.345307 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8c397e07-33a8-4f3d-be5b-eb1723247b7f req-4b66e1e0-a4c5-4087-a3ef-12fd39c2bf5e service nova] Creating event network-vif-plugged:6993adde-be55-4ee5-a441-ab52e2f48759 for instance d32f0ab1-346d-487a-aa08-ebd1656142a7 on n-h2-860892-1 Oct 11 04:25:06.364090 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-8c397e07-33a8-4f3d-be5b-eb1723247b7f req-4b66e1e0-a4c5-4087-a3ef-12fd39c2bf5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108372 Oct 11 04:25:06.365351 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1758/3357] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:06.379501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e3678589-eac5-4755-94b6-1a1cac63a921 req-f8e220ee-da17-48e9-85d6-b03d1d43cb61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f905c4dd-c9f6-452d-bc51-696256de0b36", "name": "network-vif-deleted", "tag": "5dec51fb-6f29-4e7f-aeb9-d6572fc4d1e2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:06.410213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e3678589-eac5-4755-94b6-1a1cac63a921 req-f8e220ee-da17-48e9-85d6-b03d1d43cb61 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:06.417627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e3678589-eac5-4755-94b6-1a1cac63a921 req-f8e220ee-da17-48e9-85d6-b03d1d43cb61 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:06.418208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e3678589-eac5-4755-94b6-1a1cac63a921 req-f8e220ee-da17-48e9-85d6-b03d1d43cb61 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:06.440265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.compute.server_external_events [req-e3678589-eac5-4755-94b6-1a1cac63a921 req-f8e220ee-da17-48e9-85d6-b03d1d43cb61 service nova] Unable to find a host for instance f905c4dd-c9f6-452d-bc51-696256de0b36. Dropping event network-vif-deleted {{(pid=120994) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 04:25:06.442275 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e3678589-eac5-4755-94b6-1a1cac63a921 req-f8e220ee-da17-48e9-85d6-b03d1d43cb61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.074422 Oct 11 04:25:06.448627 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1759/3358] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 77 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 04:25:06.450601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36730757-9670-4b88-85ed-fc42758184a6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:06.451642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-36730757-9670-4b88-85ed-fc42758184a6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:06.459000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36730757-9670-4b88-85ed-fc42758184a6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:06.459897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36730757-9670-4b88-85ed-fc42758184a6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:06.460618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36730757-9670-4b88-85ed-fc42758184a6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:06.461738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36730757-9670-4b88-85ed-fc42758184a6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:06.462413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36730757-9670-4b88-85ed-fc42758184a6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:06.463012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36730757-9670-4b88-85ed-fc42758184a6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:06.907239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-36730757-9670-4b88-85ed-fc42758184a6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:06.907239 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-36730757-9670-4b88-85ed-fc42758184a6 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1505 microversion: 2.1 time: 0.457829 Oct 11 04:25:06.907239 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1760/3359] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:06 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1505 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:06.909962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5768faae-1ca9-43b4-8f0a-ed88040bb536 req-5be33e84-e42d-48f3-9843-a6fe565ab141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "tag": "d5ed01b4-6c79-4f61-b2fb-415cf63f9a6f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:06.929887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5768faae-1ca9-43b4-8f0a-ed88040bb536 req-5be33e84-e42d-48f3-9843-a6fe565ab141 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:06.930527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5768faae-1ca9-43b4-8f0a-ed88040bb536 req-5be33e84-e42d-48f3-9843-a6fe565ab141 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:06.931022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5768faae-1ca9-43b4-8f0a-ed88040bb536 req-5be33e84-e42d-48f3-9843-a6fe565ab141 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:06.945623 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5768faae-1ca9-43b4-8f0a-ed88040bb536 req-5be33e84-e42d-48f3-9843-a6fe565ab141 service nova] Creating event network-changed:d5ed01b4-6c79-4f61-b2fb-415cf63f9a6f for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:25:06.951190 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5768faae-1ca9-43b4-8f0a-ed88040bb536 req-5be33e84-e42d-48f3-9843-a6fe565ab141 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046119 Oct 11 04:25:06.955239 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1761/3360] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:06.971373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:06.972092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:06.986808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:06.986808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:06.991805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:06.992731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:07.039432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:07.040177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.033s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:07.061067 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 HTTP/1.1 Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'f905c4dd-c9f6-452d-bc51-696256de0b36'} Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:07.063078 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:07.068398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:07.068398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:07.068398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:07.068398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:07.068398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:07.068398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:25:07.068398 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:07.068398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:07.069857 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5ba300e6-1933-4e38-9dcc-eccb05cdc6b5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 404 len: 111 microversion: 2.1 time: 0.113194 Oct 11 04:25:07.071009 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1762/3361] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:06 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:25:07.076497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-66c61a04-b2a8-4963-840a-785a4ea28b56 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1797971679"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:07.077308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-66c61a04-b2a8-4963-840a-785a4ea28b56 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:07.083729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66c61a04-b2a8-4963-840a-785a4ea28b56 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:07.084409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66c61a04-b2a8-4963-840a-785a4ea28b56 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:07.085011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66c61a04-b2a8-4963-840a-785a4ea28b56 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:07.085823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66c61a04-b2a8-4963-840a-785a4ea28b56 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:07.088447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66c61a04-b2a8-4963-840a-785a4ea28b56 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:07.089047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66c61a04-b2a8-4963-840a-785a4ea28b56 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:07.369561 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.network.security_group_api [None req-66c61a04-b2a8-4963-840a-785a4ea28b56 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Adding security group b277c3ef-88a8-4a87-81f5-aaae43a119df to port 08cc1bfa-756c-4b18-b1c5-b1d74ea2e257 Oct 11 04:25:07.878455 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-66c61a04-b2a8-4963-840a-785a4ea28b56 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42/action" status: 202 len: 0 microversion: 2.1 time: 0.806121 Oct 11 04:25:07.883837 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1763/3362] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:25:07 2022] POST /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42/action => generated 0 bytes in 812 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:25:07.889267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1473708463", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "eb00258c-33f3-4e50-9b19-bfa956507201"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:13.207325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:13.778847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=14 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:16.467839 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-578d1047-640e-4ac5-a2fd-5d1f420b3513 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1447 microversion: 2.1 time: 12.676220 Oct 11 04:25:16.477569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] validate_networks() for [('eb00258c-33f3-4e50-9b19-bfa956507201', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:25:16.478409 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1600/3363] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:25:03 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1447 bytes in 12688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:16.486634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:16.487309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:16.506216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:16.512977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:16.514888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:16.515830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:16.518976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:16.519651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:17.116627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=16,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1,nova_cell1:DELETE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:17.165816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:17.168605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:25:17.169257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:25:17.169893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:25:17.170673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:25:17.171265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:25:17.185421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:17.187935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:17.188755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:17.189412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:17.191538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:17.194295 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-659ef081-0d42-4e4b-8cce-88c4b71b5fdc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1885 microversion: 2.32 time: 0.712171 Oct 11 04:25:17.195144 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1601/3364] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:16 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1885 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:17.200861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f0aacac9-fd47-487b-a329-67e5bf56cbc4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda191d0f70>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:17.221461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:17.222496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:17.223190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:17.249863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:25:17.258299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for user 99027798dcba4d52a9efc682ccc973d3 and project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:25:17.277323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:25:17.280023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:25:17.541721 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-34efa47f-f91a-42f8-8745-4b5ffd74ba1c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 9.656538 Oct 11 04:25:17.554362 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1764/3365] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:25:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 9660 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:25:17.558320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-751f0ebc-688d-4f36-b36c-3f3ab4587c89 req-19912dc5-15cc-41ba-9128-ecdbe268555b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5a4c9df1-6017-4456-ab2e-69ad499d5f42", "tag": "08cc1bfa-756c-4b18-b1c5-b1d74ea2e257"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:17.581889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-751f0ebc-688d-4f36-b36c-3f3ab4587c89 req-19912dc5-15cc-41ba-9128-ecdbe268555b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:17.582893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-751f0ebc-688d-4f36-b36c-3f3ab4587c89 req-19912dc5-15cc-41ba-9128-ecdbe268555b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:17.583597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-751f0ebc-688d-4f36-b36c-3f3ab4587c89 req-19912dc5-15cc-41ba-9128-ecdbe268555b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:17.599592 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-751f0ebc-688d-4f36-b36c-3f3ab4587c89 req-19912dc5-15cc-41ba-9128-ecdbe268555b service nova] Creating event network-changed:08cc1bfa-756c-4b18-b1c5-b1d74ea2e257 for instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 on n-h2-860892-1 Oct 11 04:25:17.610534 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-751f0ebc-688d-4f36-b36c-3f3ab4587c89 req-19912dc5-15cc-41ba-9128-ecdbe268555b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064146 Oct 11 04:25:17.613928 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1765/3366] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:17.637578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-073e9378-14ca-43fa-a6fe-96ad62604720 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:17.638439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-073e9378-14ca-43fa-a6fe-96ad62604720 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:17.656657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-073e9378-14ca-43fa-a6fe-96ad62604720 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:17.657329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-073e9378-14ca-43fa-a6fe-96ad62604720 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:17.661581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-073e9378-14ca-43fa-a6fe-96ad62604720 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:17.662453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-073e9378-14ca-43fa-a6fe-96ad62604720 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:17.663708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-073e9378-14ca-43fa-a6fe-96ad62604720 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:17.669217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-073e9378-14ca-43fa-a6fe-96ad62604720 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:17.756166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-f0aacac9-fd47-487b-a329-67e5bf56cbc4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group b277c3ef-88a8-4a87-81f5-aaae43a119df in use.", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:25:17.759152 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f0aacac9-fd47-487b-a329-67e5bf56cbc4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security Group b277c3ef-88a8-4a87-81f5-aaae43a119df in use. Oct 11 04:25:17.759152 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-4efc859f-f0e8-4311-934a-ff9ed5c44b8a'] Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f0aacac9-fd47-487b-a329-67e5bf56cbc4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-security-groups/b277c3ef-88a8-4a87-81f5-aaae43a119df HTTP/1.1 Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: exception: Security Group b277c3ef-88a8-4a87-81f5-aaae43a119df in use. Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-4efc859f-f0e8-4311-934a-ff9ed5c44b8a'] Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'b277c3ef-88a8-4a87-81f5-aaae43a119df'} Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:25:17.763571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group b277c3ef-88a8-4a87-81f5-aaae43a119df in use. Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4efc859f-f0e8-4311-934a-ff9ed5c44b8a'] Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group b277c3ef-88a8-4a87-81f5-aaae43a119df in use. Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4efc859f-f0e8-4311-934a-ff9ed5c44b8a'] Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group b277c3ef-88a8-4a87-81f5-aaae43a119df in use. Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4efc859f-f0e8-4311-934a-ff9ed5c44b8a'] Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group b277c3ef-88a8-4a87-81f5-aaae43a119df in use. Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-4efc859f-f0e8-4311-934a-ff9ed5c44b8a'] Oct 11 04:25:17.768037 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:17.773894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f0aacac9-fd47-487b-a329-67e5bf56cbc4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 400 to user: Security Group b277c3ef-88a8-4a87-81f5-aaae43a119df in use. Oct 11 04:25:17.773894 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-4efc859f-f0e8-4311-934a-ff9ed5c44b8a'] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:17.775697 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f0aacac9-fd47-487b-a329-67e5bf56cbc4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/b277c3ef-88a8-4a87-81f5-aaae43a119df" status: 400 len: 185 microversion: 2.1 time: 0.579293 Oct 11 04:25:17.778735 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1602/3367] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:17 2022] DELETE /compute/v2.1/os-security-groups/b277c3ef-88a8-4a87-81f5-aaae43a119df => generated 185 bytes in 583 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:25:17.802941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-84aeef65-bd31-4130-9288-5fe953955705 req-926f0d2a-fc96-4b1a-9fe4-eaeb7ab0b4e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "tag": "cb8530f1-3a71-44d5-9c2f-f4252591ccc9"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:17.841397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-84aeef65-bd31-4130-9288-5fe953955705 req-926f0d2a-fc96-4b1a-9fe4-eaeb7ab0b4e7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:17.848839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-84aeef65-bd31-4130-9288-5fe953955705 req-926f0d2a-fc96-4b1a-9fe4-eaeb7ab0b4e7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:17.852128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-84aeef65-bd31-4130-9288-5fe953955705 req-926f0d2a-fc96-4b1a-9fe4-eaeb7ab0b4e7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:17.900327 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-073e9378-14ca-43fa-a6fe-96ad62604720 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1814 microversion: 2.1 time: 0.284789 Oct 11 04:25:17.902583 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1766/3368] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:17 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1814 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:17.917670 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-84aeef65-bd31-4130-9288-5fe953955705 req-926f0d2a-fc96-4b1a-9fe4-eaeb7ab0b4e7 service nova] Creating event network-changed:cb8530f1-3a71-44d5-9c2f-f4252591ccc9 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:25:17.926562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ce3fbe1-4e25-4315-960e-913a1e7e0991 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19b3a1f0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:17.933641 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-84aeef65-bd31-4130-9288-5fe953955705 req-926f0d2a-fc96-4b1a-9fe4-eaeb7ab0b4e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152352 Oct 11 04:25:17.938414 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1603/3369] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:17.951051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9638fb06-ddc2-4b15-a4f5-252d8892ae5c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:17.952732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9638fb06-ddc2-4b15-a4f5-252d8892ae5c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:18.020694 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ce3fbe1-4e25-4315-960e-913a1e7e0991 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 200 len: 1447 microversion: 2.1 time: 0.116720 Oct 11 04:25:18.021286 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1767/3370] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:25:17 2022] GET /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 1447 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:18.030093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-03d1c226-4adb-40d7-a9b4-1f6c11169c6d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:18.030093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-03d1c226-4adb-40d7-a9b4-1f6c11169c6d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:18.080754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d1c226-4adb-40d7-a9b4-1f6c11169c6d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:18.080754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d1c226-4adb-40d7-a9b4-1f6c11169c6d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:18.080754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d1c226-4adb-40d7-a9b4-1f6c11169c6d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:18.080754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d1c226-4adb-40d7-a9b4-1f6c11169c6d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:18.080754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d1c226-4adb-40d7-a9b4-1f6c11169c6d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:18.080754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d1c226-4adb-40d7-a9b4-1f6c11169c6d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:18.134271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9638fb06-ddc2-4b15-a4f5-252d8892ae5c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:18.146833 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9638fb06-ddc2-4b15-a4f5-252d8892ae5c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1215 microversion: 2.1 time: 0.206676 Oct 11 04:25:18.148176 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1604/3371] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:17 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:18.155302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e460e7e-1970-41ed-a917-a2fa09efa3de tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:18.160318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e460e7e-1970-41ed-a917-a2fa09efa3de tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:18.161133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e460e7e-1970-41ed-a917-a2fa09efa3de tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:18.164281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e460e7e-1970-41ed-a917-a2fa09efa3de tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:18.164281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e460e7e-1970-41ed-a917-a2fa09efa3de tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:18.166664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e460e7e-1970-41ed-a917-a2fa09efa3de tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:18.167163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e460e7e-1970-41ed-a917-a2fa09efa3de tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:18.197630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8e460e7e-1970-41ed-a917-a2fa09efa3de tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.047484 Oct 11 04:25:18.198476 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1605/3372] 10.222.0.26 () {58 vars in 1176 bytes} [Tue Oct 11 04:25:18 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:18.203457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f38b5aea-8f67-4a23-a952-5eceaefeebf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19b0a160>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:18.491990 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-03d1c226-4adb-40d7-a9b4-1f6c11169c6d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42/action" status: 202 len: 0 microversion: 2.1 time: 0.469374 Oct 11 04:25:18.496799 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1768/3373] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:25:18 2022] POST /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42/action => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:25:18.516762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:18.516762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:18.526761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:18.527450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:18.530257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:18.531990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:18.532638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:18.533231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:19.371472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:19.383623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:19.385462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:19.386876 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-91fded98-4ea6-453c-9f25-8ee01961011c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1885 microversion: 2.32 time: 0.887382 Oct 11 04:25:19.387960 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1769/3374] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:18 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1885 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:19.396358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9fadb78f-0c70-4181-b6b3-1d15c912bd4c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:19.397718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9fadb78f-0c70-4181-b6b3-1d15c912bd4c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:19.404481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fadb78f-0c70-4181-b6b3-1d15c912bd4c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:19.405172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fadb78f-0c70-4181-b6b3-1d15c912bd4c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:19.405767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fadb78f-0c70-4181-b6b3-1d15c912bd4c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:19.406680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fadb78f-0c70-4181-b6b3-1d15c912bd4c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:19.407281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fadb78f-0c70-4181-b6b3-1d15c912bd4c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:19.407850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fadb78f-0c70-4181-b6b3-1d15c912bd4c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:19.656279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9fadb78f-0c70-4181-b6b3-1d15c912bd4c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:19.667205 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9fadb78f-0c70-4181-b6b3-1d15c912bd4c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1576 microversion: 2.1 time: 0.277818 Oct 11 04:25:19.669211 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1770/3375] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:19 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1576 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:19.675576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8df88c3f-215d-490a-b1b3-146c0f14c342 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:19.676742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8df88c3f-215d-490a-b1b3-146c0f14c342 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:19.684566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df88c3f-215d-490a-b1b3-146c0f14c342 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:19.685495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df88c3f-215d-490a-b1b3-146c0f14c342 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:19.686204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df88c3f-215d-490a-b1b3-146c0f14c342 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:19.687287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df88c3f-215d-490a-b1b3-146c0f14c342 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:19.687917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df88c3f-215d-490a-b1b3-146c0f14c342 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:19.688696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8df88c3f-215d-490a-b1b3-146c0f14c342 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:19.810009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8df88c3f-215d-490a-b1b3-146c0f14c342 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:19.830035 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8df88c3f-215d-490a-b1b3-146c0f14c342 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1219 microversion: 2.1 time: 0.152569 Oct 11 04:25:19.830035 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1771/3376] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:19 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1219 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:20.043091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d72946e0-aa29-4c6c-a974-07560fd214ca req-82ee7f46-1f45-4b7b-9b1c-176f625fdfcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "tag": "19904f71-1cd6-4db1-9e7e-42cc6e25cf8d"}, {"name": "network-changed", "server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "tag": "1712ec47-14a1-4060-802b-107a47cc9b9d"}, {"name": "network-changed", "server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "tag": "12f46a1d-3f56-4b9a-ac0c-89ceb542d3f7"}, {"name": "network-changed", "server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "tag": "c90ce6b2-656f-4df4-b90a-a7af54d53844"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:20.068526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d72946e0-aa29-4c6c-a974-07560fd214ca req-82ee7f46-1f45-4b7b-9b1c-176f625fdfcc service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:20.069966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d72946e0-aa29-4c6c-a974-07560fd214ca req-82ee7f46-1f45-4b7b-9b1c-176f625fdfcc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:20.070621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d72946e0-aa29-4c6c-a974-07560fd214ca req-82ee7f46-1f45-4b7b-9b1c-176f625fdfcc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:20.085298 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d72946e0-aa29-4c6c-a974-07560fd214ca req-82ee7f46-1f45-4b7b-9b1c-176f625fdfcc service nova] Creating event network-changed:19904f71-1cd6-4db1-9e7e-42cc6e25cf8d for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:25:20.086075 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d72946e0-aa29-4c6c-a974-07560fd214ca req-82ee7f46-1f45-4b7b-9b1c-176f625fdfcc service nova] Creating event network-changed:1712ec47-14a1-4060-802b-107a47cc9b9d for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:25:20.087247 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d72946e0-aa29-4c6c-a974-07560fd214ca req-82ee7f46-1f45-4b7b-9b1c-176f625fdfcc service nova] Creating event network-changed:12f46a1d-3f56-4b9a-ac0c-89ceb542d3f7 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:25:20.087935 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d72946e0-aa29-4c6c-a974-07560fd214ca req-82ee7f46-1f45-4b7b-9b1c-176f625fdfcc service nova] Creating event network-changed:c90ce6b2-656f-4df4-b90a-a7af54d53844 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:25:20.095700 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d72946e0-aa29-4c6c-a974-07560fd214ca req-82ee7f46-1f45-4b7b-9b1c-176f625fdfcc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 680 microversion: 2.1 time: 0.059864 Oct 11 04:25:20.096880 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1772/3377] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 680 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:25:20.417800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:20.422775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:20.441704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:20.442227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:20.442666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:20.443378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:20.453907 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f38b5aea-8f67-4a23-a952-5eceaefeebf5 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 204 len: 0 microversion: 2.1 time: 2.253955 Oct 11 04:25:20.463083 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1606/3378] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:18 2022] DELETE /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 0 bytes in 2256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:25:20.463230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:20.463710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:20.466464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9670317-9330-4227-8484-708500f68eca tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:20.467205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9670317-9330-4227-8484-708500f68eca tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:20.496204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9670317-9330-4227-8484-708500f68eca tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:20.497879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9670317-9330-4227-8484-708500f68eca tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:20.498548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9670317-9330-4227-8484-708500f68eca tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:20.501185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9670317-9330-4227-8484-708500f68eca tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:20.501527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9670317-9330-4227-8484-708500f68eca tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:20.502132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9670317-9330-4227-8484-708500f68eca tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:20.608046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9670317-9330-4227-8484-708500f68eca tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:25:21.157307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:21.161674 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b9670317-9330-4227-8484-708500f68eca tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 204 len: 0 microversion: 2.1 time: 0.700823 Oct 11 04:25:21.176527 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1607/3379] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:25:20 2022] DELETE /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 0 bytes in 705 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:25:21.178853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:21.195560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:21.196794 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f44d4032-31cd-47e4-be8d-4508b8138bf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1885 microversion: 2.32 time: 0.785321 Oct 11 04:25:21.202116 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1773/3380] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:20 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1885 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:25:21.204894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a946ac34-61d2-4e73-9f04-b77342a271b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:21.206353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a946ac34-61d2-4e73-9f04-b77342a271b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:21.206978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8bd4be51-2301-4e28-ad0b-a23fd5a99956 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:21.207602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8bd4be51-2301-4e28-ad0b-a23fd5a99956 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:21.224724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a946ac34-61d2-4e73-9f04-b77342a271b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:21.225670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bd4be51-2301-4e28-ad0b-a23fd5a99956 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:21.227891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a946ac34-61d2-4e73-9f04-b77342a271b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:21.228030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bd4be51-2301-4e28-ad0b-a23fd5a99956 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:21.228030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bd4be51-2301-4e28-ad0b-a23fd5a99956 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:21.228225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a946ac34-61d2-4e73-9f04-b77342a271b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:21.228314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bd4be51-2301-4e28-ad0b-a23fd5a99956 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:21.228314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bd4be51-2301-4e28-ad0b-a23fd5a99956 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:21.228314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bd4be51-2301-4e28-ad0b-a23fd5a99956 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:21.230115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a946ac34-61d2-4e73-9f04-b77342a271b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:21.234306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a946ac34-61d2-4e73-9f04-b77342a271b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:21.235532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a946ac34-61d2-4e73-9f04-b77342a271b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:21.330282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8bd4be51-2301-4e28-ad0b-a23fd5a99956 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:21.347140 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8bd4be51-2301-4e28-ad0b-a23fd5a99956 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1275 microversion: 2.1 time: 0.143783 Oct 11 04:25:21.347977 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1774/3381] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:21 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1275 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:21.364651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e3410005-50c1-4c30-9567-3873da9022aa req-b0a15b58-7a93-405f-ae0b-bc52c800255b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a701828-9b98-4469-af1d-969d4eae10e6", "name": "network-vif-unplugged", "status": "completed", "tag": "ccebd3f9-3f22-4ca4-9e98-ada82780b131"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:21.376813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e3410005-50c1-4c30-9567-3873da9022aa req-b0a15b58-7a93-405f-ae0b-bc52c800255b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:21.381033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e3410005-50c1-4c30-9567-3873da9022aa req-b0a15b58-7a93-405f-ae0b-bc52c800255b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:21.386809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e3410005-50c1-4c30-9567-3873da9022aa req-b0a15b58-7a93-405f-ae0b-bc52c800255b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:21.407883 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e3410005-50c1-4c30-9567-3873da9022aa req-b0a15b58-7a93-405f-ae0b-bc52c800255b service nova] Creating event network-vif-unplugged:ccebd3f9-3f22-4ca4-9e98-ada82780b131 for instance 1a701828-9b98-4469-af1d-969d4eae10e6 on n-h1-860892-1 Oct 11 04:25:21.419481 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e3410005-50c1-4c30-9567-3873da9022aa req-b0a15b58-7a93-405f-ae0b-bc52c800255b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069887 Oct 11 04:25:21.426000 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1775/3382] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:21.436480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesTestJSON-server-1653172845", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "0a59a6a9-e422-43ce-a186-e7294a4957eb"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:21.576901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] validate_networks() for [('0a59a6a9-e422-43ce-a186-e7294a4957eb', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:25:22.066050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a946ac34-61d2-4e73-9f04-b77342a271b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:22.078938 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a946ac34-61d2-4e73-9f04-b77342a271b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1576 microversion: 2.1 time: 0.889648 Oct 11 04:25:22.096881 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1608/3383] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:21 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1576 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:22.228200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:22.229262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:22.238572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:22.242466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:22.245659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:22.245659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:22.246433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:22.247733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:22.477738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:25:22.478301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:25:22.478671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:25:22.479083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:25:22.479718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:25:22.484565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:22.491075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:22.495981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:22.496614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:22.497597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:22.498265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:22.498866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:22.522270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Getting quotas for project 8a50d14bbe2e4b71ac79bc37ac0ed812. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:25:22.528504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Getting quotas for user 7ade698487d7495d9e10cd7ab92d62a5 and project 8a50d14bbe2e4b71ac79bc37ac0ed812. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:25:22.580083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:25:22.585010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:25:22.773626 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4337bf2d-4c60-42a8-867d-faf2aef1917b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.345845 Oct 11 04:25:22.778669 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1776/3384] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:25:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1350 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:25:22.792759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c6f83b7-d2ca-4e2d-9b63-08df36dddf26 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:22.793668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c6f83b7-d2ca-4e2d-9b63-08df36dddf26 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:22.811115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6f83b7-d2ca-4e2d-9b63-08df36dddf26 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:22.815259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6f83b7-d2ca-4e2d-9b63-08df36dddf26 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:22.817694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6f83b7-d2ca-4e2d-9b63-08df36dddf26 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:22.824395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6f83b7-d2ca-4e2d-9b63-08df36dddf26 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:22.824942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6f83b7-d2ca-4e2d-9b63-08df36dddf26 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:22.825844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6f83b7-d2ca-4e2d-9b63-08df36dddf26 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:23.129970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c6f83b7-d2ca-4e2d-9b63-08df36dddf26 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:23.146245 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c6f83b7-d2ca-4e2d-9b63-08df36dddf26 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1275 microversion: 2.1 time: 0.362142 Oct 11 04:25:23.149097 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1777/3385] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:22 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1275 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:23.156158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-be1ea217-c431-407b-a144-81234f69c88e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:23.157326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-be1ea217-c431-407b-a144-81234f69c88e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:23.263198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be1ea217-c431-407b-a144-81234f69c88e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:23.275095 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-be1ea217-c431-407b-a144-81234f69c88e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1208 microversion: 2.1 time: 0.123254 Oct 11 04:25:23.275788 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1778/3386] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:23 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1208 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:23.283565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04a2cf83-65c7-4f48-930c-9c3bdc4a43e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a2b2f40e-cb55-4cec-82df-6fe385e35b77", "device": "/dev/xvdb"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:23.289748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-04a2cf83-65c7-4f48-930c-9c3bdc4a43e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:23.308206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04a2cf83-65c7-4f48-930c-9c3bdc4a43e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:23.311429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04a2cf83-65c7-4f48-930c-9c3bdc4a43e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:23.312067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04a2cf83-65c7-4f48-930c-9c3bdc4a43e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:23.312951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04a2cf83-65c7-4f48-930c-9c3bdc4a43e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:23.313511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04a2cf83-65c7-4f48-930c-9c3bdc4a43e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:23.313951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04a2cf83-65c7-4f48-930c-9c3bdc4a43e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:23.355576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:23.375578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:23.385540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:23.387165 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-920f44f4-07f7-4d70-bb0f-673440014f48 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 1.163083 Oct 11 04:25:23.412554 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1609/3387] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:22 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:25:23.432324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ae59faa-a3e5-4ca2-b384-0f6d0cdfa7d0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:23.434973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5ae59faa-a3e5-4ca2-b384-0f6d0cdfa7d0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:23.453319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ae59faa-a3e5-4ca2-b384-0f6d0cdfa7d0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:23.453319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ae59faa-a3e5-4ca2-b384-0f6d0cdfa7d0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:23.453319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ae59faa-a3e5-4ca2-b384-0f6d0cdfa7d0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:23.485416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ae59faa-a3e5-4ca2-b384-0f6d0cdfa7d0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:23.486249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ae59faa-a3e5-4ca2-b384-0f6d0cdfa7d0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:23.487423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ae59faa-a3e5-4ca2-b384-0f6d0cdfa7d0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:24.181163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5ae59faa-a3e5-4ca2-b384-0f6d0cdfa7d0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:24.193001 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ae59faa-a3e5-4ca2-b384-0f6d0cdfa7d0 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1574 microversion: 2.1 time: 0.778982 Oct 11 04:25:24.203068 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1610/3388] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:23 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1574 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:24.219731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4286965b-f67f-46a7-8691-9e51db9481e9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:24.222920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4286965b-f67f-46a7-8691-9e51db9481e9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:24.230945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4286965b-f67f-46a7-8691-9e51db9481e9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:24.231446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4286965b-f67f-46a7-8691-9e51db9481e9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:24.231888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4286965b-f67f-46a7-8691-9e51db9481e9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:24.232630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4286965b-f67f-46a7-8691-9e51db9481e9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:24.233091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4286965b-f67f-46a7-8691-9e51db9481e9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:24.233520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4286965b-f67f-46a7-8691-9e51db9481e9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:24.377690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4286965b-f67f-46a7-8691-9e51db9481e9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:24.389509 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4286965b-f67f-46a7-8691-9e51db9481e9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1273 microversion: 2.1 time: 0.182241 Oct 11 04:25:24.390598 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1611/3389] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:24 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1273 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:24.396536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6973051e-590e-49ad-82b8-cf55f1efb969 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-659897356"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:24.397827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6973051e-590e-49ad-82b8-cf55f1efb969 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:24.405191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6973051e-590e-49ad-82b8-cf55f1efb969 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:24.405871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6973051e-590e-49ad-82b8-cf55f1efb969 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:24.406816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6973051e-590e-49ad-82b8-cf55f1efb969 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:24.407685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6973051e-590e-49ad-82b8-cf55f1efb969 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:24.408295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6973051e-590e-49ad-82b8-cf55f1efb969 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:24.413504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6973051e-590e-49ad-82b8-cf55f1efb969 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:24.522815 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04a2cf83-65c7-4f48-930c-9c3bdc4a43e4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "POST /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.244615 Oct 11 04:25:24.524276 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1779/3390] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:25:23 2022] POST /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments => generated 194 bytes in 1248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:24.538492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-390513c8-a501-4287-a938-b7643b226ff6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:24.539549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-390513c8-a501-4287-a938-b7643b226ff6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:24.551243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390513c8-a501-4287-a938-b7643b226ff6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:24.552769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390513c8-a501-4287-a938-b7643b226ff6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:24.555030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390513c8-a501-4287-a938-b7643b226ff6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:24.555787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390513c8-a501-4287-a938-b7643b226ff6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:24.556284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390513c8-a501-4287-a938-b7643b226ff6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:24.560629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390513c8-a501-4287-a938-b7643b226ff6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:24.740116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-390513c8-a501-4287-a938-b7643b226ff6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:24.754567 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-390513c8-a501-4287-a938-b7643b226ff6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1212 microversion: 2.1 time: 0.225756 Oct 11 04:25:24.770935 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1780/3391] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:24 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1212 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:24.778319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:24.779414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:24.790439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:24.792208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:24.793162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:24.794415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:24.795183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:24.796049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:24.896155 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.network.security_group_api [None req-6973051e-590e-49ad-82b8-cf55f1efb969 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Adding security group 1ae24375-f918-4004-b8c7-b3d1a1c76657 to port 08cc1bfa-756c-4b18-b1c5-b1d74ea2e257 Oct 11 04:25:25.018459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:25.029065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:25.030962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:25.032445 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c3e84c46-8e22-4e99-b7e8-bc9264d95e32 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.260459 Oct 11 04:25:25.033247 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1781/3392] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:24 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:25.151593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e0a3d4f5-322a-4c54-b054-0390efdef793 req-5ed03194-a990-459d-8b5f-29701db439b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "tag": "cef26b29-2cac-49a3-a867-7f255a006168"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:25.165616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e0a3d4f5-322a-4c54-b054-0390efdef793 req-5ed03194-a990-459d-8b5f-29701db439b9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:25.167077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e0a3d4f5-322a-4c54-b054-0390efdef793 req-5ed03194-a990-459d-8b5f-29701db439b9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:25.168930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e0a3d4f5-322a-4c54-b054-0390efdef793 req-5ed03194-a990-459d-8b5f-29701db439b9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:25.192817 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e0a3d4f5-322a-4c54-b054-0390efdef793 req-5ed03194-a990-459d-8b5f-29701db439b9 service nova] Creating event network-changed:cef26b29-2cac-49a3-a867-7f255a006168 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:25:25.203600 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e0a3d4f5-322a-4c54-b054-0390efdef793 req-5ed03194-a990-459d-8b5f-29701db439b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057178 Oct 11 04:25:25.204970 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1782/3393] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:25.417162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-42209676-fb71-4d7d-9b63-2a3c99ee18b8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:25.419316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-42209676-fb71-4d7d-9b63-2a3c99ee18b8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:25.439543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42209676-fb71-4d7d-9b63-2a3c99ee18b8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:25.440254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42209676-fb71-4d7d-9b63-2a3c99ee18b8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:25.444222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42209676-fb71-4d7d-9b63-2a3c99ee18b8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:25.451505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42209676-fb71-4d7d-9b63-2a3c99ee18b8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:25.452070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42209676-fb71-4d7d-9b63-2a3c99ee18b8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:25.452487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42209676-fb71-4d7d-9b63-2a3c99ee18b8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:25.603146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-42209676-fb71-4d7d-9b63-2a3c99ee18b8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:25.616481 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-42209676-fb71-4d7d-9b63-2a3c99ee18b8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1273 microversion: 2.1 time: 0.206180 Oct 11 04:25:25.619895 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1783/3394] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:25 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1273 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:25.788485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e302257c-0164-4a6c-8330-4a1d053b9c78 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:25.789667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e302257c-0164-4a6c-8330-4a1d053b9c78 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:25.854975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e302257c-0164-4a6c-8330-4a1d053b9c78 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:25.854975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e302257c-0164-4a6c-8330-4a1d053b9c78 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:25.854975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e302257c-0164-4a6c-8330-4a1d053b9c78 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:25.854975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e302257c-0164-4a6c-8330-4a1d053b9c78 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:25.858488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e302257c-0164-4a6c-8330-4a1d053b9c78 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:25.859140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e302257c-0164-4a6c-8330-4a1d053b9c78 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:25.871779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:26.057300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e302257c-0164-4a6c-8330-4a1d053b9c78 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:26.065700 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e302257c-0164-4a6c-8330-4a1d053b9c78 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1260 microversion: 2.1 time: 0.286697 Oct 11 04:25:26.070295 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1784/3395] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:25 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1260 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:26.079199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:26.080107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:26.095204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:26.102987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:26.104800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:26.110744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:26.110744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:26.110744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:26.364026 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6973051e-590e-49ad-82b8-cf55f1efb969 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42/action" status: 202 len: 0 microversion: 2.1 time: 1.972060 Oct 11 04:25:26.369487 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1612/3396] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:25:24 2022] POST /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42/action => generated 0 bytes in 1978 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:25:26.374911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6a919f86-2a57-4748-9e92-f6bd535ec439 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda194311f0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:26.887332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:26.901582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:26.907167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:26.910744 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40794135-9099-47b5-b824-cecf52fe9f1c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.839173 Oct 11 04:25:26.916136 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1785/3397] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:26 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:26.927952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aa59622e-cf74-429c-b688-fdbd30cdb8a3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:26.928882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aa59622e-cf74-429c-b688-fdbd30cdb8a3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:26.959637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59622e-cf74-429c-b688-fdbd30cdb8a3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:26.961864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59622e-cf74-429c-b688-fdbd30cdb8a3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:26.962560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59622e-cf74-429c-b688-fdbd30cdb8a3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:26.964849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59622e-cf74-429c-b688-fdbd30cdb8a3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:26.966458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59622e-cf74-429c-b688-fdbd30cdb8a3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:26.967294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59622e-cf74-429c-b688-fdbd30cdb8a3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:27.450690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aa59622e-cf74-429c-b688-fdbd30cdb8a3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:27.455150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-6a919f86-2a57-4748-9e92-f6bd535ec439 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupInUse", "message": "Security Group 1ae24375-f918-4004-b8c7-b3d1a1c76657 in use.", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:25:27.457200 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-6a919f86-2a57-4748-9e92-f6bd535ec439 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security Group 1ae24375-f918-4004-b8c7-b3d1a1c76657 in use. Oct 11 04:25:27.457200 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-e02e7c97-2d6e-4f43-ad9f-f250a103d4c7'] Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6a919f86-2a57-4748-9e92-f6bd535ec439 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-security-groups/1ae24375-f918-4004-b8c7-b3d1a1c76657 HTTP/1.1 Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: exception: Security Group 1ae24375-f918-4004-b8c7-b3d1a1c76657 in use. Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-e02e7c97-2d6e-4f43-ad9f-f250a103d4c7'] Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1ae24375-f918-4004-b8c7-b3d1a1c76657'} Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 359, in destroy Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutron.delete_security_group(security_group['id']) Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1073, in delete_security_group Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.delete(self.security_group_path % (security_group)) Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 352, in delete Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("DELETE", action, body=body, Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:25:27.459753 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.Conflict: Security Group 1ae24375-f918-4004-b8c7-b3d1a1c76657 in use. Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e02e7c97-2d6e-4f43-ad9f-f250a103d4c7'] Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 179, in delete Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi security_group_api.destroy(context, security_group) Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 364, in destroy Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.Invalid(str(e)) Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.Invalid: Security Group 1ae24375-f918-4004-b8c7-b3d1a1c76657 in use. Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e02e7c97-2d6e-4f43-ad9f-f250a103d4c7'] Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 183, in delete Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=exp.format_message()) Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Security Group 1ae24375-f918-4004-b8c7-b3d1a1c76657 in use. Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e02e7c97-2d6e-4f43-ad9f-f250a103d4c7'] Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security Group 1ae24375-f918-4004-b8c7-b3d1a1c76657 in use. Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-e02e7c97-2d6e-4f43-ad9f-f250a103d4c7'] Oct 11 04:25:27.463620 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:27.474024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6a919f86-2a57-4748-9e92-f6bd535ec439 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 400 to user: Security Group 1ae24375-f918-4004-b8c7-b3d1a1c76657 in use. Oct 11 04:25:27.474024 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-e02e7c97-2d6e-4f43-ad9f-f250a103d4c7'] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:27.474024 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6a919f86-2a57-4748-9e92-f6bd535ec439 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/1ae24375-f918-4004-b8c7-b3d1a1c76657" status: 400 len: 185 microversion: 2.1 time: 1.099147 Oct 11 04:25:27.474024 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1613/3398] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:26 2022] DELETE /compute/v2.1/os-security-groups/1ae24375-f918-4004-b8c7-b3d1a1c76657 => generated 185 bytes in 1100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:25:27.498936 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aa59622e-cf74-429c-b688-fdbd30cdb8a3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1315 microversion: 2.1 time: 0.581546 Oct 11 04:25:27.499858 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1786/3399] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:26 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1315 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:27.511760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b51067d6-357f-4a47-be78-49940d9dce25 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:27.514355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b51067d6-357f-4a47-be78-49940d9dce25 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:27.514808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1fe5c1b2-4d4f-4fd0-9f38-74fb6f1363d0 req-27f067c2-056f-4335-919f-fef268f57cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a701828-9b98-4469-af1d-969d4eae10e6", "name": "network-vif-deleted", "tag": "ccebd3f9-3f22-4ca4-9e98-ada82780b131"}, {"name": "network-changed", "server_uuid": "5a4c9df1-6017-4456-ab2e-69ad499d5f42", "tag": "08cc1bfa-756c-4b18-b1c5-b1d74ea2e257"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:27.537536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b51067d6-357f-4a47-be78-49940d9dce25 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:27.545242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b51067d6-357f-4a47-be78-49940d9dce25 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:27.545242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b51067d6-357f-4a47-be78-49940d9dce25 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:27.545242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b51067d6-357f-4a47-be78-49940d9dce25 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:27.545242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b51067d6-357f-4a47-be78-49940d9dce25 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:27.545580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b51067d6-357f-4a47-be78-49940d9dce25 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:27.556615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1fe5c1b2-4d4f-4fd0-9f38-74fb6f1363d0 req-27f067c2-056f-4335-919f-fef268f57cea service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:27.558125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1fe5c1b2-4d4f-4fd0-9f38-74fb6f1363d0 req-27f067c2-056f-4335-919f-fef268f57cea service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:27.560843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1fe5c1b2-4d4f-4fd0-9f38-74fb6f1363d0 req-27f067c2-056f-4335-919f-fef268f57cea service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:27.611292 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1fe5c1b2-4d4f-4fd0-9f38-74fb6f1363d0 req-27f067c2-056f-4335-919f-fef268f57cea service nova] Creating event network-vif-deleted:ccebd3f9-3f22-4ca4-9e98-ada82780b131 for instance 1a701828-9b98-4469-af1d-969d4eae10e6 on n-h1-860892-1 Oct 11 04:25:27.611899 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1fe5c1b2-4d4f-4fd0-9f38-74fb6f1363d0 req-27f067c2-056f-4335-919f-fef268f57cea service nova] Creating event network-changed:08cc1bfa-756c-4b18-b1c5-b1d74ea2e257 for instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 on n-h2-860892-1 Oct 11 04:25:27.642414 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1fe5c1b2-4d4f-4fd0-9f38-74fb6f1363d0 req-27f067c2-056f-4335-919f-fef268f57cea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.139242 Oct 11 04:25:27.645212 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1787/3400] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:27 2022] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:27.660756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-16101e0d-107d-4f80-9f3b-ec2e38c0d55f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:27.662677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-16101e0d-107d-4f80-9f3b-ec2e38c0d55f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:27.687008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16101e0d-107d-4f80-9f3b-ec2e38c0d55f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:27.687521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16101e0d-107d-4f80-9f3b-ec2e38c0d55f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:27.689255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16101e0d-107d-4f80-9f3b-ec2e38c0d55f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:27.689490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16101e0d-107d-4f80-9f3b-ec2e38c0d55f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:27.689916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16101e0d-107d-4f80-9f3b-ec2e38c0d55f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:27.690418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16101e0d-107d-4f80-9f3b-ec2e38c0d55f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:27.742614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-16101e0d-107d-4f80-9f3b-ec2e38c0d55f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:25:28.138748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:28.177013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:28.196916 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-16101e0d-107d-4f80-9f3b-ec2e38c0d55f tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 204 len: 0 microversion: 2.1 time: 0.549734 Oct 11 04:25:28.197719 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1788/3401] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:25:27 2022] DELETE /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:25:28.209790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:28.211953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:28.231781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:28.234318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:28.235088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:28.236802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:28.238783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:28.240110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:28.327025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b51067d6-357f-4a47-be78-49940d9dce25 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:28.343014 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b51067d6-357f-4a47-be78-49940d9dce25 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1266 microversion: 2.1 time: 0.863047 Oct 11 04:25:28.343601 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1614/3402] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:27 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1266 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:28.371928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00006ec8-d754-4a57-99ca-ae1ba5873f15 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:28.372560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00006ec8-d754-4a57-99ca-ae1ba5873f15 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:28.391932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00006ec8-d754-4a57-99ca-ae1ba5873f15 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:28.392331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00006ec8-d754-4a57-99ca-ae1ba5873f15 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:28.393336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00006ec8-d754-4a57-99ca-ae1ba5873f15 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:28.394339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00006ec8-d754-4a57-99ca-ae1ba5873f15 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:28.394949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00006ec8-d754-4a57-99ca-ae1ba5873f15 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:28.395528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00006ec8-d754-4a57-99ca-ae1ba5873f15 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:28.532460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:28.542429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:28.545894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:28.548485 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-947a31b4-84c8-48d4-acfd-b4acd6aff0aa tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.348882 Oct 11 04:25:28.549297 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1789/3403] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:28 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:28.555805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c4779de1-4343-4b0f-821c-6c2d9ba85848 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:28.556413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c4779de1-4343-4b0f-821c-6c2d9ba85848 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:28.562533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4779de1-4343-4b0f-821c-6c2d9ba85848 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:28.565680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4779de1-4343-4b0f-821c-6c2d9ba85848 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:28.566141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4779de1-4343-4b0f-821c-6c2d9ba85848 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:28.566884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4779de1-4343-4b0f-821c-6c2d9ba85848 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:28.567458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4779de1-4343-4b0f-821c-6c2d9ba85848 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:28.567889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4779de1-4343-4b0f-821c-6c2d9ba85848 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:28.798222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-00006ec8-d754-4a57-99ca-ae1ba5873f15 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:28.814804 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00006ec8-d754-4a57-99ca-ae1ba5873f15 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1648 microversion: 2.1 time: 0.452142 Oct 11 04:25:28.815724 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1615/3404] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:28 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1648 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:28.845048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c4779de1-4343-4b0f-821c-6c2d9ba85848 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:28.861316 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c4779de1-4343-4b0f-821c-6c2d9ba85848 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1315 microversion: 2.1 time: 0.304414 Oct 11 04:25:28.862553 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1790/3405] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:28 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1315 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:28.883644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8304143b-7f79-4519-8eca-6cea84319465 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:28.891031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8304143b-7f79-4519-8eca-6cea84319465 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:28.891031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8304143b-7f79-4519-8eca-6cea84319465 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:28.891700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8304143b-7f79-4519-8eca-6cea84319465 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:28.892154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8304143b-7f79-4519-8eca-6cea84319465 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:28.892863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8304143b-7f79-4519-8eca-6cea84319465 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:28.893317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8304143b-7f79-4519-8eca-6cea84319465 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:28.893740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8304143b-7f79-4519-8eca-6cea84319465 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:29.202535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8304143b-7f79-4519-8eca-6cea84319465 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:29.215418 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8304143b-7f79-4519-8eca-6cea84319465 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.335927 Oct 11 04:25:29.218779 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1616/3406] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:28 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:29.239126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e4bbf3ad-dba3-4478-85ba-6ceb3af3abd6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-2-444875449"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:29.242316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e4bbf3ad-dba3-4478-85ba-6ceb3af3abd6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:29.249383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4bbf3ad-dba3-4478-85ba-6ceb3af3abd6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:29.250217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4bbf3ad-dba3-4478-85ba-6ceb3af3abd6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:29.250896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4bbf3ad-dba3-4478-85ba-6ceb3af3abd6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:29.251821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4bbf3ad-dba3-4478-85ba-6ceb3af3abd6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:29.252518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4bbf3ad-dba3-4478-85ba-6ceb3af3abd6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:29.253167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4bbf3ad-dba3-4478-85ba-6ceb3af3abd6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:29.375377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-32dddae3-6bd5-4f29-a7f3-f01d5902d898 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:29.375993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-32dddae3-6bd5-4f29-a7f3-f01d5902d898 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:29.394069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32dddae3-6bd5-4f29-a7f3-f01d5902d898 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:29.400168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32dddae3-6bd5-4f29-a7f3-f01d5902d898 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:29.401073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32dddae3-6bd5-4f29-a7f3-f01d5902d898 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:29.403016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32dddae3-6bd5-4f29-a7f3-f01d5902d898 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:29.404578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32dddae3-6bd5-4f29-a7f3-f01d5902d898 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:29.405770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32dddae3-6bd5-4f29-a7f3-f01d5902d898 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:29.602743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-32dddae3-6bd5-4f29-a7f3-f01d5902d898 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:29.611559 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-32dddae3-6bd5-4f29-a7f3-f01d5902d898 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1266 microversion: 2.1 time: 0.240314 Oct 11 04:25:29.616921 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1617/3407] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:29 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:29.620838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:29.621670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:29.635918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:29.636676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:29.637281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:29.638598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:29.639221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:29.639828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:29.786488 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e4bbf3ad-dba3-4478-85ba-6ceb3af3abd6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.551245 Oct 11 04:25:29.787729 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1791/3408] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:25:29 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 554 msecs (HTTP/1.1 202) 10 headers in 456 bytes (2 switches on core 0) Oct 11 04:25:29.839308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31e03367-3b2b-4a1b-9eb0-25149cf263b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:29.840238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31e03367-3b2b-4a1b-9eb0-25149cf263b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:29.854069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e03367-3b2b-4a1b-9eb0-25149cf263b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:29.859516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e03367-3b2b-4a1b-9eb0-25149cf263b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:29.859516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e03367-3b2b-4a1b-9eb0-25149cf263b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:29.859516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e03367-3b2b-4a1b-9eb0-25149cf263b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:29.860538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e03367-3b2b-4a1b-9eb0-25149cf263b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:29.861031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e03367-3b2b-4a1b-9eb0-25149cf263b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:30.510669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:30.525846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:30.527792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:30.537914 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-82e6658f-1881-4df8-8894-2a9c4c6334b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.915909 Oct 11 04:25:30.537914 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1618/3409] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:29 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:30.537914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f296e05-cc92-4c05-96b8-184624bb597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:30.537914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f296e05-cc92-4c05-96b8-184624bb597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:30.542958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f296e05-cc92-4c05-96b8-184624bb597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:30.547007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f296e05-cc92-4c05-96b8-184624bb597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:30.547700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f296e05-cc92-4c05-96b8-184624bb597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:30.549047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f296e05-cc92-4c05-96b8-184624bb597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:30.549689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f296e05-cc92-4c05-96b8-184624bb597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:30.550333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f296e05-cc92-4c05-96b8-184624bb597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:30.877230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-31e03367-3b2b-4a1b-9eb0-25149cf263b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:30.893013 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31e03367-3b2b-4a1b-9eb0-25149cf263b3 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1648 microversion: 2.1 time: 1.057222 Oct 11 04:25:30.894160 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1792/3410] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:29 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1648 bytes in 1060 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:25:30.901018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e4242ca9-0a85-4eb6-bb95-ca0695d03fdf req-63ca2d6d-0bcb-453d-a520-414740913b3c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0baccb1e-5505-4df8-a290-46f39e25eb7c", "tag": "40cfa72a-7b5a-42cc-acb3-5e760550a5ef"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:30.914004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e4242ca9-0a85-4eb6-bb95-ca0695d03fdf req-63ca2d6d-0bcb-453d-a520-414740913b3c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:30.914825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e4242ca9-0a85-4eb6-bb95-ca0695d03fdf req-63ca2d6d-0bcb-453d-a520-414740913b3c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:30.915580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e4242ca9-0a85-4eb6-bb95-ca0695d03fdf req-63ca2d6d-0bcb-453d-a520-414740913b3c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:30.936325 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e4242ca9-0a85-4eb6-bb95-ca0695d03fdf req-63ca2d6d-0bcb-453d-a520-414740913b3c service nova] Creating event network-changed:40cfa72a-7b5a-42cc-acb3-5e760550a5ef for instance 0baccb1e-5505-4df8-a290-46f39e25eb7c on n-h1-860892-1 Oct 11 04:25:30.942704 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e4242ca9-0a85-4eb6-bb95-ca0695d03fdf req-63ca2d6d-0bcb-453d-a520-414740913b3c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046561 Oct 11 04:25:30.946143 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1793/3411] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:30.954315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5baa6917-6c9b-411e-963f-69ba6a35f5c1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:30.955903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5baa6917-6c9b-411e-963f-69ba6a35f5c1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:30.967630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5baa6917-6c9b-411e-963f-69ba6a35f5c1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:30.968441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5baa6917-6c9b-411e-963f-69ba6a35f5c1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:30.969399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5baa6917-6c9b-411e-963f-69ba6a35f5c1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:30.970648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5baa6917-6c9b-411e-963f-69ba6a35f5c1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:30.971272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5baa6917-6c9b-411e-963f-69ba6a35f5c1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:30.972017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5baa6917-6c9b-411e-963f-69ba6a35f5c1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:31.116442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f296e05-cc92-4c05-96b8-184624bb597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:31.138038 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f296e05-cc92-4c05-96b8-184624bb597c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1315 microversion: 2.1 time: 0.596376 Oct 11 04:25:31.139457 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1619/3412] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:30 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1315 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:31.251603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5baa6917-6c9b-411e-963f-69ba6a35f5c1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:31.263183 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5baa6917-6c9b-411e-963f-69ba6a35f5c1 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1308 microversion: 2.1 time: 0.315452 Oct 11 04:25:31.264578 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1794/3413] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:30 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1308 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:31.565753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:31.566294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:31.576034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:31.576680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:31.577126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:31.581142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:31.585479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:31.585948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:31.907813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f484553d-3c0d-4c82-82cb-badae228679d req-0edc273b-4bd5-4ebf-8922-fe6dcebc52a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32f0ab1-346d-487a-aa08-ebd1656142a7", "name": "network-vif-unplugged", "status": "completed", "tag": "6993adde-be55-4ee5-a441-ab52e2f48759"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:31.919181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f484553d-3c0d-4c82-82cb-badae228679d req-0edc273b-4bd5-4ebf-8922-fe6dcebc52a8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:31.923651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f484553d-3c0d-4c82-82cb-badae228679d req-0edc273b-4bd5-4ebf-8922-fe6dcebc52a8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:31.923651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f484553d-3c0d-4c82-82cb-badae228679d req-0edc273b-4bd5-4ebf-8922-fe6dcebc52a8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:31.935129 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-f484553d-3c0d-4c82-82cb-badae228679d req-0edc273b-4bd5-4ebf-8922-fe6dcebc52a8 service nova] Creating event network-vif-unplugged:6993adde-be55-4ee5-a441-ab52e2f48759 for instance d32f0ab1-346d-487a-aa08-ebd1656142a7 on n-h2-860892-1 Oct 11 04:25:31.952095 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f484553d-3c0d-4c82-82cb-badae228679d req-0edc273b-4bd5-4ebf-8922-fe6dcebc52a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047772 Oct 11 04:25:31.952711 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1795/3414] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:25:31.968398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7fd502bc-eccd-430b-811e-b56e8fbf6845 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:31.969331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7fd502bc-eccd-430b-811e-b56e8fbf6845 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:31.986976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fd502bc-eccd-430b-811e-b56e8fbf6845 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:31.986976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fd502bc-eccd-430b-811e-b56e8fbf6845 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:31.986976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fd502bc-eccd-430b-811e-b56e8fbf6845 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:31.986976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fd502bc-eccd-430b-811e-b56e8fbf6845 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:31.986976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fd502bc-eccd-430b-811e-b56e8fbf6845 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:31.989288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fd502bc-eccd-430b-811e-b56e8fbf6845 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:32.112468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:32.122864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:32.124300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:32.126113 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-36517078-1ec8-4394-b49d-345fbccb6eb8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.564871 Oct 11 04:25:32.139955 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1620/3415] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:31 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:32.165811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1f283409-7160-43a7-93ea-56fde4263b50 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:32.169318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1f283409-7160-43a7-93ea-56fde4263b50 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:32.182761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f283409-7160-43a7-93ea-56fde4263b50 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:32.188530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f283409-7160-43a7-93ea-56fde4263b50 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:32.196037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f283409-7160-43a7-93ea-56fde4263b50 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:32.197141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f283409-7160-43a7-93ea-56fde4263b50 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:32.197824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f283409-7160-43a7-93ea-56fde4263b50 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:32.198454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f283409-7160-43a7-93ea-56fde4263b50 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:32.226220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:32.321340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7fd502bc-eccd-430b-811e-b56e8fbf6845 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:32.329941 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7fd502bc-eccd-430b-811e-b56e8fbf6845 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1648 microversion: 2.1 time: 0.366433 Oct 11 04:25:32.330566 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1796/3416] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:31 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1648 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:32.336207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb9f8255-20c9-4dcd-a7de-2be7b1dc6105 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:32.339340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bb9f8255-20c9-4dcd-a7de-2be7b1dc6105 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:32.343418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb9f8255-20c9-4dcd-a7de-2be7b1dc6105 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:32.343907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb9f8255-20c9-4dcd-a7de-2be7b1dc6105 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:32.344576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb9f8255-20c9-4dcd-a7de-2be7b1dc6105 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:32.345389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb9f8255-20c9-4dcd-a7de-2be7b1dc6105 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:32.345945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb9f8255-20c9-4dcd-a7de-2be7b1dc6105 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:32.346504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb9f8255-20c9-4dcd-a7de-2be7b1dc6105 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:32.514790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:32.901611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb9f8255-20c9-4dcd-a7de-2be7b1dc6105 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:32.922374 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb9f8255-20c9-4dcd-a7de-2be7b1dc6105 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1308 microversion: 2.1 time: 0.578715 Oct 11 04:25:32.923091 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1797/3417] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:32 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1308 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:33.130946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1907a728-b2a6-47d7-96f1-2cce41be098b req-e9e748ad-635a-4d5f-9bd6-e3f6071d94b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5a4c9df1-6017-4456-ab2e-69ad499d5f42", "name": "network-vif-deleted", "tag": "08cc1bfa-756c-4b18-b1c5-b1d74ea2e257"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:33.164163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1907a728-b2a6-47d7-96f1-2cce41be098b req-e9e748ad-635a-4d5f-9bd6-e3f6071d94b2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:33.168933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1907a728-b2a6-47d7-96f1-2cce41be098b req-e9e748ad-635a-4d5f-9bd6-e3f6071d94b2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:33.168933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1907a728-b2a6-47d7-96f1-2cce41be098b req-e9e748ad-635a-4d5f-9bd6-e3f6071d94b2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:33.183511 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1907a728-b2a6-47d7-96f1-2cce41be098b req-e9e748ad-635a-4d5f-9bd6-e3f6071d94b2 service nova] Creating event network-vif-deleted:08cc1bfa-756c-4b18-b1c5-b1d74ea2e257 for instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 on n-h2-860892-1 Oct 11 04:25:33.189982 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1907a728-b2a6-47d7-96f1-2cce41be098b req-e9e748ad-635a-4d5f-9bd6-e3f6071d94b2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077610 Oct 11 04:25:33.191907 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1798/3418] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:33.198173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1f283409-7160-43a7-93ea-56fde4263b50 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:33.199474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:33.200534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:33.208800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:33.209479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:33.209840 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1f283409-7160-43a7-93ea-56fde4263b50 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1315 microversion: 2.1 time: 1.048537 Oct 11 04:25:33.210301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:33.215936 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1621/3419] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:32 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1315 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:25:33.226289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:33.226289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:33.226289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:33.273387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=14 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:33.359328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e0f3904b-2524-4a8e-a899-be167e587501 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:33.360138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e0f3904b-2524-4a8e-a899-be167e587501 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:33.370611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f3904b-2524-4a8e-a899-be167e587501 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:33.371663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f3904b-2524-4a8e-a899-be167e587501 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:33.372524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f3904b-2524-4a8e-a899-be167e587501 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:33.374061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f3904b-2524-4a8e-a899-be167e587501 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:33.375408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f3904b-2524-4a8e-a899-be167e587501 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:33.376784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0f3904b-2524-4a8e-a899-be167e587501 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:33.508935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e0f3904b-2524-4a8e-a899-be167e587501 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:33.517661 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e0f3904b-2524-4a8e-a899-be167e587501 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1301 microversion: 2.1 time: 0.165039 Oct 11 04:25:33.527905 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1622/3420] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:33 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1301 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:33.661506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:33.672037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:33.674056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:33.675579 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48b51824-2fa7-4b6c-bae8-3f506f32d0dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.481979 Oct 11 04:25:33.676368 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1799/3421] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:33 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:33.948212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b2b91342-eafb-4985-9047-b27b0500a562 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:33.949213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b2b91342-eafb-4985-9047-b27b0500a562 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:33.957748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2b91342-eafb-4985-9047-b27b0500a562 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:33.958641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2b91342-eafb-4985-9047-b27b0500a562 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:33.959332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2b91342-eafb-4985-9047-b27b0500a562 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:33.960314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2b91342-eafb-4985-9047-b27b0500a562 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:33.961073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2b91342-eafb-4985-9047-b27b0500a562 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:33.961779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2b91342-eafb-4985-9047-b27b0500a562 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:34.159004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b2b91342-eafb-4985-9047-b27b0500a562 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:34.169364 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b2b91342-eafb-4985-9047-b27b0500a562 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1308 microversion: 2.1 time: 0.225226 Oct 11 04:25:34.170572 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1623/3422] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:33 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1308 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:34.236710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4f072614-e86f-4ea0-b6b4-dfd555dc0603 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:34.237502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4f072614-e86f-4ea0-b6b4-dfd555dc0603 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:34.281545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f072614-e86f-4ea0-b6b4-dfd555dc0603 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:34.283005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f072614-e86f-4ea0-b6b4-dfd555dc0603 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:34.285175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f072614-e86f-4ea0-b6b4-dfd555dc0603 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:34.286160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f072614-e86f-4ea0-b6b4-dfd555dc0603 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:34.289109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f072614-e86f-4ea0-b6b4-dfd555dc0603 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:34.289800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f072614-e86f-4ea0-b6b4-dfd555dc0603 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:34.313930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:34.389054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-52cb2c7c-9404-42be-8e03-27c2dcad1774 req-f7badd68-6139-4b1c-b6e7-f969d13f6443 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32f0ab1-346d-487a-aa08-ebd1656142a7", "name": "network-vif-plugged", "status": "completed", "tag": "6993adde-be55-4ee5-a441-ab52e2f48759"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:34.404601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-52cb2c7c-9404-42be-8e03-27c2dcad1774 req-f7badd68-6139-4b1c-b6e7-f969d13f6443 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:34.405086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-52cb2c7c-9404-42be-8e03-27c2dcad1774 req-f7badd68-6139-4b1c-b6e7-f969d13f6443 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:34.409937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-52cb2c7c-9404-42be-8e03-27c2dcad1774 req-f7badd68-6139-4b1c-b6e7-f969d13f6443 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:34.419068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-52cb2c7c-9404-42be-8e03-27c2dcad1774 req-f7badd68-6139-4b1c-b6e7-f969d13f6443 service nova] Creating event network-vif-plugged:6993adde-be55-4ee5-a441-ab52e2f48759 for instance d32f0ab1-346d-487a-aa08-ebd1656142a7 on n-h2-860892-1 Oct 11 04:25:34.424780 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-52cb2c7c-9404-42be-8e03-27c2dcad1774 req-f7badd68-6139-4b1c-b6e7-f969d13f6443 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041802 Oct 11 04:25:34.425576 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1624/3423] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:25:34.469022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4f072614-e86f-4ea0-b6b4-dfd555dc0603 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:34.477031 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4f072614-e86f-4ea0-b6b4-dfd555dc0603 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1315 microversion: 2.1 time: 0.244403 Oct 11 04:25:34.477610 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1800/3424] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:34 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:34.554749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:34.555463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:34.566423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:34.566917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:34.567354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:34.568057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:34.568620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:34.569020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:34.652428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:34.652917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:34.653355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:34.653814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lazy-loading 'fault' on Instance uuid 5a4c9df1-6017-4456-ab2e-69ad499d5f42 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:25:34.702869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:34.703602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:34.712897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:34.713417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:34.713814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:34.718429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:34.719219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:34.720620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:34.766054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:34.780826 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b3edd56e-0834-49ba-b90e-be4a9019ec0c tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 200 len: 1306 microversion: 2.1 time: 0.231017 Oct 11 04:25:34.781404 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1625/3425] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:34 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 1306 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:35.193792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-71fa85a2-938a-414c-92bc-7ddb3501b126 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:35.194750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-71fa85a2-938a-414c-92bc-7ddb3501b126 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:35.206234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71fa85a2-938a-414c-92bc-7ddb3501b126 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:35.211654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71fa85a2-938a-414c-92bc-7ddb3501b126 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:35.211654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71fa85a2-938a-414c-92bc-7ddb3501b126 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:35.211654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71fa85a2-938a-414c-92bc-7ddb3501b126 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:35.211654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71fa85a2-938a-414c-92bc-7ddb3501b126 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:35.211654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71fa85a2-938a-414c-92bc-7ddb3501b126 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:35.248625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:35.258452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:35.270421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:35.282306 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-56e3d624-ff1f-49da-b65a-c512e1d3990b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.573475 Oct 11 04:25:35.282306 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1801/3426] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:34 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:25:35.287623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-73eda2c0-fd04-49b9-a872-852d50609c72 req-bf6f97df-c605-451b-a8ad-1853b97188cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecd51069-301e-4fab-9e1b-64f7f8615008", "tag": "7b302a98-918e-4fac-8540-baba09828a78"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:35.307341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-73eda2c0-fd04-49b9-a872-852d50609c72 req-bf6f97df-c605-451b-a8ad-1853b97188cd service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:35.308126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-73eda2c0-fd04-49b9-a872-852d50609c72 req-bf6f97df-c605-451b-a8ad-1853b97188cd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:35.308731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-73eda2c0-fd04-49b9-a872-852d50609c72 req-bf6f97df-c605-451b-a8ad-1853b97188cd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:35.335718 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-73eda2c0-fd04-49b9-a872-852d50609c72 req-bf6f97df-c605-451b-a8ad-1853b97188cd service nova] Creating event network-changed:7b302a98-918e-4fac-8540-baba09828a78 for instance ecd51069-301e-4fab-9e1b-64f7f8615008 on n-h1-860892-1 Oct 11 04:25:35.348158 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-73eda2c0-fd04-49b9-a872-852d50609c72 req-bf6f97df-c605-451b-a8ad-1853b97188cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073458 Oct 11 04:25:35.355073 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1802/3427] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:35.501563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c8c2ee83-b833-4170-bf87-156b67730842 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:35.502625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c8c2ee83-b833-4170-bf87-156b67730842 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:35.513744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8c2ee83-b833-4170-bf87-156b67730842 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:35.517593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8c2ee83-b833-4170-bf87-156b67730842 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:35.518415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8c2ee83-b833-4170-bf87-156b67730842 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:35.522489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8c2ee83-b833-4170-bf87-156b67730842 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:35.523477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8c2ee83-b833-4170-bf87-156b67730842 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:35.524381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8c2ee83-b833-4170-bf87-156b67730842 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:36.138813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c8c2ee83-b833-4170-bf87-156b67730842 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:36.148323 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c8c2ee83-b833-4170-bf87-156b67730842 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1315 microversion: 2.1 time: 0.651351 Oct 11 04:25:36.151033 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1803/3428] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:35 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1315 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:36.156774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:36.160694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:36.181674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:36.182730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:36.184957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:36.186588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:36.188180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:36.188877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:36.220639 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 HTTP/1.1 Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '5a4c9df1-6017-4456-ab2e-69ad499d5f42'} Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:36.223861 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:36.228514 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:36.228514 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:36.228514 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:36.228514 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:36.228514 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:36.228514 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:36.228514 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:36.233032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:36.234322 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-423a6eaf-5d98-4075-be09-6190310a4db7 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 404 len: 111 microversion: 2.1 time: 0.081137 Oct 11 04:25:36.238348 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1804/3429] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:36 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:25:36.252367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-97026821-669f-4414-b5bd-705494d7e055 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19327820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:36.273324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-71fa85a2-938a-414c-92bc-7ddb3501b126 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:36.284053 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-71fa85a2-938a-414c-92bc-7ddb3501b126 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1308 microversion: 2.1 time: 1.095311 Oct 11 04:25:36.284652 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1626/3430] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:35 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1308 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:25:36.303369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:36.304027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:36.311979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:36.312484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:36.313095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:36.318551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:36.319122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:36.319583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:36.850753 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-97026821-669f-4414-b5bd-705494d7e055 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/b277c3ef-88a8-4a87-81f5-aaae43a119df" status: 202 len: 0 microversion: 2.1 time: 0.608482 Oct 11 04:25:36.852289 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1805/3431] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:36 2022] DELETE /compute/v2.1/os-security-groups/b277c3ef-88a8-4a87-81f5-aaae43a119df => generated 0 bytes in 611 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:25:36.861530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fdcccdb3-5b1c-46e6-8d3e-861b7ad41b4b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda1a00f820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:37.296811 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fdcccdb3-5b1c-46e6-8d3e-861b7ad41b4b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/1ae24375-f918-4004-b8c7-b3d1a1c76657" status: 202 len: 0 microversion: 2.1 time: 0.440160 Oct 11 04:25:37.297382 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1806/3432] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:36 2022] DELETE /compute/v2.1/os-security-groups/1ae24375-f918-4004-b8c7-b3d1a1c76657 => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:25:37.309520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c854234c-c079-465b-a512-b0517f31e39d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:37.311368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c854234c-c079-465b-a512-b0517f31e39d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:37.322877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c854234c-c079-465b-a512-b0517f31e39d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:37.324922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c854234c-c079-465b-a512-b0517f31e39d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:37.326152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c854234c-c079-465b-a512-b0517f31e39d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:37.329180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c854234c-c079-465b-a512-b0517f31e39d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:37.329853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c854234c-c079-465b-a512-b0517f31e39d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:37.330983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c854234c-c079-465b-a512-b0517f31e39d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:37.359923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:37.369923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:37.371383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:37.383819 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0ecab785-e08a-4f44-9af7-27dd208d0dcc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 1.082635 Oct 11 04:25:37.383819 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1627/3433] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:36 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:25:37.408218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c82ac248-4544-472c-b4b8-769480e12ce9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:37.409467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c82ac248-4544-472c-b4b8-769480e12ce9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:37.435652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c82ac248-4544-472c-b4b8-769480e12ce9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:37.436474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c82ac248-4544-472c-b4b8-769480e12ce9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:37.438224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c82ac248-4544-472c-b4b8-769480e12ce9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:37.439230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c82ac248-4544-472c-b4b8-769480e12ce9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:37.440001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c82ac248-4544-472c-b4b8-769480e12ce9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:37.440652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c82ac248-4544-472c-b4b8-769480e12ce9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:37.597470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c854234c-c079-465b-a512-b0517f31e39d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:37.611559 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c854234c-c079-465b-a512-b0517f31e39d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1315 microversion: 2.1 time: 0.312322 Oct 11 04:25:37.613277 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1807/3434] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:37 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:37.619473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d73d8be-ff2c-478a-9c3d-8823c563b655 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'create', calling method: .version_select at 0x7fda19b3ab80>, body: {"security_group": {"name": "tempest-SecurityGroupsTestJSON-securitygroup-1033312915", "description": "tempest-description-1110996122"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:37.905897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c82ac248-4544-472c-b4b8-769480e12ce9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:37.919002 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c82ac248-4544-472c-b4b8-769480e12ce9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1308 microversion: 2.1 time: 0.529797 Oct 11 04:25:37.920431 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1628/3435] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:37 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1308 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:38.336123 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d73d8be-ff2c-478a-9c3d-8823c563b655 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "POST /compute/v2.1/os-security-groups" status: 200 len: 244 microversion: 2.1 time: 0.721646 Oct 11 04:25:38.344815 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1808/3436] 10.222.0.26 () {60 vars in 1180 bytes} [Tue Oct 11 04:25:37 2022] POST /compute/v2.1/os-security-groups => generated 244 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:38.350873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a413b8c7-0eba-422b-aade-60d21591acde tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Action: 'update', calling method: .version_select at 0x7fda1a3ed820>, body: {"security_group": {"name": "tempest-sg-hth-332683156", "description": "tempest-description-hth-981890131"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:38.407473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:38.408387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:38.419550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:38.420059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:38.422370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:38.426515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:38.427278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:38.428064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:38.850558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:38.862299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:38.864287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:38.866057 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3e6e881f-ed62-49c8-9cfa-a40716553cbe tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.463203 Oct 11 04:25:38.867242 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1809/3437] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:38 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:25:38.872569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ccd1aa5e-25cc-4042-a12e-75901e916b65 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:38.873591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ccd1aa5e-25cc-4042-a12e-75901e916b65 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:38.883280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccd1aa5e-25cc-4042-a12e-75901e916b65 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:38.884206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccd1aa5e-25cc-4042-a12e-75901e916b65 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:38.884913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccd1aa5e-25cc-4042-a12e-75901e916b65 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:38.887325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccd1aa5e-25cc-4042-a12e-75901e916b65 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:38.888229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccd1aa5e-25cc-4042-a12e-75901e916b65 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:38.888831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccd1aa5e-25cc-4042-a12e-75901e916b65 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:39.215250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ccd1aa5e-25cc-4042-a12e-75901e916b65 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:39.227165 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ccd1aa5e-25cc-4042-a12e-75901e916b65 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1315 microversion: 2.1 time: 0.358416 Oct 11 04:25:39.251482 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1810/3438] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:38 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1315 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:39.265126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-12eeafbb-9f0e-4a24-b70d-bc2ac5b27b58 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:39.267595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-12eeafbb-9f0e-4a24-b70d-bc2ac5b27b58 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:39.284105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12eeafbb-9f0e-4a24-b70d-bc2ac5b27b58 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:39.285127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12eeafbb-9f0e-4a24-b70d-bc2ac5b27b58 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:39.285668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12eeafbb-9f0e-4a24-b70d-bc2ac5b27b58 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:39.288299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12eeafbb-9f0e-4a24-b70d-bc2ac5b27b58 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:39.292309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12eeafbb-9f0e-4a24-b70d-bc2ac5b27b58 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:39.293003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12eeafbb-9f0e-4a24-b70d-bc2ac5b27b58 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:39.726690 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a413b8c7-0eba-422b-aade-60d21591acde tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "PUT /compute/v2.1/os-security-groups/856f64fe-2139-4b4e-ac75-e22752203a8a" status: 200 len: 216 microversion: 2.1 time: 1.370826 Oct 11 04:25:39.728692 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1629/3439] 10.222.0.26 () {60 vars in 1290 bytes} [Tue Oct 11 04:25:38 2022] PUT /compute/v2.1/os-security-groups/856f64fe-2139-4b4e-ac75-e22752203a8a => generated 216 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:39.735418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8f6602c-de31-4ffb-9d84-18321940bb64 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda1a3838b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:39.837525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-12eeafbb-9f0e-4a24-b70d-bc2ac5b27b58 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:39.848812 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-12eeafbb-9f0e-4a24-b70d-bc2ac5b27b58 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1308 microversion: 2.1 time: 0.595836 Oct 11 04:25:39.874481 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1811/3440] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:39 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1308 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:39.897955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:39.898605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:39.912204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:39.918402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:39.919595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:39.920578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:39.921046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:39.921479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:39.934945 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a8f6602c-de31-4ffb-9d84-18321940bb64 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/os-security-groups/856f64fe-2139-4b4e-ac75-e22752203a8a" status: 200 len: 216 microversion: 2.1 time: 0.204892 Oct 11 04:25:39.936104 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1630/3441] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:25:39 2022] GET /compute/v2.1/os-security-groups/856f64fe-2139-4b4e-ac75-e22752203a8a => generated 216 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:39.952108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2d02019d-e234-4b4f-b03a-5dc8e344b036 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19b0a550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:40.331983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:40.344336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:40.345805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:40.347050 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a0ffc4d-7c10-43cd-a5c5-9ba425d15089 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.453057 Oct 11 04:25:40.351697 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1812/3442] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:39 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:40.361841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-628df47a-91d1-451d-8d48-485cc4488990 req-701fd604-9490-4cb9-b9de-376291411660 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baccb1e-5505-4df8-a290-46f39e25eb7c", "name": "network-vif-plugged", "status": "completed", "tag": "40cfa72a-7b5a-42cc-acb3-5e760550a5ef"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:40.388047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-628df47a-91d1-451d-8d48-485cc4488990 req-701fd604-9490-4cb9-b9de-376291411660 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:40.388954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-628df47a-91d1-451d-8d48-485cc4488990 req-701fd604-9490-4cb9-b9de-376291411660 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:40.389630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-628df47a-91d1-451d-8d48-485cc4488990 req-701fd604-9490-4cb9-b9de-376291411660 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:40.405226 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-628df47a-91d1-451d-8d48-485cc4488990 req-701fd604-9490-4cb9-b9de-376291411660 service nova] Creating event network-vif-plugged:40cfa72a-7b5a-42cc-acb3-5e760550a5ef for instance 0baccb1e-5505-4df8-a290-46f39e25eb7c on n-h1-860892-1 Oct 11 04:25:40.414859 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-628df47a-91d1-451d-8d48-485cc4488990 req-701fd604-9490-4cb9-b9de-376291411660 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056548 Oct 11 04:25:40.415500 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1813/3443] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:40.429063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9f4f48c-fb18-40a8-87d5-85b98497b3bd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:40.436581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d9f4f48c-fb18-40a8-87d5-85b98497b3bd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:40.442250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f4f48c-fb18-40a8-87d5-85b98497b3bd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:40.442750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f4f48c-fb18-40a8-87d5-85b98497b3bd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:40.443230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f4f48c-fb18-40a8-87d5-85b98497b3bd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:40.443929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f4f48c-fb18-40a8-87d5-85b98497b3bd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:40.444381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f4f48c-fb18-40a8-87d5-85b98497b3bd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:40.444806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9f4f48c-fb18-40a8-87d5-85b98497b3bd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:40.551473 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2d02019d-e234-4b4f-b03a-5dc8e344b036 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/856f64fe-2139-4b4e-ac75-e22752203a8a" status: 202 len: 0 microversion: 2.1 time: 0.605051 Oct 11 04:25:40.552112 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1631/3444] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:39 2022] DELETE /compute/v2.1/os-security-groups/856f64fe-2139-4b4e-ac75-e22752203a8a => generated 0 bytes in 607 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:25:40.568532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:40.568958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:40.582469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:40.584158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:40.584764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:40.585717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:40.586177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:40.586812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:40.607129 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 HTTP/1.1 Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '5a4c9df1-6017-4456-ab2e-69ad499d5f42'} Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:25:40.615251 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:25:40.621520 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:40.621520 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.621520 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:40.621520 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.621520 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:40.621520 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:40.621520 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:40.621520 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:40.621520 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:40.621520 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:40.621520 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.624279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:40.625501 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a17da29c-0929-461a-85cc-3785c75e6a04 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 404 len: 111 microversion: 2.1 time: 0.068697 Oct 11 04:25:40.626698 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1632/3445] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:25:40 2022] DELETE /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:25:40.637368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:40.638841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: 5a4c9df1-6017-4456-ab2e-69ad499d5f42] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:40.667454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:40.668176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:40.672009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:40.673152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:40.673867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:40.674978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 HTTP/1.1 Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '5a4c9df1-6017-4456-ab2e-69ad499d5f42'} Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:25:40.698163 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Instance 5a4c9df1-6017-4456-ab2e-69ad499d5f42 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b16858b2-d5de-4be5-ac20-9a602564afec tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42" status: 404 len: 111 microversion: 2.1 time: 0.066419 Oct 11 04:25:40.703941 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1633/3446] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:40 2022] GET /compute/v2.1/servers/5a4c9df1-6017-4456-ab2e-69ad499d5f42 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:25:40.706298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02bcc922-0c8d-46ac-a5b6-64315113ea8d tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:40.706474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-02bcc922-0c8d-46ac-a5b6-64315113ea8d tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:40.714234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02bcc922-0c8d-46ac-a5b6-64315113ea8d tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:40.714876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02bcc922-0c8d-46ac-a5b6-64315113ea8d tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:40.715679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02bcc922-0c8d-46ac-a5b6-64315113ea8d tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:40.716569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02bcc922-0c8d-46ac-a5b6-64315113ea8d tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:40.717189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02bcc922-0c8d-46ac-a5b6-64315113ea8d tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:40.717808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02bcc922-0c8d-46ac-a5b6-64315113ea8d tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:40.844422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d9f4f48c-fb18-40a8-87d5-85b98497b3bd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:40.853759 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d9f4f48c-fb18-40a8-87d5-85b98497b3bd tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1315 microversion: 2.1 time: 0.434556 Oct 11 04:25:40.864369 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1814/3447] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:40 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:40.864369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-070b6029-8a78-46da-81b1-39c5bc90ed7d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda1a059ca0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:40.891357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG neutronclient.v2_0.client [None req-070b6029-8a78-46da-81b1-39c5bc90ed7d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 1ae24375-f918-4004-b8c7-b3d1a1c76657 does not exist", "detail": ""}} {{(pid=120994) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:25:40.894484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.security_group_api [None req-070b6029-8a78-46da-81b1-39c5bc90ed7d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Neutron security group 1ae24375-f918-4004-b8c7-b3d1a1c76657 not found {{(pid=120994) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:25:40.894484 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-070b6029-8a78-46da-81b1-39c5bc90ed7d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security group 1ae24375-f918-4004-b8c7-b3d1a1c76657 does not exist Oct 11 04:25:40.894484 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-ff85f182-7316-41f8-8974-e535169b57f4'] Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-070b6029-8a78-46da-81b1-39c5bc90ed7d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-security-groups/1ae24375-f918-4004-b8c7-b3d1a1c76657 HTTP/1.1 Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: exception: Security group 1ae24375-f918-4004-b8c7-b3d1a1c76657 does not exist Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-ff85f182-7316-41f8-8974-e535169b57f4'] Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1ae24375-f918-4004-b8c7-b3d1a1c76657'} Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:25:40.896809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 1ae24375-f918-4004-b8c7-b3d1a1c76657 does not exist Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff85f182-7316-41f8-8974-e535169b57f4'] Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 1ae24375-f918-4004-b8c7-b3d1a1c76657 does not exist Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff85f182-7316-41f8-8974-e535169b57f4'] Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 1ae24375-f918-4004-b8c7-b3d1a1c76657 does not exist Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff85f182-7316-41f8-8974-e535169b57f4'] Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 1ae24375-f918-4004-b8c7-b3d1a1c76657 does not exist Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-ff85f182-7316-41f8-8974-e535169b57f4'] Oct 11 04:25:40.900821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:40.905152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-070b6029-8a78-46da-81b1-39c5bc90ed7d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Security group 1ae24375-f918-4004-b8c7-b3d1a1c76657 does not exist Oct 11 04:25:40.905152 n-d-860892-1 devstack@n-api.service[120994]: Neutron server returns request_ids: ['req-ff85f182-7316-41f8-8974-e535169b57f4'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:40.905434 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-070b6029-8a78-46da-81b1-39c5bc90ed7d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/1ae24375-f918-4004-b8c7-b3d1a1c76657" status: 404 len: 194 microversion: 2.1 time: 0.049805 Oct 11 04:25:40.909036 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1815/3448] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:40 2022] DELETE /compute/v2.1/os-security-groups/1ae24375-f918-4004-b8c7-b3d1a1c76657 => generated 194 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:25:40.911195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-416dc4e6-19fb-4d4e-ab8d-74063903f196 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:40.911874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-416dc4e6-19fb-4d4e-ab8d-74063903f196 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:40.919104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-416dc4e6-19fb-4d4e-ab8d-74063903f196 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:40.923485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-416dc4e6-19fb-4d4e-ab8d-74063903f196 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:40.923485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-416dc4e6-19fb-4d4e-ab8d-74063903f196 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:40.923485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-416dc4e6-19fb-4d4e-ab8d-74063903f196 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:40.923485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-416dc4e6-19fb-4d4e-ab8d-74063903f196 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:40.923485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-416dc4e6-19fb-4d4e-ab8d-74063903f196 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:41.087723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-416dc4e6-19fb-4d4e-ab8d-74063903f196 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:41.090029 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02bcc922-0c8d-46ac-a5b6-64315113ea8d tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1860 microversion: 2.1 time: 0.389893 Oct 11 04:25:41.093629 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1634/3449] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:40 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1860 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:41.098289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f60996c4-caa1-4cff-a1bf-92b9d8edeb7a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda192668b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:41.113170 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-416dc4e6-19fb-4d4e-ab8d-74063903f196 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1308 microversion: 2.1 time: 0.206000 Oct 11 04:25:41.114162 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1816/3450] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:40 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1308 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:41.120344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69bc898a-84da-46af-9742-0cb397b59705 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h2-860892-1", "block_migration": true, "disk_over_commit": false}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:41.127422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-69bc898a-84da-46af-9742-0cb397b59705 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:41.131737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69bc898a-84da-46af-9742-0cb397b59705 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:41.132502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69bc898a-84da-46af-9742-0cb397b59705 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:41.133186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69bc898a-84da-46af-9742-0cb397b59705 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:41.134112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69bc898a-84da-46af-9742-0cb397b59705 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:41.134932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69bc898a-84da-46af-9742-0cb397b59705 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:41.135577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69bc898a-84da-46af-9742-0cb397b59705 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:41.167295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-f60996c4-caa1-4cff-a1bf-92b9d8edeb7a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group b277c3ef-88a8-4a87-81f5-aaae43a119df does not exist", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:25:41.168008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.security_group_api [None req-f60996c4-caa1-4cff-a1bf-92b9d8edeb7a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Neutron security group b277c3ef-88a8-4a87-81f5-aaae43a119df not found {{(pid=120993) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:25:41.168669 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f60996c4-caa1-4cff-a1bf-92b9d8edeb7a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security group b277c3ef-88a8-4a87-81f5-aaae43a119df does not exist Oct 11 04:25:41.168669 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-b25c6d03-2eab-45f6-a2da-8f169683cf1b'] Oct 11 04:25:41.170071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-69bc898a-84da-46af-9742-0cb397b59705 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lazy-loading 'flavor' on Instance uuid f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f60996c4-caa1-4cff-a1bf-92b9d8edeb7a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-security-groups/b277c3ef-88a8-4a87-81f5-aaae43a119df HTTP/1.1 Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: exception: Security group b277c3ef-88a8-4a87-81f5-aaae43a119df does not exist Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-b25c6d03-2eab-45f6-a2da-8f169683cf1b'] Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'b277c3ef-88a8-4a87-81f5-aaae43a119df'} Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:25:41.171507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group b277c3ef-88a8-4a87-81f5-aaae43a119df does not exist Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b25c6d03-2eab-45f6-a2da-8f169683cf1b'] Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group b277c3ef-88a8-4a87-81f5-aaae43a119df does not exist Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b25c6d03-2eab-45f6-a2da-8f169683cf1b'] Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group b277c3ef-88a8-4a87-81f5-aaae43a119df does not exist Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b25c6d03-2eab-45f6-a2da-8f169683cf1b'] Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group b277c3ef-88a8-4a87-81f5-aaae43a119df does not exist Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-b25c6d03-2eab-45f6-a2da-8f169683cf1b'] Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f60996c4-caa1-4cff-a1bf-92b9d8edeb7a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Security group b277c3ef-88a8-4a87-81f5-aaae43a119df does not exist Oct 11 04:25:41.175535 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-b25c6d03-2eab-45f6-a2da-8f169683cf1b'] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:41.182223 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f60996c4-caa1-4cff-a1bf-92b9d8edeb7a tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/b277c3ef-88a8-4a87-81f5-aaae43a119df" status: 404 len: 194 microversion: 2.1 time: 0.085681 Oct 11 04:25:41.190474 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1635/3451] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:41 2022] DELETE /compute/v2.1/os-security-groups/b277c3ef-88a8-4a87-81f5-aaae43a119df => generated 194 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:25:41.190644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-69bc898a-84da-46af-9742-0cb397b59705 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Going to try to live migrate instance to n-h2-860892-1 {{(pid=120994) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 04:25:41.192307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c8ec2b8-a2e5-4687-8700-312eabb6af12 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19a07040>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:41.269235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-8c8ec2b8-a2e5-4687-8700-312eabb6af12 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:25:41.270166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.security_group_api [None req-8c8ec2b8-a2e5-4687-8700-312eabb6af12 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Neutron security group 59c58922-e4e6-4546-b4fa-15ea618cef92 not found {{(pid=120993) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:25:41.270769 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-8c8ec2b8-a2e5-4687-8700-312eabb6af12 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:25:41.270769 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-0b2aea6b-07f6-4c3c-afd4-772964355042'] Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c8ec2b8-a2e5-4687-8700-312eabb6af12 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-security-groups/59c58922-e4e6-4546-b4fa-15ea618cef92 HTTP/1.1 Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: exception: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-0b2aea6b-07f6-4c3c-afd4-772964355042'] Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '59c58922-e4e6-4546-b4fa-15ea618cef92'} Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:25:41.273984 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2aea6b-07f6-4c3c-afd4-772964355042'] Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2aea6b-07f6-4c3c-afd4-772964355042'] Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2aea6b-07f6-4c3c-afd4-772964355042'] Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-0b2aea6b-07f6-4c3c-afd4-772964355042'] Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c8ec2b8-a2e5-4687-8700-312eabb6af12 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Security group 59c58922-e4e6-4546-b4fa-15ea618cef92 does not exist Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-0b2aea6b-07f6-4c3c-afd4-772964355042'] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:41.278437 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8c8ec2b8-a2e5-4687-8700-312eabb6af12 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/59c58922-e4e6-4546-b4fa-15ea618cef92" status: 404 len: 194 microversion: 2.1 time: 0.088683 Oct 11 04:25:41.287321 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1636/3452] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:41 2022] DELETE /compute/v2.1/os-security-groups/59c58922-e4e6-4546-b4fa-15ea618cef92 => generated 194 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:25:41.293435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-790feb33-2ec3-485f-863d-b39cf2cfe0e4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19148f70>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:41.332073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-790feb33-2ec3-485f-863d-b39cf2cfe0e4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:25:41.332956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.security_group_api [None req-790feb33-2ec3-485f-863d-b39cf2cfe0e4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Neutron security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 not found {{(pid=120993) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:25:41.333936 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-790feb33-2ec3-485f-863d-b39cf2cfe0e4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:25:41.333936 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-459520d8-8349-422e-b4e0-c381ef09d4bf'] Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-790feb33-2ec3-485f-863d-b39cf2cfe0e4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-security-groups/c7cdda8a-ae7c-41fd-90a3-405571d5d503 HTTP/1.1 Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: exception: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-459520d8-8349-422e-b4e0-c381ef09d4bf'] Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'c7cdda8a-ae7c-41fd-90a3-405571d5d503'} Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:25:41.336559 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-459520d8-8349-422e-b4e0-c381ef09d4bf'] Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-459520d8-8349-422e-b4e0-c381ef09d4bf'] Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-459520d8-8349-422e-b4e0-c381ef09d4bf'] Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-459520d8-8349-422e-b4e0-c381ef09d4bf'] Oct 11 04:25:41.341261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.348078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-790feb33-2ec3-485f-863d-b39cf2cfe0e4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Security group c7cdda8a-ae7c-41fd-90a3-405571d5d503 does not exist Oct 11 04:25:41.348078 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-459520d8-8349-422e-b4e0-c381ef09d4bf'] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:41.349848 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-790feb33-2ec3-485f-863d-b39cf2cfe0e4 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/c7cdda8a-ae7c-41fd-90a3-405571d5d503" status: 404 len: 194 microversion: 2.1 time: 0.067961 Oct 11 04:25:41.353985 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1637/3453] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:41 2022] DELETE /compute/v2.1/os-security-groups/c7cdda8a-ae7c-41fd-90a3-405571d5d503 => generated 194 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:25:41.368854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-adcff9b3-068c-433a-ad59-c9fb153b9f3d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda199df430>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:41.409388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-adcff9b3-068c-433a-ad59-c9fb153b9f3d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:25:41.410052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.security_group_api [None req-adcff9b3-068c-433a-ad59-c9fb153b9f3d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Neutron security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b not found {{(pid=120993) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:25:41.410615 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-adcff9b3-068c-433a-ad59-c9fb153b9f3d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:25:41.410615 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-1de0acdd-926d-4e80-8ab5-2396dc381dc2'] Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-adcff9b3-068c-433a-ad59-c9fb153b9f3d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-security-groups/a7243cb9-4b72-4d6a-af8d-0a43d178b02b HTTP/1.1 Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: exception: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-1de0acdd-926d-4e80-8ab5-2396dc381dc2'] Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'a7243cb9-4b72-4d6a-af8d-0a43d178b02b'} Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:25:41.413211 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1de0acdd-926d-4e80-8ab5-2396dc381dc2'] Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1de0acdd-926d-4e80-8ab5-2396dc381dc2'] Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1de0acdd-926d-4e80-8ab5-2396dc381dc2'] Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-1de0acdd-926d-4e80-8ab5-2396dc381dc2'] Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-adcff9b3-068c-433a-ad59-c9fb153b9f3d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Security group a7243cb9-4b72-4d6a-af8d-0a43d178b02b does not exist Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-1de0acdd-926d-4e80-8ab5-2396dc381dc2'] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-adcff9b3-068c-433a-ad59-c9fb153b9f3d tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/a7243cb9-4b72-4d6a-af8d-0a43d178b02b" status: 404 len: 194 microversion: 2.1 time: 0.059521 Oct 11 04:25:41.420915 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1638/3454] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:41 2022] DELETE /compute/v2.1/os-security-groups/a7243cb9-4b72-4d6a-af8d-0a43d178b02b => generated 194 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:25:41.426902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:41.428086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:41.439796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:41.440297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:41.440796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:41.441517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:41.441976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:41.442741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:41.725468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:41.747402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:41.753132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:41.756912 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1654c809-5e14-4c82-9bc6-fefbd783ef62 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.340061 Oct 11 04:25:41.757517 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1639/3455] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:41 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:41.762909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e5ab2b07-465c-4e68-999d-da8c33ff420b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19a60af0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:41.799972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG neutronclient.v2_0.client [None req-e5ab2b07-465c-4e68-999d-da8c33ff420b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Error message: {"NeutronError": {"type": "SecurityGroupNotFound", "message": "Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist", "detail": ""}} {{(pid=120993) _handle_fault_response /usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py:262}} Oct 11 04:25:41.800669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.security_group_api [None req-e5ab2b07-465c-4e68-999d-da8c33ff420b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Neutron security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 not found {{(pid=120993) get /opt/stack/nova/nova/network/security_group_api.py:313}} Oct 11 04:25:41.801307 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-e5ab2b07-465c-4e68-999d-da8c33ff420b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:25:41.801307 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-9f50a2e4-34b3-4202-bbb5-29a41ed0abbb'] Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e5ab2b07-465c-4e68-999d-da8c33ff420b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-security-groups/6c088360-944b-425b-9fd7-a7bfefc1fe96 HTTP/1.1 Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: exception: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-9f50a2e4-34b3-4202-bbb5-29a41ed0abbb'] Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '6c088360-944b-425b-9fd7-a7bfefc1fe96'} Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 309, in get Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi group = neutron.show_security_group(id).get('security_group') Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 1068, in show_security_group Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.get(self.security_group_path % (security_group), Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 356, in get Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.retry_request("GET", action, body=body, Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 333, in retry_request Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.do_request(method, action, body=body, Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 297, in do_request Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._handle_fault_response(status_code, replybody, resp) Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 272, in _handle_fault_response Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi exception_handler_v20(status_code, error_body) Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 90, in exception_handler_v20 Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise client_exc(message=error_message, Oct 11 04:25:41.803919 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f50a2e4-34b3-4202-bbb5-29a41ed0abbb'] Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 178, in delete Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi security_group = security_group_api.get(context, id) Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 314, in get Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f50a2e4-34b3-4202-bbb5-29a41ed0abbb'] Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/security_groups.py", line 181, in delete Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=exp.format_message()) Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f50a2e4-34b3-4202-bbb5-29a41ed0abbb'] Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Neutron server returns request_ids: ['req-9f50a2e4-34b3-4202-bbb5-29a41ed0abbb'] Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e5ab2b07-465c-4e68-999d-da8c33ff420b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Security group 6c088360-944b-425b-9fd7-a7bfefc1fe96 does not exist Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: Neutron server returns request_ids: ['req-9f50a2e4-34b3-4202-bbb5-29a41ed0abbb'] {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e5ab2b07-465c-4e68-999d-da8c33ff420b tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/6c088360-944b-425b-9fd7-a7bfefc1fe96" status: 404 len: 194 microversion: 2.1 time: 0.046820 Oct 11 04:25:41.808178 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1640/3456] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:41 2022] DELETE /compute/v2.1/os-security-groups/6c088360-944b-425b-9fd7-a7bfefc1fe96 => generated 194 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:25:41.821245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7ba918e-e3e2-4bc1-8ae2-4fb1f8aa5ccd tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:41.821797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a7ba918e-e3e2-4bc1-8ae2-4fb1f8aa5ccd tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:41.840771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7ba918e-e3e2-4bc1-8ae2-4fb1f8aa5ccd tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:41.843027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7ba918e-e3e2-4bc1-8ae2-4fb1f8aa5ccd tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:41.843727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7ba918e-e3e2-4bc1-8ae2-4fb1f8aa5ccd tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:41.844664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7ba918e-e3e2-4bc1-8ae2-4fb1f8aa5ccd tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:41.845310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7ba918e-e3e2-4bc1-8ae2-4fb1f8aa5ccd tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:41.845927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7ba918e-e3e2-4bc1-8ae2-4fb1f8aa5ccd tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:41.915243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a7ba918e-e3e2-4bc1-8ae2-4fb1f8aa5ccd tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:25:42.673148 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a7ba918e-e3e2-4bc1-8ae2-4fb1f8aa5ccd tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 204 len: 0 microversion: 2.1 time: 0.860449 Oct 11 04:25:42.674729 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1641/3457] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:25:41 2022] DELETE /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 0 bytes in 863 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:25:42.680729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7f27bebf-a0f6-414f-b959-7befe8cc0ff7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:42.692858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7f27bebf-a0f6-414f-b959-7befe8cc0ff7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:42.698769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f27bebf-a0f6-414f-b959-7befe8cc0ff7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:42.699452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f27bebf-a0f6-414f-b959-7befe8cc0ff7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:42.700092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f27bebf-a0f6-414f-b959-7befe8cc0ff7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:42.700800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f27bebf-a0f6-414f-b959-7befe8cc0ff7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:42.701261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f27bebf-a0f6-414f-b959-7befe8cc0ff7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:42.701684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f27bebf-a0f6-414f-b959-7befe8cc0ff7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:42.876116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7f27bebf-a0f6-414f-b959-7befe8cc0ff7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:42.889150 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7f27bebf-a0f6-414f-b959-7befe8cc0ff7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1502 microversion: 2.1 time: 0.211159 Oct 11 04:25:42.889150 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1642/3458] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:42 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:42.924086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef4f412b-8cfe-4d78-b507-140ffaf7628b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:42.924988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef4f412b-8cfe-4d78-b507-140ffaf7628b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:42.932416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4f412b-8cfe-4d78-b507-140ffaf7628b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:42.935167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4f412b-8cfe-4d78-b507-140ffaf7628b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:42.936150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4f412b-8cfe-4d78-b507-140ffaf7628b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:42.938787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4f412b-8cfe-4d78-b507-140ffaf7628b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:42.939469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4f412b-8cfe-4d78-b507-140ffaf7628b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:42.941282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef4f412b-8cfe-4d78-b507-140ffaf7628b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:43.296757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef4f412b-8cfe-4d78-b507-140ffaf7628b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:43.314315 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef4f412b-8cfe-4d78-b507-140ffaf7628b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1308 microversion: 2.1 time: 0.410417 Oct 11 04:25:43.314968 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1643/3459] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:42 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1308 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:43.336140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c38734f9-f234-4100-9bcf-61baf2232172 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:43.336863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c38734f9-f234-4100-9bcf-61baf2232172 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:43.343595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c38734f9-f234-4100-9bcf-61baf2232172 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:43.350676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c38734f9-f234-4100-9bcf-61baf2232172 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:43.350676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c38734f9-f234-4100-9bcf-61baf2232172 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:43.350676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c38734f9-f234-4100-9bcf-61baf2232172 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:43.350676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c38734f9-f234-4100-9bcf-61baf2232172 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:43.350676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c38734f9-f234-4100-9bcf-61baf2232172 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:43.609262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c38734f9-f234-4100-9bcf-61baf2232172 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:43.621957 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c38734f9-f234-4100-9bcf-61baf2232172 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1646 microversion: 2.1 time: 0.294111 Oct 11 04:25:43.634225 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1644/3460] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:43 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1646 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:43.639378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:43.643929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:43.656786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:43.657535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:43.658218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:43.659141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:43.659946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:43.660437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:43.919978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:43.945427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:43.949051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:43.951126 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-84895d23-dac9-44c8-9ee1-f7df2799d723 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.321342 Oct 11 04:25:43.954882 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1645/3461] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:43 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:43.992584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a0e23a06-f753-412b-9714-21e6db7f2293 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:44.000818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0e23a06-f753-412b-9714-21e6db7f2293 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:44.002760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0e23a06-f753-412b-9714-21e6db7f2293 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:44.003417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0e23a06-f753-412b-9714-21e6db7f2293 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:44.039058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:44.079375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a0e23a06-f753-412b-9714-21e6db7f2293 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Going to try to stop instance {{(pid=120993) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 04:25:44.350761 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a0e23a06-f753-412b-9714-21e6db7f2293 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c/action" status: 202 len: 0 microversion: 2.1 time: 0.393558 Oct 11 04:25:44.354973 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1646/3462] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:25:43 2022] POST /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c/action => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:25:44.360641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-fd00b6d5-aa61-43c7-b0b6-1f9d404a9b0e req-a22b77c3-0433-4524-ac94-acdb1625ac34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd51069-301e-4fab-9e1b-64f7f8615008", "name": "network-vif-plugged", "status": "completed", "tag": "7b302a98-918e-4fac-8540-baba09828a78"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:44.402746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fd00b6d5-aa61-43c7-b0b6-1f9d404a9b0e req-a22b77c3-0433-4524-ac94-acdb1625ac34 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:44.403802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fd00b6d5-aa61-43c7-b0b6-1f9d404a9b0e req-a22b77c3-0433-4524-ac94-acdb1625ac34 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:44.406331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fd00b6d5-aa61-43c7-b0b6-1f9d404a9b0e req-a22b77c3-0433-4524-ac94-acdb1625ac34 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:44.442930 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-fd00b6d5-aa61-43c7-b0b6-1f9d404a9b0e req-a22b77c3-0433-4524-ac94-acdb1625ac34 service nova] Creating event network-vif-plugged:7b302a98-918e-4fac-8540-baba09828a78 for instance ecd51069-301e-4fab-9e1b-64f7f8615008 on n-h1-860892-1 Oct 11 04:25:44.463701 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-fd00b6d5-aa61-43c7-b0b6-1f9d404a9b0e req-a22b77c3-0433-4524-ac94-acdb1625ac34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105666 Oct 11 04:25:44.473833 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1647/3463] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:44.488946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5e2bb391-4b36-4393-a629-194564187178 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:44.494966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5e2bb391-4b36-4393-a629-194564187178 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:44.513268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2bb391-4b36-4393-a629-194564187178 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:44.513268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2bb391-4b36-4393-a629-194564187178 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:44.513268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2bb391-4b36-4393-a629-194564187178 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:44.513268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2bb391-4b36-4393-a629-194564187178 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:44.513268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2bb391-4b36-4393-a629-194564187178 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:44.513268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2bb391-4b36-4393-a629-194564187178 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:44.778639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e2bb391-4b36-4393-a629-194564187178 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:44.787677 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5e2bb391-4b36-4393-a629-194564187178 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1308 microversion: 2.1 time: 0.317987 Oct 11 04:25:44.791652 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1648/3464] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:44 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1308 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:44.796366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1084d526-8c9e-4152-87fb-83ea85a42cb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:44.815156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1084d526-8c9e-4152-87fb-83ea85a42cb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:44.821409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1084d526-8c9e-4152-87fb-83ea85a42cb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:44.821910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1084d526-8c9e-4152-87fb-83ea85a42cb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:44.822441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1084d526-8c9e-4152-87fb-83ea85a42cb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:44.823153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1084d526-8c9e-4152-87fb-83ea85a42cb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:44.823817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1084d526-8c9e-4152-87fb-83ea85a42cb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:44.835200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1084d526-8c9e-4152-87fb-83ea85a42cb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:45.098338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1084d526-8c9e-4152-87fb-83ea85a42cb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:45.116516 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1084d526-8c9e-4152-87fb-83ea85a42cb6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.318394 Oct 11 04:25:45.116516 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1649/3465] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:44 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:45.122937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e7830e9f-9282-402f-8243-9dc3f96b1300 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:45.124030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e7830e9f-9282-402f-8243-9dc3f96b1300 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:45.140524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:45.143409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7830e9f-9282-402f-8243-9dc3f96b1300 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:45.144122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7830e9f-9282-402f-8243-9dc3f96b1300 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:45.145689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7830e9f-9282-402f-8243-9dc3f96b1300 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:45.147228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7830e9f-9282-402f-8243-9dc3f96b1300 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:45.148934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7830e9f-9282-402f-8243-9dc3f96b1300 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:45.150201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7830e9f-9282-402f-8243-9dc3f96b1300 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:45.359953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e7830e9f-9282-402f-8243-9dc3f96b1300 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47f8ee8bc00840c99abafb15e9d32b84', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a9d56ebae03424f9f9892abf32b7579', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:45.369935 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e7830e9f-9282-402f-8243-9dc3f96b1300 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 200 len: 1467 microversion: 2.1 time: 0.256113 Oct 11 04:25:45.375257 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1650/3466] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:45 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 1467 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:45.382819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:45.386965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:45.402239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:45.403192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:45.403886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:45.405709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:45.407933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:45.408608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:46.137477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:46.153784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:46.160831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:46.163808 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-666fc2a9-17b6-404b-869f-9e417d11b356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.787266 Oct 11 04:25:46.166210 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1651/3467] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:45 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:46.180113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-52c6b9e0-0924-4bf7-90b3-c5725f346177 req-4297c8c8-3bba-4a68-8918-fb6965af9756 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8a95c5f-658f-4a48-97c8-8786b3e9de1a", "name": "network-vif-deleted", "tag": "8e3c2050-0798-4c5e-9af5-1cfbf9783ef1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:46.217977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-52c6b9e0-0924-4bf7-90b3-c5725f346177 req-4297c8c8-3bba-4a68-8918-fb6965af9756 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:46.221877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-52c6b9e0-0924-4bf7-90b3-c5725f346177 req-4297c8c8-3bba-4a68-8918-fb6965af9756 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:46.224585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-52c6b9e0-0924-4bf7-90b3-c5725f346177 req-4297c8c8-3bba-4a68-8918-fb6965af9756 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:46.251359 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-52c6b9e0-0924-4bf7-90b3-c5725f346177 req-4297c8c8-3bba-4a68-8918-fb6965af9756 service nova] Creating event network-vif-deleted:8e3c2050-0798-4c5e-9af5-1cfbf9783ef1 for instance b8a95c5f-658f-4a48-97c8-8786b3e9de1a on n-h2-860892-1 Oct 11 04:25:46.259584 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-52c6b9e0-0924-4bf7-90b3-c5725f346177 req-4297c8c8-3bba-4a68-8918-fb6965af9756 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091810 Oct 11 04:25:46.261140 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1652/3468] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:46.267908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8a97813-9dc6-4cfd-9437-2245e5fe577f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:46.269195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8a97813-9dc6-4cfd-9437-2245e5fe577f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:46.277517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8a97813-9dc6-4cfd-9437-2245e5fe577f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:46.278257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8a97813-9dc6-4cfd-9437-2245e5fe577f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:46.278996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8a97813-9dc6-4cfd-9437-2245e5fe577f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:46.280816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8a97813-9dc6-4cfd-9437-2245e5fe577f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:46.281444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8a97813-9dc6-4cfd-9437-2245e5fe577f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:46.282032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8a97813-9dc6-4cfd-9437-2245e5fe577f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:46.904881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8a97813-9dc6-4cfd-9437-2245e5fe577f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:46.914669 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e8a97813-9dc6-4cfd-9437-2245e5fe577f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1308 microversion: 2.1 time: 0.651665 Oct 11 04:25:46.936192 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1653/3469] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:46 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1308 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:46.941983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6022bc19-bbd7-463c-8230-42677f725d56 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:46.957506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6022bc19-bbd7-463c-8230-42677f725d56 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:46.972285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6022bc19-bbd7-463c-8230-42677f725d56 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:46.973075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6022bc19-bbd7-463c-8230-42677f725d56 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:46.973688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6022bc19-bbd7-463c-8230-42677f725d56 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:46.974471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6022bc19-bbd7-463c-8230-42677f725d56 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:46.974922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6022bc19-bbd7-463c-8230-42677f725d56 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:46.975509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6022bc19-bbd7-463c-8230-42677f725d56 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:47.249261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6022bc19-bbd7-463c-8230-42677f725d56 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:47.260961 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6022bc19-bbd7-463c-8230-42677f725d56 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.322752 Oct 11 04:25:47.262098 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1654/3470] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:46 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:47.282669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:47.283671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] [instance: b8a95c5f-658f-4a48-97c8-8786b3e9de1a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:47.291005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:47.292652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:47.293317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:47.294215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:47.294831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:47.295436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:47.313712 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] HTTP exception thrown: Instance b8a95c5f-658f-4a48-97c8-8786b3e9de1a could not be found. Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Request method failure captured: Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a HTTP/1.1 Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_iiEMfwa9bYQXB9zIlPrErOVS4a71CQTCTxVDNGitzFESZK8uAdSkP3SUqFk7qiC1HVnxQDlPKQxE889ESL68AnyRjKTwSnrYpgXYapn0Nj4zAeUmUUC0ad79gmk38lNhiUDtNRpa4I-qqAHrxmtldlL7xgtxT2NnQc7FF3uRh9_U Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5a9d56ebae03424f9f9892abf32b7579"}]}] Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5a9d56ebae03424f9f9892abf32b7579 Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-SecurityGroupsTestJSON-1622719869 Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 47f8ee8bc00840c99abafb15e9d32b84 Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-SecurityGroupsTestJSON-1622719869-project Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance b8a95c5f-658f-4a48-97c8-8786b3e9de1a could not be found. Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'b8a95c5f-658f-4a48-97c8-8786b3e9de1a'} Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8a95c5f-658f-4a48-97c8-8786b3e9de1a could not be found. Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8a95c5f-658f-4a48-97c8-8786b3e9de1a could not be found. Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:47.315675 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:47.324058 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:47.324058 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:47.324058 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:47.324058 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:47.324058 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:47.324058 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8a95c5f-658f-4a48-97c8-8786b3e9de1a could not be found. Oct 11 04:25:47.324058 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:47.324058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Returning 404 to user: Instance b8a95c5f-658f-4a48-97c8-8786b3e9de1a could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:47.324058 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2ccb3643-1581-450d-97d1-9ae13e3fb357 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a" status: 404 len: 111 microversion: 2.1 time: 0.053824 Oct 11 04:25:47.324058 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1655/3471] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:47 2022] GET /compute/v2.1/servers/b8a95c5f-658f-4a48-97c8-8786b3e9de1a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:25:47.329987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:47.330714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:47.342860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:47.343398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:47.344080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:47.345007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:47.345537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:47.346037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:47.542872 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-69bc898a-84da-46af-9742-0cb397b59705 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/action" status: 202 len: 0 microversion: 2.1 time: 6.426621 Oct 11 04:25:47.543426 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1817/3472] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:25:41 2022] POST /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/action => generated 0 bytes in 6428 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:25:47.548441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48d42466-52fc-4854-b9ac-68eb5742fccf tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda1df6ae50>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:47.664164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:47.675005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:47.676911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:47.678399 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f8d172d9-bd27-40b0-a278-a88ea2d73794 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.356257 Oct 11 04:25:47.679282 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1656/3473] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:47 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:47.694417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3585ac9-e321-455c-b9ba-a331c49e7fa8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:47.695287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3585ac9-e321-455c-b9ba-a331c49e7fa8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:47.702479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3585ac9-e321-455c-b9ba-a331c49e7fa8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:47.703272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3585ac9-e321-455c-b9ba-a331c49e7fa8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:47.703706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3585ac9-e321-455c-b9ba-a331c49e7fa8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:47.704418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3585ac9-e321-455c-b9ba-a331c49e7fa8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:47.704868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3585ac9-e321-455c-b9ba-a331c49e7fa8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:47.705463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3585ac9-e321-455c-b9ba-a331c49e7fa8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:48.055850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a3585ac9-e321-455c-b9ba-a331c49e7fa8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:48.055850 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3585ac9-e321-455c-b9ba-a331c49e7fa8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.294361 Oct 11 04:25:48.055850 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1657/3474] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:47 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:48.055850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c1d30278-c2dd-41cc-83a2-47a63422178a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:48.055850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c1d30278-c2dd-41cc-83a2-47a63422178a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:48.055850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d30278-c2dd-41cc-83a2-47a63422178a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:48.055850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d30278-c2dd-41cc-83a2-47a63422178a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:48.055850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d30278-c2dd-41cc-83a2-47a63422178a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:48.055850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d30278-c2dd-41cc-83a2-47a63422178a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:48.055850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d30278-c2dd-41cc-83a2-47a63422178a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:48.055850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d30278-c2dd-41cc-83a2-47a63422178a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:48.176988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c1d30278-c2dd-41cc-83a2-47a63422178a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:48.185298 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c1d30278-c2dd-41cc-83a2-47a63422178a tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1489 microversion: 2.1 time: 0.201999 Oct 11 04:25:48.185860 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1658/3475] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:47 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1489 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:48.214666 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48d42466-52fc-4854-b9ac-68eb5742fccf tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/73edb22e-cc6c-411a-ad29-bfe822d30ea2" status: 202 len: 0 microversion: 2.1 time: 0.669761 Oct 11 04:25:48.215526 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1818/3476] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:47 2022] DELETE /compute/v2.1/os-security-groups/73edb22e-cc6c-411a-ad29-bfe822d30ea2 => generated 0 bytes in 671 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:25:48.228508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9dd62516-8b9c-4533-b543-d877ec00af37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] Calling method '.version_select at 0x7fda19b73ee0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:48.236152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3af55956-6a30-468a-bd4f-44d446d87d64 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-956582510"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:48.240136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3af55956-6a30-468a-bd4f-44d446d87d64 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:48.249451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af55956-6a30-468a-bd4f-44d446d87d64 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:48.250064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af55956-6a30-468a-bd4f-44d446d87d64 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:48.250490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af55956-6a30-468a-bd4f-44d446d87d64 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:48.251203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af55956-6a30-468a-bd4f-44d446d87d64 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:48.251687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af55956-6a30-468a-bd4f-44d446d87d64 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:48.252118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af55956-6a30-468a-bd4f-44d446d87d64 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:48.836115 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3af55956-6a30-468a-bd4f-44d446d87d64 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "POST /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008/action" status: 202 len: 0 microversion: 2.1 time: 0.619773 Oct 11 04:25:48.840880 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1659/3477] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:25:48 2022] POST /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008/action => generated 0 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 04:25:48.852679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a453144a-8ecc-4ea4-a98c-af7426f68c83 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:48.856793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a453144a-8ecc-4ea4-a98c-af7426f68c83 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:48.875401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a453144a-8ecc-4ea4-a98c-af7426f68c83 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:48.876858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a453144a-8ecc-4ea4-a98c-af7426f68c83 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:48.878741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a453144a-8ecc-4ea4-a98c-af7426f68c83 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:48.884808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a453144a-8ecc-4ea4-a98c-af7426f68c83 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:48.884808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a453144a-8ecc-4ea4-a98c-af7426f68c83 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:48.884808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a453144a-8ecc-4ea4-a98c-af7426f68c83 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:49.058747 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9dd62516-8b9c-4533-b543-d877ec00af37 tempest-SecurityGroupsTestJSON-1622719869 tempest-SecurityGroupsTestJSON-1622719869-project] 10.222.0.26 "DELETE /compute/v2.1/os-security-groups/2d8a00e5-f869-48b1-96d2-fa604f9cd45e" status: 202 len: 0 microversion: 2.1 time: 0.838510 Oct 11 04:25:49.060662 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1819/3478] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:25:48 2022] DELETE /compute/v2.1/os-security-groups/2d8a00e5-f869-48b1-96d2-fa604f9cd45e => generated 0 bytes in 841 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:25:49.068112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:49.068827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:49.097705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:49.097705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:49.097705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:49.097705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:49.098724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:49.099489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:49.400324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a453144a-8ecc-4ea4-a98c-af7426f68c83 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:49.412483 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a453144a-8ecc-4ea4-a98c-af7426f68c83 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.569982 Oct 11 04:25:49.413077 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1660/3479] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:48 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:49.437582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bbcaaef4-3df7-4659-a409-ce5773088437 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19b5d310>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:49.514473 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bbcaaef4-3df7-4659-a409-ce5773088437 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a" status: 200 len: 1413 microversion: 2.1 time: 0.078416 Oct 11 04:25:49.538359 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1661/3480] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:25:49 2022] GET /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a => generated 1413 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:49.549242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7cf48379-27e8-4747-b3cc-10896e372aa1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:49.549874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7cf48379-27e8-4747-b3cc-10896e372aa1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:49.584356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:49.598501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7cf48379-27e8-4747-b3cc-10896e372aa1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:49.599693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7cf48379-27e8-4747-b3cc-10896e372aa1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:49.599944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7cf48379-27e8-4747-b3cc-10896e372aa1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:49.600662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7cf48379-27e8-4747-b3cc-10896e372aa1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:49.601124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7cf48379-27e8-4747-b3cc-10896e372aa1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:49.601555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7cf48379-27e8-4747-b3cc-10896e372aa1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:49.604217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:49.605684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:49.608926 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4339e9e1-dc27-4932-a5e9-070d018982b7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.547086 Oct 11 04:25:49.611232 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1820/3481] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:49 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:49.634242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a186a928-d7aa-4b16-bddc-b49b8ebdeeaf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19e340d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:49.731759 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a186a928-d7aa-4b16-bddc-b49b8ebdeeaf tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a" status: 200 len: 1413 microversion: 2.1 time: 0.101440 Oct 11 04:25:49.732885 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1821/3482] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:25:49 2022] GET /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a => generated 1413 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:49.754311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d42665b5-61e4-4fb4-9b25-ca8e73b47653 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1a0594c0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:49.916936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7cf48379-27e8-4747-b3cc-10896e372aa1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:49.927888 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7cf48379-27e8-4747-b3cc-10896e372aa1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.388202 Oct 11 04:25:49.943800 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1662/3483] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:49 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:50.190480 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d42665b5-61e4-4fb4-9b25-ca8e73b47653 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a" status: 204 len: 0 microversion: 2.1 time: 0.440942 Oct 11 04:25:50.190480 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1822/3484] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:49 2022] DELETE /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:25:50.205124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75762382-e4bf-42fb-abf3-6258cbb3e835 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda19b4d8b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:50.233738 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-75762382-e4bf-42fb-abf3-6258cbb3e835 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Image not found. Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75762382-e4bf-42fb-abf3-6258cbb3e835 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a HTTP/1.1 Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '89f71216-a6be-4edc-8143-2092b61e022a'} Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: No image found with ID 89f71216-a6be-4edc-8143-2092b61e022a Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 86, in show Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._image_api.get(context, id) Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1205, in get Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.show(context, image_id, Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 287, in show Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _reraise_translated_image_exception(image_id) Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1031, in _reraise_translated_image_exception Oct 11 04:25:50.236959 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise new_exc.with_traceback(exc_trace) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 285, in show Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi image = self._client.call(context, 2, 'get', args=(image_id,)) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 197, in get Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get(image_id) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 190, in _get Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.get(url, headers=header) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 395, in get Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'GET', **kwargs) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 89f71216-a6be-4edc-8143-2092b61e022a could not be found. Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 89, in show Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75762382-e4bf-42fb-abf3-6258cbb3e835 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-75762382-e4bf-42fb-abf3-6258cbb3e835 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a" status: 404 len: 62 microversion: 2.1 time: 0.046150 Oct 11 04:25:50.246997 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1663/3485] 10.222.0.26 () {58 vars in 1233 bytes} [Tue Oct 11 04:25:50 2022] GET /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:25:50.251307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80656602-8a38-4710-b491-66123364b63f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:50.252029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-80656602-8a38-4710-b491-66123364b63f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:50.254181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:50.270307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80656602-8a38-4710-b491-66123364b63f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:50.273856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80656602-8a38-4710-b491-66123364b63f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:50.276326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80656602-8a38-4710-b491-66123364b63f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:50.279850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80656602-8a38-4710-b491-66123364b63f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:50.280653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80656602-8a38-4710-b491-66123364b63f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:50.281167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80656602-8a38-4710-b491-66123364b63f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:50.440622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-79e33032-54c9-46dc-902a-72678ac35671 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:50.441639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-79e33032-54c9-46dc-902a-72678ac35671 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:50.458046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79e33032-54c9-46dc-902a-72678ac35671 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:50.459245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79e33032-54c9-46dc-902a-72678ac35671 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:50.459691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79e33032-54c9-46dc-902a-72678ac35671 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:50.460471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79e33032-54c9-46dc-902a-72678ac35671 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:50.462020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79e33032-54c9-46dc-902a-72678ac35671 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:50.462573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79e33032-54c9-46dc-902a-72678ac35671 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:50.502664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:50.669639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-79e33032-54c9-46dc-902a-72678ac35671 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:50.679512 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-79e33032-54c9-46dc-902a-72678ac35671 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.242727 Oct 11 04:25:50.680302 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1664/3486] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:50 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:50.690097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:50.690806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:50.701629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:50.702092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80656602-8a38-4710-b491-66123364b63f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:50.705693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:50.705693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:50.705693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:50.705693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:50.705693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:50.733059 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-80656602-8a38-4710-b491-66123364b63f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1501 microversion: 2.1 time: 0.487787 Oct 11 04:25:50.736439 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1823/3487] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:50 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1501 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:50.965789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-75b93ee3-1148-4cd1-8465-aecab6a005be tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:50.965789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-75b93ee3-1148-4cd1-8465-aecab6a005be tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:50.977717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75b93ee3-1148-4cd1-8465-aecab6a005be tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:50.978218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75b93ee3-1148-4cd1-8465-aecab6a005be tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:50.978686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75b93ee3-1148-4cd1-8465-aecab6a005be tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:50.979402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75b93ee3-1148-4cd1-8465-aecab6a005be tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:50.984815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75b93ee3-1148-4cd1-8465-aecab6a005be tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:50.985371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75b93ee3-1148-4cd1-8465-aecab6a005be tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:51.184403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:51.199962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:51.206279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:51.210537 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-48f367e4-4937-4504-801d-8bdbfc8f50b6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.529021 Oct 11 04:25:51.232120 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1665/3488] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:50 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:51.394324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-75b93ee3-1148-4cd1-8465-aecab6a005be tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:51.405006 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-75b93ee3-1148-4cd1-8465-aecab6a005be tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.452455 Oct 11 04:25:51.407979 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1824/3489] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:50 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:25:51.705007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-15837ed5-0d8f-45b7-a78f-3983587e9fc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:51.705626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-15837ed5-0d8f-45b7-a78f-3983587e9fc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:51.720653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15837ed5-0d8f-45b7-a78f-3983587e9fc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:51.720653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15837ed5-0d8f-45b7-a78f-3983587e9fc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:51.721104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15837ed5-0d8f-45b7-a78f-3983587e9fc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:51.729527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15837ed5-0d8f-45b7-a78f-3983587e9fc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:51.730238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15837ed5-0d8f-45b7-a78f-3983587e9fc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:51.737750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15837ed5-0d8f-45b7-a78f-3983587e9fc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:51.759693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-254e2cbe-28d1-43ac-8861-7a6dc9aad55b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:51.760310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-254e2cbe-28d1-43ac-8861-7a6dc9aad55b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:51.789399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e2cbe-28d1-43ac-8861-7a6dc9aad55b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:51.789969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e2cbe-28d1-43ac-8861-7a6dc9aad55b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:51.790451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e2cbe-28d1-43ac-8861-7a6dc9aad55b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:51.791205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e2cbe-28d1-43ac-8861-7a6dc9aad55b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:51.791661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e2cbe-28d1-43ac-8861-7a6dc9aad55b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:51.792083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e2cbe-28d1-43ac-8861-7a6dc9aad55b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:51.826923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:25:52.347325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-254e2cbe-28d1-43ac-8861-7a6dc9aad55b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:52.356326 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-254e2cbe-28d1-43ac-8861-7a6dc9aad55b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1507 microversion: 2.1 time: 0.601657 Oct 11 04:25:52.361258 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1825/3490] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:51 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1507 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:52.366756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:52.382774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:52.397889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:52.403211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:52.403916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:52.404890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:52.405554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:52.406225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:52.682836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-15837ed5-0d8f-45b7-a78f-3983587e9fc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:52.696902 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-15837ed5-0d8f-45b7-a78f-3983587e9fc7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.995632 Oct 11 04:25:52.699195 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1666/3491] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:51 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 999 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:52.712606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f37c834e-81ca-4aaf-8b8f-e856af7e0b15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:52.715598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f37c834e-81ca-4aaf-8b8f-e856af7e0b15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:52.746896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37c834e-81ca-4aaf-8b8f-e856af7e0b15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:52.747657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37c834e-81ca-4aaf-8b8f-e856af7e0b15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:52.749204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37c834e-81ca-4aaf-8b8f-e856af7e0b15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:52.750945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37c834e-81ca-4aaf-8b8f-e856af7e0b15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:52.754466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37c834e-81ca-4aaf-8b8f-e856af7e0b15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:52.757140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37c834e-81ca-4aaf-8b8f-e856af7e0b15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:52.855591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:52.870746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:52.877238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:52.880963 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6dfc499a-b85b-4c30-b068-5caf8350d582 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.518187 Oct 11 04:25:52.882844 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1826/3492] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:52 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:53.243989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f37c834e-81ca-4aaf-8b8f-e856af7e0b15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:53.254144 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f37c834e-81ca-4aaf-8b8f-e856af7e0b15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.551418 Oct 11 04:25:53.259188 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1667/3493] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:52 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:53.390527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-caf1eb9a-9223-45e5-bf74-27be12bf7d1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:53.391178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-caf1eb9a-9223-45e5-bf74-27be12bf7d1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:53.403740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf1eb9a-9223-45e5-bf74-27be12bf7d1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:53.404276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf1eb9a-9223-45e5-bf74-27be12bf7d1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:53.404619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf1eb9a-9223-45e5-bf74-27be12bf7d1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:53.405340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf1eb9a-9223-45e5-bf74-27be12bf7d1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:53.405798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf1eb9a-9223-45e5-bf74-27be12bf7d1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:53.417104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf1eb9a-9223-45e5-bf74-27be12bf7d1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:53.659590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-caf1eb9a-9223-45e5-bf74-27be12bf7d1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:53.670270 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-caf1eb9a-9223-45e5-bf74-27be12bf7d1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1507 microversion: 2.1 time: 0.283154 Oct 11 04:25:53.671820 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1827/3494] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:53 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1507 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:25:53.726534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-48eb1668-9aab-4cd7-a869-0199d327cce2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:53.728837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-48eb1668-9aab-4cd7-a869-0199d327cce2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:53.747695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48eb1668-9aab-4cd7-a869-0199d327cce2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:53.748321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48eb1668-9aab-4cd7-a869-0199d327cce2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:53.748621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48eb1668-9aab-4cd7-a869-0199d327cce2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:53.749437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48eb1668-9aab-4cd7-a869-0199d327cce2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:53.749780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48eb1668-9aab-4cd7-a869-0199d327cce2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:53.757392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48eb1668-9aab-4cd7-a869-0199d327cce2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:53.909126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:53.909739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:53.932905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:53.933397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:53.933840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:53.934683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:53.935207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:53.935637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:54.447609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48eb1668-9aab-4cd7-a869-0199d327cce2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:54.462703 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-48eb1668-9aab-4cd7-a869-0199d327cce2 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.742142 Oct 11 04:25:54.467631 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1668/3495] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:53 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:54.482555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8b15b701-490a-458f-8528-d83bd4a44241 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:54.484106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8b15b701-490a-458f-8528-d83bd4a44241 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:54.499089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b15b701-490a-458f-8528-d83bd4a44241 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:54.499611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b15b701-490a-458f-8528-d83bd4a44241 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:54.500045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b15b701-490a-458f-8528-d83bd4a44241 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:54.500758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b15b701-490a-458f-8528-d83bd4a44241 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:54.506419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b15b701-490a-458f-8528-d83bd4a44241 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:54.506419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8b15b701-490a-458f-8528-d83bd4a44241 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:54.514528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:54.544696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:54.553440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:54.559798 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5401279e-583c-44c8-afa9-84b2cea9342b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.650371 Oct 11 04:25:54.560974 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1828/3496] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:53 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:25:54.699540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b31bd7bf-f91e-4c8b-a310-cf07398318d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:54.700623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b31bd7bf-f91e-4c8b-a310-cf07398318d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:54.714442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b31bd7bf-f91e-4c8b-a310-cf07398318d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:54.721147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b31bd7bf-f91e-4c8b-a310-cf07398318d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:54.721607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b31bd7bf-f91e-4c8b-a310-cf07398318d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:54.722378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b31bd7bf-f91e-4c8b-a310-cf07398318d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:54.722831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b31bd7bf-f91e-4c8b-a310-cf07398318d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:54.723262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b31bd7bf-f91e-4c8b-a310-cf07398318d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:54.984347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b31bd7bf-f91e-4c8b-a310-cf07398318d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:54.997517 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b31bd7bf-f91e-4c8b-a310-cf07398318d9 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1502 microversion: 2.1 time: 0.303204 Oct 11 04:25:55.003907 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1829/3497] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:54 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1502 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:55.428667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8b15b701-490a-458f-8528-d83bd4a44241 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:55.443896 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8b15b701-490a-458f-8528-d83bd4a44241 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.973195 Oct 11 04:25:55.444799 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1669/3498] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:54 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:55.495531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c4233dd6-70d1-43c1-a75c-1f613c19af98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:55.496153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c4233dd6-70d1-43c1-a75c-1f613c19af98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:55.507882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4233dd6-70d1-43c1-a75c-1f613c19af98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:55.524084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4233dd6-70d1-43c1-a75c-1f613c19af98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:55.528527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4233dd6-70d1-43c1-a75c-1f613c19af98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:55.529365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4233dd6-70d1-43c1-a75c-1f613c19af98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:55.529855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4233dd6-70d1-43c1-a75c-1f613c19af98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:55.530325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4233dd6-70d1-43c1-a75c-1f613c19af98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:55.582532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c2c6f518-0645-4bc7-acce-2e4e75fff743 req-9a14351d-9cd9-4306-9205-ca9e143980d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd51069-301e-4fab-9e1b-64f7f8615008", "name": "network-vif-plugged", "status": "completed", "tag": "7b302a98-918e-4fac-8540-baba09828a78"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:55.600240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c2c6f518-0645-4bc7-acce-2e4e75fff743 req-9a14351d-9cd9-4306-9205-ca9e143980d9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:55.626796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c2c6f518-0645-4bc7-acce-2e4e75fff743 req-9a14351d-9cd9-4306-9205-ca9e143980d9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.027s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:55.627654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c2c6f518-0645-4bc7-acce-2e4e75fff743 req-9a14351d-9cd9-4306-9205-ca9e143980d9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:55.649903 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c2c6f518-0645-4bc7-acce-2e4e75fff743 req-9a14351d-9cd9-4306-9205-ca9e143980d9 service nova] Creating event network-vif-plugged:7b302a98-918e-4fac-8540-baba09828a78 for instance ecd51069-301e-4fab-9e1b-64f7f8615008 on n-h1-860892-1 Oct 11 04:25:55.673457 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c2c6f518-0645-4bc7-acce-2e4e75fff743 req-9a14351d-9cd9-4306-9205-ca9e143980d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079440 Oct 11 04:25:55.680310 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1670/3499] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:25:55.701311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:55.706325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:55.737114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:55.737877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:55.738553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:55.740442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:55.745656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:55.749457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:55.988467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c4233dd6-70d1-43c1-a75c-1f613c19af98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:55.996961 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c4233dd6-70d1-43c1-a75c-1f613c19af98 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.505870 Oct 11 04:25:55.997554 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1830/3500] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:55 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:56.029273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eaf39a80-4b33-4458-b7f1-967c4576b16d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:56.030099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eaf39a80-4b33-4458-b7f1-967c4576b16d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:56.043191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaf39a80-4b33-4458-b7f1-967c4576b16d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:56.043918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaf39a80-4b33-4458-b7f1-967c4576b16d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:56.044543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaf39a80-4b33-4458-b7f1-967c4576b16d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:56.049999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaf39a80-4b33-4458-b7f1-967c4576b16d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:56.050838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaf39a80-4b33-4458-b7f1-967c4576b16d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:56.058229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaf39a80-4b33-4458-b7f1-967c4576b16d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:56.321561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eaf39a80-4b33-4458-b7f1-967c4576b16d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:56.330222 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eaf39a80-4b33-4458-b7f1-967c4576b16d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1489 microversion: 2.1 time: 0.306391 Oct 11 04:25:56.335790 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1831/3501] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:56 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1489 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:56.354565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e5c909d-92d4-41a2-b860-ad73c96ba190 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:56.354911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e5c909d-92d4-41a2-b860-ad73c96ba190 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:56.361892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5c909d-92d4-41a2-b860-ad73c96ba190 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:56.362622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5c909d-92d4-41a2-b860-ad73c96ba190 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:56.363231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5c909d-92d4-41a2-b860-ad73c96ba190 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:56.364207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5c909d-92d4-41a2-b860-ad73c96ba190 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:56.365365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5c909d-92d4-41a2-b860-ad73c96ba190 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:56.365958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e5c909d-92d4-41a2-b860-ad73c96ba190 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:56.399462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e5c909d-92d4-41a2-b860-ad73c96ba190 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:25:56.556460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:56.566458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:56.568457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:56.570285 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef71b717-824f-42c4-8e28-5876aad38ab6 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.888695 Oct 11 04:25:56.570865 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1671/3502] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:55 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:56.575982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-098977e2-6ff2-423e-81b2-eaa419dbf727 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:56.577088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-098977e2-6ff2-423e-81b2-eaa419dbf727 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:56.584318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-098977e2-6ff2-423e-81b2-eaa419dbf727 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:56.585167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-098977e2-6ff2-423e-81b2-eaa419dbf727 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:56.585820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-098977e2-6ff2-423e-81b2-eaa419dbf727 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:56.586846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-098977e2-6ff2-423e-81b2-eaa419dbf727 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:56.587534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-098977e2-6ff2-423e-81b2-eaa419dbf727 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:56.588180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-098977e2-6ff2-423e-81b2-eaa419dbf727 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:56.935696 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e5c909d-92d4-41a2-b860-ad73c96ba190 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 204 len: 0 microversion: 2.1 time: 0.584947 Oct 11 04:25:56.950062 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1832/3503] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:25:56 2022] DELETE /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 0 bytes in 587 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:25:56.987162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dfa24155-e6a3-4ab7-9fe5-5be88462bce4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1dfc6820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:57.015363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-098977e2-6ff2-423e-81b2-eaa419dbf727 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:57.044673 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-098977e2-6ff2-423e-81b2-eaa419dbf727 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.469246 Oct 11 04:25:57.046316 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1672/3504] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:56 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-dfa24155-e6a3-4ab7-9fe5-5be88462bce4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Image not found. Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dfa24155-e6a3-4ab7-9fe5-5be88462bce4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a HTTP/1.1 Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: exception: Image not found. Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '89f71216-a6be-4edc-8143-2092b61e022a'} Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 89f71216-a6be-4edc-8143-2092b61e022a to delete Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 89f71216-a6be-4edc-8143-2092b61e022a could not be found. Oct 11 04:25:57.052533 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dfa24155-e6a3-4ab7-9fe5-5be88462bce4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Image not found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dfa24155-e6a3-4ab7-9fe5-5be88462bce4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a" status: 404 len: 62 microversion: 2.1 time: 0.099510 Oct 11 04:25:57.056960 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1833/3505] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:56 2022] DELETE /compute/v2.1/images/89f71216-a6be-4edc-8143-2092b61e022a => generated 62 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:25:57.062928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c0e8c370-6dbd-47dc-894f-fbd7be7be4a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:57.063617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c0e8c370-6dbd-47dc-894f-fbd7be7be4a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:57.070542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8079dd6a-290b-4aec-87ea-da39190581c8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:57.072727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8079dd6a-290b-4aec-87ea-da39190581c8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:57.092581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8079dd6a-290b-4aec-87ea-da39190581c8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:57.092581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8079dd6a-290b-4aec-87ea-da39190581c8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:57.092771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0e8c370-6dbd-47dc-894f-fbd7be7be4a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:57.092771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0e8c370-6dbd-47dc-894f-fbd7be7be4a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:57.092771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0e8c370-6dbd-47dc-894f-fbd7be7be4a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:57.092997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0e8c370-6dbd-47dc-894f-fbd7be7be4a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:57.093304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0e8c370-6dbd-47dc-894f-fbd7be7be4a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:57.093731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0e8c370-6dbd-47dc-894f-fbd7be7be4a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:57.095256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8079dd6a-290b-4aec-87ea-da39190581c8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:57.096308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8079dd6a-290b-4aec-87ea-da39190581c8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:57.100203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8079dd6a-290b-4aec-87ea-da39190581c8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:57.100924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8079dd6a-290b-4aec-87ea-da39190581c8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:57.165352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8079dd6a-290b-4aec-87ea-da39190581c8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:25:57.339767 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.api [None req-8079dd6a-290b-4aec-87ea-da39190581c8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Instance is already in deleting state, ignoring this request Oct 11 04:25:57.340906 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8079dd6a-290b-4aec-87ea-da39190581c8 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 204 len: 0 microversion: 2.1 time: 0.276088 Oct 11 04:25:57.346588 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1834/3506] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:25:57 2022] DELETE /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:25:57.356950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1fff1c35-61c6-4563-bc5f-0d70e2a180c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:57.357811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1fff1c35-61c6-4563-bc5f-0d70e2a180c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:57.375335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fff1c35-61c6-4563-bc5f-0d70e2a180c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:57.376254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fff1c35-61c6-4563-bc5f-0d70e2a180c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:57.376930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fff1c35-61c6-4563-bc5f-0d70e2a180c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:57.381382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fff1c35-61c6-4563-bc5f-0d70e2a180c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:57.384712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fff1c35-61c6-4563-bc5f-0d70e2a180c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:57.385461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fff1c35-61c6-4563-bc5f-0d70e2a180c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:57.480215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c0e8c370-6dbd-47dc-894f-fbd7be7be4a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:57.491515 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c0e8c370-6dbd-47dc-894f-fbd7be7be4a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.443974 Oct 11 04:25:57.501199 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1673/3507] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:57 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:57.602029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:57.602728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:57.618350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:57.624348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:57.626072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:57.631039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:57.633178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:57.634021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:57.765748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1fff1c35-61c6-4563-bc5f-0d70e2a180c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:57.786545 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1fff1c35-61c6-4563-bc5f-0d70e2a180c7 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1495 microversion: 2.1 time: 0.434697 Oct 11 04:25:57.799324 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1835/3508] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:57 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1495 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:25:57.993027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:58.005714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:58.008181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:58.011138 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7bc1ff40-04b6-4c2b-9ace-e9d95ea19d77 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.412475 Oct 11 04:25:58.012991 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1674/3509] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:57 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:58.084349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a0b3e1c9-e073-44d7-b541-53037fdbb019 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:58.085396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a0b3e1c9-e073-44d7-b541-53037fdbb019 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:58.098511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0b3e1c9-e073-44d7-b541-53037fdbb019 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:58.099038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0b3e1c9-e073-44d7-b541-53037fdbb019 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:58.099461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0b3e1c9-e073-44d7-b541-53037fdbb019 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:58.100180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0b3e1c9-e073-44d7-b541-53037fdbb019 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:58.100639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0b3e1c9-e073-44d7-b541-53037fdbb019 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:58.101067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0b3e1c9-e073-44d7-b541-53037fdbb019 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:58.525189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eb3845eb-b4e6-41cd-9232-846ada02c964 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:58.525815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eb3845eb-b4e6-41cd-9232-846ada02c964 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:58.550544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3845eb-b4e6-41cd-9232-846ada02c964 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:58.551535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3845eb-b4e6-41cd-9232-846ada02c964 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:58.552160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3845eb-b4e6-41cd-9232-846ada02c964 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:58.553093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3845eb-b4e6-41cd-9232-846ada02c964 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:58.553714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3845eb-b4e6-41cd-9232-846ada02c964 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:58.554408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3845eb-b4e6-41cd-9232-846ada02c964 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:58.917773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eb3845eb-b4e6-41cd-9232-846ada02c964 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:58.928994 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eb3845eb-b4e6-41cd-9232-846ada02c964 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.409398 Oct 11 04:25:58.929583 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1675/3510] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:58 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:58.947845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7c5fecf3-61f9-4a12-828d-c5980926378e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:58.955021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7c5fecf3-61f9-4a12-828d-c5980926378e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:58.969577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c5fecf3-61f9-4a12-828d-c5980926378e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:58.970070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c5fecf3-61f9-4a12-828d-c5980926378e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:58.971779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c5fecf3-61f9-4a12-828d-c5980926378e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:58.971779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c5fecf3-61f9-4a12-828d-c5980926378e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:58.971779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c5fecf3-61f9-4a12-828d-c5980926378e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:58.972069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c5fecf3-61f9-4a12-828d-c5980926378e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:59.258245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a0b3e1c9-e073-44d7-b541-53037fdbb019 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:59.274985 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a0b3e1c9-e073-44d7-b541-53037fdbb019 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 1.192918 Oct 11 04:25:59.288841 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1836/3511] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:58 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:59.310584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:59.311267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:59.328597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:59.329267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:59.333008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:59.335718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:59.337324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:59.340526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:59.520799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7c5fecf3-61f9-4a12-828d-c5980926378e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:59.538683 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7c5fecf3-61f9-4a12-828d-c5980926378e tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1495 microversion: 2.1 time: 0.590091 Oct 11 04:25:59.540079 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1676/3512] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:58 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1495 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:25:59.597020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-32bf8880-a542-4ddf-b989-aba1d23cd0af req-2fee5878-f3a3-4c51-865c-ec1feb3b270f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd51069-301e-4fab-9e1b-64f7f8615008", "name": "network-vif-unplugged", "status": "completed", "tag": "7b302a98-918e-4fac-8540-baba09828a78"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:25:59.618818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-32bf8880-a542-4ddf-b989-aba1d23cd0af req-2fee5878-f3a3-4c51-865c-ec1feb3b270f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:59.619624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-32bf8880-a542-4ddf-b989-aba1d23cd0af req-2fee5878-f3a3-4c51-865c-ec1feb3b270f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:59.621140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-32bf8880-a542-4ddf-b989-aba1d23cd0af req-2fee5878-f3a3-4c51-865c-ec1feb3b270f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:59.643718 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-32bf8880-a542-4ddf-b989-aba1d23cd0af req-2fee5878-f3a3-4c51-865c-ec1feb3b270f service nova] Creating event network-vif-unplugged:7b302a98-918e-4fac-8540-baba09828a78 for instance ecd51069-301e-4fab-9e1b-64f7f8615008 on n-h1-860892-1 Oct 11 04:25:59.663613 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-32bf8880-a542-4ddf-b989-aba1d23cd0af req-2fee5878-f3a3-4c51-865c-ec1feb3b270f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071480 Oct 11 04:25:59.666767 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1677/3513] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:25:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:25:59.874219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:59.889907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:59.891435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:25:59.892601 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9dbd63e5-1fff-4920-b517-e3d9512514a3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.602414 Oct 11 04:25:59.899241 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1837/3514] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:25:59 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:25:59.955653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c9a5e059-cce9-4296-8503-f3b104a65e58 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:25:59.967185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c9a5e059-cce9-4296-8503-f3b104a65e58 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:25:59.974445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a5e059-cce9-4296-8503-f3b104a65e58 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:59.976544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a5e059-cce9-4296-8503-f3b104a65e58 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:59.978285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a5e059-cce9-4296-8503-f3b104a65e58 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:25:59.980036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a5e059-cce9-4296-8503-f3b104a65e58 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:25:59.982623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a5e059-cce9-4296-8503-f3b104a65e58 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:25:59.984750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9a5e059-cce9-4296-8503-f3b104a65e58 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:00.309595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a5e8976-e410-4dbc-bb35-7f66887e16cb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:00.313771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2a5e8976-e410-4dbc-bb35-7f66887e16cb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:00.337027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a5e8976-e410-4dbc-bb35-7f66887e16cb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:00.338847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a5e8976-e410-4dbc-bb35-7f66887e16cb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:00.346896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a5e8976-e410-4dbc-bb35-7f66887e16cb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:00.348007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a5e8976-e410-4dbc-bb35-7f66887e16cb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:00.348515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a5e8976-e410-4dbc-bb35-7f66887e16cb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:00.348945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a5e8976-e410-4dbc-bb35-7f66887e16cb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:00.371976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c9a5e059-cce9-4296-8503-f3b104a65e58 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:00.384624 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c9a5e059-cce9-4296-8503-f3b104a65e58 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.434936 Oct 11 04:26:00.385753 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1678/3515] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:25:59 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:00.438258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1e7cc257-1650-4377-a574-aae9f05017e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:00.440122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1e7cc257-1650-4377-a574-aae9f05017e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:00.460854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e7cc257-1650-4377-a574-aae9f05017e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:00.461349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e7cc257-1650-4377-a574-aae9f05017e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:00.461821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e7cc257-1650-4377-a574-aae9f05017e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:00.468029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e7cc257-1650-4377-a574-aae9f05017e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:00.468761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e7cc257-1650-4377-a574-aae9f05017e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:00.469049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e7cc257-1650-4377-a574-aae9f05017e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:01.001753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1e7cc257-1650-4377-a574-aae9f05017e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:01.011285 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1e7cc257-1650-4377-a574-aae9f05017e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.585073 Oct 11 04:26:01.021763 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1679/3516] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:00 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:01.026732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-086bebaf-291d-4208-ba42-ea5fd0cc8c8c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:01.029007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-086bebaf-291d-4208-ba42-ea5fd0cc8c8c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:01.040964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-086bebaf-291d-4208-ba42-ea5fd0cc8c8c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:01.042257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-086bebaf-291d-4208-ba42-ea5fd0cc8c8c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:01.043043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-086bebaf-291d-4208-ba42-ea5fd0cc8c8c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:01.051170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-086bebaf-291d-4208-ba42-ea5fd0cc8c8c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:01.055119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-086bebaf-291d-4208-ba42-ea5fd0cc8c8c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:01.055119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-086bebaf-291d-4208-ba42-ea5fd0cc8c8c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:01.186035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-086bebaf-291d-4208-ba42-ea5fd0cc8c8c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:01.197855 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-086bebaf-291d-4208-ba42-ea5fd0cc8c8c tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1453 microversion: 2.1 time: 0.174816 Oct 11 04:26:01.201787 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1680/3517] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:01 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1453 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:01.209884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:01.210858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:01.233935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:01.234590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:01.235029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:01.235920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:01.236542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:01.237144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:01.303146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2a5e8976-e410-4dbc-bb35-7f66887e16cb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:01.325213 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2a5e8976-e410-4dbc-bb35-7f66887e16cb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 1.027876 Oct 11 04:26:01.353866 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1838/3518] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:00 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 1057 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:01.376766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cfd7343e-7bbe-4280-8a08-ef3ebc41f42e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"createBackup": {"backup_type": "daily", "rotation": 2, "name": "tempest-backup-3-799079423"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:01.387752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cfd7343e-7bbe-4280-8a08-ef3ebc41f42e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:01.402827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfd7343e-7bbe-4280-8a08-ef3ebc41f42e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:01.404480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfd7343e-7bbe-4280-8a08-ef3ebc41f42e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:01.404956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfd7343e-7bbe-4280-8a08-ef3ebc41f42e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:01.407603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfd7343e-7bbe-4280-8a08-ef3ebc41f42e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:01.409723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfd7343e-7bbe-4280-8a08-ef3ebc41f42e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:01.410171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfd7343e-7bbe-4280-8a08-ef3ebc41f42e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:01.445845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:01.581870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:01.594658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:01.594987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:01.596361 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fd0d90d0-fa5a-4393-83d6-04b3e1ee337a tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.393287 Oct 11 04:26:01.596924 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1681/3519] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:01 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:26:01.615415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-b7992a58-6bf2-458f-8d95-141b34001ff1 req-c02912a9-8224-43f8-97a0-ce71d9b25739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecd51069-301e-4fab-9e1b-64f7f8615008", "name": "network-vif-deleted", "tag": "7b302a98-918e-4fac-8540-baba09828a78"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:01.635472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b7992a58-6bf2-458f-8d95-141b34001ff1 req-c02912a9-8224-43f8-97a0-ce71d9b25739 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:01.636178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b7992a58-6bf2-458f-8d95-141b34001ff1 req-c02912a9-8224-43f8-97a0-ce71d9b25739 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:01.636931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b7992a58-6bf2-458f-8d95-141b34001ff1 req-c02912a9-8224-43f8-97a0-ce71d9b25739 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:01.649833 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-b7992a58-6bf2-458f-8d95-141b34001ff1 req-c02912a9-8224-43f8-97a0-ce71d9b25739 service nova] Creating event network-vif-deleted:7b302a98-918e-4fac-8540-baba09828a78 for instance ecd51069-301e-4fab-9e1b-64f7f8615008 on n-h1-860892-1 Oct 11 04:26:01.656513 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-b7992a58-6bf2-458f-8d95-141b34001ff1 req-c02912a9-8224-43f8-97a0-ce71d9b25739 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058340 Oct 11 04:26:01.657548 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1682/3520] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:01.665756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92f58ff1-8bc7-4b83-89a4-77fe8d2c3130 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:01.665756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-92f58ff1-8bc7-4b83-89a4-77fe8d2c3130 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:01.672405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f58ff1-8bc7-4b83-89a4-77fe8d2c3130 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:01.673253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f58ff1-8bc7-4b83-89a4-77fe8d2c3130 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:01.673897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f58ff1-8bc7-4b83-89a4-77fe8d2c3130 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:01.674893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f58ff1-8bc7-4b83-89a4-77fe8d2c3130 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:01.675572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f58ff1-8bc7-4b83-89a4-77fe8d2c3130 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:01.676529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f58ff1-8bc7-4b83-89a4-77fe8d2c3130 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:01.683037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:01.916048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92f58ff1-8bc7-4b83-89a4-77fe8d2c3130 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:01.925978 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92f58ff1-8bc7-4b83-89a4-77fe8d2c3130 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.266803 Oct 11 04:26:01.927189 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1683/3521] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:01 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:02.138318 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cfd7343e-7bbe-4280-8a08-ef3ebc41f42e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.782232 Oct 11 04:26:02.142499 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1839/3522] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:26:01 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 456 bytes (1 switches on core 0) Oct 11 04:26:02.148446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ccef7f1e-91cc-49fb-9173-938fcf61ce16 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:02.149678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ccef7f1e-91cc-49fb-9173-938fcf61ce16 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:02.156907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef7f1e-91cc-49fb-9173-938fcf61ce16 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:02.157614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef7f1e-91cc-49fb-9173-938fcf61ce16 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:02.158249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef7f1e-91cc-49fb-9173-938fcf61ce16 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:02.159136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef7f1e-91cc-49fb-9173-938fcf61ce16 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:02.159582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef7f1e-91cc-49fb-9173-938fcf61ce16 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:02.160003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef7f1e-91cc-49fb-9173-938fcf61ce16 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:02.225590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:02.226672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:02.245943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:02.245943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:02.245943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:02.245943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:02.245943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:02.249770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:02.330126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:02.334090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:02.334821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:02.335706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lazy-loading 'fault' on Instance uuid ecd51069-301e-4fab-9e1b-64f7f8615008 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:26:02.380759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ccef7f1e-91cc-49fb-9173-938fcf61ce16 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:02.398303 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ccef7f1e-91cc-49fb-9173-938fcf61ce16 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.254014 Oct 11 04:26:02.401796 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1684/3523] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:02 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:02.417304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c6a023ed-ce4d-4268-9dcc-cec0b07f412a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:02.417986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c6a023ed-ce4d-4268-9dcc-cec0b07f412a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:02.432643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a023ed-ce4d-4268-9dcc-cec0b07f412a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:02.433417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a023ed-ce4d-4268-9dcc-cec0b07f412a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:02.434715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a023ed-ce4d-4268-9dcc-cec0b07f412a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:02.435945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a023ed-ce4d-4268-9dcc-cec0b07f412a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:02.436566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a023ed-ce4d-4268-9dcc-cec0b07f412a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:02.437143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a023ed-ce4d-4268-9dcc-cec0b07f412a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:02.447780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7ade698487d7495d9e10cd7ab92d62a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a50d14bbe2e4b71ac79bc37ac0ed812', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:02.462820 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f628f2be-5ae2-46c7-9ed6-e7aeb13964f4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 200 len: 1298 microversion: 2.1 time: 0.239827 Oct 11 04:26:02.472771 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1840/3524] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:02 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 1298 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:02.627956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:02.629375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:02.652939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:02.660094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:02.660094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:02.660094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:02.660094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:02.660094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:02.715018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c6a023ed-ce4d-4268-9dcc-cec0b07f412a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:02.736643 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c6a023ed-ce4d-4268-9dcc-cec0b07f412a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.332853 Oct 11 04:26:02.737616 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1685/3525] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:02 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:02.950511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c16fe9ce-61f6-40b7-b4fd-54d64a92c9ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:02.952366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c16fe9ce-61f6-40b7-b4fd-54d64a92c9ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:02.960215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c16fe9ce-61f6-40b7-b4fd-54d64a92c9ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:02.960703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c16fe9ce-61f6-40b7-b4fd-54d64a92c9ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:02.965570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c16fe9ce-61f6-40b7-b4fd-54d64a92c9ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:02.966346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c16fe9ce-61f6-40b7-b4fd-54d64a92c9ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:02.966534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c16fe9ce-61f6-40b7-b4fd-54d64a92c9ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:02.966972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c16fe9ce-61f6-40b7-b4fd-54d64a92c9ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.017936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:03.035269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:03.037568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:03.038884 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c2375948-e573-4d3a-9293-91156494c88d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.418537 Oct 11 04:26:03.039440 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1841/3526] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:02 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:26:03.156164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c16fe9ce-61f6-40b7-b4fd-54d64a92c9ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:03.166257 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c16fe9ce-61f6-40b7-b4fd-54d64a92c9ec tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.220029 Oct 11 04:26:03.167148 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1686/3527] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:02 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:03.426895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49ace5ec-9e0a-4b58-ada1-da1228e95e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:03.428192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-49ace5ec-9e0a-4b58-ada1-da1228e95e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:03.440585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ace5ec-9e0a-4b58-ada1-da1228e95e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.441379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ace5ec-9e0a-4b58-ada1-da1228e95e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.442054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ace5ec-9e0a-4b58-ada1-da1228e95e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.443458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ace5ec-9e0a-4b58-ada1-da1228e95e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.444086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ace5ec-9e0a-4b58-ada1-da1228e95e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.444680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49ace5ec-9e0a-4b58-ada1-da1228e95e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.499997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:03.500599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: ecd51069-301e-4fab-9e1b-64f7f8615008] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:03.523735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.524231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.526688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.529200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.529835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.530460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.558270 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Instance ecd51069-301e-4fab-9e1b-64f7f8615008 could not be found. Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 HTTP/1.1 Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance ecd51069-301e-4fab-9e1b-64f7f8615008 could not be found. Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'ecd51069-301e-4fab-9e1b-64f7f8615008'} Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecd51069-301e-4fab-9e1b-64f7f8615008 could not be found. Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecd51069-301e-4fab-9e1b-64f7f8615008 could not be found. Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.567740 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.572784 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.572784 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.572784 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:26:03.572784 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:26:03.572784 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecd51069-301e-4fab-9e1b-64f7f8615008 could not be found. Oct 11 04:26:03.572784 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.581393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Instance ecd51069-301e-4fab-9e1b-64f7f8615008 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:26:03.582506 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8f85735-2ef1-4f2b-a880-43959e6afb1f tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008" status: 404 len: 111 microversion: 2.1 time: 0.086341 Oct 11 04:26:03.583589 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1687/3528] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:03 2022] GET /compute/v2.1/servers/ecd51069-301e-4fab-9e1b-64f7f8615008 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:26:03.593937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6aef9159-85f7-4c4e-b824-12ccb705837d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda199a2550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:03.627153 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-6aef9159-85f7-4c4e-b824-12ccb705837d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Image not found. Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6aef9159-85f7-4c4e-b824-12ccb705837d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 HTTP/1.1 Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'c283b9e0-6238-47cc-996a-d48660ad1a38'} Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image c283b9e0-6238-47cc-996a-d48660ad1a38 to delete Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image c283b9e0-6238-47cc-996a-d48660ad1a38 could not be found. Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.629085 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6aef9159-85f7-4c4e-b824-12ccb705837d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:26:03.635021 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6aef9159-85f7-4c4e-b824-12ccb705837d tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38" status: 404 len: 62 microversion: 2.1 time: 0.043080 Oct 11 04:26:03.636678 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1688/3529] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:03 2022] DELETE /compute/v2.1/images/c283b9e0-6238-47cc-996a-d48660ad1a38 => generated 62 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:26:03.643249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:03.643949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:03.657858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.657858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.657858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.657858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.657858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.657858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.669720 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 HTTP/1.1 Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1a701828-9b98-4469-af1d-969d4eae10e6'} Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:26:03.671349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0b7921f6-79c3-4d43-97d8-e0f273bfb404 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 404 len: 111 microversion: 2.1 time: 0.033618 Oct 11 04:26:03.681908 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1689/3530] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:26:03 2022] DELETE /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:26:03.684344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:03.684993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 1a701828-9b98-4469-af1d-969d4eae10e6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:03.700107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.700947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.701815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.703189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.705967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.707150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.765423 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 HTTP/1.1 Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1a701828-9b98-4469-af1d-969d4eae10e6'} Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.780102 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.784707 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.784707 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.784707 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:26:03.784707 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:26:03.784707 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. Oct 11 04:26:03.784707 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.788994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-49ace5ec-9e0a-4b58-ada1-da1228e95e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:03.794819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Instance 1a701828-9b98-4469-af1d-969d4eae10e6 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:26:03.795710 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-57ee8a21-d6df-4592-ae1f-2c99de684d18 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6" status: 404 len: 111 microversion: 2.1 time: 0.117236 Oct 11 04:26:03.796345 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1690/3531] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:03 2022] GET /compute/v2.1/servers/1a701828-9b98-4469-af1d-969d4eae10e6 => generated 111 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:26:03.802980 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-49ace5ec-9e0a-4b58-ada1-da1228e95e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.380380 Oct 11 04:26:03.804266 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1842/3532] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:03 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:03.808893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-58192116-514d-4c1c-bbdf-5674a848d6d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:03.809810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-58192116-514d-4c1c-bbdf-5674a848d6d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:03.810025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-60b6f803-0e75-4ce5-8a6a-f0cadbb24471 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1a050550>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:03.826136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58192116-514d-4c1c-bbdf-5674a848d6d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.828053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58192116-514d-4c1c-bbdf-5674a848d6d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.828507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58192116-514d-4c1c-bbdf-5674a848d6d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.829241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58192116-514d-4c1c-bbdf-5674a848d6d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.831857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58192116-514d-4c1c-bbdf-5674a848d6d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.832704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58192116-514d-4c1c-bbdf-5674a848d6d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.852243 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-60b6f803-0e75-4ce5-8a6a-f0cadbb24471 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Image not found. Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-60b6f803-0e75-4ce5-8a6a-f0cadbb24471 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 HTTP/1.1 Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: exception: Image not found. Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '0480520c-7df2-4444-ba49-d87d9709d050'} Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 0480520c-7df2-4444-ba49-d87d9709d050 to delete Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 0480520c-7df2-4444-ba49-d87d9709d050 could not be found. Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.858744 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-60b6f803-0e75-4ce5-8a6a-f0cadbb24471 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Image not found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-60b6f803-0e75-4ce5-8a6a-f0cadbb24471 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050" status: 404 len: 62 microversion: 2.1 time: 0.054938 Oct 11 04:26:03.870829 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1843/3533] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:03 2022] DELETE /compute/v2.1/images/0480520c-7df2-4444-ba49-d87d9709d050 => generated 62 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:26:03.877352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:03.877352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:03.894425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.895400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.896797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.897546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.898011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.898477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.924665 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df HTTP/1.1 Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '597b08ac-2ff7-485c-9ccc-cc37c67817df'} Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:26:03.928928 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. Oct 11 04:26:03.933770 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.933770 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.933770 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.933770 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.933770 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.933770 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.933770 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:26:03.933770 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:26:03.933770 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. Oct 11 04:26:03.933770 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.942474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:26:03.942474 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5014b25b-6e53-4309-be95-c6c97ea2e24b tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 404 len: 111 microversion: 2.1 time: 0.070088 Oct 11 04:26:03.942474 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1844/3534] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:26:03 2022] DELETE /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:26:03.944616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:03.945232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: 597b08ac-2ff7-485c-9ccc-cc37c67817df] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:03.951345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.952569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.953016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.953718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:03.954163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:03.954870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df HTTP/1.1 Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '597b08ac-2ff7-485c-9ccc-cc37c67817df'} Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:26:03.976255 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Instance 597b08ac-2ff7-485c-9ccc-cc37c67817df could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-00453e22-7578-45ca-a08a-6720917843f6 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df" status: 404 len: 111 microversion: 2.1 time: 0.035280 Oct 11 04:26:03.981351 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1845/3535] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:03 2022] GET /compute/v2.1/servers/597b08ac-2ff7-485c-9ccc-cc37c67817df => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:26:03.985136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-47f8389e-b718-427a-ac8d-b49874a0c256 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '.version_select at 0x7fda1e0f75e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:04.011935 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-47f8389e-b718-427a-ac8d-b49874a0c256 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Image not found. Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-47f8389e-b718-427a-ac8d-b49874a0c256 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 HTTP/1.1 Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: exception: Image not found. Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '4ecbcf69-8ca6-446c-81ff-7a178f813374'} Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4ecbcf69-8ca6-446c-81ff-7a178f813374 to delete Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4ecbcf69-8ca6-446c-81ff-7a178f813374 could not be found. Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.013818 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-47f8389e-b718-427a-ac8d-b49874a0c256 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Image not found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-47f8389e-b718-427a-ac8d-b49874a0c256 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374" status: 404 len: 62 microversion: 2.1 time: 0.034317 Oct 11 04:26:04.023314 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1846/3536] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:03 2022] DELETE /compute/v2.1/images/4ecbcf69-8ca6-446c-81ff-7a178f813374 => generated 62 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:26:04.031491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:04.031491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:04.036195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:04.036832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:04.037246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:04.038253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:04.038764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:04.039227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:04.061272 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e HTTP/1.1 Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'a99ecc72-094d-4756-a9b3-fc9d374b440e'} Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:26:04.063563 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d1e664d9-5086-4692-9cdb-024d6b9d44a4 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 404 len: 111 microversion: 2.1 time: 0.043834 Oct 11 04:26:04.069258 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1847/3537] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:26:04 2022] DELETE /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:26:04.075035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:04.075721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:04.082413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:04.083038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:04.083486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:04.084196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:04.084703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:04.085227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:04.383254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:04.407494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:04.409356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:04.410600 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8058ef4c-1ca1-4714-beab-22c346c83df7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.340645 Oct 11 04:26:04.415015 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1848/3538] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:04 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:26:04.425511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:04.427996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] [instance: a99ecc72-094d-4756-a9b3-fc9d374b440e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:04.446461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:04.447201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:04.449908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:04.453530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:04.455091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:04.455702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:04.490916 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] HTTP exception thrown: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Request method failure captured: Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e HTTP/1.1 Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO9eBX2idtNHCJf5jIbaaeQKvWXfRAg2Is_Pbo1xgtHG9C8suTPZmENuN_KhLPs_ruYSr4XdTbsXZdYN-BIf1R21m3G1faLjc-zK-5Fne5ZpUvXeN3zdvUnR8gO8w0HbOmHnPyAxTUH5n_swzfXOpTDdypt_vbKIXr0nX2yLOYTKhVQ Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8a50d14bbe2e4b71ac79bc37ac0ed812"}]}] Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 8a50d14bbe2e4b71ac79bc37ac0ed812 Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesTestJSON-2005048743 Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 7ade698487d7495d9e10cd7ab92d62a5 Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesTestJSON-2005048743-project Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'a99ecc72-094d-4756-a9b3-fc9d374b440e'} Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.497617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:04.502940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:04.502940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:04.502940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:26:04.502940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:26:04.502940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. Oct 11 04:26:04.502940 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:04.507664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] Returning 404 to user: Instance a99ecc72-094d-4756-a9b3-fc9d374b440e could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:26:04.508740 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d26b232f-1f5a-4ff1-a702-d20cd109b753 tempest-ImagesTestJSON-2005048743 tempest-ImagesTestJSON-2005048743-project] 10.222.0.26 "GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e" status: 404 len: 111 microversion: 2.1 time: 0.092548 Oct 11 04:26:04.512970 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1849/3539] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:04 2022] GET /compute/v2.1/servers/a99ecc72-094d-4756-a9b3-fc9d374b440e => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:26:04.529143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9ce4397-f16a-4a72-bdb3-3f14bb9d2f51 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:04.529711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e9ce4397-f16a-4a72-bdb3-3f14bb9d2f51 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:04.539272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ce4397-f16a-4a72-bdb3-3f14bb9d2f51 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:04.540057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ce4397-f16a-4a72-bdb3-3f14bb9d2f51 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:04.540715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ce4397-f16a-4a72-bdb3-3f14bb9d2f51 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:04.542005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ce4397-f16a-4a72-bdb3-3f14bb9d2f51 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:04.542706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ce4397-f16a-4a72-bdb3-3f14bb9d2f51 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:04.543295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9ce4397-f16a-4a72-bdb3-3f14bb9d2f51 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:04.548197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-58192116-514d-4c1c-bbdf-5674a848d6d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:04.559622 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-58192116-514d-4c1c-bbdf-5674a848d6d6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.762176 Oct 11 04:26:04.561727 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1691/3540] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:03 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:04.829309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12e5dd6a-6d7f-41cd-a2a7-8d73153f0810 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:04.830452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-12e5dd6a-6d7f-41cd-a2a7-8d73153f0810 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:04.844075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e5dd6a-6d7f-41cd-a2a7-8d73153f0810 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:04.850391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e5dd6a-6d7f-41cd-a2a7-8d73153f0810 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:04.850391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e5dd6a-6d7f-41cd-a2a7-8d73153f0810 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:04.850391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e5dd6a-6d7f-41cd-a2a7-8d73153f0810 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:04.850391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e5dd6a-6d7f-41cd-a2a7-8d73153f0810 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:04.850391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12e5dd6a-6d7f-41cd-a2a7-8d73153f0810 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:04.870698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e9ce4397-f16a-4a72-bdb3-3f14bb9d2f51 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:04.881714 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e9ce4397-f16a-4a72-bdb3-3f14bb9d2f51 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.366435 Oct 11 04:26:04.893340 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1850/3541] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:04 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:05.106888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-12e5dd6a-6d7f-41cd-a2a7-8d73153f0810 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:05.117270 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-12e5dd6a-6d7f-41cd-a2a7-8d73153f0810 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1686 microversion: 2.1 time: 0.293665 Oct 11 04:26:05.130316 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1692/3542] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:04 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1686 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:05.445500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:05.446404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:05.455667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:05.456825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:05.457594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:05.458471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:05.459125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:05.459568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:05.587669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7875aa7c-f120-4005-aa19-427336c5483b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:05.589104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7875aa7c-f120-4005-aa19-427336c5483b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:05.606122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7875aa7c-f120-4005-aa19-427336c5483b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:05.606636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7875aa7c-f120-4005-aa19-427336c5483b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:05.607105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7875aa7c-f120-4005-aa19-427336c5483b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:05.607799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7875aa7c-f120-4005-aa19-427336c5483b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:05.608243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7875aa7c-f120-4005-aa19-427336c5483b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:05.608660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7875aa7c-f120-4005-aa19-427336c5483b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:05.814209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:05.831336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:05.833568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:05.839462 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d7fb112-b12d-4d98-b77d-8aea6730d9c5 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.395268 Oct 11 04:26:05.840156 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1851/3543] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:05 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:26:05.906691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7875aa7c-f120-4005-aa19-427336c5483b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:05.918074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-45c5dfa8-ada9-4d9a-8f09-8300037d0d93 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:05.919003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45c5dfa8-ada9-4d9a-8f09-8300037d0d93 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:05.922629 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7875aa7c-f120-4005-aa19-427336c5483b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.339370 Oct 11 04:26:05.924265 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1693/3544] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:05 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:05.928133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c5dfa8-ada9-4d9a-8f09-8300037d0d93 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:05.928645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c5dfa8-ada9-4d9a-8f09-8300037d0d93 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:05.929087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c5dfa8-ada9-4d9a-8f09-8300037d0d93 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:05.929793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c5dfa8-ada9-4d9a-8f09-8300037d0d93 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:05.931973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c5dfa8-ada9-4d9a-8f09-8300037d0d93 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:05.933537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c5dfa8-ada9-4d9a-8f09-8300037d0d93 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:06.144976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-555dc649-4943-470d-a1ea-ddae85de14c9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:06.146136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-555dc649-4943-470d-a1ea-ddae85de14c9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:06.159862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-555dc649-4943-470d-a1ea-ddae85de14c9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:06.160377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-555dc649-4943-470d-a1ea-ddae85de14c9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:06.170784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-555dc649-4943-470d-a1ea-ddae85de14c9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:06.171806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-555dc649-4943-470d-a1ea-ddae85de14c9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:06.172299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-555dc649-4943-470d-a1ea-ddae85de14c9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:06.172746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-555dc649-4943-470d-a1ea-ddae85de14c9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:06.182063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45c5dfa8-ada9-4d9a-8f09-8300037d0d93 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:06.190606 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-45c5dfa8-ada9-4d9a-8f09-8300037d0d93 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.276443 Oct 11 04:26:06.203648 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1852/3545] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:05 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:06.605458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-48161591", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "dfa901b8-ba4e-45ab-9e1a-fccbcd207104"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:06.662398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-555dc649-4943-470d-a1ea-ddae85de14c9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:06.689790 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-555dc649-4943-470d-a1ea-ddae85de14c9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.542972 Oct 11 04:26:06.690880 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1694/3546] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:06 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:06.781860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] validate_networks() for [('dfa901b8-ba4e-45ab-9e1a-fccbcd207104', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:26:06.871919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:06.872526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:06.878649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:06.879357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:06.879976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:06.881110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:06.881719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:06.882322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:07.195650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:07.216168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:07.221667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:07.225095 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ae741df-e7b9-45eb-8fff-446e7ef8f6a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.357096 Oct 11 04:26:07.228561 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1695/3547] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:06 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:26:07.246586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ecaf6746-62cb-4339-94c8-2164fde2d083 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:07.247823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ecaf6746-62cb-4339-94c8-2164fde2d083 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:07.255788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaf6746-62cb-4339-94c8-2164fde2d083 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:07.256932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaf6746-62cb-4339-94c8-2164fde2d083 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:07.257665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaf6746-62cb-4339-94c8-2164fde2d083 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:07.258785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaf6746-62cb-4339-94c8-2164fde2d083 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:07.259662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaf6746-62cb-4339-94c8-2164fde2d083 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:07.261009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaf6746-62cb-4339-94c8-2164fde2d083 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:07.828765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ecaf6746-62cb-4339-94c8-2164fde2d083 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:07.838588 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ecaf6746-62cb-4339-94c8-2164fde2d083 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.606370 Oct 11 04:26:07.850827 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1696/3548] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:07 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:07.861692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-4bf9ced9-9bdb-4af4-adc1-b5ad4083b9a5 req-34d9f083-722d-4054-a545-4ba860476f3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-plugged", "status": "completed", "tag": "cb8530f1-3a71-44d5-9c2f-f4252591ccc9"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:07.877436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4bf9ced9-9bdb-4af4-adc1-b5ad4083b9a5 req-34d9f083-722d-4054-a545-4ba860476f3d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:07.878883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4bf9ced9-9bdb-4af4-adc1-b5ad4083b9a5 req-34d9f083-722d-4054-a545-4ba860476f3d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:07.880347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4bf9ced9-9bdb-4af4-adc1-b5ad4083b9a5 req-34d9f083-722d-4054-a545-4ba860476f3d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:07.904398 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-4bf9ced9-9bdb-4af4-adc1-b5ad4083b9a5 req-34d9f083-722d-4054-a545-4ba860476f3d service nova] Creating event network-vif-plugged:cb8530f1-3a71-44d5-9c2f-f4252591ccc9 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:26:07.913193 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-4bf9ced9-9bdb-4af4-adc1-b5ad4083b9a5 req-34d9f083-722d-4054-a545-4ba860476f3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059842 Oct 11 04:26:07.914262 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1697/3549] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:07.925616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ac4a23b-be3b-40b4-ba2b-25073ca96945 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:07.927838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ac4a23b-be3b-40b4-ba2b-25073ca96945 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:07.947340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ac4a23b-be3b-40b4-ba2b-25073ca96945 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:07.947546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ac4a23b-be3b-40b4-ba2b-25073ca96945 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:07.948592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ac4a23b-be3b-40b4-ba2b-25073ca96945 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:07.949623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ac4a23b-be3b-40b4-ba2b-25073ca96945 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:07.950632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ac4a23b-be3b-40b4-ba2b-25073ca96945 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:07.951507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ac4a23b-be3b-40b4-ba2b-25073ca96945 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:08.160394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:26:08.162132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:26:08.168195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:26:08.168195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:26:08.168195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:26:08.227280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:08.231624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:08.235738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:08.241790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:08.242507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:08.243161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:08.274047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Getting quotas for project 79f5da4f89bf4688be5d994f08c578bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:26:08.286598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Getting quotas for user dc692a8f67294a189e15a530c17a0228 and project 79f5da4f89bf4688be5d994f08c578bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:26:08.303567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:26:08.307485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:26:08.579963 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-85d80423-6675-4c23-a3b3-b061a1050fba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.165886 Oct 11 04:26:08.595008 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1853/3550] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:26:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2182 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:26:08.608570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-324537d7-3400-4c53-bb8e-45d98d4740d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:08.610953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-324537d7-3400-4c53-bb8e-45d98d4740d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:08.644157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-324537d7-3400-4c53-bb8e-45d98d4740d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:08.647834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-324537d7-3400-4c53-bb8e-45d98d4740d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:08.649691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-324537d7-3400-4c53-bb8e-45d98d4740d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:08.654813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-324537d7-3400-4c53-bb8e-45d98d4740d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:08.660680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-324537d7-3400-4c53-bb8e-45d98d4740d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:08.660680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-324537d7-3400-4c53-bb8e-45d98d4740d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:08.812411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3ac4a23b-be3b-40b4-ba2b-25073ca96945 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:08.829309 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ac4a23b-be3b-40b4-ba2b-25073ca96945 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1512 microversion: 2.1 time: 0.912826 Oct 11 04:26:08.833685 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1698/3551] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:07 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1512 bytes in 919 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:08.862768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:08.871355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:08.890622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:08.891115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:08.895558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:08.900931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:08.903518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:08.903970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:09.271398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-324537d7-3400-4c53-bb8e-45d98d4740d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:09.280192 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-324537d7-3400-4c53-bb8e-45d98d4740d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.683198 Oct 11 04:26:09.280873 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1854/3552] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:08 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:09.304367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-90742718", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "dfa901b8-ba4e-45ab-9e1a-fccbcd207104"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:09.394582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] validate_networks() for [('dfa901b8-ba4e-45ab-9e1a-fccbcd207104', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:26:09.564516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:09.587765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:09.614861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:09.618711 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f362f5e1-fc31-4ea6-af3c-aedb8e3a43f3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.780836 Oct 11 04:26:09.633343 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1699/3553] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:08 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:26:09.665792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d42a8a03-1a3b-4c81-902f-5f93fce1e81e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:09.666536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d42a8a03-1a3b-4c81-902f-5f93fce1e81e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:09.700571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a8a03-1a3b-4c81-902f-5f93fce1e81e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:09.700571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a8a03-1a3b-4c81-902f-5f93fce1e81e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:09.700571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a8a03-1a3b-4c81-902f-5f93fce1e81e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:09.700571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a8a03-1a3b-4c81-902f-5f93fce1e81e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:09.700571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a8a03-1a3b-4c81-902f-5f93fce1e81e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:09.700571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a8a03-1a3b-4c81-902f-5f93fce1e81e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:10.310869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:26:10.310869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:26:10.310869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:26:10.310869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:26:10.310869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:26:10.316847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:10.317907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:10.318449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:10.319403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:10.320005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:10.320619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:10.347265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Getting quotas for project 79f5da4f89bf4688be5d994f08c578bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:26:10.354708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Getting quotas for user dc692a8f67294a189e15a530c17a0228 and project 79f5da4f89bf4688be5d994f08c578bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:26:10.370321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:26:10.372832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 7e848340-de82-48aa-8c66-78908ccdd948] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:26:10.609350 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-56878006-0104-4e61-a2fb-ed4d1beb7bb6 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.309300 Oct 11 04:26:10.611335 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1855/3554] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:26:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1330 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:26:10.835925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-9616ce33-48fd-467d-97a9-8ae7d7f8d3ac req-e00250cb-79fb-4f94-9477-e2228b8be76e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f355e5e4-e6af-4b85-9dd8-99b495b0d5a8", "name": "network-vif-unplugged", "status": "completed", "tag": "ff3eb7a3-fcc1-45dc-94d9-930423c9496a"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:10.844030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d42a8a03-1a3b-4c81-902f-5f93fce1e81e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:10.853598 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d42a8a03-1a3b-4c81-902f-5f93fce1e81e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 1.218229 Oct 11 04:26:10.880868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9616ce33-48fd-467d-97a9-8ae7d7f8d3ac req-e00250cb-79fb-4f94-9477-e2228b8be76e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:10.881356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9616ce33-48fd-467d-97a9-8ae7d7f8d3ac req-e00250cb-79fb-4f94-9477-e2228b8be76e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:10.881792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9616ce33-48fd-467d-97a9-8ae7d7f8d3ac req-e00250cb-79fb-4f94-9477-e2228b8be76e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:10.890388 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1700/3555] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:09 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 1256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:10.917027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-756de8c4-e118-485a-b563-34ee42d262c6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:10.923426 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-9616ce33-48fd-467d-97a9-8ae7d7f8d3ac req-e00250cb-79fb-4f94-9477-e2228b8be76e service nova] Creating event network-vif-unplugged:ff3eb7a3-fcc1-45dc-94d9-930423c9496a for instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 on n-h1-860892-1 Oct 11 04:26:10.927001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-756de8c4-e118-485a-b563-34ee42d262c6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:10.937003 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-9616ce33-48fd-467d-97a9-8ae7d7f8d3ac req-e00250cb-79fb-4f94-9477-e2228b8be76e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.319839 Oct 11 04:26:10.940839 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1856/3556] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:10.948453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-0699e29c-5b7a-40fe-afcb-f7684fa8234b req-94b7ade2-d6e1-46c6-a41b-24b31b3c1a6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-plugged", "status": "completed", "tag": "c90ce6b2-656f-4df4-b90a-a7af54d53844"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:10.965272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-756de8c4-e118-485a-b563-34ee42d262c6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:10.968832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-756de8c4-e118-485a-b563-34ee42d262c6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:10.973823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-756de8c4-e118-485a-b563-34ee42d262c6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:10.992257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-756de8c4-e118-485a-b563-34ee42d262c6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:10.995388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-756de8c4-e118-485a-b563-34ee42d262c6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:10.995845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-756de8c4-e118-485a-b563-34ee42d262c6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:11.006652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0699e29c-5b7a-40fe-afcb-f7684fa8234b req-94b7ade2-d6e1-46c6-a41b-24b31b3c1a6f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:11.007447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0699e29c-5b7a-40fe-afcb-f7684fa8234b req-94b7ade2-d6e1-46c6-a41b-24b31b3c1a6f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:11.009835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0699e29c-5b7a-40fe-afcb-f7684fa8234b req-94b7ade2-d6e1-46c6-a41b-24b31b3c1a6f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:11.045177 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-0699e29c-5b7a-40fe-afcb-f7684fa8234b req-94b7ade2-d6e1-46c6-a41b-24b31b3c1a6f service nova] Creating event network-vif-plugged:c90ce6b2-656f-4df4-b90a-a7af54d53844 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:26:11.074653 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-0699e29c-5b7a-40fe-afcb-f7684fa8234b req-94b7ade2-d6e1-46c6-a41b-24b31b3c1a6f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.135228 Oct 11 04:26:11.079156 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1857/3557] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:11.093623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a5da8bd9-8047-4848-bd40-a93cee6982d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:11.102052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a5da8bd9-8047-4848-bd40-a93cee6982d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:11.107320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:11.122388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5da8bd9-8047-4848-bd40-a93cee6982d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:11.122885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5da8bd9-8047-4848-bd40-a93cee6982d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:11.123328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5da8bd9-8047-4848-bd40-a93cee6982d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:11.124029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5da8bd9-8047-4848-bd40-a93cee6982d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:11.124478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5da8bd9-8047-4848-bd40-a93cee6982d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:11.124934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5da8bd9-8047-4848-bd40-a93cee6982d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:11.583575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-756de8c4-e118-485a-b563-34ee42d262c6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:11.591563 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-756de8c4-e118-485a-b563-34ee42d262c6 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1489 microversion: 2.1 time: 0.694874 Oct 11 04:26:11.612384 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1701/3558] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:10 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1489 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:11.617755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:11.618435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:11.635430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:11.635928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:11.636367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:11.637076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:11.637530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:11.637968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:11.981024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a5da8bd9-8047-4848-bd40-a93cee6982d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:11.995356 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a5da8bd9-8047-4848-bd40-a93cee6982d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.913917 Oct 11 04:26:12.024619 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1858/3559] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:11 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:12.038267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServerFiltersTestJSON-instance-1723103806", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "451", "networks": [{"uuid": "dfa901b8-ba4e-45ab-9e1a-fccbcd207104"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:12.153787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] validate_networks() for [('dfa901b8-ba4e-45ab-9e1a-fccbcd207104', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:26:12.497471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:12.515905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:12.543448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:12.551881 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ecb6a0fa-aa00-42d0-9140-2f4ea357c00e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.938425 Oct 11 04:26:12.560455 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1702/3560] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:11 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:26:12.571571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3d8c9e74-dd75-4456-b996-72f1821f48a0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:12.579030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3d8c9e74-dd75-4456-b996-72f1821f48a0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:12.585113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:12.592394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8c9e74-dd75-4456-b996-72f1821f48a0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:12.592394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8c9e74-dd75-4456-b996-72f1821f48a0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:12.592394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8c9e74-dd75-4456-b996-72f1821f48a0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:12.592394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8c9e74-dd75-4456-b996-72f1821f48a0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:12.592394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8c9e74-dd75-4456-b996-72f1821f48a0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:12.592394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d8c9e74-dd75-4456-b996-72f1821f48a0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:12.671953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:12.705117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3d8c9e74-dd75-4456-b996-72f1821f48a0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:26:13.220542 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3d8c9e74-dd75-4456-b996-72f1821f48a0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 204 len: 0 microversion: 2.1 time: 0.661061 Oct 11 04:26:13.222985 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1703/3561] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:26:12 2022] DELETE /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 0 bytes in 664 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:26:13.230046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-25824e97-5556-4743-8d0f-d649dcc742a8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:13.231112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-25824e97-5556-4743-8d0f-d649dcc742a8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:13.246163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25824e97-5556-4743-8d0f-d649dcc742a8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:13.247062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25824e97-5556-4743-8d0f-d649dcc742a8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:13.247804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25824e97-5556-4743-8d0f-d649dcc742a8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:13.250080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25824e97-5556-4743-8d0f-d649dcc742a8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:13.251908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25824e97-5556-4743-8d0f-d649dcc742a8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:13.254911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25824e97-5556-4743-8d0f-d649dcc742a8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:13.459016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:26:13.459524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:26:13.459911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:26:13.460325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:26:13.461549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:26:13.492347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:13.502032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:13.502032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:13.502032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:13.502032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:13.502032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:13.588792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Getting quotas for project 79f5da4f89bf4688be5d994f08c578bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:26:13.605968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Getting quotas for user dc692a8f67294a189e15a530c17a0228 and project 79f5da4f89bf4688be5d994f08c578bd. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:26:13.684446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:26:13.697324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:26:13.876949 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2ac904a7-e5b6-4b19-bdfa-029f14616b3c tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.850863 Oct 11 04:26:13.895604 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1859/3562] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:26:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1870 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:26:13.908810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-476c9a5c-85b8-4511-8bf9-2918a62395f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:13.909882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-476c9a5c-85b8-4511-8bf9-2918a62395f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:13.936514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-476c9a5c-85b8-4511-8bf9-2918a62395f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:13.939262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-476c9a5c-85b8-4511-8bf9-2918a62395f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:13.940213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-476c9a5c-85b8-4511-8bf9-2918a62395f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:13.946220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-476c9a5c-85b8-4511-8bf9-2918a62395f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:13.949437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-476c9a5c-85b8-4511-8bf9-2918a62395f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:13.951081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-476c9a5c-85b8-4511-8bf9-2918a62395f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:14.292959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-25824e97-5556-4743-8d0f-d649dcc742a8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:14.304892 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-25824e97-5556-4743-8d0f-d649dcc742a8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 1.079650 Oct 11 04:26:14.307806 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1704/3563] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:13 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:14.700588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2d14c9ea-526b-4848-8a5f-0d28b2c68c0d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:14.701212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2d14c9ea-526b-4848-8a5f-0d28b2c68c0d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:14.712151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d14c9ea-526b-4848-8a5f-0d28b2c68c0d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:14.712653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d14c9ea-526b-4848-8a5f-0d28b2c68c0d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:14.713098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d14c9ea-526b-4848-8a5f-0d28b2c68c0d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:14.713807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d14c9ea-526b-4848-8a5f-0d28b2c68c0d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:14.716195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d14c9ea-526b-4848-8a5f-0d28b2c68c0d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:14.717854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d14c9ea-526b-4848-8a5f-0d28b2c68c0d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:15.127082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-476c9a5c-85b8-4511-8bf9-2918a62395f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:15.163278 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-476c9a5c-85b8-4511-8bf9-2918a62395f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 1.263003 Oct 11 04:26:15.164902 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1860/3564] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:13 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 1268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:15.184588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-30be2395-5066-4387-8925-ef876948e7af req-74b4b079-39ca-4d2b-b3b6-ae694103d8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-plugged", "status": "completed", "tag": "d5ed01b4-6c79-4f61-b2fb-415cf63f9a6f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:15.239618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-30be2395-5066-4387-8925-ef876948e7af req-74b4b079-39ca-4d2b-b3b6-ae694103d8f1 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:15.243600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-30be2395-5066-4387-8925-ef876948e7af req-74b4b079-39ca-4d2b-b3b6-ae694103d8f1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:15.243600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-30be2395-5066-4387-8925-ef876948e7af req-74b4b079-39ca-4d2b-b3b6-ae694103d8f1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:15.300792 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-30be2395-5066-4387-8925-ef876948e7af req-74b4b079-39ca-4d2b-b3b6-ae694103d8f1 service nova] Creating event network-vif-plugged:d5ed01b4-6c79-4f61-b2fb-415cf63f9a6f for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:26:15.327249 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-30be2395-5066-4387-8925-ef876948e7af req-74b4b079-39ca-4d2b-b3b6-ae694103d8f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159249 Oct 11 04:26:15.328670 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1861/3565] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:15.343845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:15.347420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:15.416738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:15.416738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:15.416738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:15.418687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:15.420711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:15.422270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:15.530445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2d14c9ea-526b-4848-8a5f-0d28b2c68c0d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:15.542875 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2d14c9ea-526b-4848-8a5f-0d28b2c68c0d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1495 microversion: 2.1 time: 1.232326 Oct 11 04:26:15.544997 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1705/3566] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:14 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1495 bytes in 1236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:15.556921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5a9a92ba-4172-4531-8179-8641a2ddacc4 req-642b096c-506d-4227-85f9-e4a1fbf97a86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f355e5e4-e6af-4b85-9dd8-99b495b0d5a8", "tag": "ff3eb7a3-fcc1-45dc-94d9-930423c9496a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:15.583779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5a9a92ba-4172-4531-8179-8641a2ddacc4 req-642b096c-506d-4227-85f9-e4a1fbf97a86 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:15.584570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5a9a92ba-4172-4531-8179-8641a2ddacc4 req-642b096c-506d-4227-85f9-e4a1fbf97a86 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:15.587276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5a9a92ba-4172-4531-8179-8641a2ddacc4 req-642b096c-506d-4227-85f9-e4a1fbf97a86 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:15.634803 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5a9a92ba-4172-4531-8179-8641a2ddacc4 req-642b096c-506d-4227-85f9-e4a1fbf97a86 service nova] Creating event network-changed:ff3eb7a3-fcc1-45dc-94d9-930423c9496a for instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 on n-h1-860892-1 Oct 11 04:26:15.649342 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5a9a92ba-4172-4531-8179-8641a2ddacc4 req-642b096c-506d-4227-85f9-e4a1fbf97a86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101451 Oct 11 04:26:15.651645 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1706/3567] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:15.662950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7c105fcc-2261-4ef4-bc22-32e57f8767f8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:15.664929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7c105fcc-2261-4ef4-bc22-32e57f8767f8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:15.949729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7c105fcc-2261-4ef4-bc22-32e57f8767f8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:15.974559 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7c105fcc-2261-4ef4-bc22-32e57f8767f8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1221 microversion: 2.1 time: 0.322696 Oct 11 04:26:15.976266 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1707/3568] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:15 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1221 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:15.989523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9da76e45-426d-4305-a5ab-898d2f6de2af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:15.992481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9da76e45-426d-4305-a5ab-898d2f6de2af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:16.023105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da76e45-426d-4305-a5ab-898d2f6de2af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:16.031544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da76e45-426d-4305-a5ab-898d2f6de2af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:16.036938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da76e45-426d-4305-a5ab-898d2f6de2af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:16.041310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da76e45-426d-4305-a5ab-898d2f6de2af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:16.044753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da76e45-426d-4305-a5ab-898d2f6de2af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:16.048052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9da76e45-426d-4305-a5ab-898d2f6de2af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:16.485252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9da76e45-426d-4305-a5ab-898d2f6de2af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:16.537141 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9da76e45-426d-4305-a5ab-898d2f6de2af tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.559522 Oct 11 04:26:16.552481 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1708/3569] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:15 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:16.569805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e620029-d568-4db7-81d4-1bfd2f31d664 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:16.579774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8e620029-d568-4db7-81d4-1bfd2f31d664 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:16.603594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e620029-d568-4db7-81d4-1bfd2f31d664 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:16.608756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e620029-d568-4db7-81d4-1bfd2f31d664 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:16.608756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e620029-d568-4db7-81d4-1bfd2f31d664 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:16.611283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e620029-d568-4db7-81d4-1bfd2f31d664 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:16.611772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e620029-d568-4db7-81d4-1bfd2f31d664 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:16.612211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e620029-d568-4db7-81d4-1bfd2f31d664 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:16.966032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8e620029-d568-4db7-81d4-1bfd2f31d664 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:16.978633 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8e620029-d568-4db7-81d4-1bfd2f31d664 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.424943 Oct 11 04:26:16.979857 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1709/3570] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:16 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:16.996017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1832723f-68d3-4ac9-8a6f-86950f419b5a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:16.996873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1832723f-68d3-4ac9-8a6f-86950f419b5a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:17.007732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1832723f-68d3-4ac9-8a6f-86950f419b5a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:17.011436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1832723f-68d3-4ac9-8a6f-86950f419b5a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:17.012075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1832723f-68d3-4ac9-8a6f-86950f419b5a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:17.012732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1832723f-68d3-4ac9-8a6f-86950f419b5a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:17.013213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1832723f-68d3-4ac9-8a6f-86950f419b5a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:17.015170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1832723f-68d3-4ac9-8a6f-86950f419b5a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:17.095114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:17.112159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:17.120816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:17.120816 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-11a4ef39-e0c0-409a-926d-49a303f1b3bc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 1.787279 Oct 11 04:26:17.120816 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1862/3571] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:15 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 1789 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:26:17.138919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1860287a-754d-4288-bad7-34f9e6234181 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:17.139772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1860287a-754d-4288-bad7-34f9e6234181 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:17.153059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1860287a-754d-4288-bad7-34f9e6234181 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:17.153059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1860287a-754d-4288-bad7-34f9e6234181 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:17.153059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1860287a-754d-4288-bad7-34f9e6234181 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:17.153059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1860287a-754d-4288-bad7-34f9e6234181 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:17.153059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1860287a-754d-4288-bad7-34f9e6234181 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:17.153059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1860287a-754d-4288-bad7-34f9e6234181 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:17.197072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:17.550429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1832723f-68d3-4ac9-8a6f-86950f419b5a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:17.560883 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1832723f-68d3-4ac9-8a6f-86950f419b5a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1453 microversion: 2.1 time: 0.577608 Oct 11 04:26:17.574630 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1710/3572] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:16 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1453 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:17.735270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-24a0ca26-4659-4034-8a6e-ba2b1c90d014 req-3f8a07ca-4bd3-4e8d-870b-19f49a2582b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-plugged", "status": "completed", "tag": "12f46a1d-3f56-4b9a-ac0c-89ceb542d3f7"}, {"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-plugged", "status": "completed", "tag": "cef26b29-2cac-49a3-a867-7f255a006168"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:17.769941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-24a0ca26-4659-4034-8a6e-ba2b1c90d014 req-3f8a07ca-4bd3-4e8d-870b-19f49a2582b9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:17.769941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-24a0ca26-4659-4034-8a6e-ba2b1c90d014 req-3f8a07ca-4bd3-4e8d-870b-19f49a2582b9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:17.769941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-24a0ca26-4659-4034-8a6e-ba2b1c90d014 req-3f8a07ca-4bd3-4e8d-870b-19f49a2582b9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:17.799318 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-24a0ca26-4659-4034-8a6e-ba2b1c90d014 req-3f8a07ca-4bd3-4e8d-870b-19f49a2582b9 service nova] Creating event network-vif-plugged:12f46a1d-3f56-4b9a-ac0c-89ceb542d3f7 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:26:17.799825 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-24a0ca26-4659-4034-8a6e-ba2b1c90d014 req-3f8a07ca-4bd3-4e8d-870b-19f49a2582b9 service nova] Creating event network-vif-plugged:cef26b29-2cac-49a3-a867-7f255a006168 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:26:17.813345 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-24a0ca26-4659-4034-8a6e-ba2b1c90d014 req-3f8a07ca-4bd3-4e8d-870b-19f49a2582b9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.230335 Oct 11 04:26:17.814602 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1711/3573] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:17 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:17.832280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae5018a9-2ebf-4a41-80b2-b2d843e51d15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:17.833279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ae5018a9-2ebf-4a41-80b2-b2d843e51d15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:17.845258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5018a9-2ebf-4a41-80b2-b2d843e51d15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:17.847927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5018a9-2ebf-4a41-80b2-b2d843e51d15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:17.852362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5018a9-2ebf-4a41-80b2-b2d843e51d15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:17.855329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5018a9-2ebf-4a41-80b2-b2d843e51d15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:17.856086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5018a9-2ebf-4a41-80b2-b2d843e51d15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:17.858489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5018a9-2ebf-4a41-80b2-b2d843e51d15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:18.238834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ae5018a9-2ebf-4a41-80b2-b2d843e51d15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:18.266805 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ae5018a9-2ebf-4a41-80b2-b2d843e51d15 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.449157 Oct 11 04:26:18.273256 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1712/3574] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:17 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:18.310366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-7292cf78-601b-4510-b05f-fae8170a2ba7 req-0d516256-f0fe-483b-8ebc-5e615f205384 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0baccb1e-5505-4df8-a290-46f39e25eb7c", "name": "network-vif-deleted", "tag": "40cfa72a-7b5a-42cc-acb3-5e760550a5ef"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:18.314808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7292cf78-601b-4510-b05f-fae8170a2ba7 req-0d516256-f0fe-483b-8ebc-5e615f205384 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:18.315290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7292cf78-601b-4510-b05f-fae8170a2ba7 req-0d516256-f0fe-483b-8ebc-5e615f205384 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:18.315727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7292cf78-601b-4510-b05f-fae8170a2ba7 req-0d516256-f0fe-483b-8ebc-5e615f205384 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:18.378540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1860287a-754d-4288-bad7-34f9e6234181 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:18.383991 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1860287a-754d-4288-bad7-34f9e6234181 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1273 microversion: 2.1 time: 1.259246 Oct 11 04:26:18.391098 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7292cf78-601b-4510-b05f-fae8170a2ba7 req-0d516256-f0fe-483b-8ebc-5e615f205384 service nova] Creating event network-vif-deleted:40cfa72a-7b5a-42cc-acb3-5e760550a5ef for instance 0baccb1e-5505-4df8-a290-46f39e25eb7c on n-h1-860892-1 Oct 11 04:26:18.398632 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-7292cf78-601b-4510-b05f-fae8170a2ba7 req-0d516256-f0fe-483b-8ebc-5e615f205384 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122668 Oct 11 04:26:18.399759 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1713/3575] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:18.403285 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1863/3576] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:17 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1273 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:18.406316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d050cc35-bd97-4107-82bc-7ee5fd211b9b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:18.407618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d050cc35-bd97-4107-82bc-7ee5fd211b9b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:18.408238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:18.408874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:18.420995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d050cc35-bd97-4107-82bc-7ee5fd211b9b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:18.421155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:18.421839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d050cc35-bd97-4107-82bc-7ee5fd211b9b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:18.422075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:18.422731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d050cc35-bd97-4107-82bc-7ee5fd211b9b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:18.422879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:18.423571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:18.423992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d050cc35-bd97-4107-82bc-7ee5fd211b9b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:18.424133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:18.424470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:18.424937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d050cc35-bd97-4107-82bc-7ee5fd211b9b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:18.425529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d050cc35-bd97-4107-82bc-7ee5fd211b9b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:18.685426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d050cc35-bd97-4107-82bc-7ee5fd211b9b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:18.696528 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d050cc35-bd97-4107-82bc-7ee5fd211b9b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.294919 Oct 11 04:26:18.702334 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1714/3577] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:18 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:18.702523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:18.703216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:18.715403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:18.715953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:18.716423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:18.717179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:18.718640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:18.719072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:18.758357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:18.758844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:18.759280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:18.760068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lazy-loading 'fault' on Instance uuid 0baccb1e-5505-4df8-a290-46f39e25eb7c {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:26:18.808435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:18.817124 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-588b423a-9b64-46f0-8df5-b271249e41f3 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1305 microversion: 2.1 time: 0.118325 Oct 11 04:26:18.819070 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1715/3578] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:18 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1305 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:18.935782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:18.964452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:18.968491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:18.969867 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-03ac179c-9c36-44f1-8237-30ece65a90ae tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.565464 Oct 11 04:26:18.993207 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1864/3579] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:18 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:26:19.296443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-971a15a2-ec30-4f09-bfc3-27512bd23bbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:19.298137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-971a15a2-ec30-4f09-bfc3-27512bd23bbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:19.311525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-971a15a2-ec30-4f09-bfc3-27512bd23bbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:19.312441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-971a15a2-ec30-4f09-bfc3-27512bd23bbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:19.313511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-971a15a2-ec30-4f09-bfc3-27512bd23bbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:19.315519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-971a15a2-ec30-4f09-bfc3-27512bd23bbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:19.317095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-971a15a2-ec30-4f09-bfc3-27512bd23bbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:19.318008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-971a15a2-ec30-4f09-bfc3-27512bd23bbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:19.409708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-109175de-908a-44db-b432-71a5659d79d8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:19.411036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-109175de-908a-44db-b432-71a5659d79d8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:19.424199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-109175de-908a-44db-b432-71a5659d79d8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:19.424712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-109175de-908a-44db-b432-71a5659d79d8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:19.425125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-109175de-908a-44db-b432-71a5659d79d8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:19.425888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-109175de-908a-44db-b432-71a5659d79d8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:19.426374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-109175de-908a-44db-b432-71a5659d79d8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:19.426801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-109175de-908a-44db-b432-71a5659d79d8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:19.534907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-109175de-908a-44db-b432-71a5659d79d8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:19.548002 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-109175de-908a-44db-b432-71a5659d79d8 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1279 microversion: 2.1 time: 0.142012 Oct 11 04:26:19.549336 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1865/3580] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:19 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:19.719619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-277294f4-d7e5-498c-a100-678bfea9ed06 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:19.720852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-277294f4-d7e5-498c-a100-678bfea9ed06 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:19.734727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-971a15a2-ec30-4f09-bfc3-27512bd23bbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:19.745547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-277294f4-d7e5-498c-a100-678bfea9ed06 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:19.746050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-277294f4-d7e5-498c-a100-678bfea9ed06 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:19.746284 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-971a15a2-ec30-4f09-bfc3-27512bd23bbb tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.453573 Oct 11 04:26:19.746527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-277294f4-d7e5-498c-a100-678bfea9ed06 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:19.747244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-277294f4-d7e5-498c-a100-678bfea9ed06 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:19.747976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-277294f4-d7e5-498c-a100-678bfea9ed06 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:19.748578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-277294f4-d7e5-498c-a100-678bfea9ed06 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:19.766320 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1716/3581] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:19 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:19.845385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:19.846030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:19.859814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:19.860309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:19.860746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:19.863334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:19.869635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:19.870350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:19.958481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:19.959362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:19.961332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:19.962066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lazy-loading 'fault' on Instance uuid 0baccb1e-5505-4df8-a290-46f39e25eb7c {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:26:20.055880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:20.078020 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-99f2b926-bf0a-43b7-a6d8-a123b71601cf tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 200 len: 1305 microversion: 2.1 time: 0.233152 Oct 11 04:26:20.086349 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1717/3582] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:19 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 1305 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:20.100434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-7140b14d-7abf-4062-9341-a8eff13200fa req-90f38423-559e-49db-8a03-45a229474af6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32f0ab1-346d-487a-aa08-ebd1656142a7", "name": "network-vif-plugged", "status": "completed", "tag": "6993adde-be55-4ee5-a441-ab52e2f48759"}, {"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-plugged", "status": "completed", "tag": "19904f71-1cd6-4db1-9e7e-42cc6e25cf8d"}, {"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-plugged", "status": "completed", "tag": "1712ec47-14a1-4060-802b-107a47cc9b9d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:20.119594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7140b14d-7abf-4062-9341-a8eff13200fa req-90f38423-559e-49db-8a03-45a229474af6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:20.120398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7140b14d-7abf-4062-9341-a8eff13200fa req-90f38423-559e-49db-8a03-45a229474af6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:20.120939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7140b14d-7abf-4062-9341-a8eff13200fa req-90f38423-559e-49db-8a03-45a229474af6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:20.145858 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7140b14d-7abf-4062-9341-a8eff13200fa req-90f38423-559e-49db-8a03-45a229474af6 service nova] Creating event network-vif-plugged:6993adde-be55-4ee5-a441-ab52e2f48759 for instance d32f0ab1-346d-487a-aa08-ebd1656142a7 on n-h2-860892-1 Oct 11 04:26:20.146683 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7140b14d-7abf-4062-9341-a8eff13200fa req-90f38423-559e-49db-8a03-45a229474af6 service nova] Creating event network-vif-plugged:19904f71-1cd6-4db1-9e7e-42cc6e25cf8d for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:26:20.149987 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7140b14d-7abf-4062-9341-a8eff13200fa req-90f38423-559e-49db-8a03-45a229474af6 service nova] Creating event network-vif-plugged:1712ec47-14a1-4060-802b-107a47cc9b9d for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:26:20.160557 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-7140b14d-7abf-4062-9341-a8eff13200fa req-90f38423-559e-49db-8a03-45a229474af6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.080052 Oct 11 04:26:20.162865 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1718/3583] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:20.171525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:20.173190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:20.203739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:20.211046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:20.211046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:20.227468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:20.229160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:20.230059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:20.587035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-277294f4-d7e5-498c-a100-678bfea9ed06 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:20.602925 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-277294f4-d7e5-498c-a100-678bfea9ed06 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.887458 Oct 11 04:26:20.606097 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1866/3584] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:19 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:20.622640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f4faf613-95ac-47c3-9a19-d806ebff2ac3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:20.623676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f4faf613-95ac-47c3-9a19-d806ebff2ac3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:20.637603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4faf613-95ac-47c3-9a19-d806ebff2ac3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:20.649998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4faf613-95ac-47c3-9a19-d806ebff2ac3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:20.656688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4faf613-95ac-47c3-9a19-d806ebff2ac3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:20.656688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4faf613-95ac-47c3-9a19-d806ebff2ac3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:20.658089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4faf613-95ac-47c3-9a19-d806ebff2ac3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:20.660149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4faf613-95ac-47c3-9a19-d806ebff2ac3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:20.874205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:20.889796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:20.891292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:20.897150 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-afbc797e-066e-42b8-9dfd-9644d1bbe490 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.732005 Oct 11 04:26:20.898083 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1719/3585] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:20 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:26:20.906495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f7c8ea01-a616-424a-9f2b-11a596644b33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:20.907132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f7c8ea01-a616-424a-9f2b-11a596644b33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:20.932382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7c8ea01-a616-424a-9f2b-11a596644b33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:20.933551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7c8ea01-a616-424a-9f2b-11a596644b33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:20.934465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7c8ea01-a616-424a-9f2b-11a596644b33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:20.936256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7c8ea01-a616-424a-9f2b-11a596644b33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:20.936957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7c8ea01-a616-424a-9f2b-11a596644b33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:20.937949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7c8ea01-a616-424a-9f2b-11a596644b33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:20.949135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f4faf613-95ac-47c3-9a19-d806ebff2ac3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:20.977027 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f4faf613-95ac-47c3-9a19-d806ebff2ac3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1279 microversion: 2.1 time: 0.365200 Oct 11 04:26:20.994241 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1867/3586] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:20 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1279 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:21.104846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:21.105905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:21.123836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:21.126083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:21.126574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:21.131299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:21.131826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:21.134808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:21.186480 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c HTTP/1.1 Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '0baccb1e-5505-4df8-a290-46f39e25eb7c'} Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:26:21.193771 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:21.200101 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:26:21.200101 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:26:21.200101 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:26:21.200101 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:26:21.200101 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:26:21.200101 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:26:21.200101 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:26:21.200746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f7c8ea01-a616-424a-9f2b-11a596644b33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:21.204212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:26:21.206778 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a2d6eaa5-8f01-47e5-8000-53ed244ddbbb tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 404 len: 111 microversion: 2.1 time: 0.109782 Oct 11 04:26:21.210305 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1868/3587] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:21 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:26:21.216032 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f7c8ea01-a616-424a-9f2b-11a596644b33 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.310989 Oct 11 04:26:21.216032 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1720/3588] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:20 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:21.518366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-983708844", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "eb00258c-33f3-4e50-9b19-bfa956507201"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:21.634910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ecd2ac8e-41d1-4f8f-929a-3ea20ba5c55a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:21.635847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ecd2ac8e-41d1-4f8f-929a-3ea20ba5c55a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:21.655356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd2ac8e-41d1-4f8f-929a-3ea20ba5c55a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:21.662513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd2ac8e-41d1-4f8f-929a-3ea20ba5c55a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:21.667815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd2ac8e-41d1-4f8f-929a-3ea20ba5c55a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:21.668844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd2ac8e-41d1-4f8f-929a-3ea20ba5c55a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:21.670097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd2ac8e-41d1-4f8f-929a-3ea20ba5c55a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:21.671174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd2ac8e-41d1-4f8f-929a-3ea20ba5c55a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:21.713387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] validate_networks() for [('eb00258c-33f3-4e50-9b19-bfa956507201', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:26:21.762855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:22.303294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ecd2ac8e-41d1-4f8f-929a-3ea20ba5c55a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:22.314993 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ecd2ac8e-41d1-4f8f-929a-3ea20ba5c55a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.685819 Oct 11 04:26:22.315648 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1721/3589] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:21 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:22.321641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:22.322498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:22.329508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:22.342034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:22.342875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:22.343892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:22.345175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:22.353331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:22.827768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:22.837812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:22.844697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:22.845995 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aa7feb30-ccc9-4372-bb6b-dc3a0505a9ac tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1873 microversion: 2.32 time: 0.528647 Oct 11 04:26:22.846650 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1722/3590] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:22 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1873 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:26:22.875622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-25026061-e967-4b7c-8fe4-885a75f33217 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:22.880916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-25026061-e967-4b7c-8fe4-885a75f33217 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:22.896378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25026061-e967-4b7c-8fe4-885a75f33217 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:22.897253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25026061-e967-4b7c-8fe4-885a75f33217 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:22.897897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25026061-e967-4b7c-8fe4-885a75f33217 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:22.898868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25026061-e967-4b7c-8fe4-885a75f33217 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:22.899552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25026061-e967-4b7c-8fe4-885a75f33217 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:22.902472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25026061-e967-4b7c-8fe4-885a75f33217 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:23.004437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:26:23.004915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:26:23.005633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:26:23.006069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:26:23.006522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:26:23.017915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:23.019066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:23.020252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:23.024442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-25026061-e967-4b7c-8fe4-885a75f33217 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:23.033374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:23.039260 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-25026061-e967-4b7c-8fe4-885a75f33217 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1279 microversion: 2.1 time: 0.186511 Oct 11 04:26:23.039438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:23.039438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:23.039977 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1723/3591] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:22 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:23.045155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-97a56fe4-7c6b-48eb-bf89-85e4282db478 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:23.050178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-97a56fe4-7c6b-48eb-bf89-85e4282db478 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:23.061288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97a56fe4-7c6b-48eb-bf89-85e4282db478 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:23.064186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97a56fe4-7c6b-48eb-bf89-85e4282db478 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:23.064877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97a56fe4-7c6b-48eb-bf89-85e4282db478 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:23.069776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97a56fe4-7c6b-48eb-bf89-85e4282db478 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:23.069776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97a56fe4-7c6b-48eb-bf89-85e4282db478 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:23.069776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97a56fe4-7c6b-48eb-bf89-85e4282db478 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:23.085544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:26:23.095488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Getting quotas for user 99027798dcba4d52a9efc682ccc973d3 and project 4168fd89b10f4b9f96a29f41f769fca5. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:26:23.110450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:26:23.113277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:26:23.386787 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-806ee18a-a40e-42da-b190-d27e4bb27169 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.872037 Oct 11 04:26:23.391399 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1869/3592] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:26:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:26:23.400069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3423cb69-d9a6-4b88-bcc8-c928a91df3eb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:23.402533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3423cb69-d9a6-4b88-bcc8-c928a91df3eb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:23.413681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3423cb69-d9a6-4b88-bcc8-c928a91df3eb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:23.415282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3423cb69-d9a6-4b88-bcc8-c928a91df3eb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:23.415947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3423cb69-d9a6-4b88-bcc8-c928a91df3eb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:23.425688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3423cb69-d9a6-4b88-bcc8-c928a91df3eb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:23.429030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3423cb69-d9a6-4b88-bcc8-c928a91df3eb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:23.429030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3423cb69-d9a6-4b88-bcc8-c928a91df3eb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:23.689693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-97a56fe4-7c6b-48eb-bf89-85e4282db478 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:23.703152 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-97a56fe4-7c6b-48eb-bf89-85e4282db478 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 0.661905 Oct 11 04:26:23.707409 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1724/3593] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:23 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:23.719184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b5ebf656-39c2-4437-9b0f-f4bb9ea9fcf8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:23.729188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b5ebf656-39c2-4437-9b0f-f4bb9ea9fcf8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:23.991204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3423cb69-d9a6-4b88-bcc8-c928a91df3eb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:24.002498 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3423cb69-d9a6-4b88-bcc8-c928a91df3eb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.609662 Oct 11 04:26:24.028273 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1870/3594] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:23 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:24.031393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:24.032058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:24.039018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:24.039707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:24.040332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:24.041378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:24.041996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:24.042604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:24.222734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b5ebf656-39c2-4437-9b0f-f4bb9ea9fcf8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:24.230028 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b5ebf656-39c2-4437-9b0f-f4bb9ea9fcf8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1214 microversion: 2.1 time: 0.518662 Oct 11 04:26:24.230681 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1725/3595] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:23 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1214 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:24.240089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df9a1c9e-44fa-48ae-afc1-10731effa28b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:24.242938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-df9a1c9e-44fa-48ae-afc1-10731effa28b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:24.269967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df9a1c9e-44fa-48ae-afc1-10731effa28b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:24.273467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df9a1c9e-44fa-48ae-afc1-10731effa28b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:24.274213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df9a1c9e-44fa-48ae-afc1-10731effa28b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:24.277338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df9a1c9e-44fa-48ae-afc1-10731effa28b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:24.277338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df9a1c9e-44fa-48ae-afc1-10731effa28b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:24.279236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df9a1c9e-44fa-48ae-afc1-10731effa28b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:24.600084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:24.610116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:24.611617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:24.612888 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab913a78-0a92-4119-8eb7-e917ec4a75dc tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2824 microversion: 2.32 time: 0.588602 Oct 11 04:26:24.626565 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1871/3596] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:26:24 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2824 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:26:24.651356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ffaeeb52-9283-42c5-8d0b-b96b6ee93840 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:24.651846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ffaeeb52-9283-42c5-8d0b-b96b6ee93840 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:24.658670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb52-9283-42c5-8d0b-b96b6ee93840 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:24.659164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb52-9283-42c5-8d0b-b96b6ee93840 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:24.659601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb52-9283-42c5-8d0b-b96b6ee93840 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:24.660342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb52-9283-42c5-8d0b-b96b6ee93840 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:24.660797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb52-9283-42c5-8d0b-b96b6ee93840 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:24.661225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffaeeb52-9283-42c5-8d0b-b96b6ee93840 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:24.846514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-df9a1c9e-44fa-48ae-afc1-10731effa28b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:24.857188 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df9a1c9e-44fa-48ae-afc1-10731effa28b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.618238 Oct 11 04:26:24.857937 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1726/3597] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:24 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:24.873019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d2ec59f-6f30-4b8a-a195-4fedc08df3ae tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:24.873019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0d2ec59f-6f30-4b8a-a195-4fedc08df3ae tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:24.927619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d2ec59f-6f30-4b8a-a195-4fedc08df3ae tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:24.928806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d2ec59f-6f30-4b8a-a195-4fedc08df3ae tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:24.931423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d2ec59f-6f30-4b8a-a195-4fedc08df3ae tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:24.932384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d2ec59f-6f30-4b8a-a195-4fedc08df3ae tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:24.933949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d2ec59f-6f30-4b8a-a195-4fedc08df3ae tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:24.936066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d2ec59f-6f30-4b8a-a195-4fedc08df3ae tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:25.181585 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ffaeeb52-9283-42c5-8d0b-b96b6ee93840 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.534165 Oct 11 04:26:25.183111 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1872/3598] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Oct 11 04:26:24 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4/os-interface => generated 1830 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:26:25.188510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d3252718-94a0-4e87-85da-689bfe965733 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:25.189326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d3252718-94a0-4e87-85da-689bfe965733 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:25.211065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3252718-94a0-4e87-85da-689bfe965733 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:25.211585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3252718-94a0-4e87-85da-689bfe965733 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:25.212037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3252718-94a0-4e87-85da-689bfe965733 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:25.212767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3252718-94a0-4e87-85da-689bfe965733 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:25.213223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3252718-94a0-4e87-85da-689bfe965733 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:25.213652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3252718-94a0-4e87-85da-689bfe965733 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:25.969165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0d2ec59f-6f30-4b8a-a195-4fedc08df3ae tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:25.981713 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0d2ec59f-6f30-4b8a-a195-4fedc08df3ae tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 1.122601 Oct 11 04:26:25.989681 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1727/3599] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:24 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:26.000388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5194f8f4-4bfd-44aa-b9a9-723c42e7a781 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:26.001197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5194f8f4-4bfd-44aa-b9a9-723c42e7a781 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:26.008535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194f8f4-4bfd-44aa-b9a9-723c42e7a781 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:26.009034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194f8f4-4bfd-44aa-b9a9-723c42e7a781 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:26.009671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194f8f4-4bfd-44aa-b9a9-723c42e7a781 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:26.010587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194f8f4-4bfd-44aa-b9a9-723c42e7a781 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:26.011373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194f8f4-4bfd-44aa-b9a9-723c42e7a781 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:26.012376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194f8f4-4bfd-44aa-b9a9-723c42e7a781 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:26.106358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5194f8f4-4bfd-44aa-b9a9-723c42e7a781 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:26.114929 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5194f8f4-4bfd-44aa-b9a9-723c42e7a781 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1218 microversion: 2.1 time: 0.130923 Oct 11 04:26:26.115813 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1728/3600] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:25 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:26.120982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-704ece21-6240-46c8-923f-e5f011064e2a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:26.122463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-704ece21-6240-46c8-923f-e5f011064e2a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:26.127975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-704ece21-6240-46c8-923f-e5f011064e2a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:26.128594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-704ece21-6240-46c8-923f-e5f011064e2a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:26.129104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-704ece21-6240-46c8-923f-e5f011064e2a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:26.129873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-704ece21-6240-46c8-923f-e5f011064e2a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:26.130672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-704ece21-6240-46c8-923f-e5f011064e2a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:26.131263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-704ece21-6240-46c8-923f-e5f011064e2a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:26.273401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-704ece21-6240-46c8-923f-e5f011064e2a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:26.281619 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-704ece21-6240-46c8-923f-e5f011064e2a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.164642 Oct 11 04:26:26.282310 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1729/3601] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:26 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:26.451987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d3252718-94a0-4e87-85da-689bfe965733 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:26.463965 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d3252718-94a0-4e87-85da-689bfe965733 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 1.279612 Oct 11 04:26:26.478792 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1873/3602] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:25 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 1295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:26.651261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5f727f22-82b6-4d3d-b4b1-1dc71beb9ea6 req-3e9f401d-a440-4ab4-bc36-e2aed173f6f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4c4dd776-fc91-4486-b022-91b4b1c3fc3e", "tag": "0cd6a4d1-10e9-47d0-80e8-94343ad0cab2"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:26.684199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5f727f22-82b6-4d3d-b4b1-1dc71beb9ea6 req-3e9f401d-a440-4ab4-bc36-e2aed173f6f3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:26.684685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5f727f22-82b6-4d3d-b4b1-1dc71beb9ea6 req-3e9f401d-a440-4ab4-bc36-e2aed173f6f3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:26.685123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5f727f22-82b6-4d3d-b4b1-1dc71beb9ea6 req-3e9f401d-a440-4ab4-bc36-e2aed173f6f3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:26.720026 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5f727f22-82b6-4d3d-b4b1-1dc71beb9ea6 req-3e9f401d-a440-4ab4-bc36-e2aed173f6f3 service nova] Creating event network-changed:0cd6a4d1-10e9-47d0-80e8-94343ad0cab2 for instance 4c4dd776-fc91-4486-b022-91b4b1c3fc3e on n-h1-860892-1 Oct 11 04:26:26.725616 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5f727f22-82b6-4d3d-b4b1-1dc71beb9ea6 req-3e9f401d-a440-4ab4-bc36-e2aed173f6f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079946 Oct 11 04:26:26.726821 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1730/3603] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:27.009726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0809627d-024f-4899-97b1-75c58fd6de75 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:27.020288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0809627d-024f-4899-97b1-75c58fd6de75 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:27.032305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809627d-024f-4899-97b1-75c58fd6de75 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:27.034115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809627d-024f-4899-97b1-75c58fd6de75 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:27.039267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809627d-024f-4899-97b1-75c58fd6de75 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:27.039267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809627d-024f-4899-97b1-75c58fd6de75 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:27.039267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809627d-024f-4899-97b1-75c58fd6de75 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:27.040166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809627d-024f-4899-97b1-75c58fd6de75 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:27.145355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8911bc5-e33c-4795-922a-e8468f5e4a7f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:27.146699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a8911bc5-e33c-4795-922a-e8468f5e4a7f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:27.157229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8911bc5-e33c-4795-922a-e8468f5e4a7f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:27.157919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8911bc5-e33c-4795-922a-e8468f5e4a7f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:27.158599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8911bc5-e33c-4795-922a-e8468f5e4a7f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:27.160351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8911bc5-e33c-4795-922a-e8468f5e4a7f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:27.161501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8911bc5-e33c-4795-922a-e8468f5e4a7f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:27.162143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8911bc5-e33c-4795-922a-e8468f5e4a7f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:27.433651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a8911bc5-e33c-4795-922a-e8468f5e4a7f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:27.444819 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a8911bc5-e33c-4795-922a-e8468f5e4a7f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1266 microversion: 2.1 time: 0.305352 Oct 11 04:26:27.445404 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1731/3604] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:27 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1266 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:27.454366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-955d8f2e-3086-442e-bba3-01c318d87716 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:27.460503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-955d8f2e-3086-442e-bba3-01c318d87716 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:27.471784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-955d8f2e-3086-442e-bba3-01c318d87716 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:27.474839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-955d8f2e-3086-442e-bba3-01c318d87716 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:27.475541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-955d8f2e-3086-442e-bba3-01c318d87716 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:27.478868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-955d8f2e-3086-442e-bba3-01c318d87716 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:27.479588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-955d8f2e-3086-442e-bba3-01c318d87716 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:27.480495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-955d8f2e-3086-442e-bba3-01c318d87716 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:28.243485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0809627d-024f-4899-97b1-75c58fd6de75 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:28.260187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-955d8f2e-3086-442e-bba3-01c318d87716 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:28.271295 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-955d8f2e-3086-442e-bba3-01c318d87716 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.818926 Oct 11 04:26:28.272772 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0809627d-024f-4899-97b1-75c58fd6de75 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 1.263400 Oct 11 04:26:28.273675 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1732/3605] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:27 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:28.276655 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1874/3606] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:27 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:28.288671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c3bc75a-a26e-4c9e-bcd9-bfa6febc542e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:28.288671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1c3bc75a-a26e-4c9e-bcd9-bfa6febc542e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:28.299886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3bc75a-a26e-4c9e-bcd9-bfa6febc542e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:28.301214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3bc75a-a26e-4c9e-bcd9-bfa6febc542e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:28.301852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3bc75a-a26e-4c9e-bcd9-bfa6febc542e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:28.306298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3bc75a-a26e-4c9e-bcd9-bfa6febc542e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:28.306693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3bc75a-a26e-4c9e-bcd9-bfa6febc542e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:28.307306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c3bc75a-a26e-4c9e-bcd9-bfa6febc542e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:28.476541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df4e73c1-5704-4568-bde5-f68ab93401a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:28.478271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-df4e73c1-5704-4568-bde5-f68ab93401a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:28.484684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df4e73c1-5704-4568-bde5-f68ab93401a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:28.492981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df4e73c1-5704-4568-bde5-f68ab93401a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:28.494601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df4e73c1-5704-4568-bde5-f68ab93401a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:28.501034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df4e73c1-5704-4568-bde5-f68ab93401a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:28.501034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df4e73c1-5704-4568-bde5-f68ab93401a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:28.501034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df4e73c1-5704-4568-bde5-f68ab93401a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:28.780586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-df4e73c1-5704-4568-bde5-f68ab93401a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:28.794018 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-df4e73c1-5704-4568-bde5-f68ab93401a9 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1272 microversion: 2.1 time: 0.324731 Oct 11 04:26:28.796111 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1875/3607] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:28 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1272 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:28.828547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-77a86f49-ccc5-44a7-8705-101c72a7a795 req-8fc1614e-288a-4043-bd5d-2d1b92510531 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c80a9e3-3a40-4a91-98ab-6b1b223973f9", "tag": "6693ed13-00db-414b-bab4-33aaa5703c0c"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:28.849704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-77a86f49-ccc5-44a7-8705-101c72a7a795 req-8fc1614e-288a-4043-bd5d-2d1b92510531 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:28.852839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-77a86f49-ccc5-44a7-8705-101c72a7a795 req-8fc1614e-288a-4043-bd5d-2d1b92510531 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:28.857270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-77a86f49-ccc5-44a7-8705-101c72a7a795 req-8fc1614e-288a-4043-bd5d-2d1b92510531 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:28.885649 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-77a86f49-ccc5-44a7-8705-101c72a7a795 req-8fc1614e-288a-4043-bd5d-2d1b92510531 service nova] Creating event network-changed:6693ed13-00db-414b-bab4-33aaa5703c0c for instance 5c80a9e3-3a40-4a91-98ab-6b1b223973f9 on n-h1-860892-1 Oct 11 04:26:28.900775 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-77a86f49-ccc5-44a7-8705-101c72a7a795 req-8fc1614e-288a-4043-bd5d-2d1b92510531 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084316 Oct 11 04:26:28.904071 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1876/3608] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:28.919927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b13b1696-b2af-4f55-9719-bf27bada084b req-c15b119f-7a62-4483-8268-367d8c2c552b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e848340-de82-48aa-8c66-78908ccdd948", "tag": "069dbacb-caef-4334-a4cd-7c8bb4a6d223"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:28.948290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b13b1696-b2af-4f55-9719-bf27bada084b req-c15b119f-7a62-4483-8268-367d8c2c552b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:28.949881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b13b1696-b2af-4f55-9719-bf27bada084b req-c15b119f-7a62-4483-8268-367d8c2c552b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:28.950672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b13b1696-b2af-4f55-9719-bf27bada084b req-c15b119f-7a62-4483-8268-367d8c2c552b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:28.980111 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b13b1696-b2af-4f55-9719-bf27bada084b req-c15b119f-7a62-4483-8268-367d8c2c552b service nova] Creating event network-changed:069dbacb-caef-4334-a4cd-7c8bb4a6d223 for instance 7e848340-de82-48aa-8c66-78908ccdd948 on n-h1-860892-1 Oct 11 04:26:28.992299 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b13b1696-b2af-4f55-9719-bf27bada084b req-c15b119f-7a62-4483-8268-367d8c2c552b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082773 Oct 11 04:26:28.997402 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1877/3609] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:29.301069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-79c76ff1-abe9-4bd4-b387-698950955c92 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:29.301832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-79c76ff1-abe9-4bd4-b387-698950955c92 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:29.320346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79c76ff1-abe9-4bd4-b387-698950955c92 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:29.324585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79c76ff1-abe9-4bd4-b387-698950955c92 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:29.328519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79c76ff1-abe9-4bd4-b387-698950955c92 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:29.329493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79c76ff1-abe9-4bd4-b387-698950955c92 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:29.334749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79c76ff1-abe9-4bd4-b387-698950955c92 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:29.336760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79c76ff1-abe9-4bd4-b387-698950955c92 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:29.378320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1c3bc75a-a26e-4c9e-bcd9-bfa6febc542e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:29.400202 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c3bc75a-a26e-4c9e-bcd9-bfa6febc542e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 1.125139 Oct 11 04:26:29.401060 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1733/3610] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:28 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:29.424379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-343714b6-d35d-4fda-90d5-dec71e79eb63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:29.425366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-343714b6-d35d-4fda-90d5-dec71e79eb63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:29.457798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-343714b6-d35d-4fda-90d5-dec71e79eb63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:29.459287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-343714b6-d35d-4fda-90d5-dec71e79eb63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:29.461641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-343714b6-d35d-4fda-90d5-dec71e79eb63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:29.462672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-343714b6-d35d-4fda-90d5-dec71e79eb63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:29.465464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-343714b6-d35d-4fda-90d5-dec71e79eb63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:29.467226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-343714b6-d35d-4fda-90d5-dec71e79eb63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:29.872567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-79c76ff1-abe9-4bd4-b387-698950955c92 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:29.891968 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-79c76ff1-abe9-4bd4-b387-698950955c92 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.597196 Oct 11 04:26:29.897542 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1878/3611] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:29 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:29.907074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca89ea42-4c64-461e-a87b-cd38f11ba206 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:29.911563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ca89ea42-4c64-461e-a87b-cd38f11ba206 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:29.932622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca89ea42-4c64-461e-a87b-cd38f11ba206 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:29.934814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca89ea42-4c64-461e-a87b-cd38f11ba206 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:29.937635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca89ea42-4c64-461e-a87b-cd38f11ba206 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:29.943730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca89ea42-4c64-461e-a87b-cd38f11ba206 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:29.944331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca89ea42-4c64-461e-a87b-cd38f11ba206 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:29.944880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca89ea42-4c64-461e-a87b-cd38f11ba206 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:30.407439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ca89ea42-4c64-461e-a87b-cd38f11ba206 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:30.432787 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ca89ea42-4c64-461e-a87b-cd38f11ba206 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1272 microversion: 2.1 time: 0.526497 Oct 11 04:26:30.460894 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1879/3612] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:29 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1272 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:30.492428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-474bd2a5-40f9-4a7c-8108-e25ef2f67786 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:30.506386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-474bd2a5-40f9-4a7c-8108-e25ef2f67786 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:30.562751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-474bd2a5-40f9-4a7c-8108-e25ef2f67786 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:30.564593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-474bd2a5-40f9-4a7c-8108-e25ef2f67786 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:30.566510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-474bd2a5-40f9-4a7c-8108-e25ef2f67786 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:30.568358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-474bd2a5-40f9-4a7c-8108-e25ef2f67786 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:30.569719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-474bd2a5-40f9-4a7c-8108-e25ef2f67786 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:30.572175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-474bd2a5-40f9-4a7c-8108-e25ef2f67786 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:30.907251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-474bd2a5-40f9-4a7c-8108-e25ef2f67786 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:30.916958 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-474bd2a5-40f9-4a7c-8108-e25ef2f67786 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.446131 Oct 11 04:26:30.917547 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1880/3613] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:30 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:30.937296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c13ebca-3906-4156-b0a8-d52b75aed2bc tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:30.937924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2c13ebca-3906-4156-b0a8-d52b75aed2bc tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:30.967622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c13ebca-3906-4156-b0a8-d52b75aed2bc tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:30.968456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c13ebca-3906-4156-b0a8-d52b75aed2bc tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:30.970531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c13ebca-3906-4156-b0a8-d52b75aed2bc tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:30.981147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c13ebca-3906-4156-b0a8-d52b75aed2bc tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:30.981974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c13ebca-3906-4156-b0a8-d52b75aed2bc tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:30.987833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c13ebca-3906-4156-b0a8-d52b75aed2bc tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:31.526628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2c13ebca-3906-4156-b0a8-d52b75aed2bc tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:31.533391 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c13ebca-3906-4156-b0a8-d52b75aed2bc tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.604258 Oct 11 04:26:31.540873 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1881/3614] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:30 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:31.573330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6b4ced85-b43a-409c-9628-ed6e3ebcc91d req-36a94718-ffc3-4192-9ddc-e583d2a171aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "tag": "d5ed01b4-6c79-4f61-b2fb-415cf63f9a6f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:31.637022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6b4ced85-b43a-409c-9628-ed6e3ebcc91d req-36a94718-ffc3-4192-9ddc-e583d2a171aa service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:31.642021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6b4ced85-b43a-409c-9628-ed6e3ebcc91d req-36a94718-ffc3-4192-9ddc-e583d2a171aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:31.643210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6b4ced85-b43a-409c-9628-ed6e3ebcc91d req-36a94718-ffc3-4192-9ddc-e583d2a171aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:31.693584 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6b4ced85-b43a-409c-9628-ed6e3ebcc91d req-36a94718-ffc3-4192-9ddc-e583d2a171aa service nova] Creating event network-changed:d5ed01b4-6c79-4f61-b2fb-415cf63f9a6f for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:26:31.700856 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6b4ced85-b43a-409c-9628-ed6e3ebcc91d req-36a94718-ffc3-4192-9ddc-e583d2a171aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142598 Oct 11 04:26:31.714154 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1882/3615] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:31.723557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8204104a-7c76-4954-a823-6176cf827931 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:31.725959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8204104a-7c76-4954-a823-6176cf827931 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:31.769525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8204104a-7c76-4954-a823-6176cf827931 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:31.772154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8204104a-7c76-4954-a823-6176cf827931 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:31.772884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8204104a-7c76-4954-a823-6176cf827931 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:31.777250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8204104a-7c76-4954-a823-6176cf827931 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:31.777250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8204104a-7c76-4954-a823-6176cf827931 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:31.777250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8204104a-7c76-4954-a823-6176cf827931 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:31.967021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8204104a-7c76-4954-a823-6176cf827931 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:32.004187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:32.008082 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8204104a-7c76-4954-a823-6176cf827931 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1272 microversion: 2.1 time: 0.299250 Oct 11 04:26:32.009364 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1883/3616] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:31 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1272 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:32.043836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f33d9608-a330-4c47-90d9-e74ee676b48a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:32.044935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f33d9608-a330-4c47-90d9-e74ee676b48a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:32.078057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f33d9608-a330-4c47-90d9-e74ee676b48a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:32.078568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f33d9608-a330-4c47-90d9-e74ee676b48a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:32.079062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f33d9608-a330-4c47-90d9-e74ee676b48a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:32.101353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f33d9608-a330-4c47-90d9-e74ee676b48a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:32.101353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f33d9608-a330-4c47-90d9-e74ee676b48a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:32.101353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f33d9608-a330-4c47-90d9-e74ee676b48a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:32.904454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-343714b6-d35d-4fda-90d5-dec71e79eb63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:32.917468 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-343714b6-d35d-4fda-90d5-dec71e79eb63 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1719 microversion: 2.1 time: 3.514874 Oct 11 04:26:32.922302 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1734/3617] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:29 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1719 bytes in 3520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:32.935673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8d9d999a-f1a7-43e8-98b3-7ac322225878 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:32.936611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8d9d999a-f1a7-43e8-98b3-7ac322225878 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:32.948027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d9d999a-f1a7-43e8-98b3-7ac322225878 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:32.948784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d9d999a-f1a7-43e8-98b3-7ac322225878 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:32.950620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d9d999a-f1a7-43e8-98b3-7ac322225878 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:32.950889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d9d999a-f1a7-43e8-98b3-7ac322225878 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:32.951351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d9d999a-f1a7-43e8-98b3-7ac322225878 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:32.955841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d9d999a-f1a7-43e8-98b3-7ac322225878 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:33.051129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:33.104739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=24 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:33.201967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8d9d999a-f1a7-43e8-98b3-7ac322225878 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:33.219774 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8d9d999a-f1a7-43e8-98b3-7ac322225878 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.288815 Oct 11 04:26:33.220995 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1735/3618] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:32 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:33.231918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c9f0280-40a9-4463-89fe-2d1e1edf0145 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:33.234425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5c9f0280-40a9-4463-89fe-2d1e1edf0145 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:33.250696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c9f0280-40a9-4463-89fe-2d1e1edf0145 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:33.251409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c9f0280-40a9-4463-89fe-2d1e1edf0145 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:33.253849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c9f0280-40a9-4463-89fe-2d1e1edf0145 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:33.254771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c9f0280-40a9-4463-89fe-2d1e1edf0145 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:33.262347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c9f0280-40a9-4463-89fe-2d1e1edf0145 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:33.264977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c9f0280-40a9-4463-89fe-2d1e1edf0145 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:33.571817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f33d9608-a330-4c47-90d9-e74ee676b48a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:33.602262 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f33d9608-a330-4c47-90d9-e74ee676b48a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 1.587800 Oct 11 04:26:33.604600 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1884/3619] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:32 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 1594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:33.948212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a7a8b1d0-1df3-47e1-8bee-9b8ad3c38c61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:33.949385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a7a8b1d0-1df3-47e1-8bee-9b8ad3c38c61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:33.958877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7a8b1d0-1df3-47e1-8bee-9b8ad3c38c61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:33.959829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7a8b1d0-1df3-47e1-8bee-9b8ad3c38c61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:33.960612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7a8b1d0-1df3-47e1-8bee-9b8ad3c38c61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:33.961830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7a8b1d0-1df3-47e1-8bee-9b8ad3c38c61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:33.963086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7a8b1d0-1df3-47e1-8bee-9b8ad3c38c61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:33.963808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7a8b1d0-1df3-47e1-8bee-9b8ad3c38c61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:34.119103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5c9f0280-40a9-4463-89fe-2d1e1edf0145 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:34.135517 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5c9f0280-40a9-4463-89fe-2d1e1edf0145 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1314 microversion: 2.1 time: 0.912978 Oct 11 04:26:34.136861 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1736/3620] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:33 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1314 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:34.247339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f1fc2c1-fc23-4f70-a08d-0af330db6594 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:34.248570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f1fc2c1-fc23-4f70-a08d-0af330db6594 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:34.257816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:34.271118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1fc2c1-fc23-4f70-a08d-0af330db6594 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:34.278851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1fc2c1-fc23-4f70-a08d-0af330db6594 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:34.280013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1fc2c1-fc23-4f70-a08d-0af330db6594 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:34.280992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1fc2c1-fc23-4f70-a08d-0af330db6594 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:34.281844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1fc2c1-fc23-4f70-a08d-0af330db6594 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:34.282666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f1fc2c1-fc23-4f70-a08d-0af330db6594 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:34.283960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a7a8b1d0-1df3-47e1-8bee-9b8ad3c38c61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:34.296994 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a7a8b1d0-1df3-47e1-8bee-9b8ad3c38c61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1709 microversion: 2.1 time: 0.355389 Oct 11 04:26:34.309091 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1885/3621] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:33 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1709 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:34.332158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-779776c3-6cd1-4b5e-9ebf-28f1a3dedd00 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '.version_select at 0x7fda19e34dc0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:34.335836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-779776c3-6cd1-4b5e-9ebf-28f1a3dedd00 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:34.336404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-779776c3-6cd1-4b5e-9ebf-28f1a3dedd00 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:34.336888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-779776c3-6cd1-4b5e-9ebf-28f1a3dedd00 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:34.362015 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-779776c3-6cd1-4b5e-9ebf-28f1a3dedd00 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1168 microversion: 2.1 time: 0.033625 Oct 11 04:26:34.370553 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1886/3622] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:26:34 2022] GET /compute/v2.1/os-migrations => generated 1168 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:34.379519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6594cae4-0c1f-47ff-9d77-0d6f179f0766 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:34.381456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6594cae4-0c1f-47ff-9d77-0d6f179f0766 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:34.395917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6594cae4-0c1f-47ff-9d77-0d6f179f0766 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:34.396420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6594cae4-0c1f-47ff-9d77-0d6f179f0766 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:34.398965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6594cae4-0c1f-47ff-9d77-0d6f179f0766 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:34.401210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6594cae4-0c1f-47ff-9d77-0d6f179f0766 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:34.402226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6594cae4-0c1f-47ff-9d77-0d6f179f0766 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:34.404161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6594cae4-0c1f-47ff-9d77-0d6f179f0766 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:34.762409 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6594cae4-0c1f-47ff-9d77-0d6f179f0766 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1860 microversion: 2.1 time: 0.386770 Oct 11 04:26:34.773980 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1887/3623] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:34 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1860 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:34.789197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-386e712d-b647-45ab-9dab-2e7e31547b1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:34.790217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-386e712d-b647-45ab-9dab-2e7e31547b1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:34.797172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-386e712d-b647-45ab-9dab-2e7e31547b1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:34.798131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-386e712d-b647-45ab-9dab-2e7e31547b1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:34.798839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-386e712d-b647-45ab-9dab-2e7e31547b1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:34.799787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-386e712d-b647-45ab-9dab-2e7e31547b1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:34.800526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-386e712d-b647-45ab-9dab-2e7e31547b1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:34.801181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-386e712d-b647-45ab-9dab-2e7e31547b1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:35.029012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f1fc2c1-fc23-4f70-a08d-0af330db6594 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:35.043444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-386e712d-b647-45ab-9dab-2e7e31547b1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:35.045138 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f1fc2c1-fc23-4f70-a08d-0af330db6594 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.800593 Oct 11 04:26:35.048829 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1737/3624] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:34 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:35.055659 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-386e712d-b647-45ab-9dab-2e7e31547b1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.275909 Oct 11 04:26:35.072362 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1888/3625] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:34 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:35.088214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-83d1744c-1a5b-47e1-9d86-ef75d9d1b6da tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:35.091441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-83d1744c-1a5b-47e1-9d86-ef75d9d1b6da tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:35.106862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83d1744c-1a5b-47e1-9d86-ef75d9d1b6da tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:35.108362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83d1744c-1a5b-47e1-9d86-ef75d9d1b6da tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:35.110798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83d1744c-1a5b-47e1-9d86-ef75d9d1b6da tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:35.112038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83d1744c-1a5b-47e1-9d86-ef75d9d1b6da tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:35.113310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83d1744c-1a5b-47e1-9d86-ef75d9d1b6da tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:35.115507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83d1744c-1a5b-47e1-9d86-ef75d9d1b6da tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:35.161047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e67d846d-7a41-414d-9e3c-086df513a6c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:35.162131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e67d846d-7a41-414d-9e3c-086df513a6c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:35.172175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e67d846d-7a41-414d-9e3c-086df513a6c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:35.173623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e67d846d-7a41-414d-9e3c-086df513a6c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:35.178593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e67d846d-7a41-414d-9e3c-086df513a6c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:35.178593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e67d846d-7a41-414d-9e3c-086df513a6c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:35.178593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e67d846d-7a41-414d-9e3c-086df513a6c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:35.178593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e67d846d-7a41-414d-9e3c-086df513a6c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:35.597518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e67d846d-7a41-414d-9e3c-086df513a6c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:35.629443 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e67d846d-7a41-414d-9e3c-086df513a6c5 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1314 microversion: 2.1 time: 0.472333 Oct 11 04:26:35.647784 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1889/3626] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:35 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1314 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:35.984465 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-83d1744c-1a5b-47e1-9d86-ef75d9d1b6da tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1860 microversion: 2.1 time: 0.933426 Oct 11 04:26:35.985598 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1738/3627] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:35 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1860 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:36.078527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a5c3cad2-973d-49b6-bc99-ec15386ec7da tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:36.078527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a5c3cad2-973d-49b6-bc99-ec15386ec7da tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:36.089343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5c3cad2-973d-49b6-bc99-ec15386ec7da tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:36.100903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5c3cad2-973d-49b6-bc99-ec15386ec7da tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:36.100903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5c3cad2-973d-49b6-bc99-ec15386ec7da tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:36.101362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8486d676-eb3e-4239-9feb-6cc66649d26c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:36.101362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8486d676-eb3e-4239-9feb-6cc66649d26c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:36.101565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5c3cad2-973d-49b6-bc99-ec15386ec7da tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:36.101565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5c3cad2-973d-49b6-bc99-ec15386ec7da tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:36.101565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5c3cad2-973d-49b6-bc99-ec15386ec7da tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:36.104000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8486d676-eb3e-4239-9feb-6cc66649d26c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:36.106496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8486d676-eb3e-4239-9feb-6cc66649d26c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:36.107229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8486d676-eb3e-4239-9feb-6cc66649d26c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:36.108176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8486d676-eb3e-4239-9feb-6cc66649d26c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:36.112073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8486d676-eb3e-4239-9feb-6cc66649d26c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:36.112529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8486d676-eb3e-4239-9feb-6cc66649d26c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:36.352510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a5c3cad2-973d-49b6-bc99-ec15386ec7da tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:36.362944 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a5c3cad2-973d-49b6-bc99-ec15386ec7da tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.291616 Oct 11 04:26:36.376646 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1890/3628] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:36 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:36.392292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6aa39e67-fdbc-40e4-8996-46aa712c5f80 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:36.393267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6aa39e67-fdbc-40e4-8996-46aa712c5f80 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:36.405163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aa39e67-fdbc-40e4-8996-46aa712c5f80 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:36.409098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aa39e67-fdbc-40e4-8996-46aa712c5f80 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:36.409719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aa39e67-fdbc-40e4-8996-46aa712c5f80 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:36.410557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aa39e67-fdbc-40e4-8996-46aa712c5f80 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:36.413188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aa39e67-fdbc-40e4-8996-46aa712c5f80 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:36.413775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aa39e67-fdbc-40e4-8996-46aa712c5f80 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:36.591346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-6aa39e67-fdbc-40e4-8996-46aa712c5f80 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lazy-loading 'services' on Instance uuid f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:26:36.858514 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6aa39e67-fdbc-40e4-8996-46aa712c5f80 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments/a2b2f40e-cb55-4cec-82df-6fe385e35b77" status: 202 len: 0 microversion: 2.1 time: 0.476788 Oct 11 04:26:36.860458 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1891/3629] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:26:36 2022] DELETE /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments/a2b2f40e-cb55-4cec-82df-6fe385e35b77 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:26:36.881432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b3dc4ffb-18e8-4819-b88c-c361a013d195 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:36.882612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b3dc4ffb-18e8-4819-b88c-c361a013d195 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:36.891811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3dc4ffb-18e8-4819-b88c-c361a013d195 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:36.892759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3dc4ffb-18e8-4819-b88c-c361a013d195 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:36.894124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3dc4ffb-18e8-4819-b88c-c361a013d195 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:36.895708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3dc4ffb-18e8-4819-b88c-c361a013d195 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:36.896459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3dc4ffb-18e8-4819-b88c-c361a013d195 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:36.897482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3dc4ffb-18e8-4819-b88c-c361a013d195 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:37.038140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8486d676-eb3e-4239-9feb-6cc66649d26c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:37.044999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:37.048740 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8486d676-eb3e-4239-9feb-6cc66649d26c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.967188 Oct 11 04:26:37.053225 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1739/3630] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:36 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 972 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:37.073788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ea83da7-7714-4dc5-9616-050ad5ad66cc tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:37.076454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2ea83da7-7714-4dc5-9616-050ad5ad66cc tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:37.101679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ea83da7-7714-4dc5-9616-050ad5ad66cc tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:37.102565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ea83da7-7714-4dc5-9616-050ad5ad66cc tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:37.103254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ea83da7-7714-4dc5-9616-050ad5ad66cc tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:37.104449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ea83da7-7714-4dc5-9616-050ad5ad66cc tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:37.105125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ea83da7-7714-4dc5-9616-050ad5ad66cc tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:37.105789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ea83da7-7714-4dc5-9616-050ad5ad66cc tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:37.164813 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2ea83da7-7714-4dc5-9616-050ad5ad66cc tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.110223 Oct 11 04:26:37.167638 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1740/3631] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:26:37 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments => generated 197 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:37.195143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b3dc4ffb-18e8-4819-b88c-c361a013d195 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:37.205484 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b3dc4ffb-18e8-4819-b88c-c361a013d195 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1314 microversion: 2.1 time: 0.343350 Oct 11 04:26:37.211291 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1892/3632] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:36 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1314 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:37.409240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e3ce573-ef87-49bc-b233-35e23c7700dd tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:37.409240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4e3ce573-ef87-49bc-b233-35e23c7700dd tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:37.448374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e3ce573-ef87-49bc-b233-35e23c7700dd tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:37.448946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e3ce573-ef87-49bc-b233-35e23c7700dd tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:37.449415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e3ce573-ef87-49bc-b233-35e23c7700dd tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:37.450222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e3ce573-ef87-49bc-b233-35e23c7700dd tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:37.450734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e3ce573-ef87-49bc-b233-35e23c7700dd tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:37.451237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e3ce573-ef87-49bc-b233-35e23c7700dd tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:37.764661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e166e36b-eb0b-4db2-a3ca-b5409bb2cff9 req-55df51cb-c2af-4168-b864-e4b38cbf34be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e848340-de82-48aa-8c66-78908ccdd948", "name": "network-vif-plugged", "status": "completed", "tag": "069dbacb-caef-4334-a4cd-7c8bb4a6d223"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:37.785812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e166e36b-eb0b-4db2-a3ca-b5409bb2cff9 req-55df51cb-c2af-4168-b864-e4b38cbf34be service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:37.789762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e166e36b-eb0b-4db2-a3ca-b5409bb2cff9 req-55df51cb-c2af-4168-b864-e4b38cbf34be service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:37.795899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e166e36b-eb0b-4db2-a3ca-b5409bb2cff9 req-55df51cb-c2af-4168-b864-e4b38cbf34be service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:37.818215 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e166e36b-eb0b-4db2-a3ca-b5409bb2cff9 req-55df51cb-c2af-4168-b864-e4b38cbf34be service nova] Creating event network-vif-plugged:069dbacb-caef-4334-a4cd-7c8bb4a6d223 for instance 7e848340-de82-48aa-8c66-78908ccdd948 on n-h1-860892-1 Oct 11 04:26:37.838998 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e166e36b-eb0b-4db2-a3ca-b5409bb2cff9 req-55df51cb-c2af-4168-b864-e4b38cbf34be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078040 Oct 11 04:26:37.840469 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1893/3633] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:26:38.020815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a11bfc1d-91c9-4bfe-8549-7929eb26fb1f req-18315c44-4824-46a3-8f5b-eeaed11c7536 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38cd4d92-fbc8-4d90-b1d7-06896821816c", "tag": "40b8da08-b4a5-4822-bd38-5b5993d50d42"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:38.045818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a11bfc1d-91c9-4bfe-8549-7929eb26fb1f req-18315c44-4824-46a3-8f5b-eeaed11c7536 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:38.051171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a11bfc1d-91c9-4bfe-8549-7929eb26fb1f req-18315c44-4824-46a3-8f5b-eeaed11c7536 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:38.051935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a11bfc1d-91c9-4bfe-8549-7929eb26fb1f req-18315c44-4824-46a3-8f5b-eeaed11c7536 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:38.106045 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a11bfc1d-91c9-4bfe-8549-7929eb26fb1f req-18315c44-4824-46a3-8f5b-eeaed11c7536 service nova] Creating event network-changed:40b8da08-b4a5-4822-bd38-5b5993d50d42 for instance 38cd4d92-fbc8-4d90-b1d7-06896821816c on n-h2-860892-1 Oct 11 04:26:38.118128 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a11bfc1d-91c9-4bfe-8549-7929eb26fb1f req-18315c44-4824-46a3-8f5b-eeaed11c7536 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109377 Oct 11 04:26:38.121985 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1894/3634] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:38.133753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-917cbd3b-dd95-404b-b259-9e93e0d7ab9c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:38.137660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-917cbd3b-dd95-404b-b259-9e93e0d7ab9c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:38.154393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:38.159212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917cbd3b-dd95-404b-b259-9e93e0d7ab9c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:38.159896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917cbd3b-dd95-404b-b259-9e93e0d7ab9c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:38.160668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917cbd3b-dd95-404b-b259-9e93e0d7ab9c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:38.164399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917cbd3b-dd95-404b-b259-9e93e0d7ab9c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:38.169013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917cbd3b-dd95-404b-b259-9e93e0d7ab9c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:38.169559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-917cbd3b-dd95-404b-b259-9e93e0d7ab9c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:38.395265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-917cbd3b-dd95-404b-b259-9e93e0d7ab9c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:38.404615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-917cbd3b-dd95-404b-b259-9e93e0d7ab9c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1681 microversion: 2.1 time: 0.279086 Oct 11 04:26:38.429570 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1895/3635] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:38 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1681 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:38.436812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-addff128-bc25-43ba-9101-7e2a5fea5cd3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:38.439608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-addff128-bc25-43ba-9101-7e2a5fea5cd3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:38.446267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addff128-bc25-43ba-9101-7e2a5fea5cd3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:38.446762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addff128-bc25-43ba-9101-7e2a5fea5cd3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:38.448011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addff128-bc25-43ba-9101-7e2a5fea5cd3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:38.448787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addff128-bc25-43ba-9101-7e2a5fea5cd3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:38.449611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addff128-bc25-43ba-9101-7e2a5fea5cd3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:38.450200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-addff128-bc25-43ba-9101-7e2a5fea5cd3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:38.486821 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-addff128-bc25-43ba-9101-7e2a5fea5cd3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055933 Oct 11 04:26:38.487410 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1896/3636] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:26:38 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:38.493332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0c639356-ca0a-40c9-9a53-79574ee47882 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:38.496359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0c639356-ca0a-40c9-9a53-79574ee47882 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:38.500761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c639356-ca0a-40c9-9a53-79574ee47882 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:38.501319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c639356-ca0a-40c9-9a53-79574ee47882 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:38.501753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c639356-ca0a-40c9-9a53-79574ee47882 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:38.502540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c639356-ca0a-40c9-9a53-79574ee47882 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:38.502990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c639356-ca0a-40c9-9a53-79574ee47882 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:38.503527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c639356-ca0a-40c9-9a53-79574ee47882 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:38.553860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4e3ce573-ef87-49bc-b233-35e23c7700dd tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:38.571650 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4e3ce573-ef87-49bc-b233-35e23c7700dd tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 1.170562 Oct 11 04:26:38.574147 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1741/3637] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:37 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 1174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:38.722672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0c639356-ca0a-40c9-9a53-79574ee47882 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:38.732361 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0c639356-ca0a-40c9-9a53-79574ee47882 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1314 microversion: 2.1 time: 0.242536 Oct 11 04:26:38.732361 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1897/3638] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:38 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:39.435480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-06a849a1-fd70-4789-a69b-f7fa7ee0d6f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:39.436449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-06a849a1-fd70-4789-a69b-f7fa7ee0d6f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:39.450850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06a849a1-fd70-4789-a69b-f7fa7ee0d6f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:39.451640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06a849a1-fd70-4789-a69b-f7fa7ee0d6f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:39.452679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06a849a1-fd70-4789-a69b-f7fa7ee0d6f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:39.459354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06a849a1-fd70-4789-a69b-f7fa7ee0d6f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:39.460108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06a849a1-fd70-4789-a69b-f7fa7ee0d6f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:39.466782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06a849a1-fd70-4789-a69b-f7fa7ee0d6f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:39.915018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dc336179-89c6-46ce-a76c-24a9341c2628 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:39.918376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dc336179-89c6-46ce-a76c-24a9341c2628 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:39.931617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc336179-89c6-46ce-a76c-24a9341c2628 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:39.934470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc336179-89c6-46ce-a76c-24a9341c2628 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:39.935979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc336179-89c6-46ce-a76c-24a9341c2628 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:39.938033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc336179-89c6-46ce-a76c-24a9341c2628 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:39.941637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc336179-89c6-46ce-a76c-24a9341c2628 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:39.942412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc336179-89c6-46ce-a76c-24a9341c2628 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:40.017254 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dc336179-89c6-46ce-a76c-24a9341c2628 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.519468 Oct 11 04:26:40.022872 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1898/3639] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:26:39 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments => generated 197 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:40.054002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0fbe201f-5474-4dbf-92ec-17011a83067d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:40.055150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0fbe201f-5474-4dbf-92ec-17011a83067d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:40.079464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fbe201f-5474-4dbf-92ec-17011a83067d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:40.081535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fbe201f-5474-4dbf-92ec-17011a83067d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:40.085664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fbe201f-5474-4dbf-92ec-17011a83067d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:40.087917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fbe201f-5474-4dbf-92ec-17011a83067d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:40.089838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fbe201f-5474-4dbf-92ec-17011a83067d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:40.090852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fbe201f-5474-4dbf-92ec-17011a83067d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:40.278613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-06a849a1-fd70-4789-a69b-f7fa7ee0d6f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:40.290059 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-06a849a1-fd70-4789-a69b-f7fa7ee0d6f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.858600 Oct 11 04:26:40.296239 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1742/3640] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:39 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 865 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:40.307568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7952eafc-86bb-40c0-9bf2-5938049cdb31 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:40.308308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7952eafc-86bb-40c0-9bf2-5938049cdb31 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:40.346049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7952eafc-86bb-40c0-9bf2-5938049cdb31 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:40.355951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7952eafc-86bb-40c0-9bf2-5938049cdb31 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:40.357310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7952eafc-86bb-40c0-9bf2-5938049cdb31 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:40.358365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7952eafc-86bb-40c0-9bf2-5938049cdb31 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:40.359018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7952eafc-86bb-40c0-9bf2-5938049cdb31 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:40.359644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7952eafc-86bb-40c0-9bf2-5938049cdb31 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:40.484158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0fbe201f-5474-4dbf-92ec-17011a83067d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:40.492520 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0fbe201f-5474-4dbf-92ec-17011a83067d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.467651 Oct 11 04:26:40.511557 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1899/3641] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:40 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:40.517675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-be08f650-252e-4d15-8f93-1ca40c7f4dbd req-cc4c5940-f9ea-4c3e-9223-fe47a7bca086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4dd776-fc91-4486-b022-91b4b1c3fc3e", "name": "network-vif-plugged", "status": "completed", "tag": "0cd6a4d1-10e9-47d0-80e8-94343ad0cab2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:40.544868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-be08f650-252e-4d15-8f93-1ca40c7f4dbd req-cc4c5940-f9ea-4c3e-9223-fe47a7bca086 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:40.549488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-be08f650-252e-4d15-8f93-1ca40c7f4dbd req-cc4c5940-f9ea-4c3e-9223-fe47a7bca086 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:40.549488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-be08f650-252e-4d15-8f93-1ca40c7f4dbd req-cc4c5940-f9ea-4c3e-9223-fe47a7bca086 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:40.573607 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-be08f650-252e-4d15-8f93-1ca40c7f4dbd req-cc4c5940-f9ea-4c3e-9223-fe47a7bca086 service nova] Creating event network-vif-plugged:0cd6a4d1-10e9-47d0-80e8-94343ad0cab2 for instance 4c4dd776-fc91-4486-b022-91b4b1c3fc3e on n-h1-860892-1 Oct 11 04:26:40.583768 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-be08f650-252e-4d15-8f93-1ca40c7f4dbd req-cc4c5940-f9ea-4c3e-9223-fe47a7bca086 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070587 Oct 11 04:26:40.584597 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1900/3642] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:41.035254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fd77bb5d-957a-4124-9a00-718890f2d937 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:41.043493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fd77bb5d-957a-4124-9a00-718890f2d937 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:41.060781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd77bb5d-957a-4124-9a00-718890f2d937 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:41.068071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd77bb5d-957a-4124-9a00-718890f2d937 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:41.068071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd77bb5d-957a-4124-9a00-718890f2d937 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:41.068071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd77bb5d-957a-4124-9a00-718890f2d937 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:41.068071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd77bb5d-957a-4124-9a00-718890f2d937 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:41.068071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd77bb5d-957a-4124-9a00-718890f2d937 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:41.126106 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fd77bb5d-957a-4124-9a00-718890f2d937 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.100260 Oct 11 04:26:41.131961 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1901/3643] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:26:41 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:26:41.505894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7952eafc-86bb-40c0-9bf2-5938049cdb31 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:41.521297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c7e270d-3cff-42c8-acdc-fdc051f66540 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:41.522881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c7e270d-3cff-42c8-acdc-fdc051f66540 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:41.534879 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7952eafc-86bb-40c0-9bf2-5938049cdb31 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1314 microversion: 2.1 time: 1.237139 Oct 11 04:26:41.539461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7e270d-3cff-42c8-acdc-fdc051f66540 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:41.541939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7e270d-3cff-42c8-acdc-fdc051f66540 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:41.542082 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1743/3644] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:40 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1314 bytes in 1244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:41.545234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7e270d-3cff-42c8-acdc-fdc051f66540 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:41.546332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7e270d-3cff-42c8-acdc-fdc051f66540 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:41.549925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7e270d-3cff-42c8-acdc-fdc051f66540 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:41.553281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7e270d-3cff-42c8-acdc-fdc051f66540 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:41.561711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b8eb115-5626-44c4-85c1-35248db1639a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:41.564826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6b8eb115-5626-44c4-85c1-35248db1639a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:41.587609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b8eb115-5626-44c4-85c1-35248db1639a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:41.589980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b8eb115-5626-44c4-85c1-35248db1639a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:41.591466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b8eb115-5626-44c4-85c1-35248db1639a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:41.599756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b8eb115-5626-44c4-85c1-35248db1639a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:41.599756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b8eb115-5626-44c4-85c1-35248db1639a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:41.599756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b8eb115-5626-44c4-85c1-35248db1639a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:41.633261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:42.170099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c7e270d-3cff-42c8-acdc-fdc051f66540 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:42.178629 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c7e270d-3cff-42c8-acdc-fdc051f66540 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.662520 Oct 11 04:26:42.179226 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1902/3645] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:41 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:42.197625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-64c154bc-a10d-4d2f-9176-d170fa4c1926 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:42.205015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-64c154bc-a10d-4d2f-9176-d170fa4c1926 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:42.221419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64c154bc-a10d-4d2f-9176-d170fa4c1926 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:42.221419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64c154bc-a10d-4d2f-9176-d170fa4c1926 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:42.221419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64c154bc-a10d-4d2f-9176-d170fa4c1926 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:42.221419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64c154bc-a10d-4d2f-9176-d170fa4c1926 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:42.221419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64c154bc-a10d-4d2f-9176-d170fa4c1926 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:42.221419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64c154bc-a10d-4d2f-9176-d170fa4c1926 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:42.319527 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-64c154bc-a10d-4d2f-9176-d170fa4c1926 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.135249 Oct 11 04:26:42.320176 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1903/3646] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:26:42 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:42.383088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b8eb115-5626-44c4-85c1-35248db1639a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:42.391674 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b8eb115-5626-44c4-85c1-35248db1639a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.841719 Oct 11 04:26:42.398939 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1744/3647] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:41 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:42.570203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7803110f-810e-469c-8b50-df2ec3a12f59 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:42.570918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7803110f-810e-469c-8b50-df2ec3a12f59 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:42.587552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7803110f-810e-469c-8b50-df2ec3a12f59 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:42.588180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7803110f-810e-469c-8b50-df2ec3a12f59 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:42.588597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7803110f-810e-469c-8b50-df2ec3a12f59 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:42.589522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7803110f-810e-469c-8b50-df2ec3a12f59 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:42.590180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7803110f-810e-469c-8b50-df2ec3a12f59 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:42.590838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7803110f-810e-469c-8b50-df2ec3a12f59 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:42.620121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e17e8069-9637-4544-98cf-68ec211b1386 req-0f490e60-d00b-475c-b21a-4013bff030c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c80a9e3-3a40-4a91-98ab-6b1b223973f9", "name": "network-vif-plugged", "status": "completed", "tag": "6693ed13-00db-414b-bab4-33aaa5703c0c"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:42.657744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e17e8069-9637-4544-98cf-68ec211b1386 req-0f490e60-d00b-475c-b21a-4013bff030c8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:42.658267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e17e8069-9637-4544-98cf-68ec211b1386 req-0f490e60-d00b-475c-b21a-4013bff030c8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:42.658699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e17e8069-9637-4544-98cf-68ec211b1386 req-0f490e60-d00b-475c-b21a-4013bff030c8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:42.709959 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e17e8069-9637-4544-98cf-68ec211b1386 req-0f490e60-d00b-475c-b21a-4013bff030c8 service nova] Creating event network-vif-plugged:6693ed13-00db-414b-bab4-33aaa5703c0c for instance 5c80a9e3-3a40-4a91-98ab-6b1b223973f9 on n-h1-860892-1 Oct 11 04:26:42.728066 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e17e8069-9637-4544-98cf-68ec211b1386 req-0f490e60-d00b-475c-b21a-4013bff030c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110400 Oct 11 04:26:42.730819 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1745/3648] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:26:43.147236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7803110f-810e-469c-8b50-df2ec3a12f59 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:43.172255 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7803110f-810e-469c-8b50-df2ec3a12f59 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1314 microversion: 2.1 time: 0.599360 Oct 11 04:26:43.194507 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1904/3649] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:42 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1314 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:43.216373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-841827e7-10cc-417b-af02-1cd7bffee00d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:43.220180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-841827e7-10cc-417b-af02-1cd7bffee00d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:43.233461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:43.233461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841827e7-10cc-417b-af02-1cd7bffee00d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:43.234251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841827e7-10cc-417b-af02-1cd7bffee00d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:43.234540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841827e7-10cc-417b-af02-1cd7bffee00d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:43.235980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841827e7-10cc-417b-af02-1cd7bffee00d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:43.236724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841827e7-10cc-417b-af02-1cd7bffee00d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:43.239493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841827e7-10cc-417b-af02-1cd7bffee00d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:43.334172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5cbf2ddf-d7b1-4401-899b-b2bb63573b3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:43.340451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5cbf2ddf-d7b1-4401-899b-b2bb63573b3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:43.351443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf2ddf-d7b1-4401-899b-b2bb63573b3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:43.357971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf2ddf-d7b1-4401-899b-b2bb63573b3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:43.359449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf2ddf-d7b1-4401-899b-b2bb63573b3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:43.365496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf2ddf-d7b1-4401-899b-b2bb63573b3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:43.366845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf2ddf-d7b1-4401-899b-b2bb63573b3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:43.368102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf2ddf-d7b1-4401-899b-b2bb63573b3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:43.450273 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5cbf2ddf-d7b1-4401-899b-b2bb63573b3d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.121960 Oct 11 04:26:43.460538 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1905/3650] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:26:43 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:26:43.686992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-841827e7-10cc-417b-af02-1cd7bffee00d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:43.701391 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-841827e7-10cc-417b-af02-1cd7bffee00d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.499906 Oct 11 04:26:43.706230 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1746/3651] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:43 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:44.202020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4791480e-abdb-4926-8613-eb85c19c9859 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:44.202824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4791480e-abdb-4926-8613-eb85c19c9859 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:44.215962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4791480e-abdb-4926-8613-eb85c19c9859 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:44.216472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4791480e-abdb-4926-8613-eb85c19c9859 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:44.216916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4791480e-abdb-4926-8613-eb85c19c9859 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:44.217634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4791480e-abdb-4926-8613-eb85c19c9859 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:44.218094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4791480e-abdb-4926-8613-eb85c19c9859 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:44.218543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4791480e-abdb-4926-8613-eb85c19c9859 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:44.479195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-21bc1b0f-0196-419e-b504-06cc16a97538 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:44.481864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-21bc1b0f-0196-419e-b504-06cc16a97538 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:44.490899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21bc1b0f-0196-419e-b504-06cc16a97538 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:44.491633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21bc1b0f-0196-419e-b504-06cc16a97538 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:44.492301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21bc1b0f-0196-419e-b504-06cc16a97538 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:44.493452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21bc1b0f-0196-419e-b504-06cc16a97538 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:44.494076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21bc1b0f-0196-419e-b504-06cc16a97538 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:44.494708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21bc1b0f-0196-419e-b504-06cc16a97538 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:44.577445 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-21bc1b0f-0196-419e-b504-06cc16a97538 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097372 Oct 11 04:26:44.578711 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1747/3652] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:26:44 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments => generated 197 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:44.731144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ceb8dbd1-8376-4a14-ad01-139e7c75ddeb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:44.732638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ceb8dbd1-8376-4a14-ad01-139e7c75ddeb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:44.747561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceb8dbd1-8376-4a14-ad01-139e7c75ddeb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:44.748409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceb8dbd1-8376-4a14-ad01-139e7c75ddeb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:44.749027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceb8dbd1-8376-4a14-ad01-139e7c75ddeb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:44.750552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceb8dbd1-8376-4a14-ad01-139e7c75ddeb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:44.751180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceb8dbd1-8376-4a14-ad01-139e7c75ddeb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:44.751771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceb8dbd1-8376-4a14-ad01-139e7c75ddeb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:45.338131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4791480e-abdb-4926-8613-eb85c19c9859 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:45.347341 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4791480e-abdb-4926-8613-eb85c19c9859 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1314 microversion: 2.1 time: 1.148515 Oct 11 04:26:45.368880 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1906/3653] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:44 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1314 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:45.368880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-cafb0890-c5ac-4edf-a763-2c39d7ea37fe req-1ede8f74-63e2-49bc-9818-dd7a005c77df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32f0ab1-346d-487a-aa08-ebd1656142a7", "name": "network-vif-unplugged", "status": "completed", "tag": "6993adde-be55-4ee5-a441-ab52e2f48759"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:45.390715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cafb0890-c5ac-4edf-a763-2c39d7ea37fe req-1ede8f74-63e2-49bc-9818-dd7a005c77df service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:45.391209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cafb0890-c5ac-4edf-a763-2c39d7ea37fe req-1ede8f74-63e2-49bc-9818-dd7a005c77df service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:45.391653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cafb0890-c5ac-4edf-a763-2c39d7ea37fe req-1ede8f74-63e2-49bc-9818-dd7a005c77df service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:45.412218 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-cafb0890-c5ac-4edf-a763-2c39d7ea37fe req-1ede8f74-63e2-49bc-9818-dd7a005c77df service nova] Creating event network-vif-unplugged:6993adde-be55-4ee5-a441-ab52e2f48759 for instance d32f0ab1-346d-487a-aa08-ebd1656142a7 on n-h2-860892-1 Oct 11 04:26:45.419798 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-cafb0890-c5ac-4edf-a763-2c39d7ea37fe req-1ede8f74-63e2-49bc-9818-dd7a005c77df service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.064714 Oct 11 04:26:45.421211 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1907/3654] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:45.478537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ceb8dbd1-8376-4a14-ad01-139e7c75ddeb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:45.490000 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ceb8dbd1-8376-4a14-ad01-139e7c75ddeb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1321 microversion: 2.1 time: 0.762328 Oct 11 04:26:45.491895 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1748/3655] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:44 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1321 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:45.592300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2ff1e362-46ba-42dd-a2fd-0b4974875159 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:45.594704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2ff1e362-46ba-42dd-a2fd-0b4974875159 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:45.614821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ff1e362-46ba-42dd-a2fd-0b4974875159 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:45.617767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ff1e362-46ba-42dd-a2fd-0b4974875159 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:45.620382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ff1e362-46ba-42dd-a2fd-0b4974875159 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:45.621399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ff1e362-46ba-42dd-a2fd-0b4974875159 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:45.623362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ff1e362-46ba-42dd-a2fd-0b4974875159 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:45.624611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ff1e362-46ba-42dd-a2fd-0b4974875159 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:45.681276 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2ff1e362-46ba-42dd-a2fd-0b4974875159 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093768 Oct 11 04:26:45.687570 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1908/3656] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:26:45 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:46.172829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ImagesNegativeTestJSON-server-2101549915", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "b228152b-4c34-4e89-b864-46e4b60079d0"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:46.257692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] validate_networks() for [('b228152b-4c34-4e89-b864-46e4b60079d0', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:26:46.378889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-58944d61-9dfe-4310-a54a-6871d7bff04e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:46.380306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-58944d61-9dfe-4310-a54a-6871d7bff04e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:46.398929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58944d61-9dfe-4310-a54a-6871d7bff04e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:46.401033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58944d61-9dfe-4310-a54a-6871d7bff04e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:46.401668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58944d61-9dfe-4310-a54a-6871d7bff04e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:46.406427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58944d61-9dfe-4310-a54a-6871d7bff04e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:46.407247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58944d61-9dfe-4310-a54a-6871d7bff04e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:46.410408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58944d61-9dfe-4310-a54a-6871d7bff04e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:46.696141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-58944d61-9dfe-4310-a54a-6871d7bff04e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:46.711061 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-58944d61-9dfe-4310-a54a-6871d7bff04e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1314 microversion: 2.1 time: 0.337683 Oct 11 04:26:46.724877 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1909/3657] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:46 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:46.735096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-390a0f3c-f10c-4230-b166-344b8d00bcff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:46.735967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-390a0f3c-f10c-4230-b166-344b8d00bcff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:46.742346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390a0f3c-f10c-4230-b166-344b8d00bcff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:46.743459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390a0f3c-f10c-4230-b166-344b8d00bcff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:46.744677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390a0f3c-f10c-4230-b166-344b8d00bcff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:46.745952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390a0f3c-f10c-4230-b166-344b8d00bcff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:46.746597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390a0f3c-f10c-4230-b166-344b8d00bcff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:46.748350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390a0f3c-f10c-4230-b166-344b8d00bcff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:46.943118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-390a0f3c-f10c-4230-b166-344b8d00bcff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:46.967234 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-390a0f3c-f10c-4230-b166-344b8d00bcff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.240294 Oct 11 04:26:46.968316 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1910/3658] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:46 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:46.979601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e4a5fe6d-2401-4cb5-a91e-15622da3426b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:46.981404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e4a5fe6d-2401-4cb5-a91e-15622da3426b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:47.001137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4a5fe6d-2401-4cb5-a91e-15622da3426b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:47.001935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4a5fe6d-2401-4cb5-a91e-15622da3426b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:47.003653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4a5fe6d-2401-4cb5-a91e-15622da3426b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:47.006338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4a5fe6d-2401-4cb5-a91e-15622da3426b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:47.007039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4a5fe6d-2401-4cb5-a91e-15622da3426b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:47.007756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4a5fe6d-2401-4cb5-a91e-15622da3426b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:47.261321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e4a5fe6d-2401-4cb5-a91e-15622da3426b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:47.278289 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e4a5fe6d-2401-4cb5-a91e-15622da3426b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1512 microversion: 2.1 time: 0.305040 Oct 11 04:26:47.279378 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1911/3659] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:46 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1512 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:47.293530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-baf54737-eb7d-4caa-9dfe-d3c47c197fa9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:47.300486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-baf54737-eb7d-4caa-9dfe-d3c47c197fa9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:47.308271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baf54737-eb7d-4caa-9dfe-d3c47c197fa9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:47.309109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baf54737-eb7d-4caa-9dfe-d3c47c197fa9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:47.309890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baf54737-eb7d-4caa-9dfe-d3c47c197fa9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:47.310914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baf54737-eb7d-4caa-9dfe-d3c47c197fa9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:47.312123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baf54737-eb7d-4caa-9dfe-d3c47c197fa9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:47.313069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-baf54737-eb7d-4caa-9dfe-d3c47c197fa9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:47.349698 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-baf54737-eb7d-4caa-9dfe-d3c47c197fa9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069035 Oct 11 04:26:47.356115 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1912/3660] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:26:47 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:26:47.359757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f580df5f-4297-4854-bb91-508fea8d9d4a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:47.360743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f580df5f-4297-4854-bb91-508fea8d9d4a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:47.373145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f580df5f-4297-4854-bb91-508fea8d9d4a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:47.373145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f580df5f-4297-4854-bb91-508fea8d9d4a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:47.373145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f580df5f-4297-4854-bb91-508fea8d9d4a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:47.373145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f580df5f-4297-4854-bb91-508fea8d9d4a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:47.373980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f580df5f-4297-4854-bb91-508fea8d9d4a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:47.374792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f580df5f-4297-4854-bb91-508fea8d9d4a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:47.645752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f580df5f-4297-4854-bb91-508fea8d9d4a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:47.656161 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f580df5f-4297-4854-bb91-508fea8d9d4a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.303499 Oct 11 04:26:47.658943 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1913/3661] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:47 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:47.670460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-76926b72-dabd-4d77-b4e8-78302fbbd637 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:47.672977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-76926b72-dabd-4d77-b4e8-78302fbbd637 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:47.688373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76926b72-dabd-4d77-b4e8-78302fbbd637 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:47.692041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76926b72-dabd-4d77-b4e8-78302fbbd637 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:47.694041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76926b72-dabd-4d77-b4e8-78302fbbd637 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:47.694041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76926b72-dabd-4d77-b4e8-78302fbbd637 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:47.694041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76926b72-dabd-4d77-b4e8-78302fbbd637 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:47.696901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76926b72-dabd-4d77-b4e8-78302fbbd637 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:47.937254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-76926b72-dabd-4d77-b4e8-78302fbbd637 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:47.952989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-76926b72-dabd-4d77-b4e8-78302fbbd637 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1511 microversion: 2.1 time: 0.289501 Oct 11 04:26:47.954773 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1914/3662] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:47 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1511 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:47.962378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db2f193a-9d89-4d5c-9584-8a2f4af37773 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:47.964250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-db2f193a-9d89-4d5c-9584-8a2f4af37773 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:47.983038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db2f193a-9d89-4d5c-9584-8a2f4af37773 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:47.983853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db2f193a-9d89-4d5c-9584-8a2f4af37773 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:47.984614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db2f193a-9d89-4d5c-9584-8a2f4af37773 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:47.985490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db2f193a-9d89-4d5c-9584-8a2f4af37773 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:47.986103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db2f193a-9d89-4d5c-9584-8a2f4af37773 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:47.986715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db2f193a-9d89-4d5c-9584-8a2f4af37773 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:48.280263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-db2f193a-9d89-4d5c-9584-8a2f4af37773 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:48.296609 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-db2f193a-9d89-4d5c-9584-8a2f4af37773 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.337998 Oct 11 04:26:48.297442 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1915/3663] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:47 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:48.302847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-753cec71-61a8-4907-b323-a808e738a84a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:48.310000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-753cec71-61a8-4907-b323-a808e738a84a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:48.311604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753cec71-61a8-4907-b323-a808e738a84a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:48.312160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753cec71-61a8-4907-b323-a808e738a84a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:48.312692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753cec71-61a8-4907-b323-a808e738a84a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:48.313608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753cec71-61a8-4907-b323-a808e738a84a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:48.314042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753cec71-61a8-4907-b323-a808e738a84a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:48.314526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753cec71-61a8-4907-b323-a808e738a84a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:48.457296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:26:48.457789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:26:48.458171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:26:48.458598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:26:48.459006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:26:48.484991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:48.485480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:48.485913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:48.486673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:48.487684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:48.488118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:48.551623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Getting quotas for project fd69384a24dc4bf0959c6caea6f40f42. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:26:48.560377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Getting quotas for user a30e59b6df16418e97280550c4d28ac6 and project fd69384a24dc4bf0959c6caea6f40f42. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:26:48.583584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:26:48.587289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:26:48.607040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-753cec71-61a8-4907-b323-a808e738a84a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:48.619006 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-753cec71-61a8-4907-b323-a808e738a84a tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1314 microversion: 2.1 time: 0.320291 Oct 11 04:26:48.636284 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1916/3664] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:48 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:48.648753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b463dd9f-7619-4b0c-b3c2-114623e52ee1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:48.649433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b463dd9f-7619-4b0c-b3c2-114623e52ee1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 7e848340-de82-48aa-8c66-78908ccdd948] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:48.669799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b463dd9f-7619-4b0c-b3c2-114623e52ee1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:48.670376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b463dd9f-7619-4b0c-b3c2-114623e52ee1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:48.670897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b463dd9f-7619-4b0c-b3c2-114623e52ee1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:48.671515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b463dd9f-7619-4b0c-b3c2-114623e52ee1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:48.671967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b463dd9f-7619-4b0c-b3c2-114623e52ee1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:48.672392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b463dd9f-7619-4b0c-b3c2-114623e52ee1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:48.754861 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bbf6305d-445f-4267-b87a-6d9c9b6b048a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.016077 Oct 11 04:26:48.759169 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1749/3665] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:26:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 3022 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:26:48.788228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f58fb61e-dd31-4e4f-98ca-af8d76427cb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:48.791683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f58fb61e-dd31-4e4f-98ca-af8d76427cb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:48.824935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58fb61e-dd31-4e4f-98ca-af8d76427cb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:48.825726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58fb61e-dd31-4e4f-98ca-af8d76427cb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:48.826389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58fb61e-dd31-4e4f-98ca-af8d76427cb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:48.827290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58fb61e-dd31-4e4f-98ca-af8d76427cb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:48.827907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58fb61e-dd31-4e4f-98ca-af8d76427cb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:48.828815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58fb61e-dd31-4e4f-98ca-af8d76427cb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:49.036159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b463dd9f-7619-4b0c-b3c2-114623e52ee1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:49.044577 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b463dd9f-7619-4b0c-b3c2-114623e52ee1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948" status: 200 len: 1510 microversion: 2.1 time: 0.406883 Oct 11 04:26:49.045158 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1917/3666] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:48 2022] GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948 => generated 1510 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:49.067692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-27ecafa1-cdf7-4164-bbad-58d4852d3ca2 req-80234db4-e566-4dc8-ba0d-99f4453c6cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cd4d92-fbc8-4d90-b1d7-06896821816c", "name": "network-vif-plugged", "status": "completed", "tag": "40b8da08-b4a5-4822-bd38-5b5993d50d42"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:49.110148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-27ecafa1-cdf7-4164-bbad-58d4852d3ca2 req-80234db4-e566-4dc8-ba0d-99f4453c6cf4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:49.110906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-27ecafa1-cdf7-4164-bbad-58d4852d3ca2 req-80234db4-e566-4dc8-ba0d-99f4453c6cf4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:49.111509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-27ecafa1-cdf7-4164-bbad-58d4852d3ca2 req-80234db4-e566-4dc8-ba0d-99f4453c6cf4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:49.122017 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f58fb61e-dd31-4e4f-98ca-af8d76427cb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.342473 Oct 11 04:26:49.125115 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1750/3667] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:26:48 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:26:49.131584 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-27ecafa1-cdf7-4164-bbad-58d4852d3ca2 req-80234db4-e566-4dc8-ba0d-99f4453c6cf4 service nova] Creating event network-vif-plugged:40b8da08-b4a5-4822-bd38-5b5993d50d42 for instance 38cd4d92-fbc8-4d90-b1d7-06896821816c on n-h2-860892-1 Oct 11 04:26:49.138244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e4696ece-f310-4181-a422-9064f8bcebda tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:49.138964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e4696ece-f310-4181-a422-9064f8bcebda tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:49.145959 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-27ecafa1-cdf7-4164-bbad-58d4852d3ca2 req-80234db4-e566-4dc8-ba0d-99f4453c6cf4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099331 Oct 11 04:26:49.146827 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1918/3668] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:49.162301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:49.168099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:49.170024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:26:49.193312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:49.195693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:49.196738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:49.201345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:49.202747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:49.203407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:49.366852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:26:49.444021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e4696ece-f310-4181-a422-9064f8bcebda tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:49.452604 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e4696ece-f310-4181-a422-9064f8bcebda tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1216 microversion: 2.1 time: 0.326150 Oct 11 04:26:49.455175 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1751/3669] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:49 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1216 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:49.462114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c15066a7-1a4b-4c45-a6f0-1eb800a1d8bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:49.467331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c15066a7-1a4b-4c45-a6f0-1eb800a1d8bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:49.523619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c15066a7-1a4b-4c45-a6f0-1eb800a1d8bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:49.524324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c15066a7-1a4b-4c45-a6f0-1eb800a1d8bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:49.524781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c15066a7-1a4b-4c45-a6f0-1eb800a1d8bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:49.525533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c15066a7-1a4b-4c45-a6f0-1eb800a1d8bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:49.525990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c15066a7-1a4b-4c45-a6f0-1eb800a1d8bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:49.535169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c15066a7-1a4b-4c45-a6f0-1eb800a1d8bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:49.555075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:49.575809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:49.575809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:49.582099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:49.604790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:49.907898 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c0f63755-6294-4fa2-a838-3b0a2e0a89bb tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?flavor=451" status: 200 len: 1515 microversion: 2.1 time: 0.759279 Oct 11 04:26:49.908506 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1919/3670] 10.222.0.26 () {58 vars in 1167 bytes} [Tue Oct 11 04:26:49 2022] GET /compute/v2.1/servers/detail?flavor=451 => generated 1515 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:49.913673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-85d61e0b-2088-41b2-aecb-03398ed3e4de tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:49.914649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-85d61e0b-2088-41b2-aecb-03398ed3e4de tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:49.919969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c15066a7-1a4b-4c45-a6f0-1eb800a1d8bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:49.922971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d61e0b-2088-41b2-aecb-03398ed3e4de tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:49.924178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d61e0b-2088-41b2-aecb-03398ed3e4de tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:49.924178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d61e0b-2088-41b2-aecb-03398ed3e4de tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:49.925320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d61e0b-2088-41b2-aecb-03398ed3e4de tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:49.926016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d61e0b-2088-41b2-aecb-03398ed3e4de tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:49.926634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85d61e0b-2088-41b2-aecb-03398ed3e4de tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:49.929053 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c15066a7-1a4b-4c45-a6f0-1eb800a1d8bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1670 microversion: 2.1 time: 0.471751 Oct 11 04:26:49.942576 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1752/3671] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:49 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1670 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:49.962790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:49.979565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:49.980566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-48161591', 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:26:49.988359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:49.989313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:49.990181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:49.991164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:49.991826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:49.992460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:50.127399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:26:50.260281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:50.277920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:50.279581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:50.280500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:50.375425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-85d61e0b-2088-41b2-aecb-03398ed3e4de tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:50.391567 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-85d61e0b-2088-41b2-aecb-03398ed3e4de tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1314 microversion: 2.1 time: 0.481687 Oct 11 04:26:50.392172 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1920/3672] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:49 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1314 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:50.446734 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-64f7243a-84ec-4880-9409-95f5c39e14e9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-48161591" status: 200 len: 1514 microversion: 2.1 time: 0.502787 Oct 11 04:26:50.448546 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1753/3673] 10.222.0.26 () {58 vars in 1259 bytes} [Tue Oct 11 04:26:49 2022] GET /compute/v2.1/servers/detail?name=tempest-ListServerFiltersTestJSON-instance-48161591 => generated 1514 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:50.479411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-29c14fe8-6e27-4628-a0bd-bcd1fecf1ebd tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:50.480145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:50.482568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-29c14fe8-6e27-4628-a0bd-bcd1fecf1ebd tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:50.485154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:50.485970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:26:50.499701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:50.500185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:50.500628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:50.505426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:50.505426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:50.505426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:50.565507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-29c14fe8-6e27-4628-a0bd-bcd1fecf1ebd tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:50.576485 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-29c14fe8-6e27-4628-a0bd-bcd1fecf1ebd tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1216 microversion: 2.1 time: 0.103740 Oct 11 04:26:50.577086 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1921/3674] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:50 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1216 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:50.665182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:26:50.757288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:50.769671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:50.770429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:50.771029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:50.958575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-314a784f-c0e2-44e0-b076-8134f98d713f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:50.959357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-314a784f-c0e2-44e0-b076-8134f98d713f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:50.976208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314a784f-c0e2-44e0-b076-8134f98d713f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:50.977941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314a784f-c0e2-44e0-b076-8134f98d713f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:50.980615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314a784f-c0e2-44e0-b076-8134f98d713f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:50.982515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314a784f-c0e2-44e0-b076-8134f98d713f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:50.983888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314a784f-c0e2-44e0-b076-8134f98d713f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:50.986024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-314a784f-c0e2-44e0-b076-8134f98d713f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.210236 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b2dfa084-5b36-4b63-852d-301598cefb11 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?status=active" status: 200 len: 4516 microversion: 2.1 time: 0.734793 Oct 11 04:26:51.211725 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1754/3675] 10.222.0.26 () {58 vars in 1173 bytes} [Tue Oct 11 04:26:50 2022] GET /compute/v2.1/servers/detail?status=active => generated 4516 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:51.243319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:51.249044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:51.249537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.compute.servers [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Removing options 'limit' from query {{(pid=120993) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 04:26:51.250308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:26:51.276251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.277204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.277986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.279237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.279700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.280124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.348269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:51.353906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-314a784f-c0e2-44e0-b076-8134f98d713f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:51.355803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.356414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.356789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.364013 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-314a784f-c0e2-44e0-b076-8134f98d713f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1670 microversion: 2.1 time: 0.410754 Oct 11 04:26:51.376881 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1922/3676] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:50 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1670 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:51.417414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2692d6c8-0898-4b1b-877b-52fa66ecc3c8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:51.418754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2692d6c8-0898-4b1b-877b-52fa66ecc3c8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:51.450607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2692d6c8-0898-4b1b-877b-52fa66ecc3c8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.451112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2692d6c8-0898-4b1b-877b-52fa66ecc3c8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.453409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2692d6c8-0898-4b1b-877b-52fa66ecc3c8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.455076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2692d6c8-0898-4b1b-877b-52fa66ecc3c8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.456267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2692d6c8-0898-4b1b-877b-52fa66ecc3c8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.457312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2692d6c8-0898-4b1b-877b-52fa66ecc3c8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.544510 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e0912edc-042e-45ad-9d0b-d36e2664d38a tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/detail?limit=1" status: 200 len: 1661 microversion: 2.1 time: 0.305115 Oct 11 04:26:51.545587 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1755/3677] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 04:26:51 2022] GET /compute/v2.1/servers/detail?limit=1 => generated 1661 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:51.568794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e660f023-c2eb-4391-b0b2-91ea31a010e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:51.573807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e660f023-c2eb-4391-b0b2-91ea31a010e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:51.574745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e660f023-c2eb-4391-b0b2-91ea31a010e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'vm_state': ['active'], 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:26:51.581282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e660f023-c2eb-4391-b0b2-91ea31a010e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.582033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e660f023-c2eb-4391-b0b2-91ea31a010e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.582625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e660f023-c2eb-4391-b0b2-91ea31a010e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.583613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e660f023-c2eb-4391-b0b2-91ea31a010e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.584362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e660f023-c2eb-4391-b0b2-91ea31a010e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.584973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e660f023-c2eb-4391-b0b2-91ea31a010e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.648022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-e660f023-c2eb-4391-b0b2-91ea31a010e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:26:51.663861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:51.700712 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e660f023-c2eb-4391-b0b2-91ea31a010e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?status=active" status: 200 len: 1008 microversion: 2.1 time: 0.135693 Oct 11 04:26:51.701652 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1756/3678] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:26:51 2022] GET /compute/v2.1/servers?status=active => generated 1008 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:51.707442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a0aa3c7f-d83a-4354-b460-dcca31c80ef7 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:51.715347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a0aa3c7f-d83a-4354-b460-dcca31c80ef7 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:51.730054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2692d6c8-0898-4b1b-877b-52fa66ecc3c8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:51.733534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0aa3c7f-d83a-4354-b460-dcca31c80ef7 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.734632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0aa3c7f-d83a-4354-b460-dcca31c80ef7 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.735289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0aa3c7f-d83a-4354-b460-dcca31c80ef7 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.736444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0aa3c7f-d83a-4354-b460-dcca31c80ef7 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.737654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0aa3c7f-d83a-4354-b460-dcca31c80ef7 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.738869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a0aa3c7f-d83a-4354-b460-dcca31c80ef7 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.748485 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2692d6c8-0898-4b1b-877b-52fa66ecc3c8 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1500 microversion: 2.1 time: 0.336511 Oct 11 04:26:51.762225 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1923/3679] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:51 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1500 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:51.762225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:51.771083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:51.771812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.compute.servers [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Removing options 'limit' from query {{(pid=120994) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 04:26:51.772711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:26:51.779787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.780577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.785464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.786327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.787001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.787626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.822922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:26:51.858062 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-516f9a2f-6cb1-46f1-ada4-982b56c3a411 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=100000" status: 200 len: 1008 microversion: 2.1 time: 0.103865 Oct 11 04:26:51.859032 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1924/3680] 10.222.0.26 () {58 vars in 1150 bytes} [Tue Oct 11 04:26:51 2022] GET /compute/v2.1/servers?limit=100000 => generated 1008 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:51.869572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a0aa3c7f-d83a-4354-b460-dcca31c80ef7 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:51.871691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5912dc3c-87ab-408a-a6e4-69f10367d1d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:51.872271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5912dc3c-87ab-408a-a6e4-69f10367d1d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:51.879404 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a0aa3c7f-d83a-4354-b460-dcca31c80ef7 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1212 microversion: 2.1 time: 0.176250 Oct 11 04:26:51.879814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5912dc3c-87ab-408a-a6e4-69f10367d1d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.880310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5912dc3c-87ab-408a-a6e4-69f10367d1d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.886558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5912dc3c-87ab-408a-a6e4-69f10367d1d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.886558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5912dc3c-87ab-408a-a6e4-69f10367d1d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.886558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5912dc3c-87ab-408a-a6e4-69f10367d1d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.886558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5912dc3c-87ab-408a-a6e4-69f10367d1d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.887141 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1757/3681] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:51 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1212 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:51.914869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-5912dc3c-87ab-408a-a6e4-69f10367d1d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lazy-loading 'flavor' on Instance uuid 38cd4d92-fbc8-4d90-b1d7-06896821816c {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:26:51.930835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e57b599f-9765-48ba-a9ad-8e4dbc1aaf62 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:51.941296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e57b599f-9765-48ba-a9ad-8e4dbc1aaf62 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:51.942921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e57b599f-9765-48ba-a9ad-8e4dbc1aaf62 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:26:51.948837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e57b599f-9765-48ba-a9ad-8e4dbc1aaf62 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.949921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e57b599f-9765-48ba-a9ad-8e4dbc1aaf62 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.950513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e57b599f-9765-48ba-a9ad-8e4dbc1aaf62 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.951430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e57b599f-9765-48ba-a9ad-8e4dbc1aaf62 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:51.952069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e57b599f-9765-48ba-a9ad-8e4dbc1aaf62 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:51.952496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e57b599f-9765-48ba-a9ad-8e4dbc1aaf62 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:51.989829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-e57b599f-9765-48ba-a9ad-8e4dbc1aaf62 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:26:52.024769 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e57b599f-9765-48ba-a9ad-8e4dbc1aaf62 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1008 microversion: 2.1 time: 0.117996 Oct 11 04:26:52.025520 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1758/3682] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:26:51 2022] GET /compute/v2.1/servers => generated 1008 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:52.040334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f37d2057-f8a2-4e26-abfc-765bec11c8e1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:52.046010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f37d2057-f8a2-4e26-abfc-765bec11c8e1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:52.046745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f37d2057-f8a2-4e26-abfc-765bec11c8e1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'flavor': '451', 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:26:52.061509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37d2057-f8a2-4e26-abfc-765bec11c8e1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.062339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37d2057-f8a2-4e26-abfc-765bec11c8e1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.062779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37d2057-f8a2-4e26-abfc-765bec11c8e1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.063780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37d2057-f8a2-4e26-abfc-765bec11c8e1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.064220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37d2057-f8a2-4e26-abfc-765bec11c8e1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.064678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f37d2057-f8a2-4e26-abfc-765bec11c8e1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.162454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-f37d2057-f8a2-4e26-abfc-765bec11c8e1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:26:52.248301 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f37d2057-f8a2-4e26-abfc-765bec11c8e1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=451" status: 200 len: 346 microversion: 2.1 time: 0.213400 Oct 11 04:26:52.249188 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1759/3683] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:26:52 2022] GET /compute/v2.1/servers?flavor=451 => generated 346 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:26:52.264670 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5912dc3c-87ab-408a-a6e4-69f10367d1d7 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "POST /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c/action" status: 202 len: 0 microversion: 2.1 time: 0.401731 Oct 11 04:26:52.269157 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1925/3684] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:26:51 2022] POST /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:26:52.269869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-19b871e4-080a-4055-9f87-3a5a1e59a6c0 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:52.274703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-19b871e4-080a-4055-9f87-3a5a1e59a6c0 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:52.275270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.compute.servers [None req-19b871e4-080a-4055-9f87-3a5a1e59a6c0 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Removing options 'limit' from query {{(pid=120993) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 04:26:52.276093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-19b871e4-080a-4055-9f87-3a5a1e59a6c0 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:26:52.282075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b871e4-080a-4055-9f87-3a5a1e59a6c0 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.282603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b871e4-080a-4055-9f87-3a5a1e59a6c0 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.283134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b871e4-080a-4055-9f87-3a5a1e59a6c0 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.283901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b871e4-080a-4055-9f87-3a5a1e59a6c0 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.284361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b871e4-080a-4055-9f87-3a5a1e59a6c0 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.284830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b871e4-080a-4055-9f87-3a5a1e59a6c0 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.294969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f4a86f7-ea59-4f3d-a8c9-04dd8ea2a1c0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:52.304327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f4a86f7-ea59-4f3d-a8c9-04dd8ea2a1c0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:52.314522 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-19b871e4-080a-4055-9f87-3a5a1e59a6c0 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=1" status: 200 len: 485 microversion: 2.1 time: 0.047967 Oct 11 04:26:52.323507 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1760/3685] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Oct 11 04:26:52 2022] GET /compute/v2.1/servers?limit=1 => generated 485 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:52.326532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f4a86f7-ea59-4f3d-a8c9-04dd8ea2a1c0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.328694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-658406ca-234c-4ae1-b17b-9bfe52548651 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:52.329938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f4a86f7-ea59-4f3d-a8c9-04dd8ea2a1c0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.330512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f4a86f7-ea59-4f3d-a8c9-04dd8ea2a1c0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.331537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f4a86f7-ea59-4f3d-a8c9-04dd8ea2a1c0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.332970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f4a86f7-ea59-4f3d-a8c9-04dd8ea2a1c0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.333417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f4a86f7-ea59-4f3d-a8c9-04dd8ea2a1c0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.335149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-658406ca-234c-4ae1-b17b-9bfe52548651 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:52.335903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-658406ca-234c-4ae1-b17b-9bfe52548651 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'name': 'tempest-ListServerFiltersTestJSON-instance-48161591', 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:26:52.341411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-658406ca-234c-4ae1-b17b-9bfe52548651 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.341940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-658406ca-234c-4ae1-b17b-9bfe52548651 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.342423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-658406ca-234c-4ae1-b17b-9bfe52548651 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.343150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-658406ca-234c-4ae1-b17b-9bfe52548651 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.343866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-658406ca-234c-4ae1-b17b-9bfe52548651 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.344990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-658406ca-234c-4ae1-b17b-9bfe52548651 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.440996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-658406ca-234c-4ae1-b17b-9bfe52548651 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:26:52.529189 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-658406ca-234c-4ae1-b17b-9bfe52548651 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-48161591" status: 200 len: 344 microversion: 2.1 time: 0.204508 Oct 11 04:26:52.530058 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1761/3686] 10.222.0.26 () {58 vars in 1238 bytes} [Tue Oct 11 04:26:52 2022] GET /compute/v2.1/servers?name=tempest-ListServerFiltersTestJSON-instance-48161591 => generated 344 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:52.542003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a20c987c-1e30-4703-92dd-17f01a9ff426 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:52.546588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a20c987c-1e30-4703-92dd-17f01a9ff426 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:52.548743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a20c987c-1e30-4703-92dd-17f01a9ff426 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.549582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a20c987c-1e30-4703-92dd-17f01a9ff426 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.550550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a20c987c-1e30-4703-92dd-17f01a9ff426 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.551246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a20c987c-1e30-4703-92dd-17f01a9ff426 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.551690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a20c987c-1e30-4703-92dd-17f01a9ff426 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.552109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a20c987c-1e30-4703-92dd-17f01a9ff426 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.656412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f4a86f7-ea59-4f3d-a8c9-04dd8ea2a1c0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:52.668077 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f4a86f7-ea59-4f3d-a8c9-04dd8ea2a1c0 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1508 microversion: 2.1 time: 0.395209 Oct 11 04:26:52.668077 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1926/3687] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:52 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1508 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:52.672975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dbf44f74-712f-4c14-b59f-4964a82fb8f1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:52.679644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbf44f74-712f-4c14-b59f-4964a82fb8f1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.681813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbf44f74-712f-4c14-b59f-4964a82fb8f1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.682561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dbf44f74-712f-4c14-b59f-4964a82fb8f1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.710557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dbf44f74-712f-4c14-b59f-4964a82fb8f1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Going to try to stop instance {{(pid=120994) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 04:26:52.731612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a20c987c-1e30-4703-92dd-17f01a9ff426 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:52.740861 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a20c987c-1e30-4703-92dd-17f01a9ff426 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.209757 Oct 11 04:26:52.751907 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1762/3688] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:52 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:52.768870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f36a7499-9009-44e1-8180-27023d2b2039 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:52.771773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f36a7499-9009-44e1-8180-27023d2b2039 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:52.781401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36a7499-9009-44e1-8180-27023d2b2039 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.782579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36a7499-9009-44e1-8180-27023d2b2039 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.783029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36a7499-9009-44e1-8180-27023d2b2039 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.784322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36a7499-9009-44e1-8180-27023d2b2039 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.784930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36a7499-9009-44e1-8180-27023d2b2039 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.785361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36a7499-9009-44e1-8180-27023d2b2039 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.959632 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dbf44f74-712f-4c14-b59f-4964a82fb8f1 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "POST /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e/action" status: 202 len: 0 microversion: 2.1 time: 0.291378 Oct 11 04:26:52.960263 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1927/3689] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:26:52 2022] POST /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:26:52.967354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-042c9a80-6428-49f0-b8dd-9a938780bc7f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:52.968393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-042c9a80-6428-49f0-b8dd-9a938780bc7f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:52.976325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-042c9a80-6428-49f0-b8dd-9a938780bc7f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.977175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-042c9a80-6428-49f0-b8dd-9a938780bc7f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.982960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-042c9a80-6428-49f0-b8dd-9a938780bc7f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.982960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-042c9a80-6428-49f0-b8dd-9a938780bc7f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:52.982960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-042c9a80-6428-49f0-b8dd-9a938780bc7f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:52.982960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-042c9a80-6428-49f0-b8dd-9a938780bc7f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:52.989451 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f36a7499-9009-44e1-8180-27023d2b2039 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 200 len: 322 microversion: 2.1 time: 0.225180 Oct 11 04:26:52.996292 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1763/3690] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:26:52 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:26:52.999704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cae228f8-f928-4526-9e10-be7874797eac tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:53.000809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cae228f8-f928-4526-9e10-be7874797eac tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:53.021937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cae228f8-f928-4526-9e10-be7874797eac tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:53.022799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cae228f8-f928-4526-9e10-be7874797eac tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:53.023632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cae228f8-f928-4526-9e10-be7874797eac tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:53.028930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cae228f8-f928-4526-9e10-be7874797eac tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:53.029371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cae228f8-f928-4526-9e10-be7874797eac tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:53.029804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cae228f8-f928-4526-9e10-be7874797eac tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:53.067613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-042c9a80-6428-49f0-b8dd-9a938780bc7f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:53.076651 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-042c9a80-6428-49f0-b8dd-9a938780bc7f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1268 microversion: 2.1 time: 0.114504 Oct 11 04:26:53.077544 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1928/3691] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:52 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1268 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:53.085308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4e6e5e22-c8a1-475b-a9d6-f2c8a9e971c5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:53.086278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4e6e5e22-c8a1-475b-a9d6-f2c8a9e971c5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:53.093532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e6e5e22-c8a1-475b-a9d6-f2c8a9e971c5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:53.094525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e6e5e22-c8a1-475b-a9d6-f2c8a9e971c5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:53.095184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e6e5e22-c8a1-475b-a9d6-f2c8a9e971c5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:53.096125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e6e5e22-c8a1-475b-a9d6-f2c8a9e971c5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:53.096837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e6e5e22-c8a1-475b-a9d6-f2c8a9e971c5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:53.097341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e6e5e22-c8a1-475b-a9d6-f2c8a9e971c5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:53.268770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cae228f8-f928-4526-9e10-be7874797eac tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:53.285505 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cae228f8-f928-4526-9e10-be7874797eac tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.292025 Oct 11 04:26:53.288520 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1764/3692] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:52 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:53.430913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4e6e5e22-c8a1-475b-a9d6-f2c8a9e971c5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:53.441462 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4e6e5e22-c8a1-475b-a9d6-f2c8a9e971c5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.362578 Oct 11 04:26:53.467684 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1929/3693] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:53 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:53.472294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd03ecb9-2eb4-47b0-a54d-fc9748731f6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:53.473345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd03ecb9-2eb4-47b0-a54d-fc9748731f6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:53.500899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd03ecb9-2eb4-47b0-a54d-fc9748731f6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:53.503382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd03ecb9-2eb4-47b0-a54d-fc9748731f6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:53.503382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd03ecb9-2eb4-47b0-a54d-fc9748731f6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:53.503382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd03ecb9-2eb4-47b0-a54d-fc9748731f6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:53.506506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd03ecb9-2eb4-47b0-a54d-fc9748731f6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:53.508089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd03ecb9-2eb4-47b0-a54d-fc9748731f6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:53.692792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22146480-1a66-47f3-9227-904a6e9b6a15 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:53.693459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22146480-1a66-47f3-9227-904a6e9b6a15 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:53.707613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22146480-1a66-47f3-9227-904a6e9b6a15 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:53.709881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22146480-1a66-47f3-9227-904a6e9b6a15 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:53.712257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22146480-1a66-47f3-9227-904a6e9b6a15 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:53.713375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22146480-1a66-47f3-9227-904a6e9b6a15 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:53.714083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22146480-1a66-47f3-9227-904a6e9b6a15 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:53.715459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22146480-1a66-47f3-9227-904a6e9b6a15 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:53.836910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd03ecb9-2eb4-47b0-a54d-fc9748731f6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:53.847614 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd03ecb9-2eb4-47b0-a54d-fc9748731f6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.383566 Oct 11 04:26:53.848446 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1765/3694] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:53 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:53.875792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c4b43c6-4b30-4020-bed4-61fd39ced470 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:53.878812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1c4b43c6-4b30-4020-bed4-61fd39ced470 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:53.887195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c4b43c6-4b30-4020-bed4-61fd39ced470 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:53.888317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c4b43c6-4b30-4020-bed4-61fd39ced470 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:53.889030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c4b43c6-4b30-4020-bed4-61fd39ced470 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:53.890050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c4b43c6-4b30-4020-bed4-61fd39ced470 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:53.890806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c4b43c6-4b30-4020-bed4-61fd39ced470 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:53.891735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c4b43c6-4b30-4020-bed4-61fd39ced470 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:54.073593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22146480-1a66-47f3-9227-904a6e9b6a15 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:54.087521 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22146480-1a66-47f3-9227-904a6e9b6a15 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1491 microversion: 2.1 time: 0.399502 Oct 11 04:26:54.090439 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1930/3695] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:53 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1491 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:54.099471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1c4b43c6-4b30-4020-bed4-61fd39ced470 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:54.111926 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c4b43c6-4b30-4020-bed4-61fd39ced470 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.245220 Oct 11 04:26:54.112699 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1766/3696] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:53 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:54.114609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dfc88ad1-da31-4ee5-a739-7e51272c2043 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:54.115255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dfc88ad1-da31-4ee5-a739-7e51272c2043 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:54.128869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c7214cb-320e-493d-af01-a89a10758d9b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:54.129146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc88ad1-da31-4ee5-a739-7e51272c2043 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:54.129662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc88ad1-da31-4ee5-a739-7e51272c2043 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:54.130309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc88ad1-da31-4ee5-a739-7e51272c2043 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:54.131462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc88ad1-da31-4ee5-a739-7e51272c2043 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:54.131943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc88ad1-da31-4ee5-a739-7e51272c2043 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:54.132376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc88ad1-da31-4ee5-a739-7e51272c2043 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:54.133588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c7214cb-320e-493d-af01-a89a10758d9b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:54.144730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c7214cb-320e-493d-af01-a89a10758d9b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:54.147428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c7214cb-320e-493d-af01-a89a10758d9b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:54.147867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c7214cb-320e-493d-af01-a89a10758d9b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:54.148559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c7214cb-320e-493d-af01-a89a10758d9b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:54.149101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c7214cb-320e-493d-af01-a89a10758d9b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:54.159635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c7214cb-320e-493d-af01-a89a10758d9b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:54.210248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c7214cb-320e-493d-af01-a89a10758d9b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:26:54.291562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dfc88ad1-da31-4ee5-a739-7e51272c2043 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:54.300802 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dfc88ad1-da31-4ee5-a739-7e51272c2043 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1274 microversion: 2.1 time: 0.196862 Oct 11 04:26:54.306480 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1931/3697] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:54 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1274 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:54.306658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25c2f104-e5b3-4607-bfc1-83daa36c62a5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:54.307126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-25c2f104-e5b3-4607-bfc1-83daa36c62a5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:54.315467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c2f104-e5b3-4607-bfc1-83daa36c62a5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:54.315965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c2f104-e5b3-4607-bfc1-83daa36c62a5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:54.316405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c2f104-e5b3-4607-bfc1-83daa36c62a5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:54.317110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c2f104-e5b3-4607-bfc1-83daa36c62a5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:54.317560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c2f104-e5b3-4607-bfc1-83daa36c62a5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:54.317983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c2f104-e5b3-4607-bfc1-83daa36c62a5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:54.578967 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8c7214cb-320e-493d-af01-a89a10758d9b tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 204 len: 0 microversion: 2.1 time: 0.464863 Oct 11 04:26:54.583614 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1767/3698] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:26:54 2022] DELETE /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:26:54.593205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2557ff20-6a3f-4fe2-865a-f9f72cfe63be tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:54.595004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2557ff20-6a3f-4fe2-865a-f9f72cfe63be tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:54.609841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2557ff20-6a3f-4fe2-865a-f9f72cfe63be tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:54.614830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2557ff20-6a3f-4fe2-865a-f9f72cfe63be tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:54.614830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2557ff20-6a3f-4fe2-865a-f9f72cfe63be tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:54.614830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2557ff20-6a3f-4fe2-865a-f9f72cfe63be tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:54.615312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25c2f104-e5b3-4607-bfc1-83daa36c62a5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:54.615753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2557ff20-6a3f-4fe2-865a-f9f72cfe63be tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:54.615753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2557ff20-6a3f-4fe2-865a-f9f72cfe63be tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:54.622831 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-25c2f104-e5b3-4607-bfc1-83daa36c62a5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.319847 Oct 11 04:26:54.624104 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1932/3699] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:54 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:54.629000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-63e90558-1f48-4ff2-9fa6-c3dc4722096f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:54.629838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-63e90558-1f48-4ff2-9fa6-c3dc4722096f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:54.639003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63e90558-1f48-4ff2-9fa6-c3dc4722096f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:54.639704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63e90558-1f48-4ff2-9fa6-c3dc4722096f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:54.640325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63e90558-1f48-4ff2-9fa6-c3dc4722096f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:54.641235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63e90558-1f48-4ff2-9fa6-c3dc4722096f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:54.642137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63e90558-1f48-4ff2-9fa6-c3dc4722096f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:54.642790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63e90558-1f48-4ff2-9fa6-c3dc4722096f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:54.969669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-63e90558-1f48-4ff2-9fa6-c3dc4722096f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:54.974371 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-63e90558-1f48-4ff2-9fa6-c3dc4722096f tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1497 microversion: 2.1 time: 0.348920 Oct 11 04:26:54.975885 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1933/3700] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:54 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1497 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:54.981393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-161255654", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "30252624-67f7-4bbb-9346-39722e0301e1"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:54.981553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2557ff20-6a3f-4fe2-865a-f9f72cfe63be tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:55.014691 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2557ff20-6a3f-4fe2-865a-f9f72cfe63be tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.429320 Oct 11 04:26:55.016668 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1768/3701] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:54 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:55.103117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] validate_networks() for [('30252624-67f7-4bbb-9346-39722e0301e1', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:26:55.325669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b06f23be-31d8-4f57-92e5-c3a3b861f415 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:55.326483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b06f23be-31d8-4f57-92e5-c3a3b861f415 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:55.336543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06f23be-31d8-4f57-92e5-c3a3b861f415 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:55.337160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06f23be-31d8-4f57-92e5-c3a3b861f415 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:55.337696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06f23be-31d8-4f57-92e5-c3a3b861f415 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:55.344025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06f23be-31d8-4f57-92e5-c3a3b861f415 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:55.344838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06f23be-31d8-4f57-92e5-c3a3b861f415 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:55.345391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b06f23be-31d8-4f57-92e5-c3a3b861f415 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:55.684404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b06f23be-31d8-4f57-92e5-c3a3b861f415 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:55.706945 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b06f23be-31d8-4f57-92e5-c3a3b861f415 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1316 microversion: 2.1 time: 0.386301 Oct 11 04:26:55.707794 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1769/3702] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:55 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:55.915945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:26:55.917018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:26:55.918120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:26:55.919071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:26:55.919830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:26:55.934794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:55.935537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:55.936525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:55.938983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:55.939519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:55.940884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:55.968566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for project 9a2974866e964ca2864c978d2270bd77. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:26:55.975355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for user 5feceb4a60434064a4fd08f7cc637f32 and project 9a2974866e964ca2864c978d2270bd77. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:26:55.995940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:26:56.001148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:26:56.005043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b056a396-7d47-426c-a602-7e8493af9149 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:56.006045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b056a396-7d47-426c-a602-7e8493af9149 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:56.019742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b056a396-7d47-426c-a602-7e8493af9149 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:56.020237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b056a396-7d47-426c-a602-7e8493af9149 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:56.020675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b056a396-7d47-426c-a602-7e8493af9149 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:56.021383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b056a396-7d47-426c-a602-7e8493af9149 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:56.021833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b056a396-7d47-426c-a602-7e8493af9149 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:56.022276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b056a396-7d47-426c-a602-7e8493af9149 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:56.217105 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a630f4df-98cb-419e-b7ce-e83bca0a0b97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.239698 Oct 11 04:26:56.219672 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1934/3703] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:26:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 1243 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:26:56.276283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a5e273d-4b8e-47e9-af88-d667c8e1e536 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:56.276283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a5e273d-4b8e-47e9-af88-d667c8e1e536 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:56.301281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:56.305910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a5e273d-4b8e-47e9-af88-d667c8e1e536 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:56.316160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a5e273d-4b8e-47e9-af88-d667c8e1e536 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:56.320570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a5e273d-4b8e-47e9-af88-d667c8e1e536 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:56.326538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a5e273d-4b8e-47e9-af88-d667c8e1e536 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:56.332750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a5e273d-4b8e-47e9-af88-d667c8e1e536 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:56.334310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a5e273d-4b8e-47e9-af88-d667c8e1e536 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:56.362404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:56.745994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a5e273d-4b8e-47e9-af88-d667c8e1e536 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:56.758426 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a5e273d-4b8e-47e9-af88-d667c8e1e536 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.514029 Oct 11 04:26:56.760350 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1935/3704] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:56 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:56.766824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f2d6de16-7762-45f9-884a-f3ec29eab277 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:56.768281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f2d6de16-7762-45f9-884a-f3ec29eab277 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:56.828014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b056a396-7d47-426c-a602-7e8493af9149 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:56.837350 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b056a396-7d47-426c-a602-7e8493af9149 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1497 microversion: 2.1 time: 0.836278 Oct 11 04:26:56.839908 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1770/3705] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:55 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1497 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:56.863627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-023f773b-0ac0-4345-84e8-395bde5212ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:56.864510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2d6de16-7762-45f9-884a-f3ec29eab277 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:56.864821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-023f773b-0ac0-4345-84e8-395bde5212ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:56.871831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-023f773b-0ac0-4345-84e8-395bde5212ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:56.872684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-023f773b-0ac0-4345-84e8-395bde5212ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:56.873362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-023f773b-0ac0-4345-84e8-395bde5212ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:56.874334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-023f773b-0ac0-4345-84e8-395bde5212ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:56.875031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-023f773b-0ac0-4345-84e8-395bde5212ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:56.875678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-023f773b-0ac0-4345-84e8-395bde5212ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:56.878284 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f2d6de16-7762-45f9-884a-f3ec29eab277 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1214 microversion: 2.1 time: 0.114517 Oct 11 04:26:56.879844 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1936/3706] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:56 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1214 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:56.882725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:26:57.256729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-023f773b-0ac0-4345-84e8-395bde5212ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:57.265830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-023f773b-0ac0-4345-84e8-395bde5212ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1316 microversion: 2.1 time: 0.413858 Oct 11 04:26:57.267384 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1771/3707] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:56 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1316 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:57.530541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-45e3d108-46f2-4d26-9f5e-d3915a952edd req-742a0351-a11d-4f04-b1db-d6b1de82eeec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38cd4d92-fbc8-4d90-b1d7-06896821816c", "name": "network-vif-deleted", "tag": "40b8da08-b4a5-4822-bd38-5b5993d50d42"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:57.550068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-45e3d108-46f2-4d26-9f5e-d3915a952edd req-742a0351-a11d-4f04-b1db-d6b1de82eeec service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:57.550603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-45e3d108-46f2-4d26-9f5e-d3915a952edd req-742a0351-a11d-4f04-b1db-d6b1de82eeec service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:57.551497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-45e3d108-46f2-4d26-9f5e-d3915a952edd req-742a0351-a11d-4f04-b1db-d6b1de82eeec service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:57.567385 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-45e3d108-46f2-4d26-9f5e-d3915a952edd req-742a0351-a11d-4f04-b1db-d6b1de82eeec service nova] Creating event network-vif-deleted:40b8da08-b4a5-4822-bd38-5b5993d50d42 for instance 38cd4d92-fbc8-4d90-b1d7-06896821816c on n-h2-860892-1 Oct 11 04:26:57.575801 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-45e3d108-46f2-4d26-9f5e-d3915a952edd req-742a0351-a11d-4f04-b1db-d6b1de82eeec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050685 Oct 11 04:26:57.580085 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1937/3708] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:57.785458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c2cfae4e-5f6a-49fb-8da5-4b729905c626 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:57.788223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c2cfae4e-5f6a-49fb-8da5-4b729905c626 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:57.797458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2cfae4e-5f6a-49fb-8da5-4b729905c626 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:57.798270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2cfae4e-5f6a-49fb-8da5-4b729905c626 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:57.812239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2cfae4e-5f6a-49fb-8da5-4b729905c626 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:57.817190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2cfae4e-5f6a-49fb-8da5-4b729905c626 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:57.817878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2cfae4e-5f6a-49fb-8da5-4b729905c626 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:57.821041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2cfae4e-5f6a-49fb-8da5-4b729905c626 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:57.915893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-0fc94108-bf8d-437d-8ac2-a5dd750d7910 req-1554fc24-4885-46ab-b442-7aa4a4640809 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a4d03a0-83b3-4c48-b115-358f2f52ea39", "tag": "a1407cde-af05-4c26-9fb1-a5c498cf85e9"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:26:57.929554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0fc94108-bf8d-437d-8ac2-a5dd750d7910 req-1554fc24-4885-46ab-b442-7aa4a4640809 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:57.934373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0fc94108-bf8d-437d-8ac2-a5dd750d7910 req-1554fc24-4885-46ab-b442-7aa4a4640809 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:57.934915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0fc94108-bf8d-437d-8ac2-a5dd750d7910 req-1554fc24-4885-46ab-b442-7aa4a4640809 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:57.951603 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-0fc94108-bf8d-437d-8ac2-a5dd750d7910 req-1554fc24-4885-46ab-b442-7aa4a4640809 service nova] Creating event network-changed:a1407cde-af05-4c26-9fb1-a5c498cf85e9 for instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 on n-h2-860892-1 Oct 11 04:26:57.962132 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-0fc94108-bf8d-437d-8ac2-a5dd750d7910 req-1554fc24-4885-46ab-b442-7aa4a4640809 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261107 Oct 11 04:26:57.963142 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1772/3709] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:26:57.969627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:57.970491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:57.978132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:57.978664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:57.979101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:57.980016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:57.980646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:57.981245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:58.026514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:58.027275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:58.027879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:58.028585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lazy-loading 'fault' on Instance uuid 38cd4d92-fbc8-4d90-b1d7-06896821816c {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:26:58.081608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:58.094841 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fa768062-122e-45f0-93a9-ecded8da6f74 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1304 microversion: 2.1 time: 0.130003 Oct 11 04:26:58.124866 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1773/3710] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:57 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1304 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:58.130160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1b8243ea-9450-4c71-bb82-2b1299c5445d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:58.135351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1b8243ea-9450-4c71-bb82-2b1299c5445d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:58.169895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b8243ea-9450-4c71-bb82-2b1299c5445d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:58.172180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b8243ea-9450-4c71-bb82-2b1299c5445d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:58.173973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b8243ea-9450-4c71-bb82-2b1299c5445d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:58.177156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b8243ea-9450-4c71-bb82-2b1299c5445d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:58.181030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b8243ea-9450-4c71-bb82-2b1299c5445d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:58.184362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b8243ea-9450-4c71-bb82-2b1299c5445d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:58.200846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c2cfae4e-5f6a-49fb-8da5-4b729905c626 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:58.218569 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c2cfae4e-5f6a-49fb-8da5-4b729905c626 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.439517 Oct 11 04:26:58.260495 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1938/3711] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:57 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:58.294890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8653f6bc-70c5-43e6-99dd-d41cb57ed558 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:58.295933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8653f6bc-70c5-43e6-99dd-d41cb57ed558 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:58.306081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8653f6bc-70c5-43e6-99dd-d41cb57ed558 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:58.309702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8653f6bc-70c5-43e6-99dd-d41cb57ed558 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:58.310833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8653f6bc-70c5-43e6-99dd-d41cb57ed558 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:58.313029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8653f6bc-70c5-43e6-99dd-d41cb57ed558 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:58.318245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8653f6bc-70c5-43e6-99dd-d41cb57ed558 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:58.320433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8653f6bc-70c5-43e6-99dd-d41cb57ed558 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:58.753566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1b8243ea-9450-4c71-bb82-2b1299c5445d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:58.763901 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1b8243ea-9450-4c71-bb82-2b1299c5445d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1218 microversion: 2.1 time: 0.637270 Oct 11 04:26:58.765210 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1774/3712] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:58 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1218 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:58.909863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8653f6bc-70c5-43e6-99dd-d41cb57ed558 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:58.918172 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8653f6bc-70c5-43e6-99dd-d41cb57ed558 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1316 microversion: 2.1 time: 0.632031 Oct 11 04:26:58.919043 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1939/3713] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:58 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1316 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:59.127226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:59.128317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:59.136894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:59.137630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:59.138450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:59.142298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:59.142298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:59.142298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:59.194435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:59.194987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:59.195611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:59.196277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lazy-loading 'fault' on Instance uuid 38cd4d92-fbc8-4d90-b1d7-06896821816c {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:26:59.254985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c977e062-9aa6-44ed-9678-35ddc34bd75b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:59.256319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '99027798dcba4d52a9efc682ccc973d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4168fd89b10f4b9f96a29f41f769fca5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:59.258620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c977e062-9aa6-44ed-9678-35ddc34bd75b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:59.272406 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ddf182c-e095-4013-a8ab-7890f307270e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 200 len: 1304 microversion: 2.1 time: 0.149221 Oct 11 04:26:59.276451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c977e062-9aa6-44ed-9678-35ddc34bd75b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:59.276959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c977e062-9aa6-44ed-9678-35ddc34bd75b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:59.277405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c977e062-9aa6-44ed-9678-35ddc34bd75b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:59.278117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c977e062-9aa6-44ed-9678-35ddc34bd75b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:59.278684 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1775/3714] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:59 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:26:59.279157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c977e062-9aa6-44ed-9678-35ddc34bd75b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:59.279767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c977e062-9aa6-44ed-9678-35ddc34bd75b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:59.561276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c977e062-9aa6-44ed-9678-35ddc34bd75b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:59.577804 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c977e062-9aa6-44ed-9678-35ddc34bd75b tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.329613 Oct 11 04:26:59.582412 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1940/3715] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:59 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:26:59.790351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ac4c5f3-2aeb-49cf-974a-3e8752d20317 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:59.795882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2ac4c5f3-2aeb-49cf-974a-3e8752d20317 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:59.814284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ac4c5f3-2aeb-49cf-974a-3e8752d20317 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:59.815143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ac4c5f3-2aeb-49cf-974a-3e8752d20317 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:59.815833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ac4c5f3-2aeb-49cf-974a-3e8752d20317 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:59.819160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ac4c5f3-2aeb-49cf-974a-3e8752d20317 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:59.819767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ac4c5f3-2aeb-49cf-974a-3e8752d20317 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:59.820355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ac4c5f3-2aeb-49cf-974a-3e8752d20317 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:59.943344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32616186-2f32-402b-920e-0f42e4dc4a31 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:26:59.943947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-32616186-2f32-402b-920e-0f42e4dc4a31 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:26:59.951096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32616186-2f32-402b-920e-0f42e4dc4a31 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:59.957602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32616186-2f32-402b-920e-0f42e4dc4a31 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:59.957602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32616186-2f32-402b-920e-0f42e4dc4a31 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:59.957602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32616186-2f32-402b-920e-0f42e4dc4a31 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:26:59.957602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32616186-2f32-402b-920e-0f42e4dc4a31 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:26:59.957602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32616186-2f32-402b-920e-0f42e4dc4a31 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:26:59.985950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2ac4c5f3-2aeb-49cf-974a-3e8752d20317 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:26:59.995368 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2ac4c5f3-2aeb-49cf-974a-3e8752d20317 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1266 microversion: 2.1 time: 0.211967 Oct 11 04:27:00.000394 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1776/3716] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:59 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1266 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:00.272175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-32616186-2f32-402b-920e-0f42e4dc4a31 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:00.285984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-32616186-2f32-402b-920e-0f42e4dc4a31 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1316 microversion: 2.1 time: 0.347066 Oct 11 04:27:00.286969 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1941/3717] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:26:59 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1316 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:00.296925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.297696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:00.309177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.309751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.314392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.314392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.314392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.314392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.342423 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c HTTP/1.1 Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '38cd4d92-fbc8-4d90-b1d7-06896821816c'} Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.345692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.352082 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.352082 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.352082 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.352082 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:00.352082 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:00.352082 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.352082 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.352082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:00.355706 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d6908825-44db-4a41-b873-6d3146d1642c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 404 len: 111 microversion: 2.1 time: 0.056476 Oct 11 04:27:00.359150 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1777/3718] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:00 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:00.371873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.372525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:00.380193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.381963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.383117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.386388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.386388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.386388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.417229 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c HTTP/1.1 Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '38cd4d92-fbc8-4d90-b1d7-06896821816c'} Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:00.420843 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.427257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:00.428765 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e6be7b02-866d-4679-81ab-1cde1106ae23 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 404 len: 111 microversion: 2.1 time: 0.060488 Oct 11 04:27:00.430731 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1942/3719] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:00 2022] DELETE /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:00.437886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.438836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 38cd4d92-fbc8-4d90-b1d7-06896821816c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:00.450682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.451196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.455565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.455565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.455565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.455565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.481593 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c HTTP/1.1 Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '38cd4d92-fbc8-4d90-b1d7-06896821816c'} Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.483183 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.489382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.489382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.489382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.489382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:00.489382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:00.489382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. Oct 11 04:27:00.489382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.489382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 38cd4d92-fbc8-4d90-b1d7-06896821816c could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:00.489382 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8fabace3-6583-46eb-9026-8ee1905e9809 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c" status: 404 len: 111 microversion: 2.1 time: 0.051086 Oct 11 04:27:00.493485 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1778/3720] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:00 2022] GET /compute/v2.1/servers/38cd4d92-fbc8-4d90-b1d7-06896821816c => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:00.496251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.501518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:00.510687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.511388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.511838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.512595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.513079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.513513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.532602 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c HTTP/1.1 Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '0baccb1e-5505-4df8-a290-46f39e25eb7c'} Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:00.534913 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-77fbeae1-0e4f-496d-9ad8-87eadb81d2aa tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 404 len: 111 microversion: 2.1 time: 0.044889 Oct 11 04:27:00.539810 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1943/3721] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:00 2022] DELETE /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:00.546038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.546799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 0baccb1e-5505-4df8-a290-46f39e25eb7c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:00.553225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:00.556892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.557535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.558344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.559168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.559959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.560655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.577353 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c HTTP/1.1 Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '0baccb1e-5505-4df8-a290-46f39e25eb7c'} Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.579273 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.584902 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.584902 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.584902 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.584902 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:00.584902 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:00.584902 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. Oct 11 04:27:00.584902 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.584902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 0baccb1e-5505-4df8-a290-46f39e25eb7c could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:00.584902 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-05de1b69-395d-48ea-8666-85cfd3fdf31d tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c" status: 404 len: 111 microversion: 2.1 time: 0.038878 Oct 11 04:27:00.584902 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1779/3722] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:00 2022] GET /compute/v2.1/servers/0baccb1e-5505-4df8-a290-46f39e25eb7c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:00.591116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.591299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:00.604404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.605073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.605612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.606291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.606754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.607186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.607360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-26601364-0b20-4be2-83ae-b44465280eb2 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.608665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-26601364-0b20-4be2-83ae-b44465280eb2 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:00.623614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26601364-0b20-4be2-83ae-b44465280eb2 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.624116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26601364-0b20-4be2-83ae-b44465280eb2 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.627920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26601364-0b20-4be2-83ae-b44465280eb2 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.627920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26601364-0b20-4be2-83ae-b44465280eb2 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.627920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26601364-0b20-4be2-83ae-b44465280eb2 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.627920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26601364-0b20-4be2-83ae-b44465280eb2 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.694981 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 HTTP/1.1 Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'f905c4dd-c9f6-452d-bc51-696256de0b36'} Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:00.703704 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1a4ae728-0237-45dc-bcb5-3a4b0097f073 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 404 len: 111 microversion: 2.1 time: 0.119584 Oct 11 04:27:00.719220 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1944/3723] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:00 2022] DELETE /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 111 bytes in 124 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:00.728545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.733629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: f905c4dd-c9f6-452d-bc51-696256de0b36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:00.749090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.749831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.751208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.754407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.757425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.758157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.782948 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 HTTP/1.1 Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'f905c4dd-c9f6-452d-bc51-696256de0b36'} Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.785606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.790658 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.790658 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.790658 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.790658 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:00.790658 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:00.790658 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. Oct 11 04:27:00.790658 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.793037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance f905c4dd-c9f6-452d-bc51-696256de0b36 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:00.795227 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bd7acebd-8708-4660-a895-1a84b90b8e21 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36" status: 404 len: 111 microversion: 2.1 time: 0.071618 Oct 11 04:27:00.796394 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1945/3724] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:00 2022] GET /compute/v2.1/servers/f905c4dd-c9f6-452d-bc51-696256de0b36 => generated 111 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:00.804877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.806382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:00.813272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.814407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.815916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.816845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.817799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.818449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.841506 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 HTTP/1.1 Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7'} Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:00.842657 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-532cb624-c290-4215-a9c2-e5111936bc3c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 404 len: 111 microversion: 2.1 time: 0.048325 Oct 11 04:27:00.853157 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1946/3725] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:00 2022] DELETE /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:27:00.863666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.864290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:00.895086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.895592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.896041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.896761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:00.897222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:00.897648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:00.932099 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 HTTP/1.1 Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7'} Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.934782 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.942456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.942456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.942456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.942456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:00.942456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:00.942456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. Oct 11 04:27:00.942456 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.942456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:00.942456 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e88f38fd-cf85-4735-8672-a68758719178 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7" status: 404 len: 111 microversion: 2.1 time: 0.082030 Oct 11 04:27:00.942456 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1947/3726] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:00 2022] GET /compute/v2.1/servers/40cc0c5d-7f4f-4eb8-9400-e850cd0f04f7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:00.950214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de523232-57b1-46e4-a042-11de25de3ff1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.951556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-de523232-57b1-46e4-a042-11de25de3ff1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 8ce11d80-6a85-4926-8d11-058fd0bc6697] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:00.959257 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-de523232-57b1-46e4-a042-11de25de3ff1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de523232-57b1-46e4-a042-11de25de3ff1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697 HTTP/1.1 Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '8ce11d80-6a85-4926-8d11-058fd0bc6697'} Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:00.964616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.970756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:00.970756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:00.970756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:00.970756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:00.970756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:00.970756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:27:00.970756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:00.970756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de523232-57b1-46e4-a042-11de25de3ff1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:00.970756 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-de523232-57b1-46e4-a042-11de25de3ff1 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697" status: 404 len: 111 microversion: 2.1 time: 0.019450 Oct 11 04:27:00.970756 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1948/3727] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:00 2022] DELETE /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697 => generated 111 bytes in 21 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:00.978038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-99dd38a5-3d83-4803-85de-bcb310390a86 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:00.979348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-99dd38a5-3d83-4803-85de-bcb310390a86 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 8ce11d80-6a85-4926-8d11-058fd0bc6697] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:01.001513 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-99dd38a5-3d83-4803-85de-bcb310390a86 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-99dd38a5-3d83-4803-85de-bcb310390a86 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697 HTTP/1.1 Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '8ce11d80-6a85-4926-8d11-058fd0bc6697'} Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:01.005061 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:01.014874 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:01.014874 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:01.014874 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:01.014874 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. Oct 11 04:27:01.014874 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:01.014874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-99dd38a5-3d83-4803-85de-bcb310390a86 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 8ce11d80-6a85-4926-8d11-058fd0bc6697 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:01.014874 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-99dd38a5-3d83-4803-85de-bcb310390a86 tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697" status: 404 len: 111 microversion: 2.1 time: 0.034549 Oct 11 04:27:01.014874 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1949/3728] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:00 2022] GET /compute/v2.1/servers/8ce11d80-6a85-4926-8d11-058fd0bc6697 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:01.036518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-71746952-15e5-480a-a8bc-1413b06352be tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:01.039224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-71746952-15e5-480a-a8bc-1413b06352be tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:01.058049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71746952-15e5-480a-a8bc-1413b06352be tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:01.058788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71746952-15e5-480a-a8bc-1413b06352be tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:01.059287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71746952-15e5-480a-a8bc-1413b06352be tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:01.060017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71746952-15e5-480a-a8bc-1413b06352be tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:01.060473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71746952-15e5-480a-a8bc-1413b06352be tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:01.061131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71746952-15e5-480a-a8bc-1413b06352be tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:01.144856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-26601364-0b20-4be2-83ae-b44465280eb2 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:01.153346 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-26601364-0b20-4be2-83ae-b44465280eb2 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.550915 Oct 11 04:27:01.154325 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1780/3729] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:00 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:01.237278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-71746952-15e5-480a-a8bc-1413b06352be tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:01.255928 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-71746952-15e5-480a-a8bc-1413b06352be tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1272 microversion: 2.1 time: 0.224696 Oct 11 04:27:01.255928 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1950/3730] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:01 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1272 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:01.313913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b3df87e6-e4ff-4c7d-b829-2ed52a826e0e tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:01.314560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b3df87e6-e4ff-4c7d-b829-2ed52a826e0e tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:01.327881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3df87e6-e4ff-4c7d-b829-2ed52a826e0e tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:01.329872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3df87e6-e4ff-4c7d-b829-2ed52a826e0e tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:01.332633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3df87e6-e4ff-4c7d-b829-2ed52a826e0e tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:01.342854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3df87e6-e4ff-4c7d-b829-2ed52a826e0e tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:01.344592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3df87e6-e4ff-4c7d-b829-2ed52a826e0e tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:01.345162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3df87e6-e4ff-4c7d-b829-2ed52a826e0e tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:01.345671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=14 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:01.705255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b3df87e6-e4ff-4c7d-b829-2ed52a826e0e tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:01.719458 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b3df87e6-e4ff-4c7d-b829-2ed52a826e0e tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1316 microversion: 2.1 time: 0.409571 Oct 11 04:27:01.721794 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1781/3731] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:01 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1316 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:02.179351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e467d8a7-8a2b-492b-85de-24a36668cc33 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:02.180086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e467d8a7-8a2b-492b-85de-24a36668cc33 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:02.193782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e467d8a7-8a2b-492b-85de-24a36668cc33 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:02.196083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e467d8a7-8a2b-492b-85de-24a36668cc33 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:02.198432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e467d8a7-8a2b-492b-85de-24a36668cc33 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:02.199978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e467d8a7-8a2b-492b-85de-24a36668cc33 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:02.201177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e467d8a7-8a2b-492b-85de-24a36668cc33 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:02.202384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e467d8a7-8a2b-492b-85de-24a36668cc33 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:02.307655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a5312755-56c0-473b-9f89-6522f2ab8e2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:02.307655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a5312755-56c0-473b-9f89-6522f2ab8e2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:02.307655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5312755-56c0-473b-9f89-6522f2ab8e2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:02.307655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5312755-56c0-473b-9f89-6522f2ab8e2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:02.307655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5312755-56c0-473b-9f89-6522f2ab8e2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:02.307655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5312755-56c0-473b-9f89-6522f2ab8e2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:02.307655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5312755-56c0-473b-9f89-6522f2ab8e2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:02.307655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5312755-56c0-473b-9f89-6522f2ab8e2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:02.382479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=18 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:02.764053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e467d8a7-8a2b-492b-85de-24a36668cc33 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:02.782468 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e467d8a7-8a2b-492b-85de-24a36668cc33 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.609323 Oct 11 04:27:02.783367 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1951/3732] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:02 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:02.795652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fee397d5-3e46-4106-a153-f1dff1ceb81f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:02.798828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fee397d5-3e46-4106-a153-f1dff1ceb81f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:02.811717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee397d5-3e46-4106-a153-f1dff1ceb81f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:02.816005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee397d5-3e46-4106-a153-f1dff1ceb81f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:02.817223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee397d5-3e46-4106-a153-f1dff1ceb81f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:02.828437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee397d5-3e46-4106-a153-f1dff1ceb81f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:02.829939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee397d5-3e46-4106-a153-f1dff1ceb81f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:02.831436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee397d5-3e46-4106-a153-f1dff1ceb81f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:03.016654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a5312755-56c0-473b-9f89-6522f2ab8e2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:03.031464 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a5312755-56c0-473b-9f89-6522f2ab8e2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1314 microversion: 2.1 time: 0.749994 Oct 11 04:27:03.034696 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1782/3733] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:02 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1314 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:03.701844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fee397d5-3e46-4106-a153-f1dff1ceb81f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:03.710873 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fee397d5-3e46-4106-a153-f1dff1ceb81f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1316 microversion: 2.1 time: 0.926066 Oct 11 04:27:03.711462 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1952/3734] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:02 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1316 bytes in 927 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:03.812155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4f17d6a-eaf8-4926-aa28-cb1965dd4922 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:03.813879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f4f17d6a-eaf8-4926-aa28-cb1965dd4922 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:03.831950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f17d6a-eaf8-4926-aa28-cb1965dd4922 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:03.832442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f17d6a-eaf8-4926-aa28-cb1965dd4922 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:03.836871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f17d6a-eaf8-4926-aa28-cb1965dd4922 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:03.837645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f17d6a-eaf8-4926-aa28-cb1965dd4922 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:03.838116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f17d6a-eaf8-4926-aa28-cb1965dd4922 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:03.838585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f17d6a-eaf8-4926-aa28-cb1965dd4922 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:04.062223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbc5bc1c-d91b-4fc2-9fc1-408decc02307 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:04.063673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cbc5bc1c-d91b-4fc2-9fc1-408decc02307 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:04.072155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc5bc1c-d91b-4fc2-9fc1-408decc02307 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:04.074027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc5bc1c-d91b-4fc2-9fc1-408decc02307 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:04.074027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc5bc1c-d91b-4fc2-9fc1-408decc02307 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:04.075024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc5bc1c-d91b-4fc2-9fc1-408decc02307 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:04.075292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc5bc1c-d91b-4fc2-9fc1-408decc02307 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:04.076022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbc5bc1c-d91b-4fc2-9fc1-408decc02307 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:04.135092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4f17d6a-eaf8-4926-aa28-cb1965dd4922 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:04.153288 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f4f17d6a-eaf8-4926-aa28-cb1965dd4922 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.346615 Oct 11 04:27:04.155093 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1783/3735] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:03 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:04.303947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cbc5bc1c-d91b-4fc2-9fc1-408decc02307 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:04.313046 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cbc5bc1c-d91b-4fc2-9fc1-408decc02307 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1314 microversion: 2.1 time: 0.256253 Oct 11 04:27:04.314433 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1953/3736] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:04 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:04.733028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3d2c3262-27f8-4ba9-852d-92124e760950 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:04.734424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3d2c3262-27f8-4ba9-852d-92124e760950 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:04.741531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2c3262-27f8-4ba9-852d-92124e760950 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:04.742336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2c3262-27f8-4ba9-852d-92124e760950 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:04.743077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2c3262-27f8-4ba9-852d-92124e760950 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:04.743942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2c3262-27f8-4ba9-852d-92124e760950 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:04.744568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2c3262-27f8-4ba9-852d-92124e760950 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:04.745153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2c3262-27f8-4ba9-852d-92124e760950 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:04.824643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-04b8eef8-54a0-4672-93b7-4c4f2b796a92 req-73a8e878-8fe7-40b0-9013-a8597b7dd3d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ec8dd13-4df6-4c50-a9a3-2c75493566db", "tag": "9da35fef-6bcd-4c8e-92f8-94a5701dd64c"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:04.847408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-04b8eef8-54a0-4672-93b7-4c4f2b796a92 req-73a8e878-8fe7-40b0-9013-a8597b7dd3d6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:04.848255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-04b8eef8-54a0-4672-93b7-4c4f2b796a92 req-73a8e878-8fe7-40b0-9013-a8597b7dd3d6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:04.849217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-04b8eef8-54a0-4672-93b7-4c4f2b796a92 req-73a8e878-8fe7-40b0-9013-a8597b7dd3d6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:04.865824 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-04b8eef8-54a0-4672-93b7-4c4f2b796a92 req-73a8e878-8fe7-40b0-9013-a8597b7dd3d6 service nova] Creating event network-changed:9da35fef-6bcd-4c8e-92f8-94a5701dd64c for instance 4ec8dd13-4df6-4c50-a9a3-2c75493566db on n-h1-860892-1 Oct 11 04:27:04.872064 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-04b8eef8-54a0-4672-93b7-4c4f2b796a92 req-73a8e878-8fe7-40b0-9013-a8597b7dd3d6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050935 Oct 11 04:27:04.874320 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1954/3737] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:27:05.163865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-9a791e10-0ec6-4a5d-8e0a-a94d1503abf4 req-8dfb1351-3306-4629-a22d-86ab6ea18f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a4d03a0-83b3-4c48-b115-358f2f52ea39", "name": "network-vif-plugged", "status": "completed", "tag": "a1407cde-af05-4c26-9fb1-a5c498cf85e9"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:05.178633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9a791e10-0ec6-4a5d-8e0a-a94d1503abf4 req-8dfb1351-3306-4629-a22d-86ab6ea18f71 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:05.182885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9a791e10-0ec6-4a5d-8e0a-a94d1503abf4 req-8dfb1351-3306-4629-a22d-86ab6ea18f71 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:05.183607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9a791e10-0ec6-4a5d-8e0a-a94d1503abf4 req-8dfb1351-3306-4629-a22d-86ab6ea18f71 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:05.202470 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-9a791e10-0ec6-4a5d-8e0a-a94d1503abf4 req-8dfb1351-3306-4629-a22d-86ab6ea18f71 service nova] Creating event network-vif-plugged:a1407cde-af05-4c26-9fb1-a5c498cf85e9 for instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 on n-h2-860892-1 Oct 11 04:27:05.220522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3d2c3262-27f8-4ba9-852d-92124e760950 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:05.228557 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-9a791e10-0ec6-4a5d-8e0a-a94d1503abf4 req-8dfb1351-3306-4629-a22d-86ab6ea18f71 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067176 Oct 11 04:27:05.235265 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1955/3738] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:27:05.238557 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3d2c3262-27f8-4ba9-852d-92124e760950 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1316 microversion: 2.1 time: 0.507363 Oct 11 04:27:05.243515 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1784/3739] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:04 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1316 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:05.275450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-be5b1343-a930-4df5-8d9d-1441f4b91841 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:05.277986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-be5b1343-a930-4df5-8d9d-1441f4b91841 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:05.296867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5b1343-a930-4df5-8d9d-1441f4b91841 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:05.298743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5b1343-a930-4df5-8d9d-1441f4b91841 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:05.299971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5b1343-a930-4df5-8d9d-1441f4b91841 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:05.301316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5b1343-a930-4df5-8d9d-1441f4b91841 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:05.313662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5b1343-a930-4df5-8d9d-1441f4b91841 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:05.314096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be5b1343-a930-4df5-8d9d-1441f4b91841 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:05.337386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67895efe-3779-4894-8f16-1d44ca25ea20 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:05.338400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67895efe-3779-4894-8f16-1d44ca25ea20 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:05.399418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67895efe-3779-4894-8f16-1d44ca25ea20 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:05.400078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67895efe-3779-4894-8f16-1d44ca25ea20 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:05.400649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67895efe-3779-4894-8f16-1d44ca25ea20 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:05.401614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67895efe-3779-4894-8f16-1d44ca25ea20 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:05.402453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67895efe-3779-4894-8f16-1d44ca25ea20 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:05.403175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67895efe-3779-4894-8f16-1d44ca25ea20 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:05.672651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be5b1343-a930-4df5-8d9d-1441f4b91841 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:05.686710 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-be5b1343-a930-4df5-8d9d-1441f4b91841 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.449380 Oct 11 04:27:05.688216 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1956/3740] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:05 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:06.207819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-67895efe-3779-4894-8f16-1d44ca25ea20 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:06.217775 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-67895efe-3779-4894-8f16-1d44ca25ea20 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1314 microversion: 2.1 time: 0.883586 Oct 11 04:27:06.220213 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1785/3741] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:05 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1314 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:06.265063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b5bb0672-9364-4e86-91fc-608287d569c1 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:06.265816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b5bb0672-9364-4e86-91fc-608287d569c1 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:06.269242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:06.281868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5bb0672-9364-4e86-91fc-608287d569c1 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:06.285840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5bb0672-9364-4e86-91fc-608287d569c1 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:06.285840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5bb0672-9364-4e86-91fc-608287d569c1 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:06.285840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5bb0672-9364-4e86-91fc-608287d569c1 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:06.285840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5bb0672-9364-4e86-91fc-608287d569c1 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:06.285840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5bb0672-9364-4e86-91fc-608287d569c1 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:06.545016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b5bb0672-9364-4e86-91fc-608287d569c1 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:06.554843 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b5bb0672-9364-4e86-91fc-608287d569c1 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1316 microversion: 2.1 time: 0.293725 Oct 11 04:27:06.555843 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1957/3742] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:06 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1316 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:06.716564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d21a58e4-045a-4409-b73e-4fdd548d5b06 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:06.718157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d21a58e4-045a-4409-b73e-4fdd548d5b06 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:06.749905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21a58e4-045a-4409-b73e-4fdd548d5b06 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:06.750706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21a58e4-045a-4409-b73e-4fdd548d5b06 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:06.751335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21a58e4-045a-4409-b73e-4fdd548d5b06 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:06.752308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21a58e4-045a-4409-b73e-4fdd548d5b06 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:06.752932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21a58e4-045a-4409-b73e-4fdd548d5b06 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:06.758491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21a58e4-045a-4409-b73e-4fdd548d5b06 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:06.871195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:06.871690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:06.878968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=12 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:06.886402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:06.886917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:06.890368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:06.900550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:06.901165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:06.901615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:06.948051 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c HTTP/1.1 Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '557ba8ab-6c3d-4794-95ad-0dd362e8f43c'} Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:06.950034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:06.955077 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:27:06.955077 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:06.955077 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:06.955077 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:06.955077 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:06.955077 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:06.955077 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:06.955077 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:06.955077 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:06.955077 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:27:06.955077 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:06.961276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:06.963138 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2a15d294-d447-4d6f-9025-cd793164ffce tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 404 len: 111 microversion: 2.1 time: 0.095983 Oct 11 04:27:06.965538 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1958/3743] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:06 2022] DELETE /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 111 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:27:06.977184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:06.978044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 557ba8ab-6c3d-4794-95ad-0dd362e8f43c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:06.990587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:06.993751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:06.995151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:06.996083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:06.998399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:06.999053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:07.037298 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c HTTP/1.1 Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '557ba8ab-6c3d-4794-95ad-0dd362e8f43c'} Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:07.039528 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.044107 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:07.044107 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:07.044107 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:07.044107 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:07.044107 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:07.044107 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. Oct 11 04:27:07.044107 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.046722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 557ba8ab-6c3d-4794-95ad-0dd362e8f43c could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:07.054833 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1b66813d-7dd8-44ae-a639-c058b83d2e7c tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c" status: 404 len: 111 microversion: 2.1 time: 0.074922 Oct 11 04:27:07.054833 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1959/3744] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:06 2022] GET /compute/v2.1/servers/557ba8ab-6c3d-4794-95ad-0dd362e8f43c => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:07.058328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:07.058944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:07.068553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:07.069322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:07.087683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:07.089043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:07.089806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:07.090715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:07.109008 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f HTTP/1.1 Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '5e48b394-ab48-46ff-803a-0f353c0fb99f'} Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:07.111527 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:07.115951 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:27:07.115951 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.115951 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:07.115951 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.115951 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:07.115951 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:07.115951 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:07.115951 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:07.115951 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:07.115951 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:27:07.115951 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.119552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:07.120919 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-611ef184-2f3b-4108-a5f6-7a604352ccfc tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 404 len: 111 microversion: 2.1 time: 0.067314 Oct 11 04:27:07.121759 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1960/3745] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:07 2022] DELETE /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:07.132466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:07.133460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] [instance: 5e48b394-ab48-46ff-803a-0f353c0fb99f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:07.141237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d21a58e4-045a-4409-b73e-4fdd548d5b06 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:07.141846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:07.142671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:07.143657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:07.144643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:07.145329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:07.145997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:07.164716 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d21a58e4-045a-4409-b73e-4fdd548d5b06 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.449288 Oct 11 04:27:07.176117 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1786/3746] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:06 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:07.189908 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] HTTP exception thrown: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Request method failure captured: Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f HTTP/1.1 Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO850a-mGyqkO89jTg2Ju5raSTUNr8OmCjLuTX6_gB1tghLZTk2sl4uUBiqdy6OJUCihNcfs5HjrkEdWABUPSqBwLG_qWy-nbTwpGyJLCLXsBHNyxyH8ArlP8mXLEk_27olVuUYB5NqR1HEcT9NC9s2ghIQuDw427mnRc07i7YHT-fY Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4168fd89b10f4b9f96a29f41f769fca5"}]}] Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4168fd89b10f4b9f96a29f41f769fca5 Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-79677381 Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 99027798dcba4d52a9efc682ccc973d3 Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-79677381-project Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '5e48b394-ab48-46ff-803a-0f353c0fb99f'} Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:07.194226 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.199330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:07.199330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:07.199330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:07.199330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:07.199330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:07.199330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. Oct 11 04:27:07.199330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:07.201464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] Returning 404 to user: Instance 5e48b394-ab48-46ff-803a-0f353c0fb99f could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:07.202463 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d93341c7-df09-438b-aed4-263f42ca037e tempest-DeleteServersTestJSON-79677381 tempest-DeleteServersTestJSON-79677381-project] 10.222.0.26 "GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f" status: 404 len: 111 microversion: 2.1 time: 0.075866 Oct 11 04:27:07.203233 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1961/3747] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:07 2022] GET /compute/v2.1/servers/5e48b394-ab48-46ff-803a-0f353c0fb99f => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:07.247141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-651650d9-9fc2-42a7-802d-51382fc6bd32 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:07.249465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-651650d9-9fc2-42a7-802d-51382fc6bd32 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:07.264411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-651650d9-9fc2-42a7-802d-51382fc6bd32 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:07.266752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-651650d9-9fc2-42a7-802d-51382fc6bd32 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:07.269129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-651650d9-9fc2-42a7-802d-51382fc6bd32 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:07.269909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-651650d9-9fc2-42a7-802d-51382fc6bd32 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:07.272774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-651650d9-9fc2-42a7-802d-51382fc6bd32 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:07.273386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-651650d9-9fc2-42a7-802d-51382fc6bd32 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:07.580735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a9bd2da-9c56-4f3f-b406-0df246ff9eb4 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:07.581452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a9bd2da-9c56-4f3f-b406-0df246ff9eb4 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:07.597117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a9bd2da-9c56-4f3f-b406-0df246ff9eb4 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:07.597620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a9bd2da-9c56-4f3f-b406-0df246ff9eb4 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:07.598953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a9bd2da-9c56-4f3f-b406-0df246ff9eb4 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:07.598953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a9bd2da-9c56-4f3f-b406-0df246ff9eb4 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:07.607539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a9bd2da-9c56-4f3f-b406-0df246ff9eb4 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:07.608080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a9bd2da-9c56-4f3f-b406-0df246ff9eb4 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:07.664663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-651650d9-9fc2-42a7-802d-51382fc6bd32 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:07.673338 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-651650d9-9fc2-42a7-802d-51382fc6bd32 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1314 microversion: 2.1 time: 0.430276 Oct 11 04:27:07.679626 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1787/3748] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:07 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1314 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:07.966736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3a9bd2da-9c56-4f3f-b406-0df246ff9eb4 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:07.980083 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a9bd2da-9c56-4f3f-b406-0df246ff9eb4 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1504 microversion: 2.1 time: 0.403352 Oct 11 04:27:07.982625 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1962/3749] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:07 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1504 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:08.010451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-60e49fa1-3524-49a5-bbcd-770126fa8b58 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:08.015035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-60e49fa1-3524-49a5-bbcd-770126fa8b58 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:08.030007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60e49fa1-3524-49a5-bbcd-770126fa8b58 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:08.031087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60e49fa1-3524-49a5-bbcd-770126fa8b58 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:08.031938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60e49fa1-3524-49a5-bbcd-770126fa8b58 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:08.032666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60e49fa1-3524-49a5-bbcd-770126fa8b58 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:08.033123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60e49fa1-3524-49a5-bbcd-770126fa8b58 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:08.033640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60e49fa1-3524-49a5-bbcd-770126fa8b58 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:08.090096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-60e49fa1-3524-49a5-bbcd-770126fa8b58 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:27:08.145390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:08.189763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0e535888-9ac9-418e-9661-16b41d8d4f47 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:08.190593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0e535888-9ac9-418e-9661-16b41d8d4f47 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:08.201271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e535888-9ac9-418e-9661-16b41d8d4f47 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:08.201994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e535888-9ac9-418e-9661-16b41d8d4f47 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:08.204024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e535888-9ac9-418e-9661-16b41d8d4f47 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:08.207943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e535888-9ac9-418e-9661-16b41d8d4f47 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:08.208419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e535888-9ac9-418e-9661-16b41d8d4f47 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:08.210480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e535888-9ac9-418e-9661-16b41d8d4f47 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:08.239244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:08.463855 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-60e49fa1-3524-49a5-bbcd-770126fa8b58 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 204 len: 0 microversion: 2.1 time: 0.457062 Oct 11 04:27:08.464468 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1788/3750] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:08 2022] DELETE /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:27:08.475964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5811d65-c182-4fc6-9961-0647ac3742d0 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:08.477389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c5811d65-c182-4fc6-9961-0647ac3742d0 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:08.485788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5811d65-c182-4fc6-9961-0647ac3742d0 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:08.486794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5811d65-c182-4fc6-9961-0647ac3742d0 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:08.488889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5811d65-c182-4fc6-9961-0647ac3742d0 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:08.488889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5811d65-c182-4fc6-9961-0647ac3742d0 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:08.488889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5811d65-c182-4fc6-9961-0647ac3742d0 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:08.489873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5811d65-c182-4fc6-9961-0647ac3742d0 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:08.527890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0e535888-9ac9-418e-9661-16b41d8d4f47 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:08.537315 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0e535888-9ac9-418e-9661-16b41d8d4f47 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.351914 Oct 11 04:27:08.538021 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1963/3751] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:08 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:08.699496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a83094dd-b840-44ea-bf38-eb0a3f367c4d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:08.700097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a83094dd-b840-44ea-bf38-eb0a3f367c4d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:08.714864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a83094dd-b840-44ea-bf38-eb0a3f367c4d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:08.721317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a83094dd-b840-44ea-bf38-eb0a3f367c4d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:08.721317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a83094dd-b840-44ea-bf38-eb0a3f367c4d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:08.721317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a83094dd-b840-44ea-bf38-eb0a3f367c4d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:08.721317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a83094dd-b840-44ea-bf38-eb0a3f367c4d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:08.721317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a83094dd-b840-44ea-bf38-eb0a3f367c4d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:09.051125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a83094dd-b840-44ea-bf38-eb0a3f367c4d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:09.065018 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a83094dd-b840-44ea-bf38-eb0a3f367c4d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1314 microversion: 2.1 time: 0.370011 Oct 11 04:27:09.070804 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1964/3752] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:08 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:09.167396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c5811d65-c182-4fc6-9961-0647ac3742d0 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:09.179755 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c5811d65-c182-4fc6-9961-0647ac3742d0 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1510 microversion: 2.1 time: 0.710784 Oct 11 04:27:09.187047 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1789/3753] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:08 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1510 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:09.566464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2038e09b-41e8-4734-9aa7-a093fe0af4d7 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:09.567565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2038e09b-41e8-4734-9aa7-a093fe0af4d7 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:09.578022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2038e09b-41e8-4734-9aa7-a093fe0af4d7 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:09.579193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2038e09b-41e8-4734-9aa7-a093fe0af4d7 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:09.580647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2038e09b-41e8-4734-9aa7-a093fe0af4d7 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:09.581648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2038e09b-41e8-4734-9aa7-a093fe0af4d7 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:09.583535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2038e09b-41e8-4734-9aa7-a093fe0af4d7 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:09.584418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2038e09b-41e8-4734-9aa7-a093fe0af4d7 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:10.096640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-03affce7-a860-4012-8e89-84ab704e0c47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:10.097802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-03affce7-a860-4012-8e89-84ab704e0c47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:10.120920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03affce7-a860-4012-8e89-84ab704e0c47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:10.126794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03affce7-a860-4012-8e89-84ab704e0c47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:10.126794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03affce7-a860-4012-8e89-84ab704e0c47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:10.128562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03affce7-a860-4012-8e89-84ab704e0c47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:10.131275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03affce7-a860-4012-8e89-84ab704e0c47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:10.139488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03affce7-a860-4012-8e89-84ab704e0c47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:10.143695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2038e09b-41e8-4734-9aa7-a093fe0af4d7 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:10.170240 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2038e09b-41e8-4734-9aa7-a093fe0af4d7 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.604369 Oct 11 04:27:10.171046 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1965/3754] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:09 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:10.208644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fcabaae4-010e-4447-94d0-903251cf7bae tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:10.209183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fcabaae4-010e-4447-94d0-903251cf7bae tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:10.218009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcabaae4-010e-4447-94d0-903251cf7bae tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:10.230308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcabaae4-010e-4447-94d0-903251cf7bae tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:10.230308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcabaae4-010e-4447-94d0-903251cf7bae tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:10.230308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcabaae4-010e-4447-94d0-903251cf7bae tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:10.230308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcabaae4-010e-4447-94d0-903251cf7bae tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:10.230806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcabaae4-010e-4447-94d0-903251cf7bae tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:10.824908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-03affce7-a860-4012-8e89-84ab704e0c47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:10.848113 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-03affce7-a860-4012-8e89-84ab704e0c47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1314 microversion: 2.1 time: 0.754086 Oct 11 04:27:10.857198 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1790/3755] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:10 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1314 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:10.916266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fcabaae4-010e-4447-94d0-903251cf7bae tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:10.927577 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fcabaae4-010e-4447-94d0-903251cf7bae tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1510 microversion: 2.1 time: 0.722982 Oct 11 04:27:10.928993 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1966/3756] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:10 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1510 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:11.197991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1056c071-5f1f-412c-bfd1-63049f1f92e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:11.199436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1056c071-5f1f-412c-bfd1-63049f1f92e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:11.212461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1056c071-5f1f-412c-bfd1-63049f1f92e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:11.215194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1056c071-5f1f-412c-bfd1-63049f1f92e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:11.215665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1056c071-5f1f-412c-bfd1-63049f1f92e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:11.220803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1056c071-5f1f-412c-bfd1-63049f1f92e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:11.221299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1056c071-5f1f-412c-bfd1-63049f1f92e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:11.221757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1056c071-5f1f-412c-bfd1-63049f1f92e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:11.481831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c82d78cf-ce4e-4cc4-a4f6-b85f568b3d36 req-a6b18fe1-553b-4c07-ab71-cbeda2454aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a4d03a0-83b3-4c48-b115-358f2f52ea39", "name": "network-vif-deleted", "tag": "a1407cde-af05-4c26-9fb1-a5c498cf85e9"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:11.506943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c82d78cf-ce4e-4cc4-a4f6-b85f568b3d36 req-a6b18fe1-553b-4c07-ab71-cbeda2454aea service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:11.507936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c82d78cf-ce4e-4cc4-a4f6-b85f568b3d36 req-a6b18fe1-553b-4c07-ab71-cbeda2454aea service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:11.508621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c82d78cf-ce4e-4cc4-a4f6-b85f568b3d36 req-a6b18fe1-553b-4c07-ab71-cbeda2454aea service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:11.529616 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c82d78cf-ce4e-4cc4-a4f6-b85f568b3d36 req-a6b18fe1-553b-4c07-ab71-cbeda2454aea service nova] Creating event network-vif-deleted:a1407cde-af05-4c26-9fb1-a5c498cf85e9 for instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 on n-h2-860892-1 Oct 11 04:27:11.547942 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c82d78cf-ce4e-4cc4-a4f6-b85f568b3d36 req-a6b18fe1-553b-4c07-ab71-cbeda2454aea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071141 Oct 11 04:27:11.548632 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1967/3757] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:27:11.672863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1056c071-5f1f-412c-bfd1-63049f1f92e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:11.690008 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1056c071-5f1f-412c-bfd1-63049f1f92e3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.495643 Oct 11 04:27:11.693686 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1791/3758] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:11 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:11.871215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0a044b4-6e4a-450f-bb42-fc2189049033 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:11.871918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d0a044b4-6e4a-450f-bb42-fc2189049033 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:11.889918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a044b4-6e4a-450f-bb42-fc2189049033 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:11.890436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a044b4-6e4a-450f-bb42-fc2189049033 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:11.890880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a044b4-6e4a-450f-bb42-fc2189049033 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:11.891581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a044b4-6e4a-450f-bb42-fc2189049033 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:11.892039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a044b4-6e4a-450f-bb42-fc2189049033 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:11.892973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a044b4-6e4a-450f-bb42-fc2189049033 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:11.953846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:11.954484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:11.972833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:11.973386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:11.973832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:11.984769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:11.987396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:11.987396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:12.025927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:12.026740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:12.027499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:12.028212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lazy-loading 'fault' on Instance uuid 3a4d03a0-83b3-4c48-b115-358f2f52ea39 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:27:12.098659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:12.107735 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff89eb41-b844-4d0a-ad1a-56e96d41a68b tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1306 microversion: 2.1 time: 0.157981 Oct 11 04:27:12.108977 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1792/3759] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:11 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1306 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:12.154450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e8af60a2-81d5-4455-8d9f-5d5792a052bf req-e24e1fef-4e15-4f6e-90d3-53f18a67b5fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec8dd13-4df6-4c50-a9a3-2c75493566db", "name": "network-vif-plugged", "status": "completed", "tag": "9da35fef-6bcd-4c8e-92f8-94a5701dd64c"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:12.168550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e8af60a2-81d5-4455-8d9f-5d5792a052bf req-e24e1fef-4e15-4f6e-90d3-53f18a67b5fa service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:12.192873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e8af60a2-81d5-4455-8d9f-5d5792a052bf req-e24e1fef-4e15-4f6e-90d3-53f18a67b5fa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:12.192873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e8af60a2-81d5-4455-8d9f-5d5792a052bf req-e24e1fef-4e15-4f6e-90d3-53f18a67b5fa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:12.192873 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e8af60a2-81d5-4455-8d9f-5d5792a052bf req-e24e1fef-4e15-4f6e-90d3-53f18a67b5fa service nova] Creating event network-vif-plugged:9da35fef-6bcd-4c8e-92f8-94a5701dd64c for instance 4ec8dd13-4df6-4c50-a9a3-2c75493566db on n-h1-860892-1 Oct 11 04:27:12.192873 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e8af60a2-81d5-4455-8d9f-5d5792a052bf req-e24e1fef-4e15-4f6e-90d3-53f18a67b5fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041339 Oct 11 04:27:12.192873 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1793/3760] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:27:12.260549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d0a044b4-6e4a-450f-bb42-fc2189049033 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:12.274556 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d0a044b4-6e4a-450f-bb42-fc2189049033 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1314 microversion: 2.1 time: 0.408654 Oct 11 04:27:12.275148 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1968/3761] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:11 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1314 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:12.723557 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 04:27:12.723557 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 04:27:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e (ip 10.222.0.26) !!! Oct 11 04:27:12.723557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd2b170f-7494-40ec-8d6a-f12a92b29092 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:12.723557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd2b170f-7494-40ec-8d6a-f12a92b29092 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:12.745825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b170f-7494-40ec-8d6a-f12a92b29092 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:12.747161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b170f-7494-40ec-8d6a-f12a92b29092 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:12.753808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b170f-7494-40ec-8d6a-f12a92b29092 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:12.753808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b170f-7494-40ec-8d6a-f12a92b29092 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:12.753808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b170f-7494-40ec-8d6a-f12a92b29092 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:12.753808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2b170f-7494-40ec-8d6a-f12a92b29092 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:13.028117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd2b170f-7494-40ec-8d6a-f12a92b29092 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:13.038161 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd2b170f-7494-40ec-8d6a-f12a92b29092 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1521 microversion: 2.1 time: 0.325074 Oct 11 04:27:13.051092 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1794/3762] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:12 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:13.135724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:13.138281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:13.147653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:13.148647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:13.149346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:13.150310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:13.151079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:13.151690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:13.202465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:13.203023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:13.203469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:13.204552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lazy-loading 'fault' on Instance uuid 3a4d03a0-83b3-4c48-b115-358f2f52ea39 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:27:13.271127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a30e59b6df16418e97280550c4d28ac6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd69384a24dc4bf0959c6caea6f40f42', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:13.286847 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-acfb4117-3890-4492-9eb1-c897381a905a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 200 len: 1306 microversion: 2.1 time: 0.155608 Oct 11 04:27:13.286847 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1969/3763] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:13 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 1306 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:13.304061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c5d57c2-fec6-488d-859d-d5bd770168d2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:13.304061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1c5d57c2-fec6-488d-859d-d5bd770168d2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:13.315681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c5d57c2-fec6-488d-859d-d5bd770168d2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:13.316394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c5d57c2-fec6-488d-859d-d5bd770168d2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:13.317095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c5d57c2-fec6-488d-859d-d5bd770168d2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:13.318980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c5d57c2-fec6-488d-859d-d5bd770168d2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:13.319640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c5d57c2-fec6-488d-859d-d5bd770168d2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:13.320391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c5d57c2-fec6-488d-859d-d5bd770168d2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:13.665072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1c5d57c2-fec6-488d-859d-d5bd770168d2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:13.679114 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c5d57c2-fec6-488d-859d-d5bd770168d2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1314 microversion: 2.1 time: 0.379409 Oct 11 04:27:13.690265 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1795/3764] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:13 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:14.065421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-86ca76db-50fa-4ea8-a8cf-0e12cb7a2b89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:14.066091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-86ca76db-50fa-4ea8-a8cf-0e12cb7a2b89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:14.078581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86ca76db-50fa-4ea8-a8cf-0e12cb7a2b89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.079490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86ca76db-50fa-4ea8-a8cf-0e12cb7a2b89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.080844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86ca76db-50fa-4ea8-a8cf-0e12cb7a2b89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.083053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86ca76db-50fa-4ea8-a8cf-0e12cb7a2b89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.083850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86ca76db-50fa-4ea8-a8cf-0e12cb7a2b89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.085182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86ca76db-50fa-4ea8-a8cf-0e12cb7a2b89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.307760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:14.309261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:14.323605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.328459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-86ca76db-50fa-4ea8-a8cf-0e12cb7a2b89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:14.329033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.329406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.330135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.333513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.333960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.342691 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-86ca76db-50fa-4ea8-a8cf-0e12cb7a2b89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1498 microversion: 2.1 time: 0.281354 Oct 11 04:27:14.344838 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1970/3765] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:14 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1498 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:14.372135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44e41569-9439-40d6-9817-7453cd4fec5e tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:14.377368 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] HTTP exception thrown: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.382937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44e41569-9439-40d6-9817-7453cd4fec5e tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:14.384020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44e41569-9439-40d6-9817-7453cd4fec5e tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'vm_state': ['stopped'], 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Request method failure captured: Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 HTTP/1.1 Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPCFCd4c5wQ3BArw9IOnL7yA7D8u-jiulaTdLSlhgplwj1ZJwH0ySan7xSun3gkpaiFNlAjAOe1-E9C3nJ3yFTdxigM_QQESahwZdPY93x-pUkHNtffbAh39J0lOuHSyWqqIla8MYqYJf0UdxsJ_zHNaEr0l_jao-sKl6grKA4Dcfh8 Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}] Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a30e59b6df16418e97280550c4d28ac6 Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '3a4d03a0-83b3-4c48-b115-358f2f52ea39'} Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.385553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.390992 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.390992 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.390992 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.390992 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:14.390992 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:14.390992 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.390992 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.392520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Returning 404 to user: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:14.393031 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-67c91107-6f43-470e-84f2-ae02cd98b53f tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 404 len: 111 microversion: 2.1 time: 0.089333 Oct 11 04:27:14.399852 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1796/3766] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:14 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:27:14.409609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e41569-9439-40d6-9817-7453cd4fec5e tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.409609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e41569-9439-40d6-9817-7453cd4fec5e tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.409609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e41569-9439-40d6-9817-7453cd4fec5e tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.410837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e41569-9439-40d6-9817-7453cd4fec5e tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.411594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e41569-9439-40d6-9817-7453cd4fec5e tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.411728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-35280791", "metadata": {"image_type": "test"}}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:14.412050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e41569-9439-40d6-9817-7453cd4fec5e tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.422761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:14.433177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.436219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.436680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.438024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.441346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.441965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.483496 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] HTTP exception thrown: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Request method failure captured: Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39/action HTTP/1.1 Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 110 Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPCFCd4c5wQ3BArw9IOnL7yA7D8u-jiulaTdLSlhgplwj1ZJwH0ySan7xSun3gkpaiFNlAjAOe1-E9C3nJ3yFTdxigM_QQESahwZdPY93x-pUkHNtffbAh39J0lOuHSyWqqIla8MYqYJf0UdxsJ_zHNaEr0l_jao-sKl6grKA4Dcfh8 Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}] Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a30e59b6df16418e97280550c4d28ac6 Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-35280791", "metadata": {"image_type": "test"}}} Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '3a4d03a0-83b3-4c48-b115-358f2f52ea39', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-35280791', 'metadata': {'image_type': 'test'}}}} Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 04:27:14.490986 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.496780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.499466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Returning 404 to user: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:14.501245 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-167901b7-dac4-4d8e-b4ed-f9e3cb50817c tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "POST /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39/action" status: 404 len: 111 microversion: 2.1 time: 0.099803 Oct 11 04:27:14.502086 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1797/3767] 10.222.0.26 () {60 vars in 1279 bytes} [Tue Oct 11 04:27:14 2022] POST /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39/action => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:14.516285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-97daf590-8e06-4e8f-aeab-55e3e18e04ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1951171017", "metadata": {"image_type": "test"}}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:14.531624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-97daf590-8e06-4e8f-aeab-55e3e18e04ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Failed to fetch instance by id tempest-invalid-665873756 {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 04:27:14.532958 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-97daf590-8e06-4e8f-aeab-55e3e18e04ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] HTTP exception thrown: Instance tempest-invalid-665873756 could not be found. Oct 11 04:27:14.534141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-44e41569-9439-40d6-9817-7453cd4fec5e tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-97daf590-8e06-4e8f-aeab-55e3e18e04ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Request method failure captured: Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/tempest-invalid-665873756/action HTTP/1.1 Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 112 Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPCFCd4c5wQ3BArw9IOnL7yA7D8u-jiulaTdLSlhgplwj1ZJwH0ySan7xSun3gkpaiFNlAjAOe1-E9C3nJ3yFTdxigM_QQESahwZdPY93x-pUkHNtffbAh39J0lOuHSyWqqIla8MYqYJf0UdxsJ_zHNaEr0l_jao-sKl6grKA4Dcfh8 Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}] Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a30e59b6df16418e97280550c4d28ac6 Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: {"createImage": {"name": "tempest-ImagesNegativeTestJSON-image-1951171017", "metadata": {"image_type": "test"}}} Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance tempest-invalid-665873756 could not be found. Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'tempest-invalid-665873756', 'body': {'createImage': {'name': 'tempest-ImagesNegativeTestJSON-image-1951171017', 'metadata': {'image_type': 'test'}}}} Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance tempest-invalid-665873756 could not be found. Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:14.538334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance tempest-invalid-665873756 could not be found. Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance tempest-invalid-665873756 could not be found. Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-97daf590-8e06-4e8f-aeab-55e3e18e04ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Returning 404 to user: Instance tempest-invalid-665873756 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-97daf590-8e06-4e8f-aeab-55e3e18e04ca tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "POST /compute/v2.1/servers/tempest-invalid-665873756/action" status: 404 len: 100 microversion: 2.1 time: 0.029749 Oct 11 04:27:14.545375 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1798/3768] 10.222.0.26 () {60 vars in 1246 bytes} [Tue Oct 11 04:27:14 2022] POST /compute/v2.1/servers/tempest-invalid-665873756/action => generated 100 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:14.578049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3a2a24d7-216a-441e-8e48-396b83f3a98a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-256284480"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:14.584768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3a2a24d7-216a-441e-8e48-396b83f3a98a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 04:27:14.588455 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-3a2a24d7-216a-441e-8e48-396b83f3a98a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3a2a24d7-216a-441e-8e48-396b83f3a98a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Request method failure captured: Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 56 Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPCFCd4c5wQ3BArw9IOnL7yA7D8u-jiulaTdLSlhgplwj1ZJwH0ySan7xSun3gkpaiFNlAjAOe1-E9C3nJ3yFTdxigM_QQESahwZdPY93x-pUkHNtffbAh39J0lOuHSyWqqIla8MYqYJf0UdxsJ_zHNaEr0l_jao-sKl6grKA4Dcfh8 Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}] Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a30e59b6df16418e97280550c4d28ac6 Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: {"createImage": {"name": "tempest-test-snap-256284480"}} Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-256284480'}}} Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 04:27:14.591630 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.596426 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.596426 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.596426 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.596426 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.596426 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.596426 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:14.596426 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:14.596426 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 04:27:14.596426 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.602999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3a2a24d7-216a-441e-8e48-396b83f3a98a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:14.604499 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3a2a24d7-216a-441e-8e48-396b83f3a98a tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 110 microversion: 2.1 time: 0.057802 Oct 11 04:27:14.606177 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1799/3769] 10.222.0.26 () {60 vars in 1275 bytes} [Tue Oct 11 04:27:14 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 110 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:14.619792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0fb2275d-4e83-4f80-8135-8e5cc57665b8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-test-snap-208135341"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:14.624925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0fb2275d-4e83-4f80-8135-8e5cc57665b8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Failed to fetch instance by id aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 04:27:14.628626 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-0fb2275d-4e83-4f80-8135-8e5cc57665b8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] HTTP exception thrown: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0fb2275d-4e83-4f80-8135-8e5cc57665b8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Request method failure captured: Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action HTTP/1.1 Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 56 Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPCFCd4c5wQ3BArw9IOnL7yA7D8u-jiulaTdLSlhgplwj1ZJwH0ySan7xSun3gkpaiFNlAjAOe1-E9C3nJ3yFTdxigM_QQESahwZdPY93x-pUkHNtffbAh39J0lOuHSyWqqIla8MYqYJf0UdxsJ_zHNaEr0l_jao-sKl6grKA4Dcfh8 Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}] Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a30e59b6df16418e97280550c4d28ac6 Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: {"createImage": {"name": "tempest-test-snap-208135341"}} Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'body': {'createImage': {'name': 'tempest-test-snap-208135341'}}} Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1319, in _action_create_image Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 04:27:14.632793 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0fb2275d-4e83-4f80-8135-8e5cc57665b8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Returning 404 to user: Instance aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0fb2275d-4e83-4f80-8135-8e5cc57665b8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action" status: 404 len: 112 microversion: 2.1 time: 0.021747 Oct 11 04:27:14.637621 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1800/3770] 10.222.0.26 () {60 vars in 1281 bytes} [Tue Oct 11 04:27:14 2022] POST /compute/v2.1/servers/aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa/action => generated 112 bytes in 23 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:14.654121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:14.656383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:14.676824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.680615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.680615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.680615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.681290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.682060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.694620 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44e41569-9439-40d6-9817-7453cd4fec5e tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?status=shutoff" status: 200 len: 344 microversion: 2.1 time: 0.326542 Oct 11 04:27:14.695109 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1971/3771] 10.222.0.26 () {58 vars in 1154 bytes} [Tue Oct 11 04:27:14 2022] GET /compute/v2.1/servers?status=shutoff => generated 344 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:14.707266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c4b25bd9-6044-483e-b03f-efc750d1c82f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:14.709459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c4b25bd9-6044-483e-b03f-efc750d1c82f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:14.711040 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] HTTP exception thrown: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Request method failure captured: Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 HTTP/1.1 Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPCFCd4c5wQ3BArw9IOnL7yA7D8u-jiulaTdLSlhgplwj1ZJwH0ySan7xSun3gkpaiFNlAjAOe1-E9C3nJ3yFTdxigM_QQESahwZdPY93x-pUkHNtffbAh39J0lOuHSyWqqIla8MYqYJf0UdxsJ_zHNaEr0l_jao-sKl6grKA4Dcfh8 Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}] Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a30e59b6df16418e97280550c4d28ac6 Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '3a4d03a0-83b3-4c48-b115-358f2f52ea39'} Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:14.714334 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:14.721116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.721116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.721116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:14.721116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.721116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:14.721116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:14.721116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:14.721116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:14.721116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:14.721116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:14.721116 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:14.724823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4b25bd9-6044-483e-b03f-efc750d1c82f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.724823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4b25bd9-6044-483e-b03f-efc750d1c82f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.725301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4b25bd9-6044-483e-b03f-efc750d1c82f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.725955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Returning 404 to user: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:14.726624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4b25bd9-6044-483e-b03f-efc750d1c82f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.726624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4b25bd9-6044-483e-b03f-efc750d1c82f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.726932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4b25bd9-6044-483e-b03f-efc750d1c82f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.728389 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-715c181a-920d-4b79-88ee-34b2bbdb38d2 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 404 len: 111 microversion: 2.1 time: 0.084779 Oct 11 04:27:14.729596 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1801/3772] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:14 2022] DELETE /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:14.737749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca8e0a34-190f-4965-8c41-fd5638b81f53 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:14.746397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8e0a34-190f-4965-8c41-fd5638b81f53 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:14.749660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8e0a34-190f-4965-8c41-fd5638b81f53 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:14.749660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8e0a34-190f-4965-8c41-fd5638b81f53 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:14.778028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ca8e0a34-190f-4965-8c41-fd5638b81f53 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Going to try to start instance {{(pid=120993) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 04:27:14.972515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c4b25bd9-6044-483e-b03f-efc750d1c82f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:14.985482 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c4b25bd9-6044-483e-b03f-efc750d1c82f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1502 microversion: 2.1 time: 0.286102 Oct 11 04:27:14.986617 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1972/3773] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:14 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1502 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:15.006658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:15.007637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] [instance: 3a4d03a0-83b3-4c48-b115-358f2f52ea39] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:15.015110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:15.019322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:15.019958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:15.020875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:15.021696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:15.022372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:15.034368 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ca8e0a34-190f-4965-8c41-fd5638b81f53 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "POST /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e/action" status: 202 len: 0 microversion: 2.1 time: 0.303324 Oct 11 04:27:15.038819 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1802/3774] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:27:14 2022] POST /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:27:15.052022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8236992e-5708-4311-83c1-2dfc90bcb519 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:15.067128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8236992e-5708-4311-83c1-2dfc90bcb519 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:15.069655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8236992e-5708-4311-83c1-2dfc90bcb519 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:15.070307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8236992e-5708-4311-83c1-2dfc90bcb519 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:15.088949 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] HTTP exception thrown: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Request method failure captured: Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 HTTP/1.1 Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPCFCd4c5wQ3BArw9IOnL7yA7D8u-jiulaTdLSlhgplwj1ZJwH0ySan7xSun3gkpaiFNlAjAOe1-E9C3nJ3yFTdxigM_QQESahwZdPY93x-pUkHNtffbAh39J0lOuHSyWqqIla8MYqYJf0UdxsJ_zHNaEr0l_jao-sKl6grKA4Dcfh8 Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fd69384a24dc4bf0959c6caea6f40f42"}]}] Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: fd69384a24dc4bf0959c6caea6f40f42 Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesNegativeTestJSON-526060864 Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a30e59b6df16418e97280550c4d28ac6 Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesNegativeTestJSON-526060864-project Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '3a4d03a0-83b3-4c48-b115-358f2f52ea39'} Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:15.098797 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:15.104123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:15.104123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:15.104123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:15.104123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:15.104123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:15.104123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. Oct 11 04:27:15.104123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:15.104123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] Returning 404 to user: Instance 3a4d03a0-83b3-4c48-b115-358f2f52ea39 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:15.104123 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a2fcf51-90b9-4900-9922-c902bc931fb8 tempest-ImagesNegativeTestJSON-526060864 tempest-ImagesNegativeTestJSON-526060864-project] 10.222.0.26 "GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39" status: 404 len: 111 microversion: 2.1 time: 0.108863 Oct 11 04:27:15.106269 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1973/3775] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:14 2022] GET /compute/v2.1/servers/3a4d03a0-83b3-4c48-b115-358f2f52ea39 => generated 111 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:15.120472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8236992e-5708-4311-83c1-2dfc90bcb519 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Going to try to stop instance {{(pid=120993) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 04:27:15.121783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-be1b36f6-ca71-4082-b666-cf282da1be2f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:15.126585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-be1b36f6-ca71-4082-b666-cf282da1be2f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:15.147193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be1b36f6-ca71-4082-b666-cf282da1be2f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:15.150047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be1b36f6-ca71-4082-b666-cf282da1be2f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:15.150047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be1b36f6-ca71-4082-b666-cf282da1be2f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:15.150835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be1b36f6-ca71-4082-b666-cf282da1be2f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:15.153709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be1b36f6-ca71-4082-b666-cf282da1be2f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:15.153709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be1b36f6-ca71-4082-b666-cf282da1be2f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:15.399726 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8236992e-5708-4311-83c1-2dfc90bcb519 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db/action" status: 202 len: 0 microversion: 2.1 time: 0.357818 Oct 11 04:27:15.401151 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1803/3776] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:27:15 2022] POST /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db/action => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:27:15.429489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5065a1d7-fd01-4558-ba65-05ecdb41479a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:15.430769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5065a1d7-fd01-4558-ba65-05ecdb41479a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:15.466004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5065a1d7-fd01-4558-ba65-05ecdb41479a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:15.466004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5065a1d7-fd01-4558-ba65-05ecdb41479a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:15.466004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5065a1d7-fd01-4558-ba65-05ecdb41479a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:15.466004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5065a1d7-fd01-4558-ba65-05ecdb41479a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:15.466552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5065a1d7-fd01-4558-ba65-05ecdb41479a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:15.466835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5065a1d7-fd01-4558-ba65-05ecdb41479a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:15.747912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be1b36f6-ca71-4082-b666-cf282da1be2f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:15.769726 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-be1b36f6-ca71-4082-b666-cf282da1be2f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1507 microversion: 2.1 time: 0.662308 Oct 11 04:27:15.770814 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1974/3777] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:15 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1507 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:15.825244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5065a1d7-fd01-4558-ba65-05ecdb41479a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:15.854639 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5065a1d7-fd01-4558-ba65-05ecdb41479a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.436234 Oct 11 04:27:15.854639 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1804/3778] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:15 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:16.793915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d26d544-5d3b-481c-b96c-173ee21a3c8f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:16.799198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2d26d544-5d3b-481c-b96c-173ee21a3c8f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:16.804419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d26d544-5d3b-481c-b96c-173ee21a3c8f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:16.804916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d26d544-5d3b-481c-b96c-173ee21a3c8f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:16.808886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d26d544-5d3b-481c-b96c-173ee21a3c8f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:16.809657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d26d544-5d3b-481c-b96c-173ee21a3c8f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:16.810131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d26d544-5d3b-481c-b96c-173ee21a3c8f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:16.810598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d26d544-5d3b-481c-b96c-173ee21a3c8f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:16.873289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-048c81db-42a0-4f8e-ac86-337509c78146 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:16.874848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-048c81db-42a0-4f8e-ac86-337509c78146 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:16.887378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-048c81db-42a0-4f8e-ac86-337509c78146 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:16.888156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-048c81db-42a0-4f8e-ac86-337509c78146 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:16.890327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-048c81db-42a0-4f8e-ac86-337509c78146 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:16.892860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-048c81db-42a0-4f8e-ac86-337509c78146 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:16.895540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-048c81db-42a0-4f8e-ac86-337509c78146 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:16.897889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-048c81db-42a0-4f8e-ac86-337509c78146 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:17.260916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-048c81db-42a0-4f8e-ac86-337509c78146 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:17.272589 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-048c81db-42a0-4f8e-ac86-337509c78146 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.403176 Oct 11 04:27:17.287918 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1805/3779] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:16 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:17.348870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d26d544-5d3b-481c-b96c-173ee21a3c8f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:17.360656 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d26d544-5d3b-481c-b96c-173ee21a3c8f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1507 microversion: 2.1 time: 0.571285 Oct 11 04:27:17.362852 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1975/3780] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:16 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1507 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:18.306095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c6eb14e-5e21-465c-a520-7d7e68d9f744 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:18.307437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1c6eb14e-5e21-465c-a520-7d7e68d9f744 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:18.316808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6eb14e-5e21-465c-a520-7d7e68d9f744 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:18.317677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6eb14e-5e21-465c-a520-7d7e68d9f744 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:18.318477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6eb14e-5e21-465c-a520-7d7e68d9f744 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:18.319673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6eb14e-5e21-465c-a520-7d7e68d9f744 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:18.321001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6eb14e-5e21-465c-a520-7d7e68d9f744 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:18.321978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c6eb14e-5e21-465c-a520-7d7e68d9f744 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:18.389878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d7e4652-adab-49d0-969c-02d7f1f24083 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:18.396821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d7e4652-adab-49d0-969c-02d7f1f24083 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:18.406998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7e4652-adab-49d0-969c-02d7f1f24083 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:18.408014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7e4652-adab-49d0-969c-02d7f1f24083 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:18.408739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7e4652-adab-49d0-969c-02d7f1f24083 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:18.409858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7e4652-adab-49d0-969c-02d7f1f24083 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:18.410599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7e4652-adab-49d0-969c-02d7f1f24083 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:18.415306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7e4652-adab-49d0-969c-02d7f1f24083 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:18.788472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1c6eb14e-5e21-465c-a520-7d7e68d9f744 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:18.799411 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c6eb14e-5e21-465c-a520-7d7e68d9f744 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.500034 Oct 11 04:27:18.823758 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1806/3781] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:18 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:18.887138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d7e4652-adab-49d0-969c-02d7f1f24083 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:18.897583 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d7e4652-adab-49d0-969c-02d7f1f24083 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1511 microversion: 2.1 time: 0.514246 Oct 11 04:27:18.923399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-880e0a30-2509-4214-bba8-d195daedfe89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:18.930858 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1976/3782] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:18 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1511 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:18.931000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-880e0a30-2509-4214-bba8-d195daedfe89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:18.931445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.compute.servers [None req-880e0a30-2509-4214-bba8-d195daedfe89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Removing options 'limit' from query {{(pid=120993) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 04:27:18.932457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-880e0a30-2509-4214-bba8-d195daedfe89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:18.934017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-880e0a30-2509-4214-bba8-d195daedfe89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:18.935014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-880e0a30-2509-4214-bba8-d195daedfe89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:18.935684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-880e0a30-2509-4214-bba8-d195daedfe89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:18.937005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-880e0a30-2509-4214-bba8-d195daedfe89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:18.937695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-880e0a30-2509-4214-bba8-d195daedfe89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:18.938694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-880e0a30-2509-4214-bba8-d195daedfe89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:18.941623 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-880e0a30-2509-4214-bba8-d195daedfe89 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=0" status: 200 len: 15 microversion: 2.1 time: 0.021717 Oct 11 04:27:18.942774 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1807/3783] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Oct 11 04:27:18 2022] GET /compute/v2.1/servers?limit=0 => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:27:18.958126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-351f496e-f484-4649-b211-e394710367ba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:18.959816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-351f496e-f484-4649-b211-e394710367ba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:18.970179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351f496e-f484-4649-b211-e394710367ba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:18.973579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351f496e-f484-4649-b211-e394710367ba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:18.974288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351f496e-f484-4649-b211-e394710367ba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:18.976564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351f496e-f484-4649-b211-e394710367ba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:18.976564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351f496e-f484-4649-b211-e394710367ba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:18.976564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-351f496e-f484-4649-b211-e394710367ba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:19.231236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-351f496e-f484-4649-b211-e394710367ba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:19.239760 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-351f496e-f484-4649-b211-e394710367ba tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1511 microversion: 2.1 time: 0.288376 Oct 11 04:27:19.240922 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1977/3784] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:18 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1511 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:19.269514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-37c72a55-7828-45c1-914d-cfa154a56670 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:19.270261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-37c72a55-7828-45c1-914d-cfa154a56670 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 7e848340-de82-48aa-8c66-78908ccdd948] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:19.278923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37c72a55-7828-45c1-914d-cfa154a56670 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:19.279843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37c72a55-7828-45c1-914d-cfa154a56670 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:19.280294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37c72a55-7828-45c1-914d-cfa154a56670 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:19.281371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37c72a55-7828-45c1-914d-cfa154a56670 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:19.282465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37c72a55-7828-45c1-914d-cfa154a56670 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:19.283204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37c72a55-7828-45c1-914d-cfa154a56670 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:19.589064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-37c72a55-7828-45c1-914d-cfa154a56670 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:19.598394 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-37c72a55-7828-45c1-914d-cfa154a56670 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948" status: 200 len: 1510 microversion: 2.1 time: 0.332848 Oct 11 04:27:19.610210 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1808/3785] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:19 2022] GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948 => generated 1510 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:19.624580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d46ba79-437c-444f-8056-b5d84f24fb27 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:19.625920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d46ba79-437c-444f-8056-b5d84f24fb27 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:19.637629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d46ba79-437c-444f-8056-b5d84f24fb27 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:19.638399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d46ba79-437c-444f-8056-b5d84f24fb27 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:19.639067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d46ba79-437c-444f-8056-b5d84f24fb27 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:19.640150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d46ba79-437c-444f-8056-b5d84f24fb27 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:19.640865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d46ba79-437c-444f-8056-b5d84f24fb27 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:19.641506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d46ba79-437c-444f-8056-b5d84f24fb27 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:19.836781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c9e22fd8-703e-4f8c-81c3-c33cd552f28b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:19.837378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c9e22fd8-703e-4f8c-81c3-c33cd552f28b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:19.843473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e22fd8-703e-4f8c-81c3-c33cd552f28b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:19.843953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e22fd8-703e-4f8c-81c3-c33cd552f28b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:19.844380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e22fd8-703e-4f8c-81c3-c33cd552f28b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:19.845060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e22fd8-703e-4f8c-81c3-c33cd552f28b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:19.846054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e22fd8-703e-4f8c-81c3-c33cd552f28b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:19.846499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9e22fd8-703e-4f8c-81c3-c33cd552f28b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:19.850765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:19.981542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d46ba79-437c-444f-8056-b5d84f24fb27 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:20.008962 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d46ba79-437c-444f-8056-b5d84f24fb27 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1512 microversion: 2.1 time: 0.389504 Oct 11 04:27:20.029224 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1978/3786] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:19 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1512 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:20.042213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0dd775f3-12f2-4276-b480-a6dc2504260f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:20.047407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c9e22fd8-703e-4f8c-81c3-c33cd552f28b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:20.051637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0dd775f3-12f2-4276-b480-a6dc2504260f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:20.051637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0dd775f3-12f2-4276-b480-a6dc2504260f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'ip': '172.20.0.13', 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:20.060663 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c9e22fd8-703e-4f8c-81c3-c33cd552f28b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.227601 Oct 11 04:27:20.061608 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1809/3787] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:19 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:20.205444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd775f3-12f2-4276-b480-a6dc2504260f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:20.205927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd775f3-12f2-4276-b480-a6dc2504260f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:20.206456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd775f3-12f2-4276-b480-a6dc2504260f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:20.209391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd775f3-12f2-4276-b480-a6dc2504260f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:20.209391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd775f3-12f2-4276-b480-a6dc2504260f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:20.209391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd775f3-12f2-4276-b480-a6dc2504260f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:20.312806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-0dd775f3-12f2-4276-b480-a6dc2504260f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:27:20.383984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0dd775f3-12f2-4276-b480-a6dc2504260f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0.13" status: 200 len: 344 microversion: 2.1 time: 0.345864 Oct 11 04:27:20.384903 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1979/3788] 10.222.0.26 () {58 vars in 1154 bytes} [Tue Oct 11 04:27:20 2022] GET /compute/v2.1/servers?ip=172.20.0.13 => generated 344 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:20.413542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-51d6ed2f-d5ab-4097-9958-555de36d4687 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:20.421848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-51d6ed2f-d5ab-4097-9958-555de36d4687 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:20.430214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51d6ed2f-d5ab-4097-9958-555de36d4687 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:20.430702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51d6ed2f-d5ab-4097-9958-555de36d4687 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:20.432596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51d6ed2f-d5ab-4097-9958-555de36d4687 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:20.433927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51d6ed2f-d5ab-4097-9958-555de36d4687 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:20.435508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51d6ed2f-d5ab-4097-9958-555de36d4687 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:20.438033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51d6ed2f-d5ab-4097-9958-555de36d4687 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:20.710382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51d6ed2f-d5ab-4097-9958-555de36d4687 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:20.721865 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-51d6ed2f-d5ab-4097-9958-555de36d4687 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1511 microversion: 2.1 time: 0.313826 Oct 11 04:27:20.723270 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1810/3789] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:20 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1511 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:20.744640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b0c13c92-e5b4-4502-97c1-d72325a47a76 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:20.746150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b0c13c92-e5b4-4502-97c1-d72325a47a76 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 7e848340-de82-48aa-8c66-78908ccdd948] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:20.753707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0c13c92-e5b4-4502-97c1-d72325a47a76 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:20.754492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0c13c92-e5b4-4502-97c1-d72325a47a76 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:20.754938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0c13c92-e5b4-4502-97c1-d72325a47a76 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:20.756069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0c13c92-e5b4-4502-97c1-d72325a47a76 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:20.756526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0c13c92-e5b4-4502-97c1-d72325a47a76 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:20.756981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0c13c92-e5b4-4502-97c1-d72325a47a76 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:20.780886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:20.945943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b0c13c92-e5b4-4502-97c1-d72325a47a76 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:20.961244 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b0c13c92-e5b4-4502-97c1-d72325a47a76 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948" status: 200 len: 1510 microversion: 2.1 time: 0.218040 Oct 11 04:27:20.961244 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1980/3790] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:20 2022] GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948 => generated 1510 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:20.988834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-86e4dc39-c972-412f-bd77-81f5a0e59115 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:20.989485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-86e4dc39-c972-412f-bd77-81f5a0e59115 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:21.000952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86e4dc39-c972-412f-bd77-81f5a0e59115 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:21.002169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86e4dc39-c972-412f-bd77-81f5a0e59115 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:21.002806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86e4dc39-c972-412f-bd77-81f5a0e59115 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:21.004063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86e4dc39-c972-412f-bd77-81f5a0e59115 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:21.004674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86e4dc39-c972-412f-bd77-81f5a0e59115 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:21.005477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86e4dc39-c972-412f-bd77-81f5a0e59115 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:21.088744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1c762cf0-80fb-4547-ad45-1c7bc57828dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:21.089513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1c762cf0-80fb-4547-ad45-1c7bc57828dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:21.117270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c762cf0-80fb-4547-ad45-1c7bc57828dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:21.118941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c762cf0-80fb-4547-ad45-1c7bc57828dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:21.119398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c762cf0-80fb-4547-ad45-1c7bc57828dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:21.129284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c762cf0-80fb-4547-ad45-1c7bc57828dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:21.129284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c762cf0-80fb-4547-ad45-1c7bc57828dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:21.129284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c762cf0-80fb-4547-ad45-1c7bc57828dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:21.427251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-86e4dc39-c972-412f-bd77-81f5a0e59115 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:21.433033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1c762cf0-80fb-4547-ad45-1c7bc57828dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:21.444877 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-86e4dc39-c972-412f-bd77-81f5a0e59115 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1512 microversion: 2.1 time: 0.462390 Oct 11 04:27:21.445480 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1811/3791] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:20 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1512 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:21.461240 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1c762cf0-80fb-4547-ad45-1c7bc57828dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.364362 Oct 11 04:27:21.461240 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1981/3792] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:21 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:21.473156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:21.479144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:21.485117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:21.495861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:21.495861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:21.495861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:21.495861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:21.495861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:21.496839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:21.554154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:27:21.641845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:21.649365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:21.656535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:21.656535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:21.996478 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ab289fb2-9508-49dd-96ee-7f81d6e1e2f3 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 4516 microversion: 2.1 time: 0.526765 Oct 11 04:27:21.997924 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1812/3793] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:27:21 2022] GET /compute/v2.1/servers/detail => generated 4516 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:22.031896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40a7c946-b247-4723-90a2-71a680e2dc69 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:22.039734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40a7c946-b247-4723-90a2-71a680e2dc69 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:22.043780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-40a7c946-b247-4723-90a2-71a680e2dc69 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'ip': '172.20.0.', 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:22.138791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40a7c946-b247-4723-90a2-71a680e2dc69 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:22.139278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40a7c946-b247-4723-90a2-71a680e2dc69 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:22.139712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40a7c946-b247-4723-90a2-71a680e2dc69 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:22.140435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40a7c946-b247-4723-90a2-71a680e2dc69 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:22.140882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40a7c946-b247-4723-90a2-71a680e2dc69 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:22.141305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40a7c946-b247-4723-90a2-71a680e2dc69 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:22.171511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-40a7c946-b247-4723-90a2-71a680e2dc69 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:27:22.204170 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40a7c946-b247-4723-90a2-71a680e2dc69 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?ip=172.20.0." status: 200 len: 1008 microversion: 2.1 time: 0.181028 Oct 11 04:27:22.204784 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1982/3794] 10.222.0.26 () {58 vars in 1150 bytes} [Tue Oct 11 04:27:22 2022] GET /compute/v2.1/servers?ip=172.20.0. => generated 1008 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:22.219060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9ed4a70f-cb92-45ee-8031-a9076101e55d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:22.237054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9ed4a70f-cb92-45ee-8031-a9076101e55d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:22.237054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9ed4a70f-cb92-45ee-8031-a9076101e55d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'name': '^.*\\-instance\\-[0-9]+$', 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:22.237054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ed4a70f-cb92-45ee-8031-a9076101e55d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:22.237054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ed4a70f-cb92-45ee-8031-a9076101e55d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:22.237054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ed4a70f-cb92-45ee-8031-a9076101e55d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:22.237054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ed4a70f-cb92-45ee-8031-a9076101e55d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:22.237054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ed4a70f-cb92-45ee-8031-a9076101e55d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:22.237054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ed4a70f-cb92-45ee-8031-a9076101e55d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:22.367311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-9ed4a70f-cb92-45ee-8031-a9076101e55d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:27:22.473359 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9ed4a70f-cb92-45ee-8031-a9076101e55d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24" status: 200 len: 1008 microversion: 2.1 time: 0.258379 Oct 11 04:27:22.473578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b7fb208e-cc2f-4a7f-912c-a20dd0346a35 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:22.478309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b7fb208e-cc2f-4a7f-912c-a20dd0346a35 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:22.478646 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1813/3795] 10.222.0.26 () {58 vars in 1212 bytes} [Tue Oct 11 04:27:22 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-%5B0-9%5D%2B%24 => generated 1008 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:22.489658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7fb208e-cc2f-4a7f-912c-a20dd0346a35 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:22.490512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7fb208e-cc2f-4a7f-912c-a20dd0346a35 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:22.491099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-33340c8d-17e2-4b52-a9d7-bb504c280188 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:22.491564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7fb208e-cc2f-4a7f-912c-a20dd0346a35 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:22.493405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7fb208e-cc2f-4a7f-912c-a20dd0346a35 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:22.495001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7fb208e-cc2f-4a7f-912c-a20dd0346a35 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:22.496199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7fb208e-cc2f-4a7f-912c-a20dd0346a35 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:22.498532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-33340c8d-17e2-4b52-a9d7-bb504c280188 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:22.499414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-33340c8d-17e2-4b52-a9d7-bb504c280188 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'name': '^.*\\-instance\\-.*$', 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:22.510174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33340c8d-17e2-4b52-a9d7-bb504c280188 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:22.510852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33340c8d-17e2-4b52-a9d7-bb504c280188 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:22.511541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33340c8d-17e2-4b52-a9d7-bb504c280188 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:22.512982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33340c8d-17e2-4b52-a9d7-bb504c280188 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:22.513660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33340c8d-17e2-4b52-a9d7-bb504c280188 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:22.514318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33340c8d-17e2-4b52-a9d7-bb504c280188 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:22.706337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-33340c8d-17e2-4b52-a9d7-bb504c280188 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:27:22.818275 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-33340c8d-17e2-4b52-a9d7-bb504c280188 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24" status: 200 len: 1008 microversion: 2.1 time: 0.332070 Oct 11 04:27:22.822028 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1814/3796] 10.222.0.26 () {58 vars in 1196 bytes} [Tue Oct 11 04:27:22 2022] GET /compute/v2.1/servers?name=%5E.%2A%5C-instance%5C-.%2A%24 => generated 1008 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:22.836658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7b0b5307-dc4a-4adc-bf2f-3e8b4a87a975 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:22.842933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7b0b5307-dc4a-4adc-bf2f-3e8b4a87a975 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:22.843882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7b0b5307-dc4a-4adc-bf2f-3e8b4a87a975 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'name': 'e-48161591', 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:22.857528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b0b5307-dc4a-4adc-bf2f-3e8b4a87a975 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:22.857528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b0b5307-dc4a-4adc-bf2f-3e8b4a87a975 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:22.857528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b0b5307-dc4a-4adc-bf2f-3e8b4a87a975 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:22.858093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b0b5307-dc4a-4adc-bf2f-3e8b4a87a975 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:22.858530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b0b5307-dc4a-4adc-bf2f-3e8b4a87a975 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:22.861197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b0b5307-dc4a-4adc-bf2f-3e8b4a87a975 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:22.974726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b7fb208e-cc2f-4a7f-912c-a20dd0346a35 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:22.988366 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b7fb208e-cc2f-4a7f-912c-a20dd0346a35 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.520024 Oct 11 04:27:22.995995 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1983/3797] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:22 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:23.288408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-7b0b5307-dc4a-4adc-bf2f-3e8b4a87a975 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:27:23.514206 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7b0b5307-dc4a-4adc-bf2f-3e8b4a87a975 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?name=e-48161591" status: 200 len: 344 microversion: 2.1 time: 0.682846 Oct 11 04:27:23.515861 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1815/3798] 10.222.0.26 () {58 vars in 1156 bytes} [Tue Oct 11 04:27:22 2022] GET /compute/v2.1/servers?name=e-48161591 => generated 344 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:23.530585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fbfa941e-4904-4adc-9ff1-b7002a25fe8d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:23.536601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fbfa941e-4904-4adc-9ff1-b7002a25fe8d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:23.537276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fbfa941e-4904-4adc-9ff1-b7002a25fe8d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'name': '-instance', 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:23.543586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbfa941e-4904-4adc-9ff1-b7002a25fe8d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:23.544291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbfa941e-4904-4adc-9ff1-b7002a25fe8d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:23.545155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbfa941e-4904-4adc-9ff1-b7002a25fe8d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:23.546037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbfa941e-4904-4adc-9ff1-b7002a25fe8d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:23.546711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbfa941e-4904-4adc-9ff1-b7002a25fe8d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:23.547377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbfa941e-4904-4adc-9ff1-b7002a25fe8d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:23.665160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-fbfa941e-4904-4adc-9ff1-b7002a25fe8d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 3 results from cell out of 1000 limit. Returned 3 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:27:23.732502 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fbfa941e-4904-4adc-9ff1-b7002a25fe8d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?name=-instance" status: 200 len: 1008 microversion: 2.1 time: 0.205837 Oct 11 04:27:23.733747 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1984/3799] 10.222.0.26 () {58 vars in 1154 bytes} [Tue Oct 11 04:27:23 2022] GET /compute/v2.1/servers?name=-instance => generated 1008 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:23.747838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ec68f2e7-a44c-45e4-b8ce-01177fee8137 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:23.754345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ec68f2e7-a44c-45e4-b8ce-01177fee8137 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:23.755113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ec68f2e7-a44c-45e4-b8ce-01177fee8137 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Searching by: {'name': 't-ListServerFiltersTestJSON-instance-4816159', 'deleted': False, 'project_id': '79f5da4f89bf4688be5d994f08c578bd'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:23.763600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec68f2e7-a44c-45e4-b8ce-01177fee8137 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:23.764176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec68f2e7-a44c-45e4-b8ce-01177fee8137 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:23.764676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec68f2e7-a44c-45e4-b8ce-01177fee8137 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:23.766169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec68f2e7-a44c-45e4-b8ce-01177fee8137 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:23.766900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec68f2e7-a44c-45e4-b8ce-01177fee8137 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:23.767917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec68f2e7-a44c-45e4-b8ce-01177fee8137 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:23.901154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-ec68f2e7-a44c-45e4-b8ce-01177fee8137 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:27:23.976768 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ec68f2e7-a44c-45e4-b8ce-01177fee8137 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-4816159" status: 200 len: 344 microversion: 2.1 time: 0.234273 Oct 11 04:27:23.977670 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1816/3800] 10.222.0.26 () {58 vars in 1224 bytes} [Tue Oct 11 04:27:23 2022] GET /compute/v2.1/servers?name=t-ListServerFiltersTestJSON-instance-4816159 => generated 344 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:23.992256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9022aeed-401a-4c17-809c-d31cfe98c77d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:23.998791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9022aeed-401a-4c17-809c-d31cfe98c77d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:23.999886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:24.006632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9022aeed-401a-4c17-809c-d31cfe98c77d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:24.007419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9022aeed-401a-4c17-809c-d31cfe98c77d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:24.008025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9022aeed-401a-4c17-809c-d31cfe98c77d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:24.008943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9022aeed-401a-4c17-809c-d31cfe98c77d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:24.018931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ebcce572-9759-4120-b986-f6da7f02f986 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:24.018931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ebcce572-9759-4120-b986-f6da7f02f986 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:24.019914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9022aeed-401a-4c17-809c-d31cfe98c77d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:24.026923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9022aeed-401a-4c17-809c-d31cfe98c77d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:24.035417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcce572-9759-4120-b986-f6da7f02f986 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:24.035417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcce572-9759-4120-b986-f6da7f02f986 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:24.035417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcce572-9759-4120-b986-f6da7f02f986 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:24.035417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcce572-9759-4120-b986-f6da7f02f986 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:24.036045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcce572-9759-4120-b986-f6da7f02f986 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:24.036465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcce572-9759-4120-b986-f6da7f02f986 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:24.078246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9022aeed-401a-4c17-809c-d31cfe98c77d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:27:24.540467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ebcce572-9759-4120-b986-f6da7f02f986 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:24.554083 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ebcce572-9759-4120-b986-f6da7f02f986 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.544309 Oct 11 04:27:24.555286 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1817/3801] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:24 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:24.614040 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9022aeed-401a-4c17-809c-d31cfe98c77d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 204 len: 0 microversion: 2.1 time: 0.619052 Oct 11 04:27:24.614740 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1985/3802] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:23 2022] DELETE /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 0 bytes in 627 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:27:24.623438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a05cdc59-cd0c-401e-b97c-93bce39d7d73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:24.624568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a05cdc59-cd0c-401e-b97c-93bce39d7d73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:24.635850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a05cdc59-cd0c-401e-b97c-93bce39d7d73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:24.636350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a05cdc59-cd0c-401e-b97c-93bce39d7d73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:24.636820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a05cdc59-cd0c-401e-b97c-93bce39d7d73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:24.637532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a05cdc59-cd0c-401e-b97c-93bce39d7d73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:24.638062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a05cdc59-cd0c-401e-b97c-93bce39d7d73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:24.638551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a05cdc59-cd0c-401e-b97c-93bce39d7d73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:24.981488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a05cdc59-cd0c-401e-b97c-93bce39d7d73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:24.993846 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a05cdc59-cd0c-401e-b97c-93bce39d7d73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1518 microversion: 2.1 time: 0.374382 Oct 11 04:27:24.995545 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1818/3803] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:24 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1518 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:25.111373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-303595085", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "c146bcf5-b2a0-463b-a5c5-204d05f26cb1"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:25.189036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] validate_networks() for [('c146bcf5-b2a0-463b-a5c5-204d05f26cb1', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:27:25.578933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-96d5a252-7c25-44db-b898-65e8d22ea942 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:25.580353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-96d5a252-7c25-44db-b898-65e8d22ea942 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:25.590621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96d5a252-7c25-44db-b898-65e8d22ea942 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:25.594888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96d5a252-7c25-44db-b898-65e8d22ea942 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:25.594888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96d5a252-7c25-44db-b898-65e8d22ea942 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:25.595762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96d5a252-7c25-44db-b898-65e8d22ea942 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:25.596260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96d5a252-7c25-44db-b898-65e8d22ea942 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:25.596706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96d5a252-7c25-44db-b898-65e8d22ea942 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:25.947429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-96d5a252-7c25-44db-b898-65e8d22ea942 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:25.960212 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-96d5a252-7c25-44db-b898-65e8d22ea942 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.386071 Oct 11 04:27:25.960831 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1819/3804] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:25 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:26.021674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8d765e40-ab96-47ea-adaf-87c28f72ac73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:26.022341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8d765e40-ab96-47ea-adaf-87c28f72ac73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:26.036496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d765e40-ab96-47ea-adaf-87c28f72ac73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:26.037297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d765e40-ab96-47ea-adaf-87c28f72ac73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:26.037941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d765e40-ab96-47ea-adaf-87c28f72ac73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:26.040523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d765e40-ab96-47ea-adaf-87c28f72ac73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:26.042907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d765e40-ab96-47ea-adaf-87c28f72ac73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:26.044272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8d765e40-ab96-47ea-adaf-87c28f72ac73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:26.272606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:27:26.273087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:27:26.273491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:27:26.273929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:27:26.274616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:27:26.285637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:26.286541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:26.287281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:26.288291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:26.288994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:26.289674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:26.318038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Getting quotas for project f816ed1b873b40bc93b3be8e0052fa88. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:27:26.327619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Getting quotas for user 15dbde05c5c5421e83eb7a60df664d42 and project f816ed1b873b40bc93b3be8e0052fa88. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:27:26.359754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:27:26.363174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:27:26.511978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8d765e40-ab96-47ea-adaf-87c28f72ac73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:26.533503 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8d765e40-ab96-47ea-adaf-87c28f72ac73 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1518 microversion: 2.1 time: 0.516428 Oct 11 04:27:26.534340 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1820/3805] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:26 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1518 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:26.627878 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3fbaf05-13f5-4aec-b418-a07461256d4f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.535298 Oct 11 04:27:26.628651 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1986/3806] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:27:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:27:26.644731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1110a1c0-40f7-4b23-963a-467003f36709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:26.646225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1110a1c0-40f7-4b23-963a-467003f36709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:26.780846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1110a1c0-40f7-4b23-963a-467003f36709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:26.791230 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1110a1c0-40f7-4b23-963a-467003f36709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1213 microversion: 2.1 time: 0.154229 Oct 11 04:27:26.792199 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1821/3807] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:26 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:26.986139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b07c2d2-9052-44fb-842d-ff913fe5ae0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:26.986969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b07c2d2-9052-44fb-842d-ff913fe5ae0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:27.000689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b07c2d2-9052-44fb-842d-ff913fe5ae0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:27.002262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b07c2d2-9052-44fb-842d-ff913fe5ae0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:27.003167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b07c2d2-9052-44fb-842d-ff913fe5ae0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:27.004336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b07c2d2-9052-44fb-842d-ff913fe5ae0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:27.005013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b07c2d2-9052-44fb-842d-ff913fe5ae0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:27.005731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b07c2d2-9052-44fb-842d-ff913fe5ae0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:27.284580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b07c2d2-9052-44fb-842d-ff913fe5ae0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:27.293164 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b07c2d2-9052-44fb-842d-ff913fe5ae0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.311450 Oct 11 04:27:27.293747 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1987/3808] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:26 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:27.463523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8e4f8cd0-3342-43c3-a0bb-e18f025879be req-97e83590-97f5-4481-a68a-b070717b5921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c80a9e3-3a40-4a91-98ab-6b1b223973f9", "name": "network-vif-deleted", "tag": "6693ed13-00db-414b-bab4-33aaa5703c0c"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:27.491890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8e4f8cd0-3342-43c3-a0bb-e18f025879be req-97e83590-97f5-4481-a68a-b070717b5921 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:27.492721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8e4f8cd0-3342-43c3-a0bb-e18f025879be req-97e83590-97f5-4481-a68a-b070717b5921 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:27.493217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8e4f8cd0-3342-43c3-a0bb-e18f025879be req-97e83590-97f5-4481-a68a-b070717b5921 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:27.510808 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8e4f8cd0-3342-43c3-a0bb-e18f025879be req-97e83590-97f5-4481-a68a-b070717b5921 service nova] Creating event network-vif-deleted:6693ed13-00db-414b-bab4-33aaa5703c0c for instance 5c80a9e3-3a40-4a91-98ab-6b1b223973f9 on n-h1-860892-1 Oct 11 04:27:27.518886 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8e4f8cd0-3342-43c3-a0bb-e18f025879be req-97e83590-97f5-4481-a68a-b070717b5921 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062912 Oct 11 04:27:27.520982 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1822/3809] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:27.558675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f86e8cc-d797-434c-b160-df95a17d7d3f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:27.559578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f86e8cc-d797-434c-b160-df95a17d7d3f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:27.570562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f86e8cc-d797-434c-b160-df95a17d7d3f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:27.571348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f86e8cc-d797-434c-b160-df95a17d7d3f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:27.572275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f86e8cc-d797-434c-b160-df95a17d7d3f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:27.574628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f86e8cc-d797-434c-b160-df95a17d7d3f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:27.575261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f86e8cc-d797-434c-b160-df95a17d7d3f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:27.576663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f86e8cc-d797-434c-b160-df95a17d7d3f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:27.666349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f86e8cc-d797-434c-b160-df95a17d7d3f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:27.677943 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f86e8cc-d797-434c-b160-df95a17d7d3f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1476 microversion: 2.1 time: 0.124748 Oct 11 04:27:27.679010 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1988/3810] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:27 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1476 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:27.825084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aae7ce07-7e8b-4011-8d75-32dd807fa769 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:27.825084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aae7ce07-7e8b-4011-8d75-32dd807fa769 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:28.321563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bee1050b-a552-4783-a4ae-7925e9203437 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:28.322792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bee1050b-a552-4783-a4ae-7925e9203437 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:28.333405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bee1050b-a552-4783-a4ae-7925e9203437 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:28.334257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bee1050b-a552-4783-a4ae-7925e9203437 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:28.338666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bee1050b-a552-4783-a4ae-7925e9203437 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:28.338666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bee1050b-a552-4783-a4ae-7925e9203437 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:28.338666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bee1050b-a552-4783-a4ae-7925e9203437 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:28.338666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bee1050b-a552-4783-a4ae-7925e9203437 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:28.416496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aae7ce07-7e8b-4011-8d75-32dd807fa769 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:28.425509 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aae7ce07-7e8b-4011-8d75-32dd807fa769 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1213 microversion: 2.1 time: 0.613247 Oct 11 04:27:28.426396 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1823/3811] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:27 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1213 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:28.607036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bee1050b-a552-4783-a4ae-7925e9203437 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:28.620282 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bee1050b-a552-4783-a4ae-7925e9203437 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.304785 Oct 11 04:27:28.635344 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1989/3812] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:28 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:28.702251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:28.702830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:28.726027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:28.726027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:28.726027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:28.726027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:28.726027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:28.726027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:28.754648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:28.755137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:28.755580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:28.756303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lazy-loading 'fault' on Instance uuid 5c80a9e3-3a40-4a91-98ab-6b1b223973f9 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:27:28.799134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:28.807375 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d70672dd-a533-4059-997d-a74e8b1b7204 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 200 len: 1311 microversion: 2.1 time: 0.109113 Oct 11 04:27:28.810250 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1824/3813] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:28 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 1311 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:29.449424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f62c4e10-4d78-4aed-96ed-ce4ab9ec159d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:29.450231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f62c4e10-4d78-4aed-96ed-ce4ab9ec159d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:29.458395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f62c4e10-4d78-4aed-96ed-ce4ab9ec159d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:29.458886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f62c4e10-4d78-4aed-96ed-ce4ab9ec159d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:29.459644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f62c4e10-4d78-4aed-96ed-ce4ab9ec159d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:29.460995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f62c4e10-4d78-4aed-96ed-ce4ab9ec159d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:29.461621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f62c4e10-4d78-4aed-96ed-ce4ab9ec159d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:29.462233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f62c4e10-4d78-4aed-96ed-ce4ab9ec159d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:29.566594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f62c4e10-4d78-4aed-96ed-ce4ab9ec159d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:29.579892 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f62c4e10-4d78-4aed-96ed-ce4ab9ec159d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1265 microversion: 2.1 time: 0.130997 Oct 11 04:27:29.580970 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1990/3814] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:29 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1265 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:29.651533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5590e236-6b90-4372-b971-7f49ce8830c1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:29.653478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5590e236-6b90-4372-b971-7f49ce8830c1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:29.656955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:29.666255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5590e236-6b90-4372-b971-7f49ce8830c1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:29.667873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5590e236-6b90-4372-b971-7f49ce8830c1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:29.668613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5590e236-6b90-4372-b971-7f49ce8830c1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:29.669537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5590e236-6b90-4372-b971-7f49ce8830c1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:29.670474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5590e236-6b90-4372-b971-7f49ce8830c1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:29.671117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5590e236-6b90-4372-b971-7f49ce8830c1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:29.845738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:29.846568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 5c80a9e3-3a40-4a91-98ab-6b1b223973f9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:29.861406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:29.867309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:29.868918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:29.871177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5590e236-6b90-4372-b971-7f49ce8830c1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:29.872032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:29.875503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:29.879257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:29.887813 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5590e236-6b90-4372-b971-7f49ce8830c1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.240223 Oct 11 04:27:29.904092 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1825/3815] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:29 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:29.905400 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] HTTP exception thrown: Instance 5c80a9e3-3a40-4a91-98ab-6b1b223973f9 could not be found. Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Request method failure captured: Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 HTTP/1.1 Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPBewXCuGAgQYm6DRZudfGaFhxZWkKXvAb3fy6AtAvMMPD6bkSHcq5h3p4zdKOrd9ppBV5pDWvc0C-D1we3t-y07l2mgmav7nHg8Rnwf74zR9IijIbssyl1BIIvP76gxLwKX9i6W8X1rSMnNU_MZkq3TcZAtwwycnqa5Ommc6Dnd6kc Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 79f5da4f89bf4688be5d994f08c578bd Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ListServerFiltersTestJSON-427030958 Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/79f5da4f89bf4688be5d994f08c578bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_79f5da4f89bf4688be5d994f08c578bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79f5da4f89bf4688be5d994f08c578bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79f5da4f89bf4688be5d994f08c578bd"}]}] Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ListServerFiltersTestJSON-427030958 Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 79f5da4f89bf4688be5d994f08c578bd Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-427030958 Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ListServerFiltersTestJSON-427030958-project Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: dc692a8f67294a189e15a530c17a0228 Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ListServerFiltersTestJSON-427030958-project Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 5c80a9e3-3a40-4a91-98ab-6b1b223973f9 could not be found. Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '5c80a9e3-3a40-4a91-98ab-6b1b223973f9'} Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c80a9e3-3a40-4a91-98ab-6b1b223973f9 could not be found. Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c80a9e3-3a40-4a91-98ab-6b1b223973f9 could not be found. Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:29.908348 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:29.919904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:29.919904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:29.919904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:29.919904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:29.919904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:29.919904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c80a9e3-3a40-4a91-98ab-6b1b223973f9 could not be found. Oct 11 04:27:29.919904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:29.919904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Returning 404 to user: Instance 5c80a9e3-3a40-4a91-98ab-6b1b223973f9 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:29.919904 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cbb02abc-a7cd-4e20-8ee7-c965ae65ba07 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9" status: 404 len: 111 microversion: 2.1 time: 0.079150 Oct 11 04:27:29.919904 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1991/3816] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:29 2022] GET /compute/v2.1/servers/5c80a9e3-3a40-4a91-98ab-6b1b223973f9 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:27:29.923464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b91e00ec-be33-4a49-91af-22f94fd5e4d9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:29.929850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b91e00ec-be33-4a49-91af-22f94fd5e4d9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 7e848340-de82-48aa-8c66-78908ccdd948] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:29.931646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b91e00ec-be33-4a49-91af-22f94fd5e4d9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:29.932142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b91e00ec-be33-4a49-91af-22f94fd5e4d9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:29.932574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b91e00ec-be33-4a49-91af-22f94fd5e4d9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:29.933278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b91e00ec-be33-4a49-91af-22f94fd5e4d9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:29.933725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b91e00ec-be33-4a49-91af-22f94fd5e4d9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:29.934147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b91e00ec-be33-4a49-91af-22f94fd5e4d9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:29.938964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:29.964344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b91e00ec-be33-4a49-91af-22f94fd5e4d9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 7e848340-de82-48aa-8c66-78908ccdd948] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:27:30.451341 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b91e00ec-be33-4a49-91af-22f94fd5e4d9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948" status: 204 len: 0 microversion: 2.1 time: 0.531992 Oct 11 04:27:30.456670 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1826/3817] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:29 2022] DELETE /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:27:30.465437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0695f7ce-d79a-4d54-85e5-ac71678cf021 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:30.466799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0695f7ce-d79a-4d54-85e5-ac71678cf021 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 7e848340-de82-48aa-8c66-78908ccdd948] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:30.481282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0695f7ce-d79a-4d54-85e5-ac71678cf021 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:30.486615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0695f7ce-d79a-4d54-85e5-ac71678cf021 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:30.491353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0695f7ce-d79a-4d54-85e5-ac71678cf021 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:30.506588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0695f7ce-d79a-4d54-85e5-ac71678cf021 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:30.506588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0695f7ce-d79a-4d54-85e5-ac71678cf021 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:30.506588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0695f7ce-d79a-4d54-85e5-ac71678cf021 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:30.606620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eb010fc9-4afe-4a26-a334-4884d9350c68 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:30.607520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eb010fc9-4afe-4a26-a334-4884d9350c68 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:30.617723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb010fc9-4afe-4a26-a334-4884d9350c68 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:30.618443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb010fc9-4afe-4a26-a334-4884d9350c68 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:30.619043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb010fc9-4afe-4a26-a334-4884d9350c68 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:30.620512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb010fc9-4afe-4a26-a334-4884d9350c68 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:30.622158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb010fc9-4afe-4a26-a334-4884d9350c68 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:30.623262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb010fc9-4afe-4a26-a334-4884d9350c68 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:30.770545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eb010fc9-4afe-4a26-a334-4884d9350c68 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:30.803140 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eb010fc9-4afe-4a26-a334-4884d9350c68 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1273 microversion: 2.1 time: 0.200354 Oct 11 04:27:30.807484 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1827/3818] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:30 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1273 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:30.916752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6280ec0a-2e27-4d2e-bfaa-2abd5a569f9a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:30.917846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6280ec0a-2e27-4d2e-bfaa-2abd5a569f9a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:30.938431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6280ec0a-2e27-4d2e-bfaa-2abd5a569f9a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:30.945515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6280ec0a-2e27-4d2e-bfaa-2abd5a569f9a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:30.949860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6280ec0a-2e27-4d2e-bfaa-2abd5a569f9a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:30.954408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6280ec0a-2e27-4d2e-bfaa-2abd5a569f9a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:30.954902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6280ec0a-2e27-4d2e-bfaa-2abd5a569f9a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:30.959935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6280ec0a-2e27-4d2e-bfaa-2abd5a569f9a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:31.161872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0695f7ce-d79a-4d54-85e5-ac71678cf021 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:31.169463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6280ec0a-2e27-4d2e-bfaa-2abd5a569f9a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:31.171503 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0695f7ce-d79a-4d54-85e5-ac71678cf021 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948" status: 200 len: 1516 microversion: 2.1 time: 0.710891 Oct 11 04:27:31.175320 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1992/3819] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:30 2022] GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948 => generated 1516 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:31.190059 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6280ec0a-2e27-4d2e-bfaa-2abd5a569f9a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.279217 Oct 11 04:27:31.190678 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1828/3820] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:30 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:31.407445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-tempest.common.compute-instance-420532353", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "min_count": 2, "networks": [{"uuid": "b6a68c7a-d23f-40ee-a691-aae54c90b0d5"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:31.481000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] validate_networks() for [('b6a68c7a-d23f-40ee-a691-aae54c90b0d5', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:27:31.841417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-86dc6bce-1411-4095-97b6-8e0f72648ac8 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:31.842142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-86dc6bce-1411-4095-97b6-8e0f72648ac8 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:31.856206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86dc6bce-1411-4095-97b6-8e0f72648ac8 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:31.859512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86dc6bce-1411-4095-97b6-8e0f72648ac8 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:31.861250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86dc6bce-1411-4095-97b6-8e0f72648ac8 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:31.863869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86dc6bce-1411-4095-97b6-8e0f72648ac8 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:31.865707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86dc6bce-1411-4095-97b6-8e0f72648ac8 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:31.870631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86dc6bce-1411-4095-97b6-8e0f72648ac8 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:31.980677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-86dc6bce-1411-4095-97b6-8e0f72648ac8 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:32.007353 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-86dc6bce-1411-4095-97b6-8e0f72648ac8 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1271 microversion: 2.1 time: 0.165814 Oct 11 04:27:32.008802 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1829/3821] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:31 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1271 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:32.197554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ad17d33-c3c7-4a1d-ba55-0f019a7ed568 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:32.198753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2ad17d33-c3c7-4a1d-ba55-0f019a7ed568 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 7e848340-de82-48aa-8c66-78908ccdd948] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:32.209159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ad17d33-c3c7-4a1d-ba55-0f019a7ed568 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:32.209668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ad17d33-c3c7-4a1d-ba55-0f019a7ed568 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:32.212463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ad17d33-c3c7-4a1d-ba55-0f019a7ed568 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:32.213239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ad17d33-c3c7-4a1d-ba55-0f019a7ed568 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:32.213714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ad17d33-c3c7-4a1d-ba55-0f019a7ed568 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:32.215408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ad17d33-c3c7-4a1d-ba55-0f019a7ed568 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:32.477103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:27:32.477554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:27:32.478029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:27:32.478669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:27:32.479076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:27:32.506279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:32.506942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:32.508204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:32.509156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:32.510414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:32.510414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:32.553467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Getting quotas for project c86df48dcef542c180c7b6dc0d9bac52. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:27:32.568643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Getting quotas for user 66f6c41ffe084f1bb93a918b81f98ecc and project c86df48dcef542c180c7b6dc0d9bac52. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:27:32.596411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Going to run 2 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:27:32.602213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: a432a0c5-728b-4bed-9bdc-1bba9b83ad92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:27:32.690478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2ad17d33-c3c7-4a1d-ba55-0f019a7ed568 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:32.690478 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2ad17d33-c3c7-4a1d-ba55-0f019a7ed568 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948" status: 200 len: 1516 microversion: 2.1 time: 0.497630 Oct 11 04:27:32.690478 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1830/3822] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:32 2022] GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948 => generated 1516 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:32.731995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8a42bc5-5584-4d05-bc8b-eb33bb0be020 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:32.733567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a8a42bc5-5584-4d05-bc8b-eb33bb0be020 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:32.741148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a42bc5-5584-4d05-bc8b-eb33bb0be020 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:32.741977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a42bc5-5584-4d05-bc8b-eb33bb0be020 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:32.742658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a42bc5-5584-4d05-bc8b-eb33bb0be020 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:32.743611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a42bc5-5584-4d05-bc8b-eb33bb0be020 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:32.744286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a42bc5-5584-4d05-bc8b-eb33bb0be020 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:32.744950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a42bc5-5584-4d05-bc8b-eb33bb0be020 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:32.907165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=a432a0c5-728b-4bed-9bdc-1bba9b83ad92,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:27:32.961701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a8a42bc5-5584-4d05-bc8b-eb33bb0be020 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:32.973547 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a8a42bc5-5584-4d05-bc8b-eb33bb0be020 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.250047 Oct 11 04:27:32.974589 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1831/3823] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:32 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:33.037306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f907f2e4-c8be-4e64-8301-ab5e85ab7526 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:33.038383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f907f2e4-c8be-4e64-8301-ab5e85ab7526 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:33.049167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f907f2e4-c8be-4e64-8301-ab5e85ab7526 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:33.049995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f907f2e4-c8be-4e64-8301-ab5e85ab7526 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:33.054896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f907f2e4-c8be-4e64-8301-ab5e85ab7526 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:33.058448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f907f2e4-c8be-4e64-8301-ab5e85ab7526 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:33.059112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f907f2e4-c8be-4e64-8301-ab5e85ab7526 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:33.059578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f907f2e4-c8be-4e64-8301-ab5e85ab7526 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:33.187346 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fd81c553-f265-433c-95bd-92230e1349bb tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.004517 Oct 11 04:27:33.187346 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1993/3824] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:27:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 2010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:27:33.204255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5b019f24-caef-49b7-b5d5-907da6007526 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:33.218733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5b019f24-caef-49b7-b5d5-907da6007526 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:33.220279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5b019f24-caef-49b7-b5d5-907da6007526 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Searching by: {'deleted': False, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:33.243504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b019f24-caef-49b7-b5d5-907da6007526 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:33.244180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b019f24-caef-49b7-b5d5-907da6007526 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:33.255115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b019f24-caef-49b7-b5d5-907da6007526 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:33.256384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b019f24-caef-49b7-b5d5-907da6007526 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:33.257622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b019f24-caef-49b7-b5d5-907da6007526 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:33.258061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b019f24-caef-49b7-b5d5-907da6007526 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:33.291681 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5b019f24-caef-49b7-b5d5-907da6007526 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 675 microversion: 2.1 time: 0.099023 Oct 11 04:27:33.294950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f907f2e4-c8be-4e64-8301-ab5e85ab7526 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:33.296523 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1994/3825] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:27:33 2022] GET /compute/v2.1/servers => generated 675 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:27:33.307081 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f907f2e4-c8be-4e64-8301-ab5e85ab7526 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1313 microversion: 2.1 time: 0.277185 Oct 11 04:27:33.310494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c6fd2123-2d94-4d54-a144-8084906ad1b3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:33.311357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c6fd2123-2d94-4d54-a144-8084906ad1b3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:33.317327 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1832/3826] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:33 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1313 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:33.449729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-898c0651-dfec-4de4-8294-575bf4e57edb req-a9033a95-5bbf-4344-8318-b7634c61d1bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e848340-de82-48aa-8c66-78908ccdd948", "name": "network-vif-deleted", "tag": "069dbacb-caef-4334-a4cd-7c8bb4a6d223"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:33.460892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-898c0651-dfec-4de4-8294-575bf4e57edb req-a9033a95-5bbf-4344-8318-b7634c61d1bb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:33.461728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-898c0651-dfec-4de4-8294-575bf4e57edb req-a9033a95-5bbf-4344-8318-b7634c61d1bb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:33.462062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-898c0651-dfec-4de4-8294-575bf4e57edb req-a9033a95-5bbf-4344-8318-b7634c61d1bb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:33.480440 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-898c0651-dfec-4de4-8294-575bf4e57edb req-a9033a95-5bbf-4344-8318-b7634c61d1bb service nova] Creating event network-vif-deleted:069dbacb-caef-4334-a4cd-7c8bb4a6d223 for instance 7e848340-de82-48aa-8c66-78908ccdd948 on n-h1-860892-1 Oct 11 04:27:33.483125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c6fd2123-2d94-4d54-a144-8084906ad1b3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:33.489486 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-898c0651-dfec-4de4-8294-575bf4e57edb req-a9033a95-5bbf-4344-8318-b7634c61d1bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045355 Oct 11 04:27:33.493901 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1833/3827] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:27:33.494035 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c6fd2123-2d94-4d54-a144-8084906ad1b3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1219 microversion: 2.1 time: 0.191032 Oct 11 04:27:33.494665 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1995/3828] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:33 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1219 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:33.727173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-be34a4e5-e611-4d49-b6ee-7b8d5304532d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:33.728233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-be34a4e5-e611-4d49-b6ee-7b8d5304532d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 7e848340-de82-48aa-8c66-78908ccdd948] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:33.739443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be34a4e5-e611-4d49-b6ee-7b8d5304532d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:33.740327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be34a4e5-e611-4d49-b6ee-7b8d5304532d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:33.740998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be34a4e5-e611-4d49-b6ee-7b8d5304532d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:33.741968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be34a4e5-e611-4d49-b6ee-7b8d5304532d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:33.742767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be34a4e5-e611-4d49-b6ee-7b8d5304532d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:33.743472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be34a4e5-e611-4d49-b6ee-7b8d5304532d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:33.801823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=10 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:33.846095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be34a4e5-e611-4d49-b6ee-7b8d5304532d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:33.861821 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-be34a4e5-e611-4d49-b6ee-7b8d5304532d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948" status: 200 len: 1304 microversion: 2.1 time: 0.137162 Oct 11 04:27:33.863047 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1834/3829] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:33 2022] GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948 => generated 1304 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:34.000007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9c6bcfed-417c-41d5-88c5-c2517c3c9463 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:34.001326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9c6bcfed-417c-41d5-88c5-c2517c3c9463 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:34.020633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c6bcfed-417c-41d5-88c5-c2517c3c9463 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:34.022288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c6bcfed-417c-41d5-88c5-c2517c3c9463 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:34.022925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c6bcfed-417c-41d5-88c5-c2517c3c9463 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:34.030704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c6bcfed-417c-41d5-88c5-c2517c3c9463 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:34.030704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c6bcfed-417c-41d5-88c5-c2517c3c9463 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:34.030704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c6bcfed-417c-41d5-88c5-c2517c3c9463 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:34.332457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d1db36d-cb9a-47b5-8c61-129c286e4e13 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:34.333248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7d1db36d-cb9a-47b5-8c61-129c286e4e13 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:34.340061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d1db36d-cb9a-47b5-8c61-129c286e4e13 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:34.344976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d1db36d-cb9a-47b5-8c61-129c286e4e13 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:34.345697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d1db36d-cb9a-47b5-8c61-129c286e4e13 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:34.347497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d1db36d-cb9a-47b5-8c61-129c286e4e13 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:34.348300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d1db36d-cb9a-47b5-8c61-129c286e4e13 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:34.357626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d1db36d-cb9a-47b5-8c61-129c286e4e13 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:34.554081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d1db36d-cb9a-47b5-8c61-129c286e4e13 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:34.564496 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d1db36d-cb9a-47b5-8c61-129c286e4e13 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1313 microversion: 2.1 time: 0.235615 Oct 11 04:27:34.582591 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1835/3830] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:34 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:34.590017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ae63dfd-7017-45e1-9c1f-7b39e23c7c55 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:34.591094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ae63dfd-7017-45e1-9c1f-7b39e23c7c55 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:34.627177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9c6bcfed-417c-41d5-88c5-c2517c3c9463 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:34.636019 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9c6bcfed-417c-41d5-88c5-c2517c3c9463 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.643002 Oct 11 04:27:34.654241 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1996/3831] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:33 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:34.698157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ae63dfd-7017-45e1-9c1f-7b39e23c7c55 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:34.711422 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ae63dfd-7017-45e1-9c1f-7b39e23c7c55 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1219 microversion: 2.1 time: 0.127403 Oct 11 04:27:34.735121 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1836/3832] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:34 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1219 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:34.885642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:34.886181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 7e848340-de82-48aa-8c66-78908ccdd948] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:34.898902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:34.899400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:34.899869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:34.900544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:34.900993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:34.901413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:35.036953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:35.038403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:35.039103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:35.039777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lazy-loading 'fault' on Instance uuid 7e848340-de82-48aa-8c66-78908ccdd948 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:27:35.204749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:35.218868 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-632e77e5-dccc-4d71-aded-9757f6b67136 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948" status: 200 len: 1309 microversion: 2.1 time: 0.336434 Oct 11 04:27:35.219468 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1997/3833] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:34 2022] GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948 => generated 1309 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:35.590797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29610546-6108-488e-b17a-84070eb47c5a tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:35.592227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-29610546-6108-488e-b17a-84070eb47c5a tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:35.613957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29610546-6108-488e-b17a-84070eb47c5a tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:35.616469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29610546-6108-488e-b17a-84070eb47c5a tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:35.616832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29610546-6108-488e-b17a-84070eb47c5a tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:35.617678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29610546-6108-488e-b17a-84070eb47c5a tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:35.618507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29610546-6108-488e-b17a-84070eb47c5a tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:35.619102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29610546-6108-488e-b17a-84070eb47c5a tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:35.669368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d89e1769-777b-40dd-91cc-bfe1ac122938 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:35.669368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d89e1769-777b-40dd-91cc-bfe1ac122938 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:35.675729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1769-777b-40dd-91cc-bfe1ac122938 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:35.677151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1769-777b-40dd-91cc-bfe1ac122938 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:35.678498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1769-777b-40dd-91cc-bfe1ac122938 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:35.680780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1769-777b-40dd-91cc-bfe1ac122938 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:35.682602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1769-777b-40dd-91cc-bfe1ac122938 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:35.685394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1769-777b-40dd-91cc-bfe1ac122938 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:35.704554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:35.998877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-29610546-6108-488e-b17a-84070eb47c5a tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:36.036133 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-29610546-6108-488e-b17a-84070eb47c5a tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1313 microversion: 2.1 time: 0.449732 Oct 11 04:27:36.058539 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1837/3834] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:35 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:36.058539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-90c35d71-00f7-4062-85e7-d664e754adc3 req-e55076d1-ca95-4bb2-b702-1e344b67c6af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4963ffd2-05a2-4bfe-9e61-fb4b1ea63381", "tag": "2a3021c1-375c-4cc9-9441-24a6f8f67d3d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:36.072707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-90c35d71-00f7-4062-85e7-d664e754adc3 req-e55076d1-ca95-4bb2-b702-1e344b67c6af service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:36.074538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-90c35d71-00f7-4062-85e7-d664e754adc3 req-e55076d1-ca95-4bb2-b702-1e344b67c6af service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:36.075227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-90c35d71-00f7-4062-85e7-d664e754adc3 req-e55076d1-ca95-4bb2-b702-1e344b67c6af service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:36.100609 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-90c35d71-00f7-4062-85e7-d664e754adc3 req-e55076d1-ca95-4bb2-b702-1e344b67c6af service nova] Creating event network-changed:2a3021c1-375c-4cc9-9441-24a6f8f67d3d for instance 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 on n-h2-860892-1 Oct 11 04:27:36.108187 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-90c35d71-00f7-4062-85e7-d664e754adc3 req-e55076d1-ca95-4bb2-b702-1e344b67c6af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070161 Oct 11 04:27:36.111164 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1838/3835] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:36.119102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f7d4601a-6404-42b7-876c-1af16d10de64 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:36.120193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f7d4601a-6404-42b7-876c-1af16d10de64 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:36.226557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d89e1769-777b-40dd-91cc-bfe1ac122938 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:36.239181 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d89e1769-777b-40dd-91cc-bfe1ac122938 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.575660 Oct 11 04:27:36.240198 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1998/3836] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:35 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:36.254971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:36.256303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 7e848340-de82-48aa-8c66-78908ccdd948] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:36.272576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:36.273441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:36.274117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:36.278738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:36.280102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:36.280880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:36.312093 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] HTTP exception thrown: Instance 7e848340-de82-48aa-8c66-78908ccdd948 could not be found. Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Request method failure captured: Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948 HTTP/1.1 Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPBewXCuGAgQYm6DRZudfGaFhxZWkKXvAb3fy6AtAvMMPD6bkSHcq5h3p4zdKOrd9ppBV5pDWvc0C-D1we3t-y07l2mgmav7nHg8Rnwf74zR9IijIbssyl1BIIvP76gxLwKX9i6W8X1rSMnNU_MZkq3TcZAtwwycnqa5Ommc6Dnd6kc Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 79f5da4f89bf4688be5d994f08c578bd Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ListServerFiltersTestJSON-427030958 Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/79f5da4f89bf4688be5d994f08c578bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_79f5da4f89bf4688be5d994f08c578bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79f5da4f89bf4688be5d994f08c578bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79f5da4f89bf4688be5d994f08c578bd"}]}] Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ListServerFiltersTestJSON-427030958 Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 79f5da4f89bf4688be5d994f08c578bd Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-427030958 Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ListServerFiltersTestJSON-427030958-project Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: dc692a8f67294a189e15a530c17a0228 Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ListServerFiltersTestJSON-427030958-project Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 7e848340-de82-48aa-8c66-78908ccdd948 could not be found. Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '7e848340-de82-48aa-8c66-78908ccdd948'} Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e848340-de82-48aa-8c66-78908ccdd948 could not be found. Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e848340-de82-48aa-8c66-78908ccdd948 could not be found. Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:36.314946 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:36.320714 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:36.320714 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:36.320714 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:36.320714 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:36.320714 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:36.320714 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e848340-de82-48aa-8c66-78908ccdd948 could not be found. Oct 11 04:27:36.320714 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:36.322653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Returning 404 to user: Instance 7e848340-de82-48aa-8c66-78908ccdd948 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:36.323821 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-829577f0-d5e0-491d-9aa3-25717bafd76f tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948" status: 404 len: 111 microversion: 2.1 time: 0.082576 Oct 11 04:27:36.325068 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 1999/3837] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:36 2022] GET /compute/v2.1/servers/7e848340-de82-48aa-8c66-78908ccdd948 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:36.333683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9705b692-4d04-44d7-9eba-787d15b66e0d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:36.334507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9705b692-4d04-44d7-9eba-787d15b66e0d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:36.351120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9705b692-4d04-44d7-9eba-787d15b66e0d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:36.352410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9705b692-4d04-44d7-9eba-787d15b66e0d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:36.353549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9705b692-4d04-44d7-9eba-787d15b66e0d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:36.355039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9705b692-4d04-44d7-9eba-787d15b66e0d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:36.359248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9705b692-4d04-44d7-9eba-787d15b66e0d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:36.359248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9705b692-4d04-44d7-9eba-787d15b66e0d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:36.389337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9705b692-4d04-44d7-9eba-787d15b66e0d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:27:36.440273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f7d4601a-6404-42b7-876c-1af16d10de64 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:36.449742 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f7d4601a-6404-42b7-876c-1af16d10de64 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1219 microversion: 2.1 time: 0.336971 Oct 11 04:27:36.450360 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1839/3838] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:36 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1219 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:36.962877 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9705b692-4d04-44d7-9eba-787d15b66e0d tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 204 len: 0 microversion: 2.1 time: 0.633483 Oct 11 04:27:36.967312 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2000/3839] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:36 2022] DELETE /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:27:36.976376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-515d9992-23f4-4344-b6d9-29e788f056c9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:36.977716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-515d9992-23f4-4344-b6d9-29e788f056c9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:37.005379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-515d9992-23f4-4344-b6d9-29e788f056c9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:37.007173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-515d9992-23f4-4344-b6d9-29e788f056c9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:37.007720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-515d9992-23f4-4344-b6d9-29e788f056c9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:37.010029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-515d9992-23f4-4344-b6d9-29e788f056c9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:37.010588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-515d9992-23f4-4344-b6d9-29e788f056c9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:37.015270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-515d9992-23f4-4344-b6d9-29e788f056c9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:37.095305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e035d09b-4043-4a05-8ac6-b2a335e5b709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:37.099059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e035d09b-4043-4a05-8ac6-b2a335e5b709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:37.111916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e035d09b-4043-4a05-8ac6-b2a335e5b709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:37.114869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e035d09b-4043-4a05-8ac6-b2a335e5b709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:37.115337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e035d09b-4043-4a05-8ac6-b2a335e5b709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:37.119824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e035d09b-4043-4a05-8ac6-b2a335e5b709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:37.120430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e035d09b-4043-4a05-8ac6-b2a335e5b709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:37.120872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e035d09b-4043-4a05-8ac6-b2a335e5b709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:37.393997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e035d09b-4043-4a05-8ac6-b2a335e5b709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:37.402909 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e035d09b-4043-4a05-8ac6-b2a335e5b709 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1313 microversion: 2.1 time: 0.320557 Oct 11 04:27:37.418961 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2001/3840] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:37 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1313 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:37.425399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c62e2ede-9f66-4a5d-8341-2a4366d68a37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:37.426352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c62e2ede-9f66-4a5d-8341-2a4366d68a37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:37.433254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c62e2ede-9f66-4a5d-8341-2a4366d68a37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:37.434087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c62e2ede-9f66-4a5d-8341-2a4366d68a37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:37.434795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c62e2ede-9f66-4a5d-8341-2a4366d68a37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:37.435711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c62e2ede-9f66-4a5d-8341-2a4366d68a37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:37.436359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c62e2ede-9f66-4a5d-8341-2a4366d68a37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:37.436978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c62e2ede-9f66-4a5d-8341-2a4366d68a37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:37.654595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c62e2ede-9f66-4a5d-8341-2a4366d68a37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:37.664035 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c62e2ede-9f66-4a5d-8341-2a4366d68a37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.243016 Oct 11 04:27:37.664741 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2002/3841] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:37 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:37.685733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c8ee0d02-45bf-4a83-8a1e-08e1feeb65a4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:37.686788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c8ee0d02-45bf-4a83-8a1e-08e1feeb65a4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:37.694347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8ee0d02-45bf-4a83-8a1e-08e1feeb65a4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:37.695152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8ee0d02-45bf-4a83-8a1e-08e1feeb65a4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:37.695785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8ee0d02-45bf-4a83-8a1e-08e1feeb65a4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:37.702248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8ee0d02-45bf-4a83-8a1e-08e1feeb65a4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:37.702248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8ee0d02-45bf-4a83-8a1e-08e1feeb65a4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:37.702248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8ee0d02-45bf-4a83-8a1e-08e1feeb65a4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:37.812072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-515d9992-23f4-4344-b6d9-29e788f056c9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:37.820825 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-515d9992-23f4-4344-b6d9-29e788f056c9 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1517 microversion: 2.1 time: 0.852005 Oct 11 04:27:37.821547 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1840/3842] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:36 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1517 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:37.868325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c8ee0d02-45bf-4a83-8a1e-08e1feeb65a4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:37.883550 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c8ee0d02-45bf-4a83-8a1e-08e1feeb65a4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1223 microversion: 2.1 time: 0.203284 Oct 11 04:27:37.884462 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2003/3843] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:37 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1223 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:38.425203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-be9d54a4-16de-4466-83b6-7c10fba29d38 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:38.426517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-be9d54a4-16de-4466-83b6-7c10fba29d38 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:38.442453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be9d54a4-16de-4466-83b6-7c10fba29d38 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:38.447919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be9d54a4-16de-4466-83b6-7c10fba29d38 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:38.449294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be9d54a4-16de-4466-83b6-7c10fba29d38 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:38.451893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be9d54a4-16de-4466-83b6-7c10fba29d38 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:38.455231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be9d54a4-16de-4466-83b6-7c10fba29d38 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:38.456467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be9d54a4-16de-4466-83b6-7c10fba29d38 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:38.689045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7ba5d9f7-5ae6-47e7-9471-744a62b24466 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:38.689914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7ba5d9f7-5ae6-47e7-9471-744a62b24466 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:38.703378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ba5d9f7-5ae6-47e7-9471-744a62b24466 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:38.703886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ba5d9f7-5ae6-47e7-9471-744a62b24466 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:38.705780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ba5d9f7-5ae6-47e7-9471-744a62b24466 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:38.708763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ba5d9f7-5ae6-47e7-9471-744a62b24466 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:38.709445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ba5d9f7-5ae6-47e7-9471-744a62b24466 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:38.711418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ba5d9f7-5ae6-47e7-9471-744a62b24466 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:38.924126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be9d54a4-16de-4466-83b6-7c10fba29d38 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:38.939286 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-be9d54a4-16de-4466-83b6-7c10fba29d38 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1313 microversion: 2.1 time: 0.517940 Oct 11 04:27:38.951116 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1841/3844] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:38 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1313 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:38.965902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-97cc5caa-bc94-4979-97da-ca301009b054 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:38.967081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-97cc5caa-bc94-4979-97da-ca301009b054 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:38.973991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97cc5caa-bc94-4979-97da-ca301009b054 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:38.974793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97cc5caa-bc94-4979-97da-ca301009b054 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:38.976549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97cc5caa-bc94-4979-97da-ca301009b054 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:38.976549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97cc5caa-bc94-4979-97da-ca301009b054 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:38.977836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97cc5caa-bc94-4979-97da-ca301009b054 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:38.978530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97cc5caa-bc94-4979-97da-ca301009b054 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:39.096357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7ba5d9f7-5ae6-47e7-9471-744a62b24466 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:39.112562 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7ba5d9f7-5ae6-47e7-9471-744a62b24466 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1512 microversion: 2.1 time: 0.427307 Oct 11 04:27:39.113797 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2004/3845] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:38 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1512 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:39.127343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8ca1b922-3c8d-4999-9eca-f6fd3e9e9c2a tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:39.133747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8ca1b922-3c8d-4999-9eca-f6fd3e9e9c2a tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:39.140166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ca1b922-3c8d-4999-9eca-f6fd3e9e9c2a tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:39.140972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ca1b922-3c8d-4999-9eca-f6fd3e9e9c2a tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:39.141849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ca1b922-3c8d-4999-9eca-f6fd3e9e9c2a tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:39.142938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ca1b922-3c8d-4999-9eca-f6fd3e9e9c2a tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:39.143545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ca1b922-3c8d-4999-9eca-f6fd3e9e9c2a tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:39.144251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ca1b922-3c8d-4999-9eca-f6fd3e9e9c2a tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:39.266152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8ca1b922-3c8d-4999-9eca-f6fd3e9e9c2a tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:39.276219 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8ca1b922-3c8d-4999-9eca-f6fd3e9e9c2a tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1215 microversion: 2.1 time: 0.161049 Oct 11 04:27:39.276805 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2005/3846] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:39 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1215 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:39.411997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-LiveMigrationTest-server-1505973243", "imageRef": "", "flavorRef": "452", "networks": [{"uuid": "5ff9bcca-b89a-450b-98cb-6e2aeae348c3"}], "block_device_mapping_v2": [{"uuid": "15570173-0408-4a3b-951e-4c011fd9c726", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:39.573526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] validate_networks() for [('5ff9bcca-b89a-450b-98cb-6e2aeae348c3', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:27:39.676490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-97cc5caa-bc94-4979-97da-ca301009b054 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:39.687578 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-97cc5caa-bc94-4979-97da-ca301009b054 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1517 microversion: 2.1 time: 0.732075 Oct 11 04:27:39.688563 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1842/3847] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:38 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1517 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:40.013743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ListServersNegativeTestJSON-server-1294555495", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "min_count": 3, "networks": [{"uuid": "e11bd43f-94ae-40d1-8a01-ffef384b20a0"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:40.163094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] validate_networks() for [('e11bd43f-94ae-40d1-8a01-ffef384b20a0', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:27:40.782271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:27:40.782766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:27:40.783944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:27:40.783944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:27:40.784174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:27:40.793594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:40.794156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:40.794585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:40.795285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:40.795743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:40.796167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:40.805438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=15 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:40.816051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Getting quotas for project 15b90becc5a545f0965359b05561721f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:27:40.821592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Getting quotas for user ea114683a3754c8197b61fc5ef04fe0d and project 15b90becc5a545f0965359b05561721f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:27:40.832111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=2,nova_api:INSERT=9 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:40.834455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:27:40.834927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:27:40.848163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:27:40.848163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:27:40.848163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:27:40.848163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:40.848163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:40.849285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:40.849285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:40.849526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:40.850171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:40.870095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Getting quotas for project c0ac9145210548c78285621466d44b39. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:27:40.876282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Getting quotas for user 550bea6ee48f4a8e81646d727d51a1d3 and project c0ac9145210548c78285621466d44b39. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:27:40.897943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Going to run 3 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:27:40.901784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:27:40.904102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='15570173-0408-4a3b-951e-4c011fd9c726',volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:27:40.920849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: d074edb8-863b-48c6-900d-2bcc2c5e23f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:27:41.145632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: 98213491-b0bf-4bbb-aa2f-3399f13caa8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=d074edb8-863b-48c6-900d-2bcc2c5e23f6,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:27:41.362449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=98213491-b0bf-4bbb-aa2f-3399f13caa8a,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:27:41.680434 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef360068-dc26-4d7e-933a-1c29a9e2f0d9 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.989958 Oct 11 04:27:41.691045 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1843/3848] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:27:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:27:41.706769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8e5062e-d26e-4577-99e9-f6088e3f17d1 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:41.707409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f8e5062e-d26e-4577-99e9-f6088e3f17d1 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:41.723671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8e5062e-d26e-4577-99e9-f6088e3f17d1 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:41.723671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8e5062e-d26e-4577-99e9-f6088e3f17d1 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:41.723671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8e5062e-d26e-4577-99e9-f6088e3f17d1 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:41.731456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8e5062e-d26e-4577-99e9-f6088e3f17d1 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:41.732270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8e5062e-d26e-4577-99e9-f6088e3f17d1 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:41.735809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8e5062e-d26e-4577-99e9-f6088e3f17d1 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:41.765563 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b52285ba-d132-455b-b432-76358b269bf2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.358566 Oct 11 04:27:41.768112 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2006/3849] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:27:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 2362 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:27:41.818033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2fc93328-a2c1-4b28-83af-46f80e161ce4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:41.820958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2fc93328-a2c1-4b28-83af-46f80e161ce4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:41.847479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fc93328-a2c1-4b28-83af-46f80e161ce4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:41.848374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fc93328-a2c1-4b28-83af-46f80e161ce4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:41.850153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fc93328-a2c1-4b28-83af-46f80e161ce4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:41.857029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fc93328-a2c1-4b28-83af-46f80e161ce4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:41.859681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fc93328-a2c1-4b28-83af-46f80e161ce4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:41.862156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fc93328-a2c1-4b28-83af-46f80e161ce4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.133358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f8e5062e-d26e-4577-99e9-f6088e3f17d1 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:42.156488 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f8e5062e-d26e-4577-99e9-f6088e3f17d1 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1313 microversion: 2.1 time: 0.464050 Oct 11 04:27:42.161326 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1844/3850] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:41 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1313 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:42.193217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e316315e-e858-4433-a33b-fcbe6fd78796 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:42.193777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e316315e-e858-4433-a33b-fcbe6fd78796 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:42.215114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e316315e-e858-4433-a33b-fcbe6fd78796 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.215634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e316315e-e858-4433-a33b-fcbe6fd78796 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.215826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e316315e-e858-4433-a33b-fcbe6fd78796 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.226792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e316315e-e858-4433-a33b-fcbe6fd78796 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.231918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e316315e-e858-4433-a33b-fcbe6fd78796 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.232687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e316315e-e858-4433-a33b-fcbe6fd78796 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.247076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:42.346343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2fc93328-a2c1-4b28-83af-46f80e161ce4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:42.356802 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2fc93328-a2c1-4b28-83af-46f80e161ce4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1489 microversion: 2.1 time: 0.585599 Oct 11 04:27:42.357471 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2007/3851] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:41 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1489 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:42.372028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e316315e-e858-4433-a33b-fcbe6fd78796 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:42.379801 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e316315e-e858-4433-a33b-fcbe6fd78796 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1277 microversion: 2.1 time: 0.196923 Oct 11 04:27:42.380228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-bf036a7d-0e19-4389-b554-553560b11160 req-6f6e7feb-fc03-49a7-9e81-313c12eb1981 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4c4dd776-fc91-4486-b022-91b4b1c3fc3e", "name": "network-vif-deleted", "tag": "0cd6a4d1-10e9-47d0-80e8-94343ad0cab2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:42.380552 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1845/3852] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:42 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:42.385690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:42.386636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:42.394107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.394910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.395551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.396506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.397320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bf036a7d-0e19-4389-b554-553560b11160 req-6f6e7feb-fc03-49a7-9e81-313c12eb1981 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.397583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.397814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bf036a7d-0e19-4389-b554-553560b11160 req-6f6e7feb-fc03-49a7-9e81-313c12eb1981 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.398341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bf036a7d-0e19-4389-b554-553560b11160 req-6f6e7feb-fc03-49a7-9e81-313c12eb1981 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.398575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.413364 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-bf036a7d-0e19-4389-b554-553560b11160 req-6f6e7feb-fc03-49a7-9e81-313c12eb1981 service nova] Creating event network-vif-deleted:0cd6a4d1-10e9-47d0-80e8-94343ad0cab2 for instance 4c4dd776-fc91-4486-b022-91b4b1c3fc3e on n-h1-860892-1 Oct 11 04:27:42.419951 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-bf036a7d-0e19-4389-b554-553560b11160 req-6f6e7feb-fc03-49a7-9e81-313c12eb1981 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060809 Oct 11 04:27:42.421053 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2008/3853] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:42.427072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-cd670386-5851-4a2f-b55e-f6f24f977c81 req-911a1cf7-76a9-47c5-8d88-b175b136f980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4963ffd2-05a2-4bfe-9e61-fb4b1ea63381", "name": "network-vif-plugged", "status": "completed", "tag": "2a3021c1-375c-4cc9-9441-24a6f8f67d3d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:42.436153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.436677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.437234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.437597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cd670386-5851-4a2f-b55e-f6f24f977c81 req-911a1cf7-76a9-47c5-8d88-b175b136f980 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.437894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lazy-loading 'fault' on Instance uuid 4c4dd776-fc91-4486-b022-91b4b1c3fc3e {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:27:42.438554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cd670386-5851-4a2f-b55e-f6f24f977c81 req-911a1cf7-76a9-47c5-8d88-b175b136f980 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.444200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cd670386-5851-4a2f-b55e-f6f24f977c81 req-911a1cf7-76a9-47c5-8d88-b175b136f980 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.466098 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-cd670386-5851-4a2f-b55e-f6f24f977c81 req-911a1cf7-76a9-47c5-8d88-b175b136f980 service nova] Creating event network-vif-plugged:2a3021c1-375c-4cc9-9441-24a6f8f67d3d for instance 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 on n-h2-860892-1 Oct 11 04:27:42.481670 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-cd670386-5851-4a2f-b55e-f6f24f977c81 req-911a1cf7-76a9-47c5-8d88-b175b136f980 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059242 Oct 11 04:27:42.482710 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2009/3854] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:42.491873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1c2b07d3-6426-41c1-8be5-2c77cfa6befe tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:42.499303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1c2b07d3-6426-41c1-8be5-2c77cfa6befe tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:42.500369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1c2b07d3-6426-41c1-8be5-2c77cfa6befe tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Searching by: {'deleted': False, 'project_id': 'c0ac9145210548c78285621466d44b39'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:27:42.512441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc692a8f67294a189e15a530c17a0228', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '79f5da4f89bf4688be5d994f08c578bd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:42.524739 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-11d063f2-3f9b-4baf-b8e9-046ad493f019 tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 200 len: 1309 microversion: 2.1 time: 0.138660 Oct 11 04:27:42.526988 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1846/3855] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:42 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 1309 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:42.533840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c2b07d3-6426-41c1-8be5-2c77cfa6befe tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.534386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c2b07d3-6426-41c1-8be5-2c77cfa6befe tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.534916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c2b07d3-6426-41c1-8be5-2c77cfa6befe tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.536101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c2b07d3-6426-41c1-8be5-2c77cfa6befe tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.536746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c2b07d3-6426-41c1-8be5-2c77cfa6befe tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.537968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c2b07d3-6426-41c1-8be5-2c77cfa6befe tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.553822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d6161e4d-7057-4401-ab19-374c0d4a5f7e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:42.559081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d6161e4d-7057-4401-ab19-374c0d4a5f7e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:42.573618 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1c2b07d3-6426-41c1-8be5-2c77cfa6befe tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1018 microversion: 2.1 time: 0.089417 Oct 11 04:27:42.576767 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2010/3856] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:27:42 2022] GET /compute/v2.1/servers => generated 1018 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:42.586438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-104adef6-a61b-45c6-869f-dce7ed0ebcd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 3}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:42.590079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-104adef6-a61b-45c6-869f-dce7ed0ebcd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:42.597178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104adef6-a61b-45c6-869f-dce7ed0ebcd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.603064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104adef6-a61b-45c6-869f-dce7ed0ebcd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.603064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104adef6-a61b-45c6-869f-dce7ed0ebcd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.603064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104adef6-a61b-45c6-869f-dce7ed0ebcd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.603064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104adef6-a61b-45c6-869f-dce7ed0ebcd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.603064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-104adef6-a61b-45c6-869f-dce7ed0ebcd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.655056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d6161e4d-7057-4401-ab19-374c0d4a5f7e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:42.666617 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d6161e4d-7057-4401-ab19-374c0d4a5f7e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1053 microversion: 2.1 time: 0.137693 Oct 11 04:27:42.667558 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1847/3857] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:42 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1053 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:42.674721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a4036ca9-131c-4b1c-a01a-8a95c0d9d4bd tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:42.675343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a4036ca9-131c-4b1c-a01a-8a95c0d9d4bd tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:42.696671 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-104adef6-a61b-45c6-869f-dce7ed0ebcd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 200 len: 164 microversion: 2.1 time: 0.115299 Oct 11 04:27:42.696671 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2011/3858] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:27:42 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 164 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:42.720053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b98c1569-d630-449f-8aa0-ed0fd46d7096 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:42.721763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b98c1569-d630-449f-8aa0-ed0fd46d7096 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:42.738667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b98c1569-d630-449f-8aa0-ed0fd46d7096 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.741837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b98c1569-d630-449f-8aa0-ed0fd46d7096 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.744510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b98c1569-d630-449f-8aa0-ed0fd46d7096 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.745720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b98c1569-d630-449f-8aa0-ed0fd46d7096 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:42.750448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b98c1569-d630-449f-8aa0-ed0fd46d7096 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:42.752359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b98c1569-d630-449f-8aa0-ed0fd46d7096 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:42.785007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a4036ca9-131c-4b1c-a01a-8a95c0d9d4bd tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:42.795858 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a4036ca9-131c-4b1c-a01a-8a95c0d9d4bd tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1223 microversion: 2.1 time: 0.126368 Oct 11 04:27:42.796749 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1848/3859] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:42 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1223 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:43.052165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b98c1569-d630-449f-8aa0-ed0fd46d7096 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:43.062080 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b98c1569-d630-449f-8aa0-ed0fd46d7096 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.360532 Oct 11 04:27:43.068867 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2012/3860] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:42 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:43.094165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90b811dd-ca19-40fa-998d-d2ae61e95461 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:43.095101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90b811dd-ca19-40fa-998d-d2ae61e95461 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:43.106584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90b811dd-ca19-40fa-998d-d2ae61e95461 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:43.107339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90b811dd-ca19-40fa-998d-d2ae61e95461 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:43.107901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90b811dd-ca19-40fa-998d-d2ae61e95461 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:43.109136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90b811dd-ca19-40fa-998d-d2ae61e95461 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:43.109679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90b811dd-ca19-40fa-998d-d2ae61e95461 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:43.110243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90b811dd-ca19-40fa-998d-d2ae61e95461 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:43.199418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0143fe1-24f6-4637-be65-5f6334c5648c tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:43.200193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d0143fe1-24f6-4637-be65-5f6334c5648c tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:43.208117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0143fe1-24f6-4637-be65-5f6334c5648c tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:43.209521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0143fe1-24f6-4637-be65-5f6334c5648c tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:43.213018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0143fe1-24f6-4637-be65-5f6334c5648c tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:43.215420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0143fe1-24f6-4637-be65-5f6334c5648c tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:43.215979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0143fe1-24f6-4637-be65-5f6334c5648c tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:43.217533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0143fe1-24f6-4637-be65-5f6334c5648c tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:43.357522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90b811dd-ca19-40fa-998d-d2ae61e95461 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:43.369704 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90b811dd-ca19-40fa-998d-d2ae61e95461 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.281559 Oct 11 04:27:43.370342 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1849/3861] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:43 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:43.396279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b981bc7-9fd0-4578-b661-ddd7dcddcce1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:43.398734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b981bc7-9fd0-4578-b661-ddd7dcddcce1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:43.406442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b981bc7-9fd0-4578-b661-ddd7dcddcce1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:43.408373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b981bc7-9fd0-4578-b661-ddd7dcddcce1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:43.409411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b981bc7-9fd0-4578-b661-ddd7dcddcce1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:43.410976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b981bc7-9fd0-4578-b661-ddd7dcddcce1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:43.412130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b981bc7-9fd0-4578-b661-ddd7dcddcce1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:43.413012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b981bc7-9fd0-4578-b661-ddd7dcddcce1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:43.648412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b981bc7-9fd0-4578-b661-ddd7dcddcce1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:43.674477 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b981bc7-9fd0-4578-b661-ddd7dcddcce1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.285704 Oct 11 04:27:43.675078 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1850/3862] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:43 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:43.686026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-142ecebe-087c-4b91-8062-309fa340e979 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:43.686696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-142ecebe-087c-4b91-8062-309fa340e979 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:43.693168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-142ecebe-087c-4b91-8062-309fa340e979 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:43.693902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-142ecebe-087c-4b91-8062-309fa340e979 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:43.694839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-142ecebe-087c-4b91-8062-309fa340e979 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:43.716598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-142ecebe-087c-4b91-8062-309fa340e979 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:43.717437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-142ecebe-087c-4b91-8062-309fa340e979 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:43.718398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-142ecebe-087c-4b91-8062-309fa340e979 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:44.014469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-142ecebe-087c-4b91-8062-309fa340e979 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:44.024329 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-142ecebe-087c-4b91-8062-309fa340e979 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 0.342952 Oct 11 04:27:44.025093 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1851/3863] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:43 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:44.030256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:44.031327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] [instance: 4c4dd776-fc91-4486-b022-91b4b1c3fc3e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:44.038094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:44.038873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:44.039444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:44.040161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:44.040706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:44.041280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:44.073773 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] HTTP exception thrown: Instance 4c4dd776-fc91-4486-b022-91b4b1c3fc3e could not be found. Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Request method failure captured: Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e HTTP/1.1 Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPBewXCuGAgQYm6DRZudfGaFhxZWkKXvAb3fy6AtAvMMPD6bkSHcq5h3p4zdKOrd9ppBV5pDWvc0C-D1we3t-y07l2mgmav7nHg8Rnwf74zR9IijIbssyl1BIIvP76gxLwKX9i6W8X1rSMnNU_MZkq3TcZAtwwycnqa5Ommc6Dnd6kc Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 79f5da4f89bf4688be5d994f08c578bd Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ListServerFiltersTestJSON-427030958 Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/79f5da4f89bf4688be5d994f08c578bd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_79f5da4f89bf4688be5d994f08c578bd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79f5da4f89bf4688be5d994f08c578bd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/79f5da4f89bf4688be5d994f08c578bd"}]}] Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ListServerFiltersTestJSON-427030958 Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 79f5da4f89bf4688be5d994f08c578bd Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ListServerFiltersTestJSON-427030958 Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ListServerFiltersTestJSON-427030958-project Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: dc692a8f67294a189e15a530c17a0228 Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ListServerFiltersTestJSON-427030958-project Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 4c4dd776-fc91-4486-b022-91b4b1c3fc3e could not be found. Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '4c4dd776-fc91-4486-b022-91b4b1c3fc3e'} Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4c4dd776-fc91-4486-b022-91b4b1c3fc3e could not be found. Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4c4dd776-fc91-4486-b022-91b4b1c3fc3e could not be found. Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:44.076105 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:44.081788 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:44.081788 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:44.081788 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:44.081788 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:44.081788 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:44.081788 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4c4dd776-fc91-4486-b022-91b4b1c3fc3e could not be found. Oct 11 04:27:44.081788 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:27:44.081788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] Returning 404 to user: Instance 4c4dd776-fc91-4486-b022-91b4b1c3fc3e could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:44.082674 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eaf23ade-8037-42b3-9481-90f138fb9ddf tempest-ListServerFiltersTestJSON-427030958 tempest-ListServerFiltersTestJSON-427030958-project] 10.222.0.26 "GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e" status: 404 len: 111 microversion: 2.1 time: 0.054365 Oct 11 04:27:44.092084 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1852/3864] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:44 2022] GET /compute/v2.1/servers/4c4dd776-fc91-4486-b022-91b4b1c3fc3e => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:44.103131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-53e17e75-064e-4bf2-9536-a2fd1b27f217 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:44.104971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-53e17e75-064e-4bf2-9536-a2fd1b27f217 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:44.120431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e17e75-064e-4bf2-9536-a2fd1b27f217 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:44.120927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e17e75-064e-4bf2-9536-a2fd1b27f217 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:44.121365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e17e75-064e-4bf2-9536-a2fd1b27f217 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:44.129621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e17e75-064e-4bf2-9536-a2fd1b27f217 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:44.130157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e17e75-064e-4bf2-9536-a2fd1b27f217 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:44.130630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53e17e75-064e-4bf2-9536-a2fd1b27f217 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:44.206618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d0143fe1-24f6-4637-be65-5f6334c5648c tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:44.218402 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d0143fe1-24f6-4637-be65-5f6334c5648c tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1313 microversion: 2.1 time: 1.033626 Oct 11 04:27:44.219001 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2013/3865] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:43 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1313 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:44.237892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32ff569d-5223-4c49-b110-370a90624393 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:44.238812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-32ff569d-5223-4c49-b110-370a90624393 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:44.261372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ff569d-5223-4c49-b110-370a90624393 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:44.262756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ff569d-5223-4c49-b110-370a90624393 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:44.264244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ff569d-5223-4c49-b110-370a90624393 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:44.269155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ff569d-5223-4c49-b110-370a90624393 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:44.273611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53e17e75-064e-4bf2-9536-a2fd1b27f217 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:44.284673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ff569d-5223-4c49-b110-370a90624393 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:44.289825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ff569d-5223-4c49-b110-370a90624393 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:44.289980 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-53e17e75-064e-4bf2-9536-a2fd1b27f217 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1103 microversion: 2.1 time: 0.193475 Oct 11 04:27:44.291174 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1853/3866] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:44 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1103 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:44.316310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ba8cb71-ba79-46af-8432-0d8fe4255a3e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:44.324568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ba8cb71-ba79-46af-8432-0d8fe4255a3e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:44.475846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ba8cb71-ba79-46af-8432-0d8fe4255a3e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:44.480403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=21 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:44.487067 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ba8cb71-ba79-46af-8432-0d8fe4255a3e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1223 microversion: 2.1 time: 0.187573 Oct 11 04:27:44.487969 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1854/3867] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:44 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1223 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:44.686793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-32ff569d-5223-4c49-b110-370a90624393 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:44.695608 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-32ff569d-5223-4c49-b110-370a90624393 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.474254 Oct 11 04:27:44.696525 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2014/3868] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:44 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:44.930821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1822400100", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "30252624-67f7-4bbb-9346-39722e0301e1"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:44.967626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:INSERT=9 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:45.022422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] validate_networks() for [('30252624-67f7-4bbb-9346-39722e0301e1', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:27:45.054545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f0c44bed-bbdd-4824-b4fd-d32bc1a2baf3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:45.055457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f0c44bed-bbdd-4824-b4fd-d32bc1a2baf3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:45.070955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0c44bed-bbdd-4824-b4fd-d32bc1a2baf3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:45.073236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0c44bed-bbdd-4824-b4fd-d32bc1a2baf3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:45.074547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0c44bed-bbdd-4824-b4fd-d32bc1a2baf3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:45.076026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0c44bed-bbdd-4824-b4fd-d32bc1a2baf3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:45.080072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0c44bed-bbdd-4824-b4fd-d32bc1a2baf3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:45.080709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0c44bed-bbdd-4824-b4fd-d32bc1a2baf3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:45.475435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f0c44bed-bbdd-4824-b4fd-d32bc1a2baf3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:45.488935 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f0c44bed-bbdd-4824-b4fd-d32bc1a2baf3 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 0.439304 Oct 11 04:27:45.505178 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2015/3869] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:45 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:45.505178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9a740d52-d164-4b18-ab0a-f795c855223f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:45.505178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9a740d52-d164-4b18-ab0a-f795c855223f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:45.558009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a740d52-d164-4b18-ab0a-f795c855223f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:45.558785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a740d52-d164-4b18-ab0a-f795c855223f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:45.559308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a740d52-d164-4b18-ab0a-f795c855223f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:45.567082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a740d52-d164-4b18-ab0a-f795c855223f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:45.567583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a740d52-d164-4b18-ab0a-f795c855223f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:45.568029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a740d52-d164-4b18-ab0a-f795c855223f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:46.054374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9a740d52-d164-4b18-ab0a-f795c855223f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:46.061210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:46.072139 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9a740d52-d164-4b18-ab0a-f795c855223f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1498 microversion: 2.1 time: 0.572055 Oct 11 04:27:46.072846 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2016/3870] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:45 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1498 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:46.086618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-fb7f61e3-7dd5-4cb2-af75-a58078eab762 req-59880962-20fb-43ce-8fb9-fc0c9d35ab55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a432a0c5-728b-4bed-9bdc-1bba9b83ad92", "tag": "1c85ae89-a900-4857-b9a9-1cbd35b6d433"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:46.103863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb7f61e3-7dd5-4cb2-af75-a58078eab762 req-59880962-20fb-43ce-8fb9-fc0c9d35ab55 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:46.104302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb7f61e3-7dd5-4cb2-af75-a58078eab762 req-59880962-20fb-43ce-8fb9-fc0c9d35ab55 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:46.104740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb7f61e3-7dd5-4cb2-af75-a58078eab762 req-59880962-20fb-43ce-8fb9-fc0c9d35ab55 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:46.134877 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-fb7f61e3-7dd5-4cb2-af75-a58078eab762 req-59880962-20fb-43ce-8fb9-fc0c9d35ab55 service nova] Creating event network-changed:1c85ae89-a900-4857-b9a9-1cbd35b6d433 for instance a432a0c5-728b-4bed-9bdc-1bba9b83ad92 on n-h1-860892-1 Oct 11 04:27:46.147159 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-fb7f61e3-7dd5-4cb2-af75-a58078eab762 req-59880962-20fb-43ce-8fb9-fc0c9d35ab55 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070609 Oct 11 04:27:46.147846 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2017/3871] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:46.160520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8d4af0f6-cea4-4e49-9f93-7d5be1e705c2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:46.165034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8d4af0f6-cea4-4e49-9f93-7d5be1e705c2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:46.179636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d4af0f6-cea4-4e49-9f93-7d5be1e705c2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:46.180144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d4af0f6-cea4-4e49-9f93-7d5be1e705c2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:46.182777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d4af0f6-cea4-4e49-9f93-7d5be1e705c2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:46.187035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d4af0f6-cea4-4e49-9f93-7d5be1e705c2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:46.187821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d4af0f6-cea4-4e49-9f93-7d5be1e705c2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:46.188496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d4af0f6-cea4-4e49-9f93-7d5be1e705c2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:46.286579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:27:46.287066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:27:46.288682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:27:46.289713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:27:46.290170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:27:46.310228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:46.319679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:46.319679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:46.319679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:46.319679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:46.324080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:46.361117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8d4af0f6-cea4-4e49-9f93-7d5be1e705c2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:46.369429 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8d4af0f6-cea4-4e49-9f93-7d5be1e705c2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1169 microversion: 2.1 time: 0.220333 Oct 11 04:27:46.373854 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2018/3872] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:46 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1169 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:46.396028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-84ecd29c-f252-4b42-9a75-30dc27fdd0cb tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:46.396957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-84ecd29c-f252-4b42-9a75-30dc27fdd0cb tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:46.424404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84ecd29c-f252-4b42-9a75-30dc27fdd0cb tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:46.424904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84ecd29c-f252-4b42-9a75-30dc27fdd0cb tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:46.427577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for project 9a2974866e964ca2864c978d2270bd77. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:27:46.427783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84ecd29c-f252-4b42-9a75-30dc27fdd0cb tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:46.430534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84ecd29c-f252-4b42-9a75-30dc27fdd0cb tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:46.430534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84ecd29c-f252-4b42-9a75-30dc27fdd0cb tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:46.435765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84ecd29c-f252-4b42-9a75-30dc27fdd0cb tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:46.463047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for user 5feceb4a60434064a4fd08f7cc637f32 and project 9a2974866e964ca2864c978d2270bd77. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:27:46.525516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:27:46.533356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:27:46.665762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-84ecd29c-f252-4b42-9a75-30dc27fdd0cb tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:46.675996 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-84ecd29c-f252-4b42-9a75-30dc27fdd0cb tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1227 microversion: 2.1 time: 0.297503 Oct 11 04:27:46.684637 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2019/3873] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:46 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1227 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:46.700220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d7533c8-b443-4cf8-a9f3-02b15c013929 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:46.702862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d7533c8-b443-4cf8-a9f3-02b15c013929 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:46.736271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7533c8-b443-4cf8-a9f3-02b15c013929 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:46.737312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7533c8-b443-4cf8-a9f3-02b15c013929 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:46.738043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7533c8-b443-4cf8-a9f3-02b15c013929 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:46.745316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7533c8-b443-4cf8-a9f3-02b15c013929 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:46.760053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7533c8-b443-4cf8-a9f3-02b15c013929 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:46.760053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d7533c8-b443-4cf8-a9f3-02b15c013929 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:46.844057 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c911f218-2bec-4ebd-b764-d6897af0911a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.918393 Oct 11 04:27:46.845476 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1855/3874] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:27:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:27:46.875211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2587d96f-396e-4110-82ac-03e6c91f01f9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:46.883995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2587d96f-396e-4110-82ac-03e6c91f01f9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:47.019194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2587d96f-396e-4110-82ac-03e6c91f01f9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:47.057101 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2587d96f-396e-4110-82ac-03e6c91f01f9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1215 microversion: 2.1 time: 0.196429 Oct 11 04:27:47.068945 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1856/3875] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:46 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1215 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:47.225419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d7533c8-b443-4cf8-a9f3-02b15c013929 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:47.246642 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d7533c8-b443-4cf8-a9f3-02b15c013929 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 0.548290 Oct 11 04:27:47.247970 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2020/3876] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:46 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:47.403504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dca6d244-063d-4719-b298-3b4cbcff540e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:47.405009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dca6d244-063d-4719-b298-3b4cbcff540e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:47.418457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dca6d244-063d-4719-b298-3b4cbcff540e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:47.419391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dca6d244-063d-4719-b298-3b4cbcff540e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:47.420132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dca6d244-063d-4719-b298-3b4cbcff540e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:47.421112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dca6d244-063d-4719-b298-3b4cbcff540e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:47.421773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dca6d244-063d-4719-b298-3b4cbcff540e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:47.423037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dca6d244-063d-4719-b298-3b4cbcff540e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:47.620065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dca6d244-063d-4719-b298-3b4cbcff540e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:47.635835 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dca6d244-063d-4719-b298-3b4cbcff540e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1169 microversion: 2.1 time: 0.236168 Oct 11 04:27:47.652586 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1857/3877] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:47 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1169 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:47.703250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2ae08b9a-01f9-4fda-b4ec-f76ec00fea3a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:47.704808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2ae08b9a-01f9-4fda-b4ec-f76ec00fea3a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:47.719535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae08b9a-01f9-4fda-b4ec-f76ec00fea3a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:47.720987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae08b9a-01f9-4fda-b4ec-f76ec00fea3a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:47.720987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae08b9a-01f9-4fda-b4ec-f76ec00fea3a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:47.721826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae08b9a-01f9-4fda-b4ec-f76ec00fea3a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:47.722425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae08b9a-01f9-4fda-b4ec-f76ec00fea3a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:47.725223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae08b9a-01f9-4fda-b4ec-f76ec00fea3a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:47.771579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d288dc42-e350-42bf-bc70-a9e97be4222d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:47.775512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d288dc42-e350-42bf-bc70-a9e97be4222d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:47.788420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d288dc42-e350-42bf-bc70-a9e97be4222d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:47.788579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d288dc42-e350-42bf-bc70-a9e97be4222d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:47.796065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d288dc42-e350-42bf-bc70-a9e97be4222d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:47.804413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d288dc42-e350-42bf-bc70-a9e97be4222d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:47.806939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d288dc42-e350-42bf-bc70-a9e97be4222d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:47.807491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d288dc42-e350-42bf-bc70-a9e97be4222d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:47.945391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d288dc42-e350-42bf-bc70-a9e97be4222d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:27:48.034747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2ae08b9a-01f9-4fda-b4ec-f76ec00fea3a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:48.043240 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2ae08b9a-01f9-4fda-b4ec-f76ec00fea3a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1219 microversion: 2.1 time: 0.345065 Oct 11 04:27:48.050273 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2021/3878] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:47 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1219 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:48.093954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d2fea22a-64f5-4c81-9a6d-50b5bad0d808 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:48.098408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d2fea22a-64f5-4c81-9a6d-50b5bad0d808 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:48.220250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d2fea22a-64f5-4c81-9a6d-50b5bad0d808 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:48.227730 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d2fea22a-64f5-4c81-9a6d-50b5bad0d808 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1215 microversion: 2.1 time: 0.137929 Oct 11 04:27:48.232657 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2022/3879] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:48 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1215 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:48.247549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4c4a7e5d-d355-4a77-93ae-6110f48c7c50 req-fb1259f1-3916-4e25-bb79-d850394d90f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b708d397-9029-45e8-b850-b2b5d854c2a6", "tag": "ec12fc9f-0305-4044-a1df-ae112f798f7d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:48.268444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4c4a7e5d-d355-4a77-93ae-6110f48c7c50 req-fb1259f1-3916-4e25-bb79-d850394d90f5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:48.271785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4c4a7e5d-d355-4a77-93ae-6110f48c7c50 req-fb1259f1-3916-4e25-bb79-d850394d90f5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:48.272417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4c4a7e5d-d355-4a77-93ae-6110f48c7c50 req-fb1259f1-3916-4e25-bb79-d850394d90f5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:48.295584 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4c4a7e5d-d355-4a77-93ae-6110f48c7c50 req-fb1259f1-3916-4e25-bb79-d850394d90f5 service nova] Creating event network-changed:ec12fc9f-0305-4044-a1df-ae112f798f7d for instance b708d397-9029-45e8-b850-b2b5d854c2a6 on n-h1-860892-1 Oct 11 04:27:48.308180 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4c4a7e5d-d355-4a77-93ae-6110f48c7c50 req-fb1259f1-3916-4e25-bb79-d850394d90f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070624 Oct 11 04:27:48.311597 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2023/3880] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:48.325640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3729f8ee-01c9-49ee-a863-706624a7e4cc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:48.325640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3729f8ee-01c9-49ee-a863-706624a7e4cc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:48.336449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3729f8ee-01c9-49ee-a863-706624a7e4cc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:48.339051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3729f8ee-01c9-49ee-a863-706624a7e4cc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:48.339684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3729f8ee-01c9-49ee-a863-706624a7e4cc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:48.342100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3729f8ee-01c9-49ee-a863-706624a7e4cc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:48.348702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3729f8ee-01c9-49ee-a863-706624a7e4cc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:48.348702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3729f8ee-01c9-49ee-a863-706624a7e4cc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:48.555778 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d288dc42-e350-42bf-bc70-a9e97be4222d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 204 len: 0 microversion: 2.1 time: 0.791643 Oct 11 04:27:48.557630 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1858/3881] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:27:47 2022] DELETE /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 0 bytes in 794 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:27:48.574434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-76f1b5a6-791b-496c-a775-bf9c81e27193 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:48.575452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-76f1b5a6-791b-496c-a775-bf9c81e27193 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:48.610937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76f1b5a6-791b-496c-a775-bf9c81e27193 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:48.611822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76f1b5a6-791b-496c-a775-bf9c81e27193 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:48.612477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76f1b5a6-791b-496c-a775-bf9c81e27193 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:48.613534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76f1b5a6-791b-496c-a775-bf9c81e27193 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:48.614213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76f1b5a6-791b-496c-a775-bf9c81e27193 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:48.615609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76f1b5a6-791b-496c-a775-bf9c81e27193 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:48.624153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3729f8ee-01c9-49ee-a863-706624a7e4cc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:48.640182 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3729f8ee-01c9-49ee-a863-706624a7e4cc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 0.325304 Oct 11 04:27:48.643941 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2024/3882] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:48 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:48.662962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a36629dd-95ae-4f6c-a1a0-6f677e4d41fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:48.664641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a36629dd-95ae-4f6c-a1a0-6f677e4d41fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:48.681198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a36629dd-95ae-4f6c-a1a0-6f677e4d41fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:48.684472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a36629dd-95ae-4f6c-a1a0-6f677e4d41fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:48.686014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a36629dd-95ae-4f6c-a1a0-6f677e4d41fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:48.694225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a36629dd-95ae-4f6c-a1a0-6f677e4d41fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:48.696009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a36629dd-95ae-4f6c-a1a0-6f677e4d41fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:48.702213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a36629dd-95ae-4f6c-a1a0-6f677e4d41fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:49.037251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-76f1b5a6-791b-496c-a775-bf9c81e27193 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:49.046068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-76f1b5a6-791b-496c-a775-bf9c81e27193 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1504 microversion: 2.1 time: 0.484070 Oct 11 04:27:49.061122 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1859/3883] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:48 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1504 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:49.076822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-152515bc-9528-461e-bf46-32ec45911e0c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:49.077969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-152515bc-9528-461e-bf46-32ec45911e0c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:49.086667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-152515bc-9528-461e-bf46-32ec45911e0c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:49.087461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-152515bc-9528-461e-bf46-32ec45911e0c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:49.100889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-152515bc-9528-461e-bf46-32ec45911e0c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:49.107222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-152515bc-9528-461e-bf46-32ec45911e0c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:49.108586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-152515bc-9528-461e-bf46-32ec45911e0c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:49.111535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-152515bc-9528-461e-bf46-32ec45911e0c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:49.299244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-152515bc-9528-461e-bf46-32ec45911e0c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:49.314729 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-152515bc-9528-461e-bf46-32ec45911e0c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1219 microversion: 2.1 time: 0.242316 Oct 11 04:27:49.316451 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1860/3884] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:49 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1219 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:49.323086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-15679c00-eb43-4ae2-8cf5-4e34c8295421 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:49.324959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-15679c00-eb43-4ae2-8cf5-4e34c8295421 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:49.351894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15679c00-eb43-4ae2-8cf5-4e34c8295421 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:49.352665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15679c00-eb43-4ae2-8cf5-4e34c8295421 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:49.353293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15679c00-eb43-4ae2-8cf5-4e34c8295421 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:49.354380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15679c00-eb43-4ae2-8cf5-4e34c8295421 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:49.355205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15679c00-eb43-4ae2-8cf5-4e34c8295421 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:49.355878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15679c00-eb43-4ae2-8cf5-4e34c8295421 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:49.398339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a36629dd-95ae-4f6c-a1a0-6f677e4d41fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:49.410311 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a36629dd-95ae-4f6c-a1a0-6f677e4d41fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1211 microversion: 2.1 time: 0.753716 Oct 11 04:27:49.414482 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2025/3885] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:48 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1211 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:49.502993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-15679c00-eb43-4ae2-8cf5-4e34c8295421 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:49.515532 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-15679c00-eb43-4ae2-8cf5-4e34c8295421 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1219 microversion: 2.1 time: 0.197683 Oct 11 04:27:49.518857 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1861/3886] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:49 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1219 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:49.671766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-03b331a5-505d-48ff-8658-cc006fbc4119 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:49.672499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-03b331a5-505d-48ff-8658-cc006fbc4119 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:49.681504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03b331a5-505d-48ff-8658-cc006fbc4119 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:49.681992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03b331a5-505d-48ff-8658-cc006fbc4119 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:49.690832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03b331a5-505d-48ff-8658-cc006fbc4119 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:49.695590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03b331a5-505d-48ff-8658-cc006fbc4119 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:49.699073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03b331a5-505d-48ff-8658-cc006fbc4119 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:49.699752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03b331a5-505d-48ff-8658-cc006fbc4119 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:50.076353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae650d50-3be0-41b7-9cee-29a3a5d8b0cf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:50.076978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ae650d50-3be0-41b7-9cee-29a3a5d8b0cf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:50.089017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae650d50-3be0-41b7-9cee-29a3a5d8b0cf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:50.093196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae650d50-3be0-41b7-9cee-29a3a5d8b0cf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:50.093903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae650d50-3be0-41b7-9cee-29a3a5d8b0cf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:50.097678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae650d50-3be0-41b7-9cee-29a3a5d8b0cf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:50.100374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae650d50-3be0-41b7-9cee-29a3a5d8b0cf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:50.101385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae650d50-3be0-41b7-9cee-29a3a5d8b0cf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:50.554220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-03b331a5-505d-48ff-8658-cc006fbc4119 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:50.566022 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-03b331a5-505d-48ff-8658-cc006fbc4119 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 0.897776 Oct 11 04:27:50.580971 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2026/3887] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:49 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 909 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:50.593726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2958bebd-efbf-4b52-b25e-7eaab9f4dca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:50.595123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2958bebd-efbf-4b52-b25e-7eaab9f4dca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:50.605238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2958bebd-efbf-4b52-b25e-7eaab9f4dca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:50.605982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2958bebd-efbf-4b52-b25e-7eaab9f4dca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:50.606635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2958bebd-efbf-4b52-b25e-7eaab9f4dca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:50.607553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2958bebd-efbf-4b52-b25e-7eaab9f4dca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:50.608789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2958bebd-efbf-4b52-b25e-7eaab9f4dca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:50.609541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2958bebd-efbf-4b52-b25e-7eaab9f4dca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:50.776305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2958bebd-efbf-4b52-b25e-7eaab9f4dca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:50.792410 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2958bebd-efbf-4b52-b25e-7eaab9f4dca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1275 microversion: 2.1 time: 0.207796 Oct 11 04:27:50.793565 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2027/3888] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:50 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1275 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:50.809473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5636b25-2e79-4333-8919-afa183595ff5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:50.810692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c5636b25-2e79-4333-8919-afa183595ff5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:50.821333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5636b25-2e79-4333-8919-afa183595ff5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:50.822416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5636b25-2e79-4333-8919-afa183595ff5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:50.824005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5636b25-2e79-4333-8919-afa183595ff5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:50.825093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5636b25-2e79-4333-8919-afa183595ff5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:50.826117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5636b25-2e79-4333-8919-afa183595ff5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:50.826817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5636b25-2e79-4333-8919-afa183595ff5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:51.135584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ae650d50-3be0-41b7-9cee-29a3a5d8b0cf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:51.151118 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ae650d50-3be0-41b7-9cee-29a3a5d8b0cf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1504 microversion: 2.1 time: 1.078863 Oct 11 04:27:51.153213 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1862/3889] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:50 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1504 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:51.157190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1508c850-229f-4f77-9df5-c3e5c781a99a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:51.160834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1508c850-229f-4f77-9df5-c3e5c781a99a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:51.173573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1508c850-229f-4f77-9df5-c3e5c781a99a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:51.181309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1508c850-229f-4f77-9df5-c3e5c781a99a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:51.182155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1508c850-229f-4f77-9df5-c3e5c781a99a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:51.183280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1508c850-229f-4f77-9df5-c3e5c781a99a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:51.183945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1508c850-229f-4f77-9df5-c3e5c781a99a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:51.184543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1508c850-229f-4f77-9df5-c3e5c781a99a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:51.507071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1508c850-229f-4f77-9df5-c3e5c781a99a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:51.536201 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1508c850-229f-4f77-9df5-c3e5c781a99a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1267 microversion: 2.1 time: 0.381054 Oct 11 04:27:51.537328 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1863/3890] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:51 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1267 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:51.599726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-14c3356b-4e98-48f4-87ee-570291cddffc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:51.602974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-14c3356b-4e98-48f4-87ee-570291cddffc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:51.628347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14c3356b-4e98-48f4-87ee-570291cddffc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:51.629620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14c3356b-4e98-48f4-87ee-570291cddffc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:51.634264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14c3356b-4e98-48f4-87ee-570291cddffc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:51.636694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14c3356b-4e98-48f4-87ee-570291cddffc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:51.655562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14c3356b-4e98-48f4-87ee-570291cddffc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:51.656361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14c3356b-4e98-48f4-87ee-570291cddffc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:51.790005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5636b25-2e79-4333-8919-afa183595ff5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:51.802581 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c5636b25-2e79-4333-8919-afa183595ff5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1211 microversion: 2.1 time: 1.005056 Oct 11 04:27:51.803581 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2028/3891] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:50 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1211 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:51.832281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f8d6775a-3563-4a8c-9e8f-51f7a834cc37 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:51.835373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f8d6775a-3563-4a8c-9e8f-51f7a834cc37 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:51.848903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8d6775a-3563-4a8c-9e8f-51f7a834cc37 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:51.851263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8d6775a-3563-4a8c-9e8f-51f7a834cc37 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:51.851723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8d6775a-3563-4a8c-9e8f-51f7a834cc37 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:51.852455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8d6775a-3563-4a8c-9e8f-51f7a834cc37 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:51.852915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8d6775a-3563-4a8c-9e8f-51f7a834cc37 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:51.853345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8d6775a-3563-4a8c-9e8f-51f7a834cc37 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:52.130121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f8d6775a-3563-4a8c-9e8f-51f7a834cc37 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:52.147951 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f8d6775a-3563-4a8c-9e8f-51f7a834cc37 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1281 microversion: 2.1 time: 0.322643 Oct 11 04:27:52.151015 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2029/3892] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:51 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1281 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:52.157424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-080edfa3-82c4-4efa-b919-0eee7039f713 req-015c73e4-2e6a-41eb-931b-0bd2926346b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a432a0c5-728b-4bed-9bdc-1bba9b83ad92", "name": "network-vif-plugged", "status": "completed", "tag": "1c85ae89-a900-4857-b9a9-1cbd35b6d433"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:52.193786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-080edfa3-82c4-4efa-b919-0eee7039f713 req-015c73e4-2e6a-41eb-931b-0bd2926346b0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:52.195497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-080edfa3-82c4-4efa-b919-0eee7039f713 req-015c73e4-2e6a-41eb-931b-0bd2926346b0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:52.197757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-080edfa3-82c4-4efa-b919-0eee7039f713 req-015c73e4-2e6a-41eb-931b-0bd2926346b0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:52.218596 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-080edfa3-82c4-4efa-b919-0eee7039f713 req-015c73e4-2e6a-41eb-931b-0bd2926346b0 service nova] Creating event network-vif-plugged:1c85ae89-a900-4857-b9a9-1cbd35b6d433 for instance a432a0c5-728b-4bed-9bdc-1bba9b83ad92 on n-h1-860892-1 Oct 11 04:27:52.225618 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-080edfa3-82c4-4efa-b919-0eee7039f713 req-015c73e4-2e6a-41eb-931b-0bd2926346b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072599 Oct 11 04:27:52.226982 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2030/3893] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:52.233021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae5fb64e-736f-4b49-98e5-83f61c0c3abf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:52.234077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae5fb64e-736f-4b49-98e5-83f61c0c3abf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:52.244354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae5fb64e-736f-4b49-98e5-83f61c0c3abf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:52.245230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae5fb64e-736f-4b49-98e5-83f61c0c3abf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:52.246043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae5fb64e-736f-4b49-98e5-83f61c0c3abf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:52.247883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae5fb64e-736f-4b49-98e5-83f61c0c3abf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:52.248806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae5fb64e-736f-4b49-98e5-83f61c0c3abf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:52.249959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae5fb64e-736f-4b49-98e5-83f61c0c3abf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:52.671694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-14c3356b-4e98-48f4-87ee-570291cddffc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:52.684964 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-14c3356b-4e98-48f4-87ee-570291cddffc tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 1.094955 Oct 11 04:27:52.688756 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1864/3894] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:51 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:52.694135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fdbee295-1a14-42e3-acde-201f7b37f66c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:52.695089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fdbee295-1a14-42e3-acde-201f7b37f66c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:52.701369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbee295-1a14-42e3-acde-201f7b37f66c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:52.701857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbee295-1a14-42e3-acde-201f7b37f66c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:52.702321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbee295-1a14-42e3-acde-201f7b37f66c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:52.703019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbee295-1a14-42e3-acde-201f7b37f66c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:52.703496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbee295-1a14-42e3-acde-201f7b37f66c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:52.703920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdbee295-1a14-42e3-acde-201f7b37f66c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:52.709561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:52.910357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae5fb64e-736f-4b49-98e5-83f61c0c3abf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:52.926825 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae5fb64e-736f-4b49-98e5-83f61c0c3abf tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1504 microversion: 2.1 time: 0.696047 Oct 11 04:27:52.927591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fdbee295-1a14-42e3-acde-201f7b37f66c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:52.954566 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2031/3895] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:52 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1504 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:52.977917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9dde6ff8-f7b0-4dfd-95bc-1442b27e7d89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:52.982667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9dde6ff8-f7b0-4dfd-95bc-1442b27e7d89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:52.990239 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fdbee295-1a14-42e3-acde-201f7b37f66c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1285 microversion: 2.1 time: 0.298713 Oct 11 04:27:52.995106 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1865/3896] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:52 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1285 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:53.014179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:53.034157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dde6ff8-f7b0-4dfd-95bc-1442b27e7d89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:53.034371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-023f879e-f591-41d0-b41d-abc4df1bd298 req-1fc6a83f-df65-4528-acfc-bc6fe3046cb6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa836dc-900d-4ca8-9400-c7beb1739be1", "tag": "6bd011bd-c917-4d3c-93b6-c411b91b9a58"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:53.055547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dde6ff8-f7b0-4dfd-95bc-1442b27e7d89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:53.060459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dde6ff8-f7b0-4dfd-95bc-1442b27e7d89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:53.067089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dde6ff8-f7b0-4dfd-95bc-1442b27e7d89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:53.068516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dde6ff8-f7b0-4dfd-95bc-1442b27e7d89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:53.070923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dde6ff8-f7b0-4dfd-95bc-1442b27e7d89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:53.080698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-023f879e-f591-41d0-b41d-abc4df1bd298 req-1fc6a83f-df65-4528-acfc-bc6fe3046cb6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:53.081278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-023f879e-f591-41d0-b41d-abc4df1bd298 req-1fc6a83f-df65-4528-acfc-bc6fe3046cb6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:53.081715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-023f879e-f591-41d0-b41d-abc4df1bd298 req-1fc6a83f-df65-4528-acfc-bc6fe3046cb6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:53.099209 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-023f879e-f591-41d0-b41d-abc4df1bd298 req-1fc6a83f-df65-4528-acfc-bc6fe3046cb6 service nova] Creating event network-changed:6bd011bd-c917-4d3c-93b6-c411b91b9a58 for instance afa836dc-900d-4ca8-9400-c7beb1739be1 on n-h2-860892-1 Oct 11 04:27:53.115981 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-023f879e-f591-41d0-b41d-abc4df1bd298 req-1fc6a83f-df65-4528-acfc-bc6fe3046cb6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107773 Oct 11 04:27:53.116840 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1866/3897] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:53.176645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-48c10edf-fc53-4966-b0b5-5f69423e9623 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:53.177824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-48c10edf-fc53-4966-b0b5-5f69423e9623 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:53.199684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c10edf-fc53-4966-b0b5-5f69423e9623 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:53.200435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c10edf-fc53-4966-b0b5-5f69423e9623 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:53.201080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c10edf-fc53-4966-b0b5-5f69423e9623 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:53.201998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c10edf-fc53-4966-b0b5-5f69423e9623 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:53.202672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c10edf-fc53-4966-b0b5-5f69423e9623 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:53.203989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c10edf-fc53-4966-b0b5-5f69423e9623 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:53.410110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48c10edf-fc53-4966-b0b5-5f69423e9623 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:53.422032 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-48c10edf-fc53-4966-b0b5-5f69423e9623 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1281 microversion: 2.1 time: 0.250238 Oct 11 04:27:53.430818 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1867/3898] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:53 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1281 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:53.593963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9dde6ff8-f7b0-4dfd-95bc-1442b27e7d89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:53.604196 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9dde6ff8-f7b0-4dfd-95bc-1442b27e7d89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1211 microversion: 2.1 time: 0.646359 Oct 11 04:27:53.604196 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2032/3899] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:52 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1211 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:53.709924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0e4eca37-03cc-4d5f-ad8b-e68311dd20b1 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:53.712286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0e4eca37-03cc-4d5f-ad8b-e68311dd20b1 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:53.738348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7a44c7ee-b344-4a52-8f27-c33d0445d77d req-7bae8269-4409-4f39-8fac-e59b1516e7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d074edb8-863b-48c6-900d-2bcc2c5e23f6", "tag": "6dfb7c11-7d5b-4133-91e0-e0fd02dad6c6"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:53.742686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e4eca37-03cc-4d5f-ad8b-e68311dd20b1 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:53.751530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e4eca37-03cc-4d5f-ad8b-e68311dd20b1 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:53.751530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e4eca37-03cc-4d5f-ad8b-e68311dd20b1 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:53.751530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e4eca37-03cc-4d5f-ad8b-e68311dd20b1 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:53.751530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e4eca37-03cc-4d5f-ad8b-e68311dd20b1 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:53.751530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e4eca37-03cc-4d5f-ad8b-e68311dd20b1 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:53.758478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7a44c7ee-b344-4a52-8f27-c33d0445d77d req-7bae8269-4409-4f39-8fac-e59b1516e7d3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:53.761029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7a44c7ee-b344-4a52-8f27-c33d0445d77d req-7bae8269-4409-4f39-8fac-e59b1516e7d3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:53.761706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7a44c7ee-b344-4a52-8f27-c33d0445d77d req-7bae8269-4409-4f39-8fac-e59b1516e7d3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:53.805239 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7a44c7ee-b344-4a52-8f27-c33d0445d77d req-7bae8269-4409-4f39-8fac-e59b1516e7d3 service nova] Creating event network-changed:6dfb7c11-7d5b-4133-91e0-e0fd02dad6c6 for instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 on n-h2-860892-1 Oct 11 04:27:53.820445 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7a44c7ee-b344-4a52-8f27-c33d0445d77d req-7bae8269-4409-4f39-8fac-e59b1516e7d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086905 Oct 11 04:27:53.821060 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2033/3900] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:27:53.956590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:53.958022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:53.981338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:53.981338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:53.981338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:53.981615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:53.982065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:53.982797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:54.039789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:54.040616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:54.041684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:54.042365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lazy-loading 'fault' on Instance uuid 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:27:54.260389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:54.270586 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-81ff21a0-b936-44c7-b537-bb63e6475f82 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1303 microversion: 2.1 time: 0.319985 Oct 11 04:27:54.271056 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2034/3901] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:53 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1303 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:54.286159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-52765e3b-1039-45b0-be5d-b1a8973b5151 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:54.287104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-52765e3b-1039-45b0-be5d-b1a8973b5151 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:54.298475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52765e3b-1039-45b0-be5d-b1a8973b5151 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:54.304323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52765e3b-1039-45b0-be5d-b1a8973b5151 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:54.305152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52765e3b-1039-45b0-be5d-b1a8973b5151 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:54.308208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52765e3b-1039-45b0-be5d-b1a8973b5151 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:54.309745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52765e3b-1039-45b0-be5d-b1a8973b5151 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:54.310996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52765e3b-1039-45b0-be5d-b1a8973b5151 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:54.498360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-52765e3b-1039-45b0-be5d-b1a8973b5151 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:54.513943 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-52765e3b-1039-45b0-be5d-b1a8973b5151 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1273 microversion: 2.1 time: 0.240291 Oct 11 04:27:54.515256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0e4eca37-03cc-4d5f-ad8b-e68311dd20b1 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:54.530168 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2035/3902] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:54 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1273 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:54.531041 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0e4eca37-03cc-4d5f-ad8b-e68311dd20b1 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 0.822543 Oct 11 04:27:54.547891 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1868/3903] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:53 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:54.550220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c77953f5-f452-4c8f-ae1d-6a8010809a41 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:54.551497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c77953f5-f452-4c8f-ae1d-6a8010809a41 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:54.561787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c77953f5-f452-4c8f-ae1d-6a8010809a41 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:54.562330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c77953f5-f452-4c8f-ae1d-6a8010809a41 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:54.562862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c77953f5-f452-4c8f-ae1d-6a8010809a41 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:54.563569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c77953f5-f452-4c8f-ae1d-6a8010809a41 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:54.564334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c77953f5-f452-4c8f-ae1d-6a8010809a41 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:54.565614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c77953f5-f452-4c8f-ae1d-6a8010809a41 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:54.626238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a255b01-16fb-48f6-b81c-ad41725d9a61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:54.627218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9a255b01-16fb-48f6-b81c-ad41725d9a61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:54.635108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a255b01-16fb-48f6-b81c-ad41725d9a61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:54.635818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a255b01-16fb-48f6-b81c-ad41725d9a61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:54.638401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a255b01-16fb-48f6-b81c-ad41725d9a61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:54.638401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a255b01-16fb-48f6-b81c-ad41725d9a61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:54.638401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a255b01-16fb-48f6-b81c-ad41725d9a61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:54.638401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a255b01-16fb-48f6-b81c-ad41725d9a61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:54.639813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c77953f5-f452-4c8f-ae1d-6a8010809a41 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:54.644116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:54.649391 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c77953f5-f452-4c8f-ae1d-6a8010809a41 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1281 microversion: 2.1 time: 0.104435 Oct 11 04:27:54.650702 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2036/3904] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:54 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1281 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:55.079277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9a255b01-16fb-48f6-b81c-ad41725d9a61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:55.097880 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9a255b01-16fb-48f6-b81c-ad41725d9a61 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1211 microversion: 2.1 time: 0.475909 Oct 11 04:27:55.098844 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1869/3905] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:54 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1211 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:55.160060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-ad4eb1cc-40bb-4276-b998-56c92940709b req-fc3b4654-3f36-4daf-a6d3-3804639dc94b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4963ffd2-05a2-4bfe-9e61-fb4b1ea63381", "name": "network-vif-deleted", "tag": "2a3021c1-375c-4cc9-9441-24a6f8f67d3d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:55.176337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ad4eb1cc-40bb-4276-b998-56c92940709b req-fc3b4654-3f36-4daf-a6d3-3804639dc94b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:55.176817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ad4eb1cc-40bb-4276-b998-56c92940709b req-fc3b4654-3f36-4daf-a6d3-3804639dc94b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:55.177259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ad4eb1cc-40bb-4276-b998-56c92940709b req-fc3b4654-3f36-4daf-a6d3-3804639dc94b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:55.236407 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-ad4eb1cc-40bb-4276-b998-56c92940709b req-fc3b4654-3f36-4daf-a6d3-3804639dc94b service nova] Creating event network-vif-deleted:2a3021c1-375c-4cc9-9441-24a6f8f67d3d for instance 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 on n-h2-860892-1 Oct 11 04:27:55.247226 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-ad4eb1cc-40bb-4276-b998-56c92940709b req-fc3b4654-3f36-4daf-a6d3-3804639dc94b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089241 Oct 11 04:27:55.250000 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2037/3906] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:55.296259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:55.296873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:55.304239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:55.305115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:55.305932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:55.307270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:55.307961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:55.309143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:55.442980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:55.443511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:55.444132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:55.444599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lazy-loading 'fault' on Instance uuid 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:27:55.490689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:55.497929 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-95ac7d66-123f-4287-a289-f3c85b27d3d0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 200 len: 1303 microversion: 2.1 time: 0.205500 Oct 11 04:27:55.504521 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1870/3907] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:55 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 1303 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:55.558465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-138996b0-2bdf-49b8-b034-e7b2419a1aeb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:55.559793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-138996b0-2bdf-49b8-b034-e7b2419a1aeb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:55.562219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c093049-94b9-4934-aa35-bddfb39c31d0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:55.563587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c093049-94b9-4934-aa35-bddfb39c31d0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:55.568918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-138996b0-2bdf-49b8-b034-e7b2419a1aeb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:55.569706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-138996b0-2bdf-49b8-b034-e7b2419a1aeb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:55.570774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-138996b0-2bdf-49b8-b034-e7b2419a1aeb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:55.574132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-138996b0-2bdf-49b8-b034-e7b2419a1aeb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:55.574132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-138996b0-2bdf-49b8-b034-e7b2419a1aeb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:55.574132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-138996b0-2bdf-49b8-b034-e7b2419a1aeb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:55.574486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c093049-94b9-4934-aa35-bddfb39c31d0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:55.574486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c093049-94b9-4934-aa35-bddfb39c31d0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:55.574748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c093049-94b9-4934-aa35-bddfb39c31d0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:55.575772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c093049-94b9-4934-aa35-bddfb39c31d0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:55.576776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c093049-94b9-4934-aa35-bddfb39c31d0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:55.577439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c093049-94b9-4934-aa35-bddfb39c31d0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:55.915896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-138996b0-2bdf-49b8-b034-e7b2419a1aeb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:55.944794 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-138996b0-2bdf-49b8-b034-e7b2419a1aeb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1315 microversion: 2.1 time: 0.399242 Oct 11 04:27:55.950183 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2038/3908] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:55 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1315 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:55.958824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2bcceaf1-fe4a-487d-aaa1-c1dc768e255f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:55.959736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2bcceaf1-fe4a-487d-aaa1-c1dc768e255f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:55.985026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bcceaf1-fe4a-487d-aaa1-c1dc768e255f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:55.992689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bcceaf1-fe4a-487d-aaa1-c1dc768e255f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:55.994902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bcceaf1-fe4a-487d-aaa1-c1dc768e255f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:55.995733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bcceaf1-fe4a-487d-aaa1-c1dc768e255f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:55.996235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bcceaf1-fe4a-487d-aaa1-c1dc768e255f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:55.998756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2bcceaf1-fe4a-487d-aaa1-c1dc768e255f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:56.337216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8c093049-94b9-4934-aa35-bddfb39c31d0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:56.351703 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8c093049-94b9-4934-aa35-bddfb39c31d0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 0.804107 Oct 11 04:27:56.353461 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1871/3909] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:55 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:56.360505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-05b8c96f-545b-4dfd-8a5a-2596b670ff9d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:56.361591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-05b8c96f-545b-4dfd-8a5a-2596b670ff9d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:56.369520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b8c96f-545b-4dfd-8a5a-2596b670ff9d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:56.370141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b8c96f-545b-4dfd-8a5a-2596b670ff9d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:56.373305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b8c96f-545b-4dfd-8a5a-2596b670ff9d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:56.373305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b8c96f-545b-4dfd-8a5a-2596b670ff9d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:56.373305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b8c96f-545b-4dfd-8a5a-2596b670ff9d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:56.373305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05b8c96f-545b-4dfd-8a5a-2596b670ff9d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:56.378638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:56.722502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2bcceaf1-fe4a-487d-aaa1-c1dc768e255f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:56.730376 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2bcceaf1-fe4a-487d-aaa1-c1dc768e255f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.778520 Oct 11 04:27:56.730967 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2039/3910] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:55 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:56.736144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:56.739466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:56.743526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:56.744258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:56.744902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:56.745784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:56.746591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:56.747189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:56.762052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-05b8c96f-545b-4dfd-8a5a-2596b670ff9d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:56.762950 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] HTTP exception thrown: Instance 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 could not be found. Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Request method failure captured: Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 HTTP/1.1 Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPCpw9wY9e30ASADfizvuXAXtCwLBbFUsEjbTW8F_VLxzIK3PeptnObYOedb8p4GYLZSaefVnuvOw47vBGNEE9eeuw_5UsjOLybeRsuSvVXWzkOq_m6oLjYIDdBBMREe00kTe-dpzva-zuEIe-zKA6TcMkpDVd1mDCQxin1FcyQvO-A Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f816ed1b873b40bc93b3be8e0052fa88 Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesActionsTest-1876816740 Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f816ed1b873b40bc93b3be8e0052fa88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f816ed1b873b40bc93b3be8e0052fa88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f816ed1b873b40bc93b3be8e0052fa88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f816ed1b873b40bc93b3be8e0052fa88"}]}] Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesActionsTest-1876816740 Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f816ed1b873b40bc93b3be8e0052fa88 Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesActionsTest-1876816740 Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesActionsTest-1876816740-project Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 15dbde05c5c5421e83eb7a60df664d42 Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesActionsTest-1876816740-project Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 could not be found. Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '4963ffd2-05a2-4bfe-9e61-fb4b1ea63381'} Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 could not be found. Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 could not be found. Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:27:56.764834 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:56.771066 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:27:56.771066 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:27:56.771066 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:27:56.771066 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:27:56.771066 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:27:56.771066 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 could not be found. Oct 11 04:27:56.771066 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:27:56.773442 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-05b8c96f-545b-4dfd-8a5a-2596b670ff9d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.418584 Oct 11 04:27:56.773880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Returning 404 to user: Instance 4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:27:56.782401 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1872/3911] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:56 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:56.782607 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6f8262c5-ae8c-4d50-b42b-20cc4acc45de tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381" status: 404 len: 111 microversion: 2.1 time: 0.042800 Oct 11 04:27:56.782607 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2040/3912] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:56 2022] GET /compute/v2.1/servers/4963ffd2-05a2-4bfe-9e61-fb4b1ea63381 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:27:56.926527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2137869903", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "c146bcf5-b2a0-463b-a5c5-204d05f26cb1"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:56.970522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4347bf79-3534-4f32-8726-dd39e88e9776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:56.971030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4347bf79-3534-4f32-8726-dd39e88e9776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:56.981400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4347bf79-3534-4f32-8726-dd39e88e9776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:56.984002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4347bf79-3534-4f32-8726-dd39e88e9776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:56.984002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4347bf79-3534-4f32-8726-dd39e88e9776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:56.985454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4347bf79-3534-4f32-8726-dd39e88e9776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:56.991288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4347bf79-3534-4f32-8726-dd39e88e9776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:56.991795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4347bf79-3534-4f32-8726-dd39e88e9776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:57.006927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] validate_networks() for [('c146bcf5-b2a0-463b-a5c5-204d05f26cb1', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:27:57.045386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=9 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:57.231963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4347bf79-3534-4f32-8726-dd39e88e9776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:57.240970 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4347bf79-3534-4f32-8726-dd39e88e9776 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1315 microversion: 2.1 time: 0.274501 Oct 11 04:27:57.243821 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2041/3913] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:56 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:57.376776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef30a4d6-9919-4a89-8c4c-68c18c5d920f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:57.377664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef30a4d6-9919-4a89-8c4c-68c18c5d920f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:57.385968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef30a4d6-9919-4a89-8c4c-68c18c5d920f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:57.386820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef30a4d6-9919-4a89-8c4c-68c18c5d920f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:57.387431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef30a4d6-9919-4a89-8c4c-68c18c5d920f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:57.388324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef30a4d6-9919-4a89-8c4c-68c18c5d920f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:57.388931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef30a4d6-9919-4a89-8c4c-68c18c5d920f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:57.389655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef30a4d6-9919-4a89-8c4c-68c18c5d920f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:57.703213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef30a4d6-9919-4a89-8c4c-68c18c5d920f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:57.711586 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef30a4d6-9919-4a89-8c4c-68c18c5d920f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 0.339101 Oct 11 04:27:57.730138 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2042/3914] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:57 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:57.741593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2d9ba481-2eb6-4980-877a-9f4cd29a5eb7 req-e444074f-7256-4622-b72b-e378fbc52ef8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fafb331-19af-4936-a405-cbf6020defba", "tag": "cfdd334c-b535-4947-b6cf-d889e066625f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:57.764583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2d9ba481-2eb6-4980-877a-9f4cd29a5eb7 req-e444074f-7256-4622-b72b-e378fbc52ef8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:57.765072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2d9ba481-2eb6-4980-877a-9f4cd29a5eb7 req-e444074f-7256-4622-b72b-e378fbc52ef8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:57.765508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2d9ba481-2eb6-4980-877a-9f4cd29a5eb7 req-e444074f-7256-4622-b72b-e378fbc52ef8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:57.790412 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2d9ba481-2eb6-4980-877a-9f4cd29a5eb7 req-e444074f-7256-4622-b72b-e378fbc52ef8 service nova] Creating event network-changed:cfdd334c-b535-4947-b6cf-d889e066625f for instance 3fafb331-19af-4936-a405-cbf6020defba on n-h1-860892-1 Oct 11 04:27:57.797655 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2d9ba481-2eb6-4980-877a-9f4cd29a5eb7 req-e444074f-7256-4622-b72b-e378fbc52ef8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066042 Oct 11 04:27:57.798951 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2043/3915] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:57.806932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b3c7bf3e-82da-4362-8399-30d52b05ba82 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:57.813419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b3c7bf3e-82da-4362-8399-30d52b05ba82 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:57.815952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3c7bf3e-82da-4362-8399-30d52b05ba82 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:57.816782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3c7bf3e-82da-4362-8399-30d52b05ba82 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:57.818439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3c7bf3e-82da-4362-8399-30d52b05ba82 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:57.821389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3c7bf3e-82da-4362-8399-30d52b05ba82 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:57.822888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3c7bf3e-82da-4362-8399-30d52b05ba82 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:57.823663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3c7bf3e-82da-4362-8399-30d52b05ba82 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:58.217387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b3c7bf3e-82da-4362-8399-30d52b05ba82 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:58.232462 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b3c7bf3e-82da-4362-8399-30d52b05ba82 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.431925 Oct 11 04:27:58.234109 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2044/3916] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:57 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:58.243981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-edd514b3-71c6-4235-a231-efae0dc66078 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:58.244803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-edd514b3-71c6-4235-a231-efae0dc66078 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:58.264982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=22 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:27:58.271556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edd514b3-71c6-4235-a231-efae0dc66078 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:58.271688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edd514b3-71c6-4235-a231-efae0dc66078 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:58.272142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edd514b3-71c6-4235-a231-efae0dc66078 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:58.275645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edd514b3-71c6-4235-a231-efae0dc66078 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:58.276165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edd514b3-71c6-4235-a231-efae0dc66078 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:58.276619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edd514b3-71c6-4235-a231-efae0dc66078 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:58.478920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:27:58.480299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:27:58.481013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:27:58.482117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:27:58.482825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:27:58.495877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:58.496059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-edd514b3-71c6-4235-a231-efae0dc66078 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:58.496816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:58.498354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:58.499331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:58.500038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:58.501066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:58.511319 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-edd514b3-71c6-4235-a231-efae0dc66078 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.274557 Oct 11 04:27:58.522328 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2045/3917] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:58 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:58.522328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-39409851-aa97-4c4c-a3ba-1fd1e3ddff3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:58.522328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-39409851-aa97-4c4c-a3ba-1fd1e3ddff3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:58.532362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39409851-aa97-4c4c-a3ba-1fd1e3ddff3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:58.532362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39409851-aa97-4c4c-a3ba-1fd1e3ddff3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:58.532362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39409851-aa97-4c4c-a3ba-1fd1e3ddff3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:58.532362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39409851-aa97-4c4c-a3ba-1fd1e3ddff3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:58.532362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39409851-aa97-4c4c-a3ba-1fd1e3ddff3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:58.532362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39409851-aa97-4c4c-a3ba-1fd1e3ddff3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:58.556655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Getting quotas for project f816ed1b873b40bc93b3be8e0052fa88. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:27:58.570900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Getting quotas for user 15dbde05c5c5421e83eb7a60df664d42 and project f816ed1b873b40bc93b3be8e0052fa88. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:27:58.609853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:27:58.612702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:27:58.747186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39409851-aa97-4c4c-a3ba-1fd1e3ddff3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:58.757714 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-39409851-aa97-4c4c-a3ba-1fd1e3ddff3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1315 microversion: 2.1 time: 0.243117 Oct 11 04:27:58.771221 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2046/3918] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:58 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:58.771221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f0630f4a-2993-4e8d-9222-cac6b1fe59eb req-15f61e34-3a48-40ef-9af3-9db50670282f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2314117-db3f-476d-a14a-345f2feb9366", "tag": "9d46b09c-5fc6-4a6e-ab74-4ceae2e21015"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:27:58.776169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f0630f4a-2993-4e8d-9222-cac6b1fe59eb req-15f61e34-3a48-40ef-9af3-9db50670282f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:58.778044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f0630f4a-2993-4e8d-9222-cac6b1fe59eb req-15f61e34-3a48-40ef-9af3-9db50670282f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:58.778044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f0630f4a-2993-4e8d-9222-cac6b1fe59eb req-15f61e34-3a48-40ef-9af3-9db50670282f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:58.811463 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-f0630f4a-2993-4e8d-9222-cac6b1fe59eb req-15f61e34-3a48-40ef-9af3-9db50670282f service nova] Creating event network-changed:9d46b09c-5fc6-4a6e-ab74-4ceae2e21015 for instance a2314117-db3f-476d-a14a-345f2feb9366 on n-h1-860892-1 Oct 11 04:27:58.827128 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f0630f4a-2993-4e8d-9222-cac6b1fe59eb req-15f61e34-3a48-40ef-9af3-9db50670282f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066442 Oct 11 04:27:58.828945 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2047/3919] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:27:58.837486 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-563ad4e5-ecf6-451e-a701-7ff93f32af84 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.913192 Oct 11 04:27:58.839099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e374b64f-9085-4984-8309-dba67b41b78e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:58.841834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e374b64f-9085-4984-8309-dba67b41b78e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:58.847566 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1873/3920] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:27:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1927 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:27:58.856614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e374b64f-9085-4984-8309-dba67b41b78e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:58.857363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e374b64f-9085-4984-8309-dba67b41b78e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:58.858415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e374b64f-9085-4984-8309-dba67b41b78e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:58.859381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e374b64f-9085-4984-8309-dba67b41b78e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:58.860131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e374b64f-9085-4984-8309-dba67b41b78e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:58.860877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e374b64f-9085-4984-8309-dba67b41b78e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:58.863890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41adb38f-5d8d-4d41-bf40-8f7da4bf28bd tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:58.867803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-41adb38f-5d8d-4d41-bf40-8f7da4bf28bd tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:59.037177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e374b64f-9085-4984-8309-dba67b41b78e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:59.052295 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e374b64f-9085-4984-8309-dba67b41b78e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 0.218337 Oct 11 04:27:59.052881 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2048/3921] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:58 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:59.076331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-41adb38f-5d8d-4d41-bf40-8f7da4bf28bd tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:59.088366 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41adb38f-5d8d-4d41-bf40-8f7da4bf28bd tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1214 microversion: 2.1 time: 0.239348 Oct 11 04:27:59.089038 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1874/3922] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:58 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1214 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:27:59.268372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8f45eb2b-0f29-4961-9553-926022414519 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:59.269373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8f45eb2b-0f29-4961-9553-926022414519 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:59.281262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f45eb2b-0f29-4961-9553-926022414519 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:59.287016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f45eb2b-0f29-4961-9553-926022414519 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:59.290289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f45eb2b-0f29-4961-9553-926022414519 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:59.290683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f45eb2b-0f29-4961-9553-926022414519 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:59.292312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f45eb2b-0f29-4961-9553-926022414519 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:59.292879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f45eb2b-0f29-4961-9553-926022414519 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:59.474697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8f45eb2b-0f29-4961-9553-926022414519 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:59.488473 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8f45eb2b-0f29-4961-9553-926022414519 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.229885 Oct 11 04:27:59.488473 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2049/3923] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:59 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:27:59.539607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce068036-3c48-4044-9cf8-6ab66c0bd46f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:59.540218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce068036-3c48-4044-9cf8-6ab66c0bd46f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:59.550564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce068036-3c48-4044-9cf8-6ab66c0bd46f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:59.550991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce068036-3c48-4044-9cf8-6ab66c0bd46f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:59.551623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce068036-3c48-4044-9cf8-6ab66c0bd46f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:59.552345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce068036-3c48-4044-9cf8-6ab66c0bd46f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:59.553013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce068036-3c48-4044-9cf8-6ab66c0bd46f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:59.564346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce068036-3c48-4044-9cf8-6ab66c0bd46f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:59.788209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04d117ce-ca4b-49a6-a764-cba501126d59 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:27:59.788918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-04d117ce-ca4b-49a6-a764-cba501126d59 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:27:59.802656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d117ce-ca4b-49a6-a764-cba501126d59 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:59.804166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d117ce-ca4b-49a6-a764-cba501126d59 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:59.809987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d117ce-ca4b-49a6-a764-cba501126d59 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:59.811065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d117ce-ca4b-49a6-a764-cba501126d59 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:27:59.811757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d117ce-ca4b-49a6-a764-cba501126d59 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:27:59.812405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d117ce-ca4b-49a6-a764-cba501126d59 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:27:59.834493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce068036-3c48-4044-9cf8-6ab66c0bd46f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:27:59.843547 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce068036-3c48-4044-9cf8-6ab66c0bd46f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.307709 Oct 11 04:27:59.845933 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1875/3924] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:59 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:00.016355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-04d117ce-ca4b-49a6-a764-cba501126d59 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:00.024238 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04d117ce-ca4b-49a6-a764-cba501126d59 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1315 microversion: 2.1 time: 0.243344 Oct 11 04:28:00.025102 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2050/3925] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:27:59 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:00.091763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-24df60be-9a6b-424c-91f1-4de6ee640698 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:00.093208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-24df60be-9a6b-424c-91f1-4de6ee640698 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:00.102076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24df60be-9a6b-424c-91f1-4de6ee640698 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:00.103027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24df60be-9a6b-424c-91f1-4de6ee640698 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:00.103732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24df60be-9a6b-424c-91f1-4de6ee640698 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:00.106325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24df60be-9a6b-424c-91f1-4de6ee640698 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:00.107187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24df60be-9a6b-424c-91f1-4de6ee640698 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:00.108034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24df60be-9a6b-424c-91f1-4de6ee640698 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:00.110017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f6d94181-21c8-467e-940b-b2e087c7670b req-e144a83d-f1a5-4171-a8cf-58e1cd03ad3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b708d397-9029-45e8-b850-b2b5d854c2a6", "name": "network-vif-plugged", "status": "completed", "tag": "ec12fc9f-0305-4044-a1df-ae112f798f7d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:00.127534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f6d94181-21c8-467e-940b-b2e087c7670b req-e144a83d-f1a5-4171-a8cf-58e1cd03ad3f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:00.128708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f6d94181-21c8-467e-940b-b2e087c7670b req-e144a83d-f1a5-4171-a8cf-58e1cd03ad3f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:00.129161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f6d94181-21c8-467e-940b-b2e087c7670b req-e144a83d-f1a5-4171-a8cf-58e1cd03ad3f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:00.145975 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-f6d94181-21c8-467e-940b-b2e087c7670b req-e144a83d-f1a5-4171-a8cf-58e1cd03ad3f service nova] Creating event network-vif-plugged:ec12fc9f-0305-4044-a1df-ae112f798f7d for instance b708d397-9029-45e8-b850-b2b5d854c2a6 on n-h1-860892-1 Oct 11 04:28:00.150779 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f6d94181-21c8-467e-940b-b2e087c7670b req-e144a83d-f1a5-4171-a8cf-58e1cd03ad3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054111 Oct 11 04:28:00.151394 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2051/3926] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:00.156735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8cfdd45d-21fd-49ba-8b5f-b86ea84608f0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:00.157438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8cfdd45d-21fd-49ba-8b5f-b86ea84608f0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:00.160466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:00.164626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cfdd45d-21fd-49ba-8b5f-b86ea84608f0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:00.165116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cfdd45d-21fd-49ba-8b5f-b86ea84608f0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:00.165555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cfdd45d-21fd-49ba-8b5f-b86ea84608f0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:00.166287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cfdd45d-21fd-49ba-8b5f-b86ea84608f0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:00.166747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cfdd45d-21fd-49ba-8b5f-b86ea84608f0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:00.167174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cfdd45d-21fd-49ba-8b5f-b86ea84608f0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:00.269644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8cfdd45d-21fd-49ba-8b5f-b86ea84608f0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:00.279286 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8cfdd45d-21fd-49ba-8b5f-b86ea84608f0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1218 microversion: 2.1 time: 0.126564 Oct 11 04:28:00.279900 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2052/3927] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:00 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:00.348549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-24df60be-9a6b-424c-91f1-4de6ee640698 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:00.356335 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-24df60be-9a6b-424c-91f1-4de6ee640698 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 0.280393 Oct 11 04:28:00.356909 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1876/3928] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:00 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:00.509760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d89e1532-d487-428f-884b-2f37fe78754f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:00.510214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d89e1532-d487-428f-884b-2f37fe78754f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:00.516898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1532-d487-428f-884b-2f37fe78754f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:00.517391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1532-d487-428f-884b-2f37fe78754f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:00.517834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1532-d487-428f-884b-2f37fe78754f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:00.518564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1532-d487-428f-884b-2f37fe78754f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:00.519021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1532-d487-428f-884b-2f37fe78754f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:00.519447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89e1532-d487-428f-884b-2f37fe78754f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:00.817742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d89e1532-d487-428f-884b-2f37fe78754f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:00.827678 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d89e1532-d487-428f-884b-2f37fe78754f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.322255 Oct 11 04:28:00.828818 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2053/3929] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:00 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:00.884628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-89a5d7a2-0e5c-4a08-994f-8bfc481e1fad tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:00.888044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-89a5d7a2-0e5c-4a08-994f-8bfc481e1fad tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:00.893006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c3829627-83c4-4efc-9b44-bc0872a70943 req-fa5f5acd-3d6c-4d14-a20d-b33153422f28 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98213491-b0bf-4bbb-aa2f-3399f13caa8a", "tag": "fa93e5a6-3e57-4071-9fa9-bd845e54bd0a"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:00.913369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c3829627-83c4-4efc-9b44-bc0872a70943 req-fa5f5acd-3d6c-4d14-a20d-b33153422f28 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:00.913866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c3829627-83c4-4efc-9b44-bc0872a70943 req-fa5f5acd-3d6c-4d14-a20d-b33153422f28 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:00.916816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-0e5c-4a08-994f-8bfc481e1fad tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:00.916994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c3829627-83c4-4efc-9b44-bc0872a70943 req-fa5f5acd-3d6c-4d14-a20d-b33153422f28 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:00.918460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-0e5c-4a08-994f-8bfc481e1fad tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:00.920083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-0e5c-4a08-994f-8bfc481e1fad tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:00.924287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-0e5c-4a08-994f-8bfc481e1fad tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:00.925040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-0e5c-4a08-994f-8bfc481e1fad tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:00.925680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-89a5d7a2-0e5c-4a08-994f-8bfc481e1fad tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:00.950539 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c3829627-83c4-4efc-9b44-bc0872a70943 req-fa5f5acd-3d6c-4d14-a20d-b33153422f28 service nova] Creating event network-changed:fa93e5a6-3e57-4071-9fa9-bd845e54bd0a for instance 98213491-b0bf-4bbb-aa2f-3399f13caa8a on n-h1-860892-1 Oct 11 04:28:00.956242 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c3829627-83c4-4efc-9b44-bc0872a70943 req-fa5f5acd-3d6c-4d14-a20d-b33153422f28 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067405 Oct 11 04:28:00.957979 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2054/3930] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:28:01.050708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c527344c-73b4-4c36-a263-b470dbb2c827 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:01.051667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c527344c-73b4-4c36-a263-b470dbb2c827 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:01.061894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c527344c-73b4-4c36-a263-b470dbb2c827 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:01.063317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c527344c-73b4-4c36-a263-b470dbb2c827 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:01.066822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c527344c-73b4-4c36-a263-b470dbb2c827 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:01.068088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c527344c-73b4-4c36-a263-b470dbb2c827 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:01.068577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c527344c-73b4-4c36-a263-b470dbb2c827 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:01.069279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c527344c-73b4-4c36-a263-b470dbb2c827 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:01.373816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c527344c-73b4-4c36-a263-b470dbb2c827 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:01.384356 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c527344c-73b4-4c36-a263-b470dbb2c827 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1315 microversion: 2.1 time: 0.338677 Oct 11 04:28:01.398672 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2055/3931] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:01 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:01.401947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5b1459f5-91f2-403e-ab6e-01e83ecf76fb tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:01.402609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5b1459f5-91f2-403e-ab6e-01e83ecf76fb tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:01.409551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1459f5-91f2-403e-ab6e-01e83ecf76fb tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:01.410316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1459f5-91f2-403e-ab6e-01e83ecf76fb tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:01.410965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1459f5-91f2-403e-ab6e-01e83ecf76fb tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:01.411848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1459f5-91f2-403e-ab6e-01e83ecf76fb tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:01.412469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1459f5-91f2-403e-ab6e-01e83ecf76fb tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:01.413073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1459f5-91f2-403e-ab6e-01e83ecf76fb tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:01.451492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-89a5d7a2-0e5c-4a08-994f-8bfc481e1fad tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:01.466205 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-89a5d7a2-0e5c-4a08-994f-8bfc481e1fad tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.601175 Oct 11 04:28:01.485209 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1877/3932] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:00 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:01.489689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3f8f2c0-ab04-49bc-a917-22b56097d50e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:01.490637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3f8f2c0-ab04-49bc-a917-22b56097d50e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:01.496925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3f8f2c0-ab04-49bc-a917-22b56097d50e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:01.497711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3f8f2c0-ab04-49bc-a917-22b56097d50e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:01.498400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3f8f2c0-ab04-49bc-a917-22b56097d50e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:01.499485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3f8f2c0-ab04-49bc-a917-22b56097d50e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:01.500463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3f8f2c0-ab04-49bc-a917-22b56097d50e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:01.501021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3f8f2c0-ab04-49bc-a917-22b56097d50e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:01.503697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5b1459f5-91f2-403e-ab6e-01e83ecf76fb tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:01.518864 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5b1459f5-91f2-403e-ab6e-01e83ecf76fb tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1266 microversion: 2.1 time: 0.132354 Oct 11 04:28:01.519872 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2056/3933] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:01 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1266 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:01.743290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a3f8f2c0-ab04-49bc-a917-22b56097d50e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:01.751870 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3f8f2c0-ab04-49bc-a917-22b56097d50e tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1319 microversion: 2.1 time: 0.271269 Oct 11 04:28:01.752916 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1878/3934] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:01 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:01.854833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-01d4df8b-bb15-408b-b71c-4bc78ab2a941 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:01.856093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-01d4df8b-bb15-408b-b71c-4bc78ab2a941 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:01.869827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01d4df8b-bb15-408b-b71c-4bc78ab2a941 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:01.870785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01d4df8b-bb15-408b-b71c-4bc78ab2a941 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:01.871574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01d4df8b-bb15-408b-b71c-4bc78ab2a941 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:01.872605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01d4df8b-bb15-408b-b71c-4bc78ab2a941 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:01.874429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01d4df8b-bb15-408b-b71c-4bc78ab2a941 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:01.876131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01d4df8b-bb15-408b-b71c-4bc78ab2a941 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:01.919649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:02.158399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-01d4df8b-bb15-408b-b71c-4bc78ab2a941 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:02.167269 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-01d4df8b-bb15-408b-b71c-4bc78ab2a941 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.317858 Oct 11 04:28:02.167861 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2057/3935] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:01 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:02.409439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-754eb33b-753b-4f65-a43c-fdae1fd9719f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:02.410041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-754eb33b-753b-4f65-a43c-fdae1fd9719f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:02.417618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754eb33b-753b-4f65-a43c-fdae1fd9719f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:02.418111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754eb33b-753b-4f65-a43c-fdae1fd9719f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:02.418920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754eb33b-753b-4f65-a43c-fdae1fd9719f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:02.419678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754eb33b-753b-4f65-a43c-fdae1fd9719f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:02.420414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754eb33b-753b-4f65-a43c-fdae1fd9719f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:02.421026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-754eb33b-753b-4f65-a43c-fdae1fd9719f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:02.497106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-75af8de2-be97-4b42-a96c-5e0a3f6a4063 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:02.499695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-75af8de2-be97-4b42-a96c-5e0a3f6a4063 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:02.533101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75af8de2-be97-4b42-a96c-5e0a3f6a4063 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:02.539306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75af8de2-be97-4b42-a96c-5e0a3f6a4063 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:02.539306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75af8de2-be97-4b42-a96c-5e0a3f6a4063 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:02.540965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75af8de2-be97-4b42-a96c-5e0a3f6a4063 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:02.542007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75af8de2-be97-4b42-a96c-5e0a3f6a4063 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:02.544578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75af8de2-be97-4b42-a96c-5e0a3f6a4063 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:02.727783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-75af8de2-be97-4b42-a96c-5e0a3f6a4063 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:02.738531 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-75af8de2-be97-4b42-a96c-5e0a3f6a4063 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.249386 Oct 11 04:28:02.739952 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2058/3936] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:02 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:02.751076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7e83c4c1-eba2-4e26-9716-cd2cf8b1436d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:02.753620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7e83c4c1-eba2-4e26-9716-cd2cf8b1436d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:02.763503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e83c4c1-eba2-4e26-9716-cd2cf8b1436d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:02.764376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e83c4c1-eba2-4e26-9716-cd2cf8b1436d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:02.765056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e83c4c1-eba2-4e26-9716-cd2cf8b1436d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:02.766657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e83c4c1-eba2-4e26-9716-cd2cf8b1436d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:02.767343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e83c4c1-eba2-4e26-9716-cd2cf8b1436d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:02.768047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e83c4c1-eba2-4e26-9716-cd2cf8b1436d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:02.834721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-754eb33b-753b-4f65-a43c-fdae1fd9719f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:02.847376 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-754eb33b-753b-4f65-a43c-fdae1fd9719f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1315 microversion: 2.1 time: 0.442068 Oct 11 04:28:02.848988 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1879/3937] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:02 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1315 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:02.861705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cbd4bc97-6f9e-4af8-9665-117722022524 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:02.862363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cbd4bc97-6f9e-4af8-9665-117722022524 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:02.863343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7e83c4c1-eba2-4e26-9716-cd2cf8b1436d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:02.872468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbd4bc97-6f9e-4af8-9665-117722022524 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:02.872957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbd4bc97-6f9e-4af8-9665-117722022524 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:02.873395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbd4bc97-6f9e-4af8-9665-117722022524 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:02.878113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbd4bc97-6f9e-4af8-9665-117722022524 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:02.878113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbd4bc97-6f9e-4af8-9665-117722022524 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:02.878388 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7e83c4c1-eba2-4e26-9716-cd2cf8b1436d tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1272 microversion: 2.1 time: 0.134394 Oct 11 04:28:02.878496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbd4bc97-6f9e-4af8-9665-117722022524 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:02.878585 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2059/3938] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:02 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1272 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:03.190937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-432a973b-b4cb-48a3-9708-8c7985aaec03 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:03.191586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-432a973b-b4cb-48a3-9708-8c7985aaec03 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:03.204891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432a973b-b4cb-48a3-9708-8c7985aaec03 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:03.205592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432a973b-b4cb-48a3-9708-8c7985aaec03 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:03.206256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432a973b-b4cb-48a3-9708-8c7985aaec03 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:03.207147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432a973b-b4cb-48a3-9708-8c7985aaec03 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:03.207777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432a973b-b4cb-48a3-9708-8c7985aaec03 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:03.208389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432a973b-b4cb-48a3-9708-8c7985aaec03 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:03.249630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cbd4bc97-6f9e-4af8-9665-117722022524 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:03.258668 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cbd4bc97-6f9e-4af8-9665-117722022524 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 200 len: 1508 microversion: 2.1 time: 0.406815 Oct 11 04:28:03.276754 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1880/3939] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:02 2022] GET /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 1508 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:03.284128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8a82bd08-1cbc-4cca-9348-f2c349b27fa3 req-ef8fae20-fb12-4f62-9abb-03a41a02b091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d074edb8-863b-48c6-900d-2bcc2c5e23f6", "name": "network-vif-plugged", "status": "completed", "tag": "6dfb7c11-7d5b-4133-91e0-e0fd02dad6c6"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:03.294242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8a82bd08-1cbc-4cca-9348-f2c349b27fa3 req-ef8fae20-fb12-4f62-9abb-03a41a02b091 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:03.295083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8a82bd08-1cbc-4cca-9348-f2c349b27fa3 req-ef8fae20-fb12-4f62-9abb-03a41a02b091 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:03.295691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8a82bd08-1cbc-4cca-9348-f2c349b27fa3 req-ef8fae20-fb12-4f62-9abb-03a41a02b091 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:03.314297 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8a82bd08-1cbc-4cca-9348-f2c349b27fa3 req-ef8fae20-fb12-4f62-9abb-03a41a02b091 service nova] Creating event network-vif-plugged:6dfb7c11-7d5b-4133-91e0-e0fd02dad6c6 for instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 on n-h2-860892-1 Oct 11 04:28:03.320702 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8a82bd08-1cbc-4cca-9348-f2c349b27fa3 req-ef8fae20-fb12-4f62-9abb-03a41a02b091 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042435 Oct 11 04:28:03.321973 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1881/3940] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:03.330859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-83ea0152-3dcf-44f0-a7b0-d92763ae4545 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:03.342499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-83ea0152-3dcf-44f0-a7b0-d92763ae4545 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: a432a0c5-728b-4bed-9bdc-1bba9b83ad92] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:03.342499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83ea0152-3dcf-44f0-a7b0-d92763ae4545 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:03.342499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83ea0152-3dcf-44f0-a7b0-d92763ae4545 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:03.342499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83ea0152-3dcf-44f0-a7b0-d92763ae4545 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:03.342499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83ea0152-3dcf-44f0-a7b0-d92763ae4545 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:03.342499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83ea0152-3dcf-44f0-a7b0-d92763ae4545 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:03.344364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83ea0152-3dcf-44f0-a7b0-d92763ae4545 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:03.367198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-432a973b-b4cb-48a3-9708-8c7985aaec03 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:03.380209 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-432a973b-b4cb-48a3-9708-8c7985aaec03 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.192909 Oct 11 04:28:03.383555 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2060/3941] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:03 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:03.711170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-83ea0152-3dcf-44f0-a7b0-d92763ae4545 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:03.721129 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-83ea0152-3dcf-44f0-a7b0-d92763ae4545 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/a432a0c5-728b-4bed-9bdc-1bba9b83ad92" status: 200 len: 1507 microversion: 2.1 time: 0.397740 Oct 11 04:28:03.722331 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1882/3942] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:03 2022] GET /compute/v2.1/servers/a432a0c5-728b-4bed-9bdc-1bba9b83ad92 => generated 1507 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:03.753203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c3463bd5-327a-4514-b78f-7ac316705bbf tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:03.753729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c3463bd5-327a-4514-b78f-7ac316705bbf tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: a432a0c5-728b-4bed-9bdc-1bba9b83ad92] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:03.761781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52b2eead-c370-41a5-8a66-c98384f96ba7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:03.764772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-52b2eead-c370-41a5-8a66-c98384f96ba7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:03.767101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3463bd5-327a-4514-b78f-7ac316705bbf tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:03.768528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3463bd5-327a-4514-b78f-7ac316705bbf tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:03.769062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3463bd5-327a-4514-b78f-7ac316705bbf tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:03.772196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3463bd5-327a-4514-b78f-7ac316705bbf tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:03.772955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3463bd5-327a-4514-b78f-7ac316705bbf tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:03.774827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3463bd5-327a-4514-b78f-7ac316705bbf tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:03.779738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b2eead-c370-41a5-8a66-c98384f96ba7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:03.779738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b2eead-c370-41a5-8a66-c98384f96ba7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:03.779738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b2eead-c370-41a5-8a66-c98384f96ba7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:03.780545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b2eead-c370-41a5-8a66-c98384f96ba7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:03.780651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b2eead-c370-41a5-8a66-c98384f96ba7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:03.780995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b2eead-c370-41a5-8a66-c98384f96ba7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:03.847123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c3463bd5-327a-4514-b78f-7ac316705bbf tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: a432a0c5-728b-4bed-9bdc-1bba9b83ad92] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:28:04.145144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-52b2eead-c370-41a5-8a66-c98384f96ba7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:04.154939 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c3463bd5-327a-4514-b78f-7ac316705bbf tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a432a0c5-728b-4bed-9bdc-1bba9b83ad92" status: 204 len: 0 microversion: 2.1 time: 0.408298 Oct 11 04:28:04.155566 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2061/3943] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:28:03 2022] DELETE /compute/v2.1/servers/a432a0c5-728b-4bed-9bdc-1bba9b83ad92 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:28:04.159127 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-52b2eead-c370-41a5-8a66-c98384f96ba7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.401528 Oct 11 04:28:04.174603 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1883/3944] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:03 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:04.174768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9623c299-b1d6-4b7c-8549-9427a48525c8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:04.174768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9623c299-b1d6-4b7c-8549-9427a48525c8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:04.174946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4eb95136-1e51-4d61-8e75-22ee9cafee8b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:04.177143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4eb95136-1e51-4d61-8e75-22ee9cafee8b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:04.179748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9623c299-b1d6-4b7c-8549-9427a48525c8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:04.180254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9623c299-b1d6-4b7c-8549-9427a48525c8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:04.182968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9623c299-b1d6-4b7c-8549-9427a48525c8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:04.183782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9623c299-b1d6-4b7c-8549-9427a48525c8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:04.184659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9623c299-b1d6-4b7c-8549-9427a48525c8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:04.185537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9623c299-b1d6-4b7c-8549-9427a48525c8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:04.193554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4eb95136-1e51-4d61-8e75-22ee9cafee8b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:04.193554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4eb95136-1e51-4d61-8e75-22ee9cafee8b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:04.194209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4eb95136-1e51-4d61-8e75-22ee9cafee8b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:04.198266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4eb95136-1e51-4d61-8e75-22ee9cafee8b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:04.198777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4eb95136-1e51-4d61-8e75-22ee9cafee8b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:04.199219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4eb95136-1e51-4d61-8e75-22ee9cafee8b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:04.251870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:04.482030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9623c299-b1d6-4b7c-8549-9427a48525c8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:04.501862 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9623c299-b1d6-4b7c-8549-9427a48525c8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1315 microversion: 2.1 time: 0.339028 Oct 11 04:28:04.504058 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2062/3945] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:04 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:04.512224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1222c348-0ee6-45d7-a895-0179032ecd71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:04.515073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1222c348-0ee6-45d7-a895-0179032ecd71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:04.526173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1222c348-0ee6-45d7-a895-0179032ecd71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:04.530731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1222c348-0ee6-45d7-a895-0179032ecd71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:04.530731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1222c348-0ee6-45d7-a895-0179032ecd71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:04.530731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1222c348-0ee6-45d7-a895-0179032ecd71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:04.530731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1222c348-0ee6-45d7-a895-0179032ecd71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:04.530731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1222c348-0ee6-45d7-a895-0179032ecd71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:04.566171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1222c348-0ee6-45d7-a895-0179032ecd71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b708d397-9029-45e8-b850-b2b5d854c2a6] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:28:04.638348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4eb95136-1e51-4d61-8e75-22ee9cafee8b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:04.648443 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4eb95136-1e51-4d61-8e75-22ee9cafee8b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1314 microversion: 2.1 time: 0.484962 Oct 11 04:28:04.649030 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1884/3946] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:04 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1314 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:04.658365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-674dc526-63e6-421c-a8f9-cde1de7cf53c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:04.658365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-674dc526-63e6-421c-a8f9-cde1de7cf53c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:04.664978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:04.677730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-674dc526-63e6-421c-a8f9-cde1de7cf53c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:04.679109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-674dc526-63e6-421c-a8f9-cde1de7cf53c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:04.679937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-674dc526-63e6-421c-a8f9-cde1de7cf53c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:04.681519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-674dc526-63e6-421c-a8f9-cde1de7cf53c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:04.682581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-674dc526-63e6-421c-a8f9-cde1de7cf53c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:04.686920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-674dc526-63e6-421c-a8f9-cde1de7cf53c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:04.938548 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1222c348-0ee6-45d7-a895-0179032ecd71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6" status: 204 len: 0 microversion: 2.1 time: 0.430018 Oct 11 04:28:04.939535 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2063/3947] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:28:04 2022] DELETE /compute/v2.1/servers/b708d397-9029-45e8-b850-b2b5d854c2a6 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:28:05.082916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-MultipleCreateTestJSON-server-384599042", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "min_count": 1, "max_count": 2, "return_reservation_id": true, "networks": [{"uuid": "b6a68c7a-d23f-40ee-a691-aae54c90b0d5"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:05.177933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] validate_networks() for [('b6a68c7a-d23f-40ee-a691-aae54c90b0d5', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:28:05.224011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-674dc526-63e6-421c-a8f9-cde1de7cf53c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:05.238828 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-674dc526-63e6-421c-a8f9-cde1de7cf53c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.588546 Oct 11 04:28:05.239766 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1885/3948] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:04 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:05.251526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-389074d3-0736-4de9-8af6-e582d65fcac6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:05.257956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-389074d3-0736-4de9-8af6-e582d65fcac6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:05.272483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-389074d3-0736-4de9-8af6-e582d65fcac6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:05.275304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-389074d3-0736-4de9-8af6-e582d65fcac6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:05.277163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-389074d3-0736-4de9-8af6-e582d65fcac6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:05.278058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-389074d3-0736-4de9-8af6-e582d65fcac6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:05.279573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-389074d3-0736-4de9-8af6-e582d65fcac6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:05.280043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-389074d3-0736-4de9-8af6-e582d65fcac6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:05.846593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-389074d3-0736-4de9-8af6-e582d65fcac6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:05.861571 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-389074d3-0736-4de9-8af6-e582d65fcac6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.620419 Oct 11 04:28:05.862494 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1886/3949] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:05 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:05.892187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2f013a46-271e-4ed0-8828-6e9391968c19 req-7c32ff1d-6d7f-4b57-ba9c-6f315bac949c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fafb331-19af-4936-a405-cbf6020defba", "name": "network-vif-plugged", "status": "completed", "tag": "cfdd334c-b535-4947-b6cf-d889e066625f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:05.903054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2f013a46-271e-4ed0-8828-6e9391968c19 req-7c32ff1d-6d7f-4b57-ba9c-6f315bac949c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:05.903899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2f013a46-271e-4ed0-8828-6e9391968c19 req-7c32ff1d-6d7f-4b57-ba9c-6f315bac949c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:05.904517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2f013a46-271e-4ed0-8828-6e9391968c19 req-7c32ff1d-6d7f-4b57-ba9c-6f315bac949c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:05.919224 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2f013a46-271e-4ed0-8828-6e9391968c19 req-7c32ff1d-6d7f-4b57-ba9c-6f315bac949c service nova] Creating event network-vif-plugged:cfdd334c-b535-4947-b6cf-d889e066625f for instance 3fafb331-19af-4936-a405-cbf6020defba on n-h1-860892-1 Oct 11 04:28:05.925365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2f013a46-271e-4ed0-8828-6e9391968c19 req-7c32ff1d-6d7f-4b57-ba9c-6f315bac949c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044825 Oct 11 04:28:05.930083 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1887/3950] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:05.932973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1386236d-8f66-4faf-b016-94d8d1ae26a1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:05.933897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1386236d-8f66-4faf-b016-94d8d1ae26a1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:05.941285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1386236d-8f66-4faf-b016-94d8d1ae26a1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:05.942104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1386236d-8f66-4faf-b016-94d8d1ae26a1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:05.942771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1386236d-8f66-4faf-b016-94d8d1ae26a1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:05.943710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1386236d-8f66-4faf-b016-94d8d1ae26a1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:05.944215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1386236d-8f66-4faf-b016-94d8d1ae26a1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:05.944658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1386236d-8f66-4faf-b016-94d8d1ae26a1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:05.974969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:28:05.975740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:28:05.976412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:28:05.977129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:28:05.977834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:28:06.004544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:06.005050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:06.005490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:06.006816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:06.007285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:06.007715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:06.035835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Getting quotas for project c86df48dcef542c180c7b6dc0d9bac52. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:28:06.042500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Getting quotas for user 66f6c41ffe084f1bb93a918b81f98ecc and project c86df48dcef542c180c7b6dc0d9bac52. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:28:06.074601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Going to run 2 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:28:06.077226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b69a1768-2247-440e-b300-3fc2cfa64db9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:28:06.265104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=b69a1768-2247-440e-b300-3fc2cfa64db9,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:28:06.415640 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0ea1583c-2121-4070-86aa-b630377b4c92 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 32 microversion: 2.1 time: 1.337689 Oct 11 04:28:06.416974 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2064/3951] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:28:05 2022] POST /compute/v2.1/servers => generated 32 bytes in 1340 msecs (HTTP/1.1 202) 9 headers in 362 bytes (2 switches on core 0) Oct 11 04:28:06.422831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32c34e63-007d-4092-bc16-136c1fc1e406 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:06.423704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-32c34e63-007d-4092-bc16-136c1fc1e406 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:06.431536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32c34e63-007d-4092-bc16-136c1fc1e406 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:06.432274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32c34e63-007d-4092-bc16-136c1fc1e406 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:06.432885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32c34e63-007d-4092-bc16-136c1fc1e406 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:06.434324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32c34e63-007d-4092-bc16-136c1fc1e406 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:06.435011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32c34e63-007d-4092-bc16-136c1fc1e406 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:06.435630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32c34e63-007d-4092-bc16-136c1fc1e406 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:06.553892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1386236d-8f66-4faf-b016-94d8d1ae26a1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:06.563543 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1386236d-8f66-4faf-b016-94d8d1ae26a1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1315 microversion: 2.1 time: 0.635698 Oct 11 04:28:06.564137 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1888/3952] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:05 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1315 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:06.583489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b7311d70-8779-4154-9b7b-698184e796b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:06.585741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b7311d70-8779-4154-9b7b-698184e796b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:06.601396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7311d70-8779-4154-9b7b-698184e796b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:06.601990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7311d70-8779-4154-9b7b-698184e796b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:06.602774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7311d70-8779-4154-9b7b-698184e796b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:06.605391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7311d70-8779-4154-9b7b-698184e796b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:06.605934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7311d70-8779-4154-9b7b-698184e796b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:06.606476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7311d70-8779-4154-9b7b-698184e796b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:06.653393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-32c34e63-007d-4092-bc16-136c1fc1e406 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:06.665535 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-32c34e63-007d-4092-bc16-136c1fc1e406 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1314 microversion: 2.1 time: 0.246780 Oct 11 04:28:06.666221 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2065/3953] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:06 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:06.689538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc6ed034-f9ab-4286-9d36-67d80fe6d872 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:06.697407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cc6ed034-f9ab-4286-9d36-67d80fe6d872 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:06.697407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cc6ed034-f9ab-4286-9d36-67d80fe6d872 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Searching by: {'deleted': False, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:28:06.715303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6ed034-f9ab-4286-9d36-67d80fe6d872 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:06.720502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6ed034-f9ab-4286-9d36-67d80fe6d872 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:06.720502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6ed034-f9ab-4286-9d36-67d80fe6d872 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:06.720502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6ed034-f9ab-4286-9d36-67d80fe6d872 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:06.720502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6ed034-f9ab-4286-9d36-67d80fe6d872 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:06.720502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6ed034-f9ab-4286-9d36-67d80fe6d872 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:06.748846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-cc6ed034-f9ab-4286-9d36-67d80fe6d872 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Listed batch of 2 results from cell out of 998 limit. Returned 2 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:28:06.782596 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc6ed034-f9ab-4286-9d36-67d80fe6d872 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 1333 microversion: 2.1 time: 0.099722 Oct 11 04:28:06.783555 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2066/3954] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:28:06 2022] GET /compute/v2.1/servers => generated 1333 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:06.795596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a1b7c03-c125-445b-ba71-5329eb9dc7e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:06.796223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a1b7c03-c125-445b-ba71-5329eb9dc7e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:06.857164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3a1b7c03-c125-445b-ba71-5329eb9dc7e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:06.866682 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a1b7c03-c125-445b-ba71-5329eb9dc7e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1217 microversion: 2.1 time: 0.073365 Oct 11 04:28:06.867453 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2067/3955] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:06 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1217 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:06.886418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c19eded9-79b4-42ab-b0c9-b3e82ed8cf0c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:06.887413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c19eded9-79b4-42ab-b0c9-b3e82ed8cf0c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:06.899978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c19eded9-79b4-42ab-b0c9-b3e82ed8cf0c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:06.900851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c19eded9-79b4-42ab-b0c9-b3e82ed8cf0c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:06.901467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c19eded9-79b4-42ab-b0c9-b3e82ed8cf0c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:06.902461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c19eded9-79b4-42ab-b0c9-b3e82ed8cf0c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:06.903153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c19eded9-79b4-42ab-b0c9-b3e82ed8cf0c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:06.903588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c19eded9-79b4-42ab-b0c9-b3e82ed8cf0c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:07.041396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b7311d70-8779-4154-9b7b-698184e796b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:07.055932 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b7311d70-8779-4154-9b7b-698184e796b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.489858 Oct 11 04:28:07.057872 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1889/3956] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:06 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:07.449779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c19eded9-79b4-42ab-b0c9-b3e82ed8cf0c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:07.460681 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c19eded9-79b4-42ab-b0c9-b3e82ed8cf0c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.579401 Oct 11 04:28:07.470725 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2068/3957] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:06 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:07.590317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fe790817-98eb-4aed-99c8-dca203b7e4de tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:07.590983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fe790817-98eb-4aed-99c8-dca203b7e4de tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:07.607441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe790817-98eb-4aed-99c8-dca203b7e4de tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:07.608010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe790817-98eb-4aed-99c8-dca203b7e4de tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:07.608831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe790817-98eb-4aed-99c8-dca203b7e4de tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:07.614005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe790817-98eb-4aed-99c8-dca203b7e4de tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:07.614939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe790817-98eb-4aed-99c8-dca203b7e4de tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:07.615563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe790817-98eb-4aed-99c8-dca203b7e4de tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:07.685105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c9a45e60-a953-4f5c-9814-3619d3613be2 req-92f11af5-540c-4386-8de0-3aa9f90b1635 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36146041-a1da-4b52-b096-9efc8b252767", "tag": "004dff7d-ab50-4b90-8380-f8476274dc23"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:07.699021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c9a45e60-a953-4f5c-9814-3619d3613be2 req-92f11af5-540c-4386-8de0-3aa9f90b1635 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:07.700348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c9a45e60-a953-4f5c-9814-3619d3613be2 req-92f11af5-540c-4386-8de0-3aa9f90b1635 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:07.700933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c9a45e60-a953-4f5c-9814-3619d3613be2 req-92f11af5-540c-4386-8de0-3aa9f90b1635 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:07.723280 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c9a45e60-a953-4f5c-9814-3619d3613be2 req-92f11af5-540c-4386-8de0-3aa9f90b1635 service nova] Creating event network-changed:004dff7d-ab50-4b90-8380-f8476274dc23 for instance 36146041-a1da-4b52-b096-9efc8b252767 on n-h2-860892-1 Oct 11 04:28:07.729025 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c9a45e60-a953-4f5c-9814-3619d3613be2 req-92f11af5-540c-4386-8de0-3aa9f90b1635 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049914 Oct 11 04:28:07.732505 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2069/3958] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:28:07.752069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-472e8e4f-fdf4-4a92-aae0-0c5181f32271 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:07.753669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-472e8e4f-fdf4-4a92-aae0-0c5181f32271 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:07.767000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472e8e4f-fdf4-4a92-aae0-0c5181f32271 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:07.767777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472e8e4f-fdf4-4a92-aae0-0c5181f32271 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:07.768397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472e8e4f-fdf4-4a92-aae0-0c5181f32271 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:07.769275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472e8e4f-fdf4-4a92-aae0-0c5181f32271 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:07.769903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472e8e4f-fdf4-4a92-aae0-0c5181f32271 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:07.771047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472e8e4f-fdf4-4a92-aae0-0c5181f32271 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:08.179097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fe790817-98eb-4aed-99c8-dca203b7e4de tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:08.190916 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fe790817-98eb-4aed-99c8-dca203b7e4de tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1315 microversion: 2.1 time: 0.604685 Oct 11 04:28:08.191788 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1890/3959] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:07 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1315 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:08.208783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-243c3f99-2e8b-4b37-a6be-3ca0e315e4fd tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:08.210813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-243c3f99-2e8b-4b37-a6be-3ca0e315e4fd tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:08.247546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-472e8e4f-fdf4-4a92-aae0-0c5181f32271 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:08.272859 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-472e8e4f-fdf4-4a92-aae0-0c5181f32271 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1314 microversion: 2.1 time: 0.538671 Oct 11 04:28:08.281059 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2070/3960] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:07 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:08.292482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c40c9930-4a44-4f2f-82e6-ce2d7cbf9443 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:08.293516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c40c9930-4a44-4f2f-82e6-ce2d7cbf9443 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:08.317455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c40c9930-4a44-4f2f-82e6-ce2d7cbf9443 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:08.317981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c40c9930-4a44-4f2f-82e6-ce2d7cbf9443 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:08.318454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c40c9930-4a44-4f2f-82e6-ce2d7cbf9443 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:08.319193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c40c9930-4a44-4f2f-82e6-ce2d7cbf9443 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:08.320762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c40c9930-4a44-4f2f-82e6-ce2d7cbf9443 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:08.322158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c40c9930-4a44-4f2f-82e6-ce2d7cbf9443 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:08.547303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-243c3f99-2e8b-4b37-a6be-3ca0e315e4fd tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:08.555653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:08.566460 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-243c3f99-2e8b-4b37-a6be-3ca0e315e4fd tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1217 microversion: 2.1 time: 0.371085 Oct 11 04:28:08.568186 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1891/3961] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:08 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1217 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:08.573529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-b7ccc660-807d-42f5-9d64-25ac72ee4555 req-f7190f3a-69e7-475d-ac6b-af28d730324e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98213491-b0bf-4bbb-aa2f-3399f13caa8a", "name": "network-vif-plugged", "status": "completed", "tag": "fa93e5a6-3e57-4071-9fa9-bd845e54bd0a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:08.586277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b7ccc660-807d-42f5-9d64-25ac72ee4555 req-f7190f3a-69e7-475d-ac6b-af28d730324e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:08.587134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b7ccc660-807d-42f5-9d64-25ac72ee4555 req-f7190f3a-69e7-475d-ac6b-af28d730324e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:08.589879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b7ccc660-807d-42f5-9d64-25ac72ee4555 req-f7190f3a-69e7-475d-ac6b-af28d730324e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:08.617506 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-b7ccc660-807d-42f5-9d64-25ac72ee4555 req-f7190f3a-69e7-475d-ac6b-af28d730324e service nova] Creating event network-vif-plugged:fa93e5a6-3e57-4071-9fa9-bd845e54bd0a for instance 98213491-b0bf-4bbb-aa2f-3399f13caa8a on n-h1-860892-1 Oct 11 04:28:08.631042 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-b7ccc660-807d-42f5-9d64-25ac72ee4555 req-f7190f3a-69e7-475d-ac6b-af28d730324e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058635 Oct 11 04:28:08.632413 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1892/3962] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:08.699381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c40c9930-4a44-4f2f-82e6-ce2d7cbf9443 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:08.709351 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c40c9930-4a44-4f2f-82e6-ce2d7cbf9443 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.425674 Oct 11 04:28:08.726954 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2071/3963] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:08 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:08.732855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-52001519-dd8f-4334-9ee5-bf007354805e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:08.733664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-52001519-dd8f-4334-9ee5-bf007354805e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:08.741447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52001519-dd8f-4334-9ee5-bf007354805e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:08.742215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52001519-dd8f-4334-9ee5-bf007354805e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:08.742650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52001519-dd8f-4334-9ee5-bf007354805e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:08.743413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52001519-dd8f-4334-9ee5-bf007354805e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:08.743887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52001519-dd8f-4334-9ee5-bf007354805e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:08.744463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52001519-dd8f-4334-9ee5-bf007354805e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:08.924040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-704144805", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {}, "networks": [{"uuid": "eb02ea25-81c5-4495-9952-2472f9330109"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:08.999197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-52001519-dd8f-4334-9ee5-bf007354805e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:09.003793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:09.020990 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-52001519-dd8f-4334-9ee5-bf007354805e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.292719 Oct 11 04:28:09.026945 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2072/3964] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:08 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:09.039428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d06935ab-3954-4f9b-be38-f2dbc2b96271 req-1bf2ec41-5759-47aa-b0db-f456ce35dbc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b708d397-9029-45e8-b850-b2b5d854c2a6", "name": "network-vif-deleted", "tag": "ec12fc9f-0305-4044-a1df-ae112f798f7d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:09.053508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] validate_networks() for [('eb02ea25-81c5-4495-9952-2472f9330109', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:28:09.060592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d06935ab-3954-4f9b-be38-f2dbc2b96271 req-1bf2ec41-5759-47aa-b0db-f456ce35dbc4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:09.061357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d06935ab-3954-4f9b-be38-f2dbc2b96271 req-1bf2ec41-5759-47aa-b0db-f456ce35dbc4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:09.062101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d06935ab-3954-4f9b-be38-f2dbc2b96271 req-1bf2ec41-5759-47aa-b0db-f456ce35dbc4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:09.077068 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d06935ab-3954-4f9b-be38-f2dbc2b96271 req-1bf2ec41-5759-47aa-b0db-f456ce35dbc4 service nova] Creating event network-vif-deleted:ec12fc9f-0305-4044-a1df-ae112f798f7d for instance b708d397-9029-45e8-b850-b2b5d854c2a6 on n-h1-860892-1 Oct 11 04:28:09.084025 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d06935ab-3954-4f9b-be38-f2dbc2b96271 req-1bf2ec41-5759-47aa-b0db-f456ce35dbc4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052411 Oct 11 04:28:09.089636 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2073/3965] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:09.225557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-53906f29-7908-4f1f-8697-863c1fa01699 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:09.227544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-53906f29-7908-4f1f-8697-863c1fa01699 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:09.241975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53906f29-7908-4f1f-8697-863c1fa01699 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:09.242880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53906f29-7908-4f1f-8697-863c1fa01699 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:09.243329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53906f29-7908-4f1f-8697-863c1fa01699 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:09.244129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53906f29-7908-4f1f-8697-863c1fa01699 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:09.244594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53906f29-7908-4f1f-8697-863c1fa01699 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:09.245075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53906f29-7908-4f1f-8697-863c1fa01699 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:09.447908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-53906f29-7908-4f1f-8697-863c1fa01699 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:09.461967 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-53906f29-7908-4f1f-8697-863c1fa01699 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1315 microversion: 2.1 time: 0.246013 Oct 11 04:28:09.478000 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2074/3966] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:09 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1315 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:09.484796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7b58d153-6cd4-4a00-9c78-cf9693993298 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:09.485423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7b58d153-6cd4-4a00-9c78-cf9693993298 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:09.493636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b58d153-6cd4-4a00-9c78-cf9693993298 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:09.494826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b58d153-6cd4-4a00-9c78-cf9693993298 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:09.503276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b58d153-6cd4-4a00-9c78-cf9693993298 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:09.503276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b58d153-6cd4-4a00-9c78-cf9693993298 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:09.503276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b58d153-6cd4-4a00-9c78-cf9693993298 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:09.503276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b58d153-6cd4-4a00-9c78-cf9693993298 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:09.819561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7b58d153-6cd4-4a00-9c78-cf9693993298 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:09.830129 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7b58d153-6cd4-4a00-9c78-cf9693993298 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1314 microversion: 2.1 time: 0.350872 Oct 11 04:28:09.833286 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2075/3967] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:09 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1314 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:09.841948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f40a3dbd-1430-44bb-90b4-b722212ee726 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:09.845025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f40a3dbd-1430-44bb-90b4-b722212ee726 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:09.857101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f40a3dbd-1430-44bb-90b4-b722212ee726 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:09.857815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f40a3dbd-1430-44bb-90b4-b722212ee726 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:09.859090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f40a3dbd-1430-44bb-90b4-b722212ee726 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:09.862385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f40a3dbd-1430-44bb-90b4-b722212ee726 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:09.865646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:28:09.866135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:28:09.866612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:28:09.866972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:28:09.867539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:28:09.871189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f40a3dbd-1430-44bb-90b4-b722212ee726 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:09.878758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f40a3dbd-1430-44bb-90b4-b722212ee726 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:09.882685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:09.883167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:09.883616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:09.884322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:09.888801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:09.889674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:09.921168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Getting quotas for project 84c78ea51c6549519de9ed02fdb51e5c. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:28:09.939450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Getting quotas for user fde0862f53b44ff78ca90ef763745749 and project 84c78ea51c6549519de9ed02fdb51e5c. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:28:09.952731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:28:09.955364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:28:09.972945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f40a3dbd-1430-44bb-90b4-b722212ee726 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:09.981307 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f40a3dbd-1430-44bb-90b4-b722212ee726 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1221 microversion: 2.1 time: 0.143226 Oct 11 04:28:09.982142 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2076/3968] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:09 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1221 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:09.997525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c906c18-d9c3-4205-b55f-f312a01d05ed tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:09.998473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6c906c18-d9c3-4205-b55f-f312a01d05ed tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:10.004980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c906c18-d9c3-4205-b55f-f312a01d05ed tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:10.007080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c906c18-d9c3-4205-b55f-f312a01d05ed tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:10.007080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c906c18-d9c3-4205-b55f-f312a01d05ed tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:10.007080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c906c18-d9c3-4205-b55f-f312a01d05ed tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:10.007408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c906c18-d9c3-4205-b55f-f312a01d05ed tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:10.007827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c906c18-d9c3-4205-b55f-f312a01d05ed tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:10.148736 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c57041b7-6e05-435e-9607-477159ff20e7 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.513020 Oct 11 04:28:10.155825 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1893/3969] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:28:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:28:10.161868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-d4bc2442-dec1-4227-ae5e-47425aa85625 req-6c1177d3-1658-490b-a471-eb44f1f9472d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a432a0c5-728b-4bed-9bdc-1bba9b83ad92", "name": "network-vif-deleted", "tag": "1c85ae89-a900-4857-b9a9-1cbd35b6d433"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:10.175369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d4bc2442-dec1-4227-ae5e-47425aa85625 req-6c1177d3-1658-490b-a471-eb44f1f9472d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:10.180972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d4bc2442-dec1-4227-ae5e-47425aa85625 req-6c1177d3-1658-490b-a471-eb44f1f9472d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:10.180972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d4bc2442-dec1-4227-ae5e-47425aa85625 req-6c1177d3-1658-490b-a471-eb44f1f9472d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:10.198403 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-d4bc2442-dec1-4227-ae5e-47425aa85625 req-6c1177d3-1658-490b-a471-eb44f1f9472d service nova] Creating event network-vif-deleted:1c85ae89-a900-4857-b9a9-1cbd35b6d433 for instance a432a0c5-728b-4bed-9bdc-1bba9b83ad92 on n-h1-860892-1 Oct 11 04:28:10.232023 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-d4bc2442-dec1-4227-ae5e-47425aa85625 req-6c1177d3-1658-490b-a471-eb44f1f9472d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061999 Oct 11 04:28:10.238658 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1894/3970] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:10.239579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6c906c18-d9c3-4205-b55f-f312a01d05ed tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:10.253449 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6c906c18-d9c3-4205-b55f-f312a01d05ed tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.270037 Oct 11 04:28:10.255105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b5853d00-cc78-4a95-947a-322a4eccba4d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:10.255652 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2077/3971] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:09 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:10.258082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b5853d00-cc78-4a95-947a-322a4eccba4d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:10.264636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-759af3d6-54a1-468a-8ae1-013d535e965e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:10.266411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5853d00-cc78-4a95-947a-322a4eccba4d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:10.267141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5853d00-cc78-4a95-947a-322a4eccba4d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:10.267906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5853d00-cc78-4a95-947a-322a4eccba4d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:10.269046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5853d00-cc78-4a95-947a-322a4eccba4d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:10.269799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5853d00-cc78-4a95-947a-322a4eccba4d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:10.270433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5853d00-cc78-4a95-947a-322a4eccba4d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:10.276680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-759af3d6-54a1-468a-8ae1-013d535e965e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:10.372590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-759af3d6-54a1-468a-8ae1-013d535e965e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:10.384415 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-759af3d6-54a1-468a-8ae1-013d535e965e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1223 microversion: 2.1 time: 0.127349 Oct 11 04:28:10.387217 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2078/3972] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:10 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1223 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:10.489980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d85a92c5-fa14-4aa2-9a1a-5fd1486c61a4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:10.491019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d85a92c5-fa14-4aa2-9a1a-5fd1486c61a4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:10.500101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b5853d00-cc78-4a95-947a-322a4eccba4d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:10.501437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d85a92c5-fa14-4aa2-9a1a-5fd1486c61a4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:10.507733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d85a92c5-fa14-4aa2-9a1a-5fd1486c61a4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:10.507733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d85a92c5-fa14-4aa2-9a1a-5fd1486c61a4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:10.507733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d85a92c5-fa14-4aa2-9a1a-5fd1486c61a4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:10.507733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d85a92c5-fa14-4aa2-9a1a-5fd1486c61a4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:10.507733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d85a92c5-fa14-4aa2-9a1a-5fd1486c61a4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:10.511773 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b5853d00-cc78-4a95-947a-322a4eccba4d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.273399 Oct 11 04:28:10.526236 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1895/3973] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:10 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:10.713339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d85a92c5-fa14-4aa2-9a1a-5fd1486c61a4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:10.722627 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d85a92c5-fa14-4aa2-9a1a-5fd1486c61a4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1315 microversion: 2.1 time: 0.237408 Oct 11 04:28:10.729361 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2079/3974] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:10 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1315 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:10.757306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5ac78669-2867-4dc0-a932-8a4c7cecc622 req-f213b609-090d-48eb-a750-943a207898ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa836dc-900d-4ca8-9400-c7beb1739be1", "name": "network-vif-plugged", "status": "completed", "tag": "6bd011bd-c917-4d3c-93b6-c411b91b9a58"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:10.770027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5ac78669-2867-4dc0-a932-8a4c7cecc622 req-f213b609-090d-48eb-a750-943a207898ab service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:10.770530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5ac78669-2867-4dc0-a932-8a4c7cecc622 req-f213b609-090d-48eb-a750-943a207898ab service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:10.770957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5ac78669-2867-4dc0-a932-8a4c7cecc622 req-f213b609-090d-48eb-a750-943a207898ab service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:10.786285 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5ac78669-2867-4dc0-a932-8a4c7cecc622 req-f213b609-090d-48eb-a750-943a207898ab service nova] Creating event network-vif-plugged:6bd011bd-c917-4d3c-93b6-c411b91b9a58 for instance afa836dc-900d-4ca8-9400-c7beb1739be1 on n-h2-860892-1 Oct 11 04:28:10.794961 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5ac78669-2867-4dc0-a932-8a4c7cecc622 req-f213b609-090d-48eb-a750-943a207898ab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039119 Oct 11 04:28:10.796133 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1896/3975] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:10.856687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9992e5a8-ef3e-4ba1-ab39-070d6ae91643 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:10.857308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9992e5a8-ef3e-4ba1-ab39-070d6ae91643 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:10.864797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9992e5a8-ef3e-4ba1-ab39-070d6ae91643 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:10.865285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9992e5a8-ef3e-4ba1-ab39-070d6ae91643 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:10.865717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9992e5a8-ef3e-4ba1-ab39-070d6ae91643 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:10.866472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9992e5a8-ef3e-4ba1-ab39-070d6ae91643 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:10.866926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9992e5a8-ef3e-4ba1-ab39-070d6ae91643 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:10.867349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9992e5a8-ef3e-4ba1-ab39-070d6ae91643 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:11.007255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a990aed8-e802-4f3f-92a7-bb64507a03f6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:11.008068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a990aed8-e802-4f3f-92a7-bb64507a03f6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:11.015001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a990aed8-e802-4f3f-92a7-bb64507a03f6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:11.016188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a990aed8-e802-4f3f-92a7-bb64507a03f6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:11.016626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a990aed8-e802-4f3f-92a7-bb64507a03f6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:11.017338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a990aed8-e802-4f3f-92a7-bb64507a03f6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:11.017786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a990aed8-e802-4f3f-92a7-bb64507a03f6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:11.018233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a990aed8-e802-4f3f-92a7-bb64507a03f6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:11.082249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9992e5a8-ef3e-4ba1-ab39-070d6ae91643 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:11.091249 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9992e5a8-ef3e-4ba1-ab39-070d6ae91643 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1314 microversion: 2.1 time: 0.238264 Oct 11 04:28:11.102574 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2080/3976] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:10 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1314 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:11.120906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a990aed8-e802-4f3f-92a7-bb64507a03f6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:11.129452 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a990aed8-e802-4f3f-92a7-bb64507a03f6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1213 microversion: 2.1 time: 0.127317 Oct 11 04:28:11.129802 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1897/3977] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:11 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1213 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:11.283419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bdcd9990-aab0-49bc-8660-f95b3212d193 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:11.283979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bdcd9990-aab0-49bc-8660-f95b3212d193 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:11.291186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdcd9990-aab0-49bc-8660-f95b3212d193 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:11.291682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdcd9990-aab0-49bc-8660-f95b3212d193 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:11.292138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdcd9990-aab0-49bc-8660-f95b3212d193 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:11.293785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdcd9990-aab0-49bc-8660-f95b3212d193 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:11.294279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdcd9990-aab0-49bc-8660-f95b3212d193 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:11.294715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bdcd9990-aab0-49bc-8660-f95b3212d193 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:11.412728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-54b7896f-76e8-4f27-894c-11554b12a6f4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:11.413342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-54b7896f-76e8-4f27-894c-11554b12a6f4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:11.556247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-54b7896f-76e8-4f27-894c-11554b12a6f4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:11.566564 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-54b7896f-76e8-4f27-894c-11554b12a6f4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1223 microversion: 2.1 time: 0.157587 Oct 11 04:28:11.567697 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1898/3978] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:11 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1223 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:11.597371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:11.597980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:11.605917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:11.606520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:11.606965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:11.608087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:11.608540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:11.608990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:11.641797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bdcd9990-aab0-49bc-8660-f95b3212d193 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:11.651310 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bdcd9990-aab0-49bc-8660-f95b3212d193 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.374434 Oct 11 04:28:11.659524 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2081/3979] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:11 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:11.666794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f64a5ad1-3efc-45cd-b053-d09a5d955484 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:11.668116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f64a5ad1-3efc-45cd-b053-d09a5d955484 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:11.676767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f64a5ad1-3efc-45cd-b053-d09a5d955484 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:11.683514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f64a5ad1-3efc-45cd-b053-d09a5d955484 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:11.683514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f64a5ad1-3efc-45cd-b053-d09a5d955484 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:11.683514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f64a5ad1-3efc-45cd-b053-d09a5d955484 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:11.683514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f64a5ad1-3efc-45cd-b053-d09a5d955484 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:11.683514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f64a5ad1-3efc-45cd-b053-d09a5d955484 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:11.966322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f64a5ad1-3efc-45cd-b053-d09a5d955484 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:11.979714 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f64a5ad1-3efc-45cd-b053-d09a5d955484 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.317283 Oct 11 04:28:11.981242 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2082/3980] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:11 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:12.010112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df961a82-5daa-4132-b311-3a4804cbbb6f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:12.011122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-df961a82-5daa-4132-b311-3a4804cbbb6f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:12.026289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df961a82-5daa-4132-b311-3a4804cbbb6f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.027064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df961a82-5daa-4132-b311-3a4804cbbb6f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.027674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df961a82-5daa-4132-b311-3a4804cbbb6f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.029859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df961a82-5daa-4132-b311-3a4804cbbb6f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.031796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df961a82-5daa-4132-b311-3a4804cbbb6f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.033011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df961a82-5daa-4132-b311-3a4804cbbb6f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.138766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:12.159394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:12.160901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:12.171586 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2187b765-6148-4b37-969f-c8829d42b138 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2943 microversion: 2.32 time: 0.578853 Oct 11 04:28:12.186568 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1899/3981] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:28:11 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2943 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:28:12.206040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-83c03e24-5611-4a8f-810a-92b7c3a11876 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:12.207787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-83c03e24-5611-4a8f-810a-92b7c3a11876 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:12.247356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83c03e24-5611-4a8f-810a-92b7c3a11876 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.250984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83c03e24-5611-4a8f-810a-92b7c3a11876 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.253606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83c03e24-5611-4a8f-810a-92b7c3a11876 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.271171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83c03e24-5611-4a8f-810a-92b7c3a11876 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.271171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83c03e24-5611-4a8f-810a-92b7c3a11876 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.271171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83c03e24-5611-4a8f-810a-92b7c3a11876 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.435115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-df961a82-5daa-4132-b311-3a4804cbbb6f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:12.444361 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-df961a82-5daa-4132-b311-3a4804cbbb6f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1502 microversion: 2.1 time: 0.443464 Oct 11 04:28:12.445650 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2083/3982] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:11 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1502 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:12.451188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-753f11e2-0194-4dd4-985c-e7b248824404 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:12.452002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-753f11e2-0194-4dd4-985c-e7b248824404 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:12.465152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753f11e2-0194-4dd4-985c-e7b248824404 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.470424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753f11e2-0194-4dd4-985c-e7b248824404 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.470424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753f11e2-0194-4dd4-985c-e7b248824404 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.470424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753f11e2-0194-4dd4-985c-e7b248824404 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.471057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753f11e2-0194-4dd4-985c-e7b248824404 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.471302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-753f11e2-0194-4dd4-985c-e7b248824404 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.625890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-753f11e2-0194-4dd4-985c-e7b248824404 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:12.640848 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-753f11e2-0194-4dd4-985c-e7b248824404 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1213 microversion: 2.1 time: 0.193307 Oct 11 04:28:12.641713 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2084/3983] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:12 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1213 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:12.649058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3659100d-d77a-4a84-a2af-224c32ef4d6c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:12.649930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3659100d-d77a-4a84-a2af-224c32ef4d6c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:12.650701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-83c03e24-5611-4a8f-810a-92b7c3a11876 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:12.657895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:INSERT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:12.659874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3659100d-d77a-4a84-a2af-224c32ef4d6c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.662485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3659100d-d77a-4a84-a2af-224c32ef4d6c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.662485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3659100d-d77a-4a84-a2af-224c32ef4d6c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.662485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3659100d-d77a-4a84-a2af-224c32ef4d6c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.663142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3659100d-d77a-4a84-a2af-224c32ef4d6c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.663753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3659100d-d77a-4a84-a2af-224c32ef4d6c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.667599 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-83c03e24-5611-4a8f-810a-92b7c3a11876 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1314 microversion: 2.1 time: 0.476935 Oct 11 04:28:12.668730 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1900/3984] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:12 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:12.683323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e1385c7a-ff2a-44bc-a155-18632f7ffb0c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:12.689480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e1385c7a-ff2a-44bc-a155-18632f7ffb0c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:12.734502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1385c7a-ff2a-44bc-a155-18632f7ffb0c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.735129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1385c7a-ff2a-44bc-a155-18632f7ffb0c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.737399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1385c7a-ff2a-44bc-a155-18632f7ffb0c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.742727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1385c7a-ff2a-44bc-a155-18632f7ffb0c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.744386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1385c7a-ff2a-44bc-a155-18632f7ffb0c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.744938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1385c7a-ff2a-44bc-a155-18632f7ffb0c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.886939 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e1385c7a-ff2a-44bc-a155-18632f7ffb0c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action" status: 200 len: 14 microversion: 2.1 time: 0.202773 Oct 11 04:28:12.886939 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1901/3985] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:12 2022] POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action => generated 14 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:28:12.886939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b465448-b11a-4106-b2c9-1a49132666d4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:12.886939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6b465448-b11a-4106-b2c9-1a49132666d4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:12.893603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b465448-b11a-4106-b2c9-1a49132666d4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.894110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b465448-b11a-4106-b2c9-1a49132666d4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.894675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b465448-b11a-4106-b2c9-1a49132666d4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.895396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b465448-b11a-4106-b2c9-1a49132666d4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.895852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b465448-b11a-4106-b2c9-1a49132666d4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.896282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b465448-b11a-4106-b2c9-1a49132666d4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.923248 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3659100d-d77a-4a84-a2af-224c32ef4d6c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4/os-interface" status: 200 len: 1830 microversion: 2.32 time: 0.280154 Oct 11 04:28:12.924511 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2085/3986] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Oct 11 04:28:12 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4/os-interface => generated 1830 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:28:12.930593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-18d24976-d50a-4a84-a0c1-ed8cf1e864f5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:12.931564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-18d24976-d50a-4a84-a0c1-ed8cf1e864f5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:12.946837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18d24976-d50a-4a84-a0c1-ed8cf1e864f5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.954388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18d24976-d50a-4a84-a0c1-ed8cf1e864f5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.954388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18d24976-d50a-4a84-a0c1-ed8cf1e864f5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:12.954388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18d24976-d50a-4a84-a0c1-ed8cf1e864f5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:12.954388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18d24976-d50a-4a84-a0c1-ed8cf1e864f5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:12.954388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18d24976-d50a-4a84-a0c1-ed8cf1e864f5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:13.026607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b465448-b11a-4106-b2c9-1a49132666d4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:13.039306 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b465448-b11a-4106-b2c9-1a49132666d4 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1227 microversion: 2.1 time: 0.163566 Oct 11 04:28:13.040792 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1902/3987] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:12 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1227 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:13.052001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-53711824-c4a0-4043-a725-1c4672d520de tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:13.053667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-53711824-c4a0-4043-a725-1c4672d520de tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:13.061626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53711824-c4a0-4043-a725-1c4672d520de tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:13.066290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53711824-c4a0-4043-a725-1c4672d520de tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:13.066290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53711824-c4a0-4043-a725-1c4672d520de tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:13.066290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53711824-c4a0-4043-a725-1c4672d520de tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:13.066290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53711824-c4a0-4043-a725-1c4672d520de tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:13.066911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53711824-c4a0-4043-a725-1c4672d520de tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:13.285318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-18d24976-d50a-4a84-a0c1-ed8cf1e864f5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:13.292149 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-18d24976-d50a-4a84-a0c1-ed8cf1e864f5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.361885 Oct 11 04:28:13.292813 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2086/3988] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:12 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:13.633911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53711824-c4a0-4043-a725-1c4672d520de tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:13.643047 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-53711824-c4a0-4043-a725-1c4672d520de tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1199 microversion: 2.1 time: 0.600993 Oct 11 04:28:13.647200 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1903/3989] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:13 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1199 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:13.676828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fdbddcf9-521d-4425-a7cf-3a62d57f3b98 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:13.678908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fdbddcf9-521d-4425-a7cf-3a62d57f3b98 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:13.694653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-44fc3611-d35f-43ad-af3f-bdd1f55c468f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:13.695275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-44fc3611-d35f-43ad-af3f-bdd1f55c468f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:13.704666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdbddcf9-521d-4425-a7cf-3a62d57f3b98 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:13.704666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdbddcf9-521d-4425-a7cf-3a62d57f3b98 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:13.704666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdbddcf9-521d-4425-a7cf-3a62d57f3b98 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:13.705331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdbddcf9-521d-4425-a7cf-3a62d57f3b98 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:13.705784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdbddcf9-521d-4425-a7cf-3a62d57f3b98 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:13.707873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44fc3611-d35f-43ad-af3f-bdd1f55c468f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:13.708362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44fc3611-d35f-43ad-af3f-bdd1f55c468f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:13.708794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44fc3611-d35f-43ad-af3f-bdd1f55c468f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:13.712103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44fc3611-d35f-43ad-af3f-bdd1f55c468f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:13.713913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdbddcf9-521d-4425-a7cf-3a62d57f3b98 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:13.714510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44fc3611-d35f-43ad-af3f-bdd1f55c468f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:13.716373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44fc3611-d35f-43ad-af3f-bdd1f55c468f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:13.806229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fdbddcf9-521d-4425-a7cf-3a62d57f3b98 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:13.815291 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fdbddcf9-521d-4425-a7cf-3a62d57f3b98 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1269 microversion: 2.1 time: 0.151171 Oct 11 04:28:13.821617 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2087/3990] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:13 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1269 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:13.899368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-986a29f9-fd44-4ba8-bf24-a8265b9bae90 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:13.899975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-986a29f9-fd44-4ba8-bf24-a8265b9bae90 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:13.908494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-986a29f9-fd44-4ba8-bf24-a8265b9bae90 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:13.908987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-986a29f9-fd44-4ba8-bf24-a8265b9bae90 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:13.909429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-986a29f9-fd44-4ba8-bf24-a8265b9bae90 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:13.910132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-986a29f9-fd44-4ba8-bf24-a8265b9bae90 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:13.910616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-986a29f9-fd44-4ba8-bf24-a8265b9bae90 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:13.911037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-986a29f9-fd44-4ba8-bf24-a8265b9bae90 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:13.936342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-44fc3611-d35f-43ad-af3f-bdd1f55c468f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:13.944824 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-44fc3611-d35f-43ad-af3f-bdd1f55c468f tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1314 microversion: 2.1 time: 0.254219 Oct 11 04:28:13.945394 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1904/3991] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:13 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:14.046353 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-986a29f9-fd44-4ba8-bf24-a8265b9bae90 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action" status: 200 len: 14 microversion: 2.1 time: 0.153172 Oct 11 04:28:14.050954 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2088/3992] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:13 2022] POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:28:14.068128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3af7b822-2011-4ac4-bfa5-5b00de494981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:14.069095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3af7b822-2011-4ac4-bfa5-5b00de494981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:14.080046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af7b822-2011-4ac4-bfa5-5b00de494981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:14.080689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af7b822-2011-4ac4-bfa5-5b00de494981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:14.081298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af7b822-2011-4ac4-bfa5-5b00de494981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:14.082078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af7b822-2011-4ac4-bfa5-5b00de494981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:14.082617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af7b822-2011-4ac4-bfa5-5b00de494981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:14.083067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af7b822-2011-4ac4-bfa5-5b00de494981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:14.169312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3af7b822-2011-4ac4-bfa5-5b00de494981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:14.181158 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3af7b822-2011-4ac4-bfa5-5b00de494981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1219 microversion: 2.1 time: 0.117591 Oct 11 04:28:14.184180 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1905/3993] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:14 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:14.330572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8cc594ab-ec6e-49f5-9a91-aa0021b67ad3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:14.333666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8cc594ab-ec6e-49f5-9a91-aa0021b67ad3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:14.342672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cc594ab-ec6e-49f5-9a91-aa0021b67ad3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:14.344077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cc594ab-ec6e-49f5-9a91-aa0021b67ad3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:14.344733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cc594ab-ec6e-49f5-9a91-aa0021b67ad3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:14.346805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cc594ab-ec6e-49f5-9a91-aa0021b67ad3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:14.347474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cc594ab-ec6e-49f5-9a91-aa0021b67ad3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:14.348270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8cc594ab-ec6e-49f5-9a91-aa0021b67ad3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:14.672574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9487ff97-e15e-45f4-8e71-5bd3a9d95289 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:14.673301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9487ff97-e15e-45f4-8e71-5bd3a9d95289 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:14.684553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9487ff97-e15e-45f4-8e71-5bd3a9d95289 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:14.696257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9487ff97-e15e-45f4-8e71-5bd3a9d95289 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:14.697007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9487ff97-e15e-45f4-8e71-5bd3a9d95289 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:14.699248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9487ff97-e15e-45f4-8e71-5bd3a9d95289 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:14.699901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9487ff97-e15e-45f4-8e71-5bd3a9d95289 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:14.700525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9487ff97-e15e-45f4-8e71-5bd3a9d95289 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:14.754641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8cc594ab-ec6e-49f5-9a91-aa0021b67ad3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:14.769351 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8cc594ab-ec6e-49f5-9a91-aa0021b67ad3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.448996 Oct 11 04:28:14.770582 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2089/3994] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:14 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:14.841069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d5aa98ac-55f2-4119-bd88-151303738b3f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:14.841671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d5aa98ac-55f2-4119-bd88-151303738b3f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:14.871599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5aa98ac-55f2-4119-bd88-151303738b3f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:14.871599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5aa98ac-55f2-4119-bd88-151303738b3f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:14.871599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5aa98ac-55f2-4119-bd88-151303738b3f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:14.871599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5aa98ac-55f2-4119-bd88-151303738b3f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:14.871599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5aa98ac-55f2-4119-bd88-151303738b3f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:14.871599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5aa98ac-55f2-4119-bd88-151303738b3f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:14.966372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d5aa98ac-55f2-4119-bd88-151303738b3f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:14.975241 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d5aa98ac-55f2-4119-bd88-151303738b3f tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1287 microversion: 2.1 time: 0.138401 Oct 11 04:28:14.977027 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2090/3995] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:14 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1287 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:14.990364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-17d76634-371c-4bcf-81de-44b0356e3e5f req-314a2a98-443a-42d2-b59c-6ab9bd34d08d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2314117-db3f-476d-a14a-345f2feb9366", "name": "network-vif-plugged", "status": "completed", "tag": "9d46b09c-5fc6-4a6e-ab74-4ceae2e21015"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:15.012787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9487ff97-e15e-45f4-8e71-5bd3a9d95289 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:15.016898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-17d76634-371c-4bcf-81de-44b0356e3e5f req-314a2a98-443a-42d2-b59c-6ab9bd34d08d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.020359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-17d76634-371c-4bcf-81de-44b0356e3e5f req-314a2a98-443a-42d2-b59c-6ab9bd34d08d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.020359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-17d76634-371c-4bcf-81de-44b0356e3e5f req-314a2a98-443a-42d2-b59c-6ab9bd34d08d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.023444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:15.041153 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9487ff97-e15e-45f4-8e71-5bd3a9d95289 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1383 microversion: 2.1 time: 0.373014 Oct 11 04:28:15.042053 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1906/3996] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:14 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1383 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:15.058065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-58b85455-ae3a-4de0-be6b-b4f1e39fffb0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:15.062990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-58b85455-ae3a-4de0-be6b-b4f1e39fffb0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:15.074468 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-17d76634-371c-4bcf-81de-44b0356e3e5f req-314a2a98-443a-42d2-b59c-6ab9bd34d08d service nova] Creating event network-vif-plugged:9d46b09c-5fc6-4a6e-ab74-4ceae2e21015 for instance a2314117-db3f-476d-a14a-345f2feb9366 on n-h1-860892-1 Oct 11 04:28:15.094598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58b85455-ae3a-4de0-be6b-b4f1e39fffb0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.095039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58b85455-ae3a-4de0-be6b-b4f1e39fffb0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.095548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58b85455-ae3a-4de0-be6b-b4f1e39fffb0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.097173 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-17d76634-371c-4bcf-81de-44b0356e3e5f req-314a2a98-443a-42d2-b59c-6ab9bd34d08d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118706 Oct 11 04:28:15.098365 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2091/3997] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:15.098752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58b85455-ae3a-4de0-be6b-b4f1e39fffb0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.099323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58b85455-ae3a-4de0-be6b-b4f1e39fffb0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.099768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58b85455-ae3a-4de0-be6b-b4f1e39fffb0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.106300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7f6e0d7a-3643-445c-b846-eb5e60dd1ebb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:15.115203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7f6e0d7a-3643-445c-b846-eb5e60dd1ebb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:15.130056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f6e0d7a-3643-445c-b846-eb5e60dd1ebb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.135272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f6e0d7a-3643-445c-b846-eb5e60dd1ebb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.136021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f6e0d7a-3643-445c-b846-eb5e60dd1ebb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.137023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f6e0d7a-3643-445c-b846-eb5e60dd1ebb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.140475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f6e0d7a-3643-445c-b846-eb5e60dd1ebb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.141236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f6e0d7a-3643-445c-b846-eb5e60dd1ebb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.189786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:15.209791 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7f6e0d7a-3643-445c-b846-eb5e60dd1ebb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action" status: 200 len: 14 microversion: 2.1 time: 0.108696 Oct 11 04:28:15.217003 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2092/3998] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:15 2022] POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:28:15.410962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-721ef004-cec4-4b17-9f77-2e75a2dc011f tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:15.412464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-721ef004-cec4-4b17-9f77-2e75a2dc011f tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:15.420357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-721ef004-cec4-4b17-9f77-2e75a2dc011f tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.421880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-721ef004-cec4-4b17-9f77-2e75a2dc011f tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.422638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-721ef004-cec4-4b17-9f77-2e75a2dc011f tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.423582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-721ef004-cec4-4b17-9f77-2e75a2dc011f tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.424254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-721ef004-cec4-4b17-9f77-2e75a2dc011f tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.424723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-721ef004-cec4-4b17-9f77-2e75a2dc011f tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.477086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-58b85455-ae3a-4de0-be6b-b4f1e39fffb0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:15.488482 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-58b85455-ae3a-4de0-be6b-b4f1e39fffb0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1314 microversion: 2.1 time: 0.444301 Oct 11 04:28:15.518216 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1907/3999] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:15 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:15.523477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-736b7ba5-23dd-4d95-8632-01b0b325757d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:15.523477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-736b7ba5-23dd-4d95-8632-01b0b325757d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:15.535641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-736b7ba5-23dd-4d95-8632-01b0b325757d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.538350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-736b7ba5-23dd-4d95-8632-01b0b325757d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.538350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-736b7ba5-23dd-4d95-8632-01b0b325757d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.538350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-736b7ba5-23dd-4d95-8632-01b0b325757d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.539551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-736b7ba5-23dd-4d95-8632-01b0b325757d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.540302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-736b7ba5-23dd-4d95-8632-01b0b325757d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.643812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-736b7ba5-23dd-4d95-8632-01b0b325757d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:15.653719 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-736b7ba5-23dd-4d95-8632-01b0b325757d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1283 microversion: 2.1 time: 0.146400 Oct 11 04:28:15.673376 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1908/4000] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:15 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1283 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:15.682089 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-721ef004-cec4-4b17-9f77-2e75a2dc011f tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1534 microversion: 2.1 time: 0.463668 Oct 11 04:28:15.685449 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2093/4001] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:15 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1534 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:15.708313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d9f3ffd5-870b-4720-8f8d-c391e33482e6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:15.708941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d9f3ffd5-870b-4720-8f8d-c391e33482e6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:15.715942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9f3ffd5-870b-4720-8f8d-c391e33482e6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.716468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9f3ffd5-870b-4720-8f8d-c391e33482e6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.716975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9f3ffd5-870b-4720-8f8d-c391e33482e6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.717691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9f3ffd5-870b-4720-8f8d-c391e33482e6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.718225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9f3ffd5-870b-4720-8f8d-c391e33482e6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.718731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9f3ffd5-870b-4720-8f8d-c391e33482e6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.743690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2234b1c6-e3da-42f6-962e-5fc1d2c31911 req-b55918ba-0fd9-4536-aa6e-f08b6a94e24a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b69a1768-2247-440e-b300-3fc2cfa64db9", "tag": "8f07363b-f557-4b10-81f6-7f6babc45aa1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:15.779090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2234b1c6-e3da-42f6-962e-5fc1d2c31911 req-b55918ba-0fd9-4536-aa6e-f08b6a94e24a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.779864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2234b1c6-e3da-42f6-962e-5fc1d2c31911 req-b55918ba-0fd9-4536-aa6e-f08b6a94e24a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.780910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2234b1c6-e3da-42f6-962e-5fc1d2c31911 req-b55918ba-0fd9-4536-aa6e-f08b6a94e24a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.801027 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2234b1c6-e3da-42f6-962e-5fc1d2c31911 req-b55918ba-0fd9-4536-aa6e-f08b6a94e24a service nova] Creating event network-changed:8f07363b-f557-4b10-81f6-7f6babc45aa1 for instance b69a1768-2247-440e-b300-3fc2cfa64db9 on n-h2-860892-1 Oct 11 04:28:15.807433 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2234b1c6-e3da-42f6-962e-5fc1d2c31911 req-b55918ba-0fd9-4536-aa6e-f08b6a94e24a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067895 Oct 11 04:28:15.808702 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2094/4002] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:15.814698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee0311f9-fc68-4f16-984f-a7dca7b9700f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:15.815716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee0311f9-fc68-4f16-984f-a7dca7b9700f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:15.836514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee0311f9-fc68-4f16-984f-a7dca7b9700f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.837943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee0311f9-fc68-4f16-984f-a7dca7b9700f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.838688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee0311f9-fc68-4f16-984f-a7dca7b9700f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:15.840055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee0311f9-fc68-4f16-984f-a7dca7b9700f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:15.841304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee0311f9-fc68-4f16-984f-a7dca7b9700f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:15.842005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee0311f9-fc68-4f16-984f-a7dca7b9700f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:16.144299 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d9f3ffd5-870b-4720-8f8d-c391e33482e6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1534 microversion: 2.1 time: 0.439685 Oct 11 04:28:16.144899 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1909/4003] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:15 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1534 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:16.149958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-def92bea-540b-4790-bf7b-caaf52977037 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:16.157255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-def92bea-540b-4790-bf7b-caaf52977037 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:16.178077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def92bea-540b-4790-bf7b-caaf52977037 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:16.179007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def92bea-540b-4790-bf7b-caaf52977037 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:16.179523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def92bea-540b-4790-bf7b-caaf52977037 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:16.180337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def92bea-540b-4790-bf7b-caaf52977037 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:16.180868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def92bea-540b-4790-bf7b-caaf52977037 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:16.181368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-def92bea-540b-4790-bf7b-caaf52977037 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:16.433852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-def92bea-540b-4790-bf7b-caaf52977037 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:16.453997 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-def92bea-540b-4790-bf7b-caaf52977037 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1317 microversion: 2.1 time: 0.307754 Oct 11 04:28:16.459661 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1910/4004] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:16 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:16.471174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e0a4919d-2db2-46a5-bb23-b05288b3cfd1 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:16.477843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0a4919d-2db2-46a5-bb23-b05288b3cfd1 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:16.483811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0a4919d-2db2-46a5-bb23-b05288b3cfd1 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:16.483811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0a4919d-2db2-46a5-bb23-b05288b3cfd1 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:16.483811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0a4919d-2db2-46a5-bb23-b05288b3cfd1 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:16.483811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0a4919d-2db2-46a5-bb23-b05288b3cfd1 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:16.483811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0a4919d-2db2-46a5-bb23-b05288b3cfd1 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:16.523905 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e0a4919d-2db2-46a5-bb23-b05288b3cfd1 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.062860 Oct 11 04:28:16.532562 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1911/4005] 10.222.0.26 () {58 vars in 1176 bytes} [Tue Oct 11 04:28:16 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:16.539632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a16dd0d-ea69-468f-8056-76d3d5dd13b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:16.541691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5a16dd0d-ea69-468f-8056-76d3d5dd13b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:16.559707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a16dd0d-ea69-468f-8056-76d3d5dd13b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:16.559707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a16dd0d-ea69-468f-8056-76d3d5dd13b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:16.559707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a16dd0d-ea69-468f-8056-76d3d5dd13b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:16.559707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a16dd0d-ea69-468f-8056-76d3d5dd13b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:16.559707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a16dd0d-ea69-468f-8056-76d3d5dd13b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:16.559707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a16dd0d-ea69-468f-8056-76d3d5dd13b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:16.652233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee0311f9-fc68-4f16-984f-a7dca7b9700f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:16.682692 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee0311f9-fc68-4f16-984f-a7dca7b9700f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1323 microversion: 2.1 time: 0.867314 Oct 11 04:28:16.683067 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5a16dd0d-ea69-468f-8056-76d3d5dd13b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action" status: 200 len: 14 microversion: 2.1 time: 0.146933 Oct 11 04:28:16.683426 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2095/4006] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:15 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1323 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:16.684785 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1912/4007] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:16 2022] POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action => generated 14 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:28:16.689339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7885a98a-c921-486c-ba2f-487486bbe0b0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:16.690113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7885a98a-c921-486c-ba2f-487486bbe0b0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:16.697713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7885a98a-c921-486c-ba2f-487486bbe0b0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:16.698734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7885a98a-c921-486c-ba2f-487486bbe0b0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:16.699337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7885a98a-c921-486c-ba2f-487486bbe0b0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:16.703230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7885a98a-c921-486c-ba2f-487486bbe0b0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:16.703699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8acee0d8-b87f-4f85-8d74-90145fda51a8 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": "n-h1-860892-1", "block_migration": false, "disk_over_commit": false}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:16.704092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7885a98a-c921-486c-ba2f-487486bbe0b0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:16.704709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7885a98a-c921-486c-ba2f-487486bbe0b0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:16.706491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8acee0d8-b87f-4f85-8d74-90145fda51a8 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:16.715324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8acee0d8-b87f-4f85-8d74-90145fda51a8 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:16.716036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8acee0d8-b87f-4f85-8d74-90145fda51a8 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:16.719379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8acee0d8-b87f-4f85-8d74-90145fda51a8 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:16.720420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8acee0d8-b87f-4f85-8d74-90145fda51a8 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:16.721160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8acee0d8-b87f-4f85-8d74-90145fda51a8 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:16.721759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8acee0d8-b87f-4f85-8d74-90145fda51a8 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:16.744013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:16.763112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-8acee0d8-b87f-4f85-8d74-90145fda51a8 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lazy-loading 'flavor' on Instance uuid afa836dc-900d-4ca8-9400-c7beb1739be1 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:28:16.777097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8acee0d8-b87f-4f85-8d74-90145fda51a8 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Going to try to live migrate instance to n-h1-860892-1 {{(pid=120993) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 04:28:17.080076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7885a98a-c921-486c-ba2f-487486bbe0b0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:17.088964 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7885a98a-c921-486c-ba2f-487486bbe0b0 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1314 microversion: 2.1 time: 0.406562 Oct 11 04:28:17.090647 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2096/4008] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:16 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1314 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:17.096142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0aab9952-e244-496f-9f1b-4d15ecff6f1e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:17.096842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0aab9952-e244-496f-9f1b-4d15ecff6f1e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:17.108050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aab9952-e244-496f-9f1b-4d15ecff6f1e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:17.110055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aab9952-e244-496f-9f1b-4d15ecff6f1e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:17.110744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aab9952-e244-496f-9f1b-4d15ecff6f1e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:17.113534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aab9952-e244-496f-9f1b-4d15ecff6f1e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:17.114301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aab9952-e244-496f-9f1b-4d15ecff6f1e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:17.114996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aab9952-e244-496f-9f1b-4d15ecff6f1e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:17.230612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0aab9952-e244-496f-9f1b-4d15ecff6f1e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:17.244937 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0aab9952-e244-496f-9f1b-4d15ecff6f1e tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1281 microversion: 2.1 time: 0.152730 Oct 11 04:28:17.258388 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2097/4009] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:17 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1281 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:17.262346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-70ddc58b-4b9c-4875-a116-fd3877d1cd51 req-f18f7072-f8d5-497e-b5db-9ec5790bc5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36146041-a1da-4b52-b096-9efc8b252767", "name": "network-vif-plugged", "status": "completed", "tag": "004dff7d-ab50-4b90-8380-f8476274dc23"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:17.282752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-70ddc58b-4b9c-4875-a116-fd3877d1cd51 req-f18f7072-f8d5-497e-b5db-9ec5790bc5c2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:17.284413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-70ddc58b-4b9c-4875-a116-fd3877d1cd51 req-f18f7072-f8d5-497e-b5db-9ec5790bc5c2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:17.285435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-70ddc58b-4b9c-4875-a116-fd3877d1cd51 req-f18f7072-f8d5-497e-b5db-9ec5790bc5c2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:17.305889 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-70ddc58b-4b9c-4875-a116-fd3877d1cd51 req-f18f7072-f8d5-497e-b5db-9ec5790bc5c2 service nova] Creating event network-vif-plugged:004dff7d-ab50-4b90-8380-f8476274dc23 for instance 36146041-a1da-4b52-b096-9efc8b252767 on n-h2-860892-1 Oct 11 04:28:17.313318 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-70ddc58b-4b9c-4875-a116-fd3877d1cd51 req-f18f7072-f8d5-497e-b5db-9ec5790bc5c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055506 Oct 11 04:28:17.314225 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2098/4010] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:17.481935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1ff75059-9d93-4527-81f2-00019524eca7 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:17.482681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1ff75059-9d93-4527-81f2-00019524eca7 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:17.489704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ff75059-9d93-4527-81f2-00019524eca7 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:17.490181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ff75059-9d93-4527-81f2-00019524eca7 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:17.490658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ff75059-9d93-4527-81f2-00019524eca7 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:17.491600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ff75059-9d93-4527-81f2-00019524eca7 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:17.491811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ff75059-9d93-4527-81f2-00019524eca7 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:17.492241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ff75059-9d93-4527-81f2-00019524eca7 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:17.791322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1ff75059-9d93-4527-81f2-00019524eca7 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:17.800200 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1ff75059-9d93-4527-81f2-00019524eca7 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1317 microversion: 2.1 time: 0.322828 Oct 11 04:28:17.800868 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2099/4011] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:17 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1317 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:17.815226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0cc4cd9-5f89-401f-a7b1-56e448b480af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:17.818100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d0cc4cd9-5f89-401f-a7b1-56e448b480af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:17.824767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cc4cd9-5f89-401f-a7b1-56e448b480af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:17.825281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cc4cd9-5f89-401f-a7b1-56e448b480af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:17.825720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cc4cd9-5f89-401f-a7b1-56e448b480af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:17.826752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cc4cd9-5f89-401f-a7b1-56e448b480af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:17.827214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cc4cd9-5f89-401f-a7b1-56e448b480af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:17.828170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cc4cd9-5f89-401f-a7b1-56e448b480af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:17.873525 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d0cc4cd9-5f89-401f-a7b1-56e448b480af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action" status: 200 len: 14 microversion: 2.1 time: 0.070092 Oct 11 04:28:17.874928 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2100/4012] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:17 2022] POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action => generated 14 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:28:17.881052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-37cf91f5-3224-405c-af52-4abf49500ca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:17.882170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-37cf91f5-3224-405c-af52-4abf49500ca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:17.895274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37cf91f5-3224-405c-af52-4abf49500ca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:17.898042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37cf91f5-3224-405c-af52-4abf49500ca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:17.898709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37cf91f5-3224-405c-af52-4abf49500ca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:17.899963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37cf91f5-3224-405c-af52-4abf49500ca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:17.900629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37cf91f5-3224-405c-af52-4abf49500ca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:17.901508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37cf91f5-3224-405c-af52-4abf49500ca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:18.196476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-37cf91f5-3224-405c-af52-4abf49500ca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:18.204760 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-37cf91f5-3224-405c-af52-4abf49500ca3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 200 len: 1517 microversion: 2.1 time: 0.328648 Oct 11 04:28:18.205428 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2101/4013] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:17 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 1517 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:18.210410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c23e873-c548-4d9c-9532-604bde80d1e2 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:18.211097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c23e873-c548-4d9c-9532-604bde80d1e2 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:18.219164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c23e873-c548-4d9c-9532-604bde80d1e2 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:18.219709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c23e873-c548-4d9c-9532-604bde80d1e2 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:18.220588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c23e873-c548-4d9c-9532-604bde80d1e2 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:18.220969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c23e873-c548-4d9c-9532-604bde80d1e2 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:18.221361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c23e873-c548-4d9c-9532-604bde80d1e2 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:18.222167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c23e873-c548-4d9c-9532-604bde80d1e2 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:18.379807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c23e873-c548-4d9c-9532-604bde80d1e2 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:18.387997 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c23e873-c548-4d9c-9532-604bde80d1e2 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1314 microversion: 2.1 time: 0.181248 Oct 11 04:28:18.388572 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2102/4014] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:18 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:18.393441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d1b760c-ddba-4d58-af05-072e5a60f886 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:18.394050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d1b760c-ddba-4d58-af05-072e5a60f886 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: 98213491-b0bf-4bbb-aa2f-3399f13caa8a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:18.410361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d1b760c-ddba-4d58-af05-072e5a60f886 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:18.410899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d1b760c-ddba-4d58-af05-072e5a60f886 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:18.411864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d1b760c-ddba-4d58-af05-072e5a60f886 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:18.412646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d1b760c-ddba-4d58-af05-072e5a60f886 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:18.413104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d1b760c-ddba-4d58-af05-072e5a60f886 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:18.413537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d1b760c-ddba-4d58-af05-072e5a60f886 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:18.654050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d1b760c-ddba-4d58-af05-072e5a60f886 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:18.663314 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d1b760c-ddba-4d58-af05-072e5a60f886 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a" status: 200 len: 1516 microversion: 2.1 time: 0.273571 Oct 11 04:28:18.664047 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2103/4015] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:18 2022] GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a => generated 1516 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:18.668762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d474a67-61f2-4c09-bd87-936f08264412 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:18.673185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d474a67-61f2-4c09-bd87-936f08264412 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:18.677005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d474a67-61f2-4c09-bd87-936f08264412 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:18.677593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d474a67-61f2-4c09-bd87-936f08264412 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:18.678504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d474a67-61f2-4c09-bd87-936f08264412 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:18.679476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d474a67-61f2-4c09-bd87-936f08264412 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:18.679993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d474a67-61f2-4c09-bd87-936f08264412 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:18.680428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d474a67-61f2-4c09-bd87-936f08264412 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:18.992315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d474a67-61f2-4c09-bd87-936f08264412 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:19.002317 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d474a67-61f2-4c09-bd87-936f08264412 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.337204 Oct 11 04:28:19.003243 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2104/4016] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:18 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:19.013341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-262d83ff-3480-4e54-ac8f-7f87bc4cc97e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:19.014409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-262d83ff-3480-4e54-ac8f-7f87bc4cc97e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: d074edb8-863b-48c6-900d-2bcc2c5e23f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:19.024604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262d83ff-3480-4e54-ac8f-7f87bc4cc97e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:19.025223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262d83ff-3480-4e54-ac8f-7f87bc4cc97e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:19.026058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262d83ff-3480-4e54-ac8f-7f87bc4cc97e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:19.027024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262d83ff-3480-4e54-ac8f-7f87bc4cc97e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:19.027585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262d83ff-3480-4e54-ac8f-7f87bc4cc97e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:19.028497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262d83ff-3480-4e54-ac8f-7f87bc4cc97e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:19.426892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-262d83ff-3480-4e54-ac8f-7f87bc4cc97e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:19.435122 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-262d83ff-3480-4e54-ac8f-7f87bc4cc97e tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6" status: 200 len: 1516 microversion: 2.1 time: 0.430627 Oct 11 04:28:19.435709 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2105/4017] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:19 2022] GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 => generated 1516 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:19.440987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e2d35a20-c71e-47db-b91e-ee91bbf2592a req-f1701362-7ce2-4d76-bbe6-9e4b8a1d2b11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "036bd026-451b-47dc-83f7-8ece730155b4", "tag": "4442371d-53b1-425c-83e7-d71425c37735"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:19.451441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e2d35a20-c71e-47db-b91e-ee91bbf2592a req-f1701362-7ce2-4d76-bbe6-9e4b8a1d2b11 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:19.452322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e2d35a20-c71e-47db-b91e-ee91bbf2592a req-f1701362-7ce2-4d76-bbe6-9e4b8a1d2b11 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:19.452523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e2d35a20-c71e-47db-b91e-ee91bbf2592a req-f1701362-7ce2-4d76-bbe6-9e4b8a1d2b11 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:19.469418 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e2d35a20-c71e-47db-b91e-ee91bbf2592a req-f1701362-7ce2-4d76-bbe6-9e4b8a1d2b11 service nova] Creating event network-changed:4442371d-53b1-425c-83e7-d71425c37735 for instance 036bd026-451b-47dc-83f7-8ece730155b4 on n-h1-860892-1 Oct 11 04:28:19.475278 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e2d35a20-c71e-47db-b91e-ee91bbf2592a req-f1701362-7ce2-4d76-bbe6-9e4b8a1d2b11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038301 Oct 11 04:28:19.476205 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2106/4018] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:19.482099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef4d78e2-2e6d-406b-8f27-9b637fb466af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:19.483031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef4d78e2-2e6d-406b-8f27-9b637fb466af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:19.490738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4d78e2-2e6d-406b-8f27-9b637fb466af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:19.491091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4d78e2-2e6d-406b-8f27-9b637fb466af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:19.500174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4d78e2-2e6d-406b-8f27-9b637fb466af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:19.500174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4d78e2-2e6d-406b-8f27-9b637fb466af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:19.500174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4d78e2-2e6d-406b-8f27-9b637fb466af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:19.500174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef4d78e2-2e6d-406b-8f27-9b637fb466af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:19.709447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef4d78e2-2e6d-406b-8f27-9b637fb466af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:19.719944 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef4d78e2-2e6d-406b-8f27-9b637fb466af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1317 microversion: 2.1 time: 0.242407 Oct 11 04:28:19.723424 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2107/4019] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:19 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:19.728636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d73d1fc0-b9ea-4673-bddf-a59d1abf1084 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:19.732996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d73d1fc0-b9ea-4673-bddf-a59d1abf1084 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:19.743003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d73d1fc0-b9ea-4673-bddf-a59d1abf1084 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:19.743810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d73d1fc0-b9ea-4673-bddf-a59d1abf1084 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:19.744632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d73d1fc0-b9ea-4673-bddf-a59d1abf1084 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:19.745892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d73d1fc0-b9ea-4673-bddf-a59d1abf1084 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:19.746604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d73d1fc0-b9ea-4673-bddf-a59d1abf1084 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:19.747282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d73d1fc0-b9ea-4673-bddf-a59d1abf1084 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:19.807091 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d73d1fc0-b9ea-4673-bddf-a59d1abf1084 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action" status: 200 len: 14 microversion: 2.1 time: 0.083980 Oct 11 04:28:19.808197 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2108/4020] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:19 2022] POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:28:19.816655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-752b1ab9-92c0-4bc6-8445-f80f5ffa564e tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:19.817638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-752b1ab9-92c0-4bc6-8445-f80f5ffa564e tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:19.826390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-752b1ab9-92c0-4bc6-8445-f80f5ffa564e tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:19.827523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-752b1ab9-92c0-4bc6-8445-f80f5ffa564e tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:19.828192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-752b1ab9-92c0-4bc6-8445-f80f5ffa564e tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:19.829133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-752b1ab9-92c0-4bc6-8445-f80f5ffa564e tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:19.829813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-752b1ab9-92c0-4bc6-8445-f80f5ffa564e tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:19.830515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-752b1ab9-92c0-4bc6-8445-f80f5ffa564e tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.097376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-752b1ab9-92c0-4bc6-8445-f80f5ffa564e tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:20.106812 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-752b1ab9-92c0-4bc6-8445-f80f5ffa564e tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1314 microversion: 2.1 time: 0.297321 Oct 11 04:28:20.107472 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2109/4021] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:19 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:20.113624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-516939a5-c813-4a57-834b-7dc9c2a7e920 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:20.114406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-516939a5-c813-4a57-834b-7dc9c2a7e920 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: d074edb8-863b-48c6-900d-2bcc2c5e23f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:20.122108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516939a5-c813-4a57-834b-7dc9c2a7e920 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.122855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516939a5-c813-4a57-834b-7dc9c2a7e920 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.123405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516939a5-c813-4a57-834b-7dc9c2a7e920 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.124197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516939a5-c813-4a57-834b-7dc9c2a7e920 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.125122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516939a5-c813-4a57-834b-7dc9c2a7e920 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.125753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-516939a5-c813-4a57-834b-7dc9c2a7e920 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.155693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-516939a5-c813-4a57-834b-7dc9c2a7e920 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: d074edb8-863b-48c6-900d-2bcc2c5e23f6] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:28:20.282842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:20.376849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=10 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:20.537961 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-516939a5-c813-4a57-834b-7dc9c2a7e920 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6" status: 204 len: 0 microversion: 2.1 time: 0.428364 Oct 11 04:28:20.538967 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2110/4022] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:28:20 2022] DELETE /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:28:20.545441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1c0c9ada-23db-4f30-8617-40d2794e072c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:20.546160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1c0c9ada-23db-4f30-8617-40d2794e072c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:20.554040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c0c9ada-23db-4f30-8617-40d2794e072c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.555696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c0c9ada-23db-4f30-8617-40d2794e072c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.555696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c0c9ada-23db-4f30-8617-40d2794e072c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.555952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c0c9ada-23db-4f30-8617-40d2794e072c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.556324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c0c9ada-23db-4f30-8617-40d2794e072c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.556755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c0c9ada-23db-4f30-8617-40d2794e072c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.693950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1c0c9ada-23db-4f30-8617-40d2794e072c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:20.701544 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1c0c9ada-23db-4f30-8617-40d2794e072c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.161064 Oct 11 04:28:20.702107 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2111/4023] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:20 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:20.707003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-14eff06e-05c7-4ba1-af2d-61a7f7077bb8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:20.707603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-14eff06e-05c7-4ba1-af2d-61a7f7077bb8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: d074edb8-863b-48c6-900d-2bcc2c5e23f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:20.713101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14eff06e-05c7-4ba1-af2d-61a7f7077bb8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.713575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14eff06e-05c7-4ba1-af2d-61a7f7077bb8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.714007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14eff06e-05c7-4ba1-af2d-61a7f7077bb8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.714773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14eff06e-05c7-4ba1-af2d-61a7f7077bb8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.715224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14eff06e-05c7-4ba1-af2d-61a7f7077bb8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.715649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14eff06e-05c7-4ba1-af2d-61a7f7077bb8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.751454 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8acee0d8-b87f-4f85-8d74-90145fda51a8 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1/action" status: 202 len: 0 microversion: 2.1 time: 4.065358 Oct 11 04:28:20.752075 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1913/4024] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:16 2022] POST /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1/action => generated 0 bytes in 4067 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:28:20.757007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d64d673a-2c64-4ae4-b3ed-a3a3a4ecc6e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:20.757646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d64d673a-2c64-4ae4-b3ed-a3a3a4ecc6e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:20.765619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d64d673a-2c64-4ae4-b3ed-a3a3a4ecc6e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.766105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d64d673a-2c64-4ae4-b3ed-a3a3a4ecc6e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.766565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d64d673a-2c64-4ae4-b3ed-a3a3a4ecc6e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.767491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d64d673a-2c64-4ae4-b3ed-a3a3a4ecc6e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.767964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d64d673a-2c64-4ae4-b3ed-a3a3a4ecc6e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.768375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d64d673a-2c64-4ae4-b3ed-a3a3a4ecc6e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.873420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-14eff06e-05c7-4ba1-af2d-61a7f7077bb8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:20.883105 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-14eff06e-05c7-4ba1-af2d-61a7f7077bb8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6" status: 200 len: 1522 microversion: 2.1 time: 0.179415 Oct 11 04:28:20.883987 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2112/4025] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:20 2022] GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:20.888671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-da9457a1-e3a0-4ce0-86ca-1e0eb9273aba tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:20.889279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-da9457a1-e3a0-4ce0-86ca-1e0eb9273aba tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:20.899794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da9457a1-e3a0-4ce0-86ca-1e0eb9273aba tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.899794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da9457a1-e3a0-4ce0-86ca-1e0eb9273aba tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.899794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da9457a1-e3a0-4ce0-86ca-1e0eb9273aba tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.899794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da9457a1-e3a0-4ce0-86ca-1e0eb9273aba tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.899794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da9457a1-e3a0-4ce0-86ca-1e0eb9273aba tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.899794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da9457a1-e3a0-4ce0-86ca-1e0eb9273aba tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.920436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d64d673a-2c64-4ae4-b3ed-a3a3a4ecc6e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:20.928755 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d64d673a-2c64-4ae4-b3ed-a3a3a4ecc6e8 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1317 microversion: 2.1 time: 0.175661 Oct 11 04:28:20.929670 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1914/4026] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:20 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1317 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:20.934573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f0ee75a8-f00d-4bb7-8f9b-e4e3cce272ed tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:20.937120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f0ee75a8-f00d-4bb7-8f9b-e4e3cce272ed tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:20.943588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ee75a8-f00d-4bb7-8f9b-e4e3cce272ed tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.944302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ee75a8-f00d-4bb7-8f9b-e4e3cce272ed tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.944975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ee75a8-f00d-4bb7-8f9b-e4e3cce272ed tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:20.945667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ee75a8-f00d-4bb7-8f9b-e4e3cce272ed tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:20.946115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ee75a8-f00d-4bb7-8f9b-e4e3cce272ed tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:20.946568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ee75a8-f00d-4bb7-8f9b-e4e3cce272ed tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:21.040777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da9457a1-e3a0-4ce0-86ca-1e0eb9273aba tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:21.048598 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-da9457a1-e3a0-4ce0-86ca-1e0eb9273aba tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.163656 Oct 11 04:28:21.049170 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2113/4027] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:20 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:21.131778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0502beef-0572-43e3-97cb-5f720e610fea tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:21.132513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0502beef-0572-43e3-97cb-5f720e610fea tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:21.138645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0502beef-0572-43e3-97cb-5f720e610fea tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:21.139132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0502beef-0572-43e3-97cb-5f720e610fea tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:21.139570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0502beef-0572-43e3-97cb-5f720e610fea tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:21.140865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0502beef-0572-43e3-97cb-5f720e610fea tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:21.141323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0502beef-0572-43e3-97cb-5f720e610fea tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:21.141749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0502beef-0572-43e3-97cb-5f720e610fea tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:21.284574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0502beef-0572-43e3-97cb-5f720e610fea tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:21.294966 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0502beef-0572-43e3-97cb-5f720e610fea tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1499 microversion: 2.1 time: 0.167780 Oct 11 04:28:21.296620 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2114/4028] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:21 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1499 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:21.492055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-65c79773-9e39-4226-8882-ff0aa4e4d4dc req-9ad722b7-47a1-48de-8b4b-816b521dfa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "806caeae-7326-4b20-956d-4bb4224bd5f4", "tag": "4bac0c4e-40cf-4498-a5c9-3d6a272f1f38"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:21.502694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-65c79773-9e39-4226-8882-ff0aa4e4d4dc req-9ad722b7-47a1-48de-8b4b-816b521dfa06 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:21.503172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-65c79773-9e39-4226-8882-ff0aa4e4d4dc req-9ad722b7-47a1-48de-8b4b-816b521dfa06 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:21.503611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-65c79773-9e39-4226-8882-ff0aa4e4d4dc req-9ad722b7-47a1-48de-8b4b-816b521dfa06 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:21.515328 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-65c79773-9e39-4226-8882-ff0aa4e4d4dc req-9ad722b7-47a1-48de-8b4b-816b521dfa06 service nova] Creating event network-changed:4bac0c4e-40cf-4498-a5c9-3d6a272f1f38 for instance 806caeae-7326-4b20-956d-4bb4224bd5f4 on n-h1-860892-1 Oct 11 04:28:21.520147 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-65c79773-9e39-4226-8882-ff0aa4e4d4dc req-9ad722b7-47a1-48de-8b4b-816b521dfa06 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031781 Oct 11 04:28:21.520823 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2115/4029] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:28:21.561639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=18 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:21.726117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f294684a-46a1-4455-a75a-c96c21fd87c0 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:21.727016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f294684a-46a1-4455-a75a-c96c21fd87c0 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:21.734260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f294684a-46a1-4455-a75a-c96c21fd87c0 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:21.734751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f294684a-46a1-4455-a75a-c96c21fd87c0 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:21.735192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f294684a-46a1-4455-a75a-c96c21fd87c0 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:21.735889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f294684a-46a1-4455-a75a-c96c21fd87c0 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:21.736400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f294684a-46a1-4455-a75a-c96c21fd87c0 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:21.736891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f294684a-46a1-4455-a75a-c96c21fd87c0 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:21.878994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f294684a-46a1-4455-a75a-c96c21fd87c0 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:21.887176 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f294684a-46a1-4455-a75a-c96c21fd87c0 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.165495 Oct 11 04:28:21.887597 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2116/4030] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:21 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:21.911558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-26524259-6d43-4422-8459-4ca13f422b77 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:21.911558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-26524259-6d43-4422-8459-4ca13f422b77 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: d074edb8-863b-48c6-900d-2bcc2c5e23f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:21.915746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26524259-6d43-4422-8459-4ca13f422b77 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:21.916244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26524259-6d43-4422-8459-4ca13f422b77 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:21.916683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26524259-6d43-4422-8459-4ca13f422b77 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:21.917388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26524259-6d43-4422-8459-4ca13f422b77 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:21.917845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26524259-6d43-4422-8459-4ca13f422b77 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:21.918300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26524259-6d43-4422-8459-4ca13f422b77 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:22.014327 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f0ee75a8-f00d-4bb7-8f9b-e4e3cce272ed tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action" status: 200 len: 14 microversion: 2.1 time: 1.082997 Oct 11 04:28:22.016571 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1915/4031] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:20 2022] POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action => generated 14 bytes in 1086 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:28:22.022516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b5326fd-a9ee-49c2-877d-5fbf8a3633e6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:22.023515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6b5326fd-a9ee-49c2-877d-5fbf8a3633e6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:22.040311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b5326fd-a9ee-49c2-877d-5fbf8a3633e6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:22.041204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b5326fd-a9ee-49c2-877d-5fbf8a3633e6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:22.041902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b5326fd-a9ee-49c2-877d-5fbf8a3633e6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:22.045519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b5326fd-a9ee-49c2-877d-5fbf8a3633e6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:22.046398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b5326fd-a9ee-49c2-877d-5fbf8a3633e6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:22.047655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b5326fd-a9ee-49c2-877d-5fbf8a3633e6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:22.404700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-26524259-6d43-4422-8459-4ca13f422b77 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:22.414591 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-26524259-6d43-4422-8459-4ca13f422b77 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6" status: 200 len: 1522 microversion: 2.1 time: 0.510349 Oct 11 04:28:22.422295 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2117/4032] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:21 2022] GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 => generated 1522 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:22.433940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b6ecbfab-5513-49c5-9e0e-f2a45b267f8f req-5e469e7f-664c-4a72-8b75-47fd5fa8758b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69a1768-2247-440e-b300-3fc2cfa64db9", "name": "network-vif-plugged", "status": "completed", "tag": "8f07363b-f557-4b10-81f6-7f6babc45aa1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:22.447082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6ecbfab-5513-49c5-9e0e-f2a45b267f8f req-5e469e7f-664c-4a72-8b75-47fd5fa8758b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:22.447994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6ecbfab-5513-49c5-9e0e-f2a45b267f8f req-5e469e7f-664c-4a72-8b75-47fd5fa8758b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:22.448515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6ecbfab-5513-49c5-9e0e-f2a45b267f8f req-5e469e7f-664c-4a72-8b75-47fd5fa8758b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:22.467219 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b6ecbfab-5513-49c5-9e0e-f2a45b267f8f req-5e469e7f-664c-4a72-8b75-47fd5fa8758b service nova] Creating event network-vif-plugged:8f07363b-f557-4b10-81f6-7f6babc45aa1 for instance b69a1768-2247-440e-b300-3fc2cfa64db9 on n-h2-860892-1 Oct 11 04:28:22.474970 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b6ecbfab-5513-49c5-9e0e-f2a45b267f8f req-5e469e7f-664c-4a72-8b75-47fd5fa8758b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057834 Oct 11 04:28:22.479606 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2118/4033] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:22.519936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4a12edcd-fc2c-4f3c-bae0-ead598ec7743 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:22.522660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4a12edcd-fc2c-4f3c-bae0-ead598ec7743 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:22.538336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a12edcd-fc2c-4f3c-bae0-ead598ec7743 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:22.543234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a12edcd-fc2c-4f3c-bae0-ead598ec7743 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:22.545936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a12edcd-fc2c-4f3c-bae0-ead598ec7743 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:22.545936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a12edcd-fc2c-4f3c-bae0-ead598ec7743 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:22.545936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a12edcd-fc2c-4f3c-bae0-ead598ec7743 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:22.545936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a12edcd-fc2c-4f3c-bae0-ead598ec7743 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:22.601247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b5326fd-a9ee-49c2-877d-5fbf8a3633e6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:22.611375 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b5326fd-a9ee-49c2-877d-5fbf8a3633e6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1317 microversion: 2.1 time: 0.593264 Oct 11 04:28:22.614762 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1916/4034] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:22 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1317 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:22.629217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e732bfbc-6ecd-4cee-9e50-45be570c19a7 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:22.632102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e732bfbc-6ecd-4cee-9e50-45be570c19a7 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:22.637069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e732bfbc-6ecd-4cee-9e50-45be570c19a7 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:22.638590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e732bfbc-6ecd-4cee-9e50-45be570c19a7 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:22.639132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e732bfbc-6ecd-4cee-9e50-45be570c19a7 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:22.639955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e732bfbc-6ecd-4cee-9e50-45be570c19a7 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:22.640603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e732bfbc-6ecd-4cee-9e50-45be570c19a7 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:22.641365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e732bfbc-6ecd-4cee-9e50-45be570c19a7 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:22.680509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e732bfbc-6ecd-4cee-9e50-45be570c19a7 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:28:22.958980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4a12edcd-fc2c-4f3c-bae0-ead598ec7743 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:22.972481 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4a12edcd-fc2c-4f3c-bae0-ead598ec7743 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.491288 Oct 11 04:28:22.973777 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2119/4035] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:22 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:22.981927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ed73723f-7a69-436f-aee5-1c087ee5e981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:22.983176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ed73723f-7a69-436f-aee5-1c087ee5e981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:23.005659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed73723f-7a69-436f-aee5-1c087ee5e981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:23.007557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed73723f-7a69-436f-aee5-1c087ee5e981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:23.009152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed73723f-7a69-436f-aee5-1c087ee5e981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:23.010346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed73723f-7a69-436f-aee5-1c087ee5e981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:23.012299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed73723f-7a69-436f-aee5-1c087ee5e981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:23.014226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed73723f-7a69-436f-aee5-1c087ee5e981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:23.040349 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e732bfbc-6ecd-4cee-9e50-45be570c19a7 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "DELETE /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 204 len: 0 microversion: 2.1 time: 0.423773 Oct 11 04:28:23.043296 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1917/4036] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:28:22 2022] DELETE /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:28:23.051283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-86411273-1049-48c5-907f-c9208d7dd448 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:23.058785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-86411273-1049-48c5-907f-c9208d7dd448 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:23.074596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86411273-1049-48c5-907f-c9208d7dd448 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:23.080057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86411273-1049-48c5-907f-c9208d7dd448 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:23.080737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86411273-1049-48c5-907f-c9208d7dd448 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:23.081499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86411273-1049-48c5-907f-c9208d7dd448 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:23.085046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86411273-1049-48c5-907f-c9208d7dd448 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:23.089307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86411273-1049-48c5-907f-c9208d7dd448 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:23.179863 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-86411273-1049-48c5-907f-c9208d7dd448 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action" status: 200 len: 14 microversion: 2.1 time: 0.134565 Oct 11 04:28:23.183061 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1918/4037] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:23 2022] POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action => generated 14 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:28:23.201644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d34fbf00-a9fc-40dd-abce-6c4447c77a07 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:23.204549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d34fbf00-a9fc-40dd-abce-6c4447c77a07 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:23.226179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d34fbf00-a9fc-40dd-abce-6c4447c77a07 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:23.231767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d34fbf00-a9fc-40dd-abce-6c4447c77a07 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:23.231767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d34fbf00-a9fc-40dd-abce-6c4447c77a07 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:23.231767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d34fbf00-a9fc-40dd-abce-6c4447c77a07 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:23.231767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d34fbf00-a9fc-40dd-abce-6c4447c77a07 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:23.231767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d34fbf00-a9fc-40dd-abce-6c4447c77a07 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:23.754779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d34fbf00-a9fc-40dd-abce-6c4447c77a07 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:23.763823 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d34fbf00-a9fc-40dd-abce-6c4447c77a07 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1505 microversion: 2.1 time: 0.575307 Oct 11 04:28:23.764395 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1919/4038] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:23 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1505 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:23.770044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-20971579-747c-4c5b-8ec8-110a92482f74 req-6aba4d6b-a218-4ebf-8fea-3e84cba87a49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d074edb8-863b-48c6-900d-2bcc2c5e23f6", "name": "network-vif-deleted", "tag": "6dfb7c11-7d5b-4133-91e0-e0fd02dad6c6"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:23.781498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-20971579-747c-4c5b-8ec8-110a92482f74 req-6aba4d6b-a218-4ebf-8fea-3e84cba87a49 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:23.781978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-20971579-747c-4c5b-8ec8-110a92482f74 req-6aba4d6b-a218-4ebf-8fea-3e84cba87a49 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:23.782468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-20971579-747c-4c5b-8ec8-110a92482f74 req-6aba4d6b-a218-4ebf-8fea-3e84cba87a49 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:23.793661 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-20971579-747c-4c5b-8ec8-110a92482f74 req-6aba4d6b-a218-4ebf-8fea-3e84cba87a49 service nova] Creating event network-vif-deleted:6dfb7c11-7d5b-4133-91e0-e0fd02dad6c6 for instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 on n-h2-860892-1 Oct 11 04:28:23.803456 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-20971579-747c-4c5b-8ec8-110a92482f74 req-6aba4d6b-a218-4ebf-8fea-3e84cba87a49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032630 Oct 11 04:28:23.803456 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1920/4039] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:23.803819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ed73723f-7a69-436f-aee5-1c087ee5e981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:23.807909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9709e414-32d9-4d5a-915c-e0598cfdb258 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:23.808622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9709e414-32d9-4d5a-915c-e0598cfdb258 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: d074edb8-863b-48c6-900d-2bcc2c5e23f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:23.810619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:23.811511 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ed73723f-7a69-436f-aee5-1c087ee5e981 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.835106 Oct 11 04:28:23.812161 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2120/4040] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:22 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:23.816368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9709e414-32d9-4d5a-915c-e0598cfdb258 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:23.817004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9709e414-32d9-4d5a-915c-e0598cfdb258 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:23.817373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9709e414-32d9-4d5a-915c-e0598cfdb258 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:23.818086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9709e414-32d9-4d5a-915c-e0598cfdb258 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:23.819041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9709e414-32d9-4d5a-915c-e0598cfdb258 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:23.819041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9709e414-32d9-4d5a-915c-e0598cfdb258 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:23.828301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5362f2b6-6879-48da-96fc-884e20a18867 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:23.829063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5362f2b6-6879-48da-96fc-884e20a18867 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:23.838291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362f2b6-6879-48da-96fc-884e20a18867 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:23.843676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362f2b6-6879-48da-96fc-884e20a18867 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:23.843676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362f2b6-6879-48da-96fc-884e20a18867 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:23.843676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362f2b6-6879-48da-96fc-884e20a18867 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:23.843676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362f2b6-6879-48da-96fc-884e20a18867 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:23.843676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5362f2b6-6879-48da-96fc-884e20a18867 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:23.892133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9709e414-32d9-4d5a-915c-e0598cfdb258 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:23.901117 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9709e414-32d9-4d5a-915c-e0598cfdb258 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6" status: 200 len: 1308 microversion: 2.1 time: 0.097298 Oct 11 04:28:23.901890 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1921/4041] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:23 2022] GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:23.997167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5416a10e-beb2-4d1f-b329-125a88eb08aa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:23.997839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5416a10e-beb2-4d1f-b329-125a88eb08aa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:24.003946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5416a10e-beb2-4d1f-b329-125a88eb08aa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.004436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5416a10e-beb2-4d1f-b329-125a88eb08aa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.004872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5416a10e-beb2-4d1f-b329-125a88eb08aa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.005562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5416a10e-beb2-4d1f-b329-125a88eb08aa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.006008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5416a10e-beb2-4d1f-b329-125a88eb08aa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.006999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5416a10e-beb2-4d1f-b329-125a88eb08aa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.011596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:24.150358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5416a10e-beb2-4d1f-b329-125a88eb08aa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:24.153167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5362f2b6-6879-48da-96fc-884e20a18867 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:24.160744 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5416a10e-beb2-4d1f-b329-125a88eb08aa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.167313 Oct 11 04:28:24.163162 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1922/4042] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:23 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:24.166730 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5362f2b6-6879-48da-96fc-884e20a18867 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1317 microversion: 2.1 time: 0.352814 Oct 11 04:28:24.167513 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2121/4043] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:23 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1317 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:24.194130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9611e957-1aa1-4ce5-8e32-1cfef63018e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:24.196773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9611e957-1aa1-4ce5-8e32-1cfef63018e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:24.203419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9611e957-1aa1-4ce5-8e32-1cfef63018e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.203919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9611e957-1aa1-4ce5-8e32-1cfef63018e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.204367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9611e957-1aa1-4ce5-8e32-1cfef63018e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.205075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9611e957-1aa1-4ce5-8e32-1cfef63018e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.205539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9611e957-1aa1-4ce5-8e32-1cfef63018e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.206100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9611e957-1aa1-4ce5-8e32-1cfef63018e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.294008 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9611e957-1aa1-4ce5-8e32-1cfef63018e8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action" status: 200 len: 8207 microversion: 2.1 time: 0.103637 Oct 11 04:28:24.294991 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1923/4044] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:24 2022] POST /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba/action => generated 8207 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:24.304560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1f898d6e-8b06-4c0a-baa5-9d247e5c7bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:24.305177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1f898d6e-8b06-4c0a-baa5-9d247e5c7bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:24.313048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f898d6e-8b06-4c0a-baa5-9d247e5c7bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.313048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f898d6e-8b06-4c0a-baa5-9d247e5c7bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.313330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f898d6e-8b06-4c0a-baa5-9d247e5c7bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.313979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f898d6e-8b06-4c0a-baa5-9d247e5c7bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.314521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f898d6e-8b06-4c0a-baa5-9d247e5c7bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.314959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f898d6e-8b06-4c0a-baa5-9d247e5c7bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.473923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1f898d6e-8b06-4c0a-baa5-9d247e5c7bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:24.482017 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1f898d6e-8b06-4c0a-baa5-9d247e5c7bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.181443 Oct 11 04:28:24.486217 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2122/4045] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:24 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:24.512996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c63ca96d-e04f-4454-b6fa-6b501eaf5108 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:24.514309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c63ca96d-e04f-4454-b6fa-6b501eaf5108 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:24.524141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c63ca96d-e04f-4454-b6fa-6b501eaf5108 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.526090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c63ca96d-e04f-4454-b6fa-6b501eaf5108 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.526809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c63ca96d-e04f-4454-b6fa-6b501eaf5108 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.527725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c63ca96d-e04f-4454-b6fa-6b501eaf5108 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.528291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c63ca96d-e04f-4454-b6fa-6b501eaf5108 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.528844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c63ca96d-e04f-4454-b6fa-6b501eaf5108 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.695650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c63ca96d-e04f-4454-b6fa-6b501eaf5108 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:24.704217 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c63ca96d-e04f-4454-b6fa-6b501eaf5108 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.196173 Oct 11 04:28:24.704771 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1924/4046] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:24 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:24.727064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3dee2d83-bb20-44ff-8dad-7980db54b08b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:24.727761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3dee2d83-bb20-44ff-8dad-7980db54b08b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:24.734254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dee2d83-bb20-44ff-8dad-7980db54b08b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.734777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dee2d83-bb20-44ff-8dad-7980db54b08b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.735264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dee2d83-bb20-44ff-8dad-7980db54b08b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.736020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dee2d83-bb20-44ff-8dad-7980db54b08b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.736490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dee2d83-bb20-44ff-8dad-7980db54b08b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.736983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dee2d83-bb20-44ff-8dad-7980db54b08b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.791254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3138c5d-b727-4009-95fe-9f5cd4ca688b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:24.792776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3138c5d-b727-4009-95fe-9f5cd4ca688b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:24.809690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3138c5d-b727-4009-95fe-9f5cd4ca688b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.809690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3138c5d-b727-4009-95fe-9f5cd4ca688b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.809690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3138c5d-b727-4009-95fe-9f5cd4ca688b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.809690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3138c5d-b727-4009-95fe-9f5cd4ca688b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.810950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3138c5d-b727-4009-95fe-9f5cd4ca688b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.812476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3138c5d-b727-4009-95fe-9f5cd4ca688b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.958670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3dee2d83-bb20-44ff-8dad-7980db54b08b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:24.968001 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3dee2d83-bb20-44ff-8dad-7980db54b08b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.244901 Oct 11 04:28:24.969920 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2123/4047] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:24 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:24.975605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-52f2b135-43f2-4805-9766-e7e742220c99 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:24.976565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-52f2b135-43f2-4805-9766-e7e742220c99 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:24.983993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52f2b135-43f2-4805-9766-e7e742220c99 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.984810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52f2b135-43f2-4805-9766-e7e742220c99 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.985521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52f2b135-43f2-4805-9766-e7e742220c99 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:24.986521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52f2b135-43f2-4805-9766-e7e742220c99 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:24.987243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52f2b135-43f2-4805-9766-e7e742220c99 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:24.987919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52f2b135-43f2-4805-9766-e7e742220c99 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.138025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e3138c5d-b727-4009-95fe-9f5cd4ca688b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:25.149093 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3138c5d-b727-4009-95fe-9f5cd4ca688b tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1505 microversion: 2.1 time: 0.364184 Oct 11 04:28:25.160406 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1925/4048] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:24 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1505 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:25.181088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-52f2b135-43f2-4805-9766-e7e742220c99 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:25.181666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:25.182490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: d074edb8-863b-48c6-900d-2bcc2c5e23f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:25.193795 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-52f2b135-43f2-4805-9766-e7e742220c99 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.222472 Oct 11 04:28:25.194572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:25.195247 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2124/4049] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:24 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:25.195560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:25.196395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.197207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:25.198427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:25.199210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.200597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7e1602d7-8b78-4d6f-9e32-3423642a9f95 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:25.201394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7e1602d7-8b78-4d6f-9e32-3423642a9f95 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:25.208966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1602d7-8b78-4d6f-9e32-3423642a9f95 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:25.209516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1602d7-8b78-4d6f-9e32-3423642a9f95 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:25.210077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1602d7-8b78-4d6f-9e32-3423642a9f95 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.211039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1602d7-8b78-4d6f-9e32-3423642a9f95 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:25.211496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1602d7-8b78-4d6f-9e32-3423642a9f95 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:25.212162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1602d7-8b78-4d6f-9e32-3423642a9f95 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.279595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:25.280130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:25.282703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.283357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lazy-loading 'fault' on Instance uuid d074edb8-863b-48c6-900d-2bcc2c5e23f6 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:28:25.377304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:25.392399 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-29010799-8949-436f-8e58-57ceb7eb04b7 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6" status: 200 len: 1313 microversion: 2.1 time: 0.226548 Oct 11 04:28:25.395185 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1926/4050] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:25 2022] GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 => generated 1313 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:25.414589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-af0c4663-29bc-4e7b-9703-a8b0a272c082 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:25.416811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-af0c4663-29bc-4e7b-9703-a8b0a272c082 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:25.452993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af0c4663-29bc-4e7b-9703-a8b0a272c082 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:25.456672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af0c4663-29bc-4e7b-9703-a8b0a272c082 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:25.458108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af0c4663-29bc-4e7b-9703-a8b0a272c082 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.461902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af0c4663-29bc-4e7b-9703-a8b0a272c082 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:25.463695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af0c4663-29bc-4e7b-9703-a8b0a272c082 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:25.466746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af0c4663-29bc-4e7b-9703-a8b0a272c082 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.484396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7e1602d7-8b78-4d6f-9e32-3423642a9f95 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:25.496130 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7e1602d7-8b78-4d6f-9e32-3423642a9f95 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.299393 Oct 11 04:28:25.497402 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2125/4051] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:25 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:25.520722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22005038-90d4-405b-8aeb-4897e3fdb0f4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:25.521750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22005038-90d4-405b-8aeb-4897e3fdb0f4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:25.538654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22005038-90d4-405b-8aeb-4897e3fdb0f4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:25.539266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22005038-90d4-405b-8aeb-4897e3fdb0f4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:25.539860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22005038-90d4-405b-8aeb-4897e3fdb0f4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.540636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22005038-90d4-405b-8aeb-4897e3fdb0f4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:25.541143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22005038-90d4-405b-8aeb-4897e3fdb0f4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:25.541603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22005038-90d4-405b-8aeb-4897e3fdb0f4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.738357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22005038-90d4-405b-8aeb-4897e3fdb0f4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:25.747934 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22005038-90d4-405b-8aeb-4897e3fdb0f4 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1317 microversion: 2.1 time: 0.248725 Oct 11 04:28:25.748531 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2126/4052] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:25 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1317 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:25.769087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d46fd3f1-213f-4a47-ba19-322f4bedd804 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"lock": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:25.769836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d46fd3f1-213f-4a47-ba19-322f4bedd804 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:25.777025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46fd3f1-213f-4a47-ba19-322f4bedd804 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:25.777552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46fd3f1-213f-4a47-ba19-322f4bedd804 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:25.778007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46fd3f1-213f-4a47-ba19-322f4bedd804 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.778842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46fd3f1-213f-4a47-ba19-322f4bedd804 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:25.779538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46fd3f1-213f-4a47-ba19-322f4bedd804 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:25.780011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46fd3f1-213f-4a47-ba19-322f4bedd804 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:25.866650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-af0c4663-29bc-4e7b-9703-a8b0a272c082 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:25.881158 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-af0c4663-29bc-4e7b-9703-a8b0a272c082 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.475764 Oct 11 04:28:25.884387 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1927/4053] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:25 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:25.911805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:25.988120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d46fd3f1-213f-4a47-ba19-322f4bedd804 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Locking {{(pid=120994) lock /opt/stack/nova/nova/compute/api.py:4845}} Oct 11 04:28:26.136654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8fe1ebb0-7ebf-43c9-9772-d4826b6b180f req-1f4f155b-fba2-4f9a-ada8-ef1af26d6bc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36146041-a1da-4b52-b096-9efc8b252767", "name": "network-vif-deleted", "tag": "004dff7d-ab50-4b90-8380-f8476274dc23"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:26.171297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8fe1ebb0-7ebf-43c9-9772-d4826b6b180f req-1f4f155b-fba2-4f9a-ada8-ef1af26d6bc5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.172449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8fe1ebb0-7ebf-43c9-9772-d4826b6b180f req-1f4f155b-fba2-4f9a-ada8-ef1af26d6bc5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.173901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8fe1ebb0-7ebf-43c9-9772-d4826b6b180f req-1f4f155b-fba2-4f9a-ada8-ef1af26d6bc5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.201137 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8fe1ebb0-7ebf-43c9-9772-d4826b6b180f req-1f4f155b-fba2-4f9a-ada8-ef1af26d6bc5 service nova] Creating event network-vif-deleted:004dff7d-ab50-4b90-8380-f8476274dc23 for instance 36146041-a1da-4b52-b096-9efc8b252767 on n-h2-860892-1 Oct 11 04:28:26.221380 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8fe1ebb0-7ebf-43c9-9772-d4826b6b180f req-1f4f155b-fba2-4f9a-ada8-ef1af26d6bc5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089930 Oct 11 04:28:26.222467 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1928/4054] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:28:26.230124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-478c39aa-b745-4159-9f1b-5c81ef8bac41 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:26.230954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-478c39aa-b745-4159-9f1b-5c81ef8bac41 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:26.238656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478c39aa-b745-4159-9f1b-5c81ef8bac41 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.239174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478c39aa-b745-4159-9f1b-5c81ef8bac41 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.239632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478c39aa-b745-4159-9f1b-5c81ef8bac41 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.240463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478c39aa-b745-4159-9f1b-5c81ef8bac41 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.241096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478c39aa-b745-4159-9f1b-5c81ef8bac41 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.241534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478c39aa-b745-4159-9f1b-5c81ef8bac41 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.269776 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d46fd3f1-213f-4a47-ba19-322f4bedd804 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.514845 Oct 11 04:28:26.270715 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2127/4055] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:25 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 522 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:28:26.279716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1dc89ec-dcf3-4e99-a27a-e37d312cf168 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:26.281056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b1dc89ec-dcf3-4e99-a27a-e37d312cf168 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:26.289536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1dc89ec-dcf3-4e99-a27a-e37d312cf168 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.290150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1dc89ec-dcf3-4e99-a27a-e37d312cf168 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.298809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1dc89ec-dcf3-4e99-a27a-e37d312cf168 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.299751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1dc89ec-dcf3-4e99-a27a-e37d312cf168 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.300419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1dc89ec-dcf3-4e99-a27a-e37d312cf168 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.301232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1dc89ec-dcf3-4e99-a27a-e37d312cf168 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.355185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-478c39aa-b745-4159-9f1b-5c81ef8bac41 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:26.366633 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-478c39aa-b745-4159-9f1b-5c81ef8bac41 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1463 microversion: 2.1 time: 0.142535 Oct 11 04:28:26.382276 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1929/4056] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:26 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1463 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:26.382276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eb3428b0-1163-4050-a901-53342044d3b9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:26.382276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eb3428b0-1163-4050-a901-53342044d3b9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:26.382276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3428b0-1163-4050-a901-53342044d3b9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.382820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3428b0-1163-4050-a901-53342044d3b9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.382933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3428b0-1163-4050-a901-53342044d3b9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.383654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3428b0-1163-4050-a901-53342044d3b9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.384113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3428b0-1163-4050-a901-53342044d3b9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.384634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb3428b0-1163-4050-a901-53342044d3b9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.488730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:26.511704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b1dc89ec-dcf3-4e99-a27a-e37d312cf168 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:26.526066 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b1dc89ec-dcf3-4e99-a27a-e37d312cf168 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.250583 Oct 11 04:28:26.537326 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2128/4057] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:26 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:26.537326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:26.537326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: d074edb8-863b-48c6-900d-2bcc2c5e23f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:26.539260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.539738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.543201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.543201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.543201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.543201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.557752 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] HTTP exception thrown: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Request method failure captured: Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 HTTP/1.1 Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPC7xpbGzBRbcuAtMZpwQemC1wklEvm30pAWrZ860NsZnbfJsNYSgCVWFgH-dzeFCam5u5rS1HOntgul_Vw2dsa1y2W9QHCnuMwp_2dzXuyjftYRKr1B2DthMKwyrglHu0FJE1fXYbtF3mhCjeG_cT9DZ2ZCVG7R0ytjnXMxdLWSYOQ Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c0ac9145210548c78285621466d44b39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c0ac9145210548c78285621466d44b39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}] Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 550bea6ee48f4a8e81646d727d51a1d3 Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'd074edb8-863b-48c6-900d-2bcc2c5e23f6'} Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.559519 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Returning 404 to user: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d3b001c4-69b9-4269-89b7-3d463e45e6f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6" status: 404 len: 111 microversion: 2.1 time: 0.032906 Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2129/4058] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:26 2022] GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2da77c1a-88dd-4106-8d7d-bef1754d5ce8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2da77c1a-88dd-4106-8d7d-bef1754d5ce8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2da77c1a-88dd-4106-8d7d-bef1754d5ce8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Searching by: {'changes-since': datetime.datetime(2051, 1, 1, 12, 34, tzinfo=datetime.timezone.utc), 'vm_state': ['active'], 'project_id': 'c0ac9145210548c78285621466d44b39'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da77c1a-88dd-4106-8d7d-bef1754d5ce8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da77c1a-88dd-4106-8d7d-bef1754d5ce8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da77c1a-88dd-4106-8d7d-bef1754d5ce8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da77c1a-88dd-4106-8d7d-bef1754d5ce8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.812937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da77c1a-88dd-4106-8d7d-bef1754d5ce8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.815039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da77c1a-88dd-4106-8d7d-bef1754d5ce8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eb3428b0-1163-4050-a901-53342044d3b9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eb3428b0-1163-4050-a901-53342044d3b9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.248708 Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1930/4059] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:26 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-004e2c92-b6d5-41cf-911f-da37adb4104a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004e2c92-b6d5-41cf-911f-da37adb4104a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004e2c92-b6d5-41cf-911f-da37adb4104a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004e2c92-b6d5-41cf-911f-da37adb4104a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-004e2c92-b6d5-41cf-911f-da37adb4104a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] HTTP exception thrown: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 is locked Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-004e2c92-b6d5-41cf-911f-da37adb4104a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Request method failure captured: Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action HTTP/1.1 Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 15 Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_RCh7y3VCR0ZGCz57mMkPYBNk7QiIVp9XuBnd-Uehf82A4vup9lXbNXCqWQjVjFhMOhYa9RyLqNtdWCz0WKBx8po-RawVJL-JciajTijLf7lVKUU9Uul6vpelbjCSaCgmT83upn5D4faXHmtAf4nXZcwDOtKbLho_1_PIpYNLAs5s Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a2974866e964ca2864c978d2270bd77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}] Oct 11 04:28:26.816193 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5feceb4a60434064a4fd08f7cc637f32 Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: {"os-stop": {}} Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 is locked Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'd32f0ab1-346d-487a-aa08-ebd1656142a7', 'body': {'os-stop': {}}} Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1449, in _stop_server Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.compute_api.stop(context, instance) Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 240, in inner Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceIsLocked(instance_uuid=instance.uuid) Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceIsLocked: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 is locked Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1451, in _stop_server Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=e.format_message()) Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 is locked Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 is locked Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.818127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-004e2c92-b6d5-41cf-911f-da37adb4104a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Returning 409 to user: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 is locked {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:26.823522 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2da77c1a-88dd-4106-8d7d-bef1754d5ce8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE" status: 200 len: 15 microversion: 2.1 time: 0.154339 Oct 11 04:28:26.823831 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-004e2c92-b6d5-41cf-911f-da37adb4104a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 409 len: 107 microversion: 2.1 time: 0.088368 Oct 11 04:28:26.823990 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2130/4060] 10.222.0.26 () {58 vars in 1230 bytes} [Tue Oct 11 04:28:26 2022] GET /compute/v2.1/servers?changes-since=2051-01-01T12%3A34%3A00Z&status=ACTIVE => generated 15 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 04:28:26.824080 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1931/4061] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:26 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 107 bytes in 94 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 11 04:28:26.824150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-cf42edad-d410-475e-bccd-2248a3c39a90 req-0c62a711-42ae-47d5-8890-c069454bf5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "036bd026-451b-47dc-83f7-8ece730155b4", "name": "network-vif-plugged", "status": "completed", "tag": "4442371d-53b1-425c-83e7-d71425c37735"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:26.824150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cf42edad-d410-475e-bccd-2248a3c39a90 req-0c62a711-42ae-47d5-8890-c069454bf5ad service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.824150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cf42edad-d410-475e-bccd-2248a3c39a90 req-0c62a711-42ae-47d5-8890-c069454bf5ad service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.824150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cf42edad-d410-475e-bccd-2248a3c39a90 req-0c62a711-42ae-47d5-8890-c069454bf5ad service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.824511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f9a884b-8643-4189-b185-90658b845f54 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:26.824571 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-cf42edad-d410-475e-bccd-2248a3c39a90 req-0c62a711-42ae-47d5-8890-c069454bf5ad service nova] Creating event network-vif-plugged:4442371d-53b1-425c-83e7-d71425c37735 for instance 036bd026-451b-47dc-83f7-8ece730155b4 on n-h1-860892-1 Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f9a884b-8643-4189-b185-90658b845f54 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Request method failure captured: Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 HTTP/1.1 Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPC7xpbGzBRbcuAtMZpwQemC1wklEvm30pAWrZ860NsZnbfJsNYSgCVWFgH-dzeFCam5u5rS1HOntgul_Vw2dsa1y2W9QHCnuMwp_2dzXuyjftYRKr1B2DthMKwyrglHu0FJE1fXYbtF3mhCjeG_cT9DZ2ZCVG7R0ytjnXMxdLWSYOQ Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c0ac9145210548c78285621466d44b39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c0ac9145210548c78285621466d44b39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}] Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 550bea6ee48f4a8e81646d727d51a1d3 Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: action_args: {} Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '2011/01/01' is not a 'date-time' Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['changes-since']['items']: Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'format': 'date-time', 'type': 'string'} Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi '2011/01/01' Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 04:28:26.824636 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f9a884b-8643-4189-b185-90658b845f54 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Returning 400 to user: Invalid input for query parameters changes-since. Value: 2011/01/01. '2011/01/01' is not a 'date-time' {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f9a884b-8643-4189-b185-90658b845f54 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers?changes-since=2011%2F01%2F01" status: 400 len: 146 microversion: 2.1 time: 0.011627 Oct 11 04:28:26.833515 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1932/4062] 10.222.0.26 () {58 vars in 1182 bytes} [Tue Oct 11 04:28:26 2022] GET /compute/v2.1/servers?changes-since=2011%2F01%2F01 => generated 146 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:28:26.836741 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-cf42edad-d410-475e-bccd-2248a3c39a90 req-0c62a711-42ae-47d5-8890-c069454bf5ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034880 Oct 11 04:28:26.836741 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2131/4063] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:26.836888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8959be06-816f-441d-a3d6-93eb938b36af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:26.836888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8959be06-816f-441d-a3d6-93eb938b36af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:26.837051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d3a7f0b-69e9-49f0-b571-187686d60edf tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:26.837131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8959be06-816f-441d-a3d6-93eb938b36af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.837131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8959be06-816f-441d-a3d6-93eb938b36af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.837131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8959be06-816f-441d-a3d6-93eb938b36af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.837131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8959be06-816f-441d-a3d6-93eb938b36af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.837131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8959be06-816f-441d-a3d6-93eb938b36af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.837131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8959be06-816f-441d-a3d6-93eb938b36af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.837512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d3a7f0b-69e9-49f0-b571-187686d60edf tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:26.837512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2d3a7f0b-69e9-49f0-b571-187686d60edf tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Searching by: {'deleted': False, 'project_id': 'c0ac9145210548c78285621466d44b39'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:28:26.837512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:26.837512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d3a7f0b-69e9-49f0-b571-187686d60edf tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.837512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d3a7f0b-69e9-49f0-b571-187686d60edf tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.837512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d3a7f0b-69e9-49f0-b571-187686d60edf tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.837512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d3a7f0b-69e9-49f0-b571-187686d60edf tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.837512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d3a7f0b-69e9-49f0-b571-187686d60edf tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.837512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d3a7f0b-69e9-49f0-b571-187686d60edf tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.871195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-2d3a7f0b-69e9-49f0-b571-187686d60edf tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:28:26.908260 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d3a7f0b-69e9-49f0-b571-187686d60edf tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.139638 Oct 11 04:28:26.908969 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2132/4064] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:28:26 2022] GET /compute/v2.1/servers => generated 683 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:26.914509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e354ff72-7092-48d6-b243-0ee41e199c99 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:26.915722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e354ff72-7092-48d6-b243-0ee41e199c99 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:26.923309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e354ff72-7092-48d6-b243-0ee41e199c99 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.924061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e354ff72-7092-48d6-b243-0ee41e199c99 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.924658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e354ff72-7092-48d6-b243-0ee41e199c99 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:26.925713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e354ff72-7092-48d6-b243-0ee41e199c99 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:26.926354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e354ff72-7092-48d6-b243-0ee41e199c99 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:26.926925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e354ff72-7092-48d6-b243-0ee41e199c99 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.094505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e354ff72-7092-48d6-b243-0ee41e199c99 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:27.098064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8959be06-816f-441d-a3d6-93eb938b36af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Unlocking {{(pid=120993) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 11 04:28:27.102879 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e354ff72-7092-48d6-b243-0ee41e199c99 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1317 microversion: 2.1 time: 0.192723 Oct 11 04:28:27.104996 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2133/4065] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:26 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1317 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:27.118379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e5b0b4f8-f299-480c-8ee4-2c69f87859a9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:27.118379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e5b0b4f8-f299-480c-8ee4-2c69f87859a9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:27.118379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5b0b4f8-f299-480c-8ee4-2c69f87859a9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.118379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5b0b4f8-f299-480c-8ee4-2c69f87859a9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.118379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5b0b4f8-f299-480c-8ee4-2c69f87859a9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.118379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5b0b4f8-f299-480c-8ee4-2c69f87859a9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.118379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5b0b4f8-f299-480c-8ee4-2c69f87859a9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.118379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5b0b4f8-f299-480c-8ee4-2c69f87859a9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.273254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e5b0b4f8-f299-480c-8ee4-2c69f87859a9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:27.282067 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e5b0b4f8-f299-480c-8ee4-2c69f87859a9 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.177497 Oct 11 04:28:27.282792 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2134/4066] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:27 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:27.294268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:27.294268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:27.294268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.compute.servers [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Removing options 'limit' from query {{(pid=120994) remove_invalid_options /opt/stack/nova/nova/api/openstack/compute/servers.py:1490}} Oct 11 04:28:27.294268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Searching by: {'deleted': False, 'project_id': 'c0ac9145210548c78285621466d44b39'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:28:27.300168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.300648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.301084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.301808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.302296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.302726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.332139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Listed batch of 2 results from cell out of 102 limit. Returned 2 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:28:27.363127 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d4de68f9-2c8d-47b7-9dd3-06fc08ddbb8c tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=102" status: 200 len: 683 microversion: 2.1 time: 0.078846 Oct 11 04:28:27.363811 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2135/4067] 10.222.0.26 () {58 vars in 1144 bytes} [Tue Oct 11 04:28:27 2022] GET /compute/v2.1/servers?limit=102 => generated 683 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:27.371288 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8959be06-816f-441d-a3d6-93eb938b36af tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.608701 Oct 11 04:28:27.372227 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1933/4068] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:26 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 610 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:28:27.380161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69492096-53b1-4832-8ce4-452e929a3cee tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69492096-53b1-4832-8ce4-452e929a3cee tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Request method failure captured: Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers?limit=-1 HTTP/1.1 Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPC7xpbGzBRbcuAtMZpwQemC1wklEvm30pAWrZ860NsZnbfJsNYSgCVWFgH-dzeFCam5u5rS1HOntgul_Vw2dsa1y2W9QHCnuMwp_2dzXuyjftYRKr1B2DthMKwyrglHu0FJE1fXYbtF3mhCjeG_cT9DZ2ZCVG7R0ytjnXMxdLWSYOQ Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c0ac9145210548c78285621466d44b39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c0ac9145210548c78285621466d44b39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}] Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 550bea6ee48f4a8e81646d727d51a1d3 Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: action_args: {} Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '-1' does not match '^[0-9]*$' Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi '-1' Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 04:28:27.384761 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' Oct 11 04:28:27.388012 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.388742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8b1b6c0-c238-48ea-a2c4-11f06798e793 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:27.391341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69492096-53b1-4832-8ce4-452e929a3cee tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Returning 400 to user: Invalid input for query parameters limit. Value: -1. '-1' does not match '^[0-9]*$' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:27.391341 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-69492096-53b1-4832-8ce4-452e929a3cee tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=-1" status: 400 len: 127 microversion: 2.1 time: 0.010313 Oct 11 04:28:27.391341 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2136/4069] 10.222.0.26 () {58 vars in 1142 bytes} [Tue Oct 11 04:28:27 2022] GET /compute/v2.1/servers?limit=-1 => generated 127 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:28:27.395515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:27.395624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8b1b6c0-c238-48ea-a2c4-11f06798e793 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.396142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8b1b6c0-c238-48ea-a2c4-11f06798e793 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.396281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:27.396757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8b1b6c0-c238-48ea-a2c4-11f06798e793 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.403008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.403499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.403936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.404626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.405082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.405539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.423590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8b1b6c0-c238-48ea-a2c4-11f06798e793 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Going to try to stop instance {{(pid=120993) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 04:28:27.439788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.440282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.440721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.441171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lazy-loading 'fault' on Instance uuid 36146041-a1da-4b52-b096-9efc8b252767 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:28:27.503345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15dbde05c5c5421e83eb7a60df664d42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f816ed1b873b40bc93b3be8e0052fa88', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:27.514939 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d7a9864-6ae9-4b8b-bf33-48218c1b2224 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 200 len: 1304 microversion: 2.1 time: 0.122706 Oct 11 04:28:27.516998 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2137/4070] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:27 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:27.528946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7fb46ada-4c55-4b3f-97de-2f8a8af59b3d tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7fb46ada-4c55-4b3f-97de-2f8a8af59b3d tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Request method failure captured: Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers?limit=testing HTTP/1.1 Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPC7xpbGzBRbcuAtMZpwQemC1wklEvm30pAWrZ860NsZnbfJsNYSgCVWFgH-dzeFCam5u5rS1HOntgul_Vw2dsa1y2W9QHCnuMwp_2dzXuyjftYRKr1B2DthMKwyrglHu0FJE1fXYbtF3mhCjeG_cT9DZ2ZCVG7R0ytjnXMxdLWSYOQ Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c0ac9145210548c78285621466d44b39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c0ac9145210548c78285621466d44b39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}] Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 550bea6ee48f4a8e81646d727d51a1d3 Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: action_args: {} Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'testing' does not match '^[0-9]*$' Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['limit']['items']: Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'minLength': 1, Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'minimum': 0, Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'pattern': '^[0-9]*$', Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': ['integer', 'string']} Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance[0]: Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'testing' Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 181, in wrapper Oct 11 04:28:27.534522 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi if _schema_validation_helper(query_params_schema, Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' Oct 11 04:28:27.537636 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:27.541080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7fb46ada-4c55-4b3f-97de-2f8a8af59b3d tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Returning 400 to user: Invalid input for query parameters limit. Value: testing. 'testing' does not match '^[0-9]*$' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:27.543619 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7fb46ada-4c55-4b3f-97de-2f8a8af59b3d tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers?limit=testing" status: 400 len: 137 microversion: 2.1 time: 0.021686 Oct 11 04:28:27.543619 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2138/4071] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:28:27 2022] GET /compute/v2.1/servers?limit=testing => generated 137 bytes in 23 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:28:27.554494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a57c1fd-baee-4827-bcee-27e5f6ad5b5f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:27.560860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a57c1fd-baee-4827-bcee-27e5f6ad5b5f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:27.562392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a57c1fd-baee-4827-bcee-27e5f6ad5b5f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Searching by: {'flavor': 'non_existing_flavor', 'deleted': False, 'project_id': 'c0ac9145210548c78285621466d44b39'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:28:27.570301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.compute.servers [None req-0a57c1fd-baee-4827-bcee-27e5f6ad5b5f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Flavor 'non_existing_flavor' could not be found {{(pid=120994) _get_servers /opt/stack/nova/nova/api/openstack/compute/servers.py:336}} Oct 11 04:28:27.571337 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a57c1fd-baee-4827-bcee-27e5f6ad5b5f tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers?flavor=non_existing_flavor" status: 200 len: 15 microversion: 2.1 time: 0.022578 Oct 11 04:28:27.572020 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2139/4072] 10.222.0.26 () {58 vars in 1178 bytes} [Tue Oct 11 04:28:27 2022] GET /compute/v2.1/servers?flavor=non_existing_flavor => generated 15 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:28:27.576855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3cd24a1e-2cab-486e-b5a5-a1c3cd239c3d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:27.578689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3cd24a1e-2cab-486e-b5a5-a1c3cd239c3d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:27.584026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3cd24a1e-2cab-486e-b5a5-a1c3cd239c3d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.584620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3cd24a1e-2cab-486e-b5a5-a1c3cd239c3d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.585129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3cd24a1e-2cab-486e-b5a5-a1c3cd239c3d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.585952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3cd24a1e-2cab-486e-b5a5-a1c3cd239c3d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.586544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3cd24a1e-2cab-486e-b5a5-a1c3cd239c3d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.587091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3cd24a1e-2cab-486e-b5a5-a1c3cd239c3d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.685167 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e8b1b6c0-c238-48ea-a2c4-11f06798e793 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.304852 Oct 11 04:28:27.687568 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1934/4073] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:27 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:28:27.701743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bbcb5a50-d6a4-4261-928d-a453c02eabe5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:27.709105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bbcb5a50-d6a4-4261-928d-a453c02eabe5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:27.711115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bbcb5a50-d6a4-4261-928d-a453c02eabe5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Searching by: {'image': 'non_existing_image', 'deleted': False, 'project_id': 'c0ac9145210548c78285621466d44b39'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:28:27.717506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbcb5a50-d6a4-4261-928d-a453c02eabe5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.718220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbcb5a50-d6a4-4261-928d-a453c02eabe5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.718796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbcb5a50-d6a4-4261-928d-a453c02eabe5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.719802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbcb5a50-d6a4-4261-928d-a453c02eabe5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.720493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbcb5a50-d6a4-4261-928d-a453c02eabe5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.721349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbcb5a50-d6a4-4261-928d-a453c02eabe5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.754873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3cd24a1e-2cab-486e-b5a5-a1c3cd239c3d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:27.763740 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3cd24a1e-2cab-486e-b5a5-a1c3cd239c3d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.190347 Oct 11 04:28:27.775861 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2140/4074] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:27 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:27.786934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c32abd07-0dc3-42d9-ba29-b65018dcd474 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:27.787673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c32abd07-0dc3-42d9-ba29-b65018dcd474 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:27.793729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c32abd07-0dc3-42d9-ba29-b65018dcd474 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.794344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c32abd07-0dc3-42d9-ba29-b65018dcd474 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.794785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c32abd07-0dc3-42d9-ba29-b65018dcd474 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.796166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c32abd07-0dc3-42d9-ba29-b65018dcd474 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.796632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c32abd07-0dc3-42d9-ba29-b65018dcd474 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.797063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c32abd07-0dc3-42d9-ba29-b65018dcd474 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.812734 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bbcb5a50-d6a4-4261-928d-a453c02eabe5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers?image=non_existing_image" status: 200 len: 15 microversion: 2.1 time: 0.120872 Oct 11 04:28:27.813526 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1935/4075] 10.222.0.26 () {58 vars in 1174 bytes} [Tue Oct 11 04:28:27 2022] GET /compute/v2.1/servers?image=non_existing_image => generated 15 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:28:27.825851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02633a9a-b528-4f9d-af49-c42883db840a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:27.831737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02633a9a-b528-4f9d-af49-c42883db840a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:27.832572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-02633a9a-b528-4f9d-af49-c42883db840a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Searching by: {'name': 'non_existing_server_name', 'deleted': False, 'project_id': 'c0ac9145210548c78285621466d44b39'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:28:27.838879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02633a9a-b528-4f9d-af49-c42883db840a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.839525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02633a9a-b528-4f9d-af49-c42883db840a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.840099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02633a9a-b528-4f9d-af49-c42883db840a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.840962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02633a9a-b528-4f9d-af49-c42883db840a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.842394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02633a9a-b528-4f9d-af49-c42883db840a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.843492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02633a9a-b528-4f9d-af49-c42883db840a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.949590 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02633a9a-b528-4f9d-af49-c42883db840a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers?name=non_existing_server_name" status: 200 len: 15 microversion: 2.1 time: 0.127408 Oct 11 04:28:27.950771 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1936/4076] 10.222.0.26 () {58 vars in 1184 bytes} [Tue Oct 11 04:28:27 2022] GET /compute/v2.1/servers?name=non_existing_server_name => generated 15 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 04:28:27.964489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:27.972807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:27.973986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Searching by: {'deleted': False, 'project_id': 'c0ac9145210548c78285621466d44b39'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:28:27.977640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c32abd07-0dc3-42d9-ba29-b65018dcd474 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:27.980090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.980767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.981192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.981915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:27.982393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:27.982968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:27.986604 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c32abd07-0dc3-42d9-ba29-b65018dcd474 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.209571 Oct 11 04:28:27.987751 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2141/4077] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:27 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:28.016885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:28:28.053821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:28.060712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.061261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.062332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.133720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e2b3cf6-d0e1-40d5-a4ef-b9bc6985f6a6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:28.134940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e2b3cf6-d0e1-40d5-a4ef-b9bc6985f6a6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:28.145179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2b3cf6-d0e1-40d5-a4ef-b9bc6985f6a6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.145667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2b3cf6-d0e1-40d5-a4ef-b9bc6985f6a6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.146566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2b3cf6-d0e1-40d5-a4ef-b9bc6985f6a6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.148122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2b3cf6-d0e1-40d5-a4ef-b9bc6985f6a6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.148590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2b3cf6-d0e1-40d5-a4ef-b9bc6985f6a6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.149079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e2b3cf6-d0e1-40d5-a4ef-b9bc6985f6a6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.201536 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a7f9bbd2-4fac-45e0-9e1e-f1c0ac453021 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 3026 microversion: 2.1 time: 0.241855 Oct 11 04:28:28.214402 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1937/4078] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:28:27 2022] GET /compute/v2.1/servers/detail => generated 3026 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:28.232442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16edfd20-46a5-437b-b1c5-32ddb15e8b42 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:28.238703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-16edfd20-46a5-437b-b1c5-32ddb15e8b42 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:28.239871 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-16edfd20-46a5-437b-b1c5-32ddb15e8b42 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers?status=non_existing_status" status: 200 len: 15 microversion: 2.1 time: 0.011845 Oct 11 04:28:28.240876 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1938/4079] 10.222.0.26 () {58 vars in 1178 bytes} [Tue Oct 11 04:28:28 2022] GET /compute/v2.1/servers?status=non_existing_status => generated 15 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:28:28.252885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f054998f-34b3-44dc-9164-c02d55f571fc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:28.259670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f054998f-34b3-44dc-9164-c02d55f571fc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:28.260708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f054998f-34b3-44dc-9164-c02d55f571fc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Searching by: {'deleted': False, 'project_id': 'c0ac9145210548c78285621466d44b39'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:28:28.268493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f054998f-34b3-44dc-9164-c02d55f571fc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.270172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f054998f-34b3-44dc-9164-c02d55f571fc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.271115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f054998f-34b3-44dc-9164-c02d55f571fc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.272291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f054998f-34b3-44dc-9164-c02d55f571fc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.273183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f054998f-34b3-44dc-9164-c02d55f571fc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.273828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f054998f-34b3-44dc-9164-c02d55f571fc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.292809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:28.304891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-f054998f-34b3-44dc-9164-c02d55f571fc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:28:28.349823 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f054998f-34b3-44dc-9164-c02d55f571fc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 683 microversion: 2.1 time: 0.100682 Oct 11 04:28:28.351153 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1939/4080] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 04:28:28 2022] GET /compute/v2.1/servers => generated 683 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:28:28.363572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b3713c7-bc83-4c96-8a54-194990a3f752 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:28.367262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2b3713c7-bc83-4c96-8a54-194990a3f752 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:28.370735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e2b3cf6-d0e1-40d5-a4ef-b9bc6985f6a6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:28.374631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b3713c7-bc83-4c96-8a54-194990a3f752 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.375180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b3713c7-bc83-4c96-8a54-194990a3f752 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.375620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b3713c7-bc83-4c96-8a54-194990a3f752 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.376321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b3713c7-bc83-4c96-8a54-194990a3f752 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.376772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b3713c7-bc83-4c96-8a54-194990a3f752 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.377194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b3713c7-bc83-4c96-8a54-194990a3f752 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.379484 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e2b3cf6-d0e1-40d5-a4ef-b9bc6985f6a6 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1317 microversion: 2.1 time: 0.251007 Oct 11 04:28:28.380462 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2142/4081] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:28 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1317 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:28.386890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:28.387495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: d074edb8-863b-48c6-900d-2bcc2c5e23f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:28.394306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.394867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.395314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.398394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.398394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.398394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.413159 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] HTTP exception thrown: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Request method failure captured: Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 HTTP/1.1 Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPC7xpbGzBRbcuAtMZpwQemC1wklEvm30pAWrZ860NsZnbfJsNYSgCVWFgH-dzeFCam5u5rS1HOntgul_Vw2dsa1y2W9QHCnuMwp_2dzXuyjftYRKr1B2DthMKwyrglHu0FJE1fXYbtF3mhCjeG_cT9DZ2ZCVG7R0ytjnXMxdLWSYOQ Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c0ac9145210548c78285621466d44b39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c0ac9145210548c78285621466d44b39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}] Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 550bea6ee48f4a8e81646d727d51a1d3 Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'd074edb8-863b-48c6-900d-2bcc2c5e23f6'} Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:28:28.415131 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Returning 404 to user: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:28.417912 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d34f5f9a-1ae4-4225-b577-bf800c4a7ab4 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6" status: 404 len: 111 microversion: 2.1 time: 0.035674 Oct 11 04:28:28.421643 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2143/4082] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:28:28 2022] DELETE /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:28:28.427100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d84fe22e-0563-4f2f-847e-56604c46268a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:28.427684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d84fe22e-0563-4f2f-847e-56604c46268a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: 98213491-b0bf-4bbb-aa2f-3399f13caa8a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:28.435430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84fe22e-0563-4f2f-847e-56604c46268a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.436029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84fe22e-0563-4f2f-847e-56604c46268a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.437754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84fe22e-0563-4f2f-847e-56604c46268a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.438753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84fe22e-0563-4f2f-847e-56604c46268a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.439299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84fe22e-0563-4f2f-847e-56604c46268a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.439791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84fe22e-0563-4f2f-847e-56604c46268a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.474772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d84fe22e-0563-4f2f-847e-56604c46268a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: 98213491-b0bf-4bbb-aa2f-3399f13caa8a] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:28:28.575302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2b3713c7-bc83-4c96-8a54-194990a3f752 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:28.584786 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b3713c7-bc83-4c96-8a54-194990a3f752 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.231993 Oct 11 04:28:28.601112 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1940/4083] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:28 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:28.601112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:28.601112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] [instance: 36146041-a1da-4b52-b096-9efc8b252767] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:28.606699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.607172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.607989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.609506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.610204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.610908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.637949 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] HTTP exception thrown: Instance 36146041-a1da-4b52-b096-9efc8b252767 could not be found. Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Request method failure captured: Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 HTTP/1.1 Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPCpw9wY9e30ASADfizvuXAXtCwLBbFUsEjbTW8F_VLxzIK3PeptnObYOedb8p4GYLZSaefVnuvOw47vBGNEE9eeuw_5UsjOLybeRsuSvVXWzkOq_m6oLjYIDdBBMREe00kTe-dpzva-zuEIe-zKA6TcMkpDVd1mDCQxin1FcyQvO-A Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f816ed1b873b40bc93b3be8e0052fa88 Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-VolumesActionsTest-1876816740 Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f816ed1b873b40bc93b3be8e0052fa88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f816ed1b873b40bc93b3be8e0052fa88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f816ed1b873b40bc93b3be8e0052fa88"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f816ed1b873b40bc93b3be8e0052fa88"}]}] Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-VolumesActionsTest-1876816740 Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f816ed1b873b40bc93b3be8e0052fa88 Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-VolumesActionsTest-1876816740 Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-VolumesActionsTest-1876816740-project Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 15dbde05c5c5421e83eb7a60df664d42 Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-VolumesActionsTest-1876816740-project Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 36146041-a1da-4b52-b096-9efc8b252767 could not be found. Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '36146041-a1da-4b52-b096-9efc8b252767'} Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36146041-a1da-4b52-b096-9efc8b252767 could not be found. Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36146041-a1da-4b52-b096-9efc8b252767 could not be found. Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:28.641562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:28.644602 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:28.644602 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:28.644602 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:28.644602 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:28.644602 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:28.644602 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36146041-a1da-4b52-b096-9efc8b252767 could not be found. Oct 11 04:28:28.644602 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:28.644602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] Returning 404 to user: Instance 36146041-a1da-4b52-b096-9efc8b252767 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:28.644602 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-08498c88-ed9f-4377-aff2-b9624c362a95 tempest-VolumesActionsTest-1876816740 tempest-VolumesActionsTest-1876816740-project] 10.222.0.26 "GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767" status: 404 len: 111 microversion: 2.1 time: 0.050786 Oct 11 04:28:28.653196 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1941/4084] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:28 2022] GET /compute/v2.1/servers/36146041-a1da-4b52-b096-9efc8b252767 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:28:28.789020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-49fe5b9d-e874-4ede-9630-12417052c472 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:28.789629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-49fe5b9d-e874-4ede-9630-12417052c472 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:28.795632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49fe5b9d-e874-4ede-9630-12417052c472 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.796203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49fe5b9d-e874-4ede-9630-12417052c472 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.796639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49fe5b9d-e874-4ede-9630-12417052c472 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.797355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49fe5b9d-e874-4ede-9630-12417052c472 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.798138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49fe5b9d-e874-4ede-9630-12417052c472 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.798573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49fe5b9d-e874-4ede-9630-12417052c472 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.840614 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d84fe22e-0563-4f2f-847e-56604c46268a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "DELETE /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a" status: 204 len: 0 microversion: 2.1 time: 0.416993 Oct 11 04:28:28.843832 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2144/4085] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:28:28 2022] DELETE /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:28:28.857389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d516d134-c1a0-44aa-89f5-ab5b134964f8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:28.857995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d516d134-c1a0-44aa-89f5-ab5b134964f8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:28.865639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d516d134-c1a0-44aa-89f5-ab5b134964f8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.866175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d516d134-c1a0-44aa-89f5-ab5b134964f8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.866641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d516d134-c1a0-44aa-89f5-ab5b134964f8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.867351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d516d134-c1a0-44aa-89f5-ab5b134964f8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:28.867808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d516d134-c1a0-44aa-89f5-ab5b134964f8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:28.868239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d516d134-c1a0-44aa-89f5-ab5b134964f8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:28.924783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d516d134-c1a0-44aa-89f5-ab5b134964f8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:28:28.928241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:28.966095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-49fe5b9d-e874-4ede-9630-12417052c472 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:28.974910 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-49fe5b9d-e874-4ede-9630-12417052c472 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.189806 Oct 11 04:28:28.984862 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1942/4086] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:28 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:29.012115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7c1acc8e-f667-4bf8-a499-26932c2bd11d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:29.012976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7c1acc8e-f667-4bf8-a499-26932c2bd11d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:29.020445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c1acc8e-f667-4bf8-a499-26932c2bd11d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.021203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c1acc8e-f667-4bf8-a499-26932c2bd11d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.021901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c1acc8e-f667-4bf8-a499-26932c2bd11d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.022966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c1acc8e-f667-4bf8-a499-26932c2bd11d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.023489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c1acc8e-f667-4bf8-a499-26932c2bd11d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.023976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c1acc8e-f667-4bf8-a499-26932c2bd11d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.170364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7c1acc8e-f667-4bf8-a499-26932c2bd11d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:29.178404 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7c1acc8e-f667-4bf8-a499-26932c2bd11d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.170599 Oct 11 04:28:29.178976 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1943/4087] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:29 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:29.390362 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d516d134-c1a0-44aa-89f5-ab5b134964f8 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 204 len: 0 microversion: 2.1 time: 0.541069 Oct 11 04:28:29.392811 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2145/4088] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:28:28 2022] DELETE /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:28:29.412054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:29.413601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: d074edb8-863b-48c6-900d-2bcc2c5e23f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:29.427440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c386590e-933c-4fb4-818a-c9e97680829b tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:29.428177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c386590e-933c-4fb4-818a-c9e97680829b tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:29.432667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.433374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.433883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.434416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c386590e-933c-4fb4-818a-c9e97680829b tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.434789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.434928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c386590e-933c-4fb4-818a-c9e97680829b tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.435336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c386590e-933c-4fb4-818a-c9e97680829b tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.435421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.435853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.436114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c386590e-933c-4fb4-818a-c9e97680829b tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.437115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c386590e-933c-4fb4-818a-c9e97680829b tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.437548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c386590e-933c-4fb4-818a-c9e97680829b tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.452363 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] HTTP exception thrown: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Request method failure captured: Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 HTTP/1.1 Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPC7xpbGzBRbcuAtMZpwQemC1wklEvm30pAWrZ860NsZnbfJsNYSgCVWFgH-dzeFCam5u5rS1HOntgul_Vw2dsa1y2W9QHCnuMwp_2dzXuyjftYRKr1B2DthMKwyrglHu0FJE1fXYbtF3mhCjeG_cT9DZ2ZCVG7R0ytjnXMxdLWSYOQ Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c0ac9145210548c78285621466d44b39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c0ac9145210548c78285621466d44b39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}] Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 550bea6ee48f4a8e81646d727d51a1d3 Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'd074edb8-863b-48c6-900d-2bcc2c5e23f6'} Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:29.453877 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:29.463179 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:29.463179 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:29.463179 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:29.463179 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:29.463179 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:29.463179 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:29.463179 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. Oct 11 04:28:29.463179 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:29.463179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Returning 404 to user: Instance d074edb8-863b-48c6-900d-2bcc2c5e23f6 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:29.463179 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b0346c42-b160-4a1d-b35a-da2bc521e065 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6" status: 404 len: 111 microversion: 2.1 time: 0.053254 Oct 11 04:28:29.463179 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1944/4089] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:29 2022] GET /compute/v2.1/servers/d074edb8-863b-48c6-900d-2bcc2c5e23f6 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:28:29.463835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7360e0ce-b3dd-48d9-98a1-6b39519084ba tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:29.464337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7360e0ce-b3dd-48d9-98a1-6b39519084ba tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: 98213491-b0bf-4bbb-aa2f-3399f13caa8a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:29.470977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7360e0ce-b3dd-48d9-98a1-6b39519084ba tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.471459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7360e0ce-b3dd-48d9-98a1-6b39519084ba tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.471995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7360e0ce-b3dd-48d9-98a1-6b39519084ba tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.472785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7360e0ce-b3dd-48d9-98a1-6b39519084ba tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.473239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7360e0ce-b3dd-48d9-98a1-6b39519084ba tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.479413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7360e0ce-b3dd-48d9-98a1-6b39519084ba tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.581475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c386590e-933c-4fb4-818a-c9e97680829b tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:29.590154 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c386590e-933c-4fb4-818a-c9e97680829b tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1505 microversion: 2.1 time: 0.181128 Oct 11 04:28:29.591028 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2146/4090] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:29 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:29.613447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30f8177f-b46c-424c-b6cd-7ffe7ce10b89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:29.614069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30f8177f-b46c-424c-b6cd-7ffe7ce10b89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:29.620255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f8177f-b46c-424c-b6cd-7ffe7ce10b89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.621126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f8177f-b46c-424c-b6cd-7ffe7ce10b89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.621394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f8177f-b46c-424c-b6cd-7ffe7ce10b89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.622033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f8177f-b46c-424c-b6cd-7ffe7ce10b89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.622516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f8177f-b46c-424c-b6cd-7ffe7ce10b89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.622944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f8177f-b46c-424c-b6cd-7ffe7ce10b89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.633575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7360e0ce-b3dd-48d9-98a1-6b39519084ba tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:29.642230 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7360e0ce-b3dd-48d9-98a1-6b39519084ba tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a" status: 200 len: 1522 microversion: 2.1 time: 0.182189 Oct 11 04:28:29.652884 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1945/4091] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:29 2022] GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:29.661953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-23b22cc9-41c3-46e4-8f16-d934f1f3c7af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:29.662764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-23b22cc9-41c3-46e4-8f16-d934f1f3c7af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b69a1768-2247-440e-b300-3fc2cfa64db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:29.669755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b22cc9-41c3-46e4-8f16-d934f1f3c7af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.670480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b22cc9-41c3-46e4-8f16-d934f1f3c7af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.671762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b22cc9-41c3-46e4-8f16-d934f1f3c7af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.672613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b22cc9-41c3-46e4-8f16-d934f1f3c7af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.673167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b22cc9-41c3-46e4-8f16-d934f1f3c7af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.673705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b22cc9-41c3-46e4-8f16-d934f1f3c7af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.779545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30f8177f-b46c-424c-b6cd-7ffe7ce10b89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:29.788163 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30f8177f-b46c-424c-b6cd-7ffe7ce10b89 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.180008 Oct 11 04:28:29.802761 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2147/4092] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:29 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:29.815552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-23b22cc9-41c3-46e4-8f16-d934f1f3c7af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:29.823266 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-23b22cc9-41c3-46e4-8f16-d934f1f3c7af tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9" status: 200 len: 1505 microversion: 2.1 time: 0.165874 Oct 11 04:28:29.823910 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1946/4093] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:29 2022] GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9 => generated 1505 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:29.847577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b5ca37f1-b73e-4bcf-96a8-7348840b8075 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:29.848077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b5ca37f1-b73e-4bcf-96a8-7348840b8075 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b69a1768-2247-440e-b300-3fc2cfa64db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:29.853955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5ca37f1-b73e-4bcf-96a8-7348840b8075 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.854510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5ca37f1-b73e-4bcf-96a8-7348840b8075 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.854915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5ca37f1-b73e-4bcf-96a8-7348840b8075 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.855599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5ca37f1-b73e-4bcf-96a8-7348840b8075 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:29.856053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5ca37f1-b73e-4bcf-96a8-7348840b8075 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:29.856475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5ca37f1-b73e-4bcf-96a8-7348840b8075 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:29.883331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b5ca37f1-b73e-4bcf-96a8-7348840b8075 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b69a1768-2247-440e-b300-3fc2cfa64db9] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:28:29.999624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2eca2561-60bf-45ef-a292-b91a52c601f2 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:30.000236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2eca2561-60bf-45ef-a292-b91a52c601f2 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:30.006862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eca2561-60bf-45ef-a292-b91a52c601f2 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.007366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eca2561-60bf-45ef-a292-b91a52c601f2 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.007796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eca2561-60bf-45ef-a292-b91a52c601f2 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.008486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eca2561-60bf-45ef-a292-b91a52c601f2 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.008931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eca2561-60bf-45ef-a292-b91a52c601f2 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.009352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eca2561-60bf-45ef-a292-b91a52c601f2 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.165764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2eca2561-60bf-45ef-a292-b91a52c601f2 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:30.174150 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2eca2561-60bf-45ef-a292-b91a52c601f2 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.178871 Oct 11 04:28:30.174731 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1947/4094] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:29 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:30.200872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1bbf81b1-2a5d-4a24-8583-dc264d85eeea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:30.201558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1bbf81b1-2a5d-4a24-8583-dc264d85eeea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:30.207518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bbf81b1-2a5d-4a24-8583-dc264d85eeea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.208182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bbf81b1-2a5d-4a24-8583-dc264d85eeea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.208615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bbf81b1-2a5d-4a24-8583-dc264d85eeea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.209298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bbf81b1-2a5d-4a24-8583-dc264d85eeea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.209785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bbf81b1-2a5d-4a24-8583-dc264d85eeea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.210166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bbf81b1-2a5d-4a24-8583-dc264d85eeea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.263216 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b5ca37f1-b73e-4bcf-96a8-7348840b8075 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9" status: 204 len: 0 microversion: 2.1 time: 0.418955 Oct 11 04:28:30.267796 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2148/4095] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:28:29 2022] DELETE /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:28:30.272056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9ef2464b-0485-4b88-9a6f-157e930b76ab tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:30.272691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9ef2464b-0485-4b88-9a6f-157e930b76ab tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:30.278673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef2464b-0485-4b88-9a6f-157e930b76ab tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.279156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef2464b-0485-4b88-9a6f-157e930b76ab tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.279589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef2464b-0485-4b88-9a6f-157e930b76ab tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.280505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef2464b-0485-4b88-9a6f-157e930b76ab tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.280961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef2464b-0485-4b88-9a6f-157e930b76ab tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.281389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ef2464b-0485-4b88-9a6f-157e930b76ab tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.308053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9ef2464b-0485-4b88-9a6f-157e930b76ab tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:28:30.376755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1bbf81b1-2a5d-4a24-8583-dc264d85eeea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:30.385147 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1bbf81b1-2a5d-4a24-8583-dc264d85eeea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.188048 Oct 11 04:28:30.385951 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1948/4096] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:30 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:30.650809 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9ef2464b-0485-4b88-9a6f-157e930b76ab tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "DELETE /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 204 len: 0 microversion: 2.1 time: 0.382391 Oct 11 04:28:30.654311 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2149/4097] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:28:30 2022] DELETE /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:28:30.659622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-364e0333-81b8-4b7e-9c4e-a8b966c95ec0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:30.663208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-364e0333-81b8-4b7e-9c4e-a8b966c95ec0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b69a1768-2247-440e-b300-3fc2cfa64db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:30.667881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bcb61133-8a8f-4e3b-83e7-439b409b91b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:30.668577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bcb61133-8a8f-4e3b-83e7-439b409b91b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: 98213491-b0bf-4bbb-aa2f-3399f13caa8a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:30.676384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-364e0333-81b8-4b7e-9c4e-a8b966c95ec0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.676868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-364e0333-81b8-4b7e-9c4e-a8b966c95ec0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.677297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-364e0333-81b8-4b7e-9c4e-a8b966c95ec0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.678023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-364e0333-81b8-4b7e-9c4e-a8b966c95ec0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.678555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-364e0333-81b8-4b7e-9c4e-a8b966c95ec0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.678985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-364e0333-81b8-4b7e-9c4e-a8b966c95ec0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.682502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb61133-8a8f-4e3b-83e7-439b409b91b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.687892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb61133-8a8f-4e3b-83e7-439b409b91b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.688352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb61133-8a8f-4e3b-83e7-439b409b91b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.689055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb61133-8a8f-4e3b-83e7-439b409b91b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.689505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb61133-8a8f-4e3b-83e7-439b409b91b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.690362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcb61133-8a8f-4e3b-83e7-439b409b91b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.868296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bcb61133-8a8f-4e3b-83e7-439b409b91b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:30.878575 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bcb61133-8a8f-4e3b-83e7-439b409b91b3 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a" status: 200 len: 1522 microversion: 2.1 time: 0.217143 Oct 11 04:28:30.879747 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2150/4098] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:30 2022] GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:30.882310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-364e0333-81b8-4b7e-9c4e-a8b966c95ec0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:30.885253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e8edb0a6-8a6c-4a01-b387-6d94eccbef53 req-a35ff4c6-91d0-42b6-aa6e-7fa405573d27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "806caeae-7326-4b20-956d-4bb4224bd5f4", "name": "network-vif-plugged", "status": "completed", "tag": "4bac0c4e-40cf-4498-a5c9-3d6a272f1f38"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:30.892595 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-364e0333-81b8-4b7e-9c4e-a8b966c95ec0 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9" status: 200 len: 1511 microversion: 2.1 time: 0.236852 Oct 11 04:28:30.900687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e8edb0a6-8a6c-4a01-b387-6d94eccbef53 req-a35ff4c6-91d0-42b6-aa6e-7fa405573d27 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.901411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e8edb0a6-8a6c-4a01-b387-6d94eccbef53 req-a35ff4c6-91d0-42b6-aa6e-7fa405573d27 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.902001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e8edb0a6-8a6c-4a01-b387-6d94eccbef53 req-a35ff4c6-91d0-42b6-aa6e-7fa405573d27 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.911037 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1949/4099] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:30 2022] GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9 => generated 1511 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:30.917236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1b185ccc-ce53-4730-a8f0-a0de5e737b56 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:30.918199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1b185ccc-ce53-4730-a8f0-a0de5e737b56 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:30.922033 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e8edb0a6-8a6c-4a01-b387-6d94eccbef53 req-a35ff4c6-91d0-42b6-aa6e-7fa405573d27 service nova] Creating event network-vif-plugged:4bac0c4e-40cf-4498-a5c9-3d6a272f1f38 for instance 806caeae-7326-4b20-956d-4bb4224bd5f4 on n-h1-860892-1 Oct 11 04:28:30.928413 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e8edb0a6-8a6c-4a01-b387-6d94eccbef53 req-a35ff4c6-91d0-42b6-aa6e-7fa405573d27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047221 Oct 11 04:28:30.929273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b185ccc-ce53-4730-a8f0-a0de5e737b56 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.929760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b185ccc-ce53-4730-a8f0-a0de5e737b56 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.930336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b185ccc-ce53-4730-a8f0-a0de5e737b56 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:30.931037 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2151/4100] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:30.934691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b185ccc-ce53-4730-a8f0-a0de5e737b56 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:30.935719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b185ccc-ce53-4730-a8f0-a0de5e737b56 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:30.936122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b185ccc-ce53-4730-a8f0-a0de5e737b56 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:31.090519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1b185ccc-ce53-4730-a8f0-a0de5e737b56 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:31.100499 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1b185ccc-ce53-4730-a8f0-a0de5e737b56 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.186844 Oct 11 04:28:31.101254 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1950/4101] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:30 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:31.198332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d65a33de-1639-433b-9266-21d65d6b6632 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:31.199381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d65a33de-1639-433b-9266-21d65d6b6632 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:31.207119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d65a33de-1639-433b-9266-21d65d6b6632 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:31.207610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d65a33de-1639-433b-9266-21d65d6b6632 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:31.208045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d65a33de-1639-433b-9266-21d65d6b6632 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:31.208781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d65a33de-1639-433b-9266-21d65d6b6632 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:31.209242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d65a33de-1639-433b-9266-21d65d6b6632 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:31.209667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d65a33de-1639-433b-9266-21d65d6b6632 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:31.353176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d65a33de-1639-433b-9266-21d65d6b6632 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:31.361785 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d65a33de-1639-433b-9266-21d65d6b6632 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.168580 Oct 11 04:28:31.362761 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2152/4102] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:31 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:31.410138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-01409793-2d01-4262-b3cf-400523a73222 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:31.410780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-01409793-2d01-4262-b3cf-400523a73222 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:31.417519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01409793-2d01-4262-b3cf-400523a73222 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:31.418153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01409793-2d01-4262-b3cf-400523a73222 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:31.418619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01409793-2d01-4262-b3cf-400523a73222 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:31.419319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01409793-2d01-4262-b3cf-400523a73222 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:31.419773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01409793-2d01-4262-b3cf-400523a73222 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:31.420200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01409793-2d01-4262-b3cf-400523a73222 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:31.588327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-01409793-2d01-4262-b3cf-400523a73222 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:31.596899 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-01409793-2d01-4262-b3cf-400523a73222 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.191307 Oct 11 04:28:31.597495 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1951/4103] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:31 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:31.908194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90d63510-0b57-430b-a522-acf9c76579f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:31.909655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90d63510-0b57-430b-a522-acf9c76579f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: 98213491-b0bf-4bbb-aa2f-3399f13caa8a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:31.923035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-37214222-dcda-417e-bd96-54cb8ce3bee9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:31.923035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-37214222-dcda-417e-bd96-54cb8ce3bee9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b69a1768-2247-440e-b300-3fc2cfa64db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:31.929692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37214222-dcda-417e-bd96-54cb8ce3bee9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:31.930226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37214222-dcda-417e-bd96-54cb8ce3bee9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:31.930664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37214222-dcda-417e-bd96-54cb8ce3bee9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:31.931368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37214222-dcda-417e-bd96-54cb8ce3bee9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:31.931845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37214222-dcda-417e-bd96-54cb8ce3bee9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:31.936463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d63510-0b57-430b-a522-acf9c76579f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:31.936970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d63510-0b57-430b-a522-acf9c76579f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:31.937406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d63510-0b57-430b-a522-acf9c76579f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:31.938111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d63510-0b57-430b-a522-acf9c76579f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:31.938769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37214222-dcda-417e-bd96-54cb8ce3bee9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:31.942814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d63510-0b57-430b-a522-acf9c76579f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:31.943441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90d63510-0b57-430b-a522-acf9c76579f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:32.102068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-90d63510-0b57-430b-a522-acf9c76579f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:32.111846 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90d63510-0b57-430b-a522-acf9c76579f2 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a" status: 200 len: 1522 microversion: 2.1 time: 0.208598 Oct 11 04:28:32.114246 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2153/4104] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:31 2022] GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:32.128137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d451595-b77d-4536-9be0-7dada242612c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:32.129063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d451595-b77d-4536-9be0-7dada242612c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:32.136451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d451595-b77d-4536-9be0-7dada242612c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:32.136939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d451595-b77d-4536-9be0-7dada242612c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:32.137409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d451595-b77d-4536-9be0-7dada242612c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:32.138105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d451595-b77d-4536-9be0-7dada242612c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:32.138586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d451595-b77d-4536-9be0-7dada242612c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:32.139005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d451595-b77d-4536-9be0-7dada242612c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:32.170843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-37214222-dcda-417e-bd96-54cb8ce3bee9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:32.185981 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-37214222-dcda-417e-bd96-54cb8ce3bee9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9" status: 200 len: 1511 microversion: 2.1 time: 0.268800 Oct 11 04:28:32.192792 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1952/4105] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:31 2022] GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9 => generated 1511 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:32.309186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d451595-b77d-4536-9be0-7dada242612c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:32.325455 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d451595-b77d-4536-9be0-7dada242612c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.202368 Oct 11 04:28:32.339321 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2154/4106] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:32 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:32.388336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92d8900c-d03d-4c81-a19d-51c5ecb4b93f tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:32.389079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-92d8900c-d03d-4c81-a19d-51c5ecb4b93f tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:32.397245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92d8900c-d03d-4c81-a19d-51c5ecb4b93f tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:32.397759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92d8900c-d03d-4c81-a19d-51c5ecb4b93f tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:32.398517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92d8900c-d03d-4c81-a19d-51c5ecb4b93f tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:32.399599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92d8900c-d03d-4c81-a19d-51c5ecb4b93f tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:32.400251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92d8900c-d03d-4c81-a19d-51c5ecb4b93f tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:32.400775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92d8900c-d03d-4c81-a19d-51c5ecb4b93f tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:32.625007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aaaf71bb-5e13-4d82-9247-a561ad4fbb71 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:32.627734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aaaf71bb-5e13-4d82-9247-a561ad4fbb71 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:32.666789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaaf71bb-5e13-4d82-9247-a561ad4fbb71 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:32.668373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaaf71bb-5e13-4d82-9247-a561ad4fbb71 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:32.669527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaaf71bb-5e13-4d82-9247-a561ad4fbb71 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:32.671633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaaf71bb-5e13-4d82-9247-a561ad4fbb71 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:32.672447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaaf71bb-5e13-4d82-9247-a561ad4fbb71 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:32.673685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aaaf71bb-5e13-4d82-9247-a561ad4fbb71 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:32.760242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92d8900c-d03d-4c81-a19d-51c5ecb4b93f tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:32.784492 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92d8900c-d03d-4c81-a19d-51c5ecb4b93f tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.403111 Oct 11 04:28:32.805091 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1953/4107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:32 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:32.818043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f20887e9-16d3-4d1d-8bc9-3d1825ef065d req-acb7f99c-74d7-4897-9812-de1dd149e980 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b69a1768-2247-440e-b300-3fc2cfa64db9", "name": "network-vif-deleted", "tag": "8f07363b-f557-4b10-81f6-7f6babc45aa1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:32.830435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f20887e9-16d3-4d1d-8bc9-3d1825ef065d req-acb7f99c-74d7-4897-9812-de1dd149e980 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:32.831380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f20887e9-16d3-4d1d-8bc9-3d1825ef065d req-acb7f99c-74d7-4897-9812-de1dd149e980 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:32.832553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f20887e9-16d3-4d1d-8bc9-3d1825ef065d req-acb7f99c-74d7-4897-9812-de1dd149e980 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:32.857260 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f20887e9-16d3-4d1d-8bc9-3d1825ef065d req-acb7f99c-74d7-4897-9812-de1dd149e980 service nova] Creating event network-vif-deleted:8f07363b-f557-4b10-81f6-7f6babc45aa1 for instance b69a1768-2247-440e-b300-3fc2cfa64db9 on n-h2-860892-1 Oct 11 04:28:32.870799 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f20887e9-16d3-4d1d-8bc9-3d1825ef065d req-acb7f99c-74d7-4897-9812-de1dd149e980 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062071 Oct 11 04:28:32.875970 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1954/4108] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:32.984616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aaaf71bb-5e13-4d82-9247-a561ad4fbb71 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:33.009984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aaaf71bb-5e13-4d82-9247-a561ad4fbb71 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.392684 Oct 11 04:28:33.011062 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2155/4109] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:32 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:33.141810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31dd77f8-bc92-43d7-beff-660387aeffc1 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:33.142712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-31dd77f8-bc92-43d7-beff-660387aeffc1 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: 98213491-b0bf-4bbb-aa2f-3399f13caa8a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:33.158143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd77f8-bc92-43d7-beff-660387aeffc1 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:33.161072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd77f8-bc92-43d7-beff-660387aeffc1 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:33.161745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd77f8-bc92-43d7-beff-660387aeffc1 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:33.162894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd77f8-bc92-43d7-beff-660387aeffc1 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:33.164153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd77f8-bc92-43d7-beff-660387aeffc1 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:33.165364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd77f8-bc92-43d7-beff-660387aeffc1 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:33.218489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:33.219458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b69a1768-2247-440e-b300-3fc2cfa64db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:33.240329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:33.242638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:33.244916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:33.248371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:33.249244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:33.252496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:33.363720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:33.364551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:33.366225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:33.366913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lazy-loading 'fault' on Instance uuid b69a1768-2247-440e-b300-3fc2cfa64db9 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:28:33.573160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-31dd77f8-bc92-43d7-beff-660387aeffc1 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:33.583934 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-31dd77f8-bc92-43d7-beff-660387aeffc1 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a" status: 200 len: 1522 microversion: 2.1 time: 0.450825 Oct 11 04:28:33.590283 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1955/4110] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:33 2022] GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a => generated 1522 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:33.601471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d21bc8c1-3582-4c29-9f01-ccfe5ba0692f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:33.603808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d21bc8c1-3582-4c29-9f01-ccfe5ba0692f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:33.632721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21bc8c1-3582-4c29-9f01-ccfe5ba0692f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:33.634153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21bc8c1-3582-4c29-9f01-ccfe5ba0692f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:33.636219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21bc8c1-3582-4c29-9f01-ccfe5ba0692f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:33.637110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21bc8c1-3582-4c29-9f01-ccfe5ba0692f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:33.638097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21bc8c1-3582-4c29-9f01-ccfe5ba0692f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:33.639695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d21bc8c1-3582-4c29-9f01-ccfe5ba0692f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:33.663948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:33.679435 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b946eae3-bed3-4406-aa87-86c3c4820f36 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9" status: 200 len: 1307 microversion: 2.1 time: 0.466266 Oct 11 04:28:33.680405 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2156/4111] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:33 2022] GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9 => generated 1307 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:33.812699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bddab4c4-3c2e-472f-9849-09e6f9902e95 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:33.813290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bddab4c4-3c2e-472f-9849-09e6f9902e95 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:33.826310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddab4c4-3c2e-472f-9849-09e6f9902e95 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:33.826786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddab4c4-3c2e-472f-9849-09e6f9902e95 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:33.827274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddab4c4-3c2e-472f-9849-09e6f9902e95 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:33.828005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddab4c4-3c2e-472f-9849-09e6f9902e95 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:33.828465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddab4c4-3c2e-472f-9849-09e6f9902e95 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:33.837911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bddab4c4-3c2e-472f-9849-09e6f9902e95 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:34.083196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d21bc8c1-3582-4c29-9f01-ccfe5ba0692f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:34.102231 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d21bc8c1-3582-4c29-9f01-ccfe5ba0692f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.510628 Oct 11 04:28:34.116311 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1956/4112] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:33 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:34.128236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5af92777-f2e1-4b74-a352-51ce46125275 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:34.129052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5af92777-f2e1-4b74-a352-51ce46125275 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:34.163776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af92777-f2e1-4b74-a352-51ce46125275 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:34.163776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af92777-f2e1-4b74-a352-51ce46125275 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:34.163776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af92777-f2e1-4b74-a352-51ce46125275 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:34.163776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af92777-f2e1-4b74-a352-51ce46125275 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:34.163776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af92777-f2e1-4b74-a352-51ce46125275 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:34.163776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af92777-f2e1-4b74-a352-51ce46125275 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:34.202663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:34.465486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5af92777-f2e1-4b74-a352-51ce46125275 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:34.469158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bddab4c4-3c2e-472f-9849-09e6f9902e95 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:34.484957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:34.498500 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5af92777-f2e1-4b74-a352-51ce46125275 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.380813 Oct 11 04:28:34.538562 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bddab4c4-3c2e-472f-9849-09e6f9902e95 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1323 microversion: 2.1 time: 0.712881 Oct 11 04:28:34.538562 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2157/4113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:33 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1323 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:34.538719 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1957/4114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:34 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:34.614823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f54bf1e9-6192-49c4-8571-e8b0c2adf6bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:34.617515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f54bf1e9-6192-49c4-8571-e8b0c2adf6bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: 98213491-b0bf-4bbb-aa2f-3399f13caa8a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:34.645222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f54bf1e9-6192-49c4-8571-e8b0c2adf6bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:34.646121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f54bf1e9-6192-49c4-8571-e8b0c2adf6bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:34.646798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f54bf1e9-6192-49c4-8571-e8b0c2adf6bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:34.648134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f54bf1e9-6192-49c4-8571-e8b0c2adf6bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:34.652700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f54bf1e9-6192-49c4-8571-e8b0c2adf6bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:34.656256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f54bf1e9-6192-49c4-8571-e8b0c2adf6bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:34.706913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:34.707754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b69a1768-2247-440e-b300-3fc2cfa64db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:34.751556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:34.752707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:34.753182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:34.753909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:34.760172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:34.760668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:34.863185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:34.864000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:34.864581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:34.865178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lazy-loading 'fault' on Instance uuid b69a1768-2247-440e-b300-3fc2cfa64db9 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:28:34.981194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:34.991572 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7bde6cff-7550-4977-a8f2-2f381c873a71 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9" status: 200 len: 1307 microversion: 2.1 time: 0.290319 Oct 11 04:28:35.002878 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1958/4115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:34 2022] GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9 => generated 1307 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:35.010877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-304a8404-bace-404a-974b-996c90c2cc66 req-5bec332c-988f-4fc7-9a2b-8efa9048c157 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2314117-db3f-476d-a14a-345f2feb9366", "name": "network-vif-deleted", "tag": "9d46b09c-5fc6-4a6e-ab74-4ceae2e21015"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:35.023076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-304a8404-bace-404a-974b-996c90c2cc66 req-5bec332c-988f-4fc7-9a2b-8efa9048c157 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:35.024826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-304a8404-bace-404a-974b-996c90c2cc66 req-5bec332c-988f-4fc7-9a2b-8efa9048c157 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:35.025691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-304a8404-bace-404a-974b-996c90c2cc66 req-5bec332c-988f-4fc7-9a2b-8efa9048c157 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:35.054444 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-304a8404-bace-404a-974b-996c90c2cc66 req-5bec332c-988f-4fc7-9a2b-8efa9048c157 service nova] Creating event network-vif-deleted:9d46b09c-5fc6-4a6e-ab74-4ceae2e21015 for instance a2314117-db3f-476d-a14a-345f2feb9366 on n-h1-860892-1 Oct 11 04:28:35.060730 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-304a8404-bace-404a-974b-996c90c2cc66 req-5bec332c-988f-4fc7-9a2b-8efa9048c157 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065991 Oct 11 04:28:35.062607 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1959/4116] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:35.132421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1b74762b-7fae-43b6-910b-5813cb06c697 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:35.134214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1b74762b-7fae-43b6-910b-5813cb06c697 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:35.152674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b74762b-7fae-43b6-910b-5813cb06c697 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:35.158765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b74762b-7fae-43b6-910b-5813cb06c697 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:35.158765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b74762b-7fae-43b6-910b-5813cb06c697 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:35.158765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b74762b-7fae-43b6-910b-5813cb06c697 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:35.158765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b74762b-7fae-43b6-910b-5813cb06c697 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:35.158765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b74762b-7fae-43b6-910b-5813cb06c697 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:35.166109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f54bf1e9-6192-49c4-8571-e8b0c2adf6bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:35.175809 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f54bf1e9-6192-49c4-8571-e8b0c2adf6bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a" status: 200 len: 1522 microversion: 2.1 time: 0.565591 Oct 11 04:28:35.183583 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2158/4117] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:34 2022] GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a => generated 1522 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:35.433645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1b74762b-7fae-43b6-910b-5813cb06c697 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:35.450652 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1b74762b-7fae-43b6-910b-5813cb06c697 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.322384 Oct 11 04:28:35.454036 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1960/4118] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:35 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:35.525497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b83bffda-0709-4716-a072-07db9bb8ed2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:35.526175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b83bffda-0709-4716-a072-07db9bb8ed2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:35.542953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b83bffda-0709-4716-a072-07db9bb8ed2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:35.543464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b83bffda-0709-4716-a072-07db9bb8ed2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:35.554672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4ed5a62f-3b8c-49a4-bad8-dfff24c27baf tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:35.555401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4ed5a62f-3b8c-49a4-bad8-dfff24c27baf tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:35.555821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b83bffda-0709-4716-a072-07db9bb8ed2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:35.558603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b83bffda-0709-4716-a072-07db9bb8ed2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:35.562099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b83bffda-0709-4716-a072-07db9bb8ed2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:35.566555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b83bffda-0709-4716-a072-07db9bb8ed2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:35.570861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed5a62f-3b8c-49a4-bad8-dfff24c27baf tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:35.574179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed5a62f-3b8c-49a4-bad8-dfff24c27baf tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:35.574720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed5a62f-3b8c-49a4-bad8-dfff24c27baf tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:35.590419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed5a62f-3b8c-49a4-bad8-dfff24c27baf tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:35.591027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed5a62f-3b8c-49a4-bad8-dfff24c27baf tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:35.591478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed5a62f-3b8c-49a4-bad8-dfff24c27baf tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:35.979752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ed5a62f-3b8c-49a4-bad8-dfff24c27baf tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:35.996335 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4ed5a62f-3b8c-49a4-bad8-dfff24c27baf tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1518 microversion: 2.1 time: 0.442599 Oct 11 04:28:35.999732 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1961/4119] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:35 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1518 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:36.014967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-dc1c44c9-57de-4f29-b90d-b70abce76083 req-479434a1-0b46-4a46-9996-62df9d858ded service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98213491-b0bf-4bbb-aa2f-3399f13caa8a", "name": "network-vif-deleted", "tag": "fa93e5a6-3e57-4071-9fa9-bd845e54bd0a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:36.025657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b83bffda-0709-4716-a072-07db9bb8ed2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:36.040552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-dc1c44c9-57de-4f29-b90d-b70abce76083 req-479434a1-0b46-4a46-9996-62df9d858ded service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:36.048846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-dc1c44c9-57de-4f29-b90d-b70abce76083 req-479434a1-0b46-4a46-9996-62df9d858ded service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:36.048846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-dc1c44c9-57de-4f29-b90d-b70abce76083 req-479434a1-0b46-4a46-9996-62df9d858ded service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:36.074670 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b83bffda-0709-4716-a072-07db9bb8ed2b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.553425 Oct 11 04:28:36.081980 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-dc1c44c9-57de-4f29-b90d-b70abce76083 req-479434a1-0b46-4a46-9996-62df9d858ded service nova] Creating event network-vif-deleted:fa93e5a6-3e57-4071-9fa9-bd845e54bd0a for instance 98213491-b0bf-4bbb-aa2f-3399f13caa8a on n-h1-860892-1 Oct 11 04:28:36.098946 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-dc1c44c9-57de-4f29-b90d-b70abce76083 req-479434a1-0b46-4a46-9996-62df9d858ded service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094205 Oct 11 04:28:36.099376 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2159/4120] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:35 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:36.099874 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1962/4121] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:36.112698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:36.117961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: b69a1768-2247-440e-b300-3fc2cfa64db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:36.131111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:36.133348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:36.134004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:36.135077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:36.135690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:36.136312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:36.156893 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] HTTP exception thrown: Instance b69a1768-2247-440e-b300-3fc2cfa64db9 could not be found. Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Request method failure captured: Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9 HTTP/1.1 Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPCymPoIJcSA6sHmqzOfWI6gkk7divNzkU8BHjGVPVcBVnJFl2c47uoI4XpypPOK3LIfKBXam0YYv6jwxXWDUpbjorbMTJjlzg6sxz22PuLx6ueeIJiGaIv8OZSK-w_TFv0FK6qYPQrPi16H55uQC3ZnOK9PT2EiiaKIB-vi8IvA_4Q Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: c86df48dcef542c180c7b6dc0d9bac52 Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-MultipleCreateTestJSON-703744065 Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c86df48dcef542c180c7b6dc0d9bac52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c86df48dcef542c180c7b6dc0d9bac52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c86df48dcef542c180c7b6dc0d9bac52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c86df48dcef542c180c7b6dc0d9bac52"}]}] Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-MultipleCreateTestJSON-703744065 Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: c86df48dcef542c180c7b6dc0d9bac52 Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-MultipleCreateTestJSON-703744065 Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-MultipleCreateTestJSON-703744065-project Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 66f6c41ffe084f1bb93a918b81f98ecc Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-MultipleCreateTestJSON-703744065-project Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance b69a1768-2247-440e-b300-3fc2cfa64db9 could not be found. Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'b69a1768-2247-440e-b300-3fc2cfa64db9'} Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b69a1768-2247-440e-b300-3fc2cfa64db9 could not be found. Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b69a1768-2247-440e-b300-3fc2cfa64db9 could not be found. Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.159272 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.163028 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.163028 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.163028 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.163028 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:36.163028 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:36.163028 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b69a1768-2247-440e-b300-3fc2cfa64db9 could not be found. Oct 11 04:28:36.163028 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.164754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Returning 404 to user: Instance b69a1768-2247-440e-b300-3fc2cfa64db9 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:36.165773 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ddad01c9-b57c-4b25-ba64-764106763746 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9" status: 404 len: 111 microversion: 2.1 time: 0.061205 Oct 11 04:28:36.166832 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2160/4122] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:36 2022] GET /compute/v2.1/servers/b69a1768-2247-440e-b300-3fc2cfa64db9 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:28:36.178026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a4c84b53-1232-4159-b7de-d2e77152d52c tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:36.180535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a4c84b53-1232-4159-b7de-d2e77152d52c tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:36.187800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c84b53-1232-4159-b7de-d2e77152d52c tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:36.188493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c84b53-1232-4159-b7de-d2e77152d52c tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:36.189236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c84b53-1232-4159-b7de-d2e77152d52c tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:36.190272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c84b53-1232-4159-b7de-d2e77152d52c tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:36.190862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c84b53-1232-4159-b7de-d2e77152d52c tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:36.191421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c84b53-1232-4159-b7de-d2e77152d52c tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:36.209240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:36.209855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: 98213491-b0bf-4bbb-aa2f-3399f13caa8a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:36.227918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:36.228415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:36.229019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:36.229862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:36.230715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:36.234675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:36.307273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a4c84b53-1232-4159-b7de-d2e77152d52c tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:36.316112 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a4c84b53-1232-4159-b7de-d2e77152d52c tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1469 microversion: 2.1 time: 0.143736 Oct 11 04:28:36.319636 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1963/4123] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:36 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1469 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:36.338307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b3c62647-dec1-4020-bdf0-39ec2013195d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-247696716", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "eb02ea25-81c5-4495-9952-2472f9330109"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b3c62647-dec1-4020-bdf0-39ec2013195d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Request method failure captured: Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 242 Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPDYWYs9u1_HTinhwh2CU0TePj-Nu2MuOQ115wswfIU7eVeGhZ4YYvimeFrUTgolN0H1boPEI5b5AMZtojlEFvW0Q14alimYRmAjjlAUoMA3sI7q9PEUfvtpjD-H_TV9-FehBXzJ4TFv2FgxwcczmD5C3dhyptTyQFwcVRrDYOx7SxY Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}] Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fde0862f53b44ff78ca90ef763745749 Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-247696716", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"": "data1"}, "networks": [{"uuid": "eb02ea25-81c5-4495-9952-2472f9330109"}]}} Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-247696716', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'metadata': {'': 'data1'}, 'networks': [{'uuid': 'eb02ea25-81c5-4495-9952-2472f9330109'}]}}} Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'': 'data1'} Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:36.349989 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.353578 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.355462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b3c62647-dec1-4020-bdf0-39ec2013195d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'': 'data1'}. '' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:36.357624 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b3c62647-dec1-4020-bdf0-39ec2013195d tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 175 microversion: 2.1 time: 0.029800 Oct 11 04:28:36.368585 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1964/4124] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:28:36 2022] POST /compute/v2.1/servers => generated 175 bytes in 39 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:28:36.377734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-641f0c6c-2df7-40e9-a8b2-5ac60c76f847 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:36.384514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:36.384514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:36.384514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:36.384514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lazy-loading 'fault' on Instance uuid 98213491-b0bf-4bbb-aa2f-3399f13caa8a {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:28:36.384796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-641f0c6c-2df7-40e9-a8b2-5ac60c76f847 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 05c03940-0b2f-474c-afa4-d58754494ba2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:36.392146 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-641f0c6c-2df7-40e9-a8b2-5ac60c76f847 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] HTTP exception thrown: Instance 05c03940-0b2f-474c-afa4-d58754494ba2 could not be found. Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-641f0c6c-2df7-40e9-a8b2-5ac60c76f847 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Request method failure captured: Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/05c03940-0b2f-474c-afa4-d58754494ba2/metadata HTTP/1.1 Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPDYWYs9u1_HTinhwh2CU0TePj-Nu2MuOQ115wswfIU7eVeGhZ4YYvimeFrUTgolN0H1boPEI5b5AMZtojlEFvW0Q14alimYRmAjjlAUoMA3sI7q9PEUfvtpjD-H_TV9-FehBXzJ4TFv2FgxwcczmD5C3dhyptTyQFwcVRrDYOx7SxY Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}] Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fde0862f53b44ff78ca90ef763745749 Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 05c03940-0b2f-474c-afa4-d58754494ba2 could not be found. Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': '05c03940-0b2f-474c-afa4-d58754494ba2'} Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c03940-0b2f-474c-afa4-d58754494ba2 could not be found. Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 54, in index Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c03940-0b2f-474c-afa4-d58754494ba2 could not be found. Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.398941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.402346 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:36.402346 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:36.402346 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c03940-0b2f-474c-afa4-d58754494ba2 could not be found. Oct 11 04:28:36.402346 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.403258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-641f0c6c-2df7-40e9-a8b2-5ac60c76f847 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Returning 404 to user: Instance 05c03940-0b2f-474c-afa4-d58754494ba2 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:36.404271 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-641f0c6c-2df7-40e9-a8b2-5ac60c76f847 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/05c03940-0b2f-474c-afa4-d58754494ba2/metadata" status: 404 len: 111 microversion: 2.1 time: 0.034474 Oct 11 04:28:36.407236 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1965/4125] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:28:36 2022] GET /compute/v2.1/servers/05c03940-0b2f-474c-afa4-d58754494ba2/metadata => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:28:36.481881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-19b99aa8-d360-4add-8c2b-8508f11c2528 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:36.483947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-19b99aa8-d360-4add-8c2b-8508f11c2528 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:36.499762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b99aa8-d360-4add-8c2b-8508f11c2528 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:36.499762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b99aa8-d360-4add-8c2b-8508f11c2528 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:36.499762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b99aa8-d360-4add-8c2b-8508f11c2528 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:36.500227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b99aa8-d360-4add-8c2b-8508f11c2528 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:36.502538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b99aa8-d360-4add-8c2b-8508f11c2528 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:36.503944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b99aa8-d360-4add-8c2b-8508f11c2528 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:36.513481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '550bea6ee48f4a8e81646d727d51a1d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0ac9145210548c78285621466d44b39', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:36.532044 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-79d82ddb-5915-42a9-8d03-06526f8c4f8a tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a" status: 200 len: 1313 microversion: 2.1 time: 0.326315 Oct 11 04:28:36.533437 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2161/4126] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:36 2022] GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a => generated 1313 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:36.560117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-963f6ad5-65b6-40ed-ae3b-54fb95f71821 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1142863322", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "eb02ea25-81c5-4495-9952-2472f9330109"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-963f6ad5-65b6-40ed-ae3b-54fb95f71821 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Request method failure captured: Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 499 Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPDYWYs9u1_HTinhwh2CU0TePj-Nu2MuOQ115wswfIU7eVeGhZ4YYvimeFrUTgolN0H1boPEI5b5AMZtojlEFvW0Q14alimYRmAjjlAUoMA3sI7q9PEUfvtpjD-H_TV9-FehBXzJ4TFv2FgxwcczmD5C3dhyptTyQFwcVRrDYOx7SxY Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}] Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fde0862f53b44ff78ca90ef763745749 Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1142863322", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "eb02ea25-81c5-4495-9952-2472f9330109"}]}} Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1142863322', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'eb02ea25-81c5-4495-9952-2472f9330109'}]}}} Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 04:28:36.567647 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.569970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-963f6ad5-65b6-40ed-ae3b-54fb95f71821 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:36.571645 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-963f6ad5-65b6-40ed-ae3b-54fb95f71821 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 687 microversion: 2.1 time: 0.014786 Oct 11 04:28:36.574966 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2162/4127] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:28:36 2022] POST /compute/v2.1/servers => generated 687 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:28:36.642449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d58a4ec3-0625-48c0-9ccc-9d350a5a9883 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-307391717", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "eb02ea25-81c5-4495-9952-2472f9330109"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d58a4ec3-0625-48c0-9ccc-9d350a5a9883 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Request method failure captured: Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 499 Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPDYWYs9u1_HTinhwh2CU0TePj-Nu2MuOQ115wswfIU7eVeGhZ4YYvimeFrUTgolN0H1boPEI5b5AMZtojlEFvW0Q14alimYRmAjjlAUoMA3sI7q9PEUfvtpjD-H_TV9-FehBXzJ4TFv2FgxwcczmD5C3dhyptTyQFwcVRrDYOx7SxY Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}] Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fde0862f53b44ff78ca90ef763745749 Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-307391717", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "eb02ea25-81c5-4495-9952-2472f9330109"}]}} Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-307391717', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'eb02ea25-81c5-4495-9952-2472f9330109'}]}}} Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 04:28:36.654825 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.658370 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.661928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d58a4ec3-0625-48c0-9ccc-9d350a5a9883 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:36.663099 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d58a4ec3-0625-48c0-9ccc-9d350a5a9883 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 689 microversion: 2.1 time: 0.034200 Oct 11 04:28:36.663906 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2163/4128] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:28:36 2022] POST /compute/v2.1/servers => generated 689 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:28:36.740502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5daa4887-e150-41c7-833c-945733aeef2c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1244189481", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "eb02ea25-81c5-4495-9952-2472f9330109"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5daa4887-e150-41c7-833c-945733aeef2c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Request method failure captured: Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 754 Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPDYWYs9u1_HTinhwh2CU0TePj-Nu2MuOQ115wswfIU7eVeGhZ4YYvimeFrUTgolN0H1boPEI5b5AMZtojlEFvW0Q14alimYRmAjjlAUoMA3sI7q9PEUfvtpjD-H_TV9-FehBXzJ4TFv2FgxwcczmD5C3dhyptTyQFwcVRrDYOx7SxY Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}] Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fde0862f53b44ff78ca90ef763745749 Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-1244189481", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "eb02ea25-81c5-4495-9952-2472f9330109"}]}} Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-1244189481', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'eb02ea25-81c5-4495-9952-2472f9330109'}]}}} Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:28:36.747027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:28:36.749360 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:28:36.753501 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.753501 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.754557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5daa4887-e150-41c7-833c-945733aeef2c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:36.755992 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5daa4887-e150-41c7-833c-945733aeef2c tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 1197 microversion: 2.1 time: 0.021727 Oct 11 04:28:36.757582 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2164/4129] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:28:36 2022] POST /compute/v2.1/servers => generated 1197 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 382 bytes (1 switches on core 0) Oct 11 04:28:36.789225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-19b99aa8-d360-4add-8c2b-8508f11c2528 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:36.800030 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-19b99aa8-d360-4add-8c2b-8508f11c2528 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.323836 Oct 11 04:28:36.806572 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1966/4130] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:36 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:36.908112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b0af468-6ae7-4116-8c77-35489ed3f934 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2012201044", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "eb02ea25-81c5-4495-9952-2472f9330109"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b0af468-6ae7-4116-8c77-35489ed3f934 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Request method failure captured: Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 1266 Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPDYWYs9u1_HTinhwh2CU0TePj-Nu2MuOQ115wswfIU7eVeGhZ4YYvimeFrUTgolN0H1boPEI5b5AMZtojlEFvW0Q14alimYRmAjjlAUoMA3sI7q9PEUfvtpjD-H_TV9-FehBXzJ4TFv2FgxwcczmD5C3dhyptTyQFwcVRrDYOx7SxY Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}] Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fde0862f53b44ff78ca90ef763745749 Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-ServerMetadataNegativeTestJSON-server-2012201044", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk": "data1"}, "networks": [{"uuid": "eb02ea25-81c5-4495-9952-2472f9330109"}]}} Oct 11 04:28:36.916791 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-ServerMetadataNegativeTestJSON-server-2012201044', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'metadata': {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}, 'networks': [{'uuid': 'eb02ea25-81c5-4495-9952-2472f9330109'}]}}} Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'additionalProperties' in schema['properties']['server']['properties']['metadata']: Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'additionalProperties': False, Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'patternProperties': {'^[a-zA-Z0-9-_:. ]{1,255}$': {'maxLength': 255, Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': 'string'}}, Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'type': 'object'} Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.920435 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'} Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:28:36.922880 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:28:36.925852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' Oct 11 04:28:36.925852 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:36.925852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b0af468-6ae7-4116-8c77-35489ed3f934 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Returning 400 to user: Invalid input for field/attribute metadata. Value: {'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk': 'data1'}. 'kkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkkk' does not match any of the regexes: '^[a-zA-Z0-9-_:. ]{1,255}$' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:36.931998 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1b0af468-6ae7-4116-8c77-35489ed3f934 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 2221 microversion: 2.1 time: 0.031440 Oct 11 04:28:36.933201 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2165/4131] 10.222.0.26 () {60 vars in 1148 bytes} [Tue Oct 11 04:28:36 2022] POST /compute/v2.1/servers => generated 2221 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 382 bytes (2 switches on core 0) Oct 11 04:28:36.971691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52f7084c-b442-4b80-9613-a66d8a7ecf4a tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:36.977207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-52f7084c-b442-4b80-9613-a66d8a7ecf4a tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: fe500be4-2399-4d6c-a238-be735fef301c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:37.005100 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-52f7084c-b442-4b80-9613-a66d8a7ecf4a tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] HTTP exception thrown: Instance fe500be4-2399-4d6c-a238-be735fef301c could not be found. Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52f7084c-b442-4b80-9613-a66d8a7ecf4a tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Request method failure captured: Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/fe500be4-2399-4d6c-a238-be735fef301c/metadata/test2 HTTP/1.1 Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPDYWYs9u1_HTinhwh2CU0TePj-Nu2MuOQ115wswfIU7eVeGhZ4YYvimeFrUTgolN0H1boPEI5b5AMZtojlEFvW0Q14alimYRmAjjlAUoMA3sI7q9PEUfvtpjD-H_TV9-FehBXzJ4TFv2FgxwcczmD5C3dhyptTyQFwcVRrDYOx7SxY Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}] Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fde0862f53b44ff78ca90ef763745749 Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance fe500be4-2399-4d6c-a238-be735fef301c could not be found. Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': 'fe500be4-2399-4d6c-a238-be735fef301c', 'id': 'test2'} Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe500be4-2399-4d6c-a238-be735fef301c could not be found. Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_metadata.py", line 129, in show Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, server_id) Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe500be4-2399-4d6c-a238-be735fef301c could not be found. Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:37.009714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:37.016294 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:37.016294 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:37.016294 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe500be4-2399-4d6c-a238-be735fef301c could not be found. Oct 11 04:28:37.016294 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.017753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52f7084c-b442-4b80-9613-a66d8a7ecf4a tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Returning 404 to user: Instance fe500be4-2399-4d6c-a238-be735fef301c could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:37.019207 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-52f7084c-b442-4b80-9613-a66d8a7ecf4a tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/fe500be4-2399-4d6c-a238-be735fef301c/metadata/test2" status: 404 len: 111 microversion: 2.1 time: 0.058759 Oct 11 04:28:37.020199 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1967/4132] 10.222.0.26 () {58 vars in 1281 bytes} [Tue Oct 11 04:28:36 2022] GET /compute/v2.1/servers/fe500be4-2399-4d6c-a238-be735fef301c/metadata/test2 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:28:37.060169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c9daef68-eb0c-43bb-8732-812d17144dab tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:37.060983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c9daef68-eb0c-43bb-8732-812d17144dab tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:37.099622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9daef68-eb0c-43bb-8732-812d17144dab tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.099622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9daef68-eb0c-43bb-8732-812d17144dab tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.099622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9daef68-eb0c-43bb-8732-812d17144dab tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.105320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cf9a7720-d34f-4aa8-a83f-604a3e1d783d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:37.105997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf9a7720-d34f-4aa8-a83f-604a3e1d783d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:37.114320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9daef68-eb0c-43bb-8732-812d17144dab tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.115005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9daef68-eb0c-43bb-8732-812d17144dab tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.115542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9daef68-eb0c-43bb-8732-812d17144dab tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.116143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9a7720-d34f-4aa8-a83f-604a3e1d783d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.116645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9a7720-d34f-4aa8-a83f-604a3e1d783d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.117131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9a7720-d34f-4aa8-a83f-604a3e1d783d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.122491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9a7720-d34f-4aa8-a83f-604a3e1d783d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.122978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9a7720-d34f-4aa8-a83f-604a3e1d783d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.123418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9a7720-d34f-4aa8-a83f-604a3e1d783d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.165725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c9daef68-eb0c-43bb-8732-812d17144dab tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:28:37.308083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:37.423419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cf9a7720-d34f-4aa8-a83f-604a3e1d783d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:37.438460 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cf9a7720-d34f-4aa8-a83f-604a3e1d783d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.337210 Oct 11 04:28:37.439690 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1968/4133] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:37 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:37.463552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:37.465590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:37.485210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.486557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.487239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.488274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.489019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.489648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.550523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.551835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.552790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.553562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lazy-loading 'fault' on Instance uuid 036bd026-451b-47dc-83f7-8ece730155b4 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:28:37.578247 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c9daef68-eb0c-43bb-8732-812d17144dab tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "DELETE /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 204 len: 0 microversion: 2.1 time: 0.522573 Oct 11 04:28:37.580370 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2166/4134] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:28:37 2022] DELETE /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:28:37.586355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:37.589960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: 98213491-b0bf-4bbb-aa2f-3399f13caa8a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:37.601935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.603189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.603962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.604826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.605647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.606256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.616231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:37.628463 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a556a778-24ae-41ea-86b9-e7c96dfe8702 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1307 microversion: 2.1 time: 0.186875 Oct 11 04:28:37.630411 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1969/4135] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:37 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1307 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:37.639049 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] HTTP exception thrown: Instance 98213491-b0bf-4bbb-aa2f-3399f13caa8a could not be found. Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Request method failure captured: Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a HTTP/1.1 Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPC7xpbGzBRbcuAtMZpwQemC1wklEvm30pAWrZ860NsZnbfJsNYSgCVWFgH-dzeFCam5u5rS1HOntgul_Vw2dsa1y2W9QHCnuMwp_2dzXuyjftYRKr1B2DthMKwyrglHu0FJE1fXYbtF3mhCjeG_cT9DZ2ZCVG7R0ytjnXMxdLWSYOQ Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c0ac9145210548c78285621466d44b39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c0ac9145210548c78285621466d44b39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}] Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 550bea6ee48f4a8e81646d727d51a1d3 Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 98213491-b0bf-4bbb-aa2f-3399f13caa8a could not be found. Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '98213491-b0bf-4bbb-aa2f-3399f13caa8a'} Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98213491-b0bf-4bbb-aa2f-3399f13caa8a could not be found. Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98213491-b0bf-4bbb-aa2f-3399f13caa8a could not be found. Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.642154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:37.645805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.645805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:37.645805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:37.645805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:37.645805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:37.645805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:37.645805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98213491-b0bf-4bbb-aa2f-3399f13caa8a could not be found. Oct 11 04:28:37.645805 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.646204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fdd18497-a87b-4bde-a01f-3fe726065e04 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:37.650686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Returning 404 to user: Instance 98213491-b0bf-4bbb-aa2f-3399f13caa8a could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:37.650805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fdd18497-a87b-4bde-a01f-3fe726065e04 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:37.653137 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-364545eb-5230-40ca-a393-60a3cfab08bc tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a" status: 404 len: 111 microversion: 2.1 time: 0.070538 Oct 11 04:28:37.655447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:37.657710 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2167/4136] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:37 2022] GET /compute/v2.1/servers/98213491-b0bf-4bbb-aa2f-3399f13caa8a => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:28:37.663410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdd18497-a87b-4bde-a01f-3fe726065e04 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.664012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdd18497-a87b-4bde-a01f-3fe726065e04 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.664451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdd18497-a87b-4bde-a01f-3fe726065e04 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.665505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdd18497-a87b-4bde-a01f-3fe726065e04 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.666405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdd18497-a87b-4bde-a01f-3fe726065e04 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.666990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdd18497-a87b-4bde-a01f-3fe726065e04 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.674579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:37.675365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] [instance: a2314117-db3f-476d-a14a-345f2feb9366] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:37.692086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.698096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.698692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.700131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.700700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.701356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.741402 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] HTTP exception thrown: Instance a2314117-db3f-476d-a14a-345f2feb9366 could not be found. Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Request method failure captured: Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 HTTP/1.1 Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPC7xpbGzBRbcuAtMZpwQemC1wklEvm30pAWrZ860NsZnbfJsNYSgCVWFgH-dzeFCam5u5rS1HOntgul_Vw2dsa1y2W9QHCnuMwp_2dzXuyjftYRKr1B2DthMKwyrglHu0FJE1fXYbtF3mhCjeG_cT9DZ2ZCVG7R0ytjnXMxdLWSYOQ Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c0ac9145210548c78285621466d44b39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c0ac9145210548c78285621466d44b39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c0ac9145210548c78285621466d44b39"}]}] Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: c0ac9145210548c78285621466d44b39 Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ListServersNegativeTestJSON-732637879 Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 550bea6ee48f4a8e81646d727d51a1d3 Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ListServersNegativeTestJSON-732637879-project Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance a2314117-db3f-476d-a14a-345f2feb9366 could not be found. Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'a2314117-db3f-476d-a14a-345f2feb9366'} Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a2314117-db3f-476d-a14a-345f2feb9366 could not be found. Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a2314117-db3f-476d-a14a-345f2feb9366 could not be found. Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.747198 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:37.751954 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.751954 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:37.751954 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:37.751954 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:37.751954 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:37.751954 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:37.751954 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a2314117-db3f-476d-a14a-345f2feb9366 could not be found. Oct 11 04:28:37.751954 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:37.755877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] Returning 404 to user: Instance a2314117-db3f-476d-a14a-345f2feb9366 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:37.757839 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f23c46c5-73bf-45be-8631-4864a0c33bc5 tempest-ListServersNegativeTestJSON-732637879 tempest-ListServersNegativeTestJSON-732637879-project] 10.222.0.26 "GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366" status: 404 len: 111 microversion: 2.1 time: 0.095642 Oct 11 04:28:37.759072 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2168/4137] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:37 2022] GET /compute/v2.1/servers/a2314117-db3f-476d-a14a-345f2feb9366 => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:28:37.830686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a0efec85-be0c-47bb-93d2-0bafd65e18ce tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:37.832299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a0efec85-be0c-47bb-93d2-0bafd65e18ce tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:37.845504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0efec85-be0c-47bb-93d2-0bafd65e18ce tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.849406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0efec85-be0c-47bb-93d2-0bafd65e18ce tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.849904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0efec85-be0c-47bb-93d2-0bafd65e18ce tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.850668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0efec85-be0c-47bb-93d2-0bafd65e18ce tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:37.851135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0efec85-be0c-47bb-93d2-0bafd65e18ce tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:37.851571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0efec85-be0c-47bb-93d2-0bafd65e18ce tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:37.901933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fdd18497-a87b-4bde-a01f-3fe726065e04 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:37.912246 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fdd18497-a87b-4bde-a01f-3fe726065e04 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1524 microversion: 2.1 time: 0.280627 Oct 11 04:28:37.915906 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1970/4138] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:37 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1524 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:38.118842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c633842b-6b7b-44b9-a327-1c5c2a64ffb4 req-729536c0-039d-4c03-a23f-1aecb9b805c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "036bd026-451b-47dc-83f7-8ece730155b4", "name": "network-vif-deleted", "tag": "4442371d-53b1-425c-83e7-d71425c37735"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:38.135160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:38.137519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c633842b-6b7b-44b9-a327-1c5c2a64ffb4 req-729536c0-039d-4c03-a23f-1aecb9b805c5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:38.138006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c633842b-6b7b-44b9-a327-1c5c2a64ffb4 req-729536c0-039d-4c03-a23f-1aecb9b805c5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:38.138469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c633842b-6b7b-44b9-a327-1c5c2a64ffb4 req-729536c0-039d-4c03-a23f-1aecb9b805c5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:38.155481 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c633842b-6b7b-44b9-a327-1c5c2a64ffb4 req-729536c0-039d-4c03-a23f-1aecb9b805c5 service nova] Creating event network-vif-deleted:4442371d-53b1-425c-83e7-d71425c37735 for instance 036bd026-451b-47dc-83f7-8ece730155b4 on n-h1-860892-1 Oct 11 04:28:38.181630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c633842b-6b7b-44b9-a327-1c5c2a64ffb4 req-729536c0-039d-4c03-a23f-1aecb9b805c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068369 Oct 11 04:28:38.185181 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1971/4139] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:28:38.219061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a0efec85-be0c-47bb-93d2-0bafd65e18ce tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:38.246276 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a0efec85-be0c-47bb-93d2-0bafd65e18ce tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.421110 Oct 11 04:28:38.248662 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2169/4140] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:37 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:38.461705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:38.470645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f41830c8-b625-4594-b086-ea930609600b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:38.474561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f41830c8-b625-4594-b086-ea930609600b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:38.495852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f41830c8-b625-4594-b086-ea930609600b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:38.501475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f41830c8-b625-4594-b086-ea930609600b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:38.502142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f41830c8-b625-4594-b086-ea930609600b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:38.503087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f41830c8-b625-4594-b086-ea930609600b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:38.503703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f41830c8-b625-4594-b086-ea930609600b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:38.504317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f41830c8-b625-4594-b086-ea930609600b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:38.659653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:38.661781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:38.672663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=5 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:38.679249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:38.680566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:38.681792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:38.685312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:38.686454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:38.687540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:38.757304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:38.758925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:38.760040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:38.760942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lazy-loading 'fault' on Instance uuid 036bd026-451b-47dc-83f7-8ece730155b4 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:28:38.912003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66f6c41ffe084f1bb93a918b81f98ecc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c86df48dcef542c180c7b6dc0d9bac52', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:38.927369 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a47b1904-de6d-4500-9e85-efd359da49d5 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 200 len: 1307 microversion: 2.1 time: 0.272420 Oct 11 04:28:38.929605 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2170/4141] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:38 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 1307 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:38.944954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2fefa91c-522c-4ff8-b3aa-2dd04cdfc9ce tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:38.947628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2fefa91c-522c-4ff8-b3aa-2dd04cdfc9ce tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:38.962305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fefa91c-522c-4ff8-b3aa-2dd04cdfc9ce tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:38.964646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fefa91c-522c-4ff8-b3aa-2dd04cdfc9ce tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:38.965877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fefa91c-522c-4ff8-b3aa-2dd04cdfc9ce tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:38.967038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fefa91c-522c-4ff8-b3aa-2dd04cdfc9ce tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:38.969352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fefa91c-522c-4ff8-b3aa-2dd04cdfc9ce tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:38.970063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fefa91c-522c-4ff8-b3aa-2dd04cdfc9ce tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:38.999864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f41830c8-b625-4594-b086-ea930609600b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:39.016701 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f41830c8-b625-4594-b086-ea930609600b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1655 microversion: 2.1 time: 0.557051 Oct 11 04:28:39.017293 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1972/4142] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:38 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1655 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:39.048185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-616b6d78-9fcb-4abc-b5df-698ab2b5af52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:39.062440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-616b6d78-9fcb-4abc-b5df-698ab2b5af52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:39.063044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-616b6d78-9fcb-4abc-b5df-698ab2b5af52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:39.064707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-616b6d78-9fcb-4abc-b5df-698ab2b5af52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:39.123629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-616b6d78-9fcb-4abc-b5df-698ab2b5af52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Going to try to start instance {{(pid=120993) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 04:28:39.249543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2fefa91c-522c-4ff8-b3aa-2dd04cdfc9ce tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:39.265489 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2fefa91c-522c-4ff8-b3aa-2dd04cdfc9ce tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1524 microversion: 2.1 time: 0.323850 Oct 11 04:28:39.267949 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2171/4143] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:38 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1524 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:39.289892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-78e7017f-216f-4809-ad44-49f21c5e8cda tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:39.290542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-78e7017f-216f-4809-ad44-49f21c5e8cda tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:39.312697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78e7017f-216f-4809-ad44-49f21c5e8cda tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:39.313491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78e7017f-216f-4809-ad44-49f21c5e8cda tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:39.314092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78e7017f-216f-4809-ad44-49f21c5e8cda tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:39.316615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78e7017f-216f-4809-ad44-49f21c5e8cda tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:39.317722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78e7017f-216f-4809-ad44-49f21c5e8cda tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:39.319426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78e7017f-216f-4809-ad44-49f21c5e8cda tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:39.449939 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-616b6d78-9fcb-4abc-b5df-698ab2b5af52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.411752 Oct 11 04:28:39.455017 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1973/4144] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:39 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:28:39.464183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bb97afc4-512b-4d70-b586-74e98efc51d0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:39.469698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bb97afc4-512b-4d70-b586-74e98efc51d0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:39.491048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb97afc4-512b-4d70-b586-74e98efc51d0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:39.493809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb97afc4-512b-4d70-b586-74e98efc51d0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:39.494533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb97afc4-512b-4d70-b586-74e98efc51d0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:39.495874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb97afc4-512b-4d70-b586-74e98efc51d0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:39.500014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb97afc4-512b-4d70-b586-74e98efc51d0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:39.500832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb97afc4-512b-4d70-b586-74e98efc51d0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:39.636092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-78e7017f-216f-4809-ad44-49f21c5e8cda tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:39.680321 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-78e7017f-216f-4809-ad44-49f21c5e8cda tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.409566 Oct 11 04:28:39.682352 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2172/4145] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:39 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:39.712152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb97afc4-512b-4d70-b586-74e98efc51d0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:39.721119 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bb97afc4-512b-4d70-b586-74e98efc51d0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1664 microversion: 2.1 time: 0.263849 Oct 11 04:28:39.723675 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1974/4146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:39 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1664 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:39.959080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:39.959804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] [instance: 036bd026-451b-47dc-83f7-8ece730155b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:39.966039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:39.966703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:39.967458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:39.968910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:39.969589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:39.970132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:39.986309 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] HTTP exception thrown: Instance 036bd026-451b-47dc-83f7-8ece730155b4 could not be found. Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Request method failure captured: Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 HTTP/1.1 Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPCymPoIJcSA6sHmqzOfWI6gkk7divNzkU8BHjGVPVcBVnJFl2c47uoI4XpypPOK3LIfKBXam0YYv6jwxXWDUpbjorbMTJjlzg6sxz22PuLx6ueeIJiGaIv8OZSK-w_TFv0FK6qYPQrPi16H55uQC3ZnOK9PT2EiiaKIB-vi8IvA_4Q Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: c86df48dcef542c180c7b6dc0d9bac52 Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-MultipleCreateTestJSON-703744065 Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c86df48dcef542c180c7b6dc0d9bac52"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c86df48dcef542c180c7b6dc0d9bac52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c86df48dcef542c180c7b6dc0d9bac52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c86df48dcef542c180c7b6dc0d9bac52"}]}] Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-MultipleCreateTestJSON-703744065 Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: c86df48dcef542c180c7b6dc0d9bac52 Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-MultipleCreateTestJSON-703744065 Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-MultipleCreateTestJSON-703744065-project Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 66f6c41ffe084f1bb93a918b81f98ecc Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-MultipleCreateTestJSON-703744065-project Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 036bd026-451b-47dc-83f7-8ece730155b4 could not be found. Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '036bd026-451b-47dc-83f7-8ece730155b4'} Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 036bd026-451b-47dc-83f7-8ece730155b4 could not be found. Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 036bd026-451b-47dc-83f7-8ece730155b4 could not be found. Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:39.988086 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:39.991686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:39.991686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:39.991686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:39.991686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:39.991686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:39.991686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 036bd026-451b-47dc-83f7-8ece730155b4 could not be found. Oct 11 04:28:39.991686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:39.992935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] Returning 404 to user: Instance 036bd026-451b-47dc-83f7-8ece730155b4 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:39.993944 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b932240d-00b6-4a9f-b461-fc880e6f90d9 tempest-MultipleCreateTestJSON-703744065 tempest-MultipleCreateTestJSON-703744065-project] 10.222.0.26 "GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4" status: 404 len: 111 microversion: 2.1 time: 0.038810 Oct 11 04:28:39.995969 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2173/4147] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:39 2022] GET /compute/v2.1/servers/036bd026-451b-47dc-83f7-8ece730155b4 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:28:40.289303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-18711cc8-b023-445a-a3cf-6f09bedd9bca tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:40.289932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-18711cc8-b023-445a-a3cf-6f09bedd9bca tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:40.309768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18711cc8-b023-445a-a3cf-6f09bedd9bca tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:40.310309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18711cc8-b023-445a-a3cf-6f09bedd9bca tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:40.310755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18711cc8-b023-445a-a3cf-6f09bedd9bca tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:40.311518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18711cc8-b023-445a-a3cf-6f09bedd9bca tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:40.315540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18711cc8-b023-445a-a3cf-6f09bedd9bca tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:40.316323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18711cc8-b023-445a-a3cf-6f09bedd9bca tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:40.708349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fcd5e5bd-08c8-4d3a-8683-efd5d69fabb1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:40.710374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fcd5e5bd-08c8-4d3a-8683-efd5d69fabb1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:40.722100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcd5e5bd-08c8-4d3a-8683-efd5d69fabb1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:40.725416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcd5e5bd-08c8-4d3a-8683-efd5d69fabb1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:40.728810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcd5e5bd-08c8-4d3a-8683-efd5d69fabb1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:40.732168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcd5e5bd-08c8-4d3a-8683-efd5d69fabb1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:40.734704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcd5e5bd-08c8-4d3a-8683-efd5d69fabb1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:40.749621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fcd5e5bd-08c8-4d3a-8683-efd5d69fabb1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:41.270797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18711cc8-b023-445a-a3cf-6f09bedd9bca tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:41.285069 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-18711cc8-b023-445a-a3cf-6f09bedd9bca tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1524 microversion: 2.1 time: 0.996596 Oct 11 04:28:41.305795 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1975/4148] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:40 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1524 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:41.316846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7004bdd3-cc84-4c35-993b-a342d25813b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:41.323328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7004bdd3-cc84-4c35-993b-a342d25813b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:41.337347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7004bdd3-cc84-4c35-993b-a342d25813b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:41.338666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7004bdd3-cc84-4c35-993b-a342d25813b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:41.341086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7004bdd3-cc84-4c35-993b-a342d25813b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:41.342981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7004bdd3-cc84-4c35-993b-a342d25813b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:41.343784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7004bdd3-cc84-4c35-993b-a342d25813b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:41.344441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7004bdd3-cc84-4c35-993b-a342d25813b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:41.705933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fcd5e5bd-08c8-4d3a-8683-efd5d69fabb1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:41.714011 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fcd5e5bd-08c8-4d3a-8683-efd5d69fabb1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 1.009961 Oct 11 04:28:41.714677 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2174/4149] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:40 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 1013 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:41.894307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7004bdd3-cc84-4c35-993b-a342d25813b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:41.903658 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7004bdd3-cc84-4c35-993b-a342d25813b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1664 microversion: 2.1 time: 0.595088 Oct 11 04:28:41.905886 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1976/4150] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:41 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1664 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:42.313238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-16ddedb2-0f86-4c64-b56a-a43ca7ea6886 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:42.314256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-16ddedb2-0f86-4c64-b56a-a43ca7ea6886 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:42.327802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16ddedb2-0f86-4c64-b56a-a43ca7ea6886 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:42.329652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16ddedb2-0f86-4c64-b56a-a43ca7ea6886 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:42.331427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16ddedb2-0f86-4c64-b56a-a43ca7ea6886 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:42.334475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16ddedb2-0f86-4c64-b56a-a43ca7ea6886 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:42.335216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16ddedb2-0f86-4c64-b56a-a43ca7ea6886 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:42.338794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16ddedb2-0f86-4c64-b56a-a43ca7ea6886 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:42.742448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f5ba175-af90-433a-85d8-648b79f45026 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:42.743266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2f5ba175-af90-433a-85d8-648b79f45026 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:42.772328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f5ba175-af90-433a-85d8-648b79f45026 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:42.773704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f5ba175-af90-433a-85d8-648b79f45026 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:42.776064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f5ba175-af90-433a-85d8-648b79f45026 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:42.781640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f5ba175-af90-433a-85d8-648b79f45026 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:42.782118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f5ba175-af90-433a-85d8-648b79f45026 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:42.788196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f5ba175-af90-433a-85d8-648b79f45026 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:42.801529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-16ddedb2-0f86-4c64-b56a-a43ca7ea6886 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:42.813468 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-16ddedb2-0f86-4c64-b56a-a43ca7ea6886 tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1482 microversion: 2.1 time: 0.504992 Oct 11 04:28:42.834980 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2175/4151] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:42 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1482 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:42.873476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1504c5ea-8444-4803-b1c1-3272fd9ef257 req-9d8c4496-2fdc-4d14-b84a-b03af0dd45f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "806caeae-7326-4b20-956d-4bb4224bd5f4", "name": "network-vif-deleted", "tag": "4bac0c4e-40cf-4498-a5c9-3d6a272f1f38"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:42.879138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:42.899221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1504c5ea-8444-4803-b1c1-3272fd9ef257 req-9d8c4496-2fdc-4d14-b84a-b03af0dd45f8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:42.901176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1504c5ea-8444-4803-b1c1-3272fd9ef257 req-9d8c4496-2fdc-4d14-b84a-b03af0dd45f8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:42.910610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1504c5ea-8444-4803-b1c1-3272fd9ef257 req-9d8c4496-2fdc-4d14-b84a-b03af0dd45f8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:42.949682 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1504c5ea-8444-4803-b1c1-3272fd9ef257 req-9d8c4496-2fdc-4d14-b84a-b03af0dd45f8 service nova] Creating event network-vif-deleted:4bac0c4e-40cf-4498-a5c9-3d6a272f1f38 for instance 806caeae-7326-4b20-956d-4bb4224bd5f4 on n-h1-860892-1 Oct 11 04:28:42.961321 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1504c5ea-8444-4803-b1c1-3272fd9ef257 req-9d8c4496-2fdc-4d14-b84a-b03af0dd45f8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091406 Oct 11 04:28:42.962757 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2176/4152] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:28:42.979219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-800a28c4-82d2-4ee8-8e9d-45b2d51dc216 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:42.981006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-800a28c4-82d2-4ee8-8e9d-45b2d51dc216 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:42.990101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-800a28c4-82d2-4ee8-8e9d-45b2d51dc216 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:42.991161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-800a28c4-82d2-4ee8-8e9d-45b2d51dc216 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:42.992975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-800a28c4-82d2-4ee8-8e9d-45b2d51dc216 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:42.994059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-800a28c4-82d2-4ee8-8e9d-45b2d51dc216 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:42.996508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-800a28c4-82d2-4ee8-8e9d-45b2d51dc216 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:42.998260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-800a28c4-82d2-4ee8-8e9d-45b2d51dc216 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:43.307950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-800a28c4-82d2-4ee8-8e9d-45b2d51dc216 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:43.320020 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-800a28c4-82d2-4ee8-8e9d-45b2d51dc216 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1664 microversion: 2.1 time: 0.353640 Oct 11 04:28:43.331816 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2177/4153] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:42 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1664 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:43.362575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b59bdd19-61bc-474a-907f-0cd9e187d974 req-29e49659-c932-4883-b9d5-32dfdbe9f503 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa836dc-900d-4ca8-9400-c7beb1739be1", "name": "network-vif-unplugged", "status": "completed", "tag": "6bd011bd-c917-4d3c-93b6-c411b91b9a58"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:43.429511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b59bdd19-61bc-474a-907f-0cd9e187d974 req-29e49659-c932-4883-b9d5-32dfdbe9f503 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:43.432233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b59bdd19-61bc-474a-907f-0cd9e187d974 req-29e49659-c932-4883-b9d5-32dfdbe9f503 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:43.435013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b59bdd19-61bc-474a-907f-0cd9e187d974 req-29e49659-c932-4883-b9d5-32dfdbe9f503 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:43.468694 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b59bdd19-61bc-474a-907f-0cd9e187d974 req-29e49659-c932-4883-b9d5-32dfdbe9f503 service nova] Creating event network-vif-unplugged:6bd011bd-c917-4d3c-93b6-c411b91b9a58 for instance afa836dc-900d-4ca8-9400-c7beb1739be1 on n-h2-860892-1 Oct 11 04:28:43.476015 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b59bdd19-61bc-474a-907f-0cd9e187d974 req-29e49659-c932-4883-b9d5-32dfdbe9f503 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.142100 Oct 11 04:28:43.476649 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2178/4154] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:28:43.677129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f5ba175-af90-433a-85d8-648b79f45026 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:43.685599 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f5ba175-af90-433a-85d8-648b79f45026 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.947765 Oct 11 04:28:43.690708 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1977/4155] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:42 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:43.851365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:43.852055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:43.861421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:43.864952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:43.866628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:43.869548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:43.870223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:43.870723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:43.925649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:43.926139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:43.926608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:43.927164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lazy-loading 'fault' on Instance uuid 806caeae-7326-4b20-956d-4bb4224bd5f4 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:28:43.980384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fde0862f53b44ff78ca90ef763745749', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84c78ea51c6549519de9ed02fdb51e5c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:43.987473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:43.994339 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8c601c77-ee5d-490f-af5f-35ebf5e8ad6b tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 200 len: 1313 microversion: 2.1 time: 0.148119 Oct 11 04:28:43.995709 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2179/4156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:43 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:44.719209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-05baf0fc-4e0e-4b92-aabc-17c7463e3a78 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:44.719899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-05baf0fc-4e0e-4b92-aabc-17c7463e3a78 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:44.736035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05baf0fc-4e0e-4b92-aabc-17c7463e3a78 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:44.736758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05baf0fc-4e0e-4b92-aabc-17c7463e3a78 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:44.737314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05baf0fc-4e0e-4b92-aabc-17c7463e3a78 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:44.741395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05baf0fc-4e0e-4b92-aabc-17c7463e3a78 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:44.742002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05baf0fc-4e0e-4b92-aabc-17c7463e3a78 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:44.743144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05baf0fc-4e0e-4b92-aabc-17c7463e3a78 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:44.800140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d4a0eae8-d933-4abe-b0ba-627332429fab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:44.800780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d4a0eae8-d933-4abe-b0ba-627332429fab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:44.820596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4a0eae8-d933-4abe-b0ba-627332429fab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:44.821086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4a0eae8-d933-4abe-b0ba-627332429fab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:44.824260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4a0eae8-d933-4abe-b0ba-627332429fab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:44.826392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4a0eae8-d933-4abe-b0ba-627332429fab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:44.829377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4a0eae8-d933-4abe-b0ba-627332429fab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:44.831965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4a0eae8-d933-4abe-b0ba-627332429fab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:45.049348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-05baf0fc-4e0e-4b92-aabc-17c7463e3a78 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:45.068178 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-05baf0fc-4e0e-4b92-aabc-17c7463e3a78 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.354110 Oct 11 04:28:45.071234 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2180/4157] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:44 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:45.079764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:45.081320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] [instance: 806caeae-7326-4b20-956d-4bb4224bd5f4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:45.090385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:45.091636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:45.092313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:45.093569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:45.094214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:45.094890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:45.111858 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] HTTP exception thrown: Instance 806caeae-7326-4b20-956d-4bb4224bd5f4 could not be found. Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Request method failure captured: Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 HTTP/1.1 Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPDYWYs9u1_HTinhwh2CU0TePj-Nu2MuOQ115wswfIU7eVeGhZ4YYvimeFrUTgolN0H1boPEI5b5AMZtojlEFvW0Q14alimYRmAjjlAUoMA3sI7q9PEUfvtpjD-H_TV9-FehBXzJ4TFv2FgxwcczmD5C3dhyptTyQFwcVRrDYOx7SxY Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/84c78ea51c6549519de9ed02fdb51e5c"}]}] Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 84c78ea51c6549519de9ed02fdb51e5c Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerMetadataNegativeTestJSON-1369005925 Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fde0862f53b44ff78ca90ef763745749 Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerMetadataNegativeTestJSON-1369005925-project Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 806caeae-7326-4b20-956d-4bb4224bd5f4 could not be found. Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '806caeae-7326-4b20-956d-4bb4224bd5f4'} Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 806caeae-7326-4b20-956d-4bb4224bd5f4 could not be found. Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 806caeae-7326-4b20-956d-4bb4224bd5f4 could not be found. Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:45.114014 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:28:45.117275 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:45.117275 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:28:45.117275 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:28:45.117275 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:28:45.117275 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:28:45.117275 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:28:45.117275 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 806caeae-7326-4b20-956d-4bb4224bd5f4 could not be found. Oct 11 04:28:45.117275 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:28:45.119690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] Returning 404 to user: Instance 806caeae-7326-4b20-956d-4bb4224bd5f4 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:28:45.120769 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b5a28c0-3998-4503-93e9-62d298f6ebcc tempest-ServerMetadataNegativeTestJSON-1369005925 tempest-ServerMetadataNegativeTestJSON-1369005925-project] 10.222.0.26 "GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4" status: 404 len: 111 microversion: 2.1 time: 0.046526 Oct 11 04:28:45.122617 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2181/4158] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:45 2022] GET /compute/v2.1/servers/806caeae-7326-4b20-956d-4bb4224bd5f4 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:28:45.774282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-3d50d7d6-c609-4cc2-9270-7d1f1dc4efb1 req-805cf77a-45f4-4002-8526-bc4f44f10e92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afa836dc-900d-4ca8-9400-c7beb1739be1", "tag": "6bd011bd-c917-4d3c-93b6-c411b91b9a58"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:45.818052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3d50d7d6-c609-4cc2-9270-7d1f1dc4efb1 req-805cf77a-45f4-4002-8526-bc4f44f10e92 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:45.820366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3d50d7d6-c609-4cc2-9270-7d1f1dc4efb1 req-805cf77a-45f4-4002-8526-bc4f44f10e92 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:45.820994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3d50d7d6-c609-4cc2-9270-7d1f1dc4efb1 req-805cf77a-45f4-4002-8526-bc4f44f10e92 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:45.868713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d4a0eae8-d933-4abe-b0ba-627332429fab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:45.920018 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-3d50d7d6-c609-4cc2-9270-7d1f1dc4efb1 req-805cf77a-45f4-4002-8526-bc4f44f10e92 service nova] Creating event network-changed:6bd011bd-c917-4d3c-93b6-c411b91b9a58 for instance afa836dc-900d-4ca8-9400-c7beb1739be1 on n-h2-860892-1 Oct 11 04:28:45.926726 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d4a0eae8-d933-4abe-b0ba-627332429fab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 1.571731 Oct 11 04:28:45.928691 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1978/4159] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:44 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 1587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:45.951089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cb4faa4-eb80-4fd4-b64a-4c39155f6c37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:45.953504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2cb4faa4-eb80-4fd4-b64a-4c39155f6c37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:45.967561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb4faa4-eb80-4fd4-b64a-4c39155f6c37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:45.970360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb4faa4-eb80-4fd4-b64a-4c39155f6c37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:45.971097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb4faa4-eb80-4fd4-b64a-4c39155f6c37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:45.978638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb4faa4-eb80-4fd4-b64a-4c39155f6c37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:45.978975 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-3d50d7d6-c609-4cc2-9270-7d1f1dc4efb1 req-805cf77a-45f4-4002-8526-bc4f44f10e92 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.204043 Oct 11 04:28:45.979056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb4faa4-eb80-4fd4-b64a-4c39155f6c37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:45.979056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cb4faa4-eb80-4fd4-b64a-4c39155f6c37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:45.990342 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2182/4160] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:28:46.104732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b32e01cd-f007-48f2-abfa-95684f53c4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:46.110363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b32e01cd-f007-48f2-abfa-95684f53c4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:46.166511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32e01cd-f007-48f2-abfa-95684f53c4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:46.171148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32e01cd-f007-48f2-abfa-95684f53c4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:46.173468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32e01cd-f007-48f2-abfa-95684f53c4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:46.180680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32e01cd-f007-48f2-abfa-95684f53c4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:46.182944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32e01cd-f007-48f2-abfa-95684f53c4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:46.184738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32e01cd-f007-48f2-abfa-95684f53c4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:46.750450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b32e01cd-f007-48f2-abfa-95684f53c4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:46.761482 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b32e01cd-f007-48f2-abfa-95684f53c4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.664784 Oct 11 04:28:46.762407 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2183/4161] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:46 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:47.112461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2cb4faa4-eb80-4fd4-b64a-4c39155f6c37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:47.126646 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2cb4faa4-eb80-4fd4-b64a-4c39155f6c37 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 1.180438 Oct 11 04:28:47.127902 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1979/4162] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:45 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:47.158528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff83ee9a-3ff0-4b8f-a47c-52e41ba72bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"unlock": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:47.180423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ff83ee9a-3ff0-4b8f-a47c-52e41ba72bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:47.180423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff83ee9a-3ff0-4b8f-a47c-52e41ba72bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:47.180423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff83ee9a-3ff0-4b8f-a47c-52e41ba72bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:47.180423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff83ee9a-3ff0-4b8f-a47c-52e41ba72bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:47.180423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff83ee9a-3ff0-4b8f-a47c-52e41ba72bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:47.180423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff83ee9a-3ff0-4b8f-a47c-52e41ba72bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:47.180423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff83ee9a-3ff0-4b8f-a47c-52e41ba72bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:47.459237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ff83ee9a-3ff0-4b8f-a47c-52e41ba72bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Unlocking {{(pid=120994) unlock /opt/stack/nova/nova/compute/api.py:4874}} Oct 11 04:28:47.785863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c4092b9b-93bc-4998-866b-fb1cba4970dd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:47.786885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c4092b9b-93bc-4998-866b-fb1cba4970dd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:47.800562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4092b9b-93bc-4998-866b-fb1cba4970dd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:47.805065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4092b9b-93bc-4998-866b-fb1cba4970dd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:47.805801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4092b9b-93bc-4998-866b-fb1cba4970dd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:47.806905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4092b9b-93bc-4998-866b-fb1cba4970dd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:47.807570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4092b9b-93bc-4998-866b-fb1cba4970dd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:47.808508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4092b9b-93bc-4998-866b-fb1cba4970dd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:47.811846 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff83ee9a-3ff0-4b8f-a47c-52e41ba72bff tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.658103 Oct 11 04:28:47.817229 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2184/4163] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:47 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:28:47.822898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-21da4433-9894-47c0-a7de-8b57cc7101e1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:47.823597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-21da4433-9894-47c0-a7de-8b57cc7101e1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:47.844628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21da4433-9894-47c0-a7de-8b57cc7101e1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:47.845845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21da4433-9894-47c0-a7de-8b57cc7101e1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:47.845845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21da4433-9894-47c0-a7de-8b57cc7101e1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:47.849180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21da4433-9894-47c0-a7de-8b57cc7101e1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:47.849882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21da4433-9894-47c0-a7de-8b57cc7101e1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:47.851914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21da4433-9894-47c0-a7de-8b57cc7101e1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:48.337874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-21da4433-9894-47c0-a7de-8b57cc7101e1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:48.349885 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-21da4433-9894-47c0-a7de-8b57cc7101e1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.530872 Oct 11 04:28:48.352070 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2185/4164] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:47 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:48.389697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-343090c9-5b10-4c24-bd09-795214637dc0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:48.391136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-343090c9-5b10-4c24-bd09-795214637dc0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:48.397643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-343090c9-5b10-4c24-bd09-795214637dc0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:48.398454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-343090c9-5b10-4c24-bd09-795214637dc0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:48.399134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-343090c9-5b10-4c24-bd09-795214637dc0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:48.400057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-343090c9-5b10-4c24-bd09-795214637dc0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:48.400717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-343090c9-5b10-4c24-bd09-795214637dc0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:48.401365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-343090c9-5b10-4c24-bd09-795214637dc0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:48.559943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c4092b9b-93bc-4998-866b-fb1cba4970dd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:48.570562 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c4092b9b-93bc-4998-866b-fb1cba4970dd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.788847 Oct 11 04:28:48.581492 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1980/4165] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:47 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:49.174904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-343090c9-5b10-4c24-bd09-795214637dc0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:49.200270 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-343090c9-5b10-4c24-bd09-795214637dc0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.810113 Oct 11 04:28:49.217671 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2186/4166] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:48 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:49.237041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8301c35c-a3aa-4a11-bb89-bb1a0c84f5d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:49.239909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8301c35c-a3aa-4a11-bb89-bb1a0c84f5d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:49.264580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8301c35c-a3aa-4a11-bb89-bb1a0c84f5d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:49.272732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8301c35c-a3aa-4a11-bb89-bb1a0c84f5d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:49.272732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8301c35c-a3aa-4a11-bb89-bb1a0c84f5d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:49.272732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8301c35c-a3aa-4a11-bb89-bb1a0c84f5d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:49.272732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8301c35c-a3aa-4a11-bb89-bb1a0c84f5d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:49.272732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8301c35c-a3aa-4a11-bb89-bb1a0c84f5d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:49.603124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31e3d910-07e0-4cdb-a331-ff72fb2bd9e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:49.604383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31e3d910-07e0-4cdb-a331-ff72fb2bd9e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:49.623565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e3d910-07e0-4cdb-a331-ff72fb2bd9e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:49.625805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e3d910-07e0-4cdb-a331-ff72fb2bd9e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:49.626789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e3d910-07e0-4cdb-a331-ff72fb2bd9e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:49.627561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e3d910-07e0-4cdb-a331-ff72fb2bd9e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:49.628034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e3d910-07e0-4cdb-a331-ff72fb2bd9e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:49.631128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31e3d910-07e0-4cdb-a331-ff72fb2bd9e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:50.528159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8301c35c-a3aa-4a11-bb89-bb1a0c84f5d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:50.558637 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8301c35c-a3aa-4a11-bb89-bb1a0c84f5d8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 1.331930 Oct 11 04:28:50.559741 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1981/4167] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:49 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 1334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:50.589627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce036651-d501-4fd4-91fe-eaafaa4ad941 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:50.590745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce036651-d501-4fd4-91fe-eaafaa4ad941 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:50.598770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce036651-d501-4fd4-91fe-eaafaa4ad941 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:50.599476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce036651-d501-4fd4-91fe-eaafaa4ad941 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:50.630329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce036651-d501-4fd4-91fe-eaafaa4ad941 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:50.630329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce036651-d501-4fd4-91fe-eaafaa4ad941 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:50.630329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce036651-d501-4fd4-91fe-eaafaa4ad941 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:50.631317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-31e3d910-07e0-4cdb-a331-ff72fb2bd9e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:50.631918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce036651-d501-4fd4-91fe-eaafaa4ad941 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:50.632004 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31e3d910-07e0-4cdb-a331-ff72fb2bd9e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 1.016648 Oct 11 04:28:50.633369 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2187/4168] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:49 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 1035 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:51.460333 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce036651-d501-4fd4-91fe-eaafaa4ad941 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.866453 Oct 11 04:28:51.460333 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1982/4169] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:50 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 870 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:28:51.462163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4c9f8dda-4120-4440-81d3-3d48fa1071d1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:51.462998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4c9f8dda-4120-4440-81d3-3d48fa1071d1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:51.487941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9f8dda-4120-4440-81d3-3d48fa1071d1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:51.488659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9f8dda-4120-4440-81d3-3d48fa1071d1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:51.491497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9f8dda-4120-4440-81d3-3d48fa1071d1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:51.492410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9f8dda-4120-4440-81d3-3d48fa1071d1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:51.493022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9f8dda-4120-4440-81d3-3d48fa1071d1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:51.513143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9f8dda-4120-4440-81d3-3d48fa1071d1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:51.651535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fe117716-d1a6-4885-9266-4c70d85f38c7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:51.655476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fe117716-d1a6-4885-9266-4c70d85f38c7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:51.675316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe117716-d1a6-4885-9266-4c70d85f38c7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:51.676101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe117716-d1a6-4885-9266-4c70d85f38c7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:51.676697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe117716-d1a6-4885-9266-4c70d85f38c7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:51.677747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe117716-d1a6-4885-9266-4c70d85f38c7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:51.678959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe117716-d1a6-4885-9266-4c70d85f38c7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:51.679546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe117716-d1a6-4885-9266-4c70d85f38c7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:52.125423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4c9f8dda-4120-4440-81d3-3d48fa1071d1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:52.146136 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4c9f8dda-4120-4440-81d3-3d48fa1071d1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1673 microversion: 2.1 time: 0.687424 Oct 11 04:28:52.149487 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2188/4170] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:51 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1673 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:52.246300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fe117716-d1a6-4885-9266-4c70d85f38c7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:52.266708 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fe117716-d1a6-4885-9266-4c70d85f38c7 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.622440 Oct 11 04:28:52.272337 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1983/4171] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:51 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:53.187774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d1727f6-22a5-4fa5-9e2f-dcdb7831bd2a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:53.189525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d1727f6-22a5-4fa5-9e2f-dcdb7831bd2a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:53.207596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1727f6-22a5-4fa5-9e2f-dcdb7831bd2a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:53.208115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1727f6-22a5-4fa5-9e2f-dcdb7831bd2a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:53.208569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1727f6-22a5-4fa5-9e2f-dcdb7831bd2a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:53.209281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1727f6-22a5-4fa5-9e2f-dcdb7831bd2a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:53.209720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1727f6-22a5-4fa5-9e2f-dcdb7831bd2a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:53.215840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1727f6-22a5-4fa5-9e2f-dcdb7831bd2a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:53.307027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f9e095b-581e-4bd9-a779-d5c55a1eaa00 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:53.307644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f9e095b-581e-4bd9-a779-d5c55a1eaa00 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:53.339427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9e095b-581e-4bd9-a779-d5c55a1eaa00 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:53.351302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9e095b-581e-4bd9-a779-d5c55a1eaa00 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:53.372153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9e095b-581e-4bd9-a779-d5c55a1eaa00 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:53.375605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9e095b-581e-4bd9-a779-d5c55a1eaa00 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:53.391610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9e095b-581e-4bd9-a779-d5c55a1eaa00 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:53.391610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f9e095b-581e-4bd9-a779-d5c55a1eaa00 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:54.274343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d1727f6-22a5-4fa5-9e2f-dcdb7831bd2a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:54.286464 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d1727f6-22a5-4fa5-9e2f-dcdb7831bd2a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1653 microversion: 2.1 time: 1.105985 Oct 11 04:28:54.290232 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2189/4172] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:53 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1653 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:54.325797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-190d6a57-0447-4baa-ad65-6edf9c36dcba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:28:54.325797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-190d6a57-0447-4baa-ad65-6edf9c36dcba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:54.327871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0f9e095b-581e-4bd9-a779-d5c55a1eaa00 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:54.346463 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f9e095b-581e-4bd9-a779-d5c55a1eaa00 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 1.044656 Oct 11 04:28:54.349488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-190d6a57-0447-4baa-ad65-6edf9c36dcba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:54.353610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-190d6a57-0447-4baa-ad65-6edf9c36dcba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:54.354067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-190d6a57-0447-4baa-ad65-6edf9c36dcba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:54.354858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-190d6a57-0447-4baa-ad65-6edf9c36dcba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:54.355291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-190d6a57-0447-4baa-ad65-6edf9c36dcba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:54.355729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-190d6a57-0447-4baa-ad65-6edf9c36dcba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:54.363216 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1984/4173] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:53 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:54.801875 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-190d6a57-0447-4baa-ad65-6edf9c36dcba tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.486047 Oct 11 04:28:54.805517 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2190/4174] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:28:54 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:28:54.819506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-20ef1d9e-4c3d-4bd6-9b47-53d5727df3f5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:54.820833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-20ef1d9e-4c3d-4bd6-9b47-53d5727df3f5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:54.845816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20ef1d9e-4c3d-4bd6-9b47-53d5727df3f5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:54.847691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20ef1d9e-4c3d-4bd6-9b47-53d5727df3f5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:54.847691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20ef1d9e-4c3d-4bd6-9b47-53d5727df3f5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:54.848175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20ef1d9e-4c3d-4bd6-9b47-53d5727df3f5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:54.848798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20ef1d9e-4c3d-4bd6-9b47-53d5727df3f5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:54.850876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20ef1d9e-4c3d-4bd6-9b47-53d5727df3f5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:55.400444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-965958d7-1819-4953-8560-f9c85d3bf18d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:55.407238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-965958d7-1819-4953-8560-f9c85d3bf18d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:55.410762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-20ef1d9e-4c3d-4bd6-9b47-53d5727df3f5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:55.428566 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-20ef1d9e-4c3d-4bd6-9b47-53d5727df3f5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1660 microversion: 2.1 time: 0.616969 Oct 11 04:28:55.429665 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1985/4175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:54 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1660 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:55.448009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-965958d7-1819-4953-8560-f9c85d3bf18d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:55.458893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-965958d7-1819-4953-8560-f9c85d3bf18d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:55.469248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-965958d7-1819-4953-8560-f9c85d3bf18d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:55.472822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-965958d7-1819-4953-8560-f9c85d3bf18d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:55.474764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-965958d7-1819-4953-8560-f9c85d3bf18d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:55.475224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-965958d7-1819-4953-8560-f9c85d3bf18d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:55.869271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-965958d7-1819-4953-8560-f9c85d3bf18d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:55.880922 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-965958d7-1819-4953-8560-f9c85d3bf18d tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.504690 Oct 11 04:28:55.881512 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2191/4176] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:55 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:56.457400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-728d9886-0c92-4ba5-8ad7-83b6f27f126d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:56.458533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-728d9886-0c92-4ba5-8ad7-83b6f27f126d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:56.468004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-728d9886-0c92-4ba5-8ad7-83b6f27f126d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:56.468526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-728d9886-0c92-4ba5-8ad7-83b6f27f126d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:56.469024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-728d9886-0c92-4ba5-8ad7-83b6f27f126d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:56.469728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-728d9886-0c92-4ba5-8ad7-83b6f27f126d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:56.470300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-728d9886-0c92-4ba5-8ad7-83b6f27f126d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:56.470628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-728d9886-0c92-4ba5-8ad7-83b6f27f126d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:56.914792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a1a88531-3999-4aa7-85fe-f8f7d297f585 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:56.916312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a1a88531-3999-4aa7-85fe-f8f7d297f585 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:56.936525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1a88531-3999-4aa7-85fe-f8f7d297f585 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:56.937370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1a88531-3999-4aa7-85fe-f8f7d297f585 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:56.938006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1a88531-3999-4aa7-85fe-f8f7d297f585 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:56.938934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1a88531-3999-4aa7-85fe-f8f7d297f585 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:56.939574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1a88531-3999-4aa7-85fe-f8f7d297f585 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:56.940171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1a88531-3999-4aa7-85fe-f8f7d297f585 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:57.396245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a1a88531-3999-4aa7-85fe-f8f7d297f585 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:57.419201 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a1a88531-3999-4aa7-85fe-f8f7d297f585 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.511553 Oct 11 04:28:57.437026 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2192/4177] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:56 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:57.472376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-728d9886-0c92-4ba5-8ad7-83b6f27f126d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:57.488038 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-728d9886-0c92-4ba5-8ad7-83b6f27f126d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 1.035388 Oct 11 04:28:57.488812 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1986/4178] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:56 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 1037 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:57.513552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0e96ae9d-5a4e-4b6c-bdf4-1924e42ddd97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:57.514588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0e96ae9d-5a4e-4b6c-bdf4-1924e42ddd97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:57.525308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e96ae9d-5a4e-4b6c-bdf4-1924e42ddd97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:57.525801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e96ae9d-5a4e-4b6c-bdf4-1924e42ddd97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:57.526274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e96ae9d-5a4e-4b6c-bdf4-1924e42ddd97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:57.539069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e96ae9d-5a4e-4b6c-bdf4-1924e42ddd97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:57.539847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e96ae9d-5a4e-4b6c-bdf4-1924e42ddd97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:57.540462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e96ae9d-5a4e-4b6c-bdf4-1924e42ddd97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:57.871281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0e96ae9d-5a4e-4b6c-bdf4-1924e42ddd97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:57.882310 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0e96ae9d-5a4e-4b6c-bdf4-1924e42ddd97 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.372922 Oct 11 04:28:57.918013 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2193/4179] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:57 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:57.919047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd8ea6a0-d678-4b6f-bb8e-f7da2b982d6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:57.919685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd8ea6a0-d678-4b6f-bb8e-f7da2b982d6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:57.936485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8ea6a0-d678-4b6f-bb8e-f7da2b982d6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:57.941730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8ea6a0-d678-4b6f-bb8e-f7da2b982d6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:57.946383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8ea6a0-d678-4b6f-bb8e-f7da2b982d6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:57.946383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8ea6a0-d678-4b6f-bb8e-f7da2b982d6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:57.946383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8ea6a0-d678-4b6f-bb8e-f7da2b982d6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:57.959399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd8ea6a0-d678-4b6f-bb8e-f7da2b982d6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:58.253067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd8ea6a0-d678-4b6f-bb8e-f7da2b982d6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:58.269676 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd8ea6a0-d678-4b6f-bb8e-f7da2b982d6b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.354948 Oct 11 04:28:58.280028 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1987/4180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:57 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:28:58.310227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e4ee701f-a076-490f-8539-06a6d403a553 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:58.311518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e4ee701f-a076-490f-8539-06a6d403a553 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:58.333358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4ee701f-a076-490f-8539-06a6d403a553 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:58.335169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4ee701f-a076-490f-8539-06a6d403a553 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:58.348107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4ee701f-a076-490f-8539-06a6d403a553 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:58.351369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4ee701f-a076-490f-8539-06a6d403a553 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:58.352024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4ee701f-a076-490f-8539-06a6d403a553 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:58.353552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4ee701f-a076-490f-8539-06a6d403a553 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:58.362459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:28:58.443405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cecd16d0-24ab-4301-b279-d4dce3ccccc8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:58.444029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cecd16d0-24ab-4301-b279-d4dce3ccccc8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:58.452025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cecd16d0-24ab-4301-b279-d4dce3ccccc8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:58.461525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cecd16d0-24ab-4301-b279-d4dce3ccccc8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:58.462096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cecd16d0-24ab-4301-b279-d4dce3ccccc8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:58.465430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cecd16d0-24ab-4301-b279-d4dce3ccccc8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:58.468083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cecd16d0-24ab-4301-b279-d4dce3ccccc8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:58.470696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cecd16d0-24ab-4301-b279-d4dce3ccccc8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:59.264150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e4ee701f-a076-490f-8539-06a6d403a553 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:59.270985 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e4ee701f-a076-490f-8539-06a6d403a553 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.966990 Oct 11 04:28:59.271890 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2194/4181] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:58 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:59.314006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-05f058cf-17a5-4305-b408-92d7748d87cb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:59.316140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-05f058cf-17a5-4305-b408-92d7748d87cb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:59.325295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f058cf-17a5-4305-b408-92d7748d87cb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:59.326086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f058cf-17a5-4305-b408-92d7748d87cb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:59.326784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f058cf-17a5-4305-b408-92d7748d87cb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:59.327671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f058cf-17a5-4305-b408-92d7748d87cb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:59.328191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f058cf-17a5-4305-b408-92d7748d87cb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:59.328629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05f058cf-17a5-4305-b408-92d7748d87cb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:59.333714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cecd16d0-24ab-4301-b279-d4dce3ccccc8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:59.347231 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cecd16d0-24ab-4301-b279-d4dce3ccccc8 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1393 microversion: 2.1 time: 0.907642 Oct 11 04:28:59.367096 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1988/4182] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:58 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1393 bytes in 926 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:59.731102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-05f058cf-17a5-4305-b408-92d7748d87cb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:28:59.747058 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-05f058cf-17a5-4305-b408-92d7748d87cb tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.450047 Oct 11 04:28:59.766367 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2195/4183] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:59 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:28:59.777278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-819b94cd-3d2b-4bf4-b38b-50e7fb94cb22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:28:59.786427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-819b94cd-3d2b-4bf4-b38b-50e7fb94cb22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:28:59.818166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819b94cd-3d2b-4bf4-b38b-50e7fb94cb22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:59.821657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819b94cd-3d2b-4bf4-b38b-50e7fb94cb22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:59.822407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819b94cd-3d2b-4bf4-b38b-50e7fb94cb22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:28:59.825594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819b94cd-3d2b-4bf4-b38b-50e7fb94cb22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:28:59.829920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819b94cd-3d2b-4bf4-b38b-50e7fb94cb22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:28:59.829920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-819b94cd-3d2b-4bf4-b38b-50e7fb94cb22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:00.525707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-819b94cd-3d2b-4bf4-b38b-50e7fb94cb22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:00.537484 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-819b94cd-3d2b-4bf4-b38b-50e7fb94cb22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.771586 Oct 11 04:29:00.538558 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1989/4184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:28:59 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:00.554486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e4b07c7c-5915-4897-8d9d-aa9f74b4fb08 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:00.555106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e4b07c7c-5915-4897-8d9d-aa9f74b4fb08 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:00.566213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4b07c7c-5915-4897-8d9d-aa9f74b4fb08 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:00.566213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4b07c7c-5915-4897-8d9d-aa9f74b4fb08 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:00.566213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4b07c7c-5915-4897-8d9d-aa9f74b4fb08 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:00.568406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4b07c7c-5915-4897-8d9d-aa9f74b4fb08 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:00.569896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4b07c7c-5915-4897-8d9d-aa9f74b4fb08 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:00.576344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4b07c7c-5915-4897-8d9d-aa9f74b4fb08 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:00.699077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV254Test-server-1850897001", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": "none"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:00.792968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:29:00.799074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:29:00.802412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:29:00.802412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:29:00.802412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:29:00.814664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:00.815407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:00.816054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:00.817799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:00.818483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:00.819124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:00.864309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Getting quotas for project 4360cf130e5d434eb67026b4a204a3cd. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:29:00.879353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Getting quotas for user dc777afeb0744fecafe2e1426bbdff44 and project 4360cf130e5d434eb67026b4a204a3cd. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:29:00.897560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:29:00.901549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:29:01.082228 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44d290ba-031f-42fc-9f5f-facf63807b15 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.54 time: 0.699962 Oct 11 04:29:01.082228 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2196/4185] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:29:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 11 04:29:01.099912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e4b07c7c-5915-4897-8d9d-aa9f74b4fb08 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:01.111282 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e4b07c7c-5915-4897-8d9d-aa9f74b4fb08 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1383 microversion: 2.1 time: 0.570960 Oct 11 04:29:01.112459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a35b322-8a4a-4047-8cfb-7f51b38e1618 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:01.113962 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1990/4186] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:00 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1383 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:01.114865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1a35b322-8a4a-4047-8cfb-7f51b38e1618 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:01.148369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8a5259b2-d054-4b91-897f-dda412b1de15 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '.version_select at 0x7fda19307790>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:01.157976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a5259b2-d054-4b91-897f-dda412b1de15 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:01.168179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a5259b2-d054-4b91-897f-dda412b1de15 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:01.170766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a5259b2-d054-4b91-897f-dda412b1de15 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:01.194214 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8a5259b2-d054-4b91-897f-dda412b1de15 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/os-migrations" status: 200 len: 1553 microversion: 2.1 time: 0.055968 Oct 11 04:29:01.208035 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1991/4187] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:29:01 2022] GET /compute/v2.1/os-migrations => generated 1553 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:01.222790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5bc3a2e5-435f-4dc1-99ee-489bed7f13f6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:01.224455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5bc3a2e5-435f-4dc1-99ee-489bed7f13f6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:01.240553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc3a2e5-435f-4dc1-99ee-489bed7f13f6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:01.246303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc3a2e5-435f-4dc1-99ee-489bed7f13f6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:01.262928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc3a2e5-435f-4dc1-99ee-489bed7f13f6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:01.264987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc3a2e5-435f-4dc1-99ee-489bed7f13f6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:01.273396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc3a2e5-435f-4dc1-99ee-489bed7f13f6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:01.273913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc3a2e5-435f-4dc1-99ee-489bed7f13f6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:01.372259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1a35b322-8a4a-4047-8cfb-7f51b38e1618 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:01.385553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1a35b322-8a4a-4047-8cfb-7f51b38e1618 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:01.395086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1a35b322-8a4a-4047-8cfb-7f51b38e1618 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:01.398609 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1a35b322-8a4a-4047-8cfb-7f51b38e1618 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1278 microversion: 2.54 time: 0.309865 Oct 11 04:29:01.402701 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2197/4188] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:01 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1278 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:01.776579 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5bc3a2e5-435f-4dc1-99ee-489bed7f13f6 tempest-LiveMigrationTest-1920658239 tempest-LiveMigrationTest-1920658239-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1534 microversion: 2.1 time: 0.557535 Oct 11 04:29:01.780487 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1992/4189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:01 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1534 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:01.820976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4af283a5-69bb-4635-b2bf-4f8bc5dedc58 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:01.820976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4af283a5-69bb-4635-b2bf-4f8bc5dedc58 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:01.829903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af283a5-69bb-4635-b2bf-4f8bc5dedc58 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:01.830522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af283a5-69bb-4635-b2bf-4f8bc5dedc58 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:01.834881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af283a5-69bb-4635-b2bf-4f8bc5dedc58 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:01.835992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af283a5-69bb-4635-b2bf-4f8bc5dedc58 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:01.836776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af283a5-69bb-4635-b2bf-4f8bc5dedc58 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:01.837406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af283a5-69bb-4635-b2bf-4f8bc5dedc58 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:01.924847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4af283a5-69bb-4635-b2bf-4f8bc5dedc58 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:29:02.447106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-515c121e-9bda-40cf-9797-f2e756eec876 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:02.448448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-515c121e-9bda-40cf-9797-f2e756eec876 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:02.462410 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4af283a5-69bb-4635-b2bf-4f8bc5dedc58 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 204 len: 0 microversion: 2.1 time: 0.650528 Oct 11 04:29:02.467265 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2198/4190] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:29:01 2022] DELETE /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 0 bytes in 653 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:29:02.473514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc9f6a5b-1333-443c-af00-7204ed534abe tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:02.474525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cc9f6a5b-1333-443c-af00-7204ed534abe tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:02.498710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc9f6a5b-1333-443c-af00-7204ed534abe tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:02.499277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc9f6a5b-1333-443c-af00-7204ed534abe tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:02.528398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc9f6a5b-1333-443c-af00-7204ed534abe tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:02.534073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc9f6a5b-1333-443c-af00-7204ed534abe tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:02.534848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc9f6a5b-1333-443c-af00-7204ed534abe tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:02.535451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc9f6a5b-1333-443c-af00-7204ed534abe tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:02.564855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-515c121e-9bda-40cf-9797-f2e756eec876 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:02.606164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-515c121e-9bda-40cf-9797-f2e756eec876 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:02.622302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-515c121e-9bda-40cf-9797-f2e756eec876 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:02.632079 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-515c121e-9bda-40cf-9797-f2e756eec876 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1278 microversion: 2.54 time: 0.190334 Oct 11 04:29:02.632682 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1993/4191] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:02 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1278 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:02.871435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cc9f6a5b-1333-443c-af00-7204ed534abe tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:02.887326 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc9f6a5b-1333-443c-af00-7204ed534abe tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1389 microversion: 2.1 time: 0.418253 Oct 11 04:29:02.905054 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2199/4192] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:02 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1389 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:03.663033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:03.667971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:03.690138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:03.692880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:03.694371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:03.697410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:03.697746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:03.699127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:03.931612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9fb53dbc-4699-4894-ad50-18455fb5d7e3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:03.932250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9fb53dbc-4699-4894-ad50-18455fb5d7e3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:03.948119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb53dbc-4699-4894-ad50-18455fb5d7e3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:03.951655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb53dbc-4699-4894-ad50-18455fb5d7e3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:03.954640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb53dbc-4699-4894-ad50-18455fb5d7e3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:03.955562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb53dbc-4699-4894-ad50-18455fb5d7e3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:03.956175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb53dbc-4699-4894-ad50-18455fb5d7e3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:03.961821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fb53dbc-4699-4894-ad50-18455fb5d7e3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:04.014501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:04.024127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:04.034596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:04.044866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:04.052938 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f899c81c-33b5-4a54-aee9-609e9ee994aa tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1282 microversion: 2.54 time: 0.391143 Oct 11 04:29:04.054099 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1994/4193] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:03 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1282 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:04.398503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9fb53dbc-4699-4894-ad50-18455fb5d7e3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:04.411841 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9fb53dbc-4699-4894-ad50-18455fb5d7e3 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1389 microversion: 2.1 time: 0.502624 Oct 11 04:29:04.413272 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2200/4194] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:03 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1389 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:04.818947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-27d8fd67-23b1-4872-af28-10dc45f3e3b8 req-d9aaf169-5f6c-4173-b9e7-2eb8a3fc061b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afa836dc-900d-4ca8-9400-c7beb1739be1", "name": "network-vif-deleted", "tag": "6bd011bd-c917-4d3c-93b6-c411b91b9a58"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:04.835758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-27d8fd67-23b1-4872-af28-10dc45f3e3b8 req-d9aaf169-5f6c-4173-b9e7-2eb8a3fc061b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:04.835758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-27d8fd67-23b1-4872-af28-10dc45f3e3b8 req-d9aaf169-5f6c-4173-b9e7-2eb8a3fc061b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:04.836094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-27d8fd67-23b1-4872-af28-10dc45f3e3b8 req-d9aaf169-5f6c-4173-b9e7-2eb8a3fc061b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:04.849021 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-27d8fd67-23b1-4872-af28-10dc45f3e3b8 req-d9aaf169-5f6c-4173-b9e7-2eb8a3fc061b service nova] Creating event network-vif-deleted:6bd011bd-c917-4d3c-93b6-c411b91b9a58 for instance afa836dc-900d-4ca8-9400-c7beb1739be1 on n-h1-860892-1 Oct 11 04:29:04.855101 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-27d8fd67-23b1-4872-af28-10dc45f3e3b8 req-d9aaf169-5f6c-4173-b9e7-2eb8a3fc061b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039813 Oct 11 04:29:04.858560 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1995/4195] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:29:05.085268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:05.088476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:05.107806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:05.108462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:05.109737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:05.110775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:05.111908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:05.112546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:05.407703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:05.416924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:05.432239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:05.433534 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30d7ba68-730d-4007-9606-8c5a611b46c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1330 microversion: 2.54 time: 0.354794 Oct 11 04:29:05.434123 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2201/4196] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:05 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1330 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:05.446721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-815600a0-09d3-47d9-aa6f-1e972f1c7821 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:05.447997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-815600a0-09d3-47d9-aa6f-1e972f1c7821 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:05.494018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-815600a0-09d3-47d9-aa6f-1e972f1c7821 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:05.503485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-815600a0-09d3-47d9-aa6f-1e972f1c7821 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:05.508145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-815600a0-09d3-47d9-aa6f-1e972f1c7821 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:05.523305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-815600a0-09d3-47d9-aa6f-1e972f1c7821 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:05.524509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-815600a0-09d3-47d9-aa6f-1e972f1c7821 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:05.532006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-815600a0-09d3-47d9-aa6f-1e972f1c7821 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:06.027990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-815600a0-09d3-47d9-aa6f-1e972f1c7821 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:06.042672 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-815600a0-09d3-47d9-aa6f-1e972f1c7821 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1184 microversion: 2.1 time: 0.609084 Oct 11 04:29:06.043980 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1996/4197] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:05 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1184 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:06.461086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:06.461709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:06.481284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:06.489144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:06.494901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:06.496792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:06.500491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:06.504839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:07.065145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-96a832b9-20ce-4b32-ba22-56cdbe7083ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:07.065911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-96a832b9-20ce-4b32-ba22-56cdbe7083ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:07.083491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96a832b9-20ce-4b32-ba22-56cdbe7083ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:07.084006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96a832b9-20ce-4b32-ba22-56cdbe7083ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:07.084456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96a832b9-20ce-4b32-ba22-56cdbe7083ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:07.085181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96a832b9-20ce-4b32-ba22-56cdbe7083ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:07.095666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96a832b9-20ce-4b32-ba22-56cdbe7083ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:07.096474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96a832b9-20ce-4b32-ba22-56cdbe7083ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:07.106353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:07.136149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:07.137840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:07.139802 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-26f21685-fd95-4e29-8fd9-e446a25be237 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1336 microversion: 2.54 time: 0.682682 Oct 11 04:29:07.148276 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2202/4198] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:06 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1336 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:08.171165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:08.173754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:08.200084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:08.201021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:08.205497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:08.206587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:08.207893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:08.210964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:08.368759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-96a832b9-20ce-4b32-ba22-56cdbe7083ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:08.381376 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-96a832b9-20ce-4b32-ba22-56cdbe7083ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1184 microversion: 2.1 time: 1.315663 Oct 11 04:29:08.383233 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1997/4199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:07 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1184 bytes in 1323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:08.504747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:08.514597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:08.585472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:08.585472 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c41d8b9e-9dfb-4306-a62f-ac72b37cf026 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1336 microversion: 2.54 time: 0.381952 Oct 11 04:29:08.585472 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2203/4200] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:08 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1336 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:09.411223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6c2cfac-53d8-4cf7-a1ad-ad0c7b2ac0fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:09.413818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6c2cfac-53d8-4cf7-a1ad-ad0c7b2ac0fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:09.423519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c2cfac-53d8-4cf7-a1ad-ad0c7b2ac0fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:09.424350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesTestJSON-server-1449923532", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "11608dc6-06d8-4f5a-b2e2-5eba1948310c"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:09.426026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c2cfac-53d8-4cf7-a1ad-ad0c7b2ac0fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:09.431762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c2cfac-53d8-4cf7-a1ad-ad0c7b2ac0fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:09.433468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c2cfac-53d8-4cf7-a1ad-ad0c7b2ac0fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:09.433468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c2cfac-53d8-4cf7-a1ad-ad0c7b2ac0fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:09.433984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6c2cfac-53d8-4cf7-a1ad-ad0c7b2ac0fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:09.514518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=56 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:09.606148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] validate_networks() for [('11608dc6-06d8-4f5a-b2e2-5eba1948310c', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:29:09.790951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6c2cfac-53d8-4cf7-a1ad-ad0c7b2ac0fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:09.804711 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6c2cfac-53d8-4cf7-a1ad-ad0c7b2ac0fa tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1184 microversion: 2.1 time: 0.397680 Oct 11 04:29:09.805988 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2204/4201] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:09 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1184 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:09.849923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:09.851127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:09.870305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:09.872834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:09.873596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:09.874294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:09.876461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:09.877170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:09.877834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:10.184879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:10.226693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:10.236084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:10.246638 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d282b65b-c5bc-4aa6-82ba-d32563d0f760 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1336 microversion: 2.54 time: 0.430178 Oct 11 04:29:10.247308 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2205/4202] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:09 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1336 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:10.522998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:29:10.524301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:29:10.525575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:29:10.529582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:29:10.530069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:29:10.568362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:10.568859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:10.569296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:10.570037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:10.570522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:10.570949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:10.656992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Getting quotas for project c6aad0e2e5424d37aa02a7f355bc81fd. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:29:10.676025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Getting quotas for user 7fcbb3e81cd044248c8c9196ea29000e and project c6aad0e2e5424d37aa02a7f355bc81fd. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:29:10.738955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:29:10.744069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:29:10.831274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d731efc8-8eb2-4603-b98b-2a74b249c0d1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:10.831987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d731efc8-8eb2-4603-b98b-2a74b249c0d1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:10.835212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:10.862844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d731efc8-8eb2-4603-b98b-2a74b249c0d1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:10.863413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d731efc8-8eb2-4603-b98b-2a74b249c0d1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:10.864039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d731efc8-8eb2-4603-b98b-2a74b249c0d1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:10.867070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d731efc8-8eb2-4603-b98b-2a74b249c0d1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:10.867758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d731efc8-8eb2-4603-b98b-2a74b249c0d1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:10.873276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d731efc8-8eb2-4603-b98b-2a74b249c0d1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:11.017246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d731efc8-8eb2-4603-b98b-2a74b249c0d1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:11.033636 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ef67ff6-0417-425a-a1a4-079eebf0df3d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.803224 Oct 11 04:29:11.034351 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1998/4203] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:29:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:29:11.054054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5d6d60f-6179-48e4-b6b1-25ca5b8bdc78 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:11.057832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c5d6d60f-6179-48e4-b6b1-25ca5b8bdc78 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:11.062783 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d731efc8-8eb2-4603-b98b-2a74b249c0d1 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1184 microversion: 2.1 time: 0.223526 Oct 11 04:29:11.077952 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2206/4204] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:10 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1184 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:11.218108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c5d6d60f-6179-48e4-b6b1-25ca5b8bdc78 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:11.227664 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c5d6d60f-6179-48e4-b6b1-25ca5b8bdc78 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1217 microversion: 2.1 time: 0.184842 Oct 11 04:29:11.236326 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 1999/4205] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:11 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1217 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:11.277908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:11.278665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:11.289101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:11.289641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:11.290091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:11.290867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:11.291331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:11.291766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:11.400716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:11.495204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:11.508131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:11.512146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:11.512146 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f24bf880-4422-4101-9840-1f93b6a56a33 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1357 microversion: 2.54 time: 0.238650 Oct 11 04:29:11.513826 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2207/4206] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:11 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1357 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:11.550978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-994a0c51-7c58-4a2d-9a58-348d5ed8d274 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Action: 'create', calling method: .version_select at 0x7fda1df3c820>, body: {"keypair": {"name": "tempest-ServerShowV254Test-keypair-1531716255", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJPiF/+3JIp4B3MdJc3cmw3P7CAdIcGPhIk2jor1WeOcyCZGAGznuC1SyNW+iShZPhVgkHRYmOvEUeBoQgUZkro3rSDBdhSDTB545OLi7rsshOSIBmUot3BdRHxuFWNMg=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:11.633587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-994a0c51-7c58-4a2d-9a58-348d5ed8d274 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Getting quotas for project 4360cf130e5d434eb67026b4a204a3cd. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:29:11.659266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-994a0c51-7c58-4a2d-9a58-348d5ed8d274 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Getting quotas for user dc777afeb0744fecafe2e1426bbdff44 and project 4360cf130e5d434eb67026b4a204a3cd. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:29:11.780484 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-994a0c51-7c58-4a2d-9a58-348d5ed8d274 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 420 microversion: 2.54 time: 0.231479 Oct 11 04:29:11.781637 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2000/4207] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 11 04:29:11 2022] POST /compute/v2.1/os-keypairs => generated 420 bytes in 235 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 04:29:11.793276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Action: 'action', calling method: >, body: {"rebuild": {"key_name": "tempest-ServerShowV254Test-keypair-1531716255", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:11.797538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:11.835359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:11.836036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:11.836389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:11.837368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:11.837956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:11.838552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:11.990394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:29:12.015699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:29:12.020543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:29:12.021069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:29:12.021563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:29:12.085958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c912dfad-2916-40d9-8083-7e9feff9c5cf tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:12.087187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c912dfad-2916-40d9-8083-7e9feff9c5cf tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:12.106361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c912dfad-2916-40d9-8083-7e9feff9c5cf tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:12.108573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c912dfad-2916-40d9-8083-7e9feff9c5cf tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:12.111843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c912dfad-2916-40d9-8083-7e9feff9c5cf tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:12.127038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c912dfad-2916-40d9-8083-7e9feff9c5cf tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:12.127846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c912dfad-2916-40d9-8083-7e9feff9c5cf tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:12.128712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c912dfad-2916-40d9-8083-7e9feff9c5cf tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:12.331432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c912dfad-2916-40d9-8083-7e9feff9c5cf tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:12.342556 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c912dfad-2916-40d9-8083-7e9feff9c5cf tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1184 microversion: 2.1 time: 0.259171 Oct 11 04:29:12.342943 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2001/4208] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:12 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1184 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:12.348458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-84b3343a-203c-43b3-9317-09ae6b82e348 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:12.349251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-84b3343a-203c-43b3-9317-09ae6b82e348 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:12.570158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-84b3343a-203c-43b3-9317-09ae6b82e348 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:12.579850 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-84b3343a-203c-43b3-9317-09ae6b82e348 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1217 microversion: 2.1 time: 0.235661 Oct 11 04:29:12.581331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:12.589554 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2002/4209] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:12 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1217 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:12.618174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:12.623601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:12.626938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:12.628607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:12.635569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:12.637139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:12.663980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:12.845508 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cac674cf-aaa4-4dba-b408-71840e470a25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "POST /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a/action" status: 202 len: 1140 microversion: 2.54 time: 1.035968 Oct 11 04:29:12.849489 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2208/4210] 10.222.0.26 () {62 vars in 1320 bytes} [Tue Oct 11 04:29:11 2022] POST /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a/action => generated 1140 bytes in 1062 msecs (HTTP/1.1 202) 10 headers in 454 bytes (2 switches on core 0) Oct 11 04:29:12.873875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:12.874616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:12.899742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:12.900252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:12.900701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:12.901429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:12.901875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:12.902334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:13.110802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:13.128647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:13.131191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:13.133393 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-668a24b9-4fb2-4950-b110-afb40a5997a4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.263401 Oct 11 04:29:13.134629 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2003/4211] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:12 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:13.368508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7dad4ffd-3743-47ca-9de0-e65a5059d4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:13.369386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7dad4ffd-3743-47ca-9de0-e65a5059d4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:13.410265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dad4ffd-3743-47ca-9de0-e65a5059d4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:13.425885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dad4ffd-3743-47ca-9de0-e65a5059d4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:13.426807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dad4ffd-3743-47ca-9de0-e65a5059d4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:13.430003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dad4ffd-3743-47ca-9de0-e65a5059d4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:13.438337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dad4ffd-3743-47ca-9de0-e65a5059d4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:13.438795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dad4ffd-3743-47ca-9de0-e65a5059d4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:13.611986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41b9551e-d2eb-46cb-bb91-16de54ee0a7e tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:13.612474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-41b9551e-d2eb-46cb-bb91-16de54ee0a7e tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:13.624216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41b9551e-d2eb-46cb-bb91-16de54ee0a7e tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:13.624716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41b9551e-d2eb-46cb-bb91-16de54ee0a7e tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:13.631491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41b9551e-d2eb-46cb-bb91-16de54ee0a7e tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:13.635546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41b9551e-d2eb-46cb-bb91-16de54ee0a7e tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:13.639610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41b9551e-d2eb-46cb-bb91-16de54ee0a7e tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:13.640255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41b9551e-d2eb-46cb-bb91-16de54ee0a7e tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:13.723632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7dad4ffd-3743-47ca-9de0-e65a5059d4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:13.740806 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7dad4ffd-3743-47ca-9de0-e65a5059d4ef tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1184 microversion: 2.1 time: 0.376204 Oct 11 04:29:13.741412 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2209/4212] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:13 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1184 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:13.937257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-41b9551e-d2eb-46cb-bb91-16de54ee0a7e tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:13.946416 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41b9551e-d2eb-46cb-bb91-16de54ee0a7e tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1213 microversion: 2.1 time: 0.339010 Oct 11 04:29:13.950100 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2004/4213] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:13 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1213 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:14.167057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:14.170952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:14.207259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:14.207763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:14.208460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:14.219303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:14.220017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:14.220469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:14.515128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:14.531576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:14.533083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:14.551346 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-231641dc-df57-4e76-abc5-07a003550cae tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.388093 Oct 11 04:29:14.554980 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2210/4214] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:14 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:14.769666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee81a766-4347-425f-a8dd-5ea34dc1a6e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:14.771915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee81a766-4347-425f-a8dd-5ea34dc1a6e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:14.822491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee81a766-4347-425f-a8dd-5ea34dc1a6e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:14.824293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee81a766-4347-425f-a8dd-5ea34dc1a6e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:14.824293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee81a766-4347-425f-a8dd-5ea34dc1a6e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:14.824293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee81a766-4347-425f-a8dd-5ea34dc1a6e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:14.831490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee81a766-4347-425f-a8dd-5ea34dc1a6e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:14.831982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee81a766-4347-425f-a8dd-5ea34dc1a6e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:14.915953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-185300402", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:14.995303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] validate_networks() for [('024a629d-4db2-47c1-927f-16f6b2634cc7', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:29:15.015461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee81a766-4347-425f-a8dd-5ea34dc1a6e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:15.035601 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee81a766-4347-425f-a8dd-5ea34dc1a6e2 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1184 microversion: 2.1 time: 0.272411 Oct 11 04:29:15.037753 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2211/4215] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:14 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1184 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:15.045417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-71891919-b337-45ca-b9c8-94af694392df tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:15.063397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-71891919-b337-45ca-b9c8-94af694392df tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:15.070157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71891919-b337-45ca-b9c8-94af694392df tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:15.071053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71891919-b337-45ca-b9c8-94af694392df tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:15.071714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71891919-b337-45ca-b9c8-94af694392df tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:15.072670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71891919-b337-45ca-b9c8-94af694392df tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:15.073353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71891919-b337-45ca-b9c8-94af694392df tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:15.073981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71891919-b337-45ca-b9c8-94af694392df tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:15.187880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-71891919-b337-45ca-b9c8-94af694392df tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:15.199552 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-71891919-b337-45ca-b9c8-94af694392df tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1269 microversion: 2.1 time: 0.158857 Oct 11 04:29:15.201849 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2212/4216] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:15 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1269 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:15.586095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:15.588320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:15.618833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:15.620249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:15.622758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:15.623766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:15.625614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:15.627717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:15.833553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:15.882223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:15.884283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:15.885714 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3200cfd-dbf7-49d8-a029-98ccf1c0f324 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.308304 Oct 11 04:29:15.933305 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2213/4217] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:15 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:29:16.071495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7ac28be4-9fce-4a49-9a00-e8ff865d3124 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:16.072357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7ac28be4-9fce-4a49-9a00-e8ff865d3124 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:16.087849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac28be4-9fce-4a49-9a00-e8ff865d3124 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:16.091960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac28be4-9fce-4a49-9a00-e8ff865d3124 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:16.093188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac28be4-9fce-4a49-9a00-e8ff865d3124 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:16.100360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac28be4-9fce-4a49-9a00-e8ff865d3124 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:16.102133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac28be4-9fce-4a49-9a00-e8ff865d3124 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:16.104716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac28be4-9fce-4a49-9a00-e8ff865d3124 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:16.192385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7ac28be4-9fce-4a49-9a00-e8ff865d3124 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:16.203880 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7ac28be4-9fce-4a49-9a00-e8ff865d3124 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1184 microversion: 2.1 time: 0.143677 Oct 11 04:29:16.204894 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2214/4218] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:16 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1184 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:16.234810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-75736146-1013-462b-863b-5c4992e7c787 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:16.235357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-75736146-1013-462b-863b-5c4992e7c787 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:16.249329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75736146-1013-462b-863b-5c4992e7c787 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:16.250113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75736146-1013-462b-863b-5c4992e7c787 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:16.250835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75736146-1013-462b-863b-5c4992e7c787 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:16.251801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75736146-1013-462b-863b-5c4992e7c787 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:16.252835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75736146-1013-462b-863b-5c4992e7c787 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:16.253487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75736146-1013-462b-863b-5c4992e7c787 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:16.382557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-75736146-1013-462b-863b-5c4992e7c787 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:16.393900 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-75736146-1013-462b-863b-5c4992e7c787 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1275 microversion: 2.1 time: 0.170429 Oct 11 04:29:16.415987 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2215/4219] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:16 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1275 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:16.928772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:16.929386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:16.946708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:16.949666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:16.950126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:16.953050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:16.958929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:16.959500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:17.046533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:29:17.047567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:29:17.048209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:29:17.048759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:29:17.049369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:29:17.087357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:17.092085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:17.096294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:17.098341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:17.100119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:17.103100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:17.189299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Getting quotas for project 75ee1246b11f4fb286baf525614515c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:29:17.204066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Getting quotas for user 820b6b6b001a46a2abd3415de0b5f29b and project 75ee1246b11f4fb286baf525614515c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:29:17.235875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:29:17.258220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:29:17.273216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:17.289957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:17.301493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:17.308327 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-acab0314-7086-48a6-b56e-8ffb195683c0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.384766 Oct 11 04:29:17.330047 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2216/4220] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:16 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:17.353903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6effba9f-8c12-46c3-a367-d5bd22a64bb0 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:17.357744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6effba9f-8c12-46c3-a367-d5bd22a64bb0 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:17.367398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6effba9f-8c12-46c3-a367-d5bd22a64bb0 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:17.386688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6effba9f-8c12-46c3-a367-d5bd22a64bb0 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:17.387620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6effba9f-8c12-46c3-a367-d5bd22a64bb0 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:17.390422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6effba9f-8c12-46c3-a367-d5bd22a64bb0 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:17.391066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6effba9f-8c12-46c3-a367-d5bd22a64bb0 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:17.392188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6effba9f-8c12-46c3-a367-d5bd22a64bb0 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:17.502152 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c7721343-5b04-4120-8f9c-abda8c4a68e2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.804373 Oct 11 04:29:17.505933 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2005/4221] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:29:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 2810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:29:17.517570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f236a055-cf1c-4c1a-9082-06262e9bd2b8 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:17.518351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f236a055-cf1c-4c1a-9082-06262e9bd2b8 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:17.544852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f236a055-cf1c-4c1a-9082-06262e9bd2b8 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:17.559275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f236a055-cf1c-4c1a-9082-06262e9bd2b8 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:17.559788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f236a055-cf1c-4c1a-9082-06262e9bd2b8 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:17.560544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f236a055-cf1c-4c1a-9082-06262e9bd2b8 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:17.561006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f236a055-cf1c-4c1a-9082-06262e9bd2b8 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:17.598538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f236a055-cf1c-4c1a-9082-06262e9bd2b8 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.035s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:17.618825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6effba9f-8c12-46c3-a367-d5bd22a64bb0 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:17.644221 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6effba9f-8c12-46c3-a367-d5bd22a64bb0 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1184 microversion: 2.1 time: 0.312498 Oct 11 04:29:17.684957 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2217/4222] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:17 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1184 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:17.706416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-558b7a80-65a6-4efc-9709-4cb3c34393a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:17.715665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-558b7a80-65a6-4efc-9709-4cb3c34393a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:17.953419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-558b7a80-65a6-4efc-9709-4cb3c34393a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:17.980313 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-558b7a80-65a6-4efc-9709-4cb3c34393a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1221 microversion: 2.1 time: 0.292894 Oct 11 04:29:17.983802 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2218/4223] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:17 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1221 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:18.084816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f236a055-cf1c-4c1a-9082-06262e9bd2b8 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:18.112313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1290748217", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:18.114070 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f236a055-cf1c-4c1a-9082-06262e9bd2b8 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1317 microversion: 2.1 time: 0.604390 Oct 11 04:29:18.114717 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2006/4224] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:17 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1317 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:18.273190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] validate_networks() for [('024a629d-4db2-47c1-927f-16f6b2634cc7', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:29:18.342933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:18.343592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:18.354026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:18.354640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:18.357351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:18.363850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:18.364592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:18.365251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:18.573473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:18.590566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:18.605407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:18.608066 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5eea706f-4387-452f-95c8-2ec25c428e8d tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.269305 Oct 11 04:29:18.613300 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2007/4225] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:18 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:29:18.667810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:18.668868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:18.683535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:18.694938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:18.696690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:18.702346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:18.702346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:18.702346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:18.827658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:18.828153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:18.835616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:18.836097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lazy-loading 'fault' on Instance uuid afa836dc-900d-4ca8-9400-c7beb1739be1 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:29:18.906310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:18.914136 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1e908c42-1140-471b-905a-ee27c78be906 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 200 len: 1143 microversion: 2.1 time: 0.250362 Oct 11 04:29:18.918264 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2008/4226] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:18 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 1143 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:19.140864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fe4c4c96-4a2c-46c7-8464-11fd4bd13c3a tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:19.141486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fe4c4c96-4a2c-46c7-8464-11fd4bd13c3a tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:19.160076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe4c4c96-4a2c-46c7-8464-11fd4bd13c3a tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:19.160441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe4c4c96-4a2c-46c7-8464-11fd4bd13c3a tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:19.160970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe4c4c96-4a2c-46c7-8464-11fd4bd13c3a tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:19.162056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe4c4c96-4a2c-46c7-8464-11fd4bd13c3a tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:19.163995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe4c4c96-4a2c-46c7-8464-11fd4bd13c3a tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:19.164446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe4c4c96-4a2c-46c7-8464-11fd4bd13c3a tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:19.255396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:29:19.256461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:29:19.257400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:29:19.258016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:29:19.258779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:29:19.271745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:19.271745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:19.271745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:19.271745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:19.271745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:19.272596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:19.295734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Getting quotas for project 75ee1246b11f4fb286baf525614515c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:29:19.304565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Getting quotas for user 820b6b6b001a46a2abd3415de0b5f29b and project 75ee1246b11f4fb286baf525614515c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:29:19.322533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:29:19.325864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:29:19.480473 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bba3ebce-6353-4ff2-b680-1240b533b2d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.375242 Oct 11 04:29:19.485098 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2219/4227] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:29:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:29:19.502416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1f01f6a3-cf8b-45a7-9b3e-dc4cc8145a38 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:19.503184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1f01f6a3-cf8b-45a7-9b3e-dc4cc8145a38 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:19.536207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fe4c4c96-4a2c-46c7-8464-11fd4bd13c3a tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:19.547192 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fe4c4c96-4a2c-46c7-8464-11fd4bd13c3a tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1317 microversion: 2.1 time: 0.410116 Oct 11 04:29:19.547799 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2009/4228] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:19 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1317 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:19.631152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1f01f6a3-cf8b-45a7-9b3e-dc4cc8145a38 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:19.640689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:19.641607 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1f01f6a3-cf8b-45a7-9b3e-dc4cc8145a38 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1222 microversion: 2.1 time: 0.149232 Oct 11 04:29:19.641754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:19.642212 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2220/4229] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:19 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1222 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:19.655173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:19.658250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:19.659035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:19.660433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:19.662965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:19.663609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:19.845512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:19.862931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:19.864941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:19.867926 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c826579b-1a1a-4b93-98a2-cbde3009fc3c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.232620 Oct 11 04:29:19.871138 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2010/4230] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:19 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:29:19.941335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:19.942685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: afa836dc-900d-4ca8-9400-c7beb1739be1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:19.957683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:19.971244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:19.972422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:19.973186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:19.973642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:19.975383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:19.997774 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] HTTP exception thrown: Instance afa836dc-900d-4ca8-9400-c7beb1739be1 could not be found. Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Request method failure captured: Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 HTTP/1.1 Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO88APyXyxulAU5G_yS7c7ei0ihPxzeQbFVph9RYvPIOQLdcyz69u7F_9ydoo_vd6DEt3k8XgFw4RzwRZULYtDQaEb_uGN8UNRib5IgHzPBkgUq0ztzzfcRu6UmNVXSXzNxB59S7O2jb5rNpgqbtixYTp_1U2SCkz0rGQdPvtXFCc88 Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 15b90becc5a545f0965359b05561721f Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-LiveMigrationTest-56024801 Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15b90becc5a545f0965359b05561721f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15b90becc5a545f0965359b05561721f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15b90becc5a545f0965359b05561721f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15b90becc5a545f0965359b05561721f"}]}] Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-LiveMigrationTest-56024801 Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 15b90becc5a545f0965359b05561721f Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-LiveMigrationTest-56024801 Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-LiveMigrationTest-56024801-project Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: ea114683a3754c8197b61fc5ef04fe0d Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-LiveMigrationTest-56024801-project Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance afa836dc-900d-4ca8-9400-c7beb1739be1 could not be found. Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'afa836dc-900d-4ca8-9400-c7beb1739be1'} Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afa836dc-900d-4ca8-9400-c7beb1739be1 could not be found. Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afa836dc-900d-4ca8-9400-c7beb1739be1 could not be found. Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:19.999500 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:20.003157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:20.003157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:20.003157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:20.003157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:29:20.003157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:29:20.003157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afa836dc-900d-4ca8-9400-c7beb1739be1 could not be found. Oct 11 04:29:20.003157 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:20.003157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Returning 404 to user: Instance afa836dc-900d-4ca8-9400-c7beb1739be1 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:29:20.003157 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e452d6e6-7c8a-4607-be6e-e20b3bbe57df tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1" status: 404 len: 111 microversion: 2.1 time: 0.063467 Oct 11 04:29:20.003157 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2221/4231] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:19 2022] GET /compute/v2.1/servers/afa836dc-900d-4ca8-9400-c7beb1739be1 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:29:20.068845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a8414e44-3b86-4b12-8d8c-32c08b45f094 req-db1f0269-509b-4c52-9d5f-84de48fae187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8", "tag": "0f6aefab-baff-4301-ad61-398115dd0279"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:20.098459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a8414e44-3b86-4b12-8d8c-32c08b45f094 req-db1f0269-509b-4c52-9d5f-84de48fae187 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:20.098983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a8414e44-3b86-4b12-8d8c-32c08b45f094 req-db1f0269-509b-4c52-9d5f-84de48fae187 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:20.102376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a8414e44-3b86-4b12-8d8c-32c08b45f094 req-db1f0269-509b-4c52-9d5f-84de48fae187 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:20.126425 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a8414e44-3b86-4b12-8d8c-32c08b45f094 req-db1f0269-509b-4c52-9d5f-84de48fae187 service nova] Creating event network-changed:0f6aefab-baff-4301-ad61-398115dd0279 for instance 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 on n-h2-860892-1 Oct 11 04:29:20.135636 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a8414e44-3b86-4b12-8d8c-32c08b45f094 req-db1f0269-509b-4c52-9d5f-84de48fae187 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072439 Oct 11 04:29:20.137403 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2011/4232] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:29:20.259208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-226db88a-1eea-48da-85ed-efb32d3c4e70 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:20.262473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-226db88a-1eea-48da-85ed-efb32d3c4e70 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:20.276037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-226db88a-1eea-48da-85ed-efb32d3c4e70 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:20.310108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-226db88a-1eea-48da-85ed-efb32d3c4e70 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:20.311103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-226db88a-1eea-48da-85ed-efb32d3c4e70 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.034s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:20.325162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-226db88a-1eea-48da-85ed-efb32d3c4e70 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:20.328251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-226db88a-1eea-48da-85ed-efb32d3c4e70 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:20.329050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-226db88a-1eea-48da-85ed-efb32d3c4e70 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:20.576857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-38e83f0b-69ac-4014-93f7-d14e30eb8074 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:20.578398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-38e83f0b-69ac-4014-93f7-d14e30eb8074 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:20.590745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38e83f0b-69ac-4014-93f7-d14e30eb8074 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:20.593196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38e83f0b-69ac-4014-93f7-d14e30eb8074 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:20.594953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38e83f0b-69ac-4014-93f7-d14e30eb8074 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:20.596580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38e83f0b-69ac-4014-93f7-d14e30eb8074 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:20.598167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38e83f0b-69ac-4014-93f7-d14e30eb8074 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:20.598648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38e83f0b-69ac-4014-93f7-d14e30eb8074 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:20.879735 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-226db88a-1eea-48da-85ed-efb32d3c4e70 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.623877 Oct 11 04:29:20.884293 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2222/4233] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:29:20 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 630 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:29:20.896326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6b6bfed9-76c4-410b-99cf-ae436800bba7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:20.897457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6b6bfed9-76c4-410b-99cf-ae436800bba7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:21.094850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-38e83f0b-69ac-4014-93f7-d14e30eb8074 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:21.111645 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-38e83f0b-69ac-4014-93f7-d14e30eb8074 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1317 microversion: 2.1 time: 0.540524 Oct 11 04:29:21.122532 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2012/4234] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:20 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1317 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:21.139934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-22f28708-b067-4437-bd78-5d8f1bdc5278 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:21.140913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-22f28708-b067-4437-bd78-5d8f1bdc5278 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:21.145479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6b6bfed9-76c4-410b-99cf-ae436800bba7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:21.154358 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6b6bfed9-76c4-410b-99cf-ae436800bba7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1222 microversion: 2.1 time: 0.267754 Oct 11 04:29:21.158607 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2223/4235] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:20 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1222 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:21.163950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:21.164845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:21.169250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f28708-b067-4437-bd78-5d8f1bdc5278 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:21.170129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f28708-b067-4437-bd78-5d8f1bdc5278 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:21.173652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f28708-b067-4437-bd78-5d8f1bdc5278 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:21.174757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:21.175559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:21.176406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:21.176612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f28708-b067-4437-bd78-5d8f1bdc5278 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:21.177107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f28708-b067-4437-bd78-5d8f1bdc5278 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:21.178051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:21.178703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:21.178818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22f28708-b067-4437-bd78-5d8f1bdc5278 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:21.179712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:21.418043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:21.427455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:21.428876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:21.430131 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d43d05c6-1627-41ad-931c-edc99f2739c5 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.270149 Oct 11 04:29:21.474426 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2224/4236] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:21 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:21.808404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-22f28708-b067-4437-bd78-5d8f1bdc5278 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:21.832234 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-22f28708-b067-4437-bd78-5d8f1bdc5278 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1670 microversion: 2.1 time: 0.701199 Oct 11 04:29:21.833234 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2013/4237] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:21 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1670 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:22.148332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c2e01ed0-bbf5-4314-8a5a-a5e3a14b3daf tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:22.149168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c2e01ed0-bbf5-4314-8a5a-a5e3a14b3daf tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:22.164057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e01ed0-bbf5-4314-8a5a-a5e3a14b3daf tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:22.170295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e01ed0-bbf5-4314-8a5a-a5e3a14b3daf tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:22.170843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e01ed0-bbf5-4314-8a5a-a5e3a14b3daf tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:22.180696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a86a5b7-d824-46d8-b995-d281044748fb tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:22.181455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5a86a5b7-d824-46d8-b995-d281044748fb tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:22.185797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e01ed0-bbf5-4314-8a5a-a5e3a14b3daf tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:22.189666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e01ed0-bbf5-4314-8a5a-a5e3a14b3daf tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:22.192422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e01ed0-bbf5-4314-8a5a-a5e3a14b3daf tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:22.202751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a86a5b7-d824-46d8-b995-d281044748fb tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:22.211546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a86a5b7-d824-46d8-b995-d281044748fb tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:22.213383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a86a5b7-d824-46d8-b995-d281044748fb tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:22.214382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a86a5b7-d824-46d8-b995-d281044748fb tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:22.216841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a86a5b7-d824-46d8-b995-d281044748fb tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:22.217569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a86a5b7-d824-46d8-b995-d281044748fb tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:22.697650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5a86a5b7-d824-46d8-b995-d281044748fb tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:22.713087 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5a86a5b7-d824-46d8-b995-d281044748fb tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1218 microversion: 2.1 time: 0.535722 Oct 11 04:29:22.718953 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2014/4238] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:22 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1218 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:22.729775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:22.733459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:22.749616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:22.755326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:22.756660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:22.759626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:22.763581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:22.766813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:23.008768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:23.024574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:23.033484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:23.038441 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b302a5df-1473-4bc7-8f66-a56a3be0c5b9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.316837 Oct 11 04:29:23.040624 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2015/4239] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:22 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:23.053579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-edecd203-f6d1-4cb9-a0a1-e424c189cd61 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:23.056336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-edecd203-f6d1-4cb9-a0a1-e424c189cd61 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:23.068727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c2e01ed0-bbf5-4314-8a5a-a5e3a14b3daf tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:23.074117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edecd203-f6d1-4cb9-a0a1-e424c189cd61 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:23.076447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edecd203-f6d1-4cb9-a0a1-e424c189cd61 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:23.076956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edecd203-f6d1-4cb9-a0a1-e424c189cd61 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:23.079116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edecd203-f6d1-4cb9-a0a1-e424c189cd61 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:23.079602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edecd203-f6d1-4cb9-a0a1-e424c189cd61 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:23.080027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edecd203-f6d1-4cb9-a0a1-e424c189cd61 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:23.083331 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c2e01ed0-bbf5-4314-8a5a-a5e3a14b3daf tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1317 microversion: 2.1 time: 0.938930 Oct 11 04:29:23.088726 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2225/4240] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:22 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1317 bytes in 943 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:23.312121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-edecd203-f6d1-4cb9-a0a1-e424c189cd61 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:23.314840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:23.324657 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-edecd203-f6d1-4cb9-a0a1-e424c189cd61 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1670 microversion: 2.1 time: 0.280533 Oct 11 04:29:23.339198 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2016/4241] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:23 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1670 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:23.748508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0c70823e-3e5c-4e3c-a571-cf3163121c23 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:23.748508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0c70823e-3e5c-4e3c-a571-cf3163121c23 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:23.771184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c70823e-3e5c-4e3c-a571-cf3163121c23 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:23.772615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c70823e-3e5c-4e3c-a571-cf3163121c23 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:23.776974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c70823e-3e5c-4e3c-a571-cf3163121c23 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:23.780189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c70823e-3e5c-4e3c-a571-cf3163121c23 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:23.782625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c70823e-3e5c-4e3c-a571-cf3163121c23 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:23.783308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c70823e-3e5c-4e3c-a571-cf3163121c23 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:23.969790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0c70823e-3e5c-4e3c-a571-cf3163121c23 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:23.979962 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0c70823e-3e5c-4e3c-a571-cf3163121c23 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1282 microversion: 2.1 time: 0.237292 Oct 11 04:29:23.990784 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2226/4242] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:23 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1282 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:24.081542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:24.084261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:24.099061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:24.099771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:24.101124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:24.104527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:24.105195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:24.113225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8a61e9f1-8654-487a-b486-67ddb8e6439b tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:24.113937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8a61e9f1-8654-487a-b486-67ddb8e6439b tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:24.117086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:24.120707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a61e9f1-8654-487a-b486-67ddb8e6439b tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:24.121428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a61e9f1-8654-487a-b486-67ddb8e6439b tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:24.122017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a61e9f1-8654-487a-b486-67ddb8e6439b tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:24.122960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a61e9f1-8654-487a-b486-67ddb8e6439b tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:24.123476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a61e9f1-8654-487a-b486-67ddb8e6439b tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:24.124135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a61e9f1-8654-487a-b486-67ddb8e6439b tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:24.197340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:24.220933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:24.223578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:24.225601 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-87469e49-c4bf-45d0-a7d0-fec53d3199cc tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.152266 Oct 11 04:29:24.238567 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2017/4243] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:24 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:24.357632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8a61e9f1-8654-487a-b486-67ddb8e6439b tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:24.358296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aebf57ea-8442-489d-8e9b-c82ef219de4f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:24.359050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aebf57ea-8442-489d-8e9b-c82ef219de4f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:24.368052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aebf57ea-8442-489d-8e9b-c82ef219de4f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:24.372947 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8a61e9f1-8654-487a-b486-67ddb8e6439b tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1317 microversion: 2.1 time: 0.262959 Oct 11 04:29:24.373483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aebf57ea-8442-489d-8e9b-c82ef219de4f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:24.374232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aebf57ea-8442-489d-8e9b-c82ef219de4f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:24.375056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aebf57ea-8442-489d-8e9b-c82ef219de4f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:24.376358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aebf57ea-8442-489d-8e9b-c82ef219de4f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:24.376899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aebf57ea-8442-489d-8e9b-c82ef219de4f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:24.377013 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2227/4244] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:24 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1317 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:24.851732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aebf57ea-8442-489d-8e9b-c82ef219de4f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:24.863482 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aebf57ea-8442-489d-8e9b-c82ef219de4f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1670 microversion: 2.1 time: 0.512636 Oct 11 04:29:24.868355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2018/4245] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:24 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1670 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:25.004213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b45a6af-1b72-42bc-921e-e7a5207455a7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:25.004961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b45a6af-1b72-42bc-921e-e7a5207455a7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:25.013531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b45a6af-1b72-42bc-921e-e7a5207455a7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:25.014797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b45a6af-1b72-42bc-921e-e7a5207455a7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:25.015569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b45a6af-1b72-42bc-921e-e7a5207455a7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:25.016604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b45a6af-1b72-42bc-921e-e7a5207455a7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:25.017296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b45a6af-1b72-42bc-921e-e7a5207455a7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:25.017953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b45a6af-1b72-42bc-921e-e7a5207455a7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:25.090618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:25.256925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:25.258447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:25.271726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:25.272632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:25.273234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:25.275128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:25.277608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:25.282340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:25.467651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:25.496713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:25.499229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:25.501841 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-42eb0eba-1f0e-4368-a811-71ab4ca52311 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.249930 Oct 11 04:29:25.506008 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2019/4246] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:25 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:29:25.513099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8de224ec-9c35-40af-80a8-dd135cd4c14c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:25.519404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8de224ec-9c35-40af-80a8-dd135cd4c14c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:25.536881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8de224ec-9c35-40af-80a8-dd135cd4c14c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:25.537655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8de224ec-9c35-40af-80a8-dd135cd4c14c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:25.538703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8de224ec-9c35-40af-80a8-dd135cd4c14c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:25.543289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8de224ec-9c35-40af-80a8-dd135cd4c14c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:25.544670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8de224ec-9c35-40af-80a8-dd135cd4c14c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:25.545386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8de224ec-9c35-40af-80a8-dd135cd4c14c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:25.578326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b45a6af-1b72-42bc-921e-e7a5207455a7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:25.591601 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b45a6af-1b72-42bc-921e-e7a5207455a7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.590550 Oct 11 04:29:25.607769 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2228/4247] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:24 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:25.892727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7dce70a1-c8e1-4ce4-be87-dfbc1d21f678 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:25.893384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7dce70a1-c8e1-4ce4-be87-dfbc1d21f678 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:25.911632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dce70a1-c8e1-4ce4-be87-dfbc1d21f678 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:25.912141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dce70a1-c8e1-4ce4-be87-dfbc1d21f678 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:25.912587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dce70a1-c8e1-4ce4-be87-dfbc1d21f678 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:25.913313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dce70a1-c8e1-4ce4-be87-dfbc1d21f678 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:25.913805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dce70a1-c8e1-4ce4-be87-dfbc1d21f678 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:25.914263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7dce70a1-c8e1-4ce4-be87-dfbc1d21f678 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:26.372073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8de224ec-9c35-40af-80a8-dd135cd4c14c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:26.381127 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8de224ec-9c35-40af-80a8-dd135cd4c14c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1317 microversion: 2.1 time: 0.873227 Oct 11 04:29:26.386378 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2020/4248] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:25 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1317 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:26.539658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:26.540336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:26.550169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:26.555330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:26.555330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:26.556530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:26.557849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:26.558738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:26.698512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:26.718255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:26.723426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:26.727355 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5831089d-d9a2-4811-a737-3cf213a8562e tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.192509 Oct 11 04:29:26.727958 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2021/4249] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:26 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:26.738306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-59fe4093-2f4f-4269-a3b3-b2e6d1c9710d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:26.742114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-59fe4093-2f4f-4269-a3b3-b2e6d1c9710d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:26.757421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59fe4093-2f4f-4269-a3b3-b2e6d1c9710d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:26.757923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59fe4093-2f4f-4269-a3b3-b2e6d1c9710d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:26.758401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59fe4093-2f4f-4269-a3b3-b2e6d1c9710d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:26.759138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59fe4093-2f4f-4269-a3b3-b2e6d1c9710d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:26.771014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59fe4093-2f4f-4269-a3b3-b2e6d1c9710d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:26.771472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59fe4093-2f4f-4269-a3b3-b2e6d1c9710d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:26.992093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7dce70a1-c8e1-4ce4-be87-dfbc1d21f678 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:27.001244 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7dce70a1-c8e1-4ce4-be87-dfbc1d21f678 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 1.113580 Oct 11 04:29:27.001832 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2229/4250] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:25 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:27.032432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2ae056f3-b8a5-47ae-bb7a-4ab988d7996b req-a0cea832-02e1-4723-9f9b-e9c9f93853d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aed25f7-59d6-49de-b699-3581739f0edd", "tag": "69a50552-a0f9-4376-a687-65ec01566f02"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:27.051176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ae056f3-b8a5-47ae-bb7a-4ab988d7996b req-a0cea832-02e1-4723-9f9b-e9c9f93853d3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:27.051779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ae056f3-b8a5-47ae-bb7a-4ab988d7996b req-a0cea832-02e1-4723-9f9b-e9c9f93853d3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:27.052368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ae056f3-b8a5-47ae-bb7a-4ab988d7996b req-a0cea832-02e1-4723-9f9b-e9c9f93853d3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:27.069459 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2ae056f3-b8a5-47ae-bb7a-4ab988d7996b req-a0cea832-02e1-4723-9f9b-e9c9f93853d3 service nova] Creating event network-changed:69a50552-a0f9-4376-a687-65ec01566f02 for instance 7aed25f7-59d6-49de-b699-3581739f0edd on n-h1-860892-1 Oct 11 04:29:27.074981 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2ae056f3-b8a5-47ae-bb7a-4ab988d7996b req-a0cea832-02e1-4723-9f9b-e9c9f93853d3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054789 Oct 11 04:29:27.076401 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2230/4251] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:29:27.125026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d89a581c-51cb-4d51-ad00-0ccd710d11bd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:27.128711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d89a581c-51cb-4d51-ad00-0ccd710d11bd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:27.135080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89a581c-51cb-4d51-ad00-0ccd710d11bd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:27.136355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89a581c-51cb-4d51-ad00-0ccd710d11bd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:27.137053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89a581c-51cb-4d51-ad00-0ccd710d11bd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:27.139443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89a581c-51cb-4d51-ad00-0ccd710d11bd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:27.140082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89a581c-51cb-4d51-ad00-0ccd710d11bd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:27.140659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d89a581c-51cb-4d51-ad00-0ccd710d11bd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:27.159967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:27.181228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d89a581c-51cb-4d51-ad00-0ccd710d11bd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:29:27.223627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-59fe4093-2f4f-4269-a3b3-b2e6d1c9710d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:27.233988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=22 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:27.236782 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-59fe4093-2f4f-4269-a3b3-b2e6d1c9710d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.502553 Oct 11 04:29:27.255707 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2022/4252] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:26 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:27.417871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1e20f827-47d9-4e4f-8ca1-eeca824a4a31 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:27.419782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1e20f827-47d9-4e4f-8ca1-eeca824a4a31 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:27.435811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e20f827-47d9-4e4f-8ca1-eeca824a4a31 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:27.438462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e20f827-47d9-4e4f-8ca1-eeca824a4a31 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:27.439089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e20f827-47d9-4e4f-8ca1-eeca824a4a31 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:27.439859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e20f827-47d9-4e4f-8ca1-eeca824a4a31 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:27.440316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e20f827-47d9-4e4f-8ca1-eeca824a4a31 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:27.444014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e20f827-47d9-4e4f-8ca1-eeca824a4a31 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:27.691440 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d89a581c-51cb-4d51-ad00-0ccd710d11bd tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 204 len: 0 microversion: 2.1 time: 0.570524 Oct 11 04:29:27.692056 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2231/4253] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:29:27 2022] DELETE /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 0 bytes in 573 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:29:27.701630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6b5ed1cc-7df8-4bb3-a0b6-e32104c64338 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:27.702379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6b5ed1cc-7df8-4bb3-a0b6-e32104c64338 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:27.732283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b5ed1cc-7df8-4bb3-a0b6-e32104c64338 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:27.735137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b5ed1cc-7df8-4bb3-a0b6-e32104c64338 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:27.740336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b5ed1cc-7df8-4bb3-a0b6-e32104c64338 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:27.741241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b5ed1cc-7df8-4bb3-a0b6-e32104c64338 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:27.741759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b5ed1cc-7df8-4bb3-a0b6-e32104c64338 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:27.742215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b5ed1cc-7df8-4bb3-a0b6-e32104c64338 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:27.750885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1e20f827-47d9-4e4f-8ca1-eeca824a4a31 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:27.769429 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1e20f827-47d9-4e4f-8ca1-eeca824a4a31 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1317 microversion: 2.1 time: 0.356813 Oct 11 04:29:27.770637 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2023/4254] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:27 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1317 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:27.775933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:27.776738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:27.785581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:27.786486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:27.787124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:27.788075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:27.788683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:27.789614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:27.917475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:27.928453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:27.932862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:27.935076 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-93018a43-ae85-4ad8-a607-d277010bdf21 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.162488 Oct 11 04:29:27.935801 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2024/4255] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:27 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:27.941509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-023bb343-4bee-4e91-ab59-d9d0da35829f req-88797224-a764-4644-a010-95dd4ea83231 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60554e10-db75-4001-ad84-55060fb24729", "tag": "7b951428-7511-42a9-9f1c-8b66d3bea718"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:27.953130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-023bb343-4bee-4e91-ab59-d9d0da35829f req-88797224-a764-4644-a010-95dd4ea83231 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:27.954047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-023bb343-4bee-4e91-ab59-d9d0da35829f req-88797224-a764-4644-a010-95dd4ea83231 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:27.956267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-023bb343-4bee-4e91-ab59-d9d0da35829f req-88797224-a764-4644-a010-95dd4ea83231 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:27.968908 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-023bb343-4bee-4e91-ab59-d9d0da35829f req-88797224-a764-4644-a010-95dd4ea83231 service nova] Creating event network-changed:7b951428-7511-42a9-9f1c-8b66d3bea718 for instance 60554e10-db75-4001-ad84-55060fb24729 on n-h1-860892-1 Oct 11 04:29:27.974436 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-023bb343-4bee-4e91-ab59-d9d0da35829f req-88797224-a764-4644-a010-95dd4ea83231 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036952 Oct 11 04:29:27.975131 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2025/4256] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:29:28.059615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6b5ed1cc-7df8-4bb3-a0b6-e32104c64338 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:28.068536 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6b5ed1cc-7df8-4bb3-a0b6-e32104c64338 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1669 microversion: 2.1 time: 0.371788 Oct 11 04:29:28.090313 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2232/4257] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:27 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1669 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:28.263906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a72345c5-ec0c-4cae-ba99-90d97c0ed9e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:28.264782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a72345c5-ec0c-4cae-ba99-90d97c0ed9e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:28.270580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:28.272235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a72345c5-ec0c-4cae-ba99-90d97c0ed9e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:28.272831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a72345c5-ec0c-4cae-ba99-90d97c0ed9e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:28.273357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a72345c5-ec0c-4cae-ba99-90d97c0ed9e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:28.274176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a72345c5-ec0c-4cae-ba99-90d97c0ed9e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:28.274743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a72345c5-ec0c-4cae-ba99-90d97c0ed9e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:28.275264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a72345c5-ec0c-4cae-ba99-90d97c0ed9e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:28.527907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a72345c5-ec0c-4cae-ba99-90d97c0ed9e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:28.543144 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a72345c5-ec0c-4cae-ba99-90d97c0ed9e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.284256 Oct 11 04:29:28.546307 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2026/4258] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:28 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:28.794479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-abd842d9-3b7a-4d04-b250-75df10e9b774 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:28.796132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-abd842d9-3b7a-4d04-b250-75df10e9b774 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:28.805621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abd842d9-3b7a-4d04-b250-75df10e9b774 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:28.808304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abd842d9-3b7a-4d04-b250-75df10e9b774 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:28.809154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abd842d9-3b7a-4d04-b250-75df10e9b774 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:28.810842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abd842d9-3b7a-4d04-b250-75df10e9b774 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:28.811475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abd842d9-3b7a-4d04-b250-75df10e9b774 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:28.812237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abd842d9-3b7a-4d04-b250-75df10e9b774 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:28.967468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:28.968843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:28.975439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:28.976011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:28.976505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:28.977398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:28.977886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:28.978581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:29.052997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:29.063718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:29.065227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:29.066846 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-21ccebaf-f9e7-4beb-a560-ed0a852d93e9 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.104549 Oct 11 04:29:29.067483 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2027/4259] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:28 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:29:29.078604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-abd842d9-3b7a-4d04-b250-75df10e9b774 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:29.088145 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-abd842d9-3b7a-4d04-b250-75df10e9b774 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1317 microversion: 2.1 time: 0.298131 Oct 11 04:29:29.088145 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2233/4260] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:28 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1317 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:29.102916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b115879-fa58-498e-b592-1e013950c065 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:29.103525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2b115879-fa58-498e-b592-1e013950c065 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:29.111406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b115879-fa58-498e-b592-1e013950c065 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:29.112003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b115879-fa58-498e-b592-1e013950c065 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:29.112438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b115879-fa58-498e-b592-1e013950c065 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:29.113162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b115879-fa58-498e-b592-1e013950c065 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:29.113662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b115879-fa58-498e-b592-1e013950c065 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:29.116655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b115879-fa58-498e-b592-1e013950c065 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:29.179391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2b115879-fa58-498e-b592-1e013950c065 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:29.191696 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b115879-fa58-498e-b592-1e013950c065 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1601 microversion: 2.1 time: 0.092476 Oct 11 04:29:29.195986 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2028/4261] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:29 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1601 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:29.573278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1305c988-02cb-48eb-b98f-7e6d2f9d4fd2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:29.574359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1305c988-02cb-48eb-b98f-7e6d2f9d4fd2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:29.578575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:29.584424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1305c988-02cb-48eb-b98f-7e6d2f9d4fd2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:29.586047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1305c988-02cb-48eb-b98f-7e6d2f9d4fd2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:29.586916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1305c988-02cb-48eb-b98f-7e6d2f9d4fd2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:29.587991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1305c988-02cb-48eb-b98f-7e6d2f9d4fd2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:29.588617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1305c988-02cb-48eb-b98f-7e6d2f9d4fd2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:29.589210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1305c988-02cb-48eb-b98f-7e6d2f9d4fd2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:29.752448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1305c988-02cb-48eb-b98f-7e6d2f9d4fd2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:29.763073 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1305c988-02cb-48eb-b98f-7e6d2f9d4fd2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.194105 Oct 11 04:29:29.764312 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2234/4262] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:29 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:30.022014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-cfb19e42-821f-408f-85dd-112dc2551ecf req-f55110cb-8017-474c-83f7-4a1ce06e2d50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f355e5e4-e6af-4b85-9dd8-99b495b0d5a8", "name": "network-vif-deleted", "tag": "ff3eb7a3-fcc1-45dc-94d9-930423c9496a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:30.093599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:30.095154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:30.107091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cfb19e42-821f-408f-85dd-112dc2551ecf req-f55110cb-8017-474c-83f7-4a1ce06e2d50 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:30.108253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cfb19e42-821f-408f-85dd-112dc2551ecf req-f55110cb-8017-474c-83f7-4a1ce06e2d50 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:30.108864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cfb19e42-821f-408f-85dd-112dc2551ecf req-f55110cb-8017-474c-83f7-4a1ce06e2d50 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:30.113324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:30.117525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:30.120657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:30.123112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:30.127575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:30.128211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:30.157346 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-cfb19e42-821f-408f-85dd-112dc2551ecf req-f55110cb-8017-474c-83f7-4a1ce06e2d50 service nova] Creating event network-vif-deleted:ff3eb7a3-fcc1-45dc-94d9-930423c9496a for instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 on n-h2-860892-1 Oct 11 04:29:30.176730 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-cfb19e42-821f-408f-85dd-112dc2551ecf req-f55110cb-8017-474c-83f7-4a1ce06e2d50 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158920 Oct 11 04:29:30.181551 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2029/4263] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:29:30.190786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-adb13801-5cce-4f9f-a790-ed2f9f1d4dbd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:30.191794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-adb13801-5cce-4f9f-a790-ed2f9f1d4dbd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:30.200349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb13801-5cce-4f9f-a790-ed2f9f1d4dbd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:30.201004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb13801-5cce-4f9f-a790-ed2f9f1d4dbd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:30.201724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb13801-5cce-4f9f-a790-ed2f9f1d4dbd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:30.203014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb13801-5cce-4f9f-a790-ed2f9f1d4dbd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:30.203660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb13801-5cce-4f9f-a790-ed2f9f1d4dbd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:30.204404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb13801-5cce-4f9f-a790-ed2f9f1d4dbd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:30.296436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:30.305415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:30.315402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:30.317047 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5e430314-0815-4747-a766-9812324301ba tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.227956 Oct 11 04:29:30.317773 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2235/4264] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:30 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:29:30.323717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:30.328372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:30.341889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:30.344661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:30.346469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:30.347410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:30.349717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:30.350503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:30.454658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:30.456084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:30.461032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:30.461032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lazy-loading 'fault' on Instance uuid f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:29:30.725823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:30.739319 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e7a6d90e-e588-4c52-ac8a-41615f4fd6ea tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 200 len: 1324 microversion: 2.1 time: 0.419701 Oct 11 04:29:30.742082 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2236/4265] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:30 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 1324 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:30.758955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f20cc8fb-8f05-4ba5-97ff-cac05de53883 req-fa14206a-ddb0-43e3-97df-ebea55a8ea27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8", "name": "network-vif-plugged", "status": "completed", "tag": "0f6aefab-baff-4301-ad61-398115dd0279"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:30.778865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f20cc8fb-8f05-4ba5-97ff-cac05de53883 req-fa14206a-ddb0-43e3-97df-ebea55a8ea27 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:30.783446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f20cc8fb-8f05-4ba5-97ff-cac05de53883 req-fa14206a-ddb0-43e3-97df-ebea55a8ea27 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:30.786279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f20cc8fb-8f05-4ba5-97ff-cac05de53883 req-fa14206a-ddb0-43e3-97df-ebea55a8ea27 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:30.814105 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-f20cc8fb-8f05-4ba5-97ff-cac05de53883 req-fa14206a-ddb0-43e3-97df-ebea55a8ea27 service nova] Creating event network-vif-plugged:0f6aefab-baff-4301-ad61-398115dd0279 for instance 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 on n-h2-860892-1 Oct 11 04:29:30.826143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f20cc8fb-8f05-4ba5-97ff-cac05de53883 req-fa14206a-ddb0-43e3-97df-ebea55a8ea27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079414 Oct 11 04:29:30.826784 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2237/4266] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:29:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:29:30.842364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-179f0dfe-df1a-4a3c-a76c-b4293c5adf77 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:30.843449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-179f0dfe-df1a-4a3c-a76c-b4293c5adf77 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:30.846230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:30.864950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-179f0dfe-df1a-4a3c-a76c-b4293c5adf77 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:30.865476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-179f0dfe-df1a-4a3c-a76c-b4293c5adf77 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:30.865959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-179f0dfe-df1a-4a3c-a76c-b4293c5adf77 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:30.869851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-179f0dfe-df1a-4a3c-a76c-b4293c5adf77 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:30.870378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-179f0dfe-df1a-4a3c-a76c-b4293c5adf77 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:30.870827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-179f0dfe-df1a-4a3c-a76c-b4293c5adf77 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:30.978574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-adb13801-5cce-4f9f-a790-ed2f9f1d4dbd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:31.024839 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-adb13801-5cce-4f9f-a790-ed2f9f1d4dbd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1317 microversion: 2.1 time: 0.840211 Oct 11 04:29:31.030927 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2030/4267] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:30 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1317 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:31.153789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=12 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:31.349538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:31.350176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:31.368814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:31.369448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:31.378180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:31.381290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:31.381792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:31.382514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:31.415307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-179f0dfe-df1a-4a3c-a76c-b4293c5adf77 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:31.427022 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-179f0dfe-df1a-4a3c-a76c-b4293c5adf77 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.598853 Oct 11 04:29:31.427617 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2238/4268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:30 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:31.556433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:31.567086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:31.570000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:31.571594 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c1d8870c-3fce-4dca-89c2-37935acb16f8 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.226135 Oct 11 04:29:31.581931 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2031/4269] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:31 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:31.770181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:31.771876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: f355e5e4-e6af-4b85-9dd8-99b495b0d5a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:31.813577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:31.814064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:31.815418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:31.817227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:31.825981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:31.826851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] HTTP exception thrown: Instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 could not be found. Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Request method failure captured: Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 HTTP/1.1 Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO88APyXyxulAU5G_yS7c7ei0ihPxzeQbFVph9RYvPIOQLdcyz69u7F_9ydoo_vd6DEt3k8XgFw4RzwRZULYtDQaEb_uGN8UNRib5IgHzPBkgUq0ztzzfcRu6UmNVXSXzNxB59S7O2jb5rNpgqbtixYTp_1U2SCkz0rGQdPvtXFCc88 Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 15b90becc5a545f0965359b05561721f Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-LiveMigrationTest-56024801 Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15b90becc5a545f0965359b05561721f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15b90becc5a545f0965359b05561721f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15b90becc5a545f0965359b05561721f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15b90becc5a545f0965359b05561721f"}]}] Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-LiveMigrationTest-56024801 Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 15b90becc5a545f0965359b05561721f Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-LiveMigrationTest-56024801 Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-LiveMigrationTest-56024801-project Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: ea114683a3754c8197b61fc5ef04fe0d Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-LiveMigrationTest-56024801-project Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 could not be found. Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'f355e5e4-e6af-4b85-9dd8-99b495b0d5a8'} Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 could not be found. Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:29:31.855129 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 could not be found. Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 could not be found. Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Returning 404 to user: Instance f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22dd01f6-6d18-4267-8e08-dab1e0ea632b tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8" status: 404 len: 111 microversion: 2.1 time: 0.089630 Oct 11 04:29:31.859617 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2239/4270] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:31 2022] GET /compute/v2.1/servers/f355e5e4-e6af-4b85-9dd8-99b495b0d5a8 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:29:31.865677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41c41714-5a52-4b10-a217-cb9c36c4dac5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '.version_select at 0x7fda19eb94c0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:31.938982 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41c41714-5a52-4b10-a217-cb9c36c4dac5 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862756183" status: 202 len: 0 microversion: 2.1 time: 0.077573 Oct 11 04:29:31.940549 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2032/4271] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:29:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1862756183 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:29:32.052869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0167e9b4-10f1-499e-9246-17f09496b4c1 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:32.053505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0167e9b4-10f1-499e-9246-17f09496b4c1 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:32.060603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0167e9b4-10f1-499e-9246-17f09496b4c1 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:32.061497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0167e9b4-10f1-499e-9246-17f09496b4c1 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:32.066657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0167e9b4-10f1-499e-9246-17f09496b4c1 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:32.066657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0167e9b4-10f1-499e-9246-17f09496b4c1 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:32.066657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0167e9b4-10f1-499e-9246-17f09496b4c1 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:32.066657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0167e9b4-10f1-499e-9246-17f09496b4c1 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:32.222839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0167e9b4-10f1-499e-9246-17f09496b4c1 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:32.246446 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0167e9b4-10f1-499e-9246-17f09496b4c1 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1317 microversion: 2.1 time: 0.197234 Oct 11 04:29:32.248062 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2240/4272] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:32 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1317 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:32.452511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ad5b065-89b3-48ba-aef2-437b916b87ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:32.453057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ad5b065-89b3-48ba-aef2-437b916b87ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:32.461988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ad5b065-89b3-48ba-aef2-437b916b87ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:32.462503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ad5b065-89b3-48ba-aef2-437b916b87ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:32.463019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ad5b065-89b3-48ba-aef2-437b916b87ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:32.463752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ad5b065-89b3-48ba-aef2-437b916b87ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:32.464203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ad5b065-89b3-48ba-aef2-437b916b87ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:32.464627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ad5b065-89b3-48ba-aef2-437b916b87ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:32.611635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:32.611635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:32.624544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:32.625156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:32.625576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:32.632989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:32.633582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:32.634034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:32.692093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ad5b065-89b3-48ba-aef2-437b916b87ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:32.704973 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ad5b065-89b3-48ba-aef2-437b916b87ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.256535 Oct 11 04:29:32.716328 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2033/4273] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:32 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:32.725305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:32.734725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:32.736242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:32.737517 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee432dca-af7d-4978-9011-17f47462f76a tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.140976 Oct 11 04:29:32.738369 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2241/4274] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:32 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:32.889289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e3d60b5-1518-4e09-9a96-0443b0344028 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:32.889868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9e3d60b5-1518-4e09-9a96-0443b0344028 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:32.896405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e3d60b5-1518-4e09-9a96-0443b0344028 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:32.896967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e3d60b5-1518-4e09-9a96-0443b0344028 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:32.897477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e3d60b5-1518-4e09-9a96-0443b0344028 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:32.898274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e3d60b5-1518-4e09-9a96-0443b0344028 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:32.898732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e3d60b5-1518-4e09-9a96-0443b0344028 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:32.899272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e3d60b5-1518-4e09-9a96-0443b0344028 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:32.925328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9e3d60b5-1518-4e09-9a96-0443b0344028 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:29:32.957971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:33.142900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-62b3e027-b345-450c-9a84-9e6fa3892eac req-854d768d-3064-430e-bdfe-861f5fdbcd8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aed25f7-59d6-49de-b699-3581739f0edd", "name": "network-vif-plugged", "status": "completed", "tag": "69a50552-a0f9-4376-a687-65ec01566f02"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:33.160628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-62b3e027-b345-450c-9a84-9e6fa3892eac req-854d768d-3064-430e-bdfe-861f5fdbcd8d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.161384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-62b3e027-b345-450c-9a84-9e6fa3892eac req-854d768d-3064-430e-bdfe-861f5fdbcd8d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.162307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-62b3e027-b345-450c-9a84-9e6fa3892eac req-854d768d-3064-430e-bdfe-861f5fdbcd8d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.177064 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-62b3e027-b345-450c-9a84-9e6fa3892eac req-854d768d-3064-430e-bdfe-861f5fdbcd8d service nova] Creating event network-vif-plugged:69a50552-a0f9-4376-a687-65ec01566f02 for instance 7aed25f7-59d6-49de-b699-3581739f0edd on n-h1-860892-1 Oct 11 04:29:33.182532 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-62b3e027-b345-450c-9a84-9e6fa3892eac req-854d768d-3064-430e-bdfe-861f5fdbcd8d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049436 Oct 11 04:29:33.183222 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2242/4275] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:29:33.256040 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9e3d60b5-1518-4e09-9a96-0443b0344028 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 204 len: 0 microversion: 2.1 time: 0.371312 Oct 11 04:29:33.256882 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2034/4276] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:29:32 2022] DELETE /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:29:33.275689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d568ed3-3b5b-42e0-aa39-c861803211a6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:33.277815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d568ed3-3b5b-42e0-aa39-c861803211a6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:33.291229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-86ab6af1-b6d8-4b22-a3c8-846986d1100d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:33.292343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-86ab6af1-b6d8-4b22-a3c8-846986d1100d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:33.294749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d568ed3-3b5b-42e0-aa39-c861803211a6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.295352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d568ed3-3b5b-42e0-aa39-c861803211a6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.295831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d568ed3-3b5b-42e0-aa39-c861803211a6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.296608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d568ed3-3b5b-42e0-aa39-c861803211a6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.297069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d568ed3-3b5b-42e0-aa39-c861803211a6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.297497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d568ed3-3b5b-42e0-aa39-c861803211a6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.299340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86ab6af1-b6d8-4b22-a3c8-846986d1100d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.299826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86ab6af1-b6d8-4b22-a3c8-846986d1100d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.300268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86ab6af1-b6d8-4b22-a3c8-846986d1100d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.300992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86ab6af1-b6d8-4b22-a3c8-846986d1100d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.301451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86ab6af1-b6d8-4b22-a3c8-846986d1100d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.301921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86ab6af1-b6d8-4b22-a3c8-846986d1100d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.441175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d568ed3-3b5b-42e0-aa39-c861803211a6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:33.443497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-86ab6af1-b6d8-4b22-a3c8-846986d1100d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:33.449492 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d568ed3-3b5b-42e0-aa39-c861803211a6 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1485 microversion: 2.1 time: 0.180380 Oct 11 04:29:33.450116 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2243/4277] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:33 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1485 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:33.451122 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-86ab6af1-b6d8-4b22-a3c8-846986d1100d tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1505 microversion: 2.1 time: 0.177805 Oct 11 04:29:33.451683 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2035/4278] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:33 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1505 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:33.477045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-074133c8-af31-4e0f-9445-60f894cc013f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:33.477769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-074133c8-af31-4e0f-9445-60f894cc013f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:33.484484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-074133c8-af31-4e0f-9445-60f894cc013f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.484972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-074133c8-af31-4e0f-9445-60f894cc013f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.485426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-074133c8-af31-4e0f-9445-60f894cc013f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.486112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-074133c8-af31-4e0f-9445-60f894cc013f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.486596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-074133c8-af31-4e0f-9445-60f894cc013f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.487028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-074133c8-af31-4e0f-9445-60f894cc013f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.512345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-074133c8-af31-4e0f-9445-60f894cc013f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8/ips" status: 200 len: 108 microversion: 2.1 time: 0.038185 Oct 11 04:29:33.512345 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2244/4279] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:29:33 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8/ips => generated 108 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:29:33.525287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98dd581c-8777-4d07-98b0-e1383dd2b291 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:33.525795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98dd581c-8777-4d07-98b0-e1383dd2b291 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:33.534041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98dd581c-8777-4d07-98b0-e1383dd2b291 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.534705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98dd581c-8777-4d07-98b0-e1383dd2b291 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.535152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98dd581c-8777-4d07-98b0-e1383dd2b291 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.535864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98dd581c-8777-4d07-98b0-e1383dd2b291 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.536324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98dd581c-8777-4d07-98b0-e1383dd2b291 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.536750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98dd581c-8777-4d07-98b0-e1383dd2b291 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.561712 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98dd581c-8777-4d07-98b0-e1383dd2b291 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8/ips" status: 200 len: 108 microversion: 2.1 time: 0.041453 Oct 11 04:29:33.562321 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2036/4280] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:29:33 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8/ips => generated 108 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:29:33.581113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5e19a67f-fedd-4e8c-b887-0eaf91c8b33c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:33.581113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5e19a67f-fedd-4e8c-b887-0eaf91c8b33c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:33.581806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e19a67f-fedd-4e8c-b887-0eaf91c8b33c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.581880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e19a67f-fedd-4e8c-b887-0eaf91c8b33c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.588046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e19a67f-fedd-4e8c-b887-0eaf91c8b33c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.588046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e19a67f-fedd-4e8c-b887-0eaf91c8b33c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.588046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e19a67f-fedd-4e8c-b887-0eaf91c8b33c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.588046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e19a67f-fedd-4e8c-b887-0eaf91c8b33c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.613322 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5e19a67f-fedd-4e8c-b887-0eaf91c8b33c tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8/ips/tempest-ServerAddressesTestJSON-514450124-network" status: 200 len: 93 microversion: 2.1 time: 0.043236 Oct 11 04:29:33.613928 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2245/4281] 10.222.0.26 () {58 vars in 1398 bytes} [Tue Oct 11 04:29:33 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8/ips/tempest-ServerAddressesTestJSON-514450124-network => generated 93 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:29:33.625609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-be896c77-df55-44fa-b702-8cf42e317824 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:33.630846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-be896c77-df55-44fa-b702-8cf42e317824 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:33.632825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be896c77-df55-44fa-b702-8cf42e317824 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.633329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be896c77-df55-44fa-b702-8cf42e317824 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.633770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be896c77-df55-44fa-b702-8cf42e317824 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.634531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be896c77-df55-44fa-b702-8cf42e317824 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.634985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be896c77-df55-44fa-b702-8cf42e317824 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.635409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be896c77-df55-44fa-b702-8cf42e317824 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.663225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-be896c77-df55-44fa-b702-8cf42e317824 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:29:33.730647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0019aa16-8172-4356-9d31-1377035a6c8e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:33.737414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0019aa16-8172-4356-9d31-1377035a6c8e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:33.750819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0019aa16-8172-4356-9d31-1377035a6c8e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.751317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0019aa16-8172-4356-9d31-1377035a6c8e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.751753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0019aa16-8172-4356-9d31-1377035a6c8e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.754041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0019aa16-8172-4356-9d31-1377035a6c8e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:33.758620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0019aa16-8172-4356-9d31-1377035a6c8e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:33.758620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0019aa16-8172-4356-9d31-1377035a6c8e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:33.805207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:34.046858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0019aa16-8172-4356-9d31-1377035a6c8e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:34.051776 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-be896c77-df55-44fa-b702-8cf42e317824 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 204 len: 0 microversion: 2.1 time: 0.429907 Oct 11 04:29:34.056022 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2037/4282] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:29:33 2022] DELETE /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:29:34.056477 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0019aa16-8172-4356-9d31-1377035a6c8e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.329420 Oct 11 04:29:34.062493 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2246/4283] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:33 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:34.068555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:34.068832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee2ea234-57a4-48ed-b821-cdf31bcaa110 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:34.073108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee2ea234-57a4-48ed-b821-cdf31bcaa110 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:34.073225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:34.081027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:34.081867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:34.082898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:34.084655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee2ea234-57a4-48ed-b821-cdf31bcaa110 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:34.084767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:34.084857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee2ea234-57a4-48ed-b821-cdf31bcaa110 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:34.084857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee2ea234-57a4-48ed-b821-cdf31bcaa110 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:34.085292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:34.085886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:34.089374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee2ea234-57a4-48ed-b821-cdf31bcaa110 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:34.090019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee2ea234-57a4-48ed-b821-cdf31bcaa110 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:34.091383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee2ea234-57a4-48ed-b821-cdf31bcaa110 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:34.181690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:34.190846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:34.191902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:34.193073 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef39d812-2e06-4883-81c1-027d5f3c5f01 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.135297 Oct 11 04:29:34.194284 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2038/4284] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:34 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:34.324114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee2ea234-57a4-48ed-b821-cdf31bcaa110 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:34.332584 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee2ea234-57a4-48ed-b821-cdf31bcaa110 tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1511 microversion: 2.1 time: 0.268840 Oct 11 04:29:34.333246 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2247/4285] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:34 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1511 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:34.473390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3a9b7db4-d87e-4bad-9c23-f5f309717775 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:34.474106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3a9b7db4-d87e-4bad-9c23-f5f309717775 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:34.481666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9b7db4-d87e-4bad-9c23-f5f309717775 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:34.482390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9b7db4-d87e-4bad-9c23-f5f309717775 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:34.482830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9b7db4-d87e-4bad-9c23-f5f309717775 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:34.483525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9b7db4-d87e-4bad-9c23-f5f309717775 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:34.483992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9b7db4-d87e-4bad-9c23-f5f309717775 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:34.484400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a9b7db4-d87e-4bad-9c23-f5f309717775 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:34.574405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3a9b7db4-d87e-4bad-9c23-f5f309717775 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:34.586059 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3a9b7db4-d87e-4bad-9c23-f5f309717775 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1443 microversion: 2.1 time: 0.116728 Oct 11 04:29:34.588820 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2039/4286] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:34 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1443 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:34.660983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-bc29e0e6-09ea-487c-9754-fa6cb9fd1efb req-92256226-6c29-4719-a835-b9e84d559583 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be377902-7acc-4ab8-b89e-c308d4c41a9c", "name": "network-vif-deleted", "tag": "e1b10a47-b8c3-4f1e-b4a6-24338cc309de"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:34.673602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bc29e0e6-09ea-487c-9754-fa6cb9fd1efb req-92256226-6c29-4719-a835-b9e84d559583 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:34.674137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bc29e0e6-09ea-487c-9754-fa6cb9fd1efb req-92256226-6c29-4719-a835-b9e84d559583 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:34.674588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bc29e0e6-09ea-487c-9754-fa6cb9fd1efb req-92256226-6c29-4719-a835-b9e84d559583 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:34.688320 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-bc29e0e6-09ea-487c-9754-fa6cb9fd1efb req-92256226-6c29-4719-a835-b9e84d559583 service nova] Creating event network-vif-deleted:e1b10a47-b8c3-4f1e-b4a6-24338cc309de for instance be377902-7acc-4ab8-b89e-c308d4c41a9c on n-h2-860892-1 Oct 11 04:29:34.694607 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-bc29e0e6-09ea-487c-9754-fa6cb9fd1efb req-92256226-6c29-4719-a835-b9e84d559583 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039747 Oct 11 04:29:34.695217 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2248/4287] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:29:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:29:35.081275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a27bb52f-66e5-43a5-aab9-30ca6389cb2b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:35.081884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a27bb52f-66e5-43a5-aab9-30ca6389cb2b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:35.088627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a27bb52f-66e5-43a5-aab9-30ca6389cb2b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:35.089292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a27bb52f-66e5-43a5-aab9-30ca6389cb2b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:35.089726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a27bb52f-66e5-43a5-aab9-30ca6389cb2b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:35.090456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a27bb52f-66e5-43a5-aab9-30ca6389cb2b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:35.090919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a27bb52f-66e5-43a5-aab9-30ca6389cb2b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:35.091360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a27bb52f-66e5-43a5-aab9-30ca6389cb2b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:35.222339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:35.223132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:35.232417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:35.232417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:35.232947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:35.233689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:35.234223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:35.234655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:35.251517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a27bb52f-66e5-43a5-aab9-30ca6389cb2b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:35.261117 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a27bb52f-66e5-43a5-aab9-30ca6389cb2b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.183810 Oct 11 04:29:35.267973 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2040/4288] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:35 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:35.308952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:35.318118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:35.320638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:35.324424 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8503eede-cb38-442a-bd80-1e29bde4723c tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.104956 Oct 11 04:29:35.326013 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2249/4289] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:35 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:29:35.357334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-51458986-f9d1-4488-bb7d-8140380d902f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:35.357951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-51458986-f9d1-4488-bb7d-8140380d902f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:35.363961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51458986-f9d1-4488-bb7d-8140380d902f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:35.364445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51458986-f9d1-4488-bb7d-8140380d902f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:35.364883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51458986-f9d1-4488-bb7d-8140380d902f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:35.365569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51458986-f9d1-4488-bb7d-8140380d902f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:35.366019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51458986-f9d1-4488-bb7d-8140380d902f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:35.366471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51458986-f9d1-4488-bb7d-8140380d902f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:35.504503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51458986-f9d1-4488-bb7d-8140380d902f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:35.514881 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-51458986-f9d1-4488-bb7d-8140380d902f tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1511 microversion: 2.1 time: 0.161793 Oct 11 04:29:35.515690 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2041/4290] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:35 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:35.612937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc2e96de-be7f-4de9-9ee4-32703dd8fc64 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:35.613874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cc2e96de-be7f-4de9-9ee4-32703dd8fc64 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:35.625731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc2e96de-be7f-4de9-9ee4-32703dd8fc64 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:35.626487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc2e96de-be7f-4de9-9ee4-32703dd8fc64 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:35.627071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc2e96de-be7f-4de9-9ee4-32703dd8fc64 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:35.629580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc2e96de-be7f-4de9-9ee4-32703dd8fc64 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:35.630370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc2e96de-be7f-4de9-9ee4-32703dd8fc64 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:35.630825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc2e96de-be7f-4de9-9ee4-32703dd8fc64 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:35.724496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cc2e96de-be7f-4de9-9ee4-32703dd8fc64 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:35.739297 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc2e96de-be7f-4de9-9ee4-32703dd8fc64 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1281 microversion: 2.1 time: 0.130741 Oct 11 04:29:35.740375 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2250/4291] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:35 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1281 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:36.285811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bc918ec6-4183-4320-af98-e6d8479da23c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:36.287130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bc918ec6-4183-4320-af98-e6d8479da23c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:36.296507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc918ec6-4183-4320-af98-e6d8479da23c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:36.296951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc918ec6-4183-4320-af98-e6d8479da23c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:36.297389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc918ec6-4183-4320-af98-e6d8479da23c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:36.298146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc918ec6-4183-4320-af98-e6d8479da23c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:36.298628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc918ec6-4183-4320-af98-e6d8479da23c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:36.299044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc918ec6-4183-4320-af98-e6d8479da23c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:36.352074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:36.352702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:36.361828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:36.362360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:36.362979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:36.363890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:36.364537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:36.365183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:36.550239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:36.563242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bc918ec6-4183-4320-af98-e6d8479da23c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:36.572946 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bc918ec6-4183-4320-af98-e6d8479da23c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.291240 Oct 11 04:29:36.573892 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2042/4292] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:36 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:36.574214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:36.575812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:36.582041 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aed8ffd4-82fe-4dc1-9fc3-8bdc6e0aa3ce tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.233912 Oct 11 04:29:36.583159 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2251/4293] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:36 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:36.596263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bf4ff4de-c780-4400-884a-26d539ee0bcc tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:36.596974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bf4ff4de-c780-4400-884a-26d539ee0bcc tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:36.603699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf4ff4de-c780-4400-884a-26d539ee0bcc tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:36.604329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf4ff4de-c780-4400-884a-26d539ee0bcc tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:36.605382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf4ff4de-c780-4400-884a-26d539ee0bcc tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:36.606267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf4ff4de-c780-4400-884a-26d539ee0bcc tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:36.606810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf4ff4de-c780-4400-884a-26d539ee0bcc tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:36.607375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf4ff4de-c780-4400-884a-26d539ee0bcc tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:36.680781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf4ff4de-c780-4400-884a-26d539ee0bcc tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7fcbb3e81cd044248c8c9196ea29000e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6aad0e2e5424d37aa02a7f355bc81fd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:36.689609 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bf4ff4de-c780-4400-884a-26d539ee0bcc tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 200 len: 1302 microversion: 2.1 time: 0.113899 Oct 11 04:29:36.690182 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2043/4294] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:36 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 1302 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:36.712052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-dc6c2723-517a-4bb5-b733-8ed4ef31b2c1 req-3a023f1e-ad93-4bac-bbc1-10eaac7ab05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8", "name": "network-vif-deleted", "tag": "0f6aefab-baff-4301-ad61-398115dd0279"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:36.721409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-dc6c2723-517a-4bb5-b733-8ed4ef31b2c1 req-3a023f1e-ad93-4bac-bbc1-10eaac7ab05d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:36.721887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-dc6c2723-517a-4bb5-b733-8ed4ef31b2c1 req-3a023f1e-ad93-4bac-bbc1-10eaac7ab05d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:36.722344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-dc6c2723-517a-4bb5-b733-8ed4ef31b2c1 req-3a023f1e-ad93-4bac-bbc1-10eaac7ab05d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:36.735610 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-dc6c2723-517a-4bb5-b733-8ed4ef31b2c1 req-3a023f1e-ad93-4bac-bbc1-10eaac7ab05d service nova] Creating event network-vif-deleted:0f6aefab-baff-4301-ad61-398115dd0279 for instance 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 on n-h2-860892-1 Oct 11 04:29:36.740273 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-dc6c2723-517a-4bb5-b733-8ed4ef31b2c1 req-3a023f1e-ad93-4bac-bbc1-10eaac7ab05d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032011 Oct 11 04:29:36.740873 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2252/4295] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:29:36.763545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:36.766799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:36.770276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:36.770761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:36.771201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:36.771887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:36.772343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:36.772770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:36.803152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:36.803574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:36.804012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:36.804461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lazy-loading 'fault' on Instance uuid be377902-7acc-4ab8-b89e-c308d4c41a9c {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:29:36.846103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:36.853866 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-73f5a2a8-0e2b-4c8f-bd98-18338b70bfd4 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 200 len: 1301 microversion: 2.1 time: 0.094958 Oct 11 04:29:36.854479 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2044/4296] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:36 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 1301 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:37.598588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1db2a69e-4166-4d32-8dac-e863554aa732 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:37.599290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1db2a69e-4166-4d32-8dac-e863554aa732 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:37.613258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:37.614531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:37.619550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1db2a69e-4166-4d32-8dac-e863554aa732 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:37.620239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1db2a69e-4166-4d32-8dac-e863554aa732 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:37.620694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1db2a69e-4166-4d32-8dac-e863554aa732 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:37.621466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1db2a69e-4166-4d32-8dac-e863554aa732 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:37.624290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1db2a69e-4166-4d32-8dac-e863554aa732 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:37.626143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:37.626905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1db2a69e-4166-4d32-8dac-e863554aa732 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:37.630255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:37.630990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:37.632885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:37.633553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:37.636336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:37.733687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:37.742933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:37.744414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:37.747776 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4bdd63b2-f04f-48d1-a2c4-c1a1da1b77ac tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.136920 Oct 11 04:29:37.748343 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2045/4297] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:37 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:37.778448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1db2a69e-4166-4d32-8dac-e863554aa732 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:37.783257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:37.784276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] [instance: 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:37.791058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:37.791578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:37.792012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:37.792715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:37.793163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:37.794406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:37.797644 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1db2a69e-4166-4d32-8dac-e863554aa732 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.203681 Oct 11 04:29:37.798257 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2253/4298] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:37 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:37.811384 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] HTTP exception thrown: Instance 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 could not be found. Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Request method failure captured: Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 HTTP/1.1 Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPEUpHo9GpzHHexTvpKEsw4pRdKGxL9c6xQFtKz3q0BNOWLljpxcPnrbXgEutM-DBqyC8_9ZPkyPr7Iu_TYEA_4ChYhRdskcZqBhmcGj59D3Ua9zKYssj15Wa1ZtMiyfLBcwfXsSbNLAxewFDDk7JGlkwDZbKNznPH502jXUzA-GQ6o Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: c6aad0e2e5424d37aa02a7f355bc81fd Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerAddressesTestJSON-1808326967 Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c6aad0e2e5424d37aa02a7f355bc81fd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c6aad0e2e5424d37aa02a7f355bc81fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c6aad0e2e5424d37aa02a7f355bc81fd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c6aad0e2e5424d37aa02a7f355bc81fd"}]}] Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerAddressesTestJSON-1808326967 Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: c6aad0e2e5424d37aa02a7f355bc81fd Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerAddressesTestJSON-1808326967 Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerAddressesTestJSON-1808326967-project Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7fcbb3e81cd044248c8c9196ea29000e Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerAddressesTestJSON-1808326967-project Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 could not be found. Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8'} Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 could not be found. Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 could not be found. Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:37.813134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:37.821780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:37.821780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:37.821780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:37.821780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:29:37.821780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:29:37.821780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 could not be found. Oct 11 04:29:37.821780 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:37.821780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] Returning 404 to user: Instance 1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:29:37.821780 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c547addb-1b12-49b2-990d-eaf9760676fd tempest-ServerAddressesTestJSON-1808326967 tempest-ServerAddressesTestJSON-1808326967-project] 10.222.0.26 "GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8" status: 404 len: 111 microversion: 2.1 time: 0.059162 Oct 11 04:29:37.821780 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2046/4299] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:37 2022] GET /compute/v2.1/servers/1f8262ff-d44e-4f0f-bbe9-0d87ad2565a8 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:29:37.879075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:37.879721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: be377902-7acc-4ab8-b89e-c308d4c41a9c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:37.889846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:37.905688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:37.905920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:37.906747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:37.908608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:37.909257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:37.935576 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] HTTP exception thrown: Instance be377902-7acc-4ab8-b89e-c308d4c41a9c could not be found. Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Request method failure captured: Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c HTTP/1.1 Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO88APyXyxulAU5G_yS7c7ei0ihPxzeQbFVph9RYvPIOQLdcyz69u7F_9ydoo_vd6DEt3k8XgFw4RzwRZULYtDQaEb_uGN8UNRib5IgHzPBkgUq0ztzzfcRu6UmNVXSXzNxB59S7O2jb5rNpgqbtixYTp_1U2SCkz0rGQdPvtXFCc88 Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 15b90becc5a545f0965359b05561721f Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-LiveMigrationTest-56024801 Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15b90becc5a545f0965359b05561721f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15b90becc5a545f0965359b05561721f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15b90becc5a545f0965359b05561721f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15b90becc5a545f0965359b05561721f"}]}] Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-LiveMigrationTest-56024801 Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 15b90becc5a545f0965359b05561721f Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-LiveMigrationTest-56024801 Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-LiveMigrationTest-56024801-project Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: ea114683a3754c8197b61fc5ef04fe0d Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-LiveMigrationTest-56024801-project Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance be377902-7acc-4ab8-b89e-c308d4c41a9c could not be found. Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'be377902-7acc-4ab8-b89e-c308d4c41a9c'} Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be377902-7acc-4ab8-b89e-c308d4c41a9c could not be found. Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be377902-7acc-4ab8-b89e-c308d4c41a9c could not be found. Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:37.937903 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:37.942058 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:37.942058 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:37.942058 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:37.942058 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:29:37.942058 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:29:37.942058 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be377902-7acc-4ab8-b89e-c308d4c41a9c could not be found. Oct 11 04:29:37.942058 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:29:37.943284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Returning 404 to user: Instance be377902-7acc-4ab8-b89e-c308d4c41a9c could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:29:37.944372 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d6a817b-c8f1-4aaa-9f7a-108ee950857e tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c" status: 404 len: 111 microversion: 2.1 time: 0.069545 Oct 11 04:29:37.953713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6fa436b7-1411-45da-aa23-475e7768121a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:37.954234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6fa436b7-1411-45da-aa23-475e7768121a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:37.957400 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2254/4300] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:37 2022] GET /compute/v2.1/servers/be377902-7acc-4ab8-b89e-c308d4c41a9c => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:29:37.961609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa436b7-1411-45da-aa23-475e7768121a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:37.962210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa436b7-1411-45da-aa23-475e7768121a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:37.962708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa436b7-1411-45da-aa23-475e7768121a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:37.963503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa436b7-1411-45da-aa23-475e7768121a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:37.963998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa436b7-1411-45da-aa23-475e7768121a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:37.964550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fa436b7-1411-45da-aa23-475e7768121a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:37.993238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6fa436b7-1411-45da-aa23-475e7768121a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:29:38.352354 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6fa436b7-1411-45da-aa23-475e7768121a tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 204 len: 0 microversion: 2.1 time: 0.402253 Oct 11 04:29:38.353337 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2047/4301] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:29:37 2022] DELETE /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 0 bytes in 404 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:29:38.362995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-319fb46d-ce56-48d5-b0c6-fcd618b5d695 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:38.363797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-319fb46d-ce56-48d5-b0c6-fcd618b5d695 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:38.373180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-319fb46d-ce56-48d5-b0c6-fcd618b5d695 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:38.373180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-319fb46d-ce56-48d5-b0c6-fcd618b5d695 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:38.373180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-319fb46d-ce56-48d5-b0c6-fcd618b5d695 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:38.374523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-319fb46d-ce56-48d5-b0c6-fcd618b5d695 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:38.374993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-319fb46d-ce56-48d5-b0c6-fcd618b5d695 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:38.375469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-319fb46d-ce56-48d5-b0c6-fcd618b5d695 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:38.714273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-319fb46d-ce56-48d5-b0c6-fcd618b5d695 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:38.725180 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-319fb46d-ce56-48d5-b0c6-fcd618b5d695 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1501 microversion: 2.1 time: 0.366637 Oct 11 04:29:38.725768 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2255/4302] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:38 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1501 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:38.776165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:38.777443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:38.797479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:38.797992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:38.798485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:38.799271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:38.799728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:38.800174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:38.820902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-03a6c574-2ba5-4d8d-a27c-1fed9aedb5a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:38.821941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-03a6c574-2ba5-4d8d-a27c-1fed9aedb5a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:38.827958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:38.843654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03a6c574-2ba5-4d8d-a27c-1fed9aedb5a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:38.844431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03a6c574-2ba5-4d8d-a27c-1fed9aedb5a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:38.845049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03a6c574-2ba5-4d8d-a27c-1fed9aedb5a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:38.846014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03a6c574-2ba5-4d8d-a27c-1fed9aedb5a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:38.846656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03a6c574-2ba5-4d8d-a27c-1fed9aedb5a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:38.847236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03a6c574-2ba5-4d8d-a27c-1fed9aedb5a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:38.910626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:38.924210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:38.925692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:38.929560 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b975883-0e7e-46f2-b2a0-6014694a7a26 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.158272 Oct 11 04:29:38.930172 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2048/4303] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:38 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:39.504529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8c397418-fcec-45a1-b9a8-7f051f63fe89 req-7381f27a-3220-4fcc-ba63-22b5f40b5378 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60554e10-db75-4001-ad84-55060fb24729", "name": "network-vif-plugged", "status": "completed", "tag": "7b951428-7511-42a9-9f1c-8b66d3bea718"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:39.534427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8c397418-fcec-45a1-b9a8-7f051f63fe89 req-7381f27a-3220-4fcc-ba63-22b5f40b5378 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:39.536690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8c397418-fcec-45a1-b9a8-7f051f63fe89 req-7381f27a-3220-4fcc-ba63-22b5f40b5378 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:39.536690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8c397418-fcec-45a1-b9a8-7f051f63fe89 req-7381f27a-3220-4fcc-ba63-22b5f40b5378 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:39.550765 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8c397418-fcec-45a1-b9a8-7f051f63fe89 req-7381f27a-3220-4fcc-ba63-22b5f40b5378 service nova] Creating event network-vif-plugged:7b951428-7511-42a9-9f1c-8b66d3bea718 for instance 60554e10-db75-4001-ad84-55060fb24729 on n-h1-860892-1 Oct 11 04:29:39.557489 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8c397418-fcec-45a1-b9a8-7f051f63fe89 req-7381f27a-3220-4fcc-ba63-22b5f40b5378 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058155 Oct 11 04:29:39.577056 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2049/4304] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:29:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:29:39.725048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-03a6c574-2ba5-4d8d-a27c-1fed9aedb5a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:39.733821 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-03a6c574-2ba5-4d8d-a27c-1fed9aedb5a3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.917050 Oct 11 04:29:39.750008 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2256/4305] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:38 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 934 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:39.752236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-769eac7e-2809-425b-83ee-f6e6156ec04c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:39.752942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-769eac7e-2809-425b-83ee-f6e6156ec04c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:39.760218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-769eac7e-2809-425b-83ee-f6e6156ec04c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:39.761261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-769eac7e-2809-425b-83ee-f6e6156ec04c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:39.762273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-769eac7e-2809-425b-83ee-f6e6156ec04c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:39.763256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-769eac7e-2809-425b-83ee-f6e6156ec04c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:39.763947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-769eac7e-2809-425b-83ee-f6e6156ec04c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:39.764621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-769eac7e-2809-425b-83ee-f6e6156ec04c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:39.960749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:39.961748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:39.968335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:39.969102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:39.969611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:39.970727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:39.971178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:39.971692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:40.050823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:40.063743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:40.067051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:40.068733 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30bf1ebc-9715-4d46-a8e0-f5f7a5eb6262 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1409 microversion: 2.54 time: 0.113162 Oct 11 04:29:40.070430 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2257/4306] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:39 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1409 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:29:40.193921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6ddee35f-4b13-4833-a51c-2df2de42929b req-a6065661-4cc4-4736-ad49-e8b36f764e0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec21f97-4e31-411a-90c9-19c8ad94693f", "name": "network-vif-deleted", "tag": "bf241d38-0545-4589-afea-60551eb1c3e1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:40.206147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6ddee35f-4b13-4833-a51c-2df2de42929b req-a6065661-4cc4-4736-ad49-e8b36f764e0c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:40.206730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6ddee35f-4b13-4833-a51c-2df2de42929b req-a6065661-4cc4-4736-ad49-e8b36f764e0c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:40.207169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6ddee35f-4b13-4833-a51c-2df2de42929b req-a6065661-4cc4-4736-ad49-e8b36f764e0c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:40.226423 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6ddee35f-4b13-4833-a51c-2df2de42929b req-a6065661-4cc4-4736-ad49-e8b36f764e0c service nova] Creating event network-vif-deleted:bf241d38-0545-4589-afea-60551eb1c3e1 for instance 7ec21f97-4e31-411a-90c9-19c8ad94693f on n-h2-860892-1 Oct 11 04:29:40.231651 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6ddee35f-4b13-4833-a51c-2df2de42929b req-a6065661-4cc4-4736-ad49-e8b36f764e0c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040278 Oct 11 04:29:40.233487 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2258/4307] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:29:40.255593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-769eac7e-2809-425b-83ee-f6e6156ec04c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:40.264305 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-769eac7e-2809-425b-83ee-f6e6156ec04c tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1501 microversion: 2.1 time: 0.516316 Oct 11 04:29:40.265202 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2050/4308] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:39 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1501 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:40.758817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-599e1537-044a-44b5-839f-94f111188d49 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:40.759483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-599e1537-044a-44b5-839f-94f111188d49 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:40.774526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-599e1537-044a-44b5-839f-94f111188d49 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:40.783826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-599e1537-044a-44b5-839f-94f111188d49 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:40.783826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-599e1537-044a-44b5-839f-94f111188d49 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:40.783826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-599e1537-044a-44b5-839f-94f111188d49 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:40.783826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-599e1537-044a-44b5-839f-94f111188d49 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:40.783826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-599e1537-044a-44b5-839f-94f111188d49 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:41.039366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-599e1537-044a-44b5-839f-94f111188d49 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:41.064672 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-599e1537-044a-44b5-839f-94f111188d49 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.309657 Oct 11 04:29:41.068569 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2259/4309] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:40 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:41.096848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:41.097732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:41.107489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:41.108292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:41.109091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:41.112267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:41.112920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:41.113508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:41.245564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:41.259496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:41.265745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:41.268898 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dee42d59-eb92-4678-9270-4cd81523d6ab tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1415 microversion: 2.54 time: 0.176596 Oct 11 04:29:41.291711 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2051/4310] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:41 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1415 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:41.293892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:41.294848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:41.310036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:41.322729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:41.323196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:41.323960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:41.324448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:41.330303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:41.386471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:41.387875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:41.388543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:41.389076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lazy-loading 'fault' on Instance uuid 7ec21f97-4e31-411a-90c9-19c8ad94693f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:29:41.445428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea114683a3754c8197b61fc5ef04fe0d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15b90becc5a545f0965359b05561721f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:41.454467 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-db84627d-aafa-493d-973a-fb10cde9009f tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 200 len: 1301 microversion: 2.1 time: 0.169375 Oct 11 04:29:41.459805 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2260/4311] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:41 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 1301 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:42.093125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62aa77b8-7a01-4b0a-83c8-5e38917d0cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:42.093860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-62aa77b8-7a01-4b0a-83c8-5e38917d0cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:42.104927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62aa77b8-7a01-4b0a-83c8-5e38917d0cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:42.106985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62aa77b8-7a01-4b0a-83c8-5e38917d0cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:42.111073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62aa77b8-7a01-4b0a-83c8-5e38917d0cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:42.116493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62aa77b8-7a01-4b0a-83c8-5e38917d0cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:42.116493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62aa77b8-7a01-4b0a-83c8-5e38917d0cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:42.116493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62aa77b8-7a01-4b0a-83c8-5e38917d0cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:42.317893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62aa77b8-7a01-4b0a-83c8-5e38917d0cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:42.318503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:42.319090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:42.332270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:42.332270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:42.332270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:42.332270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:42.332270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:42.332270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:42.338386 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-62aa77b8-7a01-4b0a-83c8-5e38917d0cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.250056 Oct 11 04:29:42.338976 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2052/4312] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:42 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:42.457833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:42.470856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:42.475786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:42.479963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:42.482874 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9497b94c-988a-4cb5-9f2f-3d0c0b33a523 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1415 microversion: 2.54 time: 0.162988 Oct 11 04:29:42.482997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] [instance: 7ec21f97-4e31-411a-90c9-19c8ad94693f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:42.488414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:42.489725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:42.490443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:42.491370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:42.492100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:42.492753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:42.495453 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2261/4313] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:42 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1415 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:42.545444 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] HTTP exception thrown: Instance 7ec21f97-4e31-411a-90c9-19c8ad94693f could not be found. Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Request method failure captured: Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f HTTP/1.1 Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO88APyXyxulAU5G_yS7c7ei0ihPxzeQbFVph9RYvPIOQLdcyz69u7F_9ydoo_vd6DEt3k8XgFw4RzwRZULYtDQaEb_uGN8UNRib5IgHzPBkgUq0ztzzfcRu6UmNVXSXzNxB59S7O2jb5rNpgqbtixYTp_1U2SCkz0rGQdPvtXFCc88 Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 15b90becc5a545f0965359b05561721f Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-LiveMigrationTest-56024801 Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/15b90becc5a545f0965359b05561721f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_15b90becc5a545f0965359b05561721f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15b90becc5a545f0965359b05561721f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/15b90becc5a545f0965359b05561721f"}]}] Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-LiveMigrationTest-56024801 Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 15b90becc5a545f0965359b05561721f Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-LiveMigrationTest-56024801 Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-LiveMigrationTest-56024801-project Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: ea114683a3754c8197b61fc5ef04fe0d Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-LiveMigrationTest-56024801-project Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 7ec21f97-4e31-411a-90c9-19c8ad94693f could not be found. Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '7ec21f97-4e31-411a-90c9-19c8ad94693f'} Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec21f97-4e31-411a-90c9-19c8ad94693f could not be found. Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec21f97-4e31-411a-90c9-19c8ad94693f could not be found. Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:42.549849 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:42.553446 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:42.553446 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:42.553446 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:42.553446 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:29:42.553446 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:29:42.553446 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec21f97-4e31-411a-90c9-19c8ad94693f could not be found. Oct 11 04:29:42.553446 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:42.555391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] Returning 404 to user: Instance 7ec21f97-4e31-411a-90c9-19c8ad94693f could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:29:42.556774 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-afa1bac9-2884-4065-bc8d-51f111192475 tempest-LiveMigrationTest-56024801 tempest-LiveMigrationTest-56024801-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f" status: 404 len: 111 microversion: 2.1 time: 0.082769 Oct 11 04:29:42.557847 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2053/4314] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:42 2022] GET /compute/v2.1/servers/7ec21f97-4e31-411a-90c9-19c8ad94693f => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:29:43.365246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8ac69859-9f37-4ecb-a6a8-044f4fa4f4f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:43.365876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8ac69859-9f37-4ecb-a6a8-044f4fa4f4f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:43.379822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ac69859-9f37-4ecb-a6a8-044f4fa4f4f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:43.380970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ac69859-9f37-4ecb-a6a8-044f4fa4f4f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:43.381939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ac69859-9f37-4ecb-a6a8-044f4fa4f4f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:43.384887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ac69859-9f37-4ecb-a6a8-044f4fa4f4f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:43.413801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ac69859-9f37-4ecb-a6a8-044f4fa4f4f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:43.416241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ac69859-9f37-4ecb-a6a8-044f4fa4f4f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:43.517665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:43.518351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:43.528020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:43.528510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:43.528949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:43.529653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:43.530110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:43.530564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:43.619732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:43.648944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:43.650804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:43.652934 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5e12104b-a735-41e5-aa1d-7a6596cc1c25 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1415 microversion: 2.54 time: 0.142928 Oct 11 04:29:43.654867 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2054/4315] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:43 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1415 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:43.677513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8ac69859-9f37-4ecb-a6a8-044f4fa4f4f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:43.693583 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8ac69859-9f37-4ecb-a6a8-044f4fa4f4f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1322 microversion: 2.1 time: 0.333050 Oct 11 04:29:43.694474 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2262/4316] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:43 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1322 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:44.680875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:44.682236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:44.692583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:44.693447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:44.694127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:44.695071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:44.695736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:44.696466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:44.725130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82f13420-b117-49b2-8d6f-438dcf4d4e42 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:44.725768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82f13420-b117-49b2-8d6f-438dcf4d4e42 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:44.736203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82f13420-b117-49b2-8d6f-438dcf4d4e42 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:44.737132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82f13420-b117-49b2-8d6f-438dcf4d4e42 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:44.737752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82f13420-b117-49b2-8d6f-438dcf4d4e42 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:44.738807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82f13420-b117-49b2-8d6f-438dcf4d4e42 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:44.739837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82f13420-b117-49b2-8d6f-438dcf4d4e42 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:44.740437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82f13420-b117-49b2-8d6f-438dcf4d4e42 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:44.773878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:44.783127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:44.785796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:44.787223 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-57608cfd-2212-4cd7-86d7-89bd33754e56 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1415 microversion: 2.54 time: 0.110577 Oct 11 04:29:44.787889 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2055/4317] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:44 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1415 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:45.088399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82f13420-b117-49b2-8d6f-438dcf4d4e42 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:45.097956 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82f13420-b117-49b2-8d6f-438dcf4d4e42 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1516 microversion: 2.1 time: 0.380231 Oct 11 04:29:45.101243 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2263/4318] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:44 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1516 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:45.123088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e450305d-a78f-4cd3-accc-280733a6cf69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:29:45.125866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e450305d-a78f-4cd3-accc-280733a6cf69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:45.139887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e450305d-a78f-4cd3-accc-280733a6cf69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:45.140697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e450305d-a78f-4cd3-accc-280733a6cf69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:45.141464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e450305d-a78f-4cd3-accc-280733a6cf69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:45.143034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e450305d-a78f-4cd3-accc-280733a6cf69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:45.143944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e450305d-a78f-4cd3-accc-280733a6cf69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:45.151071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e450305d-a78f-4cd3-accc-280733a6cf69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:45.180199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-e450305d-a78f-4cd3-accc-280733a6cf69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lazy-loading 'flavor' on Instance uuid 60554e10-db75-4001-ad84-55060fb24729 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:29:45.682629 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e450305d-a78f-4cd3-accc-280733a6cf69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729/action" status: 200 len: 32 microversion: 2.1 time: 0.550973 Oct 11 04:29:45.682629 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2056/4319] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:29:45 2022] POST /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729/action => generated 32 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:29:45.684212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-19f3ae60-09e8-4e87-834b-0312d10149d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:45.684212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-19f3ae60-09e8-4e87-834b-0312d10149d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:45.690176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19f3ae60-09e8-4e87-834b-0312d10149d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:45.692686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19f3ae60-09e8-4e87-834b-0312d10149d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:45.693228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19f3ae60-09e8-4e87-834b-0312d10149d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:45.695377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19f3ae60-09e8-4e87-834b-0312d10149d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:45.695877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19f3ae60-09e8-4e87-834b-0312d10149d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:45.703136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19f3ae60-09e8-4e87-834b-0312d10149d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:45.814696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:45.815603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:45.826630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:45.827122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:45.827569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:45.828276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:45.828734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:45.829160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:46.002747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:46.022315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:46.026719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:46.026719 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-62d0f7dc-cfa0-45e3-981e-023bd1668ad4 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1400 microversion: 2.54 time: 0.215454 Oct 11 04:29:46.041505 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2057/4320] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:45 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1400 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:29:46.059690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1e4009f8-30fc-4a1e-a955-9f2a804a5a1f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '.version_select at 0x7fda19148700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:46.128873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-19f3ae60-09e8-4e87-834b-0312d10149d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:46.139781 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-19f3ae60-09e8-4e87-834b-0312d10149d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.462057 Oct 11 04:29:46.140635 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2264/4321] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:45 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:29:46.182787 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1e4009f8-30fc-4a1e-a955-9f2a804a5a1f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1531716255" status: 204 len: 0 microversion: 2.54 time: 0.127486 Oct 11 04:29:46.183520 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2058/4322] 10.222.0.26 () {60 vars in 1319 bytes} [Tue Oct 11 04:29:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-ServerShowV254Test-keypair-1531716255 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 04:29:46.205441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b05fe784-ba05-419d-bbe3-10e4fe2bd674 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:46.206391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b05fe784-ba05-419d-bbe3-10e4fe2bd674 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:46.218855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b05fe784-ba05-419d-bbe3-10e4fe2bd674 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:46.220564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b05fe784-ba05-419d-bbe3-10e4fe2bd674 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:46.224599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b05fe784-ba05-419d-bbe3-10e4fe2bd674 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:46.225375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b05fe784-ba05-419d-bbe3-10e4fe2bd674 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:46.225855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b05fe784-ba05-419d-bbe3-10e4fe2bd674 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:46.226315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b05fe784-ba05-419d-bbe3-10e4fe2bd674 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:46.270799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:46.284022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b05fe784-ba05-419d-bbe3-10e4fe2bd674 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:29:46.707898 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b05fe784-ba05-419d-bbe3-10e4fe2bd674 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "DELETE /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 204 len: 0 microversion: 2.54 time: 0.506542 Oct 11 04:29:46.712191 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2265/4323] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:29:46 2022] DELETE /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:29:46.719379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:46.720001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:46.732884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:46.737777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:46.740699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:46.740699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:46.741729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:46.742442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:46.908416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:46.915703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:46.917159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:46.922745 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dc4d647e-5d01-4b31-b9c0-ef4b93a0c8e0 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1406 microversion: 2.54 time: 0.208032 Oct 11 04:29:46.926517 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2059/4324] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:46 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1406 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:47.168858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-838b7a60-8546-42e1-a437-13de9387f23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:47.170286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-838b7a60-8546-42e1-a437-13de9387f23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:47.178726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-838b7a60-8546-42e1-a437-13de9387f23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:47.179715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-838b7a60-8546-42e1-a437-13de9387f23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:47.180320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-838b7a60-8546-42e1-a437-13de9387f23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:47.181189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-838b7a60-8546-42e1-a437-13de9387f23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:47.181796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-838b7a60-8546-42e1-a437-13de9387f23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:47.182420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-838b7a60-8546-42e1-a437-13de9387f23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:47.658967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-838b7a60-8546-42e1-a437-13de9387f23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:47.675622 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-838b7a60-8546-42e1-a437-13de9387f23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.510871 Oct 11 04:29:47.679963 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2266/4325] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:47 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:47.959233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:47.960604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:47.989621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:47.990116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:47.990627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:47.991414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:47.991905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:47.992329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:48.081168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:48.092566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:48.094724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:48.096191 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2972683d-6d4e-4fbb-9e4b-3314f635f51f tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1406 microversion: 2.54 time: 0.143263 Oct 11 04:29:48.097265 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2060/4326] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:47 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1406 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:48.702693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4af72cd8-20ef-4eec-8681-11f61441f49d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:48.703314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4af72cd8-20ef-4eec-8681-11f61441f49d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:48.720016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af72cd8-20ef-4eec-8681-11f61441f49d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:48.720756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af72cd8-20ef-4eec-8681-11f61441f49d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:48.723660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af72cd8-20ef-4eec-8681-11f61441f49d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:48.724686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af72cd8-20ef-4eec-8681-11f61441f49d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:48.725305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af72cd8-20ef-4eec-8681-11f61441f49d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:48.727126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4af72cd8-20ef-4eec-8681-11f61441f49d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:48.964111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4af72cd8-20ef-4eec-8681-11f61441f49d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:48.975531 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4af72cd8-20ef-4eec-8681-11f61441f49d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.277142 Oct 11 04:29:48.979366 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2267/4327] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:48 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:49.125954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:49.126926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:49.173893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:49.178491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:49.179240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:49.180231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:49.182394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:49.183431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:49.260402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:49.261127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:49.262351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:49.262956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lazy-loading 'fault' on Instance uuid 440c8903-5fa2-4076-80c4-4ef6d8ab141a {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:29:49.467343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:49.476602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:49.510169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dc777afeb0744fecafe2e1426bbdff44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4360cf130e5d434eb67026b4a204a3cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:49.510169 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bb94166c-35cc-47da-b61c-db7160d06c04 tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 200 len: 1411 microversion: 2.54 time: 0.377331 Oct 11 04:29:49.510169 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2061/4328] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:49 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 1411 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:29:50.003449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b100b357-78b0-4740-80c5-cfebdd51ceed tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:50.004960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b100b357-78b0-4740-80c5-cfebdd51ceed tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:50.018621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b100b357-78b0-4740-80c5-cfebdd51ceed tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:50.020509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b100b357-78b0-4740-80c5-cfebdd51ceed tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:50.022712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b100b357-78b0-4740-80c5-cfebdd51ceed tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:50.023671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b100b357-78b0-4740-80c5-cfebdd51ceed tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:50.025364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b100b357-78b0-4740-80c5-cfebdd51ceed tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:50.026672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b100b357-78b0-4740-80c5-cfebdd51ceed tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:50.335287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b100b357-78b0-4740-80c5-cfebdd51ceed tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:50.350445 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b100b357-78b0-4740-80c5-cfebdd51ceed tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.352201 Oct 11 04:29:50.351223 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2268/4329] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:49 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:50.529501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:50.530698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] [instance: 440c8903-5fa2-4076-80c4-4ef6d8ab141a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:50.546287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:50.552843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:50.554536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:50.557181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:50.559454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:50.560111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:50.601160 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] HTTP exception thrown: Instance 440c8903-5fa2-4076-80c4-4ef6d8ab141a could not be found. Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Request method failure captured: Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a HTTP/1.1 Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPEM6IUjh_X1efWEIU5qaPkRRabAirkK1olUcmCeaL7pFQm_G8TS-Cp14_26fRqBGyXMhwH-OyO3xIdoNLWGf7WQsgiIWWtAAR1n3ZA86Pp-zqEwjUlcA65MTX_u8PI0ZYZ24ansOahTNQqoMbD1RufpjrHWM3XNeYQF8jsr0OfUyxQ Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.54 Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 4360cf130e5d434eb67026b4a204a3cd Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerShowV254Test-695107829 Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4360cf130e5d434eb67026b4a204a3cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4360cf130e5d434eb67026b4a204a3cd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4360cf130e5d434eb67026b4a204a3cd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4360cf130e5d434eb67026b4a204a3cd"}]}] Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerShowV254Test-695107829 Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 4360cf130e5d434eb67026b4a204a3cd Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerShowV254Test-695107829 Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerShowV254Test-695107829-project Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: dc777afeb0744fecafe2e1426bbdff44 Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerShowV254Test-695107829-project Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 440c8903-5fa2-4076-80c4-4ef6d8ab141a could not be found. Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '440c8903-5fa2-4076-80c4-4ef6d8ab141a'} Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 440c8903-5fa2-4076-80c4-4ef6d8ab141a could not be found. Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 440c8903-5fa2-4076-80c4-4ef6d8ab141a could not be found. Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:29:50.603935 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:50.608878 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:29:50.608878 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:29:50.608878 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:29:50.608878 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:29:50.608878 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:29:50.608878 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 440c8903-5fa2-4076-80c4-4ef6d8ab141a could not be found. Oct 11 04:29:50.608878 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:29:50.610672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] Returning 404 to user: Instance 440c8903-5fa2-4076-80c4-4ef6d8ab141a could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:29:50.611797 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d3babf69-9b21-492e-af40-ae23bf90143b tempest-ServerShowV254Test-695107829 tempest-ServerShowV254Test-695107829-project] 10.222.0.26 "GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a" status: 404 len: 111 microversion: 2.54 time: 0.087231 Oct 11 04:29:50.615956 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2062/4330] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:29:50 2022] GET /compute/v2.1/servers/440c8903-5fa2-4076-80c4-4ef6d8ab141a => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:29:51.376932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee5e66ad-01ee-4930-b7cb-7a1f6308e914 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:51.377552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee5e66ad-01ee-4930-b7cb-7a1f6308e914 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:51.387640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee5e66ad-01ee-4930-b7cb-7a1f6308e914 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:51.388797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee5e66ad-01ee-4930-b7cb-7a1f6308e914 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:51.389241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee5e66ad-01ee-4930-b7cb-7a1f6308e914 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:51.394976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee5e66ad-01ee-4930-b7cb-7a1f6308e914 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:51.395675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee5e66ad-01ee-4930-b7cb-7a1f6308e914 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:51.397614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee5e66ad-01ee-4930-b7cb-7a1f6308e914 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:51.888281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee5e66ad-01ee-4930-b7cb-7a1f6308e914 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:51.901612 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee5e66ad-01ee-4930-b7cb-7a1f6308e914 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.527515 Oct 11 04:29:51.901612 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2269/4331] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:51 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:52.928430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-91ef682d-c0ae-4cef-a130-413575ac6a2f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:52.939323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-91ef682d-c0ae-4cef-a130-413575ac6a2f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:52.948596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=2,nova_api:UPDATE=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:52.952915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ef682d-c0ae-4cef-a130-413575ac6a2f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:52.954901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ef682d-c0ae-4cef-a130-413575ac6a2f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:52.955709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ef682d-c0ae-4cef-a130-413575ac6a2f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:52.958431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ef682d-c0ae-4cef-a130-413575ac6a2f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:52.961551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ef682d-c0ae-4cef-a130-413575ac6a2f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:52.963555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ef682d-c0ae-4cef-a130-413575ac6a2f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:53.309665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-91ef682d-c0ae-4cef-a130-413575ac6a2f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:53.337765 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-91ef682d-c0ae-4cef-a130-413575ac6a2f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.413096 Oct 11 04:29:53.350327 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2063/4332] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:52 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:54.368592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-931a03fd-dae4-45e7-8675-fbb32ca2360b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:54.369212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-931a03fd-dae4-45e7-8675-fbb32ca2360b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:54.378216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-931a03fd-dae4-45e7-8675-fbb32ca2360b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:54.378711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-931a03fd-dae4-45e7-8675-fbb32ca2360b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:54.379472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-931a03fd-dae4-45e7-8675-fbb32ca2360b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:54.380203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-931a03fd-dae4-45e7-8675-fbb32ca2360b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:54.380640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-931a03fd-dae4-45e7-8675-fbb32ca2360b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:54.381066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-931a03fd-dae4-45e7-8675-fbb32ca2360b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:54.945741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-931a03fd-dae4-45e7-8675-fbb32ca2360b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:54.954086 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-931a03fd-dae4-45e7-8675-fbb32ca2360b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.589420 Oct 11 04:29:54.957664 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2270/4333] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:54 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:55.988953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8e18357-55f3-4cce-baeb-7c93cc5e6e0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:55.989809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8e18357-55f3-4cce-baeb-7c93cc5e6e0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:56.010457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8e18357-55f3-4cce-baeb-7c93cc5e6e0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:56.011197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8e18357-55f3-4cce-baeb-7c93cc5e6e0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:56.012595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8e18357-55f3-4cce-baeb-7c93cc5e6e0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:56.013637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8e18357-55f3-4cce-baeb-7c93cc5e6e0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:56.026468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8e18357-55f3-4cce-baeb-7c93cc5e6e0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:56.029032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8e18357-55f3-4cce-baeb-7c93cc5e6e0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:56.459780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8e18357-55f3-4cce-baeb-7c93cc5e6e0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:56.473474 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e8e18357-55f3-4cce-baeb-7c93cc5e6e0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.491922 Oct 11 04:29:56.477857 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2064/4334] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:55 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:57.495565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e410b1fd-7209-40a9-81dc-99a9ba8825c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:57.496478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e410b1fd-7209-40a9-81dc-99a9ba8825c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:57.524709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e410b1fd-7209-40a9-81dc-99a9ba8825c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:57.525294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e410b1fd-7209-40a9-81dc-99a9ba8825c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:57.535065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e410b1fd-7209-40a9-81dc-99a9ba8825c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:57.540354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e410b1fd-7209-40a9-81dc-99a9ba8825c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:57.540354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e410b1fd-7209-40a9-81dc-99a9ba8825c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:57.540354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e410b1fd-7209-40a9-81dc-99a9ba8825c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:58.326442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e410b1fd-7209-40a9-81dc-99a9ba8825c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:58.341792 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e410b1fd-7209-40a9-81dc-99a9ba8825c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.846050 Oct 11 04:29:58.342926 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2271/4335] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:57 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:59.203184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8cdf645-d79f-4a9e-b0ea-fd01ed53f0cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:59.204000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8cdf645-d79f-4a9e-b0ea-fd01ed53f0cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:59.217516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8cdf645-d79f-4a9e-b0ea-fd01ed53f0cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:59.220638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8cdf645-d79f-4a9e-b0ea-fd01ed53f0cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:59.221187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8cdf645-d79f-4a9e-b0ea-fd01ed53f0cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:59.223512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8cdf645-d79f-4a9e-b0ea-fd01ed53f0cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:59.224665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8cdf645-d79f-4a9e-b0ea-fd01ed53f0cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:59.226152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8cdf645-d79f-4a9e-b0ea-fd01ed53f0cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:59.268392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:29:59.371445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cf797ca1-0df3-414c-aaeb-db62a5378a87 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:59.373455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cf797ca1-0df3-414c-aaeb-db62a5378a87 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:59.388509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf797ca1-0df3-414c-aaeb-db62a5378a87 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:59.389006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf797ca1-0df3-414c-aaeb-db62a5378a87 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:59.389452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf797ca1-0df3-414c-aaeb-db62a5378a87 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:59.395996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf797ca1-0df3-414c-aaeb-db62a5378a87 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:59.396807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf797ca1-0df3-414c-aaeb-db62a5378a87 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:59.397422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf797ca1-0df3-414c-aaeb-db62a5378a87 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:59.699444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8cdf645-d79f-4a9e-b0ea-fd01ed53f0cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:59.709824 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e8cdf645-d79f-4a9e-b0ea-fd01ed53f0cd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.511497 Oct 11 04:29:59.718251 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2065/4336] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:59 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:59.756106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cf797ca1-0df3-414c-aaeb-db62a5378a87 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:29:59.768214 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cf797ca1-0df3-414c-aaeb-db62a5378a87 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.401446 Oct 11 04:29:59.772797 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2272/4337] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:59 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:29:59.794546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-be573e9f-d417-4847-9db0-5f84c25ed6f1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:29:59.795402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-be573e9f-d417-4847-9db0-5f84c25ed6f1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:29:59.813769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be573e9f-d417-4847-9db0-5f84c25ed6f1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:59.817504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be573e9f-d417-4847-9db0-5f84c25ed6f1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:59.817504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be573e9f-d417-4847-9db0-5f84c25ed6f1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:29:59.817504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be573e9f-d417-4847-9db0-5f84c25ed6f1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:29:59.817504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be573e9f-d417-4847-9db0-5f84c25ed6f1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:29:59.817504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be573e9f-d417-4847-9db0-5f84c25ed6f1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:00.045386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerAddressesNegativeTestJSON-server-585379049", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "176a1a02-12f3-4a5f-900c-a24224dc8191"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:00.123853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be573e9f-d417-4847-9db0-5f84c25ed6f1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:00.183944 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-be573e9f-d417-4847-9db0-5f84c25ed6f1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.409834 Oct 11 04:30:00.184986 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2273/4338] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:29:59 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:00.192756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] validate_networks() for [('176a1a02-12f3-4a5f-900c-a24224dc8191', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:30:00.207763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-472f831d-e0b1-43a0-871a-fe8f97bb642e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:00.208898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-472f831d-e0b1-43a0-871a-fe8f97bb642e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:00.220310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472f831d-e0b1-43a0-871a-fe8f97bb642e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:00.223302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472f831d-e0b1-43a0-871a-fe8f97bb642e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:00.226620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472f831d-e0b1-43a0-871a-fe8f97bb642e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:00.227595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472f831d-e0b1-43a0-871a-fe8f97bb642e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:00.235343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472f831d-e0b1-43a0-871a-fe8f97bb642e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:00.236029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472f831d-e0b1-43a0-871a-fe8f97bb642e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:00.704211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-472f831d-e0b1-43a0-871a-fe8f97bb642e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:00.720752 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-472f831d-e0b1-43a0-871a-fe8f97bb642e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.515349 Oct 11 04:30:00.721625 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2274/4339] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:00 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:00.758129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a6c9598a-97e8-48c9-bda6-9ab3c472f683 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:00.759317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a6c9598a-97e8-48c9-bda6-9ab3c472f683 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:00.771746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6c9598a-97e8-48c9-bda6-9ab3c472f683 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:00.772482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6c9598a-97e8-48c9-bda6-9ab3c472f683 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:00.774610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6c9598a-97e8-48c9-bda6-9ab3c472f683 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:00.774610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6c9598a-97e8-48c9-bda6-9ab3c472f683 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:00.775343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6c9598a-97e8-48c9-bda6-9ab3c472f683 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:00.777777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6c9598a-97e8-48c9-bda6-9ab3c472f683 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:01.067538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a6c9598a-97e8-48c9-bda6-9ab3c472f683 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:01.078733 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a6c9598a-97e8-48c9-bda6-9ab3c472f683 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.327166 Oct 11 04:30:01.080383 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2275/4340] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:00 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:01.087321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff6d011c-d0ce-41a9-909b-8ace19d9288b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:01.088073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ff6d011c-d0ce-41a9-909b-8ace19d9288b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:01.094904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff6d011c-d0ce-41a9-909b-8ace19d9288b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:01.095693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff6d011c-d0ce-41a9-909b-8ace19d9288b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:01.096246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff6d011c-d0ce-41a9-909b-8ace19d9288b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:01.097286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff6d011c-d0ce-41a9-909b-8ace19d9288b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:01.097912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff6d011c-d0ce-41a9-909b-8ace19d9288b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:01.098515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff6d011c-d0ce-41a9-909b-8ace19d9288b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:01.300285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ff6d011c-d0ce-41a9-909b-8ace19d9288b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:01.312601 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff6d011c-d0ce-41a9-909b-8ace19d9288b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.230840 Oct 11 04:30:01.324497 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2276/4341] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:01 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:01.336935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-379035403", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "30252624-67f7-4bbb-9346-39722e0301e1"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:01.428431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] validate_networks() for [('30252624-67f7-4bbb-9346-39722e0301e1', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:30:01.944511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:30:01.945049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:30:01.945438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:30:01.945848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:30:01.946288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:30:01.960769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:01.961272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:01.962603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:01.964792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:01.965412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:01.967404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:02.035843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Getting quotas for project 6d32830b844346fc9ae21fe93340e543. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:30:02.053709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Getting quotas for user 2c40cc9968244c0fb6c81301e775b17e and project 6d32830b844346fc9ae21fe93340e543. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:30:02.088399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:30:02.093442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:30:02.197936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:30:02.199610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:30:02.200434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:30:02.201049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:30:02.201649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:30:02.212448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:02.213221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:02.213845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:02.214846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:02.223586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:02.228605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:02.265418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for project 9a2974866e964ca2864c978d2270bd77. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:30:02.278311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for user 5feceb4a60434064a4fd08f7cc637f32 and project 9a2974866e964ca2864c978d2270bd77. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:30:02.325279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:30:02.331661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:30:02.366930 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6a5852f3-046e-4277-8d7c-07a36a324023 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.650764 Oct 11 04:30:02.367940 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2066/4342] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:29:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2652 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:30:02.372960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-23b27daf-a721-4916-a0ea-42e66c756706 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:02.373953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-23b27daf-a721-4916-a0ea-42e66c756706 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:02.380383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b27daf-a721-4916-a0ea-42e66c756706 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:02.381166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b27daf-a721-4916-a0ea-42e66c756706 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:02.381825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b27daf-a721-4916-a0ea-42e66c756706 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:02.383238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b27daf-a721-4916-a0ea-42e66c756706 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:02.384370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b27daf-a721-4916-a0ea-42e66c756706 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:02.385140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23b27daf-a721-4916-a0ea-42e66c756706 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:02.415667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:02.555093 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a46ab9e2-3828-4c1c-b515-1506d1059663 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.228974 Oct 11 04:30:02.555916 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2277/4343] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:30:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 1231 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:30:02.562734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-abdcd300-17c6-4598-a9fa-a7fb20950139 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:02.563361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-abdcd300-17c6-4598-a9fa-a7fb20950139 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:02.720545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-abdcd300-17c6-4598-a9fa-a7fb20950139 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:02.738366 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-abdcd300-17c6-4598-a9fa-a7fb20950139 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1224 microversion: 2.1 time: 0.170768 Oct 11 04:30:02.738366 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2278/4344] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:02 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1224 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:02.738761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-23b27daf-a721-4916-a0ea-42e66c756706 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:02.738851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f6def3c-cdb9-43cb-a81b-f45b8142352e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:02.739746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f6def3c-cdb9-43cb-a81b-f45b8142352e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:02.751167 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-23b27daf-a721-4916-a0ea-42e66c756706 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.381799 Oct 11 04:30:02.751760 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2067/4345] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:02 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:02.830955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f6def3c-cdb9-43cb-a81b-f45b8142352e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:02.838113 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f6def3c-cdb9-43cb-a81b-f45b8142352e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1214 microversion: 2.1 time: 0.103951 Oct 11 04:30:02.841292 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2279/4346] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:02 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1214 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:03.758262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2c59af48-75f2-45b3-ad9e-19353ff66bb3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:03.759759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2c59af48-75f2-45b3-ad9e-19353ff66bb3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:03.782849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b1fc57f-9115-439a-8da4-5d315874c0b3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:03.784439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b1fc57f-9115-439a-8da4-5d315874c0b3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:03.797660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1fc57f-9115-439a-8da4-5d315874c0b3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:03.799683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1fc57f-9115-439a-8da4-5d315874c0b3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:03.800469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1fc57f-9115-439a-8da4-5d315874c0b3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:03.802771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1fc57f-9115-439a-8da4-5d315874c0b3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:03.803451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1fc57f-9115-439a-8da4-5d315874c0b3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:03.805585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1fc57f-9115-439a-8da4-5d315874c0b3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:03.993442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c59af48-75f2-45b3-ad9e-19353ff66bb3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:04.010759 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2c59af48-75f2-45b3-ad9e-19353ff66bb3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1224 microversion: 2.1 time: 0.250930 Oct 11 04:30:04.026689 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2068/4347] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:03 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1224 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:30:04.052156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-28c48865-64fe-4a8a-95b0-6d05e5334627 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:04.052958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-28c48865-64fe-4a8a-95b0-6d05e5334627 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:04.069511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c48865-64fe-4a8a-95b0-6d05e5334627 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:04.071527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c48865-64fe-4a8a-95b0-6d05e5334627 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:04.074681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c48865-64fe-4a8a-95b0-6d05e5334627 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:04.075662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c48865-64fe-4a8a-95b0-6d05e5334627 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:04.076454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c48865-64fe-4a8a-95b0-6d05e5334627 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:04.077304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c48865-64fe-4a8a-95b0-6d05e5334627 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:04.189284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b1fc57f-9115-439a-8da4-5d315874c0b3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:04.200197 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b1fc57f-9115-439a-8da4-5d315874c0b3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.424582 Oct 11 04:30:04.206710 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2280/4348] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:03 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:04.230407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-28c48865-64fe-4a8a-95b0-6d05e5334627 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:04.243055 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-28c48865-64fe-4a8a-95b0-6d05e5334627 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1218 microversion: 2.1 time: 0.209013 Oct 11 04:30:04.260217 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2069/4349] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:04 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1218 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:05.041834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-73546063-6f3a-4657-90a8-ae8ef77d492c tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:05.046110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-73546063-6f3a-4657-90a8-ae8ef77d492c tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:05.060983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73546063-6f3a-4657-90a8-ae8ef77d492c tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:05.063478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73546063-6f3a-4657-90a8-ae8ef77d492c tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:05.064200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73546063-6f3a-4657-90a8-ae8ef77d492c tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:05.072963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73546063-6f3a-4657-90a8-ae8ef77d492c tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:05.072963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73546063-6f3a-4657-90a8-ae8ef77d492c tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:05.072963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73546063-6f3a-4657-90a8-ae8ef77d492c tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:05.202625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-73546063-6f3a-4657-90a8-ae8ef77d492c tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:05.210908 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-73546063-6f3a-4657-90a8-ae8ef77d492c tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1220 microversion: 2.1 time: 0.174309 Oct 11 04:30:05.215566 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2281/4350] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:05 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1220 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:05.229052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4c0edfa2-c3a8-4599-842f-9372a6779e63 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:05.229715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4c0edfa2-c3a8-4599-842f-9372a6779e63 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:05.248209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c0edfa2-c3a8-4599-842f-9372a6779e63 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:05.249943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c0edfa2-c3a8-4599-842f-9372a6779e63 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:05.250628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c0edfa2-c3a8-4599-842f-9372a6779e63 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:05.253156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c0edfa2-c3a8-4599-842f-9372a6779e63 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:05.256777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c0edfa2-c3a8-4599-842f-9372a6779e63 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:05.257775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c0edfa2-c3a8-4599-842f-9372a6779e63 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:05.270204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3c6c5c7c-399d-4e65-ba30-c37ee57d6e49 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:05.271075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3c6c5c7c-399d-4e65-ba30-c37ee57d6e49 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:05.283067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c5c7c-399d-4e65-ba30-c37ee57d6e49 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:05.284719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c5c7c-399d-4e65-ba30-c37ee57d6e49 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:05.289312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c5c7c-399d-4e65-ba30-c37ee57d6e49 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:05.290592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c5c7c-399d-4e65-ba30-c37ee57d6e49 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:05.291136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c5c7c-399d-4e65-ba30-c37ee57d6e49 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:05.291515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c5c7c-399d-4e65-ba30-c37ee57d6e49 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:05.435526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3c6c5c7c-399d-4e65-ba30-c37ee57d6e49 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:05.460492 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3c6c5c7c-399d-4e65-ba30-c37ee57d6e49 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1266 microversion: 2.1 time: 0.193056 Oct 11 04:30:05.461289 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2282/4351] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:05 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:05.528638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4c0edfa2-c3a8-4599-842f-9372a6779e63 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:05.554437 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4c0edfa2-c3a8-4599-842f-9372a6779e63 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.329039 Oct 11 04:30:05.555616 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2070/4352] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:05 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:06.244967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ffa82930-17a2-4218-899a-c8508b0190e6 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:06.245612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ffa82930-17a2-4218-899a-c8508b0190e6 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:06.261628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffa82930-17a2-4218-899a-c8508b0190e6 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:06.262381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffa82930-17a2-4218-899a-c8508b0190e6 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:06.270743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffa82930-17a2-4218-899a-c8508b0190e6 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:06.270743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffa82930-17a2-4218-899a-c8508b0190e6 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:06.270743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffa82930-17a2-4218-899a-c8508b0190e6 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:06.270743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffa82930-17a2-4218-899a-c8508b0190e6 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:06.273473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:06.438151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ffa82930-17a2-4218-899a-c8508b0190e6 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:06.456285 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ffa82930-17a2-4218-899a-c8508b0190e6 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1276 microversion: 2.1 time: 0.214966 Oct 11 04:30:06.458744 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2283/4353] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:06 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1276 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:06.486292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-34c4cb39-1c39-4e67-a50f-b43abc52e16d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:06.486917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-34c4cb39-1c39-4e67-a50f-b43abc52e16d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:06.498820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34c4cb39-1c39-4e67-a50f-b43abc52e16d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:06.499324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34c4cb39-1c39-4e67-a50f-b43abc52e16d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:06.499761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34c4cb39-1c39-4e67-a50f-b43abc52e16d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:06.500539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34c4cb39-1c39-4e67-a50f-b43abc52e16d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:06.500905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34c4cb39-1c39-4e67-a50f-b43abc52e16d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:06.501331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34c4cb39-1c39-4e67-a50f-b43abc52e16d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:06.591835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d1ecb39d-55af-45f4-afe4-9d7ccb7a99e9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:06.592604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d1ecb39d-55af-45f4-afe4-9d7ccb7a99e9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:06.608096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1ecb39d-55af-45f4-afe4-9d7ccb7a99e9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:06.620319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1ecb39d-55af-45f4-afe4-9d7ccb7a99e9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:06.631843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1ecb39d-55af-45f4-afe4-9d7ccb7a99e9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:06.634494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1ecb39d-55af-45f4-afe4-9d7ccb7a99e9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:06.634995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1ecb39d-55af-45f4-afe4-9d7ccb7a99e9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:06.638073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1ecb39d-55af-45f4-afe4-9d7ccb7a99e9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:06.647137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-34c4cb39-1c39-4e67-a50f-b43abc52e16d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:06.655779 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-34c4cb39-1c39-4e67-a50f-b43abc52e16d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1272 microversion: 2.1 time: 0.175714 Oct 11 04:30:06.669485 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2071/4354] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:06 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1272 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:07.327322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d1ecb39d-55af-45f4-afe4-9d7ccb7a99e9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:07.340493 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d1ecb39d-55af-45f4-afe4-9d7ccb7a99e9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1522 microversion: 2.1 time: 0.753166 Oct 11 04:30:07.345047 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2284/4355] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:06 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1522 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:07.479355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:07.480425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:07.490180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:07.498145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:07.498888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:07.501106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:07.501535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-212b95fc-1a9b-4740-b2d4-e9674e940fb0 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Calling method '.version_select at 0x7fda19148670>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:07.502325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:07.511629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:07.648240 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-212b95fc-1a9b-4740-b2d4-e9674e940fb0 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/9c5dfa5d2eed420cbbe4606f8bab0918" status: 200 len: 371 microversion: 2.1 time: 0.361097 Oct 11 04:30:07.649544 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2072/4356] 10.222.0.26 () {58 vars in 1242 bytes} [Tue Oct 11 04:30:07 2022] GET /compute/v2.1/os-quota-sets/9c5dfa5d2eed420cbbe4606f8bab0918 => generated 371 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:07.662168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-56965922-c9ae-4fda-bba7-9e61d8ad864c tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Action: 'update', calling method: .version_select at 0x7fda19ab8310>, body: {"quota_set": {"ram": "5120"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:07.781656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56965922-c9ae-4fda-bba7-9e61d8ad864c tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:07.787341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56965922-c9ae-4fda-bba7-9e61d8ad864c tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:07.787976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56965922-c9ae-4fda-bba7-9e61d8ad864c tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:07.789043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56965922-c9ae-4fda-bba7-9e61d8ad864c tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:07.789682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56965922-c9ae-4fda-bba7-9e61d8ad864c tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:07.793464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56965922-c9ae-4fda-bba7-9e61d8ad864c tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:07.966658 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-56965922-c9ae-4fda-bba7-9e61d8ad864c tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/9c5dfa5d2eed420cbbe4606f8bab0918" status: 200 len: 328 microversion: 2.1 time: 0.308299 Oct 11 04:30:07.967282 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2073/4357] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 11 04:30:07 2022] PUT /compute/v2.1/os-quota-sets/9c5dfa5d2eed420cbbe4606f8bab0918 => generated 328 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:30:07.972364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-004a7aec-6a44-4537-b846-f9ec1caca7d7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:07.973034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-004a7aec-6a44-4537-b846-f9ec1caca7d7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:07.980055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004a7aec-6a44-4537-b846-f9ec1caca7d7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:07.980569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004a7aec-6a44-4537-b846-f9ec1caca7d7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:07.981014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004a7aec-6a44-4537-b846-f9ec1caca7d7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:07.981717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004a7aec-6a44-4537-b846-f9ec1caca7d7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:07.982145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004a7aec-6a44-4537-b846-f9ec1caca7d7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:07.982593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004a7aec-6a44-4537-b846-f9ec1caca7d7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:08.099095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:08.110702 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1294 microversion: 2.1 time: 0.635285 Oct 11 04:30:08.111314 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2285/4358] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:07 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1294 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:08.112264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:08.113164 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-38335f07-883c-4b27-9985-e7ad2389e592 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001065 Oct 11 04:30:08.113495 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2286/4359] 10.222.0.26 () {56 vars in 886 bytes} [Tue Oct 11 04:30:08 2022] GET /compute/ => generated 377 bytes in 2 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 04:30:08.124290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db8d6599-33ba-404e-a490-28ad70dad459 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:08.203626 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-db8d6599-33ba-404e-a490-28ad70dad459 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-quota-sets/9c5dfa5d2eed420cbbe4606f8bab0918" status: 202 len: 0 microversion: 2.1 time: 0.088890 Oct 11 04:30:08.204512 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2287/4360] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:30:08 2022] DELETE /compute/v2.1/os-quota-sets/9c5dfa5d2eed420cbbe4606f8bab0918 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:30:08.213072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1217b4f1-f2d4-4b58-907f-08fbb7263b5d tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Calling method '.version_select at 0x7fda1a50ef70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:08.367217 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1217b4f1-f2d4-4b58-907f-08fbb7263b5d tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/9c5dfa5d2eed420cbbe4606f8bab0918" status: 200 len: 371 microversion: 2.1 time: 0.158226 Oct 11 04:30:08.377251 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2288/4361] 10.222.0.26 () {58 vars in 1242 bytes} [Tue Oct 11 04:30:08 2022] GET /compute/v2.1/os-quota-sets/9c5dfa5d2eed420cbbe4606f8bab0918 => generated 371 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:08.387211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a4c49f30-a91f-4fd3-95ff-e3a8117aaf3f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:08.388883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a4c49f30-a91f-4fd3-95ff-e3a8117aaf3f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:08.398416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c49f30-a91f-4fd3-95ff-e3a8117aaf3f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:08.400588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c49f30-a91f-4fd3-95ff-e3a8117aaf3f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:08.402400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c49f30-a91f-4fd3-95ff-e3a8117aaf3f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:08.404002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c49f30-a91f-4fd3-95ff-e3a8117aaf3f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:08.404789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c49f30-a91f-4fd3-95ff-e3a8117aaf3f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:08.406127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4c49f30-a91f-4fd3-95ff-e3a8117aaf3f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:08.718011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a4c49f30-a91f-4fd3-95ff-e3a8117aaf3f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:08.730426 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a4c49f30-a91f-4fd3-95ff-e3a8117aaf3f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1502 microversion: 2.1 time: 0.348752 Oct 11 04:30:08.731964 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2289/4362] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:08 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1502 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:08.737712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-004a7aec-6a44-4537-b846-f9ec1caca7d7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:08.759475 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-004a7aec-6a44-4537-b846-f9ec1caca7d7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1314 microversion: 2.1 time: 0.790785 Oct 11 04:30:08.764731 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2074/4363] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:07 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1314 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:08.769879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d64d4cd-48bc-4161-ae7f-a9ed3cc9f6ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:08.773055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d64d4cd-48bc-4161-ae7f-a9ed3cc9f6ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:08.793491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-502878f6-341b-43b0-afc5-a2a1a551d0c9 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Calling method '.version_select at 0x7fda191f5d30>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:08.810778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d64d4cd-48bc-4161-ae7f-a9ed3cc9f6ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:08.815421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d64d4cd-48bc-4161-ae7f-a9ed3cc9f6ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:08.818336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d64d4cd-48bc-4161-ae7f-a9ed3cc9f6ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:08.818336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d64d4cd-48bc-4161-ae7f-a9ed3cc9f6ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:08.818336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d64d4cd-48bc-4161-ae7f-a9ed3cc9f6ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:08.829741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d64d4cd-48bc-4161-ae7f-a9ed3cc9f6ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:09.089897 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-502878f6-341b-43b0-afc5-a2a1a551d0c9 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/7e43e05d952d4d0cb680073c3ce706df/defaults" status: 200 len: 371 microversion: 2.1 time: 0.303877 Oct 11 04:30:09.099495 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2075/4364] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:30:08 2022] GET /compute/v2.1/os-quota-sets/7e43e05d952d4d0cb680073c3ce706df/defaults => generated 371 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:09.141537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4c1128ee-fe37-4662-b617-bf5513b14fd2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:09.142351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4c1128ee-fe37-4662-b617-bf5513b14fd2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:09.155800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c1128ee-fe37-4662-b617-bf5513b14fd2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:09.157484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c1128ee-fe37-4662-b617-bf5513b14fd2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:09.158658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c1128ee-fe37-4662-b617-bf5513b14fd2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:09.163046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c1128ee-fe37-4662-b617-bf5513b14fd2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:09.163925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c1128ee-fe37-4662-b617-bf5513b14fd2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:09.165487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c1128ee-fe37-4662-b617-bf5513b14fd2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:09.274372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d64d4cd-48bc-4161-ae7f-a9ed3cc9f6ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:09.281261 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d64d4cd-48bc-4161-ae7f-a9ed3cc9f6ba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1515 microversion: 2.1 time: 0.526542 Oct 11 04:30:09.282422 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2290/4365] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:08 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1515 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:09.307489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e7daf709-7c54-4996-9cc5-442823b398b5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:09.310762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e7daf709-7c54-4996-9cc5-442823b398b5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 831244ce-bc86-4a82-875f-446dcf434f6d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:09.317178 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e7daf709-7c54-4996-9cc5-442823b398b5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] HTTP exception thrown: Instance 831244ce-bc86-4a82-875f-446dcf434f6d could not be found. Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e7daf709-7c54-4996-9cc5-442823b398b5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Request method failure captured: Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/831244ce-bc86-4a82-875f-446dcf434f6d/action HTTP/1.1 Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 14 Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPEasekUZLINQ5CZWJXkMppFiFyiPz0x7d4djdvUd-asoF16cTMXmitsW8Jw6-L4ZC10T49kVSd5NZJD7qmV4ktBS-qpfyACuQOEHpQR5BigmL06KMooK58zyWV0xifCb_yIKtS4zKCvAts6lZk9Fe5iF-Yw7nZw-Mdv0pFYP_e1eeY Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75ee1246b11f4fb286baf525614515c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}] Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 820b6b6b001a46a2abd3415de0b5f29b Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: {"rescue": {}} Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 831244ce-bc86-4a82-875f-446dcf434f6d could not be found. Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '831244ce-bc86-4a82-875f-446dcf434f6d', 'body': {'rescue': {}}} Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831244ce-bc86-4a82-875f-446dcf434f6d could not be found. Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 53, in _rescue Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831244ce-bc86-4a82-875f-446dcf434f6d could not be found. Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:09.323330 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:09.330034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:09.330034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:09.330034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:30:09.330034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:30:09.330034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831244ce-bc86-4a82-875f-446dcf434f6d could not be found. Oct 11 04:30:09.330034 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:09.330034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e7daf709-7c54-4996-9cc5-442823b398b5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Returning 404 to user: Instance 831244ce-bc86-4a82-875f-446dcf434f6d could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:30:09.330034 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e7daf709-7c54-4996-9cc5-442823b398b5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/831244ce-bc86-4a82-875f-446dcf434f6d/action" status: 404 len: 111 microversion: 2.1 time: 0.024405 Oct 11 04:30:09.330034 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2291/4366] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:09 2022] POST /compute/v2.1/servers/831244ce-bc86-4a82-875f-446dcf434f6d/action => generated 111 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:30:09.337725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b6d42e65-6013-4317-b595-e8f50df3673c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:09.338531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b6d42e65-6013-4317-b595-e8f50df3673c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:09.349304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6d42e65-6013-4317-b595-e8f50df3673c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:09.349822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6d42e65-6013-4317-b595-e8f50df3673c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:09.350300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6d42e65-6013-4317-b595-e8f50df3673c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:09.351013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6d42e65-6013-4317-b595-e8f50df3673c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:09.351469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6d42e65-6013-4317-b595-e8f50df3673c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:09.351898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6d42e65-6013-4317-b595-e8f50df3673c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:09.382365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4c1128ee-fe37-4662-b617-bf5513b14fd2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:09.393586 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4c1128ee-fe37-4662-b617-bf5513b14fd2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1282 microversion: 2.1 time: 0.256926 Oct 11 04:30:09.394802 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2076/4367] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:09 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1282 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:09.596510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1a3734d4-2504-4362-920b-9989e74a0e23 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Action: 'update', calling method: .version_select at 0x7fda191d3700>, body: {"quota_set": {"ram": "5120"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:09.671677 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b6d42e65-6013-4317-b595-e8f50df3673c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/action" status: 202 len: 0 microversion: 2.1 time: 0.338299 Oct 11 04:30:09.675399 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2292/4368] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:09 2022] POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/action => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:30:09.684539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ed2407a-3ae1-458e-8c04-6a046544a08f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:09.685248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4ed2407a-3ae1-458e-8c04-6a046544a08f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:09.707673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed2407a-3ae1-458e-8c04-6a046544a08f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:09.709206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed2407a-3ae1-458e-8c04-6a046544a08f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:09.709876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed2407a-3ae1-458e-8c04-6a046544a08f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:09.712593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed2407a-3ae1-458e-8c04-6a046544a08f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:09.714848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed2407a-3ae1-458e-8c04-6a046544a08f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:09.715643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed2407a-3ae1-458e-8c04-6a046544a08f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:09.795847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a3734d4-2504-4362-920b-9989e74a0e23 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:09.801508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a3734d4-2504-4362-920b-9989e74a0e23 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:09.801508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a3734d4-2504-4362-920b-9989e74a0e23 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:09.801508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a3734d4-2504-4362-920b-9989e74a0e23 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:09.801508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a3734d4-2504-4362-920b-9989e74a0e23 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:09.801508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a3734d4-2504-4362-920b-9989e74a0e23 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:09.953341 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1a3734d4-2504-4362-920b-9989e74a0e23 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/e78058a107384e9c93a760a5a6ee6134" status: 200 len: 328 microversion: 2.1 time: 0.360550 Oct 11 04:30:09.976439 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2077/4369] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 11 04:30:09 2022] PUT /compute/v2.1/os-quota-sets/e78058a107384e9c93a760a5a6ee6134 => generated 328 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:30:10.019130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ccfc18ec-7cdd-40b9-a007-73c25e0dd7b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:10.020157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ccfc18ec-7cdd-40b9-a007-73c25e0dd7b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:10.029048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccfc18ec-7cdd-40b9-a007-73c25e0dd7b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:10.029553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccfc18ec-7cdd-40b9-a007-73c25e0dd7b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:10.029994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccfc18ec-7cdd-40b9-a007-73c25e0dd7b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:10.031049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccfc18ec-7cdd-40b9-a007-73c25e0dd7b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:10.032787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccfc18ec-7cdd-40b9-a007-73c25e0dd7b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:10.033240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccfc18ec-7cdd-40b9-a007-73c25e0dd7b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:10.052643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ed2407a-3ae1-458e-8c04-6a046544a08f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:10.065315 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ed2407a-3ae1-458e-8c04-6a046544a08f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1520 microversion: 2.1 time: 0.385153 Oct 11 04:30:10.066330 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2293/4370] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:09 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:10.085180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1cab19d5-b9b8-49dc-a481-ebc677ad7d38 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Calling method '.version_select at 0x7fda193e0040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:10.221137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cab19d5-b9b8-49dc-a481-ebc677ad7d38 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:10.222233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cab19d5-b9b8-49dc-a481-ebc677ad7d38 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:10.222826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cab19d5-b9b8-49dc-a481-ebc677ad7d38 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:10.224313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cab19d5-b9b8-49dc-a481-ebc677ad7d38 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:10.224937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cab19d5-b9b8-49dc-a481-ebc677ad7d38 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:10.225517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cab19d5-b9b8-49dc-a481-ebc677ad7d38 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:10.258598 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1cab19d5-b9b8-49dc-a481-ebc677ad7d38 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/e78058a107384e9c93a760a5a6ee6134/detail" status: 200 len: 916 microversion: 2.1 time: 0.190973 Oct 11 04:30:10.259474 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2294/4371] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:30:10 2022] GET /compute/v2.1/os-quota-sets/e78058a107384e9c93a760a5a6ee6134/detail => generated 916 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:10.363168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ccfc18ec-7cdd-40b9-a007-73c25e0dd7b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:10.388053 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ccfc18ec-7cdd-40b9-a007-73c25e0dd7b6 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1314 microversion: 2.1 time: 0.410032 Oct 11 04:30:10.388761 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2078/4372] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:09 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:10.443274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2d70d1d-440f-4d1e-9a39-19d9e031f97b tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:10.443274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b2d70d1d-440f-4d1e-9a39-19d9e031f97b tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:10.443274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d70d1d-440f-4d1e-9a39-19d9e031f97b tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:10.443274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d70d1d-440f-4d1e-9a39-19d9e031f97b tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:10.443274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d70d1d-440f-4d1e-9a39-19d9e031f97b tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:10.443274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d70d1d-440f-4d1e-9a39-19d9e031f97b tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:10.443274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d70d1d-440f-4d1e-9a39-19d9e031f97b tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:10.444467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2d70d1d-440f-4d1e-9a39-19d9e031f97b tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:10.641050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Action: 'update', calling method: .version_select at 0x7fda191d3040>, body: {"quota_set": {"ram": "2048"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:10.670998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b2d70d1d-440f-4d1e-9a39-19d9e031f97b tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:10.681926 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2d70d1d-440f-4d1e-9a39-19d9e031f97b tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1324 microversion: 2.1 time: 0.264730 Oct 11 04:30:10.683688 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2295/4373] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:10 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1324 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:10.721626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:10.722263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:10.722848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:10.723643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:10.724417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:10.724920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:10.770066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:10.770584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:10.771013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:10.771826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:10.772335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:10.772759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:10.909470 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e86966a1-33ea-457f-9055-b782bf8f94e6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/e78058a107384e9c93a760a5a6ee6134?user_id=324f819cd55944169282631fd43f7c41" status: 200 len: 328 microversion: 2.1 time: 0.273312 Oct 11 04:30:10.918029 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2079/4374] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:30:10 2022] PUT /compute/v2.1/os-quota-sets/e78058a107384e9c93a760a5a6ee6134?user_id=324f819cd55944169282631fd43f7c41 => generated 328 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:10.930760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-53f9cbde-ee0f-4dce-ba48-894b664fb718 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Calling method '.version_select at 0x7fda1926a0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:11.088450 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-53f9cbde-ee0f-4dce-ba48-894b664fb718 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/e78058a107384e9c93a760a5a6ee6134?user_id=324f819cd55944169282631fd43f7c41" status: 200 len: 370 microversion: 2.1 time: 0.160620 Oct 11 04:30:11.093250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b6b4b35-6d4b-44a3-b3bc-f7007f71bd8d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:11.094113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2b6b4b35-6d4b-44a3-b3bc-f7007f71bd8d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:11.103276 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2296/4375] 10.222.0.26 () {58 vars in 1323 bytes} [Tue Oct 11 04:30:10 2022] GET /compute/v2.1/os-quota-sets/e78058a107384e9c93a760a5a6ee6134?user_id=324f819cd55944169282631fd43f7c41 => generated 370 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:11.104877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b6b4b35-6d4b-44a3-b3bc-f7007f71bd8d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:11.105571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b6b4b35-6d4b-44a3-b3bc-f7007f71bd8d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:11.106018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b6b4b35-6d4b-44a3-b3bc-f7007f71bd8d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:11.110088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b6b4b35-6d4b-44a3-b3bc-f7007f71bd8d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:11.110772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b6b4b35-6d4b-44a3-b3bc-f7007f71bd8d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:11.112251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b6b4b35-6d4b-44a3-b3bc-f7007f71bd8d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:11.417965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-998ab03a-7fad-4bdb-ac4d-f7a708cfd2d9 req-b049232a-3596-4e95-ae0c-536ea4c56053 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bf7aab-a813-4849-ba3b-3650c3a0b2e7", "tag": "f5a25831-8c8f-4114-8345-22fff4ba27bb"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:11.471951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-998ab03a-7fad-4bdb-ac4d-f7a708cfd2d9 req-b049232a-3596-4e95-ae0c-536ea4c56053 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:11.472805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-998ab03a-7fad-4bdb-ac4d-f7a708cfd2d9 req-b049232a-3596-4e95-ae0c-536ea4c56053 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:11.475646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-998ab03a-7fad-4bdb-ac4d-f7a708cfd2d9 req-b049232a-3596-4e95-ae0c-536ea4c56053 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:11.490246 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-998ab03a-7fad-4bdb-ac4d-f7a708cfd2d9 req-b049232a-3596-4e95-ae0c-536ea4c56053 service nova] Creating event network-changed:f5a25831-8c8f-4114-8345-22fff4ba27bb for instance c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 on n-h2-860892-1 Oct 11 04:30:11.497081 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-998ab03a-7fad-4bdb-ac4d-f7a708cfd2d9 req-b049232a-3596-4e95-ae0c-536ea4c56053 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091783 Oct 11 04:30:11.499354 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2297/4376] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:11.507259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dafcc14e-cf5f-4168-97b2-59071c8e7817 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:11.509232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dafcc14e-cf5f-4168-97b2-59071c8e7817 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:11.523020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dafcc14e-cf5f-4168-97b2-59071c8e7817 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:11.523641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dafcc14e-cf5f-4168-97b2-59071c8e7817 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:11.524269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dafcc14e-cf5f-4168-97b2-59071c8e7817 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:11.525209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dafcc14e-cf5f-4168-97b2-59071c8e7817 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:11.526628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dafcc14e-cf5f-4168-97b2-59071c8e7817 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:11.527277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dafcc14e-cf5f-4168-97b2-59071c8e7817 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:12.002648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2b6b4b35-6d4b-44a3-b3bc-f7007f71bd8d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:12.011966 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b6b4b35-6d4b-44a3-b3bc-f7007f71bd8d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1500 microversion: 2.1 time: 0.923024 Oct 11 04:30:12.032891 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2080/4377] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:11 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1500 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:12.045300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9be12f14-d203-45cb-899f-095e6cc9d91d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:12.045935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9be12f14-d203-45cb-899f-095e6cc9d91d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:12.059763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:12.062809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9be12f14-d203-45cb-899f-095e6cc9d91d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:12.066410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9be12f14-d203-45cb-899f-095e6cc9d91d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:12.067142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9be12f14-d203-45cb-899f-095e6cc9d91d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:12.070150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9be12f14-d203-45cb-899f-095e6cc9d91d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:12.071550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9be12f14-d203-45cb-899f-095e6cc9d91d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:12.072165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9be12f14-d203-45cb-899f-095e6cc9d91d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:12.127365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dafcc14e-cf5f-4168-97b2-59071c8e7817 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:12.137567 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dafcc14e-cf5f-4168-97b2-59071c8e7817 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1314 microversion: 2.1 time: 0.636786 Oct 11 04:30:12.138146 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2298/4378] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:11 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1314 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:12.159580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d61efdd5-7fea-46ce-b0b0-8281dddfc762 req-8bac57e8-b93b-4c24-a596-469ec723f74d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e11d6052-2e14-4dcb-9129-22f81bfabf18", "tag": "e094d5ba-4877-43fc-8550-c9438d490e5b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:12.172620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d61efdd5-7fea-46ce-b0b0-8281dddfc762 req-8bac57e8-b93b-4c24-a596-469ec723f74d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:12.173119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d61efdd5-7fea-46ce-b0b0-8281dddfc762 req-8bac57e8-b93b-4c24-a596-469ec723f74d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:12.173560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d61efdd5-7fea-46ce-b0b0-8281dddfc762 req-8bac57e8-b93b-4c24-a596-469ec723f74d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:12.240576 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d61efdd5-7fea-46ce-b0b0-8281dddfc762 req-8bac57e8-b93b-4c24-a596-469ec723f74d service nova] Creating event network-changed:e094d5ba-4877-43fc-8550-c9438d490e5b for instance e11d6052-2e14-4dcb-9129-22f81bfabf18 on n-h2-860892-1 Oct 11 04:30:12.278174 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d61efdd5-7fea-46ce-b0b0-8281dddfc762 req-8bac57e8-b93b-4c24-a596-469ec723f74d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133657 Oct 11 04:30:12.284667 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2299/4379] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:12.297126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'action', calling method: >, body: {"rescue": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:12.328783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:12.357978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:12.358745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:12.359487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:12.361604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:12.362849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:12.363296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:12.444052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lazy-loading 'flavor' on Instance uuid 7aed25f7-59d6-49de-b699-3581739f0edd {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:30:12.462301 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] HTTP exception thrown: Cannot 'rescue' instance 7aed25f7-59d6-49de-b699-3581739f0edd while it is in vm_state paused Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Request method failure captured: Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/action HTTP/1.1 Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 14 Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPEasekUZLINQ5CZWJXkMppFiFyiPz0x7d4djdvUd-asoF16cTMXmitsW8Jw6-L4ZC10T49kVSd5NZJD7qmV4ktBS-qpfyACuQOEHpQR5BigmL06KMooK58zyWV0xifCb_yIKtS4zKCvAts6lZk9Fe5iF-Yw7nZw-Mdv0pFYP_e1eeY Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75ee1246b11f4fb286baf525614515c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}] Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 820b6b6b001a46a2abd3415de0b5f29b Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: {"rescue": {}} Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: exception: Cannot 'rescue' instance 7aed25f7-59d6-49de-b699-3581739f0edd while it is in vm_state paused Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '7aed25f7-59d6-49de-b699-3581739f0edd', 'body': {'rescue': {}}} Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 62, in _rescue Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.compute_api.rescue(context, instance, Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7aed25f7-59d6-49de-b699-3581739f0edd in vm_state paused. Cannot rescue while the instance is in this state. Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/rescue.py", line 72, in _rescue Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rescue' instance 7aed25f7-59d6-49de-b699-3581739f0edd while it is in vm_state paused Oct 11 04:30:12.464534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:12.468347 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:12.468347 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:12.468347 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:12.468347 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:12.468347 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:12.468347 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:30:12.468347 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:30:12.468347 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rescue' instance 7aed25f7-59d6-49de-b699-3581739f0edd while it is in vm_state paused Oct 11 04:30:12.468347 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:12.469567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Returning 409 to user: Cannot 'rescue' instance 7aed25f7-59d6-49de-b699-3581739f0edd while it is in vm_state paused {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:30:12.471176 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-10be92f2-e4e6-4aa1-9830-7d83ef2555df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/action" status: 409 len: 144 microversion: 2.1 time: 0.185134 Oct 11 04:30:12.471830 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2300/4380] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:12 2022] POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/action => generated 144 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:30:12.489321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eecac052-b73f-4143-8905-c53207369911 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Calling method '.version_select at 0x7fda194ef280>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:12.560152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9be12f14-d203-45cb-899f-095e6cc9d91d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:12.602170 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9be12f14-d203-45cb-899f-095e6cc9d91d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1324 microversion: 2.1 time: 0.548567 Oct 11 04:30:12.602170 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2081/4381] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:12 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1324 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:12.617978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-adb65ea0-d81a-4806-b3f9-66566dd67f05 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:12.617978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-adb65ea0-d81a-4806-b3f9-66566dd67f05 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:12.694488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb65ea0-d81a-4806-b3f9-66566dd67f05 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:12.699952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb65ea0-d81a-4806-b3f9-66566dd67f05 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:12.708697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb65ea0-d81a-4806-b3f9-66566dd67f05 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:12.715208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb65ea0-d81a-4806-b3f9-66566dd67f05 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:12.723111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb65ea0-d81a-4806-b3f9-66566dd67f05 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:12.723111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb65ea0-d81a-4806-b3f9-66566dd67f05 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:13.083514 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-adb65ea0-d81a-4806-b3f9-66566dd67f05 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/action" status: 202 len: 0 microversion: 2.1 time: 0.492155 Oct 11 04:30:13.085279 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2082/4382] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:12 2022] POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:30:13.094164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2e8c9240-2384-41bc-8866-d81129fc504d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:13.102573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2e8c9240-2384-41bc-8866-d81129fc504d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:13.129281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c9240-2384-41bc-8866-d81129fc504d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:13.130928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c9240-2384-41bc-8866-d81129fc504d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:13.132397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c9240-2384-41bc-8866-d81129fc504d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:13.135081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c9240-2384-41bc-8866-d81129fc504d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:13.136367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c9240-2384-41bc-8866-d81129fc504d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:13.146337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c9240-2384-41bc-8866-d81129fc504d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:13.345953 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eecac052-b73f-4143-8905-c53207369911 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/7e43e05d952d4d0cb680073c3ce706df/defaults" status: 200 len: 371 microversion: 2.1 time: 0.867469 Oct 11 04:30:13.347922 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2301/4383] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:30:12 2022] GET /compute/v2.1/os-quota-sets/7e43e05d952d4d0cb680073c3ce706df/defaults => generated 371 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:13.357849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-85649ac5-2597-4288-80d8-83aa716702c3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:13.358495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-85649ac5-2597-4288-80d8-83aa716702c3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:13.383666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85649ac5-2597-4288-80d8-83aa716702c3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:13.386588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85649ac5-2597-4288-80d8-83aa716702c3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:13.387868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85649ac5-2597-4288-80d8-83aa716702c3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:13.389616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85649ac5-2597-4288-80d8-83aa716702c3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:13.390427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85649ac5-2597-4288-80d8-83aa716702c3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:13.391169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85649ac5-2597-4288-80d8-83aa716702c3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:13.649990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-85649ac5-2597-4288-80d8-83aa716702c3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:13.668713 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-85649ac5-2597-4288-80d8-83aa716702c3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1314 microversion: 2.1 time: 0.311151 Oct 11 04:30:13.668713 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2302/4384] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:13 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:13.670220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4f676ffd-3687-421d-ad0d-488698a918dd tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Action: 'update', calling method: .version_select at 0x7fda192673a0>, body: {"quota_set": {"force": true, "metadata_items": 256, "ram": 10240, "key_pairs": 200, "instances": 20, "server_groups": 20, "server_group_members": 20, "cores": 2, "fixed_ips": 10, "floating_ips": 20, "security_group_rules": 20, "security_groups": 20, "injected_file_content_bytes": 20480, "injected_file_path_bytes": 512, "injected_files": 10}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:13.873094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2e8c9240-2384-41bc-8866-d81129fc504d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:13.883770 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2e8c9240-2384-41bc-8866-d81129fc504d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1507 microversion: 2.1 time: 0.793564 Oct 11 04:30:13.884555 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2083/4385] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:13 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1507 bytes in 795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:30:13.891881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-424c6fa4-a340-42de-a165-3a45a70620f0 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:13.892543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-424c6fa4-a340-42de-a165-3a45a70620f0 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:13.900001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-424c6fa4-a340-42de-a165-3a45a70620f0 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:13.907299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-424c6fa4-a340-42de-a165-3a45a70620f0 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:13.910108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-424c6fa4-a340-42de-a165-3a45a70620f0 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:13.912171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-424c6fa4-a340-42de-a165-3a45a70620f0 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:13.912660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-424c6fa4-a340-42de-a165-3a45a70620f0 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:13.913098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-424c6fa4-a340-42de-a165-3a45a70620f0 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:14.053374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f676ffd-3687-421d-ad0d-488698a918dd tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:14.054833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f676ffd-3687-421d-ad0d-488698a918dd tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:14.055501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f676ffd-3687-421d-ad0d-488698a918dd tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:14.056301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f676ffd-3687-421d-ad0d-488698a918dd tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:14.056827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f676ffd-3687-421d-ad0d-488698a918dd tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:14.057366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f676ffd-3687-421d-ad0d-488698a918dd tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:14.284325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-424c6fa4-a340-42de-a165-3a45a70620f0 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:14.288840 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-424c6fa4-a340-42de-a165-3a45a70620f0 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1324 microversion: 2.1 time: 0.403415 Oct 11 04:30:14.289776 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2084/4386] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:13 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1324 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:14.691556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b99934fc-43e3-47cf-8d51-6a4e234a3993 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:14.692178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b99934fc-43e3-47cf-8d51-6a4e234a3993 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:14.710931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b99934fc-43e3-47cf-8d51-6a4e234a3993 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:14.711785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b99934fc-43e3-47cf-8d51-6a4e234a3993 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:14.712597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b99934fc-43e3-47cf-8d51-6a4e234a3993 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:14.717673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b99934fc-43e3-47cf-8d51-6a4e234a3993 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:14.717673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b99934fc-43e3-47cf-8d51-6a4e234a3993 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:14.717673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b99934fc-43e3-47cf-8d51-6a4e234a3993 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:14.941880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b99934fc-43e3-47cf-8d51-6a4e234a3993 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:14.961552 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b99934fc-43e3-47cf-8d51-6a4e234a3993 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1314 microversion: 2.1 time: 0.275916 Oct 11 04:30:14.981445 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2085/4387] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:14 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:14.989661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ba21c415-3c21-4652-b7b4-489019b52fe8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:14.990704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ba21c415-3c21-4652-b7b4-489019b52fe8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:15.001420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba21c415-3c21-4652-b7b4-489019b52fe8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:15.002297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba21c415-3c21-4652-b7b4-489019b52fe8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:15.004316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba21c415-3c21-4652-b7b4-489019b52fe8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:15.005230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba21c415-3c21-4652-b7b4-489019b52fe8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:15.005846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba21c415-3c21-4652-b7b4-489019b52fe8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:15.009046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba21c415-3c21-4652-b7b4-489019b52fe8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:15.018121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:15.280433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ba21c415-3c21-4652-b7b4-489019b52fe8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:15.288220 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ba21c415-3c21-4652-b7b4-489019b52fe8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1507 microversion: 2.1 time: 0.305493 Oct 11 04:30:15.288969 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2086/4388] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:14 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1507 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:15.312925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-853390a1-6c80-49fb-aa1b-67323fe75293 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:15.313543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-853390a1-6c80-49fb-aa1b-67323fe75293 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:15.325205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-853390a1-6c80-49fb-aa1b-67323fe75293 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:15.325701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-853390a1-6c80-49fb-aa1b-67323fe75293 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:15.326142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-853390a1-6c80-49fb-aa1b-67323fe75293 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:15.330302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-853390a1-6c80-49fb-aa1b-67323fe75293 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:15.330791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-853390a1-6c80-49fb-aa1b-67323fe75293 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:15.331234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-853390a1-6c80-49fb-aa1b-67323fe75293 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:15.550798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-853390a1-6c80-49fb-aa1b-67323fe75293 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:15.563027 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-853390a1-6c80-49fb-aa1b-67323fe75293 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1324 microversion: 2.1 time: 0.253920 Oct 11 04:30:15.578220 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2087/4389] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:15 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1324 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:30:15.668902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:INSERT=15,nova_api:SELECT=83,nova_api:DELETE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:15.792379 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4f676ffd-3687-421d-ad0d-488698a918dd tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/7e43e05d952d4d0cb680073c3ce706df" status: 200 len: 329 microversion: 2.1 time: 2.125993 Oct 11 04:30:15.793021 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2303/4390] 10.222.0.26 () {60 vars in 1263 bytes} [Tue Oct 11 04:30:13 2022] PUT /compute/v2.1/os-quota-sets/7e43e05d952d4d0cb680073c3ce706df => generated 329 bytes in 2128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:15.806362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3d2f121a-9c9d-4f69-bbf6-0192a43e03f6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Action: 'update', calling method: .version_select at 0x7fda191f5f70>, body: {"quota_set": {"cores": 20, "fixed_ips": -1, "floating_ips": -1, "injected_file_content_bytes": 10240, "injected_file_path_bytes": 255, "injected_files": 5, "instances": 10, "key_pairs": 100, "metadata_items": 128, "ram": 51200, "security_group_rules": -1, "security_groups": -1, "server_group_members": 10, "server_groups": 10}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:15.923631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2f121a-9c9d-4f69-bbf6-0192a43e03f6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:15.924343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2f121a-9c9d-4f69-bbf6-0192a43e03f6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:15.924838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2f121a-9c9d-4f69-bbf6-0192a43e03f6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:15.925742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2f121a-9c9d-4f69-bbf6-0192a43e03f6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:15.926874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2f121a-9c9d-4f69-bbf6-0192a43e03f6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:15.927491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3d2f121a-9c9d-4f69-bbf6-0192a43e03f6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:15.985892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a27cf014-55c1-4b28-a004-74879dc0b792 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:15.986566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a27cf014-55c1-4b28-a004-74879dc0b792 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:15.992822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a27cf014-55c1-4b28-a004-74879dc0b792 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:15.993330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a27cf014-55c1-4b28-a004-74879dc0b792 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:15.993988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a27cf014-55c1-4b28-a004-74879dc0b792 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:15.994864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a27cf014-55c1-4b28-a004-74879dc0b792 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:15.995346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a27cf014-55c1-4b28-a004-74879dc0b792 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:15.995777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a27cf014-55c1-4b28-a004-74879dc0b792 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:16.259142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a27cf014-55c1-4b28-a004-74879dc0b792 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:16.274631 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a27cf014-55c1-4b28-a004-74879dc0b792 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1314 microversion: 2.1 time: 0.293101 Oct 11 04:30:16.275496 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2304/4391] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:15 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:16.357269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerAdvancedOps-server-569761361", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "a949f82b-a2df-4d86-9b46-507b2c03261d"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:16.426434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] validate_networks() for [('a949f82b-a2df-4d86-9b46-507b2c03261d', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:30:17.030264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:30:17.032010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:30:17.033696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:30:17.037293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:30:17.037949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:30:17.051306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:17.051969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:17.052851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:17.053754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:17.054420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:17.055035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:17.077516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Getting quotas for project f358bb23de6f4d92874ae1722a7c68c8. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:30:17.084171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Getting quotas for user ef3acbedf6134c6abed4af16783c6e1e and project f358bb23de6f4d92874ae1722a7c68c8. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:30:17.119088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:30:17.122611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:30:17.273291 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-21163ec7-e417-40e2-bdea-4188aa7503cc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.994982 Oct 11 04:30:17.280821 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2305/4392] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:30:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 1004 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:30:17.286094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af8a6d77-5eca-42c3-84d6-e0b18542b725 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:17.286900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af8a6d77-5eca-42c3-84d6-e0b18542b725 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:17.295115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af8a6d77-5eca-42c3-84d6-e0b18542b725 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:17.295884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af8a6d77-5eca-42c3-84d6-e0b18542b725 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:17.296482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af8a6d77-5eca-42c3-84d6-e0b18542b725 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:17.298510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af8a6d77-5eca-42c3-84d6-e0b18542b725 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:17.299321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af8a6d77-5eca-42c3-84d6-e0b18542b725 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:17.300169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af8a6d77-5eca-42c3-84d6-e0b18542b725 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:17.487534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-af8a6d77-5eca-42c3-84d6-e0b18542b725 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:17.502425 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af8a6d77-5eca-42c3-84d6-e0b18542b725 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1507 microversion: 2.1 time: 0.216072 Oct 11 04:30:17.502425 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2306/4393] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:17 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:17.505511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-813b2d92-a0d5-45dd-a9b3-978cca235a46 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:17.506118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-813b2d92-a0d5-45dd-a9b3-978cca235a46 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:17.537795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-813b2d92-a0d5-45dd-a9b3-978cca235a46 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:17.538505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-813b2d92-a0d5-45dd-a9b3-978cca235a46 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:17.539115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-813b2d92-a0d5-45dd-a9b3-978cca235a46 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:17.540019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-813b2d92-a0d5-45dd-a9b3-978cca235a46 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:17.540879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-813b2d92-a0d5-45dd-a9b3-978cca235a46 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:17.541545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-813b2d92-a0d5-45dd-a9b3-978cca235a46 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:17.706484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-813b2d92-a0d5-45dd-a9b3-978cca235a46 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:17.715107 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-813b2d92-a0d5-45dd-a9b3-978cca235a46 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1324 microversion: 2.1 time: 0.213177 Oct 11 04:30:17.726222 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2307/4394] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:17 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1324 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:17.732746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-392076e9-49bb-4853-bad9-3768866dd67a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:17.733573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-392076e9-49bb-4853-bad9-3768866dd67a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:17.812900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-392076e9-49bb-4853-bad9-3768866dd67a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:17.828163 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-392076e9-49bb-4853-bad9-3768866dd67a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1214 microversion: 2.1 time: 0.104393 Oct 11 04:30:17.828757 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2308/4395] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:17 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:17.834277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ed31d9f-8c8d-4b9e-a477-1be2f49fa00d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:17.835917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4ed31d9f-8c8d-4b9e-a477-1be2f49fa00d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:17.855140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed31d9f-8c8d-4b9e-a477-1be2f49fa00d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:17.858300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed31d9f-8c8d-4b9e-a477-1be2f49fa00d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:17.859245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed31d9f-8c8d-4b9e-a477-1be2f49fa00d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:17.859994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed31d9f-8c8d-4b9e-a477-1be2f49fa00d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:17.860460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed31d9f-8c8d-4b9e-a477-1be2f49fa00d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:17.860891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed31d9f-8c8d-4b9e-a477-1be2f49fa00d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:17.865575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:17.998095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ed31d9f-8c8d-4b9e-a477-1be2f49fa00d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:18.006587 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ed31d9f-8c8d-4b9e-a477-1be2f49fa00d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1314 microversion: 2.1 time: 0.175866 Oct 11 04:30:18.010420 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2309/4396] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:17 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:18.221811 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3d2f121a-9c9d-4f69-bbf6-0192a43e03f6 tempest-QuotasAdminTestJSON-2003233251 tempest-QuotasAdminTestJSON-2003233251-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/7e43e05d952d4d0cb680073c3ce706df" status: 200 len: 329 microversion: 2.1 time: 2.419772 Oct 11 04:30:18.224189 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2088/4397] 10.222.0.26 () {60 vars in 1263 bytes} [Tue Oct 11 04:30:15 2022] PUT /compute/v2.1/os-quota-sets/7e43e05d952d4d0cb680073c3ce706df => generated 329 bytes in 2423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:18.277987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82447c9b-3ea8-4b1f-8835-321d15489a4e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:18.278748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82447c9b-3ea8-4b1f-8835-321d15489a4e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:18.297774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82447c9b-3ea8-4b1f-8835-321d15489a4e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:18.299034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82447c9b-3ea8-4b1f-8835-321d15489a4e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:18.300189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82447c9b-3ea8-4b1f-8835-321d15489a4e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:18.302007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82447c9b-3ea8-4b1f-8835-321d15489a4e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:18.308411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82447c9b-3ea8-4b1f-8835-321d15489a4e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:18.308411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82447c9b-3ea8-4b1f-8835-321d15489a4e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:18.408485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82447c9b-3ea8-4b1f-8835-321d15489a4e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:30:18.529632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35a47f78-078b-416b-8ace-5e087332e760 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:18.530406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-35a47f78-078b-416b-8ace-5e087332e760 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:18.548586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35a47f78-078b-416b-8ace-5e087332e760 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:18.550000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35a47f78-078b-416b-8ace-5e087332e760 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:18.552814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35a47f78-078b-416b-8ace-5e087332e760 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:18.556602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35a47f78-078b-416b-8ace-5e087332e760 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:18.564317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35a47f78-078b-416b-8ace-5e087332e760 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:18.564317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35a47f78-078b-416b-8ace-5e087332e760 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:18.808119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35a47f78-078b-416b-8ace-5e087332e760 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:18.819217 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35a47f78-078b-416b-8ace-5e087332e760 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1515 microversion: 2.1 time: 0.294082 Oct 11 04:30:18.819793 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2089/4398] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:18 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1515 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:18.835158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a3cb398-cbd8-48f5-9d73-3cf638d1d04a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:18.836004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9a3cb398-cbd8-48f5-9d73-3cf638d1d04a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:18.845683 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82447c9b-3ea8-4b1f-8835-321d15489a4e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "DELETE /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 204 len: 0 microversion: 2.32 time: 0.836609 Oct 11 04:30:18.850239 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2310/4399] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:30:18 2022] DELETE /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 0 bytes in 839 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:30:18.853527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a3cb398-cbd8-48f5-9d73-3cf638d1d04a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:18.854074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a3cb398-cbd8-48f5-9d73-3cf638d1d04a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:18.855116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a3cb398-cbd8-48f5-9d73-3cf638d1d04a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:18.857392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a3cb398-cbd8-48f5-9d73-3cf638d1d04a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:18.857888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a3cb398-cbd8-48f5-9d73-3cf638d1d04a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:18.859233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d8148988-df54-43ca-af22-44266f141271 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:18.859658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a3cb398-cbd8-48f5-9d73-3cf638d1d04a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:18.870663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d8148988-df54-43ca-af22-44266f141271 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:18.885408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8148988-df54-43ca-af22-44266f141271 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:18.888361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8148988-df54-43ca-af22-44266f141271 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:18.890960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8148988-df54-43ca-af22-44266f141271 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:18.891922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8148988-df54-43ca-af22-44266f141271 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:18.894049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8148988-df54-43ca-af22-44266f141271 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:18.896517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d8148988-df54-43ca-af22-44266f141271 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:19.031152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d8148988-df54-43ca-af22-44266f141271 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:19.043092 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d8148988-df54-43ca-af22-44266f141271 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1218 microversion: 2.1 time: 0.191524 Oct 11 04:30:19.043707 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2311/4400] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:18 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1218 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:19.063815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:19.064791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:19.071800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:19.072499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:19.073626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:19.074515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:19.075121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:19.075712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:19.215525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9a3cb398-cbd8-48f5-9d73-3cf638d1d04a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:19.232892 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9a3cb398-cbd8-48f5-9d73-3cf638d1d04a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1324 microversion: 2.1 time: 0.401340 Oct 11 04:30:19.234949 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2090/4401] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:18 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1324 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:19.260311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8822b3c6-6098-4686-85e8-e07eb94c9dcd req-2bd806a4-254d-4d71-bc31-33e8445c3da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e11d6052-2e14-4dcb-9129-22f81bfabf18", "name": "network-vif-plugged", "status": "completed", "tag": "e094d5ba-4877-43fc-8550-c9438d490e5b"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:19.273800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8822b3c6-6098-4686-85e8-e07eb94c9dcd req-2bd806a4-254d-4d71-bc31-33e8445c3da6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:19.274719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8822b3c6-6098-4686-85e8-e07eb94c9dcd req-2bd806a4-254d-4d71-bc31-33e8445c3da6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:19.275349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8822b3c6-6098-4686-85e8-e07eb94c9dcd req-2bd806a4-254d-4d71-bc31-33e8445c3da6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:19.306536 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8822b3c6-6098-4686-85e8-e07eb94c9dcd req-2bd806a4-254d-4d71-bc31-33e8445c3da6 service nova] Creating event network-vif-plugged:e094d5ba-4877-43fc-8550-c9438d490e5b for instance e11d6052-2e14-4dcb-9129-22f81bfabf18 on n-h2-860892-1 Oct 11 04:30:19.331211 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8822b3c6-6098-4686-85e8-e07eb94c9dcd req-2bd806a4-254d-4d71-bc31-33e8445c3da6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080316 Oct 11 04:30:19.331211 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2091/4402] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:19.331211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:19.331211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:19.331211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:19.331211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:19.331211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:19.333763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:19.334613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:19.335366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:19.414642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:19.429537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:19.434541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:19.438329 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e6066fe-0346-4b4d-99fe-fdf20b25f356 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2949 microversion: 2.32 time: 0.377733 Oct 11 04:30:19.443363 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2312/4403] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:19 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2949 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:19.543933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:19.554844 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1314 microversion: 2.1 time: 0.236336 Oct 11 04:30:19.558532 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2092/4404] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:19 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:20.071583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dab848ef-eefe-4362-8216-2eb5bdde3318 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:20.072900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dab848ef-eefe-4362-8216-2eb5bdde3318 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:20.090256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dab848ef-eefe-4362-8216-2eb5bdde3318 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:20.090399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dab848ef-eefe-4362-8216-2eb5bdde3318 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:20.090835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dab848ef-eefe-4362-8216-2eb5bdde3318 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:20.091588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dab848ef-eefe-4362-8216-2eb5bdde3318 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:20.092044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dab848ef-eefe-4362-8216-2eb5bdde3318 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:20.092653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dab848ef-eefe-4362-8216-2eb5bdde3318 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:20.093149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:20.094221 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001446 Oct 11 04:30:20.094645 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2093/4405] 10.222.0.26 () {56 vars in 886 bytes} [Tue Oct 11 04:30:20 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (2 switches on core 0) Oct 11 04:30:20.103722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:20.105632 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2/" status: 200 len: 379 microversion: 2.1 time: 0.002368 Oct 11 04:30:20.106295 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2094/4406] 10.222.0.26 () {54 vars in 1035 bytes} [Tue Oct 11 04:30:20 2022] GET /compute/v2/ => generated 379 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 221 bytes (1 switches on core 0) Oct 11 04:30:20.125093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:20.125093 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 Oct 11 04:30:20.125093 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2095/4407] 10.222.0.26 () {54 vars in 1041 bytes} [Tue Oct 11 04:30:20 2022] GET /compute/v2.1/ => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:20.127135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:20.128430 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-efa0f7f1-7e6b-4848-872b-906630c98c03 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001697 Oct 11 04:30:20.129013 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2096/4408] 10.222.0.26 () {56 vars in 886 bytes} [Tue Oct 11 04:30:20 2022] GET /compute/ => generated 377 bytes in 3 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 04:30:20.175780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dab848ef-eefe-4362-8216-2eb5bdde3318 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:20.185035 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dab848ef-eefe-4362-8216-2eb5bdde3318 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1266 microversion: 2.1 time: 0.118077 Oct 11 04:30:20.186310 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2313/4409] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:20 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1266 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:20.260308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0c21b035-5c9c-4776-b715-ed2eee507b65 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:20.262253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0c21b035-5c9c-4776-b715-ed2eee507b65 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:20.275995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c21b035-5c9c-4776-b715-ed2eee507b65 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:20.278861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c21b035-5c9c-4776-b715-ed2eee507b65 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:20.279328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c21b035-5c9c-4776-b715-ed2eee507b65 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:20.281753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c21b035-5c9c-4776-b715-ed2eee507b65 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:20.287271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c21b035-5c9c-4776-b715-ed2eee507b65 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:20.287271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c21b035-5c9c-4776-b715-ed2eee507b65 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:20.470940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:20.472170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:20.489087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:20.497341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:20.499822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:20.499822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:20.499822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:20.499822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:20.569194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0c21b035-5c9c-4776-b715-ed2eee507b65 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:20.580866 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0c21b035-5c9c-4776-b715-ed2eee507b65 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1324 microversion: 2.1 time: 0.326025 Oct 11 04:30:20.583151 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2097/4410] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:20 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1324 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:20.588554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69ff7999-b161-4fc3-8889-4d0092715a5f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:20.590125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69ff7999-b161-4fc3-8889-4d0092715a5f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:20.597684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69ff7999-b161-4fc3-8889-4d0092715a5f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:20.598947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69ff7999-b161-4fc3-8889-4d0092715a5f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:20.599899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69ff7999-b161-4fc3-8889-4d0092715a5f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:20.601033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69ff7999-b161-4fc3-8889-4d0092715a5f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:20.608586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69ff7999-b161-4fc3-8889-4d0092715a5f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:20.608586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69ff7999-b161-4fc3-8889-4d0092715a5f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:20.849682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-69ff7999-b161-4fc3-8889-4d0092715a5f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:20.862634 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69ff7999-b161-4fc3-8889-4d0092715a5f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1314 microversion: 2.1 time: 0.278127 Oct 11 04:30:20.864319 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2098/4411] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:20 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:21.083262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:21.097823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:21.100762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:21.106138 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d08787da-39a0-4806-bd00-08254b7a644b tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2949 microversion: 2.32 time: 0.637472 Oct 11 04:30:21.106138 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2314/4412] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:20 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2949 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:21.211862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9c61ad9e-30db-4f2f-a93f-3ba3ac1a244a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:21.212480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9c61ad9e-30db-4f2f-a93f-3ba3ac1a244a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:21.220514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c61ad9e-30db-4f2f-a93f-3ba3ac1a244a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:21.221048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c61ad9e-30db-4f2f-a93f-3ba3ac1a244a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:21.221451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c61ad9e-30db-4f2f-a93f-3ba3ac1a244a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:21.222150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c61ad9e-30db-4f2f-a93f-3ba3ac1a244a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:21.222687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c61ad9e-30db-4f2f-a93f-3ba3ac1a244a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:21.223273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c61ad9e-30db-4f2f-a93f-3ba3ac1a244a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:21.347344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d1e69827-7ae6-48a8-8f25-d3b6c7b98a79 req-f573101c-f94b-4b74-baa3-d84908126b34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf7aab-a813-4849-ba3b-3650c3a0b2e7", "name": "network-vif-plugged", "status": "completed", "tag": "f5a25831-8c8f-4114-8345-22fff4ba27bb"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:21.359016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d1e69827-7ae6-48a8-8f25-d3b6c7b98a79 req-f573101c-f94b-4b74-baa3-d84908126b34 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:21.359958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d1e69827-7ae6-48a8-8f25-d3b6c7b98a79 req-f573101c-f94b-4b74-baa3-d84908126b34 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:21.360549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d1e69827-7ae6-48a8-8f25-d3b6c7b98a79 req-f573101c-f94b-4b74-baa3-d84908126b34 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:21.373997 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d1e69827-7ae6-48a8-8f25-d3b6c7b98a79 req-f573101c-f94b-4b74-baa3-d84908126b34 service nova] Creating event network-vif-plugged:f5a25831-8c8f-4114-8345-22fff4ba27bb for instance c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 on n-h2-860892-1 Oct 11 04:30:21.379921 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d1e69827-7ae6-48a8-8f25-d3b6c7b98a79 req-f573101c-f94b-4b74-baa3-d84908126b34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036170 Oct 11 04:30:21.381239 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2315/4413] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:30:21.391579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9c61ad9e-30db-4f2f-a93f-3ba3ac1a244a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:21.413863 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9c61ad9e-30db-4f2f-a93f-3ba3ac1a244a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1272 microversion: 2.1 time: 0.205508 Oct 11 04:30:21.419431 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2099/4414] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:21 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1272 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:21.608711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6db21dee-8539-41a9-85b1-69043250bd18 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:21.610387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6db21dee-8539-41a9-85b1-69043250bd18 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:21.624617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6db21dee-8539-41a9-85b1-69043250bd18 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:21.629809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6db21dee-8539-41a9-85b1-69043250bd18 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:21.630630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6db21dee-8539-41a9-85b1-69043250bd18 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:21.631558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6db21dee-8539-41a9-85b1-69043250bd18 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:21.632163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6db21dee-8539-41a9-85b1-69043250bd18 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:21.633383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6db21dee-8539-41a9-85b1-69043250bd18 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:21.889570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c98ef38f-af63-4c87-8436-7da25cfbde08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:21.890502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c98ef38f-af63-4c87-8436-7da25cfbde08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:21.905559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c98ef38f-af63-4c87-8436-7da25cfbde08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:21.906331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c98ef38f-af63-4c87-8436-7da25cfbde08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:21.906988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c98ef38f-af63-4c87-8436-7da25cfbde08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:21.908789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c98ef38f-af63-4c87-8436-7da25cfbde08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:21.909430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c98ef38f-af63-4c87-8436-7da25cfbde08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:21.910052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c98ef38f-af63-4c87-8436-7da25cfbde08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:22.024356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6db21dee-8539-41a9-85b1-69043250bd18 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:22.037107 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6db21dee-8539-41a9-85b1-69043250bd18 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1324 microversion: 2.1 time: 0.435041 Oct 11 04:30:22.037712 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2316/4415] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:21 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1324 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:22.096656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f3a79ef6-4117-4ffd-bd61-afe4f18c1a7f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:22.099884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f3a79ef6-4117-4ffd-bd61-afe4f18c1a7f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:22.114567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a79ef6-4117-4ffd-bd61-afe4f18c1a7f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:22.115338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a79ef6-4117-4ffd-bd61-afe4f18c1a7f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:22.115520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a79ef6-4117-4ffd-bd61-afe4f18c1a7f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:22.116227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a79ef6-4117-4ffd-bd61-afe4f18c1a7f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:22.116681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a79ef6-4117-4ffd-bd61-afe4f18c1a7f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:22.120908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a79ef6-4117-4ffd-bd61-afe4f18c1a7f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:22.137823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c98ef38f-af63-4c87-8436-7da25cfbde08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:22.147289 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c98ef38f-af63-4c87-8436-7da25cfbde08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1314 microversion: 2.1 time: 0.261729 Oct 11 04:30:22.148496 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2100/4416] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:21 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:22.153746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-f3a79ef6-4117-4ffd-bd61-afe4f18c1a7f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lazy-loading 'flavor' on Instance uuid 7aed25f7-59d6-49de-b699-3581739f0edd {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:30:22.153949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:22.154788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:22.175929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:22.176425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:22.176860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:22.177563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:22.178237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:22.178659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:22.563001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:22.575831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:22.577643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:22.579676 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6f633e09-42ef-4ae2-8c85-7dd5f80e1a0c tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2949 microversion: 2.32 time: 0.429900 Oct 11 04:30:22.598597 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f3a79ef6-4117-4ffd-bd61-afe4f18c1a7f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/action" status: 200 len: 32 microversion: 2.1 time: 0.506041 Oct 11 04:30:22.610990 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2317/4417] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:22 2022] POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/action => generated 32 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 04:30:22.611687 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2101/4418] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:22 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2949 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:22.629306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c6e74fb-b860-4f36-9aab-a735769cbb30 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:22.632426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-844868be-b2cc-4d54-92b8-33a966318248 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:22.634501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-844868be-b2cc-4d54-92b8-33a966318248 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:22.637131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c6e74fb-b860-4f36-9aab-a735769cbb30 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:22.642957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=14,nova_api:UPDATE=14 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:22.654479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6e74fb-b860-4f36-9aab-a735769cbb30 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:22.655261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6e74fb-b860-4f36-9aab-a735769cbb30 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:22.655714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6e74fb-b860-4f36-9aab-a735769cbb30 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:22.657793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-844868be-b2cc-4d54-92b8-33a966318248 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:22.658983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-844868be-b2cc-4d54-92b8-33a966318248 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:22.660204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-844868be-b2cc-4d54-92b8-33a966318248 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:22.661687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-844868be-b2cc-4d54-92b8-33a966318248 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:22.662501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6e74fb-b860-4f36-9aab-a735769cbb30 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:22.663502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-844868be-b2cc-4d54-92b8-33a966318248 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:22.663679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6e74fb-b860-4f36-9aab-a735769cbb30 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:22.664776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6e74fb-b860-4f36-9aab-a735769cbb30 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:22.665399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-844868be-b2cc-4d54-92b8-33a966318248 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:22.915884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-844868be-b2cc-4d54-92b8-33a966318248 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:22.924725 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-844868be-b2cc-4d54-92b8-33a966318248 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.310490 Oct 11 04:30:22.925850 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2102/4419] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:22 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:23.064745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bd5f90a3-b323-461f-b1a6-48e4049fba38 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:23.065313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bd5f90a3-b323-461f-b1a6-48e4049fba38 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:23.072912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd5f90a3-b323-461f-b1a6-48e4049fba38 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:23.077829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd5f90a3-b323-461f-b1a6-48e4049fba38 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:23.077829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd5f90a3-b323-461f-b1a6-48e4049fba38 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:23.077829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd5f90a3-b323-461f-b1a6-48e4049fba38 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:23.077829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd5f90a3-b323-461f-b1a6-48e4049fba38 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:23.077829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd5f90a3-b323-461f-b1a6-48e4049fba38 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:23.365752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c6e74fb-b860-4f36-9aab-a735769cbb30 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:23.371507 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c6e74fb-b860-4f36-9aab-a735769cbb30 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1314 microversion: 2.1 time: 0.769765 Oct 11 04:30:23.372109 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2318/4420] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:22 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1314 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:23.376852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9c7e7a53-7184-48c8-80d4-8aca95cffe0b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:23.377463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9c7e7a53-7184-48c8-80d4-8aca95cffe0b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:23.400434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c7e7a53-7184-48c8-80d4-8aca95cffe0b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:23.400933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c7e7a53-7184-48c8-80d4-8aca95cffe0b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:23.401929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c7e7a53-7184-48c8-80d4-8aca95cffe0b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:23.402709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c7e7a53-7184-48c8-80d4-8aca95cffe0b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:23.403206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c7e7a53-7184-48c8-80d4-8aca95cffe0b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:23.403635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c7e7a53-7184-48c8-80d4-8aca95cffe0b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:23.495789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd5f90a3-b323-461f-b1a6-48e4049fba38 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:23.505995 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bd5f90a3-b323-461f-b1a6-48e4049fba38 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1521 microversion: 2.1 time: 0.445282 Oct 11 04:30:23.507019 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2103/4421] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:23 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1521 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:23.536721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:23.537213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:23.544023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:23.544509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:23.545841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:23.549774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:23.549774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:23.549774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:23.584010 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] HTTP exception thrown: Instance is not a member of specified network Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Request method failure captured: Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18/ips/invalid HTTP/1.1 Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPFHuieVpd_MlT8NdCyValjnl43mo-C04oH7GQyDe1AI--VaQw0zqc8B97ssnkLLj9WDnhzKBNCW5JKsiQxjXuY9w-3uNIqH9Tt4h10RXl881gRhw4nR6nMa9ss8KcjxmMUF3_T-81pVQAicGEHcgH-tnxz6Dv_8HTc05cp7cYswnjk Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 6d32830b844346fc9ae21fe93340e543 Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1753576683 Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d32830b844346fc9ae21fe93340e543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d32830b844346fc9ae21fe93340e543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d32830b844346fc9ae21fe93340e543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d32830b844346fc9ae21fe93340e543"}]}] Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1753576683 Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 6d32830b844346fc9ae21fe93340e543 Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1753576683 Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerAddressesNegativeTestJSON-1753576683-project Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 2c40cc9968244c0fb6c81301e775b17e Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1753576683-project Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance is not a member of specified network Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': 'e11d6052-2e14-4dcb-9129-22f81bfabf18', 'id': 'invalid'} Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 52, in show Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance is not a member of specified network Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance is not a member of specified network Oct 11 04:30:23.592283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:23.597412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Returning 404 to user: Instance is not a member of specified network {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:30:23.598356 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0d182298-290a-4fe9-9e16-c0192a485ec8 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18/ips/invalid" status: 404 len: 91 microversion: 2.1 time: 0.065979 Oct 11 04:30:23.599218 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2104/4422] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 04:30:23 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18/ips/invalid => generated 91 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:30:23.611059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-798bf796-7472-4e88-bd1b-94cb8d6c7f3e tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:23.611730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-798bf796-7472-4e88-bd1b-94cb8d6c7f3e tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Failed to fetch instance by id 999 {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 04:30:23.612227 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-798bf796-7472-4e88-bd1b-94cb8d6c7f3e tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] HTTP exception thrown: Instance 999 could not be found. Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-798bf796-7472-4e88-bd1b-94cb8d6c7f3e tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Request method failure captured: Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/999/ips HTTP/1.1 Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPFHuieVpd_MlT8NdCyValjnl43mo-C04oH7GQyDe1AI--VaQw0zqc8B97ssnkLLj9WDnhzKBNCW5JKsiQxjXuY9w-3uNIqH9Tt4h10RXl881gRhw4nR6nMa9ss8KcjxmMUF3_T-81pVQAicGEHcgH-tnxz6Dv_8HTc05cp7cYswnjk Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 6d32830b844346fc9ae21fe93340e543 Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1753576683 Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d32830b844346fc9ae21fe93340e543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d32830b844346fc9ae21fe93340e543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d32830b844346fc9ae21fe93340e543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d32830b844346fc9ae21fe93340e543"}]}] Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1753576683 Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 6d32830b844346fc9ae21fe93340e543 Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1753576683 Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerAddressesNegativeTestJSON-1753576683-project Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 2c40cc9968244c0fb6c81301e775b17e Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1753576683-project Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 999 could not be found. Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': '999'} Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999 could not be found. Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/ips.py", line 37, in index Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self._compute_api, context, server_id) Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999 could not be found. Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999 could not be found. Oct 11 04:30:23.614367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:23.619184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-798bf796-7472-4e88-bd1b-94cb8d6c7f3e tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Returning 404 to user: Instance 999 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:30:23.620755 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-798bf796-7472-4e88-bd1b-94cb8d6c7f3e tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/999/ips" status: 404 len: 78 microversion: 2.1 time: 0.013686 Oct 11 04:30:23.625685 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2105/4423] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:30:23 2022] GET /compute/v2.1/servers/999/ips => generated 78 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:30:23.631744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:23.633469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:23.641550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:23.642293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:23.642876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:23.643757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:23.644375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:23.645483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:23.861070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9c7e7a53-7184-48c8-80d4-8aca95cffe0b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:23.870516 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9c7e7a53-7184-48c8-80d4-8aca95cffe0b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1501 microversion: 2.1 time: 0.497331 Oct 11 04:30:23.875881 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2319/4424] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:23 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1501 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:23.888605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fa03d534-d31b-4c7b-a553-e84ac1bd86a3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:23.889341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fa03d534-d31b-4c7b-a553-e84ac1bd86a3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:23.904108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa03d534-d31b-4c7b-a553-e84ac1bd86a3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:23.904910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa03d534-d31b-4c7b-a553-e84ac1bd86a3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:23.906778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa03d534-d31b-4c7b-a553-e84ac1bd86a3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:23.907714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa03d534-d31b-4c7b-a553-e84ac1bd86a3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:23.909870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa03d534-d31b-4c7b-a553-e84ac1bd86a3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:23.910579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa03d534-d31b-4c7b-a553-e84ac1bd86a3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:23.938725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fa03d534-d31b-4c7b-a553-e84ac1bd86a3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:30:24.081630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:24.107547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:24.113815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:24.115255 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a971019a-1ad1-407b-8a33-44e0f1e99dab tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2949 microversion: 2.32 time: 0.487835 Oct 11 04:30:24.115831 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2106/4425] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:23 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2949 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:24.126894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2a38a43e-2b48-4b3e-972b-bd052b116454 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "default"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:24.127769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2a38a43e-2b48-4b3e-972b-bd052b116454 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:24.140233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a38a43e-2b48-4b3e-972b-bd052b116454 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:24.142946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a38a43e-2b48-4b3e-972b-bd052b116454 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:24.143618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a38a43e-2b48-4b3e-972b-bd052b116454 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:24.144771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a38a43e-2b48-4b3e-972b-bd052b116454 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:24.145435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a38a43e-2b48-4b3e-972b-bd052b116454 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:24.146031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a38a43e-2b48-4b3e-972b-bd052b116454 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:24.339349 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fa03d534-d31b-4c7b-a553-e84ac1bd86a3 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 204 len: 0 microversion: 2.1 time: 0.455155 Oct 11 04:30:24.339349 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2320/4426] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:30:23 2022] DELETE /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:30:24.350515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0a09116-6e1f-4ca7-8cda-1cbdfdf95731 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:24.352217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c0a09116-6e1f-4ca7-8cda-1cbdfdf95731 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:24.368793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0a09116-6e1f-4ca7-8cda-1cbdfdf95731 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:24.369731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0a09116-6e1f-4ca7-8cda-1cbdfdf95731 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:24.370812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0a09116-6e1f-4ca7-8cda-1cbdfdf95731 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:24.372270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0a09116-6e1f-4ca7-8cda-1cbdfdf95731 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:24.372949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0a09116-6e1f-4ca7-8cda-1cbdfdf95731 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:24.373803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0a09116-6e1f-4ca7-8cda-1cbdfdf95731 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:24.387843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:24.400633 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.network.security_group_api [None req-2a38a43e-2b48-4b3e-972b-bd052b116454 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Removing security group 8fcb806a-ffeb-440f-8e22-160b439e2872 from port f5a25831-8c8f-4114-8345-22fff4ba27bb Oct 11 04:30:24.706813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0a09116-6e1f-4ca7-8cda-1cbdfdf95731 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:24.720876 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c0a09116-6e1f-4ca7-8cda-1cbdfdf95731 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.379954 Oct 11 04:30:24.721184 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2321/4427] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:24 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:24.731445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-46b795e1-3015-4d43-8074-8653cf4252b2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:24.733846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-46b795e1-3015-4d43-8074-8653cf4252b2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:24.746377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46b795e1-3015-4d43-8074-8653cf4252b2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:24.747407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46b795e1-3015-4d43-8074-8653cf4252b2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:24.748820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46b795e1-3015-4d43-8074-8653cf4252b2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:24.749953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46b795e1-3015-4d43-8074-8653cf4252b2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:24.750453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46b795e1-3015-4d43-8074-8653cf4252b2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:24.750961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46b795e1-3015-4d43-8074-8653cf4252b2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:24.917015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-46b795e1-3015-4d43-8074-8653cf4252b2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:24.925114 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-46b795e1-3015-4d43-8074-8653cf4252b2 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1527 microversion: 2.1 time: 0.199503 Oct 11 04:30:24.925701 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2322/4428] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:24 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1527 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:24.939974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-81fcaf36-685f-4d53-8a42-a9ac5d3e8579 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:24.940583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-81fcaf36-685f-4d53-8a42-a9ac5d3e8579 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:24.946815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81fcaf36-685f-4d53-8a42-a9ac5d3e8579 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:24.947295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81fcaf36-685f-4d53-8a42-a9ac5d3e8579 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:24.948605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81fcaf36-685f-4d53-8a42-a9ac5d3e8579 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:24.949549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81fcaf36-685f-4d53-8a42-a9ac5d3e8579 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:24.950053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81fcaf36-685f-4d53-8a42-a9ac5d3e8579 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:24.950508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81fcaf36-685f-4d53-8a42-a9ac5d3e8579 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:25.220573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-81fcaf36-685f-4d53-8a42-a9ac5d3e8579 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:25.234984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-81fcaf36-685f-4d53-8a42-a9ac5d3e8579 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1314 microversion: 2.1 time: 0.302362 Oct 11 04:30:25.237239 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2323/4429] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:24 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:25.249071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-96175582-a5d8-43d0-8457-c90abd929901 req-5f2f26ae-60fc-4c14-a29c-d7b20c455daa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cbbf53c3-cd04-4cec-995b-d5ce999883ed", "tag": "aa553787-8d23-4efa-8d83-17aba549b7d3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:25.259093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-96175582-a5d8-43d0-8457-c90abd929901 req-5f2f26ae-60fc-4c14-a29c-d7b20c455daa service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:25.259747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-96175582-a5d8-43d0-8457-c90abd929901 req-5f2f26ae-60fc-4c14-a29c-d7b20c455daa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:25.260353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-96175582-a5d8-43d0-8457-c90abd929901 req-5f2f26ae-60fc-4c14-a29c-d7b20c455daa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:25.273528 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-96175582-a5d8-43d0-8457-c90abd929901 req-5f2f26ae-60fc-4c14-a29c-d7b20c455daa service nova] Creating event network-changed:aa553787-8d23-4efa-8d83-17aba549b7d3 for instance cbbf53c3-cd04-4cec-995b-d5ce999883ed on n-h1-860892-1 Oct 11 04:30:25.278935 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-96175582-a5d8-43d0-8457-c90abd929901 req-5f2f26ae-60fc-4c14-a29c-d7b20c455daa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040351 Oct 11 04:30:25.279753 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2324/4430] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:25.285020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:25.285893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:25.295438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:25.295934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:25.296377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:25.297083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:25.297540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:25.297968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:25.398660 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2a38a43e-2b48-4b3e-972b-bd052b116454 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7/action" status: 202 len: 0 microversion: 2.1 time: 1.281701 Oct 11 04:30:25.399266 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2107/4431] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:24 2022] POST /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7/action => generated 0 bytes in 1283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:30:25.704438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-28b86899-5381-40b9-8185-396ff835f752 tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Action: 'update', calling method: .version_select at 0x7fda19a020d0>, body: {"quota_set": {"ram": "5120"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:25.728519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:25.742423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:25.746125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:25.766492 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c006306b-d11a-4671-898d-9ac8526c2104 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2928 microversion: 2.32 time: 0.471157 Oct 11 04:30:25.766492 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2325/4432] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:25 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2928 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:25.784174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2ae2d043-1194-45bd-a068-473479a65ac0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:25.792755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2ae2d043-1194-45bd-a068-473479a65ac0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:25.796224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae2d043-1194-45bd-a068-473479a65ac0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:25.806685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae2d043-1194-45bd-a068-473479a65ac0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:25.807443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae2d043-1194-45bd-a068-473479a65ac0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:25.808669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae2d043-1194-45bd-a068-473479a65ac0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:25.809495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae2d043-1194-45bd-a068-473479a65ac0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:25.810330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2ae2d043-1194-45bd-a068-473479a65ac0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:25.837468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28b86899-5381-40b9-8185-396ff835f752 tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:25.839698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28b86899-5381-40b9-8185-396ff835f752 tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:25.843067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28b86899-5381-40b9-8185-396ff835f752 tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:25.844084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28b86899-5381-40b9-8185-396ff835f752 tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:25.845943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28b86899-5381-40b9-8185-396ff835f752 tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:25.846591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28b86899-5381-40b9-8185-396ff835f752 tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.031325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2ae2d043-1194-45bd-a068-473479a65ac0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:26.041181 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2ae2d043-1194-45bd-a068-473479a65ac0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1459 microversion: 2.1 time: 0.271852 Oct 11 04:30:26.044274 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2326/4433] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:25 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1459 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:26.051593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-3eb5a5d6-5f91-4186-ba6a-9b2e9297710f req-9268f713-7bba-4343-841b-aece226d3896 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1bf7aab-a813-4849-ba3b-3650c3a0b2e7", "tag": "f5a25831-8c8f-4114-8345-22fff4ba27bb"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:26.069714 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-28b86899-5381-40b9-8185-396ff835f752 tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/36909913804c4880b289e60a56a4e2a1" status: 200 len: 148 microversion: 2.57 time: 0.664405 Oct 11 04:30:26.071318 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2108/4434] 10.222.0.26 () {62 vars in 1303 bytes} [Tue Oct 11 04:30:25 2022] PUT /compute/v2.1/os-quota-sets/36909913804c4880b289e60a56a4e2a1 => generated 148 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:30:26.076347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-315aab30-f376-4839-adda-5d1a7ca68e92 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:26.077017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-315aab30-f376-4839-adda-5d1a7ca68e92 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:26.082148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3eb5a5d6-5f91-4186-ba6a-9b2e9297710f req-9268f713-7bba-4343-841b-aece226d3896 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.088063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3eb5a5d6-5f91-4186-ba6a-9b2e9297710f req-9268f713-7bba-4343-841b-aece226d3896 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.088063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3eb5a5d6-5f91-4186-ba6a-9b2e9297710f req-9268f713-7bba-4343-841b-aece226d3896 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.088315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315aab30-f376-4839-adda-5d1a7ca68e92 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.088315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315aab30-f376-4839-adda-5d1a7ca68e92 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.088315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315aab30-f376-4839-adda-5d1a7ca68e92 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.088315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315aab30-f376-4839-adda-5d1a7ca68e92 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.088315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315aab30-f376-4839-adda-5d1a7ca68e92 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.088315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-315aab30-f376-4839-adda-5d1a7ca68e92 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.113668 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-3eb5a5d6-5f91-4186-ba6a-9b2e9297710f req-9268f713-7bba-4343-841b-aece226d3896 service nova] Creating event network-changed:f5a25831-8c8f-4114-8345-22fff4ba27bb for instance c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 on n-h2-860892-1 Oct 11 04:30:26.122968 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-3eb5a5d6-5f91-4186-ba6a-9b2e9297710f req-9268f713-7bba-4343-841b-aece226d3896 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076062 Oct 11 04:30:26.123753 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2327/4435] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:26.133827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22407d0b-bafd-406d-8223-30f8a3428e0a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:26.134682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22407d0b-bafd-406d-8223-30f8a3428e0a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:26.145681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22407d0b-bafd-406d-8223-30f8a3428e0a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.146368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22407d0b-bafd-406d-8223-30f8a3428e0a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.147279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22407d0b-bafd-406d-8223-30f8a3428e0a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.148008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22407d0b-bafd-406d-8223-30f8a3428e0a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.148466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22407d0b-bafd-406d-8223-30f8a3428e0a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.149585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22407d0b-bafd-406d-8223-30f8a3428e0a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.351738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22407d0b-bafd-406d-8223-30f8a3428e0a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:26.360599 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22407d0b-bafd-406d-8223-30f8a3428e0a tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1527 microversion: 2.1 time: 0.234192 Oct 11 04:30:26.361375 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2328/4436] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:26 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1527 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:26.366823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af473ec1-1c53-4077-b0c5-daa05b73d3fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:26.367837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af473ec1-1c53-4077-b0c5-daa05b73d3fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:26.381260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af473ec1-1c53-4077-b0c5-daa05b73d3fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.382428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af473ec1-1c53-4077-b0c5-daa05b73d3fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.383228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af473ec1-1c53-4077-b0c5-daa05b73d3fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.384110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af473ec1-1c53-4077-b0c5-daa05b73d3fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.384757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af473ec1-1c53-4077-b0c5-daa05b73d3fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.385371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af473ec1-1c53-4077-b0c5-daa05b73d3fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.581062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-315aab30-f376-4839-adda-5d1a7ca68e92 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:26.597490 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-315aab30-f376-4839-adda-5d1a7ca68e92 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.524873 Oct 11 04:30:26.598294 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2109/4437] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:26 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:26.623236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c0350797-748d-4f06-bd25-a91e9508a43f tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Calling method '.version_select at 0x7fda1a9c9c10>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:26.721296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-af473ec1-1c53-4077-b0c5-daa05b73d3fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:26.750874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0350797-748d-4f06-bd25-a91e9508a43f tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.751279 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af473ec1-1c53-4077-b0c5-daa05b73d3fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.388440 Oct 11 04:30:26.751892 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2329/4438] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:26 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:26.759463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0350797-748d-4f06-bd25-a91e9508a43f tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.761908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0350797-748d-4f06-bd25-a91e9508a43f tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.766475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5814c0b3-4b00-4233-87fe-45f7e6752992 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:26.767510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0350797-748d-4f06-bd25-a91e9508a43f tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.769766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0350797-748d-4f06-bd25-a91e9508a43f tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.770411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0350797-748d-4f06-bd25-a91e9508a43f tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.774097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5814c0b3-4b00-4233-87fe-45f7e6752992 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:26.783995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5814c0b3-4b00-4233-87fe-45f7e6752992 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.784444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5814c0b3-4b00-4233-87fe-45f7e6752992 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.784988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5814c0b3-4b00-4233-87fe-45f7e6752992 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.785820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5814c0b3-4b00-4233-87fe-45f7e6752992 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.786417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5814c0b3-4b00-4233-87fe-45f7e6752992 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.786937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5814c0b3-4b00-4233-87fe-45f7e6752992 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.808937 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c0350797-748d-4f06-bd25-a91e9508a43f tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/36909913804c4880b289e60a56a4e2a1/detail" status: 200 len: 463 microversion: 2.57 time: 0.200164 Oct 11 04:30:26.814262 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2110/4439] 10.222.0.26 () {60 vars in 1304 bytes} [Tue Oct 11 04:30:26 2022] GET /compute/v2.1/os-quota-sets/36909913804c4880b289e60a56a4e2a1/detail => generated 463 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:30:26.823149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-cb29c090-cc5c-40f8-ad80-3435706cea4b req-00e59d36-0d9f-4e1b-802e-dc1b2c49efe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-unplugged", "status": "completed", "tag": "12f46a1d-3f56-4b9a-ac0c-89ceb542d3f7"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:26.840133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cb29c090-cc5c-40f8-ad80-3435706cea4b req-00e59d36-0d9f-4e1b-802e-dc1b2c49efe1 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.841573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cb29c090-cc5c-40f8-ad80-3435706cea4b req-00e59d36-0d9f-4e1b-802e-dc1b2c49efe1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.841928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cb29c090-cc5c-40f8-ad80-3435706cea4b req-00e59d36-0d9f-4e1b-802e-dc1b2c49efe1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.847656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:26.864248 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-cb29c090-cc5c-40f8-ad80-3435706cea4b req-00e59d36-0d9f-4e1b-802e-dc1b2c49efe1 service nova] Creating event network-vif-unplugged:12f46a1d-3f56-4b9a-ac0c-89ceb542d3f7 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:30:26.874837 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-cb29c090-cc5c-40f8-ad80-3435706cea4b req-00e59d36-0d9f-4e1b-802e-dc1b2c49efe1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061820 Oct 11 04:30:26.878247 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2111/4440] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:26.889028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d4cf4162-e77a-4db3-91a0-99fd6d350591 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:26.893643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d4cf4162-e77a-4db3-91a0-99fd6d350591 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:26.911721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4cf4162-e77a-4db3-91a0-99fd6d350591 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.912226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4cf4162-e77a-4db3-91a0-99fd6d350591 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.912674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4cf4162-e77a-4db3-91a0-99fd6d350591 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:26.913465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4cf4162-e77a-4db3-91a0-99fd6d350591 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:26.913933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4cf4162-e77a-4db3-91a0-99fd6d350591 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:26.914387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4cf4162-e77a-4db3-91a0-99fd6d350591 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:27.068284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:27.098954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5814c0b3-4b00-4233-87fe-45f7e6752992 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:27.110682 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5814c0b3-4b00-4233-87fe-45f7e6752992 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1314 microversion: 2.1 time: 0.357666 Oct 11 04:30:27.114020 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2330/4441] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:26 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1314 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:27.126115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:27.129145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:27.147159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:27.147909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:27.148650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:27.150291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:27.151026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:27.159355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:27.471864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d4cf4162-e77a-4db3-91a0-99fd6d350591 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:27.486312 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d4cf4162-e77a-4db3-91a0-99fd6d350591 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.604895 Oct 11 04:30:27.490391 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2112/4442] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:26 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:27.505726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Action: 'update', calling method: .version_select at 0x7fda18e481f0>, body: {"quota_set": {"ram": "2048"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:27.658235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:27.686986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:27.687571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:27.687915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:27.704188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:27.711049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:27.711557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:27.712009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:27.717861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:27.735519 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-717f4e22-dea4-43e3-bcb5-db6e5e8f2542 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2907 microversion: 2.32 time: 0.619196 Oct 11 04:30:27.738618 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2331/4443] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:27 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2907 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:27.762180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:27.763808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:27.784234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:27.785014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:27.785642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:27.786762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:27.787399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:27.787985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:27.828839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=60 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:27.914080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:27.920114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:27.920634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:27.924570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:27.925055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:27.925495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:27.938916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:27.939442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:27.939884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:27.945730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lazy-loading 'fault' on Instance uuid e11d6052-2e14-4dcb-9129-22f81bfabf18 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:30:28.054848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2c40cc9968244c0fb6c81301e775b17e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6d32830b844346fc9ae21fe93340e543', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:28.067876 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a328396c-a94c-4b2d-9d94-26874f847758 tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 200 len: 1314 microversion: 2.1 time: 0.327801 Oct 11 04:30:28.069139 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2332/4444] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:27 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 1314 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:28.080891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-02cabf92-490a-4b82-ad71-4efc0cadd85b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:28.087330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-02cabf92-490a-4b82-ad71-4efc0cadd85b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:28.112909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cabf92-490a-4b82-ad71-4efc0cadd85b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:28.114424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cabf92-490a-4b82-ad71-4efc0cadd85b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:28.115010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cabf92-490a-4b82-ad71-4efc0cadd85b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:28.116266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cabf92-490a-4b82-ad71-4efc0cadd85b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:28.118062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cabf92-490a-4b82-ad71-4efc0cadd85b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:28.120045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cabf92-490a-4b82-ad71-4efc0cadd85b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:28.178967 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5461062d-8fd4-4765-a1d5-126223eab1db tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/36909913804c4880b289e60a56a4e2a1?user_id=fe8eaf108ad0478f928e9cb4adc58a2f" status: 200 len: 148 microversion: 2.57 time: 0.686988 Oct 11 04:30:28.184264 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2113/4445] 10.222.0.26 () {62 vars in 1384 bytes} [Tue Oct 11 04:30:27 2022] PUT /compute/v2.1/os-quota-sets/36909913804c4880b289e60a56a4e2a1?user_id=fe8eaf108ad0478f928e9cb4adc58a2f => generated 148 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:30:28.214834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d872380-a141-494f-b5f1-3cdd4aef973c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:28.216584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7d872380-a141-494f-b5f1-3cdd4aef973c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:28.227791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d872380-a141-494f-b5f1-3cdd4aef973c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:28.228669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d872380-a141-494f-b5f1-3cdd4aef973c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:28.229357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d872380-a141-494f-b5f1-3cdd4aef973c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:28.230711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d872380-a141-494f-b5f1-3cdd4aef973c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:28.231430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d872380-a141-494f-b5f1-3cdd4aef973c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:28.232097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d872380-a141-494f-b5f1-3cdd4aef973c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:28.634776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d872380-a141-494f-b5f1-3cdd4aef973c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:28.637261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-02cabf92-490a-4b82-ad71-4efc0cadd85b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:28.650415 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-02cabf92-490a-4b82-ad71-4efc0cadd85b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.578444 Oct 11 04:30:28.652642 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d872380-a141-494f-b5f1-3cdd4aef973c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.466656 Oct 11 04:30:28.686535 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2333/4446] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:28 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:28.686655 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2114/4447] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:28 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:28.686747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5618b70c-1f5e-4294-9eae-a26c3ce5acc8 req-b4d2c428-58db-4f0b-825c-2b81f1274b99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-deleted", "tag": "c90ce6b2-656f-4df4-b90a-a7af54d53844"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:28.694442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5618b70c-1f5e-4294-9eae-a26c3ce5acc8 req-b4d2c428-58db-4f0b-825c-2b81f1274b99 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:28.696461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5618b70c-1f5e-4294-9eae-a26c3ce5acc8 req-b4d2c428-58db-4f0b-825c-2b81f1274b99 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:28.697092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5618b70c-1f5e-4294-9eae-a26c3ce5acc8 req-b4d2c428-58db-4f0b-825c-2b81f1274b99 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:28.699131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c79683db-a652-44af-8ca2-a9a1c91bdfec tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:28.701598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c79683db-a652-44af-8ca2-a9a1c91bdfec tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:28.724242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79683db-a652-44af-8ca2-a9a1c91bdfec tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:28.727320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79683db-a652-44af-8ca2-a9a1c91bdfec tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:28.728156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79683db-a652-44af-8ca2-a9a1c91bdfec tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:28.730623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79683db-a652-44af-8ca2-a9a1c91bdfec tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:28.731244 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5618b70c-1f5e-4294-9eae-a26c3ce5acc8 req-b4d2c428-58db-4f0b-825c-2b81f1274b99 service nova] Creating event network-vif-deleted:c90ce6b2-656f-4df4-b90a-a7af54d53844 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:30:28.735280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79683db-a652-44af-8ca2-a9a1c91bdfec tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:28.736511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c79683db-a652-44af-8ca2-a9a1c91bdfec tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:28.743683 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5618b70c-1f5e-4294-9eae-a26c3ce5acc8 req-b4d2c428-58db-4f0b-825c-2b81f1274b99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081336 Oct 11 04:30:28.746096 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2334/4448] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:28.763835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-349bdc6f-81a1-4c08-b08d-58acd20622fa req-74cb3798-733e-4178-941f-2784831e5d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e11d6052-2e14-4dcb-9129-22f81bfabf18", "name": "network-vif-deleted", "tag": "e094d5ba-4877-43fc-8550-c9438d490e5b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:28.786488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-349bdc6f-81a1-4c08-b08d-58acd20622fa req-74cb3798-733e-4178-941f-2784831e5d3e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:28.792282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-349bdc6f-81a1-4c08-b08d-58acd20622fa req-74cb3798-733e-4178-941f-2784831e5d3e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:28.792282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-349bdc6f-81a1-4c08-b08d-58acd20622fa req-74cb3798-733e-4178-941f-2784831e5d3e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:28.820419 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-349bdc6f-81a1-4c08-b08d-58acd20622fa req-74cb3798-733e-4178-941f-2784831e5d3e service nova] Creating event network-vif-deleted:e094d5ba-4877-43fc-8550-c9438d490e5b for instance e11d6052-2e14-4dcb-9129-22f81bfabf18 on n-h2-860892-1 Oct 11 04:30:28.832304 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-349bdc6f-81a1-4c08-b08d-58acd20622fa req-74cb3798-733e-4178-941f-2784831e5d3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081895 Oct 11 04:30:28.835722 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2335/4449] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:28.845622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-76537688-f0c5-4d87-9b4f-ca67a30138eb tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] Calling method '.version_select at 0x7fda194ef3a0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:29.001676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:29.045721 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-76537688-f0c5-4d87-9b4f-ca67a30138eb tempest-QuotasAdminTestV257-1362134183 tempest-QuotasAdminTestV257-1362134183-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/36909913804c4880b289e60a56a4e2a1?user_id=fe8eaf108ad0478f928e9cb4adc58a2f" status: 200 len: 190 microversion: 2.57 time: 0.208301 Oct 11 04:30:29.047482 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2336/4450] 10.222.0.26 () {60 vars in 1364 bytes} [Tue Oct 11 04:30:28 2022] GET /compute/v2.1/os-quota-sets/36909913804c4880b289e60a56a4e2a1?user_id=fe8eaf108ad0478f928e9cb4adc58a2f => generated 190 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:30:29.090912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-85974ae7-49ae-4638-8e46-2220e7b2efe9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:29.097810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-85974ae7-49ae-4638-8e46-2220e7b2efe9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:29.113618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85974ae7-49ae-4638-8e46-2220e7b2efe9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:29.115045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85974ae7-49ae-4638-8e46-2220e7b2efe9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:29.117258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85974ae7-49ae-4638-8e46-2220e7b2efe9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:29.126083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85974ae7-49ae-4638-8e46-2220e7b2efe9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:29.126083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85974ae7-49ae-4638-8e46-2220e7b2efe9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:29.126083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-85974ae7-49ae-4638-8e46-2220e7b2efe9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:29.250475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c79683db-a652-44af-8ca2-a9a1c91bdfec tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:29.270515 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c79683db-a652-44af-8ca2-a9a1c91bdfec tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1314 microversion: 2.1 time: 0.597876 Oct 11 04:30:29.282493 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2115/4451] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:28 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:29.293284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:29.295112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:29.320665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:29.321557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:29.322167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:29.327603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:29.328420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:29.329030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:29.683517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:29.699111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:29.706111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:29.710890 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-13ddc2b1-f34c-4790-8633-8819a83ecaf0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2747 microversion: 2.32 time: 0.431821 Oct 11 04:30:29.711799 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2116/4452] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:29 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2747 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:29.732212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c233d228-5b98-476a-a441-346b337f7c6f req-feb32a32-1338-44d2-9eec-45a987b3b5ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-unplugged", "status": "completed", "tag": "cef26b29-2cac-49a3-a867-7f255a006168"}, {"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-unplugged", "status": "completed", "tag": "c90ce6b2-656f-4df4-b90a-a7af54d53844"}, {"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-unplugged", "status": "completed", "tag": "d5ed01b4-6c79-4f61-b2fb-415cf63f9a6f"}, {"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-unplugged", "status": "completed", "tag": "1712ec47-14a1-4060-802b-107a47cc9b9d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:29.777772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c233d228-5b98-476a-a441-346b337f7c6f req-feb32a32-1338-44d2-9eec-45a987b3b5ba service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:29.777772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c233d228-5b98-476a-a441-346b337f7c6f req-feb32a32-1338-44d2-9eec-45a987b3b5ba service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:29.780273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c233d228-5b98-476a-a441-346b337f7c6f req-feb32a32-1338-44d2-9eec-45a987b3b5ba service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:29.820718 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c233d228-5b98-476a-a441-346b337f7c6f req-feb32a32-1338-44d2-9eec-45a987b3b5ba service nova] Creating event network-vif-unplugged:cef26b29-2cac-49a3-a867-7f255a006168 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:30:29.821726 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c233d228-5b98-476a-a441-346b337f7c6f req-feb32a32-1338-44d2-9eec-45a987b3b5ba service nova] Creating event network-vif-unplugged:c90ce6b2-656f-4df4-b90a-a7af54d53844 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:30:29.824502 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c233d228-5b98-476a-a441-346b337f7c6f req-feb32a32-1338-44d2-9eec-45a987b3b5ba service nova] Creating event network-vif-unplugged:d5ed01b4-6c79-4f61-b2fb-415cf63f9a6f for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:30:29.832107 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c233d228-5b98-476a-a441-346b337f7c6f req-feb32a32-1338-44d2-9eec-45a987b3b5ba service nova] Creating event network-vif-unplugged:1712ec47-14a1-4060-802b-107a47cc9b9d for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:30:29.860122 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c233d228-5b98-476a-a441-346b337f7c6f req-feb32a32-1338-44d2-9eec-45a987b3b5ba service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 704 microversion: 2.1 time: 0.144894 Oct 11 04:30:29.869196 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2117/4453] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 704 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:29.884635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:29.889384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] [instance: e11d6052-2e14-4dcb-9129-22f81bfabf18] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:29.901476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-85974ae7-49ae-4638-8e46-2220e7b2efe9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:29.911786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:29.916281 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-85974ae7-49ae-4638-8e46-2220e7b2efe9 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.867775 Oct 11 04:30:29.917825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:29.918470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:29.919377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:29.919838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:29.920328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:29.945477 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2337/4454] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:29 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:29.947060 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] HTTP exception thrown: Instance e11d6052-2e14-4dcb-9129-22f81bfabf18 could not be found. Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Request method failure captured: Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 HTTP/1.1 Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPFHuieVpd_MlT8NdCyValjnl43mo-C04oH7GQyDe1AI--VaQw0zqc8B97ssnkLLj9WDnhzKBNCW5JKsiQxjXuY9w-3uNIqH9Tt4h10RXl881gRhw4nR6nMa9ss8KcjxmMUF3_T-81pVQAicGEHcgH-tnxz6Dv_8HTc05cp7cYswnjk Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 6d32830b844346fc9ae21fe93340e543 Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerAddressesNegativeTestJSON-1753576683 Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6d32830b844346fc9ae21fe93340e543"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6d32830b844346fc9ae21fe93340e543"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d32830b844346fc9ae21fe93340e543"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6d32830b844346fc9ae21fe93340e543"}]}] Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerAddressesNegativeTestJSON-1753576683 Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 6d32830b844346fc9ae21fe93340e543 Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerAddressesNegativeTestJSON-1753576683 Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerAddressesNegativeTestJSON-1753576683-project Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 2c40cc9968244c0fb6c81301e775b17e Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerAddressesNegativeTestJSON-1753576683-project Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance e11d6052-2e14-4dcb-9129-22f81bfabf18 could not be found. Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e11d6052-2e14-4dcb-9129-22f81bfabf18'} Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e11d6052-2e14-4dcb-9129-22f81bfabf18 could not be found. Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e11d6052-2e14-4dcb-9129-22f81bfabf18 could not be found. Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:29.949692 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:29.953232 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:29.953232 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:29.953232 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:29.953232 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:29.953232 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:30:29.953232 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:30:29.953232 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e11d6052-2e14-4dcb-9129-22f81bfabf18 could not be found. Oct 11 04:30:29.953232 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:29.955389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] Returning 404 to user: Instance e11d6052-2e14-4dcb-9129-22f81bfabf18 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:30:29.956917 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b73e9a72-03f3-4c76-b6aa-7826d8cf842d tempest-ServerAddressesNegativeTestJSON-1753576683 tempest-ServerAddressesNegativeTestJSON-1753576683-project] 10.222.0.26 "GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18" status: 404 len: 111 microversion: 2.1 time: 0.082929 Oct 11 04:30:29.958014 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2118/4455] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:29 2022] GET /compute/v2.1/servers/e11d6052-2e14-4dcb-9129-22f81bfabf18 => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:30:29.976655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bf46dc67-a9e4-4578-ba28-b039b67f2379 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:29.977861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bf46dc67-a9e4-4578-ba28-b039b67f2379 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:29.986236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf46dc67-a9e4-4578-ba28-b039b67f2379 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:29.987164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf46dc67-a9e4-4578-ba28-b039b67f2379 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:29.987960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf46dc67-a9e4-4578-ba28-b039b67f2379 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:29.989107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf46dc67-a9e4-4578-ba28-b039b67f2379 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:29.990000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf46dc67-a9e4-4578-ba28-b039b67f2379 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:29.990722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf46dc67-a9e4-4578-ba28-b039b67f2379 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:30.101088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1040849600", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "30252624-67f7-4bbb-9346-39722e0301e1"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:30.201421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] validate_networks() for [('30252624-67f7-4bbb-9346-39722e0301e1', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:30:30.455184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf46dc67-a9e4-4578-ba28-b039b67f2379 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:30.476321 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bf46dc67-a9e4-4578-ba28-b039b67f2379 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.522776 Oct 11 04:30:30.481423 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2338/4456] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:29 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:30.498757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0130ea70-8f16-49bd-825b-05c55c200f2b tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:30.499612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0130ea70-8f16-49bd-825b-05c55c200f2b tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:30.518652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0130ea70-8f16-49bd-825b-05c55c200f2b tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:30.523704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0130ea70-8f16-49bd-825b-05c55c200f2b tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:30.524495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0130ea70-8f16-49bd-825b-05c55c200f2b tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:30.525401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0130ea70-8f16-49bd-825b-05c55c200f2b tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:30.533419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0130ea70-8f16-49bd-825b-05c55c200f2b tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:30.533419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0130ea70-8f16-49bd-825b-05c55c200f2b tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:30.890868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0130ea70-8f16-49bd-825b-05c55c200f2b tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:30.905636 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0130ea70-8f16-49bd-825b-05c55c200f2b tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1314 microversion: 2.1 time: 0.421256 Oct 11 04:30:30.918569 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2339/4457] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:30 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1314 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:30.918569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:30.918569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:30.935732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:30.939011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:30.941088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:30.945695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:30.946414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:30.946983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:31.608193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:31.621833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:31.625698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:31.628251 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e43c9ba-96ce-49a0-af6a-3deeaf805e01 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2701 microversion: 2.32 time: 0.719914 Oct 11 04:30:31.637538 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2340/4458] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:30 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2701 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:31.662711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4016b863-9db2-47dd-8627-62da0116b02f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:31.667024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4016b863-9db2-47dd-8627-62da0116b02f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:31.678847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4016b863-9db2-47dd-8627-62da0116b02f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:31.683077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4016b863-9db2-47dd-8627-62da0116b02f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:31.686156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4016b863-9db2-47dd-8627-62da0116b02f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:31.686156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4016b863-9db2-47dd-8627-62da0116b02f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:31.686156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4016b863-9db2-47dd-8627-62da0116b02f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:31.690995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4016b863-9db2-47dd-8627-62da0116b02f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:31.771275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:32.127480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:30:32.127993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:30:32.128451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:30:32.128854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:30:32.129646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:30:32.135944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4016b863-9db2-47dd-8627-62da0116b02f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:32.145090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=95 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:32.148844 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4016b863-9db2-47dd-8627-62da0116b02f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.489918 Oct 11 04:30:32.154061 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2341/4459] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:31 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:32.156827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:32.161182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:32.161910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:32.162857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:32.169332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:32.169863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-efe6b768-5816-44b0-8f95-c16af45f46cf req-a542245b-26d5-4f06-a4e5-8d0f0cc53a5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-deleted", "tag": "d5ed01b4-6c79-4f61-b2fb-415cf63f9a6f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:32.170466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:32.196823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-efe6b768-5816-44b0-8f95-c16af45f46cf req-a542245b-26d5-4f06-a4e5-8d0f0cc53a5c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:32.198589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-efe6b768-5816-44b0-8f95-c16af45f46cf req-a542245b-26d5-4f06-a4e5-8d0f0cc53a5c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:32.199200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-efe6b768-5816-44b0-8f95-c16af45f46cf req-a542245b-26d5-4f06-a4e5-8d0f0cc53a5c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:32.212490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=23 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:32.224635 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-efe6b768-5816-44b0-8f95-c16af45f46cf req-a542245b-26d5-4f06-a4e5-8d0f0cc53a5c service nova] Creating event network-vif-deleted:d5ed01b4-6c79-4f61-b2fb-415cf63f9a6f for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:30:32.261518 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-efe6b768-5816-44b0-8f95-c16af45f46cf req-a542245b-26d5-4f06-a4e5-8d0f0cc53a5c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090686 Oct 11 04:30:32.262887 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2342/4460] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:32.266360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for project 9a2974866e964ca2864c978d2270bd77. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:30:32.273146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5834eb90-2408-4b41-beb9-e2b7feb97bf2 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:32.274087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5834eb90-2408-4b41-beb9-e2b7feb97bf2 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:32.277617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Getting quotas for user 5feceb4a60434064a4fd08f7cc637f32 and project 9a2974866e964ca2864c978d2270bd77. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:30:32.286480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5834eb90-2408-4b41-beb9-e2b7feb97bf2 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:32.286976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5834eb90-2408-4b41-beb9-e2b7feb97bf2 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:32.291004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5834eb90-2408-4b41-beb9-e2b7feb97bf2 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:32.292055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5834eb90-2408-4b41-beb9-e2b7feb97bf2 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:32.298011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5834eb90-2408-4b41-beb9-e2b7feb97bf2 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:32.302906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5834eb90-2408-4b41-beb9-e2b7feb97bf2 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:32.313632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:30:32.318837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:30:32.578633 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-beb3422a-922b-4a90-8e81-69372d170a19 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.480222 Oct 11 04:30:32.588656 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2119/4461] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:30:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2492 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:30:32.600639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0a9d858b-2545-4fa9-acd2-04cdd42c86f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:32.602830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0a9d858b-2545-4fa9-acd2-04cdd42c86f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:32.982312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0a9d858b-2545-4fa9-acd2-04cdd42c86f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:33.013388 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0a9d858b-2545-4fa9-acd2-04cdd42c86f4 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1215 microversion: 2.1 time: 0.406256 Oct 11 04:30:33.013388 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2120/4462] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:32 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1215 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:33.013388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:33.015474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:33.045749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:33.046162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:33.046639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:33.047357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:33.047884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:33.048466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:33.279540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5834eb90-2408-4b41-beb9-e2b7feb97bf2 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:33.300539 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5834eb90-2408-4b41-beb9-e2b7feb97bf2 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1314 microversion: 2.1 time: 1.036018 Oct 11 04:30:33.306242 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2343/4463] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:32 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1314 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:33.321811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a0165e87-3f3f-49ca-9b32-71f06de4ff5a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:33.322957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a0165e87-3f3f-49ca-9b32-71f06de4ff5a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:33.358217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0165e87-3f3f-49ca-9b32-71f06de4ff5a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:33.358967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0165e87-3f3f-49ca-9b32-71f06de4ff5a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:33.359877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0165e87-3f3f-49ca-9b32-71f06de4ff5a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:33.363064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0165e87-3f3f-49ca-9b32-71f06de4ff5a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:33.363860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0165e87-3f3f-49ca-9b32-71f06de4ff5a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:33.364522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0165e87-3f3f-49ca-9b32-71f06de4ff5a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:33.847048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:33.863862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:33.868042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:33.869185 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3e75d356-fc92-4fe3-8b57-aad30d4081d0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2367 microversion: 2.32 time: 0.870877 Oct 11 04:30:33.895824 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2121/4464] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:32 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2367 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:33.911267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a0165e87-3f3f-49ca-9b32-71f06de4ff5a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:33.923143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a0165e87-3f3f-49ca-9b32-71f06de4ff5a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.620221 Oct 11 04:30:33.923734 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2344/4465] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:33 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:34.030405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eeb0c306-dedc-49c3-b1e6-0214f8e0cd63 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:34.031346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eeb0c306-dedc-49c3-b1e6-0214f8e0cd63 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:34.300226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a158622d-44ce-495b-8203-d6a890d9d915 req-c9238177-89f9-4f6e-b565-1ce9825ba128 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-deleted", "tag": "1712ec47-14a1-4060-802b-107a47cc9b9d"}, {"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-deleted", "tag": "12f46a1d-3f56-4b9a-ac0c-89ceb542d3f7"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:34.301717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eeb0c306-dedc-49c3-b1e6-0214f8e0cd63 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:34.309400 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eeb0c306-dedc-49c3-b1e6-0214f8e0cd63 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1215 microversion: 2.1 time: 0.283144 Oct 11 04:30:34.323430 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2122/4466] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:34 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1215 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:34.331891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a158622d-44ce-495b-8203-d6a890d9d915 req-c9238177-89f9-4f6e-b565-1ce9825ba128 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:34.332641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a158622d-44ce-495b-8203-d6a890d9d915 req-c9238177-89f9-4f6e-b565-1ce9825ba128 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:34.333184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a158622d-44ce-495b-8203-d6a890d9d915 req-c9238177-89f9-4f6e-b565-1ce9825ba128 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:34.337726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-130cd0b9-64b9-441c-a248-e32fff66c282 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:34.338415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-130cd0b9-64b9-441c-a248-e32fff66c282 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:34.353079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-130cd0b9-64b9-441c-a248-e32fff66c282 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:34.353587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-130cd0b9-64b9-441c-a248-e32fff66c282 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:34.354519 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a158622d-44ce-495b-8203-d6a890d9d915 req-c9238177-89f9-4f6e-b565-1ce9825ba128 service nova] Creating event network-vif-deleted:1712ec47-14a1-4060-802b-107a47cc9b9d for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:30:34.356449 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a158622d-44ce-495b-8203-d6a890d9d915 req-c9238177-89f9-4f6e-b565-1ce9825ba128 service nova] Creating event network-vif-deleted:12f46a1d-3f56-4b9a-ac0c-89ceb542d3f7 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:30:34.357675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-130cd0b9-64b9-441c-a248-e32fff66c282 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:34.359756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-130cd0b9-64b9-441c-a248-e32fff66c282 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:34.360237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-130cd0b9-64b9-441c-a248-e32fff66c282 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:34.362425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-130cd0b9-64b9-441c-a248-e32fff66c282 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:34.363428 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a158622d-44ce-495b-8203-d6a890d9d915 req-c9238177-89f9-4f6e-b565-1ce9825ba128 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.083654 Oct 11 04:30:34.367735 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2345/4467] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:34.904425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:34.908567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:34.968561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:34.969272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:34.969721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:34.976326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:34.979506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:34.983369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:35.141140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:35.188341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:35.192669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:35.201637 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-975e0021-7c53-453a-879b-8783a2d30915 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 2027 microversion: 2.32 time: 0.302167 Oct 11 04:30:35.206802 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2346/4468] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:34 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 2027 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:30:35.221147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-67f61721-c693-46d3-bdfd-6081e2f81993 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:35.222018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-67f61721-c693-46d3-bdfd-6081e2f81993 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:35.253013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67f61721-c693-46d3-bdfd-6081e2f81993 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:35.258607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67f61721-c693-46d3-bdfd-6081e2f81993 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:35.259582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67f61721-c693-46d3-bdfd-6081e2f81993 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:35.277957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67f61721-c693-46d3-bdfd-6081e2f81993 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:35.280197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67f61721-c693-46d3-bdfd-6081e2f81993 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:35.282455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67f61721-c693-46d3-bdfd-6081e2f81993 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:35.435335 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 04:30:35.435944 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 04:30:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd (ip 10.222.0.26) !!! Oct 11 04:30:35.698796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-67f61721-c693-46d3-bdfd-6081e2f81993 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:35.724475 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-67f61721-c693-46d3-bdfd-6081e2f81993 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.512162 Oct 11 04:30:35.725316 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2347/4469] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:35 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:35.740006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-056dec73-daa4-439c-9e0c-58689e25049d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:35.744638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-056dec73-daa4-439c-9e0c-58689e25049d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:35.773497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056dec73-daa4-439c-9e0c-58689e25049d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:35.778152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056dec73-daa4-439c-9e0c-58689e25049d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:35.778152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056dec73-daa4-439c-9e0c-58689e25049d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:35.778152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056dec73-daa4-439c-9e0c-58689e25049d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:35.778152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056dec73-daa4-439c-9e0c-58689e25049d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:35.778152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056dec73-daa4-439c-9e0c-58689e25049d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:35.879030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-130cd0b9-64b9-441c-a248-e32fff66c282 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:35.893332 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-130cd0b9-64b9-441c-a248-e32fff66c282 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1314 microversion: 2.1 time: 1.561671 Oct 11 04:30:35.894111 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2123/4470] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:34 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1314 bytes in 1570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:35.936317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-056dec73-daa4-439c-9e0c-58689e25049d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:35.974850 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-056dec73-daa4-439c-9e0c-58689e25049d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1267 microversion: 2.1 time: 0.243311 Oct 11 04:30:35.979175 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2348/4471] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:35 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1267 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:36.243480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:36.245001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:36.269557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:36.272865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:36.276851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:36.279770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:36.280785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:36.282964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:36.345140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a3a9d481-5675-45bf-96ee-a77e508025c5 req-d3b5175c-ac2e-4d30-aee8-048c8b68f85d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbf53c3-cd04-4cec-995b-d5ce999883ed", "name": "network-vif-plugged", "status": "completed", "tag": "aa553787-8d23-4efa-8d83-17aba549b7d3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:36.396319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a3a9d481-5675-45bf-96ee-a77e508025c5 req-d3b5175c-ac2e-4d30-aee8-048c8b68f85d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:36.396950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a3a9d481-5675-45bf-96ee-a77e508025c5 req-d3b5175c-ac2e-4d30-aee8-048c8b68f85d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:36.398216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a3a9d481-5675-45bf-96ee-a77e508025c5 req-d3b5175c-ac2e-4d30-aee8-048c8b68f85d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:36.446142 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a3a9d481-5675-45bf-96ee-a77e508025c5 req-d3b5175c-ac2e-4d30-aee8-048c8b68f85d service nova] Creating event network-vif-plugged:aa553787-8d23-4efa-8d83-17aba549b7d3 for instance cbbf53c3-cd04-4cec-995b-d5ce999883ed on n-h1-860892-1 Oct 11 04:30:36.458343 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a3a9d481-5675-45bf-96ee-a77e508025c5 req-d3b5175c-ac2e-4d30-aee8-048c8b68f85d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.118585 Oct 11 04:30:36.459377 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2349/4472] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:36.598835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:36.615370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:36.618276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:36.624889 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b1434d75-d071-408d-8813-99d9e7966540 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.388843 Oct 11 04:30:36.643462 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2124/4473] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:36 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:36.686205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e755572d-bcdd-4a55-a0c5-99d4e9955b86 req-30968160-8ed8-4efb-994c-e59874ef6dc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "195aa0db-57d6-41c8-ba3c-474800a0d2b4", "name": "network-vif-deleted", "tag": "cef26b29-2cac-49a3-a867-7f255a006168"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:36.711315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e755572d-bcdd-4a55-a0c5-99d4e9955b86 req-30968160-8ed8-4efb-994c-e59874ef6dc5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:36.718225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e755572d-bcdd-4a55-a0c5-99d4e9955b86 req-30968160-8ed8-4efb-994c-e59874ef6dc5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:36.719583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e755572d-bcdd-4a55-a0c5-99d4e9955b86 req-30968160-8ed8-4efb-994c-e59874ef6dc5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:36.736602 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e755572d-bcdd-4a55-a0c5-99d4e9955b86 req-30968160-8ed8-4efb-994c-e59874ef6dc5 service nova] Creating event network-vif-deleted:cef26b29-2cac-49a3-a867-7f255a006168 for instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 on n-h2-860892-1 Oct 11 04:30:36.743309 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e755572d-bcdd-4a55-a0c5-99d4e9955b86 req-30968160-8ed8-4efb-994c-e59874ef6dc5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064016 Oct 11 04:30:36.744773 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2350/4474] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:36.768457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98aa842d-4ef6-4a2c-937f-4a7f5da57bf7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:36.771007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98aa842d-4ef6-4a2c-937f-4a7f5da57bf7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:36.815684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98aa842d-4ef6-4a2c-937f-4a7f5da57bf7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:36.817024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98aa842d-4ef6-4a2c-937f-4a7f5da57bf7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:36.821169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98aa842d-4ef6-4a2c-937f-4a7f5da57bf7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:36.822570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98aa842d-4ef6-4a2c-937f-4a7f5da57bf7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:36.825483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98aa842d-4ef6-4a2c-937f-4a7f5da57bf7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:36.826172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98aa842d-4ef6-4a2c-937f-4a7f5da57bf7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:36.923184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22d47f8a-97a5-4ee8-8268-bae43e2b81aa tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:36.924311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22d47f8a-97a5-4ee8-8268-bae43e2b81aa tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:36.946273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22d47f8a-97a5-4ee8-8268-bae43e2b81aa tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:36.946794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22d47f8a-97a5-4ee8-8268-bae43e2b81aa tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:36.947244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22d47f8a-97a5-4ee8-8268-bae43e2b81aa tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:36.953046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22d47f8a-97a5-4ee8-8268-bae43e2b81aa tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:36.953046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22d47f8a-97a5-4ee8-8268-bae43e2b81aa tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:36.954850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22d47f8a-97a5-4ee8-8268-bae43e2b81aa tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:37.467140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22d47f8a-97a5-4ee8-8268-bae43e2b81aa tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:37.478282 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22d47f8a-97a5-4ee8-8268-bae43e2b81aa tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1314 microversion: 2.1 time: 0.560778 Oct 11 04:30:37.485406 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2351/4475] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:36 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1314 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:30:37.501772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6775c1d9-66eb-4da2-9ed3-5d0d40701462 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:37.502861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6775c1d9-66eb-4da2-9ed3-5d0d40701462 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:37.534695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6775c1d9-66eb-4da2-9ed3-5d0d40701462 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:37.535511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6775c1d9-66eb-4da2-9ed3-5d0d40701462 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:37.536178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6775c1d9-66eb-4da2-9ed3-5d0d40701462 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:37.537192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6775c1d9-66eb-4da2-9ed3-5d0d40701462 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:37.537979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6775c1d9-66eb-4da2-9ed3-5d0d40701462 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:37.538755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6775c1d9-66eb-4da2-9ed3-5d0d40701462 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:37.734889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6775c1d9-66eb-4da2-9ed3-5d0d40701462 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:37.755217 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6775c1d9-66eb-4da2-9ed3-5d0d40701462 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1273 microversion: 2.1 time: 0.266609 Oct 11 04:30:37.757600 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2352/4476] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:37 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1273 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:37.771355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:37.772375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:37.790239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:37.793864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:37.796558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:37.800941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:37.802606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:37.804833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:38.162876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:38.176097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:38.188073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:38.188530 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-429a4656-c53d-486d-a71d-404fab9d6297 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.429496 Oct 11 04:30:38.189810 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2353/4477] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:37 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:38.485658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-98aa842d-4ef6-4a2c-937f-4a7f5da57bf7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:38.503068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98aa842d-4ef6-4a2c-937f-4a7f5da57bf7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 1.749023 Oct 11 04:30:38.514321 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2125/4478] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:36 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 1750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:38.514516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1cfe3a2f-1371-40bf-a061-1e0b28320ae9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:38.514516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1cfe3a2f-1371-40bf-a061-1e0b28320ae9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:38.531701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cfe3a2f-1371-40bf-a061-1e0b28320ae9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:38.534792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cfe3a2f-1371-40bf-a061-1e0b28320ae9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:38.535845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cfe3a2f-1371-40bf-a061-1e0b28320ae9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:38.537208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cfe3a2f-1371-40bf-a061-1e0b28320ae9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:38.538469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cfe3a2f-1371-40bf-a061-1e0b28320ae9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:38.542591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cfe3a2f-1371-40bf-a061-1e0b28320ae9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:38.785682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ebb7d377-f290-422b-a204-4d2a78e91ed8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:38.785872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ebb7d377-f290-422b-a204-4d2a78e91ed8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:38.788155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:38.807398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb7d377-f290-422b-a204-4d2a78e91ed8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:38.807902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb7d377-f290-422b-a204-4d2a78e91ed8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:38.808340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb7d377-f290-422b-a204-4d2a78e91ed8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:38.809055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb7d377-f290-422b-a204-4d2a78e91ed8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:38.809503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb7d377-f290-422b-a204-4d2a78e91ed8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:38.809920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb7d377-f290-422b-a204-4d2a78e91ed8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:39.021866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1cfe3a2f-1371-40bf-a061-1e0b28320ae9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:39.033972 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1cfe3a2f-1371-40bf-a061-1e0b28320ae9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1314 microversion: 2.1 time: 0.528297 Oct 11 04:30:39.051276 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2354/4479] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:38 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1314 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:39.219932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:39.220895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:39.235143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:39.241992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:39.247057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:39.249312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:39.255267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:39.256930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:39.258928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:39.545673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:39.583257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:39.585793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:39.596984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2990fb62-1ced-4cbf-ac3b-d5b800f2160d tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.377998 Oct 11 04:30:39.614950 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2355/4480] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:39 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:30:39.624649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-93d7f344-1c0a-49d0-a8a5-ea8bb52d6939 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:39.625848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-93d7f344-1c0a-49d0-a8a5-ea8bb52d6939 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:39.636080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93d7f344-1c0a-49d0-a8a5-ea8bb52d6939 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:39.637165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93d7f344-1c0a-49d0-a8a5-ea8bb52d6939 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:39.637818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93d7f344-1c0a-49d0-a8a5-ea8bb52d6939 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:39.638931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93d7f344-1c0a-49d0-a8a5-ea8bb52d6939 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:39.639624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93d7f344-1c0a-49d0-a8a5-ea8bb52d6939 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:39.640293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-93d7f344-1c0a-49d0-a8a5-ea8bb52d6939 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:39.895095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ebb7d377-f290-422b-a204-4d2a78e91ed8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:39.914657 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ebb7d377-f290-422b-a204-4d2a78e91ed8 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1315 microversion: 2.1 time: 1.134713 Oct 11 04:30:39.918462 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2126/4481] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:38 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1315 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:40.063686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cf260526-2bcb-44e0-bc3c-1e89fef016fc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:40.064594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf260526-2bcb-44e0-bc3c-1e89fef016fc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:40.083052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf260526-2bcb-44e0-bc3c-1e89fef016fc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:40.086612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf260526-2bcb-44e0-bc3c-1e89fef016fc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:40.091194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf260526-2bcb-44e0-bc3c-1e89fef016fc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:40.091194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf260526-2bcb-44e0-bc3c-1e89fef016fc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:40.092770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf260526-2bcb-44e0-bc3c-1e89fef016fc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:40.094519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf260526-2bcb-44e0-bc3c-1e89fef016fc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:40.470704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-93d7f344-1c0a-49d0-a8a5-ea8bb52d6939 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:40.480017 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-93d7f344-1c0a-49d0-a8a5-ea8bb52d6939 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1501 microversion: 2.1 time: 0.863208 Oct 11 04:30:40.484594 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2356/4482] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:39 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1501 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:40.513046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ffdf26a6-7846-4659-b91e-9bdcf41d1f51"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:40.519999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:40.549399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:40.551330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:40.554900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:40.559476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:40.560307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:40.561275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:40.637330 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] HTTP exception thrown: Cannot 'attach_volume' instance 7aed25f7-59d6-49de-b699-3581739f0edd while it is in vm_state rescued Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Request method failure captured: Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/os-volume_attachments HTTP/1.1 Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 74 Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPEasekUZLINQ5CZWJXkMppFiFyiPz0x7d4djdvUd-asoF16cTMXmitsW8Jw6-L4ZC10T49kVSd5NZJD7qmV4ktBS-qpfyACuQOEHpQR5BigmL06KMooK58zyWV0xifCb_yIKtS4zKCvAts6lZk9Fe5iF-Yw7nZw-Mdv0pFYP_e1eeY Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75ee1246b11f4fb286baf525614515c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}] Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 820b6b6b001a46a2abd3415de0b5f29b Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: {"volumeAttachment": {"volumeId": "ffdf26a6-7846-4659-b91e-9bdcf41d1f51"}} Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: exception: Cannot 'attach_volume' instance 7aed25f7-59d6-49de-b699-3581739f0edd while it is in vm_state rescued Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'server_id': '7aed25f7-59d6-49de-b699-3581739f0edd', 'body': {'volumeAttachment': {'volumeId': 'ffdf26a6-7846-4659-b91e-9bdcf41d1f51'}}} Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7aed25f7-59d6-49de-b699-3581739f0edd in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 11 04:30:40.644802 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7aed25f7-59d6-49de-b699-3581739f0edd while it is in vm_state rescued Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7aed25f7-59d6-49de-b699-3581739f0edd while it is in vm_state rescued Oct 11 04:30:40.648905 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:40.653905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Returning 409 to user: Cannot 'attach_volume' instance 7aed25f7-59d6-49de-b699-3581739f0edd while it is in vm_state rescued {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:30:40.658919 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-32e66e62-62ee-4694-bc0f-412a33fedcd9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.147053 Oct 11 04:30:40.662629 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2357/4483] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:30:40 2022] POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/os-volume_attachments => generated 152 bytes in 155 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:30:40.683621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:40.684251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:40.701615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:40.702911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:40.703969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:40.725493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:40.726368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:40.728347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:40.979278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:41.013375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:41.014505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cf260526-2bcb-44e0-bc3c-1e89fef016fc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:41.015123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:41.016570 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0fce33d5-3992-4156-a565-d8b45c0610a8 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.352617 Oct 11 04:30:41.043008 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2358/4484] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:40 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:41.058007 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cf260526-2bcb-44e0-bc3c-1e89fef016fc tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1500 microversion: 2.1 time: 1.000460 Oct 11 04:30:41.063779 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2127/4485] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:40 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1500 bytes in 1009 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:41.067289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb8658b4-61c0-4f93-8e63-d52211c55fc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:41.067825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb8658b4-61c0-4f93-8e63-d52211c55fc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:41.093990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb8658b4-61c0-4f93-8e63-d52211c55fc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:41.094599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb8658b4-61c0-4f93-8e63-d52211c55fc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:41.094988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb8658b4-61c0-4f93-8e63-d52211c55fc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:41.095922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb8658b4-61c0-4f93-8e63-d52211c55fc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:41.096376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb8658b4-61c0-4f93-8e63-d52211c55fc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:41.096800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb8658b4-61c0-4f93-8e63-d52211c55fc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:41.138647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b10be6d-fee1-404a-9e35-bc24ed783349 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:41.143121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b10be6d-fee1-404a-9e35-bc24ed783349 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:41.196494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b10be6d-fee1-404a-9e35-bc24ed783349 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:41.196494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b10be6d-fee1-404a-9e35-bc24ed783349 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:41.196494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b10be6d-fee1-404a-9e35-bc24ed783349 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:41.196494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b10be6d-fee1-404a-9e35-bc24ed783349 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:41.196494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b10be6d-fee1-404a-9e35-bc24ed783349 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:41.196494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b10be6d-fee1-404a-9e35-bc24ed783349 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:41.395394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:41.509538 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb8658b4-61c0-4f93-8e63-d52211c55fc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/action" status: 202 len: 0 microversion: 2.1 time: 0.465120 Oct 11 04:30:41.511553 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2359/4486] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:41 2022] POST /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd/action => generated 0 bytes in 468 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:30:41.541189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2803b410-b154-4b4a-8618-3b59a63b85c8 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:41.546937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2803b410-b154-4b4a-8618-3b59a63b85c8 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:41.568853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2803b410-b154-4b4a-8618-3b59a63b85c8 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:41.570230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2803b410-b154-4b4a-8618-3b59a63b85c8 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:41.572136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2803b410-b154-4b4a-8618-3b59a63b85c8 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:41.573583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2803b410-b154-4b4a-8618-3b59a63b85c8 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:41.575079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2803b410-b154-4b4a-8618-3b59a63b85c8 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:41.575684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2803b410-b154-4b4a-8618-3b59a63b85c8 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:42.319918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2803b410-b154-4b4a-8618-3b59a63b85c8 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:42.356222 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2803b410-b154-4b4a-8618-3b59a63b85c8 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1500 microversion: 2.1 time: 0.840760 Oct 11 04:30:42.359120 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2360/4487] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:41 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1500 bytes in 846 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:42.375850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d2f160a2-284c-4cd4-a678-a8108bc3a1d3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:42.380468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d2f160a2-284c-4cd4-a678-a8108bc3a1d3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:42.405464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2f160a2-284c-4cd4-a678-a8108bc3a1d3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:42.407502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2f160a2-284c-4cd4-a678-a8108bc3a1d3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:42.410433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2f160a2-284c-4cd4-a678-a8108bc3a1d3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:42.413418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2f160a2-284c-4cd4-a678-a8108bc3a1d3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:42.413418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2f160a2-284c-4cd4-a678-a8108bc3a1d3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:42.413418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2f160a2-284c-4cd4-a678-a8108bc3a1d3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:42.769241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:42.922887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d2f160a2-284c-4cd4-a678-a8108bc3a1d3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:42.938420 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d2f160a2-284c-4cd4-a678-a8108bc3a1d3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1509 microversion: 2.1 time: 0.574738 Oct 11 04:30:42.940769 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2361/4488] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:42 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1509 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:42.946654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:42.947485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:42.966527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:42.967503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:42.968367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:42.969600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:42.970740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:42.971625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:43.168957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b10be6d-fee1-404a-9e35-bc24ed783349 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:43.178463 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b10be6d-fee1-404a-9e35-bc24ed783349 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1315 microversion: 2.1 time: 2.109537 Oct 11 04:30:43.196091 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2128/4489] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:41 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1315 bytes in 2127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:43.203514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f299ab7c-fbde-4821-b6f1-5c74840231e4 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:43.204322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f299ab7c-fbde-4821-b6f1-5c74840231e4 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:43.210665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f299ab7c-fbde-4821-b6f1-5c74840231e4 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:43.211346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f299ab7c-fbde-4821-b6f1-5c74840231e4 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:43.212114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f299ab7c-fbde-4821-b6f1-5c74840231e4 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:43.213583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f299ab7c-fbde-4821-b6f1-5c74840231e4 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:43.214218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f299ab7c-fbde-4821-b6f1-5c74840231e4 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:43.214792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f299ab7c-fbde-4821-b6f1-5c74840231e4 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:43.247951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-f299ab7c-fbde-4821-b6f1-5c74840231e4 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lazy-loading 'flavor' on Instance uuid cbbf53c3-cd04-4cec-995b-d5ce999883ed {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:30:43.274901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:43.300069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:43.306374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:43.310143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dea0b8d0-a20a-4efd-8e0c-5685f9e6a348 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.365513 Oct 11 04:30:43.310143 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2362/4490] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:42 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:43.325557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-00770214-48b5-4af4-948b-268938b65588 req-6c917055-aaf2-4175-b240-03058968928e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3308eac-14b8-4148-96ef-d0794593fb30", "tag": "296d8dde-1afc-4a75-b185-9efbe9173586"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:43.360342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-00770214-48b5-4af4-948b-268938b65588 req-6c917055-aaf2-4175-b240-03058968928e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:43.361092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-00770214-48b5-4af4-948b-268938b65588 req-6c917055-aaf2-4175-b240-03058968928e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:43.361696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-00770214-48b5-4af4-948b-268938b65588 req-6c917055-aaf2-4175-b240-03058968928e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:43.375093 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-00770214-48b5-4af4-948b-268938b65588 req-6c917055-aaf2-4175-b240-03058968928e service nova] Creating event network-changed:296d8dde-1afc-4a75-b185-9efbe9173586 for instance d3308eac-14b8-4148-96ef-d0794593fb30 on n-h2-860892-1 Oct 11 04:30:43.399797 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-00770214-48b5-4af4-948b-268938b65588 req-6c917055-aaf2-4175-b240-03058968928e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089595 Oct 11 04:30:43.400490 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2363/4491] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:43.633447 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f299ab7c-fbde-4821-b6f1-5c74840231e4 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "POST /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed/action" status: 202 len: 0 microversion: 2.1 time: 0.435140 Oct 11 04:30:43.635772 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2129/4492] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:43 2022] POST /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed/action => generated 0 bytes in 438 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:30:43.651836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d4aae9d0-f3ad-474a-8d9c-1b935eb2f8d9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:43.653986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d4aae9d0-f3ad-474a-8d9c-1b935eb2f8d9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:43.661752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4aae9d0-f3ad-474a-8d9c-1b935eb2f8d9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:43.665956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4aae9d0-f3ad-474a-8d9c-1b935eb2f8d9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:43.666916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4aae9d0-f3ad-474a-8d9c-1b935eb2f8d9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:43.667858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4aae9d0-f3ad-474a-8d9c-1b935eb2f8d9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:43.668531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4aae9d0-f3ad-474a-8d9c-1b935eb2f8d9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:43.669860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4aae9d0-f3ad-474a-8d9c-1b935eb2f8d9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:43.836615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d64df697-7fa5-4106-ac5b-6575f16970cf tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Calling method '.version_select at 0x7fda18eddf70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:43.915988 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d64df697-7fa5-4106-ac5b-6575f16970cf tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283" status: 200 len: 371 microversion: 2.1 time: 0.489830 Oct 11 04:30:43.916740 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2364/4493] 10.222.0.26 () {58 vars in 1242 bytes} [Tue Oct 11 04:30:43 2022] GET /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283 => generated 371 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:30:43.928648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df6beea0-87b3-4a98-a4dc-2364c277aeb9 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Action: 'update', calling method: .version_select at 0x7fda190c6a60>, body: {"quota_set": {"force": true, "cores": 0}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:44.048893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df6beea0-87b3-4a98-a4dc-2364c277aeb9 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:44.049400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df6beea0-87b3-4a98-a4dc-2364c277aeb9 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:44.049939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df6beea0-87b3-4a98-a4dc-2364c277aeb9 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:44.050789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df6beea0-87b3-4a98-a4dc-2364c277aeb9 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:44.051159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df6beea0-87b3-4a98-a4dc-2364c277aeb9 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:44.051582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df6beea0-87b3-4a98-a4dc-2364c277aeb9 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:44.100229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d4aae9d0-f3ad-474a-8d9c-1b935eb2f8d9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:44.108266 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d4aae9d0-f3ad-474a-8d9c-1b935eb2f8d9 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1508 microversion: 2.1 time: 0.468647 Oct 11 04:30:44.114513 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2130/4494] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:43 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1508 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:44.136206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae5c8644-5447-45f4-8fd5-f92a112adc40 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:44.136762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ae5c8644-5447-45f4-8fd5-f92a112adc40 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:44.148675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5c8644-5447-45f4-8fd5-f92a112adc40 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:44.153719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5c8644-5447-45f4-8fd5-f92a112adc40 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:44.154421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5c8644-5447-45f4-8fd5-f92a112adc40 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:44.155886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5c8644-5447-45f4-8fd5-f92a112adc40 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:44.157816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5c8644-5447-45f4-8fd5-f92a112adc40 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:44.158653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae5c8644-5447-45f4-8fd5-f92a112adc40 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:44.216053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:44.285193 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-df6beea0-87b3-4a98-a4dc-2364c277aeb9 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283" status: 200 len: 328 microversion: 2.1 time: 0.360272 Oct 11 04:30:44.289539 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2365/4495] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 11 04:30:43 2022] PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283 => generated 328 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:30:44.296975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7e324c47-f55e-4219-a8f7-951f492e730e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:44.298165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7e324c47-f55e-4219-a8f7-951f492e730e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:44.308347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e324c47-f55e-4219-a8f7-951f492e730e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:44.309159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e324c47-f55e-4219-a8f7-951f492e730e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:44.309462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=9 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:44.310036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e324c47-f55e-4219-a8f7-951f492e730e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:44.311509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e324c47-f55e-4219-a8f7-951f492e730e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:44.313148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e324c47-f55e-4219-a8f7-951f492e730e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:44.313806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e324c47-f55e-4219-a8f7-951f492e730e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:44.642746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7e324c47-f55e-4219-a8f7-951f492e730e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:44.653205 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7e324c47-f55e-4219-a8f7-951f492e730e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1315 microversion: 2.1 time: 0.361846 Oct 11 04:30:44.655343 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2366/4496] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:44 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:44.662629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:44.663479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:44.672883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:44.673618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:44.674384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:44.675307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:44.675943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:44.676747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:44.760023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:44.771924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:44.773376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:44.774593 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bc78484c-0d78-492d-b28d-e2a9e354c434 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.117489 Oct 11 04:30:44.775158 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2367/4497] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:44 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:44.848233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-377646283", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:44.902441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:30:45.099729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ae5c8644-5447-45f4-8fd5-f92a112adc40 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:45.108813 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ae5c8644-5447-45f4-8fd5-f92a112adc40 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1509 microversion: 2.1 time: 0.993152 Oct 11 04:30:45.109440 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2131/4498] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:44 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1509 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:45.144075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9c99bf65-e79a-4c94-8fbc-d1940ec7f070 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:45.144075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9c99bf65-e79a-4c94-8fbc-d1940ec7f070 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:45.146018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c99bf65-e79a-4c94-8fbc-d1940ec7f070 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:45.154524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c99bf65-e79a-4c94-8fbc-d1940ec7f070 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:45.154524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c99bf65-e79a-4c94-8fbc-d1940ec7f070 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:45.154524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c99bf65-e79a-4c94-8fbc-d1940ec7f070 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:45.154524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c99bf65-e79a-4c94-8fbc-d1940ec7f070 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:45.154524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c99bf65-e79a-4c94-8fbc-d1940ec7f070 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:45.591952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9c99bf65-e79a-4c94-8fbc-d1940ec7f070 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:45.607139 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9c99bf65-e79a-4c94-8fbc-d1940ec7f070 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1491 microversion: 2.1 time: 0.477224 Oct 11 04:30:45.607843 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2132/4499] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:45 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1491 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:30:45.631197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4119faf0-b07b-4acf-be27-753d7b71e658 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:45.642171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4119faf0-b07b-4acf-be27-753d7b71e658 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:45.644418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4119faf0-b07b-4acf-be27-753d7b71e658 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:45.645034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4119faf0-b07b-4acf-be27-753d7b71e658 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:45.646405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4119faf0-b07b-4acf-be27-753d7b71e658 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:45.647140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4119faf0-b07b-4acf-be27-753d7b71e658 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:45.647700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4119faf0-b07b-4acf-be27-753d7b71e658 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:45.649296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4119faf0-b07b-4acf-be27-753d7b71e658 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:45.665806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:30:45.666539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:30:45.667037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:30:45.667587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:30:45.668150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:30:45.696871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:45.698858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:45.700988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:45.701956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:45.706464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:45.706925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:45.756162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Getting quotas for project 93b5c7a53f814ae3a550e6707434f283. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:30:45.771056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Getting quotas for user 666a9c0fdb4f4a1fbfa10bb9edb1ed9b and project 93b5c7a53f814ae3a550e6707434f283. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:30:45.788088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.utils [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] cores quota exceeded for 93b5c7a53f814ae3a550e6707434f283, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120994) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 04:30:45.789159 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] HTTP exception thrown: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Request method failure captured: Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 144 Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPFxU95uWWoRL5bBrPqz5mazJbejXFwHuRhtNpskOJjqydsuzpEMPvZlStliG5bAIuRAfuEE0l_-9S_85MQ4hNvtQKWhKBbfEDkJbfiepXjn_fodEbi4xQAhBeNOkZSi9BQgDKMzOv9AaXiau3mj0eO5lIfnOd_NWAPRLUKd92st8zM Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 93b5c7a53f814ae3a550e6707434f283 Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/93b5c7a53f814ae3a550e6707434f283"}]}] Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 93b5c7a53f814ae3a550e6707434f283 Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-QuotasAdminNegativeTest-714482980-project Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 666a9c0fdb4f4a1fbfa10bb9edb1ed9b Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-QuotasAdminNegativeTest-714482980-project Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-377646283", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: exception: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-377646283', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452'}}} Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 04:30:45.796508 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores Oct 11 04:30:45.801265 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:45.805710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Returning 403 to user: Quota exceeded for cores: Requested 1, but already used 0 of 0 cores {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:30:45.814846 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72843633-4533-4329-8da2-c185ba5215f7 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 111 microversion: 2.1 time: 1.036190 Oct 11 04:30:45.816009 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2368/4500] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:30:44 2022] POST /compute/v2.1/servers => generated 111 bytes in 1040 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:30:45.823163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-00777270-7d6f-4c28-b4ed-66417175cee2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:45.824524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-00777270-7d6f-4c28-b4ed-66417175cee2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:45.833760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00777270-7d6f-4c28-b4ed-66417175cee2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:45.834488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00777270-7d6f-4c28-b4ed-66417175cee2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:45.836918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00777270-7d6f-4c28-b4ed-66417175cee2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:45.836918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00777270-7d6f-4c28-b4ed-66417175cee2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:45.837318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00777270-7d6f-4c28-b4ed-66417175cee2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:45.837949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00777270-7d6f-4c28-b4ed-66417175cee2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:46.053402 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4119faf0-b07b-4acf-be27-753d7b71e658 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "POST /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed/action" status: 202 len: 0 microversion: 2.1 time: 0.425849 Oct 11 04:30:46.058158 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2133/4501] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:45 2022] POST /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed/action => generated 0 bytes in 431 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:30:46.075532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:46.078964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:46.105386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:46.110114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:46.111436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:46.112448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:46.113078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:46.115552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:46.226254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-00777270-7d6f-4c28-b4ed-66417175cee2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:46.242232 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-00777270-7d6f-4c28-b4ed-66417175cee2 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1315 microversion: 2.1 time: 0.423320 Oct 11 04:30:46.243675 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2369/4502] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:45 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:46.256275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff2a9040-c078-4fcc-ae64-92e91b47db10 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Action: 'update', calling method: .version_select at 0x7fda18efc820>, body: {"quota_set": {"cores": 20}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:46.343026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:46.357863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:46.359431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:46.360691 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2a6873a1-f580-439a-bfdf-e91328050fc3 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.301270 Oct 11 04:30:46.384931 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2134/4503] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:46 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:46.395565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7674b05-dedc-4aac-8cc7-643dfb231e6e tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:46.396246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a7674b05-dedc-4aac-8cc7-643dfb231e6e tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:46.405644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7674b05-dedc-4aac-8cc7-643dfb231e6e tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:46.411752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7674b05-dedc-4aac-8cc7-643dfb231e6e tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:46.411752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7674b05-dedc-4aac-8cc7-643dfb231e6e tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:46.411752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7674b05-dedc-4aac-8cc7-643dfb231e6e tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:46.411752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7674b05-dedc-4aac-8cc7-643dfb231e6e tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:46.411752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7674b05-dedc-4aac-8cc7-643dfb231e6e tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:46.434815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff2a9040-c078-4fcc-ae64-92e91b47db10 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:46.434815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff2a9040-c078-4fcc-ae64-92e91b47db10 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.019s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:46.438929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff2a9040-c078-4fcc-ae64-92e91b47db10 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:46.441592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff2a9040-c078-4fcc-ae64-92e91b47db10 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:46.442885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff2a9040-c078-4fcc-ae64-92e91b47db10 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:46.446831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff2a9040-c078-4fcc-ae64-92e91b47db10 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:46.515785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:46.715611 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff2a9040-c078-4fcc-ae64-92e91b47db10 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283" status: 200 len: 329 microversion: 2.1 time: 0.467175 Oct 11 04:30:46.716223 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2370/4504] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 11 04:30:46 2022] PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283 => generated 329 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:46.732388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9dc57634-e772-4927-8c52-dcb1813d0bc0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:46.733512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9dc57634-e772-4927-8c52-dcb1813d0bc0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:46.749512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dc57634-e772-4927-8c52-dcb1813d0bc0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:46.750411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dc57634-e772-4927-8c52-dcb1813d0bc0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:46.751091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dc57634-e772-4927-8c52-dcb1813d0bc0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:46.752160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dc57634-e772-4927-8c52-dcb1813d0bc0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:46.752828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dc57634-e772-4927-8c52-dcb1813d0bc0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:46.753470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dc57634-e772-4927-8c52-dcb1813d0bc0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:46.897436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a7674b05-dedc-4aac-8cc7-643dfb231e6e tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:46.907324 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a7674b05-dedc-4aac-8cc7-643dfb231e6e tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1497 microversion: 2.1 time: 0.526945 Oct 11 04:30:46.914344 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2135/4505] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:46 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1497 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:47.047668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a087bcb8-79d8-43f5-859e-a01b05575f80 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Action: 'create', calling method: .version_select at 0x7fda19ab8160>, body: {"keypair": {"name": "tempest-keypair-1266091918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIStgD3COLQbuB+ZvVdI3Kk3JRwaRIuUGl7r0clmSIebklCTRtt321BTp/rN4T57Peo6IhcBjCFf9680JGqfbVYaVnGriP7Pwtwi3lN88MzNy/47ZEzixPew8fGu20oKkQ=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:47.083509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a087bcb8-79d8-43f5-859e-a01b05575f80 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Getting quotas for project 483579a827a84b40b6fb4c3bd5b67360. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:30:47.102051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a087bcb8-79d8-43f5-859e-a01b05575f80 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Getting quotas for user 22e2c72c29774424b6c603bf36318512 and project 483579a827a84b40b6fb4c3bd5b67360. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:30:47.167087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9dc57634-e772-4927-8c52-dcb1813d0bc0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:47.180072 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9dc57634-e772-4927-8c52-dcb1813d0bc0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1509 microversion: 2.1 time: 0.448268 Oct 11 04:30:47.182504 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2371/4506] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:46 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1509 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:47.193194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-07d9b636-0e0d-4e52-9337-d7e97c109f9e tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Calling method '.version_select at 0x7fda19003040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:47.271301 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a087bcb8-79d8-43f5-859e-a01b05575f80 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.346943 Oct 11 04:30:47.271301 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2136/4507] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:30:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:47.277177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0715e397-614a-4dcf-9006-c0643c45416d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:47.277970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0715e397-614a-4dcf-9006-c0643c45416d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:47.288632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0715e397-614a-4dcf-9006-c0643c45416d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:47.289136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0715e397-614a-4dcf-9006-c0643c45416d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:47.289608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0715e397-614a-4dcf-9006-c0643c45416d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:47.297380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0715e397-614a-4dcf-9006-c0643c45416d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:47.298045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0715e397-614a-4dcf-9006-c0643c45416d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:47.298692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0715e397-614a-4dcf-9006-c0643c45416d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:47.330096 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-07d9b636-0e0d-4e52-9337-d7e97c109f9e tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283" status: 200 len: 371 microversion: 2.1 time: 0.146149 Oct 11 04:30:47.339128 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2372/4508] 10.222.0.26 () {58 vars in 1242 bytes} [Tue Oct 11 04:30:47 2022] GET /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283 => generated 371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:47.352884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-51c5c999-9a9d-4db9-bb63-a025da677c67 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Action: 'update', calling method: .version_select at 0x7fda1926a940>, body: {"quota_set": {"force": true, "instances": 0}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:47.500817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51c5c999-9a9d-4db9-bb63-a025da677c67 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:47.502585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51c5c999-9a9d-4db9-bb63-a025da677c67 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:47.502585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51c5c999-9a9d-4db9-bb63-a025da677c67 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:47.506418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51c5c999-9a9d-4db9-bb63-a025da677c67 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:47.506967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51c5c999-9a9d-4db9-bb63-a025da677c67 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:47.507412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-51c5c999-9a9d-4db9-bb63-a025da677c67 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:47.722345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-51c5c999-9a9d-4db9-bb63-a025da677c67 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283" status: 200 len: 328 microversion: 2.1 time: 0.375196 Oct 11 04:30:47.739398 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2373/4509] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 11 04:30:47 2022] PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283 => generated 328 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:47.752616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:47.753236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:47.776736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:47.782466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:47.785572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:47.787845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:47.792440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:47.796897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:47.992429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0715e397-614a-4dcf-9006-c0643c45416d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:48.001446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:48.014105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:48.016739 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0715e397-614a-4dcf-9006-c0643c45416d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1315 microversion: 2.1 time: 0.744059 Oct 11 04:30:48.017330 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2137/4510] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:47 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1315 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:30:48.028364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2120362052", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:48.028822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:48.035077 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a8e68741-0c21-4779-9b3d-efecdd0965cf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.290209 Oct 11 04:30:48.036137 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2374/4511] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:47 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:48.050157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c183ef8b-0ec5-4147-9ebc-e519fa802671 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:48.051125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c183ef8b-0ec5-4147-9ebc-e519fa802671 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:48.084310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c183ef8b-0ec5-4147-9ebc-e519fa802671 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:48.090278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c183ef8b-0ec5-4147-9ebc-e519fa802671 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:48.092721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c183ef8b-0ec5-4147-9ebc-e519fa802671 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:48.093741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c183ef8b-0ec5-4147-9ebc-e519fa802671 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:48.094344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c183ef8b-0ec5-4147-9ebc-e519fa802671 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:48.095903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c183ef8b-0ec5-4147-9ebc-e519fa802671 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:48.188694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:30:48.508191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c183ef8b-0ec5-4147-9ebc-e519fa802671 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:48.522883 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c183ef8b-0ec5-4147-9ebc-e519fa802671 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1497 microversion: 2.1 time: 0.485356 Oct 11 04:30:48.530402 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2375/4512] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:48 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1497 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:48.561601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9c592bd2-56f3-448c-a4f2-69caf2c51821 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:48.562319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9c592bd2-56f3-448c-a4f2-69caf2c51821 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:48.578809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c592bd2-56f3-448c-a4f2-69caf2c51821 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:48.580099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c592bd2-56f3-448c-a4f2-69caf2c51821 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:48.581175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c592bd2-56f3-448c-a4f2-69caf2c51821 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:48.583646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c592bd2-56f3-448c-a4f2-69caf2c51821 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:48.584597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c592bd2-56f3-448c-a4f2-69caf2c51821 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:48.585385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c592bd2-56f3-448c-a4f2-69caf2c51821 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:48.832751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9c592bd2-56f3-448c-a4f2-69caf2c51821 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:48.844075 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9c592bd2-56f3-448c-a4f2-69caf2c51821 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1515 microversion: 2.1 time: 0.312178 Oct 11 04:30:48.848355 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2376/4513] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:48 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1515 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:49.041617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d5de7695-b851-4e66-8a06-6e2f51ddc995 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:49.042264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d5de7695-b851-4e66-8a06-6e2f51ddc995 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:49.055095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5de7695-b851-4e66-8a06-6e2f51ddc995 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:49.059194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5de7695-b851-4e66-8a06-6e2f51ddc995 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:49.059851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5de7695-b851-4e66-8a06-6e2f51ddc995 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:49.060733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5de7695-b851-4e66-8a06-6e2f51ddc995 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:49.064132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5de7695-b851-4e66-8a06-6e2f51ddc995 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:49.066907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5de7695-b851-4e66-8a06-6e2f51ddc995 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:49.250599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:30:49.251071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:30:49.252324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:30:49.252760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:30:49.253371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:30:49.271124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:49.273892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:49.277541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:49.278830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:49.279474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:49.280127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:49.320354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Getting quotas for project 93b5c7a53f814ae3a550e6707434f283. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:30:49.330222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Getting quotas for user 666a9c0fdb4f4a1fbfa10bb9edb1ed9b and project 93b5c7a53f814ae3a550e6707434f283. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:30:49.341599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d5de7695-b851-4e66-8a06-6e2f51ddc995 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:49.351807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.utils [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] instances quota exceeded for 93b5c7a53f814ae3a550e6707434f283, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120993) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 04:30:49.352424 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] HTTP exception thrown: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 04:30:49.371057 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d5de7695-b851-4e66-8a06-6e2f51ddc995 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1315 microversion: 2.1 time: 0.318032 Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Request method failure captured: Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 145 Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPFxU95uWWoRL5bBrPqz5mazJbejXFwHuRhtNpskOJjqydsuzpEMPvZlStliG5bAIuRAfuEE0l_-9S_85MQ4hNvtQKWhKBbfEDkJbfiepXjn_fodEbi4xQAhBeNOkZSi9BQgDKMzOv9AaXiau3mj0eO5lIfnOd_NWAPRLUKd92st8zM Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 93b5c7a53f814ae3a550e6707434f283 Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/93b5c7a53f814ae3a550e6707434f283"}]}] Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 93b5c7a53f814ae3a550e6707434f283 Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-QuotasAdminNegativeTest-714482980-project Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 666a9c0fdb4f4a1fbfa10bb9edb1ed9b Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-QuotasAdminNegativeTest-714482980-project Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-2120362052", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: exception: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-2120362052', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452'}}} Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['instances'] Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 04:30:49.371216 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:49.376625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Returning 403 to user: Quota exceeded for instances: Requested 1, but already used 0 of 0 instances {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:30:49.379366 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2377/4514] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:49 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1315 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:30:49.379461 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-31b32c3e-b189-4ccc-a087-109490b9b9b5 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 119 microversion: 2.1 time: 1.339198 Oct 11 04:30:49.379461 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2138/4515] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:30:48 2022] POST /compute/v2.1/servers => generated 119 bytes in 1340 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:30:49.379637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:49.379637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:49.379801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-28da7b18-78d2-44f8-b909-5d28709ae138 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Action: 'update', calling method: .version_select at 0x7fda18a92040>, body: {"quota_set": {"instances": 10}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:49.382213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:49.382213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:49.382213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:49.382213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:49.390370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:49.391022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:49.459550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28da7b18-78d2-44f8-b909-5d28709ae138 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:49.460295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28da7b18-78d2-44f8-b909-5d28709ae138 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:49.462445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28da7b18-78d2-44f8-b909-5d28709ae138 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:49.463486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28da7b18-78d2-44f8-b909-5d28709ae138 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:49.466801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28da7b18-78d2-44f8-b909-5d28709ae138 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:49.467415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28da7b18-78d2-44f8-b909-5d28709ae138 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:49.494668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:49.562854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:49.566890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:49.570043 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44ee0002-f9ff-4735-80a8-3f226c717daf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.212199 Oct 11 04:30:49.574031 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2378/4516] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:49 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:49.593553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-46bfbc9b-6b1d-4109-9c0a-c15801cb46ee tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:49.599998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-46bfbc9b-6b1d-4109-9c0a-c15801cb46ee tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:49.609921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46bfbc9b-6b1d-4109-9c0a-c15801cb46ee tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:49.610778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46bfbc9b-6b1d-4109-9c0a-c15801cb46ee tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:49.612026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46bfbc9b-6b1d-4109-9c0a-c15801cb46ee tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:49.612959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46bfbc9b-6b1d-4109-9c0a-c15801cb46ee tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:49.613664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46bfbc9b-6b1d-4109-9c0a-c15801cb46ee tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:49.614342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-46bfbc9b-6b1d-4109-9c0a-c15801cb46ee tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:49.701474 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-28da7b18-78d2-44f8-b909-5d28709ae138 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283" status: 200 len: 329 microversion: 2.1 time: 0.338617 Oct 11 04:30:49.702562 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2139/4517] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 11 04:30:49 2022] PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283 => generated 329 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:49.718469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f5c680d9-9ced-4359-8cf6-e80470dd1b3d tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Calling method '.version_select at 0x7fda18a8d940>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:49.937208 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f5c680d9-9ced-4359-8cf6-e80470dd1b3d tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283" status: 200 len: 371 microversion: 2.1 time: 0.222253 Oct 11 04:30:49.939228 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2140/4518] 10.222.0.26 () {58 vars in 1242 bytes} [Tue Oct 11 04:30:49 2022] GET /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283 => generated 371 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:49.962267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d34a58f-4066-4ff7-9a29-3fc05550c58b tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Action: 'update', calling method: .version_select at 0x7fda18a9fb80>, body: {"quota_set": {"force": true, "ram": 0}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:50.015983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-46bfbc9b-6b1d-4109-9c0a-c15801cb46ee tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:50.053967 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-46bfbc9b-6b1d-4109-9c0a-c15801cb46ee tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1497 microversion: 2.1 time: 0.478496 Oct 11 04:30:50.071319 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2379/4519] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:49 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1497 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:50.106452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d34a58f-4066-4ff7-9a29-3fc05550c58b tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:50.107396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d34a58f-4066-4ff7-9a29-3fc05550c58b tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:50.110876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d34a58f-4066-4ff7-9a29-3fc05550c58b tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:50.111861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d34a58f-4066-4ff7-9a29-3fc05550c58b tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:50.113206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d34a58f-4066-4ff7-9a29-3fc05550c58b tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:50.113839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d34a58f-4066-4ff7-9a29-3fc05550c58b tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:50.296206 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0d34a58f-4066-4ff7-9a29-3fc05550c58b tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283" status: 200 len: 325 microversion: 2.1 time: 0.349137 Oct 11 04:30:50.297931 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2141/4520] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 11 04:30:49 2022] PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283 => generated 325 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:50.373196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-924399683", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:50.382790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ed8319e-303a-43b3-848f-9730768a5a52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:50.383829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ed8319e-303a-43b3-848f-9730768a5a52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:50.401321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed8319e-303a-43b3-848f-9730768a5a52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:50.403027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed8319e-303a-43b3-848f-9730768a5a52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:50.403704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed8319e-303a-43b3-848f-9730768a5a52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:50.405029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed8319e-303a-43b3-848f-9730768a5a52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:50.423957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed8319e-303a-43b3-848f-9730768a5a52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:50.424372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ed8319e-303a-43b3-848f-9730768a5a52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:50.474373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:30:50.825045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ed8319e-303a-43b3-848f-9730768a5a52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:50.852879 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ed8319e-303a-43b3-848f-9730768a5a52 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1315 microversion: 2.1 time: 0.474114 Oct 11 04:30:50.872442 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2142/4521] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:50 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1315 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:50.872442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:50.872442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:50.907250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:50.907855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:50.908312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:50.920130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:50.920609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:50.921052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:51.019072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:30:51.019666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:30:51.020001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:30:51.021292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:30:51.022047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:30:51.038574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:51.040144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:51.041483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:51.042871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:51.045163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:51.048659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:51.082211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Getting quotas for project 93b5c7a53f814ae3a550e6707434f283. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:30:51.088244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Getting quotas for user 666a9c0fdb4f4a1fbfa10bb9edb1ed9b and project 93b5c7a53f814ae3a550e6707434f283. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:30:51.102640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.utils [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] ram quota exceeded for 93b5c7a53f814ae3a550e6707434f283, tried to run 1 instances. Cannot run any more instances of this type. {{(pid=120994) check_num_instances_quota /opt/stack/nova/nova/compute/utils.py:1173}} Oct 11 04:30:51.103999 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] HTTP exception thrown: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Request method failure captured: Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 144 Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPFxU95uWWoRL5bBrPqz5mazJbejXFwHuRhtNpskOJjqydsuzpEMPvZlStliG5bAIuRAfuEE0l_-9S_85MQ4hNvtQKWhKBbfEDkJbfiepXjn_fodEbi4xQAhBeNOkZSi9BQgDKMzOv9AaXiau3mj0eO5lIfnOd_NWAPRLUKd92st8zM Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 93b5c7a53f814ae3a550e6707434f283 Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/93b5c7a53f814ae3a550e6707434f283"}]}] Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 93b5c7a53f814ae3a550e6707434f283 Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-QuotasAdminNegativeTest-714482980-project Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 666a9c0fdb4f4a1fbfa10bb9edb1ed9b Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-QuotasAdminNegativeTest-714482980-project Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-QuotasAdminNegativeTest-server-924399683", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: exception: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-QuotasAdminNegativeTest-server-924399683', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452'}}} Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1115, in check_num_instances_quota Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, deltas, Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 588, in limit_check_project_and_user Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 04:30:51.106145 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1733, in _create_instance Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instances_to_build = self._provision_instances( Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1362, in _provision_instances Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi num_instances = compute_utils.check_num_instances_quota( Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/utils.py", line 1181, in check_num_instances_quota Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 800, in create Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram Oct 11 04:30:51.110260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:30:51.124748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Returning 403 to user: Quota exceeded for ram: Requested 1024, but already used 0 of 0 ram {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:30:51.125923 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-35f2a9cb-b563-40a5-8c3f-8314b584fca2 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 403 len: 110 microversion: 2.1 time: 0.756590 Oct 11 04:30:51.127280 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2380/4522] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:30:50 2022] POST /compute/v2.1/servers => generated 110 bytes in 758 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:30:51.134051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d1b80414-72bd-48a9-b9a0-99593e64d0ae tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:51.135572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d1b80414-72bd-48a9-b9a0-99593e64d0ae tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:51.142374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1b80414-72bd-48a9-b9a0-99593e64d0ae tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:51.143106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1b80414-72bd-48a9-b9a0-99593e64d0ae tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:51.143834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1b80414-72bd-48a9-b9a0-99593e64d0ae tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:51.144763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1b80414-72bd-48a9-b9a0-99593e64d0ae tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:51.145413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1b80414-72bd-48a9-b9a0-99593e64d0ae tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:51.146034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1b80414-72bd-48a9-b9a0-99593e64d0ae tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:51.149862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:51.160557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:51.170256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:51.171808 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f47bca46-b099-4857-8943-76a8a8c3d6f0 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.311833 Oct 11 04:30:51.175832 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2143/4523] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:50 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:51.198082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6dd0e364-e8ed-4e5f-a416-acf01d2a4c06 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Action: 'update', calling method: .version_select at 0x7fda18b04a60>, body: {"quota_set": {"ram": 51200}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:51.387692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d1b80414-72bd-48a9-b9a0-99593e64d0ae tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:51.396763 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d1b80414-72bd-48a9-b9a0-99593e64d0ae tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1500 microversion: 2.1 time: 0.267795 Oct 11 04:30:51.397730 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2381/4524] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:51 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1500 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:51.432904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fb09b606-19f3-4093-9c86-f7937fdefa77 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:51.435849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fb09b606-19f3-4093-9c86-f7937fdefa77 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:51.448331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb09b606-19f3-4093-9c86-f7937fdefa77 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:51.450229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb09b606-19f3-4093-9c86-f7937fdefa77 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:51.450843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb09b606-19f3-4093-9c86-f7937fdefa77 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:51.460142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb09b606-19f3-4093-9c86-f7937fdefa77 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:51.460872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb09b606-19f3-4093-9c86-f7937fdefa77 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:51.461477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb09b606-19f3-4093-9c86-f7937fdefa77 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:51.532006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:51.549614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-fb09b606-19f3-4093-9c86-f7937fdefa77 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lazy-loading 'flavor' on Instance uuid cbbf53c3-cd04-4cec-995b-d5ce999883ed {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:30:51.747795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dd0e364-e8ed-4e5f-a416-acf01d2a4c06 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:51.750222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dd0e364-e8ed-4e5f-a416-acf01d2a4c06 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:51.750222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dd0e364-e8ed-4e5f-a416-acf01d2a4c06 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:51.750222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dd0e364-e8ed-4e5f-a416-acf01d2a4c06 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:51.750803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dd0e364-e8ed-4e5f-a416-acf01d2a4c06 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:51.751398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dd0e364-e8ed-4e5f-a416-acf01d2a4c06 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:51.935729 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fb09b606-19f3-4093-9c86-f7937fdefa77 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "POST /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed/action" status: 202 len: 0 microversion: 2.1 time: 0.514698 Oct 11 04:30:51.936663 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2382/4525] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:51 2022] POST /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed/action => generated 0 bytes in 518 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:30:51.958493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-639d70ad-ff24-4891-b6ce-9b71ed4077e5 req-ef92cd03-146e-4330-b137-fc0955de0011 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3308eac-14b8-4148-96ef-d0794593fb30", "name": "network-vif-plugged", "status": "completed", "tag": "296d8dde-1afc-4a75-b185-9efbe9173586"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:51.973511 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6dd0e364-e8ed-4e5f-a416-acf01d2a4c06 tempest-QuotasAdminNegativeTest-1500641884 tempest-QuotasAdminNegativeTest-1500641884-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283" status: 200 len: 329 microversion: 2.1 time: 0.796346 Oct 11 04:30:51.978721 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2144/4526] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 11 04:30:51 2022] PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283 => generated 329 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:51.984370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-639d70ad-ff24-4891-b6ce-9b71ed4077e5 req-ef92cd03-146e-4330-b137-fc0955de0011 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:51.984888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-639d70ad-ff24-4891-b6ce-9b71ed4077e5 req-ef92cd03-146e-4330-b137-fc0955de0011 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:51.985519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-639d70ad-ff24-4891-b6ce-9b71ed4077e5 req-ef92cd03-146e-4330-b137-fc0955de0011 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:51.988960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c05bb56d-5ad7-4075-91af-72e34c8a46b1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:51.992201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c05bb56d-5ad7-4075-91af-72e34c8a46b1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:52.001450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=4,nova_api:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:52.005942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c05bb56d-5ad7-4075-91af-72e34c8a46b1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:52.006686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c05bb56d-5ad7-4075-91af-72e34c8a46b1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:52.008708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c05bb56d-5ad7-4075-91af-72e34c8a46b1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:52.010906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c05bb56d-5ad7-4075-91af-72e34c8a46b1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:52.011710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c05bb56d-5ad7-4075-91af-72e34c8a46b1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:52.012670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c05bb56d-5ad7-4075-91af-72e34c8a46b1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:52.038223 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-639d70ad-ff24-4891-b6ce-9b71ed4077e5 req-ef92cd03-146e-4330-b137-fc0955de0011 service nova] Creating event network-vif-plugged:296d8dde-1afc-4a75-b185-9efbe9173586 for instance d3308eac-14b8-4148-96ef-d0794593fb30 on n-h2-860892-1 Oct 11 04:30:52.053426 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-639d70ad-ff24-4891-b6ce-9b71ed4077e5 req-ef92cd03-146e-4330-b137-fc0955de0011 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114580 Oct 11 04:30:52.058243 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2383/4527] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:30:52.075246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9fc5a99-062b-4480-98ba-cc036259863a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:52.077509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e9fc5a99-062b-4480-98ba-cc036259863a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:52.096143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9fc5a99-062b-4480-98ba-cc036259863a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:52.097082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9fc5a99-062b-4480-98ba-cc036259863a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:52.100959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9fc5a99-062b-4480-98ba-cc036259863a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:52.104344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9fc5a99-062b-4480-98ba-cc036259863a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:52.116246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9fc5a99-062b-4480-98ba-cc036259863a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:52.117056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9fc5a99-062b-4480-98ba-cc036259863a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:52.428345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c05bb56d-5ad7-4075-91af-72e34c8a46b1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:52.468521 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c05bb56d-5ad7-4075-91af-72e34c8a46b1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1315 microversion: 2.1 time: 0.465200 Oct 11 04:30:52.468521 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2145/4528] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:51 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:52.470578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-44894aef-8586-427b-b093-140a785f1fb0 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Action: 'update', calling method: .version_select at 0x7fda19e545e0>, body: {"quota_set": {"ram": 0}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:52.494596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-44894aef-8586-427b-b093-140a785f1fb0 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Policy check for os_compute_api:os-quota-sets:update failed with credentials {'is_admin': False, 'user_id': '666a9c0fdb4f4a1fbfa10bb9edb1ed9b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93b5c7a53f814ae3a550e6707434f283', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-44894aef-8586-427b-b093-140a785f1fb0 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Request method failure captured: Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: request: PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283 HTTP/1.1 Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 25 Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPFxU95uWWoRL5bBrPqz5mazJbejXFwHuRhtNpskOJjqydsuzpEMPvZlStliG5bAIuRAfuEE0l_-9S_85MQ4hNvtQKWhKBbfEDkJbfiepXjn_fodEbi4xQAhBeNOkZSi9BQgDKMzOv9AaXiau3mj0eO5lIfnOd_NWAPRLUKd92st8zM Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 93b5c7a53f814ae3a550e6707434f283 Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/93b5c7a53f814ae3a550e6707434f283"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/93b5c7a53f814ae3a550e6707434f283"}]}] Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 93b5c7a53f814ae3a550e6707434f283 Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-QuotasAdminNegativeTest-714482980 Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-QuotasAdminNegativeTest-714482980-project Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 666a9c0fdb4f4a1fbfa10bb9edb1ed9b Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-QuotasAdminNegativeTest-714482980-project Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: {"quota_set": {"ram": 0}} Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '93b5c7a53f814ae3a550e6707434f283', 'body': {'quota_set': {'ram': 0}}} Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 170, in update Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._update(req, id, body, []) Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/quota_sets.py", line 189, in _update Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(qs_policies.POLICY_ROOT % 'update', {'project_id': id}) Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:30:52.506749 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. Oct 11 04:30:52.511353 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:30:52.513253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-44894aef-8586-427b-b093-140a785f1fb0 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-quota-sets:update to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:30:52.523326 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-44894aef-8586-427b-b093-140a785f1fb0 tempest-QuotasAdminNegativeTest-714482980 tempest-QuotasAdminNegativeTest-714482980-project] 10.222.0.26 "PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283" status: 403 len: 116 microversion: 2.1 time: 0.058921 Oct 11 04:30:52.527771 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2146/4529] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 11 04:30:52 2022] PUT /compute/v2.1/os-quota-sets/93b5c7a53f814ae3a550e6707434f283 => generated 116 bytes in 78 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:30:52.549637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:52.554377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:52.567189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:52.567939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:52.571000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:52.572250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:52.572777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:52.573575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:52.744388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:52.754849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:52.756364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e9fc5a99-062b-4480-98ba-cc036259863a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:52.757296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:52.759061 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c2794a2f-f90a-41a6-a794-52c3cf676adf tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.228909 Oct 11 04:30:52.778141 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e9fc5a99-062b-4480-98ba-cc036259863a tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1508 microversion: 2.1 time: 0.712156 Oct 11 04:30:52.779371 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2147/4530] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:52 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:52.780015 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2384/4531] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:52 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1508 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:52.810255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-750452350", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b04e7ccf-bf5e-4c39-aed9-e1f9805cfa18"}], "security_groups": [{"name": "tempest-securitygroup--662877368"}], "key_name": "tempest-keypair-1266091918", "user_data": "}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:52.958988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] validate_networks() for [('b04e7ccf-bf5e-4c39-aed9-e1f9805cfa18', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:30:53.248869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-685ed17b-b4c9-448f-92d9-c6239da990f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'create', calling method: .version_select at 0x7fda1946f550>, body: {"keypair": {"name": "tempest-keypair-1163993139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJYuX9Y8AhakyCL1V/l6H7GgFurusB91f9mBClPIdF1UDAHjV1ZDiRCkYwyEFFBKKj9rQ4RRofBFww0DXk88QGbIWJDS0ZWp4trnh5Q+PtdfhDq5LPU4tj2kitxvA9glUw=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:53.293641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-685ed17b-b4c9-448f-92d9-c6239da990f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Getting quotas for project 75ee1246b11f4fb286baf525614515c5. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:30:53.311297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-685ed17b-b4c9-448f-92d9-c6239da990f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Getting quotas for user 820b6b6b001a46a2abd3415de0b5f29b and project 75ee1246b11f4fb286baf525614515c5. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:30:53.480779 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-685ed17b-b4c9-448f-92d9-c6239da990f1 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.238484 Oct 11 04:30:53.482296 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2385/4532] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:30:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:30:53.492721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-50391852-c1e5-4431-ab2c-215bd9db826d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:53.494652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50391852-c1e5-4431-ab2c-215bd9db826d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:53.515057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50391852-c1e5-4431-ab2c-215bd9db826d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:53.517594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50391852-c1e5-4431-ab2c-215bd9db826d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:53.529650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50391852-c1e5-4431-ab2c-215bd9db826d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:53.531554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50391852-c1e5-4431-ab2c-215bd9db826d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:53.532695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50391852-c1e5-4431-ab2c-215bd9db826d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:53.534604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50391852-c1e5-4431-ab2c-215bd9db826d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:53.608988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:30:53.609732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:30:53.610244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:30:53.610667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:30:53.611091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:30:53.625276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:53.625813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:53.626346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:53.627086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:53.627546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:53.627977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:53.669091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Getting quotas for project 483579a827a84b40b6fb4c3bd5b67360. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:30:53.675735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Getting quotas for user 22e2c72c29774424b6c603bf36318512 and project 483579a827a84b40b6fb4c3bd5b67360. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:30:53.696152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:30:53.699322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:30:53.788124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-50391852-c1e5-4431-ab2c-215bd9db826d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:53.804376 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-50391852-c1e5-4431-ab2c-215bd9db826d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1315 microversion: 2.1 time: 0.320054 Oct 11 04:30:53.807606 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2386/4533] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:53 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1315 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:53.826246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:53.828394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:53.846283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:53.848233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:53.849288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:53.851640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:53.853117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:53.854084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:53.892969 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d608676f-7bcb-4b47-afae-7f08645defc1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.092221 Oct 11 04:30:53.902810 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2148/4534] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:30:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 1123 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:30:53.910733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ea25adb8-4e0d-4995-ae5e-67e8b4e875bf tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:53.910733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ea25adb8-4e0d-4995-ae5e-67e8b4e875bf tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:53.916989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea25adb8-4e0d-4995-ae5e-67e8b4e875bf tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:53.918160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea25adb8-4e0d-4995-ae5e-67e8b4e875bf tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:53.918967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea25adb8-4e0d-4995-ae5e-67e8b4e875bf tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:53.920039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea25adb8-4e0d-4995-ae5e-67e8b4e875bf tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:53.920856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea25adb8-4e0d-4995-ae5e-67e8b4e875bf tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:53.921577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea25adb8-4e0d-4995-ae5e-67e8b4e875bf tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:53.997434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:54.023935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:54.027140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:54.028387 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-142a8ef5-e255-440d-8836-0867e8b24373 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.215916 Oct 11 04:30:54.044711 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2387/4535] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:53 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:54.055846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8725b904-f72c-4d69-ba65-a3e43b818b7d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:54.057009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8725b904-f72c-4d69-ba65-a3e43b818b7d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:54.132470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8725b904-f72c-4d69-ba65-a3e43b818b7d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:54.142748 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8725b904-f72c-4d69-ba65-a3e43b818b7d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1237 microversion: 2.1 time: 0.096716 Oct 11 04:30:54.162268 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2388/4536] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:54 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1237 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:54.421535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea25adb8-4e0d-4995-ae5e-67e8b4e875bf tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:54.443163 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ea25adb8-4e0d-4995-ae5e-67e8b4e875bf tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1491 microversion: 2.1 time: 0.528241 Oct 11 04:30:54.443163 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2149/4537] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:53 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1491 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:54.468048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-64d9ac96-fabe-46f0-be7f-c9091e4bed83 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:54.468760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-64d9ac96-fabe-46f0-be7f-c9091e4bed83 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:54.485918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64d9ac96-fabe-46f0-be7f-c9091e4bed83 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:54.487273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64d9ac96-fabe-46f0-be7f-c9091e4bed83 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:54.490811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64d9ac96-fabe-46f0-be7f-c9091e4bed83 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:54.493342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64d9ac96-fabe-46f0-be7f-c9091e4bed83 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:54.493342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64d9ac96-fabe-46f0-be7f-c9091e4bed83 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:54.494536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64d9ac96-fabe-46f0-be7f-c9091e4bed83 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:54.804077 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-64d9ac96-fabe-46f0-be7f-c9091e4bed83 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "POST /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed/action" status: 202 len: 0 microversion: 2.1 time: 0.342773 Oct 11 04:30:54.805433 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2389/4538] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:54 2022] POST /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed/action => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:30:54.814725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d0818b6b-c365-41fb-b601-a450b4392112 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:54.815545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d0818b6b-c365-41fb-b601-a450b4392112 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:54.825488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0818b6b-c365-41fb-b601-a450b4392112 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:54.826168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0818b6b-c365-41fb-b601-a450b4392112 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:54.830561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0818b6b-c365-41fb-b601-a450b4392112 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:54.830561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0818b6b-c365-41fb-b601-a450b4392112 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:54.830561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0818b6b-c365-41fb-b601-a450b4392112 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:54.830561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0818b6b-c365-41fb-b601-a450b4392112 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:54.831502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f3a9ad80-6901-4dfe-b4f8-75de41bc9364 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:54.831502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f3a9ad80-6901-4dfe-b4f8-75de41bc9364 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:54.842949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a9ad80-6901-4dfe-b4f8-75de41bc9364 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:54.843466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a9ad80-6901-4dfe-b4f8-75de41bc9364 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:54.843906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a9ad80-6901-4dfe-b4f8-75de41bc9364 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:54.844616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a9ad80-6901-4dfe-b4f8-75de41bc9364 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:54.845062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a9ad80-6901-4dfe-b4f8-75de41bc9364 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:54.845490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3a9ad80-6901-4dfe-b4f8-75de41bc9364 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:55.229492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f3a9ad80-6901-4dfe-b4f8-75de41bc9364 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:55.241910 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f3a9ad80-6901-4dfe-b4f8-75de41bc9364 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1503 microversion: 2.1 time: 0.416320 Oct 11 04:30:55.254596 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2390/4539] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:54 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1503 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:30:55.271220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:55.274394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:55.288543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:55.289314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:55.292909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:55.294078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:55.296099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:55.296688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:55.397967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:55.415105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:55.417416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:55.434877 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-170b1394-7fd0-4ece-8629-78748bee0394 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.162361 Oct 11 04:30:55.434877 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2391/4540] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:55 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:55.434877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-497faa0d-de2b-44f2-b064-c8a118336b05 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:55.434877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-497faa0d-de2b-44f2-b064-c8a118336b05 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:55.535841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-497faa0d-de2b-44f2-b064-c8a118336b05 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:55.536455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d0818b6b-c365-41fb-b601-a450b4392112 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:55.547661 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d0818b6b-c365-41fb-b601-a450b4392112 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1497 microversion: 2.1 time: 0.737002 Oct 11 04:30:55.548712 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-497faa0d-de2b-44f2-b064-c8a118336b05 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1237 microversion: 2.1 time: 0.123295 Oct 11 04:30:55.548939 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2150/4541] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:54 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1497 bytes in 739 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:55.549581 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2392/4542] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:55 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1237 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:55.557328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0782a690-5610-4c7d-80f6-b9c9d8c0ed0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:55.558412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0782a690-5610-4c7d-80f6-b9c9d8c0ed0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:55.567978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0782a690-5610-4c7d-80f6-b9c9d8c0ed0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:55.568717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0782a690-5610-4c7d-80f6-b9c9d8c0ed0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:55.569311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0782a690-5610-4c7d-80f6-b9c9d8c0ed0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:55.570182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0782a690-5610-4c7d-80f6-b9c9d8c0ed0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:55.570859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0782a690-5610-4c7d-80f6-b9c9d8c0ed0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:55.571437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0782a690-5610-4c7d-80f6-b9c9d8c0ed0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:55.848007 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0782a690-5610-4c7d-80f6-b9c9d8c0ed0d tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30/action" status: 202 len: 0 microversion: 2.1 time: 0.296726 Oct 11 04:30:55.851512 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2151/4543] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:55 2022] POST /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:30:55.861308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90f1afe1-ece9-44a9-8238-743321445592 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:55.861995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90f1afe1-ece9-44a9-8238-743321445592 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:55.884241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90f1afe1-ece9-44a9-8238-743321445592 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:55.885066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90f1afe1-ece9-44a9-8238-743321445592 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:55.886567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90f1afe1-ece9-44a9-8238-743321445592 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:55.887306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90f1afe1-ece9-44a9-8238-743321445592 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:55.889853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90f1afe1-ece9-44a9-8238-743321445592 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:55.892483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90f1afe1-ece9-44a9-8238-743321445592 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:56.142156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-90f1afe1-ece9-44a9-8238-743321445592 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:56.150807 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90f1afe1-ece9-44a9-8238-743321445592 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1508 microversion: 2.1 time: 0.297688 Oct 11 04:30:56.151395 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2393/4544] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:55 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1508 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:56.447650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:56.449117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:56.483638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:56.485238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:56.486470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:56.487815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:56.488580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:56.496193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:56.506469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:56.594393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8aaf6996-5137-407b-9bed-707692896194 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:56.596194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8aaf6996-5137-407b-9bed-707692896194 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:56.633846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aaf6996-5137-407b-9bed-707692896194 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:56.634932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aaf6996-5137-407b-9bed-707692896194 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:56.635809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aaf6996-5137-407b-9bed-707692896194 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:56.636774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aaf6996-5137-407b-9bed-707692896194 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:56.637446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aaf6996-5137-407b-9bed-707692896194 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:56.638520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aaf6996-5137-407b-9bed-707692896194 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:56.751486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8aaf6996-5137-407b-9bed-707692896194 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:56.763037 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8aaf6996-5137-407b-9bed-707692896194 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1289 microversion: 2.1 time: 0.173332 Oct 11 04:30:56.765270 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2394/4545] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:56 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1289 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:30:56.783974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e80c07a-39f4-42c6-ba82-a60d5c0973a7 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:56.784701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e80c07a-39f4-42c6-ba82-a60d5c0973a7 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:56.791894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e80c07a-39f4-42c6-ba82-a60d5c0973a7 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:56.792880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e80c07a-39f4-42c6-ba82-a60d5c0973a7 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:56.794327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e80c07a-39f4-42c6-ba82-a60d5c0973a7 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:56.795374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e80c07a-39f4-42c6-ba82-a60d5c0973a7 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:56.796056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e80c07a-39f4-42c6-ba82-a60d5c0973a7 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:56.796680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e80c07a-39f4-42c6-ba82-a60d5c0973a7 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:56.799837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:56.814596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:56.819886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:56.821169 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd2513de-77a0-4099-ab91-a62083f43414 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.379594 Oct 11 04:30:56.830841 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2152/4546] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:56 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:57.117590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e80c07a-39f4-42c6-ba82-a60d5c0973a7 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:57.126657 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e80c07a-39f4-42c6-ba82-a60d5c0973a7 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1497 microversion: 2.1 time: 0.355649 Oct 11 04:30:57.143437 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2395/4547] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:56 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1497 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:57.174653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-21ca43ae-3657-4979-8200-df99839b21ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:57.175528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-21ca43ae-3657-4979-8200-df99839b21ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:57.189883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ca43ae-3657-4979-8200-df99839b21ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:57.190414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ca43ae-3657-4979-8200-df99839b21ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:57.191015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ca43ae-3657-4979-8200-df99839b21ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:57.191826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ca43ae-3657-4979-8200-df99839b21ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:57.192463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ca43ae-3657-4979-8200-df99839b21ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:57.195001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ca43ae-3657-4979-8200-df99839b21ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:57.448171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-21ca43ae-3657-4979-8200-df99839b21ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:57.459481 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-21ca43ae-3657-4979-8200-df99839b21ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1488 microversion: 2.1 time: 0.289610 Oct 11 04:30:57.460058 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2153/4548] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:57 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1488 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:57.491528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4b8370ca-49ff-424f-87c8-08f18bf969c0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:57.492558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4b8370ca-49ff-424f-87c8-08f18bf969c0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:57.505214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:57.527641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8370ca-49ff-424f-87c8-08f18bf969c0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:57.529083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8370ca-49ff-424f-87c8-08f18bf969c0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:57.529700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8370ca-49ff-424f-87c8-08f18bf969c0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:57.530615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8370ca-49ff-424f-87c8-08f18bf969c0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:57.531270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8370ca-49ff-424f-87c8-08f18bf969c0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:57.533890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8370ca-49ff-424f-87c8-08f18bf969c0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:57.575156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-4b8370ca-49ff-424f-87c8-08f18bf969c0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lazy-loading 'flavor' on Instance uuid d3308eac-14b8-4148-96ef-d0794593fb30 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:30:57.790249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e21e7368-d8a1-4de2-ab19-7c0a3253ff72 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:57.791968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e21e7368-d8a1-4de2-ab19-7c0a3253ff72 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:57.808316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e21e7368-d8a1-4de2-ab19-7c0a3253ff72 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:57.808901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e21e7368-d8a1-4de2-ab19-7c0a3253ff72 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:57.809586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e21e7368-d8a1-4de2-ab19-7c0a3253ff72 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:57.809962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e21e7368-d8a1-4de2-ab19-7c0a3253ff72 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:57.810516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e21e7368-d8a1-4de2-ab19-7c0a3253ff72 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:57.810862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e21e7368-d8a1-4de2-ab19-7c0a3253ff72 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:57.900211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e21e7368-d8a1-4de2-ab19-7c0a3253ff72 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:57.927707 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e21e7368-d8a1-4de2-ab19-7c0a3253ff72 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1307 microversion: 2.1 time: 0.141096 Oct 11 04:30:57.948276 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2154/4549] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:57 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1307 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:57.956837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1501409034", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "024a629d-4db2-47c1-927f-16f6b2634cc7"}], "security_groups": [{"name": "tempest-securitygroup--1627556818"}], "key_name": "tempest-keypair-1163993139", "user_data": "}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:30:58.255316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] validate_networks() for [('024a629d-4db2-47c1-927f-16f6b2634cc7', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:30:58.307716 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4b8370ca-49ff-424f-87c8-08f18bf969c0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30/action" status: 202 len: 0 microversion: 2.1 time: 0.821552 Oct 11 04:30:58.309089 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2396/4550] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:30:57 2022] POST /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30/action => generated 0 bytes in 824 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:30:58.336636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:58.338622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:58.349302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:58.350127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:58.351092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:58.352006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:58.352738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:58.354055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:58.598470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:58.617178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:58.619723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:58.625350 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f17f9af9-9e0e-4a6a-b9f0-287c52dc5823 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.301380 Oct 11 04:30:58.630777 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2397/4551] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:30:58 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:30:58.646784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4dfedebf-3aff-4977-8f72-dfaa61e72a80 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:58.655019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4dfedebf-3aff-4977-8f72-dfaa61e72a80 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:58.670065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dfedebf-3aff-4977-8f72-dfaa61e72a80 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:58.670521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dfedebf-3aff-4977-8f72-dfaa61e72a80 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:58.670972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dfedebf-3aff-4977-8f72-dfaa61e72a80 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:58.671692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dfedebf-3aff-4977-8f72-dfaa61e72a80 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:58.672157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dfedebf-3aff-4977-8f72-dfaa61e72a80 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:58.672588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dfedebf-3aff-4977-8f72-dfaa61e72a80 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:58.688296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:30:59.018598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:30:59.019798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:30:59.020435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:30:59.020982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:30:59.021561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:30:59.031931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:59.032676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:59.033269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:59.034146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:59.034764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:59.035356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:59.068128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Getting quotas for project 75ee1246b11f4fb286baf525614515c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:30:59.070711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4dfedebf-3aff-4977-8f72-dfaa61e72a80 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:59.077673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Getting quotas for user 820b6b6b001a46a2abd3415de0b5f29b and project 75ee1246b11f4fb286baf525614515c5. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:30:59.081783 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4dfedebf-3aff-4977-8f72-dfaa61e72a80 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1500 microversion: 2.1 time: 0.449629 Oct 11 04:30:59.084981 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2398/4552] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:58 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1500 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:59.102023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-07fbca16-3454-4ef0-9c1e-96f2db05f60f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:59.103376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-07fbca16-3454-4ef0-9c1e-96f2db05f60f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:59.114382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:30:59.116673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:30:59.116845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07fbca16-3454-4ef0-9c1e-96f2db05f60f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:59.117385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07fbca16-3454-4ef0-9c1e-96f2db05f60f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:59.118002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07fbca16-3454-4ef0-9c1e-96f2db05f60f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:59.127042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07fbca16-3454-4ef0-9c1e-96f2db05f60f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:59.127042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07fbca16-3454-4ef0-9c1e-96f2db05f60f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:59.127042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07fbca16-3454-4ef0-9c1e-96f2db05f60f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:59.274499 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-67f2eb43-dfe9-4322-8c23-ba6de744b783 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.323060 Oct 11 04:30:59.276495 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2155/4553] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:30:57 2022] POST /compute/v2.1/servers => generated 409 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:30:59.282766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bbccfa77-0461-460d-b1b8-e2569ddb280a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:59.283874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bbccfa77-0461-460d-b1b8-e2569ddb280a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:59.291895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbccfa77-0461-460d-b1b8-e2569ddb280a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:59.294017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbccfa77-0461-460d-b1b8-e2569ddb280a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:59.294767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbccfa77-0461-460d-b1b8-e2569ddb280a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:59.295944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbccfa77-0461-460d-b1b8-e2569ddb280a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:59.297240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbccfa77-0461-460d-b1b8-e2569ddb280a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:59.297883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bbccfa77-0461-460d-b1b8-e2569ddb280a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:59.398307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bbccfa77-0461-460d-b1b8-e2569ddb280a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:30:59.411452 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bbccfa77-0461-460d-b1b8-e2569ddb280a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1295 microversion: 2.1 time: 0.131835 Oct 11 04:30:59.412643 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2156/4554] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:59 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1295 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:30:59.418802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dba40f5f-4490-4e36-9471-f385cdcc9693 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:59.419797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dba40f5f-4490-4e36-9471-f385cdcc9693 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:30:59.430606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dba40f5f-4490-4e36-9471-f385cdcc9693 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:59.430606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dba40f5f-4490-4e36-9471-f385cdcc9693 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:59.430606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dba40f5f-4490-4e36-9471-f385cdcc9693 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:59.434616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dba40f5f-4490-4e36-9471-f385cdcc9693 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:30:59.435794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dba40f5f-4490-4e36-9471-f385cdcc9693 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:30:59.438437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dba40f5f-4490-4e36-9471-f385cdcc9693 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:30:59.501097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dba40f5f-4490-4e36-9471-f385cdcc9693 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:30:59.916818 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dba40f5f-4490-4e36-9471-f385cdcc9693 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 204 len: 0 microversion: 2.1 time: 0.501001 Oct 11 04:30:59.918238 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2157/4555] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:30:59 2022] DELETE /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 0 bytes in 505 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:30:59.930327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6523158c-8086-46bb-8287-64608f9cfc9c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:30:59.933101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6523158c-8086-46bb-8287-64608f9cfc9c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:00.067999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6523158c-8086-46bb-8287-64608f9cfc9c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:00.080365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6523158c-8086-46bb-8287-64608f9cfc9c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1246 microversion: 2.1 time: 0.160532 Oct 11 04:31:00.097290 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2158/4556] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:59 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1246 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:00.097290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:00.097290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:00.116373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.116794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.117497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.121282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.122483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.123163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.258287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-07fbca16-3454-4ef0-9c1e-96f2db05f60f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:00.268304 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-07fbca16-3454-4ef0-9c1e-96f2db05f60f tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1515 microversion: 2.1 time: 1.182028 Oct 11 04:31:00.282255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:00.288486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:00.289806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:00.292560 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2399/4557] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:30:59 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1515 bytes in 1207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:00.294992 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b0f44a26-e92b-4cda-977e-112587148b27 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.207358 Oct 11 04:31:00.295765 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2159/4558] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:31:00 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:31:00.322658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-042e42f6-4cc5-4ba2-869d-e310dd5c7c25 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:00.323369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-042e42f6-4cc5-4ba2-869d-e310dd5c7c25 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:00.333756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-042e42f6-4cc5-4ba2-869d-e310dd5c7c25 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.334396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-042e42f6-4cc5-4ba2-869d-e310dd5c7c25 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.334899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-042e42f6-4cc5-4ba2-869d-e310dd5c7c25 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.336075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-042e42f6-4cc5-4ba2-869d-e310dd5c7c25 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.336603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-042e42f6-4cc5-4ba2-869d-e310dd5c7c25 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.337330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-042e42f6-4cc5-4ba2-869d-e310dd5c7c25 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.583550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-042e42f6-4cc5-4ba2-869d-e310dd5c7c25 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:00.587043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a6a37e64-11bb-4021-9880-6e028f5b9c86 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Action: 'update', calling method: .version_select at 0x7fda18ec93a0>, body: {"status": "disabled", "disabled_reason": "maintenance"} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:00.595125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6a37e64-11bb-4021-9880-6e028f5b9c86 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.595709 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-042e42f6-4cc5-4ba2-869d-e310dd5c7c25 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1506 microversion: 2.1 time: 0.277066 Oct 11 04:31:00.596527 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2160/4559] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:00 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1506 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:00.596787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6a37e64-11bb-4021-9880-6e028f5b9c86 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.597499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6a37e64-11bb-4021-9880-6e028f5b9c86 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.602621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-97bc95c5-7e56-444c-8be7-caf3277ce039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:00.603836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-97bc95c5-7e56-444c-8be7-caf3277ce039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:00.610229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97bc95c5-7e56-444c-8be7-caf3277ce039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.610738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97bc95c5-7e56-444c-8be7-caf3277ce039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.611173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97bc95c5-7e56-444c-8be7-caf3277ce039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.612166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97bc95c5-7e56-444c-8be7-caf3277ce039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.612641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97bc95c5-7e56-444c-8be7-caf3277ce039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.613050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97bc95c5-7e56-444c-8be7-caf3277ce039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.617874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6a37e64-11bb-4021-9880-6e028f5b9c86 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.619270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6a37e64-11bb-4021-9880-6e028f5b9c86 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.619861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6a37e64-11bb-4021-9880-6e028f5b9c86 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.630102 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-a6a37e64-11bb-4021-9880-6e028f5b9c86 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] HTTP exception thrown: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a6a37e64-11bb-4021-9880-6e028f5b9c86 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Request method failure captured: Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/os-services/78e414da-15d8-47f1-aeb9-4da76846da71 HTTP/1.1 Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 56 Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPGDs_TG19CHb0LxbynmwjJ3QnZ7RCftMc3-id6te78IxKS_-3cGjc-rlurvW19eB0YFy23ozCjm57QH5I9Td0U74j143HEoEYIL7RNZILEOuk9SldQGcPaMfRvOZP5VkRqn1r45RygpmAS4tZ-AULfOgcrf0w4cA0B3aikkGLW-kto Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: e86610df76cb482898af809d130f196a Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-683864887 Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e86610df76cb482898af809d130f196a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e86610df76cb482898af809d130f196a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e86610df76cb482898af809d130f196a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e86610df76cb482898af809d130f196a"}]}] Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-683864887 Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: e86610df76cb482898af809d130f196a Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-683864887 Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 14ae18788bc3434983af4cf5de69c05a Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: {"status": "disabled", "disabled_reason": "maintenance"} Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: exception: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '78e414da-15d8-47f1-aeb9-4da76846da71', 'body': {'status': 'disabled', 'disabled_reason': 'maintenance'}} Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:31:00.632695 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.637561 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.639115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a6a37e64-11bb-4021-9880-6e028f5b9c86 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Returning 404 to user: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:31:00.640140 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a6a37e64-11bb-4021-9880-6e028f5b9c86 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/78e414da-15d8-47f1-aeb9-4da76846da71" status: 404 len: 110 microversion: 2.53 time: 0.346025 Oct 11 04:31:00.641653 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2400/4560] 10.222.0.26 () {62 vars in 1309 bytes} [Tue Oct 11 04:31:00 2022] PUT /compute/v2.1/os-services/78e414da-15d8-47f1-aeb9-4da76846da71 => generated 110 bytes in 348 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:31:00.657768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-406bbeaf-93ef-43f3-a94e-1f9059f190b8 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Action: 'update', calling method: .version_select at 0x7fda18ec9dc0>, body: {"status": "disabled"} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:00.672854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-406bbeaf-93ef-43f3-a94e-1f9059f190b8 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.674861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-406bbeaf-93ef-43f3-a94e-1f9059f190b8 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.677366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-406bbeaf-93ef-43f3-a94e-1f9059f190b8 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.692698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-406bbeaf-93ef-43f3-a94e-1f9059f190b8 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.693184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-406bbeaf-93ef-43f3-a94e-1f9059f190b8 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.693618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-406bbeaf-93ef-43f3-a94e-1f9059f190b8 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.716750 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-406bbeaf-93ef-43f3-a94e-1f9059f190b8 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] HTTP exception thrown: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-406bbeaf-93ef-43f3-a94e-1f9059f190b8 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Request method failure captured: Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/os-services/78e414da-15d8-47f1-aeb9-4da76846da71 HTTP/1.1 Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 22 Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPGDs_TG19CHb0LxbynmwjJ3QnZ7RCftMc3-id6te78IxKS_-3cGjc-rlurvW19eB0YFy23ozCjm57QH5I9Td0U74j143HEoEYIL7RNZILEOuk9SldQGcPaMfRvOZP5VkRqn1r45RygpmAS4tZ-AULfOgcrf0w4cA0B3aikkGLW-kto Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: e86610df76cb482898af809d130f196a Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-683864887 Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e86610df76cb482898af809d130f196a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e86610df76cb482898af809d130f196a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e86610df76cb482898af809d130f196a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e86610df76cb482898af809d130f196a"}]}] Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-683864887 Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: e86610df76cb482898af809d130f196a Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-683864887 Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 14ae18788bc3434983af4cf5de69c05a Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: {"status": "disabled"} Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: exception: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '78e414da-15d8-47f1-aeb9-4da76846da71', 'body': {'status': 'disabled'}} Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:31:00.722468 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-406bbeaf-93ef-43f3-a94e-1f9059f190b8 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Returning 404 to user: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-406bbeaf-93ef-43f3-a94e-1f9059f190b8 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/78e414da-15d8-47f1-aeb9-4da76846da71" status: 404 len: 110 microversion: 2.53 time: 0.077290 Oct 11 04:31:00.732964 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2401/4561] 10.222.0.26 () {62 vars in 1309 bytes} [Tue Oct 11 04:31:00 2022] PUT /compute/v2.1/os-services/78e414da-15d8-47f1-aeb9-4da76846da71 => generated 110 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:31:00.740923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cebe94f5-a8de-4156-8445-67a568c0906e tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Action: 'update', calling method: .version_select at 0x7fda193e0ca0>, body: {"status": "enabled"} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:00.743299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cebe94f5-a8de-4156-8445-67a568c0906e tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.744695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cebe94f5-a8de-4156-8445-67a568c0906e tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.745142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cebe94f5-a8de-4156-8445-67a568c0906e tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.751218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cebe94f5-a8de-4156-8445-67a568c0906e tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.751985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cebe94f5-a8de-4156-8445-67a568c0906e tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.752641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cebe94f5-a8de-4156-8445-67a568c0906e tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.759624 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-cebe94f5-a8de-4156-8445-67a568c0906e tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] HTTP exception thrown: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cebe94f5-a8de-4156-8445-67a568c0906e tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Request method failure captured: Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/os-services/78e414da-15d8-47f1-aeb9-4da76846da71 HTTP/1.1 Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 21 Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPGDs_TG19CHb0LxbynmwjJ3QnZ7RCftMc3-id6te78IxKS_-3cGjc-rlurvW19eB0YFy23ozCjm57QH5I9Td0U74j143HEoEYIL7RNZILEOuk9SldQGcPaMfRvOZP5VkRqn1r45RygpmAS4tZ-AULfOgcrf0w4cA0B3aikkGLW-kto Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: e86610df76cb482898af809d130f196a Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-683864887 Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e86610df76cb482898af809d130f196a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e86610df76cb482898af809d130f196a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e86610df76cb482898af809d130f196a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e86610df76cb482898af809d130f196a"}]}] Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-683864887 Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: e86610df76cb482898af809d130f196a Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-683864887 Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 14ae18788bc3434983af4cf5de69c05a Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: {"status": "enabled"} Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: exception: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '78e414da-15d8-47f1-aeb9-4da76846da71', 'body': {'status': 'enabled'}} Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6207, in service_get_by_id Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return _find_service_in_cell(context, service_id=service_id) Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6067, in _find_service_in_cell Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.NotFound() Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.NotFound: Resource could not be found. Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 436, in update Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi service = self.host_api.service_get_by_id(context, service_id) Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 6209, in service_get_by_id Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ServiceNotFound(service_id=service_id) Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ServiceNotFound: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:31:00.761526 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 441, in update Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. Oct 11 04:31:00.765890 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:00.768266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cebe94f5-a8de-4156-8445-67a568c0906e tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Returning 404 to user: Service 78e414da-15d8-47f1-aeb9-4da76846da71 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:31:00.769349 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cebe94f5-a8de-4156-8445-67a568c0906e tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-services/78e414da-15d8-47f1-aeb9-4da76846da71" status: 404 len: 110 microversion: 2.53 time: 0.034719 Oct 11 04:31:00.770667 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2402/4562] 10.222.0.26 () {62 vars in 1309 bytes} [Tue Oct 11 04:31:00 2022] PUT /compute/v2.1/os-services/78e414da-15d8-47f1-aeb9-4da76846da71 => generated 110 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:31:00.788963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c7718e29-852a-4e05-b636-d49a99de9f50 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:00.788963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7718e29-852a-4e05-b636-d49a99de9f50 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.788963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7718e29-852a-4e05-b636-d49a99de9f50 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.788963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7718e29-852a-4e05-b636-d49a99de9f50 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.788963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7718e29-852a-4e05-b636-d49a99de9f50 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.788963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7718e29-852a-4e05-b636-d49a99de9f50 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.789707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7718e29-852a-4e05-b636-d49a99de9f50 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.820528 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c7718e29-852a-4e05-b636-d49a99de9f50 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.043018 Oct 11 04:31:00.821695 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2403/4563] 10.222.0.26 () {60 vars in 1178 bytes} [Tue Oct 11 04:31:00 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:31:00.850628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7c684f85-46e8-4a3f-99b5-549855b31c62 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:00.862667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c684f85-46e8-4a3f-99b5-549855b31c62 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.866056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c684f85-46e8-4a3f-99b5-549855b31c62 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.866783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c684f85-46e8-4a3f-99b5-549855b31c62 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.868913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c684f85-46e8-4a3f-99b5-549855b31c62 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.869902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c684f85-46e8-4a3f-99b5-549855b31c62 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.871210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c684f85-46e8-4a3f-99b5-549855b31c62 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.936812 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7c684f85-46e8-4a3f-99b5-549855b31c62 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.093709 Oct 11 04:31:00.937870 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2404/4564] 10.222.0.26 () {60 vars in 1211 bytes} [Tue Oct 11 04:31:00 2022] GET /compute/v2.1/os-services?xxx=nova-compute => generated 1239 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:31:00.953447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-527ede6b-827e-4c30-8d73-711f8a5f3734 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:00.957006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-527ede6b-827e-4c30-8d73-711f8a5f3734 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.973402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-97bc95c5-7e56-444c-8be7-caf3277ce039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:00.978648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-527ede6b-827e-4c30-8d73-711f8a5f3734 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.980176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-527ede6b-827e-4c30-8d73-711f8a5f3734 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.982175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-527ede6b-827e-4c30-8d73-711f8a5f3734 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:00.982710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-527ede6b-827e-4c30-8d73-711f8a5f3734 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:00.983142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-527ede6b-827e-4c30-8d73-711f8a5f3734 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:00.990035 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-97bc95c5-7e56-444c-8be7-caf3277ce039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1362 microversion: 2.1 time: 0.386448 Oct 11 04:31:00.990723 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2161/4565] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:00 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:01.053624 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-527ede6b-827e-4c30-8d73-711f8a5f3734 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.105433 Oct 11 04:31:01.056952 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2405/4566] 10.222.0.26 () {60 vars in 1178 bytes} [Tue Oct 11 04:31:00 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:31:01.068384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d6558264-9e1c-4734-9ea2-ddc1f6c30304 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:01.076842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6558264-9e1c-4734-9ea2-ddc1f6c30304 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.077451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6558264-9e1c-4734-9ea2-ddc1f6c30304 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.077905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6558264-9e1c-4734-9ea2-ddc1f6c30304 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.081109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6558264-9e1c-4734-9ea2-ddc1f6c30304 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.081605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6558264-9e1c-4734-9ea2-ddc1f6c30304 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.083925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6558264-9e1c-4734-9ea2-ddc1f6c30304 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.112769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a51a73fa-314c-43d3-adea-8cc2cde09fbe tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:01.113796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a51a73fa-314c-43d3-adea-8cc2cde09fbe tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:01.122999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51a73fa-314c-43d3-adea-8cc2cde09fbe tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.124267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51a73fa-314c-43d3-adea-8cc2cde09fbe tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.125515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51a73fa-314c-43d3-adea-8cc2cde09fbe tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.126526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51a73fa-314c-43d3-adea-8cc2cde09fbe tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.127221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51a73fa-314c-43d3-adea-8cc2cde09fbe tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.128056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51a73fa-314c-43d3-adea-8cc2cde09fbe tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.156657 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d6558264-9e1c-4734-9ea2-ddc1f6c30304 tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=n-d-860892-1&binary=xxx" status: 200 len: 16 microversion: 2.53 time: 0.092951 Oct 11 04:31:01.159486 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2162/4567] 10.222.0.26 () {60 vars in 1235 bytes} [Tue Oct 11 04:31:01 2022] GET /compute/v2.1/os-services?host=n-d-860892-1&binary=xxx => generated 16 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:01.184822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f79a6382-3ab7-4b79-a11f-43e0956957ac tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:01.192407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f79a6382-3ab7-4b79-a11f-43e0956957ac tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.200568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f79a6382-3ab7-4b79-a11f-43e0956957ac tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.202007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f79a6382-3ab7-4b79-a11f-43e0956957ac tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.207766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f79a6382-3ab7-4b79-a11f-43e0956957ac tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.210913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f79a6382-3ab7-4b79-a11f-43e0956957ac tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.211613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f79a6382-3ab7-4b79-a11f-43e0956957ac tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.287837 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f79a6382-3ab7-4b79-a11f-43e0956957ac tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1239 microversion: 2.53 time: 0.113649 Oct 11 04:31:01.289096 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2163/4568] 10.222.0.26 () {60 vars in 1178 bytes} [Tue Oct 11 04:31:01 2022] GET /compute/v2.1/os-services => generated 1239 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:31:01.303334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-990c159f-dd12-4a07-b493-761e58063fcf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:01.304283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-990c159f-dd12-4a07-b493-761e58063fcf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:01.310697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-990c159f-dd12-4a07-b493-761e58063fcf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.311448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-990c159f-dd12-4a07-b493-761e58063fcf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.312107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-990c159f-dd12-4a07-b493-761e58063fcf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.313004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-990c159f-dd12-4a07-b493-761e58063fcf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.313662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-990c159f-dd12-4a07-b493-761e58063fcf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.314549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-990c159f-dd12-4a07-b493-761e58063fcf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.332131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a51a73fa-314c-43d3-adea-8cc2cde09fbe tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:01.344325 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a51a73fa-314c-43d3-adea-8cc2cde09fbe tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1242 microversion: 2.1 time: 0.242927 Oct 11 04:31:01.348342 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2406/4569] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:01 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1242 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:01.362448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3d3e07da-f058-4f98-8cf3-13dd1fbeec3c tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:01.367720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e07da-f058-4f98-8cf3-13dd1fbeec3c tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.369549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e07da-f058-4f98-8cf3-13dd1fbeec3c tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.370177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e07da-f058-4f98-8cf3-13dd1fbeec3c tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.371978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e07da-f058-4f98-8cf3-13dd1fbeec3c tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.377963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e07da-f058-4f98-8cf3-13dd1fbeec3c tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.377963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e07da-f058-4f98-8cf3-13dd1fbeec3c tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.432977 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3d3e07da-f058-4f98-8cf3-13dd1fbeec3c tempest-ServicesAdminNegativeV253TestJSON-683864887 tempest-ServicesAdminNegativeV253TestJSON-683864887-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler" status: 200 len: 16 microversion: 2.53 time: 0.083441 Oct 11 04:31:01.433599 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2407/4570] 10.222.0.26 () {60 vars in 1239 bytes} [Tue Oct 11 04:31:01 2022] GET /compute/v2.1/os-services?host=xxx&binary=nova-scheduler => generated 16 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:01.457045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:01.457780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:01.468560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.469386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.470036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.471041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.474548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.475366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.643717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:01.661178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-990c159f-dd12-4a07-b493-761e58063fcf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:01.672102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:01.673142 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-990c159f-dd12-4a07-b493-761e58063fcf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.372853 Oct 11 04:31:01.673371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:01.673721 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2164/4571] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:01 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:01.674457 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-71e6eefc-3398-42bb-a405-e23d736f18e7 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1603 microversion: 2.32 time: 0.235381 Oct 11 04:31:01.675258 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2408/4572] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:31:01 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1603 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:31:01.681531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c958b518-b754-473e-80ea-5c0e9720ee78 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:01.686915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c958b518-b754-473e-80ea-5c0e9720ee78 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:01.699244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c958b518-b754-473e-80ea-5c0e9720ee78 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.699971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c958b518-b754-473e-80ea-5c0e9720ee78 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.701565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c958b518-b754-473e-80ea-5c0e9720ee78 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.703181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c958b518-b754-473e-80ea-5c0e9720ee78 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:01.703857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c958b518-b754-473e-80ea-5c0e9720ee78 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:01.708521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c958b518-b754-473e-80ea-5c0e9720ee78 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:01.993833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0633fcc1-26f3-45b2-aa41-ebe826d19fd2 tempest-ServicesAdminNegativeV253TestJSON-594631175 tempest-ServicesAdminNegativeV253TestJSON-594631175-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:01.997511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0633fcc1-26f3-45b2-aa41-ebe826d19fd2 tempest-ServicesAdminNegativeV253TestJSON-594631175 tempest-ServicesAdminNegativeV253TestJSON-594631175-project] Policy check for os_compute_api:os-services:list failed with credentials {'is_admin': False, 'user_id': '0414d167c4df4ecba760dab450931bf4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a128fb05c3d4ca49f8816d1102204e4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0633fcc1-26f3-45b2-aa41-ebe826d19fd2 tempest-ServicesAdminNegativeV253TestJSON-594631175 tempest-ServicesAdminNegativeV253TestJSON-594631175-project] Request method failure captured: Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-services HTTP/1.1 Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPGCvLeW2LstnQImMNV6B4OycN5m2UjbdpDt2g1C6fCQgulrOTybwQ036sHjWYPT803L1nP8QjZn4ratKo39l5fscKR3NyJ2J1_uYMrATpNCpTu9RX6w5tDIPNkwiYiRmuQICBQy0J-pH3RFg3T-MtUWqdjljj0mOo7pl3hTubLdktY Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.53 Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 7a128fb05c3d4ca49f8816d1102204e4 Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServicesAdminNegativeV253TestJSON-594631175 Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7a128fb05c3d4ca49f8816d1102204e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7a128fb05c3d4ca49f8816d1102204e4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a128fb05c3d4ca49f8816d1102204e4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7a128fb05c3d4ca49f8816d1102204e4"}]}] Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServicesAdminNegativeV253TestJSON-594631175 Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 7a128fb05c3d4ca49f8816d1102204e4 Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServicesAdminNegativeV253TestJSON-594631175 Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServicesAdminNegativeV253TestJSON-594631175-project Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 0414d167c4df4ecba760dab450931bf4 Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServicesAdminNegativeV253TestJSON-594631175-project Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: exception: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: action_args: {} Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/services.py", line 384, in index Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi context.can(services_policies.BASE_POLICY_NAME % 'list', target={}) Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/context.py", line 240, in can Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return policy.authorize(self, action, target) Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 199, in authorize Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi LOG.debug('Policy check for %(action)s failed with credentials ' Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.force_reraise() Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise self.value Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/policy.py", line 186, in authorize Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = _ENFORCER.authorize(action, target, context, Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1184, in authorize Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.enforce( Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc(*args, **kwargs) Oct 11 04:31:02.001111 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.PolicyNotAuthorized: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 04:31:02.005151 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:02.005151 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:02.005151 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:02.005151 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:02.005151 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:02.005151 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:02.005151 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 354, in __exit__ Oct 11 04:31:02.005151 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(webob.exc.HTTPForbidden( Oct 11 04:31:02.005151 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Policy doesn't allow os_compute_api:os-services:list to be performed. Oct 11 04:31:02.005151 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:02.010066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0633fcc1-26f3-45b2-aa41-ebe826d19fd2 tempest-ServicesAdminNegativeV253TestJSON-594631175 tempest-ServicesAdminNegativeV253TestJSON-594631175-project] Returning 403 to user: Policy doesn't allow os_compute_api:os-services:list to be performed. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:31:02.010978 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0633fcc1-26f3-45b2-aa41-ebe826d19fd2 tempest-ServicesAdminNegativeV253TestJSON-594631175 tempest-ServicesAdminNegativeV253TestJSON-594631175-project] 10.222.0.26 "GET /compute/v2.1/os-services" status: 403 len: 112 microversion: 2.53 time: 0.336306 Oct 11 04:31:02.011554 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2165/4573] 10.222.0.26 () {60 vars in 1178 bytes} [Tue Oct 11 04:31:01 2022] GET /compute/v2.1/os-services => generated 112 bytes in 337 msecs (HTTP/1.1 403) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:31:02.017621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c91ec2e-da8a-4bf2-bba2-719d628345f7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:02.018688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5c91ec2e-da8a-4bf2-bba2-719d628345f7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:02.028770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c91ec2e-da8a-4bf2-bba2-719d628345f7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:02.029463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c91ec2e-da8a-4bf2-bba2-719d628345f7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:02.030057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c91ec2e-da8a-4bf2-bba2-719d628345f7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:02.031196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c91ec2e-da8a-4bf2-bba2-719d628345f7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:02.031811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c91ec2e-da8a-4bf2-bba2-719d628345f7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:02.032472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c91ec2e-da8a-4bf2-bba2-719d628345f7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:02.147109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c958b518-b754-473e-80ea-5c0e9720ee78 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:02.162996 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c958b518-b754-473e-80ea-5c0e9720ee78 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1506 microversion: 2.1 time: 0.486517 Oct 11 04:31:02.163593 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2409/4574] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:01 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1506 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:02.338470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5c91ec2e-da8a-4bf2-bba2-719d628345f7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:02.347951 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5c91ec2e-da8a-4bf2-bba2-719d628345f7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1362 microversion: 2.1 time: 0.335152 Oct 11 04:31:02.348994 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2166/4575] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:02 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1362 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:02.372123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e2ea967f-ba63-47b0-868e-d644a452a31f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:02.373031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e2ea967f-ba63-47b0-868e-d644a452a31f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:02.383775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2ea967f-ba63-47b0-868e-d644a452a31f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:02.383775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2ea967f-ba63-47b0-868e-d644a452a31f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:02.383775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2ea967f-ba63-47b0-868e-d644a452a31f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:02.383775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2ea967f-ba63-47b0-868e-d644a452a31f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:02.383775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2ea967f-ba63-47b0-868e-d644a452a31f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:02.383775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2ea967f-ba63-47b0-868e-d644a452a31f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:02.567941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e2ea967f-ba63-47b0-868e-d644a452a31f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:02.595553 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e2ea967f-ba63-47b0-868e-d644a452a31f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1298 microversion: 2.1 time: 0.227296 Oct 11 04:31:02.611170 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2410/4576] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:02 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1298 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:02.713514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:02.721231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-816c3c65-b086-4422-aac4-aae65a072e33 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:02.722373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-816c3c65-b086-4422-aac4-aae65a072e33 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:02.723725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:02.755972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816c3c65-b086-4422-aac4-aae65a072e33 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:02.761048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:02.765266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:02.766113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816c3c65-b086-4422-aac4-aae65a072e33 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:02.771742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816c3c65-b086-4422-aac4-aae65a072e33 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:02.772618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:02.772618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:02.773975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816c3c65-b086-4422-aac4-aae65a072e33 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:02.780090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816c3c65-b086-4422-aac4-aae65a072e33 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:02.783764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:02.784327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:02.787368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-816c3c65-b086-4422-aac4-aae65a072e33 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:02.972758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:02.976771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:02.979356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:02.979941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lazy-loading 'fault' on Instance uuid 195aa0db-57d6-41c8-ba3c-474800a0d2b4 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:31:03.247836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:03.262688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:03.268128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '1f75f519f7b44fc8b81d281cf0d3f502', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '529357092c6e404e982f968263d41eae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:03.272819 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6df0979a-83a9-44bc-996c-9d88adf54b5e tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 200 len: 1608 microversion: 2.32 time: 0.567831 Oct 11 04:31:03.291993 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2411/4577] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:31:02 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 1608 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:31:03.303310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5bfc6778-95d4-49e9-bbf9-a5cb5800dddd tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:03.304334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5bfc6778-95d4-49e9-bbf9-a5cb5800dddd tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:03.311852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5bfc6778-95d4-49e9-bbf9-a5cb5800dddd tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:03.312844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5bfc6778-95d4-49e9-bbf9-a5cb5800dddd tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:03.313518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5bfc6778-95d4-49e9-bbf9-a5cb5800dddd tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:03.314548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5bfc6778-95d4-49e9-bbf9-a5cb5800dddd tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:03.315274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5bfc6778-95d4-49e9-bbf9-a5cb5800dddd tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:03.316041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5bfc6778-95d4-49e9-bbf9-a5cb5800dddd tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:03.910178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-816c3c65-b086-4422-aac4-aae65a072e33 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:03.927057 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-816c3c65-b086-4422-aac4-aae65a072e33 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 1.227594 Oct 11 04:31:03.930787 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2167/4578] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:02 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 1233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:03.939817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5bfc6778-95d4-49e9-bbf9-a5cb5800dddd tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:03.940338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6e2c2fa3-7d9e-4356-8d78-ea8ea1d35c25 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:03.944754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6e2c2fa3-7d9e-4356-8d78-ea8ea1d35c25 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:03.951771 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5bfc6778-95d4-49e9-bbf9-a5cb5800dddd tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1506 microversion: 2.1 time: 0.658190 Oct 11 04:31:03.953308 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2412/4579] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:03 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1506 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:03.962727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c034c2b8-82b5-4f37-ac96-d3f26bf4cd7c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:03.965988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c034c2b8-82b5-4f37-ac96-d3f26bf4cd7c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:03.982463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c034c2b8-82b5-4f37-ac96-d3f26bf4cd7c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:03.984328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c034c2b8-82b5-4f37-ac96-d3f26bf4cd7c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:03.984465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2c2fa3-7d9e-4356-8d78-ea8ea1d35c25 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:03.988148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2c2fa3-7d9e-4356-8d78-ea8ea1d35c25 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:03.988454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c034c2b8-82b5-4f37-ac96-d3f26bf4cd7c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:03.988454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c034c2b8-82b5-4f37-ac96-d3f26bf4cd7c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:03.988454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c034c2b8-82b5-4f37-ac96-d3f26bf4cd7c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:03.989023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c034c2b8-82b5-4f37-ac96-d3f26bf4cd7c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:03.991612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2c2fa3-7d9e-4356-8d78-ea8ea1d35c25 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:03.996477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2c2fa3-7d9e-4356-8d78-ea8ea1d35c25 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:04.001363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2c2fa3-7d9e-4356-8d78-ea8ea1d35c25 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:04.001847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e2c2fa3-7d9e-4356-8d78-ea8ea1d35c25 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:04.194538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c034c2b8-82b5-4f37-ac96-d3f26bf4cd7c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:04.222646 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c034c2b8-82b5-4f37-ac96-d3f26bf4cd7c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1304 microversion: 2.1 time: 0.267309 Oct 11 04:31:04.233195 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2413/4580] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:03 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1304 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:04.246774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-feca6c0a-74bd-42fc-ae2e-e15c38d33452 req-c9e796bc-5088-4fec-a2ab-6d7a580d73cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cbbf53c3-cd04-4cec-995b-d5ce999883ed", "name": "network-vif-deleted", "tag": "aa553787-8d23-4efa-8d83-17aba549b7d3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:04.271295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-feca6c0a-74bd-42fc-ae2e-e15c38d33452 req-c9e796bc-5088-4fec-a2ab-6d7a580d73cb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:04.272302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-feca6c0a-74bd-42fc-ae2e-e15c38d33452 req-c9e796bc-5088-4fec-a2ab-6d7a580d73cb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:04.273938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-feca6c0a-74bd-42fc-ae2e-e15c38d33452 req-c9e796bc-5088-4fec-a2ab-6d7a580d73cb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:04.293589 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-feca6c0a-74bd-42fc-ae2e-e15c38d33452 req-c9e796bc-5088-4fec-a2ab-6d7a580d73cb service nova] Creating event network-vif-deleted:aa553787-8d23-4efa-8d83-17aba549b7d3 for instance cbbf53c3-cd04-4cec-995b-d5ce999883ed on n-h1-860892-1 Oct 11 04:31:04.300604 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-feca6c0a-74bd-42fc-ae2e-e15c38d33452 req-c9e796bc-5088-4fec-a2ab-6d7a580d73cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066038 Oct 11 04:31:04.302346 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2414/4581] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:04.308482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:04.310005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:04.318667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:04.320574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:04.322143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:04.323293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:04.324172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:04.324835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:04.345951 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] HTTP exception thrown: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Request method failure captured: Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 HTTP/1.1 Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO-sXO3EVi8WVrmYJx7fZW5vvIFsL5Rn8LpPNfvFtRtPhl1DysTAVfAwDz88PG2JmtKt8e0DC7Xl6zeOHQh6SADzY33dpzMdvBdkWjLoMKDPlK8Y0iOEZfh56aUQdgmjEViPSm6wkyDnsi6wU2-1xGIlC_q0l1CWMcPydnZuKPT-b88 Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 529357092c6e404e982f968263d41eae Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TaggedBootDevicesTest-315683041 Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/529357092c6e404e982f968263d41eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_529357092c6e404e982f968263d41eae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/529357092c6e404e982f968263d41eae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/529357092c6e404e982f968263d41eae"}]}] Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TaggedBootDevicesTest-315683041 Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 529357092c6e404e982f968263d41eae Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TaggedBootDevicesTest-315683041 Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TaggedBootDevicesTest-315683041-project Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 1f75f519f7b44fc8b81d281cf0d3f502 Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TaggedBootDevicesTest-315683041-project Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '195aa0db-57d6-41c8-ba3c-474800a0d2b4'} Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:04.348020 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:04.352294 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:04.352294 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:04.352294 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:04.352294 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:31:04.352294 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:31:04.352294 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:04.352294 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:04.354719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Returning 404 to user: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:31:04.355876 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a437c154-abfa-44be-9d21-9f9b512449e2 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 404 len: 111 microversion: 2.32 time: 0.052200 Oct 11 04:31:04.356660 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2415/4582] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:31:04 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:31:04.373182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-106c51e9-3e69-4685-adbc-0201c6a43197 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '.version_select at 0x7fda18ec93a0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:04.486251 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-106c51e9-3e69-4685-adbc-0201c6a43197 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-512300577" status: 204 len: 0 microversion: 2.32 time: 0.121785 Oct 11 04:31:04.487904 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2416/4583] 10.222.0.26 () {60 vars in 1259 bytes} [Tue Oct 11 04:31:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-512300577 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:31:04.606387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6e2c2fa3-7d9e-4356-8d78-ea8ea1d35c25 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:04.619700 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6e2c2fa3-7d9e-4356-8d78-ea8ea1d35c25 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1362 microversion: 2.1 time: 0.687391 Oct 11 04:31:04.624437 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2168/4584] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:03 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1362 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:04.803984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-82e4177c-204b-4062-90e7-f1c64c260764 req-848fc325-6e43-4e04-8fb7-17d93db8818a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3308eac-14b8-4148-96ef-d0794593fb30", "name": "network-vif-plugged", "status": "completed", "tag": "296d8dde-1afc-4a75-b185-9efbe9173586"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:04.816048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-71dc7c3c-0a7e-4161-8c53-0ee10fc2ab62 req-455e6dec-7ac5-48f1-a84b-82f5df1ff363 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "999777c2-2b4b-4ae8-ab23-7709485d2501", "tag": "a27ad975-bd5a-4090-9531-4889fbb049af"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:04.879296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-71dc7c3c-0a7e-4161-8c53-0ee10fc2ab62 req-455e6dec-7ac5-48f1-a84b-82f5df1ff363 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:04.884998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-71dc7c3c-0a7e-4161-8c53-0ee10fc2ab62 req-455e6dec-7ac5-48f1-a84b-82f5df1ff363 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:04.888662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-71dc7c3c-0a7e-4161-8c53-0ee10fc2ab62 req-455e6dec-7ac5-48f1-a84b-82f5df1ff363 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:04.890784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82e4177c-204b-4062-90e7-f1c64c260764 req-848fc325-6e43-4e04-8fb7-17d93db8818a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:04.895745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82e4177c-204b-4062-90e7-f1c64c260764 req-848fc325-6e43-4e04-8fb7-17d93db8818a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:04.898813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82e4177c-204b-4062-90e7-f1c64c260764 req-848fc325-6e43-4e04-8fb7-17d93db8818a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:04.952338 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-71dc7c3c-0a7e-4161-8c53-0ee10fc2ab62 req-455e6dec-7ac5-48f1-a84b-82f5df1ff363 service nova] Creating event network-changed:a27ad975-bd5a-4090-9531-4889fbb049af for instance 999777c2-2b4b-4ae8-ab23-7709485d2501 on n-h2-860892-1 Oct 11 04:31:04.960708 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-82e4177c-204b-4062-90e7-f1c64c260764 req-848fc325-6e43-4e04-8fb7-17d93db8818a service nova] Creating event network-vif-plugged:296d8dde-1afc-4a75-b185-9efbe9173586 for instance d3308eac-14b8-4148-96ef-d0794593fb30 on n-h2-860892-1 Oct 11 04:31:04.982234 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-71dc7c3c-0a7e-4161-8c53-0ee10fc2ab62 req-455e6dec-7ac5-48f1-a84b-82f5df1ff363 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.162599 Oct 11 04:31:04.989120 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2169/4585] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:04.990760 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-82e4177c-204b-4062-90e7-f1c64c260764 req-848fc325-6e43-4e04-8fb7-17d93db8818a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188651 Oct 11 04:31:04.995142 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2417/4586] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:05.018831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8fe2d828-642e-45bf-b195-09e61bfcedec tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:05.020677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8fe2d828-642e-45bf-b195-09e61bfcedec tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:05.022365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:05.026518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:05.036376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fe2d828-642e-45bf-b195-09e61bfcedec tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:05.037048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fe2d828-642e-45bf-b195-09e61bfcedec tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:05.037590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fe2d828-642e-45bf-b195-09e61bfcedec tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:05.040248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fe2d828-642e-45bf-b195-09e61bfcedec tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:05.043231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:05.043718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:05.044153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:05.044321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fe2d828-642e-45bf-b195-09e61bfcedec tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:05.044891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8fe2d828-642e-45bf-b195-09e61bfcedec tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:05.048369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:05.051467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:05.052011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:05.144803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:05.146590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:05.147645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:05.148115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lazy-loading 'fault' on Instance uuid cbbf53c3-cd04-4cec-995b-d5ce999883ed {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:31:05.278179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef3acbedf6134c6abed4af16783c6e1e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f358bb23de6f4d92874ae1722a7c68c8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:05.286705 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b735e57a-55be-407c-a74f-fa1fc9b68eab tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 200 len: 1304 microversion: 2.1 time: 0.287455 Oct 11 04:31:05.303025 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2418/4587] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:04 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 1304 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:05.318613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f875d7d0-841e-41c9-8506-148b75223cfa tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:05.322151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f875d7d0-841e-41c9-8506-148b75223cfa tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:05.343307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f875d7d0-841e-41c9-8506-148b75223cfa tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:05.345607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f875d7d0-841e-41c9-8506-148b75223cfa tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:05.348482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f875d7d0-841e-41c9-8506-148b75223cfa tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:05.352036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f875d7d0-841e-41c9-8506-148b75223cfa tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:05.352036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f875d7d0-841e-41c9-8506-148b75223cfa tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:05.352036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f875d7d0-841e-41c9-8506-148b75223cfa tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:05.539931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=48 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:05.655109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f875d7d0-841e-41c9-8506-148b75223cfa tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:05.667780 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f875d7d0-841e-41c9-8506-148b75223cfa tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1304 microversion: 2.1 time: 0.363426 Oct 11 04:31:05.670588 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2419/4588] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:05 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1304 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:05.704422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b4e068e-832a-4814-8936-55a04faf4029 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:05.706160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b4e068e-832a-4814-8936-55a04faf4029 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:05.721220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b4e068e-832a-4814-8936-55a04faf4029 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:05.721962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b4e068e-832a-4814-8936-55a04faf4029 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:05.722575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b4e068e-832a-4814-8936-55a04faf4029 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:05.723437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b4e068e-832a-4814-8936-55a04faf4029 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:05.724525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b4e068e-832a-4814-8936-55a04faf4029 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:05.725189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b4e068e-832a-4814-8936-55a04faf4029 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:05.747454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8fe2d828-642e-45bf-b195-09e61bfcedec tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:05.757112 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8fe2d828-642e-45bf-b195-09e61bfcedec tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.766687 Oct 11 04:31:05.757698 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2170/4589] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:04 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:06.171224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b4e068e-832a-4814-8936-55a04faf4029 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:06.180593 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b4e068e-832a-4814-8936-55a04faf4029 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1362 microversion: 2.1 time: 0.505288 Oct 11 04:31:06.183531 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2420/4590] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:05 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1362 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:06.318229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:06.319600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] [instance: cbbf53c3-cd04-4cec-995b-d5ce999883ed] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:06.332313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:06.332819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:06.337115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:06.338085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:06.338611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:06.339060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:06.402432 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] HTTP exception thrown: Instance cbbf53c3-cd04-4cec-995b-d5ce999883ed could not be found. Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Request method failure captured: Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed HTTP/1.1 Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPFS-iDyzjbGqGtaY1XYs5boYibG3AEPfTAy2WGzNm_RT-R5e07u1qcxqilFB8lWLnVQjmtReZwEggqpcEwx8M476jw8o0TJzd4JETv5be-fKDF_3WSayTit6je245g4hAKcO-ef9bcfK1wdVnZC0q9djes0Yyaj25qF0a0Lv743nIU Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f358bb23de6f4d92874ae1722a7c68c8 Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestServerAdvancedOps-604060769 Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f358bb23de6f4d92874ae1722a7c68c8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f358bb23de6f4d92874ae1722a7c68c8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f358bb23de6f4d92874ae1722a7c68c8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f358bb23de6f4d92874ae1722a7c68c8"}]}] Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestServerAdvancedOps-604060769 Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f358bb23de6f4d92874ae1722a7c68c8 Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestServerAdvancedOps-604060769 Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestServerAdvancedOps-604060769-project Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: ef3acbedf6134c6abed4af16783c6e1e Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestServerAdvancedOps-604060769-project Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance cbbf53c3-cd04-4cec-995b-d5ce999883ed could not be found. Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'cbbf53c3-cd04-4cec-995b-d5ce999883ed'} Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cbbf53c3-cd04-4cec-995b-d5ce999883ed could not be found. Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cbbf53c3-cd04-4cec-995b-d5ce999883ed could not be found. Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:06.404158 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:06.408276 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:06.408276 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:06.408276 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:06.408276 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:31:06.408276 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:31:06.408276 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cbbf53c3-cd04-4cec-995b-d5ce999883ed could not be found. Oct 11 04:31:06.408276 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:06.408276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] Returning 404 to user: Instance cbbf53c3-cd04-4cec-995b-d5ce999883ed could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:31:06.408276 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ca61e69a-4262-440d-9aba-c6307d23bdf6 tempest-TestServerAdvancedOps-604060769 tempest-TestServerAdvancedOps-604060769-project] 10.222.0.26 "GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed" status: 404 len: 111 microversion: 2.1 time: 0.091932 Oct 11 04:31:06.411468 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2171/4591] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:06 2022] GET /compute/v2.1/servers/cbbf53c3-cd04-4cec-995b-d5ce999883ed => generated 111 bytes in 98 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:31:06.700202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-524367fa-daca-4cf5-9020-67ac75d2b12f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:06.701576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-524367fa-daca-4cf5-9020-67ac75d2b12f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:06.716570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524367fa-daca-4cf5-9020-67ac75d2b12f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:06.719472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524367fa-daca-4cf5-9020-67ac75d2b12f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:06.720199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524367fa-daca-4cf5-9020-67ac75d2b12f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:06.722475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524367fa-daca-4cf5-9020-67ac75d2b12f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:06.725530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524367fa-daca-4cf5-9020-67ac75d2b12f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:06.726227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-524367fa-daca-4cf5-9020-67ac75d2b12f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:06.782585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bece2f68-25e5-4c03-aebb-f762ffb90666 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:06.783290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bece2f68-25e5-4c03-aebb-f762ffb90666 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:06.809633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bece2f68-25e5-4c03-aebb-f762ffb90666 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:06.809633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bece2f68-25e5-4c03-aebb-f762ffb90666 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:06.809633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bece2f68-25e5-4c03-aebb-f762ffb90666 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:06.809633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bece2f68-25e5-4c03-aebb-f762ffb90666 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:06.809633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bece2f68-25e5-4c03-aebb-f762ffb90666 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:06.809633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bece2f68-25e5-4c03-aebb-f762ffb90666 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:06.885395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:07.418493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bece2f68-25e5-4c03-aebb-f762ffb90666 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:07.428210 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bece2f68-25e5-4c03-aebb-f762ffb90666 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.649985 Oct 11 04:31:07.432260 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2172/4592] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:06 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:07.452741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c229d818-091e-4161-9436-7454131f2010 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:07.453773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c229d818-091e-4161-9436-7454131f2010 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:07.474641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c229d818-091e-4161-9436-7454131f2010 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:07.477437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c229d818-091e-4161-9436-7454131f2010 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:07.479173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c229d818-091e-4161-9436-7454131f2010 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:07.479934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c229d818-091e-4161-9436-7454131f2010 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:07.480406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c229d818-091e-4161-9436-7454131f2010 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:07.480840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c229d818-091e-4161-9436-7454131f2010 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:07.889200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-524367fa-daca-4cf5-9020-67ac75d2b12f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:07.893772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:07.914350 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-524367fa-daca-4cf5-9020-67ac75d2b12f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1372 microversion: 2.1 time: 1.221099 Oct 11 04:31:07.915249 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2421/4593] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:06 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1372 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:08.072148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c229d818-091e-4161-9436-7454131f2010 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:08.090826 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c229d818-091e-4161-9436-7454131f2010 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1362 microversion: 2.1 time: 0.657108 Oct 11 04:31:08.097167 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2173/4594] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:07 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1362 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:08.460975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-261cb57b-92de-409f-b491-da6b2c7b3f47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:08.462553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-261cb57b-92de-409f-b491-da6b2c7b3f47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:08.489622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-261cb57b-92de-409f-b491-da6b2c7b3f47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:08.490984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-261cb57b-92de-409f-b491-da6b2c7b3f47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:08.494694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-261cb57b-92de-409f-b491-da6b2c7b3f47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:08.495702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-261cb57b-92de-409f-b491-da6b2c7b3f47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:08.503090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-261cb57b-92de-409f-b491-da6b2c7b3f47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:08.503090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-261cb57b-92de-409f-b491-da6b2c7b3f47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:08.941454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f31d39ed-2667-4bd4-befb-d7361226123d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:08.942539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f31d39ed-2667-4bd4-befb-d7361226123d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:08.957193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f31d39ed-2667-4bd4-befb-d7361226123d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:08.961444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f31d39ed-2667-4bd4-befb-d7361226123d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:08.964218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f31d39ed-2667-4bd4-befb-d7361226123d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:08.965449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f31d39ed-2667-4bd4-befb-d7361226123d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:08.967208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f31d39ed-2667-4bd4-befb-d7361226123d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:08.969015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f31d39ed-2667-4bd4-befb-d7361226123d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:09.818473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f31d39ed-2667-4bd4-befb-d7361226123d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:09.844695 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f31d39ed-2667-4bd4-befb-d7361226123d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1372 microversion: 2.1 time: 0.894869 Oct 11 04:31:09.849555 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2174/4595] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:08 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1372 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:09.869893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bc253f3b-c509-4323-acb1-469320e161f8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:09.872628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bc253f3b-c509-4323-acb1-469320e161f8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:09.874754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:09.878760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc253f3b-c509-4323-acb1-469320e161f8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:09.879500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc253f3b-c509-4323-acb1-469320e161f8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:09.880179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc253f3b-c509-4323-acb1-469320e161f8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:09.891862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc253f3b-c509-4323-acb1-469320e161f8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:09.892765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc253f3b-c509-4323-acb1-469320e161f8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:09.894421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc253f3b-c509-4323-acb1-469320e161f8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:10.076869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=50 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:10.289594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-261cb57b-92de-409f-b491-da6b2c7b3f47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:10.307767 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-261cb57b-92de-409f-b491-da6b2c7b3f47 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 1.852010 Oct 11 04:31:10.318416 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2422/4596] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:08 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 1854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:10.324229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-68148e78-4295-47a9-af4e-b49294ccba88 req-74b0945f-cd34-48ee-bd15-06fb5fe51f90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec2cb39-bab6-4474-9901-5909a9053a80", "tag": "af219b67-485d-4b19-8980-781c7c1d38b7"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:10.358325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-68148e78-4295-47a9-af4e-b49294ccba88 req-74b0945f-cd34-48ee-bd15-06fb5fe51f90 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:10.366836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-68148e78-4295-47a9-af4e-b49294ccba88 req-74b0945f-cd34-48ee-bd15-06fb5fe51f90 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:10.367926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-68148e78-4295-47a9-af4e-b49294ccba88 req-74b0945f-cd34-48ee-bd15-06fb5fe51f90 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:10.400543 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-68148e78-4295-47a9-af4e-b49294ccba88 req-74b0945f-cd34-48ee-bd15-06fb5fe51f90 service nova] Creating event network-changed:af219b67-485d-4b19-8980-781c7c1d38b7 for instance 7ec2cb39-bab6-4474-9901-5909a9053a80 on n-h2-860892-1 Oct 11 04:31:10.417640 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-68148e78-4295-47a9-af4e-b49294ccba88 req-74b0945f-cd34-48ee-bd15-06fb5fe51f90 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107235 Oct 11 04:31:10.423995 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2423/4597] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:10.536896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bc253f3b-c509-4323-acb1-469320e161f8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:10.601394 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bc253f3b-c509-4323-acb1-469320e161f8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1362 microversion: 2.1 time: 0.752655 Oct 11 04:31:10.607914 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2175/4598] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:09 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1362 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:10.884209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab61cb88-ab7d-4548-b611-af0a6d8b6327 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:10.884209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab61cb88-ab7d-4548-b611-af0a6d8b6327 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:10.891535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab61cb88-ab7d-4548-b611-af0a6d8b6327 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:10.892031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab61cb88-ab7d-4548-b611-af0a6d8b6327 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:10.896322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab61cb88-ab7d-4548-b611-af0a6d8b6327 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:10.896322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab61cb88-ab7d-4548-b611-af0a6d8b6327 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:10.896322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab61cb88-ab7d-4548-b611-af0a6d8b6327 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:10.896322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab61cb88-ab7d-4548-b611-af0a6d8b6327 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:11.307980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab61cb88-ab7d-4548-b611-af0a6d8b6327 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:11.316380 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab61cb88-ab7d-4548-b611-af0a6d8b6327 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1372 microversion: 2.1 time: 0.446676 Oct 11 04:31:11.316980 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2424/4599] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:10 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1372 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:11.340039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4a59db96-5dc2-43f7-b3c3-ecb12af9ab3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:11.340779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4a59db96-5dc2-43f7-b3c3-ecb12af9ab3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:11.344390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=16 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:11.349608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a59db96-5dc2-43f7-b3c3-ecb12af9ab3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:11.350556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a59db96-5dc2-43f7-b3c3-ecb12af9ab3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:11.351327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a59db96-5dc2-43f7-b3c3-ecb12af9ab3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:11.352228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a59db96-5dc2-43f7-b3c3-ecb12af9ab3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:11.353526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a59db96-5dc2-43f7-b3c3-ecb12af9ab3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:11.354646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a59db96-5dc2-43f7-b3c3-ecb12af9ab3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:11.625099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e87436fc-3f9e-4c11-bc69-7beb1bae27d3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:11.626314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e87436fc-3f9e-4c11-bc69-7beb1bae27d3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:11.629169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=24 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:11.643037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e87436fc-3f9e-4c11-bc69-7beb1bae27d3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:11.643779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e87436fc-3f9e-4c11-bc69-7beb1bae27d3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:11.644411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e87436fc-3f9e-4c11-bc69-7beb1bae27d3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:11.645336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e87436fc-3f9e-4c11-bc69-7beb1bae27d3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:11.645984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e87436fc-3f9e-4c11-bc69-7beb1bae27d3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:11.648203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e87436fc-3f9e-4c11-bc69-7beb1bae27d3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:11.929929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e87436fc-3f9e-4c11-bc69-7beb1bae27d3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:11.940183 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e87436fc-3f9e-4c11-bc69-7beb1bae27d3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1362 microversion: 2.1 time: 0.318963 Oct 11 04:31:11.942875 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2425/4600] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:11 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:12.203245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4a59db96-5dc2-43f7-b3c3-ecb12af9ab3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:12.205183 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4a59db96-5dc2-43f7-b3c3-ecb12af9ab3e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.872737 Oct 11 04:31:12.227750 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2176/4601] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:11 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:12.343546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-08a62965-404b-44b8-b6ff-228275830e4f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:12.344853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-08a62965-404b-44b8-b6ff-228275830e4f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:12.354972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a62965-404b-44b8-b6ff-228275830e4f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:12.358892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a62965-404b-44b8-b6ff-228275830e4f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:12.361274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a62965-404b-44b8-b6ff-228275830e4f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:12.364262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a62965-404b-44b8-b6ff-228275830e4f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:12.366913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a62965-404b-44b8-b6ff-228275830e4f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:12.367682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a62965-404b-44b8-b6ff-228275830e4f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:12.809374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-08a62965-404b-44b8-b6ff-228275830e4f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:12.827691 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-08a62965-404b-44b8-b6ff-228275830e4f tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1372 microversion: 2.1 time: 0.482620 Oct 11 04:31:12.829442 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2426/4602] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:12 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1372 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:12.914498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a326ef8d-e301-456c-ba61-3d61dd1bff7d req-93af96dd-ae71-47f3-90fc-13e614ebe9af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999777c2-2b4b-4ae8-ab23-7709485d2501", "name": "network-vif-plugged", "status": "completed", "tag": "a27ad975-bd5a-4090-9531-4889fbb049af"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:12.934725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a326ef8d-e301-456c-ba61-3d61dd1bff7d req-93af96dd-ae71-47f3-90fc-13e614ebe9af service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:12.935457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a326ef8d-e301-456c-ba61-3d61dd1bff7d req-93af96dd-ae71-47f3-90fc-13e614ebe9af service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:12.936176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a326ef8d-e301-456c-ba61-3d61dd1bff7d req-93af96dd-ae71-47f3-90fc-13e614ebe9af service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:12.954484 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a326ef8d-e301-456c-ba61-3d61dd1bff7d req-93af96dd-ae71-47f3-90fc-13e614ebe9af service nova] Creating event network-vif-plugged:a27ad975-bd5a-4090-9531-4889fbb049af for instance 999777c2-2b4b-4ae8-ab23-7709485d2501 on n-h2-860892-1 Oct 11 04:31:12.964023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-59a60a44-bb14-4909-add9-429c9e71975e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:12.964461 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a326ef8d-e301-456c-ba61-3d61dd1bff7d req-93af96dd-ae71-47f3-90fc-13e614ebe9af service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054199 Oct 11 04:31:12.964861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-59a60a44-bb14-4909-add9-429c9e71975e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:12.966303 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2177/4603] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:12.975477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a60a44-bb14-4909-add9-429c9e71975e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:12.978016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a60a44-bb14-4909-add9-429c9e71975e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:12.978482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a60a44-bb14-4909-add9-429c9e71975e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:12.979221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a60a44-bb14-4909-add9-429c9e71975e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:12.979687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a60a44-bb14-4909-add9-429c9e71975e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:12.980122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59a60a44-bb14-4909-add9-429c9e71975e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:13.235453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29645114-2d3c-4a74-a9c3-856e866ff895 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:13.236155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-29645114-2d3c-4a74-a9c3-856e866ff895 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:13.260954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29645114-2d3c-4a74-a9c3-856e866ff895 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:13.260954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29645114-2d3c-4a74-a9c3-856e866ff895 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:13.260954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29645114-2d3c-4a74-a9c3-856e866ff895 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:13.261248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29645114-2d3c-4a74-a9c3-856e866ff895 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:13.261541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29645114-2d3c-4a74-a9c3-856e866ff895 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:13.261961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29645114-2d3c-4a74-a9c3-856e866ff895 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:13.419628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-59a60a44-bb14-4909-add9-429c9e71975e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:13.438574 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-59a60a44-bb14-4909-add9-429c9e71975e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1362 microversion: 2.1 time: 0.478932 Oct 11 04:31:13.442541 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2427/4604] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:12 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1362 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:13.880229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-15a76331-c279-4f15-87c2-5a8b59747e7e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:13.881185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-15a76331-c279-4f15-87c2-5a8b59747e7e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:13.899448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a76331-c279-4f15-87c2-5a8b59747e7e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:13.901414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a76331-c279-4f15-87c2-5a8b59747e7e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:13.901414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a76331-c279-4f15-87c2-5a8b59747e7e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:13.907178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a76331-c279-4f15-87c2-5a8b59747e7e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:13.907948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a76331-c279-4f15-87c2-5a8b59747e7e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:13.909471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a76331-c279-4f15-87c2-5a8b59747e7e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:13.914649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-29645114-2d3c-4a74-a9c3-856e866ff895 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:13.996585 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-29645114-2d3c-4a74-a9c3-856e866ff895 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.765138 Oct 11 04:31:14.011157 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2178/4605] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:13 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:14.747482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-15a76331-c279-4f15-87c2-5a8b59747e7e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:14.768280 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-15a76331-c279-4f15-87c2-5a8b59747e7e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1372 microversion: 2.1 time: 0.918152 Oct 11 04:31:14.789737 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2428/4606] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:13 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1372 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:14.816871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef6613e4-940c-4192-b970-b5152d29cadd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:14.825089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef6613e4-940c-4192-b970-b5152d29cadd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:14.843314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6613e4-940c-4192-b970-b5152d29cadd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:14.843837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6613e4-940c-4192-b970-b5152d29cadd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:14.844289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6613e4-940c-4192-b970-b5152d29cadd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:14.846652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6613e4-940c-4192-b970-b5152d29cadd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:14.848391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6613e4-940c-4192-b970-b5152d29cadd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:14.850711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef6613e4-940c-4192-b970-b5152d29cadd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:15.017350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerPasswordTestJSON-server-1882291898", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "22b6650a-f891-448e-958b-7f6fa7ac8c73"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:15.118443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] validate_networks() for [('22b6650a-f891-448e-958b-7f6fa7ac8c73', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:31:15.248193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef6613e4-940c-4192-b970-b5152d29cadd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:15.258869 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef6613e4-940c-4192-b970-b5152d29cadd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1548 microversion: 2.1 time: 0.466232 Oct 11 04:31:15.259464 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2429/4607] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:14 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1548 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:15.264713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c5e6f13-86b9-4734-9d2b-2d1dfb79a725 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:15.265514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2c5e6f13-86b9-4734-9d2b-2d1dfb79a725 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:15.272797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5e6f13-86b9-4734-9d2b-2d1dfb79a725 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:15.273611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5e6f13-86b9-4734-9d2b-2d1dfb79a725 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:15.274066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5e6f13-86b9-4734-9d2b-2d1dfb79a725 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:15.299510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5e6f13-86b9-4734-9d2b-2d1dfb79a725 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:15.300344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5e6f13-86b9-4734-9d2b-2d1dfb79a725 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:15.303077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c5e6f13-86b9-4734-9d2b-2d1dfb79a725 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:15.596381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2c5e6f13-86b9-4734-9d2b-2d1dfb79a725 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:15.607740 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c5e6f13-86b9-4734-9d2b-2d1dfb79a725 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.346879 Oct 11 04:31:15.610714 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2430/4608] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:15 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:16.002072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TenantUsagesTestJSON-server-2140644794", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:16.125619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:31:16.317571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:31:16.318019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:31:16.318477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:31:16.318880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:31:16.319497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:31:16.332713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:16.333195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:16.340930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:16.341746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:16.342408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:16.343027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:16.414964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Getting quotas for project e97c906957944763a5cedfc096350080. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:31:16.438555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Getting quotas for user 432da3b60c3240c2817bc66ea1b42aa7 and project e97c906957944763a5cedfc096350080. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:31:16.457632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:31:16.464113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:31:16.614769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:31:16.616427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:31:16.619011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:31:16.619011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:31:16.619011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:31:16.638868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:16.639692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:16.647050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:16.650463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:16.653351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:16.654989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:16.676172 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f60b942-8001-414d-9edd-260d75834c0e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.252990 Oct 11 04:31:16.684647 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2179/4609] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:31:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 2276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:31:16.695147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1d580d21-599d-4993-aea8-1790eabfe520 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:16.695654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1d580d21-599d-4993-aea8-1790eabfe520 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:16.737646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Getting quotas for project b2389f8a4b62476f82bbf86884923c22. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:31:16.740411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d580d21-599d-4993-aea8-1790eabfe520 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:16.740911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d580d21-599d-4993-aea8-1790eabfe520 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:16.741350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d580d21-599d-4993-aea8-1790eabfe520 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:16.742066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d580d21-599d-4993-aea8-1790eabfe520 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:16.744609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d580d21-599d-4993-aea8-1790eabfe520 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:16.745056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d580d21-599d-4993-aea8-1790eabfe520 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:16.760883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Getting quotas for user bac73092f41542fc9dc696dbdcbaa044 and project b2389f8a4b62476f82bbf86884923c22. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:31:16.811744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:31:16.817902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:31:17.033468 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-89198fe1-4079-462a-ba03-05bad6d1f569 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.423018 Oct 11 04:31:17.038446 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2431/4610] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:31:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 1427 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:31:17.050868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7e9273d8-6e0b-4268-882a-5df7dd692cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:17.054950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7e9273d8-6e0b-4268-882a-5df7dd692cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:17.062238 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1d580d21-599d-4993-aea8-1790eabfe520 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.376276 Oct 11 04:31:17.063425 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2180/4611] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:31:16 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/os-interface => generated 284 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:17.076404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cdef798a-807e-4171-930f-28128e288d96 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:17.077181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cdef798a-807e-4171-930f-28128e288d96 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:17.084007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e9273d8-6e0b-4268-882a-5df7dd692cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:17.094856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdef798a-807e-4171-930f-28128e288d96 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:17.094856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdef798a-807e-4171-930f-28128e288d96 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:17.094856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdef798a-807e-4171-930f-28128e288d96 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:17.094856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdef798a-807e-4171-930f-28128e288d96 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:17.095831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdef798a-807e-4171-930f-28128e288d96 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:17.096572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdef798a-807e-4171-930f-28128e288d96 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:17.100394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e9273d8-6e0b-4268-882a-5df7dd692cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:17.100886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e9273d8-6e0b-4268-882a-5df7dd692cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:17.101647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e9273d8-6e0b-4268-882a-5df7dd692cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:17.114879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e9273d8-6e0b-4268-882a-5df7dd692cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:17.119195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e9273d8-6e0b-4268-882a-5df7dd692cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:17.767511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cdef798a-807e-4171-930f-28128e288d96 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:17.775700 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cdef798a-807e-4171-930f-28128e288d96 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.710972 Oct 11 04:31:17.778525 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2181/4612] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:17 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:17.799514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-50e2caf1-e480-46d2-a655-ef07bb52134e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:17.800645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-50e2caf1-e480-46d2-a655-ef07bb52134e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:17.842537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7e9273d8-6e0b-4268-882a-5df7dd692cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:17.850169 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7e9273d8-6e0b-4268-882a-5df7dd692cf8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1372 microversion: 2.1 time: 0.810307 Oct 11 04:31:17.850854 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2432/4613] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:17 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1372 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:17.874324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce7b8ae8-5612-4142-a45e-654fd5be7761 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:17.886923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce7b8ae8-5612-4142-a45e-654fd5be7761 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:18.004633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-50e2caf1-e480-46d2-a655-ef07bb52134e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:18.021337 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-50e2caf1-e480-46d2-a655-ef07bb52134e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1216 microversion: 2.1 time: 0.225734 Oct 11 04:31:18.042089 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2182/4614] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:17 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1216 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:18.209350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce7b8ae8-5612-4142-a45e-654fd5be7761 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:18.217835 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce7b8ae8-5612-4142-a45e-654fd5be7761 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1214 microversion: 2.1 time: 0.365863 Oct 11 04:31:18.244776 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2433/4615] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:17 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1214 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:18.803943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f5358f8-79eb-4d46-9587-0fa28043247b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:18.806591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f5358f8-79eb-4d46-9587-0fa28043247b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:18.823853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5358f8-79eb-4d46-9587-0fa28043247b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:18.824645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5358f8-79eb-4d46-9587-0fa28043247b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:18.825398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5358f8-79eb-4d46-9587-0fa28043247b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:18.826335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5358f8-79eb-4d46-9587-0fa28043247b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:18.826940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5358f8-79eb-4d46-9587-0fa28043247b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:18.827531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5358f8-79eb-4d46-9587-0fa28043247b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:18.881850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9df3fa56-023c-49aa-b55b-2f1a7f1af660 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:18.884116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9df3fa56-023c-49aa-b55b-2f1a7f1af660 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:18.889335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:18.940090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df3fa56-023c-49aa-b55b-2f1a7f1af660 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:18.940616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df3fa56-023c-49aa-b55b-2f1a7f1af660 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:18.941066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df3fa56-023c-49aa-b55b-2f1a7f1af660 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:18.941775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df3fa56-023c-49aa-b55b-2f1a7f1af660 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:18.942247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df3fa56-023c-49aa-b55b-2f1a7f1af660 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:18.942668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9df3fa56-023c-49aa-b55b-2f1a7f1af660 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:19.335739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f5358f8-79eb-4d46-9587-0fa28043247b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:19.378200 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f5358f8-79eb-4d46-9587-0fa28043247b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.570758 Oct 11 04:31:19.414816 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2183/4616] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:18 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:19.466130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-28c569de-574f-4fe2-89bf-89e012474066 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:19.473069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-28c569de-574f-4fe2-89bf-89e012474066 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:19.556722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c569de-574f-4fe2-89bf-89e012474066 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:19.559916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c569de-574f-4fe2-89bf-89e012474066 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:19.567250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c569de-574f-4fe2-89bf-89e012474066 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:19.573331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c569de-574f-4fe2-89bf-89e012474066 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:19.575817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c569de-574f-4fe2-89bf-89e012474066 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:19.576950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28c569de-574f-4fe2-89bf-89e012474066 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:19.945314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9df3fa56-023c-49aa-b55b-2f1a7f1af660 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:19.956643 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9df3fa56-023c-49aa-b55b-2f1a7f1af660 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1372 microversion: 2.1 time: 1.080032 Oct 11 04:31:19.972673 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2434/4617] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:18 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1372 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:19.984017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1018d937-ced1-42cd-bdd2-d8f2973b1060 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:19.984967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1018d937-ced1-42cd-bdd2-d8f2973b1060 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:19.991573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1018d937-ced1-42cd-bdd2-d8f2973b1060 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:19.992364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1018d937-ced1-42cd-bdd2-d8f2973b1060 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:19.994296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1018d937-ced1-42cd-bdd2-d8f2973b1060 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:19.995416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1018d937-ced1-42cd-bdd2-d8f2973b1060 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:19.996042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1018d937-ced1-42cd-bdd2-d8f2973b1060 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:19.996616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1018d937-ced1-42cd-bdd2-d8f2973b1060 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:20.282529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-28c569de-574f-4fe2-89bf-89e012474066 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:20.296758 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-28c569de-574f-4fe2-89bf-89e012474066 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1268 microversion: 2.1 time: 0.875720 Oct 11 04:31:20.303227 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2184/4618] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:19 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1268 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:20.331968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1018d937-ced1-42cd-bdd2-d8f2973b1060 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:20.354019 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1018d937-ced1-42cd-bdd2-d8f2973b1060 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1210 microversion: 2.1 time: 0.375716 Oct 11 04:31:20.357735 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2435/4619] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:19 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1210 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:20.426153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c444f0ba-7934-499d-9e28-372c457a2e3c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:20.428705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c444f0ba-7934-499d-9e28-372c457a2e3c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:20.462400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c444f0ba-7934-499d-9e28-372c457a2e3c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:20.463234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c444f0ba-7934-499d-9e28-372c457a2e3c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:20.463931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c444f0ba-7934-499d-9e28-372c457a2e3c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:20.464839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c444f0ba-7934-499d-9e28-372c457a2e3c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:20.465451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c444f0ba-7934-499d-9e28-372c457a2e3c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:20.466575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c444f0ba-7934-499d-9e28-372c457a2e3c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:20.876942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5099d307-0018-46c7-b431-989059672c05 req-5aa2d88a-e8de-496a-b72c-6b925bc775cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "999777c2-2b4b-4ae8-ab23-7709485d2501", "tag": "a27ad975-bd5a-4090-9531-4889fbb049af"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:20.897635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5099d307-0018-46c7-b431-989059672c05 req-5aa2d88a-e8de-496a-b72c-6b925bc775cb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:20.898262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5099d307-0018-46c7-b431-989059672c05 req-5aa2d88a-e8de-496a-b72c-6b925bc775cb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:20.898701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5099d307-0018-46c7-b431-989059672c05 req-5aa2d88a-e8de-496a-b72c-6b925bc775cb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:20.925123 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5099d307-0018-46c7-b431-989059672c05 req-5aa2d88a-e8de-496a-b72c-6b925bc775cb service nova] Creating event network-changed:a27ad975-bd5a-4090-9531-4889fbb049af for instance 999777c2-2b4b-4ae8-ab23-7709485d2501 on n-h2-860892-1 Oct 11 04:31:20.931236 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5099d307-0018-46c7-b431-989059672c05 req-5aa2d88a-e8de-496a-b72c-6b925bc775cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058753 Oct 11 04:31:20.937005 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2436/4620] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:31:20.999529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9fa7f259-5763-44c6-9226-9515a9e20337 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:21.001024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9fa7f259-5763-44c6-9226-9515a9e20337 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:21.016471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fa7f259-5763-44c6-9226-9515a9e20337 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:21.017304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fa7f259-5763-44c6-9226-9515a9e20337 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:21.017973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fa7f259-5763-44c6-9226-9515a9e20337 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:21.018914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fa7f259-5763-44c6-9226-9515a9e20337 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:21.019599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fa7f259-5763-44c6-9226-9515a9e20337 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:21.020215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fa7f259-5763-44c6-9226-9515a9e20337 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:21.059367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c444f0ba-7934-499d-9e28-372c457a2e3c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:21.067588 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c444f0ba-7934-499d-9e28-372c457a2e3c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.650705 Oct 11 04:31:21.071038 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2185/4621] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:20 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:21.277849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:21.278393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:21.293444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:21.294169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:21.296857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:21.302023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:21.302658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:21.303107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:21.319490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9fa7f259-5763-44c6-9226-9515a9e20337 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:21.349398 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9fa7f259-5763-44c6-9226-9515a9e20337 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1372 microversion: 2.1 time: 0.355244 Oct 11 04:31:21.350021 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2437/4622] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:20 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1372 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:21.365074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ccb1869d-86d2-4a63-83c4-aff7259ccf60 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:21.365804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ccb1869d-86d2-4a63-83c4-aff7259ccf60 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:21.384427 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] HTTP exception thrown: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Request method failure captured: Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 HTTP/1.1 Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO-sXO3EVi8WVrmYJx7fZW5vvIFsL5Rn8LpPNfvFtRtPhl1DysTAVfAwDz88PG2JmtKt8e0DC7Xl6zeOHQh6SADzY33dpzMdvBdkWjLoMKDPlK8Y0iOEZfh56aUQdgmjEViPSm6wkyDnsi6wU2-1xGIlC_q0l1CWMcPydnZuKPT-b88 Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 529357092c6e404e982f968263d41eae Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TaggedBootDevicesTest-315683041 Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/529357092c6e404e982f968263d41eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_529357092c6e404e982f968263d41eae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/529357092c6e404e982f968263d41eae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/529357092c6e404e982f968263d41eae"}]}] Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TaggedBootDevicesTest-315683041 Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 529357092c6e404e982f968263d41eae Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TaggedBootDevicesTest-315683041 Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TaggedBootDevicesTest-315683041-project Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 1f75f519f7b44fc8b81d281cf0d3f502 Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TaggedBootDevicesTest-315683041-project Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '195aa0db-57d6-41c8-ba3c-474800a0d2b4'} Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:31:21.394127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:21.406448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Returning 404 to user: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:31:21.407239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb1869d-86d2-4a63-83c4-aff7259ccf60 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:21.407340 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7919b00f-6fba-4fc2-b9ee-086260165c10 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "DELETE /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 404 len: 111 microversion: 2.32 time: 0.129907 Oct 11 04:31:21.407340 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2186/4623] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:31:21 2022] DELETE /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 111 bytes in 132 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:31:21.407497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb1869d-86d2-4a63-83c4-aff7259ccf60 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:21.407756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb1869d-86d2-4a63-83c4-aff7259ccf60 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:21.410389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb1869d-86d2-4a63-83c4-aff7259ccf60 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:21.413889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb1869d-86d2-4a63-83c4-aff7259ccf60 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:21.420999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb1869d-86d2-4a63-83c4-aff7259ccf60 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:21.425477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-987b4098-c99d-44a4-a7b3-0d775cdb4eba tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:21.426144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-987b4098-c99d-44a4-a7b3-0d775cdb4eba tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:21.442925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987b4098-c99d-44a4-a7b3-0d775cdb4eba tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:21.443418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987b4098-c99d-44a4-a7b3-0d775cdb4eba tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:21.443855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987b4098-c99d-44a4-a7b3-0d775cdb4eba tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:21.444554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987b4098-c99d-44a4-a7b3-0d775cdb4eba tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:21.445016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987b4098-c99d-44a4-a7b3-0d775cdb4eba tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:21.445429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-987b4098-c99d-44a4-a7b3-0d775cdb4eba tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:21.608362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ccb1869d-86d2-4a63-83c4-aff7259ccf60 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:21.617059 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ccb1869d-86d2-4a63-83c4-aff7259ccf60 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1276 microversion: 2.1 time: 0.265755 Oct 11 04:31:21.618832 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2438/4624] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:21 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1276 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:21.623894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:21.624708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] [instance: 195aa0db-57d6-41c8-ba3c-474800a0d2b4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:21.630991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:21.631664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:21.632292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:21.633700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:21.634337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:21.634909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:21.665987 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] HTTP exception thrown: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Request method failure captured: Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 HTTP/1.1 Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO-sXO3EVi8WVrmYJx7fZW5vvIFsL5Rn8LpPNfvFtRtPhl1DysTAVfAwDz88PG2JmtKt8e0DC7Xl6zeOHQh6SADzY33dpzMdvBdkWjLoMKDPlK8Y0iOEZfh56aUQdgmjEViPSm6wkyDnsi6wU2-1xGIlC_q0l1CWMcPydnZuKPT-b88 Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.32 Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 529357092c6e404e982f968263d41eae Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TaggedBootDevicesTest-315683041 Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/529357092c6e404e982f968263d41eae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_529357092c6e404e982f968263d41eae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/529357092c6e404e982f968263d41eae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/529357092c6e404e982f968263d41eae"}]}] Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TaggedBootDevicesTest-315683041 Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 529357092c6e404e982f968263d41eae Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TaggedBootDevicesTest-315683041 Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TaggedBootDevicesTest-315683041-project Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 1f75f519f7b44fc8b81d281cf0d3f502 Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TaggedBootDevicesTest-315683041-project Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '195aa0db-57d6-41c8-ba3c-474800a0d2b4'} Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:21.671414 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:21.675745 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:21.675745 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:21.675745 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:21.675745 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:31:21.675745 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:31:21.675745 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. Oct 11 04:31:21.675745 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:21.681849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] Returning 404 to user: Instance 195aa0db-57d6-41c8-ba3c-474800a0d2b4 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:31:21.684898 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1a6b21f4-c851-41b4-8575-a8b7387ebde9 tempest-TaggedBootDevicesTest-315683041 tempest-TaggedBootDevicesTest-315683041-project] 10.222.0.26 "GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4" status: 404 len: 111 microversion: 2.32 time: 0.062791 Oct 11 04:31:21.684898 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2439/4625] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:31:21 2022] GET /compute/v2.1/servers/195aa0db-57d6-41c8-ba3c-474800a0d2b4 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:31:21.743634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-987b4098-c99d-44a4-a7b3-0d775cdb4eba tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:21.751735 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-987b4098-c99d-44a4-a7b3-0d775cdb4eba tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1266 microversion: 2.1 time: 0.347714 Oct 11 04:31:21.752201 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2187/4626] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:21 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1266 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:21.988348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2ccd5e00-d026-4b07-86cd-746765de344a req-a3179172-7877-45fb-8ac8-5b021ee25466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec2cb39-bab6-4474-9901-5909a9053a80", "name": "network-vif-plugged", "status": "completed", "tag": "af219b67-485d-4b19-8980-781c7c1d38b7"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:22.023482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ccd5e00-d026-4b07-86cd-746765de344a req-a3179172-7877-45fb-8ac8-5b021ee25466 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:22.024156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ccd5e00-d026-4b07-86cd-746765de344a req-a3179172-7877-45fb-8ac8-5b021ee25466 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:22.031842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ccd5e00-d026-4b07-86cd-746765de344a req-a3179172-7877-45fb-8ac8-5b021ee25466 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:22.076783 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2ccd5e00-d026-4b07-86cd-746765de344a req-a3179172-7877-45fb-8ac8-5b021ee25466 service nova] Creating event network-vif-plugged:af219b67-485d-4b19-8980-781c7c1d38b7 for instance 7ec2cb39-bab6-4474-9901-5909a9053a80 on n-h2-860892-1 Oct 11 04:31:22.082590 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2ccd5e00-d026-4b07-86cd-746765de344a req-a3179172-7877-45fb-8ac8-5b021ee25466 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.397990 Oct 11 04:31:22.083829 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2440/4627] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:22.093858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bc019de-6583-44b6-b86f-3c6a51e60999 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:22.101538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0bc019de-6583-44b6-b86f-3c6a51e60999 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:22.137403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bc019de-6583-44b6-b86f-3c6a51e60999 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:22.137403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bc019de-6583-44b6-b86f-3c6a51e60999 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:22.137403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bc019de-6583-44b6-b86f-3c6a51e60999 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:22.137403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bc019de-6583-44b6-b86f-3c6a51e60999 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:22.137843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bc019de-6583-44b6-b86f-3c6a51e60999 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:22.138180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bc019de-6583-44b6-b86f-3c6a51e60999 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:22.385001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-50155e51-a398-45a0-88b7-89d19f67f081 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:22.386000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50155e51-a398-45a0-88b7-89d19f67f081 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:22.419038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50155e51-a398-45a0-88b7-89d19f67f081 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:22.423462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50155e51-a398-45a0-88b7-89d19f67f081 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:22.427597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50155e51-a398-45a0-88b7-89d19f67f081 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:22.435849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50155e51-a398-45a0-88b7-89d19f67f081 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:22.437263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50155e51-a398-45a0-88b7-89d19f67f081 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:22.440613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50155e51-a398-45a0-88b7-89d19f67f081 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:22.624361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0bc019de-6583-44b6-b86f-3c6a51e60999 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:22.634614 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0bc019de-6583-44b6-b86f-3c6a51e60999 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.543608 Oct 11 04:31:22.646726 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2188/4628] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:22 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:22.652415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1026647a-59cf-43c3-a5e2-02a0230d3a75 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:22.653036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1026647a-59cf-43c3-a5e2-02a0230d3a75 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:22.680036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1026647a-59cf-43c3-a5e2-02a0230d3a75 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:22.680725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1026647a-59cf-43c3-a5e2-02a0230d3a75 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:22.687077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1026647a-59cf-43c3-a5e2-02a0230d3a75 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:22.688083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1026647a-59cf-43c3-a5e2-02a0230d3a75 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:22.693826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1026647a-59cf-43c3-a5e2-02a0230d3a75 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:22.694525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1026647a-59cf-43c3-a5e2-02a0230d3a75 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:22.854248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1026647a-59cf-43c3-a5e2-02a0230d3a75 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:22.868854 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1026647a-59cf-43c3-a5e2-02a0230d3a75 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1274 microversion: 2.1 time: 0.220124 Oct 11 04:31:22.873437 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2189/4629] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:22 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1274 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:22.886392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9613cc92-183b-43c6-a0fb-3abf2bb31556 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:22.887370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9613cc92-183b-43c6-a0fb-3abf2bb31556 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:22.911324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9613cc92-183b-43c6-a0fb-3abf2bb31556 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:22.913343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9613cc92-183b-43c6-a0fb-3abf2bb31556 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:22.914208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9613cc92-183b-43c6-a0fb-3abf2bb31556 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:22.917171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9613cc92-183b-43c6-a0fb-3abf2bb31556 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:22.920462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9613cc92-183b-43c6-a0fb-3abf2bb31556 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:22.921727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9613cc92-183b-43c6-a0fb-3abf2bb31556 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:23.053028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9613cc92-183b-43c6-a0fb-3abf2bb31556 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:23.067321 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9613cc92-183b-43c6-a0fb-3abf2bb31556 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1284 microversion: 2.1 time: 0.192074 Oct 11 04:31:23.067915 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2190/4630] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:22 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1284 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:23.632064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-50155e51-a398-45a0-88b7-89d19f67f081 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:23.661233 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-50155e51-a398-45a0-88b7-89d19f67f081 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1372 microversion: 2.1 time: 1.282555 Oct 11 04:31:23.675482 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2441/4631] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:22 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1372 bytes in 1297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:23.681122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46c73ef6-13f9-4e67-b0fa-feb07ecf5bb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:23.682448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-46c73ef6-13f9-4e67-b0fa-feb07ecf5bb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:23.704645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46c73ef6-13f9-4e67-b0fa-feb07ecf5bb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:23.707192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46c73ef6-13f9-4e67-b0fa-feb07ecf5bb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:23.707836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46c73ef6-13f9-4e67-b0fa-feb07ecf5bb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:23.713496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46c73ef6-13f9-4e67-b0fa-feb07ecf5bb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:23.714728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46c73ef6-13f9-4e67-b0fa-feb07ecf5bb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:23.715404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46c73ef6-13f9-4e67-b0fa-feb07ecf5bb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:23.899400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7892ae7d-02ef-431d-9ae3-e7445941871e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:23.900284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7892ae7d-02ef-431d-9ae3-e7445941871e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:23.909545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7892ae7d-02ef-431d-9ae3-e7445941871e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:23.917019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7892ae7d-02ef-431d-9ae3-e7445941871e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:23.917652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7892ae7d-02ef-431d-9ae3-e7445941871e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:23.918689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7892ae7d-02ef-431d-9ae3-e7445941871e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:23.919324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7892ae7d-02ef-431d-9ae3-e7445941871e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:23.919909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7892ae7d-02ef-431d-9ae3-e7445941871e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:24.502818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-46c73ef6-13f9-4e67-b0fa-feb07ecf5bb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:24.517313 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-46c73ef6-13f9-4e67-b0fa-feb07ecf5bb1 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.840029 Oct 11 04:31:24.526234 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2191/4632] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:23 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:24.537993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62eec956-5adc-42eb-9182-eaf7ec50abc8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:24.538830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-62eec956-5adc-42eb-9182-eaf7ec50abc8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:24.553943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62eec956-5adc-42eb-9182-eaf7ec50abc8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:24.554493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62eec956-5adc-42eb-9182-eaf7ec50abc8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:24.559303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62eec956-5adc-42eb-9182-eaf7ec50abc8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:24.560117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62eec956-5adc-42eb-9182-eaf7ec50abc8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:24.560588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62eec956-5adc-42eb-9182-eaf7ec50abc8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:24.563061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62eec956-5adc-42eb-9182-eaf7ec50abc8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:24.623507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7892ae7d-02ef-431d-9ae3-e7445941871e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:24.630924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:24.639854 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7892ae7d-02ef-431d-9ae3-e7445941871e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1316 microversion: 2.1 time: 0.744801 Oct 11 04:31:24.641277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:24.656348 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2442/4633] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:23 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1316 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:24.706451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b3889b2e-bfc4-4a33-9439-0a0b9f5a7655 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:24.707276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b3889b2e-bfc4-4a33-9439-0a0b9f5a7655 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:24.722152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3889b2e-bfc4-4a33-9439-0a0b9f5a7655 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:24.724636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3889b2e-bfc4-4a33-9439-0a0b9f5a7655 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:24.729017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3889b2e-bfc4-4a33-9439-0a0b9f5a7655 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:24.732758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3889b2e-bfc4-4a33-9439-0a0b9f5a7655 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:24.733520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3889b2e-bfc4-4a33-9439-0a0b9f5a7655 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:24.734721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3889b2e-bfc4-4a33-9439-0a0b9f5a7655 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:24.845327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62eec956-5adc-42eb-9182-eaf7ec50abc8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:24.855820 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-62eec956-5adc-42eb-9182-eaf7ec50abc8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1272 microversion: 2.1 time: 0.329926 Oct 11 04:31:24.864149 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2192/4634] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:24 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1272 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:25.549129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-24bd79f0-7b33-47eb-9424-d30aa2a5e885 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:25.555858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-24bd79f0-7b33-47eb-9424-d30aa2a5e885 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:25.577431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24bd79f0-7b33-47eb-9424-d30aa2a5e885 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:25.577431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24bd79f0-7b33-47eb-9424-d30aa2a5e885 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:25.577431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24bd79f0-7b33-47eb-9424-d30aa2a5e885 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:25.594728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24bd79f0-7b33-47eb-9424-d30aa2a5e885 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:25.600104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24bd79f0-7b33-47eb-9424-d30aa2a5e885 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:25.601769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24bd79f0-7b33-47eb-9424-d30aa2a5e885 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:25.838605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b3889b2e-bfc4-4a33-9439-0a0b9f5a7655 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:25.847212 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b3889b2e-bfc4-4a33-9439-0a0b9f5a7655 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1372 microversion: 2.1 time: 1.162228 Oct 11 04:31:25.854071 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2443/4635] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:24 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1372 bytes in 1170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:25.864794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ba9f37d6-5ba3-4645-8786-b4dcc0f7c7f6 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:25.874305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ba9f37d6-5ba3-4645-8786-b4dcc0f7c7f6 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:25.896598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba9f37d6-5ba3-4645-8786-b4dcc0f7c7f6 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:25.897251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba9f37d6-5ba3-4645-8786-b4dcc0f7c7f6 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:25.898283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba9f37d6-5ba3-4645-8786-b4dcc0f7c7f6 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:25.900014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba9f37d6-5ba3-4645-8786-b4dcc0f7c7f6 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:25.904625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba9f37d6-5ba3-4645-8786-b4dcc0f7c7f6 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:25.905072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba9f37d6-5ba3-4645-8786-b4dcc0f7c7f6 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:25.979523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-24bd79f0-7b33-47eb-9424-d30aa2a5e885 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:25.998952 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-24bd79f0-7b33-47eb-9424-d30aa2a5e885 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.459148 Oct 11 04:31:26.007296 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2193/4636] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:25 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:26.042370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3799ea21-6f49-48f1-be82-fabd720858d8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:26.045047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3799ea21-6f49-48f1-be82-fabd720858d8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:26.080340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3799ea21-6f49-48f1-be82-fabd720858d8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:26.084677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3799ea21-6f49-48f1-be82-fabd720858d8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:26.085101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3799ea21-6f49-48f1-be82-fabd720858d8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:26.110925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3799ea21-6f49-48f1-be82-fabd720858d8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:26.111465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3799ea21-6f49-48f1-be82-fabd720858d8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:26.111908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3799ea21-6f49-48f1-be82-fabd720858d8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:26.375373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:26.675928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:26.802911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3799ea21-6f49-48f1-be82-fabd720858d8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:26.819930 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3799ea21-6f49-48f1-be82-fabd720858d8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.808835 Oct 11 04:31:26.826100 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2194/4637] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:26 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:26.876935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-531560b4-55e2-4c58-ad69-d667dd75da65 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:26.877704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-531560b4-55e2-4c58-ad69-d667dd75da65 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:26.890766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-531560b4-55e2-4c58-ad69-d667dd75da65 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:26.910569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ba9f37d6-5ba3-4645-8786-b4dcc0f7c7f6 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:26.920402 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ba9f37d6-5ba3-4645-8786-b4dcc0f7c7f6 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1316 microversion: 2.1 time: 1.059413 Oct 11 04:31:26.922998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-531560b4-55e2-4c58-ad69-d667dd75da65 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.032s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:26.929272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-531560b4-55e2-4c58-ad69-d667dd75da65 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:26.932254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-531560b4-55e2-4c58-ad69-d667dd75da65 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:26.933036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-531560b4-55e2-4c58-ad69-d667dd75da65 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:26.933721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-531560b4-55e2-4c58-ad69-d667dd75da65 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:26.941665 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2444/4638] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:25 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1316 bytes in 1087 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:27.036603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc10285d-e723-4839-9d35-bb2b409f4ea7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:27.036603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cc10285d-e723-4839-9d35-bb2b409f4ea7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:27.062072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc10285d-e723-4839-9d35-bb2b409f4ea7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:27.065266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc10285d-e723-4839-9d35-bb2b409f4ea7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:27.065266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc10285d-e723-4839-9d35-bb2b409f4ea7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:27.066093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc10285d-e723-4839-9d35-bb2b409f4ea7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:27.066811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc10285d-e723-4839-9d35-bb2b409f4ea7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:27.067561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc10285d-e723-4839-9d35-bb2b409f4ea7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:27.334251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-531560b4-55e2-4c58-ad69-d667dd75da65 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:27.343812 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-531560b4-55e2-4c58-ad69-d667dd75da65 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1566 microversion: 2.1 time: 0.470648 Oct 11 04:31:27.345908 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2195/4639] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:26 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1566 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:27.374479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cc9d959-a227-4af5-b117-298c9b71e588 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:27.374872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2cc9d959-a227-4af5-b117-298c9b71e588 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:27.389471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc9d959-a227-4af5-b117-298c9b71e588 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:27.398306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc9d959-a227-4af5-b117-298c9b71e588 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:27.399015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc9d959-a227-4af5-b117-298c9b71e588 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:27.404796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc9d959-a227-4af5-b117-298c9b71e588 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:27.404796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc9d959-a227-4af5-b117-298c9b71e588 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:27.404796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc9d959-a227-4af5-b117-298c9b71e588 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:27.473766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cc10285d-e723-4839-9d35-bb2b409f4ea7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:27.483345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc10285d-e723-4839-9d35-bb2b409f4ea7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.456157 Oct 11 04:31:27.500095 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2445/4640] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:27 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:27.688305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-004984e1-e3db-49a4-af45-72ad80b9b974 req-f6fc9f17-ce57-4ef9-b27f-ffed66a8d0ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "801d607e-a694-4809-a818-cce55c9ddfd2", "tag": "693df5da-dfb9-4762-95de-f6db1070504b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:27.697743 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2cc9d959-a227-4af5-b117-298c9b71e588 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.327697 Oct 11 04:31:27.699048 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2196/4641] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:31:27 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-interface => generated 285 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:27.714061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-004984e1-e3db-49a4-af45-72ad80b9b974 req-f6fc9f17-ce57-4ef9-b27f-ffed66a8d0ad service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:27.714608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-004984e1-e3db-49a4-af45-72ad80b9b974 req-f6fc9f17-ce57-4ef9-b27f-ffed66a8d0ad service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:27.715036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-004984e1-e3db-49a4-af45-72ad80b9b974 req-f6fc9f17-ce57-4ef9-b27f-ffed66a8d0ad service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:27.778644 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-004984e1-e3db-49a4-af45-72ad80b9b974 req-f6fc9f17-ce57-4ef9-b27f-ffed66a8d0ad service nova] Creating event network-changed:693df5da-dfb9-4762-95de-f6db1070504b for instance 801d607e-a694-4809-a818-cce55c9ddfd2 on n-h1-860892-1 Oct 11 04:31:27.796675 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-004984e1-e3db-49a4-af45-72ad80b9b974 req-f6fc9f17-ce57-4ef9-b27f-ffed66a8d0ad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.263890 Oct 11 04:31:27.797602 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2446/4642] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:27.845298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-19b5a84b-d772-444f-b45b-e2d35ba31ff9 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:27.846321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-19b5a84b-d772-444f-b45b-e2d35ba31ff9 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:27.854222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b5a84b-d772-444f-b45b-e2d35ba31ff9 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:27.862092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b5a84b-d772-444f-b45b-e2d35ba31ff9 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:27.862949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b5a84b-d772-444f-b45b-e2d35ba31ff9 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:27.865302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b5a84b-d772-444f-b45b-e2d35ba31ff9 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:27.865989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b5a84b-d772-444f-b45b-e2d35ba31ff9 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:27.866675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19b5a84b-d772-444f-b45b-e2d35ba31ff9 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:27.944049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b5656281-0e5d-49d3-98e1-60da6ab6ee12 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:27.944779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b5656281-0e5d-49d3-98e1-60da6ab6ee12 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:27.971969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5656281-0e5d-49d3-98e1-60da6ab6ee12 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:27.972669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5656281-0e5d-49d3-98e1-60da6ab6ee12 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:27.982697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5656281-0e5d-49d3-98e1-60da6ab6ee12 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:27.985925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5656281-0e5d-49d3-98e1-60da6ab6ee12 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:27.986481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5656281-0e5d-49d3-98e1-60da6ab6ee12 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:27.986933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5656281-0e5d-49d3-98e1-60da6ab6ee12 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:28.012888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:28.214363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:28.877072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-19b5a84b-d772-444f-b45b-e2d35ba31ff9 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:28.888692 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-19b5a84b-d772-444f-b45b-e2d35ba31ff9 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 1.047106 Oct 11 04:31:28.892020 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2197/4643] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:27 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 1053 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:28.896987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1fcf305d-9455-46f0-a1f8-bfa4289575ad tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:28.910732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1fcf305d-9455-46f0-a1f8-bfa4289575ad tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:28.938654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fcf305d-9455-46f0-a1f8-bfa4289575ad tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:28.938654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fcf305d-9455-46f0-a1f8-bfa4289575ad tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:28.938654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fcf305d-9455-46f0-a1f8-bfa4289575ad tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:28.938654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fcf305d-9455-46f0-a1f8-bfa4289575ad tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:28.938654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fcf305d-9455-46f0-a1f8-bfa4289575ad tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:28.938654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1fcf305d-9455-46f0-a1f8-bfa4289575ad tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:29.544805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b5656281-0e5d-49d3-98e1-60da6ab6ee12 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:29.578885 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b5656281-0e5d-49d3-98e1-60da6ab6ee12 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1316 microversion: 2.1 time: 1.635274 Oct 11 04:31:29.582765 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2447/4644] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:27 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1316 bytes in 1645 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:29.790938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1fcf305d-9455-46f0-a1f8-bfa4289575ad tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:29.804737 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1fcf305d-9455-46f0-a1f8-bfa4289575ad tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.909036 Oct 11 04:31:29.807272 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2198/4645] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:28 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:29.920429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3434d152-058e-441a-af8d-46f4fa9d6da5 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:29.921927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3434d152-058e-441a-af8d-46f4fa9d6da5 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:29.928380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3434d152-058e-441a-af8d-46f4fa9d6da5 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:29.933403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3434d152-058e-441a-af8d-46f4fa9d6da5 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:29.937125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3434d152-058e-441a-af8d-46f4fa9d6da5 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:29.942471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3434d152-058e-441a-af8d-46f4fa9d6da5 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:29.943267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3434d152-058e-441a-af8d-46f4fa9d6da5 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:29.943896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3434d152-058e-441a-af8d-46f4fa9d6da5 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:30.368068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-1ba7a2bc-459d-4442-87bb-106aeea776bb req-142ad8d6-95a5-4868-a88d-fa65c53bf540 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "619f5d1a-728e-4d57-bdbe-b042aaca532f", "tag": "bfdee7fb-d6c4-4124-bf6a-abb48bfefdeb"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:30.414847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1ba7a2bc-459d-4442-87bb-106aeea776bb req-142ad8d6-95a5-4868-a88d-fa65c53bf540 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:30.416980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1ba7a2bc-459d-4442-87bb-106aeea776bb req-142ad8d6-95a5-4868-a88d-fa65c53bf540 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:30.422515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1ba7a2bc-459d-4442-87bb-106aeea776bb req-142ad8d6-95a5-4868-a88d-fa65c53bf540 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:30.484751 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-1ba7a2bc-459d-4442-87bb-106aeea776bb req-142ad8d6-95a5-4868-a88d-fa65c53bf540 service nova] Creating event network-changed:bfdee7fb-d6c4-4124-bf6a-abb48bfefdeb for instance 619f5d1a-728e-4d57-bdbe-b042aaca532f on n-h1-860892-1 Oct 11 04:31:30.513107 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-1ba7a2bc-459d-4442-87bb-106aeea776bb req-142ad8d6-95a5-4868-a88d-fa65c53bf540 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149875 Oct 11 04:31:30.518949 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2199/4646] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:31:30.602904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ba4bf0fc-887a-43e9-a9bd-47d9fa71857e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:30.603811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ba4bf0fc-887a-43e9-a9bd-47d9fa71857e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:30.620553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba4bf0fc-887a-43e9-a9bd-47d9fa71857e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:30.622006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba4bf0fc-887a-43e9-a9bd-47d9fa71857e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:30.622502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba4bf0fc-887a-43e9-a9bd-47d9fa71857e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:30.625114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba4bf0fc-887a-43e9-a9bd-47d9fa71857e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:30.627016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba4bf0fc-887a-43e9-a9bd-47d9fa71857e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:30.627629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba4bf0fc-887a-43e9-a9bd-47d9fa71857e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:30.725359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3434d152-058e-441a-af8d-46f4fa9d6da5 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:30.735499 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3434d152-058e-441a-af8d-46f4fa9d6da5 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.819640 Oct 11 04:31:30.754575 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2448/4647] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:29 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:30.829675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fee7982b-1a1d-4964-b7fd-145fc961cdd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:30.830686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fee7982b-1a1d-4964-b7fd-145fc961cdd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:30.842443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee7982b-1a1d-4964-b7fd-145fc961cdd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:30.843307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee7982b-1a1d-4964-b7fd-145fc961cdd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:30.843905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee7982b-1a1d-4964-b7fd-145fc961cdd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:30.848043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee7982b-1a1d-4964-b7fd-145fc961cdd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:30.848754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee7982b-1a1d-4964-b7fd-145fc961cdd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:30.850384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fee7982b-1a1d-4964-b7fd-145fc961cdd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:31.088347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ba4bf0fc-887a-43e9-a9bd-47d9fa71857e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:31.097636 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ba4bf0fc-887a-43e9-a9bd-47d9fa71857e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1316 microversion: 2.1 time: 0.500312 Oct 11 04:31:31.099531 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2200/4648] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:30 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1316 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:31.333705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fee7982b-1a1d-4964-b7fd-145fc961cdd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:31.344977 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fee7982b-1a1d-4964-b7fd-145fc961cdd5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.518947 Oct 11 04:31:31.348390 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2449/4649] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:30 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:31.765876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8697db2f-e07b-4d2b-a38d-237f144d2388 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:31.766545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8697db2f-e07b-4d2b-a38d-237f144d2388 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:31.773204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8697db2f-e07b-4d2b-a38d-237f144d2388 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:31.773717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8697db2f-e07b-4d2b-a38d-237f144d2388 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:31.774155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8697db2f-e07b-4d2b-a38d-237f144d2388 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:31.774892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8697db2f-e07b-4d2b-a38d-237f144d2388 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:31.775345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8697db2f-e07b-4d2b-a38d-237f144d2388 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:31.775768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8697db2f-e07b-4d2b-a38d-237f144d2388 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:32.124899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ed2846c0-3357-4a53-adf2-d8df99c9ea1b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:32.126068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ed2846c0-3357-4a53-adf2-d8df99c9ea1b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:32.141177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2846c0-3357-4a53-adf2-d8df99c9ea1b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:32.141906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2846c0-3357-4a53-adf2-d8df99c9ea1b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:32.142538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2846c0-3357-4a53-adf2-d8df99c9ea1b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:32.144932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2846c0-3357-4a53-adf2-d8df99c9ea1b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:32.145642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2846c0-3357-4a53-adf2-d8df99c9ea1b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:32.146889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed2846c0-3357-4a53-adf2-d8df99c9ea1b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:32.267015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8697db2f-e07b-4d2b-a38d-237f144d2388 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:32.277185 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8697db2f-e07b-4d2b-a38d-237f144d2388 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.515599 Oct 11 04:31:32.282777 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2201/4650] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:31 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:32.376257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-11e2530d-e952-49fe-8ea9-9dc74b9cb80e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:32.377461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-11e2530d-e952-49fe-8ea9-9dc74b9cb80e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:32.386277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11e2530d-e952-49fe-8ea9-9dc74b9cb80e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:32.389823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11e2530d-e952-49fe-8ea9-9dc74b9cb80e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:32.390313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11e2530d-e952-49fe-8ea9-9dc74b9cb80e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:32.391061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11e2530d-e952-49fe-8ea9-9dc74b9cb80e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:32.391520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11e2530d-e952-49fe-8ea9-9dc74b9cb80e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:32.391950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11e2530d-e952-49fe-8ea9-9dc74b9cb80e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:32.770303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ed2846c0-3357-4a53-adf2-d8df99c9ea1b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:32.784324 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ed2846c0-3357-4a53-adf2-d8df99c9ea1b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1316 microversion: 2.1 time: 0.660301 Oct 11 04:31:32.806788 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2450/4651] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:32 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1316 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:33.235297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-11e2530d-e952-49fe-8ea9-9dc74b9cb80e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:33.251226 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-11e2530d-e952-49fe-8ea9-9dc74b9cb80e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.879561 Oct 11 04:31:33.252391 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2202/4652] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:32 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:33.309943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d5b8a5b1-4401-4a32-aa20-28ef3a3e7591 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:33.310591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d5b8a5b1-4401-4a32-aa20-28ef3a3e7591 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:33.322825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b8a5b1-4401-4a32-aa20-28ef3a3e7591 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:33.323582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b8a5b1-4401-4a32-aa20-28ef3a3e7591 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:33.324652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b8a5b1-4401-4a32-aa20-28ef3a3e7591 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:33.325605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b8a5b1-4401-4a32-aa20-28ef3a3e7591 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:33.326497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b8a5b1-4401-4a32-aa20-28ef3a3e7591 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:33.327999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b8a5b1-4401-4a32-aa20-28ef3a3e7591 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:33.707463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d5b8a5b1-4401-4a32-aa20-28ef3a3e7591 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:33.723966 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d5b8a5b1-4401-4a32-aa20-28ef3a3e7591 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.421790 Oct 11 04:31:33.724851 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2451/4653] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:33 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:33.726224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5d14acc2-6d4f-4334-9b30-f30909e0c3c4 req-d94fad3d-55bb-43a8-85f3-98760da000a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec2cb39-bab6-4474-9901-5909a9053a80", "tag": "af219b67-485d-4b19-8980-781c7c1d38b7"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:33.745172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5d14acc2-6d4f-4334-9b30-f30909e0c3c4 req-d94fad3d-55bb-43a8-85f3-98760da000a0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:33.745656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5d14acc2-6d4f-4334-9b30-f30909e0c3c4 req-d94fad3d-55bb-43a8-85f3-98760da000a0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:33.746096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5d14acc2-6d4f-4334-9b30-f30909e0c3c4 req-d94fad3d-55bb-43a8-85f3-98760da000a0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:33.808360 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5d14acc2-6d4f-4334-9b30-f30909e0c3c4 req-d94fad3d-55bb-43a8-85f3-98760da000a0 service nova] Creating event network-changed:af219b67-485d-4b19-8980-781c7c1d38b7 for instance 7ec2cb39-bab6-4474-9901-5909a9053a80 on n-h2-860892-1 Oct 11 04:31:33.815984 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5d14acc2-6d4f-4334-9b30-f30909e0c3c4 req-d94fad3d-55bb-43a8-85f3-98760da000a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093459 Oct 11 04:31:33.817120 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2203/4654] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:31:33.827283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fa297aec-3665-456a-833c-781a0dc5862d tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:33.829028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fa297aec-3665-456a-833c-781a0dc5862d tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:33.871333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa297aec-3665-456a-833c-781a0dc5862d tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:33.879888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa297aec-3665-456a-833c-781a0dc5862d tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:33.880743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa297aec-3665-456a-833c-781a0dc5862d tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:33.885356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa297aec-3665-456a-833c-781a0dc5862d tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:33.887740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa297aec-3665-456a-833c-781a0dc5862d tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:33.888373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa297aec-3665-456a-833c-781a0dc5862d tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:34.276992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-51bbb3ba-52ed-4681-ae86-e6d0ca6bb042 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:34.278373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-51bbb3ba-52ed-4681-ae86-e6d0ca6bb042 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:34.297451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51bbb3ba-52ed-4681-ae86-e6d0ca6bb042 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:34.300773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51bbb3ba-52ed-4681-ae86-e6d0ca6bb042 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:34.309305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51bbb3ba-52ed-4681-ae86-e6d0ca6bb042 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:34.312732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51bbb3ba-52ed-4681-ae86-e6d0ca6bb042 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:34.313463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51bbb3ba-52ed-4681-ae86-e6d0ca6bb042 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:34.317115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51bbb3ba-52ed-4681-ae86-e6d0ca6bb042 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:34.519097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fa297aec-3665-456a-833c-781a0dc5862d tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:34.539046 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fa297aec-3665-456a-833c-781a0dc5862d tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1316 microversion: 2.1 time: 0.729718 Oct 11 04:31:34.540591 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2452/4655] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:33 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1316 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:34.576131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51bbb3ba-52ed-4681-ae86-e6d0ca6bb042 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:34.589512 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-51bbb3ba-52ed-4681-ae86-e6d0ca6bb042 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.314507 Oct 11 04:31:34.591821 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2204/4656] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:34 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:34.758951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3780a722-2723-4b3a-b2da-a68aadf43e83 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:34.759828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3780a722-2723-4b3a-b2da-a68aadf43e83 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:34.765959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3780a722-2723-4b3a-b2da-a68aadf43e83 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:34.766591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3780a722-2723-4b3a-b2da-a68aadf43e83 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:34.767121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3780a722-2723-4b3a-b2da-a68aadf43e83 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:34.767897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3780a722-2723-4b3a-b2da-a68aadf43e83 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:34.768425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3780a722-2723-4b3a-b2da-a68aadf43e83 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:34.768919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3780a722-2723-4b3a-b2da-a68aadf43e83 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:35.254100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3780a722-2723-4b3a-b2da-a68aadf43e83 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:35.263174 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3780a722-2723-4b3a-b2da-a68aadf43e83 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.513923 Oct 11 04:31:35.264309 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2453/4657] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:34 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:35.563411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ebb6e1b1-8a40-486e-a76f-8648e8ca16da tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:35.564025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ebb6e1b1-8a40-486e-a76f-8648e8ca16da tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:35.573681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb6e1b1-8a40-486e-a76f-8648e8ca16da tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:35.574565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb6e1b1-8a40-486e-a76f-8648e8ca16da tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:35.575801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb6e1b1-8a40-486e-a76f-8648e8ca16da tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:35.576805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb6e1b1-8a40-486e-a76f-8648e8ca16da tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:35.577581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb6e1b1-8a40-486e-a76f-8648e8ca16da tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:35.578252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebb6e1b1-8a40-486e-a76f-8648e8ca16da tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:35.622428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a76afbb1-d317-4af4-ad91-73153964af11 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:35.624340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a76afbb1-d317-4af4-ad91-73153964af11 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:35.636266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a76afbb1-d317-4af4-ad91-73153964af11 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:35.640295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a76afbb1-d317-4af4-ad91-73153964af11 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:35.643722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a76afbb1-d317-4af4-ad91-73153964af11 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:35.644865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a76afbb1-d317-4af4-ad91-73153964af11 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:35.649704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a76afbb1-d317-4af4-ad91-73153964af11 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:35.652206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a76afbb1-d317-4af4-ad91-73153964af11 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:35.993988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ebb6e1b1-8a40-486e-a76f-8648e8ca16da tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:35.999433 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ebb6e1b1-8a40-486e-a76f-8648e8ca16da tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1316 microversion: 2.1 time: 0.441050 Oct 11 04:31:36.000622 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2205/4658] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:35 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1316 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:36.294238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dfce9c36-5a24-4aeb-a85e-71d9e9755bea tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:36.294238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dfce9c36-5a24-4aeb-a85e-71d9e9755bea tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:36.305414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfce9c36-5a24-4aeb-a85e-71d9e9755bea tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:36.306722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfce9c36-5a24-4aeb-a85e-71d9e9755bea tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:36.307514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfce9c36-5a24-4aeb-a85e-71d9e9755bea tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:36.308589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfce9c36-5a24-4aeb-a85e-71d9e9755bea tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:36.309852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfce9c36-5a24-4aeb-a85e-71d9e9755bea tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:36.310528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dfce9c36-5a24-4aeb-a85e-71d9e9755bea tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:36.430152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a76afbb1-d317-4af4-ad91-73153964af11 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:36.444349 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a76afbb1-d317-4af4-ad91-73153964af11 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1507 microversion: 2.1 time: 0.830703 Oct 11 04:31:36.465427 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2454/4659] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:35 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1507 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:36.925034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dfce9c36-5a24-4aeb-a85e-71d9e9755bea tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:36.934697 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dfce9c36-5a24-4aeb-a85e-71d9e9755bea tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.651307 Oct 11 04:31:36.935491 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2206/4660] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:36 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:37.025118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ba0e7725-6df0-4186-9c47-e574afd72170 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:37.025727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ba0e7725-6df0-4186-9c47-e574afd72170 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:37.040171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba0e7725-6df0-4186-9c47-e574afd72170 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:37.040902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba0e7725-6df0-4186-9c47-e574afd72170 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:37.041606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba0e7725-6df0-4186-9c47-e574afd72170 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:37.046426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba0e7725-6df0-4186-9c47-e574afd72170 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:37.047029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba0e7725-6df0-4186-9c47-e574afd72170 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:37.047567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba0e7725-6df0-4186-9c47-e574afd72170 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:37.324433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ba0e7725-6df0-4186-9c47-e574afd72170 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:37.336214 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ba0e7725-6df0-4186-9c47-e574afd72170 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1316 microversion: 2.1 time: 0.314839 Oct 11 04:31:37.336974 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2455/4661] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:37 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1316 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:37.476349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c75c80b9-85b7-40c1-b847-a91fa37e4e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:37.477036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c75c80b9-85b7-40c1-b847-a91fa37e4e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:37.487889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c75c80b9-85b7-40c1-b847-a91fa37e4e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:37.488374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c75c80b9-85b7-40c1-b847-a91fa37e4e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:37.488808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c75c80b9-85b7-40c1-b847-a91fa37e4e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:37.489499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c75c80b9-85b7-40c1-b847-a91fa37e4e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:37.490704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c75c80b9-85b7-40c1-b847-a91fa37e4e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:37.495218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c75c80b9-85b7-40c1-b847-a91fa37e4e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:37.756319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c75c80b9-85b7-40c1-b847-a91fa37e4e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:37.764958 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c75c80b9-85b7-40c1-b847-a91fa37e4e1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1507 microversion: 2.1 time: 0.292869 Oct 11 04:31:37.766257 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2207/4662] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:37 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1507 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:37.962591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-01205d4d-0324-425c-b9a1-a7323bd1e586 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:37.963110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-01205d4d-0324-425c-b9a1-a7323bd1e586 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:37.978504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01205d4d-0324-425c-b9a1-a7323bd1e586 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:37.979224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01205d4d-0324-425c-b9a1-a7323bd1e586 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:37.979926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01205d4d-0324-425c-b9a1-a7323bd1e586 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:37.981557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01205d4d-0324-425c-b9a1-a7323bd1e586 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:37.983679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01205d4d-0324-425c-b9a1-a7323bd1e586 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:37.984300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01205d4d-0324-425c-b9a1-a7323bd1e586 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:38.263648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-01205d4d-0324-425c-b9a1-a7323bd1e586 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:38.273220 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-01205d4d-0324-425c-b9a1-a7323bd1e586 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.314700 Oct 11 04:31:38.273866 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2456/4663] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:37 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:38.368903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f747959a-95fe-4516-ba91-d13c557edd70 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:38.369781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f747959a-95fe-4516-ba91-d13c557edd70 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:38.377485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f747959a-95fe-4516-ba91-d13c557edd70 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:38.378671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f747959a-95fe-4516-ba91-d13c557edd70 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:38.379402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f747959a-95fe-4516-ba91-d13c557edd70 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:38.380390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f747959a-95fe-4516-ba91-d13c557edd70 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:38.381063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f747959a-95fe-4516-ba91-d13c557edd70 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:38.382480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f747959a-95fe-4516-ba91-d13c557edd70 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:38.635708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1c396d1e-db5a-4fb0-85be-9c76f8a229f2 req-dda3e04d-52fb-450c-8558-99588c9994d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801d607e-a694-4809-a818-cce55c9ddfd2", "name": "network-vif-plugged", "status": "completed", "tag": "693df5da-dfb9-4762-95de-f6db1070504b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:38.642366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1c396d1e-db5a-4fb0-85be-9c76f8a229f2 req-dda3e04d-52fb-450c-8558-99588c9994d0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:38.643360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1c396d1e-db5a-4fb0-85be-9c76f8a229f2 req-dda3e04d-52fb-450c-8558-99588c9994d0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:38.643985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1c396d1e-db5a-4fb0-85be-9c76f8a229f2 req-dda3e04d-52fb-450c-8558-99588c9994d0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:38.662663 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1c396d1e-db5a-4fb0-85be-9c76f8a229f2 req-dda3e04d-52fb-450c-8558-99588c9994d0 service nova] Creating event network-vif-plugged:693df5da-dfb9-4762-95de-f6db1070504b for instance 801d607e-a694-4809-a818-cce55c9ddfd2 on n-h1-860892-1 Oct 11 04:31:38.671700 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1c396d1e-db5a-4fb0-85be-9c76f8a229f2 req-dda3e04d-52fb-450c-8558-99588c9994d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051152 Oct 11 04:31:38.673063 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2457/4664] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:38.790844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dda6c1c6-073d-43cb-a219-99120118ecda tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:38.800133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dda6c1c6-073d-43cb-a219-99120118ecda tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:38.823662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dda6c1c6-073d-43cb-a219-99120118ecda tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:38.824391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dda6c1c6-073d-43cb-a219-99120118ecda tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:38.825053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dda6c1c6-073d-43cb-a219-99120118ecda tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:38.827720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dda6c1c6-073d-43cb-a219-99120118ecda tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:38.828422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dda6c1c6-073d-43cb-a219-99120118ecda tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:38.829498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dda6c1c6-073d-43cb-a219-99120118ecda tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:39.115522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f747959a-95fe-4516-ba91-d13c557edd70 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:39.124830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f747959a-95fe-4516-ba91-d13c557edd70 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1316 microversion: 2.1 time: 0.763620 Oct 11 04:31:39.141651 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2208/4665] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:38 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1316 bytes in 781 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:39.153274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dda6c1c6-073d-43cb-a219-99120118ecda tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:39.161430 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dda6c1c6-073d-43cb-a219-99120118ecda tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 200 len: 1510 microversion: 2.1 time: 0.376166 Oct 11 04:31:39.174217 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2458/4666] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:38 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 1510 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:39.188826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9cd7f851-01fb-478d-90b0-e8c6185d93cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:39.189632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9cd7f851-01fb-478d-90b0-e8c6185d93cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:39.200027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cd7f851-01fb-478d-90b0-e8c6185d93cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:39.201484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cd7f851-01fb-478d-90b0-e8c6185d93cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:39.202704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cd7f851-01fb-478d-90b0-e8c6185d93cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:39.206355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cd7f851-01fb-478d-90b0-e8c6185d93cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:39.206978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cd7f851-01fb-478d-90b0-e8c6185d93cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:39.211022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9cd7f851-01fb-478d-90b0-e8c6185d93cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:39.296187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f67eb7ff-338f-4376-a257-62cd5eb89b2c tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:39.296808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f67eb7ff-338f-4376-a257-62cd5eb89b2c tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:39.312182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f67eb7ff-338f-4376-a257-62cd5eb89b2c tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:39.312905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f67eb7ff-338f-4376-a257-62cd5eb89b2c tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:39.313505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f67eb7ff-338f-4376-a257-62cd5eb89b2c tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:39.314246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f67eb7ff-338f-4376-a257-62cd5eb89b2c tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:39.314844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f67eb7ff-338f-4376-a257-62cd5eb89b2c tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:39.315421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f67eb7ff-338f-4376-a257-62cd5eb89b2c tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:39.792334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f67eb7ff-338f-4376-a257-62cd5eb89b2c tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:39.800925 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f67eb7ff-338f-4376-a257-62cd5eb89b2c tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.508622 Oct 11 04:31:39.817186 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2459/4667] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:39 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:39.852412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9cd7f851-01fb-478d-90b0-e8c6185d93cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:39.867165 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9cd7f851-01fb-478d-90b0-e8c6185d93cf tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.682187 Oct 11 04:31:39.868958 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2209/4668] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:39 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:39.898034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e7a00978-0d9c-418f-929a-198cb052b902 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:39.898230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e7a00978-0d9c-418f-929a-198cb052b902 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:39.910508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a00978-0d9c-418f-929a-198cb052b902 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:39.911005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a00978-0d9c-418f-929a-198cb052b902 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:39.911440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a00978-0d9c-418f-929a-198cb052b902 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:39.919865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a00978-0d9c-418f-929a-198cb052b902 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:39.922627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a00978-0d9c-418f-929a-198cb052b902 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:39.923420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7a00978-0d9c-418f-929a-198cb052b902 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:40.149052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cad5fc6d-ab5a-48cf-9a95-c1553f04d50e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:40.149602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cad5fc6d-ab5a-48cf-9a95-c1553f04d50e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:40.159481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7a00978-0d9c-418f-929a-198cb052b902 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:40.163196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:40.164829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cad5fc6d-ab5a-48cf-9a95-c1553f04d50e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:40.172239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cad5fc6d-ab5a-48cf-9a95-c1553f04d50e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:40.172239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cad5fc6d-ab5a-48cf-9a95-c1553f04d50e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:40.172239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cad5fc6d-ab5a-48cf-9a95-c1553f04d50e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:40.172239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cad5fc6d-ab5a-48cf-9a95-c1553f04d50e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:40.172239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cad5fc6d-ab5a-48cf-9a95-c1553f04d50e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:40.173144 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e7a00978-0d9c-418f-929a-198cb052b902 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.275044 Oct 11 04:31:40.173144 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2460/4669] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:39 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:40.194107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b070ca01-99da-41b3-b04f-de9d8d2e2894 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:40.195050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b070ca01-99da-41b3-b04f-de9d8d2e2894 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:40.204203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b070ca01-99da-41b3-b04f-de9d8d2e2894 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:40.208365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b070ca01-99da-41b3-b04f-de9d8d2e2894 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:40.208920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b070ca01-99da-41b3-b04f-de9d8d2e2894 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:40.209858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b070ca01-99da-41b3-b04f-de9d8d2e2894 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:40.212230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b070ca01-99da-41b3-b04f-de9d8d2e2894 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:40.212896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b070ca01-99da-41b3-b04f-de9d8d2e2894 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:40.408439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b070ca01-99da-41b3-b04f-de9d8d2e2894 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:40.459396 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b070ca01-99da-41b3-b04f-de9d8d2e2894 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.268735 Oct 11 04:31:40.471841 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2461/4670] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:40 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:40.498930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a39e4aa8-ef6f-40b4-a18c-04f20571fe80 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:40.498930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a39e4aa8-ef6f-40b4-a18c-04f20571fe80 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:40.512008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a39e4aa8-ef6f-40b4-a18c-04f20571fe80 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:40.512515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a39e4aa8-ef6f-40b4-a18c-04f20571fe80 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:40.512958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a39e4aa8-ef6f-40b4-a18c-04f20571fe80 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:40.513675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a39e4aa8-ef6f-40b4-a18c-04f20571fe80 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:40.514125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a39e4aa8-ef6f-40b4-a18c-04f20571fe80 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:40.514748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a39e4aa8-ef6f-40b4-a18c-04f20571fe80 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:40.522070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cad5fc6d-ab5a-48cf-9a95-c1553f04d50e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:40.522070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:40.529538 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cad5fc6d-ab5a-48cf-9a95-c1553f04d50e tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1316 microversion: 2.1 time: 0.384413 Oct 11 04:31:40.534170 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2210/4671] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:40 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:40.747566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a39e4aa8-ef6f-40b4-a18c-04f20571fe80 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:40.774643 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a39e4aa8-ef6f-40b4-a18c-04f20571fe80 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.285840 Oct 11 04:31:40.778931 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2462/4672] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:40 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:40.805805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31aa79ce-80d8-4fe6-99e2-ed8f10092a31 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:40.806727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31aa79ce-80d8-4fe6-99e2-ed8f10092a31 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:40.807385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31aa79ce-80d8-4fe6-99e2-ed8f10092a31 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:40.807970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31aa79ce-80d8-4fe6-99e2-ed8f10092a31 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:40.826054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b788e42-e262-4865-9948-0090dfc2c3fc tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:40.826772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b788e42-e262-4865-9948-0090dfc2c3fc tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:40.837899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b788e42-e262-4865-9948-0090dfc2c3fc tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:40.846318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b788e42-e262-4865-9948-0090dfc2c3fc tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:40.847013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b788e42-e262-4865-9948-0090dfc2c3fc tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:40.848731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b788e42-e262-4865-9948-0090dfc2c3fc tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:40.852272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b788e42-e262-4865-9948-0090dfc2c3fc tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:40.852918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b788e42-e262-4865-9948-0090dfc2c3fc tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:40.863901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-31aa79ce-80d8-4fe6-99e2-ed8f10092a31 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Going to try to stop instance {{(pid=120993) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 04:31:41.144275 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-31aa79ce-80d8-4fe6-99e2-ed8f10092a31 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.349751 Oct 11 04:31:41.144983 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2211/4673] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:31:40 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:31:41.170951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2ea189cb-dbfa-46e6-8645-662bc3eb5c00 req-1a41a115-d48d-44dd-a29c-824c7afe5faf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3308eac-14b8-4148-96ef-d0794593fb30", "name": "network-vif-unplugged", "status": "completed", "tag": "296d8dde-1afc-4a75-b185-9efbe9173586"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:41.221094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2ea189cb-dbfa-46e6-8645-662bc3eb5c00 req-1a41a115-d48d-44dd-a29c-824c7afe5faf service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:41.227809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2ea189cb-dbfa-46e6-8645-662bc3eb5c00 req-1a41a115-d48d-44dd-a29c-824c7afe5faf service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:41.229584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2ea189cb-dbfa-46e6-8645-662bc3eb5c00 req-1a41a115-d48d-44dd-a29c-824c7afe5faf service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:41.279907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.compute.server_external_events [req-2ea189cb-dbfa-46e6-8645-662bc3eb5c00 req-1a41a115-d48d-44dd-a29c-824c7afe5faf service nova] Unable to find a host for instance d3308eac-14b8-4148-96ef-d0794593fb30. Dropping event network-vif-unplugged {{(pid=120993) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 04:31:41.281986 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2ea189cb-dbfa-46e6-8645-662bc3eb5c00 req-1a41a115-d48d-44dd-a29c-824c7afe5faf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.135616 Oct 11 04:31:41.283831 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2212/4674] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 138 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 04:31:41.307702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-19fabada-1dbc-4605-bc8f-f94361476550 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:41.308734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-19fabada-1dbc-4605-bc8f-f94361476550 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:41.323849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19fabada-1dbc-4605-bc8f-f94361476550 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:41.327237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19fabada-1dbc-4605-bc8f-f94361476550 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:41.328363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19fabada-1dbc-4605-bc8f-f94361476550 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:41.332217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19fabada-1dbc-4605-bc8f-f94361476550 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:41.333064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19fabada-1dbc-4605-bc8f-f94361476550 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:41.333795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19fabada-1dbc-4605-bc8f-f94361476550 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:41.549641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9b788e42-e262-4865-9948-0090dfc2c3fc tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:41.565171 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b788e42-e262-4865-9948-0090dfc2c3fc tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.743251 Oct 11 04:31:41.590361 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2463/4675] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:40 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:41.604545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0fca53cb-f2c4-4235-808b-d219c007c730 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:41.605535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0fca53cb-f2c4-4235-808b-d219c007c730 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:41.614665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fca53cb-f2c4-4235-808b-d219c007c730 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:41.615537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fca53cb-f2c4-4235-808b-d219c007c730 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:41.616868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fca53cb-f2c4-4235-808b-d219c007c730 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:41.618564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fca53cb-f2c4-4235-808b-d219c007c730 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:41.619289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fca53cb-f2c4-4235-808b-d219c007c730 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:41.619984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fca53cb-f2c4-4235-808b-d219c007c730 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:41.964190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-19fabada-1dbc-4605-bc8f-f94361476550 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:41.981188 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-19fabada-1dbc-4605-bc8f-f94361476550 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.689741 Oct 11 04:31:41.997815 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2213/4676] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:41 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:42.385111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0fca53cb-f2c4-4235-808b-d219c007c730 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:42.395771 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0fca53cb-f2c4-4235-808b-d219c007c730 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1505 microversion: 2.1 time: 0.804023 Oct 11 04:31:42.410212 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2464/4677] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:41 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1505 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:42.426049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7adf0ed6-6b78-47dc-abba-2f911d6e5f08 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:42.426570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7adf0ed6-6b78-47dc-abba-2f911d6e5f08 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:42.437775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:42.440854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7adf0ed6-6b78-47dc-abba-2f911d6e5f08 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:42.442768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7adf0ed6-6b78-47dc-abba-2f911d6e5f08 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:42.443206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7adf0ed6-6b78-47dc-abba-2f911d6e5f08 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:42.451668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7adf0ed6-6b78-47dc-abba-2f911d6e5f08 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:42.451668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7adf0ed6-6b78-47dc-abba-2f911d6e5f08 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:42.453670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7adf0ed6-6b78-47dc-abba-2f911d6e5f08 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:42.597813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4eb8450e-2a86-4a5c-b84b-404d476a7a09 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:42.599112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4eb8450e-2a86-4a5c-b84b-404d476a7a09 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:42.612906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eb8450e-2a86-4a5c-b84b-404d476a7a09 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:42.614524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eb8450e-2a86-4a5c-b84b-404d476a7a09 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:42.616440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eb8450e-2a86-4a5c-b84b-404d476a7a09 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:42.619147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eb8450e-2a86-4a5c-b84b-404d476a7a09 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:42.620522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eb8450e-2a86-4a5c-b84b-404d476a7a09 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:42.623949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4eb8450e-2a86-4a5c-b84b-404d476a7a09 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:42.764770 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7adf0ed6-6b78-47dc-abba-2f911d6e5f08 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "DELETE /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2/os-server-password" status: 204 len: 0 microversion: 2.1 time: 0.343708 Oct 11 04:31:42.770781 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2214/4678] 10.222.0.26 () {58 vars in 1296 bytes} [Tue Oct 11 04:31:42 2022] DELETE /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2/os-server-password => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:31:42.777628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef511612-9527-4abd-9036-7afeb2a934c4 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:42.778557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef511612-9527-4abd-9036-7afeb2a934c4 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:42.788474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef511612-9527-4abd-9036-7afeb2a934c4 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:42.789382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef511612-9527-4abd-9036-7afeb2a934c4 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:42.793329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef511612-9527-4abd-9036-7afeb2a934c4 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:42.797122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef511612-9527-4abd-9036-7afeb2a934c4 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:42.798139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef511612-9527-4abd-9036-7afeb2a934c4 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:42.799002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef511612-9527-4abd-9036-7afeb2a934c4 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:42.862748 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef511612-9527-4abd-9036-7afeb2a934c4 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2/os-server-password" status: 200 len: 16 microversion: 2.1 time: 0.089852 Oct 11 04:31:42.864095 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2215/4679] 10.222.0.26 () {58 vars in 1293 bytes} [Tue Oct 11 04:31:42 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2/os-server-password => generated 16 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:31:42.879313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c7506948-9fc3-41f8-86e4-b5c6318ddee2 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:42.879951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c7506948-9fc3-41f8-86e4-b5c6318ddee2 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:42.897630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7506948-9fc3-41f8-86e4-b5c6318ddee2 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:42.898948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7506948-9fc3-41f8-86e4-b5c6318ddee2 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:42.900501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7506948-9fc3-41f8-86e4-b5c6318ddee2 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:42.902034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7506948-9fc3-41f8-86e4-b5c6318ddee2 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:42.903361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7506948-9fc3-41f8-86e4-b5c6318ddee2 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:42.905762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7506948-9fc3-41f8-86e4-b5c6318ddee2 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:42.956516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c7506948-9fc3-41f8-86e4-b5c6318ddee2 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:31:43.398279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4eb8450e-2a86-4a5c-b84b-404d476a7a09 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:43.419095 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4eb8450e-2a86-4a5c-b84b-404d476a7a09 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.826104 Oct 11 04:31:43.430683 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2465/4680] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:42 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:43.449269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aa59c236-e5a9-411f-ae45-e9c55d8ccf18 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:43.451674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aa59c236-e5a9-411f-ae45-e9c55d8ccf18 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:43.470634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59c236-e5a9-411f-ae45-e9c55d8ccf18 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:43.474617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59c236-e5a9-411f-ae45-e9c55d8ccf18 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:43.474617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59c236-e5a9-411f-ae45-e9c55d8ccf18 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:43.474617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59c236-e5a9-411f-ae45-e9c55d8ccf18 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:43.474617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59c236-e5a9-411f-ae45-e9c55d8ccf18 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:43.474617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa59c236-e5a9-411f-ae45-e9c55d8ccf18 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:43.552000 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c7506948-9fc3-41f8-86e4-b5c6318ddee2 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "DELETE /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 204 len: 0 microversion: 2.1 time: 0.681111 Oct 11 04:31:43.552970 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2216/4681] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:31:42 2022] DELETE /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:31:43.564834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-cb0bdf52-0283-4b3b-9f61-93eec4c34466 req-42d7057f-d6b3-497c-9a16-32205d31c023 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619f5d1a-728e-4d57-bdbe-b042aaca532f", "name": "network-vif-plugged", "status": "completed", "tag": "bfdee7fb-d6c4-4124-bf6a-abb48bfefdeb"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:43.603169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cb0bdf52-0283-4b3b-9f61-93eec4c34466 req-42d7057f-d6b3-497c-9a16-32205d31c023 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:43.604035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cb0bdf52-0283-4b3b-9f61-93eec4c34466 req-42d7057f-d6b3-497c-9a16-32205d31c023 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:43.605369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cb0bdf52-0283-4b3b-9f61-93eec4c34466 req-42d7057f-d6b3-497c-9a16-32205d31c023 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:43.621910 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-cb0bdf52-0283-4b3b-9f61-93eec4c34466 req-42d7057f-d6b3-497c-9a16-32205d31c023 service nova] Creating event network-vif-plugged:bfdee7fb-d6c4-4124-bf6a-abb48bfefdeb for instance 619f5d1a-728e-4d57-bdbe-b042aaca532f on n-h1-860892-1 Oct 11 04:31:43.631124 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-cb0bdf52-0283-4b3b-9f61-93eec4c34466 req-42d7057f-d6b3-497c-9a16-32205d31c023 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076251 Oct 11 04:31:43.632183 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2217/4682] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:43.661674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-141d6da2-aec6-4971-93ec-fb37dd0ffb45 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:43.665875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-141d6da2-aec6-4971-93ec-fb37dd0ffb45 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:43.672263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141d6da2-aec6-4971-93ec-fb37dd0ffb45 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:43.672976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141d6da2-aec6-4971-93ec-fb37dd0ffb45 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:43.673509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141d6da2-aec6-4971-93ec-fb37dd0ffb45 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:43.676274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141d6da2-aec6-4971-93ec-fb37dd0ffb45 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:43.677544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141d6da2-aec6-4971-93ec-fb37dd0ffb45 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:43.678234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141d6da2-aec6-4971-93ec-fb37dd0ffb45 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:43.934705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aa59c236-e5a9-411f-ae45-e9c55d8ccf18 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:43.949473 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aa59c236-e5a9-411f-ae45-e9c55d8ccf18 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.517573 Oct 11 04:31:43.950062 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2466/4683] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:43 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:44.026769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-141d6da2-aec6-4971-93ec-fb37dd0ffb45 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:44.042937 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-141d6da2-aec6-4971-93ec-fb37dd0ffb45 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1511 microversion: 2.1 time: 0.405856 Oct 11 04:31:44.047292 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2218/4684] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:43 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1511 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:44.446674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9e36485-7cf4-44ea-9e34-8d80499be194 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:44.447303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d9e36485-7cf4-44ea-9e34-8d80499be194 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:44.454392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e36485-7cf4-44ea-9e34-8d80499be194 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:44.455941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e36485-7cf4-44ea-9e34-8d80499be194 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:44.455941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e36485-7cf4-44ea-9e34-8d80499be194 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:44.461864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e36485-7cf4-44ea-9e34-8d80499be194 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:44.462638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e36485-7cf4-44ea-9e34-8d80499be194 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:44.463363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9e36485-7cf4-44ea-9e34-8d80499be194 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:44.973383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb75d727-a574-4a9c-86da-71e7ab36f736 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:44.974671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fb75d727-a574-4a9c-86da-71e7ab36f736 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:44.994159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb75d727-a574-4a9c-86da-71e7ab36f736 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:45.007652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb75d727-a574-4a9c-86da-71e7ab36f736 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:45.011867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb75d727-a574-4a9c-86da-71e7ab36f736 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:45.013130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb75d727-a574-4a9c-86da-71e7ab36f736 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:45.013793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb75d727-a574-4a9c-86da-71e7ab36f736 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:45.014491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb75d727-a574-4a9c-86da-71e7ab36f736 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:45.060106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d9e36485-7cf4-44ea-9e34-8d80499be194 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:45.072707 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d9e36485-7cf4-44ea-9e34-8d80499be194 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.629960 Oct 11 04:31:45.075142 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2467/4685] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:44 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:45.080546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8faaacfc-25b4-4110-94cf-7b4e617d5174 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:45.081559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8faaacfc-25b4-4110-94cf-7b4e617d5174 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:45.095013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8faaacfc-25b4-4110-94cf-7b4e617d5174 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:45.095507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8faaacfc-25b4-4110-94cf-7b4e617d5174 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:45.095943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8faaacfc-25b4-4110-94cf-7b4e617d5174 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:45.096651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8faaacfc-25b4-4110-94cf-7b4e617d5174 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:45.097100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8faaacfc-25b4-4110-94cf-7b4e617d5174 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:45.097621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8faaacfc-25b4-4110-94cf-7b4e617d5174 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:45.369106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8faaacfc-25b4-4110-94cf-7b4e617d5174 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:45.382302 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8faaacfc-25b4-4110-94cf-7b4e617d5174 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1511 microversion: 2.1 time: 0.305546 Oct 11 04:31:45.384104 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2468/4686] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:45 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1511 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:46.055046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb75d727-a574-4a9c-86da-71e7ab36f736 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:46.066019 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb75d727-a574-4a9c-86da-71e7ab36f736 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 1.096846 Oct 11 04:31:46.067159 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2219/4687] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:44 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 1099 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:46.097359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a54b1633-5804-4f50-8daa-e68d34996e6e tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:46.097956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a54b1633-5804-4f50-8daa-e68d34996e6e tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:46.108871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54b1633-5804-4f50-8daa-e68d34996e6e tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:46.109505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54b1633-5804-4f50-8daa-e68d34996e6e tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:46.109799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54b1633-5804-4f50-8daa-e68d34996e6e tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:46.113531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54b1633-5804-4f50-8daa-e68d34996e6e tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:46.115645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54b1633-5804-4f50-8daa-e68d34996e6e tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:46.118437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a54b1633-5804-4f50-8daa-e68d34996e6e tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:46.413079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2db8223e-e093-4511-8482-a2e62e860a0b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:46.414882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2db8223e-e093-4511-8482-a2e62e860a0b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:46.424356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2db8223e-e093-4511-8482-a2e62e860a0b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:46.431791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2db8223e-e093-4511-8482-a2e62e860a0b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:46.432559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2db8223e-e093-4511-8482-a2e62e860a0b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:46.435616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2db8223e-e093-4511-8482-a2e62e860a0b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:46.436459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2db8223e-e093-4511-8482-a2e62e860a0b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:46.437091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2db8223e-e093-4511-8482-a2e62e860a0b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:46.750350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2db8223e-e093-4511-8482-a2e62e860a0b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:46.761201 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2db8223e-e093-4511-8482-a2e62e860a0b tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1511 microversion: 2.1 time: 0.355942 Oct 11 04:31:46.763680 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2220/4688] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:46 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1511 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:46.963109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a54b1633-5804-4f50-8daa-e68d34996e6e tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:47.000434 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a54b1633-5804-4f50-8daa-e68d34996e6e tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1314 microversion: 2.1 time: 0.905362 Oct 11 04:31:47.015203 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2469/4689] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:46 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1314 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:47.093893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8ebe3b6f-fadf-4fbe-9491-1368adf5adc5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:47.094659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8ebe3b6f-fadf-4fbe-9491-1368adf5adc5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:47.104148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ebe3b6f-fadf-4fbe-9491-1368adf5adc5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:47.108477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ebe3b6f-fadf-4fbe-9491-1368adf5adc5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:47.111503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ebe3b6f-fadf-4fbe-9491-1368adf5adc5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:47.112721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ebe3b6f-fadf-4fbe-9491-1368adf5adc5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:47.113488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ebe3b6f-fadf-4fbe-9491-1368adf5adc5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:47.114398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ebe3b6f-fadf-4fbe-9491-1368adf5adc5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:47.694897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b8f7e276-f7e1-4832-8446-f7e1fe0dc5db req-4b2fafa7-272c-4bf0-b0fd-4d0fddef077c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "801d607e-a694-4809-a818-cce55c9ddfd2", "name": "network-vif-deleted", "tag": "693df5da-dfb9-4762-95de-f6db1070504b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:47.722910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b8f7e276-f7e1-4832-8446-f7e1fe0dc5db req-4b2fafa7-272c-4bf0-b0fd-4d0fddef077c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:47.723991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b8f7e276-f7e1-4832-8446-f7e1fe0dc5db req-4b2fafa7-272c-4bf0-b0fd-4d0fddef077c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:47.726095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b8f7e276-f7e1-4832-8446-f7e1fe0dc5db req-4b2fafa7-272c-4bf0-b0fd-4d0fddef077c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:47.763279 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b8f7e276-f7e1-4832-8446-f7e1fe0dc5db req-4b2fafa7-272c-4bf0-b0fd-4d0fddef077c service nova] Creating event network-vif-deleted:693df5da-dfb9-4762-95de-f6db1070504b for instance 801d607e-a694-4809-a818-cce55c9ddfd2 on n-h1-860892-1 Oct 11 04:31:47.792340 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b8f7e276-f7e1-4832-8446-f7e1fe0dc5db req-4b2fafa7-272c-4bf0-b0fd-4d0fddef077c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101443 Oct 11 04:31:47.794854 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2470/4690] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:31:47.808428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a1873370-e7f3-4317-87ee-65e634f9b903 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:47.811232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a1873370-e7f3-4317-87ee-65e634f9b903 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:47.830447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1873370-e7f3-4317-87ee-65e634f9b903 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:47.833272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1873370-e7f3-4317-87ee-65e634f9b903 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:47.834843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1873370-e7f3-4317-87ee-65e634f9b903 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:47.838359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1873370-e7f3-4317-87ee-65e634f9b903 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:47.839761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1873370-e7f3-4317-87ee-65e634f9b903 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:47.842150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1873370-e7f3-4317-87ee-65e634f9b903 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:48.011693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a1873370-e7f3-4317-87ee-65e634f9b903 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:48.028646 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a1873370-e7f3-4317-87ee-65e634f9b903 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1301 microversion: 2.1 time: 0.231470 Oct 11 04:31:48.033504 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2471/4691] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:47 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1301 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:48.035282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8ebe3b6f-fadf-4fbe-9491-1368adf5adc5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:48.041446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2048bd8b-5f3c-4bde-80c6-6d795e607ff1 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:48.043562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2048bd8b-5f3c-4bde-80c6-6d795e607ff1 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:48.050298 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8ebe3b6f-fadf-4fbe-9491-1368adf5adc5 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.959816 Oct 11 04:31:48.051104 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2221/4692] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:47 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 963 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:48.079315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2048bd8b-5f3c-4bde-80c6-6d795e607ff1 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:48.081575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2048bd8b-5f3c-4bde-80c6-6d795e607ff1 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:48.082839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2048bd8b-5f3c-4bde-80c6-6d795e607ff1 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:48.087139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2048bd8b-5f3c-4bde-80c6-6d795e607ff1 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:48.087865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2048bd8b-5f3c-4bde-80c6-6d795e607ff1 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:48.089900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2048bd8b-5f3c-4bde-80c6-6d795e607ff1 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:48.786224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2048bd8b-5f3c-4bde-80c6-6d795e607ff1 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:48.798657 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2048bd8b-5f3c-4bde-80c6-6d795e607ff1 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1464 microversion: 2.1 time: 0.763720 Oct 11 04:31:48.800042 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2472/4693] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:48 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1464 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:49.059827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:49.061827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:49.072632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.073193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.073640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.074396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.078478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.079035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.171381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.173795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.175493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.178800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lazy-loading 'fault' on Instance uuid 801d607e-a694-4809-a818-cce55c9ddfd2 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:31:49.245406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-85b59496-715a-4dda-b2b5-42c389826aa6 tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Calling method '.version_select at 0x7fda18a36a60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:49.265239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85b59496-715a-4dda-b2b5-42c389826aa6 tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.265760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85b59496-715a-4dda-b2b5-42c389826aa6 tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.269007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85b59496-715a-4dda-b2b5-42c389826aa6 tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.305524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85b59496-715a-4dda-b2b5-42c389826aa6 tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.306016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85b59496-715a-4dda-b2b5-42c389826aa6 tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.307016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85b59496-715a-4dda-b2b5-42c389826aa6 tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.336000 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-85b59496-715a-4dda-b2b5-42c389826aa6 tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/b2389f8a4b62476f82bbf86884923c22?start=2022-10-10T04%3A31%3A48.819462&end=2022-10-12T04%3A31%3A48.819462" status: 200 len: 695 microversion: 2.1 time: 0.511849 Oct 11 04:31:49.347834 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2222/4694] 10.222.0.26 () {58 vars in 1412 bytes} [Tue Oct 11 04:31:48 2022] GET /compute/v2.1/os-simple-tenant-usage/b2389f8a4b62476f82bbf86884923c22?start=2022-10-10T04%3A31%3A48.819462&end=2022-10-12T04%3A31%3A48.819462 => generated 695 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:49.371019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5840f2b-558c-4f3e-94bc-a48113581927 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:49.373100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d5840f2b-558c-4f3e-94bc-a48113581927 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:49.386054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '432da3b60c3240c2817bc66ea1b42aa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e97c906957944763a5cedfc096350080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:49.390869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5840f2b-558c-4f3e-94bc-a48113581927 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.392511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5840f2b-558c-4f3e-94bc-a48113581927 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.392966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5840f2b-558c-4f3e-94bc-a48113581927 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.393695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5840f2b-558c-4f3e-94bc-a48113581927 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.394157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5840f2b-558c-4f3e-94bc-a48113581927 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.401476 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3c974afc-1b37-4640-99c2-3b6aa7a7eb78 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 200 len: 1306 microversion: 2.1 time: 0.343524 Oct 11 04:31:49.401613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5840f2b-558c-4f3e-94bc-a48113581927 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.401751 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2473/4695] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:49 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 1306 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:49.402602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-94abb7fa-db88-4ac5-97be-867a05c95805 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '.version_select at 0x7fda18dcb5e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:49.415671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94abb7fa-db88-4ac5-97be-867a05c95805 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.416188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94abb7fa-db88-4ac5-97be-867a05c95805 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.416798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94abb7fa-db88-4ac5-97be-867a05c95805 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.436566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94abb7fa-db88-4ac5-97be-867a05c95805 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.438763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94abb7fa-db88-4ac5-97be-867a05c95805 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.438763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94abb7fa-db88-4ac5-97be-867a05c95805 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.460066 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-94abb7fa-db88-4ac5-97be-867a05c95805 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage/b2389f8a4b62476f82bbf86884923c22?start=2022-10-10T04%3A31%3A48.819462&end=2022-10-12T04%3A31%3A48.819462" status: 200 len: 694 microversion: 2.1 time: 0.061398 Oct 11 04:31:49.469249 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2474/4696] 10.222.0.26 () {58 vars in 1412 bytes} [Tue Oct 11 04:31:49 2022] GET /compute/v2.1/os-simple-tenant-usage/b2389f8a4b62476f82bbf86884923c22?start=2022-10-10T04%3A31%3A48.819462&end=2022-10-12T04%3A31%3A48.819462 => generated 694 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:49.478297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-75eeeede-13ed-4d3b-ad92-2433201fe6cf tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Calling method '.version_select at 0x7fda18e45430>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:49.493747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75eeeede-13ed-4d3b-ad92-2433201fe6cf tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.494587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75eeeede-13ed-4d3b-ad92-2433201fe6cf tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.499253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75eeeede-13ed-4d3b-ad92-2433201fe6cf tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.513451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75eeeede-13ed-4d3b-ad92-2433201fe6cf tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.516965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75eeeede-13ed-4d3b-ad92-2433201fe6cf tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.518171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75eeeede-13ed-4d3b-ad92-2433201fe6cf tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.751577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d5840f2b-558c-4f3e-94bc-a48113581927 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:49.752790 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-75eeeede-13ed-4d3b-ad92-2433201fe6cf tempest-TenantUsagesTestJSON-1139185820 tempest-TenantUsagesTestJSON-1139185820-project-admin] 10.222.0.26 "GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T04%3A31%3A48.819462&end=2022-10-12T04%3A31%3A48.819462&detailed=1" status: 200 len: 53894 microversion: 2.1 time: 0.277898 Oct 11 04:31:49.760189 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d5840f2b-558c-4f3e-94bc-a48113581927 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.420610 Oct 11 04:31:49.760941 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2223/4697] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:49 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:49.764354 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2475/4698] 10.222.0.26 () {58 vars in 1335 bytes} [Tue Oct 11 04:31:49 2022] GET /compute/v2.1/os-simple-tenant-usage?start=2022-10-10T04%3A31%3A48.819462&end=2022-10-12T04%3A31%3A48.819462&detailed=1 => generated 53894 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:31:49.816415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0798badb-b030-4172-910d-94e5fa074df3 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:49.817334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0798badb-b030-4172-910d-94e5fa074df3 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:49.824911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0798badb-b030-4172-910d-94e5fa074df3 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.825688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0798badb-b030-4172-910d-94e5fa074df3 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.826396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0798badb-b030-4172-910d-94e5fa074df3 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.827316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0798badb-b030-4172-910d-94e5fa074df3 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:49.827997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0798badb-b030-4172-910d-94e5fa074df3 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:49.828770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0798badb-b030-4172-910d-94e5fa074df3 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:49.862886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0798badb-b030-4172-910d-94e5fa074df3 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:31:49.940474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=4,nova_cell1:INSERT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:50.257893 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0798badb-b030-4172-910d-94e5fa074df3 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "DELETE /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 204 len: 0 microversion: 2.1 time: 0.441778 Oct 11 04:31:50.257893 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2224/4699] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:31:49 2022] DELETE /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:31:50.266887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0758e204-70ff-4dcd-8820-d80e06a8da47 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:50.269053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0758e204-70ff-4dcd-8820-d80e06a8da47 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:50.272636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=85 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:50.291092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0758e204-70ff-4dcd-8820-d80e06a8da47 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:50.294659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0758e204-70ff-4dcd-8820-d80e06a8da47 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:50.296264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0758e204-70ff-4dcd-8820-d80e06a8da47 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:50.297314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0758e204-70ff-4dcd-8820-d80e06a8da47 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:50.303807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0758e204-70ff-4dcd-8820-d80e06a8da47 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:50.303807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0758e204-70ff-4dcd-8820-d80e06a8da47 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:50.425395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:50.431199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] [instance: 801d607e-a694-4809-a818-cce55c9ddfd2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:50.436788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:50.440380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:50.441039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:50.441934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:50.444433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:50.445142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:50.495199 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] HTTP exception thrown: Instance 801d607e-a694-4809-a818-cce55c9ddfd2 could not be found. Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Request method failure captured: Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 HTTP/1.1 Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPGRVyDgnms-6FMZ0jb0UyEOXcdD5UhGqiM_0NyWbB4Zd0lGGjltZKLclmtTxtDIRREzE7v9YbFQtJ4XdE3jCk8HnPh8LtFgcqKzEJBw9kJ6RkjLxoivuLxnJWur_fONG1fISFKdP5j0C60__tRL7QwLLQ0Ql7uM5lRXJQY_8G8zGpw Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: e97c906957944763a5cedfc096350080 Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerPasswordTestJSON-1702372399 Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e97c906957944763a5cedfc096350080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e97c906957944763a5cedfc096350080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e97c906957944763a5cedfc096350080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e97c906957944763a5cedfc096350080"}]}] Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerPasswordTestJSON-1702372399 Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: e97c906957944763a5cedfc096350080 Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerPasswordTestJSON-1702372399 Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerPasswordTestJSON-1702372399-project Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 432da3b60c3240c2817bc66ea1b42aa7 Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerPasswordTestJSON-1702372399-project Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 801d607e-a694-4809-a818-cce55c9ddfd2 could not be found. Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '801d607e-a694-4809-a818-cce55c9ddfd2'} Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 801d607e-a694-4809-a818-cce55c9ddfd2 could not be found. Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 801d607e-a694-4809-a818-cce55c9ddfd2 could not be found. Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:50.502410 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:50.507378 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:50.507378 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:50.507378 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:50.507378 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:31:50.507378 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:31:50.507378 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 801d607e-a694-4809-a818-cce55c9ddfd2 could not be found. Oct 11 04:31:50.507378 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:31:50.507378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] Returning 404 to user: Instance 801d607e-a694-4809-a818-cce55c9ddfd2 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:31:50.507378 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7944aad0-42f5-49cf-9c9d-fb777b58b221 tempest-ServerPasswordTestJSON-1702372399 tempest-ServerPasswordTestJSON-1702372399-project] 10.222.0.26 "GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2" status: 404 len: 111 microversion: 2.1 time: 0.078399 Oct 11 04:31:50.507378 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2225/4700] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:50 2022] GET /compute/v2.1/servers/801d607e-a694-4809-a818-cce55c9ddfd2 => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:31:50.792849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9802c0da-130b-4a43-9857-30baa6388d08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:50.793480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9802c0da-130b-4a43-9857-30baa6388d08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:50.808071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9802c0da-130b-4a43-9857-30baa6388d08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:50.808585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9802c0da-130b-4a43-9857-30baa6388d08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:50.809027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9802c0da-130b-4a43-9857-30baa6388d08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:50.809907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9802c0da-130b-4a43-9857-30baa6388d08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:50.814076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9802c0da-130b-4a43-9857-30baa6388d08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:50.816309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9802c0da-130b-4a43-9857-30baa6388d08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:51.206367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0758e204-70ff-4dcd-8820-d80e06a8da47 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:51.218367 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0758e204-70ff-4dcd-8820-d80e06a8da47 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1470 microversion: 2.1 time: 0.955983 Oct 11 04:31:51.220015 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2476/4701] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:50 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1470 bytes in 958 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:51.228223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-540b868e-8a06-4623-ac54-3f4a96426e1f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Action: 'create', calling method: .version_select at 0x7fda18ded0d0>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-1596601567", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMAx5gdCMeNM9k5iAW60LC4MVjIg60/b3gS3ppSqYG49g9UXavWwlE1g1FiNACYNhJ6NUmt8m/aEE/AfIxklyPDLxj1WjZml6P0aFXhjc4eaSePnJEk8C99wu8AaK0QmaQ=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:51.251065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-540b868e-8a06-4623-ac54-3f4a96426e1f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:31:51.258552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-540b868e-8a06-4623-ac54-3f4a96426e1f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for user 752975bff6034a7086aafa3319a4f1d4 and project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:31:51.439256 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-540b868e-8a06-4623-ac54-3f4a96426e1f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.216376 Oct 11 04:31:51.442442 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2477/4702] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:31:51 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:51.768799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9802c0da-130b-4a43-9857-30baa6388d08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:51.778309 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9802c0da-130b-4a43-9857-30baa6388d08 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1678 microversion: 2.1 time: 0.990250 Oct 11 04:31:51.790944 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2226/4703] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:50 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1678 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:52.249818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48fcc1d3-5837-4952-b723-e05fc52e0ea8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:52.250976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-48fcc1d3-5837-4952-b723-e05fc52e0ea8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:52.259217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcc1d3-5837-4952-b723-e05fc52e0ea8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:52.259985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcc1d3-5837-4952-b723-e05fc52e0ea8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:52.260636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcc1d3-5837-4952-b723-e05fc52e0ea8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:52.261667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcc1d3-5837-4952-b723-e05fc52e0ea8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:52.262367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcc1d3-5837-4952-b723-e05fc52e0ea8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:52.262973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48fcc1d3-5837-4952-b723-e05fc52e0ea8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:52.529645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48fcc1d3-5837-4952-b723-e05fc52e0ea8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:52.541113 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48fcc1d3-5837-4952-b723-e05fc52e0ea8 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1470 microversion: 2.1 time: 0.295209 Oct 11 04:31:52.542121 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2478/4704] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:52 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1470 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:52.803345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-920016ba-910a-49dc-99e6-bcdc6cf67c22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:52.805734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-920016ba-910a-49dc-99e6-bcdc6cf67c22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:52.813740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920016ba-910a-49dc-99e6-bcdc6cf67c22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:52.814590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920016ba-910a-49dc-99e6-bcdc6cf67c22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:52.815194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920016ba-910a-49dc-99e6-bcdc6cf67c22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:52.816037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920016ba-910a-49dc-99e6-bcdc6cf67c22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:52.816629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920016ba-910a-49dc-99e6-bcdc6cf67c22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:52.817186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-920016ba-910a-49dc-99e6-bcdc6cf67c22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:53.236115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de8574d3-5e01-4bf2-b62f-8743d8dc007e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:53.240026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-de8574d3-5e01-4bf2-b62f-8743d8dc007e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:53.244127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de8574d3-5e01-4bf2-b62f-8743d8dc007e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:53.244618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de8574d3-5e01-4bf2-b62f-8743d8dc007e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:53.245053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de8574d3-5e01-4bf2-b62f-8743d8dc007e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:53.245750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de8574d3-5e01-4bf2-b62f-8743d8dc007e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:53.246230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de8574d3-5e01-4bf2-b62f-8743d8dc007e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:53.246644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de8574d3-5e01-4bf2-b62f-8743d8dc007e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:53.277287 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-de8574d3-5e01-4bf2-b62f-8743d8dc007e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/ips" status: 200 len: 144 microversion: 2.1 time: 0.044990 Oct 11 04:31:53.278579 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2479/4705] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:31:53 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/ips => generated 144 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:53.329909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-920016ba-910a-49dc-99e6-bcdc6cf67c22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:53.344670 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-920016ba-910a-49dc-99e6-bcdc6cf67c22 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1655 microversion: 2.1 time: 0.544006 Oct 11 04:31:53.344670 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2227/4706] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:52 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1655 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:53.360419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-69f8b7c0-03de-4e58-90be-7cfe8aea4fc7 req-ac6aaa3d-ead9-492f-9605-b557c06e7fc1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "619f5d1a-728e-4d57-bdbe-b042aaca532f", "name": "network-vif-deleted", "tag": "bfdee7fb-d6c4-4124-bf6a-abb48bfefdeb"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:53.380913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1abbaf33-1f16-44eb-bca8-619932aff063 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:53.390652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-69f8b7c0-03de-4e58-90be-7cfe8aea4fc7 req-ac6aaa3d-ead9-492f-9605-b557c06e7fc1 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:53.390652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-69f8b7c0-03de-4e58-90be-7cfe8aea4fc7 req-ac6aaa3d-ead9-492f-9605-b557c06e7fc1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:53.390652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-69f8b7c0-03de-4e58-90be-7cfe8aea4fc7 req-ac6aaa3d-ead9-492f-9605-b557c06e7fc1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:53.399625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1abbaf33-1f16-44eb-bca8-619932aff063 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:53.400428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1abbaf33-1f16-44eb-bca8-619932aff063 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:53.401022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1abbaf33-1f16-44eb-bca8-619932aff063 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:53.407597 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-69f8b7c0-03de-4e58-90be-7cfe8aea4fc7 req-ac6aaa3d-ead9-492f-9605-b557c06e7fc1 service nova] Creating event network-vif-deleted:bfdee7fb-d6c4-4124-bf6a-abb48bfefdeb for instance 619f5d1a-728e-4d57-bdbe-b042aaca532f on n-h1-860892-1 Oct 11 04:31:53.415270 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-69f8b7c0-03de-4e58-90be-7cfe8aea4fc7 req-ac6aaa3d-ead9-492f-9605-b557c06e7fc1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060564 Oct 11 04:31:53.416478 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2480/4707] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:53.465637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1abbaf33-1f16-44eb-bca8-619932aff063 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Going to try to start instance {{(pid=120993) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 04:31:53.568609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bcec51fd-31cd-4f86-a6a8-851d015ce7f7 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:53.569497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bcec51fd-31cd-4f86-a6a8-851d015ce7f7 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:53.577647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcec51fd-31cd-4f86-a6a8-851d015ce7f7 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:53.578459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcec51fd-31cd-4f86-a6a8-851d015ce7f7 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:53.579167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcec51fd-31cd-4f86-a6a8-851d015ce7f7 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:53.580444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcec51fd-31cd-4f86-a6a8-851d015ce7f7 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:53.581212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcec51fd-31cd-4f86-a6a8-851d015ce7f7 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:53.581877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bcec51fd-31cd-4f86-a6a8-851d015ce7f7 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:53.588524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:53.623726 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1abbaf33-1f16-44eb-bca8-619932aff063 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.248258 Oct 11 04:31:53.624498 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2228/4708] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:31:53 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:31:53.636629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a4501127-0d1a-4a36-bc32-542d88ddbc1c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:53.645749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a4501127-0d1a-4a36-bc32-542d88ddbc1c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:53.667969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4501127-0d1a-4a36-bc32-542d88ddbc1c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:53.669024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4501127-0d1a-4a36-bc32-542d88ddbc1c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:53.669693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4501127-0d1a-4a36-bc32-542d88ddbc1c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:53.670730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4501127-0d1a-4a36-bc32-542d88ddbc1c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:53.671701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4501127-0d1a-4a36-bc32-542d88ddbc1c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:53.672099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4501127-0d1a-4a36-bc32-542d88ddbc1c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:53.731166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bcec51fd-31cd-4f86-a6a8-851d015ce7f7 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:53.746799 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bcec51fd-31cd-4f86-a6a8-851d015ce7f7 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1299 microversion: 2.1 time: 0.183169 Oct 11 04:31:53.747590 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2481/4709] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:53 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1299 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:54.568923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a4501127-0d1a-4a36-bc32-542d88ddbc1c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:54.578366 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a4501127-0d1a-4a36-bc32-542d88ddbc1c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1664 microversion: 2.1 time: 0.949079 Oct 11 04:31:54.579252 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2229/4710] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:53 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1664 bytes in 951 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:54.767711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1556478173", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "224e8981-d623-469e-a841-4c9351b450ea"}], "key_name": "tempest-TestNetworkBasicOps-1596601567", "security_groups": [{"name": "tempest-secgroup-smoke-1253594215"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:54.773429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:54.776133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:54.783700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:54.784612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:54.785233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:54.786104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:54.786739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:54.787318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:54.922259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:54.924392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:54.924844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:54.930395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lazy-loading 'fault' on Instance uuid 619f5d1a-728e-4d57-bdbe-b042aaca532f {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:31:55.000012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] validate_networks() for [('224e8981-d623-469e-a841-4c9351b450ea', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:31:55.010231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bac73092f41542fc9dc696dbdcbaa044', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2389f8a4b62476f82bbf86884923c22', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:55.023455 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-864d681f-0b95-46ce-84c9-5752b757457d tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 200 len: 1304 microversion: 2.1 time: 0.254428 Oct 11 04:31:55.024671 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2230/4711] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:54 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 1304 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:55.224183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b8f2a9f5-43f7-40ad-83f9-f2f5d4f53be6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Action: 'create', calling method: .version_select at 0x7fda18a6b280>, body: {"keypair": {"name": "tempest-TestServerBasicOps-792414490", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdnmGs7AhR258Ek8NKWhyaUphDYZW52sBjNHEGANwmSBP/O2X/eb0ovuKvWDh6sMZzGSNQzxSQ/IvsYzN7P7k4VESqezfAiqew6WhooT/L0sK3Tv/Vn9OQScm45wb2+gw=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:55.261734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-b8f2a9f5-43f7-40ad-83f9-f2f5d4f53be6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Getting quotas for project 4df950b23b29437d9b2a30ec4a33fc3a. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:31:55.277093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-b8f2a9f5-43f7-40ad-83f9-f2f5d4f53be6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Getting quotas for user 29ef277265894627961369a52d81f493 and project 4df950b23b29437d9b2a30ec4a33fc3a. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:31:55.528948 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b8f2a9f5-43f7-40ad-83f9-f2f5d4f53be6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.502973 Oct 11 04:31:55.536568 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2231/4712] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:31:55 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:55.603276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dc0ea147-bb44-4756-a277-41f26526fbdd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:55.603920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dc0ea147-bb44-4756-a277-41f26526fbdd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:55.610139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0ea147-bb44-4756-a277-41f26526fbdd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:55.610859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0ea147-bb44-4756-a277-41f26526fbdd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:55.611454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0ea147-bb44-4756-a277-41f26526fbdd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:55.612308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0ea147-bb44-4756-a277-41f26526fbdd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:55.612918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0ea147-bb44-4756-a277-41f26526fbdd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:55.613527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc0ea147-bb44-4756-a277-41f26526fbdd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:55.878177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:31:55.879365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:31:55.880438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:31:55.881073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:31:55.881713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:31:55.897623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:55.898847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:55.903358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:55.903358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:55.903358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:55.903358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:55.940522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc0ea147-bb44-4756-a277-41f26526fbdd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:55.959745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:31:55.974788 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dc0ea147-bb44-4756-a277-41f26526fbdd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.375844 Oct 11 04:31:55.993115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for user 752975bff6034a7086aafa3319a4f1d4 and project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:31:55.995672 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2232/4713] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:55 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:31:56.015205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4fa272bd-45da-4ee2-aaa1-9d1a03650f66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:56.021402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4fa272bd-45da-4ee2-aaa1-9d1a03650f66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:56.044943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fa272bd-45da-4ee2-aaa1-9d1a03650f66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:56.045436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fa272bd-45da-4ee2-aaa1-9d1a03650f66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:56.045876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fa272bd-45da-4ee2-aaa1-9d1a03650f66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:56.046664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fa272bd-45da-4ee2-aaa1-9d1a03650f66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:56.047111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fa272bd-45da-4ee2-aaa1-9d1a03650f66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:56.047537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fa272bd-45da-4ee2-aaa1-9d1a03650f66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:56.059523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:31:56.062007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:31:56.263040 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0d2113b1-58d8-41f3-91a7-bc43f2c5787c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.501756 Oct 11 04:31:56.266237 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2482/4714] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:31:54 2022] POST /compute/v2.1/servers => generated 406 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:31:56.278684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:56.280316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] [instance: 619f5d1a-728e-4d57-bdbe-b042aaca532f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:56.305182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:56.305775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:56.306303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:56.308705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:56.309929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:56.310610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:56.327775 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] HTTP exception thrown: Instance 619f5d1a-728e-4d57-bdbe-b042aaca532f could not be found. Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Request method failure captured: Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f HTTP/1.1 Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPGQXfahci_OW5GTAy2bS0Gcejw_RnGBwp4UBb1ECS9nZYQBHtoO5NxaulQtABcWBeK45I4UtPnSaCreRsum_qNr_b2fmHGYVIA-qSAdgPO00_27Q7gZpvVx1LGILkb_NtinhoBSb2m7XEkODKz7QJeuEScxGBy6MCYjN-0a8oqyDaY Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: b2389f8a4b62476f82bbf86884923c22 Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TenantUsagesTestJSON-993211570 Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b2389f8a4b62476f82bbf86884923c22"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b2389f8a4b62476f82bbf86884923c22"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2389f8a4b62476f82bbf86884923c22"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b2389f8a4b62476f82bbf86884923c22"}]}] Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TenantUsagesTestJSON-993211570 Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: b2389f8a4b62476f82bbf86884923c22 Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TenantUsagesTestJSON-993211570 Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TenantUsagesTestJSON-993211570-project Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: bac73092f41542fc9dc696dbdcbaa044 Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TenantUsagesTestJSON-993211570-project Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 619f5d1a-728e-4d57-bdbe-b042aaca532f could not be found. Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '619f5d1a-728e-4d57-bdbe-b042aaca532f'} Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 619f5d1a-728e-4d57-bdbe-b042aaca532f could not be found. Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 619f5d1a-728e-4d57-bdbe-b042aaca532f could not be found. Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:31:56.330138 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:56.334821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:31:56.334821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:31:56.334821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:31:56.334821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:31:56.334821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:31:56.334821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 619f5d1a-728e-4d57-bdbe-b042aaca532f could not be found. Oct 11 04:31:56.334821 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:31:56.336533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] Returning 404 to user: Instance 619f5d1a-728e-4d57-bdbe-b042aaca532f could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:31:56.337730 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0401c53f-317f-4ec9-b382-e0ab329d89a6 tempest-TenantUsagesTestJSON-993211570 tempest-TenantUsagesTestJSON-993211570-project] 10.222.0.26 "GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f" status: 404 len: 111 microversion: 2.1 time: 0.064486 Oct 11 04:31:56.338549 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2483/4715] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:56 2022] GET /compute/v2.1/servers/619f5d1a-728e-4d57-bdbe-b042aaca532f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:31:56.361974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9a4d6190-0bb2-4bf9-8de9-5bafc0f7b906 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:56.363847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9a4d6190-0bb2-4bf9-8de9-5bafc0f7b906 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:56.527120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9a4d6190-0bb2-4bf9-8de9-5bafc0f7b906 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:56.534676 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9a4d6190-0bb2-4bf9-8de9-5bafc0f7b906 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1249 microversion: 2.1 time: 0.194839 Oct 11 04:31:56.539574 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2484/4716] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:56 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1249 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:57.050684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4fa272bd-45da-4ee2-aaa1-9d1a03650f66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:57.068768 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4fa272bd-45da-4ee2-aaa1-9d1a03650f66 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 1.058458 Oct 11 04:31:57.071496 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2233/4717] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:56 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 1068 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:57.106056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0009ba42-efdb-49b9-8951-d4b14c1820f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:57.107228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0009ba42-efdb-49b9-8951-d4b14c1820f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:57.117484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0009ba42-efdb-49b9-8951-d4b14c1820f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:57.118893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0009ba42-efdb-49b9-8951-d4b14c1820f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:57.119535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0009ba42-efdb-49b9-8951-d4b14c1820f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:57.120451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0009ba42-efdb-49b9-8951-d4b14c1820f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:57.121280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0009ba42-efdb-49b9-8951-d4b14c1820f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:57.121873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0009ba42-efdb-49b9-8951-d4b14c1820f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:57.568682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb14d498-be04-47e3-8232-c19f9781527f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:57.569594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fb14d498-be04-47e3-8232-c19f9781527f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:57.671417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb14d498-be04-47e3-8232-c19f9781527f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:57.681409 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb14d498-be04-47e3-8232-c19f9781527f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1249 microversion: 2.1 time: 0.117785 Oct 11 04:31:57.684226 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2234/4718] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:57 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1249 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:57.865717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0009ba42-efdb-49b9-8951-d4b14c1820f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:57.875000 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0009ba42-efdb-49b9-8951-d4b14c1820f0 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.776699 Oct 11 04:31:57.889906 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2485/4719] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:57 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:57.905725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4284097d-2208-4ace-9995-f4db5103e9fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:57.906361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4284097d-2208-4ace-9995-f4db5103e9fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:57.916249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4284097d-2208-4ace-9995-f4db5103e9fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:57.917012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4284097d-2208-4ace-9995-f4db5103e9fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:57.917612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4284097d-2208-4ace-9995-f4db5103e9fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:57.918561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4284097d-2208-4ace-9995-f4db5103e9fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:57.919175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4284097d-2208-4ace-9995-f4db5103e9fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:57.919802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4284097d-2208-4ace-9995-f4db5103e9fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:58.034368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aa361fec-30b2-4836-bacd-cc437f2c5117 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6e18136-0ea3-409e-aa28-12679cda21e9"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:58.043851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aa361fec-30b2-4836-bacd-cc437f2c5117 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:58.063535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa361fec-30b2-4836-bacd-cc437f2c5117 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:58.064040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa361fec-30b2-4836-bacd-cc437f2c5117 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:58.064489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa361fec-30b2-4836-bacd-cc437f2c5117 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:58.072271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa361fec-30b2-4836-bacd-cc437f2c5117 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:58.073515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa361fec-30b2-4836-bacd-cc437f2c5117 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:58.073980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aa361fec-30b2-4836-bacd-cc437f2c5117 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:58.577361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4284097d-2208-4ace-9995-f4db5103e9fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:58.587734 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4284097d-2208-4ace-9995-f4db5103e9fd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.687523 Oct 11 04:31:58.605059 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2235/4720] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:57 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:58.632392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-854bb6f8-bf5d-4725-97bc-0465aa3d9889 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:58.632921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-854bb6f8-bf5d-4725-97bc-0465aa3d9889 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:58.647788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-854bb6f8-bf5d-4725-97bc-0465aa3d9889 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:58.648309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-854bb6f8-bf5d-4725-97bc-0465aa3d9889 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:58.653055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-854bb6f8-bf5d-4725-97bc-0465aa3d9889 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:58.655047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-854bb6f8-bf5d-4725-97bc-0465aa3d9889 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:58.656076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-854bb6f8-bf5d-4725-97bc-0465aa3d9889 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:58.656505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-854bb6f8-bf5d-4725-97bc-0465aa3d9889 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:59.002971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-854bb6f8-bf5d-4725-97bc-0465aa3d9889 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:59.024440 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-854bb6f8-bf5d-4725-97bc-0465aa3d9889 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.397130 Oct 11 04:31:59.025893 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2236/4721] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:58 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:59.036301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-268e810c-1424-4ed8-af44-d85f2c4b926d tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:59.038040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-268e810c-1424-4ed8-af44-d85f2c4b926d tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:59.048262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268e810c-1424-4ed8-af44-d85f2c4b926d tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:59.048997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268e810c-1424-4ed8-af44-d85f2c4b926d tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:59.049605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268e810c-1424-4ed8-af44-d85f2c4b926d tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:59.051014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268e810c-1424-4ed8-af44-d85f2c4b926d tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:59.052443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268e810c-1424-4ed8-af44-d85f2c4b926d tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:59.059218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-268e810c-1424-4ed8-af44-d85f2c4b926d tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:59.166841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-268e810c-1424-4ed8-af44-d85f2c4b926d tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:31:59.192759 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-268e810c-1424-4ed8-af44-d85f2c4b926d tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1245 microversion: 2.1 time: 0.164586 Oct 11 04:31:59.193684 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2237/4722] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:59 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1245 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:31:59.200118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69955194-fff4-4c4b-a295-12002cf9053e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:31:59.200694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69955194-fff4-4c4b-a295-12002cf9053e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:59.206743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69955194-fff4-4c4b-a295-12002cf9053e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:59.207224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69955194-fff4-4c4b-a295-12002cf9053e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:59.208440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69955194-fff4-4c4b-a295-12002cf9053e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:59.209293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69955194-fff4-4c4b-a295-12002cf9053e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:59.209939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69955194-fff4-4c4b-a295-12002cf9053e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:59.210689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69955194-fff4-4c4b-a295-12002cf9053e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:59.260050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-69955194-fff4-4c4b-a295-12002cf9053e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lazy-loading 'flavor' on Instance uuid d32f0ab1-346d-487a-aa08-ebd1656142a7 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:31:59.273148 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aa361fec-30b2-4836-bacd-cc437f2c5117 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "POST /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.244507 Oct 11 04:31:59.274512 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2486/4723] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:31:58 2022] POST /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/os-volume_attachments => generated 194 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:31:59.316682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:31:59.785023 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69955194-fff4-4c4b-a295-12002cf9053e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.585110 Oct 11 04:31:59.787664 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2238/4724] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:31:59 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:31:59.796509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0238648c-ad07-4ebf-acab-13f067a3e37c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:31:59.797454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0238648c-ad07-4ebf-acab-13f067a3e37c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:31:59.812842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0238648c-ad07-4ebf-acab-13f067a3e37c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:59.814779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0238648c-ad07-4ebf-acab-13f067a3e37c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:59.816693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0238648c-ad07-4ebf-acab-13f067a3e37c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:31:59.819589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0238648c-ad07-4ebf-acab-13f067a3e37c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:31:59.820090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0238648c-ad07-4ebf-acab-13f067a3e37c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:31:59.823749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0238648c-ad07-4ebf-acab-13f067a3e37c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:00.069464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0238648c-ad07-4ebf-acab-13f067a3e37c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:00.081464 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0238648c-ad07-4ebf-acab-13f067a3e37c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1676 microversion: 2.1 time: 0.287604 Oct 11 04:32:00.083788 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2487/4725] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:31:59 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1676 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:00.220576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd495295-718c-4546-841e-2bf00bfe3cd5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:00.221334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd495295-718c-4546-841e-2bf00bfe3cd5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:00.248787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd495295-718c-4546-841e-2bf00bfe3cd5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:00.250023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd495295-718c-4546-841e-2bf00bfe3cd5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:00.250743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd495295-718c-4546-841e-2bf00bfe3cd5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:00.252952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd495295-718c-4546-841e-2bf00bfe3cd5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:00.254944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd495295-718c-4546-841e-2bf00bfe3cd5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:00.256503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd495295-718c-4546-841e-2bf00bfe3cd5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:00.731164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd495295-718c-4546-841e-2bf00bfe3cd5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:00.750140 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd495295-718c-4546-841e-2bf00bfe3cd5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1309 microversion: 2.1 time: 0.535052 Oct 11 04:32:00.753524 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2239/4726] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:00 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1309 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:01.113810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9100aa9d-3bf4-4fd5-be41-9aca760001bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:01.115178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9100aa9d-3bf4-4fd5-be41-9aca760001bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:01.129256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9100aa9d-3bf4-4fd5-be41-9aca760001bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:01.134915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9100aa9d-3bf4-4fd5-be41-9aca760001bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:01.135601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9100aa9d-3bf4-4fd5-be41-9aca760001bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:01.136897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9100aa9d-3bf4-4fd5-be41-9aca760001bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:01.137568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9100aa9d-3bf4-4fd5-be41-9aca760001bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:01.138172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9100aa9d-3bf4-4fd5-be41-9aca760001bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:01.448125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9100aa9d-3bf4-4fd5-be41-9aca760001bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:01.456537 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9100aa9d-3bf4-4fd5-be41-9aca760001bc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1659 microversion: 2.1 time: 0.346945 Oct 11 04:32:01.461914 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2488/4727] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:01 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1659 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:01.488467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f427eac-e79c-4b25-ab8e-a6ca378b7859 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:01.489016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f427eac-e79c-4b25-ab8e-a6ca378b7859 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:01.503129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f427eac-e79c-4b25-ab8e-a6ca378b7859 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:01.503882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f427eac-e79c-4b25-ab8e-a6ca378b7859 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:01.504486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f427eac-e79c-4b25-ab8e-a6ca378b7859 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:01.505367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f427eac-e79c-4b25-ab8e-a6ca378b7859 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:01.505981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f427eac-e79c-4b25-ab8e-a6ca378b7859 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:01.507127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f427eac-e79c-4b25-ab8e-a6ca378b7859 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:01.766823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerBasicOps-server-1136421811", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "key_name": "tempest-TestServerBasicOps-792414490", "security_groups": [{"name": "tempest-secgroup-smoke-1879029610"}], "config_drive": true, "metadata": {"meta1": "data1", "meta2": "data2", "metaN": "dataN"}, "networks": [{"uuid": "4b209799-9944-47cf-a31d-ceba9c721495"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:01.989578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] validate_networks() for [('4b209799-9944-47cf-a31d-ceba9c721495', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:32:02.016174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:02.318700 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f427eac-e79c-4b25-ab8e-a6ca378b7859 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action" status: 202 len: 0 microversion: 2.1 time: 0.834984 Oct 11 04:32:02.323968 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2240/4728] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:32:01 2022] POST /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7/action => generated 0 bytes in 838 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:32:02.351578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f2bcc57e-8eed-4cf6-adad-fb3618c93574 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:02.352507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f2bcc57e-8eed-4cf6-adad-fb3618c93574 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:02.384627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2bcc57e-8eed-4cf6-adad-fb3618c93574 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:02.391939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2bcc57e-8eed-4cf6-adad-fb3618c93574 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:02.395387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2bcc57e-8eed-4cf6-adad-fb3618c93574 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:02.411738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2bcc57e-8eed-4cf6-adad-fb3618c93574 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:02.423645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2bcc57e-8eed-4cf6-adad-fb3618c93574 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:02.425351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2bcc57e-8eed-4cf6-adad-fb3618c93574 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:02.931803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f2bcc57e-8eed-4cf6-adad-fb3618c93574 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:02.945748 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f2bcc57e-8eed-4cf6-adad-fb3618c93574 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1375 microversion: 2.1 time: 0.617903 Oct 11 04:32:02.959774 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2241/4729] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:02 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1375 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:02.969393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c56d70de-e703-4b20-b98b-9f7ce7085400 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:02.971100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c56d70de-e703-4b20-b98b-9f7ce7085400 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:02.979226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56d70de-e703-4b20-b98b-9f7ce7085400 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:02.980828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56d70de-e703-4b20-b98b-9f7ce7085400 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:02.981557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56d70de-e703-4b20-b98b-9f7ce7085400 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:02.982886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56d70de-e703-4b20-b98b-9f7ce7085400 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:02.983663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56d70de-e703-4b20-b98b-9f7ce7085400 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:02.984312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c56d70de-e703-4b20-b98b-9f7ce7085400 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:03.032198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Getting quotas for project 4df950b23b29437d9b2a30ec4a33fc3a. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:03.051457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Getting quotas for user 29ef277265894627961369a52d81f493 and project 4df950b23b29437d9b2a30ec4a33fc3a. Resources: dict_keys(['metadata_items']) {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:32:03.071403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:32:03.072173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:32:03.076512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:32:03.077479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:32:03.078253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:32:03.089182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:03.089966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:03.090693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:03.091692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:03.093135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:03.093811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:03.116440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Getting quotas for project 4df950b23b29437d9b2a30ec4a33fc3a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:03.124340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Getting quotas for user 29ef277265894627961369a52d81f493 and project 4df950b23b29437d9b2a30ec4a33fc3a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:32:03.143795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:32:03.147060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:32:03.308135 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af889eff-cff4-4763-a02b-697fdbdfb63f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.544976 Oct 11 04:32:03.318149 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2489/4730] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:32:01 2022] POST /compute/v2.1/servers => generated 406 bytes in 1556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:32:03.327327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c330914-1867-479e-80eb-d7950c5ef107 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:03.329201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6c330914-1867-479e-80eb-d7950c5ef107 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:03.335769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c56d70de-e703-4b20-b98b-9f7ce7085400 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:03.375065 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c56d70de-e703-4b20-b98b-9f7ce7085400 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1665 microversion: 2.1 time: 0.395267 Oct 11 04:32:03.377829 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2242/4731] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:02 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1665 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:03.507460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6c330914-1867-479e-80eb-d7950c5ef107 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:03.518329 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6c330914-1867-479e-80eb-d7950c5ef107 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1302 microversion: 2.1 time: 0.198227 Oct 11 04:32:03.524492 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2490/4732] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:03 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1302 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:03.980532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3b59d799-9033-40d6-91e4-82475d5ff74f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:03.981475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3b59d799-9033-40d6-91e4-82475d5ff74f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:03.993050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b59d799-9033-40d6-91e4-82475d5ff74f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:03.993570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b59d799-9033-40d6-91e4-82475d5ff74f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:03.994688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b59d799-9033-40d6-91e4-82475d5ff74f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:03.994806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b59d799-9033-40d6-91e4-82475d5ff74f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:03.995230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b59d799-9033-40d6-91e4-82475d5ff74f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:03.995651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b59d799-9033-40d6-91e4-82475d5ff74f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:04.290920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3b59d799-9033-40d6-91e4-82475d5ff74f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:04.299285 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3b59d799-9033-40d6-91e4-82475d5ff74f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1375 microversion: 2.1 time: 0.325039 Oct 11 04:32:04.300285 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2243/4733] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:03 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1375 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:04.405387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-997ff8f8-cdc3-421e-bbd4-9ee4ca461206 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:04.405387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-997ff8f8-cdc3-421e-bbd4-9ee4ca461206 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:04.411778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997ff8f8-cdc3-421e-bbd4-9ee4ca461206 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:04.412266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997ff8f8-cdc3-421e-bbd4-9ee4ca461206 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:04.412869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997ff8f8-cdc3-421e-bbd4-9ee4ca461206 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:04.413645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997ff8f8-cdc3-421e-bbd4-9ee4ca461206 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:04.414093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997ff8f8-cdc3-421e-bbd4-9ee4ca461206 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:04.414560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997ff8f8-cdc3-421e-bbd4-9ee4ca461206 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:04.489591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-4cfc7312-324e-4504-abe9-e6484f129ccb req-c234f49a-17dd-4451-ace9-c7fd10fb3db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24168887-732a-4aa1-b723-e789feed3002", "tag": "0b4de9d4-3966-4f60-a837-066bba5af6b5"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:04.500344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4cfc7312-324e-4504-abe9-e6484f129ccb req-c234f49a-17dd-4451-ace9-c7fd10fb3db8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:04.501150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4cfc7312-324e-4504-abe9-e6484f129ccb req-c234f49a-17dd-4451-ace9-c7fd10fb3db8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:04.501752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4cfc7312-324e-4504-abe9-e6484f129ccb req-c234f49a-17dd-4451-ace9-c7fd10fb3db8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:04.533751 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-4cfc7312-324e-4504-abe9-e6484f129ccb req-c234f49a-17dd-4451-ace9-c7fd10fb3db8 service nova] Creating event network-changed:0b4de9d4-3966-4f60-a837-066bba5af6b5 for instance 24168887-732a-4aa1-b723-e789feed3002 on n-h1-860892-1 Oct 11 04:32:04.544423 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-4cfc7312-324e-4504-abe9-e6484f129ccb req-c234f49a-17dd-4451-ace9-c7fd10fb3db8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058143 Oct 11 04:32:04.545337 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2244/4734] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:04.565194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fa114414-e828-4ed9-827a-f721f48ad159 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:04.565194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fa114414-e828-4ed9-827a-f721f48ad159 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:04.638771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-997ff8f8-cdc3-421e-bbd4-9ee4ca461206 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:04.673144 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-997ff8f8-cdc3-421e-bbd4-9ee4ca461206 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1665 microversion: 2.1 time: 0.271619 Oct 11 04:32:04.674631 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2491/4735] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:04 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1665 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:04.678526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa114414-e828-4ed9-827a-f721f48ad159 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:04.685499 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fa114414-e828-4ed9-827a-f721f48ad159 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1302 microversion: 2.1 time: 0.125946 Oct 11 04:32:04.691431 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2245/4736] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:04 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1302 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:05.324197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c7463f03-0542-4e03-a4fb-a6e275f357b1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:05.325257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c7463f03-0542-4e03-a4fb-a6e275f357b1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:05.339157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7463f03-0542-4e03-a4fb-a6e275f357b1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:05.339157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7463f03-0542-4e03-a4fb-a6e275f357b1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:05.339157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7463f03-0542-4e03-a4fb-a6e275f357b1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:05.339157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7463f03-0542-4e03-a4fb-a6e275f357b1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:05.339157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7463f03-0542-4e03-a4fb-a6e275f357b1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:05.342571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7463f03-0542-4e03-a4fb-a6e275f357b1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:05.678137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c7463f03-0542-4e03-a4fb-a6e275f357b1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:05.692480 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c7463f03-0542-4e03-a4fb-a6e275f357b1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1375 microversion: 2.1 time: 0.373488 Oct 11 04:32:05.693531 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2492/4737] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:05 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1375 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:05.705664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2e7705b3-c04a-4add-b53f-e8ff838633dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:05.706928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2e7705b3-c04a-4add-b53f-e8ff838633dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:05.722997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-86d65673-ba3d-421d-8993-f89ad49e9d7c tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:05.723291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e7705b3-c04a-4add-b53f-e8ff838633dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:05.723603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-86d65673-ba3d-421d-8993-f89ad49e9d7c tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:05.723785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e7705b3-c04a-4add-b53f-e8ff838633dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:05.737540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e7705b3-c04a-4add-b53f-e8ff838633dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:05.737707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86d65673-ba3d-421d-8993-f89ad49e9d7c tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:05.737707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86d65673-ba3d-421d-8993-f89ad49e9d7c tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:05.737707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86d65673-ba3d-421d-8993-f89ad49e9d7c tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:05.738149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86d65673-ba3d-421d-8993-f89ad49e9d7c tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:05.738706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e7705b3-c04a-4add-b53f-e8ff838633dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:05.739193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e7705b3-c04a-4add-b53f-e8ff838633dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:05.739634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e7705b3-c04a-4add-b53f-e8ff838633dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:05.742508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86d65673-ba3d-421d-8993-f89ad49e9d7c tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:05.742955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86d65673-ba3d-421d-8993-f89ad49e9d7c tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:05.931717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-86d65673-ba3d-421d-8993-f89ad49e9d7c tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:05.946500 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-86d65673-ba3d-421d-8993-f89ad49e9d7c tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1354 microversion: 2.1 time: 0.227624 Oct 11 04:32:05.947374 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2493/4738] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:05 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1354 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:06.032156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2e7705b3-c04a-4add-b53f-e8ff838633dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:06.047187 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2e7705b3-c04a-4add-b53f-e8ff838633dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.345361 Oct 11 04:32:06.061717 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2246/4739] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:05 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:06.077689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b3df096f-1ce8-404a-ad2c-595f5c71d0dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:06.078485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b3df096f-1ce8-404a-ad2c-595f5c71d0dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:06.087235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3df096f-1ce8-404a-ad2c-595f5c71d0dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:06.087235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3df096f-1ce8-404a-ad2c-595f5c71d0dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:06.087443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3df096f-1ce8-404a-ad2c-595f5c71d0dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:06.088733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3df096f-1ce8-404a-ad2c-595f5c71d0dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:06.089269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3df096f-1ce8-404a-ad2c-595f5c71d0dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:06.089757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3df096f-1ce8-404a-ad2c-595f5c71d0dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:06.368165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-992f07d0-bf63-4980-8cc8-f9de00994c0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "85356c7f-4333-4881-bea9-1fca4fe845cf"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:06.373112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-992f07d0-bf63-4980-8cc8-f9de00994c0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:06.384919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992f07d0-bf63-4980-8cc8-f9de00994c0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:06.385843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992f07d0-bf63-4980-8cc8-f9de00994c0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:06.386567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992f07d0-bf63-4980-8cc8-f9de00994c0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:06.387603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992f07d0-bf63-4980-8cc8-f9de00994c0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:06.388246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992f07d0-bf63-4980-8cc8-f9de00994c0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:06.388858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-992f07d0-bf63-4980-8cc8-f9de00994c0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:06.795949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b3df096f-1ce8-404a-ad2c-595f5c71d0dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:06.809360 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b3df096f-1ce8-404a-ad2c-595f5c71d0dd tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1668 microversion: 2.1 time: 0.738205 Oct 11 04:32:06.810578 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2494/4740] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:06 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1668 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:06.815521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fed60f4c-ba32-4357-b76b-a61f4f02ff9b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:06.816135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fed60f4c-ba32-4357-b76b-a61f4f02ff9b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:06.823797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fed60f4c-ba32-4357-b76b-a61f4f02ff9b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:06.824304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fed60f4c-ba32-4357-b76b-a61f4f02ff9b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:06.825177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fed60f4c-ba32-4357-b76b-a61f4f02ff9b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:06.835220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fed60f4c-ba32-4357-b76b-a61f4f02ff9b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:06.835220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fed60f4c-ba32-4357-b76b-a61f4f02ff9b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:06.835220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fed60f4c-ba32-4357-b76b-a61f4f02ff9b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:07.161794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fed60f4c-ba32-4357-b76b-a61f4f02ff9b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:07.169902 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fed60f4c-ba32-4357-b76b-a61f4f02ff9b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1375 microversion: 2.1 time: 0.358258 Oct 11 04:32:07.170494 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2495/4741] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:06 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1375 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:07.175324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:07.175819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:07.182092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:07.182840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:07.183224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:07.183919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:07.184376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:07.184813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:07.210300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:32:07.216532 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.api [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Working on deleting snapshot fe3967ef-3c8c-45e4-8ddd-0a1e7c714839 from shelved instance... Oct 11 04:32:07.323427 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-992f07d0-bf63-4980-8cc8-f9de00994c0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.963971 Oct 11 04:32:07.325290 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2247/4742] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:32:06 2022] POST /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments => generated 194 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:07.327821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-992f07d0-bf63-4980-8cc8-f9de00994c0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:07.329230 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-992f07d0-bf63-4980-8cc8-f9de00994c0d tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute//" status: 200 len: 377 microversion: - time: 0.001776 Oct 11 04:32:07.332880 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2248/4743] 10.222.0.26 () {56 vars in 886 bytes} [Tue Oct 11 04:32:07 2022] GET /compute/ => generated 377 bytes in 7 msecs (HTTP/1.1 200) 3 headers in 91 bytes (1 switches on core 0) Oct 11 04:32:07.346114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4bcddd35-f272-4f47-934e-45207f4d690b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:07.347234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4bcddd35-f272-4f47-934e-45207f4d690b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:07.362041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bcddd35-f272-4f47-934e-45207f4d690b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:07.364047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bcddd35-f272-4f47-934e-45207f4d690b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:07.364832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bcddd35-f272-4f47-934e-45207f4d690b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:07.367761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bcddd35-f272-4f47-934e-45207f4d690b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:07.368325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bcddd35-f272-4f47-934e-45207f4d690b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:07.369225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bcddd35-f272-4f47-934e-45207f4d690b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:07.535506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4bcddd35-f272-4f47-934e-45207f4d690b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:07.544540 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4bcddd35-f272-4f47-934e-45207f4d690b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1360 microversion: 2.1 time: 0.210386 Oct 11 04:32:07.554575 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2249/4744] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:07 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1360 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:08.193062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d33eff09-f5d9-40f1-b0f4-d4e137150731 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:08.193674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d33eff09-f5d9-40f1-b0f4-d4e137150731 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:08.201603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d33eff09-f5d9-40f1-b0f4-d4e137150731 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:08.202090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d33eff09-f5d9-40f1-b0f4-d4e137150731 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:08.202548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d33eff09-f5d9-40f1-b0f4-d4e137150731 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:08.203242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d33eff09-f5d9-40f1-b0f4-d4e137150731 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:08.203693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d33eff09-f5d9-40f1-b0f4-d4e137150731 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:08.204112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d33eff09-f5d9-40f1-b0f4-d4e137150731 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:09.048109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d33eff09-f5d9-40f1-b0f4-d4e137150731 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:09.066020 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d33eff09-f5d9-40f1-b0f4-d4e137150731 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1375 microversion: 2.1 time: 0.876820 Oct 11 04:32:09.066646 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2250/4745] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:08 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1375 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:09.072446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-74b18b50-3f50-44ca-895d-952e1adf4846 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:09.073942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-74b18b50-3f50-44ca-895d-952e1adf4846 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:09.091388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:09.092927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74b18b50-3f50-44ca-895d-952e1adf4846 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:09.093428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74b18b50-3f50-44ca-895d-952e1adf4846 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:09.093872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74b18b50-3f50-44ca-895d-952e1adf4846 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:09.094600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74b18b50-3f50-44ca-895d-952e1adf4846 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:09.095227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74b18b50-3f50-44ca-895d-952e1adf4846 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:09.095884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74b18b50-3f50-44ca-895d-952e1adf4846 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:09.144202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Doing local delete in cell 7f919055-bb4c-4077-93f0-960b402ab88d(cell1) {{(pid=120994) _delete /opt/stack/nova/nova/compute/api.py:2546}} Oct 11 04:32:09.148544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:09.149052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:09.149498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:09.149933 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.api [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] instance is in SHELVED_OFFLOADED state, cleanup the instance's info from database. Oct 11 04:32:09.159947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] deallocate_for_instance() {{(pid=120994) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1780}} Oct 11 04:32:09.526720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-74b18b50-3f50-44ca-895d-952e1adf4846 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:09.557438 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-74b18b50-3f50-44ca-895d-952e1adf4846 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1428 microversion: 2.1 time: 0.489141 Oct 11 04:32:09.562858 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2251/4746] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:09 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1428 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:10.091115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7450ce4e-2e37-45e6-98e4-60bb65c7f0ff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:10.092061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7450ce4e-2e37-45e6-98e4-60bb65c7f0ff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:10.107444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7450ce4e-2e37-45e6-98e4-60bb65c7f0ff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:10.108486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7450ce4e-2e37-45e6-98e4-60bb65c7f0ff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:10.109763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7450ce4e-2e37-45e6-98e4-60bb65c7f0ff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:10.113402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7450ce4e-2e37-45e6-98e4-60bb65c7f0ff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:10.113402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7450ce4e-2e37-45e6-98e4-60bb65c7f0ff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:10.113402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7450ce4e-2e37-45e6-98e4-60bb65c7f0ff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:10.819005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Updating instance_info_cache with network_info: [] {{(pid=120994) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}} Oct 11 04:32:11.165524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7450ce4e-2e37-45e6-98e4-60bb65c7f0ff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:11.179929 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7450ce4e-2e37-45e6-98e4-60bb65c7f0ff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1375 microversion: 2.1 time: 1.089699 Oct 11 04:32:11.183557 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2252/4747] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:10 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1375 bytes in 1097 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:11.768600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:11.932823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-0fdeba60-b390-4ac9-857f-7b6ad451dedd req-5191eb23-648f-4352-950e-5b7ef9d07336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f249f1b-29b6-41f0-9917-551729acc982", "tag": "6c0f99dc-4582-45a3-bdba-f7254fbe6fb8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:11.947454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=7,nova_cell1:INSERT=1,nova_cell1:SAVEPOINT=1,nova_cell1:RELEASE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:11.966155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0fdeba60-b390-4ac9-857f-7b6ad451dedd req-5191eb23-648f-4352-950e-5b7ef9d07336 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:11.966661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0fdeba60-b390-4ac9-857f-7b6ad451dedd req-5191eb23-648f-4352-950e-5b7ef9d07336 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:11.967101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0fdeba60-b390-4ac9-857f-7b6ad451dedd req-5191eb23-648f-4352-950e-5b7ef9d07336 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:11.988706 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-0fdeba60-b390-4ac9-857f-7b6ad451dedd req-5191eb23-648f-4352-950e-5b7ef9d07336 service nova] Creating event network-changed:6c0f99dc-4582-45a3-bdba-f7254fbe6fb8 for instance 6f249f1b-29b6-41f0-9917-551729acc982 on n-h2-860892-1 Oct 11 04:32:11.998975 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-0fdeba60-b390-4ac9-857f-7b6ad451dedd req-5191eb23-648f-4352-950e-5b7ef9d07336 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.813864 Oct 11 04:32:11.999938 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2253/4748] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:12.013766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bb1a8ab7-0c79-42ee-a347-dd55cd377389 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:12.016229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bb1a8ab7-0c79-42ee-a347-dd55cd377389 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:12.024638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb1a8ab7-0c79-42ee-a347-dd55cd377389 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:12.025363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb1a8ab7-0c79-42ee-a347-dd55cd377389 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:12.025884 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e3166db-ac9b-4e70-a1b4-a10b717098dc tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 204 len: 0 microversion: 2.1 time: 4.854221 Oct 11 04:32:12.027865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb1a8ab7-0c79-42ee-a347-dd55cd377389 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:12.027981 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2496/4749] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:32:07 2022] DELETE /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 0 bytes in 4856 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:32:12.028062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb1a8ab7-0c79-42ee-a347-dd55cd377389 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:12.028062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb1a8ab7-0c79-42ee-a347-dd55cd377389 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:12.028062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb1a8ab7-0c79-42ee-a347-dd55cd377389 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:12.035253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:12.036359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d3308eac-14b8-4148-96ef-d0794593fb30] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:12.052497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:12.056658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:12.057230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:12.059176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:12.061510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:12.063758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:12.092672 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] HTTP exception thrown: Instance d3308eac-14b8-4148-96ef-d0794593fb30 could not be found. Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Request method failure captured: Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 HTTP/1.1 Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO_RCh7y3VCR0ZGCz57mMkPYBNk7QiIVp9XuBnd-Uehf82A4vup9lXbNXCqWQjVjFhMOhYa9RyLqNtdWCz0WKBx8po-RawVJL-JciajTijLf7lVKUU9Uul6vpelbjCSaCgmT83upn5D4faXHmtAf4nXZcwDOtKbLho_1_PIpYNLAs5s Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a2974866e964ca2864c978d2270bd77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}] Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5feceb4a60434064a4fd08f7cc637f32 Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance d3308eac-14b8-4148-96ef-d0794593fb30 could not be found. Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'd3308eac-14b8-4148-96ef-d0794593fb30'} Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3308eac-14b8-4148-96ef-d0794593fb30 could not be found. Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3308eac-14b8-4148-96ef-d0794593fb30 could not be found. Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:12.094850 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:12.098622 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:12.098622 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:12.098622 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:12.098622 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:12.098622 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:12.098622 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3308eac-14b8-4148-96ef-d0794593fb30 could not be found. Oct 11 04:32:12.098622 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:12.098622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Returning 404 to user: Instance d3308eac-14b8-4148-96ef-d0794593fb30 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:12.099300 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fb6b3495-01da-4b7e-a86a-e69f5d2c9185 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30" status: 404 len: 111 microversion: 2.1 time: 0.068603 Oct 11 04:32:12.104199 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2497/4750] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:12 2022] GET /compute/v2.1/servers/d3308eac-14b8-4148-96ef-d0794593fb30 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:32:12.113905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2af78f8e-5152-4044-8bb3-7d7fff56e26a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:12.115742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2af78f8e-5152-4044-8bb3-7d7fff56e26a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:12.123556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2af78f8e-5152-4044-8bb3-7d7fff56e26a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:12.124350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2af78f8e-5152-4044-8bb3-7d7fff56e26a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:12.125152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2af78f8e-5152-4044-8bb3-7d7fff56e26a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:12.126120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2af78f8e-5152-4044-8bb3-7d7fff56e26a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:12.126802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2af78f8e-5152-4044-8bb3-7d7fff56e26a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:12.127481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2af78f8e-5152-4044-8bb3-7d7fff56e26a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:12.191174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2af78f8e-5152-4044-8bb3-7d7fff56e26a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:32:12.453343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb1a8ab7-0c79-42ee-a347-dd55cd377389 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:12.467431 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bb1a8ab7-0c79-42ee-a347-dd55cd377389 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1428 microversion: 2.1 time: 0.466053 Oct 11 04:32:12.468690 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2254/4751] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:11 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1428 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:12.478222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cef2386c-d0b4-4451-af67-dd30febe23c5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:12.479067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cef2386c-d0b4-4451-af67-dd30febe23c5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:12.555477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cef2386c-d0b4-4451-af67-dd30febe23c5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:12.555477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cef2386c-d0b4-4451-af67-dd30febe23c5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:12.555477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cef2386c-d0b4-4451-af67-dd30febe23c5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:12.555477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cef2386c-d0b4-4451-af67-dd30febe23c5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:12.555477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cef2386c-d0b4-4451-af67-dd30febe23c5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:12.555477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cef2386c-d0b4-4451-af67-dd30febe23c5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:12.678594 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2af78f8e-5152-4044-8bb3-7d7fff56e26a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 204 len: 0 microversion: 2.1 time: 0.572469 Oct 11 04:32:12.679501 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2498/4752] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:32:12 2022] DELETE /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:32:12.690048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d316953d-148f-4a78-97da-9d906aec3c5a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:12.690803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d316953d-148f-4a78-97da-9d906aec3c5a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:12.707197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d316953d-148f-4a78-97da-9d906aec3c5a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:12.707695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d316953d-148f-4a78-97da-9d906aec3c5a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:12.708132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d316953d-148f-4a78-97da-9d906aec3c5a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:12.708874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d316953d-148f-4a78-97da-9d906aec3c5a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:12.709337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d316953d-148f-4a78-97da-9d906aec3c5a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:12.710348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d316953d-148f-4a78-97da-9d906aec3c5a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:13.014802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d316953d-148f-4a78-97da-9d906aec3c5a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:13.025595 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d316953d-148f-4a78-97da-9d906aec3c5a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1465 microversion: 2.1 time: 0.340986 Oct 11 04:32:13.029409 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2499/4753] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:12 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1465 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:13.495998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cac42e3e-4e8c-4aaa-a11b-055db4923d24 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:13.496670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cac42e3e-4e8c-4aaa-a11b-055db4923d24 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:13.500257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:13.516960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=24 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:13.521861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac42e3e-4e8c-4aaa-a11b-055db4923d24 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:13.522454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac42e3e-4e8c-4aaa-a11b-055db4923d24 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:13.522900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac42e3e-4e8c-4aaa-a11b-055db4923d24 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:13.523619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac42e3e-4e8c-4aaa-a11b-055db4923d24 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:13.530903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac42e3e-4e8c-4aaa-a11b-055db4923d24 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:13.531367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cac42e3e-4e8c-4aaa-a11b-055db4923d24 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:13.875504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cac42e3e-4e8c-4aaa-a11b-055db4923d24 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:13.904577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cef2386c-d0b4-4451-af67-dd30febe23c5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:13.919143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cac42e3e-4e8c-4aaa-a11b-055db4923d24 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1428 microversion: 2.1 time: 0.395221 Oct 11 04:32:13.923052 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2500/4754] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:13 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1428 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:13.923728 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cef2386c-d0b4-4451-af67-dd30febe23c5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1375 microversion: 2.1 time: 1.449057 Oct 11 04:32:13.924836 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2255/4755] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:12 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1375 bytes in 1456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:14.035418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b702a613-acbf-40fc-82b1-7ab2ecbaa3c6 req-2dba79f5-348e-454b-8a05-2ad653af1221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3308eac-14b8-4148-96ef-d0794593fb30", "name": "network-vif-deleted", "tag": "296d8dde-1afc-4a75-b185-9efbe9173586"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:14.061015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b8de0a39-abf7-4daf-863a-fe7af14e2f14 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:14.062576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b8de0a39-abf7-4daf-863a-fe7af14e2f14 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:14.085689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b702a613-acbf-40fc-82b1-7ab2ecbaa3c6 req-2dba79f5-348e-454b-8a05-2ad653af1221 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:14.087050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b702a613-acbf-40fc-82b1-7ab2ecbaa3c6 req-2dba79f5-348e-454b-8a05-2ad653af1221 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:14.087525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b702a613-acbf-40fc-82b1-7ab2ecbaa3c6 req-2dba79f5-348e-454b-8a05-2ad653af1221 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:14.091848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8de0a39-abf7-4daf-863a-fe7af14e2f14 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:14.098396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8de0a39-abf7-4daf-863a-fe7af14e2f14 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:14.099216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8de0a39-abf7-4daf-863a-fe7af14e2f14 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:14.104946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8de0a39-abf7-4daf-863a-fe7af14e2f14 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:14.107534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8de0a39-abf7-4daf-863a-fe7af14e2f14 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:14.108247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8de0a39-abf7-4daf-863a-fe7af14e2f14 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:14.173835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.compute.server_external_events [req-b702a613-acbf-40fc-82b1-7ab2ecbaa3c6 req-2dba79f5-348e-454b-8a05-2ad653af1221 service nova] Unable to find a host for instance d3308eac-14b8-4148-96ef-d0794593fb30. Dropping event network-vif-deleted {{(pid=120994) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 04:32:14.190409 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b702a613-acbf-40fc-82b1-7ab2ecbaa3c6 req-2dba79f5-348e-454b-8a05-2ad653af1221 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 180 microversion: 2.1 time: 0.153954 Oct 11 04:32:14.192855 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2501/4756] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:14 2022] POST /compute/v2.1/os-server-external-events => generated 180 bytes in 164 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 04:32:14.562837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b8de0a39-abf7-4daf-863a-fe7af14e2f14 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:14.571519 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b8de0a39-abf7-4daf-863a-fe7af14e2f14 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1465 microversion: 2.1 time: 0.516304 Oct 11 04:32:14.590799 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2256/4757] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:14 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1465 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:14.965747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f16cd89c-9bb8-4e00-bcbd-a711c26af1a6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:14.968542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f16cd89c-9bb8-4e00-bcbd-a711c26af1a6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:14.968947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb9f2a69-d5d0-4c21-b61b-7550585d081c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:14.976437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb9f2a69-d5d0-4c21-b61b-7550585d081c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:14.988418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:14.990009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f16cd89c-9bb8-4e00-bcbd-a711c26af1a6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:15.000445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f16cd89c-9bb8-4e00-bcbd-a711c26af1a6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:15.003315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f16cd89c-9bb8-4e00-bcbd-a711c26af1a6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:15.005107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9f2a69-d5d0-4c21-b61b-7550585d081c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:15.005107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9f2a69-d5d0-4c21-b61b-7550585d081c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:15.008602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f16cd89c-9bb8-4e00-bcbd-a711c26af1a6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:15.011697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f16cd89c-9bb8-4e00-bcbd-a711c26af1a6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:15.015822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9f2a69-d5d0-4c21-b61b-7550585d081c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:15.017083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9f2a69-d5d0-4c21-b61b-7550585d081c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:15.017796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f16cd89c-9bb8-4e00-bcbd-a711c26af1a6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:15.025694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9f2a69-d5d0-4c21-b61b-7550585d081c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:15.026422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb9f2a69-d5d0-4c21-b61b-7550585d081c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:15.633665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f16cd89c-9bb8-4e00-bcbd-a711c26af1a6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:15.650814 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f16cd89c-9bb8-4e00-bcbd-a711c26af1a6 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1428 microversion: 2.1 time: 0.692761 Oct 11 04:32:15.670725 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2257/4758] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:14 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1428 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:15.678858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bd0d3cc4-0834-4cfd-a278-34d1caeeee0b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:15.686999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd0d3cc4-0834-4cfd-a278-34d1caeeee0b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:15.687745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd0d3cc4-0834-4cfd-a278-34d1caeeee0b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:15.689190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd0d3cc4-0834-4cfd-a278-34d1caeeee0b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:15.695273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:15.697440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb9f2a69-d5d0-4c21-b61b-7550585d081c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:15.705156 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb9f2a69-d5d0-4c21-b61b-7550585d081c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1375 microversion: 2.1 time: 0.749668 Oct 11 04:32:15.705743 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2502/4759] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:14 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1375 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:15.747382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3f715aa3-2c02-4e99-8006-b4308795be15 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:15.753602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3f715aa3-2c02-4e99-8006-b4308795be15 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:15.753910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bd0d3cc4-0834-4cfd-a278-34d1caeeee0b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Going to try to stop instance {{(pid=120993) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 04:32:15.770486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f715aa3-2c02-4e99-8006-b4308795be15 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:15.770995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f715aa3-2c02-4e99-8006-b4308795be15 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:15.771440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f715aa3-2c02-4e99-8006-b4308795be15 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:15.774403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f715aa3-2c02-4e99-8006-b4308795be15 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:15.775806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f715aa3-2c02-4e99-8006-b4308795be15 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:15.776258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f715aa3-2c02-4e99-8006-b4308795be15 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:16.027005 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bd0d3cc4-0834-4cfd-a278-34d1caeeee0b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "POST /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/action" status: 202 len: 0 microversion: 2.1 time: 0.354614 Oct 11 04:32:16.030106 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2258/4760] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:32:15 2022] POST /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/action => generated 0 bytes in 359 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:32:16.059578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e46480ab-6816-4fdc-83e0-27c1cb74496c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:16.060653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e46480ab-6816-4fdc-83e0-27c1cb74496c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:16.088701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e46480ab-6816-4fdc-83e0-27c1cb74496c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:16.089840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e46480ab-6816-4fdc-83e0-27c1cb74496c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:16.099117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e46480ab-6816-4fdc-83e0-27c1cb74496c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:16.099117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e46480ab-6816-4fdc-83e0-27c1cb74496c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:16.099117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e46480ab-6816-4fdc-83e0-27c1cb74496c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:16.099117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e46480ab-6816-4fdc-83e0-27c1cb74496c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:16.165825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3f715aa3-2c02-4e99-8006-b4308795be15 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:16.188529 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3f715aa3-2c02-4e99-8006-b4308795be15 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1465 microversion: 2.1 time: 0.463880 Oct 11 04:32:16.193476 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2503/4761] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:15 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1465 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:16.576413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5c660a2c-5f2b-435c-8a9d-4bc8c4986d35 req-c6294ab7-4675-4bbd-8e83-6779e2c55d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1bf7aab-a813-4849-ba3b-3650c3a0b2e7", "name": "network-vif-deleted", "tag": "f5a25831-8c8f-4114-8345-22fff4ba27bb"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:16.594923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5c660a2c-5f2b-435c-8a9d-4bc8c4986d35 req-c6294ab7-4675-4bbd-8e83-6779e2c55d3f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:16.594923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5c660a2c-5f2b-435c-8a9d-4bc8c4986d35 req-c6294ab7-4675-4bbd-8e83-6779e2c55d3f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:16.594923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5c660a2c-5f2b-435c-8a9d-4bc8c4986d35 req-c6294ab7-4675-4bbd-8e83-6779e2c55d3f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:16.630703 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5c660a2c-5f2b-435c-8a9d-4bc8c4986d35 req-c6294ab7-4675-4bbd-8e83-6779e2c55d3f service nova] Creating event network-vif-deleted:f5a25831-8c8f-4114-8345-22fff4ba27bb for instance c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 on n-h2-860892-1 Oct 11 04:32:16.637700 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5c660a2c-5f2b-435c-8a9d-4bc8c4986d35 req-c6294ab7-4675-4bbd-8e83-6779e2c55d3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069050 Oct 11 04:32:16.638976 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2504/4762] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:16.683768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e09354a0-2db4-43f0-b0ca-123bca41d046 req-0f8b41a6-f335-4e1f-af0e-88db03532be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24168887-732a-4aa1-b723-e789feed3002", "name": "network-vif-plugged", "status": "completed", "tag": "0b4de9d4-3966-4f60-a837-066bba5af6b5"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:16.711702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e09354a0-2db4-43f0-b0ca-123bca41d046 req-0f8b41a6-f335-4e1f-af0e-88db03532be2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:16.713259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e09354a0-2db4-43f0-b0ca-123bca41d046 req-0f8b41a6-f335-4e1f-af0e-88db03532be2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:16.713921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e09354a0-2db4-43f0-b0ca-123bca41d046 req-0f8b41a6-f335-4e1f-af0e-88db03532be2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:16.730607 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e09354a0-2db4-43f0-b0ca-123bca41d046 req-0f8b41a6-f335-4e1f-af0e-88db03532be2 service nova] Creating event network-vif-plugged:0b4de9d4-3966-4f60-a837-066bba5af6b5 for instance 24168887-732a-4aa1-b723-e789feed3002 on n-h1-860892-1 Oct 11 04:32:16.739347 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e09354a0-2db4-43f0-b0ca-123bca41d046 req-0f8b41a6-f335-4e1f-af0e-88db03532be2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069667 Oct 11 04:32:16.741706 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2505/4763] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:16.773948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0158912f-b5c4-4dbe-a75a-25c96863f1fd tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:16.777639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0158912f-b5c4-4dbe-a75a-25c96863f1fd tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:16.783272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0158912f-b5c4-4dbe-a75a-25c96863f1fd tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:16.783929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0158912f-b5c4-4dbe-a75a-25c96863f1fd tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:16.784569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0158912f-b5c4-4dbe-a75a-25c96863f1fd tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:16.785492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0158912f-b5c4-4dbe-a75a-25c96863f1fd tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:16.786533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0158912f-b5c4-4dbe-a75a-25c96863f1fd tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:16.788872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0158912f-b5c4-4dbe-a75a-25c96863f1fd tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:16.895979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e46480ab-6816-4fdc-83e0-27c1cb74496c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:16.909897 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e46480ab-6816-4fdc-83e0-27c1cb74496c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.875366 Oct 11 04:32:16.926250 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2259/4764] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:16 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 878 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:16.933586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-382f7bce-401e-438d-8ced-311418c473bd tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:16.933831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-382f7bce-401e-438d-8ced-311418c473bd tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:16.945808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-382f7bce-401e-438d-8ced-311418c473bd tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:16.949416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-382f7bce-401e-438d-8ced-311418c473bd tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:16.949416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-382f7bce-401e-438d-8ced-311418c473bd tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:16.949416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-382f7bce-401e-438d-8ced-311418c473bd tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:16.949416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-382f7bce-401e-438d-8ced-311418c473bd tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:16.950056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-382f7bce-401e-438d-8ced-311418c473bd tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:17.375355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0158912f-b5c4-4dbe-a75a-25c96863f1fd tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:17.389770 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0158912f-b5c4-4dbe-a75a-25c96863f1fd tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1428 microversion: 2.1 time: 0.625208 Oct 11 04:32:17.393581 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2506/4765] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:16 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1428 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:17.404163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:17.405150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:17.412301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:17.413738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:17.416318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:17.416318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:17.416750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:17.417489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:17.457809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:17.458605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:17.459390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:17.462276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lazy-loading 'fault' on Instance uuid c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:17.511675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:17.522881 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-770605f3-21b5-4f3e-b304-46539aea6057 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 200 len: 1304 microversion: 2.1 time: 0.127649 Oct 11 04:32:17.527555 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2507/4766] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:17 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 1304 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:17.575268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-382f7bce-401e-438d-8ced-311418c473bd tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:17.582897 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-382f7bce-401e-438d-8ced-311418c473bd tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1375 microversion: 2.1 time: 0.670350 Oct 11 04:32:17.605964 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2260/4767] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:16 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1375 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:17.935844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-892a6dd0-e618-4914-87f6-81c559eee4e9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:17.939280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-892a6dd0-e618-4914-87f6-81c559eee4e9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:17.951886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-892a6dd0-e618-4914-87f6-81c559eee4e9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:17.956729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-892a6dd0-e618-4914-87f6-81c559eee4e9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:17.960585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-892a6dd0-e618-4914-87f6-81c559eee4e9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:17.961378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-892a6dd0-e618-4914-87f6-81c559eee4e9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:17.961861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-892a6dd0-e618-4914-87f6-81c559eee4e9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:17.966423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-892a6dd0-e618-4914-87f6-81c559eee4e9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:18.418225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6f05b168-8fe3-4ad8-8c50-5beb92e0b713 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:18.419280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6f05b168-8fe3-4ad8-8c50-5beb92e0b713 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:18.440105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f05b168-8fe3-4ad8-8c50-5beb92e0b713 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:18.440835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f05b168-8fe3-4ad8-8c50-5beb92e0b713 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:18.441319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f05b168-8fe3-4ad8-8c50-5beb92e0b713 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:18.442067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f05b168-8fe3-4ad8-8c50-5beb92e0b713 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:18.442563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f05b168-8fe3-4ad8-8c50-5beb92e0b713 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:18.442973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6f05b168-8fe3-4ad8-8c50-5beb92e0b713 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:18.937826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-892a6dd0-e618-4914-87f6-81c559eee4e9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:18.947667 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-892a6dd0-e618-4914-87f6-81c559eee4e9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 1.016716 Oct 11 04:32:18.955165 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2508/4768] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:17 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 1021 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:18.966800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:18.967436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: c1bf7aab-a813-4849-ba3b-3650c3a0b2e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:18.994015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:18.994817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:18.995430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:18.996393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:18.997013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:18.997600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:19.026455 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] HTTP exception thrown: Instance c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 could not be found. Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Request method failure captured: Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 HTTP/1.1 Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO_RCh7y3VCR0ZGCz57mMkPYBNk7QiIVp9XuBnd-Uehf82A4vup9lXbNXCqWQjVjFhMOhYa9RyLqNtdWCz0WKBx8po-RawVJL-JciajTijLf7lVKUU9Uul6vpelbjCSaCgmT83upn5D4faXHmtAf4nXZcwDOtKbLho_1_PIpYNLAs5s Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a2974866e964ca2864c978d2270bd77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}] Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5feceb4a60434064a4fd08f7cc637f32 Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 could not be found. Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'c1bf7aab-a813-4849-ba3b-3650c3a0b2e7'} Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 could not be found. Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 could not be found. Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:19.028518 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:19.033224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:19.033224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:19.033224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:19.033224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:19.033224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:19.033224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 could not be found. Oct 11 04:32:19.033224 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:19.039449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Returning 404 to user: Instance c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:19.040649 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d3b35c9-fd0b-4bac-bf6f-4e182f31dd4c tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7" status: 404 len: 111 microversion: 2.1 time: 0.088801 Oct 11 04:32:19.041765 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2509/4769] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:18 2022] GET /compute/v2.1/servers/c1bf7aab-a813-4849-ba3b-3650c3a0b2e7 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:32:19.054071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b84462b-c4f7-435a-951c-ce08b63052c8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:19.055126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1b84462b-c4f7-435a-951c-ce08b63052c8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:19.063977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b84462b-c4f7-435a-951c-ce08b63052c8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:19.064723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b84462b-c4f7-435a-951c-ce08b63052c8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:19.065352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b84462b-c4f7-435a-951c-ce08b63052c8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:19.066283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b84462b-c4f7-435a-951c-ce08b63052c8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:19.066933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b84462b-c4f7-435a-951c-ce08b63052c8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:19.067581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b84462b-c4f7-435a-951c-ce08b63052c8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:19.377693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1b84462b-c4f7-435a-951c-ce08b63052c8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:19.387510 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1b84462b-c4f7-435a-951c-ce08b63052c8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1375 microversion: 2.1 time: 0.343960 Oct 11 04:32:19.388381 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2510/4770] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:19 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1375 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:19.393340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6f05b168-8fe3-4ad8-8c50-5beb92e0b713 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:19.394881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d8d70b3-2e0b-418a-b945-1cd47194b61a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:19.395635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d8d70b3-2e0b-418a-b945-1cd47194b61a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:19.405260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d8d70b3-2e0b-418a-b945-1cd47194b61a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:19.408043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d8d70b3-2e0b-418a-b945-1cd47194b61a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:19.409358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d8d70b3-2e0b-418a-b945-1cd47194b61a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:19.410989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d8d70b3-2e0b-418a-b945-1cd47194b61a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:19.412103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d8d70b3-2e0b-418a-b945-1cd47194b61a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:19.412859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d8d70b3-2e0b-418a-b945-1cd47194b61a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:19.413821 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6f05b168-8fe3-4ad8-8c50-5beb92e0b713 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1428 microversion: 2.1 time: 1.001631 Oct 11 04:32:19.417303 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2261/4771] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:18 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1428 bytes in 1006 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:19.440196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c43f4e19-9c8a-4af6-abcd-381d8b2c1957 req-542582b2-4952-48d3-8626-2b4b839e40cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f249f1b-29b6-41f0-9917-551729acc982", "name": "network-vif-plugged", "status": "completed", "tag": "6c0f99dc-4582-45a3-bdba-f7254fbe6fb8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:19.482325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c43f4e19-9c8a-4af6-abcd-381d8b2c1957 req-542582b2-4952-48d3-8626-2b4b839e40cf service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:19.482325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c43f4e19-9c8a-4af6-abcd-381d8b2c1957 req-542582b2-4952-48d3-8626-2b4b839e40cf service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:19.482325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c43f4e19-9c8a-4af6-abcd-381d8b2c1957 req-542582b2-4952-48d3-8626-2b4b839e40cf service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:19.488522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d8d70b3-2e0b-418a-b945-1cd47194b61a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:32:19.501992 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c43f4e19-9c8a-4af6-abcd-381d8b2c1957 req-542582b2-4952-48d3-8626-2b4b839e40cf service nova] Creating event network-vif-plugged:6c0f99dc-4582-45a3-bdba-f7254fbe6fb8 for instance 6f249f1b-29b6-41f0-9917-551729acc982 on n-h2-860892-1 Oct 11 04:32:19.535005 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c43f4e19-9c8a-4af6-abcd-381d8b2c1957 req-542582b2-4952-48d3-8626-2b4b839e40cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115783 Oct 11 04:32:19.535503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=12,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:19.536588 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2262/4772] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:19.923555 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d8d70b3-2e0b-418a-b945-1cd47194b61a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 204 len: 0 microversion: 2.1 time: 0.532766 Oct 11 04:32:19.924525 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2511/4773] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:32:19 2022] DELETE /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 0 bytes in 535 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:32:19.937742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b8c2cd9-9f58-41e5-abfe-238a81521a1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:19.938629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b8c2cd9-9f58-41e5-abfe-238a81521a1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:19.947817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-49042925-3571-4352-b9ac-a719eca24a64 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] Action: 'create', calling method: .version_select at 0x7fda18e97040>, body: {"pool": null} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:19.960175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b8c2cd9-9f58-41e5-abfe-238a81521a1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:19.961138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b8c2cd9-9f58-41e5-abfe-238a81521a1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:19.961764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b8c2cd9-9f58-41e5-abfe-238a81521a1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:19.962554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b8c2cd9-9f58-41e5-abfe-238a81521a1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:19.963375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b8c2cd9-9f58-41e5-abfe-238a81521a1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:19.963984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b8c2cd9-9f58-41e5-abfe-238a81521a1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:20.145928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9b8c2cd9-9f58-41e5-abfe-238a81521a1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:20.158831 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b8c2cd9-9f58-41e5-abfe-238a81521a1e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1508 microversion: 2.1 time: 0.227935 Oct 11 04:32:20.179747 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2512/4774] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:19 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1508 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:20.188662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-64e16f60-1562-4029-bd3e-6e1804f13f55 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:20.189279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-64e16f60-1562-4029-bd3e-6e1804f13f55 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:20.198910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e16f60-1562-4029-bd3e-6e1804f13f55 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:20.199655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e16f60-1562-4029-bd3e-6e1804f13f55 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:20.200137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e16f60-1562-4029-bd3e-6e1804f13f55 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:20.200845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e16f60-1562-4029-bd3e-6e1804f13f55 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:20.201297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e16f60-1562-4029-bd3e-6e1804f13f55 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:20.201721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e16f60-1562-4029-bd3e-6e1804f13f55 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:20.449803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-64e16f60-1562-4029-bd3e-6e1804f13f55 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:20.473839 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-64e16f60-1562-4029-bd3e-6e1804f13f55 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.292778 Oct 11 04:32:20.487020 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2513/4775] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:20 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:20.499998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-793cd89a-b86a-49d0-818d-d738e377a4ec tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:20.500621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-793cd89a-b86a-49d0-818d-d738e377a4ec tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:20.515124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793cd89a-b86a-49d0-818d-d738e377a4ec tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:20.515619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793cd89a-b86a-49d0-818d-d738e377a4ec tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:20.516061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793cd89a-b86a-49d0-818d-d738e377a4ec tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:20.516773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793cd89a-b86a-49d0-818d-d738e377a4ec tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:20.517221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793cd89a-b86a-49d0-818d-d738e377a4ec tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:20.517842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-793cd89a-b86a-49d0-818d-d738e377a4ec tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:20.769210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-793cd89a-b86a-49d0-818d-d738e377a4ec tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:20.779011 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-793cd89a-b86a-49d0-818d-d738e377a4ec tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1546 microversion: 2.1 time: 0.290416 Oct 11 04:32:20.779974 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2514/4776] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:20 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1546 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:20.785099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6ea18519-2a7c-4ecf-9324-b166eefb0df2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:20.785833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6ea18519-2a7c-4ecf-9324-b166eefb0df2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:20.805933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ea18519-2a7c-4ecf-9324-b166eefb0df2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:20.806521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ea18519-2a7c-4ecf-9324-b166eefb0df2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:20.807463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ea18519-2a7c-4ecf-9324-b166eefb0df2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:20.807717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ea18519-2a7c-4ecf-9324-b166eefb0df2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:20.811487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ea18519-2a7c-4ecf-9324-b166eefb0df2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:20.812198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ea18519-2a7c-4ecf-9324-b166eefb0df2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:21.007292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6ea18519-2a7c-4ecf-9324-b166eefb0df2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:21.016752 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6ea18519-2a7c-4ecf-9324-b166eefb0df2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1428 microversion: 2.1 time: 0.235698 Oct 11 04:32:21.033582 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2515/4777] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:20 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1428 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:21.388447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerTagsTestJSON-server-1693557572", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "1f340568-7d98-4bf6-853b-5c5d14d9fd25"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:21.451308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] validate_networks() for [('1f340568-7d98-4bf6-853b-5c5d14d9fd25', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:32:22.015255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:32:22.016028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:32:22.016728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:32:22.017331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:32:22.017688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:32:22.028719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:22.029474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:22.030115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:22.031157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:22.031806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:22.032409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:22.060905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Getting quotas for project 51ba34bd1c7c4536b162a2a8a1bfefd9. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:22.067658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Getting quotas for user 80cf1965120740158d17c1c050c32139 and project 51ba34bd1c7c4536b162a2a8a1bfefd9. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:32:22.084503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:32:22.087716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:32:22.213786 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-88e8b91a-8be5-439e-90bc-ab4213a26406 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.26 time: 1.178341 Oct 11 04:32:22.221703 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2516/4778] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:32:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 1187 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:32:22.228165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36964613-310e-4f72-bca7-92a59aca4e80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:22.229248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-36964613-310e-4f72-bca7-92a59aca4e80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:22.240408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36964613-310e-4f72-bca7-92a59aca4e80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:22.241799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36964613-310e-4f72-bca7-92a59aca4e80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:22.243048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36964613-310e-4f72-bca7-92a59aca4e80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:22.244114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36964613-310e-4f72-bca7-92a59aca4e80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:22.244911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36964613-310e-4f72-bca7-92a59aca4e80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:22.245823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36964613-310e-4f72-bca7-92a59aca4e80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:22.427678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-36964613-310e-4f72-bca7-92a59aca4e80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:22.437785 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-36964613-310e-4f72-bca7-92a59aca4e80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1546 microversion: 2.1 time: 0.214041 Oct 11 04:32:22.438873 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2517/4779] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:22 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1546 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:22.445157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f25b25a-e84b-4db3-807d-7b394b6f3f92 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:22.462893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f25b25a-e84b-4db3-807d-7b394b6f3f92 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:22.483922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f25b25a-e84b-4db3-807d-7b394b6f3f92 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:22.484438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f25b25a-e84b-4db3-807d-7b394b6f3f92 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:22.484881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f25b25a-e84b-4db3-807d-7b394b6f3f92 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:22.487874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f25b25a-e84b-4db3-807d-7b394b6f3f92 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:22.492075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f25b25a-e84b-4db3-807d-7b394b6f3f92 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:22.493396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f25b25a-e84b-4db3-807d-7b394b6f3f92 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:22.710726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f25b25a-e84b-4db3-807d-7b394b6f3f92 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:22.719412 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f25b25a-e84b-4db3-807d-7b394b6f3f92 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 200 len: 1466 microversion: 2.1 time: 0.278651 Oct 11 04:32:22.719980 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2518/4780] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:22 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 1466 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:22.725132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7ff22ef5-422d-4abd-8fa1-d290dcebc90a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:22.725961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7ff22ef5-422d-4abd-8fa1-d290dcebc90a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:22.733669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ff22ef5-422d-4abd-8fa1-d290dcebc90a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:22.734495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ff22ef5-422d-4abd-8fa1-d290dcebc90a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:22.735124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ff22ef5-422d-4abd-8fa1-d290dcebc90a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:22.736507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ff22ef5-422d-4abd-8fa1-d290dcebc90a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:22.737157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ff22ef5-422d-4abd-8fa1-d290dcebc90a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:22.738828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ff22ef5-422d-4abd-8fa1-d290dcebc90a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:23.091027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7ff22ef5-422d-4abd-8fa1-d290dcebc90a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:23.109171 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7ff22ef5-422d-4abd-8fa1-d290dcebc90a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.387527 Oct 11 04:32:23.115344 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2519/4781] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:22 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:23.135226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e218aa8-6dac-4a9a-85f8-42e51376259b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:23.135957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e218aa8-6dac-4a9a-85f8-42e51376259b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:23.158283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e218aa8-6dac-4a9a-85f8-42e51376259b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:23.158283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e218aa8-6dac-4a9a-85f8-42e51376259b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:23.158283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e218aa8-6dac-4a9a-85f8-42e51376259b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:23.158283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e218aa8-6dac-4a9a-85f8-42e51376259b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:23.163365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e218aa8-6dac-4a9a-85f8-42e51376259b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:23.163899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e218aa8-6dac-4a9a-85f8-42e51376259b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:23.280554 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-49042925-3571-4352-b9ac-a719eca24a64 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.740465 Oct 11 04:32:23.281802 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2263/4782] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:32:19 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:23.314357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-63317725-790e-4c4b-bcee-16ffeb4c3ce8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:23.315529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-63317725-790e-4c4b-bcee-16ffeb4c3ce8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:23.412954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-63317725-790e-4c4b-bcee-16ffeb4c3ce8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:23.424843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-63317725-790e-4c4b-bcee-16ffeb4c3ce8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:23.426638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-63317725-790e-4c4b-bcee-16ffeb4c3ce8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:23.433309 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-63317725-790e-4c4b-bcee-16ffeb4c3ce8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1262 microversion: 2.26 time: 0.145616 Oct 11 04:32:23.434883 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2264/4783] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:23 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:23.447308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6d0fe891-0d20-401e-a7d0-3c0d0436c446 req-c86518c9-db90-4dd4-820d-7c77de13f82e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fafb331-19af-4936-a405-cbf6020defba", "name": "network-vif-deleted", "tag": "cfdd334c-b535-4947-b6cf-d889e066625f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:23.471263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d0fe891-0d20-401e-a7d0-3c0d0436c446 req-c86518c9-db90-4dd4-820d-7c77de13f82e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:23.471749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d0fe891-0d20-401e-a7d0-3c0d0436c446 req-c86518c9-db90-4dd4-820d-7c77de13f82e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:23.472190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d0fe891-0d20-401e-a7d0-3c0d0436c446 req-c86518c9-db90-4dd4-820d-7c77de13f82e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:23.496733 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6d0fe891-0d20-401e-a7d0-3c0d0436c446 req-c86518c9-db90-4dd4-820d-7c77de13f82e service nova] Creating event network-vif-deleted:cfdd334c-b535-4947-b6cf-d889e066625f for instance 3fafb331-19af-4936-a405-cbf6020defba on n-h1-860892-1 Oct 11 04:32:23.523866 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6d0fe891-0d20-401e-a7d0-3c0d0436c446 req-c86518c9-db90-4dd4-820d-7c77de13f82e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086850 Oct 11 04:32:23.525004 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2265/4784] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:23.534089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b7aaf7a7-2a07-41de-a816-e5fc5df2bc2c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:23.538232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b7aaf7a7-2a07-41de-a816-e5fc5df2bc2c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:23.545465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7aaf7a7-2a07-41de-a816-e5fc5df2bc2c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:23.545968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7aaf7a7-2a07-41de-a816-e5fc5df2bc2c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:23.546448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7aaf7a7-2a07-41de-a816-e5fc5df2bc2c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:23.547165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7aaf7a7-2a07-41de-a816-e5fc5df2bc2c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:23.547624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7aaf7a7-2a07-41de-a816-e5fc5df2bc2c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:23.548062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7aaf7a7-2a07-41de-a816-e5fc5df2bc2c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:23.569612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e218aa8-6dac-4a9a-85f8-42e51376259b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:23.577131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-b7aaf7a7-2a07-41de-a816-e5fc5df2bc2c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lazy-loading 'flavor' on Instance uuid 7ec2cb39-bab6-4474-9901-5909a9053a80 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:23.583111 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e218aa8-6dac-4a9a-85f8-42e51376259b tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1609 microversion: 2.1 time: 0.462881 Oct 11 04:32:23.584004 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2520/4785] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:23 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1609 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:23.602616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df96bcce-fdd2-42db-b1b0-a8a75fbe67ab tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] Action: 'create', calling method: .version_select at 0x7fda190c60d0>, body: {"pool": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:23.985593 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b7aaf7a7-2a07-41de-a816-e5fc5df2bc2c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/action" status: 200 len: 32 microversion: 2.1 time: 0.458835 Oct 11 04:32:23.986882 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2266/4786] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:32:23 2022] POST /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/action => generated 32 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:32:23.994382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-772ce669-27f8-40a3-8e90-9a82f7affddb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:23.995345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-772ce669-27f8-40a3-8e90-9a82f7affddb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:24.003315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-772ce669-27f8-40a3-8e90-9a82f7affddb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:24.003811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-772ce669-27f8-40a3-8e90-9a82f7affddb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:24.004255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-772ce669-27f8-40a3-8e90-9a82f7affddb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:24.004964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-772ce669-27f8-40a3-8e90-9a82f7affddb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:24.005419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-772ce669-27f8-40a3-8e90-9a82f7affddb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:24.005989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-772ce669-27f8-40a3-8e90-9a82f7affddb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:24.330140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-772ce669-27f8-40a3-8e90-9a82f7affddb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:24.357064 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-772ce669-27f8-40a3-8e90-9a82f7affddb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1609 microversion: 2.1 time: 0.368584 Oct 11 04:32:24.357663 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2267/4787] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:23 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1609 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:24.369439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:24.371727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 3fafb331-19af-4936-a405-cbf6020defba] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:24.387370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:24.388198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:24.388890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:24.389823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:24.390501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:24.391111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:24.435975 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] HTTP exception thrown: Instance 3fafb331-19af-4936-a405-cbf6020defba could not be found. Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Request method failure captured: Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba HTTP/1.1 Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_RCh7y3VCR0ZGCz57mMkPYBNk7QiIVp9XuBnd-Uehf82A4vup9lXbNXCqWQjVjFhMOhYa9RyLqNtdWCz0WKBx8po-RawVJL-JciajTijLf7lVKUU9Uul6vpelbjCSaCgmT83upn5D4faXHmtAf4nXZcwDOtKbLho_1_PIpYNLAs5s Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a2974866e964ca2864c978d2270bd77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}] Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5feceb4a60434064a4fd08f7cc637f32 Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 3fafb331-19af-4936-a405-cbf6020defba could not be found. Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '3fafb331-19af-4936-a405-cbf6020defba'} Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fafb331-19af-4936-a405-cbf6020defba could not be found. Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fafb331-19af-4936-a405-cbf6020defba could not be found. Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:24.437774 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:24.442368 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:24.442368 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:24.442368 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:24.442368 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:24.442368 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:24.442368 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fafb331-19af-4936-a405-cbf6020defba could not be found. Oct 11 04:32:24.442368 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:24.443220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Returning 404 to user: Instance 3fafb331-19af-4936-a405-cbf6020defba could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:24.445752 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd89c35c-f624-41b0-bcbd-81e9507ac67b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba" status: 404 len: 111 microversion: 2.1 time: 0.080698 Oct 11 04:32:24.446660 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2268/4788] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:24 2022] GET /compute/v2.1/servers/3fafb331-19af-4936-a405-cbf6020defba => generated 111 bytes in 88 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:32:24.457686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-58db5ca2-38c7-4ff4-8fab-af288c127363 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:24.458626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-58db5ca2-38c7-4ff4-8fab-af288c127363 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:24.477013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58db5ca2-38c7-4ff4-8fab-af288c127363 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:24.480934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58db5ca2-38c7-4ff4-8fab-af288c127363 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:24.480934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58db5ca2-38c7-4ff4-8fab-af288c127363 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:24.480934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58db5ca2-38c7-4ff4-8fab-af288c127363 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:24.480934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58db5ca2-38c7-4ff4-8fab-af288c127363 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:24.480934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58db5ca2-38c7-4ff4-8fab-af288c127363 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:24.902897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-58db5ca2-38c7-4ff4-8fab-af288c127363 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:24.913047 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-58db5ca2-38c7-4ff4-8fab-af288c127363 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.458770 Oct 11 04:32:24.913637 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2269/4789] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:24 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:24.932209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31dd73b8-b7c8-4446-b594-cda01826d06d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:24.933021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-31dd73b8-b7c8-4446-b594-cda01826d06d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:24.955507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd73b8-b7c8-4446-b594-cda01826d06d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:24.955507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd73b8-b7c8-4446-b594-cda01826d06d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:24.955507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd73b8-b7c8-4446-b594-cda01826d06d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:24.955507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd73b8-b7c8-4446-b594-cda01826d06d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:24.955507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd73b8-b7c8-4446-b594-cda01826d06d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:24.955507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31dd73b8-b7c8-4446-b594-cda01826d06d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:25.318943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-31dd73b8-b7c8-4446-b594-cda01826d06d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:25.333764 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-31dd73b8-b7c8-4446-b594-cda01826d06d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.415922 Oct 11 04:32:25.336210 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2270/4790] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:24 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:25.365326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ab6200ad-6ac7-4a5f-9e98-a242d6dd6c3e tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:25.366489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ab6200ad-6ac7-4a5f-9e98-a242d6dd6c3e tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:25.380031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab6200ad-6ac7-4a5f-9e98-a242d6dd6c3e tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:25.380526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab6200ad-6ac7-4a5f-9e98-a242d6dd6c3e tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:25.380989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab6200ad-6ac7-4a5f-9e98-a242d6dd6c3e tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:25.381942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab6200ad-6ac7-4a5f-9e98-a242d6dd6c3e tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:25.382644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab6200ad-6ac7-4a5f-9e98-a242d6dd6c3e tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:25.383328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab6200ad-6ac7-4a5f-9e98-a242d6dd6c3e tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:25.551201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab6200ad-6ac7-4a5f-9e98-a242d6dd6c3e tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:25.563131 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ab6200ad-6ac7-4a5f-9e98-a242d6dd6c3e tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1609 microversion: 2.1 time: 0.224910 Oct 11 04:32:25.563720 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2271/4791] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:25 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1609 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:25.568682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-602c0a4f-2d7d-4d79-9af4-c25fe13546e7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:25.569751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-602c0a4f-2d7d-4d79-9af4-c25fe13546e7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:25.575112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-602c0a4f-2d7d-4d79-9af4-c25fe13546e7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:25.575952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-602c0a4f-2d7d-4d79-9af4-c25fe13546e7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:25.576587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-602c0a4f-2d7d-4d79-9af4-c25fe13546e7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:25.577529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-602c0a4f-2d7d-4d79-9af4-c25fe13546e7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:25.585969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-602c0a4f-2d7d-4d79-9af4-c25fe13546e7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:25.586817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-602c0a4f-2d7d-4d79-9af4-c25fe13546e7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:25.620816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-602c0a4f-2d7d-4d79-9af4-c25fe13546e7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:32:26.021550 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-602c0a4f-2d7d-4d79-9af4-c25fe13546e7 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 204 len: 0 microversion: 2.1 time: 0.456531 Oct 11 04:32:26.027737 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2272/4792] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:32:25 2022] DELETE /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:32:26.035127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:26.036281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:26.042885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:26.043623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:26.044212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:26.045133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:26.049960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:26.052450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:26.209051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:26.221417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:26.223230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:26.230327 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-802271a0-1383-47da-b79b-741a136719c0 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1322 microversion: 2.26 time: 0.195627 Oct 11 04:32:26.230327 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2273/4793] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:26 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1322 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:26.250501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c7395692-847a-40fc-9a14-6b631abb18b6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:26.252873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c7395692-847a-40fc-9a14-6b631abb18b6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:26.274741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7395692-847a-40fc-9a14-6b631abb18b6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:26.277050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7395692-847a-40fc-9a14-6b631abb18b6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:26.277948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7395692-847a-40fc-9a14-6b631abb18b6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:26.278957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7395692-847a-40fc-9a14-6b631abb18b6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:26.280559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7395692-847a-40fc-9a14-6b631abb18b6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:26.281949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7395692-847a-40fc-9a14-6b631abb18b6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:26.290149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:26.888554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c7395692-847a-40fc-9a14-6b631abb18b6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:26.903356 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c7395692-847a-40fc-9a14-6b631abb18b6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.675581 Oct 11 04:32:26.914983 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2274/4794] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:26 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:26.933045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ac7e4293-a008-413d-bdb3-43000ad755ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:26.933716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ac7e4293-a008-413d-bdb3-43000ad755ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:26.960943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac7e4293-a008-413d-bdb3-43000ad755ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:26.961648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac7e4293-a008-413d-bdb3-43000ad755ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:26.963099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac7e4293-a008-413d-bdb3-43000ad755ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:26.963851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac7e4293-a008-413d-bdb3-43000ad755ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:26.964317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac7e4293-a008-413d-bdb3-43000ad755ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:26.968273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac7e4293-a008-413d-bdb3-43000ad755ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:27.477381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ac7e4293-a008-413d-bdb3-43000ad755ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:27.483105 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-df96bcce-fdd2-42db-b1b0-a8a75fbe67ab tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 141 microversion: 2.1 time: 3.896438 Oct 11 04:32:27.484605 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2521/4795] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:32:23 2022] POST /compute/v2.1/os-floating-ips => generated 141 bytes in 3900 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:27.495411 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ac7e4293-a008-413d-bdb3-43000ad755ab tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1495 microversion: 2.1 time: 0.579099 Oct 11 04:32:27.500159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1fb2d724-e383-468b-a5df-e8715fc675e7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:27.501795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1fb2d724-e383-468b-a5df-e8715fc675e7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:27.511439 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2275/4796] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:26 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1495 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:27.522713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:27.523615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:27.528075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fb2d724-e383-468b-a5df-e8715fc675e7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:27.528584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fb2d724-e383-468b-a5df-e8715fc675e7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:27.529029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fb2d724-e383-468b-a5df-e8715fc675e7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:27.536389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fb2d724-e383-468b-a5df-e8715fc675e7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:27.537085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fb2d724-e383-468b-a5df-e8715fc675e7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:27.539692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1fb2d724-e383-468b-a5df-e8715fc675e7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:27.540068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:27.540851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:27.541490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:27.542318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:27.542789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:27.543809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:27.769388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1fb2d724-e383-468b-a5df-e8715fc675e7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:27.778912 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1fb2d724-e383-468b-a5df-e8715fc675e7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.282780 Oct 11 04:32:27.779509 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2522/4797] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:27 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:27.784311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-abdd90f3-aa85-49b0-b6ee-e66fe6ef5dd1 req-9dadbe6a-0daf-444d-b7cb-edd8819d7e0d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24168887-732a-4aa1-b723-e789feed3002", "tag": "0b4de9d4-3966-4f60-a837-066bba5af6b5"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:27.794544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-abdd90f3-aa85-49b0-b6ee-e66fe6ef5dd1 req-9dadbe6a-0daf-444d-b7cb-edd8819d7e0d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:27.795349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-abdd90f3-aa85-49b0-b6ee-e66fe6ef5dd1 req-9dadbe6a-0daf-444d-b7cb-edd8819d7e0d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:27.795951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-abdd90f3-aa85-49b0-b6ee-e66fe6ef5dd1 req-9dadbe6a-0daf-444d-b7cb-edd8819d7e0d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:27.809803 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-abdd90f3-aa85-49b0-b6ee-e66fe6ef5dd1 req-9dadbe6a-0daf-444d-b7cb-edd8819d7e0d service nova] Creating event network-changed:0b4de9d4-3966-4f60-a837-066bba5af6b5 for instance 24168887-732a-4aa1-b723-e789feed3002 on n-h1-860892-1 Oct 11 04:32:27.815845 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-abdd90f3-aa85-49b0-b6ee-e66fe6ef5dd1 req-9dadbe6a-0daf-444d-b7cb-edd8819d7e0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034858 Oct 11 04:32:27.820773 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2523/4798] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:27.826534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b505976-dee6-4dc1-a4c7-3dbcecc8be59 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] Action: 'create', calling method: .version_select at 0x7fda1e0ea670>, body: {"pool": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:28.017126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:28.032737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:28.036279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:28.038516 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fa332c50-afa8-4a01-875e-c591e19c0fc3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1320 microversion: 2.26 time: 0.525983 Oct 11 04:32:28.058644 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2276/4799] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:27 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1320 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:28.083446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4916a3de-fd7b-40d1-86d3-252ba3c1f46b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:28.084327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4916a3de-fd7b-40d1-86d3-252ba3c1f46b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:28.095618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4916a3de-fd7b-40d1-86d3-252ba3c1f46b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:28.096386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4916a3de-fd7b-40d1-86d3-252ba3c1f46b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:28.097051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4916a3de-fd7b-40d1-86d3-252ba3c1f46b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:28.098008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4916a3de-fd7b-40d1-86d3-252ba3c1f46b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:28.098913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4916a3de-fd7b-40d1-86d3-252ba3c1f46b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:28.099568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4916a3de-fd7b-40d1-86d3-252ba3c1f46b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:28.666806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4916a3de-fd7b-40d1-86d3-252ba3c1f46b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:28.679016 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4916a3de-fd7b-40d1-86d3-252ba3c1f46b tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.621880 Oct 11 04:32:28.694807 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2277/4800] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:28 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:28.699023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a92fa495-7459-42b0-8a33-cfa48c6a1ae3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:28.700356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a92fa495-7459-42b0-8a33-cfa48c6a1ae3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:28.713860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92fa495-7459-42b0-8a33-cfa48c6a1ae3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:28.718030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92fa495-7459-42b0-8a33-cfa48c6a1ae3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:28.718786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92fa495-7459-42b0-8a33-cfa48c6a1ae3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:28.719709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92fa495-7459-42b0-8a33-cfa48c6a1ae3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:28.720402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92fa495-7459-42b0-8a33-cfa48c6a1ae3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:28.726121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92fa495-7459-42b0-8a33-cfa48c6a1ae3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:28.941279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a92fa495-7459-42b0-8a33-cfa48c6a1ae3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:28.951798 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a92fa495-7459-42b0-8a33-cfa48c6a1ae3 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 200 len: 1453 microversion: 2.1 time: 0.271125 Oct 11 04:32:28.966313 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2278/4801] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:28 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 1453 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:28.966313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2acd6a01-b3d7-42a6-bc47-e5e2e33d39f7 req-a07cdf3f-b32b-4a2f-843e-62cd670e6464 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ec8dd13-4df6-4c50-a9a3-2c75493566db", "name": "network-vif-deleted", "tag": "9da35fef-6bcd-4c8e-92f8-94a5701dd64c"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:28.971586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2acd6a01-b3d7-42a6-bc47-e5e2e33d39f7 req-a07cdf3f-b32b-4a2f-843e-62cd670e6464 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:28.971586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2acd6a01-b3d7-42a6-bc47-e5e2e33d39f7 req-a07cdf3f-b32b-4a2f-843e-62cd670e6464 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:28.971586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2acd6a01-b3d7-42a6-bc47-e5e2e33d39f7 req-a07cdf3f-b32b-4a2f-843e-62cd670e6464 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:28.988430 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2acd6a01-b3d7-42a6-bc47-e5e2e33d39f7 req-a07cdf3f-b32b-4a2f-843e-62cd670e6464 service nova] Creating event network-vif-deleted:9da35fef-6bcd-4c8e-92f8-94a5701dd64c for instance 4ec8dd13-4df6-4c50-a9a3-2c75493566db on n-h1-860892-1 Oct 11 04:32:28.995646 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2acd6a01-b3d7-42a6-bc47-e5e2e33d39f7 req-a07cdf3f-b32b-4a2f-843e-62cd670e6464 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040082 Oct 11 04:32:28.996784 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2279/4802] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:29.011013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f734ced1-7122-408b-afa7-14c2dd940017 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:29.011013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f734ced1-7122-408b-afa7-14c2dd940017 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:29.019245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f734ced1-7122-408b-afa7-14c2dd940017 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:29.021466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f734ced1-7122-408b-afa7-14c2dd940017 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:29.022790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f734ced1-7122-408b-afa7-14c2dd940017 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:29.023706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f734ced1-7122-408b-afa7-14c2dd940017 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:29.024828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f734ced1-7122-408b-afa7-14c2dd940017 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:29.025912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f734ced1-7122-408b-afa7-14c2dd940017 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:29.617569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f734ced1-7122-408b-afa7-14c2dd940017 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:29.630434 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f734ced1-7122-408b-afa7-14c2dd940017 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.630830 Oct 11 04:32:29.633401 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2280/4803] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:28 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:29.641778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:29.643666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:29.656364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:29.658309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:29.661454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:29.667394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:29.668188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:29.668800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:30.033049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:30.045509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:30.047296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:30.049344 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-18ec8a0a-68ec-4f82-a05d-225b08db4126 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1362 microversion: 2.26 time: 0.413845 Oct 11 04:32:30.050717 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2281/4804] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:29 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1362 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:30.058084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a5c67791-5931-4f8e-93a0-0bd69a01846c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:30.058866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a5c67791-5931-4f8e-93a0-0bd69a01846c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:30.065000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c67791-5931-4f8e-93a0-0bd69a01846c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:30.065774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c67791-5931-4f8e-93a0-0bd69a01846c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:30.066366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c67791-5931-4f8e-93a0-0bd69a01846c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:30.067307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c67791-5931-4f8e-93a0-0bd69a01846c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:30.067996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c67791-5931-4f8e-93a0-0bd69a01846c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:30.068678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c67791-5931-4f8e-93a0-0bd69a01846c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:30.363169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a5c67791-5931-4f8e-93a0-0bd69a01846c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:30.371980 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a5c67791-5931-4f8e-93a0-0bd69a01846c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.320061 Oct 11 04:32:30.372560 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2282/4805] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:30 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:30.378274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:30.378917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: 4ec8dd13-4df6-4c50-a9a3-2c75493566db] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:30.387240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:30.388283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:30.389602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:30.390389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:30.390849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:30.391400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:30.408633 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] HTTP exception thrown: Instance 4ec8dd13-4df6-4c50-a9a3-2c75493566db could not be found. Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Request method failure captured: Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db HTTP/1.1 Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRO_RCh7y3VCR0ZGCz57mMkPYBNk7QiIVp9XuBnd-Uehf82A4vup9lXbNXCqWQjVjFhMOhYa9RyLqNtdWCz0WKBx8po-RawVJL-JciajTijLf7lVKUU9Uul6vpelbjCSaCgmT83upn5D4faXHmtAf4nXZcwDOtKbLho_1_PIpYNLAs5s Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a2974866e964ca2864c978d2270bd77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}] Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5feceb4a60434064a4fd08f7cc637f32 Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 4ec8dd13-4df6-4c50-a9a3-2c75493566db could not be found. Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '4ec8dd13-4df6-4c50-a9a3-2c75493566db'} Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ec8dd13-4df6-4c50-a9a3-2c75493566db could not be found. Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ec8dd13-4df6-4c50-a9a3-2c75493566db could not be found. Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:30.410406 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:30.416198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:30.416198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:30.416198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:30.416198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:30.416198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:30.416198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ec8dd13-4df6-4c50-a9a3-2c75493566db could not be found. Oct 11 04:32:30.416198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:30.416198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Returning 404 to user: Instance 4ec8dd13-4df6-4c50-a9a3-2c75493566db could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:30.416198 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-973a46fc-4ba7-4ee5-8bf7-b741f14492ef tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db" status: 404 len: 111 microversion: 2.1 time: 0.038231 Oct 11 04:32:30.416198 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2283/4806] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:30 2022] GET /compute/v2.1/servers/4ec8dd13-4df6-4c50-a9a3-2c75493566db => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:32:30.420907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7b8b5b0d-6488-42a6-91f5-168246d3289a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:30.421691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7b8b5b0d-6488-42a6-91f5-168246d3289a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:30.427995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b8b5b0d-6488-42a6-91f5-168246d3289a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:30.428824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b8b5b0d-6488-42a6-91f5-168246d3289a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:30.429422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b8b5b0d-6488-42a6-91f5-168246d3289a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:30.430331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b8b5b0d-6488-42a6-91f5-168246d3289a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:30.430796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b8b5b0d-6488-42a6-91f5-168246d3289a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:30.431226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b8b5b0d-6488-42a6-91f5-168246d3289a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:30.495591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7b8b5b0d-6488-42a6-91f5-168246d3289a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:32:30.618644 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b505976-dee6-4dc1-a4c7-3dbcecc8be59 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.796457 Oct 11 04:32:30.619242 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2524/4807] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:32:27 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:30.633376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b0830ba-b6f2-444a-b819-64fc75647281 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] Action: 'create', calling method: .version_select at 0x7fda18daadc0>, body: {"pool": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:30.816631 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7b8b5b0d-6488-42a6-91f5-168246d3289a tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 204 len: 0 microversion: 2.1 time: 0.398433 Oct 11 04:32:30.817450 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2284/4808] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:32:30 2022] DELETE /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:32:30.830891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3b386bc6-5681-439d-ae28-1885bc1bbd7b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:30.831933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3b386bc6-5681-439d-ae28-1885bc1bbd7b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:30.839688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b386bc6-5681-439d-ae28-1885bc1bbd7b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:30.840252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b386bc6-5681-439d-ae28-1885bc1bbd7b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:30.841161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b386bc6-5681-439d-ae28-1885bc1bbd7b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:30.842112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b386bc6-5681-439d-ae28-1885bc1bbd7b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:30.842894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b386bc6-5681-439d-ae28-1885bc1bbd7b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:30.843330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b386bc6-5681-439d-ae28-1885bc1bbd7b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:31.091457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3b386bc6-5681-439d-ae28-1885bc1bbd7b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:31.103022 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3b386bc6-5681-439d-ae28-1885bc1bbd7b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.282768 Oct 11 04:32:31.103604 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2285/4809] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:30 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:31.120374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5e0e70b4-1fc9-414a-aa72-6211a60c322b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:31.125947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5e0e70b4-1fc9-414a-aa72-6211a60c322b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:31.136470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e0e70b4-1fc9-414a-aa72-6211a60c322b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:31.136990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e0e70b4-1fc9-414a-aa72-6211a60c322b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:31.137429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e0e70b4-1fc9-414a-aa72-6211a60c322b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:31.138128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e0e70b4-1fc9-414a-aa72-6211a60c322b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:31.138759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e0e70b4-1fc9-414a-aa72-6211a60c322b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:31.139337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e0e70b4-1fc9-414a-aa72-6211a60c322b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:31.342294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e0e70b4-1fc9-414a-aa72-6211a60c322b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:31.352567 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5e0e70b4-1fc9-414a-aa72-6211a60c322b tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1674 microversion: 2.1 time: 0.245361 Oct 11 04:32:31.353647 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2286/4810] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:31 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1674 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:31.361635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-84cca517-eda9-4ee4-9e8d-8c9c33fd24b8 req-b0c29edf-72db-4e4d-8402-ceef6adbc35f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "169d9577-af83-4ba6-b89a-ae0e5cc989a5", "tag": "6a9378f4-c8df-4092-a9b6-df8b7a008287"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:31.374538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-84cca517-eda9-4ee4-9e8d-8c9c33fd24b8 req-b0c29edf-72db-4e4d-8402-ceef6adbc35f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:31.375022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-84cca517-eda9-4ee4-9e8d-8c9c33fd24b8 req-b0c29edf-72db-4e4d-8402-ceef6adbc35f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:31.375462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-84cca517-eda9-4ee4-9e8d-8c9c33fd24b8 req-b0c29edf-72db-4e4d-8402-ceef6adbc35f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:31.388731 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-84cca517-eda9-4ee4-9e8d-8c9c33fd24b8 req-b0c29edf-72db-4e4d-8402-ceef6adbc35f service nova] Creating event network-changed:6a9378f4-c8df-4092-a9b6-df8b7a008287 for instance 169d9577-af83-4ba6-b89a-ae0e5cc989a5 on n-h2-860892-1 Oct 11 04:32:31.397665 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-84cca517-eda9-4ee4-9e8d-8c9c33fd24b8 req-b0c29edf-72db-4e4d-8402-ceef6adbc35f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041547 Oct 11 04:32:31.398897 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2287/4811] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:31.406125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:31.406878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:31.415327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:31.416484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:31.417426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:31.418867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:31.419860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:31.420782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:31.617468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:31.626515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:31.629170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:31.630460 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d538436c-487e-420a-92e9-ab1941426e0c tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1362 microversion: 2.26 time: 0.229940 Oct 11 04:32:31.635300 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2288/4812] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:31 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1362 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:31.641373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8cabda4-cb09-4841-92b7-cda9ba615243 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:31.642154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d8cabda4-cb09-4841-92b7-cda9ba615243 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:31.649824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8cabda4-cb09-4841-92b7-cda9ba615243 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:31.650360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8cabda4-cb09-4841-92b7-cda9ba615243 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:31.650819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8cabda4-cb09-4841-92b7-cda9ba615243 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:31.651520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8cabda4-cb09-4841-92b7-cda9ba615243 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:31.652536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8cabda4-cb09-4841-92b7-cda9ba615243 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:31.652536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8cabda4-cb09-4841-92b7-cda9ba615243 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:31.826597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d8cabda4-cb09-4841-92b7-cda9ba615243 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:31.836168 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8cabda4-cb09-4841-92b7-cda9ba615243 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.199792 Oct 11 04:32:31.836830 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2289/4813] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:31 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:32.048615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:32.077876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:32.129311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8ed30aeb-4895-4e9b-b478-eb7a4915519e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:32.130727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8ed30aeb-4895-4e9b-b478-eb7a4915519e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:32.138915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ed30aeb-4895-4e9b-b478-eb7a4915519e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:32.139437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ed30aeb-4895-4e9b-b478-eb7a4915519e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:32.142517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ed30aeb-4895-4e9b-b478-eb7a4915519e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:32.142517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ed30aeb-4895-4e9b-b478-eb7a4915519e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:32.142517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ed30aeb-4895-4e9b-b478-eb7a4915519e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:32.142517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ed30aeb-4895-4e9b-b478-eb7a4915519e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:32.777578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8ed30aeb-4895-4e9b-b478-eb7a4915519e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:32.791400 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8ed30aeb-4895-4e9b-b478-eb7a4915519e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.664020 Oct 11 04:32:32.798480 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2290/4814] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:32 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:32.809135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-759459e0-3304-40cf-9631-c9ca2a8d23ea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:32.809954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-759459e0-3304-40cf-9631-c9ca2a8d23ea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:32.824640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-759459e0-3304-40cf-9631-c9ca2a8d23ea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:32.827032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-759459e0-3304-40cf-9631-c9ca2a8d23ea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:32.827492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-759459e0-3304-40cf-9631-c9ca2a8d23ea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:32.828264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-759459e0-3304-40cf-9631-c9ca2a8d23ea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:32.828731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-759459e0-3304-40cf-9631-c9ca2a8d23ea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:32.829634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-759459e0-3304-40cf-9631-c9ca2a8d23ea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:32.857069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:33.068239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-759459e0-3304-40cf-9631-c9ca2a8d23ea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:33.083198 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-759459e0-3304-40cf-9631-c9ca2a8d23ea tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1674 microversion: 2.1 time: 0.276572 Oct 11 04:32:33.083198 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2291/4815] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:32 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1674 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:33.087492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:33.088245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:33.094950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:33.096158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:33.096830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:33.097930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:33.098618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:33.099278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:33.124272 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b0830ba-b6f2-444a-b819-64fc75647281 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] 10.222.0.26 "POST /compute/v2.1/os-floating-ips" status: 200 len: 142 microversion: 2.1 time: 2.495623 Oct 11 04:32:33.125164 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2525/4816] 10.222.0.26 () {60 vars in 1170 bytes} [Tue Oct 11 04:32:30 2022] POST /compute/v2.1/os-floating-ips => generated 142 bytes in 2497 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:33.141324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-28858b6f-0550-438a-8559-a00df28171b7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:33.143333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-28858b6f-0550-438a-8559-a00df28171b7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:33.152202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28858b6f-0550-438a-8559-a00df28171b7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:33.152940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28858b6f-0550-438a-8559-a00df28171b7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:33.153551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28858b6f-0550-438a-8559-a00df28171b7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:33.155075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28858b6f-0550-438a-8559-a00df28171b7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:33.155754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28858b6f-0550-438a-8559-a00df28171b7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:33.156485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28858b6f-0550-438a-8559-a00df28171b7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:33.386073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:33.390159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-28858b6f-0550-438a-8559-a00df28171b7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:33.408266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:33.409399 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-28858b6f-0550-438a-8559-a00df28171b7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.273805 Oct 11 04:32:33.409707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:33.411105 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2526/4817] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:33 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:33.417987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-81bd5dc6-eae6-48f0-b5a7-93e51e24c552 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] Calling method '.version_select at 0x7fda1e0ea0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:33.431844 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-74ad6f76-c836-4a62-837f-9afb57c902f8 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1362 microversion: 2.26 time: 0.352728 Oct 11 04:32:33.437159 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2292/4818] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:33 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1362 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:33.457289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-38ede4a9-3784-49d0-a577-88d02376388e req-34382243-5106-46f1-aa08-3e991c14ae3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f249f1b-29b6-41f0-9917-551729acc982", "tag": "6c0f99dc-4582-45a3-bdba-f7254fbe6fb8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:33.462940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:33.474209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-38ede4a9-3784-49d0-a577-88d02376388e req-34382243-5106-46f1-aa08-3e991c14ae3a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:33.474747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-38ede4a9-3784-49d0-a577-88d02376388e req-34382243-5106-46f1-aa08-3e991c14ae3a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:33.482800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-38ede4a9-3784-49d0-a577-88d02376388e req-34382243-5106-46f1-aa08-3e991c14ae3a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:33.509972 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-38ede4a9-3784-49d0-a577-88d02376388e req-34382243-5106-46f1-aa08-3e991c14ae3a service nova] Creating event network-changed:6c0f99dc-4582-45a3-bdba-f7254fbe6fb8 for instance 6f249f1b-29b6-41f0-9917-551729acc982 on n-h2-860892-1 Oct 11 04:32:33.519960 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-38ede4a9-3784-49d0-a577-88d02376388e req-34382243-5106-46f1-aa08-3e991c14ae3a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072387 Oct 11 04:32:33.521241 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2293/4819] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:33.720520 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-81bd5dc6-eae6-48f0-b5a7-93e51e24c552 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips/d999c127-65b3-43da-84d0-e810d894adf5" status: 200 len: 142 microversion: 2.1 time: 0.308126 Oct 11 04:32:33.721361 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2527/4820] 10.222.0.26 () {58 vars in 1260 bytes} [Tue Oct 11 04:32:33 2022] GET /compute/v2.1/os-floating-ips/d999c127-65b3-43da-84d0-e810d894adf5 => generated 142 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:33.734927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b1e5856a-3864-4e90-9b96-9a290b80bdcf tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] Calling method '.version_select at 0x7fda18a7f040>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:33.815268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a7d7f24-0b3b-403e-b860-39a922985afc tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:33.815894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a7d7f24-0b3b-403e-b860-39a922985afc tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:33.822448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a7d7f24-0b3b-403e-b860-39a922985afc tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:33.823258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a7d7f24-0b3b-403e-b860-39a922985afc tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:33.823703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a7d7f24-0b3b-403e-b860-39a922985afc tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:33.824608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a7d7f24-0b3b-403e-b860-39a922985afc tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:33.825069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a7d7f24-0b3b-403e-b860-39a922985afc tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:33.825673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a7d7f24-0b3b-403e-b860-39a922985afc tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:34.063786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3a7d7f24-0b3b-403e-b860-39a922985afc tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:34.073665 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a7d7f24-0b3b-403e-b860-39a922985afc tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.262223 Oct 11 04:32:34.074509 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2528/4821] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:33 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:34.101575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-522456c8-eef7-460a-b5e9-46d3a9125d6e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:34.102455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-522456c8-eef7-460a-b5e9-46d3a9125d6e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:34.111468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-522456c8-eef7-460a-b5e9-46d3a9125d6e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:34.112341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-522456c8-eef7-460a-b5e9-46d3a9125d6e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:34.112733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-522456c8-eef7-460a-b5e9-46d3a9125d6e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:34.117242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-522456c8-eef7-460a-b5e9-46d3a9125d6e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:34.117982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-522456c8-eef7-460a-b5e9-46d3a9125d6e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:34.118799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-522456c8-eef7-460a-b5e9-46d3a9125d6e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:34.320445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-522456c8-eef7-460a-b5e9-46d3a9125d6e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:34.330465 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-522456c8-eef7-460a-b5e9-46d3a9125d6e tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1606 microversion: 2.1 time: 0.233128 Oct 11 04:32:34.331977 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2529/4822] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:34 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1606 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:34.339390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b48fffb8-a2d1-47b4-820d-fc1fd2a6c623 req-15f5993e-8146-4680-b8d8-1228a887d205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d32f0ab1-346d-487a-aa08-ebd1656142a7", "name": "network-vif-deleted", "tag": "6993adde-be55-4ee5-a441-ab52e2f48759"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:34.360819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b48fffb8-a2d1-47b4-820d-fc1fd2a6c623 req-15f5993e-8146-4680-b8d8-1228a887d205 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:34.361318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b48fffb8-a2d1-47b4-820d-fc1fd2a6c623 req-15f5993e-8146-4680-b8d8-1228a887d205 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:34.361821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b48fffb8-a2d1-47b4-820d-fc1fd2a6c623 req-15f5993e-8146-4680-b8d8-1228a887d205 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:34.375945 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b48fffb8-a2d1-47b4-820d-fc1fd2a6c623 req-15f5993e-8146-4680-b8d8-1228a887d205 service nova] Creating event network-vif-deleted:6993adde-be55-4ee5-a441-ab52e2f48759 for instance d32f0ab1-346d-487a-aa08-ebd1656142a7 on n-h2-860892-1 Oct 11 04:32:34.381876 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b48fffb8-a2d1-47b4-820d-fc1fd2a6c623 req-15f5993e-8146-4680-b8d8-1228a887d205 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047770 Oct 11 04:32:34.382492 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2530/4823] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:34.434029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b68875a1-b6a4-46c2-b968-78f6bebfa3bc tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:34.435613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b68875a1-b6a4-46c2-b968-78f6bebfa3bc tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:34.442511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b68875a1-b6a4-46c2-b968-78f6bebfa3bc tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:34.443342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b68875a1-b6a4-46c2-b968-78f6bebfa3bc tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:34.444377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b68875a1-b6a4-46c2-b968-78f6bebfa3bc tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:34.445154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b68875a1-b6a4-46c2-b968-78f6bebfa3bc tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:34.445683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b68875a1-b6a4-46c2-b968-78f6bebfa3bc tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:34.446406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b68875a1-b6a4-46c2-b968-78f6bebfa3bc tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:34.599422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b68875a1-b6a4-46c2-b968-78f6bebfa3bc tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:34.608946 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b68875a1-b6a4-46c2-b968-78f6bebfa3bc tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.179140 Oct 11 04:32:34.609732 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2531/4824] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:34 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:34.620610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:34.621273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:34.629420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:34.629922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:34.630438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:34.631666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:34.633718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:34.633718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:34.811735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:34.821241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:34.824003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:34.825341 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-caf291b2-7bf4-432e-a986-7cf4eccedab5 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1362 microversion: 2.26 time: 0.210403 Oct 11 04:32:34.830269 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2532/4825] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:34 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1362 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:35.038393 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b1e5856a-3864-4e90-9b96-9a290b80bdcf tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/d999c127-65b3-43da-84d0-e810d894adf5" status: 202 len: 0 microversion: 2.1 time: 1.299281 Oct 11 04:32:35.038393 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2294/4826] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:32:33 2022] DELETE /compute/v2.1/os-floating-ips/d999c127-65b3-43da-84d0-e810d894adf5 => generated 0 bytes in 1301 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:32:35.048052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b99a6c4b-8e17-4374-bb4a-f0cf09abb932 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] Calling method '.version_select at 0x7fda193ce5e0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:35.100224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-70e3a9d8-9f99-421f-9696-1afb77716f5b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:35.100989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-70e3a9d8-9f99-421f-9696-1afb77716f5b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:35.110767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70e3a9d8-9f99-421f-9696-1afb77716f5b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:35.112849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70e3a9d8-9f99-421f-9696-1afb77716f5b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:35.118331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70e3a9d8-9f99-421f-9696-1afb77716f5b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:35.118331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70e3a9d8-9f99-421f-9696-1afb77716f5b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:35.118331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70e3a9d8-9f99-421f-9696-1afb77716f5b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:35.118331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70e3a9d8-9f99-421f-9696-1afb77716f5b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:35.291994 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b99a6c4b-8e17-4374-bb4a-f0cf09abb932 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ip-pools" status: 200 len: 43 microversion: 2.1 time: 0.249597 Oct 11 04:32:35.292635 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2533/4827] 10.222.0.26 () {58 vars in 1164 bytes} [Tue Oct 11 04:32:35 2022] GET /compute/v2.1/os-floating-ip-pools => generated 43 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 04:32:35.303396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db8162d0-1b0d-4372-b2ce-760f570046ff tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] Calling method '.version_select at 0x7fda193ce9d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:35.361639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-70e3a9d8-9f99-421f-9696-1afb77716f5b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:35.370028 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-70e3a9d8-9f99-421f-9696-1afb77716f5b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.275763 Oct 11 04:32:35.371052 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2295/4828] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:35 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:35.379350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:35.380256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:35.394453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:35.399285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:35.402935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:35.403380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:35.404113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:35.404565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:35.404990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:35.457205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:35.457963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:35.458659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:35.459897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lazy-loading 'fault' on Instance uuid d32f0ab1-346d-487a-aa08-ebd1656142a7 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:35.515775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5feceb4a60434064a4fd08f7cc637f32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9a2974866e964ca2864c978d2270bd77', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:35.524825 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-de04a93f-40e1-44f5-848b-2137f6020204 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 200 len: 1327 microversion: 2.1 time: 0.152676 Oct 11 04:32:35.525414 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2296/4829] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:35 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 1327 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:35.574652 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-db8162d0-1b0d-4372-b2ce-760f570046ff tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] 10.222.0.26 "GET /compute/v2.1/os-floating-ips" status: 200 len: 397 microversion: 2.1 time: 0.275057 Oct 11 04:32:35.575943 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2534/4830] 10.222.0.26 () {58 vars in 1149 bytes} [Tue Oct 11 04:32:35 2022] GET /compute/v2.1/os-floating-ips => generated 397 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:32:35.591064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c302ce1d-7d03-46ac-b8de-5193c583f95e tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] Calling method '.version_select at 0x7fda18add280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:35.634005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3f5e9382-5e82-40d6-b7eb-50d456db9c28 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:35.635209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3f5e9382-5e82-40d6-b7eb-50d456db9c28 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:35.650709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f5e9382-5e82-40d6-b7eb-50d456db9c28 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:35.651479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f5e9382-5e82-40d6-b7eb-50d456db9c28 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:35.651975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f5e9382-5e82-40d6-b7eb-50d456db9c28 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:35.652802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f5e9382-5e82-40d6-b7eb-50d456db9c28 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:35.653316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f5e9382-5e82-40d6-b7eb-50d456db9c28 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:35.653786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f5e9382-5e82-40d6-b7eb-50d456db9c28 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:35.661292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:35.862839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3f5e9382-5e82-40d6-b7eb-50d456db9c28 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:35.871735 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3f5e9382-5e82-40d6-b7eb-50d456db9c28 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.243311 Oct 11 04:32:35.872438 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2535/4831] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:35 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:35.877139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:35.877848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:35.884712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:35.885304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:35.885851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:35.886724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:35.887473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:35.888132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:36.093313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:36.102687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:36.104156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:36.105525 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d7299c6-316e-48cd-8d9d-a14dab634464 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1362 microversion: 2.26 time: 0.232066 Oct 11 04:32:36.106087 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2536/4832] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:35 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:36.393547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e56f14df-8dce-4818-b9b2-949eee748473 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:36.394371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e56f14df-8dce-4818-b9b2-949eee748473 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:36.397343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:36.403191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f14df-8dce-4818-b9b2-949eee748473 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:36.403894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f14df-8dce-4818-b9b2-949eee748473 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:36.404496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f14df-8dce-4818-b9b2-949eee748473 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:36.405206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f14df-8dce-4818-b9b2-949eee748473 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:36.405668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f14df-8dce-4818-b9b2-949eee748473 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:36.406162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f14df-8dce-4818-b9b2-949eee748473 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:36.515885 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c302ce1d-7d03-46ac-b8de-5193c583f95e tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/3f0c02c6-bf9f-4ece-b3da-857e8cd32d90" status: 202 len: 0 microversion: 2.1 time: 0.928751 Oct 11 04:32:36.516638 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2297/4833] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:32:35 2022] DELETE /compute/v2.1/os-floating-ips/3f0c02c6-bf9f-4ece-b3da-857e8cd32d90 => generated 0 bytes in 930 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:32:36.529494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-677f4bf9-08d3-4021-a3e9-3a16c6597d19 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] Calling method '.version_select at 0x7fda18a06160>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:36.862354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e56f14df-8dce-4818-b9b2-949eee748473 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:36.872599 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e56f14df-8dce-4818-b9b2-949eee748473 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.481956 Oct 11 04:32:36.874066 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2537/4834] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:36 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:36.896963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:36.897973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] [instance: d32f0ab1-346d-487a-aa08-ebd1656142a7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:36.904111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:36.904797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:36.905241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:36.905950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:36.906440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:36.906870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:36.926268 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] HTTP exception thrown: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 could not be found. Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Request method failure captured: Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 HTTP/1.1 Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRO_RCh7y3VCR0ZGCz57mMkPYBNk7QiIVp9XuBnd-Uehf82A4vup9lXbNXCqWQjVjFhMOhYa9RyLqNtdWCz0WKBx8po-RawVJL-JciajTijLf7lVKUU9Uul6vpelbjCSaCgmT83upn5D4faXHmtAf4nXZcwDOtKbLho_1_PIpYNLAs5s Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9a2974866e964ca2864c978d2270bd77"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9a2974866e964ca2864c978d2270bd77"}]}] Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9a2974866e964ca2864c978d2270bd77 Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerActionsTestJSON-1308788021 Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5feceb4a60434064a4fd08f7cc637f32 Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerActionsTestJSON-1308788021-project Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 could not be found. Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'd32f0ab1-346d-487a-aa08-ebd1656142a7'} Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 could not be found. Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 could not be found. Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:36.928585 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:36.932803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:36.932803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:36.932803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:36.932803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:36.932803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:36.932803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 could not be found. Oct 11 04:32:36.932803 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:36.932803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Returning 404 to user: Instance d32f0ab1-346d-487a-aa08-ebd1656142a7 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:36.932803 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2cc5cd18-b1fb-4189-83f8-85514012b183 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7" status: 404 len: 111 microversion: 2.1 time: 0.041647 Oct 11 04:32:36.935460 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2538/4835] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:36 2022] GET /compute/v2.1/servers/d32f0ab1-346d-487a-aa08-ebd1656142a7 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:32:36.945526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5bc6052-4f80-4d7d-af05-8e2a785800ff tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:36.945526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5bc6052-4f80-4d7d-af05-8e2a785800ff tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:36.955634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6052-4f80-4d7d-af05-8e2a785800ff tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:36.956132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6052-4f80-4d7d-af05-8e2a785800ff tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:36.956576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6052-4f80-4d7d-af05-8e2a785800ff tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:36.957297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6052-4f80-4d7d-af05-8e2a785800ff tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:36.957729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6052-4f80-4d7d-af05-8e2a785800ff tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:36.958155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bc6052-4f80-4d7d-af05-8e2a785800ff tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:37.157721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5bc6052-4f80-4d7d-af05-8e2a785800ff tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:37.173653 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5bc6052-4f80-4d7d-af05-8e2a785800ff tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.233454 Oct 11 04:32:37.179352 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2539/4836] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:36 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:37.184836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fe7bab71-efa5-43b9-a379-6280113c7265 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] Calling method '.version_select at 0x7fda1a31df70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:37.278326 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fe7bab71-efa5-43b9-a379-6280113c7265 tempest-ServerActionsTestJSON-1308788021 tempest-ServerActionsTestJSON-1308788021-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-427074894" status: 202 len: 0 microversion: 2.1 time: 0.097110 Oct 11 04:32:37.278918 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2540/4837] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-427074894 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:32:37.283534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:37.284151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:37.290661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:37.291119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:37.291557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:37.292263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:37.292720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:37.293159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:37.435479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:37.446569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:37.448144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:37.450122 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f01010c4-1bb0-4d1b-ac1f-bf82da29af99 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1362 microversion: 2.26 time: 0.170200 Oct 11 04:32:37.450792 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2541/4838] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:37 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1362 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:37.519894 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-677f4bf9-08d3-4021-a3e9-3a16c6597d19 tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/5fc247c8-24b1-4ccf-8d14-60b7f05ba221" status: 202 len: 0 microversion: 2.1 time: 0.997477 Oct 11 04:32:37.522067 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2298/4839] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:32:36 2022] DELETE /compute/v2.1/os-floating-ips/5fc247c8-24b1-4ccf-8d14-60b7f05ba221 => generated 0 bytes in 1001 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:32:37.530122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2fddcf87-857d-4bfa-bccb-1595bc58b41c tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] Calling method '.version_select at 0x7fda18ec94c0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:37.902731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-121b59db-a6ad-4bd8-8697-ce8d532b5007 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:37.903611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-121b59db-a6ad-4bd8-8697-ce8d532b5007 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:37.915913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-121b59db-a6ad-4bd8-8697-ce8d532b5007 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:37.918529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-121b59db-a6ad-4bd8-8697-ce8d532b5007 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:37.919057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-121b59db-a6ad-4bd8-8697-ce8d532b5007 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:37.919848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-121b59db-a6ad-4bd8-8697-ce8d532b5007 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:37.922706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-121b59db-a6ad-4bd8-8697-ce8d532b5007 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:37.923258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-121b59db-a6ad-4bd8-8697-ce8d532b5007 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:38.090909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-121b59db-a6ad-4bd8-8697-ce8d532b5007 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:38.100830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-121b59db-a6ad-4bd8-8697-ce8d532b5007 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.202769 Oct 11 04:32:38.101409 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2299/4840] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:37 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:38.203711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a003f242-5e2b-4c20-b926-766f451b0527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:38.204353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a003f242-5e2b-4c20-b926-766f451b0527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:38.211039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a003f242-5e2b-4c20-b926-766f451b0527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:38.215915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a003f242-5e2b-4c20-b926-766f451b0527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:38.215915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a003f242-5e2b-4c20-b926-766f451b0527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:38.215915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a003f242-5e2b-4c20-b926-766f451b0527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:38.215915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a003f242-5e2b-4c20-b926-766f451b0527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:38.215915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a003f242-5e2b-4c20-b926-766f451b0527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:38.382016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a003f242-5e2b-4c20-b926-766f451b0527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:38.391044 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a003f242-5e2b-4c20-b926-766f451b0527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.192203 Oct 11 04:32:38.391630 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2300/4841] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:38 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:38.478281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:38.478898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:38.486816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:38.486816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:38.488355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:38.489654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:38.490884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:38.491323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:38.639322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:38.648431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:38.650335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:38.651796 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9971e29-e11b-45c8-871b-fd3f1c71fbcd tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1362 microversion: 2.26 time: 0.178944 Oct 11 04:32:38.652974 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2301/4842] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:38 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:32:38.740722 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2fddcf87-857d-4bfa-bccb-1595bc58b41c tempest-FloatingIPDetailsTestJSON-78590780 tempest-FloatingIPDetailsTestJSON-78590780-project] 10.222.0.26 "DELETE /compute/v2.1/os-floating-ips/28a0cfd8-1080-4f90-852c-4e26acd42094" status: 202 len: 0 microversion: 2.1 time: 1.214325 Oct 11 04:32:38.741320 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2542/4843] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:32:37 2022] DELETE /compute/v2.1/os-floating-ips/28a0cfd8-1080-4f90-852c-4e26acd42094 => generated 0 bytes in 1216 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:32:39.133883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b735eaa5-5de0-463d-a24c-2c83709f14e5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:39.134942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b735eaa5-5de0-463d-a24c-2c83709f14e5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:39.145545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b735eaa5-5de0-463d-a24c-2c83709f14e5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:39.148296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b735eaa5-5de0-463d-a24c-2c83709f14e5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:39.148296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b735eaa5-5de0-463d-a24c-2c83709f14e5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:39.149073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b735eaa5-5de0-463d-a24c-2c83709f14e5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:39.150062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b735eaa5-5de0-463d-a24c-2c83709f14e5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:39.151481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b735eaa5-5de0-463d-a24c-2c83709f14e5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:39.175302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-ad396e0f-dfdc-428e-b53e-c209deaaf45c req-0aaec8d9-49b2-495d-8257-b8423ee8375c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169d9577-af83-4ba6-b89a-ae0e5cc989a5", "name": "network-vif-plugged", "status": "completed", "tag": "6a9378f4-c8df-4092-a9b6-df8b7a008287"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:39.195151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ad396e0f-dfdc-428e-b53e-c209deaaf45c req-0aaec8d9-49b2-495d-8257-b8423ee8375c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:39.196715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ad396e0f-dfdc-428e-b53e-c209deaaf45c req-0aaec8d9-49b2-495d-8257-b8423ee8375c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:39.197612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ad396e0f-dfdc-428e-b53e-c209deaaf45c req-0aaec8d9-49b2-495d-8257-b8423ee8375c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:39.215106 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-ad396e0f-dfdc-428e-b53e-c209deaaf45c req-0aaec8d9-49b2-495d-8257-b8423ee8375c service nova] Creating event network-vif-plugged:6a9378f4-c8df-4092-a9b6-df8b7a008287 for instance 169d9577-af83-4ba6-b89a-ae0e5cc989a5 on n-h2-860892-1 Oct 11 04:32:39.222579 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-ad396e0f-dfdc-428e-b53e-c209deaaf45c req-0aaec8d9-49b2-495d-8257-b8423ee8375c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050551 Oct 11 04:32:39.224005 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2543/4844] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:32:39.421081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5b8fdca3-4246-41fb-b990-109abfbde217 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:39.421812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5b8fdca3-4246-41fb-b990-109abfbde217 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:39.430703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b8fdca3-4246-41fb-b990-109abfbde217 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:39.434515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b8fdca3-4246-41fb-b990-109abfbde217 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:39.434515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b8fdca3-4246-41fb-b990-109abfbde217 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:39.434515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b8fdca3-4246-41fb-b990-109abfbde217 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:39.434515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b8fdca3-4246-41fb-b990-109abfbde217 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:39.434515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b8fdca3-4246-41fb-b990-109abfbde217 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:39.638013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b735eaa5-5de0-463d-a24c-2c83709f14e5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:39.656651 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b735eaa5-5de0-463d-a24c-2c83709f14e5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.528855 Oct 11 04:32:39.658330 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2302/4845] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:39 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:39.688074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:39.689064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:39.701258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:39.701258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:39.701258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:39.702770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:39.704008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:39.704628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:39.739955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5b8fdca3-4246-41fb-b990-109abfbde217 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:39.749791 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5b8fdca3-4246-41fb-b990-109abfbde217 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.334377 Oct 11 04:32:39.751042 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2544/4846] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:39 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:40.053930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:40.062612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:40.064080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:40.065245 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ea6a011-b27c-4d17-b7b0-7598f9243abb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1362 microversion: 2.26 time: 0.383897 Oct 11 04:32:40.078209 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2303/4847] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:39 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1362 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:40.684563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d493b90a-5c77-4f45-b992-a6bc5a8cdbee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:40.685201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d493b90a-5c77-4f45-b992-a6bc5a8cdbee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:40.693044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d493b90a-5c77-4f45-b992-a6bc5a8cdbee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:40.693792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d493b90a-5c77-4f45-b992-a6bc5a8cdbee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:40.694291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d493b90a-5c77-4f45-b992-a6bc5a8cdbee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:40.695204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d493b90a-5c77-4f45-b992-a6bc5a8cdbee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:40.695680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d493b90a-5c77-4f45-b992-a6bc5a8cdbee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:40.696104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d493b90a-5c77-4f45-b992-a6bc5a8cdbee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:40.782717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c1cd9f40-7b21-40c2-9f75-d93f6b3c2d41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:40.784786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c1cd9f40-7b21-40c2-9f75-d93f6b3c2d41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:40.795935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1cd9f40-7b21-40c2-9f75-d93f6b3c2d41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:40.796715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1cd9f40-7b21-40c2-9f75-d93f6b3c2d41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:40.797413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1cd9f40-7b21-40c2-9f75-d93f6b3c2d41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:40.798397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1cd9f40-7b21-40c2-9f75-d93f6b3c2d41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:40.799147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1cd9f40-7b21-40c2-9f75-d93f6b3c2d41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:40.799946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1cd9f40-7b21-40c2-9f75-d93f6b3c2d41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:40.881119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d493b90a-5c77-4f45-b992-a6bc5a8cdbee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:40.889546 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d493b90a-5c77-4f45-b992-a6bc5a8cdbee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.208815 Oct 11 04:32:40.890142 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2545/4848] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:40 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:41.093476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:41.094352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:41.094796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c1cd9f40-7b21-40c2-9f75-d93f6b3c2d41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:41.108280 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c1cd9f40-7b21-40c2-9f75-d93f6b3c2d41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.329730 Oct 11 04:32:41.108557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.109232 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2304/4849] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:40 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:41.109612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.110272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.111163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.111794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.112384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.274545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:41.286394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:41.286394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:41.287719 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0b581fe2-69aa-4742-963c-5b682a750dcb tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1547 microversion: 2.26 time: 0.198813 Oct 11 04:32:41.288402 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2546/4850] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:41 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1547 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:41.313865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda19282dc0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:41.325269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.325687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.326132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.326660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:41.332592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.333090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.333528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.334786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.335242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.335683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.363493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.364425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.364883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.379316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.379805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.380497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.523405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:41.540213 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5b91925d-b965-4541-9df6-1d28fc1f5488 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1906943133" status: 201 len: 0 microversion: 2.26 time: 0.230464 Oct 11 04:32:41.541197 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2305/4851] 10.222.0.26 () {62 vars in 1380 bytes} [Tue Oct 11 04:32:41 2022] PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1906943133 => generated 0 bytes in 232 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 11 04:32:41.552749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5730c363-a832-45fd-8a93-d1adf8a68b6a tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda18daa4c0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:41.559065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5730c363-a832-45fd-8a93-d1adf8a68b6a tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.559638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5730c363-a832-45fd-8a93-d1adf8a68b6a tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.560163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5730c363-a832-45fd-8a93-d1adf8a68b6a tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.576482 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5730c363-a832-45fd-8a93-d1adf8a68b6a tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1906943133" status: 204 len: 0 microversion: 2.26 time: 0.029598 Oct 11 04:32:41.577709 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2547/4852] 10.222.0.26 () {60 vars in 1361 bytes} [Tue Oct 11 04:32:41 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1906943133 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:32:41.592918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda191e9ee0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:41.595179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.595855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.596302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.596787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:41.602765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.603259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.603701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.604441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.604870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.605300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.632548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.633040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.633482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.759132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:41.777736 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-80dfaaf6-6597-4aaf-a896-43dc11c1ebd3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags" status: 204 len: 0 microversion: 2.26 time: 0.195466 Oct 11 04:32:41.779079 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2306/4853] 10.222.0.26 () {60 vars in 1295 bytes} [Tue Oct 11 04:32:41 2022] DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 04:32:41.788686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a609826b-1e13-4a1f-9689-1274e6898725 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda18daaf70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:41.798794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a609826b-1e13-4a1f-9689-1274e6898725 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.799289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a609826b-1e13-4a1f-9689-1274e6898725 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.799998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a609826b-1e13-4a1f-9689-1274e6898725 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.822058 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a609826b-1e13-4a1f-9689-1274e6898725 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags" status: 200 len: 12 microversion: 2.26 time: 0.037126 Oct 11 04:32:41.827901 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2548/4854] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 11 04:32:41 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags => generated 12 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:41.843463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda18a130d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:41.848547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.849038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.849847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.850519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:41.858032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.858986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.859626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.860410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.861430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.861863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.894273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.894995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.895595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.905658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.906285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.906671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.914461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4629741a-4895-4366-b6cf-c1329bb20481 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:41.918813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=94,nova_cell1:SAVEPOINT=2,nova_cell1:INSERT=2,nova_cell1:RELEASE=1,nova_cell1:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:41.923698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4629741a-4895-4366-b6cf-c1329bb20481 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:41.942305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629741a-4895-4366-b6cf-c1329bb20481 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.942976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629741a-4895-4366-b6cf-c1329bb20481 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.944017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629741a-4895-4366-b6cf-c1329bb20481 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.944764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629741a-4895-4366-b6cf-c1329bb20481 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:41.946154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629741a-4895-4366-b6cf-c1329bb20481 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:41.946154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4629741a-4895-4366-b6cf-c1329bb20481 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:41.992838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:42.010334 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8077b94f-6ad2-4c03-a908-c4bcf3015679 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1517262820" status: 201 len: 0 microversion: 2.26 time: 0.181070 Oct 11 04:32:42.011079 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2307/4855] 10.222.0.26 () {62 vars in 1380 bytes} [Tue Oct 11 04:32:41 2022] PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1517262820 => generated 0 bytes in 183 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 11 04:32:42.021340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c26393ba-76b7-41a0-9104-6c89d2c0154a tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda19148a60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:42.029808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c26393ba-76b7-41a0-9104-6c89d2c0154a tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.030455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c26393ba-76b7-41a0-9104-6c89d2c0154a tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.031069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c26393ba-76b7-41a0-9104-6c89d2c0154a tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.041188 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c26393ba-76b7-41a0-9104-6c89d2c0154a tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags" status: 200 len: 36 microversion: 2.26 time: 0.024155 Oct 11 04:32:42.043721 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2308/4856] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 11 04:32:42 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags => generated 36 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:42.053844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda18a135e0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:42.064174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.065057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.065864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.067184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:42.074832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.075858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.076545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.077248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.083127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.084296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.113196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.113779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.114249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.139878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4629741a-4895-4366-b6cf-c1329bb20481 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:42.149543 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4629741a-4895-4366-b6cf-c1329bb20481 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.239729 Oct 11 04:32:42.150364 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2549/4857] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:41 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:42.156532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eaec7f87-8834-49af-861d-fb7df71843de tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:42.157372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eaec7f87-8834-49af-861d-fb7df71843de tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:42.164403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaec7f87-8834-49af-861d-fb7df71843de tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.165115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaec7f87-8834-49af-861d-fb7df71843de tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.165707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaec7f87-8834-49af-861d-fb7df71843de tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.166631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaec7f87-8834-49af-861d-fb7df71843de tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.167244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaec7f87-8834-49af-861d-fb7df71843de tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.167833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eaec7f87-8834-49af-861d-fb7df71843de tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.214869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:42.232777 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ada3899c-1049-44a2-8c59-953390208207 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1517262820" status: 204 len: 0 microversion: 2.26 time: 0.183376 Oct 11 04:32:42.233874 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2309/4858] 10.222.0.26 () {60 vars in 1364 bytes} [Tue Oct 11 04:32:42 2022] DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1517262820 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 11 04:32:42.244801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3175b13-e614-4265-93c5-b902ba6cca64 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda19a02550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:42.254178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3175b13-e614-4265-93c5-b902ba6cca64 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.254919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3175b13-e614-4265-93c5-b902ba6cca64 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.255589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3175b13-e614-4265-93c5-b902ba6cca64 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.272986 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3175b13-e614-4265-93c5-b902ba6cca64 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags" status: 200 len: 12 microversion: 2.26 time: 0.032139 Oct 11 04:32:42.274154 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2310/4859] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 11 04:32:42 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags => generated 12 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:42.286073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda18a13820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:42.299219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.299219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.299219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.299219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:42.307090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.307576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.308004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.309319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.309930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.311097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.338577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.339375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.340066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.352392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:42.369674 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f71a1def-101c-4ef9-a727-28cee293fcce tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags" status: 204 len: 0 microversion: 2.26 time: 0.087768 Oct 11 04:32:42.370860 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2311/4860] 10.222.0.26 () {60 vars in 1295 bytes} [Tue Oct 11 04:32:42 2022] DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:32:42.380376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda18a13dc0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:42.392311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.393225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.393862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.394847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:42.402391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.402874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.403438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.404501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.404727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.405329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.437088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.437615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.438054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.447896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.448249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eaec7f87-8834-49af-861d-fb7df71843de tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:42.448374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.448790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.457722 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eaec7f87-8834-49af-861d-fb7df71843de tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.306180 Oct 11 04:32:42.459318 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2550/4861] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:42 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:42.527119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:42.554417 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ba55739-ec0d-4e3a-a3a8-cbfee5e1df59 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-540480290" status: 201 len: 0 microversion: 2.26 time: 0.178154 Oct 11 04:32:42.566435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda190c6310>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:42.571414 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2312/4862] 10.222.0.26 () {62 vars in 1377 bytes} [Tue Oct 11 04:32:42 2022] PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-540480290 => generated 0 bytes in 195 msecs (HTTP/1.1 201) 10 headers in 485 bytes (1 switches on core 0) Oct 11 04:32:42.579965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.580756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.581583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.582253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:42.590287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.591933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.592593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.593882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.594589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.596439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.645283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.646764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.647843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.660813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.661556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.663928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.798135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:42.833549 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e82282ce-b481-47b6-b4f4-1d0943cc6f08 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1930796490" status: 201 len: 0 microversion: 2.26 time: 0.271270 Oct 11 04:32:42.838408 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2551/4863] 10.222.0.26 () {62 vars in 1380 bytes} [Tue Oct 11 04:32:42 2022] PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1930796490 => generated 0 bytes in 276 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 11 04:32:42.847051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda18a25940>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:42.865626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.866621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.867929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.869363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:42.879057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.880223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.881736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.882760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.885117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.886174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:42.920784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:42.921905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:42.923380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.024099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:43.071243 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9017e2d3-d062-481f-8c34-df3277e061bf tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags" status: 204 len: 0 microversion: 2.26 time: 0.228292 Oct 11 04:32:43.074368 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2313/4864] 10.222.0.26 () {60 vars in 1295 bytes} [Tue Oct 11 04:32:42 2022] DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags => generated 0 bytes in 234 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:32:43.082837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ac8e93ec-4e98-49b0-9e34-c27d5d3b14b2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda18ee8f70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:43.098645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac8e93ec-4e98-49b0-9e34-c27d5d3b14b2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.101871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac8e93ec-4e98-49b0-9e34-c27d5d3b14b2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.102509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac8e93ec-4e98-49b0-9e34-c27d5d3b14b2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.123603 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ac8e93ec-4e98-49b0-9e34-c27d5d3b14b2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags" status: 200 len: 12 microversion: 2.26 time: 0.043059 Oct 11 04:32:43.124971 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2552/4865] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 11 04:32:43 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags => generated 12 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:43.137583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda19a02700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:43.147699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.148474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.149057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.149693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:43.156610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.157299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.158004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.159502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.160277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.160862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.181157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2aa934d2-420a-4961-b9ac-391a05bf97f1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:43.181665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2aa934d2-420a-4961-b9ac-391a05bf97f1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:43.192661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aa934d2-420a-4961-b9ac-391a05bf97f1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.193694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aa934d2-420a-4961-b9ac-391a05bf97f1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.195503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aa934d2-420a-4961-b9ac-391a05bf97f1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.197885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aa934d2-420a-4961-b9ac-391a05bf97f1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.205340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aa934d2-420a-4961-b9ac-391a05bf97f1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.205340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2aa934d2-420a-4961-b9ac-391a05bf97f1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.217620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.218546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.222066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.253609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:43.282906 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-38c836fd-716b-4dc8-bb93-8fd37fcc60d7 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags" status: 204 len: 0 microversion: 2.26 time: 0.151095 Oct 11 04:32:43.284274 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2314/4866] 10.222.0.26 () {60 vars in 1295 bytes} [Tue Oct 11 04:32:43 2022] DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:32:43.308639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda191480d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:43.308639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.309523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.310113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.310817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:43.320159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.320924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.321583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.322735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.323336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.324015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.390023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.391671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.392159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.415432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.415916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.416350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.476401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2aa934d2-420a-4961-b9ac-391a05bf97f1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:43.484828 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2aa934d2-420a-4961-b9ac-391a05bf97f1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.308969 Oct 11 04:32:43.488985 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2553/4867] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:43 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:43.501074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-849e9422-fb24-41ac-9c2a-a44dc90915af tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:43.501699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-849e9422-fb24-41ac-9c2a-a44dc90915af tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:43.515247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-849e9422-fb24-41ac-9c2a-a44dc90915af tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.515747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-849e9422-fb24-41ac-9c2a-a44dc90915af tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.516190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-849e9422-fb24-41ac-9c2a-a44dc90915af tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.516895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-849e9422-fb24-41ac-9c2a-a44dc90915af tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.517356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-849e9422-fb24-41ac-9c2a-a44dc90915af tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.517782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-849e9422-fb24-41ac-9c2a-a44dc90915af tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.526968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:43.560945 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-32ac9f0d-545d-4f53-bbcf-49c5c13e2ba3 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1017629438" status: 201 len: 0 microversion: 2.26 time: 0.271030 Oct 11 04:32:43.567404 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2315/4868] 10.222.0.26 () {62 vars in 1380 bytes} [Tue Oct 11 04:32:43 2022] PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1017629438 => generated 0 bytes in 278 msecs (HTTP/1.1 201) 10 headers in 486 bytes (2 switches on core 0) Oct 11 04:32:43.572518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda19246280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:43.592870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.593362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.593809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.594321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:43.605307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.612131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.612131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.612131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.612131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.612131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.650802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.651368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.651824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.664145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.664636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.665792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.785928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:RELEASE=4,nova_cell1:SELECT=86,nova_cell1:DELETE=4,nova_cell1:SAVEPOINT=3,nova_cell1:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:43.791498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:43.809093 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-22dded17-7f0f-4f63-9408-ddd68bed40c1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1189277540" status: 201 len: 0 microversion: 2.26 time: 0.240187 Oct 11 04:32:43.809917 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2316/4869] 10.222.0.26 () {62 vars in 1380 bytes} [Tue Oct 11 04:32:43 2022] PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags/tempest-tag-1189277540 => generated 0 bytes in 242 msecs (HTTP/1.1 201) 10 headers in 486 bytes (1 switches on core 0) Oct 11 04:32:43.826734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Action: 'update_all', calling method: .version_select at 0x7fda19ab83a0>, body: {"tags": ["tempest-tag-1628793959", "tempest-tag-1323095164"]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:43.837532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.838283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.838772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.839261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:43.845108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.846112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.851612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.851612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.851612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.851612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.852386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-849e9422-fb24-41ac-9c2a-a44dc90915af tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:43.865536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:SAVEPOINT=1,nova_cell1:INSERT=1,nova_cell1:RELEASE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:43.880335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:43.880335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:43.880335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:43.881457 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-849e9422-fb24-41ac-9c2a-a44dc90915af tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.388785 Oct 11 04:32:43.881457 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2554/4870] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:43 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:43.979352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:44.021821 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b349077e-6c0a-4fb7-abd7-946ca79042ef tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags" status: 200 len: 62 microversion: 2.26 time: 0.198423 Oct 11 04:32:44.023812 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2317/4871] 10.222.0.26 () {62 vars in 1312 bytes} [Tue Oct 11 04:32:43 2022] PUT /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags => generated 62 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:44.036687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-20dcbb3c-e23d-469c-ae84-cf0fe6978c43 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda1e0ea8b0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:44.046043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20dcbb3c-e23d-469c-ae84-cf0fe6978c43 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.046573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20dcbb3c-e23d-469c-ae84-cf0fe6978c43 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.047038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20dcbb3c-e23d-469c-ae84-cf0fe6978c43 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.061912 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-20dcbb3c-e23d-469c-ae84-cf0fe6978c43 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags" status: 200 len: 62 microversion: 2.26 time: 0.031778 Oct 11 04:32:44.062915 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2555/4872] 10.222.0.26 () {60 vars in 1292 bytes} [Tue Oct 11 04:32:44 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags => generated 62 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:44.076610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '.version_select at 0x7fda18addaf0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:44.094925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.095525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.096034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.096597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:44.102722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.103239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.103746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.104509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.105039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.105644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.129690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.130340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.131258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.238482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'flavor' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:44.257494 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a151d120-74fc-4d13-8b53-86cdfad11df2 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags" status: 204 len: 0 microversion: 2.26 time: 0.187418 Oct 11 04:32:44.259049 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2318/4873] 10.222.0.26 () {60 vars in 1295 bytes} [Tue Oct 11 04:32:44 2022] DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5/tags => generated 0 bytes in 191 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:32:44.268593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8a7f4fc-8ee5-4edb-8f35-a354671f9b40 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:44.269419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e8a7f4fc-8ee5-4edb-8f35-a354671f9b40 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:44.275388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a7f4fc-8ee5-4edb-8f35-a354671f9b40 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.276068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a7f4fc-8ee5-4edb-8f35-a354671f9b40 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.276681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a7f4fc-8ee5-4edb-8f35-a354671f9b40 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.277390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a7f4fc-8ee5-4edb-8f35-a354671f9b40 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.278128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a7f4fc-8ee5-4edb-8f35-a354671f9b40 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.278771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a7f4fc-8ee5-4edb-8f35-a354671f9b40 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.314541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e8a7f4fc-8ee5-4edb-8f35-a354671f9b40 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:32:44.518143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d51cd980-c69a-4d5e-96bc-adf21b0e93ff tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:44.519088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d51cd980-c69a-4d5e-96bc-adf21b0e93ff tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:44.530744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d51cd980-c69a-4d5e-96bc-adf21b0e93ff tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.531551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d51cd980-c69a-4d5e-96bc-adf21b0e93ff tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.532352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d51cd980-c69a-4d5e-96bc-adf21b0e93ff tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.533402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d51cd980-c69a-4d5e-96bc-adf21b0e93ff tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.534059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d51cd980-c69a-4d5e-96bc-adf21b0e93ff tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.534726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d51cd980-c69a-4d5e-96bc-adf21b0e93ff tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.653156 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e8a7f4fc-8ee5-4edb-8f35-a354671f9b40 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 204 len: 0 microversion: 2.26 time: 0.387743 Oct 11 04:32:44.657467 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2556/4874] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:32:44 2022] DELETE /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:32:44.665134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:44.665750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:44.680011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.680390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.680849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.683041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.683386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.685706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.795027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d51cd980-c69a-4d5e-96bc-adf21b0e93ff tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:44.807802 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d51cd980-c69a-4d5e-96bc-adf21b0e93ff tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.295873 Oct 11 04:32:44.809040 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2319/4875] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:44 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:44.905481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07186c98-afb3-4dc4-bb49-cddc37ad4be5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:44.907152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-07186c98-afb3-4dc4-bb49-cddc37ad4be5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:44.920508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07186c98-afb3-4dc4-bb49-cddc37ad4be5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.921828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07186c98-afb3-4dc4-bb49-cddc37ad4be5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.922561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07186c98-afb3-4dc4-bb49-cddc37ad4be5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:44.937380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07186c98-afb3-4dc4-bb49-cddc37ad4be5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:44.942043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07186c98-afb3-4dc4-bb49-cddc37ad4be5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:44.942043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07186c98-afb3-4dc4-bb49-cddc37ad4be5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:45.335881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-07186c98-afb3-4dc4-bb49-cddc37ad4be5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:45.365066 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-07186c98-afb3-4dc4-bb49-cddc37ad4be5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.460516 Oct 11 04:32:45.365066 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2320/4876] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:44 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:45.665215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:45.682882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:45.688482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:45.704014 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce06e14c-f4f0-46ee-bef3-a495d1a424ad tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1553 microversion: 2.26 time: 1.045230 Oct 11 04:32:45.732040 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2557/4877] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:44 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1553 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:45.841907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-38b1afea-2c90-4cca-b047-087fc47ed0bb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:45.842713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-38b1afea-2c90-4cca-b047-087fc47ed0bb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:45.855770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b1afea-2c90-4cca-b047-087fc47ed0bb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:45.857691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b1afea-2c90-4cca-b047-087fc47ed0bb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:45.857691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b1afea-2c90-4cca-b047-087fc47ed0bb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:45.858281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b1afea-2c90-4cca-b047-087fc47ed0bb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:45.859091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b1afea-2c90-4cca-b047-087fc47ed0bb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:45.859714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b1afea-2c90-4cca-b047-087fc47ed0bb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:46.121527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-38b1afea-2c90-4cca-b047-087fc47ed0bb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:46.137540 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-38b1afea-2c90-4cca-b047-087fc47ed0bb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1721 microversion: 2.1 time: 0.299790 Oct 11 04:32:46.138808 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2321/4878] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:45 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:46.387695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-83441751-c4d6-44cf-ab09-8a82e0ef77b9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:46.389599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-83441751-c4d6-44cf-ab09-8a82e0ef77b9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:46.407415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83441751-c4d6-44cf-ab09-8a82e0ef77b9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:46.409564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83441751-c4d6-44cf-ab09-8a82e0ef77b9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:46.410331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83441751-c4d6-44cf-ab09-8a82e0ef77b9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:46.413592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83441751-c4d6-44cf-ab09-8a82e0ef77b9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:46.415700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83441751-c4d6-44cf-ab09-8a82e0ef77b9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:46.419408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83441751-c4d6-44cf-ab09-8a82e0ef77b9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:46.733649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:46.734288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:46.747351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:46.748037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:46.749594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:46.750470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:46.751234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:46.752761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:46.838738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-83441751-c4d6-44cf-ab09-8a82e0ef77b9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:46.860669 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-83441751-c4d6-44cf-ab09-8a82e0ef77b9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.475872 Oct 11 04:32:46.874336 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2558/4879] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:46 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:46.940810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:46.953745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:46.958615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:46.963250 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68084dc7-5edc-4bbb-87a6-e2f16879fbf1 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1511 microversion: 2.26 time: 0.232128 Oct 11 04:32:46.964140 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2322/4880] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:46 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1511 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:32:47.002634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-8ad13bac-02cd-498f-9801-7b259b6b7bdd req-c77f0e65-bd1a-4ac4-a079-bdadfcb3f6da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "169d9577-af83-4ba6-b89a-ae0e5cc989a5", "name": "network-vif-deleted", "tag": "6a9378f4-c8df-4092-a9b6-df8b7a008287"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:47.030919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8ad13bac-02cd-498f-9801-7b259b6b7bdd req-c77f0e65-bd1a-4ac4-a079-bdadfcb3f6da service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:47.031407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8ad13bac-02cd-498f-9801-7b259b6b7bdd req-c77f0e65-bd1a-4ac4-a079-bdadfcb3f6da service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:47.032553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8ad13bac-02cd-498f-9801-7b259b6b7bdd req-c77f0e65-bd1a-4ac4-a079-bdadfcb3f6da service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:47.083427 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8ad13bac-02cd-498f-9801-7b259b6b7bdd req-c77f0e65-bd1a-4ac4-a079-bdadfcb3f6da service nova] Creating event network-vif-deleted:6a9378f4-c8df-4092-a9b6-df8b7a008287 for instance 169d9577-af83-4ba6-b89a-ae0e5cc989a5 on n-h2-860892-1 Oct 11 04:32:47.093530 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-8ad13bac-02cd-498f-9801-7b259b6b7bdd req-c77f0e65-bd1a-4ac4-a079-bdadfcb3f6da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110228 Oct 11 04:32:47.094511 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2559/4881] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:47.169535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7f850230-c767-4d95-b2db-dcb0f7630e52 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:47.171284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7f850230-c767-4d95-b2db-dcb0f7630e52 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:47.179182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f850230-c767-4d95-b2db-dcb0f7630e52 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:47.179813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f850230-c767-4d95-b2db-dcb0f7630e52 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:47.180375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f850230-c767-4d95-b2db-dcb0f7630e52 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:47.181329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f850230-c767-4d95-b2db-dcb0f7630e52 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:47.182019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f850230-c767-4d95-b2db-dcb0f7630e52 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:47.189524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f850230-c767-4d95-b2db-dcb0f7630e52 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:47.407982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7f850230-c767-4d95-b2db-dcb0f7630e52 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:47.419138 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7f850230-c767-4d95-b2db-dcb0f7630e52 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1698 microversion: 2.1 time: 0.254807 Oct 11 04:32:47.431417 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2323/4882] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:47 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1698 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:47.448182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49f2d8d6-5bba-48a2-9cf4-78cbed14d2d5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:47.455446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49f2d8d6-5bba-48a2-9cf4-78cbed14d2d5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:47.455947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49f2d8d6-5bba-48a2-9cf4-78cbed14d2d5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:47.456385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-49f2d8d6-5bba-48a2-9cf4-78cbed14d2d5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:47.494069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-49f2d8d6-5bba-48a2-9cf4-78cbed14d2d5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Going to try to start instance {{(pid=120994) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 04:32:47.725689 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-49f2d8d6-5bba-48a2-9cf4-78cbed14d2d5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "POST /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/action" status: 202 len: 0 microversion: 2.1 time: 0.284360 Oct 11 04:32:47.726347 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2560/4883] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:32:47 2022] POST /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:32:47.734567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bf0447c0-2f99-4ec2-845e-71d0545f3039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:47.735177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bf0447c0-2f99-4ec2-845e-71d0545f3039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:47.741637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf0447c0-2f99-4ec2-845e-71d0545f3039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:47.742099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf0447c0-2f99-4ec2-845e-71d0545f3039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:47.742605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf0447c0-2f99-4ec2-845e-71d0545f3039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:47.743316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf0447c0-2f99-4ec2-845e-71d0545f3039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:47.743768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf0447c0-2f99-4ec2-845e-71d0545f3039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:47.744188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf0447c0-2f99-4ec2-845e-71d0545f3039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:47.882318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf0447c0-2f99-4ec2-845e-71d0545f3039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:47.890889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7e1240ac-44c9-4fd7-aa3b-2f0fd1e224a8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:47.891809 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bf0447c0-2f99-4ec2-845e-71d0545f3039 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1707 microversion: 2.1 time: 0.160330 Oct 11 04:32:47.891809 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2324/4884] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:47 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:47.902546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7e1240ac-44c9-4fd7-aa3b-2f0fd1e224a8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:47.909710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1240ac-44c9-4fd7-aa3b-2f0fd1e224a8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:47.910535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1240ac-44c9-4fd7-aa3b-2f0fd1e224a8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:47.911130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1240ac-44c9-4fd7-aa3b-2f0fd1e224a8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:47.912829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1240ac-44c9-4fd7-aa3b-2f0fd1e224a8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:47.912829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1240ac-44c9-4fd7-aa3b-2f0fd1e224a8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:47.912829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e1240ac-44c9-4fd7-aa3b-2f0fd1e224a8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:47.995504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:47.996128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:48.003931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:48.004611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:48.005230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:48.006968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:48.007581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:48.008164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:48.047348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:48.048527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:48.049128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:48.049741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lazy-loading 'fault' on Instance uuid 169d9577-af83-4ba6-b89a-ae0e5cc989a5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:32:48.067226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7e1240ac-44c9-4fd7-aa3b-2f0fd1e224a8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:48.083704 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7e1240ac-44c9-4fd7-aa3b-2f0fd1e224a8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.197052 Oct 11 04:32:48.096661 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2561/4885] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:47 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:48.114359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:48.123831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:48.125150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80cf1965120740158d17c1c050c32139', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '51ba34bd1c7c4536b162a2a8a1bfefd9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:48.126556 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8dcee239-be8b-461c-91fc-118fe253e501 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 200 len: 1352 microversion: 2.26 time: 0.135100 Oct 11 04:32:48.127319 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2325/4886] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:47 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 1352 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:32:48.916494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d23f345d-ba5d-4fe7-89e5-323393779592 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:48.917879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d23f345d-ba5d-4fe7-89e5-323393779592 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:48.932002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d23f345d-ba5d-4fe7-89e5-323393779592 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:48.932002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d23f345d-ba5d-4fe7-89e5-323393779592 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:48.932002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d23f345d-ba5d-4fe7-89e5-323393779592 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:48.934833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d23f345d-ba5d-4fe7-89e5-323393779592 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:48.935467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d23f345d-ba5d-4fe7-89e5-323393779592 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:48.936061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d23f345d-ba5d-4fe7-89e5-323393779592 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:49.108737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2a6b24ea-fc10-49d8-a765-e2004b8ae8f9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:49.110051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2a6b24ea-fc10-49d8-a765-e2004b8ae8f9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:49.121394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6b24ea-fc10-49d8-a765-e2004b8ae8f9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:49.121886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6b24ea-fc10-49d8-a765-e2004b8ae8f9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:49.122366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6b24ea-fc10-49d8-a765-e2004b8ae8f9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:49.123072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6b24ea-fc10-49d8-a765-e2004b8ae8f9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:49.123395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d23f345d-ba5d-4fe7-89e5-323393779592 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:49.123527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6b24ea-fc10-49d8-a765-e2004b8ae8f9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:49.123947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6b24ea-fc10-49d8-a765-e2004b8ae8f9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:49.142820 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d23f345d-ba5d-4fe7-89e5-323393779592 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1707 microversion: 2.1 time: 0.230571 Oct 11 04:32:49.154406 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2562/4887] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:48 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1707 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:49.160943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:49.162549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] [instance: 169d9577-af83-4ba6-b89a-ae0e5cc989a5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:49.169074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:49.169908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:49.170558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:49.171765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:49.172410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:49.173029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:49.214946 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] HTTP exception thrown: Instance 169d9577-af83-4ba6-b89a-ae0e5cc989a5 could not be found. Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Request method failure captured: Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 HTTP/1.1 Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPHU1jw3XwYnm606f5S7mBOunr6ypFSAznMCarQNhoGGdvwv9_wihC1yqrfGFvcYZ2wxtobT_pk00dwDch_qezdTSDB12Q0voDbeuy1x7K0Bx6K0jFTV7QThOWOyT4HVYpwY0P3Fqq76ObnJMZLJ0gRHTZ59-h2ODaolSE8T3UER5eQ Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.26 Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 51ba34bd1c7c4536b162a2a8a1bfefd9 Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerTagsTestJSON-1570421152 Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/51ba34bd1c7c4536b162a2a8a1bfefd9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_51ba34bd1c7c4536b162a2a8a1bfefd9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/51ba34bd1c7c4536b162a2a8a1bfefd9"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/51ba34bd1c7c4536b162a2a8a1bfefd9"}]}] Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerTagsTestJSON-1570421152 Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 51ba34bd1c7c4536b162a2a8a1bfefd9 Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerTagsTestJSON-1570421152 Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerTagsTestJSON-1570421152-project Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 80cf1965120740158d17c1c050c32139 Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerTagsTestJSON-1570421152-project Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 169d9577-af83-4ba6-b89a-ae0e5cc989a5 could not be found. Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '169d9577-af83-4ba6-b89a-ae0e5cc989a5'} Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 169d9577-af83-4ba6-b89a-ae0e5cc989a5 could not be found. Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 169d9577-af83-4ba6-b89a-ae0e5cc989a5 could not be found. Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:49.217205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.221938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:49.221938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:49.221938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:49.221938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:49.221938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:49.221938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 169d9577-af83-4ba6-b89a-ae0e5cc989a5 could not be found. Oct 11 04:32:49.221938 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.223762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] Returning 404 to user: Instance 169d9577-af83-4ba6-b89a-ae0e5cc989a5 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:49.225370 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8d786598-c61b-4d0b-ae0a-f8844b721236 tempest-ServerTagsTestJSON-1570421152 tempest-ServerTagsTestJSON-1570421152-project] 10.222.0.26 "GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5" status: 404 len: 111 microversion: 2.26 time: 0.068805 Oct 11 04:32:49.226596 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2563/4888] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:32:49 2022] GET /compute/v2.1/servers/169d9577-af83-4ba6-b89a-ae0e5cc989a5 => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:32:49.306058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2a6b24ea-fc10-49d8-a765-e2004b8ae8f9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:49.314729 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2a6b24ea-fc10-49d8-a765-e2004b8ae8f9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.210717 Oct 11 04:32:49.315598 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2326/4889] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:49 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:49.872499 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2af02d4b-10af-475b-beca-3b93c40b3ed7 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] 10.222.0.26 "DELETE /compute/v2.1/images/" status: 404 len: 112 microversion: - time: 0.255723 Oct 11 04:32:49.873221 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2564/4890] 10.222.0.26 () {58 vars in 1128 bytes} [Tue Oct 11 04:32:49 2022] DELETE /compute/v2.1/images/ => generated 112 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 11 04:32:49.882959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35087948-cb7a-4108-a288-378c8d902199 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Calling method '.version_select at 0x7fda19a02d30>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:49.905609 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-35087948-cb7a-4108-a288-378c8d902199 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] HTTP exception thrown: Image not found. Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35087948-cb7a-4108-a288-378c8d902199 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Request method failure captured: Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/images/-1 HTTP/1.1 Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPHxws3GRfdRgGR8EzvsKNjFP39B4uCOxKOWboSkqGlt7OIq21SsPrmAdH_1W1sS3MhWwLVp6CRSFHX5w0BJWRigkh3i9be-WkGusPYy5kc4cZnV99WKv42axIDh9ewSLQAriipcYIoK6PV-SCVtlFrkBBNHzgNab-1ZDpm5mmaNpoA Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f5caf34feaf04148b9a6d0f33a5609ec Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5caf34feaf04148b9a6d0f33a5609ec"}]}] Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f5caf34feaf04148b9a6d0f33a5609ec Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesDeleteNegativeTestJSON-696249674-project Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 864e4af4e8a84fefbeec9ae0cbccff88 Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-696249674-project Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '-1'} Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image -1 to delete Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image -1 could not be found. Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.908076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35087948-cb7a-4108-a288-378c8d902199 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35087948-cb7a-4108-a288-378c8d902199 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] 10.222.0.26 "DELETE /compute/v2.1/images/-1" status: 404 len: 62 microversion: 2.1 time: 0.032895 Oct 11 04:32:49.915869 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2327/4891] 10.222.0.26 () {58 vars in 1134 bytes} [Tue Oct 11 04:32:49 2022] DELETE /compute/v2.1/images/-1 => generated 62 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:32:49.932216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-93a02e38-8a07-48ee-aedb-3549e26c2c7d tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Calling method '.version_select at 0x7fda18ef2a60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:49.965769 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-93a02e38-8a07-48ee-aedb-3549e26c2c7d tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] HTTP exception thrown: Image not found. Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-93a02e38-8a07-48ee-aedb-3549e26c2c7d tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Request method failure captured: Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/images/1ac05ddd-3384-4760-a301-ba00d1bab98j HTTP/1.1 Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPHxws3GRfdRgGR8EzvsKNjFP39B4uCOxKOWboSkqGlt7OIq21SsPrmAdH_1W1sS3MhWwLVp6CRSFHX5w0BJWRigkh3i9be-WkGusPYy5kc4cZnV99WKv42axIDh9ewSLQAriipcYIoK6PV-SCVtlFrkBBNHzgNab-1ZDpm5mmaNpoA Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f5caf34feaf04148b9a6d0f33a5609ec Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5caf34feaf04148b9a6d0f33a5609ec"}]}] Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f5caf34feaf04148b9a6d0f33a5609ec Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesDeleteNegativeTestJSON-696249674-project Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 864e4af4e8a84fefbeec9ae0cbccff88 Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-696249674-project Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: exception: Image not found. Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1ac05ddd-3384-4760-a301-ba00d1bab98j'} Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 1ac05ddd-3384-4760-a301-ba00d1bab98j to delete Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 1ac05ddd-3384-4760-a301-ba00d1bab98j could not be found. Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:49.967737 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-93a02e38-8a07-48ee-aedb-3549e26c2c7d tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Returning 404 to user: Image not found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:49.972388 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-93a02e38-8a07-48ee-aedb-3549e26c2c7d tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] 10.222.0.26 "DELETE /compute/v2.1/images/1ac05ddd-3384-4760-a301-ba00d1bab98j" status: 404 len: 62 microversion: 2.1 time: 0.050844 Oct 11 04:32:49.975838 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2565/4892] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:49 2022] DELETE /compute/v2.1/images/1ac05ddd-3384-4760-a301-ba00d1bab98j => generated 62 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:32:49.984399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-85701ae5-566c-40db-9181-1a998621ec11 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Calling method '.version_select at 0x7fda1a9c9a60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:49.997924 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-85701ae5-566c-40db-9181-1a998621ec11 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] HTTP exception thrown: Image not found. Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-85701ae5-566c-40db-9181-1a998621ec11 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Request method failure captured: Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/images/4b7ffaa7-2869-4e91-a674-a85bca86e3481 HTTP/1.1 Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPHxws3GRfdRgGR8EzvsKNjFP39B4uCOxKOWboSkqGlt7OIq21SsPrmAdH_1W1sS3MhWwLVp6CRSFHX5w0BJWRigkh3i9be-WkGusPYy5kc4cZnV99WKv42axIDh9ewSLQAriipcYIoK6PV-SCVtlFrkBBNHzgNab-1ZDpm5mmaNpoA Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f5caf34feaf04148b9a6d0f33a5609ec Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5caf34feaf04148b9a6d0f33a5609ec"}]}] Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f5caf34feaf04148b9a6d0f33a5609ec Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesDeleteNegativeTestJSON-696249674-project Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 864e4af4e8a84fefbeec9ae0cbccff88 Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-696249674-project Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '4b7ffaa7-2869-4e91-a674-a85bca86e3481'} Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image 4b7ffaa7-2869-4e91-a674-a85bca86e3481 to delete Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image 4b7ffaa7-2869-4e91-a674-a85bca86e3481 could not be found. Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:50.000039 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-85701ae5-566c-40db-9181-1a998621ec11 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-85701ae5-566c-40db-9181-1a998621ec11 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] 10.222.0.26 "DELETE /compute/v2.1/images/4b7ffaa7-2869-4e91-a674-a85bca86e3481" status: 404 len: 62 microversion: 2.1 time: 0.024499 Oct 11 04:32:50.004380 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2328/4893] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:32:49 2022] DELETE /compute/v2.1/images/4b7ffaa7-2869-4e91-a674-a85bca86e3481 => generated 62 bytes in 26 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:32:50.014296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9770ec64-889d-4214-a447-03aeccdb6d75 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Calling method '.version_select at 0x7fda18daa4c0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:50.037587 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-9770ec64-889d-4214-a447-03aeccdb6d75 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] HTTP exception thrown: Image not found. Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9770ec64-889d-4214-a447-03aeccdb6d75 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Request method failure captured: Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/images/tempest-invalid-410038463 HTTP/1.1 Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPHxws3GRfdRgGR8EzvsKNjFP39B4uCOxKOWboSkqGlt7OIq21SsPrmAdH_1W1sS3MhWwLVp6CRSFHX5w0BJWRigkh3i9be-WkGusPYy5kc4cZnV99WKv42axIDh9ewSLQAriipcYIoK6PV-SCVtlFrkBBNHzgNab-1ZDpm5mmaNpoA Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f5caf34feaf04148b9a6d0f33a5609ec Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5caf34feaf04148b9a6d0f33a5609ec"}]}] Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f5caf34feaf04148b9a6d0f33a5609ec Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ImagesDeleteNegativeTestJSON-696249674-project Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 864e4af4e8a84fefbeec9ae0cbccff88 Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-696249674-project Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: exception: Image not found. Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'tempest-invalid-410038463'} Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image tempest-invalid-410038463 to delete Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image tempest-invalid-410038463 could not be found. Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.039463 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9770ec64-889d-4214-a447-03aeccdb6d75 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Returning 404 to user: Image not found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:50.044482 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9770ec64-889d-4214-a447-03aeccdb6d75 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] 10.222.0.26 "DELETE /compute/v2.1/images/tempest-invalid-410038463" status: 404 len: 62 microversion: 2.1 time: 0.031914 Oct 11 04:32:50.046406 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2566/4894] 10.222.0.26 () {58 vars in 1203 bytes} [Tue Oct 11 04:32:50 2022] DELETE /compute/v2.1/images/tempest-invalid-410038463 => generated 62 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 04:32:50.051749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29981566-e68f-4204-9d51-b43d623fc7f7 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Calling method '.version_select at 0x7fda19a02c10>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:50.077387 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-29981566-e68f-4204-9d51-b43d623fc7f7 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] HTTP exception thrown: Image not found. Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29981566-e68f-4204-9d51-b43d623fc7f7 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Request method failure captured: Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/images/e14a2112-ebc1-4819-8574-ca67fa9a404d HTTP/1.1 Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPHxws3GRfdRgGR8EzvsKNjFP39B4uCOxKOWboSkqGlt7OIq21SsPrmAdH_1W1sS3MhWwLVp6CRSFHX5w0BJWRigkh3i9be-WkGusPYy5kc4cZnV99WKv42axIDh9ewSLQAriipcYIoK6PV-SCVtlFrkBBNHzgNab-1ZDpm5mmaNpoA Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f5caf34feaf04148b9a6d0f33a5609ec Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5caf34feaf04148b9a6d0f33a5609ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f5caf34feaf04148b9a6d0f33a5609ec"}]}] Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f5caf34feaf04148b9a6d0f33a5609ec Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ImagesDeleteNegativeTestJSON-696249674 Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ImagesDeleteNegativeTestJSON-696249674-project Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 864e4af4e8a84fefbeec9ae0cbccff88 Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ImagesDeleteNegativeTestJSON-696249674-project Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: exception: Image not found. Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e14a2112-ebc1-4819-8574-ca67fa9a404d'} Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 724, in delete Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._client.call(context, 2, 'delete', args=(image_id,)) Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 191, in call Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = getattr(controller, method)(*args, **kwargs) Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/utils.py", line 670, in inner Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return RequestIdProxy(wrapped(*args, **kwargs)) Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/v2/images.py", line 394, in delete Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.http_client.delete(url) Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/adapter.py", line 410, in delete Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, 'DELETE', **kwargs) Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 380, in request Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._handle_response(resp) Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/glanceclient/common/http.py", line 120, in _handle_response Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.from_response(resp, resp.content) Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi glanceclient.exc.HTTPNotFound: HTTP 404 Not Found: Failed to find image e14a2112-ebc1-4819-8574-ca67fa9a404d to delete Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 104, in delete Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._image_api.delete(context, id) Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 1255, in delete Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return session.delete(context, image_id) Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/image/glance.py", line 726, in delete Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ImageNotFound(image_id=image_id) Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ImageNotFound: Image e14a2112-ebc1-4819-8574-ca67fa9a404d could not be found. Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:50.079861 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/images.py", line 107, in delete Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=explanation) Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Image not found. Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Image not found. Oct 11 04:32:50.084981 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:50.088941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29981566-e68f-4204-9d51-b43d623fc7f7 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] Returning 404 to user: Image not found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:50.089912 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-29981566-e68f-4204-9d51-b43d623fc7f7 tempest-ImagesDeleteNegativeTestJSON-696249674 tempest-ImagesDeleteNegativeTestJSON-696249674-project] 10.222.0.26 "DELETE /compute/v2.1/images/e14a2112-ebc1-4819-8574-ca67fa9a404d" status: 404 len: 62 microversion: 2.1 time: 0.041752 Oct 11 04:32:50.090504 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2329/4895] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:50 2022] DELETE /compute/v2.1/images/e14a2112-ebc1-4819-8574-ca67fa9a404d => generated 62 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Oct 11 04:32:50.179073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3155e61d-45b2-41c1-bb36-eadd36fea87e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:50.179720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3155e61d-45b2-41c1-bb36-eadd36fea87e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:50.191437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3155e61d-45b2-41c1-bb36-eadd36fea87e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:50.191437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3155e61d-45b2-41c1-bb36-eadd36fea87e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:50.191437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3155e61d-45b2-41c1-bb36-eadd36fea87e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:50.192682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3155e61d-45b2-41c1-bb36-eadd36fea87e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:50.194292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3155e61d-45b2-41c1-bb36-eadd36fea87e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:50.194914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3155e61d-45b2-41c1-bb36-eadd36fea87e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:50.342631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69d09e56-54e4-4a10-960d-5793f7da6050 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:50.343255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69d09e56-54e4-4a10-960d-5793f7da6050 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:50.351328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69d09e56-54e4-4a10-960d-5793f7da6050 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:50.351830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69d09e56-54e4-4a10-960d-5793f7da6050 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:50.352446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69d09e56-54e4-4a10-960d-5793f7da6050 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:50.353154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69d09e56-54e4-4a10-960d-5793f7da6050 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:50.353606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69d09e56-54e4-4a10-960d-5793f7da6050 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:50.354226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69d09e56-54e4-4a10-960d-5793f7da6050 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:50.512595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3155e61d-45b2-41c1-bb36-eadd36fea87e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:50.524500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-69d09e56-54e4-4a10-960d-5793f7da6050 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:50.529571 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3155e61d-45b2-41c1-bb36-eadd36fea87e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1711 microversion: 2.1 time: 0.360003 Oct 11 04:32:50.531372 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2567/4896] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:50 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1711 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:50.535282 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69d09e56-54e4-4a10-960d-5793f7da6050 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.199554 Oct 11 04:32:50.551355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2330/4897] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:50 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:51.560749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae955007-aa75-4091-bb40-a728edefb173 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:51.561871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae955007-aa75-4091-bb40-a728edefb173 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:51.588844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae955007-aa75-4091-bb40-a728edefb173 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:51.589343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae955007-aa75-4091-bb40-a728edefb173 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:51.592638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae955007-aa75-4091-bb40-a728edefb173 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:51.595904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae955007-aa75-4091-bb40-a728edefb173 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:51.596551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae955007-aa75-4091-bb40-a728edefb173 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:51.600696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae955007-aa75-4091-bb40-a728edefb173 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:51.840819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae955007-aa75-4091-bb40-a728edefb173 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:51.852317 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae955007-aa75-4091-bb40-a728edefb173 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.295487 Oct 11 04:32:51.853567 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2568/4898] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:51 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:52.883623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-48c33df3-2e34-4133-a725-c0eee6b63574 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:52.885091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-48c33df3-2e34-4133-a725-c0eee6b63574 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:52.892606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c33df3-2e34-4133-a725-c0eee6b63574 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:52.893444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c33df3-2e34-4133-a725-c0eee6b63574 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:52.895075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c33df3-2e34-4133-a725-c0eee6b63574 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:52.896136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c33df3-2e34-4133-a725-c0eee6b63574 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:52.896811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c33df3-2e34-4133-a725-c0eee6b63574 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:52.897441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48c33df3-2e34-4133-a725-c0eee6b63574 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:53.215805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48c33df3-2e34-4133-a725-c0eee6b63574 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:53.230364 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-48c33df3-2e34-4133-a725-c0eee6b63574 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1736 microversion: 2.1 time: 0.349423 Oct 11 04:32:53.231605 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2331/4899] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:52 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1736 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:53.269006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c7f589c4-1162-4ad0-a423-08694691ab45 tempest-AbsoluteLimitsTestJSON-561371459 tempest-AbsoluteLimitsTestJSON-561371459-project] Calling method '.version_select at 0x7fda192a5790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:53.324387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7f589c4-1162-4ad0-a423-08694691ab45 tempest-AbsoluteLimitsTestJSON-561371459 tempest-AbsoluteLimitsTestJSON-561371459-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:53.325408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7f589c4-1162-4ad0-a423-08694691ab45 tempest-AbsoluteLimitsTestJSON-561371459 tempest-AbsoluteLimitsTestJSON-561371459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:53.325740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7f589c4-1162-4ad0-a423-08694691ab45 tempest-AbsoluteLimitsTestJSON-561371459 tempest-AbsoluteLimitsTestJSON-561371459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:53.326730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7f589c4-1162-4ad0-a423-08694691ab45 tempest-AbsoluteLimitsTestJSON-561371459 tempest-AbsoluteLimitsTestJSON-561371459-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:53.327141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7f589c4-1162-4ad0-a423-08694691ab45 tempest-AbsoluteLimitsTestJSON-561371459 tempest-AbsoluteLimitsTestJSON-561371459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:53.327594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7f589c4-1162-4ad0-a423-08694691ab45 tempest-AbsoluteLimitsTestJSON-561371459 tempest-AbsoluteLimitsTestJSON-561371459-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:53.368530 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c7f589c4-1162-4ad0-a423-08694691ab45 tempest-AbsoluteLimitsTestJSON-561371459 tempest-AbsoluteLimitsTestJSON-561371459-project] 10.222.0.26 "GET /compute/v2.1/limits" status: 200 len: 511 microversion: 2.1 time: 0.270522 Oct 11 04:32:53.381641 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2569/4900] 10.222.0.26 () {58 vars in 1122 bytes} [Tue Oct 11 04:32:53 2022] GET /compute/v2.1/limits => generated 511 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:32:54.254633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92b03a6e-ca64-44c2-8b62-3e2dd6aafd9a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:54.256794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-92b03a6e-ca64-44c2-8b62-3e2dd6aafd9a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:54.281784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92b03a6e-ca64-44c2-8b62-3e2dd6aafd9a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:54.282317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92b03a6e-ca64-44c2-8b62-3e2dd6aafd9a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:54.289965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92b03a6e-ca64-44c2-8b62-3e2dd6aafd9a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:54.290765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92b03a6e-ca64-44c2-8b62-3e2dd6aafd9a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:54.291291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92b03a6e-ca64-44c2-8b62-3e2dd6aafd9a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:54.291980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92b03a6e-ca64-44c2-8b62-3e2dd6aafd9a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:54.469087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31c67556-26bd-4229-a5df-762383ba1b61 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:54.471559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31c67556-26bd-4229-a5df-762383ba1b61 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:54.486593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31c67556-26bd-4229-a5df-762383ba1b61 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:54.495661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31c67556-26bd-4229-a5df-762383ba1b61 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:54.495661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31c67556-26bd-4229-a5df-762383ba1b61 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:54.495661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31c67556-26bd-4229-a5df-762383ba1b61 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:54.495661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31c67556-26bd-4229-a5df-762383ba1b61 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:54.495661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31c67556-26bd-4229-a5df-762383ba1b61 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:54.556858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92b03a6e-ca64-44c2-8b62-3e2dd6aafd9a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:54.569608 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92b03a6e-ca64-44c2-8b62-3e2dd6aafd9a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1716 microversion: 2.1 time: 0.319098 Oct 11 04:32:54.572408 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2332/4901] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:54 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1716 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:54.576345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31c67556-26bd-4229-a5df-762383ba1b61 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "POST /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002/action" status: 200 len: 24570 microversion: 2.1 time: 0.111069 Oct 11 04:32:54.579205 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2570/4902] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:32:54 2022] POST /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002/action => generated 24570 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:32:54.789553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:54.790057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:54.813522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:54.816941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:54.816941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:54.818630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:54.820801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:54.821314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:55.023120 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] HTTP exception thrown: Cannot 'detach_volume' instance 7ec2cb39-bab6-4474-9901-5909a9053a80 while it is in vm_state rescued Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Request method failure captured: Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments/85356c7f-4333-4881-bea9-1fca4fe845cf HTTP/1.1 Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPEasekUZLINQ5CZWJXkMppFiFyiPz0x7d4djdvUd-asoF16cTMXmitsW8Jw6-L4ZC10T49kVSd5NZJD7qmV4ktBS-qpfyACuQOEHpQR5BigmL06KMooK58zyWV0xifCb_yIKtS4zKCvAts6lZk9Fe5iF-Yw7nZw-Mdv0pFYP_e1eeY Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75ee1246b11f4fb286baf525614515c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}] Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 820b6b6b001a46a2abd3415de0b5f29b Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: exception: Cannot 'detach_volume' instance 7ec2cb39-bab6-4474-9901-5909a9053a80 while it is in vm_state rescued Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': '7ec2cb39-bab6-4474-9901-5909a9053a80', 'id': '85356c7f-4333-4881-bea9-1fca4fe845cf'} Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7ec2cb39-bab6-4474-9901-5909a9053a80 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7ec2cb39-bab6-4474-9901-5909a9053a80 while it is in vm_state rescued Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:55.025076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:32:55.029395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:32:55.029395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:32:55.029395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:32:55.029395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:32:55.029395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7ec2cb39-bab6-4474-9901-5909a9053a80 while it is in vm_state rescued Oct 11 04:32:55.029395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:32:55.030973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Returning 409 to user: Cannot 'detach_volume' instance 7ec2cb39-bab6-4474-9901-5909a9053a80 while it is in vm_state rescued {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:32:55.034065 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5df9d10f-6508-4717-86c1-6f0f05729be9 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments/85356c7f-4333-4881-bea9-1fca4fe845cf" status: 409 len: 152 microversion: 2.1 time: 0.248857 Oct 11 04:32:55.040096 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2333/4903] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:32:54 2022] DELETE /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments/85356c7f-4333-4881-bea9-1fca4fe845cf => generated 152 bytes in 255 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:32:55.053883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c3fee279-79a1-4e92-975c-1c092038d40c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:55.053883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c3fee279-79a1-4e92-975c-1c092038d40c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:55.060497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3fee279-79a1-4e92-975c-1c092038d40c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:55.060979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3fee279-79a1-4e92-975c-1c092038d40c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:55.061459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3fee279-79a1-4e92-975c-1c092038d40c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:55.062452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3fee279-79a1-4e92-975c-1c092038d40c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:55.063079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3fee279-79a1-4e92-975c-1c092038d40c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:55.063678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3fee279-79a1-4e92-975c-1c092038d40c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:55.443216 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c3fee279-79a1-4e92-975c-1c092038d40c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/action" status: 202 len: 0 microversion: 2.1 time: 0.397514 Oct 11 04:32:55.444056 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2571/4904] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:32:55 2022] POST /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/action => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:32:55.452523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c644e72e-b264-4e5a-b3df-761c3d6cccba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:55.453593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c644e72e-b264-4e5a-b3df-761c3d6cccba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:55.474692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c644e72e-b264-4e5a-b3df-761c3d6cccba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:55.475574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c644e72e-b264-4e5a-b3df-761c3d6cccba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:55.477078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c644e72e-b264-4e5a-b3df-761c3d6cccba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:55.478993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c644e72e-b264-4e5a-b3df-761c3d6cccba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:55.495679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c644e72e-b264-4e5a-b3df-761c3d6cccba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:55.496192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c644e72e-b264-4e5a-b3df-761c3d6cccba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:55.519541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:DELETE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:55.859043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c644e72e-b264-4e5a-b3df-761c3d6cccba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:55.873663 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c644e72e-b264-4e5a-b3df-761c3d6cccba tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1724 microversion: 2.1 time: 0.425024 Oct 11 04:32:55.886572 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2334/4905] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:55 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1724 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:56.908577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-692fcc20-dcac-4fa1-8959-eb24c66082ca tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:56.909312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-692fcc20-dcac-4fa1-8959-eb24c66082ca tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:56.923323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-692fcc20-dcac-4fa1-8959-eb24c66082ca tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:56.928076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-692fcc20-dcac-4fa1-8959-eb24c66082ca tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:56.928076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-692fcc20-dcac-4fa1-8959-eb24c66082ca tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:56.928076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-692fcc20-dcac-4fa1-8959-eb24c66082ca tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:56.928076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-692fcc20-dcac-4fa1-8959-eb24c66082ca tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:56.928076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-692fcc20-dcac-4fa1-8959-eb24c66082ca tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:57.197920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-692fcc20-dcac-4fa1-8959-eb24c66082ca tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:57.208228 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-692fcc20-dcac-4fa1-8959-eb24c66082ca tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1724 microversion: 2.1 time: 0.308435 Oct 11 04:32:57.209110 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2572/4906] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:56 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1724 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:32:58.233211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38743b7b-a34a-40e5-bb56-95a3e67b9123 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:58.233898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-38743b7b-a34a-40e5-bb56-95a3e67b9123 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:58.241645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38743b7b-a34a-40e5-bb56-95a3e67b9123 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:58.242134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38743b7b-a34a-40e5-bb56-95a3e67b9123 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:58.242907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38743b7b-a34a-40e5-bb56-95a3e67b9123 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:58.243628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38743b7b-a34a-40e5-bb56-95a3e67b9123 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:58.244125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38743b7b-a34a-40e5-bb56-95a3e67b9123 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:58.244493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38743b7b-a34a-40e5-bb56-95a3e67b9123 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:58.434708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bb8b4e60-2e16-4fa2-a80e-c1abd79060c9 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Action: 'create', calling method: .version_select at 0x7fda19ab89d0>, body: {"server_group": {"name": "tempest-ServerGroupTestJSON-Server-Group-250124583", "policies": ["affinity"]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:58.469074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:58.487062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-bb8b4e60-2e16-4fa2-a80e-c1abd79060c9 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:58.500323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-bb8b4e60-2e16-4fa2-a80e-c1abd79060c9 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:32:58.656363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-bb8b4e60-2e16-4fa2-a80e-c1abd79060c9 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:58.664602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-bb8b4e60-2e16-4fa2-a80e-c1abd79060c9 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:32:58.666752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-38743b7b-a34a-40e5-bb56-95a3e67b9123 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:32:58.670256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:58.679088 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-38743b7b-a34a-40e5-bb56-95a3e67b9123 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1724 microversion: 2.1 time: 0.449965 Oct 11 04:32:58.679910 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2573/4907] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:58 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1724 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:32:58.680797 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bb8b4e60-2e16-4fa2-a80e-c1abd79060c9 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 183 microversion: 2.1 time: 0.532534 Oct 11 04:32:58.681390 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2335/4908] 10.222.0.26 () {60 vars in 1174 bytes} [Tue Oct 11 04:32:58 2022] POST /compute/v2.1/os-server-groups => generated 183 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:58.693567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04f4ae33-e019-4ce3-bb6f-d43ad8f5dc1b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Action: 'create', calling method: .version_select at 0x7fda192e3940>, body: {"server_group": {"name": "tempest-server-group-673143081", "policies": ["affinity"]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:58.713658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-04f4ae33-e019-4ce3-bb6f-d43ad8f5dc1b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:58.726300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-04f4ae33-e019-4ce3-bb6f-d43ad8f5dc1b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:32:58.843805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:32:58.851389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-04f4ae33-e019-4ce3-bb6f-d43ad8f5dc1b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:58.858701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-04f4ae33-e019-4ce3-bb6f-d43ad8f5dc1b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:32:58.878602 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04f4ae33-e019-4ce3-bb6f-d43ad8f5dc1b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.188776 Oct 11 04:32:58.879310 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2574/4909] 10.222.0.26 () {60 vars in 1173 bytes} [Tue Oct 11 04:32:58 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:32:58.894513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0e03923e-cc4e-42bc-b006-4fbf57609770 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Action: 'create', calling method: .version_select at 0x7fda19ab84c0>, body: {"server_group": {"name": "tempest-server-group-673143081", "policies": ["affinity"]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:58.920718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-0e03923e-cc4e-42bc-b006-4fbf57609770 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:58.926959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-0e03923e-cc4e-42bc-b006-4fbf57609770 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:32:59.025186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-0e03923e-cc4e-42bc-b006-4fbf57609770 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:59.032632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-0e03923e-cc4e-42bc-b006-4fbf57609770 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:32:59.056887 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0e03923e-cc4e-42bc-b006-4fbf57609770 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 163 microversion: 2.1 time: 0.170044 Oct 11 04:32:59.073328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35d81fa8-c0f5-4755-b07a-882e2cb0304a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:59.082251 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2336/4910] 10.222.0.26 () {60 vars in 1173 bytes} [Tue Oct 11 04:32:58 2022] POST /compute/v2.1/os-server-groups => generated 163 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:59.213439 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-35d81fa8-c0f5-4755-b07a-882e2cb0304a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/5519539a-4336-4789-aa6c-c1e898b2f62d" status: 204 len: 0 microversion: 2.1 time: 0.146812 Oct 11 04:32:59.216824 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2575/4911] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:32:59 2022] DELETE /compute/v2.1/os-server-groups/5519539a-4336-4789-aa6c-c1e898b2f62d => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:32:59.227959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8b38cd93-80be-4369-8464-fbd7613aed0f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:59.262045 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8b38cd93-80be-4369-8464-fbd7613aed0f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 333 microversion: 2.1 time: 0.040670 Oct 11 04:32:59.268892 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2337/4912] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:32:59 2022] GET /compute/v2.1/os-server-groups => generated 333 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:59.279954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ac6402f6-e0a5-4b35-9aa0-45c6fcc2b116 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:59.404432 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ac6402f6-e0a5-4b35-9aa0-45c6fcc2b116 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/7b187523-cfc5-4d82-a802-15f04915fa46" status: 204 len: 0 microversion: 2.1 time: 0.129081 Oct 11 04:32:59.416341 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2576/4913] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:32:59 2022] DELETE /compute/v2.1/os-server-groups/7b187523-cfc5-4d82-a802-15f04915fa46 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:32:59.417973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f2a7a4d-2ead-4de5-84f0-29368c0b35d4 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:59.440988 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f2a7a4d-2ead-4de5-84f0-29368c0b35d4 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.029250 Oct 11 04:32:59.452251 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2338/4914] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:32:59 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:59.455108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a42fb59-51ac-45d9-a612-8f581a99bf9d tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Action: 'create', calling method: .version_select at 0x7fda19267430>, body: {"server_group": {"name": "tempest-server-group-2066569923", "policies": ["affinity"]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:59.502199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-1a42fb59-51ac-45d9-a612-8f581a99bf9d tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:59.519334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-1a42fb59-51ac-45d9-a612-8f581a99bf9d tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:32:59.655689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-1a42fb59-51ac-45d9-a612-8f581a99bf9d tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:59.670618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-1a42fb59-51ac-45d9-a612-8f581a99bf9d tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:32:59.700780 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1a42fb59-51ac-45d9-a612-8f581a99bf9d tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 164 microversion: 2.1 time: 0.248594 Oct 11 04:32:59.702149 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2577/4915] 10.222.0.26 () {60 vars in 1173 bytes} [Tue Oct 11 04:32:59 2022] POST /compute/v2.1/os-server-groups => generated 164 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:32:59.713909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fdabc8f1-0e25-4a57-8f4f-66f586190d7d tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:59.726633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f569ed9b-38eb-4026-ac3c-5deb5ff07de2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:59.726633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f569ed9b-38eb-4026-ac3c-5deb5ff07de2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:32:59.734484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f569ed9b-38eb-4026-ac3c-5deb5ff07de2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:59.735647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f569ed9b-38eb-4026-ac3c-5deb5ff07de2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:59.736345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f569ed9b-38eb-4026-ac3c-5deb5ff07de2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:59.737541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f569ed9b-38eb-4026-ac3c-5deb5ff07de2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:32:59.738565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f569ed9b-38eb-4026-ac3c-5deb5ff07de2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:32:59.741933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f569ed9b-38eb-4026-ac3c-5deb5ff07de2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:32:59.839222 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fdabc8f1-0e25-4a57-8f4f-66f586190d7d tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/40de3d41-3f9a-4db1-9660-6d2fab9dcf28" status: 204 len: 0 microversion: 2.1 time: 0.129334 Oct 11 04:32:59.840181 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2578/4916] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:32:59 2022] DELETE /compute/v2.1/os-server-groups/40de3d41-3f9a-4db1-9660-6d2fab9dcf28 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:32:59.851235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e2fa1239-9637-4767-a155-0baf29f1f231 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:32:59.875907 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e2fa1239-9637-4767-a155-0baf29f1f231 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.027102 Oct 11 04:32:59.886079 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2579/4917] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:32:59 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:32:59.899901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-97205e47-994a-4b74-ad70-53bd3b1ad967 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Action: 'create', calling method: .version_select at 0x7fda1a80d430>, body: {"server_group": {"name": "tempest-server-group-1366746539", "policies": ["anti-affinity"]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:32:59.940162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-97205e47-994a-4b74-ad70-53bd3b1ad967 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:32:59.950322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-97205e47-994a-4b74-ad70-53bd3b1ad967 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:33:00.127217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f569ed9b-38eb-4026-ac3c-5deb5ff07de2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:00.131575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-97205e47-994a-4b74-ad70-53bd3b1ad967 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:33:00.140115 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f569ed9b-38eb-4026-ac3c-5deb5ff07de2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1730 microversion: 2.1 time: 0.431269 Oct 11 04:33:00.140384 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2339/4918] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:32:59 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1730 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:00.143066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-97205e47-994a-4b74-ad70-53bd3b1ad967 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_groups'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:33:00.165121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e605cf81-e27c-4a6e-a201-2e7f253ca3b2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:00.166028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e605cf81-e27c-4a6e-a201-2e7f253ca3b2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:00.176779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e605cf81-e27c-4a6e-a201-2e7f253ca3b2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:00.177499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e605cf81-e27c-4a6e-a201-2e7f253ca3b2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:00.178126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e605cf81-e27c-4a6e-a201-2e7f253ca3b2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:00.179802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e605cf81-e27c-4a6e-a201-2e7f253ca3b2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:00.184065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e605cf81-e27c-4a6e-a201-2e7f253ca3b2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:00.184553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e605cf81-e27c-4a6e-a201-2e7f253ca3b2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:00.193079 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-97205e47-994a-4b74-ad70-53bd3b1ad967 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 169 microversion: 2.1 time: 0.305163 Oct 11 04:33:00.199565 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2580/4919] 10.222.0.26 () {60 vars in 1173 bytes} [Tue Oct 11 04:32:59 2022] POST /compute/v2.1/os-server-groups => generated 169 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:00.204640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b8e0934-0641-4e92-a827-809788498de5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:00.324728 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b8e0934-0641-4e92-a827-809788498de5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/a034dfe3-004e-4575-a7f8-d2206238ede4" status: 204 len: 0 microversion: 2.1 time: 0.123743 Oct 11 04:33:00.326587 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2581/4920] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:33:00 2022] DELETE /compute/v2.1/os-server-groups/a034dfe3-004e-4575-a7f8-d2206238ede4 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:33:00.335237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f5500be-082f-490d-9126-bdcaffd79dba tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:00.368667 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f5500be-082f-490d-9126-bdcaffd79dba tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.037572 Oct 11 04:33:00.369270 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2582/4921] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:33:00 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:00.393137 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e605cf81-e27c-4a6e-a201-2e7f253ca3b2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.231882 Oct 11 04:33:00.394300 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2340/4922] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:33:00 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-interface => generated 285 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:33:00.496851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerGroupTestJSON-server-243110944", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "2e67f598-d946-466c-8cd7-7280c63ac096"}]}, "os:scheduler_hints": {"group": "d8850290-93f5-42d4-b70d-28d3c1041789"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:00.580134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] validate_networks() for [('2e67f598-d946-466c-8cd7-7280c63ac096', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:33:01.140302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e4a7a009-d844-4a4b-a9a2-b1475cf7f5f2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:01.141390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e4a7a009-d844-4a4b-a9a2-b1475cf7f5f2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:01.148787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a7a009-d844-4a4b-a9a2-b1475cf7f5f2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:01.151608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a7a009-d844-4a4b-a9a2-b1475cf7f5f2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:01.151608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a7a009-d844-4a4b-a9a2-b1475cf7f5f2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:01.152185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a7a009-d844-4a4b-a9a2-b1475cf7f5f2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:01.152845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a7a009-d844-4a4b-a9a2-b1475cf7f5f2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:01.153423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a7a009-d844-4a4b-a9a2-b1475cf7f5f2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:01.184464 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e4a7a009-d844-4a4b-a9a2-b1475cf7f5f2 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982/os-server-password" status: 200 len: 116 microversion: 2.1 time: 0.049724 Oct 11 04:33:01.185857 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2341/4923] 10.222.0.26 () {58 vars in 1293 bytes} [Tue Oct 11 04:33:01 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982/os-server-password => generated 116 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:01.193301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:33:01.193301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:33:01.194643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:33:01.195728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:33:01.196386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:33:01.204663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=84,nova_api:DELETE=12,nova_api:INSERT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:01.225767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:01.228274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:01.229013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:01.230983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:01.232273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:01.232943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:01.265457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:33:01.273171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:33:01.299013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:33:01.307719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:33:01.488927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:33:01.497436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:33:01.624146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:33:01.631680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Getting quotas for user 90117a9c881446c2a417389a3dbe6f1b and project d165f0bda6de4f3e9eea841bea40fc82. Resources: {'server_group_members'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:33:01.689446 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee8531f9-8148-47fc-b97b-e2ed5f21e304 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.194578 Oct 11 04:33:01.691404 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2583/4924] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:33:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 1199 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:33:01.711861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1455fff5-cfbc-4bde-aa57-6851bba642e5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:01.712847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1455fff5-cfbc-4bde-aa57-6851bba642e5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:01.949148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1455fff5-cfbc-4bde-aa57-6851bba642e5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:01.984164 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1455fff5-cfbc-4bde-aa57-6851bba642e5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1212 microversion: 2.1 time: 0.284359 Oct 11 04:33:01.999840 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2342/4925] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:01 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1212 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:02.580457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2eb40284-6524-4efd-9e4c-26e940e7eede req-5138cb45-b8a9-480f-80c8-5fe10ed23f2c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec2cb39-bab6-4474-9901-5909a9053a80", "tag": "af219b67-485d-4b19-8980-781c7c1d38b7"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:02.608228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2eb40284-6524-4efd-9e4c-26e940e7eede req-5138cb45-b8a9-480f-80c8-5fe10ed23f2c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:02.608713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2eb40284-6524-4efd-9e4c-26e940e7eede req-5138cb45-b8a9-480f-80c8-5fe10ed23f2c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:02.609141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2eb40284-6524-4efd-9e4c-26e940e7eede req-5138cb45-b8a9-480f-80c8-5fe10ed23f2c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:02.638049 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2eb40284-6524-4efd-9e4c-26e940e7eede req-5138cb45-b8a9-480f-80c8-5fe10ed23f2c service nova] Creating event network-changed:af219b67-485d-4b19-8980-781c7c1d38b7 for instance 7ec2cb39-bab6-4474-9901-5909a9053a80 on n-h2-860892-1 Oct 11 04:33:02.645155 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2eb40284-6524-4efd-9e4c-26e940e7eede req-5138cb45-b8a9-480f-80c8-5fe10ed23f2c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070121 Oct 11 04:33:02.647235 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2584/4926] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:03.013721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90a832fa-7f55-422a-8a0c-9e4dd2ee581b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:03.014382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90a832fa-7f55-422a-8a0c-9e4dd2ee581b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:03.211800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90a832fa-7f55-422a-8a0c-9e4dd2ee581b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:03.224864 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90a832fa-7f55-422a-8a0c-9e4dd2ee581b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1212 microversion: 2.1 time: 0.215349 Oct 11 04:33:03.225774 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2343/4927] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:03 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1212 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:04.254002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e68ae6ad-4e5b-4eac-8b4d-9f7330a4b513 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:04.254805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e68ae6ad-4e5b-4eac-8b4d-9f7330a4b513 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:04.270987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e68ae6ad-4e5b-4eac-8b4d-9f7330a4b513 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:04.273452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e68ae6ad-4e5b-4eac-8b4d-9f7330a4b513 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:04.274011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e68ae6ad-4e5b-4eac-8b4d-9f7330a4b513 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:04.274807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e68ae6ad-4e5b-4eac-8b4d-9f7330a4b513 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:04.275316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e68ae6ad-4e5b-4eac-8b4d-9f7330a4b513 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:04.275685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e68ae6ad-4e5b-4eac-8b4d-9f7330a4b513 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:04.631151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e68ae6ad-4e5b-4eac-8b4d-9f7330a4b513 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:04.667229 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e68ae6ad-4e5b-4eac-8b4d-9f7330a4b513 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1208 microversion: 2.1 time: 0.418530 Oct 11 04:33:04.668938 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2585/4928] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:04 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1208 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:04.705689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-42b3b8d9-20c9-4d9e-a639-6f53b5301b11 req-09bf7c9c-7b0c-492c-b22a-738c183b61bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ec2cb39-bab6-4474-9901-5909a9053a80", "tag": "af219b67-485d-4b19-8980-781c7c1d38b7"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:04.736343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-42b3b8d9-20c9-4d9e-a639-6f53b5301b11 req-09bf7c9c-7b0c-492c-b22a-738c183b61bb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:04.737139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-42b3b8d9-20c9-4d9e-a639-6f53b5301b11 req-09bf7c9c-7b0c-492c-b22a-738c183b61bb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:04.737792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-42b3b8d9-20c9-4d9e-a639-6f53b5301b11 req-09bf7c9c-7b0c-492c-b22a-738c183b61bb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:04.752187 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-42b3b8d9-20c9-4d9e-a639-6f53b5301b11 req-09bf7c9c-7b0c-492c-b22a-738c183b61bb service nova] Creating event network-changed:af219b67-485d-4b19-8980-781c7c1d38b7 for instance 7ec2cb39-bab6-4474-9901-5909a9053a80 on n-h2-860892-1 Oct 11 04:33:04.759921 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-42b3b8d9-20c9-4d9e-a639-6f53b5301b11 req-09bf7c9c-7b0c-492c-b22a-738c183b61bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059339 Oct 11 04:33:04.760847 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2344/4929] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:05.694003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c7cf390a-d016-465d-af67-f600841003b5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:05.695415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c7cf390a-d016-465d-af67-f600841003b5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:05.701957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cf390a-d016-465d-af67-f600841003b5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:05.702765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cf390a-d016-465d-af67-f600841003b5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:05.709183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cf390a-d016-465d-af67-f600841003b5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:05.709183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cf390a-d016-465d-af67-f600841003b5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:05.709183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cf390a-d016-465d-af67-f600841003b5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:05.709183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7cf390a-d016-465d-af67-f600841003b5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:05.800112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c7cf390a-d016-465d-af67-f600841003b5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:05.826731 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c7cf390a-d016-465d-af67-f600841003b5 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1282 microversion: 2.1 time: 0.137939 Oct 11 04:33:05.840502 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2586/4930] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:05 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1282 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:06.854321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a264b473-a3b5-437e-9ee1-d415604c6b55 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:06.855698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a264b473-a3b5-437e-9ee1-d415604c6b55 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:06.873848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a264b473-a3b5-437e-9ee1-d415604c6b55 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:06.874592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a264b473-a3b5-437e-9ee1-d415604c6b55 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:06.875115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a264b473-a3b5-437e-9ee1-d415604c6b55 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:06.876411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a264b473-a3b5-437e-9ee1-d415604c6b55 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:06.876878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a264b473-a3b5-437e-9ee1-d415604c6b55 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:06.877716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a264b473-a3b5-437e-9ee1-d415604c6b55 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:06.992717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a264b473-a3b5-437e-9ee1-d415604c6b55 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:07.002406 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a264b473-a3b5-437e-9ee1-d415604c6b55 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1270 microversion: 2.1 time: 0.152469 Oct 11 04:33:07.002989 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2345/4931] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:06 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1270 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:08.027538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6ca554fb-ab40-4aa1-bb22-f9808fad6271 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:08.028886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6ca554fb-ab40-4aa1-bb22-f9808fad6271 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:08.041161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ca554fb-ab40-4aa1-bb22-f9808fad6271 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:08.041917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ca554fb-ab40-4aa1-bb22-f9808fad6271 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:08.049490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ca554fb-ab40-4aa1-bb22-f9808fad6271 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:08.050558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ca554fb-ab40-4aa1-bb22-f9808fad6271 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:08.051294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ca554fb-ab40-4aa1-bb22-f9808fad6271 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:08.051988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ca554fb-ab40-4aa1-bb22-f9808fad6271 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:08.592246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6ca554fb-ab40-4aa1-bb22-f9808fad6271 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:08.604822 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6ca554fb-ab40-4aa1-bb22-f9808fad6271 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1312 microversion: 2.1 time: 0.581251 Oct 11 04:33:08.610294 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2587/4932] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:08 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1312 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:09.639698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-144c84c3-ff1a-40d5-9bac-590464bf4aff tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:09.642488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-144c84c3-ff1a-40d5-9bac-590464bf4aff tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:09.663758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c84c3-ff1a-40d5-9bac-590464bf4aff tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:09.664258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c84c3-ff1a-40d5-9bac-590464bf4aff tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:09.665098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c84c3-ff1a-40d5-9bac-590464bf4aff tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:09.667660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c84c3-ff1a-40d5-9bac-590464bf4aff tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:09.670387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c84c3-ff1a-40d5-9bac-590464bf4aff tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:09.671028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c84c3-ff1a-40d5-9bac-590464bf4aff tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:09.975039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-144c84c3-ff1a-40d5-9bac-590464bf4aff tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:09.992010 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-144c84c3-ff1a-40d5-9bac-590464bf4aff tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1312 microversion: 2.1 time: 0.364543 Oct 11 04:33:09.997331 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2346/4933] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:09 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1312 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:11.015756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f2e1c93a-c1dd-4af3-867f-befde902f4b0 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:11.016358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f2e1c93a-c1dd-4af3-867f-befde902f4b0 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:11.026520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2e1c93a-c1dd-4af3-867f-befde902f4b0 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:11.031588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2e1c93a-c1dd-4af3-867f-befde902f4b0 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:11.031910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2e1c93a-c1dd-4af3-867f-befde902f4b0 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:11.034897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2e1c93a-c1dd-4af3-867f-befde902f4b0 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:11.037409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2e1c93a-c1dd-4af3-867f-befde902f4b0 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:11.041788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2e1c93a-c1dd-4af3-867f-befde902f4b0 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:11.249125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:11.443726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2e1c93a-c1dd-4af3-867f-befde902f4b0 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:11.457688 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f2e1c93a-c1dd-4af3-867f-befde902f4b0 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1312 microversion: 2.1 time: 0.445757 Oct 11 04:33:11.458603 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2588/4934] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:11 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1312 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:11.563903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-b4f8c9d4-d717-4fe8-a12f-ab146fa7ae8c req-7f3fbcee-e85f-4537-8203-345818cebd81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5770a63c-b10b-4613-aded-c7231391b762", "tag": "db4957cb-e05c-432f-b643-1a264d2c69ad"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:11.593008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b4f8c9d4-d717-4fe8-a12f-ab146fa7ae8c req-7f3fbcee-e85f-4537-8203-345818cebd81 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:11.596137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b4f8c9d4-d717-4fe8-a12f-ab146fa7ae8c req-7f3fbcee-e85f-4537-8203-345818cebd81 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:11.596790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b4f8c9d4-d717-4fe8-a12f-ab146fa7ae8c req-7f3fbcee-e85f-4537-8203-345818cebd81 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:11.615490 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-b4f8c9d4-d717-4fe8-a12f-ab146fa7ae8c req-7f3fbcee-e85f-4537-8203-345818cebd81 service nova] Creating event network-changed:db4957cb-e05c-432f-b643-1a264d2c69ad for instance 5770a63c-b10b-4613-aded-c7231391b762 on n-h1-860892-1 Oct 11 04:33:11.622630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-b4f8c9d4-d717-4fe8-a12f-ab146fa7ae8c req-7f3fbcee-e85f-4537-8203-345818cebd81 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062552 Oct 11 04:33:11.623704 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2347/4935] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:12.344089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=40 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:12.483706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62ba0449-6a9a-44e9-b6c8-0fa26b86d06f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:12.484464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-62ba0449-6a9a-44e9-b6c8-0fa26b86d06f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:12.493896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ba0449-6a9a-44e9-b6c8-0fa26b86d06f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:12.497785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ba0449-6a9a-44e9-b6c8-0fa26b86d06f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:12.498303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ba0449-6a9a-44e9-b6c8-0fa26b86d06f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:12.499057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ba0449-6a9a-44e9-b6c8-0fa26b86d06f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:12.499530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ba0449-6a9a-44e9-b6c8-0fa26b86d06f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:12.499967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62ba0449-6a9a-44e9-b6c8-0fa26b86d06f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:12.554165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1219641432", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:12.694575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] validate_networks() for [('970f73ec-9c49-458a-9006-bef8b5b2ed1f', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:33:13.058693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-62ba0449-6a9a-44e9-b6c8-0fa26b86d06f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:13.069719 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-62ba0449-6a9a-44e9-b6c8-0fa26b86d06f tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1312 microversion: 2.1 time: 0.589638 Oct 11 04:33:13.086691 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2348/4936] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:12 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1312 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:13.693399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:33:13.702803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:33:13.703640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:33:13.705573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:33:13.707257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:33:13.737184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:13.738633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:13.739727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:13.740810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:13.741655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:13.749150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:13.771438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Getting quotas for project ef6449e7695048039f7e9b4f2301616c. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:33:13.778222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Getting quotas for user 85832d32146545d79d249f533b0c652e and project ef6449e7695048039f7e9b4f2301616c. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:33:13.795217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:33:13.797725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:33:13.951615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-924fa4d4-5168-46e3-9e99-1ae242242249 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.611964 Oct 11 04:33:13.953657 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2589/4937] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:33:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 1616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:33:13.964728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2c55f228-7904-4926-b10a-c23dc2a6307e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:13.965711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2c55f228-7904-4926-b10a-c23dc2a6307e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:13.975519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=20 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:14.095812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-94c3e7e1-9039-44d1-bf03-cb4e644adc8a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:14.096696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-94c3e7e1-9039-44d1-bf03-cb4e644adc8a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:14.110523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94c3e7e1-9039-44d1-bf03-cb4e644adc8a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:14.112454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94c3e7e1-9039-44d1-bf03-cb4e644adc8a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:14.113099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94c3e7e1-9039-44d1-bf03-cb4e644adc8a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:14.114633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94c3e7e1-9039-44d1-bf03-cb4e644adc8a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:14.115395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94c3e7e1-9039-44d1-bf03-cb4e644adc8a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:14.116242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94c3e7e1-9039-44d1-bf03-cb4e644adc8a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:14.150639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c55f228-7904-4926-b10a-c23dc2a6307e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:14.157611 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2c55f228-7904-4926-b10a-c23dc2a6307e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1217 microversion: 2.1 time: 0.196694 Oct 11 04:33:14.163874 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2349/4938] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:13 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:14.377664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-94c3e7e1-9039-44d1-bf03-cb4e644adc8a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:14.391559 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-94c3e7e1-9039-44d1-bf03-cb4e644adc8a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1312 microversion: 2.1 time: 0.300268 Oct 11 04:33:14.392686 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2590/4939] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:14 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1312 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:15.188435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e04e0a4-9fa0-4e2f-b600-892b231071de tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:15.189775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8e04e0a4-9fa0-4e2f-b600-892b231071de tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:15.345262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8e04e0a4-9fa0-4e2f-b600-892b231071de tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:15.362598 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8e04e0a4-9fa0-4e2f-b600-892b231071de tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1217 microversion: 2.1 time: 0.180042 Oct 11 04:33:15.370032 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2350/4940] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:15 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1217 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:15.420303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c05515c-3069-480d-8c82-77b79349cd1c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:15.422258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c05515c-3069-480d-8c82-77b79349cd1c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:15.438788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c05515c-3069-480d-8c82-77b79349cd1c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:15.440514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c05515c-3069-480d-8c82-77b79349cd1c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:15.442510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c05515c-3069-480d-8c82-77b79349cd1c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:15.443593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c05515c-3069-480d-8c82-77b79349cd1c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:15.445923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c05515c-3069-480d-8c82-77b79349cd1c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:15.446704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c05515c-3069-480d-8c82-77b79349cd1c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:15.944148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c05515c-3069-480d-8c82-77b79349cd1c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:15.955008 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c05515c-3069-480d-8c82-77b79349cd1c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1312 microversion: 2.1 time: 0.541034 Oct 11 04:33:15.955922 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2591/4941] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:15 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1312 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:16.404275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cfcf318-0062-4a4c-9934-4f2a4355cc4c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:16.405215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2cfcf318-0062-4a4c-9934-4f2a4355cc4c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:16.429324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfcf318-0062-4a4c-9934-4f2a4355cc4c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:16.433313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfcf318-0062-4a4c-9934-4f2a4355cc4c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:16.433313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfcf318-0062-4a4c-9934-4f2a4355cc4c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:16.434340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfcf318-0062-4a4c-9934-4f2a4355cc4c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:16.435458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfcf318-0062-4a4c-9934-4f2a4355cc4c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:16.436458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfcf318-0062-4a4c-9934-4f2a4355cc4c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:16.604231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2cfcf318-0062-4a4c-9934-4f2a4355cc4c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:16.625609 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2cfcf318-0062-4a4c-9934-4f2a4355cc4c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1213 microversion: 2.1 time: 0.233749 Oct 11 04:33:16.649167 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2351/4942] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:16 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1213 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:16.983232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5f80aa53-143d-48c4-9eec-8557a6151653 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:16.983846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5f80aa53-143d-48c4-9eec-8557a6151653 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:16.999210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f80aa53-143d-48c4-9eec-8557a6151653 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:17.000179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f80aa53-143d-48c4-9eec-8557a6151653 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:17.002435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f80aa53-143d-48c4-9eec-8557a6151653 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:17.007560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f80aa53-143d-48c4-9eec-8557a6151653 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:17.008786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f80aa53-143d-48c4-9eec-8557a6151653 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:17.009039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f80aa53-143d-48c4-9eec-8557a6151653 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:17.539434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5f80aa53-143d-48c4-9eec-8557a6151653 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:17.550111 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5f80aa53-143d-48c4-9eec-8557a6151653 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1312 microversion: 2.1 time: 0.571003 Oct 11 04:33:17.558242 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2592/4943] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:16 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1312 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:17.661389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-505f90a8-73c2-4373-9f5d-442bf80aa228 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:17.662211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-505f90a8-73c2-4373-9f5d-442bf80aa228 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:17.677372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-505f90a8-73c2-4373-9f5d-442bf80aa228 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:17.678746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-505f90a8-73c2-4373-9f5d-442bf80aa228 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:17.679386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-505f90a8-73c2-4373-9f5d-442bf80aa228 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:17.682979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-505f90a8-73c2-4373-9f5d-442bf80aa228 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:17.683720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-505f90a8-73c2-4373-9f5d-442bf80aa228 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:17.685760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-505f90a8-73c2-4373-9f5d-442bf80aa228 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:17.853722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-505f90a8-73c2-4373-9f5d-442bf80aa228 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:17.874793 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-505f90a8-73c2-4373-9f5d-442bf80aa228 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1277 microversion: 2.1 time: 0.220094 Oct 11 04:33:17.886227 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2352/4944] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:17 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1277 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:18.574919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3c84d9c4-9e8c-4e6c-bcf6-c06dfad58eb8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:18.575691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3c84d9c4-9e8c-4e6c-bcf6-c06dfad58eb8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:18.587033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c84d9c4-9e8c-4e6c-bcf6-c06dfad58eb8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:18.587636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c84d9c4-9e8c-4e6c-bcf6-c06dfad58eb8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:18.588315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c84d9c4-9e8c-4e6c-bcf6-c06dfad58eb8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:18.589115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c84d9c4-9e8c-4e6c-bcf6-c06dfad58eb8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:18.590237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c84d9c4-9e8c-4e6c-bcf6-c06dfad58eb8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:18.590756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c84d9c4-9e8c-4e6c-bcf6-c06dfad58eb8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:18.903821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-77d28091-0b73-4de7-aabc-d3c086deca78 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:18.905282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-77d28091-0b73-4de7-aabc-d3c086deca78 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:18.927832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77d28091-0b73-4de7-aabc-d3c086deca78 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:18.940145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77d28091-0b73-4de7-aabc-d3c086deca78 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:18.941147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77d28091-0b73-4de7-aabc-d3c086deca78 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:18.942684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77d28091-0b73-4de7-aabc-d3c086deca78 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:18.945552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77d28091-0b73-4de7-aabc-d3c086deca78 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:18.947482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77d28091-0b73-4de7-aabc-d3c086deca78 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:19.103004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3c84d9c4-9e8c-4e6c-bcf6-c06dfad58eb8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:19.133018 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3c84d9c4-9e8c-4e6c-bcf6-c06dfad58eb8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1312 microversion: 2.1 time: 0.562305 Oct 11 04:33:19.147444 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2593/4945] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:18 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1312 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:19.328593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-77d28091-0b73-4de7-aabc-d3c086deca78 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:19.341045 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-77d28091-0b73-4de7-aabc-d3c086deca78 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1275 microversion: 2.1 time: 0.440037 Oct 11 04:33:19.342675 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2353/4946] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:18 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1275 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:20.165946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e1bfff12-6895-45e5-87d0-3f0529ba5a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:20.167243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e1bfff12-6895-45e5-87d0-3f0529ba5a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:20.176847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1bfff12-6895-45e5-87d0-3f0529ba5a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:20.177155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1bfff12-6895-45e5-87d0-3f0529ba5a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:20.178096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1bfff12-6895-45e5-87d0-3f0529ba5a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:20.179095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1bfff12-6895-45e5-87d0-3f0529ba5a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:20.179762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1bfff12-6895-45e5-87d0-3f0529ba5a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:20.180444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1bfff12-6895-45e5-87d0-3f0529ba5a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:20.369638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ffdb125-8eca-42fc-919a-cf809d6a06f5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:20.371197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ffdb125-8eca-42fc-919a-cf809d6a06f5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:20.394005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ffdb125-8eca-42fc-919a-cf809d6a06f5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:20.399085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ffdb125-8eca-42fc-919a-cf809d6a06f5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:20.405652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ffdb125-8eca-42fc-919a-cf809d6a06f5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:20.405652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ffdb125-8eca-42fc-919a-cf809d6a06f5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:20.405652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ffdb125-8eca-42fc-919a-cf809d6a06f5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:20.405652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ffdb125-8eca-42fc-919a-cf809d6a06f5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:20.459942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e1bfff12-6895-45e5-87d0-3f0529ba5a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:20.470808 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e1bfff12-6895-45e5-87d0-3f0529ba5a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1312 microversion: 2.1 time: 0.308926 Oct 11 04:33:20.479190 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2594/4947] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:20 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1312 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:20.873797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ffdb125-8eca-42fc-919a-cf809d6a06f5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:20.884435 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ffdb125-8eca-42fc-919a-cf809d6a06f5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1317 microversion: 2.1 time: 0.520460 Oct 11 04:33:20.885295 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2354/4948] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:20 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1317 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:21.503323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5e536db-7219-4296-9d7b-135e5bc96ae8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:21.503949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c5e536db-7219-4296-9d7b-135e5bc96ae8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:21.525015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5e536db-7219-4296-9d7b-135e5bc96ae8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:21.526622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5e536db-7219-4296-9d7b-135e5bc96ae8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:21.526622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5e536db-7219-4296-9d7b-135e5bc96ae8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:21.527034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5e536db-7219-4296-9d7b-135e5bc96ae8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:21.527288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5e536db-7219-4296-9d7b-135e5bc96ae8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:21.527727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5e536db-7219-4296-9d7b-135e5bc96ae8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:21.558345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5c035442-b6bd-4863-9666-a633753fe5fe req-5d96f673-6fdb-4d82-b88b-797ae5988cd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5770a63c-b10b-4613-aded-c7231391b762", "name": "network-vif-plugged", "status": "completed", "tag": "db4957cb-e05c-432f-b643-1a264d2c69ad"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:21.577048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5c035442-b6bd-4863-9666-a633753fe5fe req-5d96f673-6fdb-4d82-b88b-797ae5988cd5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:21.577545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5c035442-b6bd-4863-9666-a633753fe5fe req-5d96f673-6fdb-4d82-b88b-797ae5988cd5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:21.578211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5c035442-b6bd-4863-9666-a633753fe5fe req-5d96f673-6fdb-4d82-b88b-797ae5988cd5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:21.591693 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5c035442-b6bd-4863-9666-a633753fe5fe req-5d96f673-6fdb-4d82-b88b-797ae5988cd5 service nova] Creating event network-vif-plugged:db4957cb-e05c-432f-b643-1a264d2c69ad for instance 5770a63c-b10b-4613-aded-c7231391b762 on n-h1-860892-1 Oct 11 04:33:21.597501 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5c035442-b6bd-4863-9666-a633753fe5fe req-5d96f673-6fdb-4d82-b88b-797ae5988cd5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043017 Oct 11 04:33:21.599167 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2355/4949] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:33:21.635580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-924b068b-d9bf-426b-9b92-acfc6198ca08 req-510f1046-3bbb-46b4-82c9-e18d93045009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90650e13-1fd0-479b-972e-d36b6521b37f", "tag": "04a8a7cd-3242-44a3-b767-f91dca6b2149"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:21.647815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-924b068b-d9bf-426b-9b92-acfc6198ca08 req-510f1046-3bbb-46b4-82c9-e18d93045009 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:21.648514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-924b068b-d9bf-426b-9b92-acfc6198ca08 req-510f1046-3bbb-46b4-82c9-e18d93045009 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:21.649106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-924b068b-d9bf-426b-9b92-acfc6198ca08 req-510f1046-3bbb-46b4-82c9-e18d93045009 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:21.683709 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-924b068b-d9bf-426b-9b92-acfc6198ca08 req-510f1046-3bbb-46b4-82c9-e18d93045009 service nova] Creating event network-changed:04a8a7cd-3242-44a3-b767-f91dca6b2149 for instance 90650e13-1fd0-479b-972e-d36b6521b37f on n-h2-860892-1 Oct 11 04:33:21.691131 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-924b068b-d9bf-426b-9b92-acfc6198ca08 req-510f1046-3bbb-46b4-82c9-e18d93045009 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060792 Oct 11 04:33:21.693097 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2356/4950] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:21.915919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-11009a62-fc3f-4f2a-8fd9-6550b3f99650 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:21.919361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-11009a62-fc3f-4f2a-8fd9-6550b3f99650 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:21.928546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11009a62-fc3f-4f2a-8fd9-6550b3f99650 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:21.929317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11009a62-fc3f-4f2a-8fd9-6550b3f99650 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:21.929991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11009a62-fc3f-4f2a-8fd9-6550b3f99650 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:21.930948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11009a62-fc3f-4f2a-8fd9-6550b3f99650 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:21.931830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11009a62-fc3f-4f2a-8fd9-6550b3f99650 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:21.932529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11009a62-fc3f-4f2a-8fd9-6550b3f99650 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:21.998920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5e536db-7219-4296-9d7b-135e5bc96ae8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:22.013562 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c5e536db-7219-4296-9d7b-135e5bc96ae8 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1312 microversion: 2.1 time: 0.512233 Oct 11 04:33:22.014820 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2595/4951] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:21 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1312 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:22.243997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-11009a62-fc3f-4f2a-8fd9-6550b3f99650 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:22.256113 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-11009a62-fc3f-4f2a-8fd9-6550b3f99650 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1317 microversion: 2.1 time: 0.346658 Oct 11 04:33:22.257693 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2357/4952] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:21 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:23.037671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-191e6817-fb47-4713-a880-2e1da7a9ad51 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:23.039165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-191e6817-fb47-4713-a880-2e1da7a9ad51 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:23.047363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-191e6817-fb47-4713-a880-2e1da7a9ad51 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:23.052345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-191e6817-fb47-4713-a880-2e1da7a9ad51 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:23.054558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-191e6817-fb47-4713-a880-2e1da7a9ad51 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:23.054558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-191e6817-fb47-4713-a880-2e1da7a9ad51 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:23.054558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-191e6817-fb47-4713-a880-2e1da7a9ad51 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:23.055673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-191e6817-fb47-4713-a880-2e1da7a9ad51 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:23.253302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-191e6817-fb47-4713-a880-2e1da7a9ad51 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:23.264907 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-191e6817-fb47-4713-a880-2e1da7a9ad51 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1312 microversion: 2.1 time: 0.231381 Oct 11 04:33:23.265717 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2596/4953] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:23 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1312 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:23.286680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae988290-cb6f-4362-a467-784e116556c9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:23.287291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ae988290-cb6f-4362-a467-784e116556c9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:23.293807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:23.296473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae988290-cb6f-4362-a467-784e116556c9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:23.297344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae988290-cb6f-4362-a467-784e116556c9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:23.297476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae988290-cb6f-4362-a467-784e116556c9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:23.298072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae988290-cb6f-4362-a467-784e116556c9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:23.298716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae988290-cb6f-4362-a467-784e116556c9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:23.299950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae988290-cb6f-4362-a467-784e116556c9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:23.482024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ae988290-cb6f-4362-a467-784e116556c9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:23.491491 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ae988290-cb6f-4362-a467-784e116556c9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1317 microversion: 2.1 time: 0.209283 Oct 11 04:33:23.492672 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2358/4954] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:23 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1317 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:24.106057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb1fc828-a661-4c5b-a981-302373457c8e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:24.107414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bb1fc828-a661-4c5b-a981-302373457c8e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:24.113808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:24.114829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:24.121089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb1fc828-a661-4c5b-a981-302373457c8e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:24.127204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb1fc828-a661-4c5b-a981-302373457c8e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:24.127204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb1fc828-a661-4c5b-a981-302373457c8e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:24.127204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb1fc828-a661-4c5b-a981-302373457c8e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:24.127204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb1fc828-a661-4c5b-a981-302373457c8e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:24.127204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb1fc828-a661-4c5b-a981-302373457c8e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:24.234352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-bb1fc828-a661-4c5b-a981-302373457c8e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lazy-loading 'services' on Instance uuid 999777c2-2b4b-4ae8-ab23-7709485d2501 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:33:24.288994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-50ac04c6-0d71-4479-8821-4f14285c910b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:24.290804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-50ac04c6-0d71-4479-8821-4f14285c910b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:24.303762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ac04c6-0d71-4479-8821-4f14285c910b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:24.304782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ac04c6-0d71-4479-8821-4f14285c910b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:24.305652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ac04c6-0d71-4479-8821-4f14285c910b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:24.307258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ac04c6-0d71-4479-8821-4f14285c910b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:24.307909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ac04c6-0d71-4479-8821-4f14285c910b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:24.309096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ac04c6-0d71-4479-8821-4f14285c910b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:24.517664 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb1fc828-a661-4c5b-a981-302373457c8e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "DELETE /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/os-volume_attachments/f6e18136-0ea3-409e-aa28-12679cda21e9" status: 202 len: 0 microversion: 2.1 time: 0.417722 Oct 11 04:33:24.520975 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2597/4955] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:33:24 2022] DELETE /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/os-volume_attachments/f6e18136-0ea3-409e-aa28-12679cda21e9 => generated 0 bytes in 424 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:33:24.529258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0bae51d3-c7eb-4a48-b3f7-1546d4d101e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:24.530258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0bae51d3-c7eb-4a48-b3f7-1546d4d101e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:24.540586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bae51d3-c7eb-4a48-b3f7-1546d4d101e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:24.541368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bae51d3-c7eb-4a48-b3f7-1546d4d101e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:24.549855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bae51d3-c7eb-4a48-b3f7-1546d4d101e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:24.551730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bae51d3-c7eb-4a48-b3f7-1546d4d101e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:24.552436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bae51d3-c7eb-4a48-b3f7-1546d4d101e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:24.553178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bae51d3-c7eb-4a48-b3f7-1546d4d101e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:24.584152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-50ac04c6-0d71-4479-8821-4f14285c910b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:24.595252 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-50ac04c6-0d71-4479-8821-4f14285c910b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1498 microversion: 2.1 time: 0.311295 Oct 11 04:33:24.599778 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2359/4956] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:24 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1498 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:24.627365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3af7202a-7d14-4551-b638-3859e53fc31b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:24.664187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.compute.server_groups [None req-3af7202a-7d14-4551-b638-3859e53fc31b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Querying cell 7f919055-bb4c-4077-93f0-960b402ab88d(cell1) for 1 instances {{(pid=120993) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 04:33:24.664969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af7202a-7d14-4551-b638-3859e53fc31b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:24.665456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af7202a-7d14-4551-b638-3859e53fc31b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:24.670231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3af7202a-7d14-4551-b638-3859e53fc31b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:24.740557 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3af7202a-7d14-4551-b638-3859e53fc31b tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/d8850290-93f5-42d4-b70d-28d3c1041789" status: 200 len: 221 microversion: 2.1 time: 0.121986 Oct 11 04:33:24.741344 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2360/4957] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:33:24 2022] GET /compute/v2.1/os-server-groups/d8850290-93f5-42d4-b70d-28d3c1041789 => generated 221 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:24.752428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ecf5ad6-8a46-4eb2-a553-7a6cf6671cef tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:24.754821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ecf5ad6-8a46-4eb2-a553-7a6cf6671cef tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:24.765561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecf5ad6-8a46-4eb2-a553-7a6cf6671cef tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:24.766792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecf5ad6-8a46-4eb2-a553-7a6cf6671cef tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:24.767091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecf5ad6-8a46-4eb2-a553-7a6cf6671cef tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:24.768662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecf5ad6-8a46-4eb2-a553-7a6cf6671cef tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:24.769215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecf5ad6-8a46-4eb2-a553-7a6cf6671cef tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:24.770504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ecf5ad6-8a46-4eb2-a553-7a6cf6671cef tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:24.807626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ecf5ad6-8a46-4eb2-a553-7a6cf6671cef tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:33:24.821526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0bae51d3-c7eb-4a48-b3f7-1546d4d101e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:24.834283 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0bae51d3-c7eb-4a48-b3f7-1546d4d101e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1317 microversion: 2.1 time: 0.311754 Oct 11 04:33:24.835887 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2598/4958] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:24 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1317 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:24.852522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:25.167676 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ecf5ad6-8a46-4eb2-a553-7a6cf6671cef tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 204 len: 0 microversion: 2.1 time: 0.418797 Oct 11 04:33:25.168427 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2361/4959] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:33:24 2022] DELETE /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:33:25.178580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8ec96c72-79b8-4c85-8525-8c6ce780e04c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:25.178580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8ec96c72-79b8-4c85-8525-8c6ce780e04c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:25.192602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ec96c72-79b8-4c85-8525-8c6ce780e04c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:25.197971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ec96c72-79b8-4c85-8525-8c6ce780e04c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:25.200688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ec96c72-79b8-4c85-8525-8c6ce780e04c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:25.201847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ec96c72-79b8-4c85-8525-8c6ce780e04c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:25.204556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ec96c72-79b8-4c85-8525-8c6ce780e04c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:25.205489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ec96c72-79b8-4c85-8525-8c6ce780e04c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:25.467176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8ec96c72-79b8-4c85-8525-8c6ce780e04c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:25.480287 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8ec96c72-79b8-4c85-8525-8c6ce780e04c tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1504 microversion: 2.1 time: 0.304918 Oct 11 04:33:25.490897 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2599/4960] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:25 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1504 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:25.859879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3dc41990-f858-4768-9ead-b29eb3169647 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:25.861478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3dc41990-f858-4768-9ead-b29eb3169647 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:25.870399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:25.886014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3dc41990-f858-4768-9ead-b29eb3169647 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:25.888926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3dc41990-f858-4768-9ead-b29eb3169647 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:25.889376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3dc41990-f858-4768-9ead-b29eb3169647 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:25.890099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3dc41990-f858-4768-9ead-b29eb3169647 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:25.890582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3dc41990-f858-4768-9ead-b29eb3169647 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:25.890996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3dc41990-f858-4768-9ead-b29eb3169647 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:26.111448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3dc41990-f858-4768-9ead-b29eb3169647 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:26.129816 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3dc41990-f858-4768-9ead-b29eb3169647 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1317 microversion: 2.1 time: 0.274070 Oct 11 04:33:26.130998 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2362/4961] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:25 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1317 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:26.507116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6b6c9f1-0ad1-41cd-8eea-2747bf8f03f6 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:26.507729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6b6c9f1-0ad1-41cd-8eea-2747bf8f03f6 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:26.517723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b6c9f1-0ad1-41cd-8eea-2747bf8f03f6 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:26.518226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b6c9f1-0ad1-41cd-8eea-2747bf8f03f6 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:26.526784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b6c9f1-0ad1-41cd-8eea-2747bf8f03f6 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:26.526784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b6c9f1-0ad1-41cd-8eea-2747bf8f03f6 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:26.526784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b6c9f1-0ad1-41cd-8eea-2747bf8f03f6 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:26.526784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6b6c9f1-0ad1-41cd-8eea-2747bf8f03f6 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:26.966117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6b6c9f1-0ad1-41cd-8eea-2747bf8f03f6 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:26.966117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:26.973842 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6b6c9f1-0ad1-41cd-8eea-2747bf8f03f6 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1504 microversion: 2.1 time: 0.470350 Oct 11 04:33:26.975132 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2600/4962] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:26 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1504 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:27.153375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-929a8b35-4eee-4527-b803-6b2073c9109b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:27.154869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-929a8b35-4eee-4527-b803-6b2073c9109b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:27.173476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-929a8b35-4eee-4527-b803-6b2073c9109b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:27.174165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-929a8b35-4eee-4527-b803-6b2073c9109b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:27.174790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-929a8b35-4eee-4527-b803-6b2073c9109b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:27.175661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-929a8b35-4eee-4527-b803-6b2073c9109b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:27.176358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-929a8b35-4eee-4527-b803-6b2073c9109b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:27.176929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-929a8b35-4eee-4527-b803-6b2073c9109b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:27.427129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-929a8b35-4eee-4527-b803-6b2073c9109b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:27.438386 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-929a8b35-4eee-4527-b803-6b2073c9109b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1317 microversion: 2.1 time: 0.288848 Oct 11 04:33:27.452312 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2363/4963] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:27 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1317 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:27.476882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-ede74c53-ddbf-4cd5-838e-1b4d68a35bbc req-fc58cda4-219d-40a6-98ac-cec8e8ea5d3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5770a63c-b10b-4613-aded-c7231391b762", "name": "network-vif-deleted", "tag": "db4957cb-e05c-432f-b643-1a264d2c69ad"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:27.491120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ede74c53-ddbf-4cd5-838e-1b4d68a35bbc req-fc58cda4-219d-40a6-98ac-cec8e8ea5d3f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:27.503110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ede74c53-ddbf-4cd5-838e-1b4d68a35bbc req-fc58cda4-219d-40a6-98ac-cec8e8ea5d3f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:27.503826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ede74c53-ddbf-4cd5-838e-1b4d68a35bbc req-fc58cda4-219d-40a6-98ac-cec8e8ea5d3f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:27.537501 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-ede74c53-ddbf-4cd5-838e-1b4d68a35bbc req-fc58cda4-219d-40a6-98ac-cec8e8ea5d3f service nova] Creating event network-vif-deleted:db4957cb-e05c-432f-b643-1a264d2c69ad for instance 5770a63c-b10b-4613-aded-c7231391b762 on n-h1-860892-1 Oct 11 04:33:27.545236 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-ede74c53-ddbf-4cd5-838e-1b4d68a35bbc req-fc58cda4-219d-40a6-98ac-cec8e8ea5d3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072833 Oct 11 04:33:27.546629 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2601/4964] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:27.601642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2ae7f73b-f6f0-4fb0-9a21-a316f6691c8b req-62a09bae-fe45-4941-9032-81b29a1bd018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90650e13-1fd0-479b-972e-d36b6521b37f", "name": "network-vif-plugged", "status": "completed", "tag": "04a8a7cd-3242-44a3-b767-f91dca6b2149"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:27.627262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2ae7f73b-f6f0-4fb0-9a21-a316f6691c8b req-62a09bae-fe45-4941-9032-81b29a1bd018 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:27.627262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2ae7f73b-f6f0-4fb0-9a21-a316f6691c8b req-62a09bae-fe45-4941-9032-81b29a1bd018 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:27.627262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2ae7f73b-f6f0-4fb0-9a21-a316f6691c8b req-62a09bae-fe45-4941-9032-81b29a1bd018 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:27.643093 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2ae7f73b-f6f0-4fb0-9a21-a316f6691c8b req-62a09bae-fe45-4941-9032-81b29a1bd018 service nova] Creating event network-vif-plugged:04a8a7cd-3242-44a3-b767-f91dca6b2149 for instance 90650e13-1fd0-479b-972e-d36b6521b37f on n-h2-860892-1 Oct 11 04:33:27.653131 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2ae7f73b-f6f0-4fb0-9a21-a316f6691c8b req-62a09bae-fe45-4941-9032-81b29a1bd018 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059652 Oct 11 04:33:27.653907 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2364/4965] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:27.998594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:27.999349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:28.007801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:28.011851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:28.013526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:28.015633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:28.015633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:28.015633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:28.087460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:28.087965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:28.088431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:28.088873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lazy-loading 'fault' on Instance uuid 5770a63c-b10b-4613-aded-c7231391b762 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:33:28.139042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '90117a9c881446c2a417389a3dbe6f1b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd165f0bda6de4f3e9eea841bea40fc82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:28.148377 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e200751-0896-4ff3-9707-31750c561543 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 200 len: 1302 microversion: 2.1 time: 0.154753 Oct 11 04:33:28.158551 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2602/4966] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:27 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 1302 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:28.478949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00d96e35-3666-47a9-8aa5-3f6362fd820d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:28.479702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00d96e35-3666-47a9-8aa5-3f6362fd820d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:28.487789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d96e35-3666-47a9-8aa5-3f6362fd820d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:28.488834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d96e35-3666-47a9-8aa5-3f6362fd820d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:28.489281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d96e35-3666-47a9-8aa5-3f6362fd820d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:28.489983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d96e35-3666-47a9-8aa5-3f6362fd820d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:28.490461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d96e35-3666-47a9-8aa5-3f6362fd820d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:28.491338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00d96e35-3666-47a9-8aa5-3f6362fd820d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:28.743218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-00d96e35-3666-47a9-8aa5-3f6362fd820d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:28.754786 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00d96e35-3666-47a9-8aa5-3f6362fd820d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1317 microversion: 2.1 time: 0.278229 Oct 11 04:33:28.754786 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2365/4967] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:28 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1317 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:29.179271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:29.179861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:29.189558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:29.195445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:29.195445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:29.195445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:29.195445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:29.195445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:29.208013 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] HTTP exception thrown: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Request method failure captured: Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 HTTP/1.1 Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPH6ZDW4sMW6yLD_Cx1HV73movADEzI-bR23z6ZbtdltzOD0JS5ns4mWI9IpbHW3XTdFSy37PRnPqEPOsRX8GCIScb04jk_Nry0bvdl8KWjGlZwBEXdqXp23si9iQKEabPdNhIbVLKeAV8dBDnElDC5lyLSfkMsr8TtSJ4RfpICqch4 Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}] Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 90117a9c881446c2a417389a3dbe6f1b Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '5770a63c-b10b-4613-aded-c7231391b762'} Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.209698 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.214181 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.214181 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.214181 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.214181 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:33:29.214181 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:33:29.214181 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.214181 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.214181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Returning 404 to user: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:29.214181 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-43c99a43-d229-49ba-9641-84bab51ce6c3 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 404 len: 111 microversion: 2.1 time: 0.037161 Oct 11 04:33:29.214181 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2603/4968] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:29 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:33:29.221697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f480269-ca8b-4aca-9413-01e87e92d09e tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:29.237193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.compute.server_groups [None req-2f480269-ca8b-4aca-9413-01e87e92d09e tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Querying cell 7f919055-bb4c-4077-93f0-960b402ab88d(cell1) for 1 instances {{(pid=120993) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 04:33:29.237917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f480269-ca8b-4aca-9413-01e87e92d09e tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:29.238958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f480269-ca8b-4aca-9413-01e87e92d09e tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:29.239589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f480269-ca8b-4aca-9413-01e87e92d09e tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:29.251155 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f480269-ca8b-4aca-9413-01e87e92d09e tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 186 microversion: 2.1 time: 0.032831 Oct 11 04:33:29.251743 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2366/4969] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:33:29 2022] GET /compute/v2.1/os-server-groups => generated 186 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:29.264320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8a147d0e-9bc9-400c-9e11-f51cf1aba61a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:29.279162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.compute.server_groups [None req-8a147d0e-9bc9-400c-9e11-f51cf1aba61a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Querying cell 7f919055-bb4c-4077-93f0-960b402ab88d(cell1) for 1 instances {{(pid=120994) _get_not_deleted /opt/stack/nova/nova/api/openstack/compute/server_groups.py:69}} Oct 11 04:33:29.289426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a147d0e-9bc9-400c-9e11-f51cf1aba61a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:29.289426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a147d0e-9bc9-400c-9e11-f51cf1aba61a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:29.289426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a147d0e-9bc9-400c-9e11-f51cf1aba61a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:29.291787 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8a147d0e-9bc9-400c-9e11-f51cf1aba61a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/d8850290-93f5-42d4-b70d-28d3c1041789" status: 200 len: 183 microversion: 2.1 time: 0.031565 Oct 11 04:33:29.292372 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2604/4970] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 04:33:29 2022] GET /compute/v2.1/os-server-groups/d8850290-93f5-42d4-b70d-28d3c1041789 => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:29.305748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:29.306456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:29.312806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:29.313431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:29.314006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:29.315010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:29.315735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:29.316327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:29.332096 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] HTTP exception thrown: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Request method failure captured: Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 HTTP/1.1 Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPH6ZDW4sMW6yLD_Cx1HV73movADEzI-bR23z6ZbtdltzOD0JS5ns4mWI9IpbHW3XTdFSy37PRnPqEPOsRX8GCIScb04jk_Nry0bvdl8KWjGlZwBEXdqXp23si9iQKEabPdNhIbVLKeAV8dBDnElDC5lyLSfkMsr8TtSJ4RfpICqch4 Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}] Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 90117a9c881446c2a417389a3dbe6f1b Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '5770a63c-b10b-4613-aded-c7231391b762'} Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:33:29.334093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.338653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Returning 404 to user: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:29.340195 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f6a55cf-31cf-439a-be96-87a0d24b9401 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 404 len: 111 microversion: 2.1 time: 0.040258 Oct 11 04:33:29.341336 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2367/4971] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:33:29 2022] DELETE /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:33:29.349765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:29.350814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] [instance: 5770a63c-b10b-4613-aded-c7231391b762] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:29.354490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:29.358693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:29.361615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:29.361615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:29.361615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:29.361615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:29.361615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:29.388617 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] HTTP exception thrown: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Request method failure captured: Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 HTTP/1.1 Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPH6ZDW4sMW6yLD_Cx1HV73movADEzI-bR23z6ZbtdltzOD0JS5ns4mWI9IpbHW3XTdFSy37PRnPqEPOsRX8GCIScb04jk_Nry0bvdl8KWjGlZwBEXdqXp23si9iQKEabPdNhIbVLKeAV8dBDnElDC5lyLSfkMsr8TtSJ4RfpICqch4 Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}] Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 90117a9c881446c2a417389a3dbe6f1b Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '5770a63c-b10b-4613-aded-c7231391b762'} Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.392726 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.400750 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.400750 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.400750 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.400750 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:33:29.400750 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:33:29.400750 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. Oct 11 04:33:29.400750 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.400750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Returning 404 to user: Instance 5770a63c-b10b-4613-aded-c7231391b762 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:29.401615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-de1977ad-b6a7-4cc4-93c1-1df63e61ac79 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762" status: 404 len: 111 microversion: 2.1 time: 0.050819 Oct 11 04:33:29.405743 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2605/4972] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:29 2022] GET /compute/v2.1/servers/5770a63c-b10b-4613-aded-c7231391b762 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:33:29.411336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3b7820c9-2d9f-4c71-9a50-7498d22ef72a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:29.417915 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-3b7820c9-2d9f-4c71-9a50-7498d22ef72a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] HTTP exception thrown: Instance group a034dfe3-004e-4575-a7f8-d2206238ede4 could not be found. Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3b7820c9-2d9f-4c71-9a50-7498d22ef72a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Request method failure captured: Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-server-groups/a034dfe3-004e-4575-a7f8-d2206238ede4 HTTP/1.1 Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPH6ZDW4sMW6yLD_Cx1HV73movADEzI-bR23z6ZbtdltzOD0JS5ns4mWI9IpbHW3XTdFSy37PRnPqEPOsRX8GCIScb04jk_Nry0bvdl8KWjGlZwBEXdqXp23si9iQKEabPdNhIbVLKeAV8dBDnElDC5lyLSfkMsr8TtSJ4RfpICqch4 Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}] Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 90117a9c881446c2a417389a3dbe6f1b Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance group a034dfe3-004e-4575-a7f8-d2206238ede4 could not be found. Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'a034dfe3-004e-4575-a7f8-d2206238ede4'} Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a034dfe3-004e-4575-a7f8-d2206238ede4 could not be found. Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a034dfe3-004e-4575-a7f8-d2206238ede4 could not be found. Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.428107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.432724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.432724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.432724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:33:29.432724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:33:29.432724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a034dfe3-004e-4575-a7f8-d2206238ede4 could not be found. Oct 11 04:33:29.432724 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.434822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3b7820c9-2d9f-4c71-9a50-7498d22ef72a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Returning 404 to user: Instance group a034dfe3-004e-4575-a7f8-d2206238ede4 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:29.436070 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3b7820c9-2d9f-4c71-9a50-7498d22ef72a tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/a034dfe3-004e-4575-a7f8-d2206238ede4" status: 404 len: 117 microversion: 2.1 time: 0.029537 Oct 11 04:33:29.442275 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2368/4973] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:33:29 2022] DELETE /compute/v2.1/os-server-groups/a034dfe3-004e-4575-a7f8-d2206238ede4 => generated 117 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:33:29.445427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a84333e-6590-493f-a722-9c91978c1a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:29.452682 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-3a84333e-6590-493f-a722-9c91978c1a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] HTTP exception thrown: Instance group 40de3d41-3f9a-4db1-9660-6d2fab9dcf28 could not be found. Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a84333e-6590-493f-a722-9c91978c1a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Request method failure captured: Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-server-groups/40de3d41-3f9a-4db1-9660-6d2fab9dcf28 HTTP/1.1 Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPH6ZDW4sMW6yLD_Cx1HV73movADEzI-bR23z6ZbtdltzOD0JS5ns4mWI9IpbHW3XTdFSy37PRnPqEPOsRX8GCIScb04jk_Nry0bvdl8KWjGlZwBEXdqXp23si9iQKEabPdNhIbVLKeAV8dBDnElDC5lyLSfkMsr8TtSJ4RfpICqch4 Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}] Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 90117a9c881446c2a417389a3dbe6f1b Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance group 40de3d41-3f9a-4db1-9660-6d2fab9dcf28 could not be found. Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '40de3d41-3f9a-4db1-9660-6d2fab9dcf28'} Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 40de3d41-3f9a-4db1-9660-6d2fab9dcf28 could not be found. Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 40de3d41-3f9a-4db1-9660-6d2fab9dcf28 could not be found. Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.455205 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.459609 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.459609 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.459609 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:33:29.459609 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:33:29.459609 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 40de3d41-3f9a-4db1-9660-6d2fab9dcf28 could not be found. Oct 11 04:33:29.459609 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.460869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a84333e-6590-493f-a722-9c91978c1a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Returning 404 to user: Instance group 40de3d41-3f9a-4db1-9660-6d2fab9dcf28 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:29.461882 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a84333e-6590-493f-a722-9c91978c1a35 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/40de3d41-3f9a-4db1-9660-6d2fab9dcf28" status: 404 len: 117 microversion: 2.1 time: 0.020905 Oct 11 04:33:29.465859 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2606/4974] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:33:29 2022] DELETE /compute/v2.1/os-server-groups/40de3d41-3f9a-4db1-9660-6d2fab9dcf28 => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:33:29.472566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e7403450-4e17-40de-9034-56cc96b843b4 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:29.480583 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-e7403450-4e17-40de-9034-56cc96b843b4 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] HTTP exception thrown: Instance group 7b187523-cfc5-4d82-a802-15f04915fa46 could not be found. Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e7403450-4e17-40de-9034-56cc96b843b4 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Request method failure captured: Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-server-groups/7b187523-cfc5-4d82-a802-15f04915fa46 HTTP/1.1 Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPH6ZDW4sMW6yLD_Cx1HV73movADEzI-bR23z6ZbtdltzOD0JS5ns4mWI9IpbHW3XTdFSy37PRnPqEPOsRX8GCIScb04jk_Nry0bvdl8KWjGlZwBEXdqXp23si9iQKEabPdNhIbVLKeAV8dBDnElDC5lyLSfkMsr8TtSJ4RfpICqch4 Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}] Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 90117a9c881446c2a417389a3dbe6f1b Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance group 7b187523-cfc5-4d82-a802-15f04915fa46 could not be found. Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '7b187523-cfc5-4d82-a802-15f04915fa46'} Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 7b187523-cfc5-4d82-a802-15f04915fa46 could not be found. Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 7b187523-cfc5-4d82-a802-15f04915fa46 could not be found. Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.482831 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.492899 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.492899 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.492899 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:33:29.492899 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:33:29.492899 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 7b187523-cfc5-4d82-a802-15f04915fa46 could not be found. Oct 11 04:33:29.492899 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.492899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e7403450-4e17-40de-9034-56cc96b843b4 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Returning 404 to user: Instance group 7b187523-cfc5-4d82-a802-15f04915fa46 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:29.492899 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e7403450-4e17-40de-9034-56cc96b843b4 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/7b187523-cfc5-4d82-a802-15f04915fa46" status: 404 len: 117 microversion: 2.1 time: 0.016923 Oct 11 04:33:29.492899 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2369/4975] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:33:29 2022] DELETE /compute/v2.1/os-server-groups/7b187523-cfc5-4d82-a802-15f04915fa46 => generated 117 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:33:29.497978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-293a3ea0-3bc6-4eec-a26b-b13474d319b1 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:29.505877 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-293a3ea0-3bc6-4eec-a26b-b13474d319b1 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] HTTP exception thrown: Instance group 5519539a-4336-4789-aa6c-c1e898b2f62d could not be found. Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-293a3ea0-3bc6-4eec-a26b-b13474d319b1 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Request method failure captured: Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-server-groups/5519539a-4336-4789-aa6c-c1e898b2f62d HTTP/1.1 Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPH6ZDW4sMW6yLD_Cx1HV73movADEzI-bR23z6ZbtdltzOD0JS5ns4mWI9IpbHW3XTdFSy37PRnPqEPOsRX8GCIScb04jk_Nry0bvdl8KWjGlZwBEXdqXp23si9iQKEabPdNhIbVLKeAV8dBDnElDC5lyLSfkMsr8TtSJ4RfpICqch4 Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d165f0bda6de4f3e9eea841bea40fc82"}]}] Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d165f0bda6de4f3e9eea841bea40fc82 Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerGroupTestJSON-1355646561 Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 90117a9c881446c2a417389a3dbe6f1b Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerGroupTestJSON-1355646561-project Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance group 5519539a-4336-4789-aa6c-c1e898b2f62d could not be found. Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '5519539a-4336-4789-aa6c-c1e898b2f62d'} Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group 5519539a-4336-4789-aa6c-c1e898b2f62d could not be found. Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group 5519539a-4336-4789-aa6c-c1e898b2f62d could not be found. Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.507482 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:29.512292 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:29.512292 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:29.512292 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:33:29.512292 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:33:29.512292 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group 5519539a-4336-4789-aa6c-c1e898b2f62d could not be found. Oct 11 04:33:29.512292 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:29.512292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-293a3ea0-3bc6-4eec-a26b-b13474d319b1 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Returning 404 to user: Instance group 5519539a-4336-4789-aa6c-c1e898b2f62d could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:29.512292 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-293a3ea0-3bc6-4eec-a26b-b13474d319b1 tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/5519539a-4336-4789-aa6c-c1e898b2f62d" status: 404 len: 117 microversion: 2.1 time: 0.015089 Oct 11 04:33:29.518245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a9f1ebb6-aba5-4659-94d2-89e282195dfc tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:29.522274 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2607/4976] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:33:29 2022] DELETE /compute/v2.1/os-server-groups/5519539a-4336-4789-aa6c-c1e898b2f62d => generated 117 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:33:29.644193 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a9f1ebb6-aba5-4659-94d2-89e282195dfc tempest-ServerGroupTestJSON-1355646561 tempest-ServerGroupTestJSON-1355646561-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/d8850290-93f5-42d4-b70d-28d3c1041789" status: 204 len: 0 microversion: 2.1 time: 0.130073 Oct 11 04:33:29.645462 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2370/4977] 10.222.0.26 () {58 vars in 1266 bytes} [Tue Oct 11 04:33:29 2022] DELETE /compute/v2.1/os-server-groups/d8850290-93f5-42d4-b70d-28d3c1041789 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:33:29.775501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5ecffcd-1f1d-499e-b039-0a9967f82bd1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:29.776093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c5ecffcd-1f1d-499e-b039-0a9967f82bd1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:29.784153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ecffcd-1f1d-499e-b039-0a9967f82bd1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:29.784650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ecffcd-1f1d-499e-b039-0a9967f82bd1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:29.785096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ecffcd-1f1d-499e-b039-0a9967f82bd1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:29.786391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ecffcd-1f1d-499e-b039-0a9967f82bd1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:29.786834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ecffcd-1f1d-499e-b039-0a9967f82bd1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:29.787257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ecffcd-1f1d-499e-b039-0a9967f82bd1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:30.139926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5ecffcd-1f1d-499e-b039-0a9967f82bd1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:30.153050 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c5ecffcd-1f1d-499e-b039-0a9967f82bd1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.381327 Oct 11 04:33:30.156407 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2608/4978] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:29 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:30.243024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-146183731", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:30.306458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] validate_networks() for [('970f73ec-9c49-458a-9006-bef8b5b2ed1f', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:33:31.261070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2afd53d6-9d40-4330-870c-6b1a3fef959a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:31.269421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2afd53d6-9d40-4330-870c-6b1a3fef959a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:31.270276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2afd53d6-9d40-4330-870c-6b1a3fef959a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:31.271176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2afd53d6-9d40-4330-870c-6b1a3fef959a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:31.306146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2afd53d6-9d40-4330-870c-6b1a3fef959a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Going to try to stop instance {{(pid=120994) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 04:33:31.526000 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2afd53d6-9d40-4330-870c-6b1a3fef959a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "POST /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/action" status: 202 len: 0 microversion: 2.1 time: 0.268972 Oct 11 04:33:31.530819 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2609/4979] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:33:31 2022] POST /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:33:31.539322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee676adf-e499-46a7-931f-322d0c5fd79e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:31.541007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee676adf-e499-46a7-931f-322d0c5fd79e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:31.550181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee676adf-e499-46a7-931f-322d0c5fd79e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:31.551079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee676adf-e499-46a7-931f-322d0c5fd79e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:31.551753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee676adf-e499-46a7-931f-322d0c5fd79e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:31.552968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee676adf-e499-46a7-931f-322d0c5fd79e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:31.553952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee676adf-e499-46a7-931f-322d0c5fd79e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:31.554779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee676adf-e499-46a7-931f-322d0c5fd79e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:31.561172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:33:31.561689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:33:31.562058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:33:31.562507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:33:31.562925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:33:31.576700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:31.578986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:31.579647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:31.581203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:31.581821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:31.583015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:31.610232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Getting quotas for project ef6449e7695048039f7e9b4f2301616c. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:33:31.616185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Getting quotas for user 85832d32146545d79d249f533b0c652e and project ef6449e7695048039f7e9b4f2301616c. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:33:31.631013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:33:31.634309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:33:31.772401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee676adf-e499-46a7-931f-322d0c5fd79e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:31.782239 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-874d91ec-1bae-4654-a21e-52c4a345efd5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.543083 Oct 11 04:33:31.790217 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2371/4980] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:33:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 1551 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:33:31.796067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b0dc6088-ae6d-4b09-9257-1f9b989d5642 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:31.796923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b0dc6088-ae6d-4b09-9257-1f9b989d5642 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:31.810614 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee676adf-e499-46a7-931f-322d0c5fd79e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1675 microversion: 2.1 time: 0.278151 Oct 11 04:33:31.818523 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2610/4981] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:31 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1675 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:31.892486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b0dc6088-ae6d-4b09-9257-1f9b989d5642 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:31.901270 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b0dc6088-ae6d-4b09-9257-1f9b989d5642 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1216 microversion: 2.1 time: 0.109395 Oct 11 04:33:31.907590 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2372/4982] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:31 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1216 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:32.839396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d5021b4-ef92-42c9-9fd4-fce59f143a47 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:32.840043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d5021b4-ef92-42c9-9fd4-fce59f143a47 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:32.850371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d5021b4-ef92-42c9-9fd4-fce59f143a47 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:32.851403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d5021b4-ef92-42c9-9fd4-fce59f143a47 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:32.852375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d5021b4-ef92-42c9-9fd4-fce59f143a47 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:32.853356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d5021b4-ef92-42c9-9fd4-fce59f143a47 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:32.853807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d5021b4-ef92-42c9-9fd4-fce59f143a47 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:32.854256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d5021b4-ef92-42c9-9fd4-fce59f143a47 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:32.904591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0366088f-f649-4428-b9c8-b86de75b7dc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:32.905873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0366088f-f649-4428-b9c8-b86de75b7dc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:32.940375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0366088f-f649-4428-b9c8-b86de75b7dc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:32.940872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0366088f-f649-4428-b9c8-b86de75b7dc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:32.941385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0366088f-f649-4428-b9c8-b86de75b7dc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:32.943167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0366088f-f649-4428-b9c8-b86de75b7dc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:32.943769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0366088f-f649-4428-b9c8-b86de75b7dc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:32.944260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0366088f-f649-4428-b9c8-b86de75b7dc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:33.069653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-0366088f-f649-4428-b9c8-b86de75b7dc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lazy-loading 'services' on Instance uuid 7ec2cb39-bab6-4474-9901-5909a9053a80 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:33:33.120950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d5021b4-ef92-42c9-9fd4-fce59f143a47 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:33.129538 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d5021b4-ef92-42c9-9fd4-fce59f143a47 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1675 microversion: 2.1 time: 0.293957 Oct 11 04:33:33.131351 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2611/4983] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:32 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1675 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:33.136414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5870aa54-5098-4f76-a728-ff6f9363c241 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:33.137020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5870aa54-5098-4f76-a728-ff6f9363c241 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:33.143694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5870aa54-5098-4f76-a728-ff6f9363c241 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:33.144212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5870aa54-5098-4f76-a728-ff6f9363c241 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:33.144880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5870aa54-5098-4f76-a728-ff6f9363c241 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:33.145575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5870aa54-5098-4f76-a728-ff6f9363c241 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:33.146032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5870aa54-5098-4f76-a728-ff6f9363c241 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:33.146478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5870aa54-5098-4f76-a728-ff6f9363c241 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:33.225605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5870aa54-5098-4f76-a728-ff6f9363c241 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:33.235854 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5870aa54-5098-4f76-a728-ff6f9363c241 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1220 microversion: 2.1 time: 0.102987 Oct 11 04:33:33.239252 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2612/4984] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:33 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1220 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:33.669870 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0366088f-f649-4428-b9c8-b86de75b7dc2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments/85356c7f-4333-4881-bea9-1fca4fe845cf" status: 202 len: 0 microversion: 2.1 time: 0.765209 Oct 11 04:33:33.673029 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2373/4985] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:33:32 2022] DELETE /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments/85356c7f-4333-4881-bea9-1fca4fe845cf => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:33:33.683237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1d22ee9-d98a-45c8-b601-d54cf21292c4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:33.686616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b1d22ee9-d98a-45c8-b601-d54cf21292c4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:33.699094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1d22ee9-d98a-45c8-b601-d54cf21292c4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:33.703730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1d22ee9-d98a-45c8-b601-d54cf21292c4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:33.705047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1d22ee9-d98a-45c8-b601-d54cf21292c4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:33.707213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1d22ee9-d98a-45c8-b601-d54cf21292c4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:33.707771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1d22ee9-d98a-45c8-b601-d54cf21292c4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:33.708412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1d22ee9-d98a-45c8-b601-d54cf21292c4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:33.752750 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b1d22ee9-d98a-45c8-b601-d54cf21292c4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077375 Oct 11 04:33:33.753491 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2613/4986] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:33:33 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:34.153523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fcad79bf-632e-4906-9fac-19618490c7fb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:34.154476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fcad79bf-632e-4906-9fac-19618490c7fb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:34.164348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcad79bf-632e-4906-9fac-19618490c7fb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:34.165180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcad79bf-632e-4906-9fac-19618490c7fb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:34.165871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcad79bf-632e-4906-9fac-19618490c7fb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:34.166608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcad79bf-632e-4906-9fac-19618490c7fb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:34.167254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcad79bf-632e-4906-9fac-19618490c7fb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:34.167867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcad79bf-632e-4906-9fac-19618490c7fb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:34.260961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-722e75ce-dd0a-49ad-900d-2f9f1e58fbf2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:34.261572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-722e75ce-dd0a-49ad-900d-2f9f1e58fbf2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:34.268789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-722e75ce-dd0a-49ad-900d-2f9f1e58fbf2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:34.269425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-722e75ce-dd0a-49ad-900d-2f9f1e58fbf2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:34.269866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-722e75ce-dd0a-49ad-900d-2f9f1e58fbf2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:34.270589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-722e75ce-dd0a-49ad-900d-2f9f1e58fbf2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:34.271076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-722e75ce-dd0a-49ad-900d-2f9f1e58fbf2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:34.271465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-722e75ce-dd0a-49ad-900d-2f9f1e58fbf2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:34.347436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-722e75ce-dd0a-49ad-900d-2f9f1e58fbf2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:34.360806 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-722e75ce-dd0a-49ad-900d-2f9f1e58fbf2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1268 microversion: 2.1 time: 0.103847 Oct 11 04:33:34.362405 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2614/4987] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:34 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1268 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:34.463287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fcad79bf-632e-4906-9fac-19618490c7fb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:34.486263 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fcad79bf-632e-4906-9fac-19618490c7fb tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1675 microversion: 2.1 time: 0.336442 Oct 11 04:33:34.487636 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2374/4988] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:34 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1675 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:34.767197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3acaded7-3c9e-4e5d-8658-d778978a63c6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:34.770417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3acaded7-3c9e-4e5d-8658-d778978a63c6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:34.785735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3acaded7-3c9e-4e5d-8658-d778978a63c6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:34.792073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3acaded7-3c9e-4e5d-8658-d778978a63c6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:34.792734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3acaded7-3c9e-4e5d-8658-d778978a63c6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:34.793664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3acaded7-3c9e-4e5d-8658-d778978a63c6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:34.794300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3acaded7-3c9e-4e5d-8658-d778978a63c6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:34.794901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3acaded7-3c9e-4e5d-8658-d778978a63c6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:34.858816 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3acaded7-3c9e-4e5d-8658-d778978a63c6 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.096633 Oct 11 04:33:34.862286 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2615/4989] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:33:34 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:35.386283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c793a614-9b1e-48a1-b169-b931e2f31c20 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:35.387113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c793a614-9b1e-48a1-b169-b931e2f31c20 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:35.399891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c793a614-9b1e-48a1-b169-b931e2f31c20 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:35.399891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c793a614-9b1e-48a1-b169-b931e2f31c20 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:35.399891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c793a614-9b1e-48a1-b169-b931e2f31c20 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:35.405004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c793a614-9b1e-48a1-b169-b931e2f31c20 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:35.405487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c793a614-9b1e-48a1-b169-b931e2f31c20 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:35.409519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c793a614-9b1e-48a1-b169-b931e2f31c20 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:35.530295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c793a614-9b1e-48a1-b169-b931e2f31c20 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:35.531521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8b3bde33-065d-4c37-9922-8dbc4cb60eba tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:35.532205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8b3bde33-065d-4c37-9922-8dbc4cb60eba tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:35.543680 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c793a614-9b1e-48a1-b169-b931e2f31c20 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1274 microversion: 2.1 time: 0.162382 Oct 11 04:33:35.544349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b3bde33-065d-4c37-9922-8dbc4cb60eba tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:35.544846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b3bde33-065d-4c37-9922-8dbc4cb60eba tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:35.545281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b3bde33-065d-4c37-9922-8dbc4cb60eba tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:35.545738 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2375/4990] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:35 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1274 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:35.554612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b3bde33-065d-4c37-9922-8dbc4cb60eba tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:35.555164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b3bde33-065d-4c37-9922-8dbc4cb60eba tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:35.555471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8b3bde33-065d-4c37-9922-8dbc4cb60eba tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:35.875873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5e44683-54aa-43b2-ae7a-71603dc0707a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:35.878210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c5e44683-54aa-43b2-ae7a-71603dc0707a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:35.899435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5e44683-54aa-43b2-ae7a-71603dc0707a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:35.900205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5e44683-54aa-43b2-ae7a-71603dc0707a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:35.900838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5e44683-54aa-43b2-ae7a-71603dc0707a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:35.901725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5e44683-54aa-43b2-ae7a-71603dc0707a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:35.902434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5e44683-54aa-43b2-ae7a-71603dc0707a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:35.903033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5e44683-54aa-43b2-ae7a-71603dc0707a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:35.970751 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c5e44683-54aa-43b2-ae7a-71603dc0707a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.099643 Oct 11 04:33:35.973486 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2376/4991] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:33:35 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments => generated 197 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:33:36.573296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8e4ec23-3e27-43f9-b23f-14d65835f25c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:36.579663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d8e4ec23-3e27-43f9-b23f-14d65835f25c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:36.583909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8e4ec23-3e27-43f9-b23f-14d65835f25c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:36.584399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8e4ec23-3e27-43f9-b23f-14d65835f25c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:36.590169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8e4ec23-3e27-43f9-b23f-14d65835f25c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:36.590982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8e4ec23-3e27-43f9-b23f-14d65835f25c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:36.591456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8e4ec23-3e27-43f9-b23f-14d65835f25c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:36.591891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8e4ec23-3e27-43f9-b23f-14d65835f25c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:36.631074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8b3bde33-065d-4c37-9922-8dbc4cb60eba tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:36.641579 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8b3bde33-065d-4c37-9922-8dbc4cb60eba tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1675 microversion: 2.1 time: 1.134694 Oct 11 04:33:36.645266 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2616/4992] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:35 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1675 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:36.747320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d8e4ec23-3e27-43f9-b23f-14d65835f25c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:36.764564 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8e4ec23-3e27-43f9-b23f-14d65835f25c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1274 microversion: 2.1 time: 0.192818 Oct 11 04:33:36.768338 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2377/4993] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:36 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1274 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:36.985148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22f70098-e5f0-4c38-b485-73a459fc7273 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:36.987400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22f70098-e5f0-4c38-b485-73a459fc7273 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:37.004163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f70098-e5f0-4c38-b485-73a459fc7273 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:37.004709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f70098-e5f0-4c38-b485-73a459fc7273 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:37.005130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f70098-e5f0-4c38-b485-73a459fc7273 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:37.005854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f70098-e5f0-4c38-b485-73a459fc7273 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:37.006355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f70098-e5f0-4c38-b485-73a459fc7273 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:37.006795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f70098-e5f0-4c38-b485-73a459fc7273 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:37.054002 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22f70098-e5f0-4c38-b485-73a459fc7273 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072854 Oct 11 04:33:37.055356 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2617/4994] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:33:36 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:37.668682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f814decf-012b-4caf-b2b0-d98f8576c2ee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:37.669354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f814decf-012b-4caf-b2b0-d98f8576c2ee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:37.676901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f814decf-012b-4caf-b2b0-d98f8576c2ee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:37.678712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f814decf-012b-4caf-b2b0-d98f8576c2ee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:37.679169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f814decf-012b-4caf-b2b0-d98f8576c2ee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:37.679883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f814decf-012b-4caf-b2b0-d98f8576c2ee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:37.681944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f814decf-012b-4caf-b2b0-d98f8576c2ee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:37.683138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f814decf-012b-4caf-b2b0-d98f8576c2ee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:37.792077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee8a1a53-6757-4000-ba12-d3f41000f41f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:37.792715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee8a1a53-6757-4000-ba12-d3f41000f41f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:37.801356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8a1a53-6757-4000-ba12-d3f41000f41f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:37.802353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8a1a53-6757-4000-ba12-d3f41000f41f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:37.802805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8a1a53-6757-4000-ba12-d3f41000f41f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:37.803526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8a1a53-6757-4000-ba12-d3f41000f41f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:37.803981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8a1a53-6757-4000-ba12-d3f41000f41f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:37.804599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee8a1a53-6757-4000-ba12-d3f41000f41f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:37.849805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f814decf-012b-4caf-b2b0-d98f8576c2ee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:37.858583 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f814decf-012b-4caf-b2b0-d98f8576c2ee tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1675 microversion: 2.1 time: 0.193596 Oct 11 04:33:37.874148 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2378/4995] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:37 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1675 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:37.889847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee8a1a53-6757-4000-ba12-d3f41000f41f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:37.904851 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee8a1a53-6757-4000-ba12-d3f41000f41f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1274 microversion: 2.1 time: 0.116987 Oct 11 04:33:37.916945 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2618/4996] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:37 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1274 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:38.067926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d23d6bad-f0aa-4c51-b7e5-da2991dfb4d8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:38.070449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d23d6bad-f0aa-4c51-b7e5-da2991dfb4d8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:38.083024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23d6bad-f0aa-4c51-b7e5-da2991dfb4d8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:38.083591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23d6bad-f0aa-4c51-b7e5-da2991dfb4d8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:38.084133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23d6bad-f0aa-4c51-b7e5-da2991dfb4d8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:38.085916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23d6bad-f0aa-4c51-b7e5-da2991dfb4d8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:38.089075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23d6bad-f0aa-4c51-b7e5-da2991dfb4d8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:38.089798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23d6bad-f0aa-4c51-b7e5-da2991dfb4d8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:38.156570 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d23d6bad-f0aa-4c51-b7e5-da2991dfb4d8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093501 Oct 11 04:33:38.163306 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2379/4997] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:33:38 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:38.882342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a751e088-d1f8-42b4-b1bf-c3d02619766d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:38.883476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a751e088-d1f8-42b4-b1bf-c3d02619766d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:38.894864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a751e088-d1f8-42b4-b1bf-c3d02619766d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:38.895669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a751e088-d1f8-42b4-b1bf-c3d02619766d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:38.896329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a751e088-d1f8-42b4-b1bf-c3d02619766d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:38.897362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a751e088-d1f8-42b4-b1bf-c3d02619766d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:38.898106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a751e088-d1f8-42b4-b1bf-c3d02619766d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:38.898833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a751e088-d1f8-42b4-b1bf-c3d02619766d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:38.931471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-522e06e1-061c-40e9-b3a7-9760b68693ca tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:38.934957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-522e06e1-061c-40e9-b3a7-9760b68693ca tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:38.973516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-522e06e1-061c-40e9-b3a7-9760b68693ca tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:38.974010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-522e06e1-061c-40e9-b3a7-9760b68693ca tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:38.976469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-522e06e1-061c-40e9-b3a7-9760b68693ca tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:38.977197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-522e06e1-061c-40e9-b3a7-9760b68693ca tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:38.978566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-522e06e1-061c-40e9-b3a7-9760b68693ca tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:38.979161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-522e06e1-061c-40e9-b3a7-9760b68693ca tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:39.272055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-522e06e1-061c-40e9-b3a7-9760b68693ca tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:39.280191 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-522e06e1-061c-40e9-b3a7-9760b68693ca tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1316 microversion: 2.1 time: 0.354663 Oct 11 04:33:39.280773 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2380/4998] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:38 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1316 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:39.290465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90a48cad-dea2-46c2-b46e-793d6d9556e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:39.292726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90a48cad-dea2-46c2-b46e-793d6d9556e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:39.326586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a48cad-dea2-46c2-b46e-793d6d9556e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:39.326586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a48cad-dea2-46c2-b46e-793d6d9556e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:39.326586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a48cad-dea2-46c2-b46e-793d6d9556e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:39.326586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a48cad-dea2-46c2-b46e-793d6d9556e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:39.326586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a48cad-dea2-46c2-b46e-793d6d9556e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:39.326586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a48cad-dea2-46c2-b46e-793d6d9556e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:39.383278 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90a48cad-dea2-46c2-b46e-793d6d9556e0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097196 Oct 11 04:33:39.388663 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2381/4999] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:33:39 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:39.545397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a751e088-d1f8-42b4-b1bf-c3d02619766d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:39.554834 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a751e088-d1f8-42b4-b1bf-c3d02619766d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1675 microversion: 2.1 time: 0.676683 Oct 11 04:33:39.566695 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2619/5000] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:38 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1675 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:40.305054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-453446ea-d049-4821-8237-c48e0661e295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:40.305671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-453446ea-d049-4821-8237-c48e0661e295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:40.318983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-453446ea-d049-4821-8237-c48e0661e295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:40.319472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-453446ea-d049-4821-8237-c48e0661e295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:40.319908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-453446ea-d049-4821-8237-c48e0661e295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:40.322081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-453446ea-d049-4821-8237-c48e0661e295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:40.324852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-453446ea-d049-4821-8237-c48e0661e295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:40.326794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-453446ea-d049-4821-8237-c48e0661e295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:40.400272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ed4b8d7e-1eaa-4e44-b8f3-aeff370c4a41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:40.402761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ed4b8d7e-1eaa-4e44-b8f3-aeff370c4a41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:40.428975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed4b8d7e-1eaa-4e44-b8f3-aeff370c4a41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:40.434527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed4b8d7e-1eaa-4e44-b8f3-aeff370c4a41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:40.434527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed4b8d7e-1eaa-4e44-b8f3-aeff370c4a41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:40.435827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed4b8d7e-1eaa-4e44-b8f3-aeff370c4a41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:40.436317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed4b8d7e-1eaa-4e44-b8f3-aeff370c4a41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:40.436755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed4b8d7e-1eaa-4e44-b8f3-aeff370c4a41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:40.471853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:40.477564 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ed4b8d7e-1eaa-4e44-b8f3-aeff370c4a41 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.084512 Oct 11 04:33:40.484268 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2620/5001] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:33:40 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80/os-volume_attachments => generated 25 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 04:33:40.525819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-453446ea-d049-4821-8237-c48e0661e295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:40.536464 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-453446ea-d049-4821-8237-c48e0661e295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1316 microversion: 2.1 time: 0.236057 Oct 11 04:33:40.564419 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2382/5002] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:40 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1316 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:40.602399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ed7954d-bb1e-46d8-89b7-aac5b8bd503a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:40.603307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4ed7954d-bb1e-46d8-89b7-aac5b8bd503a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:40.619034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed7954d-bb1e-46d8-89b7-aac5b8bd503a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:40.621348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed7954d-bb1e-46d8-89b7-aac5b8bd503a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:40.622181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed7954d-bb1e-46d8-89b7-aac5b8bd503a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:40.623160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed7954d-bb1e-46d8-89b7-aac5b8bd503a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:40.625280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed7954d-bb1e-46d8-89b7-aac5b8bd503a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:40.628634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:40.629160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed7954d-bb1e-46d8-89b7-aac5b8bd503a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:40.631204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:40.650010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:40.650010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:40.650010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:40.656677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:40.656677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:40.656677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:40.761867 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] HTTP exception thrown: Cannot 'reboot' instance 60554e10-db75-4001-ad84-55060fb24729 while it is in vm_state rescued Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Request method failure captured: Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729/action HTTP/1.1 Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 28 Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPEasekUZLINQ5CZWJXkMppFiFyiPz0x7d4djdvUd-asoF16cTMXmitsW8Jw6-L4ZC10T49kVSd5NZJD7qmV4ktBS-qpfyACuQOEHpQR5BigmL06KMooK58zyWV0xifCb_yIKtS4zKCvAts6lZk9Fe5iF-Yw7nZw-Mdv0pFYP_e1eeY Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75ee1246b11f4fb286baf525614515c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}] Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 820b6b6b001a46a2abd3415de0b5f29b Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: {"reboot": {"type": "HARD"}} Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: exception: Cannot 'reboot' instance 60554e10-db75-4001-ad84-55060fb24729 while it is in vm_state rescued Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '60554e10-db75-4001-ad84-55060fb24729', 'body': {'reboot': {'type': 'HARD'}}} Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1036, in _action_reboot Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.compute_api.reboot(context, instance, reboot_type) Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3552, in reboot Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._hard_reboot(context, instance) Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 60554e10-db75-4001-ad84-55060fb24729 in vm_state rescued. Cannot _hard_reboot while the instance is in this state. Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1040, in _action_reboot Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:33:40.766714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:33:40.772421 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'reboot' instance 60554e10-db75-4001-ad84-55060fb24729 while it is in vm_state rescued Oct 11 04:33:40.772421 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:40.772421 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:40.772421 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:40.772421 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:40.772421 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:40.772421 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:40.772421 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:33:40.772421 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:33:40.772421 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'reboot' instance 60554e10-db75-4001-ad84-55060fb24729 while it is in vm_state rescued Oct 11 04:33:40.772421 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:40.775583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Returning 409 to user: Cannot 'reboot' instance 60554e10-db75-4001-ad84-55060fb24729 while it is in vm_state rescued {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:40.776895 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a996feed-b79a-4fd8-9a4e-7248819cf235 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729/action" status: 409 len: 145 microversion: 2.1 time: 0.184127 Oct 11 04:33:40.778113 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2383/5003] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:33:40 2022] POST /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729/action => generated 145 bytes in 186 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:33:40.786767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e97dee3e-4bd7-4d6c-afd0-e477abbcba3f req-e362d923-f1cc-4123-bf5e-1e2fa06d6be2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4c2cb1d-6389-41d3-8352-730a774ff2f7", "tag": "b6e83be0-c818-42a0-bcb5-7a0cc5206730"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:40.805647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e97dee3e-4bd7-4d6c-afd0-e477abbcba3f req-e362d923-f1cc-4123-bf5e-1e2fa06d6be2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:40.805647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e97dee3e-4bd7-4d6c-afd0-e477abbcba3f req-e362d923-f1cc-4123-bf5e-1e2fa06d6be2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:40.805647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e97dee3e-4bd7-4d6c-afd0-e477abbcba3f req-e362d923-f1cc-4123-bf5e-1e2fa06d6be2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:40.809628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:40.820553 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e97dee3e-4bd7-4d6c-afd0-e477abbcba3f req-e362d923-f1cc-4123-bf5e-1e2fa06d6be2 service nova] Creating event network-changed:b6e83be0-c818-42a0-bcb5-7a0cc5206730 for instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 on n-h1-860892-1 Oct 11 04:33:40.827199 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e97dee3e-4bd7-4d6c-afd0-e477abbcba3f req-e362d923-f1cc-4123-bf5e-1e2fa06d6be2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047563 Oct 11 04:33:40.832111 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2384/5004] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:40.838605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce95f538-5440-4681-926c-29d356b17819 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Action: 'create', calling method: .version_select at 0x7fda19c63700>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-575368388", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlIK+2H295OeaPpj3F8Q+CYmCCKFNrz3C2ykwtIgvCeUzpraD/FryW4S/LgSVMzZm5WO4bzC3JPke45qB87G+gV50jr0M++3J7pTf5nuW2YVR326TYyPukmXR2JclCi9A=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:40.866109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ce95f538-5440-4681-926c-29d356b17819 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:33:40.874502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ce95f538-5440-4681-926c-29d356b17819 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for user 752975bff6034a7086aafa3319a4f1d4 and project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:33:40.986580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ed7954d-bb1e-46d8-89b7-aac5b8bd503a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:41.001167 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce95f538-5440-4681-926c-29d356b17819 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.167605 Oct 11 04:33:41.005411 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2385/5005] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:33:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:41.012480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:41.015195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:41.018210 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ed7954d-bb1e-46d8-89b7-aac5b8bd503a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1675 microversion: 2.1 time: 0.436297 Oct 11 04:33:41.037432 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2621/5006] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:40 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1675 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:41.045150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:41.050985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:41.051374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:41.052114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:41.052574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:41.052994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:41.128638 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] HTTP exception thrown: Cannot 'rebuild' instance 60554e10-db75-4001-ad84-55060fb24729 while it is in vm_state rescued Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Request method failure captured: Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729/action HTTP/1.1 Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 65 Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPEasekUZLINQ5CZWJXkMppFiFyiPz0x7d4djdvUd-asoF16cTMXmitsW8Jw6-L4ZC10T49kVSd5NZJD7qmV4ktBS-qpfyACuQOEHpQR5BigmL06KMooK58zyWV0xifCb_yIKtS4zKCvAts6lZk9Fe5iF-Yw7nZw-Mdv0pFYP_e1eeY Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75ee1246b11f4fb286baf525614515c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}] Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 820b6b6b001a46a2abd3415de0b5f29b Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: exception: Cannot 'rebuild' instance 60554e10-db75-4001-ad84-55060fb24729 while it is in vm_state rescued Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '60554e10-db75-4001-ad84-55060fb24729', 'body': {'rebuild': {'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55'}}} Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1223, in _action_rebuild Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.compute_api.rebuild(context, Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 60554e10-db75-4001-ad84-55060fb24729 in vm_state rescued. Cannot rebuild while the instance is in this state. Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:33:41.132889 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1231, in _action_rebuild Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'rebuild' instance 60554e10-db75-4001-ad84-55060fb24729 while it is in vm_state rescued Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'rebuild' instance 60554e10-db75-4001-ad84-55060fb24729 while it is in vm_state rescued Oct 11 04:33:41.137237 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:41.141228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Returning 409 to user: Cannot 'rebuild' instance 60554e10-db75-4001-ad84-55060fb24729 while it is in vm_state rescued {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:41.142379 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c49c2c7a-1270-400a-ba74-cfdb56d5a685 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "POST /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729/action" status: 409 len: 146 microversion: 2.1 time: 0.139439 Oct 11 04:33:41.143176 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2386/5007] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:33:41 2022] POST /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729/action => generated 146 bytes in 141 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:33:41.155230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1c725bae-f43d-4fb8-b767-d87969cd1e24 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:41.155734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1c725bae-f43d-4fb8-b767-d87969cd1e24 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:41.178170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c725bae-f43d-4fb8-b767-d87969cd1e24 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:41.182048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c725bae-f43d-4fb8-b767-d87969cd1e24 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:41.182717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c725bae-f43d-4fb8-b767-d87969cd1e24 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:41.183535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c725bae-f43d-4fb8-b767-d87969cd1e24 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:41.184005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c725bae-f43d-4fb8-b767-d87969cd1e24 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:41.185584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c725bae-f43d-4fb8-b767-d87969cd1e24 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:41.258335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1c725bae-f43d-4fb8-b767-d87969cd1e24 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:33:41.594723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69c6bd09-0c16-435a-8e92-9c2610447bde tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:41.595938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69c6bd09-0c16-435a-8e92-9c2610447bde tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:41.612107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:41.619113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:DELETE=3,nova_api:INSERT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:41.641002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69c6bd09-0c16-435a-8e92-9c2610447bde tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:41.647481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69c6bd09-0c16-435a-8e92-9c2610447bde tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:41.647481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69c6bd09-0c16-435a-8e92-9c2610447bde tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:41.647481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69c6bd09-0c16-435a-8e92-9c2610447bde tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:41.648929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69c6bd09-0c16-435a-8e92-9c2610447bde tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:41.649619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69c6bd09-0c16-435a-8e92-9c2610447bde tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:41.740723 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1c725bae-f43d-4fb8-b767-d87969cd1e24 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 204 len: 0 microversion: 2.1 time: 0.590607 Oct 11 04:33:41.742876 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2622/5008] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:33:41 2022] DELETE /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:33:41.751932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90b51c54-d0c2-4f06-850e-193d3ef2067c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:41.753525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90b51c54-d0c2-4f06-850e-193d3ef2067c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:41.768882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b51c54-d0c2-4f06-850e-193d3ef2067c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:41.770975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b51c54-d0c2-4f06-850e-193d3ef2067c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:41.771620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b51c54-d0c2-4f06-850e-193d3ef2067c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:41.772392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b51c54-d0c2-4f06-850e-193d3ef2067c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:41.772851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b51c54-d0c2-4f06-850e-193d3ef2067c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:41.773282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b51c54-d0c2-4f06-850e-193d3ef2067c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:41.967581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-90b51c54-d0c2-4f06-850e-193d3ef2067c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:41.979194 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90b51c54-d0c2-4f06-850e-193d3ef2067c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1690 microversion: 2.1 time: 0.231413 Oct 11 04:33:42.008371 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2623/5009] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:41 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1690 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:42.046905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3359dcee-c386-4abf-a9e0-730d2fa1ee92 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:42.047552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3359dcee-c386-4abf-a9e0-730d2fa1ee92 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:42.065720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3359dcee-c386-4abf-a9e0-730d2fa1ee92 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:42.065720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3359dcee-c386-4abf-a9e0-730d2fa1ee92 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:42.065720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3359dcee-c386-4abf-a9e0-730d2fa1ee92 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:42.065720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3359dcee-c386-4abf-a9e0-730d2fa1ee92 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:42.065720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3359dcee-c386-4abf-a9e0-730d2fa1ee92 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:42.065720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3359dcee-c386-4abf-a9e0-730d2fa1ee92 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:42.188123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-69c6bd09-0c16-435a-8e92-9c2610447bde tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:42.198490 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69c6bd09-0c16-435a-8e92-9c2610447bde tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1316 microversion: 2.1 time: 0.611897 Oct 11 04:33:42.199101 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2387/5010] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:41 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1316 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:42.320561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3359dcee-c386-4abf-a9e0-730d2fa1ee92 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:42.328644 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3359dcee-c386-4abf-a9e0-730d2fa1ee92 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1675 microversion: 2.1 time: 0.285570 Oct 11 04:33:42.337029 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2624/5011] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:42 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1675 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:43.009592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1c40a2c3-2249-4f95-9d6e-adda975be28e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:43.010615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1c40a2c3-2249-4f95-9d6e-adda975be28e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:43.046067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c40a2c3-2249-4f95-9d6e-adda975be28e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:43.053953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c40a2c3-2249-4f95-9d6e-adda975be28e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:43.054645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c40a2c3-2249-4f95-9d6e-adda975be28e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:43.055437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c40a2c3-2249-4f95-9d6e-adda975be28e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:43.059693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c40a2c3-2249-4f95-9d6e-adda975be28e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:43.061034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1c40a2c3-2249-4f95-9d6e-adda975be28e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:43.230625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1c4d2089-869a-4059-847d-aab0985879b8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:43.231232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1c4d2089-869a-4059-847d-aab0985879b8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:43.242645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c4d2089-869a-4059-847d-aab0985879b8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:43.251967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c4d2089-869a-4059-847d-aab0985879b8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:43.252593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c4d2089-869a-4059-847d-aab0985879b8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:43.254226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c4d2089-869a-4059-847d-aab0985879b8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:43.254856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c4d2089-869a-4059-847d-aab0985879b8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:43.255437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c4d2089-869a-4059-847d-aab0985879b8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:43.277266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1c40a2c3-2249-4f95-9d6e-adda975be28e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:43.287456 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1c40a2c3-2249-4f95-9d6e-adda975be28e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1690 microversion: 2.1 time: 0.282731 Oct 11 04:33:43.288366 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2388/5012] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:43 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1690 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:43.364754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ab4610e0-62a2-444a-acb4-2d830ef4c8ea tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:43.365966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ab4610e0-62a2-444a-acb4-2d830ef4c8ea tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:43.372974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab4610e0-62a2-444a-acb4-2d830ef4c8ea tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:43.377135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab4610e0-62a2-444a-acb4-2d830ef4c8ea tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:43.377135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab4610e0-62a2-444a-acb4-2d830ef4c8ea tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:43.377135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab4610e0-62a2-444a-acb4-2d830ef4c8ea tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:43.377135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab4610e0-62a2-444a-acb4-2d830ef4c8ea tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:43.377135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab4610e0-62a2-444a-acb4-2d830ef4c8ea tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:43.470438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1c4d2089-869a-4059-847d-aab0985879b8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:43.489910 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1c4d2089-869a-4059-847d-aab0985879b8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1316 microversion: 2.1 time: 0.264313 Oct 11 04:33:43.490995 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2625/5013] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:43 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1316 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:43.591919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab4610e0-62a2-444a-acb4-2d830ef4c8ea tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:43.602501 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ab4610e0-62a2-444a-acb4-2d830ef4c8ea tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1675 microversion: 2.1 time: 0.243480 Oct 11 04:33:43.603701 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2389/5014] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:43 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1675 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:44.314152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c97b319c-0232-44c2-be63-aa726775d5d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:44.315082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c97b319c-0232-44c2-be63-aa726775d5d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:44.330953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97b319c-0232-44c2-be63-aa726775d5d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:44.330953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97b319c-0232-44c2-be63-aa726775d5d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:44.330953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97b319c-0232-44c2-be63-aa726775d5d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:44.330953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97b319c-0232-44c2-be63-aa726775d5d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:44.331443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97b319c-0232-44c2-be63-aa726775d5d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:44.332146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c97b319c-0232-44c2-be63-aa726775d5d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:44.522092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8178a5b7-9905-4c90-b817-ea56c3976e13 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:44.527696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8178a5b7-9905-4c90-b817-ea56c3976e13 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:44.539256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8178a5b7-9905-4c90-b817-ea56c3976e13 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:44.541317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8178a5b7-9905-4c90-b817-ea56c3976e13 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:44.542223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8178a5b7-9905-4c90-b817-ea56c3976e13 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:44.543168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8178a5b7-9905-4c90-b817-ea56c3976e13 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:44.558066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8178a5b7-9905-4c90-b817-ea56c3976e13 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:44.559160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8178a5b7-9905-4c90-b817-ea56c3976e13 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:44.653343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c97b319c-0232-44c2-be63-aa726775d5d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:44.666488 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c97b319c-0232-44c2-be63-aa726775d5d0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1690 microversion: 2.1 time: 0.358292 Oct 11 04:33:44.667736 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2626/5015] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:44 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1690 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:44.673681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df570c7a-97e1-468f-bf59-5be6dd0ee333 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:44.673947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-df570c7a-97e1-468f-bf59-5be6dd0ee333 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:44.687005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df570c7a-97e1-468f-bf59-5be6dd0ee333 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:44.691094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df570c7a-97e1-468f-bf59-5be6dd0ee333 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:44.691911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df570c7a-97e1-468f-bf59-5be6dd0ee333 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:44.693054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df570c7a-97e1-468f-bf59-5be6dd0ee333 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:44.693772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df570c7a-97e1-468f-bf59-5be6dd0ee333 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:44.694474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df570c7a-97e1-468f-bf59-5be6dd0ee333 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:44.910174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8178a5b7-9905-4c90-b817-ea56c3976e13 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:44.938387 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8178a5b7-9905-4c90-b817-ea56c3976e13 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1316 microversion: 2.1 time: 0.422600 Oct 11 04:33:44.967450 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2390/5016] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:44 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1316 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:44.984103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-df570c7a-97e1-468f-bf59-5be6dd0ee333 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:44.995275 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-df570c7a-97e1-468f-bf59-5be6dd0ee333 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1675 microversion: 2.1 time: 0.326114 Oct 11 04:33:44.997206 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2627/5017] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:44 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1675 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:45.383537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1783917259", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "fd34e87b-f754-4d42-9c78-5e3c400323fa"}], "key_name": "tempest-TestNetworkBasicOps-575368388", "security_groups": [{"name": "tempest-secgroup-smoke-1861065900"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:45.695624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a43715e-8bf1-4ed3-a5a4-980581974000 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:45.700135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6a43715e-8bf1-4ed3-a5a4-980581974000 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:45.711433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a43715e-8bf1-4ed3-a5a4-980581974000 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:45.711934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a43715e-8bf1-4ed3-a5a4-980581974000 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:45.712383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a43715e-8bf1-4ed3-a5a4-980581974000 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:45.713104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a43715e-8bf1-4ed3-a5a4-980581974000 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:45.713560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a43715e-8bf1-4ed3-a5a4-980581974000 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:45.713990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a43715e-8bf1-4ed3-a5a4-980581974000 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:45.737523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] validate_networks() for [('fd34e87b-f754-4d42-9c78-5e3c400323fa', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:33:45.910518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a43715e-8bf1-4ed3-a5a4-980581974000 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:45.919644 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a43715e-8bf1-4ed3-a5a4-980581974000 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1690 microversion: 2.1 time: 0.228144 Oct 11 04:33:45.922915 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2628/5018] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:45 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1690 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:45.969171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f1086189-7ee6-4f61-83a4-cc940c1613a3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:45.969932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f1086189-7ee6-4f61-83a4-cc940c1613a3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:45.977214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1086189-7ee6-4f61-83a4-cc940c1613a3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:45.978163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1086189-7ee6-4f61-83a4-cc940c1613a3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:45.979463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1086189-7ee6-4f61-83a4-cc940c1613a3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:45.980426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1086189-7ee6-4f61-83a4-cc940c1613a3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:45.980961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1086189-7ee6-4f61-83a4-cc940c1613a3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:45.981570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1086189-7ee6-4f61-83a4-cc940c1613a3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:46.187532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f1086189-7ee6-4f61-83a4-cc940c1613a3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:46.210890 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f1086189-7ee6-4f61-83a4-cc940c1613a3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1316 microversion: 2.1 time: 0.245615 Oct 11 04:33:46.211498 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2629/5019] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:45 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1316 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:46.255301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d9ff4b1-462d-4d1e-a332-6489295bd5d6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:46.258335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d9ff4b1-462d-4d1e-a332-6489295bd5d6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:46.267190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d9ff4b1-462d-4d1e-a332-6489295bd5d6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:46.267702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d9ff4b1-462d-4d1e-a332-6489295bd5d6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:46.268327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d9ff4b1-462d-4d1e-a332-6489295bd5d6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:46.269540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d9ff4b1-462d-4d1e-a332-6489295bd5d6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:46.270170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d9ff4b1-462d-4d1e-a332-6489295bd5d6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:46.270784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d9ff4b1-462d-4d1e-a332-6489295bd5d6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:46.628191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d9ff4b1-462d-4d1e-a332-6489295bd5d6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:46.638500 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d9ff4b1-462d-4d1e-a332-6489295bd5d6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1652 microversion: 2.1 time: 0.414146 Oct 11 04:33:46.639106 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2630/5020] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:46 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1652 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:46.666028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8843c782-7d1e-4f20-8f15-988afad1b7f5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:46.676358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8843c782-7d1e-4f20-8f15-988afad1b7f5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:46.678064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8843c782-7d1e-4f20-8f15-988afad1b7f5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:46.678627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8843c782-7d1e-4f20-8f15-988afad1b7f5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:46.731845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8843c782-7d1e-4f20-8f15-988afad1b7f5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Going to try to start instance {{(pid=120994) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 04:33:47.132863 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8843c782-7d1e-4f20-8f15-988afad1b7f5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "POST /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/action" status: 202 len: 0 microversion: 2.1 time: 0.466686 Oct 11 04:33:47.132863 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2631/5021] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:33:46 2022] POST /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/action => generated 0 bytes in 469 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:33:47.139524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b11affb1-ebbf-4301-9ecc-719af21b3458 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:47.140605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b11affb1-ebbf-4301-9ecc-719af21b3458 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:47.155022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b11affb1-ebbf-4301-9ecc-719af21b3458 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:47.155960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b11affb1-ebbf-4301-9ecc-719af21b3458 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:47.156659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b11affb1-ebbf-4301-9ecc-719af21b3458 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:47.158244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b11affb1-ebbf-4301-9ecc-719af21b3458 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:47.158931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b11affb1-ebbf-4301-9ecc-719af21b3458 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:47.161251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b11affb1-ebbf-4301-9ecc-719af21b3458 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:47.285610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:33:47.286160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:33:47.286644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:33:47.287267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:33:47.287853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:33:47.298231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:47.302221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:47.302885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:47.303850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:47.304486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:47.305086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:47.333427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:33:47.340232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for user 752975bff6034a7086aafa3319a4f1d4 and project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:33:47.357391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:33:47.360210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:33:47.562367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b11affb1-ebbf-4301-9ecc-719af21b3458 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:47.576537 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4fca2f46-fbe2-4e45-85be-58691857ad54 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.198728 Oct 11 04:33:47.577787 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2391/5022] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:33:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 2203 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:33:47.595035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41eac133-bd4e-4963-bad0-36c653f7d68e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:47.598010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-41eac133-bd4e-4963-bad0-36c653f7d68e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:47.619918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41eac133-bd4e-4963-bad0-36c653f7d68e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:47.622153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41eac133-bd4e-4963-bad0-36c653f7d68e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:47.624052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41eac133-bd4e-4963-bad0-36c653f7d68e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:47.627849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41eac133-bd4e-4963-bad0-36c653f7d68e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:47.630302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41eac133-bd4e-4963-bad0-36c653f7d68e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:47.633911 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b11affb1-ebbf-4301-9ecc-719af21b3458 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1690 microversion: 2.1 time: 0.499228 Oct 11 04:33:47.642378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41eac133-bd4e-4963-bad0-36c653f7d68e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:47.655192 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2632/5023] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:47 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1690 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:47.678459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-309d4991-1210-4dfe-b669-38493d180f17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:47.678459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-309d4991-1210-4dfe-b669-38493d180f17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:47.698467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-309d4991-1210-4dfe-b669-38493d180f17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:47.698975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-309d4991-1210-4dfe-b669-38493d180f17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:47.704944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-309d4991-1210-4dfe-b669-38493d180f17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:47.706249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-309d4991-1210-4dfe-b669-38493d180f17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:47.706739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-309d4991-1210-4dfe-b669-38493d180f17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:47.707198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-309d4991-1210-4dfe-b669-38493d180f17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:47.985395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-309d4991-1210-4dfe-b669-38493d180f17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:48.000598 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-309d4991-1210-4dfe-b669-38493d180f17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1316 microversion: 2.1 time: 0.342383 Oct 11 04:33:48.004530 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2633/5024] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:47 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1316 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:48.009344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3598cd07-cfa2-496d-94e2-ee325e9809c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:48.017346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3598cd07-cfa2-496d-94e2-ee325e9809c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:48.121887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3598cd07-cfa2-496d-94e2-ee325e9809c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:48.130130 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3598cd07-cfa2-496d-94e2-ee325e9809c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1248 microversion: 2.1 time: 0.124130 Oct 11 04:33:48.146779 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2634/5025] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:48 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1248 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:48.157851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-3539a1b4-0835-40d9-92ba-cb99c1207faf req-9290f9ce-3f6f-46d2-af15-84703e0a3e4e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c2cb1d-6389-41d3-8352-730a774ff2f7", "name": "network-vif-plugged", "status": "completed", "tag": "b6e83be0-c818-42a0-bcb5-7a0cc5206730"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:48.181025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3539a1b4-0835-40d9-92ba-cb99c1207faf req-9290f9ce-3f6f-46d2-af15-84703e0a3e4e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:48.181961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3539a1b4-0835-40d9-92ba-cb99c1207faf req-9290f9ce-3f6f-46d2-af15-84703e0a3e4e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:48.184802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3539a1b4-0835-40d9-92ba-cb99c1207faf req-9290f9ce-3f6f-46d2-af15-84703e0a3e4e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:48.211929 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-3539a1b4-0835-40d9-92ba-cb99c1207faf req-9290f9ce-3f6f-46d2-af15-84703e0a3e4e service nova] Creating event network-vif-plugged:b6e83be0-c818-42a0-bcb5-7a0cc5206730 for instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 on n-h1-860892-1 Oct 11 04:33:48.229835 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-3539a1b4-0835-40d9-92ba-cb99c1207faf req-9290f9ce-3f6f-46d2-af15-84703e0a3e4e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080307 Oct 11 04:33:48.237499 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2635/5026] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:48.239356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-41eac133-bd4e-4963-bad0-36c653f7d68e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:48.253585 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41eac133-bd4e-4963-bad0-36c653f7d68e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1661 microversion: 2.1 time: 0.674112 Oct 11 04:33:48.269176 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2392/5027] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:47 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1661 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:48.639076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-afe884a1-7d66-49e7-9620-3dd1c33e901b req-dd860ed7-3fb0-4cdc-9f4c-e303ad9dda13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ec2cb39-bab6-4474-9901-5909a9053a80", "name": "network-vif-deleted", "tag": "af219b67-485d-4b19-8980-781c7c1d38b7"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:48.663303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3c2f6f6-644d-4108-a839-7e03f4dc92b8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:48.664100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3c2f6f6-644d-4108-a839-7e03f4dc92b8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:48.665766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-afe884a1-7d66-49e7-9620-3dd1c33e901b req-dd860ed7-3fb0-4cdc-9f4c-e303ad9dda13 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:48.667506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-afe884a1-7d66-49e7-9620-3dd1c33e901b req-dd860ed7-3fb0-4cdc-9f4c-e303ad9dda13 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:48.669519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-afe884a1-7d66-49e7-9620-3dd1c33e901b req-dd860ed7-3fb0-4cdc-9f4c-e303ad9dda13 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:48.675940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c2f6f6-644d-4108-a839-7e03f4dc92b8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:48.678908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c2f6f6-644d-4108-a839-7e03f4dc92b8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:48.679632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c2f6f6-644d-4108-a839-7e03f4dc92b8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:48.681438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c2f6f6-644d-4108-a839-7e03f4dc92b8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:48.682771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c2f6f6-644d-4108-a839-7e03f4dc92b8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:48.684730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c2f6f6-644d-4108-a839-7e03f4dc92b8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:48.708005 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-afe884a1-7d66-49e7-9620-3dd1c33e901b req-dd860ed7-3fb0-4cdc-9f4c-e303ad9dda13 service nova] Creating event network-vif-deleted:af219b67-485d-4b19-8980-781c7c1d38b7 for instance 7ec2cb39-bab6-4474-9901-5909a9053a80 on n-h2-860892-1 Oct 11 04:33:48.714296 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-afe884a1-7d66-49e7-9620-3dd1c33e901b req-dd860ed7-3fb0-4cdc-9f4c-e303ad9dda13 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080765 Oct 11 04:33:48.715567 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2636/5028] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:33:48.805447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a3c2f6f6-644d-4108-a839-7e03f4dc92b8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:48.817003 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3c2f6f6-644d-4108-a839-7e03f4dc92b8 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1622 microversion: 2.1 time: 0.158899 Oct 11 04:33:48.817795 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2393/5029] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:48 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1622 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:49.032754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a066cc4c-4374-4bba-99d8-bc67bea4ae7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:49.035148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a066cc4c-4374-4bba-99d8-bc67bea4ae7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:49.077000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a066cc4c-4374-4bba-99d8-bc67bea4ae7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:49.082270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a066cc4c-4374-4bba-99d8-bc67bea4ae7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:49.082747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a066cc4c-4374-4bba-99d8-bc67bea4ae7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:49.085467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a066cc4c-4374-4bba-99d8-bc67bea4ae7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:49.085983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a066cc4c-4374-4bba-99d8-bc67bea4ae7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:49.087019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a066cc4c-4374-4bba-99d8-bc67bea4ae7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:49.133381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:49.159105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1b98397d-c128-4d03-bdb7-54d4700c39e6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:49.160681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1b98397d-c128-4d03-bdb7-54d4700c39e6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:49.167337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b98397d-c128-4d03-bdb7-54d4700c39e6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:49.168922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b98397d-c128-4d03-bdb7-54d4700c39e6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:49.169700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b98397d-c128-4d03-bdb7-54d4700c39e6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:49.171751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b98397d-c128-4d03-bdb7-54d4700c39e6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:49.172465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b98397d-c128-4d03-bdb7-54d4700c39e6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:49.173148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b98397d-c128-4d03-bdb7-54d4700c39e6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:49.313518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1b98397d-c128-4d03-bdb7-54d4700c39e6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:49.325541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a066cc4c-4374-4bba-99d8-bc67bea4ae7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:49.334641 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a066cc4c-4374-4bba-99d8-bc67bea4ae7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1316 microversion: 2.1 time: 0.308518 Oct 11 04:33:49.336811 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2637/5030] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:49 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1316 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:49.341886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6caaecf4-a5d1-4da3-b011-3b933b11d272 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:49.342882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6caaecf4-a5d1-4da3-b011-3b933b11d272 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:49.353400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaecf4-a5d1-4da3-b011-3b933b11d272 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:49.356226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaecf4-a5d1-4da3-b011-3b933b11d272 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:49.358681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaecf4-a5d1-4da3-b011-3b933b11d272 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:49.359873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaecf4-a5d1-4da3-b011-3b933b11d272 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:49.360461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaecf4-a5d1-4da3-b011-3b933b11d272 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:49.361176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6caaecf4-a5d1-4da3-b011-3b933b11d272 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:49.366294 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1b98397d-c128-4d03-bdb7-54d4700c39e6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1252 microversion: 2.1 time: 0.210959 Oct 11 04:33:49.371896 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2394/5031] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:49 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1252 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:49.671305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6caaecf4-a5d1-4da3-b011-3b933b11d272 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:49.682247 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6caaecf4-a5d1-4da3-b011-3b933b11d272 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1661 microversion: 2.1 time: 0.343147 Oct 11 04:33:49.690032 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2638/5032] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:49 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1661 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:49.842330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:49.843502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:49.853783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:49.854419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:49.855188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:49.856150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:49.856606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:49.857029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:49.895001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:49.895752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:49.896362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:49.896973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lazy-loading 'fault' on Instance uuid 7ec2cb39-bab6-4474-9901-5909a9053a80 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:33:49.963852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:49.979629 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-171438d5-22f8-40fc-979b-cd27e9878d13 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 200 len: 1336 microversion: 2.1 time: 0.141866 Oct 11 04:33:49.980709 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2395/5033] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:49 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 1336 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:50.360334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e66027f3-6d51-43aa-8c1b-5ad82e6ad2cd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:50.361005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e66027f3-6d51-43aa-8c1b-5ad82e6ad2cd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:50.372449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66027f3-6d51-43aa-8c1b-5ad82e6ad2cd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:50.373948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66027f3-6d51-43aa-8c1b-5ad82e6ad2cd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:50.374571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66027f3-6d51-43aa-8c1b-5ad82e6ad2cd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:50.375802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66027f3-6d51-43aa-8c1b-5ad82e6ad2cd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:50.376412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66027f3-6d51-43aa-8c1b-5ad82e6ad2cd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:50.376993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e66027f3-6d51-43aa-8c1b-5ad82e6ad2cd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:50.398422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-afe981a5-8975-431e-97c8-86cfd5102ee4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:50.398422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-afe981a5-8975-431e-97c8-86cfd5102ee4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:50.406860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afe981a5-8975-431e-97c8-86cfd5102ee4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:50.407545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afe981a5-8975-431e-97c8-86cfd5102ee4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:50.412883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afe981a5-8975-431e-97c8-86cfd5102ee4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:50.414034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afe981a5-8975-431e-97c8-86cfd5102ee4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:50.414793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afe981a5-8975-431e-97c8-86cfd5102ee4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:50.415457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-afe981a5-8975-431e-97c8-86cfd5102ee4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:50.490708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-afe981a5-8975-431e-97c8-86cfd5102ee4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:50.500412 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-afe981a5-8975-431e-97c8-86cfd5102ee4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1300 microversion: 2.1 time: 0.111584 Oct 11 04:33:50.502587 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2396/5034] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:50 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:50.564717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e66027f3-6d51-43aa-8c1b-5ad82e6ad2cd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:50.572445 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e66027f3-6d51-43aa-8c1b-5ad82e6ad2cd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1316 microversion: 2.1 time: 0.216212 Oct 11 04:33:50.573012 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2639/5035] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:50 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1316 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:50.707312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0e433154-8d44-4d96-9d7e-56e9cb43852d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:50.708407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0e433154-8d44-4d96-9d7e-56e9cb43852d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:50.731961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e433154-8d44-4d96-9d7e-56e9cb43852d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:50.740223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e433154-8d44-4d96-9d7e-56e9cb43852d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:50.740989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e433154-8d44-4d96-9d7e-56e9cb43852d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:50.741985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e433154-8d44-4d96-9d7e-56e9cb43852d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:50.745372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e433154-8d44-4d96-9d7e-56e9cb43852d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:50.746151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e433154-8d44-4d96-9d7e-56e9cb43852d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:51.004923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:51.005728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7ec2cb39-bab6-4474-9901-5909a9053a80] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:51.020178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:51.021060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:51.021696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:51.027725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:51.027725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:51.027725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:51.054458 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] HTTP exception thrown: Instance 7ec2cb39-bab6-4474-9901-5909a9053a80 could not be found. Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Request method failure captured: Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 HTTP/1.1 Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPEasekUZLINQ5CZWJXkMppFiFyiPz0x7d4djdvUd-asoF16cTMXmitsW8Jw6-L4ZC10T49kVSd5NZJD7qmV4ktBS-qpfyACuQOEHpQR5BigmL06KMooK58zyWV0xifCb_yIKtS4zKCvAts6lZk9Fe5iF-Yw7nZw-Mdv0pFYP_e1eeY Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75ee1246b11f4fb286baf525614515c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}] Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 820b6b6b001a46a2abd3415de0b5f29b Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 7ec2cb39-bab6-4474-9901-5909a9053a80 could not be found. Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '7ec2cb39-bab6-4474-9901-5909a9053a80'} Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ec2cb39-bab6-4474-9901-5909a9053a80 could not be found. Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ec2cb39-bab6-4474-9901-5909a9053a80 could not be found. Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:51.058986 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:51.069467 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:51.069467 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:51.069467 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:51.069467 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:51.069467 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:33:51.069467 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:33:51.069467 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ec2cb39-bab6-4474-9901-5909a9053a80 could not be found. Oct 11 04:33:51.069467 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:51.069467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Returning 404 to user: Instance 7ec2cb39-bab6-4474-9901-5909a9053a80 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:51.069467 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-989d4b74-acfc-4600-b18d-718deeafdc18 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80" status: 404 len: 111 microversion: 2.1 time: 0.060000 Oct 11 04:33:51.069467 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2640/5036] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:50 2022] GET /compute/v2.1/servers/7ec2cb39-bab6-4474-9901-5909a9053a80 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:33:51.073147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-afa63965-bf41-4c1d-87cd-735a6dd5a1df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '.version_select at 0x7fda19b25310>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:51.201959 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-afa63965-bf41-4c1d-87cd-735a6dd5a1df tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163993139" status: 202 len: 0 microversion: 2.1 time: 0.135806 Oct 11 04:33:51.202879 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2641/5037] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:33:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1163993139 => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:33:51.522597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0e433154-8d44-4d96-9d7e-56e9cb43852d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:51.530095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d6833e4-9e9a-422b-8539-105e7de26117 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:51.530787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d6833e4-9e9a-422b-8539-105e7de26117 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:51.538411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d6833e4-9e9a-422b-8539-105e7de26117 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:51.538791 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0e433154-8d44-4d96-9d7e-56e9cb43852d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1665 microversion: 2.1 time: 0.835474 Oct 11 04:33:51.538902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d6833e4-9e9a-422b-8539-105e7de26117 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:51.539513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d6833e4-9e9a-422b-8539-105e7de26117 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:51.540002 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2397/5038] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:50 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1665 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:51.540358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d6833e4-9e9a-422b-8539-105e7de26117 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:51.540828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d6833e4-9e9a-422b-8539-105e7de26117 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:51.541258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d6833e4-9e9a-422b-8539-105e7de26117 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:51.595964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dd9aa71b-4e37-4e0d-886e-9dbacb3e4a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:51.596584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dd9aa71b-4e37-4e0d-886e-9dbacb3e4a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:51.604475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd9aa71b-4e37-4e0d-886e-9dbacb3e4a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:51.605220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd9aa71b-4e37-4e0d-886e-9dbacb3e4a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:51.613962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd9aa71b-4e37-4e0d-886e-9dbacb3e4a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:51.613962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd9aa71b-4e37-4e0d-886e-9dbacb3e4a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:51.613962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd9aa71b-4e37-4e0d-886e-9dbacb3e4a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:51.613962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd9aa71b-4e37-4e0d-886e-9dbacb3e4a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:51.614476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d6833e4-9e9a-422b-8539-105e7de26117 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:51.617108 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d6833e4-9e9a-422b-8539-105e7de26117 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1300 microversion: 2.1 time: 0.091882 Oct 11 04:33:51.629198 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2642/5039] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:51 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:51.891722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dd9aa71b-4e37-4e0d-886e-9dbacb3e4a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:51.907438 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dd9aa71b-4e37-4e0d-886e-9dbacb3e4a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1505 microversion: 2.1 time: 0.314970 Oct 11 04:33:51.908037 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2398/5040] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:51 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:51.944735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef37d1e1-c8ad-4781-a1e0-c7baa621e828 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:51.945788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef37d1e1-c8ad-4781-a1e0-c7baa621e828 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:51.957770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef37d1e1-c8ad-4781-a1e0-c7baa621e828 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:51.963413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef37d1e1-c8ad-4781-a1e0-c7baa621e828 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:51.963857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef37d1e1-c8ad-4781-a1e0-c7baa621e828 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:51.965038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef37d1e1-c8ad-4781-a1e0-c7baa621e828 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:51.968175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef37d1e1-c8ad-4781-a1e0-c7baa621e828 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:51.970396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef37d1e1-c8ad-4781-a1e0-c7baa621e828 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:52.021471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef37d1e1-c8ad-4781-a1e0-c7baa621e828 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:33:52.613409 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef37d1e1-c8ad-4781-a1e0-c7baa621e828 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 204 len: 0 microversion: 2.1 time: 0.675376 Oct 11 04:33:52.614725 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2643/5041] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:33:51 2022] DELETE /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:33:52.623248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-38224795-4c49-426c-b6ed-fb8e50b9ea9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:52.624988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-38224795-4c49-426c-b6ed-fb8e50b9ea9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:52.632676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38224795-4c49-426c-b6ed-fb8e50b9ea9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:52.633172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38224795-4c49-426c-b6ed-fb8e50b9ea9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:52.633614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38224795-4c49-426c-b6ed-fb8e50b9ea9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:52.634451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38224795-4c49-426c-b6ed-fb8e50b9ea9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:52.634918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38224795-4c49-426c-b6ed-fb8e50b9ea9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:52.635601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38224795-4c49-426c-b6ed-fb8e50b9ea9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:52.641735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-79d06db6-2ba9-488b-b1e1-ea113b0ac65c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:52.642933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-79d06db6-2ba9-488b-b1e1-ea113b0ac65c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:52.649736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d06db6-2ba9-488b-b1e1-ea113b0ac65c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:52.651201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d06db6-2ba9-488b-b1e1-ea113b0ac65c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:52.651868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d06db6-2ba9-488b-b1e1-ea113b0ac65c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:52.655338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d06db6-2ba9-488b-b1e1-ea113b0ac65c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:52.656722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d06db6-2ba9-488b-b1e1-ea113b0ac65c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:52.657093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79d06db6-2ba9-488b-b1e1-ea113b0ac65c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:52.792548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-79d06db6-2ba9-488b-b1e1-ea113b0ac65c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:52.807215 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-79d06db6-2ba9-488b-b1e1-ea113b0ac65c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1306 microversion: 2.1 time: 0.163450 Oct 11 04:33:52.808379 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2644/5042] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:52 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1306 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:52.962567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-38224795-4c49-426c-b6ed-fb8e50b9ea9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:52.973549 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-38224795-4c49-426c-b6ed-fb8e50b9ea9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1511 microversion: 2.1 time: 0.354229 Oct 11 04:33:52.974488 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2399/5043] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:52 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1511 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:53.320804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-\u20a1-229986794", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "09b3f7b6-0734-4684-a67d-dc5b0c7e4aff"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:53.388104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] validate_networks() for [('09b3f7b6-0734-4684-a67d-dc5b0c7e4aff', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:33:53.835122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1e4684f8-a980-4b9f-9b91-585319c6e261 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:53.845871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1e4684f8-a980-4b9f-9b91-585319c6e261 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:53.849293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e4684f8-a980-4b9f-9b91-585319c6e261 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:53.854471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e4684f8-a980-4b9f-9b91-585319c6e261 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:53.855466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e4684f8-a980-4b9f-9b91-585319c6e261 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:53.856451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e4684f8-a980-4b9f-9b91-585319c6e261 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:53.867319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e4684f8-a980-4b9f-9b91-585319c6e261 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:53.868218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1e4684f8-a980-4b9f-9b91-585319c6e261 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:54.085872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:33:54.086380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:33:54.086968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:33:54.087390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:33:54.087852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:33:54.103447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:54.105180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:54.105180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:54.105180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:54.105562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:54.110880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:54.132082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1e4684f8-a980-4b9f-9b91-585319c6e261 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:54.143470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:54.145084 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1e4684f8-a980-4b9f-9b91-585319c6e261 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1374 microversion: 2.1 time: 0.315828 Oct 11 04:33:54.146839 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2400/5044] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:53 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1374 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:54.158836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-76194988-e24d-4aa3-8a57-6cf497bc23ed tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:54.160303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:33:54.161247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-76194988-e24d-4aa3-8a57-6cf497bc23ed tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:54.176811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76194988-e24d-4aa3-8a57-6cf497bc23ed tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:54.177561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for user 96880360d7994e09a1fd27193d2cd152 and project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:33:54.177803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76194988-e24d-4aa3-8a57-6cf497bc23ed tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:54.182638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76194988-e24d-4aa3-8a57-6cf497bc23ed tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:54.183746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76194988-e24d-4aa3-8a57-6cf497bc23ed tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:54.184393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76194988-e24d-4aa3-8a57-6cf497bc23ed tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:54.185989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76194988-e24d-4aa3-8a57-6cf497bc23ed tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:54.219734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:33:54.226278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:33:54.552533 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3aafa4b9-f78d-4eea-9a8d-868fe4682cf6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.394511 Oct 11 04:33:54.556046 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2645/5045] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:33:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 1399 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:33:54.570350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bcb6f241-5af7-4eba-a253-85191cfb2ec8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:54.573460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bcb6f241-5af7-4eba-a253-85191cfb2ec8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:54.767956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bcb6f241-5af7-4eba-a253-85191cfb2ec8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:54.781525 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bcb6f241-5af7-4eba-a253-85191cfb2ec8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1192 microversion: 2.1 time: 0.216573 Oct 11 04:33:54.784099 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2646/5046] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:54 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1192 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:54.805530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-76194988-e24d-4aa3-8a57-6cf497bc23ed tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:54.818444 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-76194988-e24d-4aa3-8a57-6cf497bc23ed tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1511 microversion: 2.1 time: 0.667329 Oct 11 04:33:54.821750 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2401/5047] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:54 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1511 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:55.173009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b32c5d2e-7e22-4235-bffd-27cdd6697dff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:55.176126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b32c5d2e-7e22-4235-bffd-27cdd6697dff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:55.189256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32c5d2e-7e22-4235-bffd-27cdd6697dff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:55.198751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32c5d2e-7e22-4235-bffd-27cdd6697dff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:55.201288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32c5d2e-7e22-4235-bffd-27cdd6697dff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:55.202313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32c5d2e-7e22-4235-bffd-27cdd6697dff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:55.206867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32c5d2e-7e22-4235-bffd-27cdd6697dff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:55.207584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b32c5d2e-7e22-4235-bffd-27cdd6697dff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:55.260057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-d75f1333-a287-48cb-9ec8-261895e25c0b req-ca9b2684-a703-445e-b207-222af8e95410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4c2cb1d-6389-41d3-8352-730a774ff2f7", "name": "network-vif-deleted", "tag": "b6e83be0-c818-42a0-bcb5-7a0cc5206730"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:55.293622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d75f1333-a287-48cb-9ec8-261895e25c0b req-ca9b2684-a703-445e-b207-222af8e95410 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:55.308375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d75f1333-a287-48cb-9ec8-261895e25c0b req-ca9b2684-a703-445e-b207-222af8e95410 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:55.308375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d75f1333-a287-48cb-9ec8-261895e25c0b req-ca9b2684-a703-445e-b207-222af8e95410 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:55.326712 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-d75f1333-a287-48cb-9ec8-261895e25c0b req-ca9b2684-a703-445e-b207-222af8e95410 service nova] Creating event network-vif-deleted:b6e83be0-c818-42a0-bcb5-7a0cc5206730 for instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 on n-h1-860892-1 Oct 11 04:33:55.342150 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-d75f1333-a287-48cb-9ec8-261895e25c0b req-ca9b2684-a703-445e-b207-222af8e95410 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086332 Oct 11 04:33:55.352117 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2402/5048] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:33:55.712899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b32c5d2e-7e22-4235-bffd-27cdd6697dff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:55.723075 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b32c5d2e-7e22-4235-bffd-27cdd6697dff tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1374 microversion: 2.1 time: 0.553904 Oct 11 04:33:55.727534 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2647/5049] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:55 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1374 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:33:55.809067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-48230452-8c86-4ed0-8052-fec7d69ba5eb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:55.809944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-48230452-8c86-4ed0-8052-fec7d69ba5eb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:55.869087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:55.869087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:55.877623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:55.883820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:55.886858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:55.888016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:55.888478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:55.889076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:55.926044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48230452-8c86-4ed0-8052-fec7d69ba5eb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:55.935792 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-48230452-8c86-4ed0-8052-fec7d69ba5eb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1192 microversion: 2.1 time: 0.132038 Oct 11 04:33:55.940415 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2403/5050] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:55 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1192 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:56.002380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:56.007872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:56.008606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:56.009278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lazy-loading 'fault' on Instance uuid f4c2cb1d-6389-41d3-8352-730a774ff2f7 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:33:56.075246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:56.083806 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7267b02b-a932-4eea-877a-8c4f23e933dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 200 len: 1306 microversion: 2.1 time: 0.220028 Oct 11 04:33:56.084624 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2648/5051] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:55 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 1306 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:56.748168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0db743e2-96e2-4ab6-be40-7062dcacb980 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:56.748800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0db743e2-96e2-4ab6-be40-7062dcacb980 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:56.768279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0db743e2-96e2-4ab6-be40-7062dcacb980 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:56.772600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0db743e2-96e2-4ab6-be40-7062dcacb980 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:56.773312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0db743e2-96e2-4ab6-be40-7062dcacb980 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:56.774376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0db743e2-96e2-4ab6-be40-7062dcacb980 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:56.778000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0db743e2-96e2-4ab6-be40-7062dcacb980 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:56.778681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0db743e2-96e2-4ab6-be40-7062dcacb980 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:56.964564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-739e4fe6-8648-45ae-bb17-ccf542c7bcdf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:56.965953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-739e4fe6-8648-45ae-bb17-ccf542c7bcdf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:56.975095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-739e4fe6-8648-45ae-bb17-ccf542c7bcdf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:56.975939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-739e4fe6-8648-45ae-bb17-ccf542c7bcdf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:56.976574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-739e4fe6-8648-45ae-bb17-ccf542c7bcdf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:56.978012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-739e4fe6-8648-45ae-bb17-ccf542c7bcdf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:57.009667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-739e4fe6-8648-45ae-bb17-ccf542c7bcdf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:57.010889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-739e4fe6-8648-45ae-bb17-ccf542c7bcdf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.032s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:57.153708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0db743e2-96e2-4ab6-be40-7062dcacb980 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:57.156612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:57.176211 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0db743e2-96e2-4ab6-be40-7062dcacb980 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1374 microversion: 2.1 time: 0.423171 Oct 11 04:33:57.176211 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2404/5052] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:56 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1374 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:57.180427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:57.181165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:57.191556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:57.192177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:57.193019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:57.193838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:57.194478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:57.195002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:57.219530 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 HTTP/1.1 Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'f4c2cb1d-6389-41d3-8352-730a774ff2f7'} Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:57.221649 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.226108 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:57.226108 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:57.226108 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:57.226108 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:33:57.226108 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:33:57.226108 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:33:57.226108 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.228553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:57.229686 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d22cb338-d6c0-49f6-acb2-8471440df622 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 404 len: 111 microversion: 2.1 time: 0.057966 Oct 11 04:33:57.230859 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2405/5053] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:57 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:33:57.247125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c340093d-3fc7-49f3-aaaa-b46690ff6f89 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:57.251430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c340093d-3fc7-49f3-aaaa-b46690ff6f89 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:57.264165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c340093d-3fc7-49f3-aaaa-b46690ff6f89 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:57.264913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c340093d-3fc7-49f3-aaaa-b46690ff6f89 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:57.265543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c340093d-3fc7-49f3-aaaa-b46690ff6f89 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:57.266471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c340093d-3fc7-49f3-aaaa-b46690ff6f89 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:57.268408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c340093d-3fc7-49f3-aaaa-b46690ff6f89 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:57.269395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c340093d-3fc7-49f3-aaaa-b46690ff6f89 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:57.277203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-739e4fe6-8648-45ae-bb17-ccf542c7bcdf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:57.289728 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-739e4fe6-8648-45ae-bb17-ccf542c7bcdf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1188 microversion: 2.1 time: 0.330456 Oct 11 04:33:57.290776 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2649/5054] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:56 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1188 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:57.332448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:33:57.422393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1f362f03-ad1b-4c29-93a3-4669635f36fb req-2b5e7ac1-c2e2-4669-96ed-5d658da8344a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e04f82e5-4f36-463a-89dd-805b017815b8", "tag": "a81a8f24-2501-4cde-8095-da9af4ad9c9a"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:57.443934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1f362f03-ad1b-4c29-93a3-4669635f36fb req-2b5e7ac1-c2e2-4669-96ed-5d658da8344a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:57.444423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1f362f03-ad1b-4c29-93a3-4669635f36fb req-2b5e7ac1-c2e2-4669-96ed-5d658da8344a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:57.444862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1f362f03-ad1b-4c29-93a3-4669635f36fb req-2b5e7ac1-c2e2-4669-96ed-5d658da8344a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:57.473301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c340093d-3fc7-49f3-aaaa-b46690ff6f89 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:57.474200 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1f362f03-ad1b-4c29-93a3-4669635f36fb req-2b5e7ac1-c2e2-4669-96ed-5d658da8344a service nova] Creating event network-changed:a81a8f24-2501-4cde-8095-da9af4ad9c9a for instance e04f82e5-4f36-463a-89dd-805b017815b8 on n-h2-860892-1 Oct 11 04:33:57.481788 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1f362f03-ad1b-4c29-93a3-4669635f36fb req-2b5e7ac1-c2e2-4669-96ed-5d658da8344a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064508 Oct 11 04:33:57.484375 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c340093d-3fc7-49f3-aaaa-b46690ff6f89 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.246366 Oct 11 04:33:57.489152 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2650/5055] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:33:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:33:57.495053 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2406/5056] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:57 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:57.727944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2ec3ad32-4592-4088-b6d9-7098f4c6fbff tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": 12345, "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2ec3ad32-4592-4088-b6d9-7098f4c6fbff tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 163 Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": 12345, "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 12345, 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 12345 is not of type 'string' Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'type' in schema['properties']['server']['properties']['name']: Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 12345 Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:33:57.746612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2ec3ad32-4592-4088-b6d9-7098f4c6fbff tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Invalid input for field/attribute name. Value: 12345. 12345 is not of type 'string' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2ec3ad32-4592-4088-b6d9-7098f4c6fbff tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 127 microversion: 2.1 time: 0.025883 Oct 11 04:33:57.757006 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2651/5057] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:33:57 2022] POST /compute/v2.1/servers => generated 127 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:33:57.759740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-22dea7fa-fb03-4b8a-af20-8092833bcae9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:57.760633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-22dea7fa-fb03-4b8a-af20-8092833bcae9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:57.784480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dea7fa-fb03-4b8a-af20-8092833bcae9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:57.784480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dea7fa-fb03-4b8a-af20-8092833bcae9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:57.784480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dea7fa-fb03-4b8a-af20-8092833bcae9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:57.784480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dea7fa-fb03-4b8a-af20-8092833bcae9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:57.784480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dea7fa-fb03-4b8a-af20-8092833bcae9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:57.784480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22dea7fa-fb03-4b8a-af20-8092833bcae9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:58.196439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce149ab4-cbe8-495b-be06-4a125e5a7151 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:58.200187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce149ab4-cbe8-495b-be06-4a125e5a7151 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:58.241407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce149ab4-cbe8-495b-be06-4a125e5a7151 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:58.246007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce149ab4-cbe8-495b-be06-4a125e5a7151 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:58.247544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce149ab4-cbe8-495b-be06-4a125e5a7151 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:58.248884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce149ab4-cbe8-495b-be06-4a125e5a7151 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:58.254318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce149ab4-cbe8-495b-be06-4a125e5a7151 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:58.257772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce149ab4-cbe8-495b-be06-4a125e5a7151 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:58.303632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-22dea7fa-fb03-4b8a-af20-8092833bcae9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:58.320388 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-22dea7fa-fb03-4b8a-af20-8092833bcae9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.562070 Oct 11 04:33:58.321032 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2407/5058] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:57 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:58.347835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-87636496-e394-4d56-80f5-2e86afc63693 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:58.357798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-87636496-e394-4d56-80f5-2e86afc63693 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:58.388451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87636496-e394-4d56-80f5-2e86afc63693 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:58.388953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87636496-e394-4d56-80f5-2e86afc63693 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:58.395016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87636496-e394-4d56-80f5-2e86afc63693 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:58.401790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87636496-e394-4d56-80f5-2e86afc63693 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:58.402500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87636496-e394-4d56-80f5-2e86afc63693 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:58.410462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87636496-e394-4d56-80f5-2e86afc63693 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:58.593961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-87636496-e394-4d56-80f5-2e86afc63693 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:58.649999 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-87636496-e394-4d56-80f5-2e86afc63693 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1252 microversion: 2.1 time: 0.327824 Oct 11 04:33:58.650674 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2408/5059] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:58 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1252 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:58.695326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-261e6109-f5af-4e64-8cc7-ac5e2729e7a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:58.695585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-261e6109-f5af-4e64-8cc7-ac5e2729e7a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:58.709937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-261e6109-f5af-4e64-8cc7-ac5e2729e7a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:58.710860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-261e6109-f5af-4e64-8cc7-ac5e2729e7a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:58.711910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-261e6109-f5af-4e64-8cc7-ac5e2729e7a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:58.712812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-261e6109-f5af-4e64-8cc7-ac5e2729e7a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:58.713593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-261e6109-f5af-4e64-8cc7-ac5e2729e7a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:58.715974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-261e6109-f5af-4e64-8cc7-ac5e2729e7a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:58.959997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce149ab4-cbe8-495b-be06-4a125e5a7151 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:58.975959 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce149ab4-cbe8-495b-be06-4a125e5a7151 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1374 microversion: 2.1 time: 0.787164 Oct 11 04:33:58.991332 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2652/5060] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:58 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1374 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:59.016641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-261e6109-f5af-4e64-8cc7-ac5e2729e7a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:59.027896 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-261e6109-f5af-4e64-8cc7-ac5e2729e7a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.353638 Oct 11 04:33:59.028868 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2409/5061] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:58 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:33:59.676401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f82813d-bd80-49b3-9de3-94a81363e7f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:33:59.683320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f82813d-bd80-49b3-9de3-94a81363e7f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:33:59.691981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f82813d-bd80-49b3-9de3-94a81363e7f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:59.696545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f82813d-bd80-49b3-9de3-94a81363e7f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:59.696545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f82813d-bd80-49b3-9de3-94a81363e7f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:59.696545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f82813d-bd80-49b3-9de3-94a81363e7f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:33:59.698508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f82813d-bd80-49b3-9de3-94a81363e7f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:33:59.699326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f82813d-bd80-49b3-9de3-94a81363e7f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:33:59.882390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2f82813d-bd80-49b3-9de3-94a81363e7f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:33:59.896091 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f82813d-bd80-49b3-9de3-94a81363e7f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1250 microversion: 2.1 time: 0.223973 Oct 11 04:33:59.902695 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2653/5062] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:59 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1250 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:00.006554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dd43a45b-0cd8-4472-b86b-817f9a8cc78b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:00.008105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dd43a45b-0cd8-4472-b86b-817f9a8cc78b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:00.024257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd43a45b-0cd8-4472-b86b-817f9a8cc78b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:00.027448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd43a45b-0cd8-4472-b86b-817f9a8cc78b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:00.035079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd43a45b-0cd8-4472-b86b-817f9a8cc78b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:00.035079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd43a45b-0cd8-4472-b86b-817f9a8cc78b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:00.035079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd43a45b-0cd8-4472-b86b-817f9a8cc78b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:00.035079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd43a45b-0cd8-4472-b86b-817f9a8cc78b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:00.412916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dd43a45b-0cd8-4472-b86b-817f9a8cc78b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:00.427203 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dd43a45b-0cd8-4472-b86b-817f9a8cc78b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1374 microversion: 2.1 time: 0.426553 Oct 11 04:34:00.428500 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2410/5063] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:33:59 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1374 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:00.923712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e464593-3435-4dab-bc4f-707380a9b7fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:00.926208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e464593-3435-4dab-bc4f-707380a9b7fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:00.956149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e464593-3435-4dab-bc4f-707380a9b7fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:00.959736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e464593-3435-4dab-bc4f-707380a9b7fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:00.965370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e464593-3435-4dab-bc4f-707380a9b7fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:00.970046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e464593-3435-4dab-bc4f-707380a9b7fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:00.985028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e464593-3435-4dab-bc4f-707380a9b7fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:00.985487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e464593-3435-4dab-bc4f-707380a9b7fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:01.453627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-26daeb4e-41b3-4705-a43c-2c71e2c6801c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:01.454617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-26daeb4e-41b3-4705-a43c-2c71e2c6801c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:01.474763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26daeb4e-41b3-4705-a43c-2c71e2c6801c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:01.477886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26daeb4e-41b3-4705-a43c-2c71e2c6801c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:01.481832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26daeb4e-41b3-4705-a43c-2c71e2c6801c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:01.482755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26daeb4e-41b3-4705-a43c-2c71e2c6801c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:01.483251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26daeb4e-41b3-4705-a43c-2c71e2c6801c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:01.483701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26daeb4e-41b3-4705-a43c-2c71e2c6801c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:01.944415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-26daeb4e-41b3-4705-a43c-2c71e2c6801c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:01.955460 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-26daeb4e-41b3-4705-a43c-2c71e2c6801c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1374 microversion: 2.1 time: 0.505501 Oct 11 04:34:01.957341 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2411/5064] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:01 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1374 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:01.988352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e464593-3435-4dab-bc4f-707380a9b7fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:02.010994 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e464593-3435-4dab-bc4f-707380a9b7fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1292 microversion: 2.1 time: 1.090639 Oct 11 04:34:02.027398 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2654/5065] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:00 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1292 bytes in 1108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:02.379829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-afe2a3a7-e825-47bb-b4aa-e061224c0fb2 req-22911b76-0583-4d6a-b4ae-4d3a84a8b77c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "451260aa-21f7-42e6-b412-66610aad28ee", "tag": "90a81ee1-9aac-4772-979d-b78a8ea22a38"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:02.431452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-afe2a3a7-e825-47bb-b4aa-e061224c0fb2 req-22911b76-0583-4d6a-b4ae-4d3a84a8b77c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:02.436392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-afe2a3a7-e825-47bb-b4aa-e061224c0fb2 req-22911b76-0583-4d6a-b4ae-4d3a84a8b77c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:02.439416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-afe2a3a7-e825-47bb-b4aa-e061224c0fb2 req-22911b76-0583-4d6a-b4ae-4d3a84a8b77c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:02.472158 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-afe2a3a7-e825-47bb-b4aa-e061224c0fb2 req-22911b76-0583-4d6a-b4ae-4d3a84a8b77c service nova] Creating event network-changed:90a81ee1-9aac-4772-979d-b78a8ea22a38 for instance 451260aa-21f7-42e6-b412-66610aad28ee on n-h1-860892-1 Oct 11 04:34:02.488522 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-afe2a3a7-e825-47bb-b4aa-e061224c0fb2 req-22911b76-0583-4d6a-b4ae-4d3a84a8b77c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115246 Oct 11 04:34:02.489908 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2412/5066] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:02.981608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d5dedd43-1073-44de-8477-f0364a901bd4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:02.982371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d5dedd43-1073-44de-8477-f0364a901bd4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:02.998502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5dedd43-1073-44de-8477-f0364a901bd4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:02.999801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5dedd43-1073-44de-8477-f0364a901bd4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:03.001476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5dedd43-1073-44de-8477-f0364a901bd4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:03.004081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5dedd43-1073-44de-8477-f0364a901bd4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:03.007752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5dedd43-1073-44de-8477-f0364a901bd4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:03.008540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5dedd43-1073-44de-8477-f0364a901bd4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:03.047747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-233a3cd7-0793-4fd0-9ad1-9124abe65eaa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:03.048938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-233a3cd7-0793-4fd0-9ad1-9124abe65eaa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:03.060678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-233a3cd7-0793-4fd0-9ad1-9124abe65eaa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:03.061647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-233a3cd7-0793-4fd0-9ad1-9124abe65eaa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:03.063777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-233a3cd7-0793-4fd0-9ad1-9124abe65eaa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:03.064886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-233a3cd7-0793-4fd0-9ad1-9124abe65eaa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:03.065679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-233a3cd7-0793-4fd0-9ad1-9124abe65eaa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:03.066347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-233a3cd7-0793-4fd0-9ad1-9124abe65eaa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:03.302855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-233a3cd7-0793-4fd0-9ad1-9124abe65eaa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:03.311290 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-233a3cd7-0793-4fd0-9ad1-9124abe65eaa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1292 microversion: 2.1 time: 0.267928 Oct 11 04:34:03.312524 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2413/5067] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:03 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1292 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:03.330088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d5dedd43-1073-44de-8477-f0364a901bd4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:03.339267 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d5dedd43-1073-44de-8477-f0364a901bd4 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1374 microversion: 2.1 time: 0.361650 Oct 11 04:34:03.339848 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2655/5068] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:02 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1374 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:03.678046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cce7616-7d2c-4439-b038-9b40029e4565 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-706563211", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e58fe7d1-d4ee-4da1-8c7e-a7ec90d1fa0f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:03.751452 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-2cce7616-7d2c-4439-b038-9b40029e4565 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Block Device e58fe7d1-d4ee-4da1-8c7e-a7ec90d1fa0f is not bootable. Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cce7616-7d2c-4439-b038-9b40029e4565 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 357 Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-706563211", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "e58fe7d1-d4ee-4da1-8c7e-a7ec90d1fa0f", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: exception: Block Device e58fe7d1-d4ee-4da1-8c7e-a7ec90d1fa0f is not bootable. Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-706563211', 'imageRef': '', 'flavorRef': '452', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': 'e58fe7d1-d4ee-4da1-8c7e-a7ec90d1fa0f'}], 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device e58fe7d1-d4ee-4da1-8c7e-a7ec90d1fa0f is not bootable. Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:03.768901 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device e58fe7d1-d4ee-4da1-8c7e-a7ec90d1fa0f is not bootable. Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device e58fe7d1-d4ee-4da1-8c7e-a7ec90d1fa0f is not bootable. Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cce7616-7d2c-4439-b038-9b40029e4565 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Block Device e58fe7d1-d4ee-4da1-8c7e-a7ec90d1fa0f is not bootable. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2cce7616-7d2c-4439-b038-9b40029e4565 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.098378 Oct 11 04:34:03.779851 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2414/5069] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:03 2022] POST /compute/v2.1/servers => generated 110 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:34:03.781577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c7c89d6-e74a-4967-91c3-2197b8dc627a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:03.781577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c7c89d6-e74a-4967-91c3-2197b8dc627a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:03.787337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7c89d6-e74a-4967-91c3-2197b8dc627a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:03.787832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7c89d6-e74a-4967-91c3-2197b8dc627a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:03.788475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7c89d6-e74a-4967-91c3-2197b8dc627a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:03.789187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7c89d6-e74a-4967-91c3-2197b8dc627a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:03.789652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7c89d6-e74a-4967-91c3-2197b8dc627a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:03.790080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c7c89d6-e74a-4967-91c3-2197b8dc627a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:03.810386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-d99e568a-8be8-487d-a79e-93ff14a47564 req-0f5e2e02-7119-4e7e-9d9e-845a38f4f923 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04f82e5-4f36-463a-89dd-805b017815b8", "name": "network-vif-plugged", "status": "completed", "tag": "a81a8f24-2501-4cde-8095-da9af4ad9c9a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:03.830719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d99e568a-8be8-487d-a79e-93ff14a47564 req-0f5e2e02-7119-4e7e-9d9e-845a38f4f923 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:03.838429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d99e568a-8be8-487d-a79e-93ff14a47564 req-0f5e2e02-7119-4e7e-9d9e-845a38f4f923 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:03.838429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d99e568a-8be8-487d-a79e-93ff14a47564 req-0f5e2e02-7119-4e7e-9d9e-845a38f4f923 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:03.861619 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-d99e568a-8be8-487d-a79e-93ff14a47564 req-0f5e2e02-7119-4e7e-9d9e-845a38f4f923 service nova] Creating event network-vif-plugged:a81a8f24-2501-4cde-8095-da9af4ad9c9a for instance e04f82e5-4f36-463a-89dd-805b017815b8 on n-h2-860892-1 Oct 11 04:34:03.868673 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-d99e568a-8be8-487d-a79e-93ff14a47564 req-0f5e2e02-7119-4e7e-9d9e-845a38f4f923 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063528 Oct 11 04:34:03.869895 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2415/5070] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:34:03.892934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f0c9fc4-78ea-4651-97af-881e8b8975f2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:03.894519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3f0c9fc4-78ea-4651-97af-881e8b8975f2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:03.904529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f0c9fc4-78ea-4651-97af-881e8b8975f2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:03.905310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f0c9fc4-78ea-4651-97af-881e8b8975f2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:03.906516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f0c9fc4-78ea-4651-97af-881e8b8975f2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:03.907467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f0c9fc4-78ea-4651-97af-881e8b8975f2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:03.908082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f0c9fc4-78ea-4651-97af-881e8b8975f2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:03.908812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f0c9fc4-78ea-4651-97af-881e8b8975f2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:03.940717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3f0c9fc4-78ea-4651-97af-881e8b8975f2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:34:04.031942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c7c89d6-e74a-4967-91c3-2197b8dc627a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:04.036606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:04.044261 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c7c89d6-e74a-4967-91c3-2197b8dc627a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.267979 Oct 11 04:34:04.045112 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2656/5071] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:03 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:04.072268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cd877d1-805b-4e69-80f1-857bbaf1eae1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:04.073152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2cd877d1-805b-4e69-80f1-857bbaf1eae1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:04.079638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cd877d1-805b-4e69-80f1-857bbaf1eae1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:04.080654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cd877d1-805b-4e69-80f1-857bbaf1eae1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:04.081842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cd877d1-805b-4e69-80f1-857bbaf1eae1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:04.082765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cd877d1-805b-4e69-80f1-857bbaf1eae1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:04.083386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cd877d1-805b-4e69-80f1-857bbaf1eae1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:04.083994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cd877d1-805b-4e69-80f1-857bbaf1eae1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:04.134581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:04.257790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2cd877d1-805b-4e69-80f1-857bbaf1eae1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:04.268253 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2cd877d1-805b-4e69-80f1-857bbaf1eae1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.199531 Oct 11 04:34:04.270143 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2657/5072] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:04 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:04.339868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-542b4304-a643-48bf-9483-4ac28d04801e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:04.341625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-542b4304-a643-48bf-9483-4ac28d04801e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:04.350344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542b4304-a643-48bf-9483-4ac28d04801e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:04.351093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542b4304-a643-48bf-9483-4ac28d04801e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:04.351818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542b4304-a643-48bf-9483-4ac28d04801e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:04.353123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542b4304-a643-48bf-9483-4ac28d04801e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:04.353903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542b4304-a643-48bf-9483-4ac28d04801e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:04.354526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542b4304-a643-48bf-9483-4ac28d04801e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:04.391834 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3f0c9fc4-78ea-4651-97af-881e8b8975f2 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "DELETE /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 204 len: 0 microversion: 2.1 time: 0.507689 Oct 11 04:34:04.393615 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2416/5073] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:34:03 2022] DELETE /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:34:04.401900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-70d2b6fc-28e0-4e39-b049-79eac80a3c0a tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:04.402986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-70d2b6fc-28e0-4e39-b049-79eac80a3c0a tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:04.411956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70d2b6fc-28e0-4e39-b049-79eac80a3c0a tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:04.412934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70d2b6fc-28e0-4e39-b049-79eac80a3c0a tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:04.413599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70d2b6fc-28e0-4e39-b049-79eac80a3c0a tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:04.414691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70d2b6fc-28e0-4e39-b049-79eac80a3c0a tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:04.415567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70d2b6fc-28e0-4e39-b049-79eac80a3c0a tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:04.416275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70d2b6fc-28e0-4e39-b049-79eac80a3c0a tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:04.600052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-542b4304-a643-48bf-9483-4ac28d04801e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:04.608483 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-542b4304-a643-48bf-9483-4ac28d04801e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1292 microversion: 2.1 time: 0.275163 Oct 11 04:34:04.609059 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2658/5074] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:04 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1292 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:04.615851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fd4e9c71-b517-49b5-b7d2-0dddc56b1f69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:04.616761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fd4e9c71-b517-49b5-b7d2-0dddc56b1f69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:04.625038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd4e9c71-b517-49b5-b7d2-0dddc56b1f69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:04.625796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd4e9c71-b517-49b5-b7d2-0dddc56b1f69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:04.626503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd4e9c71-b517-49b5-b7d2-0dddc56b1f69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:04.627466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd4e9c71-b517-49b5-b7d2-0dddc56b1f69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:04.628530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd4e9c71-b517-49b5-b7d2-0dddc56b1f69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:04.629023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd4e9c71-b517-49b5-b7d2-0dddc56b1f69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:04.783277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=10 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:04.798774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-70d2b6fc-28e0-4e39-b049-79eac80a3c0a tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:04.810039 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-70d2b6fc-28e0-4e39-b049-79eac80a3c0a tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1374 microversion: 2.1 time: 0.414813 Oct 11 04:34:04.811881 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2417/5075] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:04 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1374 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:04.836083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fd4e9c71-b517-49b5-b7d2-0dddc56b1f69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:04.843947 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fd4e9c71-b517-49b5-b7d2-0dddc56b1f69 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1508 microversion: 2.1 time: 0.233431 Oct 11 04:34:04.844519 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2659/5076] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:04 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:05.636056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-96e7459c-42fb-4b18-84d3-91c2067fac44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:05.636932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-96e7459c-42fb-4b18-84d3-91c2067fac44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:05.643278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96e7459c-42fb-4b18-84d3-91c2067fac44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:05.643853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96e7459c-42fb-4b18-84d3-91c2067fac44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:05.644427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96e7459c-42fb-4b18-84d3-91c2067fac44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:05.646008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96e7459c-42fb-4b18-84d3-91c2067fac44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:05.646824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96e7459c-42fb-4b18-84d3-91c2067fac44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:05.648189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96e7459c-42fb-4b18-84d3-91c2067fac44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:05.837087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0793ac7b-f58a-4a29-b3bf-d3ec0fd5cda7 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:05.838414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0793ac7b-f58a-4a29-b3bf-d3ec0fd5cda7 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:05.847334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0793ac7b-f58a-4a29-b3bf-d3ec0fd5cda7 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:05.847859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0793ac7b-f58a-4a29-b3bf-d3ec0fd5cda7 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:05.848301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0793ac7b-f58a-4a29-b3bf-d3ec0fd5cda7 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:05.848997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0793ac7b-f58a-4a29-b3bf-d3ec0fd5cda7 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:05.849448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0793ac7b-f58a-4a29-b3bf-d3ec0fd5cda7 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:05.849872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0793ac7b-f58a-4a29-b3bf-d3ec0fd5cda7 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:05.915659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-96e7459c-42fb-4b18-84d3-91c2067fac44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:05.924595 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-96e7459c-42fb-4b18-84d3-91c2067fac44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1292 microversion: 2.1 time: 0.293025 Oct 11 04:34:05.925883 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2418/5077] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:05 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1292 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:05.930785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=20 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:05.935725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f09635ee-563b-4933-93f9-a7dd15e2e7e3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:05.936673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f09635ee-563b-4933-93f9-a7dd15e2e7e3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:05.946510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f09635ee-563b-4933-93f9-a7dd15e2e7e3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:05.947118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f09635ee-563b-4933-93f9-a7dd15e2e7e3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:05.947797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f09635ee-563b-4933-93f9-a7dd15e2e7e3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:05.948609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f09635ee-563b-4933-93f9-a7dd15e2e7e3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:05.949180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f09635ee-563b-4933-93f9-a7dd15e2e7e3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:05.949740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f09635ee-563b-4933-93f9-a7dd15e2e7e3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:05.997063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0793ac7b-f58a-4a29-b3bf-d3ec0fd5cda7 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:06.007555 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0793ac7b-f58a-4a29-b3bf-d3ec0fd5cda7 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1547 microversion: 2.1 time: 0.174423 Oct 11 04:34:06.008539 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2660/5078] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:05 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1547 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:06.036615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc654978-b715-4e20-92ea-c03310295ad5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:06.037251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bc654978-b715-4e20-92ea-c03310295ad5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:06.044882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc654978-b715-4e20-92ea-c03310295ad5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:06.045765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc654978-b715-4e20-92ea-c03310295ad5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:06.046093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc654978-b715-4e20-92ea-c03310295ad5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:06.046842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc654978-b715-4e20-92ea-c03310295ad5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:06.047297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc654978-b715-4e20-92ea-c03310295ad5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:06.047726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc654978-b715-4e20-92ea-c03310295ad5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:06.237480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc654978-b715-4e20-92ea-c03310295ad5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:06.246408 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bc654978-b715-4e20-92ea-c03310295ad5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1547 microversion: 2.1 time: 0.218186 Oct 11 04:34:06.246984 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2661/5079] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:06 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1547 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:06.252597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f09635ee-563b-4933-93f9-a7dd15e2e7e3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:06.261593 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f09635ee-563b-4933-93f9-a7dd15e2e7e3 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1508 microversion: 2.1 time: 0.333840 Oct 11 04:34:06.262988 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2419/5080] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:05 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1508 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:06.949798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-da0399e2-78c0-4616-8c54-441a62b977dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:06.951267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-da0399e2-78c0-4616-8c54-441a62b977dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:06.963366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0399e2-78c0-4616-8c54-441a62b977dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:06.964662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0399e2-78c0-4616-8c54-441a62b977dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:06.966175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0399e2-78c0-4616-8c54-441a62b977dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:06.967468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0399e2-78c0-4616-8c54-441a62b977dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:06.968211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0399e2-78c0-4616-8c54-441a62b977dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:06.969002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0399e2-78c0-4616-8c54-441a62b977dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:07.185309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da0399e2-78c0-4616-8c54-441a62b977dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:07.199964 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-da0399e2-78c0-4616-8c54-441a62b977dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1292 microversion: 2.1 time: 0.254691 Oct 11 04:34:07.200977 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2662/5081] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:06 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1292 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:07.290831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7771f682-6804-43d9-9a7a-5d95350827c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:07.297513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7771f682-6804-43d9-9a7a-5d95350827c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:07.305089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7771f682-6804-43d9-9a7a-5d95350827c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:07.305607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7771f682-6804-43d9-9a7a-5d95350827c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:07.306063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7771f682-6804-43d9-9a7a-5d95350827c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:07.308977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7771f682-6804-43d9-9a7a-5d95350827c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:07.309477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7771f682-6804-43d9-9a7a-5d95350827c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:07.309910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7771f682-6804-43d9-9a7a-5d95350827c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:07.352495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-58691a2e-da75-4118-b4c5-4e91f2057bc5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-63198605", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "destination_type": "local"}, {"source_type": "volume", "uuid": "d50e66ca-ef4a-4de9-b824-58a6b5ad37f6", "destination_type": "invalid"}], "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-58691a2e-da75-4118-b4c5-4e91f2057bc5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 493 Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-63198605", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "destination_type": "local"}, {"source_type": "volume", "uuid": "d50e66ca-ef4a-4de9-b824-58a6b5ad37f6", "destination_type": "invalid"}], "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-63198605', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'd50e66ca-ef4a-4de9-b824-58a6b5ad37f6', 'destination_type': 'invalid'}], 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'invalid' Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:07.357669 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-58691a2e-da75-4118-b4c5-4e91f2057bc5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:07.362051 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-58691a2e-da75-4118-b4c5-4e91f2057bc5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.011791 Oct 11 04:34:07.365175 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2663/5082] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:07 2022] POST /compute/v2.1/servers => generated 155 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:34:07.372149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cbc8a2b-02d8-4657-aeef-762b916fb2f1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:07.372780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2cbc8a2b-02d8-4657-aeef-762b916fb2f1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:07.382310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cbc8a2b-02d8-4657-aeef-762b916fb2f1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:07.386074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cbc8a2b-02d8-4657-aeef-762b916fb2f1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:07.386074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cbc8a2b-02d8-4657-aeef-762b916fb2f1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:07.386074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cbc8a2b-02d8-4657-aeef-762b916fb2f1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:07.386074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cbc8a2b-02d8-4657-aeef-762b916fb2f1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:07.386544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cbc8a2b-02d8-4657-aeef-762b916fb2f1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:07.616759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7771f682-6804-43d9-9a7a-5d95350827c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:07.644540 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7771f682-6804-43d9-9a7a-5d95350827c7 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1508 microversion: 2.1 time: 0.341776 Oct 11 04:34:07.644540 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2420/5083] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:07 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:07.720917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2cbc8a2b-02d8-4657-aeef-762b916fb2f1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:07.729053 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2cbc8a2b-02d8-4657-aeef-762b916fb2f1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.362628 Oct 11 04:34:07.729914 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2664/5084] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:07 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:07.753219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bf9085df-f56a-463e-b553-957f0380e7e5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:07.754178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bf9085df-f56a-463e-b553-957f0380e7e5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:07.760099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf9085df-f56a-463e-b553-957f0380e7e5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:07.761043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf9085df-f56a-463e-b553-957f0380e7e5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:07.761484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf9085df-f56a-463e-b553-957f0380e7e5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:07.762275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf9085df-f56a-463e-b553-957f0380e7e5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:07.762677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf9085df-f56a-463e-b553-957f0380e7e5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:07.763101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf9085df-f56a-463e-b553-957f0380e7e5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:08.224259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a29e095b-dfeb-414a-8270-13e2669e9a36 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:08.225122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a29e095b-dfeb-414a-8270-13e2669e9a36 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:08.237698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a29e095b-dfeb-414a-8270-13e2669e9a36 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:08.244347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a29e095b-dfeb-414a-8270-13e2669e9a36 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:08.245050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a29e095b-dfeb-414a-8270-13e2669e9a36 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:08.246059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a29e095b-dfeb-414a-8270-13e2669e9a36 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:08.246647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a29e095b-dfeb-414a-8270-13e2669e9a36 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:08.247173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a29e095b-dfeb-414a-8270-13e2669e9a36 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:08.521841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf9085df-f56a-463e-b553-957f0380e7e5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:08.529953 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bf9085df-f56a-463e-b553-957f0380e7e5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.781254 Oct 11 04:34:08.535090 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2421/5085] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:07 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:08.602872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f54aa14-8a5f-423b-b009-0690665c8c3c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-634441749", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f54aa14-8a5f-423b-b009-0690665c8c3c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 491 Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-634441749", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "metadata": {"a": "bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb"}, "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-634441749', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'metadata': {'a': 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb'}, 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['metadata']['patternProperties']['^[a-zA-Z0-9-_:. ]{1,255}$']: Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'maxLength': 255, 'type': 'string'} Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:08.607773 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['server']['metadata']: Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long Oct 11 04:34:08.610723 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:08.614830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f54aa14-8a5f-423b-b009-0690665c8c3c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Invalid input for field/attribute a. Value: bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb. 'bbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbbb' is too long {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:08.615950 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f54aa14-8a5f-423b-b009-0690665c8c3c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 624 microversion: 2.1 time: 0.017312 Oct 11 04:34:08.617371 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2422/5086] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:08 2022] POST /compute/v2.1/servers => generated 624 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:34:08.625718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f9641ed-9d9d-49a0-aa86-8b128ee5137f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:08.628682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9f9641ed-9d9d-49a0-aa86-8b128ee5137f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:08.637197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f9641ed-9d9d-49a0-aa86-8b128ee5137f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:08.638031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f9641ed-9d9d-49a0-aa86-8b128ee5137f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:08.639158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f9641ed-9d9d-49a0-aa86-8b128ee5137f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:08.640089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f9641ed-9d9d-49a0-aa86-8b128ee5137f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:08.640752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f9641ed-9d9d-49a0-aa86-8b128ee5137f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:08.641366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f9641ed-9d9d-49a0-aa86-8b128ee5137f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:08.865830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a29e095b-dfeb-414a-8270-13e2669e9a36 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:08.880094 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a29e095b-dfeb-414a-8270-13e2669e9a36 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1292 microversion: 2.1 time: 0.660801 Oct 11 04:34:08.881716 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2665/5087] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:08 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1292 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:08.895820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b5815cc-f163-4495-886f-6dfd66e0fdf0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:08.896779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b5815cc-f163-4495-886f-6dfd66e0fdf0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:08.906384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5815cc-f163-4495-886f-6dfd66e0fdf0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:08.906893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5815cc-f163-4495-886f-6dfd66e0fdf0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:08.907380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5815cc-f163-4495-886f-6dfd66e0fdf0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:08.913755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5815cc-f163-4495-886f-6dfd66e0fdf0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:08.914289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5815cc-f163-4495-886f-6dfd66e0fdf0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:08.914744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b5815cc-f163-4495-886f-6dfd66e0fdf0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:09.082930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9f9641ed-9d9d-49a0-aa86-8b128ee5137f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:09.090063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:09.097543 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9f9641ed-9d9d-49a0-aa86-8b128ee5137f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.476062 Oct 11 04:34:09.100702 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2423/5088] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:08 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:09.133663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0adbe12b-b8b6-4f0d-a2e9-d2733bb3c2dd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:09.134697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0adbe12b-b8b6-4f0d-a2e9-d2733bb3c2dd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:09.144541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0adbe12b-b8b6-4f0d-a2e9-d2733bb3c2dd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:09.145648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0adbe12b-b8b6-4f0d-a2e9-d2733bb3c2dd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:09.147839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0adbe12b-b8b6-4f0d-a2e9-d2733bb3c2dd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:09.149144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0adbe12b-b8b6-4f0d-a2e9-d2733bb3c2dd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:09.149846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0adbe12b-b8b6-4f0d-a2e9-d2733bb3c2dd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:09.150508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0adbe12b-b8b6-4f0d-a2e9-d2733bb3c2dd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:09.250771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b5815cc-f163-4495-886f-6dfd66e0fdf0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:09.263025 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b5815cc-f163-4495-886f-6dfd66e0fdf0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1508 microversion: 2.1 time: 0.379995 Oct 11 04:34:09.264467 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2666/5089] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:08 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1508 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:09.461286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0adbe12b-b8b6-4f0d-a2e9-d2733bb3c2dd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:09.469291 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0adbe12b-b8b6-4f0d-a2e9-d2733bb3c2dd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.342803 Oct 11 04:34:09.484982 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2424/5090] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:09 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:09.564234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-93a5b61a-ec7e-4d20-8a81-4e367ede2b2d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-93a5b61a-ec7e-4d20-8a81-4e367ede2b2d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 416 Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:09.575192 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:09.578503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-93a5b61a-ec7e-4d20-8a81-4e367ede2b2d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:09.582917 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-93a5b61a-ec7e-4d20-8a81-4e367ede2b2d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 619 microversion: 2.1 time: 0.017999 Oct 11 04:34:09.584803 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2667/5091] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:09 2022] POST /compute/v2.1/servers => generated 619 bytes in 28 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:34:09.588589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a70e3fce-dcc3-4b4c-8672-88c6ee3b7531 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:09.589748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a70e3fce-dcc3-4b4c-8672-88c6ee3b7531 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:09.598007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:09.599707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a70e3fce-dcc3-4b4c-8672-88c6ee3b7531 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:09.602796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a70e3fce-dcc3-4b4c-8672-88c6ee3b7531 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:09.606096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a70e3fce-dcc3-4b4c-8672-88c6ee3b7531 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:09.607092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a70e3fce-dcc3-4b4c-8672-88c6ee3b7531 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:09.607738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a70e3fce-dcc3-4b4c-8672-88c6ee3b7531 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:09.608831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a70e3fce-dcc3-4b4c-8672-88c6ee3b7531 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:09.774285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-0e7bd92c-b5ef-47f4-a8d5-b4d5f3591768 req-01d90768-a997-4b11-9b6f-c25341403159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60554e10-db75-4001-ad84-55060fb24729", "name": "network-vif-deleted", "tag": "7b951428-7511-42a9-9f1c-8b66d3bea718"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:09.790069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0e7bd92c-b5ef-47f4-a8d5-b4d5f3591768 req-01d90768-a997-4b11-9b6f-c25341403159 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:09.797066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0e7bd92c-b5ef-47f4-a8d5-b4d5f3591768 req-01d90768-a997-4b11-9b6f-c25341403159 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:09.797066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0e7bd92c-b5ef-47f4-a8d5-b4d5f3591768 req-01d90768-a997-4b11-9b6f-c25341403159 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:09.821390 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-0e7bd92c-b5ef-47f4-a8d5-b4d5f3591768 req-01d90768-a997-4b11-9b6f-c25341403159 service nova] Creating event network-vif-deleted:7b951428-7511-42a9-9f1c-8b66d3bea718 for instance 60554e10-db75-4001-ad84-55060fb24729 on n-h1-860892-1 Oct 11 04:34:09.828413 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-0e7bd92c-b5ef-47f4-a8d5-b4d5f3591768 req-01d90768-a997-4b11-9b6f-c25341403159 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057771 Oct 11 04:34:09.829990 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2668/5092] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:09.914628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a70e3fce-dcc3-4b4c-8672-88c6ee3b7531 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:09.917377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-912376e3-1ee5-474e-8716-38b872dff64c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:09.918718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-912376e3-1ee5-474e-8716-38b872dff64c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:09.925776 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a70e3fce-dcc3-4b4c-8672-88c6ee3b7531 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.341129 Oct 11 04:34:09.926725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912376e3-1ee5-474e-8716-38b872dff64c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:09.927663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912376e3-1ee5-474e-8716-38b872dff64c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:09.928611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912376e3-1ee5-474e-8716-38b872dff64c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:09.929570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912376e3-1ee5-474e-8716-38b872dff64c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:09.930604 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2425/5093] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:09 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:09.932008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912376e3-1ee5-474e-8716-38b872dff64c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:09.932527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-912376e3-1ee5-474e-8716-38b872dff64c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:09.956413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f0ae7c97-8d52-4657-b026-707d10431a33 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:09.957791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f0ae7c97-8d52-4657-b026-707d10431a33 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:09.969071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ae7c97-8d52-4657-b026-707d10431a33 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:09.970705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ae7c97-8d52-4657-b026-707d10431a33 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:09.971255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ae7c97-8d52-4657-b026-707d10431a33 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:09.972939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ae7c97-8d52-4657-b026-707d10431a33 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:09.978394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ae7c97-8d52-4657-b026-707d10431a33 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:09.978978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0ae7c97-8d52-4657-b026-707d10431a33 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:10.345766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f0ae7c97-8d52-4657-b026-707d10431a33 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:10.357832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-912376e3-1ee5-474e-8716-38b872dff64c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:10.364447 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f0ae7c97-8d52-4657-b026-707d10431a33 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.411389 Oct 11 04:34:10.366377 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2426/5094] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:09 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:10.374880 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-912376e3-1ee5-474e-8716-38b872dff64c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1292 microversion: 2.1 time: 0.465547 Oct 11 04:34:10.381925 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2669/5095] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:09 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1292 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:10.395938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:10.398511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:10.414297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:10.414904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:10.415437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:10.416877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:10.417841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:10.418525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:10.460284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bae73676-584e-42a9-b907-f972cdee6e86 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-825819209", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": -1, "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:10.483554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:10.484216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:10.485075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:10.485892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lazy-loading 'fault' on Instance uuid 60554e10-db75-4001-ad84-55060fb24729 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:34:10.488897 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-bae73676-584e-42a9-b907-f972cdee6e86 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Flavor -1 could not be found. Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bae73676-584e-42a9-b907-f972cdee6e86 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 205 Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-825819209", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": -1, "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: exception: Flavor -1 could not be found. Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-825819209', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': -1, 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 778, in create Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id( Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor -1 could not be found. Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:10.494371 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor -1 could not be found. Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor -1 could not be found. Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bae73676-584e-42a9-b907-f972cdee6e86 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Flavor -1 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bae73676-584e-42a9-b907-f972cdee6e86 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 73 microversion: 2.1 time: 0.041479 Oct 11 04:34:10.500407 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2670/5096] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:10 2022] POST /compute/v2.1/servers => generated 73 bytes in 43 msecs (HTTP/1.1 400) 9 headers in 380 bytes (2 switches on core 0) Oct 11 04:34:10.517659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-51312170-01d4-4620-a68f-b8fb92f754f7 req-11aa3722-e7ab-491f-b21e-b1a2f4bc7e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451260aa-21f7-42e6-b412-66610aad28ee", "name": "network-vif-plugged", "status": "completed", "tag": "90a81ee1-9aac-4772-979d-b78a8ea22a38"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:10.531961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-51312170-01d4-4620-a68f-b8fb92f754f7 req-11aa3722-e7ab-491f-b21e-b1a2f4bc7e49 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:10.533056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-51312170-01d4-4620-a68f-b8fb92f754f7 req-11aa3722-e7ab-491f-b21e-b1a2f4bc7e49 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:10.533786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-51312170-01d4-4620-a68f-b8fb92f754f7 req-11aa3722-e7ab-491f-b21e-b1a2f4bc7e49 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:10.545654 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-51312170-01d4-4620-a68f-b8fb92f754f7 req-11aa3722-e7ab-491f-b21e-b1a2f4bc7e49 service nova] Creating event network-vif-plugged:90a81ee1-9aac-4772-979d-b78a8ea22a38 for instance 451260aa-21f7-42e6-b412-66610aad28ee on n-h1-860892-1 Oct 11 04:34:10.554022 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-51312170-01d4-4620-a68f-b8fb92f754f7 req-11aa3722-e7ab-491f-b21e-b1a2f4bc7e49 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056002 Oct 11 04:34:10.554847 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2671/5097] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:10.560763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-472ad53f-6557-465e-af9b-80106e22c15c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:10.561737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-472ad53f-6557-465e-af9b-80106e22c15c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:10.567613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:10.568906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472ad53f-6557-465e-af9b-80106e22c15c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:10.569395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472ad53f-6557-465e-af9b-80106e22c15c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:10.570048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472ad53f-6557-465e-af9b-80106e22c15c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:10.570759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472ad53f-6557-465e-af9b-80106e22c15c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:10.571965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472ad53f-6557-465e-af9b-80106e22c15c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:10.571965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-472ad53f-6557-465e-af9b-80106e22c15c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:10.598239 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-25ed1963-c8a0-4ab0-b3fe-99ecdf945527 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 200 len: 1312 microversion: 2.1 time: 0.210317 Oct 11 04:34:10.598239 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2427/5098] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:10 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 1312 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:10.990452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-472ad53f-6557-465e-af9b-80106e22c15c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:11.023268 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-472ad53f-6557-465e-af9b-80106e22c15c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.466635 Oct 11 04:34:11.024103 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2672/5099] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:10 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:11.051898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-61540ff6-1434-4598-a174-8a4c8f79ff02 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:11.052850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-61540ff6-1434-4598-a174-8a4c8f79ff02 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:11.064667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61540ff6-1434-4598-a174-8a4c8f79ff02 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:11.065441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61540ff6-1434-4598-a174-8a4c8f79ff02 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:11.065970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61540ff6-1434-4598-a174-8a4c8f79ff02 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:11.067085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61540ff6-1434-4598-a174-8a4c8f79ff02 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:11.069537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61540ff6-1434-4598-a174-8a4c8f79ff02 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:11.070282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61540ff6-1434-4598-a174-8a4c8f79ff02 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:11.371232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-61540ff6-1434-4598-a174-8a4c8f79ff02 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:11.379939 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-61540ff6-1434-4598-a174-8a4c8f79ff02 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.334860 Oct 11 04:34:11.380511 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2428/5100] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:11 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:11.394227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-47988925-78b0-4104-a380-0d1e78b726cb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:11.395005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-47988925-78b0-4104-a380-0d1e78b726cb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:11.402565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47988925-78b0-4104-a380-0d1e78b726cb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:11.403124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47988925-78b0-4104-a380-0d1e78b726cb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:11.403634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47988925-78b0-4104-a380-0d1e78b726cb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:11.404331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47988925-78b0-4104-a380-0d1e78b726cb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:11.405366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47988925-78b0-4104-a380-0d1e78b726cb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:11.405366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47988925-78b0-4104-a380-0d1e78b726cb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:11.447371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-26e7b0e7-84e3-4dd2-acd9-21ed579bde1d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1834796983", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-26e7b0e7-84e3-4dd2-acd9-21ed579bde1d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 173 Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1834796983", "imageRef": -1, "flavorRef": "452", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1834796983', 'imageRef': -1, 'flavorRef': '452', 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: -1 is not valid under any of the given schemas Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'oneOf' in schema['properties']['server']['properties']['imageRef']: Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'oneOf': [{'format': 'uuid', 'type': 'string'}, Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'maxLength': 0, 'type': 'string'}]} Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi -1 Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:34:11.451961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas Oct 11 04:34:11.456587 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.459484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-26e7b0e7-84e3-4dd2-acd9-21ed579bde1d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Invalid input for field/attribute imageRef. Value: -1. -1 is not valid under any of the given schemas {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:11.460619 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-26e7b0e7-84e3-4dd2-acd9-21ed579bde1d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 145 microversion: 2.1 time: 0.017185 Oct 11 04:34:11.461702 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2429/5101] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:11 2022] POST /compute/v2.1/servers => generated 145 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:34:11.474231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09daec51-037d-49ad-b27d-16341a7e985b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:11.474956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09daec51-037d-49ad-b27d-16341a7e985b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:11.482072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09daec51-037d-49ad-b27d-16341a7e985b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:11.482694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09daec51-037d-49ad-b27d-16341a7e985b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:11.483224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09daec51-037d-49ad-b27d-16341a7e985b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:11.484062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09daec51-037d-49ad-b27d-16341a7e985b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:11.484598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09daec51-037d-49ad-b27d-16341a7e985b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:11.485086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09daec51-037d-49ad-b27d-16341a7e985b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:11.710011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09daec51-037d-49ad-b27d-16341a7e985b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:11.719147 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09daec51-037d-49ad-b27d-16341a7e985b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.248944 Oct 11 04:34:11.719935 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2430/5102] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:11 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:11.725104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:11.725942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 60554e10-db75-4001-ad84-55060fb24729] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:11.732894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:11.734260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:11.734883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:11.738853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:11.738853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:11.738853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:11.776948 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] HTTP exception thrown: Instance 60554e10-db75-4001-ad84-55060fb24729 could not be found. Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Request method failure captured: Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 HTTP/1.1 Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPEasekUZLINQ5CZWJXkMppFiFyiPz0x7d4djdvUd-asoF16cTMXmitsW8Jw6-L4ZC10T49kVSd5NZJD7qmV4ktBS-qpfyACuQOEHpQR5BigmL06KMooK58zyWV0xifCb_yIKtS4zKCvAts6lZk9Fe5iF-Yw7nZw-Mdv0pFYP_e1eeY Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75ee1246b11f4fb286baf525614515c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}] Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 820b6b6b001a46a2abd3415de0b5f29b Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 60554e10-db75-4001-ad84-55060fb24729 could not be found. Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '60554e10-db75-4001-ad84-55060fb24729'} Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60554e10-db75-4001-ad84-55060fb24729 could not be found. Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60554e10-db75-4001-ad84-55060fb24729 could not be found. Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.778519 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:11.782658 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.782658 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:11.782658 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:11.782658 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:11.782658 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:11.782658 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:11.782658 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60554e10-db75-4001-ad84-55060fb24729 could not be found. Oct 11 04:34:11.782658 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:11.784736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Returning 404 to user: Instance 60554e10-db75-4001-ad84-55060fb24729 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:11.785854 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bfe350be-2bb9-4729-9e11-a0b3ab98d7e5 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729" status: 404 len: 111 microversion: 2.1 time: 0.064727 Oct 11 04:34:11.786585 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2431/5103] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:11 2022] GET /compute/v2.1/servers/60554e10-db75-4001-ad84-55060fb24729 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:11.791888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b793b169-3214-493d-bb6b-a83fa73813c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:11.796257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b793b169-3214-493d-bb6b-a83fa73813c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:11.800634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b793b169-3214-493d-bb6b-a83fa73813c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:11.801343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b793b169-3214-493d-bb6b-a83fa73813c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:11.801984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b793b169-3214-493d-bb6b-a83fa73813c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:11.802939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b793b169-3214-493d-bb6b-a83fa73813c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:11.803453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b793b169-3214-493d-bb6b-a83fa73813c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:11.803841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b793b169-3214-493d-bb6b-a83fa73813c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:12.024924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b793b169-3214-493d-bb6b-a83fa73813c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:12.036257 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b793b169-3214-493d-bb6b-a83fa73813c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.248348 Oct 11 04:34:12.037553 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2432/5104] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:11 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:12.042966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4ed313db-8aaf-44ae-8795-26c8680f456e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:12.043695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4ed313db-8aaf-44ae-8795-26c8680f456e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:12.051888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed313db-8aaf-44ae-8795-26c8680f456e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:12.053192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed313db-8aaf-44ae-8795-26c8680f456e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:12.056125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed313db-8aaf-44ae-8795-26c8680f456e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:12.058430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed313db-8aaf-44ae-8795-26c8680f456e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:12.061143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed313db-8aaf-44ae-8795-26c8680f456e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:12.065095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ed313db-8aaf-44ae-8795-26c8680f456e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:12.099634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4ed313db-8aaf-44ae-8795-26c8680f456e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:34:12.210708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-47988925-78b0-4104-a380-0d1e78b726cb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:12.219642 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-47988925-78b0-4104-a380-0d1e78b726cb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1292 microversion: 2.1 time: 0.830041 Oct 11 04:34:12.220778 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2673/5105] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:11 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1292 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:12.225618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ba77bf20-246d-4ee0-a56f-31d2016653fd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1519445750", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:12.231151 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ba77bf20-246d-4ee0-a56f-31d2016653fd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ba77bf20-246d-4ee0-a56f-31d2016653fd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 216 Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1519445750", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"fixed_ip": "10.0.1.1", "uuid": "a-b-c-d-e-f-g-h-i-j"}]}} Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: exception: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1519445750', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'networks': [{'fixed_ip': '10.0.1.1', 'uuid': 'a-b-c-d-e-f-g-h-i-j'}]}}} Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 773, in create Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._process_networks_for_create( Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 547, in _process_networks_for_create Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi requested_networks = self._get_requested_networks( Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 447, in _get_requested_networks Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._validate_network_id( Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 396, in _validate_network_id Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:12.233223 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:12.237583 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:12.237583 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:12.237583 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:12.237583 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:12.237583 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:12.237583 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:12.237583 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) Oct 11 04:34:12.237583 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:12.238851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ba77bf20-246d-4ee0-a56f-31d2016653fd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Bad networks format: network uuid is not in proper format (a-b-c-d-e-f-g-h-i-j) {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:12.239864 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ba77bf20-246d-4ee0-a56f-31d2016653fd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 123 microversion: 2.1 time: 0.017958 Oct 11 04:34:12.242567 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2674/5106] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:12 2022] POST /compute/v2.1/servers => generated 123 bytes in 21 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:34:12.249390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bfd6324e-e424-40e3-bfe6-acbc04dac2ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:12.257431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bfd6324e-e424-40e3-bfe6-acbc04dac2ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:12.257996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd6324e-e424-40e3-bfe6-acbc04dac2ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:12.258533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd6324e-e424-40e3-bfe6-acbc04dac2ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:12.258968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd6324e-e424-40e3-bfe6-acbc04dac2ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:12.260195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd6324e-e424-40e3-bfe6-acbc04dac2ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:12.260899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd6324e-e424-40e3-bfe6-acbc04dac2ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:12.261277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd6324e-e424-40e3-bfe6-acbc04dac2ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:12.527964 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4ed313db-8aaf-44ae-8795-26c8680f456e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 204 len: 0 microversion: 2.1 time: 0.482326 Oct 11 04:34:12.534755 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2433/5107] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:34:12 2022] DELETE /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 0 bytes in 496 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:34:12.535984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bfd6324e-e424-40e3-bfe6-acbc04dac2ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:12.556116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31913045-5406-447f-bbbf-fa1babce0e1e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:12.560068 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bfd6324e-e424-40e3-bfe6-acbc04dac2ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.315154 Oct 11 04:34:12.560661 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2675/5108] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:12 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:12.576801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-31913045-5406-447f-bbbf-fa1babce0e1e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:12.597931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f1e79599-0e54-4b47-8263-7a904023bab9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:12.601723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31913045-5406-447f-bbbf-fa1babce0e1e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:12.602459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31913045-5406-447f-bbbf-fa1babce0e1e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:12.603907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31913045-5406-447f-bbbf-fa1babce0e1e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:12.607175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31913045-5406-447f-bbbf-fa1babce0e1e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:12.607920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31913045-5406-447f-bbbf-fa1babce0e1e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:12.611047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31913045-5406-447f-bbbf-fa1babce0e1e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:12.612623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f1e79599-0e54-4b47-8263-7a904023bab9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:12.621076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1e79599-0e54-4b47-8263-7a904023bab9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:12.626118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1e79599-0e54-4b47-8263-7a904023bab9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:12.626702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1e79599-0e54-4b47-8263-7a904023bab9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:12.628783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1e79599-0e54-4b47-8263-7a904023bab9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:12.629270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1e79599-0e54-4b47-8263-7a904023bab9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:12.630430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1e79599-0e54-4b47-8263-7a904023bab9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:12.913644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-31913045-5406-447f-bbbf-fa1babce0e1e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:12.928417 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-31913045-5406-447f-bbbf-fa1babce0e1e tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.387099 Oct 11 04:34:12.929015 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2434/5109] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:12 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:12.940678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8b9e11c1-d320-475a-9cbd-b249eecdf65b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Action: 'create', calling method: .version_select at 0x7fda192a2670>, body: {"keypair": {"name": "tempest-keypair-1219382750", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOeno2Ki88MKtysQJXrYCZwJ/t4Qy2pbmHIyYKc9NDrrA2uIy530T5OqFFpqO6990ZMD5SDPvihdpOF1o+6XVoY6C8uJ8FhC0mmjprCRdN/wn+Krwc7+JGEyR7UleNOTiQ=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:12.964812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8b9e11c1-d320-475a-9cbd-b249eecdf65b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Getting quotas for project 1be50887a9724000a57a65b62e36bef0. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:34:12.970967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8b9e11c1-d320-475a-9cbd-b249eecdf65b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Getting quotas for user 92eb07c3e1e044a9b306385deb784876 and project 1be50887a9724000a57a65b62e36bef0. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:34:13.027175 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8b9e11c1-d320-475a-9cbd-b249eecdf65b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.42 time: 0.096863 Oct 11 04:34:13.028751 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2435/5110] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 11 04:34:12 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 04:34:13.089323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f1e79599-0e54-4b47-8263-7a904023bab9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:13.097388 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f1e79599-0e54-4b47-8263-7a904023bab9 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.512925 Oct 11 04:34:13.097859 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2676/5111] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:12 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:13.159752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d94b2df5-7092-4b56-92cc-c9e63570a074 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1708013690", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "key_name": "tempest-key-1136223417", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:13.229352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-d94b2df5-7092-4b56-92cc-c9e63570a074 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] validate_networks() for [('970f73ec-9c49-458a-9006-bef8b5b2ed1f', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:34:13.244128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-21a83638-3581-4518-8e33-c593f261a1a4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:13.244918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-21a83638-3581-4518-8e33-c593f261a1a4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:13.258761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21a83638-3581-4518-8e33-c593f261a1a4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:13.259376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21a83638-3581-4518-8e33-c593f261a1a4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:13.259940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21a83638-3581-4518-8e33-c593f261a1a4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:13.261026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21a83638-3581-4518-8e33-c593f261a1a4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:13.261478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21a83638-3581-4518-8e33-c593f261a1a4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:13.261907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21a83638-3581-4518-8e33-c593f261a1a4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:13.524409 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d94b2df5-7092-4b56-92cc-c9e63570a074 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Invalid key_name provided. Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d94b2df5-7092-4b56-92cc-c9e63570a074 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 247 Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1708013690", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "key_name": "tempest-key-1136223417", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid key_name provided. Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1708013690', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'key_name': 'tempest-key-1136223417', 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1089, in _validate_and_build_base_options Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi key_pair = objects.KeyPair.get_by_name(context, Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 144, in get_by_name Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_keypair = cls._get_from_db(context, user_id, name) Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 126, in _get_from_db Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return _get_from_db(context, user_id, name=name) Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/keypair.py", line 40, in _get_from_db Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.KeypairNotFound(user_id=user_id, name=name) Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.KeypairNotFound: Keypair tempest-key-1136223417 not found for user 85832d32146545d79d249f533b0c652e Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:13.527068 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 807, in create Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=msg) Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid key_name provided. Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid key_name provided. Oct 11 04:34:13.530817 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:13.534699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d94b2df5-7092-4b56-92cc-c9e63570a074 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Invalid key_name provided. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:13.535810 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d94b2df5-7092-4b56-92cc-c9e63570a074 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 70 microversion: 2.1 time: 0.380682 Oct 11 04:34:13.536853 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2436/5112] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:13 2022] POST /compute/v2.1/servers => generated 70 bytes in 382 msecs (HTTP/1.1 400) 9 headers in 380 bytes (1 switches on core 0) Oct 11 04:34:13.544713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00c00b9f-0591-436f-b0ff-94de82a68294 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:13.545588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00c00b9f-0591-436f-b0ff-94de82a68294 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:13.553176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c00b9f-0591-436f-b0ff-94de82a68294 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:13.553984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c00b9f-0591-436f-b0ff-94de82a68294 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:13.554739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c00b9f-0591-436f-b0ff-94de82a68294 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:13.555637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c00b9f-0591-436f-b0ff-94de82a68294 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:13.556257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c00b9f-0591-436f-b0ff-94de82a68294 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:13.556686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00c00b9f-0591-436f-b0ff-94de82a68294 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:13.678245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-21a83638-3581-4518-8e33-c593f261a1a4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:13.688933 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-21a83638-3581-4518-8e33-c593f261a1a4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1473 microversion: 2.1 time: 0.448198 Oct 11 04:34:13.703585 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2677/5113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:13 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1473 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:13.731306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-00c00b9f-0591-436f-b0ff-94de82a68294 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:13.743839 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00c00b9f-0591-436f-b0ff-94de82a68294 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.202904 Oct 11 04:34:13.750393 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2437/5114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:13 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:13.772001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2321cb87-46f0-4325-a07b-08410948a076 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:13.772765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2321cb87-46f0-4325-a07b-08410948a076 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:13.779035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2321cb87-46f0-4325-a07b-08410948a076 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:13.779519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2321cb87-46f0-4325-a07b-08410948a076 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:13.779953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2321cb87-46f0-4325-a07b-08410948a076 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:13.780641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2321cb87-46f0-4325-a07b-08410948a076 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:13.781092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2321cb87-46f0-4325-a07b-08410948a076 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:13.781669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2321cb87-46f0-4325-a07b-08410948a076 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:13.827436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1212473199", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:13.912907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] validate_networks() for [('09b3f7b6-0734-4684-a67d-dc5b0c7e4aff', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:34:14.098831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2321cb87-46f0-4325-a07b-08410948a076 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:14.108797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:14.124473 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2321cb87-46f0-4325-a07b-08410948a076 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.355716 Oct 11 04:34:14.125199 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2678/5115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:13 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:14.136594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-162fadc7-f82e-45b4-b366-44ecad8f9234 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:14.139818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-162fadc7-f82e-45b4-b366-44ecad8f9234 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:14.156446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162fadc7-f82e-45b4-b366-44ecad8f9234 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:14.157221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162fadc7-f82e-45b4-b366-44ecad8f9234 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:14.157877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162fadc7-f82e-45b4-b366-44ecad8f9234 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:14.158871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162fadc7-f82e-45b4-b366-44ecad8f9234 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:14.159589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162fadc7-f82e-45b4-b366-44ecad8f9234 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:14.160276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162fadc7-f82e-45b4-b366-44ecad8f9234 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:14.401026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-162fadc7-f82e-45b4-b366-44ecad8f9234 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:14.413005 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-162fadc7-f82e-45b4-b366-44ecad8f9234 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.285854 Oct 11 04:34:14.416119 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2679/5116] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:14 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:14.435949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d420e1fb-4c56-49d0-b507-2d8f1d1f1a5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2138198537", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:14.481152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:34:14.483053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:34:14.483832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:34:14.484988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:34:14.485622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:34:14.504037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:14.504599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:14.505132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:14.506052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:14.506767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:14.508191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:14.535381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:34:14.540819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for user 96880360d7994e09a1fd27193d2cd152 and project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:34:14.557041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:34:14.560302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 69f275c4-7756-4009-ac0e-f0cc7412b12c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:34:14.572976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.security_group_api [None req-d420e1fb-4c56-49d0-b507-2d8f1d1f1a5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Neutron security group does_not_exist not found {{(pid=120994) validate_name /opt/stack/nova/nova/network/security_group_api.py:74}} Oct 11 04:34:14.573619 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d420e1fb-4c56-49d0-b507-2d8f1d1f1a5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Unable to find security_group with name or id 'does_not_exist' Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d420e1fb-4c56-49d0-b507-2d8f1d1f1a5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 258 Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-2138198537", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "security_groups": [{"name": "does_not_exist"}], "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: exception: Unable to find security_group with name or id 'does_not_exist' Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-2138198537', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'security_groups': [{'name': 'does_not_exist'}], 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 476, in find_resource Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.find_resource_by_id(resource, name_or_id, Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 440, in find_resource_by_id Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with id 'does_not_exist' Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 480, in find_resource Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._find_resource_by_name( Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 469, in _find_resource_by_name Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound(message=not_found_message) Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name 'does_not_exist' Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 68, in validate_name Oct 11 04:34:14.583056 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return neutronv20.find_resourceid_by_name_or_id( Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 56, in find_resourceid_by_name_or_id Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return find_resource_by_name_or_id(client, resource, name_or_id, Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/neutron/v2_0/__init__.py", line 49, in find_resource_by_name_or_id Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return client.find_resource(resource, name_or_id, project_id, Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/neutron.py", line 196, in wrapper Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ret = obj(*args, **kwargs) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/neutronclient/v2_0/client.py", line 488, in find_resource Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.NotFound( Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi neutronclient.common.exceptions.NotFound: Unable to find security_group with name or id 'does_not_exist' Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 784, in create Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._create_instance( Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1682, in _create_instance Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ) = self._validate_and_build_base_options( Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1074, in _validate_and_build_base_options Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi security_groups = self._check_requested_secgroups( Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 521, in _check_requested_secgroups Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi secgroup_uuid = security_group_api.validate_name(context, secgroup) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/network/security_group_api.py", line 75, in validate_name Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.SecurityGroupNotFound(str(e)) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.SecurityGroupNotFound: Unable to find security_group with name or id 'does_not_exist' Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 10 more times] Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 866, in create Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Unable to find security_group with name or id 'does_not_exist' Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Unable to find security_group with name or id 'does_not_exist' Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:14.587520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d420e1fb-4c56-49d0-b507-2d8f1d1f1a5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Unable to find security_group with name or id 'does_not_exist' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:14.598875 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d420e1fb-4c56-49d0-b507-2d8f1d1f1a5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 106 microversion: 2.1 time: 0.167289 Oct 11 04:34:14.598875 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2680/5117] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:14 2022] POST /compute/v2.1/servers => generated 106 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:34:14.598875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cfb19f72-05f8-447e-bf21-b36d5114fd08 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:14.598875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cfb19f72-05f8-447e-bf21-b36d5114fd08 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:14.600858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb19f72-05f8-447e-bf21-b36d5114fd08 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:14.601352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb19f72-05f8-447e-bf21-b36d5114fd08 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:14.601786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb19f72-05f8-447e-bf21-b36d5114fd08 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:14.602851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb19f72-05f8-447e-bf21-b36d5114fd08 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:14.603301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb19f72-05f8-447e-bf21-b36d5114fd08 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:14.603726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb19f72-05f8-447e-bf21-b36d5114fd08 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:14.741087 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-23397dea-2a0b-41b0-9cad-3bd9d8d8a9e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.921065 Oct 11 04:34:14.748608 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2438/5118] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:34:14.754836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e15757c-b481-4cf8-9773-cd07b0da9a8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:14.755331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8e15757c-b481-4cf8-9773-cd07b0da9a8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 69f275c4-7756-4009-ac0e-f0cc7412b12c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:14.774250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8e15757c-b481-4cf8-9773-cd07b0da9a8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 69f275c4-7756-4009-ac0e-f0cc7412b12c] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:34:14.965482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cfb19f72-05f8-447e-bf21-b36d5114fd08 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:14.973861 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cfb19f72-05f8-447e-bf21-b36d5114fd08 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.384126 Oct 11 04:34:14.990898 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2681/5119] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:14 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:15.004502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-75988d0e-9d10-44af-bd65-2040f9467c67 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:15.005306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-75988d0e-9d10-44af-bd65-2040f9467c67 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:15.013990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75988d0e-9d10-44af-bd65-2040f9467c67 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:15.018704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75988d0e-9d10-44af-bd65-2040f9467c67 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:15.018704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75988d0e-9d10-44af-bd65-2040f9467c67 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:15.018704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75988d0e-9d10-44af-bd65-2040f9467c67 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:15.018704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75988d0e-9d10-44af-bd65-2040f9467c67 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:15.018704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-75988d0e-9d10-44af-bd65-2040f9467c67 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:15.213053 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8e15757c-b481-4cf8-9773-cd07b0da9a8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/69f275c4-7756-4009-ac0e-f0cc7412b12c" status: 204 len: 0 microversion: 2.1 time: 0.463002 Oct 11 04:34:15.216202 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2439/5120] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:34:14 2022] DELETE /compute/v2.1/servers/69f275c4-7756-4009-ac0e-f0cc7412b12c => generated 0 bytes in 467 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:34:15.236086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6c47370-4352-4d2b-957b-9a5440daaf7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:15.246012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f6c47370-4352-4d2b-957b-9a5440daaf7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 69f275c4-7756-4009-ac0e-f0cc7412b12c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:15.283056 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f6c47370-4352-4d2b-957b-9a5440daaf7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6c47370-4352-4d2b-957b-9a5440daaf7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/69f275c4-7756-4009-ac0e-f0cc7412b12c HTTP/1.1 Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '69f275c4-7756-4009-ac0e-f0cc7412b12c'} Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2932, in _get_instance Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi build_req = objects.BuildRequest.get_by_instance_uuid( Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 177, in get_by_instance_uuid Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_req = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/build_request.py", line 172, in _get_by_instance_uuid_from_db Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.BuildRequestNotFound(uuid=instance_uuid) Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.BuildRequestNotFound: BuildRequest not found for instance 69f275c4-7756-4009-ac0e-f0cc7412b12c Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2944, in _get_instance Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:15.295702 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:34:15.302822 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.306117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6c47370-4352-4d2b-957b-9a5440daaf7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:15.307192 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f6c47370-4352-4d2b-957b-9a5440daaf7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/69f275c4-7756-4009-ac0e-f0cc7412b12c" status: 404 len: 111 microversion: 2.1 time: 0.084219 Oct 11 04:34:15.309121 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2440/5121] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:15 2022] GET /compute/v2.1/servers/69f275c4-7756-4009-ac0e-f0cc7412b12c => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:15.387578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-75988d0e-9d10-44af-bd65-2040f9467c67 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:15.399193 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-75988d0e-9d10-44af-bd65-2040f9467c67 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.399989 Oct 11 04:34:15.405375 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2682/5122] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:14 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:15.415261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-577449565", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "accessIPv6": "2001:2001::3", "networks": [{"uuid": "09b3f7b6-0734-4684-a67d-dc5b0c7e4aff"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:15.443362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-02d658aa-2add-4de8-85e8-61718dfa559d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:15.448048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-02d658aa-2add-4de8-85e8-61718dfa559d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: e5d18999-4811-4451-8cce-e57eca52ad26] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:15.487682 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-02d658aa-2add-4de8-85e8-61718dfa559d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance e5d18999-4811-4451-8cce-e57eca52ad26 could not be found. Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-02d658aa-2add-4de8-85e8-61718dfa559d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/e5d18999-4811-4451-8cce-e57eca52ad26 HTTP/1.1 Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance e5d18999-4811-4451-8cce-e57eca52ad26 could not be found. Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e5d18999-4811-4451-8cce-e57eca52ad26'} Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5d18999-4811-4451-8cce-e57eca52ad26 could not be found. Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5d18999-4811-4451-8cce-e57eca52ad26 could not be found. Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.490027 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:15.494591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.494591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:15.494591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:15.494591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:15.494591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:15.494591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:15.494591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5d18999-4811-4451-8cce-e57eca52ad26 could not be found. Oct 11 04:34:15.494591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:15.503967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-02d658aa-2add-4de8-85e8-61718dfa559d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance e5d18999-4811-4451-8cce-e57eca52ad26 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:15.511113 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-02d658aa-2add-4de8-85e8-61718dfa559d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e5d18999-4811-4451-8cce-e57eca52ad26" status: 404 len: 111 microversion: 2.1 time: 0.076496 Oct 11 04:34:15.513799 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2683/5123] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:34:15 2022] DELETE /compute/v2.1/servers/e5d18999-4811-4451-8cce-e57eca52ad26 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:15.588870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] validate_networks() for [('09b3f7b6-0734-4684-a67d-dc5b0c7e4aff', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:34:15.830951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b61120d-22c8-4de0-9034-15ecc00a44a0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:15.831661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b61120d-22c8-4de0-9034-15ecc00a44a0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:15.848729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b61120d-22c8-4de0-9034-15ecc00a44a0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:15.850576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b61120d-22c8-4de0-9034-15ecc00a44a0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:15.859152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b61120d-22c8-4de0-9034-15ecc00a44a0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:15.860304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b61120d-22c8-4de0-9034-15ecc00a44a0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:15.863314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b61120d-22c8-4de0-9034-15ecc00a44a0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:15.863767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b61120d-22c8-4de0-9034-15ecc00a44a0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:16.193229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b61120d-22c8-4de0-9034-15ecc00a44a0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:16.209376 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b61120d-22c8-4de0-9034-15ecc00a44a0 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.687605 Oct 11 04:34:16.209889 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2684/5124] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:15 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:16.217455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80e1d52e-7b88-4cc1-bbc8-eadc56e17c5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:16.218900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-80e1d52e-7b88-4cc1-bbc8-eadc56e17c5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:16.237775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e1d52e-7b88-4cc1-bbc8-eadc56e17c5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:16.238487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e1d52e-7b88-4cc1-bbc8-eadc56e17c5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:16.238729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e1d52e-7b88-4cc1-bbc8-eadc56e17c5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:16.240654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e1d52e-7b88-4cc1-bbc8-eadc56e17c5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:16.241119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e1d52e-7b88-4cc1-bbc8-eadc56e17c5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:16.241605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e1d52e-7b88-4cc1-bbc8-eadc56e17c5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:16.624419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80e1d52e-7b88-4cc1-bbc8-eadc56e17c5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:16.633890 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-80e1d52e-7b88-4cc1-bbc8-eadc56e17c5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.420958 Oct 11 04:34:16.635220 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2685/5125] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:16 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:16.664097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-37f37c71-e005-41b7-974e-4f3139991fc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:16.664838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-37f37c71-e005-41b7-974e-4f3139991fc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:16.674695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37f37c71-e005-41b7-974e-4f3139991fc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:16.675298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37f37c71-e005-41b7-974e-4f3139991fc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:16.675814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37f37c71-e005-41b7-974e-4f3139991fc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:16.676746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37f37c71-e005-41b7-974e-4f3139991fc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:16.677277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37f37c71-e005-41b7-974e-4f3139991fc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:16.678337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37f37c71-e005-41b7-974e-4f3139991fc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:16.972760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-37f37c71-e005-41b7-974e-4f3139991fc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:16.983855 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-37f37c71-e005-41b7-974e-4f3139991fc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.327423 Oct 11 04:34:17.002933 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2686/5126] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:16 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:17.008200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-603576cb-cde2-4a6d-82f3-c3f99753a65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:17.008949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-603576cb-cde2-4a6d-82f3-c3f99753a65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Failed to fetch instance by id 9223372036854775808 {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 04:34:17.009761 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-603576cb-cde2-4a6d-82f3-c3f99753a65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance 9223372036854775808 could not be found. Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-603576cb-cde2-4a6d-82f3-c3f99753a65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/9223372036854775808 HTTP/1.1 Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 9223372036854775808 could not be found. Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '9223372036854775808'} Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9223372036854775808 could not be found. Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9223372036854775808 could not be found. Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:17.012239 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:17.017300 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:17.017300 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:17.017300 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:17.017300 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9223372036854775808 could not be found. Oct 11 04:34:17.017300 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:17.018443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-603576cb-cde2-4a6d-82f3-c3f99753a65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance 9223372036854775808 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:17.019560 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-603576cb-cde2-4a6d-82f3-c3f99753a65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9223372036854775808" status: 404 len: 94 microversion: 2.1 time: 0.015264 Oct 11 04:34:17.020279 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2687/5127] 10.222.0.26 () {58 vars in 1188 bytes} [Tue Oct 11 04:34:17 2022] DELETE /compute/v2.1/servers/9223372036854775808 => generated 94 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:34:17.040267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ebfd3200-72ae-49a1-9ac4-6568870570c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:17.041195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ebfd3200-72ae-49a1-9ac4-6568870570c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:17.077860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebfd3200-72ae-49a1-9ac4-6568870570c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:17.081478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebfd3200-72ae-49a1-9ac4-6568870570c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:17.084151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebfd3200-72ae-49a1-9ac4-6568870570c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:17.086803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebfd3200-72ae-49a1-9ac4-6568870570c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:17.086803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebfd3200-72ae-49a1-9ac4-6568870570c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:17.089941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebfd3200-72ae-49a1-9ac4-6568870570c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:17.311363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:34:17.312973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:34:17.313676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:34:17.314325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:34:17.315795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:34:17.333983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ebfd3200-72ae-49a1-9ac4-6568870570c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:17.344363 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ebfd3200-72ae-49a1-9ac4-6568870570c6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.318618 Oct 11 04:34:17.345253 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2688/5128] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:17 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:17.357903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44781a13-3336-4434-b552-b9745f05cc1c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:17.360147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:17.360792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44781a13-3336-4434-b552-b9745f05cc1c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:17.361663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:17.363465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:17.365764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:17.366415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:17.368358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:17.377781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44781a13-3336-4434-b552-b9745f05cc1c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:17.378749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44781a13-3336-4434-b552-b9745f05cc1c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:17.379685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44781a13-3336-4434-b552-b9745f05cc1c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:17.380516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44781a13-3336-4434-b552-b9745f05cc1c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:17.381446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44781a13-3336-4434-b552-b9745f05cc1c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:17.382008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44781a13-3336-4434-b552-b9745f05cc1c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:17.410095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:34:17.418133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for user 96880360d7994e09a1fd27193d2cd152 and project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:34:17.442530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:34:17.445716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:34:17.554839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44781a13-3336-4434-b552-b9745f05cc1c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:17.564072 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44781a13-3336-4434-b552-b9745f05cc1c tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1521 microversion: 2.1 time: 0.217594 Oct 11 04:34:17.565460 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2689/5129] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:17 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:17.570718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-818701400", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "config_drive": true, "networks": [{"uuid": "4b7a9bd4-4805-4b18-b37c-a58bd2c6d60d"}, {"port": "ce10ffc1-2e72-42f8-a990-d02439f40888", "tag": "port-1"}, {"port": "7eeb954c-49a9-44c1-99b3-9d24db3203f1", "tag": "port-2"}, {"uuid": "4e51e8c4-f814-4c4f-a7c7-8a362de719eb", "tag": "net-1"}, {"uuid": "4e51e8c4-f814-4c4f-a7c7-8a362de719eb"}, {"uuid": "0bb7e28c-2342-450d-b487-725ff2f957c3", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "0bb7e28c-2342-450d-b487-725ff2f957c3", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "a3173a71-df0b-46f8-a90f-58f339307094", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "261f8061-6a7f-4958-b15c-1780b82291c2", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "6bbae231-8fe4-4dc9-899c-a65aee73d3e5", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2050408404"}], "key_name": "tempest-keypair-1219382750", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:17.638629 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-78b84aa0-5e6e-45aa-8a46-843e8d21c7e4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.232054 Oct 11 04:34:17.644541 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2441/5130] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2239 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:34:17.649796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3684eb9c-ad52-47fb-8377-877611279fab tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:17.654737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3684eb9c-ad52-47fb-8377-877611279fab tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:17.664832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3684eb9c-ad52-47fb-8377-877611279fab tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:17.665561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3684eb9c-ad52-47fb-8377-877611279fab tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:17.666208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3684eb9c-ad52-47fb-8377-877611279fab tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:17.667107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3684eb9c-ad52-47fb-8377-877611279fab tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:17.685488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3684eb9c-ad52-47fb-8377-877611279fab tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:17.685488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3684eb9c-ad52-47fb-8377-877611279fab tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:17.734314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] validate_networks() for [('4b7a9bd4-4805-4b18-b37c-a58bd2c6d60d', None, None, None, None, None), (None, None, 'ce10ffc1-2e72-42f8-a990-d02439f40888', None, None, None), (None, None, '7eeb954c-49a9-44c1-99b3-9d24db3203f1', None, None, None), ('4e51e8c4-f814-4c4f-a7c7-8a362de719eb', None, None, None, None, None), ('4e51e8c4-f814-4c4f-a7c7-8a362de719eb', None, None, None, None, None), ('0bb7e28c-2342-450d-b487-725ff2f957c3', '10.2.2.100', None, None, None, None), ('0bb7e28c-2342-450d-b487-725ff2f957c3', '10.2.2.200', None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:34:17.989157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3684eb9c-ad52-47fb-8377-877611279fab tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:17.999018 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3684eb9c-ad52-47fb-8377-877611279fab tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.353159 Oct 11 04:34:18.014360 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2442/5131] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:17 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:18.023955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cf57d1c8-f466-4b46-8fa2-6673505c3a6b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:18.024587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf57d1c8-f466-4b46-8fa2-6673505c3a6b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:18.037577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=2,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:18.208145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cf57d1c8-f466-4b46-8fa2-6673505c3a6b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:18.224937 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cf57d1c8-f466-4b46-8fa2-6673505c3a6b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1220 microversion: 2.1 time: 0.208590 Oct 11 04:34:18.225050 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2443/5132] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:18 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1220 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:18.232177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-789fece6-3bb6-4ce3-9e62-e421895c41b8 req-411e4336-e700-4e19-88a4-ecd13caabfb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aed25f7-59d6-49de-b699-3581739f0edd", "name": "network-vif-deleted", "tag": "69a50552-a0f9-4376-a687-65ec01566f02"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:18.276481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-789fece6-3bb6-4ce3-9e62-e421895c41b8 req-411e4336-e700-4e19-88a4-ecd13caabfb6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:18.280848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-789fece6-3bb6-4ce3-9e62-e421895c41b8 req-411e4336-e700-4e19-88a4-ecd13caabfb6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:18.287492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-789fece6-3bb6-4ce3-9e62-e421895c41b8 req-411e4336-e700-4e19-88a4-ecd13caabfb6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:18.317315 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-789fece6-3bb6-4ce3-9e62-e421895c41b8 req-411e4336-e700-4e19-88a4-ecd13caabfb6 service nova] Creating event network-vif-deleted:69a50552-a0f9-4376-a687-65ec01566f02 for instance 7aed25f7-59d6-49de-b699-3581739f0edd on n-h1-860892-1 Oct 11 04:34:18.323166 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-789fece6-3bb6-4ce3-9e62-e421895c41b8 req-411e4336-e700-4e19-88a4-ecd13caabfb6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096871 Oct 11 04:34:18.324224 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2444/5133] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:18.329574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a6a47445-ffc7-4158-8d8e-69f5ffe40185 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:18.336694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a6a47445-ffc7-4158-8d8e-69f5ffe40185 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Failed to fetch instance by id -1 {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2981}} Oct 11 04:34:18.336694 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-a6a47445-ffc7-4158-8d8e-69f5ffe40185 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance -1 could not be found. Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a6a47445-ffc7-4158-8d8e-69f5ffe40185 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/-1 HTTP/1.1 Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance -1 could not be found. Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '-1'} Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2982, in get Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_id) Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance -1 could not be found. Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance -1 could not be found. Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:18.337349 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:18.341975 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:18.341975 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:18.341975 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance -1 could not be found. Oct 11 04:34:18.341975 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:18.341975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a6a47445-ffc7-4158-8d8e-69f5ffe40185 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance -1 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:18.341975 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a6a47445-ffc7-4158-8d8e-69f5ffe40185 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "DELETE /compute/v2.1/servers/-1" status: 404 len: 77 microversion: 2.1 time: 0.015636 Oct 11 04:34:18.341975 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2445/5134] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:34:18 2022] DELETE /compute/v2.1/servers/-1 => generated 77 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:34:18.356046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-286b1746-6311-4c07-9cbd-9a2c2ee8e13a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:18.356801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-286b1746-6311-4c07-9cbd-9a2c2ee8e13a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:18.389593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-286b1746-6311-4c07-9cbd-9a2c2ee8e13a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:18.390174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-286b1746-6311-4c07-9cbd-9a2c2ee8e13a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:18.390651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-286b1746-6311-4c07-9cbd-9a2c2ee8e13a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:18.391416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-286b1746-6311-4c07-9cbd-9a2c2ee8e13a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:18.392187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-286b1746-6311-4c07-9cbd-9a2c2ee8e13a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:18.392620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-286b1746-6311-4c07-9cbd-9a2c2ee8e13a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:18.587321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-286b1746-6311-4c07-9cbd-9a2c2ee8e13a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:18.606475 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-286b1746-6311-4c07-9cbd-9a2c2ee8e13a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.259308 Oct 11 04:34:18.608889 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2446/5135] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:18 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:18.647429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:18.657164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:18.657164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:18.657577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:18.657701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:18.658695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:18.659606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:18.660396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:18.736385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:18.737619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:18.738100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:18.746978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lazy-loading 'fault' on Instance uuid 7aed25f7-59d6-49de-b699-3581739f0edd {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:34:18.817308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820b6b6b001a46a2abd3415de0b5f29b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75ee1246b11f4fb286baf525614515c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:18.819840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:18.827337 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f914a9f-5f31-4814-8831-05e45b99b23a tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 200 len: 1311 microversion: 2.1 time: 0.215972 Oct 11 04:34:18.845846 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2447/5136] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:18 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 1311 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:18.858170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6398df74-7239-48dd-aabd-7b845dce5d4d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:18.858995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6398df74-7239-48dd-aabd-7b845dce5d4d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:18.866997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6398df74-7239-48dd-aabd-7b845dce5d4d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:18.867717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6398df74-7239-48dd-aabd-7b845dce5d4d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:18.868309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6398df74-7239-48dd-aabd-7b845dce5d4d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:18.869179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6398df74-7239-48dd-aabd-7b845dce5d4d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:18.869785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6398df74-7239-48dd-aabd-7b845dce5d4d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:18.870464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6398df74-7239-48dd-aabd-7b845dce5d4d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:19.159003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6398df74-7239-48dd-aabd-7b845dce5d4d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:19.169209 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6398df74-7239-48dd-aabd-7b845dce5d4d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.321993 Oct 11 04:34:19.170014 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2448/5137] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:18 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:19.196015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f36d569d-6cc1-47fe-8df7-30cbde9ff33d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"forceDelete": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:19.196678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f36d569d-6cc1-47fe-8df7-30cbde9ff33d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 61855615-4199-46ae-94f3-2c20d46c60ea] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:19.206359 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f36d569d-6cc1-47fe-8df7-30cbde9ff33d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance 61855615-4199-46ae-94f3-2c20d46c60ea could not be found. Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f36d569d-6cc1-47fe-8df7-30cbde9ff33d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/61855615-4199-46ae-94f3-2c20d46c60ea/action HTTP/1.1 Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 19 Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: {"forceDelete": {}} Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 61855615-4199-46ae-94f3-2c20d46c60ea could not be found. Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '61855615-4199-46ae-94f3-2c20d46c60ea', 'body': {'forceDelete': {}}} Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61855615-4199-46ae-94f3-2c20d46c60ea could not be found. Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 55, in _force_delete Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61855615-4199-46ae-94f3-2c20d46c60ea could not be found. Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:19.225764 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:19.230699 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:19.230699 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:19.230699 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61855615-4199-46ae-94f3-2c20d46c60ea could not be found. Oct 11 04:34:19.230699 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.234433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f36d569d-6cc1-47fe-8df7-30cbde9ff33d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance 61855615-4199-46ae-94f3-2c20d46c60ea could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:19.242388 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f36d569d-6cc1-47fe-8df7-30cbde9ff33d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/61855615-4199-46ae-94f3-2c20d46c60ea/action" status: 404 len: 111 microversion: 2.1 time: 0.046226 Oct 11 04:34:19.242388 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2449/5138] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:19 2022] POST /compute/v2.1/servers/61855615-4199-46ae-94f3-2c20d46c60ea/action => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:19.251115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2e1552fd-c1bd-4ce7-9295-8cdbbb0242f7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:19.253387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2e1552fd-c1bd-4ce7-9295-8cdbbb0242f7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:19.266328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e1552fd-c1bd-4ce7-9295-8cdbbb0242f7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:19.267971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e1552fd-c1bd-4ce7-9295-8cdbbb0242f7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:19.268445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e1552fd-c1bd-4ce7-9295-8cdbbb0242f7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:19.269245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e1552fd-c1bd-4ce7-9295-8cdbbb0242f7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:19.271058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e1552fd-c1bd-4ce7-9295-8cdbbb0242f7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:19.271638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e1552fd-c1bd-4ce7-9295-8cdbbb0242f7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:19.527885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2e1552fd-c1bd-4ce7-9295-8cdbbb0242f7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:19.544057 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2e1552fd-c1bd-4ce7-9295-8cdbbb0242f7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.300305 Oct 11 04:34:19.551319 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2450/5139] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:19 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:19.556921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b8f04e4-4273-4b0d-9177-9feac808ebb7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:19.557944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b8f04e4-4273-4b0d-9177-9feac808ebb7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:19.564702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b8f04e4-4273-4b0d-9177-9feac808ebb7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:19.565499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b8f04e4-4273-4b0d-9177-9feac808ebb7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:19.566085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b8f04e4-4273-4b0d-9177-9feac808ebb7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:19.567138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b8f04e4-4273-4b0d-9177-9feac808ebb7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:19.567958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b8f04e4-4273-4b0d-9177-9feac808ebb7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:19.568389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b8f04e4-4273-4b0d-9177-9feac808ebb7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:19.641187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b8f04e4-4273-4b0d-9177-9feac808ebb7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:19.654896 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b8f04e4-4273-4b0d-9177-9feac808ebb7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1216 microversion: 2.1 time: 0.101874 Oct 11 04:34:19.656267 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2451/5140] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:19 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1216 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:19.661558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-348f1066-b9a7-418b-8273-e38fdbd009e8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:19.662543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-348f1066-b9a7-418b-8273-e38fdbd009e8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:19.670748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-348f1066-b9a7-418b-8273-e38fdbd009e8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:19.671469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-348f1066-b9a7-418b-8273-e38fdbd009e8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:19.672208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-348f1066-b9a7-418b-8273-e38fdbd009e8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:19.673107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-348f1066-b9a7-418b-8273-e38fdbd009e8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:19.673720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-348f1066-b9a7-418b-8273-e38fdbd009e8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:19.674423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-348f1066-b9a7-418b-8273-e38fdbd009e8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:19.880608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-348f1066-b9a7-418b-8273-e38fdbd009e8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:19.891170 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-348f1066-b9a7-418b-8273-e38fdbd009e8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.233460 Oct 11 04:34:19.891998 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2452/5141] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:19 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:19.913161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:19.913752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] [instance: 7aed25f7-59d6-49de-b699-3581739f0edd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:19.919914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:19.920867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:19.921318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:19.922025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:19.922518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:19.923001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:19.939481 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] HTTP exception thrown: Instance 7aed25f7-59d6-49de-b699-3581739f0edd could not be found. Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Request method failure captured: Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd HTTP/1.1 Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPEasekUZLINQ5CZWJXkMppFiFyiPz0x7d4djdvUd-asoF16cTMXmitsW8Jw6-L4ZC10T49kVSd5NZJD7qmV4ktBS-qpfyACuQOEHpQR5BigmL06KMooK58zyWV0xifCb_yIKtS4zKCvAts6lZk9Fe5iF-Yw7nZw-Mdv0pFYP_e1eeY Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_75ee1246b11f4fb286baf525614515c5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/75ee1246b11f4fb286baf525614515c5"}]}] Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 75ee1246b11f4fb286baf525614515c5 Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-183739171 Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 820b6b6b001a46a2abd3415de0b5f29b Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerRescueNegativeTestJSON-183739171-project Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 7aed25f7-59d6-49de-b699-3581739f0edd could not be found. Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '7aed25f7-59d6-49de-b699-3581739f0edd'} Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aed25f7-59d6-49de-b699-3581739f0edd could not be found. Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aed25f7-59d6-49de-b699-3581739f0edd could not be found. Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.941830 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:19.946299 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.946299 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:19.946299 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:19.946299 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:19.946299 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:19.946299 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:19.946299 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aed25f7-59d6-49de-b699-3581739f0edd could not be found. Oct 11 04:34:19.946299 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.946299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] Returning 404 to user: Instance 7aed25f7-59d6-49de-b699-3581739f0edd could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:19.946299 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ebcd4210-0aa9-4a11-bc58-ca404d61f1d4 tempest-ServerRescueNegativeTestJSON-183739171 tempest-ServerRescueNegativeTestJSON-183739171-project] 10.222.0.26 "GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd" status: 404 len: 111 microversion: 2.1 time: 0.050753 Oct 11 04:34:19.946299 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2453/5142] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:19 2022] GET /compute/v2.1/servers/7aed25f7-59d6-49de-b699-3581739f0edd => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:19.949018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bc64bf68-20a0-442e-8959-e444016ed1da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {"length": 10}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:19.951480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bc64bf68-20a0-442e-8959-e444016ed1da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: d5f6809c-0748-47f8-b57b-ad4997387ff6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:19.957658 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-bc64bf68-20a0-442e-8959-e444016ed1da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance d5f6809c-0748-47f8-b57b-ad4997387ff6 could not be found. Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bc64bf68-20a0-442e-8959-e444016ed1da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/d5f6809c-0748-47f8-b57b-ad4997387ff6/action HTTP/1.1 Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 39 Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: {"os-getConsoleOutput": {"length": 10}} Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance d5f6809c-0748-47f8-b57b-ad4997387ff6 could not be found. Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'd5f6809c-0748-47f8-b57b-ad4997387ff6', 'body': {'os-getConsoleOutput': {'length': 10}}} Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d5f6809c-0748-47f8-b57b-ad4997387ff6 could not be found. Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/console_output.py", line 41, in get_console_output Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d5f6809c-0748-47f8-b57b-ad4997387ff6 could not be found. Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.966125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:19.973805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:19.973805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:19.973805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:19.973805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:19.973805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d5f6809c-0748-47f8-b57b-ad4997387ff6 could not be found. Oct 11 04:34:19.973805 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:19.973805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bc64bf68-20a0-442e-8959-e444016ed1da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance d5f6809c-0748-47f8-b57b-ad4997387ff6 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:19.973805 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bc64bf68-20a0-442e-8959-e444016ed1da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/d5f6809c-0748-47f8-b57b-ad4997387ff6/action" status: 404 len: 111 microversion: 2.1 time: 0.022743 Oct 11 04:34:19.973805 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2454/5143] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:19 2022] POST /compute/v2.1/servers/d5f6809c-0748-47f8-b57b-ad4997387ff6/action => generated 111 bytes in 24 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:19.977203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5bf6e9ac-aa1c-4d54-a77c-cfae8cb35bc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:19.977811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5bf6e9ac-aa1c-4d54-a77c-cfae8cb35bc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:20.006014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bf6e9ac-aa1c-4d54-a77c-cfae8cb35bc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:20.006745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bf6e9ac-aa1c-4d54-a77c-cfae8cb35bc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:20.008160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bf6e9ac-aa1c-4d54-a77c-cfae8cb35bc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:20.010817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bf6e9ac-aa1c-4d54-a77c-cfae8cb35bc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:20.012666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bf6e9ac-aa1c-4d54-a77c-cfae8cb35bc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:20.014489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bf6e9ac-aa1c-4d54-a77c-cfae8cb35bc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:20.466305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5bf6e9ac-aa1c-4d54-a77c-cfae8cb35bc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:20.480781 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5bf6e9ac-aa1c-4d54-a77c-cfae8cb35bc7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.507290 Oct 11 04:34:20.481352 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2455/5144] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:19 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:20.508845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f6ff543-309a-49e8-980f-1b446a321f27 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:20.515961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f6ff543-309a-49e8-980f-1b446a321f27 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:20.522917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6ff543-309a-49e8-980f-1b446a321f27 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:20.525723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6ff543-309a-49e8-980f-1b446a321f27 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:20.526717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6ff543-309a-49e8-980f-1b446a321f27 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:20.527456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6ff543-309a-49e8-980f-1b446a321f27 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:20.527923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6ff543-309a-49e8-980f-1b446a321f27 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:20.528463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f6ff543-309a-49e8-980f-1b446a321f27 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:20.917445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:34:20.917939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:34:20.918369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:34:20.919310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:34:20.919795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:34:20.929605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:20.930240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:20.930910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:20.931768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:20.932293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:20.932829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:20.946866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:20.953615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Getting quotas for project 1be50887a9724000a57a65b62e36bef0. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:34:20.960537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Getting quotas for user 92eb07c3e1e044a9b306385deb784876 and project 1be50887a9724000a57a65b62e36bef0. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:34:21.131208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:34:21.134395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='a3173a71-df0b-46f8-a90f-58f339307094',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='261f8061-6a7f-4958-b15c-1780b82291c2',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6bbae231-8fe4-4dc9-899c-a65aee73d3e5',volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:34:21.317666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0f6ff543-309a-49e8-980f-1b446a321f27 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:21.325777 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f6ff543-309a-49e8-980f-1b446a321f27 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.821585 Oct 11 04:34:21.326587 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2456/5145] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:20 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:21.331408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5e06340e-4add-4d65-bfe9-9e3548b84da6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:21.332015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5e06340e-4add-4d65-bfe9-9e3548b84da6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:21.345005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e06340e-4add-4d65-bfe9-9e3548b84da6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:21.345498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e06340e-4add-4d65-bfe9-9e3548b84da6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:21.345970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e06340e-4add-4d65-bfe9-9e3548b84da6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:21.346703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e06340e-4add-4d65-bfe9-9e3548b84da6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:21.347154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e06340e-4add-4d65-bfe9-9e3548b84da6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:21.347584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e06340e-4add-4d65-bfe9-9e3548b84da6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:21.458344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e06340e-4add-4d65-bfe9-9e3548b84da6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:21.467229 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5e06340e-4add-4d65-bfe9-9e3548b84da6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1278 microversion: 2.1 time: 0.139793 Oct 11 04:34:21.467830 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2457/5146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:21 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1278 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:21.477703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-097a2255-4ad0-4e18-bf96-c47fe62241d1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:21.477984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-097a2255-4ad0-4e18-bf96-c47fe62241d1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 07e59565-956c-47b1-a1b8-657dbb376617] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-097a2255-4ad0-4e18-bf96-c47fe62241d1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance 07e59565-956c-47b1-a1b8-657dbb376617 could not be found. Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-097a2255-4ad0-4e18-bf96-c47fe62241d1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/07e59565-956c-47b1-a1b8-657dbb376617 HTTP/1.1 Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 07e59565-956c-47b1-a1b8-657dbb376617 could not be found. Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '07e59565-956c-47b1-a1b8-657dbb376617'} Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07e59565-956c-47b1-a1b8-657dbb376617 could not be found. Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07e59565-956c-47b1-a1b8-657dbb376617 could not be found. Oct 11 04:34:21.488834 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07e59565-956c-47b1-a1b8-657dbb376617 could not be found. Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-097a2255-4ad0-4e18-bf96-c47fe62241d1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance 07e59565-956c-47b1-a1b8-657dbb376617 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-097a2255-4ad0-4e18-bf96-c47fe62241d1 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/07e59565-956c-47b1-a1b8-657dbb376617" status: 404 len: 111 microversion: 2.1 time: 0.021466 Oct 11 04:34:21.494499 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2458/5147] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:21 2022] GET /compute/v2.1/servers/07e59565-956c-47b1-a1b8-657dbb376617 => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:21.502723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e055f9ce-a2af-453e-a852-d2cd60d13914 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:21.503374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e055f9ce-a2af-453e-a852-d2cd60d13914 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:21.513523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e055f9ce-a2af-453e-a852-d2cd60d13914 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:21.514413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e055f9ce-a2af-453e-a852-d2cd60d13914 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:21.515013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e055f9ce-a2af-453e-a852-d2cd60d13914 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:21.516005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e055f9ce-a2af-453e-a852-d2cd60d13914 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:21.516644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e055f9ce-a2af-453e-a852-d2cd60d13914 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:21.517227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e055f9ce-a2af-453e-a852-d2cd60d13914 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:21.974058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e055f9ce-a2af-453e-a852-d2cd60d13914 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:21.981990 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e055f9ce-a2af-453e-a852-d2cd60d13914 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.483199 Oct 11 04:34:21.982629 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2459/5148] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:21 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:22.011312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cf94d139-7500-45b5-9104-94d12dcbc306 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:22.012016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf94d139-7500-45b5-9104-94d12dcbc306 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:22.018774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf94d139-7500-45b5-9104-94d12dcbc306 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:22.019584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf94d139-7500-45b5-9104-94d12dcbc306 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:22.020199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf94d139-7500-45b5-9104-94d12dcbc306 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:22.020898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf94d139-7500-45b5-9104-94d12dcbc306 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:22.021687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf94d139-7500-45b5-9104-94d12dcbc306 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:22.022416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf94d139-7500-45b5-9104-94d12dcbc306 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:22.301439 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-666e06bc-8a2d-445a-a6d1-6a7ad342f719 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.42 time: 4.734692 Oct 11 04:34:22.310331 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2690/5149] 10.222.0.26 () {62 vars in 1189 bytes} [Tue Oct 11 04:34:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 4744 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:34:22.316307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cf206f41-cb60-4086-9836-2fcee9d7ae0b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:22.316930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cf206f41-cb60-4086-9836-2fcee9d7ae0b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:22.387290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cf206f41-cb60-4086-9836-2fcee9d7ae0b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:22.397013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cf206f41-cb60-4086-9836-2fcee9d7ae0b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:22.398634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cf206f41-cb60-4086-9836-2fcee9d7ae0b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:22.400124 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cf206f41-cb60-4086-9836-2fcee9d7ae0b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1285 microversion: 2.42 time: 0.088533 Oct 11 04:34:22.410299 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2691/5150] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:22 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:22.452994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cf94d139-7500-45b5-9104-94d12dcbc306 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:22.462100 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cf94d139-7500-45b5-9104-94d12dcbc306 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.454971 Oct 11 04:34:22.462732 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2460/5151] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:22 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:22.497016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d08b7c8-952f-4f75-b828-414f0be99871 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:22.497630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4d08b7c8-952f-4f75-b828-414f0be99871 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:22.506623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d08b7c8-952f-4f75-b828-414f0be99871 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:22.507036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d08b7c8-952f-4f75-b828-414f0be99871 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:22.507651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d08b7c8-952f-4f75-b828-414f0be99871 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:22.508706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d08b7c8-952f-4f75-b828-414f0be99871 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:22.509390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d08b7c8-952f-4f75-b828-414f0be99871 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:22.509970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d08b7c8-952f-4f75-b828-414f0be99871 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:22.565003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a64f303f-677a-4bf6-8ce1-2f0f11be81ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1822186267", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a64f303f-677a-4bf6-8ce1-2f0f11be81ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 238 Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1822186267", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "accessIPv4": "1.1.1.1.1.1", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1822186267', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'accessIPv4': '1.1.1.1.1.1', 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 253, in is_ipv4 Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return bool(ipaddress.IPv4Address(instance)) Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1257, in __init__ Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1144, in _ip_int_from_string Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise AddressValueError("Expected 4 octets in %r" % ip_str) Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: Expected 4 octets in '1.1.1.1.1.1' Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '1.1.1.1.1.1' is not a 'ipv4' Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv4']: Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'format': 'ipv4', 'type': 'string'} Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi '1.1.1.1.1.1' Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:22.587425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' Oct 11 04:34:22.592301 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:22.595962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a64f303f-677a-4bf6-8ce1-2f0f11be81ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Invalid input for field/attribute accessIPv4. Value: 1.1.1.1.1.1. '1.1.1.1.1.1' is not a 'ipv4' {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:22.601379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4d08b7c8-952f-4f75-b828-414f0be99871 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:22.603559 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a64f303f-677a-4bf6-8ce1-2f0f11be81ae tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 139 microversion: 2.1 time: 0.045878 Oct 11 04:34:22.605369 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2461/5152] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:22 2022] POST /compute/v2.1/servers => generated 139 bytes in 48 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:34:22.613003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a51eca68-8fe2-4f04-8810-962fb99c4efc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:22.616724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a51eca68-8fe2-4f04-8810-962fb99c4efc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:22.616974 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4d08b7c8-952f-4f75-b828-414f0be99871 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1278 microversion: 2.1 time: 0.122382 Oct 11 04:34:22.616974 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2692/5153] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:22 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:22.625847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51eca68-8fe2-4f04-8810-962fb99c4efc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:22.626435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51eca68-8fe2-4f04-8810-962fb99c4efc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:22.627600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51eca68-8fe2-4f04-8810-962fb99c4efc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:22.628556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51eca68-8fe2-4f04-8810-962fb99c4efc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:22.629341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51eca68-8fe2-4f04-8810-962fb99c4efc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:22.629846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a51eca68-8fe2-4f04-8810-962fb99c4efc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:23.000667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a51eca68-8fe2-4f04-8810-962fb99c4efc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:23.016895 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a51eca68-8fe2-4f04-8810-962fb99c4efc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.407508 Oct 11 04:34:23.025062 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2462/5154] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:22 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:23.042428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b4936c1-1e9b-42b3-b707-159d50bdc797 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:23.043535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b4936c1-1e9b-42b3-b707-159d50bdc797 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:23.050335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b4936c1-1e9b-42b3-b707-159d50bdc797 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:23.051141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b4936c1-1e9b-42b3-b707-159d50bdc797 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:23.051908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b4936c1-1e9b-42b3-b707-159d50bdc797 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:23.056591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b4936c1-1e9b-42b3-b707-159d50bdc797 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:23.057297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b4936c1-1e9b-42b3-b707-159d50bdc797 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:23.058114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b4936c1-1e9b-42b3-b707-159d50bdc797 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:23.348342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b4936c1-1e9b-42b3-b707-159d50bdc797 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:23.365267 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b4936c1-1e9b-42b3-b707-159d50bdc797 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.326885 Oct 11 04:34:23.366965 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2693/5155] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:23 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:23.431260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d660cb5e-dc71-477a-8111-34656b405ec1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:23.432130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d660cb5e-dc71-477a-8111-34656b405ec1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:23.439777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49138fef-76e4-41bb-9e6a-1c7c824a6a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-689548492", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49138fef-76e4-41bb-9e6a-1c7c824a6a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 234 Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-689548492", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "accessIPv6": "notvalid", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-689548492', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'accessIPv6': 'notvalid', 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 263, in check Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = func(instance) Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/_format.py", line 260, in is_ipv6 Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi address = ipaddress.IPv6Address(instance) Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1844, in __init__ Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._ip = self._ip_int_from_string(addr_str) Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3.8/ipaddress.py", line 1581, in _ip_int_from_string Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise AddressValueError(msg) Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi ipaddress.AddressValueError: At least 3 parts expected in 'notvalid' Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi The above exception was the direct cause of the following exception: Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'notvalid' is not a 'ipv6' Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'format' in schema['properties']['server']['properties']['accessIPv6']: Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'format': 'ipv6', 'type': 'string'} Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'notvalid' Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:23.446639 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' Oct 11 04:34:23.451496 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:23.459557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-49138fef-76e4-41bb-9e6a-1c7c824a6a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Invalid input for field/attribute accessIPv6. Value: notvalid. 'notvalid' is not a 'ipv6' {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:23.462012 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-49138fef-76e4-41bb-9e6a-1c7c824a6a2f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 133 microversion: 2.1 time: 0.032347 Oct 11 04:34:23.467900 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2694/5156] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:23 2022] POST /compute/v2.1/servers => generated 133 bytes in 34 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:34:23.474971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a28891ba-aacd-4839-a7c0-df5c06b0a73b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:23.475999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a28891ba-aacd-4839-a7c0-df5c06b0a73b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:23.484882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28891ba-aacd-4839-a7c0-df5c06b0a73b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:23.485989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28891ba-aacd-4839-a7c0-df5c06b0a73b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:23.487618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28891ba-aacd-4839-a7c0-df5c06b0a73b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:23.489221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28891ba-aacd-4839-a7c0-df5c06b0a73b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:23.490014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28891ba-aacd-4839-a7c0-df5c06b0a73b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:23.490654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a28891ba-aacd-4839-a7c0-df5c06b0a73b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:23.599637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d660cb5e-dc71-477a-8111-34656b405ec1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:23.612035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d660cb5e-dc71-477a-8111-34656b405ec1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:23.614665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d660cb5e-dc71-477a-8111-34656b405ec1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:23.627047 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d660cb5e-dc71-477a-8111-34656b405ec1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1285 microversion: 2.42 time: 0.191787 Oct 11 04:34:23.627047 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2463/5157] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:23 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1285 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:23.642062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f7798298-6102-43f3-a840-afea165bd0c7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:23.642702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f7798298-6102-43f3-a840-afea165bd0c7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:23.653217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7798298-6102-43f3-a840-afea165bd0c7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:23.653706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7798298-6102-43f3-a840-afea165bd0c7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:23.654698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7798298-6102-43f3-a840-afea165bd0c7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:23.655576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7798298-6102-43f3-a840-afea165bd0c7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:23.656217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7798298-6102-43f3-a840-afea165bd0c7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:23.656757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7798298-6102-43f3-a840-afea165bd0c7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:23.734598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a28891ba-aacd-4839-a7c0-df5c06b0a73b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:23.743569 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a28891ba-aacd-4839-a7c0-df5c06b0a73b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.276149 Oct 11 04:34:23.744589 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2695/5158] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:23 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:23.768399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-28f17274-cfd0-4484-a3a1-efa429754f35 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:23.769012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-28f17274-cfd0-4484-a3a1-efa429754f35 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:23.775315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28f17274-cfd0-4484-a3a1-efa429754f35 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:23.775806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28f17274-cfd0-4484-a3a1-efa429754f35 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:23.776242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28f17274-cfd0-4484-a3a1-efa429754f35 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:23.777279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28f17274-cfd0-4484-a3a1-efa429754f35 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:23.777925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28f17274-cfd0-4484-a3a1-efa429754f35 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:23.778558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28f17274-cfd0-4484-a3a1-efa429754f35 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:23.996529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f7798298-6102-43f3-a840-afea165bd0c7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:23.998266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-28f17274-cfd0-4484-a3a1-efa429754f35 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:24.006490 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f7798298-6102-43f3-a840-afea165bd0c7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1320 microversion: 2.1 time: 0.368458 Oct 11 04:34:24.007050 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-28f17274-cfd0-4484-a3a1-efa429754f35 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.242545 Oct 11 04:34:24.007496 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2696/5159] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:23 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:24.022828 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2464/5160] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:23 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1320 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:24.030462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c38452f4-7bc6-462d-97ba-44362d243a7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:24.031025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c38452f4-7bc6-462d-97ba-44362d243a7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 7891c353-b5fb-42b4-aa11-77e800f099eb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:24.036774 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-c38452f4-7bc6-462d-97ba-44362d243a7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance 7891c353-b5fb-42b4-aa11-77e800f099eb could not be found. Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c38452f4-7bc6-462d-97ba-44362d243a7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/7891c353-b5fb-42b4-aa11-77e800f099eb/action HTTP/1.1 Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 13 Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: {"pause": {}} Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 7891c353-b5fb-42b4-aa11-77e800f099eb could not be found. Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '7891c353-b5fb-42b4-aa11-77e800f099eb', 'body': {'pause': {}}} Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7891c353-b5fb-42b4-aa11-77e800f099eb could not be found. Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 36, in _pause Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7891c353-b5fb-42b4-aa11-77e800f099eb could not be found. Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:24.045553 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:24.051243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:24.051243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:24.051243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7891c353-b5fb-42b4-aa11-77e800f099eb could not be found. Oct 11 04:34:24.051243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:24.051243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c38452f4-7bc6-462d-97ba-44362d243a7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance 7891c353-b5fb-42b4-aa11-77e800f099eb could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:24.051243 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c38452f4-7bc6-462d-97ba-44362d243a7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/7891c353-b5fb-42b4-aa11-77e800f099eb/action" status: 404 len: 111 microversion: 2.1 time: 0.020719 Oct 11 04:34:24.051243 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2697/5161] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:24 2022] POST /compute/v2.1/servers/7891c353-b5fb-42b4-aa11-77e800f099eb/action => generated 111 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:34:24.056554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a0a73d9-86dc-49f9-a24d-b090422fb1e3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:24.057165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7a0a73d9-86dc-49f9-a24d-b090422fb1e3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:24.063687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a0a73d9-86dc-49f9-a24d-b090422fb1e3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:24.064168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a0a73d9-86dc-49f9-a24d-b090422fb1e3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:24.064751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a0a73d9-86dc-49f9-a24d-b090422fb1e3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:24.065866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a0a73d9-86dc-49f9-a24d-b090422fb1e3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:24.066581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a0a73d9-86dc-49f9-a24d-b090422fb1e3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:24.067122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a0a73d9-86dc-49f9-a24d-b090422fb1e3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:24.553139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6474d135-8053-43fa-9df4-068fe00fd326 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:24.555537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6474d135-8053-43fa-9df4-068fe00fd326 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:24.584514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6474d135-8053-43fa-9df4-068fe00fd326 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:24.585036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6474d135-8053-43fa-9df4-068fe00fd326 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:24.585479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6474d135-8053-43fa-9df4-068fe00fd326 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:24.586228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6474d135-8053-43fa-9df4-068fe00fd326 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:24.586678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6474d135-8053-43fa-9df4-068fe00fd326 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:24.587290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6474d135-8053-43fa-9df4-068fe00fd326 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:24.649713 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6474d135-8053-43fa-9df4-068fe00fd326 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.106905 Oct 11 04:34:24.657286 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2698/5162] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:34:24 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501/os-volume_attachments => generated 25 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 04:34:24.664051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:24.665022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:24.672857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:24.673697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:24.674971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:24.675842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:24.676451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:24.677060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:24.757964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:24.769217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:24.770701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:24.771864 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b37ff04b-5f02-438c-82a2-dc7946692e4c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1519 microversion: 2.42 time: 0.113383 Oct 11 04:34:24.786994 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2699/5163] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:24 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1519 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:24.795932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7a0a73d9-86dc-49f9-a24d-b090422fb1e3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:24.804476 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7a0a73d9-86dc-49f9-a24d-b090422fb1e3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.751719 Oct 11 04:34:24.805011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b7534bb0-47b2-4f2e-8dc2-bd56438e8cfd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:24.805161 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2465/5164] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:24 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:24.822498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b7534bb0-47b2-4f2e-8dc2-bd56438e8cfd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:24.832006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7534bb0-47b2-4f2e-8dc2-bd56438e8cfd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:24.838670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6ad4a7fb-30e8-4263-b34d-d58fec6094d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:24.838817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7534bb0-47b2-4f2e-8dc2-bd56438e8cfd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:24.838920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6ad4a7fb-30e8-4263-b34d-d58fec6094d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:24.839015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7534bb0-47b2-4f2e-8dc2-bd56438e8cfd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:24.839015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7534bb0-47b2-4f2e-8dc2-bd56438e8cfd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:24.839015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7534bb0-47b2-4f2e-8dc2-bd56438e8cfd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:24.839015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7534bb0-47b2-4f2e-8dc2-bd56438e8cfd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:24.841852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ad4a7fb-30e8-4263-b34d-d58fec6094d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:24.842389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ad4a7fb-30e8-4263-b34d-d58fec6094d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:24.842832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ad4a7fb-30e8-4263-b34d-d58fec6094d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:24.843537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ad4a7fb-30e8-4263-b34d-d58fec6094d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:24.843991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ad4a7fb-30e8-4263-b34d-d58fec6094d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:24.844421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ad4a7fb-30e8-4263-b34d-d58fec6094d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:24.874873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b7534bb0-47b2-4f2e-8dc2-bd56438e8cfd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:34:24.999491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:25.179350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6ad4a7fb-30e8-4263-b34d-d58fec6094d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:25.202688 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6ad4a7fb-30e8-4263-b34d-d58fec6094d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.373079 Oct 11 04:34:25.207036 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b7534bb0-47b2-4f2e-8dc2-bd56438e8cfd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "DELETE /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 204 len: 0 microversion: 2.1 time: 0.416986 Oct 11 04:34:25.207466 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2466/5165] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:24 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:25.209062 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2700/5166] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:34:24 2022] DELETE /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:34:25.217414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-45ae5c0a-1b9c-4f7a-b2bf-7fa76e192cf3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:25.219895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-04366ac5-2448-46f2-a9c1-8f371ac7b5a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:25.221294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-04366ac5-2448-46f2-a9c1-8f371ac7b5a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:25.222218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45ae5c0a-1b9c-4f7a-b2bf-7fa76e192cf3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:25.233897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45ae5c0a-1b9c-4f7a-b2bf-7fa76e192cf3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:25.237480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04366ac5-2448-46f2-a9c1-8f371ac7b5a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:25.238218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04366ac5-2448-46f2-a9c1-8f371ac7b5a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:25.239115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04366ac5-2448-46f2-a9c1-8f371ac7b5a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:25.240006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04366ac5-2448-46f2-a9c1-8f371ac7b5a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:25.240479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04366ac5-2448-46f2-a9c1-8f371ac7b5a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:25.240904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04366ac5-2448-46f2-a9c1-8f371ac7b5a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:25.244112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45ae5c0a-1b9c-4f7a-b2bf-7fa76e192cf3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:25.244572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45ae5c0a-1b9c-4f7a-b2bf-7fa76e192cf3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:25.245322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45ae5c0a-1b9c-4f7a-b2bf-7fa76e192cf3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:25.245765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45ae5c0a-1b9c-4f7a-b2bf-7fa76e192cf3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:25.246228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45ae5c0a-1b9c-4f7a-b2bf-7fa76e192cf3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:25.536960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-04366ac5-2448-46f2-a9c1-8f371ac7b5a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:25.545834 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-04366ac5-2448-46f2-a9c1-8f371ac7b5a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1320 microversion: 2.1 time: 0.336059 Oct 11 04:34:25.554851 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2467/5167] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:25 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1320 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:25.568605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4418c7f6-d332-4bd3-970f-b8d9695bcf95 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:25.569495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4418c7f6-d332-4bd3-970f-b8d9695bcf95 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:25.576264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4418c7f6-d332-4bd3-970f-b8d9695bcf95 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:25.577135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4418c7f6-d332-4bd3-970f-b8d9695bcf95 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:25.577726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4418c7f6-d332-4bd3-970f-b8d9695bcf95 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:25.578632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4418c7f6-d332-4bd3-970f-b8d9695bcf95 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:25.579240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4418c7f6-d332-4bd3-970f-b8d9695bcf95 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:25.579819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4418c7f6-d332-4bd3-970f-b8d9695bcf95 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:25.728549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45ae5c0a-1b9c-4f7a-b2bf-7fa76e192cf3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:25.737115 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-45ae5c0a-1b9c-4f7a-b2bf-7fa76e192cf3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1671 microversion: 2.1 time: 0.523037 Oct 11 04:34:25.738063 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2701/5168] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:25 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1671 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:25.742939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2378ec3c-4c94-4262-b9a5-28d2b7898d43 req-beb654bd-a8f9-4015-96fd-89f2e116c158 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2f3247f-ef76-46bd-ae1e-b2c1d10b0618", "tag": "35ff5000-d3e4-4425-bb05-30cf6b7bd0a4"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:25.753174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2378ec3c-4c94-4262-b9a5-28d2b7898d43 req-beb654bd-a8f9-4015-96fd-89f2e116c158 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:25.753976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2378ec3c-4c94-4262-b9a5-28d2b7898d43 req-beb654bd-a8f9-4015-96fd-89f2e116c158 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:25.754653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2378ec3c-4c94-4262-b9a5-28d2b7898d43 req-beb654bd-a8f9-4015-96fd-89f2e116c158 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:25.774419 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2378ec3c-4c94-4262-b9a5-28d2b7898d43 req-beb654bd-a8f9-4015-96fd-89f2e116c158 service nova] Creating event network-changed:35ff5000-d3e4-4425-bb05-30cf6b7bd0a4 for instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 on n-h1-860892-1 Oct 11 04:34:25.782856 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4418c7f6-d332-4bd3-970f-b8d9695bcf95 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 202 len: 0 microversion: 2.1 time: 0.226273 Oct 11 04:34:25.785792 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2378ec3c-4c94-4262-b9a5-28d2b7898d43 req-beb654bd-a8f9-4015-96fd-89f2e116c158 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046287 Oct 11 04:34:25.787243 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2468/5169] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:25 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:34:25.790219 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2702/5170] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:25.793251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3b7503b-e37d-46b1-9fd9-b56a82cdd278 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:25.794240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3b7503b-e37d-46b1-9fd9-b56a82cdd278 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:25.810073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3b7503b-e37d-46b1-9fd9-b56a82cdd278 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:25.811004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3b7503b-e37d-46b1-9fd9-b56a82cdd278 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:25.811794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3b7503b-e37d-46b1-9fd9-b56a82cdd278 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:25.812772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3b7503b-e37d-46b1-9fd9-b56a82cdd278 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:25.813434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3b7503b-e37d-46b1-9fd9-b56a82cdd278 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:25.814729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3b7503b-e37d-46b1-9fd9-b56a82cdd278 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:25.819547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:25.821373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:25.822266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:25.829736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:25.830302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:25.830826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:25.831725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:25.832175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:25.832662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:25.947577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:25.957082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:25.958920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:25.962615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-45dc5462-ee45-4e08-bc3b-3033456006aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1575 microversion: 2.42 time: 0.157470 Oct 11 04:34:25.962615 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2703/5171] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:25 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1575 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:26.044546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a3b7503b-e37d-46b1-9fd9-b56a82cdd278 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:26.052910 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3b7503b-e37d-46b1-9fd9-b56a82cdd278 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1512 microversion: 2.1 time: 0.264166 Oct 11 04:34:26.053609 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2469/5172] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:25 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1512 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:26.581824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-17ccaf29-5e1d-4c28-94d2-ea7d636c4054 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:26.582474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-17ccaf29-5e1d-4c28-94d2-ea7d636c4054 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:26.589698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ccaf29-5e1d-4c28-94d2-ea7d636c4054 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:26.592564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ccaf29-5e1d-4c28-94d2-ea7d636c4054 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:26.592564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ccaf29-5e1d-4c28-94d2-ea7d636c4054 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:26.592564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ccaf29-5e1d-4c28-94d2-ea7d636c4054 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:26.592564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ccaf29-5e1d-4c28-94d2-ea7d636c4054 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:26.592564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17ccaf29-5e1d-4c28-94d2-ea7d636c4054 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:26.761692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-94bda0b1-2c1a-4198-97f7-255f72c48394 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:26.762417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-94bda0b1-2c1a-4198-97f7-255f72c48394 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:26.770071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94bda0b1-2c1a-4198-97f7-255f72c48394 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:26.770599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94bda0b1-2c1a-4198-97f7-255f72c48394 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:26.771036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94bda0b1-2c1a-4198-97f7-255f72c48394 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:26.771742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94bda0b1-2c1a-4198-97f7-255f72c48394 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:26.772205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94bda0b1-2c1a-4198-97f7-255f72c48394 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:26.772629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94bda0b1-2c1a-4198-97f7-255f72c48394 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:26.914673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-94bda0b1-2c1a-4198-97f7-255f72c48394 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:26.922667 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-94bda0b1-2c1a-4198-97f7-255f72c48394 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1671 microversion: 2.1 time: 0.165591 Oct 11 04:34:26.923479 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2470/5173] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:26 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:26.988927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:26.989551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:26.995715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:26.997873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:26.997873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:26.997873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:26.997873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:26.998450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:27.071202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:27.081727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:27.083201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:27.084415 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c058d334-1f45-41d0-b3e3-5b6e96d20bf1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1575 microversion: 2.42 time: 0.101077 Oct 11 04:34:27.084979 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2471/5174] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:26 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1575 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:34:27.089634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90292c70-9000-4494-9b0d-72ef4a1d39e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:27.090282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90292c70-9000-4494-9b0d-72ef4a1d39e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:27.106720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90292c70-9000-4494-9b0d-72ef4a1d39e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:27.106720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90292c70-9000-4494-9b0d-72ef4a1d39e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:27.106720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90292c70-9000-4494-9b0d-72ef4a1d39e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:27.106720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90292c70-9000-4494-9b0d-72ef4a1d39e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:27.106720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90292c70-9000-4494-9b0d-72ef4a1d39e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:27.107166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90292c70-9000-4494-9b0d-72ef4a1d39e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:27.158778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-17ccaf29-5e1d-4c28-94d2-ea7d636c4054 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:27.167857 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-17ccaf29-5e1d-4c28-94d2-ea7d636c4054 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1320 microversion: 2.1 time: 0.590603 Oct 11 04:34:27.168714 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2704/5175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:26 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1320 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:27.296678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90292c70-9000-4494-9b0d-72ef4a1d39e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:27.305468 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90292c70-9000-4494-9b0d-72ef4a1d39e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1512 microversion: 2.1 time: 0.219479 Oct 11 04:34:27.306437 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2472/5176] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:27 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1512 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:27.953032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-557d0819-9464-4295-bf1b-bffe28846b12 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:27.954152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-557d0819-9464-4295-bf1b-bffe28846b12 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:27.962847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-557d0819-9464-4295-bf1b-bffe28846b12 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:27.963418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-557d0819-9464-4295-bf1b-bffe28846b12 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:27.964037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-557d0819-9464-4295-bf1b-bffe28846b12 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:27.964763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-557d0819-9464-4295-bf1b-bffe28846b12 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:27.965528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-557d0819-9464-4295-bf1b-bffe28846b12 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:27.966028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-557d0819-9464-4295-bf1b-bffe28846b12 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:28.114221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:28.115788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:28.133401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:28.156901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:28.159693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:28.160776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:28.164047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:28.166489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:28.167945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:28.278363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:28.292851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:28.294465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:28.319126 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c626a8c7-d8ec-4dda-8413-d7d66d011669 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1593 microversion: 2.42 time: 0.193207 Oct 11 04:34:28.319126 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2473/5177] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:28 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1593 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:28.319126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca84ec4e-24dd-4e05-bf6b-23e32919b8c6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:28.319126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ca84ec4e-24dd-4e05-bf6b-23e32919b8c6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:28.324027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca84ec4e-24dd-4e05-bf6b-23e32919b8c6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:28.324574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca84ec4e-24dd-4e05-bf6b-23e32919b8c6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:28.325221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca84ec4e-24dd-4e05-bf6b-23e32919b8c6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:28.326101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca84ec4e-24dd-4e05-bf6b-23e32919b8c6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:28.327676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca84ec4e-24dd-4e05-bf6b-23e32919b8c6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:28.328405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca84ec4e-24dd-4e05-bf6b-23e32919b8c6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:28.629342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-557d0819-9464-4295-bf1b-bffe28846b12 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:28.641213 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-557d0819-9464-4295-bf1b-bffe28846b12 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1671 microversion: 2.1 time: 0.698292 Oct 11 04:34:28.642770 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2705/5178] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:27 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1671 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:28.648485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4a625da8-bfe3-4583-9bb5-dddf6a1fad83 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:28.649543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4a625da8-bfe3-4583-9bb5-dddf6a1fad83 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:28.664865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a625da8-bfe3-4583-9bb5-dddf6a1fad83 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:28.665617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a625da8-bfe3-4583-9bb5-dddf6a1fad83 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:28.666311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a625da8-bfe3-4583-9bb5-dddf6a1fad83 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:28.667242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a625da8-bfe3-4583-9bb5-dddf6a1fad83 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:28.668034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a625da8-bfe3-4583-9bb5-dddf6a1fad83 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:28.668655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a625da8-bfe3-4583-9bb5-dddf6a1fad83 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:28.754575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ca84ec4e-24dd-4e05-bf6b-23e32919b8c6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:28.766593 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ca84ec4e-24dd-4e05-bf6b-23e32919b8c6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1320 microversion: 2.1 time: 0.463944 Oct 11 04:34:28.767560 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2474/5179] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:28 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1320 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:29.087706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4a625da8-bfe3-4583-9bb5-dddf6a1fad83 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:29.098339 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4a625da8-bfe3-4583-9bb5-dddf6a1fad83 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1492 microversion: 2.1 time: 0.454163 Oct 11 04:34:29.099260 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2706/5180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:28 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1492 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:29.131981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:29.133431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:29.150201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:29.151973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:29.152324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:29.153131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:29.154276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:29.154866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:29.198079 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Cannot 'pause' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state paused Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action HTTP/1.1 Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 13 Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: {"pause": {}} Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: exception: Cannot 'pause' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state paused Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '90650e13-1fd0-479b-972e-d36b6521b37f', 'body': {'pause': {}}} Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 41, in _pause Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.compute_api.pause(ctxt, server) Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90650e13-1fd0-479b-972e-d36b6521b37f in vm_state paused. Cannot pause while the instance is in this state. Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 45, in _pause Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'pause' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state paused Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:29.203840 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:29.208893 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:29.208893 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:29.208893 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:29.208893 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'pause' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state paused Oct 11 04:34:29.208893 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:29.212669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 409 to user: Cannot 'pause' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state paused {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:29.217919 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-600a1915-723e-4e28-958d-2a281907c775 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 409 len: 143 microversion: 2.1 time: 0.096184 Oct 11 04:34:29.220571 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2475/5181] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:29 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 143 bytes in 100 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:34:29.232270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c13bfd1-79d3-418f-8a3b-36d75d869e53 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:29.233038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6c13bfd1-79d3-418f-8a3b-36d75d869e53 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:29.256435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c13bfd1-79d3-418f-8a3b-36d75d869e53 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:29.257274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c13bfd1-79d3-418f-8a3b-36d75d869e53 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:29.257882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c13bfd1-79d3-418f-8a3b-36d75d869e53 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:29.258688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c13bfd1-79d3-418f-8a3b-36d75d869e53 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:29.259143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c13bfd1-79d3-418f-8a3b-36d75d869e53 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:29.259583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c13bfd1-79d3-418f-8a3b-36d75d869e53 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:29.329269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:29.329878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:29.339627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:29.340119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:29.340556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:29.341257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:29.341845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:29.342123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:29.596957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:29.612560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:29.614000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:29.615495 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-46b3a191-9581-49be-a53c-ef91d7d19ac0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1661 microversion: 2.42 time: 0.290127 Oct 11 04:34:29.616638 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2476/5182] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:29 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1661 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:34:29.641121 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6c13bfd1-79d3-418f-8a3b-36d75d869e53 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 202 len: 0 microversion: 2.1 time: 0.414916 Oct 11 04:34:29.642503 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2707/5183] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:29 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 0 bytes in 417 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:34:29.650116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-51351df7-4f75-4120-9d94-fa3ed5edf441 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:29.650827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-51351df7-4f75-4120-9d94-fa3ed5edf441 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:29.666609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51351df7-4f75-4120-9d94-fa3ed5edf441 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:29.667107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51351df7-4f75-4120-9d94-fa3ed5edf441 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:29.667549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51351df7-4f75-4120-9d94-fa3ed5edf441 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:29.668319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51351df7-4f75-4120-9d94-fa3ed5edf441 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:29.668776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51351df7-4f75-4120-9d94-fa3ed5edf441 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:29.669202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51351df7-4f75-4120-9d94-fa3ed5edf441 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:29.675407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f1ed4f0c-3f23-4ed3-acbd-b0b639f472b9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:29.675407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f1ed4f0c-3f23-4ed3-acbd-b0b639f472b9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:29.686911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1ed4f0c-3f23-4ed3-acbd-b0b639f472b9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:29.686911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1ed4f0c-3f23-4ed3-acbd-b0b639f472b9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:29.687197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1ed4f0c-3f23-4ed3-acbd-b0b639f472b9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:29.691373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1ed4f0c-3f23-4ed3-acbd-b0b639f472b9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:29.691373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1ed4f0c-3f23-4ed3-acbd-b0b639f472b9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:29.691373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1ed4f0c-3f23-4ed3-acbd-b0b639f472b9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:30.005927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51351df7-4f75-4120-9d94-fa3ed5edf441 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:30.018370 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-51351df7-4f75-4120-9d94-fa3ed5edf441 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1499 microversion: 2.1 time: 0.372009 Oct 11 04:34:30.022847 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2477/5184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:29 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1499 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:30.036684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f86e7aa2-a049-414e-9591-51045901b0ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:30.038757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f86e7aa2-a049-414e-9591-51045901b0ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:30.057005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f86e7aa2-a049-414e-9591-51045901b0ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:30.058377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f86e7aa2-a049-414e-9591-51045901b0ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:30.060162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f86e7aa2-a049-414e-9591-51045901b0ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:30.061142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f86e7aa2-a049-414e-9591-51045901b0ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:30.063480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f1ed4f0c-3f23-4ed3-acbd-b0b639f472b9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:30.065478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f86e7aa2-a049-414e-9591-51045901b0ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:30.067855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f86e7aa2-a049-414e-9591-51045901b0ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:30.078986 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f1ed4f0c-3f23-4ed3-acbd-b0b639f472b9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1604 microversion: 2.1 time: 0.412957 Oct 11 04:34:30.088039 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2708/5185] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:29 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1604 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:30.446130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f86e7aa2-a049-414e-9591-51045901b0ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:30.455169 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f86e7aa2-a049-414e-9591-51045901b0ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1320 microversion: 2.1 time: 0.430295 Oct 11 04:34:30.455826 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2478/5186] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:30 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1320 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:30.602943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5dbbfca3-1e5e-453c-b82c-dcd8a4092aee req-ee328eec-3991-4764-b72a-6589a471bb36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "999777c2-2b4b-4ae8-ab23-7709485d2501", "name": "network-vif-deleted", "tag": "a27ad975-bd5a-4090-9531-4889fbb049af"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:30.614974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5dbbfca3-1e5e-453c-b82c-dcd8a4092aee req-ee328eec-3991-4764-b72a-6589a471bb36 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:30.615614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5dbbfca3-1e5e-453c-b82c-dcd8a4092aee req-ee328eec-3991-4764-b72a-6589a471bb36 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:30.616145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5dbbfca3-1e5e-453c-b82c-dcd8a4092aee req-ee328eec-3991-4764-b72a-6589a471bb36 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:30.630573 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5dbbfca3-1e5e-453c-b82c-dcd8a4092aee req-ee328eec-3991-4764-b72a-6589a471bb36 service nova] Creating event network-vif-deleted:a27ad975-bd5a-4090-9531-4889fbb049af for instance 999777c2-2b4b-4ae8-ab23-7709485d2501 on n-h2-860892-1 Oct 11 04:34:30.639289 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5dbbfca3-1e5e-453c-b82c-dcd8a4092aee req-ee328eec-3991-4764-b72a-6589a471bb36 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038612 Oct 11 04:34:30.640363 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2709/5187] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:30.656259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:30.656259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:30.658206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:30.659387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:30.660014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:30.660950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:30.661624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:30.662211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:30.992068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:31.011755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:31.013650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:31.017958 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1bcac0fb-9cad-4a21-b537-adfe1b745d92 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1708 microversion: 2.42 time: 0.373241 Oct 11 04:34:31.018855 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2479/5188] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:30 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1708 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:31.053846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-459d8d60-d78a-4ce8-8ed4-3dafe4960ed5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:31.054594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-459d8d60-d78a-4ce8-8ed4-3dafe4960ed5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:31.058099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:31.065786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-459d8d60-d78a-4ce8-8ed4-3dafe4960ed5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:31.066563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-459d8d60-d78a-4ce8-8ed4-3dafe4960ed5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:31.067199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-459d8d60-d78a-4ce8-8ed4-3dafe4960ed5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:31.068126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-459d8d60-d78a-4ce8-8ed4-3dafe4960ed5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:31.074645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-459d8d60-d78a-4ce8-8ed4-3dafe4960ed5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:31.074645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-459d8d60-d78a-4ce8-8ed4-3dafe4960ed5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:31.118714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:31.119348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:31.128523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:31.129018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:31.130705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:31.138314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:31.138810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:31.139257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:31.188217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:31.188997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:31.190149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:31.190782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lazy-loading 'fault' on Instance uuid 999777c2-2b4b-4ae8-ab23-7709485d2501 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:34:31.287236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:31.295865 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b7892065-0806-42c0-b335-40eb3849835d tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 200 len: 1327 microversion: 2.1 time: 0.182239 Oct 11 04:34:31.318539 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2480/5189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:31 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 1327 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:31.482738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2af287b7-0e2e-4566-a829-51dc82da7f79 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:31.483214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2af287b7-0e2e-4566-a829-51dc82da7f79 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:31.489760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2af287b7-0e2e-4566-a829-51dc82da7f79 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:31.490326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2af287b7-0e2e-4566-a829-51dc82da7f79 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:31.490947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2af287b7-0e2e-4566-a829-51dc82da7f79 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:31.491838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2af287b7-0e2e-4566-a829-51dc82da7f79 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:31.492456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2af287b7-0e2e-4566-a829-51dc82da7f79 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:31.493235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2af287b7-0e2e-4566-a829-51dc82da7f79 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:31.602344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-459d8d60-d78a-4ce8-8ed4-3dafe4960ed5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:31.628741 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-459d8d60-d78a-4ce8-8ed4-3dafe4960ed5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.580925 Oct 11 04:34:31.651740 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2710/5190] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:31 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:31.660911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3dec804c-d626-4c38-abe3-427f695a738d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:31.668536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3dec804c-d626-4c38-abe3-427f695a738d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:31.693314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dec804c-d626-4c38-abe3-427f695a738d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:31.695124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dec804c-d626-4c38-abe3-427f695a738d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:31.695788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dec804c-d626-4c38-abe3-427f695a738d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:31.696906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dec804c-d626-4c38-abe3-427f695a738d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:31.697560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dec804c-d626-4c38-abe3-427f695a738d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:31.698182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3dec804c-d626-4c38-abe3-427f695a738d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:32.056792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3dec804c-d626-4c38-abe3-427f695a738d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:32.106104 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3dec804c-d626-4c38-abe3-427f695a738d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.447712 Oct 11 04:34:32.108317 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2711/5191] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:31 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:32.119483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-52fec75a-aaff-4419-a724-19fcc4ec5339 req-3ba4ba0a-c89d-4bc8-aec4-a283e922154d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f3247f-ef76-46bd-ae1e-b2c1d10b0618", "name": "network-vif-plugged", "status": "completed", "tag": "35ff5000-d3e4-4425-bb05-30cf6b7bd0a4"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:32.156105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-52fec75a-aaff-4419-a724-19fcc4ec5339 req-3ba4ba0a-c89d-4bc8-aec4-a283e922154d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:32.156520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-52fec75a-aaff-4419-a724-19fcc4ec5339 req-3ba4ba0a-c89d-4bc8-aec4-a283e922154d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:32.160134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-52fec75a-aaff-4419-a724-19fcc4ec5339 req-3ba4ba0a-c89d-4bc8-aec4-a283e922154d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:32.163821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2af287b7-0e2e-4566-a829-51dc82da7f79 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:32.176638 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2af287b7-0e2e-4566-a829-51dc82da7f79 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1320 microversion: 2.1 time: 0.695449 Oct 11 04:34:32.192995 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2481/5192] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:31 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1320 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:32.212261 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-52fec75a-aaff-4419-a724-19fcc4ec5339 req-3ba4ba0a-c89d-4bc8-aec4-a283e922154d service nova] Creating event network-vif-plugged:35ff5000-d3e4-4425-bb05-30cf6b7bd0a4 for instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 on n-h1-860892-1 Oct 11 04:34:32.217064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:32.220919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:32.224959 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-52fec75a-aaff-4419-a724-19fcc4ec5339 req-3ba4ba0a-c89d-4bc8-aec4-a283e922154d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.114180 Oct 11 04:34:32.229648 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2712/5193] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:32.240648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:32.241145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:32.242616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:32.244035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:32.255226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:32.255226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:32.255226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:32.275113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:32.297798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:32.300734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:32.301427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:32.302431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:32.303785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:32.304828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:32.335583 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7/action HTTP/1.1 Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 28 Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: {"reboot": {"type": "SOFT"}} Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'f4c2cb1d-6389-41d3-8352-730a774ff2f7', 'body': {'reboot': {'type': 'SOFT'}}} Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:32.337754 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:32.344006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:34:32.344006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:32.344006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:32.344006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:32.344006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:32.344006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:32.344006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:32.344006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:32.344006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:32.344006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:34:32.344006 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:32.357673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:32.359600 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-97904f6a-74eb-4396-8922-b1ed8d34b054 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7/action" status: 404 len: 111 microversion: 2.1 time: 0.128355 Oct 11 04:34:32.360835 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2713/5194] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:32 2022] POST /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7/action => generated 111 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:32.375625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:32.378641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:32.394043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:32.396297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:32.401462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:32.402412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:32.403460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:32.404151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:32.404859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:32.451889 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] HTTP exception thrown: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Request method failure captured: Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 HTTP/1.1 Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPF1upEjEVWRbUy2PR7AoBTg_fKJ73H7rmgS4At6biFPXPQbajm6xKtNgxnB6dXbnvJFTIFv-Ql-Ua1ANx4PBITTQ1WTmCFFJgO-3rYaBPyJ3NlyQPglizDzqL0dBhEO75PdD4Hsf4cN2KcFkLEFKhsk9U1n-mAgPTXbVv-xsMazHjc Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}] Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 22e2c72c29774424b6c603bf36318512 Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '999777c2-2b4b-4ae8-ab23-7709485d2501'} Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:32.453476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:32.459168 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:32.459168 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:32.459168 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:32.459168 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:32.459168 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:32.459168 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:34:32.459168 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:32.459168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Returning 404 to user: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:32.459168 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04ad62e7-a40d-4023-b9ad-5b63e13989a8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 404 len: 111 microversion: 2.1 time: 0.092087 Oct 11 04:34:32.459168 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2714/5195] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:32 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:32.480763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fb4770ae-79d6-4fb6-b09e-9a50d7e3d47a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:32.481411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fb4770ae-79d6-4fb6-b09e-9a50d7e3d47a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:32.497591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb4770ae-79d6-4fb6-b09e-9a50d7e3d47a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:32.498172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb4770ae-79d6-4fb6-b09e-9a50d7e3d47a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:32.498640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb4770ae-79d6-4fb6-b09e-9a50d7e3d47a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:32.499360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb4770ae-79d6-4fb6-b09e-9a50d7e3d47a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:32.499825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb4770ae-79d6-4fb6-b09e-9a50d7e3d47a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:32.500430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb4770ae-79d6-4fb6-b09e-9a50d7e3d47a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:32.700640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:32.710139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:32.719998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:32.721730 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-feea0a5c-2737-41f4-83df-69b3611080d8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1708 microversion: 2.42 time: 0.525352 Oct 11 04:34:32.722612 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2482/5196] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:32 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1708 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:32.739590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8d1abbc8-f6d1-403e-8406-b2fb98eb9c0c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '.version_select at 0x7fda1a3823a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:32.818570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fb4770ae-79d6-4fb6-b09e-9a50d7e3d47a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:32.829567 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fb4770ae-79d6-4fb6-b09e-9a50d7e3d47a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.355254 Oct 11 04:34:32.838271 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2715/5197] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:32 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:32.852319 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8d1abbc8-f6d1-403e-8406-b2fb98eb9c0c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266091918" status: 202 len: 0 microversion: 2.1 time: 0.128405 Oct 11 04:34:32.852915 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2483/5198] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:34:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1266091918 => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:34:32.854529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-87fd2676-51e7-4b06-b8cd-f1791005fbe7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:32.862127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-87fd2676-51e7-4b06-b8cd-f1791005fbe7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:32.862316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87fd2676-51e7-4b06-b8cd-f1791005fbe7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:32.862913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87fd2676-51e7-4b06-b8cd-f1791005fbe7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:32.863547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87fd2676-51e7-4b06-b8cd-f1791005fbe7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:32.864357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87fd2676-51e7-4b06-b8cd-f1791005fbe7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:32.864923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87fd2676-51e7-4b06-b8cd-f1791005fbe7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:32.865438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87fd2676-51e7-4b06-b8cd-f1791005fbe7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:33.035939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-87fd2676-51e7-4b06-b8cd-f1791005fbe7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:33.052613 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-87fd2676-51e7-4b06-b8cd-f1791005fbe7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.194143 Oct 11 04:34:33.058808 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2716/5199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:32 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:33.071163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ba81e01-23cc-4695-aca3-1d7568edde32 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:33.073882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2ba81e01-23cc-4695-aca3-1d7568edde32 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: e101312d-2802-45e2-933f-522cd5a8816e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:33.079801 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-2ba81e01-23cc-4695-aca3-1d7568edde32 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance e101312d-2802-45e2-933f-522cd5a8816e could not be found. Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ba81e01-23cc-4695-aca3-1d7568edde32 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/e101312d-2802-45e2-933f-522cd5a8816e/action HTTP/1.1 Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 28 Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: {"reboot": {"type": "SOFT"}} Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance e101312d-2802-45e2-933f-522cd5a8816e could not be found. Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e101312d-2802-45e2-933f-522cd5a8816e', 'body': {'reboot': {'type': 'SOFT'}}} Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e101312d-2802-45e2-933f-522cd5a8816e could not be found. Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1031, in _action_reboot Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e101312d-2802-45e2-933f-522cd5a8816e could not be found. Oct 11 04:34:33.081443 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e101312d-2802-45e2-933f-522cd5a8816e could not be found. Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ba81e01-23cc-4695-aca3-1d7568edde32 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance e101312d-2802-45e2-933f-522cd5a8816e could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2ba81e01-23cc-4695-aca3-1d7568edde32 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/e101312d-2802-45e2-933f-522cd5a8816e/action" status: 404 len: 111 microversion: 2.1 time: 0.016862 Oct 11 04:34:33.086005 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2484/5200] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:33 2022] POST /compute/v2.1/servers/e101312d-2802-45e2-933f-522cd5a8816e/action => generated 111 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:33.092418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9c088bb-b4f5-4e50-ac0f-5790186ca6dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:33.093190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d9c088bb-b4f5-4e50-ac0f-5790186ca6dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:33.101199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9c088bb-b4f5-4e50-ac0f-5790186ca6dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:33.104327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9c088bb-b4f5-4e50-ac0f-5790186ca6dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:33.104327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9c088bb-b4f5-4e50-ac0f-5790186ca6dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:33.104327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9c088bb-b4f5-4e50-ac0f-5790186ca6dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:33.104327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9c088bb-b4f5-4e50-ac0f-5790186ca6dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:33.104327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9c088bb-b4f5-4e50-ac0f-5790186ca6dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:33.221928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e556ff33-4a37-487d-adac-43346ceec587 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:33.221928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e556ff33-4a37-487d-adac-43346ceec587 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:33.229478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e556ff33-4a37-487d-adac-43346ceec587 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:33.230523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e556ff33-4a37-487d-adac-43346ceec587 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:33.231197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e556ff33-4a37-487d-adac-43346ceec587 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:33.232757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e556ff33-4a37-487d-adac-43346ceec587 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:33.233479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e556ff33-4a37-487d-adac-43346ceec587 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:33.234254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e556ff33-4a37-487d-adac-43346ceec587 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:33.483864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d9c088bb-b4f5-4e50-ac0f-5790186ca6dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:33.498145 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d9c088bb-b4f5-4e50-ac0f-5790186ca6dc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.409496 Oct 11 04:34:33.499431 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2717/5201] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:33 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:33.608277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=22 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:33.676353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bbb0e9c7-35d5-44d7-95a4-5a179a5e4e51 tempest-QuotasTestJSON-1853953572 tempest-QuotasTestJSON-1853953572-project] Calling method '.version_select at 0x7fda1a038820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:33.778687 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bbb0e9c7-35d5-44d7-95a4-5a179a5e4e51 tempest-QuotasTestJSON-1853953572 tempest-QuotasTestJSON-1853953572-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/7de5d9e11cdc426fb86621585e32ade4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.277067 Oct 11 04:34:33.779956 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2718/5202] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:34:33 2022] GET /compute/v2.1/os-quota-sets/7de5d9e11cdc426fb86621585e32ade4/defaults => generated 371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:33.792103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0240278f-57ee-4d19-8bc7-ba478b39f083 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:33.794274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0240278f-57ee-4d19-8bc7-ba478b39f083 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:33.801058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0240278f-57ee-4d19-8bc7-ba478b39f083 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:33.803912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0240278f-57ee-4d19-8bc7-ba478b39f083 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:33.804712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0240278f-57ee-4d19-8bc7-ba478b39f083 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:33.805670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0240278f-57ee-4d19-8bc7-ba478b39f083 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:33.806609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0240278f-57ee-4d19-8bc7-ba478b39f083 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:33.807269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0240278f-57ee-4d19-8bc7-ba478b39f083 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:33.869643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e556ff33-4a37-487d-adac-43346ceec587 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:33.886348 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e556ff33-4a37-487d-adac-43346ceec587 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1320 microversion: 2.1 time: 0.666374 Oct 11 04:34:33.887126 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2485/5203] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:33 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1320 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:33.892640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:33.898882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:33.910461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:33.911473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:33.912077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:33.912953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:33.919012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:33.920348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:34.179657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0240278f-57ee-4d19-8bc7-ba478b39f083 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:34.190846 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0240278f-57ee-4d19-8bc7-ba478b39f083 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.407860 Oct 11 04:34:34.191422 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2719/5204] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:33 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:34.199512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7725f1f2-46e7-44da-9388-62f60d37abf8 tempest-QuotasTestJSON-1853953572 tempest-QuotasTestJSON-1853953572-project] Calling method '.version_select at 0x7fda1a038820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:34.299490 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7725f1f2-46e7-44da-9388-62f60d37abf8 tempest-QuotasTestJSON-1853953572 tempest-QuotasTestJSON-1853953572-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/7de5d9e11cdc426fb86621585e32ade4" status: 200 len: 371 microversion: 2.1 time: 0.106636 Oct 11 04:34:34.308905 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2720/5205] 10.222.0.26 () {58 vars in 1242 bytes} [Tue Oct 11 04:34:34 2022] GET /compute/v2.1/os-quota-sets/7de5d9e11cdc426fb86621585e32ade4 => generated 371 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:34.308905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:34.308905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:34.315817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:34.316370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:34.317040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:34.318222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:34.319108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:34.319873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:34.353942 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7/action HTTP/1.1 Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 65 Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'f4c2cb1d-6389-41d3-8352-730a774ff2f7', 'body': {'rebuild': {'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55'}}} Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 04:34:34.363591 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72171fc0-bff4-4fb3-a254-bf7a2bf7b9a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7/action" status: 404 len: 111 microversion: 2.1 time: 0.056737 Oct 11 04:34:34.368243 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2721/5206] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:34 2022] POST /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7/action => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:34.374475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9e3bb5af-9bd1-4e94-b44f-209b413366e7 tempest-QuotasTestJSON-1853953572 tempest-QuotasTestJSON-1853953572-project] Calling method '.version_select at 0x7fda1a0501f0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:34.410333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:34.423443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:34.425392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:34.427265 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6d179609-7835-4461-898c-04c8fdc563a9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1755 microversion: 2.42 time: 0.538713 Oct 11 04:34:34.444445 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2486/5207] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:33 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1755 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:34.456949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-86a1c902-ceeb-453c-b3cf-f64801ca92fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:34.461567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-86a1c902-ceeb-453c-b3cf-f64801ca92fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:34.466637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a1c902-ceeb-453c-b3cf-f64801ca92fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:34.467240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a1c902-ceeb-453c-b3cf-f64801ca92fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:34.468041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a1c902-ceeb-453c-b3cf-f64801ca92fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:34.469240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a1c902-ceeb-453c-b3cf-f64801ca92fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:34.469884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a1c902-ceeb-453c-b3cf-f64801ca92fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:34.470554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a1c902-ceeb-453c-b3cf-f64801ca92fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:34.493617 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9e3bb5af-9bd1-4e94-b44f-209b413366e7 tempest-QuotasTestJSON-1853953572 tempest-QuotasTestJSON-1853953572-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/7de5d9e11cdc426fb86621585e32ade4/defaults" status: 200 len: 371 microversion: 2.1 time: 0.130990 Oct 11 04:34:34.507050 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2722/5208] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:34:34 2022] GET /compute/v2.1/os-quota-sets/7de5d9e11cdc426fb86621585e32ade4/defaults => generated 371 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:34.521926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c137e8e8-b5ae-439b-a240-147b471d6e64 tempest-QuotasTestJSON-1853953572 tempest-QuotasTestJSON-1853953572-project] Calling method '.version_select at 0x7fda1a00f9d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:34.608045 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c137e8e8-b5ae-439b-a240-147b471d6e64 tempest-QuotasTestJSON-1853953572 tempest-QuotasTestJSON-1853953572-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/7de5d9e11cdc426fb86621585e32ade4" status: 200 len: 371 microversion: 2.1 time: 0.099349 Oct 11 04:34:34.608637 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2723/5209] 10.222.0.26 () {58 vars in 1242 bytes} [Tue Oct 11 04:34:34 2022] GET /compute/v2.1/os-quota-sets/7de5d9e11cdc426fb86621585e32ade4 => generated 371 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:34.620756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c112e1e8-ef5e-47d2-92d8-9f52e3d15156 tempest-QuotasTestJSON-1853953572 tempest-QuotasTestJSON-1853953572-project] Calling method '.version_select at 0x7fda193fc310>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:34.707591 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c112e1e8-ef5e-47d2-92d8-9f52e3d15156 tempest-QuotasTestJSON-1853953572 tempest-QuotasTestJSON-1853953572-project] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/7de5d9e11cdc426fb86621585e32ade4?user_id=0371e81a09774bcc982180a4335cd843" status: 200 len: 371 microversion: 2.1 time: 0.090869 Oct 11 04:34:34.710273 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2724/5210] 10.222.0.26 () {58 vars in 1323 bytes} [Tue Oct 11 04:34:34 2022] GET /compute/v2.1/os-quota-sets/7de5d9e11cdc426fb86621585e32ade4?user_id=0371e81a09774bcc982180a4335cd843 => generated 371 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:34:34.911332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-94849fbc-3eeb-44c7-9954-d8c695e0aea3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:34.912010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-94849fbc-3eeb-44c7-9954-d8c695e0aea3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:34.918246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94849fbc-3eeb-44c7-9954-d8c695e0aea3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:34.919037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94849fbc-3eeb-44c7-9954-d8c695e0aea3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:34.919484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94849fbc-3eeb-44c7-9954-d8c695e0aea3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:34.920195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94849fbc-3eeb-44c7-9954-d8c695e0aea3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:34.920659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94849fbc-3eeb-44c7-9954-d8c695e0aea3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:34.921084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94849fbc-3eeb-44c7-9954-d8c695e0aea3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:34.926235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:34.985075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-86a1c902-ceeb-453c-b3cf-f64801ca92fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:34.990782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:34.999034 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-86a1c902-ceeb-453c-b3cf-f64801ca92fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.553046 Oct 11 04:34:35.002861 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2487/5211] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:34 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:35.028628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d0b59df-5de9-4e57-a852-6dda770a16a8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:35.029685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7d0b59df-5de9-4e57-a852-6dda770a16a8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:35.046411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d0b59df-5de9-4e57-a852-6dda770a16a8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:35.048073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d0b59df-5de9-4e57-a852-6dda770a16a8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:35.048073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d0b59df-5de9-4e57-a852-6dda770a16a8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:35.049396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d0b59df-5de9-4e57-a852-6dda770a16a8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:35.050073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d0b59df-5de9-4e57-a852-6dda770a16a8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:35.050677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d0b59df-5de9-4e57-a852-6dda770a16a8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:35.212179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-94849fbc-3eeb-44c7-9954-d8c695e0aea3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:35.238590 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-94849fbc-3eeb-44c7-9954-d8c695e0aea3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1501 microversion: 2.1 time: 0.330871 Oct 11 04:34:35.239554 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2725/5212] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:34 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1501 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:35.272711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-26e7e7c4-a134-465c-9e37-f92e478b6631 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:35.275546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-26e7e7c4-a134-465c-9e37-f92e478b6631 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:35.289844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26e7e7c4-a134-465c-9e37-f92e478b6631 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:35.291803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26e7e7c4-a134-465c-9e37-f92e478b6631 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:35.292490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26e7e7c4-a134-465c-9e37-f92e478b6631 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:35.293896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26e7e7c4-a134-465c-9e37-f92e478b6631 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:35.295129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26e7e7c4-a134-465c-9e37-f92e478b6631 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:35.295981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26e7e7c4-a134-465c-9e37-f92e478b6631 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:35.466268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d0b59df-5de9-4e57-a852-6dda770a16a8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:35.474455 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d0b59df-5de9-4e57-a852-6dda770a16a8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.449727 Oct 11 04:34:35.475368 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2488/5213] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:35 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:35.497570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:35.498301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:35.505239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:35.505720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:35.506451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:35.507230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:35.507960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:35.508702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:35.649505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-26e7e7c4-a134-465c-9e37-f92e478b6631 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:35.660633 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-26e7e7c4-a134-465c-9e37-f92e478b6631 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1501 microversion: 2.1 time: 0.397206 Oct 11 04:34:35.670876 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2726/5214] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:35 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1501 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:35.670876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8bc129c7-76f2-4b34-80fc-25eb8fc81568 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:35.671940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8bc129c7-76f2-4b34-80fc-25eb8fc81568 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: a15058b0-e6d2-496f-93d0-b49957ce1a04] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:35.678767 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-8bc129c7-76f2-4b34-80fc-25eb8fc81568 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance a15058b0-e6d2-496f-93d0-b49957ce1a04 could not be found. Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8bc129c7-76f2-4b34-80fc-25eb8fc81568 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/a15058b0-e6d2-496f-93d0-b49957ce1a04/action HTTP/1.1 Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 65 Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance a15058b0-e6d2-496f-93d0-b49957ce1a04 could not be found. Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'a15058b0-e6d2-496f-93d0-b49957ce1a04', 'body': {'rebuild': {'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55'}}} Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a15058b0-e6d2-496f-93d0-b49957ce1a04 could not be found. Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 4 more times] Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1160, in _action_rebuild Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, id) Oct 11 04:34:35.682154 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a15058b0-e6d2-496f-93d0-b49957ce1a04 could not be found. Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a15058b0-e6d2-496f-93d0-b49957ce1a04 could not be found. Oct 11 04:34:35.686204 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:35.687926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8bc129c7-76f2-4b34-80fc-25eb8fc81568 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance a15058b0-e6d2-496f-93d0-b49957ce1a04 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:35.690846 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8bc129c7-76f2-4b34-80fc-25eb8fc81568 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/a15058b0-e6d2-496f-93d0-b49957ce1a04/action" status: 404 len: 111 microversion: 2.1 time: 0.025486 Oct 11 04:34:35.691830 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2727/5215] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:35 2022] POST /compute/v2.1/servers/a15058b0-e6d2-496f-93d0-b49957ce1a04/action => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:35.697118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92f21ac5-a3b3-4ee8-a360-06c4eb74da61 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:35.697633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-92f21ac5-a3b3-4ee8-a360-06c4eb74da61 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:35.703038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:35.707111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92f21ac5-a3b3-4ee8-a360-06c4eb74da61 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:35.707609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92f21ac5-a3b3-4ee8-a360-06c4eb74da61 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:35.710654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92f21ac5-a3b3-4ee8-a360-06c4eb74da61 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:35.710654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92f21ac5-a3b3-4ee8-a360-06c4eb74da61 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:35.710654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92f21ac5-a3b3-4ee8-a360-06c4eb74da61 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:35.710654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92f21ac5-a3b3-4ee8-a360-06c4eb74da61 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:35.744512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-92f21ac5-a3b3-4ee8-a360-06c4eb74da61 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:34:36.017500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:36.043414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:36.046995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:36.048996 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fcdf5cb5-9b9f-4274-b40c-374cfdfd1af7 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1755 microversion: 2.42 time: 0.556977 Oct 11 04:34:36.050126 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2489/5216] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:35 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1755 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:36.056676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-21ffec5c-b4ac-4d05-b6a5-bad8e8cdc5af tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:36.058400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-21ffec5c-b4ac-4d05-b6a5-bad8e8cdc5af tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:36.066831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:36.069517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ffec5c-b4ac-4d05-b6a5-bad8e8cdc5af tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:36.070094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ffec5c-b4ac-4d05-b6a5-bad8e8cdc5af tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:36.070813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ffec5c-b4ac-4d05-b6a5-bad8e8cdc5af tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:36.072241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ffec5c-b4ac-4d05-b6a5-bad8e8cdc5af tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:36.072708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ffec5c-b4ac-4d05-b6a5-bad8e8cdc5af tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:36.076259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21ffec5c-b4ac-4d05-b6a5-bad8e8cdc5af tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:36.100342 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-92f21ac5-a3b3-4ee8-a360-06c4eb74da61 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 204 len: 0 microversion: 2.1 time: 0.407134 Oct 11 04:34:36.101313 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2728/5217] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:34:35 2022] DELETE /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:34:36.109148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-95fe0af5-e315-4b92-b8c7-d993d722ce98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Action: 'create', calling method: .version_select at 0x7fda193e00d0>, body: {"keypair": {"name": "tempest-keypair-1508188651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF7SilcsIirPL6nidYWuaeGx4j1e+r7hLWAF7KRBOodYmGT2ZschySSMxSgVtTVUS72F60m5+vQu8Gin3YRWrjgGlTG3CkaZ33GkB4vgt4byZx2TzKP+mO2t8pglNXBOeg=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:36.134360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-95fe0af5-e315-4b92-b8c7-d993d722ce98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Getting quotas for project 483579a827a84b40b6fb4c3bd5b67360. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:34:36.139990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-95fe0af5-e315-4b92-b8c7-d993d722ce98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Getting quotas for user 22e2c72c29774424b6c603bf36318512 and project 483579a827a84b40b6fb4c3bd5b67360. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:34:36.259676 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-95fe0af5-e315-4b92-b8c7-d993d722ce98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155703 Oct 11 04:34:36.262671 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2729/5218] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:34:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:36.275401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2fbd9a4c-ac4e-4ad3-98a1-ac2e3481bcce tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:36.276500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2fbd9a4c-ac4e-4ad3-98a1-ac2e3481bcce tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:36.288264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fbd9a4c-ac4e-4ad3-98a1-ac2e3481bcce tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:36.289760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fbd9a4c-ac4e-4ad3-98a1-ac2e3481bcce tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:36.290688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fbd9a4c-ac4e-4ad3-98a1-ac2e3481bcce tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:36.292282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fbd9a4c-ac4e-4ad3-98a1-ac2e3481bcce tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:36.292843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fbd9a4c-ac4e-4ad3-98a1-ac2e3481bcce tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:36.293350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fbd9a4c-ac4e-4ad3-98a1-ac2e3481bcce tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:36.859800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2fbd9a4c-ac4e-4ad3-98a1-ac2e3481bcce tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:36.871456 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2fbd9a4c-ac4e-4ad3-98a1-ac2e3481bcce tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1507 microversion: 2.1 time: 0.606346 Oct 11 04:34:36.887826 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2730/5219] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:36 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1507 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:36.915159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-21ffec5c-b4ac-4d05-b6a5-bad8e8cdc5af tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:36.923742 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-21ffec5c-b4ac-4d05-b6a5-bad8e8cdc5af tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.871563 Oct 11 04:34:36.925561 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2490/5220] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:36 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:36.949331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4688410f-b755-4778-abb8-c24fd5f0b264 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:36.949952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4688410f-b755-4778-abb8-c24fd5f0b264 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:36.956482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4688410f-b755-4778-abb8-c24fd5f0b264 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:36.957027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4688410f-b755-4778-abb8-c24fd5f0b264 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:36.957466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4688410f-b755-4778-abb8-c24fd5f0b264 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:36.958341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4688410f-b755-4778-abb8-c24fd5f0b264 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:36.958649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4688410f-b755-4778-abb8-c24fd5f0b264 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:36.959094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4688410f-b755-4778-abb8-c24fd5f0b264 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:37.082472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:37.083096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:37.103466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:37.106538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:37.108501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:37.111195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:37.111668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:37.112729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:37.251053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4688410f-b755-4778-abb8-c24fd5f0b264 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:37.260226 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4688410f-b755-4778-abb8-c24fd5f0b264 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.314752 Oct 11 04:34:37.262569 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2731/5221] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:36 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:37.288183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-812900c1-3d15-4c1e-89b7-c8f195d875a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:37.288994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-812900c1-3d15-4c1e-89b7-c8f195d875a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 52388a3f-40bd-4fab-b826-9e99f5801e15] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:37.295389 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-812900c1-3d15-4c1e-89b7-c8f195d875a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance 52388a3f-40bd-4fab-b826-9e99f5801e15 could not be found. Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-812900c1-3d15-4c1e-89b7-c8f195d875a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/52388a3f-40bd-4fab-b826-9e99f5801e15/action HTTP/1.1 Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 15 Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: {"restore": {}} Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 52388a3f-40bd-4fab-b826-9e99f5801e15 could not be found. Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '52388a3f-40bd-4fab-b826-9e99f5801e15', 'body': {'restore': {}}} Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52388a3f-40bd-4fab-b826-9e99f5801e15 could not be found. Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 38, in _restore Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52388a3f-40bd-4fab-b826-9e99f5801e15 could not be found. Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:37.298116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:37.309987 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:37.309987 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:37.309987 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52388a3f-40bd-4fab-b826-9e99f5801e15 could not be found. Oct 11 04:34:37.309987 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:37.309987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-812900c1-3d15-4c1e-89b7-c8f195d875a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance 52388a3f-40bd-4fab-b826-9e99f5801e15 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:37.309987 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-812900c1-3d15-4c1e-89b7-c8f195d875a0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/52388a3f-40bd-4fab-b826-9e99f5801e15/action" status: 404 len: 111 microversion: 2.1 time: 0.022285 Oct 11 04:34:37.310968 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2732/5222] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:37 2022] POST /compute/v2.1/servers/52388a3f-40bd-4fab-b826-9e99f5801e15/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:34:37.317205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30252d25-8705-48ca-a40c-ff6b410e2ba4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:37.318060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30252d25-8705-48ca-a40c-ff6b410e2ba4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:37.327731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30252d25-8705-48ca-a40c-ff6b410e2ba4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:37.328695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30252d25-8705-48ca-a40c-ff6b410e2ba4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:37.329293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30252d25-8705-48ca-a40c-ff6b410e2ba4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:37.330358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30252d25-8705-48ca-a40c-ff6b410e2ba4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:37.330974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30252d25-8705-48ca-a40c-ff6b410e2ba4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:37.331560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30252d25-8705-48ca-a40c-ff6b410e2ba4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:37.499881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:37.516654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:37.532320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:37.538286 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f89e0105-47fd-4f10-a7f5-3dffc92c7f40 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1802 microversion: 2.42 time: 0.462254 Oct 11 04:34:37.538952 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2491/5223] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:37 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1802 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:37.748066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30252d25-8705-48ca-a40c-ff6b410e2ba4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:37.758285 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30252d25-8705-48ca-a40c-ff6b410e2ba4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.445992 Oct 11 04:34:37.774835 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2733/5224] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:37 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:37.787354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-edc6c8cc-4142-4730-8663-e701322301ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:37.791889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-edc6c8cc-4142-4730-8663-e701322301ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:37.796292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edc6c8cc-4142-4730-8663-e701322301ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:37.796787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edc6c8cc-4142-4730-8663-e701322301ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:37.797425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edc6c8cc-4142-4730-8663-e701322301ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:37.799038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edc6c8cc-4142-4730-8663-e701322301ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:37.799720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edc6c8cc-4142-4730-8663-e701322301ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:37.800452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edc6c8cc-4142-4730-8663-e701322301ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:37.897132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c251ed3-8738-4436-860a-9a531df0e060 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:37.898785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c251ed3-8738-4436-860a-9a531df0e060 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:37.918644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c251ed3-8738-4436-860a-9a531df0e060 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:37.919635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c251ed3-8738-4436-860a-9a531df0e060 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:37.925449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c251ed3-8738-4436-860a-9a531df0e060 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:37.927541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c251ed3-8738-4436-860a-9a531df0e060 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:37.928250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c251ed3-8738-4436-860a-9a531df0e060 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:37.928905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c251ed3-8738-4436-860a-9a531df0e060 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:38.485042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-edc6c8cc-4142-4730-8663-e701322301ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:38.497799 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-edc6c8cc-4142-4730-8663-e701322301ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.713809 Oct 11 04:34:38.499080 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2492/5225] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:37 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:38.531083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5fb7fd48-7755-4aed-8da0-c72dc2e3c9a9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:38.539694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5fb7fd48-7755-4aed-8da0-c72dc2e3c9a9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:38.550595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb7fd48-7755-4aed-8da0-c72dc2e3c9a9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:38.551975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb7fd48-7755-4aed-8da0-c72dc2e3c9a9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:38.552589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb7fd48-7755-4aed-8da0-c72dc2e3c9a9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:38.554253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb7fd48-7755-4aed-8da0-c72dc2e3c9a9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:38.556062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb7fd48-7755-4aed-8da0-c72dc2e3c9a9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:38.557840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb7fd48-7755-4aed-8da0-c72dc2e3c9a9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:38.622203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5fb7fd48-7755-4aed-8da0-c72dc2e3c9a9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:34:38.672536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c251ed3-8738-4436-860a-9a531df0e060 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:38.688345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c251ed3-8738-4436-860a-9a531df0e060 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1507 microversion: 2.1 time: 0.797273 Oct 11 04:34:38.692289 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2734/5226] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:37 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1507 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:38.703994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"restore": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:38.704612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:38.721400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:38.721895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:38.723491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:38.724247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:38.724705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:38.729297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:38.805096 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Cannot 'restore' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action HTTP/1.1 Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 15 Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: {"restore": {}} Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: exception: Cannot 'restore' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '90650e13-1fd0-479b-972e-d36b6521b37f', 'body': {'restore': {}}} Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 42, in _restore Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.compute_api.restore(context, instance) Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90650e13-1fd0-479b-972e-d36b6521b37f in vm_state active. Cannot restore while the instance is in this state. Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/deferred_delete.py", line 46, in _restore Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'restore' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:38.810548 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:38.815130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:38.815130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:38.815130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:38.815130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'restore' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:34:38.815130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:38.815130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 409 to user: Cannot 'restore' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:38.815515 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce684407-6953-4276-926e-83627762c079 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 409 len: 145 microversion: 2.1 time: 0.121067 Oct 11 04:34:38.817369 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2735/5227] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:38 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 145 bytes in 124 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:34:38.828467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:38.834969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:38.845248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:38.846497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:38.847197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:38.848134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:38.848814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:38.849509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:39.025180 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5fb7fd48-7755-4aed-8da0-c72dc2e3c9a9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 204 len: 0 microversion: 2.1 time: 0.511200 Oct 11 04:34:39.025771 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2493/5228] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:34:38 2022] DELETE /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:34:39.035083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-36493295-cfc2-480c-8f4c-ecbf0f96b94d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:39.038757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-36493295-cfc2-480c-8f4c-ecbf0f96b94d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:39.049751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36493295-cfc2-480c-8f4c-ecbf0f96b94d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:39.050288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36493295-cfc2-480c-8f4c-ecbf0f96b94d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:39.050734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36493295-cfc2-480c-8f4c-ecbf0f96b94d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:39.051452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36493295-cfc2-480c-8f4c-ecbf0f96b94d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:39.053715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36493295-cfc2-480c-8f4c-ecbf0f96b94d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:39.054216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36493295-cfc2-480c-8f4c-ecbf0f96b94d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:39.158701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:39.170326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:39.172126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:39.173288 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0f047bde-6e3f-443d-bc82-8d49ba47c4a1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1802 microversion: 2.42 time: 0.354925 Oct 11 04:34:39.175186 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2736/5229] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:38 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1802 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:39.180031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-551f1b12-9e52-47ad-b30c-c5ddd536fcb5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:39.182379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-551f1b12-9e52-47ad-b30c-c5ddd536fcb5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:39.200268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-551f1b12-9e52-47ad-b30c-c5ddd536fcb5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:39.203822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-551f1b12-9e52-47ad-b30c-c5ddd536fcb5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:39.213426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-551f1b12-9e52-47ad-b30c-c5ddd536fcb5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:39.213426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-551f1b12-9e52-47ad-b30c-c5ddd536fcb5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:39.213426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-551f1b12-9e52-47ad-b30c-c5ddd536fcb5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:39.213426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-551f1b12-9e52-47ad-b30c-c5ddd536fcb5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:39.580983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-551f1b12-9e52-47ad-b30c-c5ddd536fcb5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:39.595989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-551f1b12-9e52-47ad-b30c-c5ddd536fcb5 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1553 microversion: 2.1 time: 0.416597 Oct 11 04:34:39.596937 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2737/5230] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:39 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1553 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:39.693775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a0e3bd39-e23c-4357-b6f6-956b515958e7 req-683f74d4-459e-48de-aa35-ff954138ce1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2f3247f-ef76-46bd-ae1e-b2c1d10b0618", "name": "network-vif-deleted", "tag": "35ff5000-d3e4-4425-bb05-30cf6b7bd0a4"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:39.713056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a0e3bd39-e23c-4357-b6f6-956b515958e7 req-683f74d4-459e-48de-aa35-ff954138ce1c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:39.713538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a0e3bd39-e23c-4357-b6f6-956b515958e7 req-683f74d4-459e-48de-aa35-ff954138ce1c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:39.713977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a0e3bd39-e23c-4357-b6f6-956b515958e7 req-683f74d4-459e-48de-aa35-ff954138ce1c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:39.742722 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a0e3bd39-e23c-4357-b6f6-956b515958e7 req-683f74d4-459e-48de-aa35-ff954138ce1c service nova] Creating event network-vif-deleted:35ff5000-d3e4-4425-bb05-30cf6b7bd0a4 for instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 on n-h1-860892-1 Oct 11 04:34:39.747430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-36493295-cfc2-480c-8f4c-ecbf0f96b94d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:39.759296 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-36493295-cfc2-480c-8f4c-ecbf0f96b94d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.727417 Oct 11 04:34:39.761723 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2494/5231] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:39 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:39.774393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c31e8dbb-eabd-48a5-b29d-a6c305f9f865 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:39.775020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c31e8dbb-eabd-48a5-b29d-a6c305f9f865 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:39.776996 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a0e3bd39-e23c-4357-b6f6-956b515958e7 req-683f74d4-459e-48de-aa35-ff954138ce1c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083017 Oct 11 04:34:39.781065 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2738/5232] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:34:39.793568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e0663e14-2ebb-49c2-b187-bf354d733139 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:39.800710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e0663e14-2ebb-49c2-b187-bf354d733139 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:39.804570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c31e8dbb-eabd-48a5-b29d-a6c305f9f865 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:39.805094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c31e8dbb-eabd-48a5-b29d-a6c305f9f865 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:39.805517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c31e8dbb-eabd-48a5-b29d-a6c305f9f865 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:39.806279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c31e8dbb-eabd-48a5-b29d-a6c305f9f865 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:39.806743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c31e8dbb-eabd-48a5-b29d-a6c305f9f865 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:39.807174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c31e8dbb-eabd-48a5-b29d-a6c305f9f865 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:39.820717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0663e14-2ebb-49c2-b187-bf354d733139 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:39.821320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0663e14-2ebb-49c2-b187-bf354d733139 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:39.824396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0663e14-2ebb-49c2-b187-bf354d733139 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:39.826359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0663e14-2ebb-49c2-b187-bf354d733139 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:39.837958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0663e14-2ebb-49c2-b187-bf354d733139 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:39.839573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e0663e14-2ebb-49c2-b187-bf354d733139 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:40.011243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c31e8dbb-eabd-48a5-b29d-a6c305f9f865 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:40.020429 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c31e8dbb-eabd-48a5-b29d-a6c305f9f865 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1465 microversion: 2.1 time: 0.257506 Oct 11 04:34:40.024821 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2495/5233] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:39 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1465 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:40.201967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:40.202619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:40.215900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:40.216198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:40.216990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:40.217903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:40.218630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:40.222830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:40.450886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e0663e14-2ebb-49c2-b187-bf354d733139 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:40.464939 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e0663e14-2ebb-49c2-b187-bf354d733139 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.677118 Oct 11 04:34:40.467687 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2739/5234] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:39 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:40.492667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72379e04-3ed5-4815-9f2f-206cf966b9e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:40.494520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72379e04-3ed5-4815-9f2f-206cf966b9e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: e4080880-75e1-49a8-b716-5b4a279ec90d] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:40.503316 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-72379e04-3ed5-4815-9f2f-206cf966b9e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance e4080880-75e1-49a8-b716-5b4a279ec90d could not be found. Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72379e04-3ed5-4815-9f2f-206cf966b9e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/e4080880-75e1-49a8-b716-5b4a279ec90d/action HTTP/1.1 Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 14 Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: {"resume": {}} Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance e4080880-75e1-49a8-b716-5b4a279ec90d could not be found. Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e4080880-75e1-49a8-b716-5b4a279ec90d', 'body': {'resume': {}}} Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4080880-75e1-49a8-b716-5b4a279ec90d could not be found. Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 55, in _resume Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4080880-75e1-49a8-b716-5b4a279ec90d could not be found. Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:40.512992 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:40.521558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:40.521558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:40.521558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4080880-75e1-49a8-b716-5b4a279ec90d could not be found. Oct 11 04:34:40.521558 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:40.521558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72379e04-3ed5-4815-9f2f-206cf966b9e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance e4080880-75e1-49a8-b716-5b4a279ec90d could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:40.521558 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72379e04-3ed5-4815-9f2f-206cf966b9e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/e4080880-75e1-49a8-b716-5b4a279ec90d/action" status: 404 len: 111 microversion: 2.1 time: 0.027347 Oct 11 04:34:40.521558 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2740/5235] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:40 2022] POST /compute/v2.1/servers/e4080880-75e1-49a8-b716-5b4a279ec90d/action => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:40.524511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0cf2127f-e514-4290-b05c-d3bb3fdbc0fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:40.526689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0cf2127f-e514-4290-b05c-d3bb3fdbc0fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:40.543795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf2127f-e514-4290-b05c-d3bb3fdbc0fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:40.551137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf2127f-e514-4290-b05c-d3bb3fdbc0fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:40.553684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf2127f-e514-4290-b05c-d3bb3fdbc0fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:40.555723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf2127f-e514-4290-b05c-d3bb3fdbc0fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:40.556232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf2127f-e514-4290-b05c-d3bb3fdbc0fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:40.558315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cf2127f-e514-4290-b05c-d3bb3fdbc0fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:40.700696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:40.715791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:40.717909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:40.719555 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a5ee41d3-7261-4c65-8e1d-8b37391fe538 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1849 microversion: 2.42 time: 0.521680 Oct 11 04:34:40.735616 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2496/5236] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:40 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1849 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:34:40.745981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7dc18389-f7e7-40d4-8786-bd37d8e0c3c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:40.751731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7dc18389-f7e7-40d4-8786-bd37d8e0c3c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:40.755478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc18389-f7e7-40d4-8786-bd37d8e0c3c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:40.756243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc18389-f7e7-40d4-8786-bd37d8e0c3c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:40.756840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc18389-f7e7-40d4-8786-bd37d8e0c3c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:40.757736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc18389-f7e7-40d4-8786-bd37d8e0c3c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:40.758205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc18389-f7e7-40d4-8786-bd37d8e0c3c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:40.758902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc18389-f7e7-40d4-8786-bd37d8e0c3c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.034923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7dc18389-f7e7-40d4-8786-bd37d8e0c3c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:41.044160 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7dc18389-f7e7-40d4-8786-bd37d8e0c3c9 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1553 microversion: 2.1 time: 0.306995 Oct 11 04:34:41.046221 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2497/5237] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:40 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1553 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:41.069223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:41.073143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:41.083519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.084483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.085342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.086373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.087324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.087968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.143966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.144696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.145340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.146173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lazy-loading 'fault' on Instance uuid e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:34:41.164626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0cf2127f-e514-4290-b05c-d3bb3fdbc0fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:41.176959 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0cf2127f-e514-4290-b05c-d3bb3fdbc0fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.655350 Oct 11 04:34:41.190718 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2741/5238] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:40 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:41.201600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-edfe5fa5-1845-4a13-a269-cca027fb4d6b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:41.202255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-edfe5fa5-1845-4a13-a269-cca027fb4d6b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:41.211650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:41.224275 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b080c9d-e4ca-4e56-8072-48f1131714fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 200 len: 1310 microversion: 2.1 time: 0.168324 Oct 11 04:34:41.228487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edfe5fa5-1845-4a13-a269-cca027fb4d6b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.229289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edfe5fa5-1845-4a13-a269-cca027fb4d6b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.229948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edfe5fa5-1845-4a13-a269-cca027fb4d6b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.230679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edfe5fa5-1845-4a13-a269-cca027fb4d6b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.231291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edfe5fa5-1845-4a13-a269-cca027fb4d6b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.231873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-edfe5fa5-1845-4a13-a269-cca027fb4d6b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.241945 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2498/5239] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:41 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 1310 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:41.507070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-edfe5fa5-1845-4a13-a269-cca027fb4d6b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:41.544681 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-edfe5fa5-1845-4a13-a269-cca027fb4d6b tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.347492 Oct 11 04:34:41.545278 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2742/5240] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:41 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:41.569555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:41.570091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:41.579508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.581664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.582289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.583510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.584104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.584753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.621060 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Cannot 'resume' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action HTTP/1.1 Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 14 Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: {"resume": {}} Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: exception: Cannot 'resume' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '90650e13-1fd0-479b-972e-d36b6521b37f', 'body': {'resume': {}}} Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 59, in _resume Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.compute_api.resume(context, server) Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90650e13-1fd0-479b-972e-d36b6521b37f in vm_state active. Cannot resume while the instance is in this state. Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 63, in _resume Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'resume' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:41.627022 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:41.632671 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:41.632671 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:41.632671 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:41.632671 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:41.632671 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:41.632671 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'resume' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:34:41.632671 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:34:41.634348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 409 to user: Cannot 'resume' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:41.635438 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d1e30fc2-05e7-4b1e-9f8a-76dd5fc464aa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 409 len: 144 microversion: 2.1 time: 0.069783 Oct 11 04:34:41.642842 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2499/5241] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:41 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 144 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:34:41.650981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b1b3aa3-df53-4437-9b36-47fd9c9d01fb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:41.651606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1b1b3aa3-df53-4437-9b36-47fd9c9d01fb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:41.665679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b1b3aa3-df53-4437-9b36-47fd9c9d01fb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.666222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b1b3aa3-df53-4437-9b36-47fd9c9d01fb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.666956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b1b3aa3-df53-4437-9b36-47fd9c9d01fb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.667415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b1b3aa3-df53-4437-9b36-47fd9c9d01fb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.667858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b1b3aa3-df53-4437-9b36-47fd9c9d01fb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.668333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b1b3aa3-df53-4437-9b36-47fd9c9d01fb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.749034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:41.749906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:41.756923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.758829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.759499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.762444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.769220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.770453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:41.946295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1b1b3aa3-df53-4437-9b36-47fd9c9d01fb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:41.958609 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1b1b3aa3-df53-4437-9b36-47fd9c9d01fb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.308729 Oct 11 04:34:41.959450 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2743/5242] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:41 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:41.969869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a8605fcc-b3aa-46bc-ad7d-009e1ba4d4cb req-b74e4441-79ff-40a5-ae7a-865857e8e8b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "tag": "8a2e3024-32a6-42ac-9aa6-31fac197b837"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:41.994580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a8605fcc-b3aa-46bc-ad7d-009e1ba4d4cb req-b74e4441-79ff-40a5-ae7a-865857e8e8b0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:41.995179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a8605fcc-b3aa-46bc-ad7d-009e1ba4d4cb req-b74e4441-79ff-40a5-ae7a-865857e8e8b0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:41.995471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a8605fcc-b3aa-46bc-ad7d-009e1ba4d4cb req-b74e4441-79ff-40a5-ae7a-865857e8e8b0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:42.020372 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a8605fcc-b3aa-46bc-ad7d-009e1ba4d4cb req-b74e4441-79ff-40a5-ae7a-865857e8e8b0 service nova] Creating event network-changed:8a2e3024-32a6-42ac-9aa6-31fac197b837 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:34:42.031500 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a8605fcc-b3aa-46bc-ad7d-009e1ba4d4cb req-b74e4441-79ff-40a5-ae7a-865857e8e8b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070462 Oct 11 04:34:42.032342 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2744/5243] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:42.050282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dfa4d5b5-e258-480f-8f90-1a88f8517ba0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:42.051200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dfa4d5b5-e258-480f-8f90-1a88f8517ba0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:42.062730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfa4d5b5-e258-480f-8f90-1a88f8517ba0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:42.062730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfa4d5b5-e258-480f-8f90-1a88f8517ba0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:42.062730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfa4d5b5-e258-480f-8f90-1a88f8517ba0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:42.062730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfa4d5b5-e258-480f-8f90-1a88f8517ba0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:42.062730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfa4d5b5-e258-480f-8f90-1a88f8517ba0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:42.062730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfa4d5b5-e258-480f-8f90-1a88f8517ba0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:42.598419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:42.612704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:42.626975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:42.629002 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3c510a97-0a74-4cd4-911f-9b3b4e982a33 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1849 microversion: 2.42 time: 0.883890 Oct 11 04:34:42.629957 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2500/5244] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:41 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1849 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:34:42.635338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:42.639624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:42.655224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:42.659801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:42.660275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:42.661474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:42.661803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:42.662261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:42.707932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:42.709455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:42.710120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:42.710610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lazy-loading 'fault' on Instance uuid e04f82e5-4f36-463a-89dd-805b017815b8 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:34:42.871631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dfa4d5b5-e258-480f-8f90-1a88f8517ba0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:42.878297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:42.883533 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dfa4d5b5-e258-480f-8f90-1a88f8517ba0 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.849460 Oct 11 04:34:42.884131 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2745/5245] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:42 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:42.905102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7e5004a0-ccd0-4d0a-bdec-79ba5f40ea28 req-e24df073-3696-4f63-9be0-b157c420e4e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e04f82e5-4f36-463a-89dd-805b017815b8", "name": "network-vif-deleted", "tag": "a81a8f24-2501-4cde-8095-da9af4ad9c9a"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:42.955604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7e5004a0-ccd0-4d0a-bdec-79ba5f40ea28 req-e24df073-3696-4f63-9be0-b157c420e4e0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:42.956111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7e5004a0-ccd0-4d0a-bdec-79ba5f40ea28 req-e24df073-3696-4f63-9be0-b157c420e4e0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:42.956559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7e5004a0-ccd0-4d0a-bdec-79ba5f40ea28 req-e24df073-3696-4f63-9be0-b157c420e4e0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:42.976115 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7e5004a0-ccd0-4d0a-bdec-79ba5f40ea28 req-e24df073-3696-4f63-9be0-b157c420e4e0 service nova] Creating event network-vif-deleted:a81a8f24-2501-4cde-8095-da9af4ad9c9a for instance e04f82e5-4f36-463a-89dd-805b017815b8 on n-h2-860892-1 Oct 11 04:34:42.982803 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7e5004a0-ccd0-4d0a-bdec-79ba5f40ea28 req-e24df073-3696-4f63-9be0-b157c420e4e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093259 Oct 11 04:34:42.984012 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2746/5246] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:42.994477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:42.994477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:43.000887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:43.001857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:43.002534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:43.003435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:43.004054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:43.004708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:43.020955 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 HTTP/1.1 Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e2f3247f-ef76-46bd-ae1e-b2c1d10b0618'} Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:43.023105 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.028165 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:43.028165 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:43.028165 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:43.028165 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:43.028165 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:43.028165 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:34:43.028165 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.029407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:43.030517 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-36916039-536d-41f9-a8d4-9c28b6496d2d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 404 len: 111 microversion: 2.1 time: 0.045217 Oct 11 04:34:43.031623 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2747/5247] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:42 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:43.044022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aa652b2c-da44-4c83-84fa-869ab1e20438 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'create', calling method: .version_select at 0x7fda1a059ca0>, body: {"keypair": {"name": "tempest-key-523270834", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIdXsifcZ6UHZfJGBRMHT8S+ghVBmW9CZ16dYlUSpnIWYXcQY3yKjECoyshMWjRolQPzMwWqr1hxgpcOqtsznyRdAzYXOQVGACY+nGy1gHlMTPFXb2cM20JIidPHyFN9Ew=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:43.061323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-aa652b2c-da44-4c83-84fa-869ab1e20438 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:34:43.067393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-aa652b2c-da44-4c83-84fa-869ab1e20438 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for user 96880360d7994e09a1fd27193d2cd152 and project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:34:43.149963 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aa652b2c-da44-4c83-84fa-869ab1e20438 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 381 microversion: 2.1 time: 0.108917 Oct 11 04:34:43.151619 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2748/5248] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:34:43 2022] POST /compute/v2.1/os-keypairs => generated 381 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:34:43.164762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a52ab8b-c330-4d3c-bc94-33f7f4c26641 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'create', calling method: >, body: {"server": {"name": "", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a52ab8b-c330-4d3c-bc94-33f7f4c26641 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers HTTP/1.1 Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 160 Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "970f73ec-9c49-458a-9006-bef8b5b2ed1f"}]}} Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'body': {'server': {'name': '', 'imageRef': 'f5e997ff-e5de-4be2-9fc9-af1f070d3e55', 'flavorRef': '452', 'networks': [{'uuid': '970f73ec-9c49-458a-9006-bef8b5b2ed1f'}]}}} Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi '' Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:34:43.171060 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:34:43.175364 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:43.177539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a52ab8b-c330-4d3c-bc94-33f7f4c26641 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:43.178657 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a52ab8b-c330-4d3c-bc94-33f7f4c26641 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 400 len: 108 microversion: 2.1 time: 0.018155 Oct 11 04:34:43.181821 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2749/5249] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:43 2022] POST /compute/v2.1/servers => generated 108 bytes in 22 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:34:43.190836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fa9900e1-5f20-41b0-a952-c71042cf7cb0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '.version_select at 0x7fda193cc670>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:43.196551 n-d-860892-1 devstack@n-api.service[120994]: WARNING oslo_db.sqlalchemy.utils [None req-fa9900e1-5f20-41b0-a952-c71042cf7cb0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Unique keys not in sort_keys. The sorting order may be unstable. Oct 11 04:34:43.211843 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fa9900e1-5f20-41b0-a952-c71042cf7cb0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/os-keypairs" status: 200 len: 350 microversion: 2.1 time: 0.026457 Oct 11 04:34:43.213237 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2750/5250] 10.222.0.26 () {58 vars in 1137 bytes} [Tue Oct 11 04:34:43 2022] GET /compute/v2.1/os-keypairs => generated 350 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:43.237795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0e012318-bc54-462a-8ebd-bcfd9b9d5e7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:43.239003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0e012318-bc54-462a-8ebd-bcfd9b9d5e7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:43.255889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e012318-bc54-462a-8ebd-bcfd9b9d5e7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:43.257761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e012318-bc54-462a-8ebd-bcfd9b9d5e7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:43.259897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e012318-bc54-462a-8ebd-bcfd9b9d5e7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:43.260643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e012318-bc54-462a-8ebd-bcfd9b9d5e7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:43.261366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e012318-bc54-462a-8ebd-bcfd9b9d5e7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:43.261801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e012318-bc54-462a-8ebd-bcfd9b9d5e7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:43.398896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:43.407777 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d908b359-4484-4e47-89b5-82713209b10f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 200 len: 1338 microversion: 2.1 time: 0.776174 Oct 11 04:34:43.418896 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2501/5251] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:42 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 1338 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:43.424181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1854065914", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "key_name": "tempest-key-523270834", "networks": [{"uuid": "09b3f7b6-0734-4684-a67d-dc5b0c7e4aff"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:43.502409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] validate_networks() for [('09b3f7b6-0734-4684-a67d-dc5b0c7e4aff', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:34:43.534082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0e012318-bc54-462a-8ebd-bcfd9b9d5e7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:43.545531 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0e012318-bc54-462a-8ebd-bcfd9b9d5e7f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.320488 Oct 11 04:34:43.547814 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2751/5252] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:43 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:43.574809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-393da64a-7a57-446b-a4bc-26e298949865 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:43.576035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-393da64a-7a57-446b-a4bc-26e298949865 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:43.582924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-393da64a-7a57-446b-a4bc-26e298949865 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:43.584650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-393da64a-7a57-446b-a4bc-26e298949865 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:43.584650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-393da64a-7a57-446b-a4bc-26e298949865 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:43.585271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-393da64a-7a57-446b-a4bc-26e298949865 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:43.585949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-393da64a-7a57-446b-a4bc-26e298949865 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:43.586606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-393da64a-7a57-446b-a4bc-26e298949865 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:43.760736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-393da64a-7a57-446b-a4bc-26e298949865 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:43.770815 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-393da64a-7a57-446b-a4bc-26e298949865 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.200703 Oct 11 04:34:43.771557 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2752/5253] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:43 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:43.777690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2131684079", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b04e7ccf-bf5e-4c39-aed9-e1f9805cfa18"}], "security_groups": [{"name": "tempest-securitygroup--796023238"}], "key_name": "tempest-keypair-1508188651", "user_data": "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:43.901300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] validate_networks() for [('b04e7ccf-bf5e-4c39-aed9-e1f9805cfa18', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:34:44.335826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:34:44.336450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:34:44.337022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:34:44.337532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:34:44.338012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:34:44.348569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:44.349180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:44.349615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:44.350420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:44.350870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:44.351289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:44.368357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Getting quotas for project 483579a827a84b40b6fb4c3bd5b67360. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:34:44.373809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Getting quotas for user 22e2c72c29774424b6c603bf36318512 and project 483579a827a84b40b6fb4c3bd5b67360. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:34:44.387987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:34:44.390038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:34:44.532135 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cd41b151-5575-4275-8eee-442de54892a4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.759171 Oct 11 04:34:44.533800 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2753/5254] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:34:44.539292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:44.540313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:44.565958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:44.566517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:44.567106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:44.568425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:44.568725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:44.569323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:44.787188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:44.799480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:44.802757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:44.804578 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-421e92bb-6859-4285-9039-347e9bd5a821 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1870 microversion: 2.42 time: 0.269623 Oct 11 04:34:44.817484 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2754/5255] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:44 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1870 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:44.835242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-476d3f7a-0964-47f2-a119-e51ed3ed679f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:44.835787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-476d3f7a-0964-47f2-a119-e51ed3ed679f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 48145498-e08b-4cda-999d-878f967bf4d0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:44.841683 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-476d3f7a-0964-47f2-a119-e51ed3ed679f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance 48145498-e08b-4cda-999d-878f967bf4d0 could not be found. Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-476d3f7a-0964-47f2-a119-e51ed3ed679f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/48145498-e08b-4cda-999d-878f967bf4d0/action HTTP/1.1 Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 14 Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: {"shelve": {}} Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 48145498-e08b-4cda-999d-878f967bf4d0 could not be found. Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '48145498-e08b-4cda-999d-878f967bf4d0', 'body': {'shelve': {}}} Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48145498-e08b-4cda-999d-878f967bf4d0 could not be found. Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 44, in _shelve Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48145498-e08b-4cda-999d-878f967bf4d0 could not be found. Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:44.855906 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:44.859908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:44.859908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:44.859908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48145498-e08b-4cda-999d-878f967bf4d0 could not be found. Oct 11 04:34:44.859908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:44.859908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-476d3f7a-0964-47f2-a119-e51ed3ed679f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance 48145498-e08b-4cda-999d-878f967bf4d0 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:44.859908 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-476d3f7a-0964-47f2-a119-e51ed3ed679f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/48145498-e08b-4cda-999d-878f967bf4d0/action" status: 404 len: 111 microversion: 2.1 time: 0.034453 Oct 11 04:34:44.859908 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2755/5256] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:44 2022] POST /compute/v2.1/servers/48145498-e08b-4cda-999d-878f967bf4d0/action => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:44.865534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:44.866409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: e04f82e5-4f36-463a-89dd-805b017815b8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:44.874981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:44.875464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:44.875897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:44.876620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:44.877071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:44.877493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:44.892624 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] HTTP exception thrown: Instance e04f82e5-4f36-463a-89dd-805b017815b8 could not be found. Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Request method failure captured: Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 HTTP/1.1 Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPGkWxy3OtSgAGPLdTkFtYFvELislRCTj6KM7bq7fM9-tVBqZFS9x88of4rCD9CeDlGa8j810_nEPQHvxJFa8fQACoYg5xJ1ENm2zuLmeaB_ksi97w0YCZO7PO8MrSKsyAzCX3oPd1kIKI1jUDRiRIIwcwOUhk95JpYD630bDrQ19e4 Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 13a4630fe9284b8b83a7bd9a7ef4ce95 Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestNetworkBasicOps-93795933 Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13a4630fe9284b8b83a7bd9a7ef4ce95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13a4630fe9284b8b83a7bd9a7ef4ce95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13a4630fe9284b8b83a7bd9a7ef4ce95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13a4630fe9284b8b83a7bd9a7ef4ce95"}]}] Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestNetworkBasicOps-93795933 Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 13a4630fe9284b8b83a7bd9a7ef4ce95 Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestNetworkBasicOps-93795933 Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestNetworkBasicOps-93795933-project Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 752975bff6034a7086aafa3319a4f1d4 Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestNetworkBasicOps-93795933-project Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance e04f82e5-4f36-463a-89dd-805b017815b8 could not be found. Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e04f82e5-4f36-463a-89dd-805b017815b8'} Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e04f82e5-4f36-463a-89dd-805b017815b8 could not be found. Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e04f82e5-4f36-463a-89dd-805b017815b8 could not be found. Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:44.894835 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e04f82e5-4f36-463a-89dd-805b017815b8 could not be found. Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Returning 404 to user: Instance e04f82e5-4f36-463a-89dd-805b017815b8 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0f5a2380-de88-43a5-899d-208fe5682d03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8" status: 404 len: 111 microversion: 2.1 time: 0.041463 Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2756/5257] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:44 2022] GET /compute/v2.1/servers/e04f82e5-4f36-463a-89dd-805b017815b8 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-046cbda0-12ac-4926-bdfc-156e6365e116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:44.903386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-046cbda0-12ac-4926-bdfc-156e6365e116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:44.910475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=5 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:45.015099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-046cbda0-12ac-4926-bdfc-156e6365e116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:45.025622 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-046cbda0-12ac-4926-bdfc-156e6365e116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1238 microversion: 2.1 time: 0.127820 Oct 11 04:34:45.027273 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2757/5258] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:44 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1238 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:45.032342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c16f76c6-f222-4e35-afe4-c0832e0fbb8a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:45.033674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c16f76c6-f222-4e35-afe4-c0832e0fbb8a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:45.041065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c16f76c6-f222-4e35-afe4-c0832e0fbb8a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:45.041742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c16f76c6-f222-4e35-afe4-c0832e0fbb8a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:45.042523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c16f76c6-f222-4e35-afe4-c0832e0fbb8a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:45.044644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c16f76c6-f222-4e35-afe4-c0832e0fbb8a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:45.045278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c16f76c6-f222-4e35-afe4-c0832e0fbb8a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:45.045935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c16f76c6-f222-4e35-afe4-c0832e0fbb8a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:45.272065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c16f76c6-f222-4e35-afe4-c0832e0fbb8a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:45.281462 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c16f76c6-f222-4e35-afe4-c0832e0fbb8a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.252903 Oct 11 04:34:45.283496 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2758/5259] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:45 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:45.293844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:34:45.294929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:34:45.296621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:34:45.307919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:34:45.307919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:34:45.321186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6783307b-f2b2-4409-bbf7-bd6aeb84a04c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:45.322571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:45.323118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6783307b-f2b2-4409-bbf7-bd6aeb84a04c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:45.324553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:45.326090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:45.327081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:45.328123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:45.328578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:45.333777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6783307b-f2b2-4409-bbf7-bd6aeb84a04c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:45.334382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6783307b-f2b2-4409-bbf7-bd6aeb84a04c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:45.334761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6783307b-f2b2-4409-bbf7-bd6aeb84a04c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:45.335456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6783307b-f2b2-4409-bbf7-bd6aeb84a04c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:45.335904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6783307b-f2b2-4409-bbf7-bd6aeb84a04c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:45.336329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6783307b-f2b2-4409-bbf7-bd6aeb84a04c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:45.357372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:34:45.363505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for user 96880360d7994e09a1fd27193d2cd152 and project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:34:45.396279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:34:45.403260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:34:45.547370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6783307b-f2b2-4409-bbf7-bd6aeb84a04c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:45.556194 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6783307b-f2b2-4409-bbf7-bd6aeb84a04c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.249050 Oct 11 04:34:45.695789 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2759/5260] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:45 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:45.695789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-68420fac-5ffb-4c25-b0c2-92474140ef03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '.version_select at 0x7fda1a050940>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:45.698461 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6afdd459-8afc-42b3-b4a5-e343c32340ac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.232280 Oct 11 04:34:45.698461 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2502/5261] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:34:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 2234 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:34:45.698461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1a49ee18-4d68-40a9-97b1-bf321b0ce7d6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:45.698461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1a49ee18-4d68-40a9-97b1-bf321b0ce7d6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:45.698461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a49ee18-4d68-40a9-97b1-bf321b0ce7d6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:45.698461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a49ee18-4d68-40a9-97b1-bf321b0ce7d6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:45.698461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a49ee18-4d68-40a9-97b1-bf321b0ce7d6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:45.698461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a49ee18-4d68-40a9-97b1-bf321b0ce7d6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:45.698461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a49ee18-4d68-40a9-97b1-bf321b0ce7d6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:45.698461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a49ee18-4d68-40a9-97b1-bf321b0ce7d6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:45.698461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:45.740913 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-68420fac-5ffb-4c25-b0c2-92474140ef03 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-575368388" status: 202 len: 0 microversion: 2.1 time: 0.177447 Oct 11 04:34:45.746526 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2760/5262] 10.222.0.26 () {58 vars in 1254 bytes} [Tue Oct 11 04:34:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-575368388 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:34:45.751528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6dc1f2aa-0a43-4281-a71f-009ce7c32ff4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:45.752262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6dc1f2aa-0a43-4281-a71f-009ce7c32ff4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:45.781568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-1a49ee18-4d68-40a9-97b1-bf321b0ce7d6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lazy-loading 'flavor' on Instance uuid 90650e13-1fd0-479b-972e-d36b6521b37f {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:34:45.896260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6dc1f2aa-0a43-4281-a71f-009ce7c32ff4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:45.931575 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6dc1f2aa-0a43-4281-a71f-009ce7c32ff4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1228 microversion: 2.1 time: 0.185186 Oct 11 04:34:45.932302 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2761/5263] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:45 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1228 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:45.962487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-3a32593e-57b4-4001-badd-014ac59df754 req-c8110c36-d3c5-46a5-a73c-7fd985246704 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "tag": "ce10ffc1-2e72-42f8-a990-d02439f40888"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:45.985234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3a32593e-57b4-4001-badd-014ac59df754 req-c8110c36-d3c5-46a5-a73c-7fd985246704 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:45.985978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3a32593e-57b4-4001-badd-014ac59df754 req-c8110c36-d3c5-46a5-a73c-7fd985246704 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:45.986597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3a32593e-57b4-4001-badd-014ac59df754 req-c8110c36-d3c5-46a5-a73c-7fd985246704 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:45.999848 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-3a32593e-57b4-4001-badd-014ac59df754 req-c8110c36-d3c5-46a5-a73c-7fd985246704 service nova] Creating event network-changed:ce10ffc1-2e72-42f8-a990-d02439f40888 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:34:46.007023 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-3a32593e-57b4-4001-badd-014ac59df754 req-c8110c36-d3c5-46a5-a73c-7fd985246704 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054276 Oct 11 04:34:46.008845 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2762/5264] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:46.014960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:46.016248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:46.026719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:46.027938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:46.028699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:46.029583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:46.030225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:46.030807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:46.670445 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1a49ee18-4d68-40a9-97b1-bf321b0ce7d6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 202 len: 0 microversion: 2.1 time: 1.014841 Oct 11 04:34:46.672515 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2503/5265] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:34:45 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 0 bytes in 1018 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:34:46.709331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-30940d61-9755-41cb-acaf-8d265272b17f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:46.725742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-30940d61-9755-41cb-acaf-8d265272b17f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:46.749516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30940d61-9755-41cb-acaf-8d265272b17f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:46.754694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30940d61-9755-41cb-acaf-8d265272b17f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:46.756203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30940d61-9755-41cb-acaf-8d265272b17f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:46.758295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30940d61-9755-41cb-acaf-8d265272b17f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:46.760498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30940d61-9755-41cb-acaf-8d265272b17f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:46.761648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30940d61-9755-41cb-acaf-8d265272b17f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:46.809725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:46.822878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:46.824881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:46.830248 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f433646a-7abb-4070-b655-29b26cc4287a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1870 microversion: 2.42 time: 0.817524 Oct 11 04:34:46.830248 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2763/5266] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:46 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1870 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:46.842907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7e28d323-0163-4d68-9726-a79c821d93d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:46.856182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7e28d323-0163-4d68-9726-a79c821d93d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:46.888523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e28d323-0163-4d68-9726-a79c821d93d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:46.890357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e28d323-0163-4d68-9726-a79c821d93d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:46.893200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e28d323-0163-4d68-9726-a79c821d93d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:46.894876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e28d323-0163-4d68-9726-a79c821d93d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:46.895344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e28d323-0163-4d68-9726-a79c821d93d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:46.895774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e28d323-0163-4d68-9726-a79c821d93d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:47.166946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-30940d61-9755-41cb-acaf-8d265272b17f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:47.178316 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-30940d61-9755-41cb-acaf-8d265272b17f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1234 microversion: 2.1 time: 0.480183 Oct 11 04:34:47.178930 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2504/5267] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:46 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1234 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:47.189957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-18db5c72-b2b3-4acd-a9b0-f2f49199e7e5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:47.195113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-18db5c72-b2b3-4acd-a9b0-f2f49199e7e5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:47.308854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18db5c72-b2b3-4acd-a9b0-f2f49199e7e5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:47.321687 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-18db5c72-b2b3-4acd-a9b0-f2f49199e7e5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1228 microversion: 2.1 time: 0.139650 Oct 11 04:34:47.322341 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2505/5268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:47 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1228 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:47.537295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7e28d323-0163-4d68-9726-a79c821d93d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:47.567244 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7e28d323-0163-4d68-9726-a79c821d93d8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1513 microversion: 2.1 time: 0.733979 Oct 11 04:34:47.570842 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2764/5269] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:46 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1513 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:47.856119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:47.856832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:47.870743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:47.878744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:47.879250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:47.879999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:47.880452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:47.881052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:48.205633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cefe53c-ebd9-41da-9818-f9c447ee6e44 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:48.207208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2cefe53c-ebd9-41da-9818-f9c447ee6e44 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:48.221614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cefe53c-ebd9-41da-9818-f9c447ee6e44 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:48.224890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cefe53c-ebd9-41da-9818-f9c447ee6e44 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:48.226282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cefe53c-ebd9-41da-9818-f9c447ee6e44 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:48.227243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cefe53c-ebd9-41da-9818-f9c447ee6e44 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:48.230071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cefe53c-ebd9-41da-9818-f9c447ee6e44 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:48.230637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cefe53c-ebd9-41da-9818-f9c447ee6e44 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:48.354323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2cefe53c-ebd9-41da-9818-f9c447ee6e44 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:48.368191 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2cefe53c-ebd9-41da-9818-f9c447ee6e44 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1308 microversion: 2.1 time: 0.166847 Oct 11 04:34:48.383008 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2765/5270] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:48 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1308 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:48.390936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30f4370e-8bb0-4b32-b4a0-c7c8b2c7106f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:48.391804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30f4370e-8bb0-4b32-b4a0-c7c8b2c7106f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:48.399705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f4370e-8bb0-4b32-b4a0-c7c8b2c7106f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:48.400638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f4370e-8bb0-4b32-b4a0-c7c8b2c7106f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:48.401244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f4370e-8bb0-4b32-b4a0-c7c8b2c7106f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:48.402153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f4370e-8bb0-4b32-b4a0-c7c8b2c7106f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:48.402792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f4370e-8bb0-4b32-b4a0-c7c8b2c7106f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:48.403378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f4370e-8bb0-4b32-b4a0-c7c8b2c7106f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:48.641454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30f4370e-8bb0-4b32-b4a0-c7c8b2c7106f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:48.651651 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30f4370e-8bb0-4b32-b4a0-c7c8b2c7106f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1280 microversion: 2.1 time: 0.267144 Oct 11 04:34:48.655452 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2766/5271] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:48 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1280 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:48.661382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-12807aad-e771-4489-bcf2-26570b118c6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:48.662284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-12807aad-e771-4489-bcf2-26570b118c6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:48.670857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12807aad-e771-4489-bcf2-26570b118c6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:48.671635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12807aad-e771-4489-bcf2-26570b118c6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:48.672247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12807aad-e771-4489-bcf2-26570b118c6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:48.673201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12807aad-e771-4489-bcf2-26570b118c6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:48.673817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12807aad-e771-4489-bcf2-26570b118c6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:48.674453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12807aad-e771-4489-bcf2-26570b118c6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:49.012881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-12807aad-e771-4489-bcf2-26570b118c6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:49.024842 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-12807aad-e771-4489-bcf2-26570b118c6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1513 microversion: 2.1 time: 0.370981 Oct 11 04:34:49.025800 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2767/5272] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:48 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1513 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:49.075870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:49.096328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:49.106594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:49.126419 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3b989667-cac6-4518-85da-e17da777c902 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1870 microversion: 2.42 time: 1.256027 Oct 11 04:34:49.143789 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2506/5273] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:47 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1870 bytes in 1292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:49.396045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4c9aac44-8aa8-42ec-ac9d-f3c4d523c5d4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:49.396935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4c9aac44-8aa8-42ec-ac9d-f3c4d523c5d4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:49.408540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9aac44-8aa8-42ec-ac9d-f3c4d523c5d4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:49.409208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9aac44-8aa8-42ec-ac9d-f3c4d523c5d4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:49.409823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9aac44-8aa8-42ec-ac9d-f3c4d523c5d4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:49.411379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9aac44-8aa8-42ec-ac9d-f3c4d523c5d4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:49.412676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9aac44-8aa8-42ec-ac9d-f3c4d523c5d4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:49.413359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c9aac44-8aa8-42ec-ac9d-f3c4d523c5d4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:49.542017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4c9aac44-8aa8-42ec-ac9d-f3c4d523c5d4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:49.557082 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4c9aac44-8aa8-42ec-ac9d-f3c4d523c5d4 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1296 microversion: 2.1 time: 0.165085 Oct 11 04:34:49.565561 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2768/5274] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:49 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1296 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:49.675751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3dba061-85d4-4d30-b9ae-fac733d74eb6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:49.676279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3dba061-85d4-4d30-b9ae-fac733d74eb6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:49.691110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3dba061-85d4-4d30-b9ae-fac733d74eb6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:49.691614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3dba061-85d4-4d30-b9ae-fac733d74eb6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:49.692058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3dba061-85d4-4d30-b9ae-fac733d74eb6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:49.692797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3dba061-85d4-4d30-b9ae-fac733d74eb6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:49.693246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3dba061-85d4-4d30-b9ae-fac733d74eb6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:49.693676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3dba061-85d4-4d30-b9ae-fac733d74eb6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:49.833887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a3dba061-85d4-4d30-b9ae-fac733d74eb6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:49.846687 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3dba061-85d4-4d30-b9ae-fac733d74eb6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1286 microversion: 2.1 time: 0.174777 Oct 11 04:34:49.848145 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2507/5275] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:49 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1286 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:50.016730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d987ec2e-d1d0-4edd-a39e-0b20fba1bbe6 req-4bf14eed-97e1-49e8-912d-5bfee9a9cb4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "tag": "7eeb954c-49a9-44c1-99b3-9d24db3203f1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:50.034459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d987ec2e-d1d0-4edd-a39e-0b20fba1bbe6 req-4bf14eed-97e1-49e8-912d-5bfee9a9cb4f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:50.039784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d987ec2e-d1d0-4edd-a39e-0b20fba1bbe6 req-4bf14eed-97e1-49e8-912d-5bfee9a9cb4f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:50.040481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d987ec2e-d1d0-4edd-a39e-0b20fba1bbe6 req-4bf14eed-97e1-49e8-912d-5bfee9a9cb4f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:50.051809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41f58a6a-9dad-4b39-bdb4-225bea4b4fe3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:50.053301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-41f58a6a-9dad-4b39-bdb4-225bea4b4fe3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:50.067672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f58a6a-9dad-4b39-bdb4-225bea4b4fe3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:50.068465 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d987ec2e-d1d0-4edd-a39e-0b20fba1bbe6 req-4bf14eed-97e1-49e8-912d-5bfee9a9cb4f service nova] Creating event network-changed:7eeb954c-49a9-44c1-99b3-9d24db3203f1 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:34:50.068973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f58a6a-9dad-4b39-bdb4-225bea4b4fe3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:50.069834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f58a6a-9dad-4b39-bdb4-225bea4b4fe3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:50.071347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f58a6a-9dad-4b39-bdb4-225bea4b4fe3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:50.073592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f58a6a-9dad-4b39-bdb4-225bea4b4fe3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:50.075500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41f58a6a-9dad-4b39-bdb4-225bea4b4fe3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:50.079869 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d987ec2e-d1d0-4edd-a39e-0b20fba1bbe6 req-4bf14eed-97e1-49e8-912d-5bfee9a9cb4f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068377 Oct 11 04:34:50.086675 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2769/5276] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:50.145092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:50.146118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:50.161254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:50.162003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:50.162583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:50.163514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:50.164247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:50.164823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:50.606536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-41f58a6a-9dad-4b39-bdb4-225bea4b4fe3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:50.617889 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41f58a6a-9dad-4b39-bdb4-225bea4b4fe3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1513 microversion: 2.1 time: 0.573790 Oct 11 04:34:50.640364 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2508/5277] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:50 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1513 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:50.646039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7027b5c9-3f8d-4dd2-a6a1-aee3150dab7f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:50.646883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7027b5c9-3f8d-4dd2-a6a1-aee3150dab7f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:50.657466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7027b5c9-3f8d-4dd2-a6a1-aee3150dab7f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:50.661158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7027b5c9-3f8d-4dd2-a6a1-aee3150dab7f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:50.661898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7027b5c9-3f8d-4dd2-a6a1-aee3150dab7f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:50.662898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7027b5c9-3f8d-4dd2-a6a1-aee3150dab7f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:50.663478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7027b5c9-3f8d-4dd2-a6a1-aee3150dab7f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:50.664574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7027b5c9-3f8d-4dd2-a6a1-aee3150dab7f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:50.796370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7027b5c9-3f8d-4dd2-a6a1-aee3150dab7f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:50.809878 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7027b5c9-3f8d-4dd2-a6a1-aee3150dab7f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1296 microversion: 2.1 time: 0.167748 Oct 11 04:34:50.812261 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2509/5278] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:50 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1296 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:50.876144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4688049a-f35d-4667-b482-495e55490ff7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:50.877679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4688049a-f35d-4667-b482-495e55490ff7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:50.891611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4688049a-f35d-4667-b482-495e55490ff7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:50.892802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4688049a-f35d-4667-b482-495e55490ff7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:50.894042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4688049a-f35d-4667-b482-495e55490ff7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:50.895311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4688049a-f35d-4667-b482-495e55490ff7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:50.895857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4688049a-f35d-4667-b482-495e55490ff7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:50.896298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4688049a-f35d-4667-b482-495e55490ff7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:51.038585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:51.067331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:51.074496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:51.075913 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab14a0d3-3df0-4ffd-84a9-4a3223edd28e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1891 microversion: 2.42 time: 0.936850 Oct 11 04:34:51.077812 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2770/5279] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:50 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1891 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:51.397337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4688049a-f35d-4667-b482-495e55490ff7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:51.405796 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4688049a-f35d-4667-b482-495e55490ff7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1286 microversion: 2.1 time: 0.538943 Oct 11 04:34:51.413316 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2510/5280] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:50 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1286 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:51.646763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e39e2e5-af8f-4fc2-b7d5-dbb23d760eba tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:51.648458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e39e2e5-af8f-4fc2-b7d5-dbb23d760eba tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:51.669165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e39e2e5-af8f-4fc2-b7d5-dbb23d760eba tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:51.670139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e39e2e5-af8f-4fc2-b7d5-dbb23d760eba tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:51.672562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e39e2e5-af8f-4fc2-b7d5-dbb23d760eba tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:51.674760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e39e2e5-af8f-4fc2-b7d5-dbb23d760eba tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:51.676837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e39e2e5-af8f-4fc2-b7d5-dbb23d760eba tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:51.679183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e39e2e5-af8f-4fc2-b7d5-dbb23d760eba tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:51.833616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c4b589bb-3812-4c79-956b-3fc0521441a5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:51.835005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c4b589bb-3812-4c79-956b-3fc0521441a5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:51.846709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b589bb-3812-4c79-956b-3fc0521441a5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:51.849779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b589bb-3812-4c79-956b-3fc0521441a5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:51.850369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b589bb-3812-4c79-956b-3fc0521441a5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:51.855351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b589bb-3812-4c79-956b-3fc0521441a5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:51.855964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b589bb-3812-4c79-956b-3fc0521441a5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:51.856463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b589bb-3812-4c79-956b-3fc0521441a5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:52.327208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c4b589bb-3812-4c79-956b-3fc0521441a5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:52.338386 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c4b589bb-3812-4c79-956b-3fc0521441a5 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1363 microversion: 2.1 time: 0.508765 Oct 11 04:34:52.354669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e39e2e5-af8f-4fc2-b7d5-dbb23d760eba tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:52.363699 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2511/5281] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:51 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1363 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:52.366495 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e39e2e5-af8f-4fc2-b7d5-dbb23d760eba tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1513 microversion: 2.1 time: 0.723677 Oct 11 04:34:52.370968 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2771/5282] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:51 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1513 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:52.375161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:52.376042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:52.380884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0b5fa40d-41a5-4906-b1a1-d93b788086d1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:52.381569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0b5fa40d-41a5-4906-b1a1-d93b788086d1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:52.387735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:52.391232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b5fa40d-41a5-4906-b1a1-d93b788086d1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:52.391761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b5fa40d-41a5-4906-b1a1-d93b788086d1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:52.392744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b5fa40d-41a5-4906-b1a1-d93b788086d1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:52.393465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b5fa40d-41a5-4906-b1a1-d93b788086d1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:52.393928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b5fa40d-41a5-4906-b1a1-d93b788086d1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:52.394391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b5fa40d-41a5-4906-b1a1-d93b788086d1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:52.398851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:52.399309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:52.400025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:52.400672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:52.401108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:52.428253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0b5fa40d-41a5-4906-b1a1-d93b788086d1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:34:52.457184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:52.865176 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0b5fa40d-41a5-4906-b1a1-d93b788086d1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 204 len: 0 microversion: 2.1 time: 0.492516 Oct 11 04:34:52.870305 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2772/5283] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:34:52 2022] DELETE /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:34:52.880144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1b3184ac-a28e-4048-aff2-845c7ef953b7 req-7f03ddf4-e161-4d39-b2b1-a10bca1ba36f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24168887-732a-4aa1-b723-e789feed3002", "tag": "0b4de9d4-3966-4f60-a837-066bba5af6b5"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:52.902181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1b3184ac-a28e-4048-aff2-845c7ef953b7 req-7f03ddf4-e161-4d39-b2b1-a10bca1ba36f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:52.904600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1b3184ac-a28e-4048-aff2-845c7ef953b7 req-7f03ddf4-e161-4d39-b2b1-a10bca1ba36f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:52.905998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1b3184ac-a28e-4048-aff2-845c7ef953b7 req-7f03ddf4-e161-4d39-b2b1-a10bca1ba36f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:52.916082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:52.931912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:52.935393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:52.948055 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6da3fa38-6580-4d13-8d56-1e3023898381 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1891 microversion: 2.42 time: 0.578733 Oct 11 04:34:52.958273 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2512/5284] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:52 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1891 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:52.958273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3cd7ad12-4a9e-4e39-b707-1c4e7705b07a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:52.958273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3cd7ad12-4a9e-4e39-b707-1c4e7705b07a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:52.960994 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1b3184ac-a28e-4048-aff2-845c7ef953b7 req-7f03ddf4-e161-4d39-b2b1-a10bca1ba36f service nova] Creating event network-changed:0b4de9d4-3966-4f60-a837-066bba5af6b5 for instance 24168887-732a-4aa1-b723-e789feed3002 on n-h1-860892-1 Oct 11 04:34:52.971350 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1b3184ac-a28e-4048-aff2-845c7ef953b7 req-7f03ddf4-e161-4d39-b2b1-a10bca1ba36f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097981 Oct 11 04:34:52.972033 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2773/5285] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:52.984442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cd7ad12-4a9e-4e39-b707-1c4e7705b07a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:52.984843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cd7ad12-4a9e-4e39-b707-1c4e7705b07a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:52.985290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cd7ad12-4a9e-4e39-b707-1c4e7705b07a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:52.986532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-52667dbf-00cf-4ac1-8a37-a486042c6b0f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:52.986676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cd7ad12-4a9e-4e39-b707-1c4e7705b07a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:52.987137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cd7ad12-4a9e-4e39-b707-1c4e7705b07a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:52.987574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3cd7ad12-4a9e-4e39-b707-1c4e7705b07a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:52.988066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-52667dbf-00cf-4ac1-8a37-a486042c6b0f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:52.998288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52667dbf-00cf-4ac1-8a37-a486042c6b0f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:52.999168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52667dbf-00cf-4ac1-8a37-a486042c6b0f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:52.999848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52667dbf-00cf-4ac1-8a37-a486042c6b0f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:53.002551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52667dbf-00cf-4ac1-8a37-a486042c6b0f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:53.003320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52667dbf-00cf-4ac1-8a37-a486042c6b0f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:53.004435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52667dbf-00cf-4ac1-8a37-a486042c6b0f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:53.375940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3cd7ad12-4a9e-4e39-b707-1c4e7705b07a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:53.410302 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3cd7ad12-4a9e-4e39-b707-1c4e7705b07a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1328 microversion: 2.1 time: 0.460064 Oct 11 04:34:53.416344 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2513/5286] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:52 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1328 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:53.425956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f614635b-23ac-4c13-a08b-da46b77ad5a3 req-446c41ce-d350-46b4-ad68-a93ebff1a030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "tag": "10df1ea8-87de-47cc-85e2-c32ce043673a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:53.446720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f614635b-23ac-4c13-a08b-da46b77ad5a3 req-446c41ce-d350-46b4-ad68-a93ebff1a030 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:53.447568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f614635b-23ac-4c13-a08b-da46b77ad5a3 req-446c41ce-d350-46b4-ad68-a93ebff1a030 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:53.449212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f614635b-23ac-4c13-a08b-da46b77ad5a3 req-446c41ce-d350-46b4-ad68-a93ebff1a030 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:53.475999 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f614635b-23ac-4c13-a08b-da46b77ad5a3 req-446c41ce-d350-46b4-ad68-a93ebff1a030 service nova] Creating event network-changed:10df1ea8-87de-47cc-85e2-c32ce043673a for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:34:53.482409 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f614635b-23ac-4c13-a08b-da46b77ad5a3 req-446c41ce-d350-46b4-ad68-a93ebff1a030 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063473 Oct 11 04:34:53.485213 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2514/5287] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:53.494064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cbcf2bd0-d49c-4d49-b333-c50edfc9eab9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:53.495122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cbcf2bd0-d49c-4d49-b333-c50edfc9eab9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:53.503882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbcf2bd0-d49c-4d49-b333-c50edfc9eab9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:53.504730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbcf2bd0-d49c-4d49-b333-c50edfc9eab9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:53.505362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbcf2bd0-d49c-4d49-b333-c50edfc9eab9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:53.506074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbcf2bd0-d49c-4d49-b333-c50edfc9eab9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:53.506990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbcf2bd0-d49c-4d49-b333-c50edfc9eab9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:53.507588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cbcf2bd0-d49c-4d49-b333-c50edfc9eab9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:53.789706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-52667dbf-00cf-4ac1-8a37-a486042c6b0f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:53.801494 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-52667dbf-00cf-4ac1-8a37-a486042c6b0f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1670 microversion: 2.1 time: 0.828227 Oct 11 04:34:53.802090 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2774/5288] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:52 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1670 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:53.807854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-069f25ed-4882-4bef-a058-6228bcd3ef7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:53.808676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-069f25ed-4882-4bef-a058-6228bcd3ef7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:53.816263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-069f25ed-4882-4bef-a058-6228bcd3ef7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:53.817042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-069f25ed-4882-4bef-a058-6228bcd3ef7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:53.818105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-069f25ed-4882-4bef-a058-6228bcd3ef7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:53.819012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-069f25ed-4882-4bef-a058-6228bcd3ef7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:53.820141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-069f25ed-4882-4bef-a058-6228bcd3ef7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:53.820727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-069f25ed-4882-4bef-a058-6228bcd3ef7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:54.056269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cbcf2bd0-d49c-4d49-b333-c50edfc9eab9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:54.066334 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cbcf2bd0-d49c-4d49-b333-c50edfc9eab9 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1363 microversion: 2.1 time: 0.578763 Oct 11 04:34:54.067303 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2515/5289] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:53 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1363 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:54.072222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:54.073082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:54.081262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:54.081829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:54.082363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:54.083125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:54.083802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:54.084297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:54.223840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-069f25ed-4882-4bef-a058-6228bcd3ef7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:54.237155 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-069f25ed-4882-4bef-a058-6228bcd3ef7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1513 microversion: 2.1 time: 0.433071 Oct 11 04:34:54.243543 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2775/5290] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:53 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1513 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:54.435078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-63392032-d979-41f7-97ab-3e2d858cf7ef tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:54.435962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-63392032-d979-41f7-97ab-3e2d858cf7ef tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:54.457005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:54.461528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63392032-d979-41f7-97ab-3e2d858cf7ef tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:54.466210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63392032-d979-41f7-97ab-3e2d858cf7ef tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:54.466694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63392032-d979-41f7-97ab-3e2d858cf7ef tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:54.467466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63392032-d979-41f7-97ab-3e2d858cf7ef tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:54.468026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63392032-d979-41f7-97ab-3e2d858cf7ef tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:54.468460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63392032-d979-41f7-97ab-3e2d858cf7ef tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:54.659374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:54.670690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:54.672447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:54.674226 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f1c2b080-88fc-4cf2-b5b3-bc81439244b6 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.605637 Oct 11 04:34:54.675113 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2516/5291] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:54 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:54.826766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9014102c-d31f-4b5b-9433-783f790375c0 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:54.827481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9014102c-d31f-4b5b-9433-783f790375c0 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:54.835270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9014102c-d31f-4b5b-9433-783f790375c0 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:54.836071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9014102c-d31f-4b5b-9433-783f790375c0 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:54.836817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9014102c-d31f-4b5b-9433-783f790375c0 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:54.837686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9014102c-d31f-4b5b-9433-783f790375c0 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:54.838222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9014102c-d31f-4b5b-9433-783f790375c0 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:54.838869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9014102c-d31f-4b5b-9433-783f790375c0 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:55.019039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-63392032-d979-41f7-97ab-3e2d858cf7ef tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:55.030394 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-63392032-d979-41f7-97ab-3e2d858cf7ef tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1328 microversion: 2.1 time: 0.600077 Oct 11 04:34:55.032370 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2776/5292] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:54 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1328 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:55.038627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4a1a03f1-817b-4b70-95e6-da2e18cd7f6f req-57c6a264-1563-408d-8a41-62a4ea922db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1451d1bc-1e82-4436-8f11-4cc54dcd4ec8", "tag": "942e4314-fba3-4b1d-a9aa-e410d5ed23b4"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:55.050594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4a1a03f1-817b-4b70-95e6-da2e18cd7f6f req-57c6a264-1563-408d-8a41-62a4ea922db9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:55.051168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4a1a03f1-817b-4b70-95e6-da2e18cd7f6f req-57c6a264-1563-408d-8a41-62a4ea922db9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:55.051668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4a1a03f1-817b-4b70-95e6-da2e18cd7f6f req-57c6a264-1563-408d-8a41-62a4ea922db9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:55.070161 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4a1a03f1-817b-4b70-95e6-da2e18cd7f6f req-57c6a264-1563-408d-8a41-62a4ea922db9 service nova] Creating event network-changed:942e4314-fba3-4b1d-a9aa-e410d5ed23b4 for instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 on n-h1-860892-1 Oct 11 04:34:55.075406 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4a1a03f1-817b-4b70-95e6-da2e18cd7f6f req-57c6a264-1563-408d-8a41-62a4ea922db9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043172 Oct 11 04:34:55.076365 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2777/5293] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:55.090545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25e1a6f4-b753-4767-80cb-8a39e60c76e8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:55.091514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-25e1a6f4-b753-4767-80cb-8a39e60c76e8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:55.100514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25e1a6f4-b753-4767-80cb-8a39e60c76e8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:55.101512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25e1a6f4-b753-4767-80cb-8a39e60c76e8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:55.102344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25e1a6f4-b753-4767-80cb-8a39e60c76e8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:55.103008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25e1a6f4-b753-4767-80cb-8a39e60c76e8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:55.103462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25e1a6f4-b753-4767-80cb-8a39e60c76e8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:55.103886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25e1a6f4-b753-4767-80cb-8a39e60c76e8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:55.298011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9014102c-d31f-4b5b-9433-783f790375c0 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:55.306455 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9014102c-d31f-4b5b-9433-783f790375c0 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1670 microversion: 2.1 time: 0.483897 Oct 11 04:34:55.307081 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2517/5294] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:54 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1670 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:55.328453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3da1d9fe-bc97-4e47-b112-78abef1620d5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:55.329070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3da1d9fe-bc97-4e47-b112-78abef1620d5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:55.335811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3da1d9fe-bc97-4e47-b112-78abef1620d5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:55.336292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3da1d9fe-bc97-4e47-b112-78abef1620d5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:55.336927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3da1d9fe-bc97-4e47-b112-78abef1620d5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:55.337624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3da1d9fe-bc97-4e47-b112-78abef1620d5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:55.338076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3da1d9fe-bc97-4e47-b112-78abef1620d5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:55.338523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3da1d9fe-bc97-4e47-b112-78abef1620d5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:55.355159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:55.610924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25e1a6f4-b753-4767-80cb-8a39e60c76e8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:55.620098 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-25e1a6f4-b753-4767-80cb-8a39e60c76e8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1363 microversion: 2.1 time: 0.534719 Oct 11 04:34:55.620857 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2778/5295] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:55 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1363 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:55.705353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:55.706227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:55.713731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:55.714521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:55.714958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:55.715849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:55.716310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:55.716738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:55.928093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=26 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:56.036863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:56.049266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:56.050859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:56.052112 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e5e7d5d5-f8a6-4de5-bd33-10c091041687 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.350779 Oct 11 04:34:56.053572 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2779/5296] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:55 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:56.065243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-107e90ce-df00-42e8-9b0f-eeedff4c1f89 req-db446991-0571-4f38-aaa7-cdb421f4df07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b45813-cd45-4fed-ae2b-9f2b1c5bc457", "tag": "c01d4853-a4bd-4db8-a2bd-9014e950ba88"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:56.070760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-107e90ce-df00-42e8-9b0f-eeedff4c1f89 req-db446991-0571-4f38-aaa7-cdb421f4df07 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:56.071496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-107e90ce-df00-42e8-9b0f-eeedff4c1f89 req-db446991-0571-4f38-aaa7-cdb421f4df07 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:56.072057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-107e90ce-df00-42e8-9b0f-eeedff4c1f89 req-db446991-0571-4f38-aaa7-cdb421f4df07 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:56.084383 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-107e90ce-df00-42e8-9b0f-eeedff4c1f89 req-db446991-0571-4f38-aaa7-cdb421f4df07 service nova] Creating event network-changed:c01d4853-a4bd-4db8-a2bd-9014e950ba88 for instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 on n-h1-860892-1 Oct 11 04:34:56.089172 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-107e90ce-df00-42e8-9b0f-eeedff4c1f89 req-db446991-0571-4f38-aaa7-cdb421f4df07 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034515 Oct 11 04:34:56.090102 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2780/5297] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:56.098691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db120c2d-6b06-4ad3-857f-415b0fe7e17d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:56.098691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-db120c2d-6b06-4ad3-857f-415b0fe7e17d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:56.102817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db120c2d-6b06-4ad3-857f-415b0fe7e17d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:56.103301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db120c2d-6b06-4ad3-857f-415b0fe7e17d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:56.103738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db120c2d-6b06-4ad3-857f-415b0fe7e17d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:56.104426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db120c2d-6b06-4ad3-857f-415b0fe7e17d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:56.104911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db120c2d-6b06-4ad3-857f-415b0fe7e17d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:56.105678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db120c2d-6b06-4ad3-857f-415b0fe7e17d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:56.137074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3da1d9fe-bc97-4e47-b112-78abef1620d5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:56.145503 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3da1d9fe-bc97-4e47-b112-78abef1620d5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1513 microversion: 2.1 time: 0.821442 Oct 11 04:34:56.146581 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2518/5298] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:55 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1513 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:56.257962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-db120c2d-6b06-4ad3-857f-415b0fe7e17d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:56.267519 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-db120c2d-6b06-4ad3-857f-415b0fe7e17d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1328 microversion: 2.1 time: 0.176181 Oct 11 04:34:56.270778 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2781/5299] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:56 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1328 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:56.335188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-428b6b79-1a84-4848-a959-d65f45e6dd1e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:56.336430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-428b6b79-1a84-4848-a959-d65f45e6dd1e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:56.343740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428b6b79-1a84-4848-a959-d65f45e6dd1e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:56.348848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428b6b79-1a84-4848-a959-d65f45e6dd1e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:56.348848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428b6b79-1a84-4848-a959-d65f45e6dd1e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:56.348848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428b6b79-1a84-4848-a959-d65f45e6dd1e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:56.348848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428b6b79-1a84-4848-a959-d65f45e6dd1e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:56.348848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428b6b79-1a84-4848-a959-d65f45e6dd1e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:56.367078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:56.451190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-428b6b79-1a84-4848-a959-d65f45e6dd1e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:56.463523 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-428b6b79-1a84-4848-a959-d65f45e6dd1e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1484 microversion: 2.1 time: 0.132180 Oct 11 04:34:56.466355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2519/5300] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:56 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1484 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:56.645272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-70e03cb6-b33c-4502-aa98-b3a1d4803901 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:56.649509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-70e03cb6-b33c-4502-aa98-b3a1d4803901 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:56.652017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70e03cb6-b33c-4502-aa98-b3a1d4803901 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:56.652498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70e03cb6-b33c-4502-aa98-b3a1d4803901 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:56.652933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70e03cb6-b33c-4502-aa98-b3a1d4803901 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:56.653622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70e03cb6-b33c-4502-aa98-b3a1d4803901 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:56.654074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70e03cb6-b33c-4502-aa98-b3a1d4803901 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:56.654605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-70e03cb6-b33c-4502-aa98-b3a1d4803901 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:56.789227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-70e03cb6-b33c-4502-aa98-b3a1d4803901 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:56.797416 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-70e03cb6-b33c-4502-aa98-b3a1d4803901 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1363 microversion: 2.1 time: 0.156775 Oct 11 04:34:56.798648 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2782/5301] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:56 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:57.080345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:57.081462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:57.088334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:57.088821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:57.089828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:57.090820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:57.091505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:57.091989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:57.101400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1e3984b6-92f5-4107-87b3-490b90c98fa1 req-4075b6ed-a508-4894-a733-c60324fed294 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24168887-732a-4aa1-b723-e789feed3002", "name": "network-vif-deleted", "tag": "0b4de9d4-3966-4f60-a837-066bba5af6b5"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:57.112205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1e3984b6-92f5-4107-87b3-490b90c98fa1 req-4075b6ed-a508-4894-a733-c60324fed294 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:57.112967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1e3984b6-92f5-4107-87b3-490b90c98fa1 req-4075b6ed-a508-4894-a733-c60324fed294 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:57.113571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1e3984b6-92f5-4107-87b3-490b90c98fa1 req-4075b6ed-a508-4894-a733-c60324fed294 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:57.136346 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1e3984b6-92f5-4107-87b3-490b90c98fa1 req-4075b6ed-a508-4894-a733-c60324fed294 service nova] Creating event network-vif-deleted:0b4de9d4-3966-4f60-a837-066bba5af6b5 for instance 24168887-732a-4aa1-b723-e789feed3002 on n-h1-860892-1 Oct 11 04:34:57.143196 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1e3984b6-92f5-4107-87b3-490b90c98fa1 req-4075b6ed-a508-4894-a733-c60324fed294 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045358 Oct 11 04:34:57.144222 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2783/5302] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:34:57.171053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-081e32c6-47d5-4777-bce0-6b950008df09 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:57.171695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-081e32c6-47d5-4777-bce0-6b950008df09 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:57.178553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-081e32c6-47d5-4777-bce0-6b950008df09 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:57.179049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-081e32c6-47d5-4777-bce0-6b950008df09 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:57.179490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-081e32c6-47d5-4777-bce0-6b950008df09 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:57.180193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-081e32c6-47d5-4777-bce0-6b950008df09 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:57.180651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-081e32c6-47d5-4777-bce0-6b950008df09 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:57.181081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-081e32c6-47d5-4777-bce0-6b950008df09 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:57.317667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:34:57.333235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-081e32c6-47d5-4777-bce0-6b950008df09 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:57.342417 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-081e32c6-47d5-4777-bce0-6b950008df09 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1513 microversion: 2.1 time: 0.175584 Oct 11 04:34:57.343348 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2784/5303] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:57 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1513 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:34:57.352478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-10ee750d-264d-4330-b2ee-86f80a97f4e1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:57.352478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-10ee750d-264d-4330-b2ee-86f80a97f4e1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:57.356719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10ee750d-264d-4330-b2ee-86f80a97f4e1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:57.357216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10ee750d-264d-4330-b2ee-86f80a97f4e1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:57.357650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10ee750d-264d-4330-b2ee-86f80a97f4e1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:57.358412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10ee750d-264d-4330-b2ee-86f80a97f4e1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:57.359064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10ee750d-264d-4330-b2ee-86f80a97f4e1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:57.360140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10ee750d-264d-4330-b2ee-86f80a97f4e1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:57.485249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:57.495938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:57.497641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:57.500503 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d739a27-91e0-4531-bb6e-513d35dc403b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.423784 Oct 11 04:34:57.500503 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2520/5304] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:57 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:34:57.504525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c86f6986-78a5-4f05-82f9-0210d33a0369 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:57.505135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c86f6986-78a5-4f05-82f9-0210d33a0369 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:57.512732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c86f6986-78a5-4f05-82f9-0210d33a0369 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:57.513461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c86f6986-78a5-4f05-82f9-0210d33a0369 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:57.514175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c86f6986-78a5-4f05-82f9-0210d33a0369 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:57.515558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c86f6986-78a5-4f05-82f9-0210d33a0369 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:57.516372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c86f6986-78a5-4f05-82f9-0210d33a0369 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:57.517306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c86f6986-78a5-4f05-82f9-0210d33a0369 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:57.519652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-10ee750d-264d-4330-b2ee-86f80a97f4e1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:57.533336 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-10ee750d-264d-4330-b2ee-86f80a97f4e1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1328 microversion: 2.1 time: 0.187747 Oct 11 04:34:57.534219 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2785/5305] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:57 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1328 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:57.610310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c86f6986-78a5-4f05-82f9-0210d33a0369 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:57.619682 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c86f6986-78a5-4f05-82f9-0210d33a0369 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 200 len: 1484 microversion: 2.1 time: 0.118887 Oct 11 04:34:57.620579 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2521/5306] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:57 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 1484 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:57.824231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de207a05-2efb-4ec5-aab8-06723383ed35 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:57.825042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-de207a05-2efb-4ec5-aab8-06723383ed35 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:57.835208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de207a05-2efb-4ec5-aab8-06723383ed35 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:57.836214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de207a05-2efb-4ec5-aab8-06723383ed35 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:57.836860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de207a05-2efb-4ec5-aab8-06723383ed35 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:57.837804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de207a05-2efb-4ec5-aab8-06723383ed35 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:57.838659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de207a05-2efb-4ec5-aab8-06723383ed35 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:57.839410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de207a05-2efb-4ec5-aab8-06723383ed35 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:58.123331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-3f75d6c0-9796-4312-acf2-a64c4dc73199 req-97ba61ae-0972-42a8-b0fd-aadb10588c83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "tag": "665442b9-2aa6-4687-b61d-1f39a176e14f"}, {"name": "network-changed", "server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "tag": "f193892e-4606-44c5-8ce9-edc616f636e4"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:34:58.148700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3f75d6c0-9796-4312-acf2-a64c4dc73199 req-97ba61ae-0972-42a8-b0fd-aadb10588c83 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:58.150822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3f75d6c0-9796-4312-acf2-a64c4dc73199 req-97ba61ae-0972-42a8-b0fd-aadb10588c83 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:58.153207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3f75d6c0-9796-4312-acf2-a64c4dc73199 req-97ba61ae-0972-42a8-b0fd-aadb10588c83 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:58.182410 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-3f75d6c0-9796-4312-acf2-a64c4dc73199 req-97ba61ae-0972-42a8-b0fd-aadb10588c83 service nova] Creating event network-changed:665442b9-2aa6-4687-b61d-1f39a176e14f for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:34:58.183311 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-3f75d6c0-9796-4312-acf2-a64c4dc73199 req-97ba61ae-0972-42a8-b0fd-aadb10588c83 service nova] Creating event network-changed:f193892e-4606-44c5-8ce9-edc616f636e4 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:34:58.192965 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-3f75d6c0-9796-4312-acf2-a64c4dc73199 req-97ba61ae-0972-42a8-b0fd-aadb10588c83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.072627 Oct 11 04:34:58.194857 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2522/5307] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:34:58 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:34:58.366373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-de207a05-2efb-4ec5-aab8-06723383ed35 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:58.373713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f57409b0-6ea8-477e-9d54-537bf522ad7d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:58.375119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f57409b0-6ea8-477e-9d54-537bf522ad7d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:58.375978 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-de207a05-2efb-4ec5-aab8-06723383ed35 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1363 microversion: 2.1 time: 0.558228 Oct 11 04:34:58.378539 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2786/5308] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:57 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1363 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:58.398220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57409b0-6ea8-477e-9d54-537bf522ad7d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:58.404353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57409b0-6ea8-477e-9d54-537bf522ad7d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:58.404353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57409b0-6ea8-477e-9d54-537bf522ad7d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:58.404353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57409b0-6ea8-477e-9d54-537bf522ad7d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:58.404353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57409b0-6ea8-477e-9d54-537bf522ad7d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:58.404353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f57409b0-6ea8-477e-9d54-537bf522ad7d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:58.527824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:58.528508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:58.535950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:58.540537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:58.540537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:58.540537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:58.540537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:58.540537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:58.787607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:58.798714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:58.800240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:58.801581 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fca24701-aa55-479b-a6b9-3f94e5bce02c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.278363 Oct 11 04:34:58.802640 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2787/5309] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:58 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:34:58.807453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-18ef6502-0b63-4039-bde8-bf6bb1f3f8f6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:58.808093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-18ef6502-0b63-4039-bde8-bf6bb1f3f8f6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:58.824471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18ef6502-0b63-4039-bde8-bf6bb1f3f8f6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:58.824979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18ef6502-0b63-4039-bde8-bf6bb1f3f8f6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:58.825629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18ef6502-0b63-4039-bde8-bf6bb1f3f8f6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:58.826396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18ef6502-0b63-4039-bde8-bf6bb1f3f8f6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:58.827023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18ef6502-0b63-4039-bde8-bf6bb1f3f8f6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:58.828498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18ef6502-0b63-4039-bde8-bf6bb1f3f8f6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:59.061034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-18ef6502-0b63-4039-bde8-bf6bb1f3f8f6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:59.073178 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-18ef6502-0b63-4039-bde8-bf6bb1f3f8f6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1328 microversion: 2.1 time: 0.269408 Oct 11 04:34:59.073773 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2788/5310] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:58 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1328 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:59.078427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:59.079650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 24168887-732a-4aa1-b723-e789feed3002] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:59.090379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:59.090379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:59.090379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:59.090379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:59.090379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:59.090379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:59.102058 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] HTTP exception thrown: Instance 24168887-732a-4aa1-b723-e789feed3002 could not be found. Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Request method failure captured: Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 HTTP/1.1 Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPGkWxy3OtSgAGPLdTkFtYFvELislRCTj6KM7bq7fM9-tVBqZFS9x88of4rCD9CeDlGa8j810_nEPQHvxJFa8fQACoYg5xJ1ENm2zuLmeaB_ksi97w0YCZO7PO8MrSKsyAzCX3oPd1kIKI1jUDRiRIIwcwOUhk95JpYD630bDrQ19e4 Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 13a4630fe9284b8b83a7bd9a7ef4ce95 Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestNetworkBasicOps-93795933 Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13a4630fe9284b8b83a7bd9a7ef4ce95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13a4630fe9284b8b83a7bd9a7ef4ce95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13a4630fe9284b8b83a7bd9a7ef4ce95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13a4630fe9284b8b83a7bd9a7ef4ce95"}]}] Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestNetworkBasicOps-93795933 Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 13a4630fe9284b8b83a7bd9a7ef4ce95 Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestNetworkBasicOps-93795933 Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestNetworkBasicOps-93795933-project Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 752975bff6034a7086aafa3319a4f1d4 Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestNetworkBasicOps-93795933-project Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 24168887-732a-4aa1-b723-e789feed3002 could not be found. Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '24168887-732a-4aa1-b723-e789feed3002'} Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24168887-732a-4aa1-b723-e789feed3002 could not be found. Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24168887-732a-4aa1-b723-e789feed3002 could not be found. Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:34:59.103829 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:59.109182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:34:59.109182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:34:59.109182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:34:59.109182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:34:59.109182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:34:59.109182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24168887-732a-4aa1-b723-e789feed3002 could not be found. Oct 11 04:34:59.109182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:34:59.109182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Returning 404 to user: Instance 24168887-732a-4aa1-b723-e789feed3002 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:34:59.109182 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d0b6b4ff-bf6d-4d1e-8d46-d5b19f119028 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002" status: 404 len: 111 microversion: 2.1 time: 0.030442 Oct 11 04:34:59.109182 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2789/5311] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:59 2022] GET /compute/v2.1/servers/24168887-732a-4aa1-b723-e789feed3002 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:34:59.174645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f57409b0-6ea8-477e-9d54-537bf522ad7d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:59.184840 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f57409b0-6ea8-477e-9d54-537bf522ad7d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1534 microversion: 2.1 time: 0.819406 Oct 11 04:34:59.196194 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2523/5312] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:58 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1534 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:59.399345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fa9337f0-0039-4ba8-ab0c-16f18b86508c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:59.400455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fa9337f0-0039-4ba8-ab0c-16f18b86508c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:59.407265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9337f0-0039-4ba8-ab0c-16f18b86508c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:59.408522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9337f0-0039-4ba8-ab0c-16f18b86508c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:59.408960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9337f0-0039-4ba8-ab0c-16f18b86508c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:59.409657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9337f0-0039-4ba8-ab0c-16f18b86508c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:59.410110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9337f0-0039-4ba8-ab0c-16f18b86508c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:59.410554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9337f0-0039-4ba8-ab0c-16f18b86508c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:59.465626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a5194dc1-76fe-4791-b5fd-18d663068ae1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '.version_select at 0x7fda1a1b91f0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:59.710966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fa9337f0-0039-4ba8-ab0c-16f18b86508c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:34:59.722503 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fa9337f0-0039-4ba8-ab0c-16f18b86508c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1363 microversion: 2.1 time: 0.326735 Oct 11 04:34:59.741117 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2790/5313] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:34:59 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:34:59.742355 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a5194dc1-76fe-4791-b5fd-18d663068ae1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1596601567" status: 202 len: 0 microversion: 2.1 time: 0.281332 Oct 11 04:34:59.744546 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2524/5314] 10.222.0.26 () {58 vars in 1257 bytes} [Tue Oct 11 04:34:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-1596601567 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:34:59.829567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:34:59.830770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:34:59.842061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:59.845289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:59.846382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:34:59.846647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:34:59.847114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:34:59.847914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:00.102282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce1e4af4-6ebd-479d-9c31-4fc9dcc50ed9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:00.103226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce1e4af4-6ebd-479d-9c31-4fc9dcc50ed9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:00.120342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:00.122331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce1e4af4-6ebd-479d-9c31-4fc9dcc50ed9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:00.123063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce1e4af4-6ebd-479d-9c31-4fc9dcc50ed9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:00.124660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce1e4af4-6ebd-479d-9c31-4fc9dcc50ed9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:00.125618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce1e4af4-6ebd-479d-9c31-4fc9dcc50ed9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:00.126374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce1e4af4-6ebd-479d-9c31-4fc9dcc50ed9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:00.127029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce1e4af4-6ebd-479d-9c31-4fc9dcc50ed9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:00.142565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:00.145094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:00.153570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:00.160543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:00.163224 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e7fcf01-3b5a-484b-b5b1-5c0b07e807b1 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.337919 Oct 11 04:35:00.168281 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2791/5315] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:34:59 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:00.210878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9146e4a9-f479-4124-b1d6-7a649b41a3ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:00.211496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9146e4a9-f479-4124-b1d6-7a649b41a3ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:00.226162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9146e4a9-f479-4124-b1d6-7a649b41a3ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:00.226683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9146e4a9-f479-4124-b1d6-7a649b41a3ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:00.227123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9146e4a9-f479-4124-b1d6-7a649b41a3ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:00.227941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9146e4a9-f479-4124-b1d6-7a649b41a3ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:00.228386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9146e4a9-f479-4124-b1d6-7a649b41a3ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:00.228809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9146e4a9-f479-4124-b1d6-7a649b41a3ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:00.467065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce1e4af4-6ebd-479d-9c31-4fc9dcc50ed9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:00.474349 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce1e4af4-6ebd-479d-9c31-4fc9dcc50ed9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1328 microversion: 2.1 time: 0.379628 Oct 11 04:35:00.491826 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2525/5316] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:00 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1328 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:00.497061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-295137ec-d6f2-4b8e-86d8-9e481cd27577 req-9f6a1abf-74c5-4a08-ac66-917d16341568 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "tag": "9e71def9-e943-4b32-a256-31fe7ded5fd0"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:00.513219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-295137ec-d6f2-4b8e-86d8-9e481cd27577 req-9f6a1abf-74c5-4a08-ac66-917d16341568 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:00.514667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-295137ec-d6f2-4b8e-86d8-9e481cd27577 req-9f6a1abf-74c5-4a08-ac66-917d16341568 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:00.515284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-295137ec-d6f2-4b8e-86d8-9e481cd27577 req-9f6a1abf-74c5-4a08-ac66-917d16341568 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:00.528405 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-295137ec-d6f2-4b8e-86d8-9e481cd27577 req-9f6a1abf-74c5-4a08-ac66-917d16341568 service nova] Creating event network-changed:9e71def9-e943-4b32-a256-31fe7ded5fd0 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:35:00.534928 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-295137ec-d6f2-4b8e-86d8-9e481cd27577 req-9f6a1abf-74c5-4a08-ac66-917d16341568 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041540 Oct 11 04:35:00.535949 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2526/5317] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:00.712834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9146e4a9-f479-4124-b1d6-7a649b41a3ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:00.728021 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9146e4a9-f479-4124-b1d6-7a649b41a3ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.518785 Oct 11 04:35:00.729594 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2792/5318] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:00 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:00.756847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-74d78b0f-74ea-481a-88f7-27bef18dc510 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:00.757572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-74d78b0f-74ea-481a-88f7-27bef18dc510 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:00.765196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74d78b0f-74ea-481a-88f7-27bef18dc510 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:00.765943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74d78b0f-74ea-481a-88f7-27bef18dc510 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:00.767172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74d78b0f-74ea-481a-88f7-27bef18dc510 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:00.769076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74d78b0f-74ea-481a-88f7-27bef18dc510 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:00.770418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74d78b0f-74ea-481a-88f7-27bef18dc510 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:00.772373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74d78b0f-74ea-481a-88f7-27bef18dc510 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:01.098869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-74d78b0f-74ea-481a-88f7-27bef18dc510 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:01.111262 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-74d78b0f-74ea-481a-88f7-27bef18dc510 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1363 microversion: 2.1 time: 0.359311 Oct 11 04:35:01.117547 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2527/5319] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:00 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:01.195875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:01.196492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:01.214306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:01.215247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:01.215869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:01.216751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:01.217372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:01.217965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:01.497523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c6bf77b7-ae2b-4107-b09d-1f157d52f278 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:01.498331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c6bf77b7-ae2b-4107-b09d-1f157d52f278 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:01.506242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6bf77b7-ae2b-4107-b09d-1f157d52f278 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:01.534128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6bf77b7-ae2b-4107-b09d-1f157d52f278 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:01.536850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6bf77b7-ae2b-4107-b09d-1f157d52f278 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:01.538150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6bf77b7-ae2b-4107-b09d-1f157d52f278 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:01.540950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6bf77b7-ae2b-4107-b09d-1f157d52f278 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:01.542961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6bf77b7-ae2b-4107-b09d-1f157d52f278 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:01.955079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c6bf77b7-ae2b-4107-b09d-1f157d52f278 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:01.963238 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c6bf77b7-ae2b-4107-b09d-1f157d52f278 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1328 microversion: 2.1 time: 0.469641 Oct 11 04:35:01.969444 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2528/5320] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:01 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1328 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:01.986915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1b92ca20-e75d-4ba9-a3f2-f37d5e0b8fb2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:01.988279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1b92ca20-e75d-4ba9-a3f2-f37d5e0b8fb2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:02.003929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b92ca20-e75d-4ba9-a3f2-f37d5e0b8fb2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:02.007975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b92ca20-e75d-4ba9-a3f2-f37d5e0b8fb2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:02.010953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b92ca20-e75d-4ba9-a3f2-f37d5e0b8fb2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:02.014621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b92ca20-e75d-4ba9-a3f2-f37d5e0b8fb2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:02.017819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b92ca20-e75d-4ba9-a3f2-f37d5e0b8fb2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:02.018548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b92ca20-e75d-4ba9-a3f2-f37d5e0b8fb2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:02.374412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1b92ca20-e75d-4ba9-a3f2-f37d5e0b8fb2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:02.385384 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1b92ca20-e75d-4ba9-a3f2-f37d5e0b8fb2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.412099 Oct 11 04:35:02.385976 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2529/5321] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:01 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:02.405233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:02.410598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5b155fcb-0f06-4105-bc76-6d62943f0402 req-7e8fae78-34bb-4e4b-b759-8ace666c8c4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90650e13-1fd0-479b-972e-d36b6521b37f", "name": "network-vif-plugged", "status": "completed", "tag": "04a8a7cd-3242-44a3-b767-f91dca6b2149"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:02.424831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5b155fcb-0f06-4105-bc76-6d62943f0402 req-7e8fae78-34bb-4e4b-b759-8ace666c8c4d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:02.426163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5b155fcb-0f06-4105-bc76-6d62943f0402 req-7e8fae78-34bb-4e4b-b759-8ace666c8c4d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:02.427049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5b155fcb-0f06-4105-bc76-6d62943f0402 req-7e8fae78-34bb-4e4b-b759-8ace666c8c4d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:02.429123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:02.430633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:02.440378 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2941890c-9162-4f22-abb0-a4fe838a2b5a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 1.248649 Oct 11 04:35:02.440997 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2793/5322] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:01 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 1250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:02.459528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-526a8d59-ce1d-484f-a149-7accc34d4f85 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:02.465625 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5b155fcb-0f06-4105-bc76-6d62943f0402 req-7e8fae78-34bb-4e4b-b759-8ace666c8c4d service nova] Creating event network-vif-plugged:04a8a7cd-3242-44a3-b767-f91dca6b2149 for instance 90650e13-1fd0-479b-972e-d36b6521b37f on n-h2-860892-1 Oct 11 04:35:02.466747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-526a8d59-ce1d-484f-a149-7accc34d4f85 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:02.472369 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5b155fcb-0f06-4105-bc76-6d62943f0402 req-7e8fae78-34bb-4e4b-b759-8ace666c8c4d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067476 Oct 11 04:35:02.473336 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2530/5323] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:02.484164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-526a8d59-ce1d-484f-a149-7accc34d4f85 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:02.484670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-526a8d59-ce1d-484f-a149-7accc34d4f85 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:02.485143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-526a8d59-ce1d-484f-a149-7accc34d4f85 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:02.485867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-526a8d59-ce1d-484f-a149-7accc34d4f85 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:02.486367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-526a8d59-ce1d-484f-a149-7accc34d4f85 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:02.486803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-526a8d59-ce1d-484f-a149-7accc34d4f85 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:02.873709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-526a8d59-ce1d-484f-a149-7accc34d4f85 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:02.883992 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-526a8d59-ce1d-484f-a149-7accc34d4f85 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1363 microversion: 2.1 time: 0.441920 Oct 11 04:35:02.889208 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2794/5324] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:02 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1363 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:02.999372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-36aaa952-ad5b-426d-9878-8412381e674a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:03.003718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-36aaa952-ad5b-426d-9878-8412381e674a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:03.014687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36aaa952-ad5b-426d-9878-8412381e674a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:03.016880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36aaa952-ad5b-426d-9878-8412381e674a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:03.021085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36aaa952-ad5b-426d-9878-8412381e674a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:03.023166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36aaa952-ad5b-426d-9878-8412381e674a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:03.023819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36aaa952-ad5b-426d-9878-8412381e674a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:03.024468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36aaa952-ad5b-426d-9878-8412381e674a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:03.299451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-36aaa952-ad5b-426d-9878-8412381e674a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:03.311334 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-36aaa952-ad5b-426d-9878-8412381e674a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1328 microversion: 2.1 time: 0.316308 Oct 11 04:35:03.312316 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2531/5325] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:02 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1328 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:03.409960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6aab1757-4b4a-4500-8abd-a46e6bc1513c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:03.410610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6aab1757-4b4a-4500-8abd-a46e6bc1513c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:03.420838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aab1757-4b4a-4500-8abd-a46e6bc1513c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:03.421473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aab1757-4b4a-4500-8abd-a46e6bc1513c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:03.424824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aab1757-4b4a-4500-8abd-a46e6bc1513c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:03.426633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aab1757-4b4a-4500-8abd-a46e6bc1513c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:03.428601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aab1757-4b4a-4500-8abd-a46e6bc1513c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:03.429857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aab1757-4b4a-4500-8abd-a46e6bc1513c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:03.470909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:03.471898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:03.486113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:03.486113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:03.486113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:03.489788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:03.490570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:03.491980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:03.916691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:03.935938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:03.937620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:03.942334 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-51ca1867-56ce-4880-839f-ebb4a91e9d17 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.478238 Oct 11 04:35:03.945241 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2532/5326] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:03 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:03.956918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4ce6855-62b6-491b-8171-1f3cee108742 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:03.957905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f4ce6855-62b6-491b-8171-1f3cee108742 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:03.973771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ce6855-62b6-491b-8171-1f3cee108742 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:03.974453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ce6855-62b6-491b-8171-1f3cee108742 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:03.975164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ce6855-62b6-491b-8171-1f3cee108742 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:03.979231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ce6855-62b6-491b-8171-1f3cee108742 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:03.980169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ce6855-62b6-491b-8171-1f3cee108742 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:03.980732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4ce6855-62b6-491b-8171-1f3cee108742 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:04.118276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6aab1757-4b4a-4500-8abd-a46e6bc1513c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:04.141061 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6aab1757-4b4a-4500-8abd-a46e6bc1513c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.734606 Oct 11 04:35:04.143248 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2795/5327] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:03 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:04.335351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4b8f87a2-4d76-4276-a7e1-53588ac94719 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:04.337489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4b8f87a2-4d76-4276-a7e1-53588ac94719 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:04.350229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8f87a2-4d76-4276-a7e1-53588ac94719 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:04.350747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8f87a2-4d76-4276-a7e1-53588ac94719 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:04.352917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8f87a2-4d76-4276-a7e1-53588ac94719 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:04.355375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8f87a2-4d76-4276-a7e1-53588ac94719 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:04.356067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8f87a2-4d76-4276-a7e1-53588ac94719 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:04.356892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8f87a2-4d76-4276-a7e1-53588ac94719 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:04.393989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4ce6855-62b6-491b-8171-1f3cee108742 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:04.406074 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f4ce6855-62b6-491b-8171-1f3cee108742 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1363 microversion: 2.1 time: 0.460721 Oct 11 04:35:04.421339 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2533/5328] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:03 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1363 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:04.498230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-4a8adbd5-f197-4acf-8bb8-ae446bdfc948 req-a36c8363-95d7-4fcd-9f68-3bd3e6b7e341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1451d1bc-1e82-4436-8f11-4cc54dcd4ec8", "name": "network-vif-plugged", "status": "completed", "tag": "942e4314-fba3-4b1d-a9aa-e410d5ed23b4"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:04.541617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4a8adbd5-f197-4acf-8bb8-ae446bdfc948 req-a36c8363-95d7-4fcd-9f68-3bd3e6b7e341 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:04.542777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4a8adbd5-f197-4acf-8bb8-ae446bdfc948 req-a36c8363-95d7-4fcd-9f68-3bd3e6b7e341 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:04.546503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4a8adbd5-f197-4acf-8bb8-ae446bdfc948 req-a36c8363-95d7-4fcd-9f68-3bd3e6b7e341 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:04.572567 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-4a8adbd5-f197-4acf-8bb8-ae446bdfc948 req-a36c8363-95d7-4fcd-9f68-3bd3e6b7e341 service nova] Creating event network-vif-plugged:942e4314-fba3-4b1d-a9aa-e410d5ed23b4 for instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 on n-h1-860892-1 Oct 11 04:35:04.586395 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-4a8adbd5-f197-4acf-8bb8-ae446bdfc948 req-a36c8363-95d7-4fcd-9f68-3bd3e6b7e341 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090708 Oct 11 04:35:04.590541 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2534/5329] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:35:04.978939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:04.980076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:04.989089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:04.990011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:04.990707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:04.991652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:04.992519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:04.993157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:05.147272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4b8f87a2-4d76-4276-a7e1-53588ac94719 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:05.169855 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4b8f87a2-4d76-4276-a7e1-53588ac94719 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1328 microversion: 2.1 time: 0.838229 Oct 11 04:35:05.171295 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2796/5330] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:04 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1328 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:05.187171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bf81910c-468a-48d6-8462-33174239c7db tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:05.187943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bf81910c-468a-48d6-8462-33174239c7db tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:05.198540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf81910c-468a-48d6-8462-33174239c7db tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:05.199050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf81910c-468a-48d6-8462-33174239c7db tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:05.199496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf81910c-468a-48d6-8462-33174239c7db tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:05.204519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf81910c-468a-48d6-8462-33174239c7db tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:05.205084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf81910c-468a-48d6-8462-33174239c7db tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:05.205539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf81910c-468a-48d6-8462-33174239c7db tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:05.310847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:05.325653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:05.327078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:05.328259 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92999167-4e91-4d1d-9902-4b293ed4ce15 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.356656 Oct 11 04:35:05.329366 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2535/5331] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:04 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:05.435847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-15caae9a-2b09-4a2b-8625-1d7acf8c1d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:05.437409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-15caae9a-2b09-4a2b-8625-1d7acf8c1d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:05.450600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15caae9a-2b09-4a2b-8625-1d7acf8c1d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:05.451217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15caae9a-2b09-4a2b-8625-1d7acf8c1d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:05.451768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15caae9a-2b09-4a2b-8625-1d7acf8c1d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:05.452943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15caae9a-2b09-4a2b-8625-1d7acf8c1d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:05.453653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15caae9a-2b09-4a2b-8625-1d7acf8c1d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:05.456558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15caae9a-2b09-4a2b-8625-1d7acf8c1d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:05.966508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf81910c-468a-48d6-8462-33174239c7db tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:05.978658 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bf81910c-468a-48d6-8462-33174239c7db tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.794949 Oct 11 04:35:05.980067 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2797/5332] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:05 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:06.179923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-15caae9a-2b09-4a2b-8625-1d7acf8c1d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:06.191097 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-15caae9a-2b09-4a2b-8625-1d7acf8c1d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1363 microversion: 2.1 time: 0.759602 Oct 11 04:35:06.192321 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2536/5333] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:05 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1363 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:06.212885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0783191-4d3d-4ca8-94d3-1502a9926713 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:06.213802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c0783191-4d3d-4ca8-94d3-1502a9926713 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:06.222074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0783191-4d3d-4ca8-94d3-1502a9926713 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:06.222619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0783191-4d3d-4ca8-94d3-1502a9926713 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:06.223089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0783191-4d3d-4ca8-94d3-1502a9926713 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:06.224269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0783191-4d3d-4ca8-94d3-1502a9926713 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:06.224890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0783191-4d3d-4ca8-94d3-1502a9926713 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:06.225328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0783191-4d3d-4ca8-94d3-1502a9926713 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:06.357351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:06.358232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:06.364672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:06.365440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:06.366098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:06.367200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:06.367847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:06.368464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:06.606785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:06.622980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:06.624887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:06.626791 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-639a4ab4-7a03-4ac8-afe2-f140fe653c9b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.273798 Oct 11 04:35:06.627441 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2537/5334] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:06 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:06.665360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-62d84321-1766-4bd5-97ad-5c4638e09530 req-386c0605-edb9-46ac-832e-e6ecb1eff68b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b45813-cd45-4fed-ae2b-9f2b1c5bc457", "name": "network-vif-plugged", "status": "completed", "tag": "c01d4853-a4bd-4db8-a2bd-9014e950ba88"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:06.676913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-62d84321-1766-4bd5-97ad-5c4638e09530 req-386c0605-edb9-46ac-832e-e6ecb1eff68b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:06.678431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-62d84321-1766-4bd5-97ad-5c4638e09530 req-386c0605-edb9-46ac-832e-e6ecb1eff68b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:06.678593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0783191-4d3d-4ca8-94d3-1502a9926713 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:06.679410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-62d84321-1766-4bd5-97ad-5c4638e09530 req-386c0605-edb9-46ac-832e-e6ecb1eff68b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:06.696998 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-62d84321-1766-4bd5-97ad-5c4638e09530 req-386c0605-edb9-46ac-832e-e6ecb1eff68b service nova] Creating event network-vif-plugged:c01d4853-a4bd-4db8-a2bd-9014e950ba88 for instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 on n-h1-860892-1 Oct 11 04:35:06.698486 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c0783191-4d3d-4ca8-94d3-1502a9926713 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1328 microversion: 2.1 time: 0.490787 Oct 11 04:35:06.699199 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2798/5335] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:06 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1328 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:06.736201 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-62d84321-1766-4bd5-97ad-5c4638e09530 req-386c0605-edb9-46ac-832e-e6ecb1eff68b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079787 Oct 11 04:35:06.745960 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2538/5336] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:07.003425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cdb8bd1e-cf64-421f-955b-d312028369fe tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:07.004194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cdb8bd1e-cf64-421f-955b-d312028369fe tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:07.012277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdb8bd1e-cf64-421f-955b-d312028369fe tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:07.013208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdb8bd1e-cf64-421f-955b-d312028369fe tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:07.013831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdb8bd1e-cf64-421f-955b-d312028369fe tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:07.014742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdb8bd1e-cf64-421f-955b-d312028369fe tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:07.015386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdb8bd1e-cf64-421f-955b-d312028369fe tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:07.016028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdb8bd1e-cf64-421f-955b-d312028369fe tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:07.218914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d14c50f6-8855-43f8-8a79-8ad2f2f9a3be tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:07.219151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d14c50f6-8855-43f8-8a79-8ad2f2f9a3be tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:07.233240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d14c50f6-8855-43f8-8a79-8ad2f2f9a3be tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:07.233743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d14c50f6-8855-43f8-8a79-8ad2f2f9a3be tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:07.234211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d14c50f6-8855-43f8-8a79-8ad2f2f9a3be tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:07.234921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d14c50f6-8855-43f8-8a79-8ad2f2f9a3be tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:07.235908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d14c50f6-8855-43f8-8a79-8ad2f2f9a3be tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:07.236339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d14c50f6-8855-43f8-8a79-8ad2f2f9a3be tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:07.410494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cdb8bd1e-cf64-421f-955b-d312028369fe tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:07.424580 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cdb8bd1e-cf64-421f-955b-d312028369fe tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.425085 Oct 11 04:35:07.428083 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2799/5337] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:06 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:07.658413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:07.659445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:07.675445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:07.678083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:07.681952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:07.682888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:07.691173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:07.696964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:07.710018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d14c50f6-8855-43f8-8a79-8ad2f2f9a3be tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:07.731093 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d14c50f6-8855-43f8-8a79-8ad2f2f9a3be tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1363 microversion: 2.1 time: 0.517723 Oct 11 04:35:07.733409 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2539/5338] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:07 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1363 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:07.760981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cee9236e-1c12-4e0c-8e2c-72f99260a9c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:07.760981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cee9236e-1c12-4e0c-8e2c-72f99260a9c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:07.783382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cee9236e-1c12-4e0c-8e2c-72f99260a9c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:07.783898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cee9236e-1c12-4e0c-8e2c-72f99260a9c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:07.784344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cee9236e-1c12-4e0c-8e2c-72f99260a9c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:07.789066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cee9236e-1c12-4e0c-8e2c-72f99260a9c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:07.789853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cee9236e-1c12-4e0c-8e2c-72f99260a9c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:07.790625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cee9236e-1c12-4e0c-8e2c-72f99260a9c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:07.840371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:08.009082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cee9236e-1c12-4e0c-8e2c-72f99260a9c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:08.017899 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cee9236e-1c12-4e0c-8e2c-72f99260a9c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1510 microversion: 2.1 time: 0.283010 Oct 11 04:35:08.037609 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2540/5339] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:07 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1510 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:08.042917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f7ee5ae-da59-4116-9948-c0795fbb787b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:08.044552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3f7ee5ae-da59-4116-9948-c0795fbb787b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:08.055266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7ee5ae-da59-4116-9948-c0795fbb787b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:08.055772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7ee5ae-da59-4116-9948-c0795fbb787b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:08.056214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7ee5ae-da59-4116-9948-c0795fbb787b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:08.056923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7ee5ae-da59-4116-9948-c0795fbb787b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:08.057379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7ee5ae-da59-4116-9948-c0795fbb787b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:08.057858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7ee5ae-da59-4116-9948-c0795fbb787b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:08.358369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3f7ee5ae-da59-4116-9948-c0795fbb787b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:08.372988 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3f7ee5ae-da59-4116-9948-c0795fbb787b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1510 microversion: 2.1 time: 0.334007 Oct 11 04:35:08.376360 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2541/5340] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:08 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1510 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:08.427106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e89317a9-b73d-4eff-8f3b-51125186401c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:08.428410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e89317a9-b73d-4eff-8f3b-51125186401c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:08.431866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:08.446954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e89317a9-b73d-4eff-8f3b-51125186401c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:08.447623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e89317a9-b73d-4eff-8f3b-51125186401c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:08.448244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e89317a9-b73d-4eff-8f3b-51125186401c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:08.449153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e89317a9-b73d-4eff-8f3b-51125186401c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:08.449798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e89317a9-b73d-4eff-8f3b-51125186401c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:08.450407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e89317a9-b73d-4eff-8f3b-51125186401c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:08.473587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:08.481109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:08.485108 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bf78f600-4cc2-44c1-850d-901829f9e14c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.831010 Oct 11 04:35:08.486975 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2800/5341] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:07 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 835 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:08.499934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-57de6e9b-8774-4598-88f6-2fc253f45e49 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:08.502571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-57de6e9b-8774-4598-88f6-2fc253f45e49 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:08.523266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57de6e9b-8774-4598-88f6-2fc253f45e49 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:08.525477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57de6e9b-8774-4598-88f6-2fc253f45e49 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:08.526663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57de6e9b-8774-4598-88f6-2fc253f45e49 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:08.536424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57de6e9b-8774-4598-88f6-2fc253f45e49 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:08.536424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57de6e9b-8774-4598-88f6-2fc253f45e49 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:08.536424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57de6e9b-8774-4598-88f6-2fc253f45e49 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:08.537126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e89317a9-b73d-4eff-8f3b-51125186401c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:35:08.810597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-57de6e9b-8774-4598-88f6-2fc253f45e49 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:08.825648 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-57de6e9b-8774-4598-88f6-2fc253f45e49 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.336526 Oct 11 04:35:08.827318 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2801/5342] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:08 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:08.835520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7a8e73bb-387d-4cc5-9ef6-6bfa4e2d2498 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:08.836142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7a8e73bb-387d-4cc5-9ef6-6bfa4e2d2498 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:08.842065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:08.843719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a8e73bb-387d-4cc5-9ef6-6bfa4e2d2498 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:08.845051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a8e73bb-387d-4cc5-9ef6-6bfa4e2d2498 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:08.845682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a8e73bb-387d-4cc5-9ef6-6bfa4e2d2498 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:08.846646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a8e73bb-387d-4cc5-9ef6-6bfa4e2d2498 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:08.847266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a8e73bb-387d-4cc5-9ef6-6bfa4e2d2498 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:08.847965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a8e73bb-387d-4cc5-9ef6-6bfa4e2d2498 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:09.031161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7a8e73bb-387d-4cc5-9ef6-6bfa4e2d2498 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:09.040556 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7a8e73bb-387d-4cc5-9ef6-6bfa4e2d2498 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1549 microversion: 2.1 time: 0.210906 Oct 11 04:35:09.041156 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2802/5343] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:08 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1549 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:09.069626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-00289a7a-813a-4def-ba3e-d3663bff5bcd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:09.070071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-00289a7a-813a-4def-ba3e-d3663bff5bcd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:09.079998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00289a7a-813a-4def-ba3e-d3663bff5bcd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:09.080974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00289a7a-813a-4def-ba3e-d3663bff5bcd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:09.081569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00289a7a-813a-4def-ba3e-d3663bff5bcd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:09.082578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00289a7a-813a-4def-ba3e-d3663bff5bcd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:09.083099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00289a7a-813a-4def-ba3e-d3663bff5bcd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:09.083599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-00289a7a-813a-4def-ba3e-d3663bff5bcd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:09.090028 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e89317a9-b73d-4eff-8f3b-51125186401c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 204 len: 0 microversion: 2.1 time: 0.680765 Oct 11 04:35:09.090905 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2542/5344] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:35:08 2022] DELETE /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 0 bytes in 683 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:35:09.106695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-016f67f6-b485-405b-81c7-9be68d3bdd24 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:09.107400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-016f67f6-b485-405b-81c7-9be68d3bdd24 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:09.116718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-016f67f6-b485-405b-81c7-9be68d3bdd24 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:09.120098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-016f67f6-b485-405b-81c7-9be68d3bdd24 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:09.120805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-016f67f6-b485-405b-81c7-9be68d3bdd24 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:09.121538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-016f67f6-b485-405b-81c7-9be68d3bdd24 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:09.122167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-016f67f6-b485-405b-81c7-9be68d3bdd24 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:09.122611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-016f67f6-b485-405b-81c7-9be68d3bdd24 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:09.437280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-016f67f6-b485-405b-81c7-9be68d3bdd24 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:09.446325 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-016f67f6-b485-405b-81c7-9be68d3bdd24 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1516 microversion: 2.1 time: 0.344452 Oct 11 04:35:09.446901 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2543/5345] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:09 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1516 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:09.516202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:09.517058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:09.525147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:09.525892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:09.527336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:09.528526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:09.529205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:09.529843 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-00289a7a-813a-4def-ba3e-d3663bff5bcd tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.468284 Oct 11 04:35:09.533845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:09.533981 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2803/5346] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:35:09 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-interface => generated 284 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:09.850391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-71d1e400-33af-4524-af4f-efbaa6863c8f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:09.855264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-71d1e400-33af-4524-af4f-efbaa6863c8f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:09.863521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71d1e400-33af-4524-af4f-efbaa6863c8f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:09.867054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71d1e400-33af-4524-af4f-efbaa6863c8f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:09.867054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71d1e400-33af-4524-af4f-efbaa6863c8f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:09.867054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71d1e400-33af-4524-af4f-efbaa6863c8f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:09.867054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71d1e400-33af-4524-af4f-efbaa6863c8f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:09.867054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71d1e400-33af-4524-af4f-efbaa6863c8f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:10.151419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-71d1e400-33af-4524-af4f-efbaa6863c8f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:10.163727 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-71d1e400-33af-4524-af4f-efbaa6863c8f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.318194 Oct 11 04:35:10.166156 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2804/5347] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:09 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:10.471339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b8bfbf1a-8e95-4477-9f96-8d3328b1e819 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:10.472650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b8bfbf1a-8e95-4477-9f96-8d3328b1e819 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:10.487528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:10.491235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8bfbf1a-8e95-4477-9f96-8d3328b1e819 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:10.491235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8bfbf1a-8e95-4477-9f96-8d3328b1e819 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:10.491235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8bfbf1a-8e95-4477-9f96-8d3328b1e819 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:10.491235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8bfbf1a-8e95-4477-9f96-8d3328b1e819 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:10.491235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8bfbf1a-8e95-4477-9f96-8d3328b1e819 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:10.491704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8bfbf1a-8e95-4477-9f96-8d3328b1e819 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:10.506257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:10.559785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:10.568080 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0c68b15b-a058-4ddc-8c60-12308cbb6adc tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 1.051641 Oct 11 04:35:10.568080 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2544/5348] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:09 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:10.864754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b8bfbf1a-8e95-4477-9f96-8d3328b1e819 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:10.875397 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b8bfbf1a-8e95-4477-9f96-8d3328b1e819 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1516 microversion: 2.1 time: 0.408886 Oct 11 04:35:10.898498 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2805/5349] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:10 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1516 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:11.190901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e188672d-2a23-4610-8b47-e020181ba646 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:11.192314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e188672d-2a23-4610-8b47-e020181ba646 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:11.202033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e188672d-2a23-4610-8b47-e020181ba646 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:11.207528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e188672d-2a23-4610-8b47-e020181ba646 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:11.208065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e188672d-2a23-4610-8b47-e020181ba646 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:11.208875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e188672d-2a23-4610-8b47-e020181ba646 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:11.209578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e188672d-2a23-4610-8b47-e020181ba646 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:11.210351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e188672d-2a23-4610-8b47-e020181ba646 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:11.456756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-da9a763e-e9e5-4cf8-8457-980c659e8670 req-4b01e2e9-7ff2-4d97-8958-aa10eb0716e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1451d1bc-1e82-4436-8f11-4cc54dcd4ec8", "name": "network-vif-deleted", "tag": "942e4314-fba3-4b1d-a9aa-e410d5ed23b4"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:11.489055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-da9a763e-e9e5-4cf8-8457-980c659e8670 req-4b01e2e9-7ff2-4d97-8958-aa10eb0716e8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:11.491152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-da9a763e-e9e5-4cf8-8457-980c659e8670 req-4b01e2e9-7ff2-4d97-8958-aa10eb0716e8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:11.492067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-da9a763e-e9e5-4cf8-8457-980c659e8670 req-4b01e2e9-7ff2-4d97-8958-aa10eb0716e8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:11.522542 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-da9a763e-e9e5-4cf8-8457-980c659e8670 req-4b01e2e9-7ff2-4d97-8958-aa10eb0716e8 service nova] Creating event network-vif-deleted:942e4314-fba3-4b1d-a9aa-e410d5ed23b4 for instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 on n-h1-860892-1 Oct 11 04:35:11.535227 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-da9a763e-e9e5-4cf8-8457-980c659e8670 req-4b01e2e9-7ff2-4d97-8958-aa10eb0716e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080110 Oct 11 04:35:11.539186 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2806/5350] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:11.594878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:11.595826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:11.607964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:11.611453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:11.611453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:11.613430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:11.614905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:11.616845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:12.037241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:12.048263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:12.049818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:12.051167 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-434efa3f-20f7-4e1c-867c-6748ad97c364 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.461832 Oct 11 04:35:12.051876 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2807/5351] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:11 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:12.056764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-47409662-5a71-4aef-87a5-7d5d0cd2d67a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:12.057498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-47409662-5a71-4aef-87a5-7d5d0cd2d67a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:12.064030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47409662-5a71-4aef-87a5-7d5d0cd2d67a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:12.064772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47409662-5a71-4aef-87a5-7d5d0cd2d67a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:12.065480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47409662-5a71-4aef-87a5-7d5d0cd2d67a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:12.066433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47409662-5a71-4aef-87a5-7d5d0cd2d67a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:12.066989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47409662-5a71-4aef-87a5-7d5d0cd2d67a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:12.067629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47409662-5a71-4aef-87a5-7d5d0cd2d67a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:12.139488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e188672d-2a23-4610-8b47-e020181ba646 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:12.149788 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e188672d-2a23-4610-8b47-e020181ba646 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.964692 Oct 11 04:35:12.161773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-47409662-5a71-4aef-87a5-7d5d0cd2d67a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:12.163784 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2545/5352] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:11 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 976 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:12.171933 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-47409662-5a71-4aef-87a5-7d5d0cd2d67a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 200 len: 1313 microversion: 2.1 time: 0.118612 Oct 11 04:35:12.173346 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2808/5353] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:12 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 1313 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:12.731160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8c49de49-7378-4778-9083-628d1f86efc5 req-74beaf7a-2f84-40a5-a465-f2a184b24bf2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0b45813-cd45-4fed-ae2b-9f2b1c5bc457", "tag": "c01d4853-a4bd-4db8-a2bd-9014e950ba88"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:12.758035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8c49de49-7378-4778-9083-628d1f86efc5 req-74beaf7a-2f84-40a5-a465-f2a184b24bf2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:12.758560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8c49de49-7378-4778-9083-628d1f86efc5 req-74beaf7a-2f84-40a5-a465-f2a184b24bf2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:12.759767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8c49de49-7378-4778-9083-628d1f86efc5 req-74beaf7a-2f84-40a5-a465-f2a184b24bf2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:12.805119 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8c49de49-7378-4778-9083-628d1f86efc5 req-74beaf7a-2f84-40a5-a465-f2a184b24bf2 service nova] Creating event network-changed:c01d4853-a4bd-4db8-a2bd-9014e950ba88 for instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 on n-h1-860892-1 Oct 11 04:35:12.818968 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8c49de49-7378-4778-9083-628d1f86efc5 req-74beaf7a-2f84-40a5-a465-f2a184b24bf2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093045 Oct 11 04:35:12.822319 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2546/5354] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:13.082479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:13.083746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:13.098069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:13.103138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:13.103138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:13.103138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:13.103138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:13.103138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:13.170940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:13.191098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6261b14c-ff47-478f-8178-9f4c1ad215b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:13.192018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6261b14c-ff47-478f-8178-9f4c1ad215b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:13.217846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6261b14c-ff47-478f-8178-9f4c1ad215b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:13.218513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6261b14c-ff47-478f-8178-9f4c1ad215b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:13.220368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6261b14c-ff47-478f-8178-9f4c1ad215b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:13.223575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6261b14c-ff47-478f-8178-9f4c1ad215b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:13.225241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6261b14c-ff47-478f-8178-9f4c1ad215b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:13.227520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6261b14c-ff47-478f-8178-9f4c1ad215b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:13.927795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:13.947047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:13.951022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:13.958334 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a8c86e6f-951d-41e0-b790-fd3587062acd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.876869 Oct 11 04:35:13.970373 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2809/5355] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:13 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:13.979615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:13.984228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:14.008786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:14.011725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:14.013381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:14.016272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:14.016938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:14.020783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:14.046988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6261b14c-ff47-478f-8178-9f4c1ad215b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:14.073082 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6261b14c-ff47-478f-8178-9f4c1ad215b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.890254 Oct 11 04:35:14.075579 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2547/5356] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:13 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 900 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:14.086218 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 HTTP/1.1 Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1451d1bc-1e82-4436-8f11-4cc54dcd4ec8'} Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:35:14.090781 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:14.097072 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:14.097072 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:35:14.097072 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:35:14.097072 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:35:14.097072 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:35:14.097072 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:35:14.097072 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:14.100527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:35:14.102582 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e78a477f-0768-43ae-ac3d-d8430c0fa048 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 404 len: 111 microversion: 2.1 time: 0.138126 Oct 11 04:35:14.104494 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2810/5357] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:13 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:35:14.114046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f0555c5-a63e-4c70-8751-c3fbe9c1b8ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '.version_select at 0x7fda19acb940>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:14.253863 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5f0555c5-a63e-4c70-8751-c3fbe9c1b8ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-key-523270834" status: 202 len: 0 microversion: 2.1 time: 0.144331 Oct 11 04:35:14.255248 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2548/5358] 10.222.0.26 () {58 vars in 1206 bytes} [Tue Oct 11 04:35:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-key-523270834 => generated 0 bytes in 147 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:35:14.497875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-842996070", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "09b3f7b6-0734-4684-a67d-dc5b0c7e4aff"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:14.607930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] validate_networks() for [('09b3f7b6-0734-4684-a67d-dc5b0c7e4aff', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:35:14.988980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:14.989821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:15.002864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:15.004140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:15.004817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:15.006256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:15.006907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:15.007555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:15.363946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:15.387227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:15.389966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:15.391907 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-51b2c1a5-2622-415f-ac9c-8e7aa998598e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.406999 Oct 11 04:35:15.393735 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2549/5359] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:14 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:15.415076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-48d1921b-b4d2-44dc-8278-45f6ec7c3cdd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:15.417290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-48d1921b-b4d2-44dc-8278-45f6ec7c3cdd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:15.434622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48d1921b-b4d2-44dc-8278-45f6ec7c3cdd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:15.440248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48d1921b-b4d2-44dc-8278-45f6ec7c3cdd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:15.440248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48d1921b-b4d2-44dc-8278-45f6ec7c3cdd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:15.440248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48d1921b-b4d2-44dc-8278-45f6ec7c3cdd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:15.452430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48d1921b-b4d2-44dc-8278-45f6ec7c3cdd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:15.454340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-48d1921b-b4d2-44dc-8278-45f6ec7c3cdd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:15.678061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-48d1921b-b4d2-44dc-8278-45f6ec7c3cdd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:15.691987 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-48d1921b-b4d2-44dc-8278-45f6ec7c3cdd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.296797 Oct 11 04:35:15.692573 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2550/5360] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:15 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:16.060519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:35:16.062816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:35:16.063638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:35:16.064528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:35:16.065224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:35:16.086487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:16.088883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:16.092022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:16.094234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:16.096551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:16.097269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:16.136653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:35:16.146588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for user 96880360d7994e09a1fd27193d2cd152 and project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:35:16.163980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:35:16.166861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:35:16.365541 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-143664ea-7a14-4dc8-828b-368220c512ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.871151 Oct 11 04:35:16.369733 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2811/5361] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:35:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:35:16.383648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b2c05064-40da-44b3-80c0-18ddc9e98b13 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:16.384174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b2c05064-40da-44b3-80c0-18ddc9e98b13 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:16.427083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:16.427689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:16.441760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:16.442301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:16.442757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:16.443478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:16.450883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:16.451616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:16.566512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b2c05064-40da-44b3-80c0-18ddc9e98b13 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:16.574487 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b2c05064-40da-44b3-80c0-18ddc9e98b13 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1208 microversion: 2.1 time: 0.197611 Oct 11 04:35:16.577850 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2551/5362] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:16 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1208 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:16.716465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e94de7fb-afe4-4381-ab94-6bc28d8529d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:16.717086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e94de7fb-afe4-4381-ab94-6bc28d8529d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:16.729293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e94de7fb-afe4-4381-ab94-6bc28d8529d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:16.729792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e94de7fb-afe4-4381-ab94-6bc28d8529d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:16.730350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e94de7fb-afe4-4381-ab94-6bc28d8529d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:16.738837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e94de7fb-afe4-4381-ab94-6bc28d8529d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:16.742909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e94de7fb-afe4-4381-ab94-6bc28d8529d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:16.743644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e94de7fb-afe4-4381-ab94-6bc28d8529d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:17.111886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:17.130671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:17.133578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:17.137677 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d989f85-34e2-49db-967d-22ebc5a15fbd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.714504 Oct 11 04:35:17.158838 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2812/5363] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:16 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:17.281056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e94de7fb-afe4-4381-ab94-6bc28d8529d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:17.292133 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e94de7fb-afe4-4381-ab94-6bc28d8529d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.579287 Oct 11 04:35:17.295103 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2552/5364] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:16 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:17.605141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d65d477-a4ff-4fba-93c0-c94a6e333fe8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:17.606849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d65d477-a4ff-4fba-93c0-c94a6e333fe8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:17.784308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d65d477-a4ff-4fba-93c0-c94a6e333fe8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:17.796937 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d65d477-a4ff-4fba-93c0-c94a6e333fe8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1208 microversion: 2.1 time: 0.195140 Oct 11 04:35:17.806232 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2813/5365] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:17 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1208 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:18.179038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:18.182647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:18.204633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:18.205136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:18.212598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:18.213414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:18.213899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:18.214373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:18.322752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a4d5b2ab-4560-42aa-82c5-8467cc537450 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:18.324311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a4d5b2ab-4560-42aa-82c5-8467cc537450 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:18.341507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4d5b2ab-4560-42aa-82c5-8467cc537450 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:18.342043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4d5b2ab-4560-42aa-82c5-8467cc537450 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:18.342529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4d5b2ab-4560-42aa-82c5-8467cc537450 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:18.343282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4d5b2ab-4560-42aa-82c5-8467cc537450 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:18.343749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4d5b2ab-4560-42aa-82c5-8467cc537450 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:18.344257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4d5b2ab-4560-42aa-82c5-8467cc537450 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:18.567817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:18.577333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:18.578874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:18.580305 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-861adc62-2259-4fb9-8dea-3e31940af684 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.408335 Oct 11 04:35:18.581173 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2553/5366] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:18 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:18.596069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a4d5b2ab-4560-42aa-82c5-8467cc537450 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:18.604842 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a4d5b2ab-4560-42aa-82c5-8467cc537450 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.287214 Oct 11 04:35:18.605422 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2814/5367] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:18 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:18.841911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-60f630ad-bba1-41a7-b7fe-d37904c4d67c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:18.843408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-60f630ad-bba1-41a7-b7fe-d37904c4d67c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:18.856525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f630ad-bba1-41a7-b7fe-d37904c4d67c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:18.857279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f630ad-bba1-41a7-b7fe-d37904c4d67c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:18.861942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f630ad-bba1-41a7-b7fe-d37904c4d67c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:18.863012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f630ad-bba1-41a7-b7fe-d37904c4d67c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:18.864428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f630ad-bba1-41a7-b7fe-d37904c4d67c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:18.864690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f630ad-bba1-41a7-b7fe-d37904c4d67c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:19.074515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-60f630ad-bba1-41a7-b7fe-d37904c4d67c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:19.083314 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-60f630ad-bba1-41a7-b7fe-d37904c4d67c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1204 microversion: 2.1 time: 0.255038 Oct 11 04:35:19.086254 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2554/5368] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:18 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1204 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:19.629415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4b55849a-eb1d-4bd7-89ef-c5bcf03f0f62 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:19.630342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:19.630799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4b55849a-eb1d-4bd7-89ef-c5bcf03f0f62 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:19.631564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:19.638025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b55849a-eb1d-4bd7-89ef-c5bcf03f0f62 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:19.638548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b55849a-eb1d-4bd7-89ef-c5bcf03f0f62 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:19.647646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:19.647646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:19.647942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b55849a-eb1d-4bd7-89ef-c5bcf03f0f62 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:19.649280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:19.649842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b55849a-eb1d-4bd7-89ef-c5bcf03f0f62 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:19.650569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b55849a-eb1d-4bd7-89ef-c5bcf03f0f62 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:19.650891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:19.651358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b55849a-eb1d-4bd7-89ef-c5bcf03f0f62 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:19.651508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:19.651789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:20.129569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4b55849a-eb1d-4bd7-89ef-c5bcf03f0f62 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:20.144169 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4b55849a-eb1d-4bd7-89ef-c5bcf03f0f62 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.519214 Oct 11 04:35:20.144774 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2815/5369] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:19 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:20.149797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5cbf8edf-f9e3-4923-a133-4aed0a64023f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:20.150445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5cbf8edf-f9e3-4923-a133-4aed0a64023f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:20.166534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf8edf-f9e3-4923-a133-4aed0a64023f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:20.168421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf8edf-f9e3-4923-a133-4aed0a64023f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:20.168876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf8edf-f9e3-4923-a133-4aed0a64023f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:20.169686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf8edf-f9e3-4923-a133-4aed0a64023f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:20.170155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf8edf-f9e3-4923-a133-4aed0a64023f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:20.170623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cbf8edf-f9e3-4923-a133-4aed0a64023f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:20.242006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:20.262442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:20.268147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:20.272016 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-73a1676d-a615-4112-961a-bdd7e1063290 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.645821 Oct 11 04:35:20.278492 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2555/5370] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:19 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:20.384058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5cbf8edf-f9e3-4923-a133-4aed0a64023f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:20.396806 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5cbf8edf-f9e3-4923-a133-4aed0a64023f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1268 microversion: 2.1 time: 0.250457 Oct 11 04:35:20.398095 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2816/5371] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:20 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1268 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:21.177556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ecaac688-fd6a-478e-9f86-12499fa269f8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:21.178732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ecaac688-fd6a-478e-9f86-12499fa269f8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:21.188532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaac688-fd6a-478e-9f86-12499fa269f8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:21.189297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaac688-fd6a-478e-9f86-12499fa269f8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:21.189939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaac688-fd6a-478e-9f86-12499fa269f8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:21.192304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaac688-fd6a-478e-9f86-12499fa269f8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:21.193396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaac688-fd6a-478e-9f86-12499fa269f8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:21.201052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecaac688-fd6a-478e-9f86-12499fa269f8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:21.305166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:21.306520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:21.315652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:21.316144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:21.316580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:21.317282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:21.317725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:21.318996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:21.418513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ecaac688-fd6a-478e-9f86-12499fa269f8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:21.430905 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ecaac688-fd6a-478e-9f86-12499fa269f8 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1529 microversion: 2.1 time: 0.264392 Oct 11 04:35:21.431503 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2556/5372] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:21 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1529 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:21.442170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5fb26932-a88c-415b-8ba6-64b9c708c5b2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:21.443137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5fb26932-a88c-415b-8ba6-64b9c708c5b2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:21.453868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb26932-a88c-415b-8ba6-64b9c708c5b2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:21.454751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb26932-a88c-415b-8ba6-64b9c708c5b2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:21.455211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb26932-a88c-415b-8ba6-64b9c708c5b2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:21.455943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb26932-a88c-415b-8ba6-64b9c708c5b2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:21.456571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb26932-a88c-415b-8ba6-64b9c708c5b2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:21.457211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fb26932-a88c-415b-8ba6-64b9c708c5b2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:21.543242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5fb26932-a88c-415b-8ba6-64b9c708c5b2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:21.553698 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5fb26932-a88c-415b-8ba6-64b9c708c5b2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1266 microversion: 2.1 time: 0.120945 Oct 11 04:35:21.554466 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2557/5373] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:21 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1266 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:21.738492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:21.749033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:21.751074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:21.752440 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-306ef310-436d-491e-9bb9-cfffdb5cb4d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.451566 Oct 11 04:35:21.767015 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2817/5374] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:21 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:22.460606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ddaf034-f65e-44d3-a6f2-cbc4fa86280c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:22.463959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ddaf034-f65e-44d3-a6f2-cbc4fa86280c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:22.488199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddaf034-f65e-44d3-a6f2-cbc4fa86280c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:22.489083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddaf034-f65e-44d3-a6f2-cbc4fa86280c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:22.492546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddaf034-f65e-44d3-a6f2-cbc4fa86280c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:22.493491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddaf034-f65e-44d3-a6f2-cbc4fa86280c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:22.494331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddaf034-f65e-44d3-a6f2-cbc4fa86280c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:22.494926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ddaf034-f65e-44d3-a6f2-cbc4fa86280c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:22.507482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:22.604890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bfd77efb-83b1-4b06-9efb-eec8efb79e70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:22.605508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bfd77efb-83b1-4b06-9efb-eec8efb79e70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:22.625509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd77efb-83b1-4b06-9efb-eec8efb79e70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:22.626126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd77efb-83b1-4b06-9efb-eec8efb79e70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:22.626801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd77efb-83b1-4b06-9efb-eec8efb79e70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:22.627463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd77efb-83b1-4b06-9efb-eec8efb79e70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:22.627912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd77efb-83b1-4b06-9efb-eec8efb79e70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:22.628342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bfd77efb-83b1-4b06-9efb-eec8efb79e70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:22.920754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ddaf034-f65e-44d3-a6f2-cbc4fa86280c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:22.929871 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ddaf034-f65e-44d3-a6f2-cbc4fa86280c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1511 microversion: 2.1 time: 0.478419 Oct 11 04:35:22.931410 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2558/5375] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:22 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1511 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:22.937346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:22.938308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:22.944492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:22.944989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:22.945627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:22.946897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:22.947537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:22.948140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:23.301938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bfd77efb-83b1-4b06-9efb-eec8efb79e70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:23.318944 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bfd77efb-83b1-4b06-9efb-eec8efb79e70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1308 microversion: 2.1 time: 0.732180 Oct 11 04:35:23.326141 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2818/5376] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:22 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1308 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:23.482519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:23.498307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:23.510830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:23.516630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8ecdea95-dd2f-49eb-9309-9bc19b81a09b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.583206 Oct 11 04:35:23.519932 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2559/5377] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:22 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:23.953560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a2300d5d-38ca-4fe7-a2c2-4e319826155c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:23.954836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a2300d5d-38ca-4fe7-a2c2-4e319826155c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:23.963102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2300d5d-38ca-4fe7-a2c2-4e319826155c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:23.963779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2300d5d-38ca-4fe7-a2c2-4e319826155c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:23.964413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2300d5d-38ca-4fe7-a2c2-4e319826155c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:23.965276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2300d5d-38ca-4fe7-a2c2-4e319826155c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:23.965900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2300d5d-38ca-4fe7-a2c2-4e319826155c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:23.966511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2300d5d-38ca-4fe7-a2c2-4e319826155c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:24.304599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a2300d5d-38ca-4fe7-a2c2-4e319826155c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:24.314988 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a2300d5d-38ca-4fe7-a2c2-4e319826155c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1511 microversion: 2.1 time: 0.365295 Oct 11 04:35:24.316079 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2819/5378] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:23 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1511 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:24.352110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f86f750-0c3d-4e90-bb35-749f3150b3fb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:24.353155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f86f750-0c3d-4e90-bb35-749f3150b3fb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:24.361596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f86f750-0c3d-4e90-bb35-749f3150b3fb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:24.362826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f86f750-0c3d-4e90-bb35-749f3150b3fb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:24.363413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f86f750-0c3d-4e90-bb35-749f3150b3fb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:24.364525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f86f750-0c3d-4e90-bb35-749f3150b3fb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:24.365982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f86f750-0c3d-4e90-bb35-749f3150b3fb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:24.367668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f86f750-0c3d-4e90-bb35-749f3150b3fb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:24.543655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:24.548585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:24.560852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:24.563169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:24.566135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:24.568119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:24.569512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:24.583032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:24.928749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:24.939818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:24.942430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:24.943822 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-39904e72-58f2-4fe7-a3b0-0edfc681713c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.404221 Oct 11 04:35:24.944551 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2820/5379] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:24 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:24.949208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c62b7e92-cfd6-44cc-9419-ceb4c157622b req-142aa4e9-f62b-4528-b23f-b7f71c09ec94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2e3ee58-f888-413a-9d48-8fd7ef276b07", "tag": "10cc8014-997b-49d9-b4b9-e79e194a6c02"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:24.961765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c62b7e92-cfd6-44cc-9419-ceb4c157622b req-142aa4e9-f62b-4528-b23f-b7f71c09ec94 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:24.963870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c62b7e92-cfd6-44cc-9419-ceb4c157622b req-142aa4e9-f62b-4528-b23f-b7f71c09ec94 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:24.964181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c62b7e92-cfd6-44cc-9419-ceb4c157622b req-142aa4e9-f62b-4528-b23f-b7f71c09ec94 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:24.977034 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c62b7e92-cfd6-44cc-9419-ceb4c157622b req-142aa4e9-f62b-4528-b23f-b7f71c09ec94 service nova] Creating event network-changed:10cc8014-997b-49d9-b4b9-e79e194a6c02 for instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 on n-h1-860892-1 Oct 11 04:35:24.982973 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c62b7e92-cfd6-44cc-9419-ceb4c157622b req-142aa4e9-f62b-4528-b23f-b7f71c09ec94 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036802 Oct 11 04:35:24.986825 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2821/5380] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:25.345723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90e8d2e3-c1e1-43c1-97f7-6e127a2a2e94 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:25.348034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90e8d2e3-c1e1-43c1-97f7-6e127a2a2e94 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:25.355300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90e8d2e3-c1e1-43c1-97f7-6e127a2a2e94 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:25.356196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90e8d2e3-c1e1-43c1-97f7-6e127a2a2e94 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:25.357041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90e8d2e3-c1e1-43c1-97f7-6e127a2a2e94 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:25.358095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90e8d2e3-c1e1-43c1-97f7-6e127a2a2e94 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:25.358812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90e8d2e3-c1e1-43c1-97f7-6e127a2a2e94 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:25.360106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90e8d2e3-c1e1-43c1-97f7-6e127a2a2e94 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:25.370302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f86f750-0c3d-4e90-bb35-749f3150b3fb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:25.383026 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f86f750-0c3d-4e90-bb35-749f3150b3fb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1308 microversion: 2.1 time: 1.037794 Oct 11 04:35:25.390759 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2560/5381] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:24 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1308 bytes in 1046 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:25.983476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:25.984923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:26.000317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:26.001112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:26.003886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:26.003886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:26.003886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:26.003886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:26.028440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-90e8d2e3-c1e1-43c1-97f7-6e127a2a2e94 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:26.043100 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90e8d2e3-c1e1-43c1-97f7-6e127a2a2e94 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1511 microversion: 2.1 time: 0.700941 Oct 11 04:35:26.055275 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2822/5382] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:25 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1511 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:26.060317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ad0a35da-9bf8-4927-884e-baffc04ca837 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Action: 'create', calling method: .version_select at 0x7fda193d7550>, body: {"keypair": {"name": "tempest-TestNetworkBasicOps-388901209", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2/41KDs0IKMcVE4IIaTZcEXxvyAglV1rIiAUETBcvuxKll5ZNPtHG9RuO7RofuLcgjo5fkZVDhZwlgIAdM30ijouePP0OA7BMun9Q5kQGCMepRNJ4WI+wS/QHE+i2VtQ=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:26.077990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ad0a35da-9bf8-4927-884e-baffc04ca837 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:35:26.084710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ad0a35da-9bf8-4927-884e-baffc04ca837 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for user 752975bff6034a7086aafa3319a4f1d4 and project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:35:26.124401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:26.215854 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ad0a35da-9bf8-4927-884e-baffc04ca837 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.159384 Oct 11 04:35:26.216965 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2823/5383] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:35:26 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:26.329102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:26.338977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:26.340527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:26.341686 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2c5d59aa-b349-4ec4-93e7-e25b084941dd tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.371299 Oct 11 04:35:26.342270 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2561/5384] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:25 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:26.409504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-47d3452c-b74d-4af4-a63a-734c54135b07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:26.410422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-47d3452c-b74d-4af4-a63a-734c54135b07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:26.420964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47d3452c-b74d-4af4-a63a-734c54135b07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:26.426447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47d3452c-b74d-4af4-a63a-734c54135b07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:26.426907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47d3452c-b74d-4af4-a63a-734c54135b07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:26.427776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47d3452c-b74d-4af4-a63a-734c54135b07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:26.428397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47d3452c-b74d-4af4-a63a-734c54135b07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:26.429826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47d3452c-b74d-4af4-a63a-734c54135b07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:26.448209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8cc098b8-ffbb-4896-b5bc-13523d8f10a9 req-f6137f7a-409d-450f-8f2e-849421c3d946 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90650e13-1fd0-479b-972e-d36b6521b37f", "name": "network-vif-unplugged", "status": "completed", "tag": "04a8a7cd-3242-44a3-b767-f91dca6b2149"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:26.474950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8cc098b8-ffbb-4896-b5bc-13523d8f10a9 req-f6137f7a-409d-450f-8f2e-849421c3d946 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:26.475536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8cc098b8-ffbb-4896-b5bc-13523d8f10a9 req-f6137f7a-409d-450f-8f2e-849421c3d946 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:26.476252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8cc098b8-ffbb-4896-b5bc-13523d8f10a9 req-f6137f7a-409d-450f-8f2e-849421c3d946 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:26.506102 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8cc098b8-ffbb-4896-b5bc-13523d8f10a9 req-f6137f7a-409d-450f-8f2e-849421c3d946 service nova] Creating event network-vif-unplugged:04a8a7cd-3242-44a3-b767-f91dca6b2149 for instance 90650e13-1fd0-479b-972e-d36b6521b37f on n-h2-860892-1 Oct 11 04:35:26.518234 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8cc098b8-ffbb-4896-b5bc-13523d8f10a9 req-f6137f7a-409d-450f-8f2e-849421c3d946 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.073236 Oct 11 04:35:26.519239 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2562/5385] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:26.657095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-47d3452c-b74d-4af4-a63a-734c54135b07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:26.670861 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-47d3452c-b74d-4af4-a63a-734c54135b07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1308 microversion: 2.1 time: 0.262552 Oct 11 04:35:26.670861 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2824/5386] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:26 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1308 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:27.064269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:27.071123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a92a7906-3462-444d-a41b-dbf304ce3928 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:27.072089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a92a7906-3462-444d-a41b-dbf304ce3928 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:27.080093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92a7906-3462-444d-a41b-dbf304ce3928 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:27.080840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92a7906-3462-444d-a41b-dbf304ce3928 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:27.081274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92a7906-3462-444d-a41b-dbf304ce3928 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:27.082152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92a7906-3462-444d-a41b-dbf304ce3928 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:27.082811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92a7906-3462-444d-a41b-dbf304ce3928 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:27.083401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a92a7906-3462-444d-a41b-dbf304ce3928 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:27.365200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a92a7906-3462-444d-a41b-dbf304ce3928 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:27.374860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:27.375578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:27.383526 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a92a7906-3462-444d-a41b-dbf304ce3928 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1454 microversion: 2.1 time: 0.320152 Oct 11 04:35:27.384398 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2563/5387] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:27 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1454 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:27.387240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:27.387736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:27.391273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:27.391273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:27.391273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:27.391273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:27.407734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cf96d811-a4ab-4f11-be02-7035d9a227b3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:27.409516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf96d811-a4ab-4f11-be02-7035d9a227b3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:27.416646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf96d811-a4ab-4f11-be02-7035d9a227b3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:27.417215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf96d811-a4ab-4f11-be02-7035d9a227b3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:27.417879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf96d811-a4ab-4f11-be02-7035d9a227b3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:27.418846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf96d811-a4ab-4f11-be02-7035d9a227b3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:27.425592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf96d811-a4ab-4f11-be02-7035d9a227b3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:27.426298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf96d811-a4ab-4f11-be02-7035d9a227b3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:27.770867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cf96d811-a4ab-4f11-be02-7035d9a227b3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:27.785757 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cf96d811-a4ab-4f11-be02-7035d9a227b3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1454 microversion: 2.1 time: 0.381501 Oct 11 04:35:27.788254 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2564/5388] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:27 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1454 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:27.800748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-14dfc544-25c3-43be-8a74-ee47d6703106 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:27.802992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-14dfc544-25c3-43be-8a74-ee47d6703106 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:27.822061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dfc544-25c3-43be-8a74-ee47d6703106 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:27.822763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dfc544-25c3-43be-8a74-ee47d6703106 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:27.823304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dfc544-25c3-43be-8a74-ee47d6703106 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:27.855181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dfc544-25c3-43be-8a74-ee47d6703106 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:27.862449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dfc544-25c3-43be-8a74-ee47d6703106 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:27.863068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14dfc544-25c3-43be-8a74-ee47d6703106 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:27.961434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:27.977764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:27.979541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:27.980908 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-caea94d2-5883-4055-bb32-d30a7758fa95 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.616607 Oct 11 04:35:27.983606 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2825/5389] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:27 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:28.006787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:28.007841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:28.026574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:28.028280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:28.028906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:28.029962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:28.030615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:28.031267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:28.130660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lazy-loading 'flavor' on Instance uuid 90650e13-1fd0-479b-972e-d36b6521b37f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:35:28.179040 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Cannot 'shelve' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state shelved_offloaded Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action HTTP/1.1 Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 14 Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: {"shelve": {}} Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: exception: Cannot 'shelve' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state shelved_offloaded Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '90650e13-1fd0-479b-972e-d36b6521b37f', 'body': {'shelve': {}}} Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 49, in _shelve Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.compute_api.shelve(context, instance) Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 278, in inner Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90650e13-1fd0-479b-972e-d36b6521b37f in vm_state shelved_offloaded. Cannot shelve while the instance is in this state. Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 56, in _shelve Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:35:28.185756 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'shelve' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state shelved_offloaded Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'shelve' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state shelved_offloaded Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 409 to user: Cannot 'shelve' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state shelved_offloaded {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:35:28.191228 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fede3e4d-a77a-4641-aff0-50d9a296c84d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 409 len: 155 microversion: 2.1 time: 0.201905 Oct 11 04:35:28.192511 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2826/5390] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:35:27 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 155 bytes in 207 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:35:28.199437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4a7c3db6-f1c2-4d8f-b90d-573eaaa925d7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:28.200049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4a7c3db6-f1c2-4d8f-b90d-573eaaa925d7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:28.212873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7c3db6-f1c2-4d8f-b90d-573eaaa925d7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:28.213468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7c3db6-f1c2-4d8f-b90d-573eaaa925d7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:28.213814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7c3db6-f1c2-4d8f-b90d-573eaaa925d7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:28.214874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7c3db6-f1c2-4d8f-b90d-573eaaa925d7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:28.215400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7c3db6-f1c2-4d8f-b90d-573eaaa925d7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:28.215827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a7c3db6-f1c2-4d8f-b90d-573eaaa925d7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:28.327394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4a7c3db6-f1c2-4d8f-b90d-573eaaa925d7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120994) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 04:35:28.360795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-14dfc544-25c3-43be-8a74-ee47d6703106 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:28.368999 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-14dfc544-25c3-43be-8a74-ee47d6703106 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1308 microversion: 2.1 time: 0.579563 Oct 11 04:35:28.369600 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2565/5391] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:27 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1308 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:28.681141 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4a7c3db6-f1c2-4d8f-b90d-573eaaa925d7 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 202 len: 0 microversion: 2.1 time: 0.487162 Oct 11 04:35:28.690042 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2827/5392] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:35:28 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 0 bytes in 498 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:35:28.695406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-73e9dd58-1afa-4e88-ba2f-ff78420e64f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:28.696112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73e9dd58-1afa-4e88-ba2f-ff78420e64f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:28.704293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e9dd58-1afa-4e88-ba2f-ff78420e64f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:28.704809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e9dd58-1afa-4e88-ba2f-ff78420e64f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:28.705243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e9dd58-1afa-4e88-ba2f-ff78420e64f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:28.705947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e9dd58-1afa-4e88-ba2f-ff78420e64f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:28.706437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e9dd58-1afa-4e88-ba2f-ff78420e64f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:28.706865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73e9dd58-1afa-4e88-ba2f-ff78420e64f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:29.012107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:29.013359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:29.041564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:29.042357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:29.043283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:29.044224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:29.047089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:29.051367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:29.116594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73e9dd58-1afa-4e88-ba2f-ff78420e64f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:29.128295 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-73e9dd58-1afa-4e88-ba2f-ff78420e64f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1462 microversion: 2.1 time: 0.437078 Oct 11 04:35:29.134271 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2566/5393] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:28 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1462 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:29.396497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4b26f16-793a-432c-8b3e-a39d8f90b3c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:29.397295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f4b26f16-793a-432c-8b3e-a39d8f90b3c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:29.411551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4b26f16-793a-432c-8b3e-a39d8f90b3c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:29.412055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4b26f16-793a-432c-8b3e-a39d8f90b3c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:29.412547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4b26f16-793a-432c-8b3e-a39d8f90b3c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:29.413266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4b26f16-793a-432c-8b3e-a39d8f90b3c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:29.414242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4b26f16-793a-432c-8b3e-a39d8f90b3c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:29.414242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4b26f16-793a-432c-8b3e-a39d8f90b3c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:29.619290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:29.630811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:29.633005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:29.648467 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb75d782-5554-4fe7-b26f-5fcde6ae6d21 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.627658 Oct 11 04:35:29.649179 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2828/5394] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:29 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:29.746126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4b26f16-793a-432c-8b3e-a39d8f90b3c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:29.756454 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f4b26f16-793a-432c-8b3e-a39d8f90b3c8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1308 microversion: 2.1 time: 0.366829 Oct 11 04:35:29.758411 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2567/5395] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:29 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1308 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:30.161774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b5548ad3-b9cc-44df-b552-6de32381f854 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:30.161774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b5548ad3-b9cc-44df-b552-6de32381f854 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:30.168564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5548ad3-b9cc-44df-b552-6de32381f854 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:30.169245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5548ad3-b9cc-44df-b552-6de32381f854 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:30.170434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5548ad3-b9cc-44df-b552-6de32381f854 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:30.172256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5548ad3-b9cc-44df-b552-6de32381f854 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:30.172892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5548ad3-b9cc-44df-b552-6de32381f854 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:30.173661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5548ad3-b9cc-44df-b552-6de32381f854 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:30.212594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:30.442694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b5548ad3-b9cc-44df-b552-6de32381f854 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:30.450749 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b5548ad3-b9cc-44df-b552-6de32381f854 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1462 microversion: 2.1 time: 0.294790 Oct 11 04:35:30.451787 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2829/5396] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:30 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1462 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:30.663598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:30.664808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:30.675954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:30.676448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:30.677021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:30.677565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:30.678037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:30.678487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:30.791180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-07d11212-2efc-483b-a866-64bf34487279 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:30.791877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-07d11212-2efc-483b-a866-64bf34487279 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:30.810538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d11212-2efc-483b-a866-64bf34487279 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:30.810812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d11212-2efc-483b-a866-64bf34487279 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:30.811501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d11212-2efc-483b-a866-64bf34487279 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:30.812504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d11212-2efc-483b-a866-64bf34487279 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:30.813200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d11212-2efc-483b-a866-64bf34487279 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:30.813877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07d11212-2efc-483b-a866-64bf34487279 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:31.065492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:31.076751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:31.079466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:31.080842 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4cd55474-1c55-40dd-b8e4-9279e7198ddb tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.421341 Oct 11 04:35:31.095544 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2568/5397] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:30 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:31.222130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-07d11212-2efc-483b-a866-64bf34487279 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:31.230440 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-07d11212-2efc-483b-a866-64bf34487279 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1308 microversion: 2.1 time: 0.443512 Oct 11 04:35:31.231111 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2830/5398] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:30 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1308 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:31.441015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkBasicOps-server-1462200796", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "033510aa-3016-4ad4-8c08-d234864c7451"}], "key_name": "tempest-TestNetworkBasicOps-388901209", "security_groups": [{"name": "tempest-secgroup-smoke-1210674040"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:31.474449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a8901435-e1ee-4eae-83c9-b3a155b3f116 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:31.475434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a8901435-e1ee-4eae-83c9-b3a155b3f116 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:31.482797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8901435-e1ee-4eae-83c9-b3a155b3f116 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:31.483284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8901435-e1ee-4eae-83c9-b3a155b3f116 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:31.483926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8901435-e1ee-4eae-83c9-b3a155b3f116 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:31.484768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8901435-e1ee-4eae-83c9-b3a155b3f116 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:31.485947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8901435-e1ee-4eae-83c9-b3a155b3f116 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:31.486655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8901435-e1ee-4eae-83c9-b3a155b3f116 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:31.565140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] validate_networks() for [('033510aa-3016-4ad4-8c08-d234864c7451', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:35:31.701464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8901435-e1ee-4eae-83c9-b3a155b3f116 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:31.712961 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a8901435-e1ee-4eae-83c9-b3a155b3f116 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1464 microversion: 2.1 time: 0.242631 Oct 11 04:35:31.713867 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2831/5399] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:31 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1464 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:31.902358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:32.107710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:32.108318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:32.115427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:32.115919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:32.116352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:32.117062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:32.117698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:32.118366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:32.378966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:32.392442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:32.394385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:32.396633 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d069562d-5956-4701-a17e-51eef92f26a2 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.292941 Oct 11 04:35:32.409700 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2832/5400] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:32 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:32.418038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-589c07d1-9dd3-490c-aba9-2d7459c1bbd1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:32.419043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-589c07d1-9dd3-490c-aba9-2d7459c1bbd1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:32.431250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589c07d1-9dd3-490c-aba9-2d7459c1bbd1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:32.431755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589c07d1-9dd3-490c-aba9-2d7459c1bbd1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:32.432199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589c07d1-9dd3-490c-aba9-2d7459c1bbd1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:32.432906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589c07d1-9dd3-490c-aba9-2d7459c1bbd1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:32.433365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589c07d1-9dd3-490c-aba9-2d7459c1bbd1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:32.433797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589c07d1-9dd3-490c-aba9-2d7459c1bbd1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:32.646871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-589c07d1-9dd3-490c-aba9-2d7459c1bbd1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:32.665181 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-589c07d1-9dd3-490c-aba9-2d7459c1bbd1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1308 microversion: 2.1 time: 0.262675 Oct 11 04:35:32.680634 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2833/5401] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:32 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1308 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:32.729334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:35:32.732817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:35:32.733556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:35:32.735767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:35:32.736279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:35:32.763535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3e051753-1800-458d-aa3a-447453b9938e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:32.763535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3e051753-1800-458d-aa3a-447453b9938e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:32.772202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:32.780151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:32.782161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:32.784595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:32.785784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:32.786714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:32.788279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e051753-1800-458d-aa3a-447453b9938e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:32.790379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e051753-1800-458d-aa3a-447453b9938e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:32.793707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e051753-1800-458d-aa3a-447453b9938e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:32.797193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e051753-1800-458d-aa3a-447453b9938e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:32.797847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e051753-1800-458d-aa3a-447453b9938e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:32.798482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e051753-1800-458d-aa3a-447453b9938e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:32.892339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:35:32.909186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Getting quotas for user 752975bff6034a7086aafa3319a4f1d4 and project 13a4630fe9284b8b83a7bd9a7ef4ce95. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:35:32.965193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:35:32.975942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:35:33.137402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3e051753-1800-458d-aa3a-447453b9938e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:33.148661 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3e051753-1800-458d-aa3a-447453b9938e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.403735 Oct 11 04:35:33.156679 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2834/5402] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:32 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:33.201799 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-989168d5-2eb9-49c0-b551-98f8a7668f9c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.765131 Oct 11 04:35:33.202413 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2569/5403] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:35:31 2022] POST /compute/v2.1/servers => generated 406 bytes in 1767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:35:33.215673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-adfb331d-6274-4764-948d-372e05209bee tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:33.216748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-adfb331d-6274-4764-948d-372e05209bee tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:33.365160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-adec96f7-8455-4a7f-a6af-13b1710d41e9 req-c6fcee31-a96c-46f0-8620-053aac73ef18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e3ee58-f888-413a-9d48-8fd7ef276b07", "name": "network-vif-plugged", "status": "completed", "tag": "10cc8014-997b-49d9-b4b9-e79e194a6c02"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:33.368649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-adfb331d-6274-4764-948d-372e05209bee tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:33.379298 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-adfb331d-6274-4764-948d-372e05209bee tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1248 microversion: 2.1 time: 0.168648 Oct 11 04:35:33.392654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-adec96f7-8455-4a7f-a6af-13b1710d41e9 req-c6fcee31-a96c-46f0-8620-053aac73ef18 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:33.392965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-adec96f7-8455-4a7f-a6af-13b1710d41e9 req-c6fcee31-a96c-46f0-8620-053aac73ef18 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:33.393396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-adec96f7-8455-4a7f-a6af-13b1710d41e9 req-c6fcee31-a96c-46f0-8620-053aac73ef18 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:33.393543 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2835/5404] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:33 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1248 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:33.412928 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-adec96f7-8455-4a7f-a6af-13b1710d41e9 req-c6fcee31-a96c-46f0-8620-053aac73ef18 service nova] Creating event network-vif-plugged:10cc8014-997b-49d9-b4b9-e79e194a6c02 for instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 on n-h1-860892-1 Oct 11 04:35:33.424576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:33.425381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:33.431427 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-adec96f7-8455-4a7f-a6af-13b1710d41e9 req-c6fcee31-a96c-46f0-8620-053aac73ef18 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067887 Oct 11 04:35:33.432307 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2570/5405] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:35:33.437619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:33.450312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:33.450825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:33.451273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:33.451991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:33.452455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:33.462121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:33.693395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ea2ccbb-80b4-4655-acd0-aed9bdbd11ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:33.694411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5ea2ccbb-80b4-4655-acd0-aed9bdbd11ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:33.702746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea2ccbb-80b4-4655-acd0-aed9bdbd11ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:33.703311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea2ccbb-80b4-4655-acd0-aed9bdbd11ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:33.703760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea2ccbb-80b4-4655-acd0-aed9bdbd11ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:33.704439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea2ccbb-80b4-4655-acd0-aed9bdbd11ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:33.704887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea2ccbb-80b4-4655-acd0-aed9bdbd11ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:33.705306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ea2ccbb-80b4-4655-acd0-aed9bdbd11ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:33.875516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5ea2ccbb-80b4-4655-acd0-aed9bdbd11ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:33.883537 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ea2ccbb-80b4-4655-acd0-aed9bdbd11ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1308 microversion: 2.1 time: 0.194753 Oct 11 04:35:33.884103 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2571/5406] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:33 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1308 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:33.903447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:33.913834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:33.915361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:33.916730 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b4c79114-0693-4c2f-a835-1adfe401cf56 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.496669 Oct 11 04:35:33.922542 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2836/5407] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:33 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:34.172322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5194bb97-e478-4edb-a702-2d752e8f98b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:34.172983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5194bb97-e478-4edb-a702-2d752e8f98b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:34.179485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194bb97-e478-4edb-a702-2d752e8f98b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:34.180311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194bb97-e478-4edb-a702-2d752e8f98b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:34.180755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194bb97-e478-4edb-a702-2d752e8f98b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:34.181503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194bb97-e478-4edb-a702-2d752e8f98b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:34.181984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194bb97-e478-4edb-a702-2d752e8f98b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:34.182553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5194bb97-e478-4edb-a702-2d752e8f98b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:34.406739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5194bb97-e478-4edb-a702-2d752e8f98b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:34.428409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb26dc0f-2c60-4045-9fbc-bc10da7aad77 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:34.428914 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5194bb97-e478-4edb-a702-2d752e8f98b6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.252629 Oct 11 04:35:34.429028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb26dc0f-2c60-4045-9fbc-bc10da7aad77 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:34.429137 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2572/5408] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:34 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:34.543268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb26dc0f-2c60-4045-9fbc-bc10da7aad77 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:34.557837 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb26dc0f-2c60-4045-9fbc-bc10da7aad77 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1248 microversion: 2.1 time: 0.141750 Oct 11 04:35:34.559175 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2837/5409] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:34 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1248 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:34.907883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6641b1f0-d92d-4ba3-949d-54af11ec07ae tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:34.908509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6641b1f0-d92d-4ba3-949d-54af11ec07ae tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:34.918693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6641b1f0-d92d-4ba3-949d-54af11ec07ae tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:34.923388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6641b1f0-d92d-4ba3-949d-54af11ec07ae tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:34.923849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6641b1f0-d92d-4ba3-949d-54af11ec07ae tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:34.929294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6641b1f0-d92d-4ba3-949d-54af11ec07ae tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:34.929294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6641b1f0-d92d-4ba3-949d-54af11ec07ae tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:34.929294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6641b1f0-d92d-4ba3-949d-54af11ec07ae tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:34.945532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:34.946560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:34.969004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:34.980863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:34.980863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:34.980863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:34.980863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:34.980863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:35.252412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6641b1f0-d92d-4ba3-949d-54af11ec07ae tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:35.263718 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6641b1f0-d92d-4ba3-949d-54af11ec07ae tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1308 microversion: 2.1 time: 0.359546 Oct 11 04:35:35.270252 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2573/5410] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:34 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1308 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:35.326692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:35.326692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:35.326692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:35.330593 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8bb11e0f-d24b-4e9b-a0ad-f241569c81f4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.391950 Oct 11 04:35:35.331717 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2838/5411] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:34 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:35.452404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8bd5e96e-61cb-433b-bd86-62e49f298f51 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:35.453277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8bd5e96e-61cb-433b-bd86-62e49f298f51 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:35.462754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd5e96e-61cb-433b-bd86-62e49f298f51 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:35.463699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd5e96e-61cb-433b-bd86-62e49f298f51 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:35.464427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd5e96e-61cb-433b-bd86-62e49f298f51 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:35.465429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd5e96e-61cb-433b-bd86-62e49f298f51 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:35.466237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd5e96e-61cb-433b-bd86-62e49f298f51 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:35.466785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8bd5e96e-61cb-433b-bd86-62e49f298f51 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:35.589812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22953ee0-42f3-4f67-b91f-7296b68a8d80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:35.591103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22953ee0-42f3-4f67-b91f-7296b68a8d80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:35.604564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22953ee0-42f3-4f67-b91f-7296b68a8d80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:35.611719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22953ee0-42f3-4f67-b91f-7296b68a8d80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:35.612573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22953ee0-42f3-4f67-b91f-7296b68a8d80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:35.616461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22953ee0-42f3-4f67-b91f-7296b68a8d80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:35.616461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22953ee0-42f3-4f67-b91f-7296b68a8d80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:35.616461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22953ee0-42f3-4f67-b91f-7296b68a8d80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:35.783548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8bd5e96e-61cb-433b-bd86-62e49f298f51 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:35.790745 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8bd5e96e-61cb-433b-bd86-62e49f298f51 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.342443 Oct 11 04:35:35.791800 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2574/5412] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:35 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:35.792441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22953ee0-42f3-4f67-b91f-7296b68a8d80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:35.797792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-312f573a-533e-4362-aaf8-c22c2451c338 req-de364075-81dd-44f0-94aa-b9107d45cbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-plugged", "status": "completed", "tag": "665442b9-2aa6-4687-b61d-1f39a176e14f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:35.802116 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22953ee0-42f3-4f67-b91f-7296b68a8d80 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1244 microversion: 2.1 time: 0.216294 Oct 11 04:35:35.803179 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2839/5413] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:35 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1244 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:35.821972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-312f573a-533e-4362-aaf8-c22c2451c338 req-de364075-81dd-44f0-94aa-b9107d45cbde service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:35.822548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-312f573a-533e-4362-aaf8-c22c2451c338 req-de364075-81dd-44f0-94aa-b9107d45cbde service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:35.823038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-312f573a-533e-4362-aaf8-c22c2451c338 req-de364075-81dd-44f0-94aa-b9107d45cbde service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:35.836475 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-312f573a-533e-4362-aaf8-c22c2451c338 req-de364075-81dd-44f0-94aa-b9107d45cbde service nova] Creating event network-vif-plugged:665442b9-2aa6-4687-b61d-1f39a176e14f for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:35:35.847086 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-312f573a-533e-4362-aaf8-c22c2451c338 req-de364075-81dd-44f0-94aa-b9107d45cbde service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049442 Oct 11 04:35:35.847086 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2575/5414] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:36.298922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0b8dd11c-e1da-4e52-b718-c1494de37cfa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:36.300344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0b8dd11c-e1da-4e52-b718-c1494de37cfa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:36.309582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b8dd11c-e1da-4e52-b718-c1494de37cfa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:36.310722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b8dd11c-e1da-4e52-b718-c1494de37cfa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:36.311470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b8dd11c-e1da-4e52-b718-c1494de37cfa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:36.313625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b8dd11c-e1da-4e52-b718-c1494de37cfa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:36.314456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b8dd11c-e1da-4e52-b718-c1494de37cfa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:36.315272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b8dd11c-e1da-4e52-b718-c1494de37cfa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:36.366136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:36.367158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:36.377937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:36.378539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:36.379044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:36.379859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:36.382656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:36.383264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:36.578528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0b8dd11c-e1da-4e52-b718-c1494de37cfa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:36.590313 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0b8dd11c-e1da-4e52-b718-c1494de37cfa tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1489 microversion: 2.1 time: 0.300309 Oct 11 04:35:36.612166 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2840/5415] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:36 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1489 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:36.756312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:36.778806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:36.784824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:36.784824 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9ce815bb-b810-4ea7-9ab5-90d9ec5718ca tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.423049 Oct 11 04:35:36.784824 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2576/5416] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:36 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:36.820241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb850ef5-21d9-4ba0-90c2-7b53dff7a2bc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:36.820989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bb850ef5-21d9-4ba0-90c2-7b53dff7a2bc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:36.832821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09896056-8c91-4f09-9b04-1c36160039ca tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:36.833442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09896056-8c91-4f09-9b04-1c36160039ca tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:36.845781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09896056-8c91-4f09-9b04-1c36160039ca tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:36.846400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09896056-8c91-4f09-9b04-1c36160039ca tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:36.846980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09896056-8c91-4f09-9b04-1c36160039ca tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:36.847815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09896056-8c91-4f09-9b04-1c36160039ca tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:36.854131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb850ef5-21d9-4ba0-90c2-7b53dff7a2bc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:36.854707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb850ef5-21d9-4ba0-90c2-7b53dff7a2bc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:36.855159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb850ef5-21d9-4ba0-90c2-7b53dff7a2bc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:36.856006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb850ef5-21d9-4ba0-90c2-7b53dff7a2bc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:36.856467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb850ef5-21d9-4ba0-90c2-7b53dff7a2bc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:36.856957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb850ef5-21d9-4ba0-90c2-7b53dff7a2bc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:36.858708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09896056-8c91-4f09-9b04-1c36160039ca tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:36.861849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09896056-8c91-4f09-9b04-1c36160039ca tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:36.916976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:37.131186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb850ef5-21d9-4ba0-90c2-7b53dff7a2bc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:37.145345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb850ef5-21d9-4ba0-90c2-7b53dff7a2bc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.330101 Oct 11 04:35:37.146406 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2841/5417] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:36 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:37.162602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-842996070", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "09b3f7b6-0734-4684-a67d-dc5b0c7e4aff"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:37.171130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09896056-8c91-4f09-9b04-1c36160039ca tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:37.182682 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09896056-8c91-4f09-9b04-1c36160039ca tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1300 microversion: 2.1 time: 0.351924 Oct 11 04:35:37.183749 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2577/5418] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:36 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1300 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:37.539497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] validate_networks() for [('09b3f7b6-0734-4684-a67d-dc5b0c7e4aff', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:35:37.815521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:37.816882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:37.830621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:37.834796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:37.835600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:37.836658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:37.837345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:37.841139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:38.267323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:35:38.267933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:35:38.268709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:35:38.270616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:35:38.271279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:35:38.311948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=17 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:38.319670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:38.321187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:38.324903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:38.329802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:38.330920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:38.336453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:38.410856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:35:38.417369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for user 96880360d7994e09a1fd27193d2cd152 and project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:35:38.444320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:35:38.464053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:35:38.532741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:38.543169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:38.547375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:38.547375 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f1527911-3550-480d-8091-42c932c0b0aa tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.735557 Oct 11 04:35:38.547375 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2578/5419] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:37 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:38.587755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-abc0058c-c843-4c1b-b673-2c4ac0ffd53f req-eae9b81b-0dd1-4e39-9eb7-35ad2c033c61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-plugged", "status": "completed", "tag": "8a2e3024-32a6-42ac-9aa6-31fac197b837"}, {"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-plugged", "status": "completed", "tag": "9e71def9-e943-4b32-a256-31fe7ded5fd0"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:38.588413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-abc0058c-c843-4c1b-b673-2c4ac0ffd53f req-eae9b81b-0dd1-4e39-9eb7-35ad2c033c61 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:38.588933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-abc0058c-c843-4c1b-b673-2c4ac0ffd53f req-eae9b81b-0dd1-4e39-9eb7-35ad2c033c61 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:38.589447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-abc0058c-c843-4c1b-b673-2c4ac0ffd53f req-eae9b81b-0dd1-4e39-9eb7-35ad2c033c61 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:38.615283 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-abc0058c-c843-4c1b-b673-2c4ac0ffd53f req-eae9b81b-0dd1-4e39-9eb7-35ad2c033c61 service nova] Creating event network-vif-plugged:8a2e3024-32a6-42ac-9aa6-31fac197b837 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:35:38.616062 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-abc0058c-c843-4c1b-b673-2c4ac0ffd53f req-eae9b81b-0dd1-4e39-9eb7-35ad2c033c61 service nova] Creating event network-vif-plugged:9e71def9-e943-4b32-a256-31fe7ded5fd0 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:35:38.626082 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-abc0058c-c843-4c1b-b673-2c4ac0ffd53f req-eae9b81b-0dd1-4e39-9eb7-35ad2c033c61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.059026 Oct 11 04:35:38.627522 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2579/5420] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:38 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:38.634935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a73d5a33-7778-43d9-a6d6-f91b314d4f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:38.635910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a73d5a33-7778-43d9-a6d6-f91b314d4f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:38.662445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a73d5a33-7778-43d9-a6d6-f91b314d4f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:38.662445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a73d5a33-7778-43d9-a6d6-f91b314d4f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:38.662445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a73d5a33-7778-43d9-a6d6-f91b314d4f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:38.662445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a73d5a33-7778-43d9-a6d6-f91b314d4f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:38.666832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a73d5a33-7778-43d9-a6d6-f91b314d4f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:38.667621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a73d5a33-7778-43d9-a6d6-f91b314d4f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:38.737144 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aea75637-4492-44b2-8061-c3a1034fb710 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.589188 Oct 11 04:35:38.738054 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2842/5421] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:35:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 1591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:35:38.743951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82668a70-7c50-427f-bdf2-b14a16d3bd2c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:38.745290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82668a70-7c50-427f-bdf2-b14a16d3bd2c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:38.755710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82668a70-7c50-427f-bdf2-b14a16d3bd2c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:38.756443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82668a70-7c50-427f-bdf2-b14a16d3bd2c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:38.757220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82668a70-7c50-427f-bdf2-b14a16d3bd2c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:38.758253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82668a70-7c50-427f-bdf2-b14a16d3bd2c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:38.758876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82668a70-7c50-427f-bdf2-b14a16d3bd2c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:38.759501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82668a70-7c50-427f-bdf2-b14a16d3bd2c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:38.986235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82668a70-7c50-427f-bdf2-b14a16d3bd2c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:39.002497 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82668a70-7c50-427f-bdf2-b14a16d3bd2c tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1318 microversion: 2.1 time: 0.263090 Oct 11 04:35:39.020513 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2843/5422] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:38 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1318 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:39.029405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f2cd07c3-223d-404a-9111-6dc13d6db846 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:39.031871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f2cd07c3-223d-404a-9111-6dc13d6db846 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:39.206667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2cd07c3-223d-404a-9111-6dc13d6db846 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:39.224910 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f2cd07c3-223d-404a-9111-6dc13d6db846 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1208 microversion: 2.1 time: 0.195191 Oct 11 04:35:39.241636 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2844/5423] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:39 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1208 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:39.250559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a73d5a33-7778-43d9-a6d6-f91b314d4f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:39.259790 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a73d5a33-7778-43d9-a6d6-f91b314d4f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.630711 Oct 11 04:35:39.260426 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2580/5424] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:38 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:39.582263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:39.584211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:39.603536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:39.606392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:39.608240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:39.609588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:39.611737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:39.612532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:40.039275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2629edd7-f5e0-4de5-bebe-0b9335f56440 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:40.044740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2629edd7-f5e0-4de5-bebe-0b9335f56440 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:40.054723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2629edd7-f5e0-4de5-bebe-0b9335f56440 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:40.055558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2629edd7-f5e0-4de5-bebe-0b9335f56440 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:40.056684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2629edd7-f5e0-4de5-bebe-0b9335f56440 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:40.057586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2629edd7-f5e0-4de5-bebe-0b9335f56440 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:40.058447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2629edd7-f5e0-4de5-bebe-0b9335f56440 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:40.059827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2629edd7-f5e0-4de5-bebe-0b9335f56440 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:40.162715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2629edd7-f5e0-4de5-bebe-0b9335f56440 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:40.174919 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2629edd7-f5e0-4de5-bebe-0b9335f56440 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1306 microversion: 2.1 time: 0.143836 Oct 11 04:35:40.190826 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2581/5425] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:40 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1306 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:40.250131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-047f1d5b-283f-4c3c-ae9f-fab2a763d8b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:40.250827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-047f1d5b-283f-4c3c-ae9f-fab2a763d8b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:40.360068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-047f1d5b-283f-4c3c-ae9f-fab2a763d8b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:40.373997 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-047f1d5b-283f-4c3c-ae9f-fab2a763d8b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1208 microversion: 2.1 time: 0.128355 Oct 11 04:35:40.377277 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2582/5426] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:40 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1208 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:40.395992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2d4e0e2f-6464-453a-86a8-473e0822db17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:40.397748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2d4e0e2f-6464-453a-86a8-473e0822db17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:40.418368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4e0e2f-6464-453a-86a8-473e0822db17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:40.419827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4e0e2f-6464-453a-86a8-473e0822db17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:40.421924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4e0e2f-6464-453a-86a8-473e0822db17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:40.422942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4e0e2f-6464-453a-86a8-473e0822db17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:40.423783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4e0e2f-6464-453a-86a8-473e0822db17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:40.424526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2d4e0e2f-6464-453a-86a8-473e0822db17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:40.748105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:40.772586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:40.778124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:40.784131 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8f9204e7-7c13-4550-94e9-9d3ebfc10835 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 1.206342 Oct 11 04:35:40.787620 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2845/5427] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:39 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 1209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:40.793302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-79d04558-c1fc-4056-ad98-a76c3c1e2c72 req-406cb3c6-5729-4ef5-87a7-1f74be85ff51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-plugged", "status": "completed", "tag": "f193892e-4606-44c5-8ce9-edc616f636e4"}, {"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-plugged", "status": "completed", "tag": "10df1ea8-87de-47cc-85e2-c32ce043673a"}, {"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-plugged", "status": "completed", "tag": "7eeb954c-49a9-44c1-99b3-9d24db3203f1"}, {"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-plugged", "status": "completed", "tag": "ce10ffc1-2e72-42f8-a990-d02439f40888"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:40.814708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-79d04558-c1fc-4056-ad98-a76c3c1e2c72 req-406cb3c6-5729-4ef5-87a7-1f74be85ff51 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:40.817732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-79d04558-c1fc-4056-ad98-a76c3c1e2c72 req-406cb3c6-5729-4ef5-87a7-1f74be85ff51 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:40.818166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-79d04558-c1fc-4056-ad98-a76c3c1e2c72 req-406cb3c6-5729-4ef5-87a7-1f74be85ff51 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:40.839434 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-79d04558-c1fc-4056-ad98-a76c3c1e2c72 req-406cb3c6-5729-4ef5-87a7-1f74be85ff51 service nova] Creating event network-vif-plugged:f193892e-4606-44c5-8ce9-edc616f636e4 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:35:40.839434 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-79d04558-c1fc-4056-ad98-a76c3c1e2c72 req-406cb3c6-5729-4ef5-87a7-1f74be85ff51 service nova] Creating event network-vif-plugged:10df1ea8-87de-47cc-85e2-c32ce043673a for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:35:40.839434 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-79d04558-c1fc-4056-ad98-a76c3c1e2c72 req-406cb3c6-5729-4ef5-87a7-1f74be85ff51 service nova] Creating event network-vif-plugged:7eeb954c-49a9-44c1-99b3-9d24db3203f1 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:35:40.839434 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-79d04558-c1fc-4056-ad98-a76c3c1e2c72 req-406cb3c6-5729-4ef5-87a7-1f74be85ff51 service nova] Creating event network-vif-plugged:ce10ffc1-2e72-42f8-a990-d02439f40888 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:35:40.844026 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-79d04558-c1fc-4056-ad98-a76c3c1e2c72 req-406cb3c6-5729-4ef5-87a7-1f74be85ff51 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.054149 Oct 11 04:35:40.850829 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2846/5428] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:40.857008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2d4e0e2f-6464-453a-86a8-473e0822db17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:40.866523 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2d4e0e2f-6464-453a-86a8-473e0822db17 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.487202 Oct 11 04:35:40.875511 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2583/5429] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:40 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:41.213858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-744757cd-30a6-4d61-a315-710ceea27b4f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:41.214868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-744757cd-30a6-4d61-a315-710ceea27b4f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:41.223351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-744757cd-30a6-4d61-a315-710ceea27b4f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:41.227783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-744757cd-30a6-4d61-a315-710ceea27b4f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:41.227783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-744757cd-30a6-4d61-a315-710ceea27b4f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:41.227783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-744757cd-30a6-4d61-a315-710ceea27b4f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:41.227783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-744757cd-30a6-4d61-a315-710ceea27b4f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:41.227783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-744757cd-30a6-4d61-a315-710ceea27b4f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:41.410524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-93ed24ae-4f2d-4677-a02a-31a63551e25c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:41.412578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-93ed24ae-4f2d-4677-a02a-31a63551e25c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:41.442055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93ed24ae-4f2d-4677-a02a-31a63551e25c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:41.445703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93ed24ae-4f2d-4677-a02a-31a63551e25c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:41.448545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93ed24ae-4f2d-4677-a02a-31a63551e25c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:41.452102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93ed24ae-4f2d-4677-a02a-31a63551e25c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:41.452102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93ed24ae-4f2d-4677-a02a-31a63551e25c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:41.452102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93ed24ae-4f2d-4677-a02a-31a63551e25c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:41.621280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-744757cd-30a6-4d61-a315-710ceea27b4f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:41.634100 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-744757cd-30a6-4d61-a315-710ceea27b4f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.424713 Oct 11 04:35:41.652646 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2847/5430] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:41 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:41.851276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:41.851276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:41.851276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:41.851276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:41.851276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:41.851276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:41.851276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:41.851276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:41.927530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-93ed24ae-4f2d-4677-a02a-31a63551e25c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:41.938344 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-93ed24ae-4f2d-4677-a02a-31a63551e25c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1260 microversion: 2.1 time: 0.536075 Oct 11 04:35:41.951389 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2584/5431] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:41 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1260 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:41.956546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b1db5b1-ffa4-4156-8c2b-9e20fe29c473 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:41.957360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2b1db5b1-ffa4-4156-8c2b-9e20fe29c473 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:41.966328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b1db5b1-ffa4-4156-8c2b-9e20fe29c473 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:41.966922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b1db5b1-ffa4-4156-8c2b-9e20fe29c473 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:41.967368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b1db5b1-ffa4-4156-8c2b-9e20fe29c473 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:41.968078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b1db5b1-ffa4-4156-8c2b-9e20fe29c473 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:41.969059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b1db5b1-ffa4-4156-8c2b-9e20fe29c473 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:41.969481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b1db5b1-ffa4-4156-8c2b-9e20fe29c473 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:42.259594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:42.270578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:42.272170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:42.273629 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c5c097b8-097c-4a96-8d33-9e95d6351a4d tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.462859 Oct 11 04:35:42.274115 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2848/5432] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:41 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:42.386463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2b1db5b1-ffa4-4156-8c2b-9e20fe29c473 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:42.396000 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b1db5b1-ffa4-4156-8c2b-9e20fe29c473 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.443231 Oct 11 04:35:42.410713 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2585/5433] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:41 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:42.661772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0d02c24d-4acf-40f4-b1a8-bfac3bceba59 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:42.662763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0d02c24d-4acf-40f4-b1a8-bfac3bceba59 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:42.709481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d02c24d-4acf-40f4-b1a8-bfac3bceba59 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:42.719405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d02c24d-4acf-40f4-b1a8-bfac3bceba59 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:42.720331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d02c24d-4acf-40f4-b1a8-bfac3bceba59 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:42.723479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d02c24d-4acf-40f4-b1a8-bfac3bceba59 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:42.727075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d02c24d-4acf-40f4-b1a8-bfac3bceba59 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:42.727704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d02c24d-4acf-40f4-b1a8-bfac3bceba59 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:42.977811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e73bb9c-153f-4dcf-b43a-2b772b8d2f70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:42.980010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8e73bb9c-153f-4dcf-b43a-2b772b8d2f70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:42.982912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:42.994728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e73bb9c-153f-4dcf-b43a-2b772b8d2f70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:42.995528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e73bb9c-153f-4dcf-b43a-2b772b8d2f70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:42.996213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e73bb9c-153f-4dcf-b43a-2b772b8d2f70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:42.997187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e73bb9c-153f-4dcf-b43a-2b772b8d2f70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:42.997870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e73bb9c-153f-4dcf-b43a-2b772b8d2f70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:42.998701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e73bb9c-153f-4dcf-b43a-2b772b8d2f70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:43.087256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0d02c24d-4acf-40f4-b1a8-bfac3bceba59 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:43.104628 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0d02c24d-4acf-40f4-b1a8-bfac3bceba59 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.445043 Oct 11 04:35:43.108019 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2849/5434] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:42 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:43.228489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8e73bb9c-153f-4dcf-b43a-2b772b8d2f70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:43.238750 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8e73bb9c-153f-4dcf-b43a-2b772b8d2f70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1278 microversion: 2.1 time: 0.264561 Oct 11 04:35:43.243445 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2586/5435] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:42 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1278 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:43.305434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:43.307244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:43.335468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:43.337876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:43.340810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:43.341966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:43.343937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:43.345880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:43.362059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:43.423690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f7585a36-b15c-4266-a5a0-55f2fde5cc18 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:43.424379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f7585a36-b15c-4266-a5a0-55f2fde5cc18 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:43.436013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7585a36-b15c-4266-a5a0-55f2fde5cc18 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:43.436647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7585a36-b15c-4266-a5a0-55f2fde5cc18 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:43.438747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7585a36-b15c-4266-a5a0-55f2fde5cc18 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:43.454080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7585a36-b15c-4266-a5a0-55f2fde5cc18 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:43.454080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7585a36-b15c-4266-a5a0-55f2fde5cc18 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:43.454080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7585a36-b15c-4266-a5a0-55f2fde5cc18 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:43.738879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:43.749370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:43.751401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:43.768929 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c9f88ea0-5347-4fac-8c42-ee6d05fa52ea tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1879 microversion: 2.42 time: 0.459348 Oct 11 04:35:43.768929 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2850/5436] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:43 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1879 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:43.968839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f7585a36-b15c-4266-a5a0-55f2fde5cc18 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:43.979753 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f7585a36-b15c-4266-a5a0-55f2fde5cc18 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.562124 Oct 11 04:35:43.980344 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2587/5437] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:43 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:44.129679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a2f5b56-851c-4a19-935b-b998cf19e78e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:44.131668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a2f5b56-851c-4a19-935b-b998cf19e78e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:44.147385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a2f5b56-851c-4a19-935b-b998cf19e78e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:44.149181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a2f5b56-851c-4a19-935b-b998cf19e78e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:44.149904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a2f5b56-851c-4a19-935b-b998cf19e78e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:44.152057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a2f5b56-851c-4a19-935b-b998cf19e78e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:44.154111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a2f5b56-851c-4a19-935b-b998cf19e78e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:44.154636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a2f5b56-851c-4a19-935b-b998cf19e78e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:44.271853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-25cebf2b-fb78-4dea-ab4c-23875d455d33 req-8a33c2e3-4ab2-4958-a495-35a921cf0351 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a7df08-6119-4cc4-9ccd-d1eae28cff36", "tag": "1ebf4f78-f2e9-4d5c-baf2-65b40b7f530a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:44.302235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-25cebf2b-fb78-4dea-ab4c-23875d455d33 req-8a33c2e3-4ab2-4958-a495-35a921cf0351 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:44.302235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-25cebf2b-fb78-4dea-ab4c-23875d455d33 req-8a33c2e3-4ab2-4958-a495-35a921cf0351 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:44.302235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-25cebf2b-fb78-4dea-ab4c-23875d455d33 req-8a33c2e3-4ab2-4958-a495-35a921cf0351 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:44.321254 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-25cebf2b-fb78-4dea-ab4c-23875d455d33 req-8a33c2e3-4ab2-4958-a495-35a921cf0351 service nova] Creating event network-changed:1ebf4f78-f2e9-4d5c-baf2-65b40b7f530a for instance 05a7df08-6119-4cc4-9ccd-d1eae28cff36 on n-h2-860892-1 Oct 11 04:35:44.330168 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-25cebf2b-fb78-4dea-ab4c-23875d455d33 req-8a33c2e3-4ab2-4958-a495-35a921cf0351 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071339 Oct 11 04:35:44.331806 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2588/5438] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:35:44.344204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6b3b4cb-a7c8-4e1f-a7d1-0cde7fdeab67 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:44.364788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f6b3b4cb-a7c8-4e1f-a7d1-0cde7fdeab67 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:44.364788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6b3b4cb-a7c8-4e1f-a7d1-0cde7fdeab67 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:44.364788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6b3b4cb-a7c8-4e1f-a7d1-0cde7fdeab67 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:44.364788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6b3b4cb-a7c8-4e1f-a7d1-0cde7fdeab67 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:44.364788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6b3b4cb-a7c8-4e1f-a7d1-0cde7fdeab67 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:44.364788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6b3b4cb-a7c8-4e1f-a7d1-0cde7fdeab67 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:44.364788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6b3b4cb-a7c8-4e1f-a7d1-0cde7fdeab67 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:44.724828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a2f5b56-851c-4a19-935b-b998cf19e78e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:44.738606 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a2f5b56-851c-4a19-935b-b998cf19e78e tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.613064 Oct 11 04:35:44.756804 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2851/5439] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:44 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:44.793235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:44.794013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:44.810665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:44.816420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:44.817362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:44.821043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:44.823938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:44.826491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:44.884597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f6b3b4cb-a7c8-4e1f-a7d1-0cde7fdeab67 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:44.893879 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f6b3b4cb-a7c8-4e1f-a7d1-0cde7fdeab67 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1308 microversion: 2.1 time: 0.560088 Oct 11 04:35:44.894445 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2589/5440] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:44 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1308 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:45.022164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1d42e6cc-cd76-4ecc-90e5-ef6cfc1e7f6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:45.029102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1d42e6cc-cd76-4ecc-90e5-ef6cfc1e7f6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:45.035748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d42e6cc-cd76-4ecc-90e5-ef6cfc1e7f6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:45.038662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d42e6cc-cd76-4ecc-90e5-ef6cfc1e7f6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:45.038662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d42e6cc-cd76-4ecc-90e5-ef6cfc1e7f6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:45.038662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d42e6cc-cd76-4ecc-90e5-ef6cfc1e7f6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:45.038662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d42e6cc-cd76-4ecc-90e5-ef6cfc1e7f6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:45.038662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d42e6cc-cd76-4ecc-90e5-ef6cfc1e7f6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:45.285914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:45.302219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:45.304029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:45.309065 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bd72ec43-c664-45e8-afc0-f79ef5759948 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 2833 microversion: 2.42 time: 0.518308 Oct 11 04:35:45.311509 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2852/5441] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:35:44 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 2833 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:35:45.347346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d7586958-362b-4c12-9863-25a4c6108e47 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:45.347973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d7586958-362b-4c12-9863-25a4c6108e47 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:45.371502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7586958-362b-4c12-9863-25a4c6108e47 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:45.371502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7586958-362b-4c12-9863-25a4c6108e47 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:45.371502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7586958-362b-4c12-9863-25a4c6108e47 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:45.371502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7586958-362b-4c12-9863-25a4c6108e47 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:45.371502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7586958-362b-4c12-9863-25a4c6108e47 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:45.371502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d7586958-362b-4c12-9863-25a4c6108e47 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:45.536360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1d42e6cc-cd76-4ecc-90e5-ef6cfc1e7f6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:45.555046 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1d42e6cc-cd76-4ecc-90e5-ef6cfc1e7f6f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.532463 Oct 11 04:35:45.570355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2590/5442] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:45 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:45.664397 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d7586958-362b-4c12-9863-25a4c6108e47 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.321542 Oct 11 04:35:45.664949 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2853/5443] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Oct 11 04:35:45 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377/os-interface => generated 1828 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:35:45.766168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-80152c34-725e-48eb-ae77-75e7822d3dad tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:45.766946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-80152c34-725e-48eb-ae77-75e7822d3dad tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:45.773989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80152c34-725e-48eb-ae77-75e7822d3dad tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:45.774509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80152c34-725e-48eb-ae77-75e7822d3dad tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:45.774990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80152c34-725e-48eb-ae77-75e7822d3dad tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:45.775643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80152c34-725e-48eb-ae77-75e7822d3dad tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:45.776311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80152c34-725e-48eb-ae77-75e7822d3dad tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:45.776870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80152c34-725e-48eb-ae77-75e7822d3dad tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:45.919607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee80a525-a5f8-4d1e-83a4-2d6e5203491c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:45.920685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee80a525-a5f8-4d1e-83a4-2d6e5203491c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:45.927287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee80a525-a5f8-4d1e-83a4-2d6e5203491c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:45.928100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee80a525-a5f8-4d1e-83a4-2d6e5203491c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:45.928796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee80a525-a5f8-4d1e-83a4-2d6e5203491c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:45.929998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee80a525-a5f8-4d1e-83a4-2d6e5203491c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:45.930765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee80a525-a5f8-4d1e-83a4-2d6e5203491c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:45.931682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee80a525-a5f8-4d1e-83a4-2d6e5203491c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:46.138455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee80a525-a5f8-4d1e-83a4-2d6e5203491c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:46.153843 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee80a525-a5f8-4d1e-83a4-2d6e5203491c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1308 microversion: 2.1 time: 0.237889 Oct 11 04:35:46.154799 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2854/5444] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:45 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1308 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:46.192643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-80152c34-725e-48eb-ae77-75e7822d3dad tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:46.212888 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-80152c34-725e-48eb-ae77-75e7822d3dad tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.448242 Oct 11 04:35:46.214181 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2591/5445] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:45 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:46.574385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-678e29e3-945f-4831-b793-8f338bf4d336 req-2f2ef3ac-1087-4781-8530-5753cfd080c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f08acea-8a20-4fcf-936f-1f8414dda402", "tag": "b920f741-3535-4516-b14d-4f818b819827"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:46.589879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb0f5417-fc41-4c16-8431-5b24e5ffd234 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:46.590633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fb0f5417-fc41-4c16-8431-5b24e5ffd234 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:46.604808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0f5417-fc41-4c16-8431-5b24e5ffd234 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:46.606572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0f5417-fc41-4c16-8431-5b24e5ffd234 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:46.620291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0f5417-fc41-4c16-8431-5b24e5ffd234 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:46.621188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0f5417-fc41-4c16-8431-5b24e5ffd234 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:46.621683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0f5417-fc41-4c16-8431-5b24e5ffd234 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:46.622101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0f5417-fc41-4c16-8431-5b24e5ffd234 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:46.627157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-678e29e3-945f-4831-b793-8f338bf4d336 req-2f2ef3ac-1087-4781-8530-5753cfd080c9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:46.627649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-678e29e3-945f-4831-b793-8f338bf4d336 req-2f2ef3ac-1087-4781-8530-5753cfd080c9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:46.628092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-678e29e3-945f-4831-b793-8f338bf4d336 req-2f2ef3ac-1087-4781-8530-5753cfd080c9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:46.649953 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-678e29e3-945f-4831-b793-8f338bf4d336 req-2f2ef3ac-1087-4781-8530-5753cfd080c9 service nova] Creating event network-changed:b920f741-3535-4516-b14d-4f818b819827 for instance 2f08acea-8a20-4fcf-936f-1f8414dda402 on n-h1-860892-1 Oct 11 04:35:46.661586 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-678e29e3-945f-4831-b793-8f338bf4d336 req-2f2ef3ac-1087-4781-8530-5753cfd080c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092794 Oct 11 04:35:46.665638 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2855/5446] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:47.092548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb0f5417-fc41-4c16-8431-5b24e5ffd234 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:47.101461 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb0f5417-fc41-4c16-8431-5b24e5ffd234 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.521155 Oct 11 04:35:47.102795 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2592/5447] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:46 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:47.185292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-05ed2976-719e-43d3-a9ec-94e979e994d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:47.185561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-05ed2976-719e-43d3-a9ec-94e979e994d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:47.205718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05ed2976-719e-43d3-a9ec-94e979e994d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:47.206247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05ed2976-719e-43d3-a9ec-94e979e994d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:47.206691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05ed2976-719e-43d3-a9ec-94e979e994d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:47.207435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05ed2976-719e-43d3-a9ec-94e979e994d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:47.207920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05ed2976-719e-43d3-a9ec-94e979e994d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:47.208347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05ed2976-719e-43d3-a9ec-94e979e994d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:47.237979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dd2c78d1-4a56-46fe-a64d-a8afa4441dba tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:47.239473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dd2c78d1-4a56-46fe-a64d-a8afa4441dba tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:47.254535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2c78d1-4a56-46fe-a64d-a8afa4441dba tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:47.255391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2c78d1-4a56-46fe-a64d-a8afa4441dba tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:47.256228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2c78d1-4a56-46fe-a64d-a8afa4441dba tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:47.257364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2c78d1-4a56-46fe-a64d-a8afa4441dba tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:47.258555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2c78d1-4a56-46fe-a64d-a8afa4441dba tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:47.259489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd2c78d1-4a56-46fe-a64d-a8afa4441dba tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:47.552489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-05ed2976-719e-43d3-a9ec-94e979e994d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:47.562890 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-05ed2976-719e-43d3-a9ec-94e979e994d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1308 microversion: 2.1 time: 0.383302 Oct 11 04:35:47.565549 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2856/5448] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:47 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1308 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:47.696397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dd2c78d1-4a56-46fe-a64d-a8afa4441dba tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:47.704643 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dd2c78d1-4a56-46fe-a64d-a8afa4441dba tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.471709 Oct 11 04:35:47.705304 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2593/5449] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:47 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:48.085519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2b4a6c99-8911-4ac3-898b-863f143562de req-bdf72b7e-2007-44c7-aa9d-aea30c9dfda2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "tag": "8a2e3024-32a6-42ac-9aa6-31fac197b837"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:48.110347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2b4a6c99-8911-4ac3-898b-863f143562de req-bdf72b7e-2007-44c7-aa9d-aea30c9dfda2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:48.114046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2b4a6c99-8911-4ac3-898b-863f143562de req-bdf72b7e-2007-44c7-aa9d-aea30c9dfda2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:48.114046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2b4a6c99-8911-4ac3-898b-863f143562de req-bdf72b7e-2007-44c7-aa9d-aea30c9dfda2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:48.125762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4765038e-8bab-4c76-9869-4b74ba28a992 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:48.126762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4765038e-8bab-4c76-9869-4b74ba28a992 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:48.138405 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2b4a6c99-8911-4ac3-898b-863f143562de req-bdf72b7e-2007-44c7-aa9d-aea30c9dfda2 service nova] Creating event network-changed:8a2e3024-32a6-42ac-9aa6-31fac197b837 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:35:48.138659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4765038e-8bab-4c76-9869-4b74ba28a992 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:48.139108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4765038e-8bab-4c76-9869-4b74ba28a992 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:48.140372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4765038e-8bab-4c76-9869-4b74ba28a992 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:48.147966 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2b4a6c99-8911-4ac3-898b-863f143562de req-bdf72b7e-2007-44c7-aa9d-aea30c9dfda2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066589 Oct 11 04:35:48.156375 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2857/5450] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:48.161723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4765038e-8bab-4c76-9869-4b74ba28a992 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:48.162571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4765038e-8bab-4c76-9869-4b74ba28a992 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:48.164115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4765038e-8bab-4c76-9869-4b74ba28a992 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:48.349308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4765038e-8bab-4c76-9869-4b74ba28a992 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:48.367727 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4765038e-8bab-4c76-9869-4b74ba28a992 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.246272 Oct 11 04:35:48.368864 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2594/5451] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:48 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:48.587350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5120cb39-c258-43ed-a9e2-f6c8601c1874 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:48.588204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5120cb39-c258-43ed-a9e2-f6c8601c1874 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:48.591611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:48.599977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5120cb39-c258-43ed-a9e2-f6c8601c1874 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:48.600487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5120cb39-c258-43ed-a9e2-f6c8601c1874 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:48.603018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5120cb39-c258-43ed-a9e2-f6c8601c1874 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:48.603018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5120cb39-c258-43ed-a9e2-f6c8601c1874 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:48.603018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5120cb39-c258-43ed-a9e2-f6c8601c1874 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:48.603018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5120cb39-c258-43ed-a9e2-f6c8601c1874 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:48.728588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00232fa9-198b-4bfe-920a-027351046c86 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:48.729200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00232fa9-198b-4bfe-920a-027351046c86 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:48.742904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00232fa9-198b-4bfe-920a-027351046c86 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:48.743553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00232fa9-198b-4bfe-920a-027351046c86 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:48.744091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00232fa9-198b-4bfe-920a-027351046c86 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:48.745156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00232fa9-198b-4bfe-920a-027351046c86 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:48.745760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00232fa9-198b-4bfe-920a-027351046c86 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:48.746320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00232fa9-198b-4bfe-920a-027351046c86 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:48.935625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-00232fa9-198b-4bfe-920a-027351046c86 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:48.968546 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00232fa9-198b-4bfe-920a-027351046c86 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.240604 Oct 11 04:35:48.980525 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2595/5452] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:48 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:49.031218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5120cb39-c258-43ed-a9e2-f6c8601c1874 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:49.051148 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5120cb39-c258-43ed-a9e2-f6c8601c1874 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1308 microversion: 2.1 time: 0.467922 Oct 11 04:35:49.056368 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2858/5453] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:48 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1308 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:49.391541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7c998e94-1347-46a4-85b9-6d73a56f3ddb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:49.397103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7c998e94-1347-46a4-85b9-6d73a56f3ddb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:49.399147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c998e94-1347-46a4-85b9-6d73a56f3ddb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:49.399815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c998e94-1347-46a4-85b9-6d73a56f3ddb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:49.400412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c998e94-1347-46a4-85b9-6d73a56f3ddb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:49.401268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c998e94-1347-46a4-85b9-6d73a56f3ddb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:49.401881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c998e94-1347-46a4-85b9-6d73a56f3ddb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:49.402515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c998e94-1347-46a4-85b9-6d73a56f3ddb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:49.418761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:49.997795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c86b7e8f-7cc2-45dd-92aa-7630256f20bc tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:49.998600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c86b7e8f-7cc2-45dd-92aa-7630256f20bc tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:50.009752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=7 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:50.028921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c86b7e8f-7cc2-45dd-92aa-7630256f20bc tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:50.028921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c86b7e8f-7cc2-45dd-92aa-7630256f20bc tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:50.028921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c86b7e8f-7cc2-45dd-92aa-7630256f20bc tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:50.029494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c86b7e8f-7cc2-45dd-92aa-7630256f20bc tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:50.031669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c86b7e8f-7cc2-45dd-92aa-7630256f20bc tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:50.032108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c86b7e8f-7cc2-45dd-92aa-7630256f20bc tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:50.231135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7c998e94-1347-46a4-85b9-6d73a56f3ddb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:50.246042 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7c998e94-1347-46a4-85b9-6d73a56f3ddb tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.856728 Oct 11 04:35:50.262623 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2596/5454] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:49 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:50.274070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c951f498-f0d4-44f3-bc98-94776cfa56f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:50.274756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c951f498-f0d4-44f3-bc98-94776cfa56f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:50.282705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c951f498-f0d4-44f3-bc98-94776cfa56f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:50.283769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c951f498-f0d4-44f3-bc98-94776cfa56f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:50.284391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c951f498-f0d4-44f3-bc98-94776cfa56f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:50.285295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c951f498-f0d4-44f3-bc98-94776cfa56f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:50.285913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c951f498-f0d4-44f3-bc98-94776cfa56f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:50.286636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c951f498-f0d4-44f3-bc98-94776cfa56f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:50.367909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:50.467288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c951f498-f0d4-44f3-bc98-94776cfa56f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:50.476325 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c951f498-f0d4-44f3-bc98-94776cfa56f8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1308 microversion: 2.1 time: 0.212535 Oct 11 04:35:50.476917 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2597/5455] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:50 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1308 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:50.607917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c86b7e8f-7cc2-45dd-92aa-7630256f20bc tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:50.617098 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c86b7e8f-7cc2-45dd-92aa-7630256f20bc tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.625610 Oct 11 04:35:50.633514 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2859/5456] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:49 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:51.278321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e573b232-786c-46b5-95a8-634f77b9e9e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:51.279010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e573b232-786c-46b5-95a8-634f77b9e9e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:51.286047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e573b232-786c-46b5-95a8-634f77b9e9e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:51.286656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e573b232-786c-46b5-95a8-634f77b9e9e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:51.287287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e573b232-786c-46b5-95a8-634f77b9e9e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:51.288018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e573b232-786c-46b5-95a8-634f77b9e9e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:51.288543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e573b232-786c-46b5-95a8-634f77b9e9e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:51.289313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e573b232-786c-46b5-95a8-634f77b9e9e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:51.440156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e573b232-786c-46b5-95a8-634f77b9e9e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:51.451554 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e573b232-786c-46b5-95a8-634f77b9e9e6 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.177131 Oct 11 04:35:51.452801 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2598/5457] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:51 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:51.500487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c9e161bc-0828-4da2-9f1c-f9f157b6d159 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:51.501157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c9e161bc-0828-4da2-9f1c-f9f157b6d159 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:51.510224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9e161bc-0828-4da2-9f1c-f9f157b6d159 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:51.510224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9e161bc-0828-4da2-9f1c-f9f157b6d159 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:51.510224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9e161bc-0828-4da2-9f1c-f9f157b6d159 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:51.513644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9e161bc-0828-4da2-9f1c-f9f157b6d159 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:51.513644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9e161bc-0828-4da2-9f1c-f9f157b6d159 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:51.513644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9e161bc-0828-4da2-9f1c-f9f157b6d159 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:51.641307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-028bbc23-4562-4c6c-9cd6-53e1c941bb95 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:51.641948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-028bbc23-4562-4c6c-9cd6-53e1c941bb95 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:51.653518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-028bbc23-4562-4c6c-9cd6-53e1c941bb95 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:51.654035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-028bbc23-4562-4c6c-9cd6-53e1c941bb95 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:51.654922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-028bbc23-4562-4c6c-9cd6-53e1c941bb95 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:51.656876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-028bbc23-4562-4c6c-9cd6-53e1c941bb95 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:51.657346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-028bbc23-4562-4c6c-9cd6-53e1c941bb95 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:51.657774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-028bbc23-4562-4c6c-9cd6-53e1c941bb95 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:51.694204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c9e161bc-0828-4da2-9f1c-f9f157b6d159 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:51.703991 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c9e161bc-0828-4da2-9f1c-f9f157b6d159 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1308 microversion: 2.1 time: 0.208506 Oct 11 04:35:51.704620 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2860/5458] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:51 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1308 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:51.838577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-028bbc23-4562-4c6c-9cd6-53e1c941bb95 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:51.841695 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-028bbc23-4562-4c6c-9cd6-53e1c941bb95 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.204582 Oct 11 04:35:51.842543 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2599/5459] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:51 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:52.475093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36fba9f0-a37a-451b-a9a1-ae49ad7caf26 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:52.476073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-36fba9f0-a37a-451b-a9a1-ae49ad7caf26 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:52.482840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36fba9f0-a37a-451b-a9a1-ae49ad7caf26 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:52.483354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36fba9f0-a37a-451b-a9a1-ae49ad7caf26 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:52.484602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36fba9f0-a37a-451b-a9a1-ae49ad7caf26 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:52.485335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36fba9f0-a37a-451b-a9a1-ae49ad7caf26 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:52.485796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36fba9f0-a37a-451b-a9a1-ae49ad7caf26 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:52.486452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36fba9f0-a37a-451b-a9a1-ae49ad7caf26 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:52.665970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-36fba9f0-a37a-451b-a9a1-ae49ad7caf26 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:52.677668 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-36fba9f0-a37a-451b-a9a1-ae49ad7caf26 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.206463 Oct 11 04:35:52.687116 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2861/5460] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:52 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:52.728103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bcd7530a-205f-49ef-8c0c-386de032de94 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:52.730203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bcd7530a-205f-49ef-8c0c-386de032de94 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:52.741266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7530a-205f-49ef-8c0c-386de032de94 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:52.742430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7530a-205f-49ef-8c0c-386de032de94 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:52.748032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7530a-205f-49ef-8c0c-386de032de94 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:52.748032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7530a-205f-49ef-8c0c-386de032de94 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:52.748032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7530a-205f-49ef-8c0c-386de032de94 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:52.748032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7530a-205f-49ef-8c0c-386de032de94 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:52.868623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-555ba4fe-5b3a-400b-94e9-46b7e3b14ce8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:52.868623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-555ba4fe-5b3a-400b-94e9-46b7e3b14ce8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:52.872837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-555ba4fe-5b3a-400b-94e9-46b7e3b14ce8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:52.873336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-555ba4fe-5b3a-400b-94e9-46b7e3b14ce8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:52.873979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-555ba4fe-5b3a-400b-94e9-46b7e3b14ce8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:52.875013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-555ba4fe-5b3a-400b-94e9-46b7e3b14ce8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:52.875697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-555ba4fe-5b3a-400b-94e9-46b7e3b14ce8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:52.876354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-555ba4fe-5b3a-400b-94e9-46b7e3b14ce8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:52.906834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bcd7530a-205f-49ef-8c0c-386de032de94 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:52.914917 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bcd7530a-205f-49ef-8c0c-386de032de94 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1308 microversion: 2.1 time: 0.190889 Oct 11 04:35:52.915492 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2600/5461] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:52 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1308 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:53.058734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-555ba4fe-5b3a-400b-94e9-46b7e3b14ce8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:53.068321 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-555ba4fe-5b3a-400b-94e9-46b7e3b14ce8 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.206433 Oct 11 04:35:53.069201 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2862/5462] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:52 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:53.570887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-fc4aeb6a-ae16-4926-bbaf-270ed6bebcb7 req-168515c3-28c4-49ea-a14b-e5937af73e31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90650e13-1fd0-479b-972e-d36b6521b37f", "name": "network-vif-plugged", "status": "completed", "tag": "04a8a7cd-3242-44a3-b767-f91dca6b2149"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:53.582765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fc4aeb6a-ae16-4926-bbaf-270ed6bebcb7 req-168515c3-28c4-49ea-a14b-e5937af73e31 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:53.583321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fc4aeb6a-ae16-4926-bbaf-270ed6bebcb7 req-168515c3-28c4-49ea-a14b-e5937af73e31 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:53.584062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fc4aeb6a-ae16-4926-bbaf-270ed6bebcb7 req-168515c3-28c4-49ea-a14b-e5937af73e31 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:53.603558 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-fc4aeb6a-ae16-4926-bbaf-270ed6bebcb7 req-168515c3-28c4-49ea-a14b-e5937af73e31 service nova] Creating event network-vif-plugged:04a8a7cd-3242-44a3-b767-f91dca6b2149 for instance 90650e13-1fd0-479b-972e-d36b6521b37f on n-h2-860892-1 Oct 11 04:35:53.611384 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-fc4aeb6a-ae16-4926-bbaf-270ed6bebcb7 req-168515c3-28c4-49ea-a14b-e5937af73e31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044710 Oct 11 04:35:53.612482 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2601/5463] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:53.705835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b3e2f6b2-9749-4c7f-9cdd-e5dbed2cfe66 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:53.705835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b3e2f6b2-9749-4c7f-9cdd-e5dbed2cfe66 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:53.712675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3e2f6b2-9749-4c7f-9cdd-e5dbed2cfe66 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:53.713962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3e2f6b2-9749-4c7f-9cdd-e5dbed2cfe66 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:53.716624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3e2f6b2-9749-4c7f-9cdd-e5dbed2cfe66 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:53.717574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3e2f6b2-9749-4c7f-9cdd-e5dbed2cfe66 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:53.718314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3e2f6b2-9749-4c7f-9cdd-e5dbed2cfe66 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:53.718917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b3e2f6b2-9749-4c7f-9cdd-e5dbed2cfe66 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:53.938374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f3f7b38a-d4f3-444f-816c-266589d79b72 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:53.939221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f3f7b38a-d4f3-444f-816c-266589d79b72 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:53.947232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3f7b38a-d4f3-444f-816c-266589d79b72 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:53.947946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3f7b38a-d4f3-444f-816c-266589d79b72 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:53.948482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3f7b38a-d4f3-444f-816c-266589d79b72 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:53.949283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3f7b38a-d4f3-444f-816c-266589d79b72 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:53.950416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3f7b38a-d4f3-444f-816c-266589d79b72 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:53.951064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3f7b38a-d4f3-444f-816c-266589d79b72 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:54.011543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b3e2f6b2-9749-4c7f-9cdd-e5dbed2cfe66 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:54.026039 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b3e2f6b2-9749-4c7f-9cdd-e5dbed2cfe66 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.328084 Oct 11 04:35:54.031674 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2863/5464] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:53 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:54.091689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-589af57e-25ea-49f3-8590-8b676bd81d8b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:54.092602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-589af57e-25ea-49f3-8590-8b676bd81d8b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:54.099651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589af57e-25ea-49f3-8590-8b676bd81d8b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:54.100212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589af57e-25ea-49f3-8590-8b676bd81d8b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:54.100659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589af57e-25ea-49f3-8590-8b676bd81d8b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:54.101362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589af57e-25ea-49f3-8590-8b676bd81d8b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:54.101997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589af57e-25ea-49f3-8590-8b676bd81d8b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:54.102486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-589af57e-25ea-49f3-8590-8b676bd81d8b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:54.286658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f3f7b38a-d4f3-444f-816c-266589d79b72 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:54.302147 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f3f7b38a-d4f3-444f-816c-266589d79b72 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1308 microversion: 2.1 time: 0.367918 Oct 11 04:35:54.307731 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2602/5465] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:53 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1308 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:54.340672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-589af57e-25ea-49f3-8590-8b676bd81d8b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:54.354425 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-589af57e-25ea-49f3-8590-8b676bd81d8b tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.266622 Oct 11 04:35:54.355985 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2864/5466] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:54 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:55.054381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e6790958-902e-4fda-805a-ef8f32bd2d4a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:55.055967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e6790958-902e-4fda-805a-ef8f32bd2d4a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:55.064098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6790958-902e-4fda-805a-ef8f32bd2d4a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:55.064766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6790958-902e-4fda-805a-ef8f32bd2d4a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:55.065385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6790958-902e-4fda-805a-ef8f32bd2d4a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:55.066275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6790958-902e-4fda-805a-ef8f32bd2d4a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:55.066951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6790958-902e-4fda-805a-ef8f32bd2d4a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:55.067651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6790958-902e-4fda-805a-ef8f32bd2d4a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:55.330877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8921c1f2-97eb-4cc8-8a3e-e7ede675a89f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:55.331706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8921c1f2-97eb-4cc8-8a3e-e7ede675a89f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:55.332510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e6790958-902e-4fda-805a-ef8f32bd2d4a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:55.345317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8921c1f2-97eb-4cc8-8a3e-e7ede675a89f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:55.347208 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e6790958-902e-4fda-805a-ef8f32bd2d4a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.293732 Oct 11 04:35:55.348153 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2603/5467] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:55 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:55.348883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8921c1f2-97eb-4cc8-8a3e-e7ede675a89f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:55.349479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8921c1f2-97eb-4cc8-8a3e-e7ede675a89f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:55.351433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8921c1f2-97eb-4cc8-8a3e-e7ede675a89f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:55.352334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8921c1f2-97eb-4cc8-8a3e-e7ede675a89f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:55.353061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8921c1f2-97eb-4cc8-8a3e-e7ede675a89f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:55.382486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-571eb6ab-b694-429d-9601-4605cad54e55 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:55.383212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-571eb6ab-b694-429d-9601-4605cad54e55 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:55.391338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-571eb6ab-b694-429d-9601-4605cad54e55 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:55.394950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-571eb6ab-b694-429d-9601-4605cad54e55 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:55.403407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-571eb6ab-b694-429d-9601-4605cad54e55 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:55.403407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-571eb6ab-b694-429d-9601-4605cad54e55 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:55.403407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-571eb6ab-b694-429d-9601-4605cad54e55 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:55.403407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-571eb6ab-b694-429d-9601-4605cad54e55 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:55.538121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8921c1f2-97eb-4cc8-8a3e-e7ede675a89f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:55.548619 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8921c1f2-97eb-4cc8-8a3e-e7ede675a89f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1308 microversion: 2.1 time: 0.221508 Oct 11 04:35:55.548619 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2865/5468] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:55 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1308 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:55.673048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-571eb6ab-b694-429d-9601-4605cad54e55 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:55.682088 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-571eb6ab-b694-429d-9601-4605cad54e55 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.305808 Oct 11 04:35:55.682750 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2604/5469] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:55 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:55.714138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-93143b06-eb3f-4c69-a160-0c5fe32fe002 req-64f696f6-7a92-4a50-80e9-5ec4b9f9e9bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a7df08-6119-4cc4-9ccd-d1eae28cff36", "name": "network-vif-plugged", "status": "completed", "tag": "1ebf4f78-f2e9-4d5c-baf2-65b40b7f530a"}, {"server_uuid": "2f08acea-8a20-4fcf-936f-1f8414dda402", "name": "network-vif-plugged", "status": "completed", "tag": "b920f741-3535-4516-b14d-4f818b819827"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:55.725831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-93143b06-eb3f-4c69-a160-0c5fe32fe002 req-64f696f6-7a92-4a50-80e9-5ec4b9f9e9bd service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:55.726374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-93143b06-eb3f-4c69-a160-0c5fe32fe002 req-64f696f6-7a92-4a50-80e9-5ec4b9f9e9bd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:55.726808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-93143b06-eb3f-4c69-a160-0c5fe32fe002 req-64f696f6-7a92-4a50-80e9-5ec4b9f9e9bd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:55.740323 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-93143b06-eb3f-4c69-a160-0c5fe32fe002 req-64f696f6-7a92-4a50-80e9-5ec4b9f9e9bd service nova] Creating event network-vif-plugged:1ebf4f78-f2e9-4d5c-baf2-65b40b7f530a for instance 05a7df08-6119-4cc4-9ccd-d1eae28cff36 on n-h2-860892-1 Oct 11 04:35:55.741211 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-93143b06-eb3f-4c69-a160-0c5fe32fe002 req-64f696f6-7a92-4a50-80e9-5ec4b9f9e9bd service nova] Creating event network-vif-plugged:b920f741-3535-4516-b14d-4f818b819827 for instance 2f08acea-8a20-4fcf-936f-1f8414dda402 on n-h1-860892-1 Oct 11 04:35:55.750395 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-93143b06-eb3f-4c69-a160-0c5fe32fe002 req-64f696f6-7a92-4a50-80e9-5ec4b9f9e9bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.039864 Oct 11 04:35:55.751020 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2866/5470] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:35:56.376466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-51c85ee2-83ca-4384-8b7f-a77d9d72e51e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:56.376466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-51c85ee2-83ca-4384-8b7f-a77d9d72e51e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:56.380012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51c85ee2-83ca-4384-8b7f-a77d9d72e51e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:56.380509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51c85ee2-83ca-4384-8b7f-a77d9d72e51e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:56.380951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51c85ee2-83ca-4384-8b7f-a77d9d72e51e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:56.381657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51c85ee2-83ca-4384-8b7f-a77d9d72e51e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:56.382175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51c85ee2-83ca-4384-8b7f-a77d9d72e51e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:56.382632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-51c85ee2-83ca-4384-8b7f-a77d9d72e51e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:56.524500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51c85ee2-83ca-4384-8b7f-a77d9d72e51e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:56.532270 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-51c85ee2-83ca-4384-8b7f-a77d9d72e51e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1520 microversion: 2.1 time: 0.163889 Oct 11 04:35:56.532865 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2605/5471] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:56 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:56.573464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cb8fbc2a-1e94-4aff-887a-6c2d0f76d998 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:56.574364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cb8fbc2a-1e94-4aff-887a-6c2d0f76d998 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:56.581689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb8fbc2a-1e94-4aff-887a-6c2d0f76d998 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:56.582208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb8fbc2a-1e94-4aff-887a-6c2d0f76d998 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:56.582777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb8fbc2a-1e94-4aff-887a-6c2d0f76d998 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:56.583593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb8fbc2a-1e94-4aff-887a-6c2d0f76d998 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:56.584169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb8fbc2a-1e94-4aff-887a-6c2d0f76d998 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:56.584776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb8fbc2a-1e94-4aff-887a-6c2d0f76d998 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:56.706263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a8f1ac0-18e6-4ada-b27a-10814c28554f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:56.707254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5a8f1ac0-18e6-4ada-b27a-10814c28554f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:56.714097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a8f1ac0-18e6-4ada-b27a-10814c28554f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:56.714868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a8f1ac0-18e6-4ada-b27a-10814c28554f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:56.715673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a8f1ac0-18e6-4ada-b27a-10814c28554f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:56.716605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a8f1ac0-18e6-4ada-b27a-10814c28554f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:56.717233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a8f1ac0-18e6-4ada-b27a-10814c28554f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:56.717873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a8f1ac0-18e6-4ada-b27a-10814c28554f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:56.883043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5a8f1ac0-18e6-4ada-b27a-10814c28554f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:56.891925 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5a8f1ac0-18e6-4ada-b27a-10814c28554f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1374 microversion: 2.1 time: 0.189632 Oct 11 04:35:56.892464 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2606/5472] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:56 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1374 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:56.914654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cb8fbc2a-1e94-4aff-887a-6c2d0f76d998 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:56.922845 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cb8fbc2a-1e94-4aff-887a-6c2d0f76d998 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1308 microversion: 2.1 time: 0.355372 Oct 11 04:35:56.923772 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2867/5473] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:56 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1308 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:57.560664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f0b5bcf6-35e9-408c-b2b2-b63914bb01d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:57.561912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f0b5bcf6-35e9-408c-b2b2-b63914bb01d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:57.569140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0b5bcf6-35e9-408c-b2b2-b63914bb01d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:57.569632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0b5bcf6-35e9-408c-b2b2-b63914bb01d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:57.570175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0b5bcf6-35e9-408c-b2b2-b63914bb01d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:57.572992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0b5bcf6-35e9-408c-b2b2-b63914bb01d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:57.572992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0b5bcf6-35e9-408c-b2b2-b63914bb01d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:57.572992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0b5bcf6-35e9-408c-b2b2-b63914bb01d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:57.784207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f0b5bcf6-35e9-408c-b2b2-b63914bb01d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:57.792076 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f0b5bcf6-35e9-408c-b2b2-b63914bb01d3 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.235291 Oct 11 04:35:57.792646 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2607/5474] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:57 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:57.814564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9639d75f-4855-4e60-abe7-975b7367c32f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:57.815182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9639d75f-4855-4e60-abe7-975b7367c32f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:57.822100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9639d75f-4855-4e60-abe7-975b7367c32f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:57.822875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9639d75f-4855-4e60-abe7-975b7367c32f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:57.823315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9639d75f-4855-4e60-abe7-975b7367c32f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:57.824012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9639d75f-4855-4e60-abe7-975b7367c32f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:57.824463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9639d75f-4855-4e60-abe7-975b7367c32f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:57.824890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9639d75f-4855-4e60-abe7-975b7367c32f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:57.917268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-40c1f3e8-fac0-4e79-b04d-e4d1423f4a7f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:57.918878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-40c1f3e8-fac0-4e79-b04d-e4d1423f4a7f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:57.926719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40c1f3e8-fac0-4e79-b04d-e4d1423f4a7f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:57.927569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40c1f3e8-fac0-4e79-b04d-e4d1423f4a7f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:57.928336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40c1f3e8-fac0-4e79-b04d-e4d1423f4a7f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:57.929346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40c1f3e8-fac0-4e79-b04d-e4d1423f4a7f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:57.929802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40c1f3e8-fac0-4e79-b04d-e4d1423f4a7f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:57.930241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40c1f3e8-fac0-4e79-b04d-e4d1423f4a7f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:58.039287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9639d75f-4855-4e60-abe7-975b7367c32f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:58.048361 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9639d75f-4855-4e60-abe7-975b7367c32f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.238153 Oct 11 04:35:58.049634 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2868/5475] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:57 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:58.064781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-170b61cc-ce6b-423f-af6e-4d3248bd7f44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:58.065765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-170b61cc-ce6b-423f-af6e-4d3248bd7f44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:58.089653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b61cc-ce6b-423f-af6e-4d3248bd7f44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:58.090154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b61cc-ce6b-423f-af6e-4d3248bd7f44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:58.090622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b61cc-ce6b-423f-af6e-4d3248bd7f44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:58.091395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b61cc-ce6b-423f-af6e-4d3248bd7f44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:58.091850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b61cc-ce6b-423f-af6e-4d3248bd7f44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:58.092276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-170b61cc-ce6b-423f-af6e-4d3248bd7f44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:58.096834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:58.150829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-40c1f3e8-fac0-4e79-b04d-e4d1423f4a7f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:58.158901 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-40c1f3e8-fac0-4e79-b04d-e4d1423f4a7f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1545 microversion: 2.1 time: 0.246330 Oct 11 04:35:58.159475 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2608/5476] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:57 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1545 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:58.163912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c8095ef2-e8be-45a5-8c13-34ad4770ad24 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:58.164763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c8095ef2-e8be-45a5-8c13-34ad4770ad24 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:58.170527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8095ef2-e8be-45a5-8c13-34ad4770ad24 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:58.171544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8095ef2-e8be-45a5-8c13-34ad4770ad24 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:58.171980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8095ef2-e8be-45a5-8c13-34ad4770ad24 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:58.172866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8095ef2-e8be-45a5-8c13-34ad4770ad24 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:58.173320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8095ef2-e8be-45a5-8c13-34ad4770ad24 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:58.173747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8095ef2-e8be-45a5-8c13-34ad4770ad24 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:58.440444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c8095ef2-e8be-45a5-8c13-34ad4770ad24 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:58.449456 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c8095ef2-e8be-45a5-8c13-34ad4770ad24 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.288921 Oct 11 04:35:58.450168 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2609/5477] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:58 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:58.464978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3e4b4ad5-e546-4f7c-9675-43480e62e1de tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:58.464978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3e4b4ad5-e546-4f7c-9675-43480e62e1de tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:58.464978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b4ad5-e546-4f7c-9675-43480e62e1de tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:58.464978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b4ad5-e546-4f7c-9675-43480e62e1de tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:58.464978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b4ad5-e546-4f7c-9675-43480e62e1de tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:58.464978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b4ad5-e546-4f7c-9675-43480e62e1de tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:58.464978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b4ad5-e546-4f7c-9675-43480e62e1de tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:58.465930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b4ad5-e546-4f7c-9675-43480e62e1de tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:58.604945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-170b61cc-ce6b-423f-af6e-4d3248bd7f44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:58.614219 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-170b61cc-ce6b-423f-af6e-4d3248bd7f44 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1489 microversion: 2.1 time: 0.563004 Oct 11 04:35:58.614810 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2869/5478] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:58 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1489 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:58.619933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8c1cf1c1-e8ba-4a37-98a1-d440db2e7752 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:58.626402 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-8c1cf1c1-e8ba-4a37-98a1-d440db2e7752 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance e080f51b-7687-4a9d-9836-0ac667580c32 has no mapping to a cell. Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8c1cf1c1-e8ba-4a37-98a1-d440db2e7752 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/e080f51b-7687-4a9d-9836-0ac667580c32/action HTTP/1.1 Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 15 Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: {"os-stop": {}} Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance e080f51b-7687-4a9d-9836-0ac667580c32 has no mapping to a cell. Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e080f51b-7687-4a9d-9836-0ac667580c32', 'body': {'os-stop': {}}} Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1411, in _get_instance Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi mapping = objects.InstanceMapping.get_by_instance_uuid( Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 112, in get_by_instance_uuid Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi db_mapping = cls._get_by_instance_uuid_from_db(context, instance_uuid) Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_mapping.py", line 106, in _get_by_instance_uuid_from_db Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceMappingNotFound(uuid=instance_uuid) Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceMappingNotFound: Instance e080f51b-7687-4a9d-9836-0ac667580c32 has no mapping to a cell. Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1444, in _stop_server Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, id) Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1418, in _get_instance Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:35:58.633260 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e080f51b-7687-4a9d-9836-0ac667580c32 has no mapping to a cell. Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e080f51b-7687-4a9d-9836-0ac667580c32 has no mapping to a cell. Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8c1cf1c1-e8ba-4a37-98a1-d440db2e7752 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance e080f51b-7687-4a9d-9836-0ac667580c32 has no mapping to a cell. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:35:58.639116 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8c1cf1c1-e8ba-4a37-98a1-d440db2e7752 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/e080f51b-7687-4a9d-9836-0ac667580c32/action" status: 404 len: 117 microversion: 2.1 time: 0.021129 Oct 11 04:35:58.641071 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2870/5479] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:35:58 2022] POST /compute/v2.1/servers/e080f51b-7687-4a9d-9836-0ac667580c32/action => generated 117 bytes in 25 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:35:58.647054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-469a198c-9b83-49b5-8c63-e120f28e7ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:58.647959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-469a198c-9b83-49b5-8c63-e120f28e7ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:58.654981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-469a198c-9b83-49b5-8c63-e120f28e7ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:58.656103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-469a198c-9b83-49b5-8c63-e120f28e7ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:58.656539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-469a198c-9b83-49b5-8c63-e120f28e7ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:58.657238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-469a198c-9b83-49b5-8c63-e120f28e7ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:58.657843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-469a198c-9b83-49b5-8c63-e120f28e7ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:58.658295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-469a198c-9b83-49b5-8c63-e120f28e7ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:58.819227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-469a198c-9b83-49b5-8c63-e120f28e7ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:58.828637 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-469a198c-9b83-49b5-8c63-e120f28e7ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1489 microversion: 2.1 time: 0.186248 Oct 11 04:35:58.829227 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2871/5480] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:58 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1489 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:58.836112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1aae8b17-9159-4543-8b2a-8c75cd1e00da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:58.841915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1aae8b17-9159-4543-8b2a-8c75cd1e00da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:58.844251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1aae8b17-9159-4543-8b2a-8c75cd1e00da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:58.844990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1aae8b17-9159-4543-8b2a-8c75cd1e00da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:58.845831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1aae8b17-9159-4543-8b2a-8c75cd1e00da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:58.846944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1aae8b17-9159-4543-8b2a-8c75cd1e00da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:58.847406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1aae8b17-9159-4543-8b2a-8c75cd1e00da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:58.847900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1aae8b17-9159-4543-8b2a-8c75cd1e00da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:58.984942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3e4b4ad5-e546-4f7c-9675-43480e62e1de tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:58.994109 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3e4b4ad5-e546-4f7c-9675-43480e62e1de tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1545 microversion: 2.1 time: 0.542822 Oct 11 04:35:58.994947 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2610/5481] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:58 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1545 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:59.010532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35710be1-de40-4490-867f-f095a2bc12a7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:59.011239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-35710be1-de40-4490-867f-f095a2bc12a7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:59.016805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:59.019477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35710be1-de40-4490-867f-f095a2bc12a7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.020189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35710be1-de40-4490-867f-f095a2bc12a7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.020733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35710be1-de40-4490-867f-f095a2bc12a7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.021513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35710be1-de40-4490-867f-f095a2bc12a7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.022048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35710be1-de40-4490-867f-f095a2bc12a7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.022580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35710be1-de40-4490-867f-f095a2bc12a7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.107765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1aae8b17-9159-4543-8b2a-8c75cd1e00da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:59.117797 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1aae8b17-9159-4543-8b2a-8c75cd1e00da tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.287520 Oct 11 04:35:59.121602 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2872/5482] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:58 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:59.142182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8bc286da-f7f3-4c91-93cd-00190b876f39 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:59.143250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8bc286da-f7f3-4c91-93cd-00190b876f39 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:59.149977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bc286da-f7f3-4c91-93cd-00190b876f39 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.151094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bc286da-f7f3-4c91-93cd-00190b876f39 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.151775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bc286da-f7f3-4c91-93cd-00190b876f39 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.152732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bc286da-f7f3-4c91-93cd-00190b876f39 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.153284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bc286da-f7f3-4c91-93cd-00190b876f39 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.153821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bc286da-f7f3-4c91-93cd-00190b876f39 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.257792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35710be1-de40-4490-867f-f095a2bc12a7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:59.268147 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35710be1-de40-4490-867f-f095a2bc12a7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1489 microversion: 2.1 time: 0.271927 Oct 11 04:35:59.268817 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2611/5483] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:58 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1489 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:35:59.292093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-748793c6-b295-45dd-9204-de328a721298 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:59.292899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-748793c6-b295-45dd-9204-de328a721298 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:59.299377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-748793c6-b295-45dd-9204-de328a721298 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.299868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-748793c6-b295-45dd-9204-de328a721298 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.301808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-748793c6-b295-45dd-9204-de328a721298 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.301808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-748793c6-b295-45dd-9204-de328a721298 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.301808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-748793c6-b295-45dd-9204-de328a721298 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.302098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-748793c6-b295-45dd-9204-de328a721298 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.329877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-748793c6-b295-45dd-9204-de328a721298 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:35:59.348869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8bc286da-f7f3-4c91-93cd-00190b876f39 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:59.356634 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8bc286da-f7f3-4c91-93cd-00190b876f39 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.218498 Oct 11 04:35:59.357198 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2873/5484] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:59 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:59.364728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:59.380343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6bc67b3e-25ce-41fb-8387-00457ec8dc25 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:59.380960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6bc67b3e-25ce-41fb-8387-00457ec8dc25 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 4101a957-a10d-4266-9e12-de9a992866bc] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:59.386430 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-6bc67b3e-25ce-41fb-8387-00457ec8dc25 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance 4101a957-a10d-4266-9e12-de9a992866bc could not be found. Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6bc67b3e-25ce-41fb-8387-00457ec8dc25 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/4101a957-a10d-4266-9e12-de9a992866bc/action HTTP/1.1 Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 15 Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: {"suspend": {}} Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 4101a957-a10d-4266-9e12-de9a992866bc could not be found. Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '4101a957-a10d-4266-9e12-de9a992866bc', 'body': {'suspend': {}}} Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4101a957-a10d-4266-9e12-de9a992866bc could not be found. Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 35, in _suspend Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, context, id) Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4101a957-a10d-4266-9e12-de9a992866bc could not be found. Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:35:59.388400 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:35:59.396794 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:35:59.396794 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:35:59.396794 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4101a957-a10d-4266-9e12-de9a992866bc could not be found. Oct 11 04:35:59.396794 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:35:59.396794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6bc67b3e-25ce-41fb-8387-00457ec8dc25 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance 4101a957-a10d-4266-9e12-de9a992866bc could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:35:59.396794 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6bc67b3e-25ce-41fb-8387-00457ec8dc25 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/4101a957-a10d-4266-9e12-de9a992866bc/action" status: 404 len: 111 microversion: 2.1 time: 0.013390 Oct 11 04:35:59.396794 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2874/5485] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:35:59 2022] POST /compute/v2.1/servers/4101a957-a10d-4266-9e12-de9a992866bc/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:35:59.402715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dcd498be-81d3-4787-91b5-f33bb8301372 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:59.403333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dcd498be-81d3-4787-91b5-f33bb8301372 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:59.410551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcd498be-81d3-4787-91b5-f33bb8301372 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.411071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcd498be-81d3-4787-91b5-f33bb8301372 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.411619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcd498be-81d3-4787-91b5-f33bb8301372 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.412327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcd498be-81d3-4787-91b5-f33bb8301372 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.412781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcd498be-81d3-4787-91b5-f33bb8301372 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.413210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcd498be-81d3-4787-91b5-f33bb8301372 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.704803 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-748793c6-b295-45dd-9204-de328a721298 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 204 len: 0 microversion: 2.1 time: 0.416606 Oct 11 04:35:59.707265 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2612/5486] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:35:59 2022] DELETE /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:35:59.716242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ba09333-2bad-494a-b6dc-f9c64116173a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:59.717181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ba09333-2bad-494a-b6dc-f9c64116173a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:59.721507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dcd498be-81d3-4787-91b5-f33bb8301372 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:59.724648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba09333-2bad-494a-b6dc-f9c64116173a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.725361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba09333-2bad-494a-b6dc-f9c64116173a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.725810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba09333-2bad-494a-b6dc-f9c64116173a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.726540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba09333-2bad-494a-b6dc-f9c64116173a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.727164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba09333-2bad-494a-b6dc-f9c64116173a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.727780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba09333-2bad-494a-b6dc-f9c64116173a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.729869 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dcd498be-81d3-4787-91b5-f33bb8301372 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.330612 Oct 11 04:35:59.730488 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2875/5487] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:59 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:59.753898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4c1fb312-1994-4ce2-804b-855ef0fc7fbc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:35:59.754547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4c1fb312-1994-4ce2-804b-855ef0fc7fbc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:59.760703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c1fb312-1994-4ce2-804b-855ef0fc7fbc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.761189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c1fb312-1994-4ce2-804b-855ef0fc7fbc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.761628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c1fb312-1994-4ce2-804b-855ef0fc7fbc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.762613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c1fb312-1994-4ce2-804b-855ef0fc7fbc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.763069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c1fb312-1994-4ce2-804b-855ef0fc7fbc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.763496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4c1fb312-1994-4ce2-804b-855ef0fc7fbc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.947322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4c1fb312-1994-4ce2-804b-855ef0fc7fbc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:35:59.956186 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4c1fb312-1994-4ce2-804b-855ef0fc7fbc tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.206084 Oct 11 04:35:59.968260 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2876/5488] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:59 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:35:59.978739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-977c3c34-f2dc-4c09-844c-675c382b87f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:35:59.979277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-977c3c34-f2dc-4c09-844c-675c382b87f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:35:59.981536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:35:59.987137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-977c3c34-f2dc-4c09-844c-675c382b87f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.992056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-977c3c34-f2dc-4c09-844c-675c382b87f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.992056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-977c3c34-f2dc-4c09-844c-675c382b87f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:35:59.992056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-977c3c34-f2dc-4c09-844c-675c382b87f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:35:59.992056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-977c3c34-f2dc-4c09-844c-675c382b87f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:35:59.992056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-977c3c34-f2dc-4c09-844c-675c382b87f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:00.013855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-977c3c34-f2dc-4c09-844c-675c382b87f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lazy-loading 'flavor' on Instance uuid 90650e13-1fd0-479b-972e-d36b6521b37f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:36:00.035034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3ba09333-2bad-494a-b6dc-f9c64116173a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:00.044030 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ba09333-2bad-494a-b6dc-f9c64116173a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1495 microversion: 2.1 time: 0.331938 Oct 11 04:36:00.045170 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2613/5489] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:35:59 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1495 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:36:00.353933 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-977c3c34-f2dc-4c09-844c-675c382b87f2 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 202 len: 0 microversion: 2.1 time: 0.378579 Oct 11 04:36:00.354768 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2877/5490] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:35:59 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 0 bytes in 381 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:36:00.365167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a471354d-ef78-4fd8-b6de-28acea4d235a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:00.366084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a471354d-ef78-4fd8-b6de-28acea4d235a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:00.376132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a471354d-ef78-4fd8-b6de-28acea4d235a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:00.377032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a471354d-ef78-4fd8-b6de-28acea4d235a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:00.377698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a471354d-ef78-4fd8-b6de-28acea4d235a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:00.378813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a471354d-ef78-4fd8-b6de-28acea4d235a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:00.379461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a471354d-ef78-4fd8-b6de-28acea4d235a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:00.380096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a471354d-ef78-4fd8-b6de-28acea4d235a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:00.706227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a471354d-ef78-4fd8-b6de-28acea4d235a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:00.716144 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a471354d-ef78-4fd8-b6de-28acea4d235a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1515 microversion: 2.1 time: 0.356037 Oct 11 04:36:00.717733 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2614/5491] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:00 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1515 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:36:01.070567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4f26767e-5703-4958-9295-ec6f12645136 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:01.071543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4f26767e-5703-4958-9295-ec6f12645136 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:01.082111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f26767e-5703-4958-9295-ec6f12645136 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:01.082111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f26767e-5703-4958-9295-ec6f12645136 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:01.082111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f26767e-5703-4958-9295-ec6f12645136 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:01.082111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f26767e-5703-4958-9295-ec6f12645136 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:01.082964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f26767e-5703-4958-9295-ec6f12645136 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:01.083717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f26767e-5703-4958-9295-ec6f12645136 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:01.401464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4f26767e-5703-4958-9295-ec6f12645136 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:01.418208 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4f26767e-5703-4958-9295-ec6f12645136 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1495 microversion: 2.1 time: 0.353445 Oct 11 04:36:01.431757 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2878/5492] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:01 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1495 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:01.740970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-31a074fc-938d-4d1d-af48-63521048d54d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:01.742230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-31a074fc-938d-4d1d-af48-63521048d54d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:01.750532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31a074fc-938d-4d1d-af48-63521048d54d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:01.751296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31a074fc-938d-4d1d-af48-63521048d54d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:01.751954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31a074fc-938d-4d1d-af48-63521048d54d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:01.752832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31a074fc-938d-4d1d-af48-63521048d54d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:01.753458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31a074fc-938d-4d1d-af48-63521048d54d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:01.754056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-31a074fc-938d-4d1d-af48-63521048d54d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:01.963699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-31a074fc-938d-4d1d-af48-63521048d54d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:01.974035 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-31a074fc-938d-4d1d-af48-63521048d54d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1498 microversion: 2.1 time: 0.237443 Oct 11 04:36:01.975664 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2615/5493] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:01 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1498 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:02.001373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:02.002313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:02.010475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:02.011339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:02.012263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:02.013234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:02.013893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:02.015283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:02.046331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lazy-loading 'flavor' on Instance uuid 90650e13-1fd0-479b-972e-d36b6521b37f {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:36:02.061235 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Cannot 'suspend' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state suspended Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action HTTP/1.1 Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 15 Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: {"suspend": {}} Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: exception: Cannot 'suspend' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state suspended Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '90650e13-1fd0-479b-972e-d36b6521b37f', 'body': {'suspend': {}}} Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 40, in _suspend Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.compute_api.suspend(context, server) Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 309, in inner Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 259, in inner Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90650e13-1fd0-479b-972e-d36b6521b37f in vm_state suspended. Cannot suspend while the instance is in this state. Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/suspend_server.py", line 44, in _suspend Oct 11 04:36:02.065108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'suspend' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state suspended Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'suspend' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state suspended Oct 11 04:36:02.069607 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:02.072750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 409 to user: Cannot 'suspend' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state suspended {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:02.073870 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bc65e081-a6d0-457b-b22e-b0df996d3d1a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 409 len: 148 microversion: 2.1 time: 0.078143 Oct 11 04:36:02.074973 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2879/5494] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:36:01 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 148 bytes in 80 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:36:02.085578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e7d2ca05-2f74-42ed-b468-85797a9acc9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:02.086364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e7d2ca05-2f74-42ed-b468-85797a9acc9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:02.097915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d2ca05-2f74-42ed-b468-85797a9acc9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:02.098876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d2ca05-2f74-42ed-b468-85797a9acc9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:02.099606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d2ca05-2f74-42ed-b468-85797a9acc9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:02.100615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d2ca05-2f74-42ed-b468-85797a9acc9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:02.101241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d2ca05-2f74-42ed-b468-85797a9acc9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:02.101838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7d2ca05-2f74-42ed-b468-85797a9acc9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:02.393735 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e7d2ca05-2f74-42ed-b468-85797a9acc9f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 202 len: 0 microversion: 2.1 time: 0.313910 Oct 11 04:36:02.397986 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2616/5495] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:36:02 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:36:02.403082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d10af34-3b1c-4817-a32b-378287877f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:02.403670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d10af34-3b1c-4817-a32b-378287877f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:02.418283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d10af34-3b1c-4817-a32b-378287877f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:02.418837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d10af34-3b1c-4817-a32b-378287877f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:02.419225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d10af34-3b1c-4817-a32b-378287877f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:02.419949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d10af34-3b1c-4817-a32b-378287877f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:02.421378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d10af34-3b1c-4817-a32b-378287877f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:02.421838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d10af34-3b1c-4817-a32b-378287877f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:02.446950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-87ceab17-a2f4-42e7-af54-2b42e02d7371 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:02.447901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-87ceab17-a2f4-42e7-af54-2b42e02d7371 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:02.457682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87ceab17-a2f4-42e7-af54-2b42e02d7371 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:02.460102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87ceab17-a2f4-42e7-af54-2b42e02d7371 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:02.460708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87ceab17-a2f4-42e7-af54-2b42e02d7371 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:02.461563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87ceab17-a2f4-42e7-af54-2b42e02d7371 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:02.464746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87ceab17-a2f4-42e7-af54-2b42e02d7371 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:02.465549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87ceab17-a2f4-42e7-af54-2b42e02d7371 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:02.604581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-87ceab17-a2f4-42e7-af54-2b42e02d7371 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:02.617910 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-87ceab17-a2f4-42e7-af54-2b42e02d7371 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1453 microversion: 2.1 time: 0.173967 Oct 11 04:36:02.626358 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2617/5496] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:02 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:36:02.680904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d10af34-3b1c-4817-a32b-378287877f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:02.692748 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d10af34-3b1c-4817-a32b-378287877f5e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1504 microversion: 2.1 time: 0.293726 Oct 11 04:36:02.694769 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2880/5497] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:02 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1504 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:36:02.796712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-afd2a370-b60f-4cf5-a2c1-0128a215aea7 req-5c57af82-de89-473b-a10a-d989d09902aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a7df08-6119-4cc4-9ccd-d1eae28cff36", "tag": "1ebf4f78-f2e9-4d5c-baf2-65b40b7f530a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:02.838826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-afd2a370-b60f-4cf5-a2c1-0128a215aea7 req-5c57af82-de89-473b-a10a-d989d09902aa service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:02.844813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-afd2a370-b60f-4cf5-a2c1-0128a215aea7 req-5c57af82-de89-473b-a10a-d989d09902aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:02.845467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-afd2a370-b60f-4cf5-a2c1-0128a215aea7 req-5c57af82-de89-473b-a10a-d989d09902aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:02.885106 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-afd2a370-b60f-4cf5-a2c1-0128a215aea7 req-5c57af82-de89-473b-a10a-d989d09902aa service nova] Creating event network-changed:1ebf4f78-f2e9-4d5c-baf2-65b40b7f530a for instance 05a7df08-6119-4cc4-9ccd-d1eae28cff36 on n-h2-860892-1 Oct 11 04:36:02.901051 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-afd2a370-b60f-4cf5-a2c1-0128a215aea7 req-5c57af82-de89-473b-a10a-d989d09902aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110122 Oct 11 04:36:02.909347 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2618/5498] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:36:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:03.650382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:03.650881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:03.668646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:03.669141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:03.671717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:03.671717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:03.671717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:03.672097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:03.738439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0ac74135-a5d3-49ef-a07d-af75a931b65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:03.746806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0ac74135-a5d3-49ef-a07d-af75a931b65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:03.752395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:03.761362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:03.762775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:03.765409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lazy-loading 'fault' on Instance uuid 2f08acea-8a20-4fcf-936f-1f8414dda402 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:36:03.769285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ac74135-a5d3-49ef-a07d-af75a931b65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:03.770109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ac74135-a5d3-49ef-a07d-af75a931b65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:03.770801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ac74135-a5d3-49ef-a07d-af75a931b65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:03.771737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ac74135-a5d3-49ef-a07d-af75a931b65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:03.772384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ac74135-a5d3-49ef-a07d-af75a931b65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:03.779223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ac74135-a5d3-49ef-a07d-af75a931b65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:04.093087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:04.115047 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a63c9ac-f053-49da-b9b5-97cca7124e8e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 200 len: 1298 microversion: 2.1 time: 0.469554 Oct 11 04:36:04.126953 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2881/5499] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:03 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 1298 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:04.183990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0ac74135-a5d3-49ef-a07d-af75a931b65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:04.193139 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0ac74135-a5d3-49ef-a07d-af75a931b65e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1504 microversion: 2.1 time: 0.459855 Oct 11 04:36:04.198042 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2619/5500] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:03 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1504 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:04.985825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-62d6a079-84b1-482b-b3e2-2c9aba9525b1 req-80a6538b-238a-48cf-b276-635caaa17090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f08acea-8a20-4fcf-936f-1f8414dda402", "name": "network-vif-deleted", "tag": "b920f741-3535-4516-b14d-4f818b819827"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:05.004564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-62d6a079-84b1-482b-b3e2-2c9aba9525b1 req-80a6538b-238a-48cf-b276-635caaa17090 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.005060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-62d6a079-84b1-482b-b3e2-2c9aba9525b1 req-80a6538b-238a-48cf-b276-635caaa17090 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.005764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-62d6a079-84b1-482b-b3e2-2c9aba9525b1 req-80a6538b-238a-48cf-b276-635caaa17090 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.021183 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-62d6a079-84b1-482b-b3e2-2c9aba9525b1 req-80a6538b-238a-48cf-b276-635caaa17090 service nova] Creating event network-vif-deleted:b920f741-3535-4516-b14d-4f818b819827 for instance 2f08acea-8a20-4fcf-936f-1f8414dda402 on n-h1-860892-1 Oct 11 04:36:05.027079 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-62d6a079-84b1-482b-b3e2-2c9aba9525b1 req-80a6538b-238a-48cf-b276-635caaa17090 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047271 Oct 11 04:36:05.027869 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2882/5501] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:36:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:05.146423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:05.146978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:05.154495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.155405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.155868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.156659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.157147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.157582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.172842 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 HTTP/1.1 Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '2f08acea-8a20-4fcf-936f-1f8414dda402'} Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:05.174569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:05.180618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:05.180618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:05.180618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:05.180618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:05.180618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:05.180618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:36:05.180618 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:05.180618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:05.180618 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1b697f5c-0ea8-4889-ae4f-2bda26a39c3f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 404 len: 111 microversion: 2.1 time: 0.033727 Oct 11 04:36:05.180618 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2620/5502] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:05 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:36:05.188032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31b0018e-aa7a-4689-b1f8-def49f135238 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:05.188677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31b0018e-aa7a-4689-b1f8-def49f135238 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:05.196140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31b0018e-aa7a-4689-b1f8-def49f135238 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.196642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31b0018e-aa7a-4689-b1f8-def49f135238 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.197107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31b0018e-aa7a-4689-b1f8-def49f135238 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.197951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31b0018e-aa7a-4689-b1f8-def49f135238 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.198439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31b0018e-aa7a-4689-b1f8-def49f135238 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.198868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31b0018e-aa7a-4689-b1f8-def49f135238 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.227254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31b0018e-aa7a-4689-b1f8-def49f135238 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:36:05.236244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ad9badca-1628-455f-9bb7-38a520816f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:05.237440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ad9badca-1628-455f-9bb7-38a520816f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:05.244312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad9badca-1628-455f-9bb7-38a520816f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.245034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad9badca-1628-455f-9bb7-38a520816f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.245630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad9badca-1628-455f-9bb7-38a520816f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.246543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad9badca-1628-455f-9bb7-38a520816f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.247164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad9badca-1628-455f-9bb7-38a520816f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.247737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad9badca-1628-455f-9bb7-38a520816f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.508725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ad9badca-1628-455f-9bb7-38a520816f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:05.520447 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ad9badca-1628-455f-9bb7-38a520816f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.292977 Oct 11 04:36:05.520447 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2621/5503] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:05 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:36:05.543497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb0a610c-7dca-4c4b-9e92-4a4a0c6c9f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:05.544111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fb0a610c-7dca-4c4b-9e92-4a4a0c6c9f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:05.552037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0a610c-7dca-4c4b-9e92-4a4a0c6c9f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.552037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0a610c-7dca-4c4b-9e92-4a4a0c6c9f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.552037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0a610c-7dca-4c4b-9e92-4a4a0c6c9f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.552037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0a610c-7dca-4c4b-9e92-4a4a0c6c9f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.552363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0a610c-7dca-4c4b-9e92-4a4a0c6c9f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.552503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb0a610c-7dca-4c4b-9e92-4a4a0c6c9f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.606516 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31b0018e-aa7a-4689-b1f8-def49f135238 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 204 len: 0 microversion: 2.1 time: 0.424806 Oct 11 04:36:05.607660 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2883/5504] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:36:05 2022] DELETE /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:36:05.617239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-11c32f8b-e868-4b83-b9ea-419737cfb2a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:05.617945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-11c32f8b-e868-4b83-b9ea-419737cfb2a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:05.625044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11c32f8b-e868-4b83-b9ea-419737cfb2a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.625879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11c32f8b-e868-4b83-b9ea-419737cfb2a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.626535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11c32f8b-e868-4b83-b9ea-419737cfb2a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.627792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11c32f8b-e868-4b83-b9ea-419737cfb2a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.628259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11c32f8b-e868-4b83-b9ea-419737cfb2a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.628689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11c32f8b-e868-4b83-b9ea-419737cfb2a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.796288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb0a610c-7dca-4c4b-9e92-4a4a0c6c9f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:05.805999 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb0a610c-7dca-4c4b-9e92-4a4a0c6c9f88 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.266753 Oct 11 04:36:05.813433 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2622/5505] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:05 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:36:05.836232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f048f307-1c67-47a1-92ba-09fb796c7061 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:05.836952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f048f307-1c67-47a1-92ba-09fb796c7061 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: af85112f-5eec-4cbb-9e87-4454f91597fd] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:05.843436 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f048f307-1c67-47a1-92ba-09fb796c7061 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance af85112f-5eec-4cbb-9e87-4454f91597fd could not be found. Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f048f307-1c67-47a1-92ba-09fb796c7061 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/af85112f-5eec-4cbb-9e87-4454f91597fd/action HTTP/1.1 Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 15 Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: {"unpause": {}} Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance af85112f-5eec-4cbb-9e87-4454f91597fd could not be found. Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'af85112f-5eec-4cbb-9e87-4454f91597fd', 'body': {'unpause': {}}} Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af85112f-5eec-4cbb-9e87-4454f91597fd could not be found. Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 58, in _unpause Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi server = common.get_instance(self.compute_api, ctxt, id) Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af85112f-5eec-4cbb-9e87-4454f91597fd could not be found. Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:05.844941 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:05.849957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:05.849957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:05.849957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af85112f-5eec-4cbb-9e87-4454f91597fd could not be found. Oct 11 04:36:05.849957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:05.849957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f048f307-1c67-47a1-92ba-09fb796c7061 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance af85112f-5eec-4cbb-9e87-4454f91597fd could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:05.849957 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f048f307-1c67-47a1-92ba-09fb796c7061 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/af85112f-5eec-4cbb-9e87-4454f91597fd/action" status: 404 len: 111 microversion: 2.1 time: 0.015109 Oct 11 04:36:05.849957 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2623/5506] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:36:05 2022] POST /compute/v2.1/servers/af85112f-5eec-4cbb-9e87-4454f91597fd/action => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:36:05.855938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46e473a8-2caf-4f90-91fc-8de31c0f05fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:05.856616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-46e473a8-2caf-4f90-91fc-8de31c0f05fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:05.864665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46e473a8-2caf-4f90-91fc-8de31c0f05fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.865175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46e473a8-2caf-4f90-91fc-8de31c0f05fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.865609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46e473a8-2caf-4f90-91fc-8de31c0f05fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.866531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46e473a8-2caf-4f90-91fc-8de31c0f05fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:05.866983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46e473a8-2caf-4f90-91fc-8de31c0f05fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:05.867406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46e473a8-2caf-4f90-91fc-8de31c0f05fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:05.881427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-11c32f8b-e868-4b83-b9ea-419737cfb2a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:05.890158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:05.897047 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-11c32f8b-e868-4b83-b9ea-419737cfb2a6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1495 microversion: 2.1 time: 0.284384 Oct 11 04:36:05.897683 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2884/5507] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:05 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1495 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:06.100386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-46e473a8-2caf-4f90-91fc-8de31c0f05fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:06.113805 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-46e473a8-2caf-4f90-91fc-8de31c0f05fa tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.261645 Oct 11 04:36:06.114548 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2624/5508] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:05 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:06.140915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82e8cbda-dd51-4a1c-a682-f6c85bc7a394 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:06.142839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82e8cbda-dd51-4a1c-a682-f6c85bc7a394 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:06.151298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e8cbda-dd51-4a1c-a682-f6c85bc7a394 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.152128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e8cbda-dd51-4a1c-a682-f6c85bc7a394 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.152754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e8cbda-dd51-4a1c-a682-f6c85bc7a394 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:06.153628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e8cbda-dd51-4a1c-a682-f6c85bc7a394 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.154272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e8cbda-dd51-4a1c-a682-f6c85bc7a394 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.154882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82e8cbda-dd51-4a1c-a682-f6c85bc7a394 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:06.330492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82e8cbda-dd51-4a1c-a682-f6c85bc7a394 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:06.341352 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82e8cbda-dd51-4a1c-a682-f6c85bc7a394 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.205202 Oct 11 04:36:06.342108 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2885/5509] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:06 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:06.365820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:06.375250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:06.375250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.375250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.375250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:06.375780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.376046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.376693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:06.402144 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Cannot 'unpause' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action HTTP/1.1 Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 15 Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: {"unpause": {}} Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: exception: Cannot 'unpause' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '90650e13-1fd0-479b-972e-d36b6521b37f', 'body': {'unpause': {}}} Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 62, in _unpause Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.compute_api.unpause(ctxt, server) Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90650e13-1fd0-479b-972e-d36b6521b37f in vm_state active. Cannot unpause while the instance is in this state. Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/pause_server.py", line 66, in _unpause Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unpause' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:06.404808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:06.413341 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:06.413341 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:06.413341 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:06.413341 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unpause' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:36:06.413341 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:06.413341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 409 to user: Cannot 'unpause' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:06.413341 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9e2596ed-9069-4dd1-b10a-790b84ffcc8e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 409 len: 145 microversion: 2.1 time: 0.044273 Oct 11 04:36:06.413341 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2625/5510] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:36:06 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 145 bytes in 46 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:36:06.422529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d9cec5d-1c73-40d4-933d-ecf7e9edd617 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:06.423346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d9cec5d-1c73-40d4-933d-ecf7e9edd617 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:06.432041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d9cec5d-1c73-40d4-933d-ecf7e9edd617 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.432959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d9cec5d-1c73-40d4-933d-ecf7e9edd617 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.433593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d9cec5d-1c73-40d4-933d-ecf7e9edd617 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:06.434531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d9cec5d-1c73-40d4-933d-ecf7e9edd617 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.435505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d9cec5d-1c73-40d4-933d-ecf7e9edd617 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.436508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d9cec5d-1c73-40d4-933d-ecf7e9edd617 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:06.615733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d9cec5d-1c73-40d4-933d-ecf7e9edd617 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:06.625356 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d9cec5d-1c73-40d4-933d-ecf7e9edd617 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.208339 Oct 11 04:36:06.626014 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2886/5511] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:06 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:06.649887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-edd16a5f-65bc-4997-8026-3fca3a6fac7e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:06.650547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-edd16a5f-65bc-4997-8026-3fca3a6fac7e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:06.658100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edd16a5f-65bc-4997-8026-3fca3a6fac7e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.658751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edd16a5f-65bc-4997-8026-3fca3a6fac7e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.659386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edd16a5f-65bc-4997-8026-3fca3a6fac7e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:06.660099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edd16a5f-65bc-4997-8026-3fca3a6fac7e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.660914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edd16a5f-65bc-4997-8026-3fca3a6fac7e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.661480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edd16a5f-65bc-4997-8026-3fca3a6fac7e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:06.835100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-edd16a5f-65bc-4997-8026-3fca3a6fac7e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:06.843685 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-edd16a5f-65bc-4997-8026-3fca3a6fac7e tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.197700 Oct 11 04:36:06.856216 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2626/5512] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:06 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:06.866551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5343d222-e902-4d9b-9452-8139c003f243 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:06.867148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5343d222-e902-4d9b-9452-8139c003f243 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 93bdfa4d-fef9-46cb-a2cd-d1ddc9673042] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:06.872725 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-5343d222-e902-4d9b-9452-8139c003f243 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance 93bdfa4d-fef9-46cb-a2cd-d1ddc9673042 could not be found. Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5343d222-e902-4d9b-9452-8139c003f243 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/93bdfa4d-fef9-46cb-a2cd-d1ddc9673042/action HTTP/1.1 Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 18 Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: {"unshelve": null} Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 93bdfa4d-fef9-46cb-a2cd-d1ddc9673042 could not be found. Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '93bdfa4d-fef9-46cb-a2cd-d1ddc9673042', 'body': {'unshelve': None}} Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93bdfa4d-fef9-46cb-a2cd-d1ddc9673042 could not be found. Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 102, in _unshelve Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, id) Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93bdfa4d-fef9-46cb-a2cd-d1ddc9673042 could not be found. Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:06.874578 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:06.886476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:06.886476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:06.886476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:06.886476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:06.886476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:06.886476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:06.886476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93bdfa4d-fef9-46cb-a2cd-d1ddc9673042 could not be found. Oct 11 04:36:06.886476 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:06.886476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5343d222-e902-4d9b-9452-8139c003f243 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance 93bdfa4d-fef9-46cb-a2cd-d1ddc9673042 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:06.886476 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5343d222-e902-4d9b-9452-8139c003f243 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/93bdfa4d-fef9-46cb-a2cd-d1ddc9673042/action" status: 404 len: 111 microversion: 2.1 time: 0.013579 Oct 11 04:36:06.886476 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2887/5513] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:36:06 2022] POST /compute/v2.1/servers/93bdfa4d-fef9-46cb-a2cd-d1ddc9673042/action => generated 111 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:36:06.893015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-adb0696d-5a9f-4f6a-aa72-57c239bd2330 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:06.893621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-adb0696d-5a9f-4f6a-aa72-57c239bd2330 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:06.899804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb0696d-5a9f-4f6a-aa72-57c239bd2330 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.900279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb0696d-5a9f-4f6a-aa72-57c239bd2330 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.900702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb0696d-5a9f-4f6a-aa72-57c239bd2330 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:06.901447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb0696d-5a9f-4f6a-aa72-57c239bd2330 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.901894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb0696d-5a9f-4f6a-aa72-57c239bd2330 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.902344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-adb0696d-5a9f-4f6a-aa72-57c239bd2330 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:06.922587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a336469-8eb7-4f0e-a8c5-ca2e8f38c553 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:06.923845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1a336469-8eb7-4f0e-a8c5-ca2e8f38c553 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:06.934484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a336469-8eb7-4f0e-a8c5-ca2e8f38c553 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.935103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a336469-8eb7-4f0e-a8c5-ca2e8f38c553 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.935646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a336469-8eb7-4f0e-a8c5-ca2e8f38c553 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:06.936669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a336469-8eb7-4f0e-a8c5-ca2e8f38c553 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:06.937230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a336469-8eb7-4f0e-a8c5-ca2e8f38c553 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:06.937758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a336469-8eb7-4f0e-a8c5-ca2e8f38c553 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:07.157933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-adb0696d-5a9f-4f6a-aa72-57c239bd2330 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:07.175252 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-adb0696d-5a9f-4f6a-aa72-57c239bd2330 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.286700 Oct 11 04:36:07.179626 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2627/5514] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:06 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:36:07.198853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f1394f2-7872-429a-8387-e7a348eba159 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:07.199468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f1394f2-7872-429a-8387-e7a348eba159 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:07.212924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f1394f2-7872-429a-8387-e7a348eba159 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:07.215183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f1394f2-7872-429a-8387-e7a348eba159 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:07.215824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f1394f2-7872-429a-8387-e7a348eba159 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:07.218449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f1394f2-7872-429a-8387-e7a348eba159 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:07.219095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f1394f2-7872-429a-8387-e7a348eba159 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:07.219700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f1394f2-7872-429a-8387-e7a348eba159 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:07.234230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1a336469-8eb7-4f0e-a8c5-ca2e8f38c553 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:07.251589 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1a336469-8eb7-4f0e-a8c5-ca2e8f38c553 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1495 microversion: 2.1 time: 0.333835 Oct 11 04:36:07.264445 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2888/5515] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:06 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1495 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:36:07.423709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f1394f2-7872-429a-8387-e7a348eba159 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:07.426477 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f1394f2-7872-429a-8387-e7a348eba159 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.231492 Oct 11 04:36:07.427267 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2628/5516] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:07 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:36:07.452983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:07.453587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:07.461113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:07.462491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:07.463158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:07.464172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:07.465178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:07.465793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:07.505606 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Cannot 'unshelve' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action HTTP/1.1 Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 18 Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: {"unshelve": null} Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: exception: Cannot 'unshelve' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '90650e13-1fd0-479b-972e-d36b6521b37f', 'body': {'unshelve': None}} Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 124, in _unshelve Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.compute_api.unshelve( Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90650e13-1fd0-479b-972e-d36b6521b37f in vm_state active. Cannot unshelve while the instance is in this state. Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/shelve.py", line 137, in _unshelve Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state( Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 11 04:36:07.507612 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'unshelve' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'unshelve' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 409 to user: Cannot 'unshelve' instance 90650e13-1fd0-479b-972e-d36b6521b37f while it is in vm_state active {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c5ccea45-3dee-434f-b2e9-5239d028ca7c tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action" status: 409 len: 146 microversion: 2.1 time: 0.061253 Oct 11 04:36:07.519773 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2889/5517] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:36:07 2022] POST /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f/action => generated 146 bytes in 64 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 11 04:36:07.526580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e970ef41-bd81-46cd-9946-90f905d2fa56 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:07.527532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e970ef41-bd81-46cd-9946-90f905d2fa56 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:07.539544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e970ef41-bd81-46cd-9946-90f905d2fa56 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:07.540289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e970ef41-bd81-46cd-9946-90f905d2fa56 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:07.542501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e970ef41-bd81-46cd-9946-90f905d2fa56 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:07.545078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e970ef41-bd81-46cd-9946-90f905d2fa56 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:07.545827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e970ef41-bd81-46cd-9946-90f905d2fa56 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:07.546562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e970ef41-bd81-46cd-9946-90f905d2fa56 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:07.897429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5bf05fac-14c6-4c4b-b682-c993c20222b0 req-5d7b2ecf-f879-433e-a43c-dec21f23afce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2e3ee58-f888-413a-9d48-8fd7ef276b07", "name": "network-vif-deleted", "tag": "10cc8014-997b-49d9-b4b9-e79e194a6c02"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:07.911043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5bf05fac-14c6-4c4b-b682-c993c20222b0 req-5d7b2ecf-f879-433e-a43c-dec21f23afce service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:07.911625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5bf05fac-14c6-4c4b-b682-c993c20222b0 req-5d7b2ecf-f879-433e-a43c-dec21f23afce service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:07.912126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5bf05fac-14c6-4c4b-b682-c993c20222b0 req-5d7b2ecf-f879-433e-a43c-dec21f23afce service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:07.926591 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5bf05fac-14c6-4c4b-b682-c993c20222b0 req-5d7b2ecf-f879-433e-a43c-dec21f23afce service nova] Creating event network-vif-deleted:10cc8014-997b-49d9-b4b9-e79e194a6c02 for instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 on n-h1-860892-1 Oct 11 04:36:07.933616 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5bf05fac-14c6-4c4b-b682-c993c20222b0 req-5d7b2ecf-f879-433e-a43c-dec21f23afce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040677 Oct 11 04:36:07.934821 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2890/5518] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:36:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:36:08.004243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e970ef41-bd81-46cd-9946-90f905d2fa56 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:08.036413 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e970ef41-bd81-46cd-9946-90f905d2fa56 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.512461 Oct 11 04:36:08.037271 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2629/5519] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:07 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:08.064239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2fdaf851-7fef-4c6a-a290-325d3d3acea5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:08.065337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2fdaf851-7fef-4c6a-a290-325d3d3acea5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:08.072528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fdaf851-7fef-4c6a-a290-325d3d3acea5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:08.073024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fdaf851-7fef-4c6a-a290-325d3d3acea5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:08.073709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fdaf851-7fef-4c6a-a290-325d3d3acea5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:08.074551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fdaf851-7fef-4c6a-a290-325d3d3acea5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:08.075093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fdaf851-7fef-4c6a-a290-325d3d3acea5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:08.075653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fdaf851-7fef-4c6a-a290-325d3d3acea5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:08.283239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2fdaf851-7fef-4c6a-a290-325d3d3acea5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:08.291042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:08.291725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:08.304436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:08.305263 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2fdaf851-7fef-4c6a-a290-325d3d3acea5 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.243296 Oct 11 04:36:08.306798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:08.307433 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2891/5520] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:08 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:08.308131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:08.308936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:08.309476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:08.309972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:08.329098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-388e84db-68df-4e77-8e18-aeb3e302a420 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1368935604_updated"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:08.339339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-388e84db-68df-4e77-8e18-aeb3e302a420 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 150829e5-ee99-43f0-8454-5fc1a8242c28] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:08.352534 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-388e84db-68df-4e77-8e18-aeb3e302a420 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance 150829e5-ee99-43f0-8454-5fc1a8242c28 could not be found. Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-388e84db-68df-4e77-8e18-aeb3e302a420 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/servers/150829e5-ee99-43f0-8454-5fc1a8242c28 HTTP/1.1 Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 81 Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1368935604_updated"}} Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 150829e5-ee99-43f0-8454-5fc1a8242c28 could not be found. Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '150829e5-ee99-43f0-8454-5fc1a8242c28', 'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-1368935604_updated'}}} Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 150829e5-ee99-43f0-8454-5fc1a8242c28 could not be found. Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi [Previous line repeated 1 more time] Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 915, in update Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(ctxt, req, id, is_detail=True) Oct 11 04:36:08.354633 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 150829e5-ee99-43f0-8454-5fc1a8242c28 could not be found. Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 150829e5-ee99-43f0-8454-5fc1a8242c28 could not be found. Oct 11 04:36:08.363379 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:08.364375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:08.364467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-388e84db-68df-4e77-8e18-aeb3e302a420 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance 150829e5-ee99-43f0-8454-5fc1a8242c28 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:08.364467 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-388e84db-68df-4e77-8e18-aeb3e302a420 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "PUT /compute/v2.1/servers/150829e5-ee99-43f0-8454-5fc1a8242c28" status: 404 len: 111 microversion: 2.1 time: 0.036291 Oct 11 04:36:08.369755 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2892/5521] 10.222.0.26 () {60 vars in 1256 bytes} [Tue Oct 11 04:36:08 2022] PUT /compute/v2.1/servers/150829e5-ee99-43f0-8454-5fc1a8242c28 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:36:08.383621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65f32466-4676-491b-882d-b910a64c3a00 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:08.384721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-65f32466-4676-491b-882d-b910a64c3a00 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:08.397435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f32466-4676-491b-882d-b910a64c3a00 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:08.400672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f32466-4676-491b-882d-b910a64c3a00 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:08.401374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f32466-4676-491b-882d-b910a64c3a00 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:08.402392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f32466-4676-491b-882d-b910a64c3a00 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:08.403377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:08.404176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:08.404306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f32466-4676-491b-882d-b910a64c3a00 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:08.406824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:08.407272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65f32466-4676-491b-882d-b910a64c3a00 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:08.407418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lazy-loading 'fault' on Instance uuid f2e3ee58-f888-413a-9d48-8fd7ef276b07 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:36:08.496185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:08.533527 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4c2da6f3-090b-465c-8f79-2ed84394cfb8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 200 len: 1298 microversion: 2.1 time: 0.260299 Oct 11 04:36:08.534348 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2630/5522] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:08 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 1298 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:08.682343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-65f32466-4676-491b-882d-b910a64c3a00 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:08.695882 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-65f32466-4676-491b-882d-b910a64c3a00 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.319649 Oct 11 04:36:08.699084 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2893/5523] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:08 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:08.721947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cfa5002f-9084-42b0-83dd-81dbeec5fcbd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:08.722695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cfa5002f-9084-42b0-83dd-81dbeec5fcbd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:08.735309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa5002f-9084-42b0-83dd-81dbeec5fcbd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:08.745902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa5002f-9084-42b0-83dd-81dbeec5fcbd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:08.757353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa5002f-9084-42b0-83dd-81dbeec5fcbd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:08.760591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa5002f-9084-42b0-83dd-81dbeec5fcbd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:08.761417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa5002f-9084-42b0-83dd-81dbeec5fcbd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:08.769315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa5002f-9084-42b0-83dd-81dbeec5fcbd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:09.005628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cfa5002f-9084-42b0-83dd-81dbeec5fcbd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:09.015034 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cfa5002f-9084-42b0-83dd-81dbeec5fcbd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.297234 Oct 11 04:36:09.022852 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2631/5524] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:08 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:09.047094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc5b1e7a-03fc-4fea-b6c2-f0c6e7cc364a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'update', calling method: >, body: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc5b1e7a-03fc-4fea-b6c2-f0c6e7cc364a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: request: PUT /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f HTTP/1.1 Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 280 Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: {"server": {"name": "aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa"}} Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '90650e13-1fd0-479b-972e-d36b6521b37f', 'body': {'server': {'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa'}}} Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'maxLength' in schema['properties']['server']['properties']['name']: Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.051238 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 11 04:36:09.054849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.057032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc5b1e7a-03fc-4fea-b6c2-f0c6e7cc364a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Invalid input for field/attribute name. Value: aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa. 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:09.057032 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc5b1e7a-03fc-4fea-b6c2-f0c6e7cc364a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "PUT /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 400 len: 619 microversion: 2.1 time: 0.013973 Oct 11 04:36:09.057032 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2894/5525] 10.222.0.26 () {60 vars in 1257 bytes} [Tue Oct 11 04:36:09 2022] PUT /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 619 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:36:09.066362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-576d90d3-cd27-45df-a495-98bfcbb03fcd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:09.066975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-576d90d3-cd27-45df-a495-98bfcbb03fcd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:09.073898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-576d90d3-cd27-45df-a495-98bfcbb03fcd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:09.074427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-576d90d3-cd27-45df-a495-98bfcbb03fcd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:09.074867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-576d90d3-cd27-45df-a495-98bfcbb03fcd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:09.075765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-576d90d3-cd27-45df-a495-98bfcbb03fcd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:09.076218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-576d90d3-cd27-45df-a495-98bfcbb03fcd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:09.076671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-576d90d3-cd27-45df-a495-98bfcbb03fcd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:09.432229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-576d90d3-cd27-45df-a495-98bfcbb03fcd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:09.460521 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-576d90d3-cd27-45df-a495-98bfcbb03fcd tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.399508 Oct 11 04:36:09.463649 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2632/5526] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:09 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:09.492250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-346e40aa-4cbe-4603-bd04-2f31ab0e38ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:09.492740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-346e40aa-4cbe-4603-bd04-2f31ab0e38ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:09.505071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-346e40aa-4cbe-4603-bd04-2f31ab0e38ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:09.506313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-346e40aa-4cbe-4603-bd04-2f31ab0e38ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:09.507146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-346e40aa-4cbe-4603-bd04-2f31ab0e38ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:09.508136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-346e40aa-4cbe-4603-bd04-2f31ab0e38ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:09.508821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-346e40aa-4cbe-4603-bd04-2f31ab0e38ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:09.509972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-346e40aa-4cbe-4603-bd04-2f31ab0e38ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:09.571381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:09.573117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:09.586932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:09.587717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:09.588331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:09.589216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:09.589845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:09.590550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:09.635846 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 HTTP/1.1 Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'f2e3ee58-f888-413a-9d48-8fd7ef276b07'} Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:09.638367 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.643663 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:09.643663 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:09.643663 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:09.643663 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:09.643663 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:09.643663 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:36:09.643663 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.651785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:09.652684 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8161a730-081b-42d0-adcc-129a863dd2ff tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 404 len: 111 microversion: 2.1 time: 0.095619 Oct 11 04:36:09.653602 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2633/5527] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:09 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:36:09.721923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-346e40aa-4cbe-4603-bd04-2f31ab0e38ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:09.731253 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-346e40aa-4cbe-4603-bd04-2f31ab0e38ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.244031 Oct 11 04:36:09.731943 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2895/5528] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:09 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:09.755664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-88dfa08b-fbd3-4a32-a031-61620ccb0c5d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Action: 'update', calling method: >, body: {"server": {"name": ""}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-88dfa08b-fbd3-4a32-a031-61620ccb0c5d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: request: PUT /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f HTTP/1.1 Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 24 Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: {"server": {"name": ""}} Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '90650e13-1fd0-479b-972e-d36b6521b37f', 'body': {'server': {'name': ''}}} Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise error Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['server']['properties']['name']: Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi {'format': 'name', 'maxLength': 255, 'minLength': 1, 'type': 'string'} Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi On instance['server']: Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi '' Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 04:36:09.759490 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 04:36:09.765820 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:36:09.765820 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.765820 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:09.765820 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.765820 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:09.765820 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:09.765820 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:09.765820 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 04:36:09.765820 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 04:36:09.765820 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute name. Value: . '' is too short Oct 11 04:36:09.765820 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:09.772698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-88dfa08b-fbd3-4a32-a031-61620ccb0c5d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 400 to user: Invalid input for field/attribute name. Value: . '' is too short {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:09.772698 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-88dfa08b-fbd3-4a32-a031-61620ccb0c5d tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "PUT /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 400 len: 108 microversion: 2.1 time: 0.016781 Oct 11 04:36:09.772698 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2634/5529] 10.222.0.26 () {60 vars in 1256 bytes} [Tue Oct 11 04:36:09 2022] PUT /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 108 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:36:09.779526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fb03861e-4b61-4fdf-979d-31d8d9b0fb4f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:09.780186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fb03861e-4b61-4fdf-979d-31d8d9b0fb4f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:09.787355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb03861e-4b61-4fdf-979d-31d8d9b0fb4f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:09.788064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb03861e-4b61-4fdf-979d-31d8d9b0fb4f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:09.788673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb03861e-4b61-4fdf-979d-31d8d9b0fb4f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:09.789647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb03861e-4b61-4fdf-979d-31d8d9b0fb4f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:09.790316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb03861e-4b61-4fdf-979d-31d8d9b0fb4f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:09.790917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb03861e-4b61-4fdf-979d-31d8d9b0fb4f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:09.802344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1781589420", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "09b3f7b6-0734-4684-a67d-dc5b0c7e4aff"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:10.005347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fb03861e-4b61-4fdf-979d-31d8d9b0fb4f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:10.017372 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fb03861e-4b61-4fdf-979d-31d8d9b0fb4f tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1507 microversion: 2.1 time: 0.241953 Oct 11 04:36:10.023148 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2896/5530] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:09 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1507 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:10.115572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] validate_networks() for [('09b3f7b6-0734-4684-a67d-dc5b0c7e4aff', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:36:10.712867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:36:10.715559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:36:10.715559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:36:10.715559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:36:10.715559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:36:10.729356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:10.730270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:10.733572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:10.735406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:10.738509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:10.738509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:10.769412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:36:10.777112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for user 96880360d7994e09a1fd27193d2cd152 and project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:36:10.793076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:36:10.796061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:36:11.041338 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e28f70c6-a2e2-434c-acb6-aa134fe28efb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.243211 Oct 11 04:36:11.041984 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2635/5531] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:36:09 2022] POST /compute/v2.1/servers => generated 380 bytes in 1244 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:36:11.053385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-58a49f80-36d8-4fd6-9785-c8e8aa0cb30c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:11.054003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-58a49f80-36d8-4fd6-9785-c8e8aa0cb30c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:11.121758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-58a49f80-36d8-4fd6-9785-c8e8aa0cb30c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:11.129972 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-58a49f80-36d8-4fd6-9785-c8e8aa0cb30c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1209 microversion: 2.1 time: 0.080349 Oct 11 04:36:11.132408 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2897/5532] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:11 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1209 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:12.159211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-34d78570-d517-48d0-b914-7b409d0df77a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:12.160391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-34d78570-d517-48d0-b914-7b409d0df77a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:12.218816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-34d78570-d517-48d0-b914-7b409d0df77a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:12.226891 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-34d78570-d517-48d0-b914-7b409d0df77a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1209 microversion: 2.1 time: 0.072564 Oct 11 04:36:12.244533 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2636/5533] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:12 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1209 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:13.251146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-78dc4abf-ac22-4422-908f-f6df2ed35c0a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:13.252442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-78dc4abf-ac22-4422-908f-f6df2ed35c0a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:13.262673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78dc4abf-ac22-4422-908f-f6df2ed35c0a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:13.263435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78dc4abf-ac22-4422-908f-f6df2ed35c0a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:13.263884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78dc4abf-ac22-4422-908f-f6df2ed35c0a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:13.264595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78dc4abf-ac22-4422-908f-f6df2ed35c0a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:13.265058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78dc4abf-ac22-4422-908f-f6df2ed35c0a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:13.265487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78dc4abf-ac22-4422-908f-f6df2ed35c0a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:13.338931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-78dc4abf-ac22-4422-908f-f6df2ed35c0a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:13.347758 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-78dc4abf-ac22-4422-908f-f6df2ed35c0a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1261 microversion: 2.1 time: 0.101239 Oct 11 04:36:13.348327 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2898/5534] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:13 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1261 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:14.374493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-55409de0-28ae-4639-845f-acdb57fbea37 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:14.376914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-55409de0-28ae-4639-845f-acdb57fbea37 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:14.391097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55409de0-28ae-4639-845f-acdb57fbea37 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:14.391846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55409de0-28ae-4639-845f-acdb57fbea37 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:14.392618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55409de0-28ae-4639-845f-acdb57fbea37 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:14.393494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55409de0-28ae-4639-845f-acdb57fbea37 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:14.394110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55409de0-28ae-4639-845f-acdb57fbea37 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:14.396160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55409de0-28ae-4639-845f-acdb57fbea37 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:14.496491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-55409de0-28ae-4639-845f-acdb57fbea37 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:14.506643 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-55409de0-28ae-4639-845f-acdb57fbea37 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1279 microversion: 2.1 time: 0.137536 Oct 11 04:36:14.508813 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2637/5535] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:14 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1279 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:15.538009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2fe98906-1ffe-432c-a4bd-e377971c988a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:15.538755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2fe98906-1ffe-432c-a4bd-e377971c988a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:15.547441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fe98906-1ffe-432c-a4bd-e377971c988a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:15.548366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fe98906-1ffe-432c-a4bd-e377971c988a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:15.548980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fe98906-1ffe-432c-a4bd-e377971c988a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:15.549898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fe98906-1ffe-432c-a4bd-e377971c988a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:15.551408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fe98906-1ffe-432c-a4bd-e377971c988a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:15.552036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fe98906-1ffe-432c-a4bd-e377971c988a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:15.634501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2fe98906-1ffe-432c-a4bd-e377971c988a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:15.644020 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2fe98906-1ffe-432c-a4bd-e377971c988a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1267 microversion: 2.1 time: 0.115860 Oct 11 04:36:15.648083 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2899/5536] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:15 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1267 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:16.669946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-95ebaeff-7ab0-417f-a7f2-1332148b2dcd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:16.673769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-95ebaeff-7ab0-417f-a7f2-1332148b2dcd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:16.678759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ebaeff-7ab0-417f-a7f2-1332148b2dcd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:16.679233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ebaeff-7ab0-417f-a7f2-1332148b2dcd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:16.679663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ebaeff-7ab0-417f-a7f2-1332148b2dcd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:16.680349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ebaeff-7ab0-417f-a7f2-1332148b2dcd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:16.680793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ebaeff-7ab0-417f-a7f2-1332148b2dcd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:16.681211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95ebaeff-7ab0-417f-a7f2-1332148b2dcd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:16.958239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-95ebaeff-7ab0-417f-a7f2-1332148b2dcd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:16.966745 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-95ebaeff-7ab0-417f-a7f2-1332148b2dcd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1309 microversion: 2.1 time: 0.302355 Oct 11 04:36:16.967879 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2638/5537] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:16 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1309 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:17.231114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:17.231666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:17.239430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:17.240121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:17.240572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:17.241362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:17.241819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:17.242268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:17.257416 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 HTTP/1.1 Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'f4c2cb1d-6389-41d3-8352-730a774ff2f7'} Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:36:17.259188 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5eae9d72-34ac-4b51-995a-ff54d74c7f14 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 404 len: 111 microversion: 2.1 time: 0.033594 Oct 11 04:36:17.265656 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2900/5538] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:36:17 2022] DELETE /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:36:17.269802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:17.270798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: f4c2cb1d-6389-41d3-8352-730a774ff2f7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:17.276738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:17.280128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:17.280128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:17.280128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:17.280128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:17.280128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:17.296849 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 HTTP/1.1 Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'f4c2cb1d-6389-41d3-8352-730a774ff2f7'} Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:17.298523 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:17.304042 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:17.304042 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:17.304042 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:17.304042 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:17.304042 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:17.304042 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. Oct 11 04:36:17.304042 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:17.304042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance f4c2cb1d-6389-41d3-8352-730a774ff2f7 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:17.304042 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d3d8e829-ab78-48d2-b8c9-c4c6925c2215 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7" status: 404 len: 111 microversion: 2.1 time: 0.034476 Oct 11 04:36:17.304042 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2639/5539] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:17 2022] GET /compute/v2.1/servers/f4c2cb1d-6389-41d3-8352-730a774ff2f7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:36:17.309601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b07e52ce-d4f0-476e-bc1b-2e7bcf1e1295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:17.310239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b07e52ce-d4f0-476e-bc1b-2e7bcf1e1295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:17.316962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b07e52ce-d4f0-476e-bc1b-2e7bcf1e1295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:17.317586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b07e52ce-d4f0-476e-bc1b-2e7bcf1e1295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:17.318126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b07e52ce-d4f0-476e-bc1b-2e7bcf1e1295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:17.318954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b07e52ce-d4f0-476e-bc1b-2e7bcf1e1295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:17.319664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b07e52ce-d4f0-476e-bc1b-2e7bcf1e1295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:17.320241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b07e52ce-d4f0-476e-bc1b-2e7bcf1e1295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:17.347827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b07e52ce-d4f0-476e-bc1b-2e7bcf1e1295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:36:17.719203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e0fc1d20-a97f-4072-9096-3404c59856f3 req-37da69fe-2896-400c-90a3-1de6049c0634 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068559f3-6ff0-4f99-b4e3-5ac47e603ecf", "tag": "f49d06cf-0efa-42f8-9658-cee150177f32"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:17.730812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e0fc1d20-a97f-4072-9096-3404c59856f3 req-37da69fe-2896-400c-90a3-1de6049c0634 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:17.731455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e0fc1d20-a97f-4072-9096-3404c59856f3 req-37da69fe-2896-400c-90a3-1de6049c0634 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:17.732080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e0fc1d20-a97f-4072-9096-3404c59856f3 req-37da69fe-2896-400c-90a3-1de6049c0634 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:17.746480 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e0fc1d20-a97f-4072-9096-3404c59856f3 req-37da69fe-2896-400c-90a3-1de6049c0634 service nova] Creating event network-changed:f49d06cf-0efa-42f8-9658-cee150177f32 for instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf on n-h1-860892-1 Oct 11 04:36:17.755129 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e0fc1d20-a97f-4072-9096-3404c59856f3 req-37da69fe-2896-400c-90a3-1de6049c0634 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039815 Oct 11 04:36:17.757333 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2640/5540] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:36:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:36:17.938516 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b07e52ce-d4f0-476e-bc1b-2e7bcf1e1295 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "DELETE /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 204 len: 0 microversion: 2.1 time: 0.632410 Oct 11 04:36:17.940251 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2901/5541] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:36:17 2022] DELETE /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 0 bytes in 636 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:36:17.949703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1f65013b-997a-4417-996c-969c4aaf0b3a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:17.950902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1f65013b-997a-4417-996c-969c4aaf0b3a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:17.959679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65013b-997a-4417-996c-969c4aaf0b3a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:17.962700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65013b-997a-4417-996c-969c4aaf0b3a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:17.962700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65013b-997a-4417-996c-969c4aaf0b3a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:17.962700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65013b-997a-4417-996c-969c4aaf0b3a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:17.962700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65013b-997a-4417-996c-969c4aaf0b3a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:17.963660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65013b-997a-4417-996c-969c4aaf0b3a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:17.996690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-569b8ab1-8d42-441a-9561-8f294eab95ad tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:17.997568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-569b8ab1-8d42-441a-9561-8f294eab95ad tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:18.006322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-569b8ab1-8d42-441a-9561-8f294eab95ad tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:18.006822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-569b8ab1-8d42-441a-9561-8f294eab95ad tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:18.007260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-569b8ab1-8d42-441a-9561-8f294eab95ad tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:18.008066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-569b8ab1-8d42-441a-9561-8f294eab95ad tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:18.008533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-569b8ab1-8d42-441a-9561-8f294eab95ad tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:18.008965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-569b8ab1-8d42-441a-9561-8f294eab95ad tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:18.264342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-569b8ab1-8d42-441a-9561-8f294eab95ad tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:18.274488 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-569b8ab1-8d42-441a-9561-8f294eab95ad tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1309 microversion: 2.1 time: 0.282883 Oct 11 04:36:18.275761 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2902/5542] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:17 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1309 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:18.522780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1f65013b-997a-4417-996c-969c4aaf0b3a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:18.535202 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1f65013b-997a-4417-996c-969c4aaf0b3a tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1513 microversion: 2.1 time: 0.590767 Oct 11 04:36:18.550238 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2641/5543] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:17 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1513 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:19.301477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ed0ea67-4c85-435f-82c2-5c142d35079b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:19.302476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4ed0ea67-4c85-435f-82c2-5c142d35079b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:19.309672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed0ea67-4c85-435f-82c2-5c142d35079b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:19.310329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed0ea67-4c85-435f-82c2-5c142d35079b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:19.311374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed0ea67-4c85-435f-82c2-5c142d35079b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:19.312152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed0ea67-4c85-435f-82c2-5c142d35079b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:19.312753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed0ea67-4c85-435f-82c2-5c142d35079b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:19.313279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed0ea67-4c85-435f-82c2-5c142d35079b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:19.563594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ed0ea67-4c85-435f-82c2-5c142d35079b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:19.564768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-250aa52a-ff3b-463c-a3fd-7ee488bef6e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:19.565404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-250aa52a-ff3b-463c-a3fd-7ee488bef6e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:19.573674 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ed0ea67-4c85-435f-82c2-5c142d35079b tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1309 microversion: 2.1 time: 0.276522 Oct 11 04:36:19.573978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-250aa52a-ff3b-463c-a3fd-7ee488bef6e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:19.574508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-250aa52a-ff3b-463c-a3fd-7ee488bef6e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:19.574961 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2903/5544] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:19 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1309 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:19.575081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-250aa52a-ff3b-463c-a3fd-7ee488bef6e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:19.575684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-250aa52a-ff3b-463c-a3fd-7ee488bef6e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:19.576123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-250aa52a-ff3b-463c-a3fd-7ee488bef6e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:19.577103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-250aa52a-ff3b-463c-a3fd-7ee488bef6e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:19.888135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-250aa52a-ff3b-463c-a3fd-7ee488bef6e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:19.896927 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-250aa52a-ff3b-463c-a3fd-7ee488bef6e4 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1513 microversion: 2.1 time: 0.336473 Oct 11 04:36:19.897863 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2642/5545] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:19 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1513 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:20.603971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e151de13-ae8d-4df8-9b01-db3021eec7af tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:20.605134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e151de13-ae8d-4df8-9b01-db3021eec7af tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:20.618425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e151de13-ae8d-4df8-9b01-db3021eec7af tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:20.620077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e151de13-ae8d-4df8-9b01-db3021eec7af tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:20.622894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e151de13-ae8d-4df8-9b01-db3021eec7af tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:20.623966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e151de13-ae8d-4df8-9b01-db3021eec7af tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:20.627316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e151de13-ae8d-4df8-9b01-db3021eec7af tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:20.630553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e151de13-ae8d-4df8-9b01-db3021eec7af tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:20.677199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a9590362-d124-411f-b10e-48285a9d3161 req-c872395f-909c-4c81-baae-f71a6581f5bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90650e13-1fd0-479b-972e-d36b6521b37f", "name": "network-vif-deleted", "tag": "04a8a7cd-3242-44a3-b767-f91dca6b2149"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:20.695175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a9590362-d124-411f-b10e-48285a9d3161 req-c872395f-909c-4c81-baae-f71a6581f5bd service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:20.697536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a9590362-d124-411f-b10e-48285a9d3161 req-c872395f-909c-4c81-baae-f71a6581f5bd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:20.698222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a9590362-d124-411f-b10e-48285a9d3161 req-c872395f-909c-4c81-baae-f71a6581f5bd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:20.729033 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a9590362-d124-411f-b10e-48285a9d3161 req-c872395f-909c-4c81-baae-f71a6581f5bd service nova] Creating event network-vif-deleted:04a8a7cd-3242-44a3-b767-f91dca6b2149 for instance 90650e13-1fd0-479b-972e-d36b6521b37f on n-h2-860892-1 Oct 11 04:36:20.744013 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a9590362-d124-411f-b10e-48285a9d3161 req-c872395f-909c-4c81-baae-f71a6581f5bd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074528 Oct 11 04:36:20.752756 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2643/5546] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:36:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:20.920966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:20.930154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dbee746f-cffb-435d-85e3-4bc17571a6ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:20.935082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dbee746f-cffb-435d-85e3-4bc17571a6ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:20.963392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbee746f-cffb-435d-85e3-4bc17571a6ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:20.963896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbee746f-cffb-435d-85e3-4bc17571a6ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:20.964340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbee746f-cffb-435d-85e3-4bc17571a6ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:20.965061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbee746f-cffb-435d-85e3-4bc17571a6ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:20.973567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbee746f-cffb-435d-85e3-4bc17571a6ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:20.975062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dbee746f-cffb-435d-85e3-4bc17571a6ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:21.084041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dbee746f-cffb-435d-85e3-4bc17571a6ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:21.094557 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dbee746f-cffb-435d-85e3-4bc17571a6ad tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1302 microversion: 2.1 time: 0.177721 Oct 11 04:36:21.096001 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2644/5547] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:20 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1302 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:21.127028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:21.375969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e151de13-ae8d-4df8-9b01-db3021eec7af tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:21.399426 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e151de13-ae8d-4df8-9b01-db3021eec7af tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1309 microversion: 2.1 time: 0.804581 Oct 11 04:36:21.400033 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2904/5548] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:20 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1309 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:22.119135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:22.119749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:22.130379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:22.131350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:22.132035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:22.133000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:22.133680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:22.134386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:22.180949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:22.181760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:22.182214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:22.182846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lazy-loading 'fault' on Instance uuid 90650e13-1fd0-479b-972e-d36b6521b37f {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:36:22.229501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:22.291508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85832d32146545d79d249f533b0c652e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef6449e7695048039f7e9b4f2301616c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:22.306829 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5cdeff95-ccb2-47d9-a637-1d0690c84a21 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 200 len: 1307 microversion: 2.1 time: 0.192422 Oct 11 04:36:22.323623 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2645/5549] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:22 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 1307 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:22.429534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-936c3cd1-653d-4bb5-8085-0afebb7c5a4f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:22.430153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-936c3cd1-653d-4bb5-8085-0afebb7c5a4f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:22.441830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-936c3cd1-653d-4bb5-8085-0afebb7c5a4f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:22.444293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-936c3cd1-653d-4bb5-8085-0afebb7c5a4f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:22.444621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-936c3cd1-653d-4bb5-8085-0afebb7c5a4f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:22.445345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-936c3cd1-653d-4bb5-8085-0afebb7c5a4f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:22.445797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-936c3cd1-653d-4bb5-8085-0afebb7c5a4f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:22.451642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-936c3cd1-653d-4bb5-8085-0afebb7c5a4f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:22.473995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:22.719973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-936c3cd1-653d-4bb5-8085-0afebb7c5a4f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:22.728378 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-936c3cd1-653d-4bb5-8085-0afebb7c5a4f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1309 microversion: 2.1 time: 0.303247 Oct 11 04:36:22.729411 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2905/5550] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:22 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1309 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:23.339437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:23.340226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] [instance: 90650e13-1fd0-479b-972e-d36b6521b37f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:23.351509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:23.352645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:23.353148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:23.353953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:23.354435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:23.355059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:23.369894 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] HTTP exception thrown: Instance 90650e13-1fd0-479b-972e-d36b6521b37f could not be found. Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Request method failure captured: Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f HTTP/1.1 Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIIu82v2ds3KUkOsK7jVxdExgk3jqTh2jvutBCbAwsl-i8hya4LcwhrK3iYLJ9dkOhceGtt8dClMTuMYhtQ0Gn5nZNLbrlaTeJw_M3xrieEM4TcT79y6XC5FyN2xPjzDrLk-bTEGACF5RbYu7v86Z2zSawl1yvP3H84b3CcSudtrUs Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/ef6449e7695048039f7e9b4f2301616c"}]}] Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: ef6449e7695048039f7e9b4f2301616c Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1073075415 Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 85832d32146545d79d249f533b0c652e Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1073075415-project Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 90650e13-1fd0-479b-972e-d36b6521b37f could not be found. Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '90650e13-1fd0-479b-972e-d36b6521b37f'} Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90650e13-1fd0-479b-972e-d36b6521b37f could not be found. Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90650e13-1fd0-479b-972e-d36b6521b37f could not be found. Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:23.377997 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:23.383918 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:23.383918 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:23.383918 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:23.383918 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:23.383918 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:23.383918 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90650e13-1fd0-479b-972e-d36b6521b37f could not be found. Oct 11 04:36:23.383918 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:36:23.383918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] Returning 404 to user: Instance 90650e13-1fd0-479b-972e-d36b6521b37f could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:23.383918 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0b2d3fea-f82d-40b6-b681-e9acdecf0780 tempest-ServersNegativeTestJSON-1073075415 tempest-ServersNegativeTestJSON-1073075415-project] 10.222.0.26 "GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f" status: 404 len: 111 microversion: 2.1 time: 0.044170 Oct 11 04:36:23.383918 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2646/5551] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:23 2022] GET /compute/v2.1/servers/90650e13-1fd0-479b-972e-d36b6521b37f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:36:23.625622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a529f4d1-e38a-4ee6-8fd0-7f6fb1dde1c6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:23.628823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a529f4d1-e38a-4ee6-8fd0-7f6fb1dde1c6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:23.637743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a529f4d1-e38a-4ee6-8fd0-7f6fb1dde1c6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:23.639968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a529f4d1-e38a-4ee6-8fd0-7f6fb1dde1c6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:23.640677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a529f4d1-e38a-4ee6-8fd0-7f6fb1dde1c6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:23.641710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a529f4d1-e38a-4ee6-8fd0-7f6fb1dde1c6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:23.642848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a529f4d1-e38a-4ee6-8fd0-7f6fb1dde1c6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:23.643497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a529f4d1-e38a-4ee6-8fd0-7f6fb1dde1c6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:23.712107 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a529f4d1-e38a-4ee6-8fd0-7f6fb1dde1c6 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "POST /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36/action" status: 200 len: 24561 microversion: 2.1 time: 0.092268 Oct 11 04:36:23.713033 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2906/5552] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:36:23 2022] POST /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36/action => generated 24561 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:36:23.755179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f84e7bfb-16e5-46b2-829a-17082bf2f6de tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:23.761485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f84e7bfb-16e5-46b2-829a-17082bf2f6de tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:23.763806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f84e7bfb-16e5-46b2-829a-17082bf2f6de tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:23.764308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f84e7bfb-16e5-46b2-829a-17082bf2f6de tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:23.764747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f84e7bfb-16e5-46b2-829a-17082bf2f6de tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:23.765460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f84e7bfb-16e5-46b2-829a-17082bf2f6de tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:23.765915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f84e7bfb-16e5-46b2-829a-17082bf2f6de tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:23.766375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f84e7bfb-16e5-46b2-829a-17082bf2f6de tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:23.920513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f84e7bfb-16e5-46b2-829a-17082bf2f6de tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:23.929887 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f84e7bfb-16e5-46b2-829a-17082bf2f6de tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1309 microversion: 2.1 time: 0.179730 Oct 11 04:36:23.930975 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2647/5553] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:23 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1309 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:24.883667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-9da1542e-e9d7-48d9-a679-edb9d10090b9 req-004d1c9c-9830-4810-9d07-5ef30b998546 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068559f3-6ff0-4f99-b4e3-5ac47e603ecf", "name": "network-vif-plugged", "status": "completed", "tag": "f49d06cf-0efa-42f8-9658-cee150177f32"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:24.906493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9da1542e-e9d7-48d9-a679-edb9d10090b9 req-004d1c9c-9830-4810-9d07-5ef30b998546 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:24.908557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9da1542e-e9d7-48d9-a679-edb9d10090b9 req-004d1c9c-9830-4810-9d07-5ef30b998546 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:24.909567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9da1542e-e9d7-48d9-a679-edb9d10090b9 req-004d1c9c-9830-4810-9d07-5ef30b998546 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:24.935380 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-9da1542e-e9d7-48d9-a679-edb9d10090b9 req-004d1c9c-9830-4810-9d07-5ef30b998546 service nova] Creating event network-vif-plugged:f49d06cf-0efa-42f8-9658-cee150177f32 for instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf on n-h1-860892-1 Oct 11 04:36:24.949122 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-9da1542e-e9d7-48d9-a679-edb9d10090b9 req-004d1c9c-9830-4810-9d07-5ef30b998546 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.269678 Oct 11 04:36:24.949869 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2907/5554] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:36:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:24.954475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a2dd2c84-5307-48a6-949e-962ca834d1ed tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:24.955097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a2dd2c84-5307-48a6-949e-962ca834d1ed tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:24.983669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2dd2c84-5307-48a6-949e-962ca834d1ed tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:24.988827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2dd2c84-5307-48a6-949e-962ca834d1ed tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:24.989610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2dd2c84-5307-48a6-949e-962ca834d1ed tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:24.992547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2dd2c84-5307-48a6-949e-962ca834d1ed tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:24.993261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2dd2c84-5307-48a6-949e-962ca834d1ed tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:24.994358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2dd2c84-5307-48a6-949e-962ca834d1ed tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:25.244167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a2dd2c84-5307-48a6-949e-962ca834d1ed tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:25.254367 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a2dd2c84-5307-48a6-949e-962ca834d1ed tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1309 microversion: 2.1 time: 0.303079 Oct 11 04:36:25.255947 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2648/5555] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:24 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1309 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:26.280324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-21f549ea-a5e5-4c49-9e7d-2fb52bbc296c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:26.281694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-21f549ea-a5e5-4c49-9e7d-2fb52bbc296c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:26.289867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f549ea-a5e5-4c49-9e7d-2fb52bbc296c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:26.290666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f549ea-a5e5-4c49-9e7d-2fb52bbc296c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:26.291322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f549ea-a5e5-4c49-9e7d-2fb52bbc296c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:26.292221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f549ea-a5e5-4c49-9e7d-2fb52bbc296c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:26.292867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f549ea-a5e5-4c49-9e7d-2fb52bbc296c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:26.293295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21f549ea-a5e5-4c49-9e7d-2fb52bbc296c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:26.606663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-87b0fa0f-b372-42b7-8451-b46c8da20337 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:26.607230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-87b0fa0f-b372-42b7-8451-b46c8da20337 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:26.610274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:26.617303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87b0fa0f-b372-42b7-8451-b46c8da20337 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:26.617796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87b0fa0f-b372-42b7-8451-b46c8da20337 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:26.618252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87b0fa0f-b372-42b7-8451-b46c8da20337 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:26.618967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87b0fa0f-b372-42b7-8451-b46c8da20337 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:26.619421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87b0fa0f-b372-42b7-8451-b46c8da20337 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:26.619839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-87b0fa0f-b372-42b7-8451-b46c8da20337 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:26.633531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-21f549ea-a5e5-4c49-9e7d-2fb52bbc296c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:26.642068 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-21f549ea-a5e5-4c49-9e7d-2fb52bbc296c tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1309 microversion: 2.1 time: 0.367495 Oct 11 04:36:26.659306 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2908/5556] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:26 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1309 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:26.672174 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-87b0fa0f-b372-42b7-8451-b46c8da20337 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/ips" status: 200 len: 145 microversion: 2.1 time: 0.319446 Oct 11 04:36:26.673041 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2649/5557] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:36:26 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/ips => generated 145 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:27.664990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-966f8f9a-5435-458e-b4d1-fa70ef0802e8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:27.665619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-966f8f9a-5435-458e-b4d1-fa70ef0802e8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:27.680176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-966f8f9a-5435-458e-b4d1-fa70ef0802e8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:27.681148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-966f8f9a-5435-458e-b4d1-fa70ef0802e8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:27.681759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-966f8f9a-5435-458e-b4d1-fa70ef0802e8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:27.682803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-966f8f9a-5435-458e-b4d1-fa70ef0802e8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:27.683616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-966f8f9a-5435-458e-b4d1-fa70ef0802e8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:27.685148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-966f8f9a-5435-458e-b4d1-fa70ef0802e8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:27.987071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-966f8f9a-5435-458e-b4d1-fa70ef0802e8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:27.995972 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-966f8f9a-5435-458e-b4d1-fa70ef0802e8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1491 microversion: 2.1 time: 0.334898 Oct 11 04:36:27.996590 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2909/5558] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:27 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1491 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:28.020569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f24c884-e900-41f7-a02f-3b8371dac8d5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'update', calling method: >, body: {"server": {"accessIPv4": "1.1.1.1", "accessIPv6": "::babe:202:202"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:28.023741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f24c884-e900-41f7-a02f-3b8371dac8d5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:28.030993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f24c884-e900-41f7-a02f-3b8371dac8d5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:28.031464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f24c884-e900-41f7-a02f-3b8371dac8d5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:28.031898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f24c884-e900-41f7-a02f-3b8371dac8d5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:28.032807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f24c884-e900-41f7-a02f-3b8371dac8d5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:28.033285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f24c884-e900-41f7-a02f-3b8371dac8d5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:28.033683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f24c884-e900-41f7-a02f-3b8371dac8d5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:28.244372 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f24c884-e900-41f7-a02f-3b8371dac8d5 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "PUT /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1086 microversion: 2.1 time: 0.227959 Oct 11 04:36:28.246506 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2650/5559] 10.222.0.26 () {60 vars in 1256 bytes} [Tue Oct 11 04:36:28 2022] PUT /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1086 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:28.268085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-542c4c94-e130-47b4-b81d-dbe4dc403080 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:28.268612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-542c4c94-e130-47b4-b81d-dbe4dc403080 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:28.285891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542c4c94-e130-47b4-b81d-dbe4dc403080 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:28.286338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542c4c94-e130-47b4-b81d-dbe4dc403080 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:28.286774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542c4c94-e130-47b4-b81d-dbe4dc403080 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:28.287692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542c4c94-e130-47b4-b81d-dbe4dc403080 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:28.288316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542c4c94-e130-47b4-b81d-dbe4dc403080 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:28.288914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-542c4c94-e130-47b4-b81d-dbe4dc403080 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:28.553586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-542c4c94-e130-47b4-b81d-dbe4dc403080 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:28.566813 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-542c4c94-e130-47b4-b81d-dbe4dc403080 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1512 microversion: 2.1 time: 0.302340 Oct 11 04:36:28.571720 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2910/5560] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:28 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1512 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:28.590619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0165e327-8660-426c-a049-ee2351f1924d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:28.591272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0165e327-8660-426c-a049-ee2351f1924d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:28.596872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0165e327-8660-426c-a049-ee2351f1924d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:28.597579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0165e327-8660-426c-a049-ee2351f1924d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:28.598018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0165e327-8660-426c-a049-ee2351f1924d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:28.598743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0165e327-8660-426c-a049-ee2351f1924d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:28.599197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0165e327-8660-426c-a049-ee2351f1924d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:28.599616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0165e327-8660-426c-a049-ee2351f1924d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:28.911639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0165e327-8660-426c-a049-ee2351f1924d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:28.921280 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0165e327-8660-426c-a049-ee2351f1924d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1512 microversion: 2.1 time: 0.334934 Oct 11 04:36:28.922355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2651/5561] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:28 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1512 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:28.951126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de73c643-07be-4a98-bcee-64b3b4e5bc16 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:28.953195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-de73c643-07be-4a98-bcee-64b3b4e5bc16 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:28.966890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de73c643-07be-4a98-bcee-64b3b4e5bc16 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:28.967821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de73c643-07be-4a98-bcee-64b3b4e5bc16 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:28.968505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de73c643-07be-4a98-bcee-64b3b4e5bc16 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:28.969698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de73c643-07be-4a98-bcee-64b3b4e5bc16 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:28.971083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de73c643-07be-4a98-bcee-64b3b4e5bc16 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:28.971862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de73c643-07be-4a98-bcee-64b3b4e5bc16 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:29.008622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-de73c643-07be-4a98-bcee-64b3b4e5bc16 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:36:29.538160 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-de73c643-07be-4a98-bcee-64b3b4e5bc16 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 204 len: 0 microversion: 2.1 time: 0.597136 Oct 11 04:36:29.547534 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2911/5562] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:36:28 2022] DELETE /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 0 bytes in 600 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:36:29.554330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-74833f4e-b9d4-44a6-a46d-557822578e3d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:29.554956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-74833f4e-b9d4-44a6-a46d-557822578e3d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:29.562320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74833f4e-b9d4-44a6-a46d-557822578e3d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:29.562860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74833f4e-b9d4-44a6-a46d-557822578e3d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:29.563432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74833f4e-b9d4-44a6-a46d-557822578e3d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:29.564135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74833f4e-b9d4-44a6-a46d-557822578e3d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:29.564752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74833f4e-b9d4-44a6-a46d-557822578e3d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:29.565507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74833f4e-b9d4-44a6-a46d-557822578e3d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:29.590493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:29.724932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1c152185-6790-4cfd-bb30-f2131fe0ee98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc94dd5b-561c-4b73-b0c0-69bd4deacbcd"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:29.728779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1c152185-6790-4cfd-bb30-f2131fe0ee98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:29.735024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c152185-6790-4cfd-bb30-f2131fe0ee98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:29.735867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c152185-6790-4cfd-bb30-f2131fe0ee98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:29.736404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c152185-6790-4cfd-bb30-f2131fe0ee98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:29.737361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c152185-6790-4cfd-bb30-f2131fe0ee98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:29.738044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c152185-6790-4cfd-bb30-f2131fe0ee98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:29.738778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1c152185-6790-4cfd-bb30-f2131fe0ee98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:29.906245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-74833f4e-b9d4-44a6-a46d-557822578e3d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:29.916303 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-74833f4e-b9d4-44a6-a46d-557822578e3d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1518 microversion: 2.1 time: 0.366696 Oct 11 04:36:29.923092 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2652/5563] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:29 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1518 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:30.941450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bcec6589-7ec9-4c23-897e-f21a839e64d0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:30.942328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bcec6589-7ec9-4c23-897e-f21a839e64d0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:30.970386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcec6589-7ec9-4c23-897e-f21a839e64d0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:30.970915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcec6589-7ec9-4c23-897e-f21a839e64d0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:30.971711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcec6589-7ec9-4c23-897e-f21a839e64d0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:30.972058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcec6589-7ec9-4c23-897e-f21a839e64d0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:30.972509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcec6589-7ec9-4c23-897e-f21a839e64d0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:30.972929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcec6589-7ec9-4c23-897e-f21a839e64d0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:31.528773 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1c152185-6790-4cfd-bb30-f2131fe0ee98 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "POST /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.808806 Oct 11 04:36:31.529868 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2912/5564] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:36:29 2022] POST /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments => generated 194 bytes in 1811 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:36:31.747691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bcec6589-7ec9-4c23-897e-f21a839e64d0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:31.751285 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bcec6589-7ec9-4c23-897e-f21a839e64d0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1518 microversion: 2.1 time: 0.814566 Oct 11 04:36:31.766600 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2653/5565] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:30 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1518 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:31.846180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7bc7939e-09bf-4d89-b075-8e27dfa11588 req-d3b943cd-5926-4785-b935-6cdc33534536 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068559f3-6ff0-4f99-b4e3-5ac47e603ecf", "name": "network-vif-deleted", "tag": "f49d06cf-0efa-42f8-9658-cee150177f32"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:31.879054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7bc7939e-09bf-4d89-b075-8e27dfa11588 req-d3b943cd-5926-4785-b935-6cdc33534536 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:31.883762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7bc7939e-09bf-4d89-b075-8e27dfa11588 req-d3b943cd-5926-4785-b935-6cdc33534536 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:31.884224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7bc7939e-09bf-4d89-b075-8e27dfa11588 req-d3b943cd-5926-4785-b935-6cdc33534536 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:31.910446 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7bc7939e-09bf-4d89-b075-8e27dfa11588 req-d3b943cd-5926-4785-b935-6cdc33534536 service nova] Creating event network-vif-deleted:f49d06cf-0efa-42f8-9658-cee150177f32 for instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf on n-h1-860892-1 Oct 11 04:36:31.916940 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7bc7939e-09bf-4d89-b075-8e27dfa11588 req-d3b943cd-5926-4785-b935-6cdc33534536 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076071 Oct 11 04:36:31.924627 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2913/5566] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:36:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:32.778047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:32.779910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:32.797818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:32.798822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:32.799499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:32.800473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:32.801266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:32.801977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:32.854598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:32.855720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:32.856397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:32.857098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lazy-loading 'fault' on Instance uuid 068559f3-6ff0-4f99-b4e3-5ac47e603ecf {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:36:32.923564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:32.954336 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd6c8dea-26a2-4f00-9b18-bc0df0c75f0e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 200 len: 1320 microversion: 2.1 time: 0.180035 Oct 11 04:36:32.971332 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2654/5567] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:32 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 1320 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:33.984381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:33.986602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:33.993701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:33.995710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:33.996479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:33.997315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:33.999036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:33.999732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:34.000437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:34.017974 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf HTTP/1.1 Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '068559f3-6ff0-4f99-b4e3-5ac47e603ecf'} Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:34.020123 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:34.027368 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:34.027368 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:34.027368 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:34.027368 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:34.027368 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:34.027368 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:36:34.027368 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:34.032765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:34.033842 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3ac1ed85-bcbe-40ff-84bb-563f850f720a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 404 len: 111 microversion: 2.1 time: 0.054703 Oct 11 04:36:34.038107 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2914/5568] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:33 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:36:34.175102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersTestJSON-server-1980934767", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "09b3f7b6-0734-4684-a67d-dc5b0c7e4aff"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:34.280274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] validate_networks() for [('09b3f7b6-0734-4684-a67d-dc5b0c7e4aff', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:36:34.425090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dc522316-77be-4b8a-bd98-cf3af5b361d7 tempest-ComputeTenantNetworksTest-490657574 tempest-ComputeTenantNetworksTest-490657574-project] Calling method '.version_select at 0x7fda194efdc0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:34.704068 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dc522316-77be-4b8a-bd98-cf3af5b361d7 tempest-ComputeTenantNetworksTest-490657574 tempest-ComputeTenantNetworksTest-490657574-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks" status: 200 len: 308 microversion: 2.1 time: 0.456310 Oct 11 04:36:34.705712 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2915/5569] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 04:36:34 2022] GET /compute/v2.1/os-tenant-networks => generated 308 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:34.716469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ced7d3a1-6282-4d63-910d-029a1c13812c tempest-ComputeTenantNetworksTest-490657574 tempest-ComputeTenantNetworksTest-490657574-project] Calling method '.version_select at 0x7fda18cd9c10>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:34.890989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ced7d3a1-6282-4d63-910d-029a1c13812c tempest-ComputeTenantNetworksTest-490657574 tempest-ComputeTenantNetworksTest-490657574-project] 10.222.0.26 "GET /compute/v2.1/os-tenant-networks/e56a6e62-594a-4f6d-9005-86b9a07c4901" status: 200 len: 139 microversion: 2.1 time: 0.179126 Oct 11 04:36:34.891871 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2916/5570] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:36:34 2022] GET /compute/v2.1/os-tenant-networks/e56a6e62-594a-4f6d-9005-86b9a07c4901 => generated 139 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:36:35.119400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:36:35.120053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:36:35.120675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:36:35.121671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:36:35.123384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:36:35.138218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:35.138218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:35.138218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:35.139815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:35.140277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:35.141051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:35.162904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0e4b7c8f-c3a6-4946-8f82-27a0be1f9062 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:35.169776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0e4b7c8f-c3a6-4946-8f82-27a0be1f9062 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:35.181930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4b7c8f-c3a6-4946-8f82-27a0be1f9062 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:35.182475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4b7c8f-c3a6-4946-8f82-27a0be1f9062 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:35.182922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4b7c8f-c3a6-4946-8f82-27a0be1f9062 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:35.183647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4b7c8f-c3a6-4946-8f82-27a0be1f9062 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:35.184106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4b7c8f-c3a6-4946-8f82-27a0be1f9062 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:35.184622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4b7c8f-c3a6-4946-8f82-27a0be1f9062 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:35.185100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:36:35.193403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Getting quotas for user 96880360d7994e09a1fd27193d2cd152 and project 5f89aebc94ff4fb3922014b59e5b935a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:36:35.209967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:36:35.213642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:36:35.267098 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0e4b7c8f-c3a6-4946-8f82-27a0be1f9062 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "POST /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36/action" status: 200 len: 32634 microversion: 2.1 time: 0.107475 Oct 11 04:36:35.270822 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2917/5571] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:36:35 2022] POST /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36/action => generated 32634 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:36:35.415892 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-40f3e247-3f25-4497-9de6-e42be1079a39 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.253675 Oct 11 04:36:35.417170 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2655/5572] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:36:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1256 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:36:35.430636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8b8a3859-8e5d-494b-970a-1832c4bc04dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:35.431393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8b8a3859-8e5d-494b-970a-1832c4bc04dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:35.531715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8b8a3859-8e5d-494b-970a-1832c4bc04dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:35.546587 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8b8a3859-8e5d-494b-970a-1832c4bc04dd tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1209 microversion: 2.1 time: 0.121122 Oct 11 04:36:35.550524 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2918/5573] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:35 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1209 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:36.575448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ecd7a17-3bc1-4685-8537-60f3ed10adac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:36.576997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ecd7a17-3bc1-4685-8537-60f3ed10adac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:36.586248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ecd7a17-3bc1-4685-8537-60f3ed10adac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:36.587225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ecd7a17-3bc1-4685-8537-60f3ed10adac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:36.587861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ecd7a17-3bc1-4685-8537-60f3ed10adac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:36.589003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ecd7a17-3bc1-4685-8537-60f3ed10adac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:36.589696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ecd7a17-3bc1-4685-8537-60f3ed10adac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:36.590400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ecd7a17-3bc1-4685-8537-60f3ed10adac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:36.703312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ecd7a17-3bc1-4685-8537-60f3ed10adac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:36.712967 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ecd7a17-3bc1-4685-8537-60f3ed10adac tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1213 microversion: 2.1 time: 0.143034 Oct 11 04:36:36.714313 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2656/5574] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:36 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:36.799961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44e105e1-6f8c-4707-a827-64f5d449aec2 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:36.801238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44e105e1-6f8c-4707-a827-64f5d449aec2 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:36.816941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e105e1-6f8c-4707-a827-64f5d449aec2 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:36.819470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e105e1-6f8c-4707-a827-64f5d449aec2 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:36.820516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e105e1-6f8c-4707-a827-64f5d449aec2 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:36.821915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-13e03bbe-3e37-482e-934d-ef264d78376f req-c97c0ecf-c61e-4bda-80b5-546a9bf91e99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05a7df08-6119-4cc4-9ccd-d1eae28cff36", "tag": "1ebf4f78-f2e9-4d5c-baf2-65b40b7f530a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:36.824978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e105e1-6f8c-4707-a827-64f5d449aec2 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:36.825668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e105e1-6f8c-4707-a827-64f5d449aec2 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:36.827082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e105e1-6f8c-4707-a827-64f5d449aec2 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:36.848470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-13e03bbe-3e37-482e-934d-ef264d78376f req-c97c0ecf-c61e-4bda-80b5-546a9bf91e99 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:36.848957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-13e03bbe-3e37-482e-934d-ef264d78376f req-c97c0ecf-c61e-4bda-80b5-546a9bf91e99 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:36.849394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-13e03bbe-3e37-482e-934d-ef264d78376f req-c97c0ecf-c61e-4bda-80b5-546a9bf91e99 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:36.867579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44e105e1-6f8c-4707-a827-64f5d449aec2 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:36:36.876379 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-13e03bbe-3e37-482e-934d-ef264d78376f req-c97c0ecf-c61e-4bda-80b5-546a9bf91e99 service nova] Creating event network-changed:1ebf4f78-f2e9-4d5c-baf2-65b40b7f530a for instance 05a7df08-6119-4cc4-9ccd-d1eae28cff36 on n-h2-860892-1 Oct 11 04:36:36.885604 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-13e03bbe-3e37-482e-934d-ef264d78376f req-c97c0ecf-c61e-4bda-80b5-546a9bf91e99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067957 Oct 11 04:36:36.889824 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2657/5575] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:36:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:36:37.464691 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44e105e1-6f8c-4707-a827-64f5d449aec2 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "DELETE /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 204 len: 0 microversion: 2.1 time: 0.667857 Oct 11 04:36:37.465819 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2919/5576] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:36:36 2022] DELETE /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 0 bytes in 671 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:36:37.476434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e2889535-e920-44de-89be-8d751746663f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:37.477620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e2889535-e920-44de-89be-8d751746663f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:37.486869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2889535-e920-44de-89be-8d751746663f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:37.487366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2889535-e920-44de-89be-8d751746663f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:37.494095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2889535-e920-44de-89be-8d751746663f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:37.495412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2889535-e920-44de-89be-8d751746663f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:37.496158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2889535-e920-44de-89be-8d751746663f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:37.498386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2889535-e920-44de-89be-8d751746663f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:37.739752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f67c597-d269-4475-9923-6b77704379a9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:37.740455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f67c597-d269-4475-9923-6b77704379a9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:37.750901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f67c597-d269-4475-9923-6b77704379a9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:37.752019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f67c597-d269-4475-9923-6b77704379a9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:37.752468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f67c597-d269-4475-9923-6b77704379a9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:37.753293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f67c597-d269-4475-9923-6b77704379a9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:37.753878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f67c597-d269-4475-9923-6b77704379a9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:37.754844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f67c597-d269-4475-9923-6b77704379a9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:37.838160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e2889535-e920-44de-89be-8d751746663f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:37.847321 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e2889535-e920-44de-89be-8d751746663f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1669 microversion: 2.1 time: 0.376330 Oct 11 04:36:37.850147 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2658/5577] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:37 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1669 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:38.037310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2f67c597-d269-4475-9923-6b77704379a9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:38.049690 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f67c597-d269-4475-9923-6b77704379a9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1261 microversion: 2.1 time: 0.312483 Oct 11 04:36:38.054937 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2920/5578] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:37 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1261 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:36:38.875708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5bc4417b-4623-47fb-9fb9-ab991a7ce628 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:38.876472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5bc4417b-4623-47fb-9fb9-ab991a7ce628 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:38.892666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc4417b-4623-47fb-9fb9-ab991a7ce628 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:38.895831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc4417b-4623-47fb-9fb9-ab991a7ce628 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:38.898022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc4417b-4623-47fb-9fb9-ab991a7ce628 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:38.899023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc4417b-4623-47fb-9fb9-ab991a7ce628 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:38.902851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc4417b-4623-47fb-9fb9-ab991a7ce628 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:38.903588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bc4417b-4623-47fb-9fb9-ab991a7ce628 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:39.079086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a95e295c-a013-4f32-853a-2e7c8c6557bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:39.079883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a95e295c-a013-4f32-853a-2e7c8c6557bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:39.103224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a95e295c-a013-4f32-853a-2e7c8c6557bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:39.105387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a95e295c-a013-4f32-853a-2e7c8c6557bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:39.106340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a95e295c-a013-4f32-853a-2e7c8c6557bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:39.114302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a95e295c-a013-4f32-853a-2e7c8c6557bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:39.115217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a95e295c-a013-4f32-853a-2e7c8c6557bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:39.115673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a95e295c-a013-4f32-853a-2e7c8c6557bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:39.361042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a95e295c-a013-4f32-853a-2e7c8c6557bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:39.378622 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a95e295c-a013-4f32-853a-2e7c8c6557bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1279 microversion: 2.1 time: 0.304791 Oct 11 04:36:39.395452 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2921/5579] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:39 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1279 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:39.785323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5bc4417b-4623-47fb-9fb9-ab991a7ce628 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:39.804257 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5bc4417b-4623-47fb-9fb9-ab991a7ce628 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1669 microversion: 2.1 time: 0.926015 Oct 11 04:36:39.808356 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2659/5580] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:38 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1669 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:40.405948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a814949-b776-46ac-aa84-d41e4bf20ba7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:40.407168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a814949-b776-46ac-aa84-d41e4bf20ba7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:40.414163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a814949-b776-46ac-aa84-d41e4bf20ba7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:40.414634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a814949-b776-46ac-aa84-d41e4bf20ba7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:40.415077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a814949-b776-46ac-aa84-d41e4bf20ba7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:40.415795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a814949-b776-46ac-aa84-d41e4bf20ba7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:40.416258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a814949-b776-46ac-aa84-d41e4bf20ba7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:40.416963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a814949-b776-46ac-aa84-d41e4bf20ba7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:40.830981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-186dfcba-ad5f-4f85-87ed-8dfba1fd0848 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:40.831602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-186dfcba-ad5f-4f85-87ed-8dfba1fd0848 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:40.847207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-186dfcba-ad5f-4f85-87ed-8dfba1fd0848 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:40.848312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-186dfcba-ad5f-4f85-87ed-8dfba1fd0848 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:40.850066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-186dfcba-ad5f-4f85-87ed-8dfba1fd0848 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:40.850848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-186dfcba-ad5f-4f85-87ed-8dfba1fd0848 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:40.853423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-186dfcba-ad5f-4f85-87ed-8dfba1fd0848 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:40.853896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-186dfcba-ad5f-4f85-87ed-8dfba1fd0848 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:40.878998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a814949-b776-46ac-aa84-d41e4bf20ba7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:40.894909 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a814949-b776-46ac-aa84-d41e4bf20ba7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1309 microversion: 2.1 time: 0.495326 Oct 11 04:36:40.901412 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2922/5581] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:40 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1309 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:41.033486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-186dfcba-ad5f-4f85-87ed-8dfba1fd0848 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:41.052269 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-186dfcba-ad5f-4f85-87ed-8dfba1fd0848 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1483 microversion: 2.1 time: 0.225058 Oct 11 04:36:41.056151 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2660/5582] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:40 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1483 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:41.324322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f9d1179a-9586-40a7-b5ec-75dbbfa75cf7 req-1db2387f-8373-44ae-a9ca-84fbc9f73192 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05a7df08-6119-4cc4-9ccd-d1eae28cff36", "name": "network-vif-deleted", "tag": "1ebf4f78-f2e9-4d5c-baf2-65b40b7f530a"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:41.341859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f9d1179a-9586-40a7-b5ec-75dbbfa75cf7 req-1db2387f-8373-44ae-a9ca-84fbc9f73192 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:41.343004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f9d1179a-9586-40a7-b5ec-75dbbfa75cf7 req-1db2387f-8373-44ae-a9ca-84fbc9f73192 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:41.343955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f9d1179a-9586-40a7-b5ec-75dbbfa75cf7 req-1db2387f-8373-44ae-a9ca-84fbc9f73192 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:41.355803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:41.371572 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-f9d1179a-9586-40a7-b5ec-75dbbfa75cf7 req-1db2387f-8373-44ae-a9ca-84fbc9f73192 service nova] Creating event network-vif-deleted:1ebf4f78-f2e9-4d5c-baf2-65b40b7f530a for instance 05a7df08-6119-4cc4-9ccd-d1eae28cff36 on n-h2-860892-1 Oct 11 04:36:41.383038 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f9d1179a-9586-40a7-b5ec-75dbbfa75cf7 req-1db2387f-8373-44ae-a9ca-84fbc9f73192 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309970 Oct 11 04:36:41.387293 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2923/5583] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:36:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:41.926001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b96c90cf-07c5-4147-b66c-a612f203bf70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:41.926651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b96c90cf-07c5-4147-b66c-a612f203bf70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:41.934706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96c90cf-07c5-4147-b66c-a612f203bf70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:41.936738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96c90cf-07c5-4147-b66c-a612f203bf70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:41.937412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96c90cf-07c5-4147-b66c-a612f203bf70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:41.938428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96c90cf-07c5-4147-b66c-a612f203bf70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:41.939206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96c90cf-07c5-4147-b66c-a612f203bf70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:41.939887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b96c90cf-07c5-4147-b66c-a612f203bf70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:42.091709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:42.091709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:42.094077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:42.094876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:42.098353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:42.099311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:42.099827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:42.100443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:42.151709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:42.154129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:42.154861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:42.156684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lazy-loading 'fault' on Instance uuid 05a7df08-6119-4cc4-9ccd-d1eae28cff36 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:36:42.227874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '752975bff6034a7086aafa3319a4f1d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13a4630fe9284b8b83a7bd9a7ef4ce95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:42.238985 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-23a37de5-bc3a-4fe8-a62c-fbcb99b439c1 tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 200 len: 1338 microversion: 2.1 time: 0.157789 Oct 11 04:36:42.239583 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2924/5584] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:42 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 1338 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:42.451815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-92009f1d-8fc8-4970-8259-b856f9e42051 req-f06697fe-e401-4222-a200-fcd78ff1f026 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc7fc59-8223-407c-ae32-73663f5ae0b9", "tag": "beb1f2b6-4c8f-4e53-8eb9-fe789b434cfa"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:42.464660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-92009f1d-8fc8-4970-8259-b856f9e42051 req-f06697fe-e401-4222-a200-fcd78ff1f026 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:42.465417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-92009f1d-8fc8-4970-8259-b856f9e42051 req-f06697fe-e401-4222-a200-fcd78ff1f026 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:42.466978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-92009f1d-8fc8-4970-8259-b856f9e42051 req-f06697fe-e401-4222-a200-fcd78ff1f026 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:42.489014 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-92009f1d-8fc8-4970-8259-b856f9e42051 req-f06697fe-e401-4222-a200-fcd78ff1f026 service nova] Creating event network-changed:beb1f2b6-4c8f-4e53-8eb9-fe789b434cfa for instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 on n-h1-860892-1 Oct 11 04:36:42.496916 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-92009f1d-8fc8-4970-8259-b856f9e42051 req-f06697fe-e401-4222-a200-fcd78ff1f026 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054882 Oct 11 04:36:42.498827 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2925/5585] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:36:42.578174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b96c90cf-07c5-4147-b66c-a612f203bf70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:42.590145 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b96c90cf-07c5-4147-b66c-a612f203bf70 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1309 microversion: 2.1 time: 0.668897 Oct 11 04:36:42.597390 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2661/5586] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:41 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1309 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:43.263555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:43.264879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] [instance: 05a7df08-6119-4cc4-9ccd-d1eae28cff36] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:43.273379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:43.274111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:43.274786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:43.275707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:43.276338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:43.276957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:43.294964 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] HTTP exception thrown: Instance 05a7df08-6119-4cc4-9ccd-d1eae28cff36 could not be found. Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Request method failure captured: Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 HTTP/1.1 Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPGkWxy3OtSgAGPLdTkFtYFvELislRCTj6KM7bq7fM9-tVBqZFS9x88of4rCD9CeDlGa8j810_nEPQHvxJFa8fQACoYg5xJ1ENm2zuLmeaB_ksi97w0YCZO7PO8MrSKsyAzCX3oPd1kIKI1jUDRiRIIwcwOUhk95JpYD630bDrQ19e4 Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 13a4630fe9284b8b83a7bd9a7ef4ce95 Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestNetworkBasicOps-93795933 Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/13a4630fe9284b8b83a7bd9a7ef4ce95"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_13a4630fe9284b8b83a7bd9a7ef4ce95"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13a4630fe9284b8b83a7bd9a7ef4ce95"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/13a4630fe9284b8b83a7bd9a7ef4ce95"}]}] Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestNetworkBasicOps-93795933 Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 13a4630fe9284b8b83a7bd9a7ef4ce95 Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestNetworkBasicOps-93795933 Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestNetworkBasicOps-93795933-project Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 752975bff6034a7086aafa3319a4f1d4 Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestNetworkBasicOps-93795933-project Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 05a7df08-6119-4cc4-9ccd-d1eae28cff36 could not be found. Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '05a7df08-6119-4cc4-9ccd-d1eae28cff36'} Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05a7df08-6119-4cc4-9ccd-d1eae28cff36 could not be found. Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05a7df08-6119-4cc4-9ccd-d1eae28cff36 could not be found. Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:36:43.296773 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:43.301792 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:36:43.301792 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:36:43.301792 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:36:43.301792 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:36:43.301792 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:36:43.301792 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05a7df08-6119-4cc4-9ccd-d1eae28cff36 could not be found. Oct 11 04:36:43.301792 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:36:43.301792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Returning 404 to user: Instance 05a7df08-6119-4cc4-9ccd-d1eae28cff36 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:36:43.301792 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aac84c22-2420-4b42-ae11-fd2262a8cd2f tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36" status: 404 len: 111 microversion: 2.1 time: 0.039538 Oct 11 04:36:43.301792 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2926/5587] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:43 2022] GET /compute/v2.1/servers/05a7df08-6119-4cc4-9ccd-d1eae28cff36 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:36:43.616599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7c36659-57dc-4e49-ac28-e2faeffdd5d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:43.617283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a7c36659-57dc-4e49-ac28-e2faeffdd5d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:43.627526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c36659-57dc-4e49-ac28-e2faeffdd5d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:43.632086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c36659-57dc-4e49-ac28-e2faeffdd5d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:43.633633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c36659-57dc-4e49-ac28-e2faeffdd5d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:43.635564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c36659-57dc-4e49-ac28-e2faeffdd5d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:43.636049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c36659-57dc-4e49-ac28-e2faeffdd5d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:43.638752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c36659-57dc-4e49-ac28-e2faeffdd5d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:43.885865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a932a90-26d4-436b-be8b-b7f3255746fe tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] Calling method '.version_select at 0x7fda18e2f160>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:43.922210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a7c36659-57dc-4e49-ac28-e2faeffdd5d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:43.938945 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a7c36659-57dc-4e49-ac28-e2faeffdd5d1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1309 microversion: 2.1 time: 0.320143 Oct 11 04:36:43.942585 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2662/5588] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:43 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1309 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:44.025137 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a932a90-26d4-436b-be8b-b7f3255746fe tempest-TestNetworkBasicOps-93795933 tempest-TestNetworkBasicOps-93795933-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-388901209" status: 202 len: 0 microversion: 2.1 time: 0.150994 Oct 11 04:36:44.030021 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2927/5589] 10.222.0.26 () {58 vars in 1254 bytes} [Tue Oct 11 04:36:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkBasicOps-388901209 => generated 0 bytes in 154 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:36:44.965161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-15af8dca-1b1d-49a2-a825-828e483bc5fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:44.967380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-15af8dca-1b1d-49a2-a825-828e483bc5fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:44.984185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15af8dca-1b1d-49a2-a825-828e483bc5fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:44.984934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15af8dca-1b1d-49a2-a825-828e483bc5fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:44.985560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15af8dca-1b1d-49a2-a825-828e483bc5fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:44.986477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15af8dca-1b1d-49a2-a825-828e483bc5fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:44.987115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15af8dca-1b1d-49a2-a825-828e483bc5fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:44.987540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15af8dca-1b1d-49a2-a825-828e483bc5fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:45.165486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:45.209140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:45.284861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-15af8dca-1b1d-49a2-a825-828e483bc5fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:45.292928 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-15af8dca-1b1d-49a2-a825-828e483bc5fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1309 microversion: 2.1 time: 0.331605 Oct 11 04:36:45.294077 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2663/5590] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:44 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1309 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:46.320384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c646fad4-d775-4a35-89f3-c1eacf5606c0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:46.321013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c646fad4-d775-4a35-89f3-c1eacf5606c0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:46.331037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:46.332624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c646fad4-d775-4a35-89f3-c1eacf5606c0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:46.337781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c646fad4-d775-4a35-89f3-c1eacf5606c0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:46.341622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c646fad4-d775-4a35-89f3-c1eacf5606c0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:46.342579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c646fad4-d775-4a35-89f3-c1eacf5606c0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:46.343069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c646fad4-d775-4a35-89f3-c1eacf5606c0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:46.344825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c646fad4-d775-4a35-89f3-c1eacf5606c0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:46.850121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c646fad4-d775-4a35-89f3-c1eacf5606c0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:46.861720 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c646fad4-d775-4a35-89f3-c1eacf5606c0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1309 microversion: 2.1 time: 0.544291 Oct 11 04:36:46.861720 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2928/5591] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:46 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1309 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:47.376001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b936ecd9-a56d-4486-8906-10c92743665b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:47.378347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b936ecd9-a56d-4486-8906-10c92743665b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:47.388952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b936ecd9-a56d-4486-8906-10c92743665b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:47.393219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b936ecd9-a56d-4486-8906-10c92743665b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:47.393219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b936ecd9-a56d-4486-8906-10c92743665b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:47.393219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b936ecd9-a56d-4486-8906-10c92743665b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:47.393219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b936ecd9-a56d-4486-8906-10c92743665b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:47.393219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b936ecd9-a56d-4486-8906-10c92743665b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:47.443271 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b936ecd9-a56d-4486-8906-10c92743665b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071344 Oct 11 04:36:47.444693 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2664/5592] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:36:47 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:47.467646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bd05c5ba-f796-46a5-b9d5-9e0a0b2b6b5a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:47.468802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bd05c5ba-f796-46a5-b9d5-9e0a0b2b6b5a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:47.480936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd05c5ba-f796-46a5-b9d5-9e0a0b2b6b5a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:47.485605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd05c5ba-f796-46a5-b9d5-9e0a0b2b6b5a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:47.486058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd05c5ba-f796-46a5-b9d5-9e0a0b2b6b5a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:47.486822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd05c5ba-f796-46a5-b9d5-9e0a0b2b6b5a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:47.487281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd05c5ba-f796-46a5-b9d5-9e0a0b2b6b5a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:47.490623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd05c5ba-f796-46a5-b9d5-9e0a0b2b6b5a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:47.570843 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bd05c5ba-f796-46a5-b9d5-9e0a0b2b6b5a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments/fc94dd5b-561c-4b73-b0c0-69bd4deacbcd" status: 200 len: 194 microversion: 2.1 time: 0.118800 Oct 11 04:36:47.571787 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2929/5593] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Oct 11 04:36:47 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments/fc94dd5b-561c-4b73-b0c0-69bd4deacbcd => generated 194 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:47.885216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1f521837-f46d-4a51-b428-71881a897676 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:47.885830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1f521837-f46d-4a51-b428-71881a897676 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:47.896894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f521837-f46d-4a51-b428-71881a897676 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:47.898522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f521837-f46d-4a51-b428-71881a897676 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:47.900162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f521837-f46d-4a51-b428-71881a897676 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:47.904101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f521837-f46d-4a51-b428-71881a897676 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:47.904101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f521837-f46d-4a51-b428-71881a897676 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:47.904101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f521837-f46d-4a51-b428-71881a897676 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:48.478525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1f521837-f46d-4a51-b428-71881a897676 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:48.495384 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1f521837-f46d-4a51-b428-71881a897676 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1309 microversion: 2.1 time: 0.613075 Oct 11 04:36:48.497087 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2665/5594] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:47 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1309 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:49.523720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-15f0cd9a-b49f-4ba4-bdfe-62a0fbbfc72a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:49.525173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-15f0cd9a-b49f-4ba4-bdfe-62a0fbbfc72a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:49.545389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15f0cd9a-b49f-4ba4-bdfe-62a0fbbfc72a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:49.546349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15f0cd9a-b49f-4ba4-bdfe-62a0fbbfc72a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:49.547063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15f0cd9a-b49f-4ba4-bdfe-62a0fbbfc72a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:49.549218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15f0cd9a-b49f-4ba4-bdfe-62a0fbbfc72a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:49.549894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15f0cd9a-b49f-4ba4-bdfe-62a0fbbfc72a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:49.551614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15f0cd9a-b49f-4ba4-bdfe-62a0fbbfc72a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:50.183267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-15f0cd9a-b49f-4ba4-bdfe-62a0fbbfc72a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:50.204330 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-15f0cd9a-b49f-4ba4-bdfe-62a0fbbfc72a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1309 microversion: 2.1 time: 0.686975 Oct 11 04:36:50.205622 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2930/5595] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:49 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1309 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:50.888171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e185eb7a-f75b-4089-bfd9-7292c2b8c116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8770aa27-0518-4daa-8fc8-eb419dd6fbf4"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:50.891323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e185eb7a-f75b-4089-bfd9-7292c2b8c116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:50.900824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e185eb7a-f75b-4089-bfd9-7292c2b8c116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:50.903130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e185eb7a-f75b-4089-bfd9-7292c2b8c116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:50.903130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e185eb7a-f75b-4089-bfd9-7292c2b8c116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:50.903130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e185eb7a-f75b-4089-bfd9-7292c2b8c116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:50.904774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e185eb7a-f75b-4089-bfd9-7292c2b8c116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:50.905930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e185eb7a-f75b-4089-bfd9-7292c2b8c116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:51.233449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-06b789c8-5d57-4017-81d2-176931086c47 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:51.234820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-06b789c8-5d57-4017-81d2-176931086c47 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:51.249581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b789c8-5d57-4017-81d2-176931086c47 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:51.250077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b789c8-5d57-4017-81d2-176931086c47 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:51.252251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b789c8-5d57-4017-81d2-176931086c47 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:51.254331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b789c8-5d57-4017-81d2-176931086c47 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:51.254808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b789c8-5d57-4017-81d2-176931086c47 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:51.257608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06b789c8-5d57-4017-81d2-176931086c47 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:51.775001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-06b789c8-5d57-4017-81d2-176931086c47 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:51.787462 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-06b789c8-5d57-4017-81d2-176931086c47 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1309 microversion: 2.1 time: 0.557651 Oct 11 04:36:51.791234 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2931/5596] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:51 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1309 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:36:51.805100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e78f7a64-5cd3-4310-9bc8-80242b2ffa43 req-e1f24523-979d-4e9c-8da4-49855edbc3c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc7fc59-8223-407c-ae32-73663f5ae0b9", "name": "network-vif-plugged", "status": "completed", "tag": "beb1f2b6-4c8f-4e53-8eb9-fe789b434cfa"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:51.822330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e78f7a64-5cd3-4310-9bc8-80242b2ffa43 req-e1f24523-979d-4e9c-8da4-49855edbc3c5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:51.822977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e78f7a64-5cd3-4310-9bc8-80242b2ffa43 req-e1f24523-979d-4e9c-8da4-49855edbc3c5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:51.823515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e78f7a64-5cd3-4310-9bc8-80242b2ffa43 req-e1f24523-979d-4e9c-8da4-49855edbc3c5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:51.837579 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e78f7a64-5cd3-4310-9bc8-80242b2ffa43 req-e1f24523-979d-4e9c-8da4-49855edbc3c5 service nova] Creating event network-vif-plugged:beb1f2b6-4c8f-4e53-8eb9-fe789b434cfa for instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 on n-h1-860892-1 Oct 11 04:36:51.844074 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e78f7a64-5cd3-4310-9bc8-80242b2ffa43 req-e1f24523-979d-4e9c-8da4-49855edbc3c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051232 Oct 11 04:36:51.844983 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2932/5597] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:36:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:52.214922 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e185eb7a-f75b-4089-bfd9-7292c2b8c116 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "POST /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.331367 Oct 11 04:36:52.221910 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2666/5598] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:36:50 2022] POST /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments => generated 194 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:52.812912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a72fd51b-a29e-41ac-b2ab-7830028e51e6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:52.814028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a72fd51b-a29e-41ac-b2ab-7830028e51e6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:52.830095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a72fd51b-a29e-41ac-b2ab-7830028e51e6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:52.830619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a72fd51b-a29e-41ac-b2ab-7830028e51e6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:52.831133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a72fd51b-a29e-41ac-b2ab-7830028e51e6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:52.833774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a72fd51b-a29e-41ac-b2ab-7830028e51e6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:52.834503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a72fd51b-a29e-41ac-b2ab-7830028e51e6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:52.835095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a72fd51b-a29e-41ac-b2ab-7830028e51e6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:53.234413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a72fd51b-a29e-41ac-b2ab-7830028e51e6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:53.257011 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a72fd51b-a29e-41ac-b2ab-7830028e51e6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1309 microversion: 2.1 time: 0.452617 Oct 11 04:36:53.265475 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2933/5599] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:52 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1309 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:53.696182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-59246a9f-7c3f-43f8-9467-5f1d6c1600af tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: .version_select at 0x7fda188690d0>, body: {"keypair": {"name": "tempest-keypair-605384260", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL59s+7f3QjBYRCQtLgt1MiP9PzrfLqx+QFBf6hEfKyeXJ5SyEo9FitG6yirfAdq/btdEKgcjzSk5DomT5suyXXP9qvmuy1Z3uRA6of9+Qo3fR4xMUeCZqO/QBZS1EK8Fg=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:53.728976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-59246a9f-7c3f-43f8-9467-5f1d6c1600af tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:36:53.738677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-59246a9f-7c3f-43f8-9467-5f1d6c1600af tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for user 285715b491b34b90b2a3fcf0e268be46 and project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:36:53.877448 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-59246a9f-7c3f-43f8-9467-5f1d6c1600af tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.259262 Oct 11 04:36:53.878664 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2667/5600] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:36:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:36:54.291147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c1004342-2a88-4245-aebc-ac4a7f0b06bf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:54.292480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c1004342-2a88-4245-aebc-ac4a7f0b06bf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:54.312206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1004342-2a88-4245-aebc-ac4a7f0b06bf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:54.314542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1004342-2a88-4245-aebc-ac4a7f0b06bf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:54.317905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1004342-2a88-4245-aebc-ac4a7f0b06bf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:54.320085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1004342-2a88-4245-aebc-ac4a7f0b06bf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:54.321947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1004342-2a88-4245-aebc-ac4a7f0b06bf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:54.322780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1004342-2a88-4245-aebc-ac4a7f0b06bf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:55.011106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c1004342-2a88-4245-aebc-ac4a7f0b06bf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:55.020194 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c1004342-2a88-4245-aebc-ac4a7f0b06bf tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1491 microversion: 2.1 time: 0.735701 Oct 11 04:36:55.024343 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2934/5601] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:54 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1491 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:55.050656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4273a140-284e-40b8-a58a-ac5672144600 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-2112592281"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:55.053218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4273a140-284e-40b8-a58a-ac5672144600 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:55.071803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4273a140-284e-40b8-a58a-ac5672144600 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:55.072298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4273a140-284e-40b8-a58a-ac5672144600 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:55.072745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4273a140-284e-40b8-a58a-ac5672144600 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:55.074682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4273a140-284e-40b8-a58a-ac5672144600 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:55.075346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4273a140-284e-40b8-a58a-ac5672144600 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:55.075870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4273a140-284e-40b8-a58a-ac5672144600 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:55.191830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:36:55.387097 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4273a140-284e-40b8-a58a-ac5672144600 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "PUT /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1076 microversion: 2.1 time: 0.339107 Oct 11 04:36:55.406604 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2668/5602] 10.222.0.26 () {60 vars in 1256 bytes} [Tue Oct 11 04:36:55 2022] PUT /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1076 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:55.412119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de24de59-8fec-418e-9f49-d9d3e726a3e3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:55.412895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-de24de59-8fec-418e-9f49-d9d3e726a3e3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:55.426883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de24de59-8fec-418e-9f49-d9d3e726a3e3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:55.427405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de24de59-8fec-418e-9f49-d9d3e726a3e3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:55.427853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de24de59-8fec-418e-9f49-d9d3e726a3e3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:55.428593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de24de59-8fec-418e-9f49-d9d3e726a3e3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:55.431083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de24de59-8fec-418e-9f49-d9d3e726a3e3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:55.437663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de24de59-8fec-418e-9f49-d9d3e726a3e3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:55.819381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-de24de59-8fec-418e-9f49-d9d3e726a3e3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:55.829956 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-de24de59-8fec-418e-9f49-d9d3e726a3e3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1502 microversion: 2.1 time: 0.422013 Oct 11 04:36:55.833774 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2935/5603] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:55 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1502 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:55.860662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-527c04bd-3160-4453-8644-6209e8073cd3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:55.861355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-527c04bd-3160-4453-8644-6209e8073cd3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:55.869037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-527c04bd-3160-4453-8644-6209e8073cd3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:55.869525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-527c04bd-3160-4453-8644-6209e8073cd3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:55.870385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-527c04bd-3160-4453-8644-6209e8073cd3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:55.871194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-527c04bd-3160-4453-8644-6209e8073cd3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:55.871796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-527c04bd-3160-4453-8644-6209e8073cd3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:55.872354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-527c04bd-3160-4453-8644-6209e8073cd3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:56.096198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-527c04bd-3160-4453-8644-6209e8073cd3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:56.110176 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-527c04bd-3160-4453-8644-6209e8073cd3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1502 microversion: 2.1 time: 0.253692 Oct 11 04:36:56.112122 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2669/5604] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:55 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1502 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:56.137992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d17aa252-3ad9-4916-a691-98101f215d7f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:56.154256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d17aa252-3ad9-4916-a691-98101f215d7f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:56.154782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d17aa252-3ad9-4916-a691-98101f215d7f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:56.155197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d17aa252-3ad9-4916-a691-98101f215d7f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:56.192323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d17aa252-3ad9-4916-a691-98101f215d7f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Going to try to stop instance {{(pid=120994) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 04:36:56.702552 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d17aa252-3ad9-4916-a691-98101f215d7f tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "POST /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9/action" status: 202 len: 0 microversion: 2.1 time: 0.568203 Oct 11 04:36:56.704292 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2936/5605] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:36:56 2022] POST /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:36:56.715373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-abef680f-9dbb-4959-8a75-32751583838e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:56.715990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-abef680f-9dbb-4959-8a75-32751583838e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:56.728814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abef680f-9dbb-4959-8a75-32751583838e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:56.735718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abef680f-9dbb-4959-8a75-32751583838e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:56.735718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abef680f-9dbb-4959-8a75-32751583838e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:56.735718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abef680f-9dbb-4959-8a75-32751583838e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:56.735718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abef680f-9dbb-4959-8a75-32751583838e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:56.736515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-abef680f-9dbb-4959-8a75-32751583838e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:57.274486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-abef680f-9dbb-4959-8a75-32751583838e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:57.287185 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-abef680f-9dbb-4959-8a75-32751583838e tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.576728 Oct 11 04:36:57.302638 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2670/5606] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:56 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:58.331132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e58f3f29-6e5f-47a2-9f83-74f537a55733 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:58.332608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e58f3f29-6e5f-47a2-9f83-74f537a55733 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:58.346645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58f3f29-6e5f-47a2-9f83-74f537a55733 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:58.347463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58f3f29-6e5f-47a2-9f83-74f537a55733 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:58.348149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58f3f29-6e5f-47a2-9f83-74f537a55733 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:58.349246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58f3f29-6e5f-47a2-9f83-74f537a55733 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:58.349927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58f3f29-6e5f-47a2-9f83-74f537a55733 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:58.350608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58f3f29-6e5f-47a2-9f83-74f537a55733 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:58.683638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-249243270", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "515fe902-bb8c-47e9-944d-01e95f3d351a"}], "security_groups": [{"name": "tempest-securitygroup--1227073718"}], "key_name": "tempest-keypair-605384260", "user_data": "}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:36:58.685130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e58f3f29-6e5f-47a2-9f83-74f537a55733 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:36:58.702618 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e58f3f29-6e5f-47a2-9f83-74f537a55733 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.393601 Oct 11 04:36:58.703227 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2937/5607] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:58 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:36:58.879970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] validate_networks() for [('515fe902-bb8c-47e9-944d-01e95f3d351a', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:36:59.730062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb4a82eb-5cd7-4d39-8112-ab550987d9d7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:36:59.731906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb4a82eb-5cd7-4d39-8112-ab550987d9d7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:36:59.740714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb4a82eb-5cd7-4d39-8112-ab550987d9d7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:59.741260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb4a82eb-5cd7-4d39-8112-ab550987d9d7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:59.741921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb4a82eb-5cd7-4d39-8112-ab550987d9d7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:59.742866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb4a82eb-5cd7-4d39-8112-ab550987d9d7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:59.743553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb4a82eb-5cd7-4d39-8112-ab550987d9d7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:59.744179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb4a82eb-5cd7-4d39-8112-ab550987d9d7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:59.830813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:36:59.831267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:36:59.831706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:36:59.832260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:36:59.832570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:36:59.859361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:59.860182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:59.861749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:59.865660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:36:59.866544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:36:59.867197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:36:59.893099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:36:59.900076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for user 285715b491b34b90b2a3fcf0e268be46 and project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:36:59.923906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:36:59.926808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:37:00.123753 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0e7951ea-5070-4c3d-bb39-fc162490f8f8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.444613 Oct 11 04:37:00.124322 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2671/5608] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:36:58 2022] POST /compute/v2.1/servers => generated 402 bytes in 1446 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:37:00.135966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ec9b4b6-dbd0-47e7-8164-718b81891bf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:00.136579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ec9b4b6-dbd0-47e7-8164-718b81891bf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:00.218669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ec9b4b6-dbd0-47e7-8164-718b81891bf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:00.227679 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ec9b4b6-dbd0-47e7-8164-718b81891bf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1240 microversion: 2.1 time: 0.095618 Oct 11 04:37:00.228814 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2672/5609] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:00 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1240 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:00.268041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb4a82eb-5cd7-4d39-8112-ab550987d9d7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:00.276218 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb4a82eb-5cd7-4d39-8112-ab550987d9d7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.550552 Oct 11 04:37:00.276814 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2938/5610] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:36:59 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:01.254412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7354898e-95c3-4c4e-b6f0-25cdb4336a08 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:01.255684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7354898e-95c3-4c4e-b6f0-25cdb4336a08 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:01.262977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:01.300321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3030f62f-1450-424a-96df-671f250d77bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:01.301211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3030f62f-1450-424a-96df-671f250d77bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:01.312379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3030f62f-1450-424a-96df-671f250d77bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:01.316421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3030f62f-1450-424a-96df-671f250d77bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:01.316874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3030f62f-1450-424a-96df-671f250d77bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:01.317626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3030f62f-1450-424a-96df-671f250d77bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:01.318087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3030f62f-1450-424a-96df-671f250d77bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:01.320062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3030f62f-1450-424a-96df-671f250d77bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:01.325310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7354898e-95c3-4c4e-b6f0-25cdb4336a08 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:01.336484 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7354898e-95c3-4c4e-b6f0-25cdb4336a08 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1240 microversion: 2.1 time: 0.083063 Oct 11 04:37:01.336484 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2673/5611] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:01 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:01.614884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3030f62f-1450-424a-96df-671f250d77bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:01.629614 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3030f62f-1450-424a-96df-671f250d77bb tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.333907 Oct 11 04:37:01.633213 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2939/5612] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:01 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:02.360262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-53d6dbcc-0379-4a20-8a8c-2c2bc3427cbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:02.364942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-53d6dbcc-0379-4a20-8a8c-2c2bc3427cbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:02.369042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d6dbcc-0379-4a20-8a8c-2c2bc3427cbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:02.369550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d6dbcc-0379-4a20-8a8c-2c2bc3427cbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:02.369995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d6dbcc-0379-4a20-8a8c-2c2bc3427cbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:02.371003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d6dbcc-0379-4a20-8a8c-2c2bc3427cbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:02.371464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d6dbcc-0379-4a20-8a8c-2c2bc3427cbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:02.371992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53d6dbcc-0379-4a20-8a8c-2c2bc3427cbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:02.458235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53d6dbcc-0379-4a20-8a8c-2c2bc3427cbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:02.467746 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-53d6dbcc-0379-4a20-8a8c-2c2bc3427cbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1244 microversion: 2.1 time: 0.111991 Oct 11 04:37:02.485174 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2674/5613] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:02 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1244 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:02.660987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc6f04a3-a3f9-4140-8d24-228bcf360ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:02.662499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cc6f04a3-a3f9-4140-8d24-228bcf360ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:02.671543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f04a3-a3f9-4140-8d24-228bcf360ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:02.672476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f04a3-a3f9-4140-8d24-228bcf360ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:02.673383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f04a3-a3f9-4140-8d24-228bcf360ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:02.674104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f04a3-a3f9-4140-8d24-228bcf360ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:02.674638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f04a3-a3f9-4140-8d24-228bcf360ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:02.675074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc6f04a3-a3f9-4140-8d24-228bcf360ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:02.831451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cc6f04a3-a3f9-4140-8d24-228bcf360ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:02.842491 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc6f04a3-a3f9-4140-8d24-228bcf360ca8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.185036 Oct 11 04:37:02.844637 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2940/5614] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:02 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:03.492787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41c1d84a-41f3-4cc4-8f16-3530af549fcf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:03.496373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-41c1d84a-41f3-4cc4-8f16-3530af549fcf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:03.505055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c1d84a-41f3-4cc4-8f16-3530af549fcf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:03.505638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c1d84a-41f3-4cc4-8f16-3530af549fcf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:03.506078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c1d84a-41f3-4cc4-8f16-3530af549fcf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:03.507082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c1d84a-41f3-4cc4-8f16-3530af549fcf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:03.507735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c1d84a-41f3-4cc4-8f16-3530af549fcf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:03.508570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c1d84a-41f3-4cc4-8f16-3530af549fcf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:03.628860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-41c1d84a-41f3-4cc4-8f16-3530af549fcf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:03.646664 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41c1d84a-41f3-4cc4-8f16-3530af549fcf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1292 microversion: 2.1 time: 0.158448 Oct 11 04:37:03.650691 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2675/5615] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:03 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1292 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:03.868097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f13aa423-17a7-4c5d-9b3c-c91cca00cae9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:03.868976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f13aa423-17a7-4c5d-9b3c-c91cca00cae9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:03.876561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f13aa423-17a7-4c5d-9b3c-c91cca00cae9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:03.877120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f13aa423-17a7-4c5d-9b3c-c91cca00cae9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:03.877667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f13aa423-17a7-4c5d-9b3c-c91cca00cae9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:03.878505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f13aa423-17a7-4c5d-9b3c-c91cca00cae9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:03.879031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f13aa423-17a7-4c5d-9b3c-c91cca00cae9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:03.879740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f13aa423-17a7-4c5d-9b3c-c91cca00cae9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:04.096284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f13aa423-17a7-4c5d-9b3c-c91cca00cae9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:04.107338 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f13aa423-17a7-4c5d-9b3c-c91cca00cae9 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.242059 Oct 11 04:37:04.115218 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2941/5616] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:03 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:04.674390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fcfb4656-eb85-4a98-8a6f-c330553b9dfe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:04.675586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fcfb4656-eb85-4a98-8a6f-c330553b9dfe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:04.683105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcfb4656-eb85-4a98-8a6f-c330553b9dfe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:04.683602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcfb4656-eb85-4a98-8a6f-c330553b9dfe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:04.684039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcfb4656-eb85-4a98-8a6f-c330553b9dfe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:04.684807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcfb4656-eb85-4a98-8a6f-c330553b9dfe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:04.685263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcfb4656-eb85-4a98-8a6f-c330553b9dfe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:04.685692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fcfb4656-eb85-4a98-8a6f-c330553b9dfe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:04.797165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fcfb4656-eb85-4a98-8a6f-c330553b9dfe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:04.810545 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fcfb4656-eb85-4a98-8a6f-c330553b9dfe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1298 microversion: 2.1 time: 0.141963 Oct 11 04:37:04.811138 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2676/5617] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:04 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1298 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:05.066960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e5506d96-668f-4847-be90-c2e4081c7eb3 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:05.067539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e5506d96-668f-4847-be90-c2e4081c7eb3 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:05.073979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5506d96-668f-4847-be90-c2e4081c7eb3 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:05.074869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5506d96-668f-4847-be90-c2e4081c7eb3 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:05.075440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5506d96-668f-4847-be90-c2e4081c7eb3 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:05.076447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5506d96-668f-4847-be90-c2e4081c7eb3 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:05.076905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5506d96-668f-4847-be90-c2e4081c7eb3 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:05.077334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e5506d96-668f-4847-be90-c2e4081c7eb3 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:05.094173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:05.107453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e5506d96-668f-4847-be90-c2e4081c7eb3 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:37:05.131066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eb2b76d4-b48b-4878-9f37-aa7bb4d071d3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:05.131997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eb2b76d4-b48b-4878-9f37-aa7bb4d071d3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:05.139465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb2b76d4-b48b-4878-9f37-aa7bb4d071d3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:05.140294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb2b76d4-b48b-4878-9f37-aa7bb4d071d3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:05.140729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb2b76d4-b48b-4878-9f37-aa7bb4d071d3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:05.141673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb2b76d4-b48b-4878-9f37-aa7bb4d071d3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:05.142423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb2b76d4-b48b-4878-9f37-aa7bb4d071d3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:05.143073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb2b76d4-b48b-4878-9f37-aa7bb4d071d3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:05.606104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eb2b76d4-b48b-4878-9f37-aa7bb4d071d3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:05.629529 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eb2b76d4-b48b-4878-9f37-aa7bb4d071d3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.502071 Oct 11 04:37:05.630726 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2677/5618] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:05 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:05.668610 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e5506d96-668f-4847-be90-c2e4081c7eb3 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 204 len: 0 microversion: 2.1 time: 0.818843 Oct 11 04:37:05.670123 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2942/5619] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:04 2022] DELETE /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:37:05.680248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5d5dabe3-8d90-4bc7-ad83-00aac201416f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:05.681570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5d5dabe3-8d90-4bc7-ad83-00aac201416f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:05.691302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d5dabe3-8d90-4bc7-ad83-00aac201416f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:05.692039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d5dabe3-8d90-4bc7-ad83-00aac201416f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:05.692686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d5dabe3-8d90-4bc7-ad83-00aac201416f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:05.693562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d5dabe3-8d90-4bc7-ad83-00aac201416f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:05.694230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d5dabe3-8d90-4bc7-ad83-00aac201416f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:05.698826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d5dabe3-8d90-4bc7-ad83-00aac201416f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:05.835520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-608016e5-497f-44d5-a865-1a5df80b3272 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:05.836233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-608016e5-497f-44d5-a865-1a5df80b3272 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:05.846647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-608016e5-497f-44d5-a865-1a5df80b3272 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:05.847151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-608016e5-497f-44d5-a865-1a5df80b3272 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:05.847596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-608016e5-497f-44d5-a865-1a5df80b3272 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:05.848314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-608016e5-497f-44d5-a865-1a5df80b3272 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:05.848768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-608016e5-497f-44d5-a865-1a5df80b3272 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:05.849197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-608016e5-497f-44d5-a865-1a5df80b3272 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:05.987875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5d5dabe3-8d90-4bc7-ad83-00aac201416f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:05.996318 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5d5dabe3-8d90-4bc7-ad83-00aac201416f tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1734 microversion: 2.1 time: 0.320533 Oct 11 04:37:05.997493 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2678/5620] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:05 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1734 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:05.998102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-608016e5-497f-44d5-a865-1a5df80b3272 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:06.010227 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-608016e5-497f-44d5-a865-1a5df80b3272 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1298 microversion: 2.1 time: 0.178235 Oct 11 04:37:06.016030 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2943/5621] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:05 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1298 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:06.531613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4fd0b18f-1784-4a5e-b686-21eade3c287b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:06.533878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4fd0b18f-1784-4a5e-b686-21eade3c287b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:06.540552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fd0b18f-1784-4a5e-b686-21eade3c287b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:06.545860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fd0b18f-1784-4a5e-b686-21eade3c287b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:06.545860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fd0b18f-1784-4a5e-b686-21eade3c287b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:06.545860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fd0b18f-1784-4a5e-b686-21eade3c287b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:06.545860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fd0b18f-1784-4a5e-b686-21eade3c287b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:06.545860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fd0b18f-1784-4a5e-b686-21eade3c287b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:06.586334 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4fd0b18f-1784-4a5e-b686-21eade3c287b tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.059022 Oct 11 04:37:06.587822 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2679/5622] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:37:06 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:37:06.654368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d5516c21-dfea-40aa-8762-749deb278df1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:06.655160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d5516c21-dfea-40aa-8762-749deb278df1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:06.663430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5516c21-dfea-40aa-8762-749deb278df1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:06.663986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5516c21-dfea-40aa-8762-749deb278df1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:06.664359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5516c21-dfea-40aa-8762-749deb278df1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:06.665069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5516c21-dfea-40aa-8762-749deb278df1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:06.665514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5516c21-dfea-40aa-8762-749deb278df1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:06.668647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5516c21-dfea-40aa-8762-749deb278df1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:06.737824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-82570093-2b50-400c-8b75-107ee1855d4e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:06.738381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-82570093-2b50-400c-8b75-107ee1855d4e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:06.757229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82570093-2b50-400c-8b75-107ee1855d4e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:06.757740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82570093-2b50-400c-8b75-107ee1855d4e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:06.758208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82570093-2b50-400c-8b75-107ee1855d4e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:06.758989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82570093-2b50-400c-8b75-107ee1855d4e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:06.759654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82570093-2b50-400c-8b75-107ee1855d4e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:06.760086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82570093-2b50-400c-8b75-107ee1855d4e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:06.808068 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-82570093-2b50-400c-8b75-107ee1855d4e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments/fc94dd5b-561c-4b73-b0c0-69bd4deacbcd" status: 200 len: 194 microversion: 2.1 time: 0.074050 Oct 11 04:37:06.809744 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2680/5623] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Oct 11 04:37:06 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments/fc94dd5b-561c-4b73-b0c0-69bd4deacbcd => generated 194 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:37:06.820367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-76362d03-bcd9-4c88-821d-43d3110c84b3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:06.821138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-76362d03-bcd9-4c88-821d-43d3110c84b3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:06.830731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76362d03-bcd9-4c88-821d-43d3110c84b3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:06.830731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76362d03-bcd9-4c88-821d-43d3110c84b3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:06.830731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76362d03-bcd9-4c88-821d-43d3110c84b3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:06.830731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76362d03-bcd9-4c88-821d-43d3110c84b3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:06.830731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76362d03-bcd9-4c88-821d-43d3110c84b3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:06.831312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76362d03-bcd9-4c88-821d-43d3110c84b3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:06.966965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-76362d03-bcd9-4c88-821d-43d3110c84b3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lazy-loading 'services' on Instance uuid b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:37:07.163756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d5516c21-dfea-40aa-8762-749deb278df1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:07.175441 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d5516c21-dfea-40aa-8762-749deb278df1 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.524637 Oct 11 04:37:07.176454 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2944/5624] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:06 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:07.181949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-08a6ee3a-a312-4dc2-916d-b47f499708ab tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:07.186528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-08a6ee3a-a312-4dc2-916d-b47f499708ab tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:07.189399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:07.191230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a6ee3a-a312-4dc2-916d-b47f499708ab tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:07.192178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a6ee3a-a312-4dc2-916d-b47f499708ab tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:07.192780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a6ee3a-a312-4dc2-916d-b47f499708ab tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:07.194311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a6ee3a-a312-4dc2-916d-b47f499708ab tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:07.194940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a6ee3a-a312-4dc2-916d-b47f499708ab tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:07.195643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08a6ee3a-a312-4dc2-916d-b47f499708ab tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:07.369399 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-76362d03-bcd9-4c88-821d-43d3110c84b3 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments/fc94dd5b-561c-4b73-b0c0-69bd4deacbcd" status: 202 len: 0 microversion: 2.1 time: 0.535197 Oct 11 04:37:07.375796 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2681/5625] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:37:06 2022] DELETE /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments/fc94dd5b-561c-4b73-b0c0-69bd4deacbcd => generated 0 bytes in 560 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:37:07.398371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-822a5dbb-f3ae-4e27-86a8-c43d983cdf1f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:07.403842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-822a5dbb-f3ae-4e27-86a8-c43d983cdf1f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:07.415162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-822a5dbb-f3ae-4e27-86a8-c43d983cdf1f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:07.416087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-822a5dbb-f3ae-4e27-86a8-c43d983cdf1f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:07.418708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-822a5dbb-f3ae-4e27-86a8-c43d983cdf1f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:07.420511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-822a5dbb-f3ae-4e27-86a8-c43d983cdf1f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:07.421931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-822a5dbb-f3ae-4e27-86a8-c43d983cdf1f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:07.422881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-822a5dbb-f3ae-4e27-86a8-c43d983cdf1f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:07.873557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-822a5dbb-f3ae-4e27-86a8-c43d983cdf1f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:07.883399 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-822a5dbb-f3ae-4e27-86a8-c43d983cdf1f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1366 microversion: 2.1 time: 0.505798 Oct 11 04:37:07.884481 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2682/5626] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:07 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1366 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:08.004337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-08a6ee3a-a312-4dc2-916d-b47f499708ab tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:08.015751 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-08a6ee3a-a312-4dc2-916d-b47f499708ab tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1734 microversion: 2.1 time: 0.838181 Oct 11 04:37:08.017166 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2945/5627] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:07 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1734 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:08.210549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92f77b2d-5373-48ee-8ed6-1ff60b53e4da tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:08.210549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-92f77b2d-5373-48ee-8ed6-1ff60b53e4da tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:08.218491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f77b2d-5373-48ee-8ed6-1ff60b53e4da tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:08.219504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f77b2d-5373-48ee-8ed6-1ff60b53e4da tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:08.220127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f77b2d-5373-48ee-8ed6-1ff60b53e4da tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:08.222356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f77b2d-5373-48ee-8ed6-1ff60b53e4da tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:08.223247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f77b2d-5373-48ee-8ed6-1ff60b53e4da tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:08.223945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92f77b2d-5373-48ee-8ed6-1ff60b53e4da tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:08.447850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92f77b2d-5373-48ee-8ed6-1ff60b53e4da tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:08.460171 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92f77b2d-5373-48ee-8ed6-1ff60b53e4da tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.262497 Oct 11 04:37:08.465173 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2683/5628] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:08 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:08.577488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d93210c4-7200-47de-9dea-1e56a54f746a req-0eb9eb93-f8bd-45dd-a326-2f4159030288 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63dbf99-f394-4f8c-b8cd-4c44979d03d3", "tag": "71156c1e-b551-4900-b358-8217224ddbb0"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:37:08.596978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d93210c4-7200-47de-9dea-1e56a54f746a req-0eb9eb93-f8bd-45dd-a326-2f4159030288 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:08.597459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d93210c4-7200-47de-9dea-1e56a54f746a req-0eb9eb93-f8bd-45dd-a326-2f4159030288 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:08.601539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d93210c4-7200-47de-9dea-1e56a54f746a req-0eb9eb93-f8bd-45dd-a326-2f4159030288 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:08.627755 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d93210c4-7200-47de-9dea-1e56a54f746a req-0eb9eb93-f8bd-45dd-a326-2f4159030288 service nova] Creating event network-changed:71156c1e-b551-4900-b358-8217224ddbb0 for instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 on n-h2-860892-1 Oct 11 04:37:08.633412 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d93210c4-7200-47de-9dea-1e56a54f746a req-0eb9eb93-f8bd-45dd-a326-2f4159030288 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060947 Oct 11 04:37:08.634543 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2946/5629] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:37:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:37:08.911745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90d7e863-bd1f-4d13-b2e6-548cdf28f2cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:08.913000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90d7e863-bd1f-4d13-b2e6-548cdf28f2cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:08.919805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d7e863-bd1f-4d13-b2e6-548cdf28f2cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:08.920990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d7e863-bd1f-4d13-b2e6-548cdf28f2cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:08.921820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d7e863-bd1f-4d13-b2e6-548cdf28f2cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:08.922785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d7e863-bd1f-4d13-b2e6-548cdf28f2cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:08.923560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d7e863-bd1f-4d13-b2e6-548cdf28f2cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:08.924193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d7e863-bd1f-4d13-b2e6-548cdf28f2cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:09.045078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f6e93fc-03c5-4596-8456-43d15528fcf4 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:09.045882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f6e93fc-03c5-4596-8456-43d15528fcf4 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:09.052820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6e93fc-03c5-4596-8456-43d15528fcf4 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:09.053355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6e93fc-03c5-4596-8456-43d15528fcf4 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:09.053798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6e93fc-03c5-4596-8456-43d15528fcf4 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:09.054548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6e93fc-03c5-4596-8456-43d15528fcf4 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:09.055008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6e93fc-03c5-4596-8456-43d15528fcf4 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:09.055439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6e93fc-03c5-4596-8456-43d15528fcf4 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:09.222447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f6e93fc-03c5-4596-8456-43d15528fcf4 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:09.230791 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f6e93fc-03c5-4596-8456-43d15528fcf4 tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1666 microversion: 2.1 time: 0.191194 Oct 11 04:37:09.242583 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2947/5630] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:09 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1666 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:09.290784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90d7e863-bd1f-4d13-b2e6-548cdf28f2cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:09.310227 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90d7e863-bd1f-4d13-b2e6-548cdf28f2cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1366 microversion: 2.1 time: 0.399720 Oct 11 04:37:09.312134 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2684/5631] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:08 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:09.492208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-26c6167d-86a8-451b-af96-b4dbdce93475 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:09.492834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-26c6167d-86a8-451b-af96-b4dbdce93475 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:09.519906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26c6167d-86a8-451b-af96-b4dbdce93475 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:09.520424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26c6167d-86a8-451b-af96-b4dbdce93475 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:09.520874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26c6167d-86a8-451b-af96-b4dbdce93475 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:09.521600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26c6167d-86a8-451b-af96-b4dbdce93475 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:09.529062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26c6167d-86a8-451b-af96-b4dbdce93475 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:09.529633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26c6167d-86a8-451b-af96-b4dbdce93475 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:10.110299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-26c6167d-86a8-451b-af96-b4dbdce93475 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:10.122837 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-26c6167d-86a8-451b-af96-b4dbdce93475 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.631898 Oct 11 04:37:10.125021 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2948/5632] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:09 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:10.262070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:10.263110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:10.265286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:10.282336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:10.283109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:10.283756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:10.284788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:10.286086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:10.286801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:10.335452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d77f9c52-5e40-42a5-994d-77b3cf5aa99d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:10.336455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d77f9c52-5e40-42a5-994d-77b3cf5aa99d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:10.350303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77f9c52-5e40-42a5-994d-77b3cf5aa99d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:10.351311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77f9c52-5e40-42a5-994d-77b3cf5aa99d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:10.352092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77f9c52-5e40-42a5-994d-77b3cf5aa99d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:10.353077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77f9c52-5e40-42a5-994d-77b3cf5aa99d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:10.353777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77f9c52-5e40-42a5-994d-77b3cf5aa99d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:10.354633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77f9c52-5e40-42a5-994d-77b3cf5aa99d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:10.386911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:10.391541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:10.392718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:10.398787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lazy-loading 'fault' on Instance uuid 6f249f1b-29b6-41f0-9917-551729acc982 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:37:10.650331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d77f9c52-5e40-42a5-994d-77b3cf5aa99d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:10.659045 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d77f9c52-5e40-42a5-994d-77b3cf5aa99d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1366 microversion: 2.1 time: 0.327860 Oct 11 04:37:10.663570 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2949/5633] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:10 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1366 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:10.907619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c93d3318-c9d3-4e81-9f91-ba0eeae6c5b3 req-1919f00b-e16d-4120-9ece-0a8fdf3c3c03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f249f1b-29b6-41f0-9917-551729acc982", "name": "network-vif-deleted", "tag": "6c0f99dc-4582-45a3-bdba-f7254fbe6fb8"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:37:10.925436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c93d3318-c9d3-4e81-9f91-ba0eeae6c5b3 req-1919f00b-e16d-4120-9ece-0a8fdf3c3c03 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:10.925911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c93d3318-c9d3-4e81-9f91-ba0eeae6c5b3 req-1919f00b-e16d-4120-9ece-0a8fdf3c3c03 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:10.932303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c93d3318-c9d3-4e81-9f91-ba0eeae6c5b3 req-1919f00b-e16d-4120-9ece-0a8fdf3c3c03 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:10.956442 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c93d3318-c9d3-4e81-9f91-ba0eeae6c5b3 req-1919f00b-e16d-4120-9ece-0a8fdf3c3c03 service nova] Creating event network-vif-deleted:6c0f99dc-4582-45a3-bdba-f7254fbe6fb8 for instance 6f249f1b-29b6-41f0-9917-551729acc982 on n-h2-860892-1 Oct 11 04:37:10.960210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '29ef277265894627961369a52d81f493', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4df950b23b29437d9b2a30ec4a33fc3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:10.962816 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c93d3318-c9d3-4e81-9f91-ba0eeae6c5b3 req-1919f00b-e16d-4120-9ece-0a8fdf3c3c03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057940 Oct 11 04:37:10.964270 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2950/5634] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:37:10.969981 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb5b5f85-250d-40fb-9c6d-ef8ebf434abc tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 200 len: 1388 microversion: 2.1 time: 0.713144 Oct 11 04:37:10.970596 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2685/5635] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:10 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 1388 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:11.159619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0dd85f0c-868f-43ab-aea4-710a6b0718fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:11.160921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0dd85f0c-868f-43ab-aea4-710a6b0718fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:11.168015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd85f0c-868f-43ab-aea4-710a6b0718fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:11.168795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd85f0c-868f-43ab-aea4-710a6b0718fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:11.169430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd85f0c-868f-43ab-aea4-710a6b0718fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:11.170352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd85f0c-868f-43ab-aea4-710a6b0718fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:11.170974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd85f0c-868f-43ab-aea4-710a6b0718fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:11.171565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dd85f0c-868f-43ab-aea4-710a6b0718fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:11.427005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0dd85f0c-868f-43ab-aea4-710a6b0718fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:11.436253 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0dd85f0c-868f-43ab-aea4-710a6b0718fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.283652 Oct 11 04:37:11.449099 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2951/5636] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:11 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:11.689107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a1c2d6aa-8f14-4e01-9212-e59d9add3f76 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:11.690960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a1c2d6aa-8f14-4e01-9212-e59d9add3f76 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:11.701919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=14 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:11.711829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1c2d6aa-8f14-4e01-9212-e59d9add3f76 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:11.713077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1c2d6aa-8f14-4e01-9212-e59d9add3f76 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:11.713723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1c2d6aa-8f14-4e01-9212-e59d9add3f76 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:11.715976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1c2d6aa-8f14-4e01-9212-e59d9add3f76 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:11.716636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1c2d6aa-8f14-4e01-9212-e59d9add3f76 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:11.717968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1c2d6aa-8f14-4e01-9212-e59d9add3f76 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:11.897431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a1c2d6aa-8f14-4e01-9212-e59d9add3f76 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:11.910516 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a1c2d6aa-8f14-4e01-9212-e59d9add3f76 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1366 microversion: 2.1 time: 0.227241 Oct 11 04:37:11.926561 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2686/5637] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:11 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:11.995010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:11.995972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:12.004270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:12.005047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:12.005684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:12.006572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:12.008221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:12.008660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:12.023170 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] HTTP exception thrown: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Request method failure captured: Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 HTTP/1.1 Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPGobXFhQJTIIKBcl0bc4N82O-d_aXYsjZysqj8ClxuIwETTXn7CgXOoSd0OYibcjX7JpPGvbYz09N1En8Uoe1s6-5VRG60wkYTj4B3HmTZ74ksWb1E2FrgNMyNlEAcvD_YAXtsEj7VNDEFyLNVr3Fh_PF1MpIgmPhcd1dqMIeP5Tro Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 4df950b23b29437d9b2a30ec4a33fc3a Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestServerBasicOps-1262531793 Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4df950b23b29437d9b2a30ec4a33fc3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4df950b23b29437d9b2a30ec4a33fc3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4df950b23b29437d9b2a30ec4a33fc3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4df950b23b29437d9b2a30ec4a33fc3a"}]}] Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestServerBasicOps-1262531793 Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 4df950b23b29437d9b2a30ec4a33fc3a Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestServerBasicOps-1262531793 Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestServerBasicOps-1262531793-project Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 29ef277265894627961369a52d81f493 Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestServerBasicOps-1262531793-project Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '6f249f1b-29b6-41f0-9917-551729acc982'} Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:12.024819 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:12.030790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:12.030790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:12.030790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:12.030790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:12.030790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:12.030790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:12.030790 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:12.032209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Returning 404 to user: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:12.033073 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-38d6524d-3ead-49f7-8062-1b2dc019cbeb tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 404 len: 111 microversion: 2.1 time: 0.042007 Oct 11 04:37:12.033645 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2952/5638] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:11 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:12.463211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4cbb1bc5-dc3f-4b6f-a354-8c4c4c8b4ee2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:12.463943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4cbb1bc5-dc3f-4b6f-a354-8c4c4c8b4ee2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:12.471192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cbb1bc5-dc3f-4b6f-a354-8c4c4c8b4ee2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:12.477088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cbb1bc5-dc3f-4b6f-a354-8c4c4c8b4ee2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:12.477088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cbb1bc5-dc3f-4b6f-a354-8c4c4c8b4ee2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:12.477088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cbb1bc5-dc3f-4b6f-a354-8c4c4c8b4ee2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:12.477088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cbb1bc5-dc3f-4b6f-a354-8c4c4c8b4ee2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:12.477088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cbb1bc5-dc3f-4b6f-a354-8c4c4c8b4ee2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:12.480088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:12.717504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4cbb1bc5-dc3f-4b6f-a354-8c4c4c8b4ee2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:12.726106 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4cbb1bc5-dc3f-4b6f-a354-8c4c4c8b4ee2 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.267808 Oct 11 04:37:12.726727 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2687/5639] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:12 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:12.936452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-07e668d8-d6f9-4136-bb75-5e58344d9f32 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:12.937251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-07e668d8-d6f9-4136-bb75-5e58344d9f32 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:12.944471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07e668d8-d6f9-4136-bb75-5e58344d9f32 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:12.945060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07e668d8-d6f9-4136-bb75-5e58344d9f32 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:12.945662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07e668d8-d6f9-4136-bb75-5e58344d9f32 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:12.946516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07e668d8-d6f9-4136-bb75-5e58344d9f32 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:12.947063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07e668d8-d6f9-4136-bb75-5e58344d9f32 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:12.947587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07e668d8-d6f9-4136-bb75-5e58344d9f32 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:13.116845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:13.118789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:13.128582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:13.129348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:13.129882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:13.130714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:13.131274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:13.131789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:13.151065 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] HTTP exception thrown: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Request method failure captured: Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 HTTP/1.1 Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPGobXFhQJTIIKBcl0bc4N82O-d_aXYsjZysqj8ClxuIwETTXn7CgXOoSd0OYibcjX7JpPGvbYz09N1En8Uoe1s6-5VRG60wkYTj4B3HmTZ74ksWb1E2FrgNMyNlEAcvD_YAXtsEj7VNDEFyLNVr3Fh_PF1MpIgmPhcd1dqMIeP5Tro Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 4df950b23b29437d9b2a30ec4a33fc3a Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestServerBasicOps-1262531793 Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4df950b23b29437d9b2a30ec4a33fc3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4df950b23b29437d9b2a30ec4a33fc3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4df950b23b29437d9b2a30ec4a33fc3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4df950b23b29437d9b2a30ec4a33fc3a"}]}] Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestServerBasicOps-1262531793 Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 4df950b23b29437d9b2a30ec4a33fc3a Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestServerBasicOps-1262531793 Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestServerBasicOps-1262531793-project Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 29ef277265894627961369a52d81f493 Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestServerBasicOps-1262531793-project Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '6f249f1b-29b6-41f0-9917-551729acc982'} Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:13.152961 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:13.157264 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:13.157264 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:13.157264 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:13.157264 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:13.157264 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:13.157264 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:13.157264 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:13.157264 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:13.157264 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:13.157264 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:13.157264 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:13.158946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Returning 404 to user: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:13.159862 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-52d50fd8-d0cb-44f2-8aac-eb38fc9513de tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 404 len: 111 microversion: 2.1 time: 0.048992 Oct 11 04:37:13.160632 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2688/5640] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:13 2022] DELETE /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:13.169758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:13.170700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] [instance: 6f249f1b-29b6-41f0-9917-551729acc982] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:13.177223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:13.177619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:13.178262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:13.178954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:13.179403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:13.180118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:13.195440 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] HTTP exception thrown: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Request method failure captured: Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 HTTP/1.1 Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPGobXFhQJTIIKBcl0bc4N82O-d_aXYsjZysqj8ClxuIwETTXn7CgXOoSd0OYibcjX7JpPGvbYz09N1En8Uoe1s6-5VRG60wkYTj4B3HmTZ74ksWb1E2FrgNMyNlEAcvD_YAXtsEj7VNDEFyLNVr3Fh_PF1MpIgmPhcd1dqMIeP5Tro Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 4df950b23b29437d9b2a30ec4a33fc3a Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestServerBasicOps-1262531793 Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/4df950b23b29437d9b2a30ec4a33fc3a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_4df950b23b29437d9b2a30ec4a33fc3a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4df950b23b29437d9b2a30ec4a33fc3a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/4df950b23b29437d9b2a30ec4a33fc3a"}]}] Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestServerBasicOps-1262531793 Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 4df950b23b29437d9b2a30ec4a33fc3a Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestServerBasicOps-1262531793 Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestServerBasicOps-1262531793-project Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 29ef277265894627961369a52d81f493 Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestServerBasicOps-1262531793-project Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '6f249f1b-29b6-41f0-9917-551729acc982'} Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:13.197107 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:13.205632 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:13.205632 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:13.205632 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:13.205632 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:13.205632 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:13.205632 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. Oct 11 04:37:13.205632 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:13.205632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Returning 404 to user: Instance 6f249f1b-29b6-41f0-9917-551729acc982 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:13.205632 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-333bfd15-6468-4495-a9fe-9ad4f5272bca tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982" status: 404 len: 111 microversion: 2.1 time: 0.033598 Oct 11 04:37:13.205632 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2689/5641] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:13 2022] GET /compute/v2.1/servers/6f249f1b-29b6-41f0-9917-551729acc982 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:13.206703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-07e668d8-d6f9-4136-bb75-5e58344d9f32 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:13.210400 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-07e668d8-d6f9-4136-bb75-5e58344d9f32 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1366 microversion: 2.1 time: 0.279031 Oct 11 04:37:13.224857 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2953/5642] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:12 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:13.671693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-172c9bfc-673e-4481-a54b-c34a50a71b1d tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] Calling method '.version_select at 0x7fda188a7ca0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:13.749338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cd756146-c9fa-4868-b1f6-4f1449ee4155 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:13.749951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cd756146-c9fa-4868-b1f6-4f1449ee4155 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:13.756112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd756146-c9fa-4868-b1f6-4f1449ee4155 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:13.758777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd756146-c9fa-4868-b1f6-4f1449ee4155 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:13.758777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd756146-c9fa-4868-b1f6-4f1449ee4155 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:13.758777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd756146-c9fa-4868-b1f6-4f1449ee4155 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:13.758777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd756146-c9fa-4868-b1f6-4f1449ee4155 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:13.760017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd756146-c9fa-4868-b1f6-4f1449ee4155 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:13.779583 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-172c9bfc-673e-4481-a54b-c34a50a71b1d tempest-TestServerBasicOps-1262531793 tempest-TestServerBasicOps-1262531793-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-792414490" status: 202 len: 0 microversion: 2.1 time: 0.111661 Oct 11 04:37:13.789871 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2690/5643] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:37:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestServerBasicOps-792414490 => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:37:14.029473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cd756146-c9fa-4868-b1f6-4f1449ee4155 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:14.038116 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cd756146-c9fa-4868-b1f6-4f1449ee4155 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.292984 Oct 11 04:37:14.056367 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2954/5644] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:13 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:14.125713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb1505ae-84ac-41bf-b4b4-17bed467e1df tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:14.126306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cb1505ae-84ac-41bf-b4b4-17bed467e1df tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:14.135559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1505ae-84ac-41bf-b4b4-17bed467e1df tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:14.136402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1505ae-84ac-41bf-b4b4-17bed467e1df tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:14.137133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1505ae-84ac-41bf-b4b4-17bed467e1df tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:14.138358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1505ae-84ac-41bf-b4b4-17bed467e1df tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:14.138988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1505ae-84ac-41bf-b4b4-17bed467e1df tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:14.139620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb1505ae-84ac-41bf-b4b4-17bed467e1df tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:14.182963 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cb1505ae-84ac-41bf-b4b4-17bed467e1df tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments/8770aa27-0518-4daa-8fc8-eb419dd6fbf4" status: 200 len: 194 microversion: 2.1 time: 0.061915 Oct 11 04:37:14.184759 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2691/5645] 10.222.0.26 () {58 vars in 1413 bytes} [Tue Oct 11 04:37:14 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments/8770aa27-0518-4daa-8fc8-eb419dd6fbf4 => generated 194 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:37:14.204958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-701d1bf7-64f5-44af-bb1e-d27ee3f9c80c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:14.206012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-701d1bf7-64f5-44af-bb1e-d27ee3f9c80c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:14.216022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-701d1bf7-64f5-44af-bb1e-d27ee3f9c80c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:14.217429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-701d1bf7-64f5-44af-bb1e-d27ee3f9c80c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:14.218229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-701d1bf7-64f5-44af-bb1e-d27ee3f9c80c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:14.219150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-701d1bf7-64f5-44af-bb1e-d27ee3f9c80c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:14.219769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-701d1bf7-64f5-44af-bb1e-d27ee3f9c80c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:14.220440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-701d1bf7-64f5-44af-bb1e-d27ee3f9c80c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:14.236768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3c971ed-943a-4064-adb4-c46773bb4af2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:14.238083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3c971ed-943a-4064-adb4-c46773bb4af2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:14.245809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3c971ed-943a-4064-adb4-c46773bb4af2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:14.246835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3c971ed-943a-4064-adb4-c46773bb4af2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:14.247631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3c971ed-943a-4064-adb4-c46773bb4af2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:14.248891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3c971ed-943a-4064-adb4-c46773bb4af2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:14.249584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3c971ed-943a-4064-adb4-c46773bb4af2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:14.250181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3c971ed-943a-4064-adb4-c46773bb4af2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:14.376644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-701d1bf7-64f5-44af-bb1e-d27ee3f9c80c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lazy-loading 'services' on Instance uuid b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:37:14.548273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e3c971ed-943a-4064-adb4-c46773bb4af2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:14.556644 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3c971ed-943a-4064-adb4-c46773bb4af2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1366 microversion: 2.1 time: 0.326790 Oct 11 04:37:14.571325 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2692/5646] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:14 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:14.754724 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-701d1bf7-64f5-44af-bb1e-d27ee3f9c80c tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments/8770aa27-0518-4daa-8fc8-eb419dd6fbf4" status: 202 len: 0 microversion: 2.1 time: 0.559289 Oct 11 04:37:14.756039 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2955/5647] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:37:14 2022] DELETE /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments/8770aa27-0518-4daa-8fc8-eb419dd6fbf4 => generated 0 bytes in 562 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:37:15.063595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cc3329ea-1175-4a56-a414-d0897eb85c83 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:15.064184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cc3329ea-1175-4a56-a414-d0897eb85c83 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:15.071605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc3329ea-1175-4a56-a414-d0897eb85c83 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:15.072053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc3329ea-1175-4a56-a414-d0897eb85c83 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:15.072489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc3329ea-1175-4a56-a414-d0897eb85c83 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:15.073208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc3329ea-1175-4a56-a414-d0897eb85c83 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:15.073663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc3329ea-1175-4a56-a414-d0897eb85c83 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:15.074087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc3329ea-1175-4a56-a414-d0897eb85c83 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:15.581614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f271dd04-9fe5-46ec-84be-db2b289a3cac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:15.584451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f271dd04-9fe5-46ec-84be-db2b289a3cac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:15.593257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f271dd04-9fe5-46ec-84be-db2b289a3cac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:15.593998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f271dd04-9fe5-46ec-84be-db2b289a3cac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:15.594655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f271dd04-9fe5-46ec-84be-db2b289a3cac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:15.595625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f271dd04-9fe5-46ec-84be-db2b289a3cac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:15.596242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f271dd04-9fe5-46ec-84be-db2b289a3cac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:15.596865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f271dd04-9fe5-46ec-84be-db2b289a3cac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:15.753564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cc3329ea-1175-4a56-a414-d0897eb85c83 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:15.762739 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cc3329ea-1175-4a56-a414-d0897eb85c83 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.703861 Oct 11 04:37:15.765042 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2693/5648] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:15 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:15.864160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f271dd04-9fe5-46ec-84be-db2b289a3cac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:15.875523 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f271dd04-9fe5-46ec-84be-db2b289a3cac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1366 microversion: 2.1 time: 0.297755 Oct 11 04:37:15.876839 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2956/5649] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:15 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:16.025022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-3b307a91-32be-4c0c-bfc7-776d3be2dac8 req-f9e346dd-bfd7-45c9-bff4-202968d065f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63dbf99-f394-4f8c-b8cd-4c44979d03d3", "name": "network-vif-plugged", "status": "completed", "tag": "71156c1e-b551-4900-b358-8217224ddbb0"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:37:16.034667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3b307a91-32be-4c0c-bfc7-776d3be2dac8 req-f9e346dd-bfd7-45c9-bff4-202968d065f7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:16.035371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3b307a91-32be-4c0c-bfc7-776d3be2dac8 req-f9e346dd-bfd7-45c9-bff4-202968d065f7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:16.035950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3b307a91-32be-4c0c-bfc7-776d3be2dac8 req-f9e346dd-bfd7-45c9-bff4-202968d065f7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:16.048290 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-3b307a91-32be-4c0c-bfc7-776d3be2dac8 req-f9e346dd-bfd7-45c9-bff4-202968d065f7 service nova] Creating event network-vif-plugged:71156c1e-b551-4900-b358-8217224ddbb0 for instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 on n-h2-860892-1 Oct 11 04:37:16.053662 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-3b307a91-32be-4c0c-bfc7-776d3be2dac8 req-f9e346dd-bfd7-45c9-bff4-202968d065f7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033248 Oct 11 04:37:16.054947 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2694/5650] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:37:16.795775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25167f5a-17b6-40bb-b839-90846df86c07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:16.796447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-25167f5a-17b6-40bb-b839-90846df86c07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:16.806390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25167f5a-17b6-40bb-b839-90846df86c07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:16.806854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25167f5a-17b6-40bb-b839-90846df86c07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:16.807295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25167f5a-17b6-40bb-b839-90846df86c07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:16.808010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25167f5a-17b6-40bb-b839-90846df86c07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:16.808468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25167f5a-17b6-40bb-b839-90846df86c07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:16.808965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25167f5a-17b6-40bb-b839-90846df86c07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:16.907586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07346d36-ba77-409e-ac63-038d027ed2bf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:16.910489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-07346d36-ba77-409e-ac63-038d027ed2bf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:16.935043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07346d36-ba77-409e-ac63-038d027ed2bf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:16.945836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07346d36-ba77-409e-ac63-038d027ed2bf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:16.955297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07346d36-ba77-409e-ac63-038d027ed2bf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:16.958104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07346d36-ba77-409e-ac63-038d027ed2bf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:16.958629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07346d36-ba77-409e-ac63-038d027ed2bf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:16.959065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07346d36-ba77-409e-ac63-038d027ed2bf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:17.208418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25167f5a-17b6-40bb-b839-90846df86c07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:17.221187 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-25167f5a-17b6-40bb-b839-90846df86c07 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.429840 Oct 11 04:37:17.222177 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2957/5651] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:16 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:17.317653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-07346d36-ba77-409e-ac63-038d027ed2bf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:17.328264 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-07346d36-ba77-409e-ac63-038d027ed2bf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1366 microversion: 2.1 time: 0.428824 Oct 11 04:37:17.329070 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2695/5652] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:16 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1366 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:18.244878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1df45319-6321-4205-90d9-9d12683f56f4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:18.246394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1df45319-6321-4205-90d9-9d12683f56f4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:18.254396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1df45319-6321-4205-90d9-9d12683f56f4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:18.255365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1df45319-6321-4205-90d9-9d12683f56f4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:18.256035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1df45319-6321-4205-90d9-9d12683f56f4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:18.257024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1df45319-6321-4205-90d9-9d12683f56f4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:18.257762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1df45319-6321-4205-90d9-9d12683f56f4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:18.258519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1df45319-6321-4205-90d9-9d12683f56f4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:18.279115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:18.359793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a6bfd249-90f5-4cef-b4e3-7b0b04a49f8e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:18.359793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a6bfd249-90f5-4cef-b4e3-7b0b04a49f8e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:18.364590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6bfd249-90f5-4cef-b4e3-7b0b04a49f8e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:18.365082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6bfd249-90f5-4cef-b4e3-7b0b04a49f8e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:18.367834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6bfd249-90f5-4cef-b4e3-7b0b04a49f8e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:18.368579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6bfd249-90f5-4cef-b4e3-7b0b04a49f8e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:18.369042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6bfd249-90f5-4cef-b4e3-7b0b04a49f8e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:18.369469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a6bfd249-90f5-4cef-b4e3-7b0b04a49f8e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:18.494703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1df45319-6321-4205-90d9-9d12683f56f4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:18.507603 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1df45319-6321-4205-90d9-9d12683f56f4 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.266592 Oct 11 04:37:18.508201 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2958/5653] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:18 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:18.739016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a6bfd249-90f5-4cef-b4e3-7b0b04a49f8e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:18.752055 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a6bfd249-90f5-4cef-b4e3-7b0b04a49f8e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1557 microversion: 2.1 time: 0.402005 Oct 11 04:37:18.754089 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2696/5654] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:18 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1557 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:18.776173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d248977a-da90-4d2e-8d47-c10154c0d8d1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:18.776673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d248977a-da90-4d2e-8d47-c10154c0d8d1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:18.786164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d248977a-da90-4d2e-8d47-c10154c0d8d1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:18.793740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d248977a-da90-4d2e-8d47-c10154c0d8d1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:18.793740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d248977a-da90-4d2e-8d47-c10154c0d8d1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:18.793740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d248977a-da90-4d2e-8d47-c10154c0d8d1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:18.793740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d248977a-da90-4d2e-8d47-c10154c0d8d1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:18.793740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d248977a-da90-4d2e-8d47-c10154c0d8d1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:18.967924 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d248977a-da90-4d2e-8d47-c10154c0d8d1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.195901 Oct 11 04:37:18.968530 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2959/5655] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:37:18 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-interface => generated 285 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:37:19.536032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8164a57a-0d2f-4724-b40f-d1717a83752a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:19.537337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8164a57a-0d2f-4724-b40f-d1717a83752a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:19.559499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8164a57a-0d2f-4724-b40f-d1717a83752a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:19.561276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8164a57a-0d2f-4724-b40f-d1717a83752a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:19.563195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8164a57a-0d2f-4724-b40f-d1717a83752a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:19.564051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8164a57a-0d2f-4724-b40f-d1717a83752a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:19.571127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8164a57a-0d2f-4724-b40f-d1717a83752a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:19.572480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8164a57a-0d2f-4724-b40f-d1717a83752a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:20.113990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8164a57a-0d2f-4724-b40f-d1717a83752a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:20.124470 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8164a57a-0d2f-4724-b40f-d1717a83752a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.592661 Oct 11 04:37:20.125845 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2697/5656] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:19 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:21.150102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d0fcd8c-efac-4c8a-9bc8-adf691585dd0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:21.152168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d0fcd8c-efac-4c8a-9bc8-adf691585dd0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:21.165218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d0fcd8c-efac-4c8a-9bc8-adf691585dd0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:21.166652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d0fcd8c-efac-4c8a-9bc8-adf691585dd0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:21.167440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d0fcd8c-efac-4c8a-9bc8-adf691585dd0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:21.170174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d0fcd8c-efac-4c8a-9bc8-adf691585dd0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:21.171613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d0fcd8c-efac-4c8a-9bc8-adf691585dd0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:21.172488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d0fcd8c-efac-4c8a-9bc8-adf691585dd0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:21.609067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f38b1e1d-59c0-4a22-b5ae-bbbf8bf8a2e2 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:21.611587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f38b1e1d-59c0-4a22-b5ae-bbbf8bf8a2e2 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:21.619502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38b1e1d-59c0-4a22-b5ae-bbbf8bf8a2e2 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:21.620668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38b1e1d-59c0-4a22-b5ae-bbbf8bf8a2e2 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:21.621841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38b1e1d-59c0-4a22-b5ae-bbbf8bf8a2e2 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:21.624617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38b1e1d-59c0-4a22-b5ae-bbbf8bf8a2e2 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:21.631255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38b1e1d-59c0-4a22-b5ae-bbbf8bf8a2e2 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:21.631255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38b1e1d-59c0-4a22-b5ae-bbbf8bf8a2e2 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:21.670618 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f38b1e1d-59c0-4a22-b5ae-bbbf8bf8a2e2 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067562 Oct 11 04:37:21.671801 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2698/5657] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:37:21 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:37:21.792965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d0fcd8c-efac-4c8a-9bc8-adf691585dd0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:21.807233 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d0fcd8c-efac-4c8a-9bc8-adf691585dd0 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1512 microversion: 2.1 time: 0.662120 Oct 11 04:37:21.826621 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2960/5658] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:21 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1512 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:21.847840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bdfb92a1-6c32-4ef7-aa63-72d0973879e1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:21.850269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bdfb92a1-6c32-4ef7-aa63-72d0973879e1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:21.857189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfb92a1-6c32-4ef7-aa63-72d0973879e1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:21.858005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfb92a1-6c32-4ef7-aa63-72d0973879e1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:21.858725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfb92a1-6c32-4ef7-aa63-72d0973879e1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:21.859661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfb92a1-6c32-4ef7-aa63-72d0973879e1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:21.860421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfb92a1-6c32-4ef7-aa63-72d0973879e1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:21.861243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfb92a1-6c32-4ef7-aa63-72d0973879e1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:21.909274 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bdfb92a1-6c32-4ef7-aa63-72d0973879e1 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065225 Oct 11 04:37:21.910508 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2699/5659] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:37:21 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:37:22.008054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5154c698-929f-4abf-b8a8-41b634c9b38e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:22.008054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5154c698-929f-4abf-b8a8-41b634c9b38e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:22.015059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5154c698-929f-4abf-b8a8-41b634c9b38e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:22.015818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5154c698-929f-4abf-b8a8-41b634c9b38e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:22.016448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5154c698-929f-4abf-b8a8-41b634c9b38e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:22.017326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5154c698-929f-4abf-b8a8-41b634c9b38e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:22.017949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5154c698-929f-4abf-b8a8-41b634c9b38e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:22.018634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5154c698-929f-4abf-b8a8-41b634c9b38e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:22.049185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5154c698-929f-4abf-b8a8-41b634c9b38e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:37:22.178344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-141f7287-6984-475b-8734-5e8d44eb8478 req-8c8ae128-576c-4ccd-8b6f-4feaeb4c96de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63dbf99-f394-4f8c-b8cd-4c44979d03d3", "tag": "71156c1e-b551-4900-b358-8217224ddbb0"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:37:22.195317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-141f7287-6984-475b-8734-5e8d44eb8478 req-8c8ae128-576c-4ccd-8b6f-4feaeb4c96de service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:22.203043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-141f7287-6984-475b-8734-5e8d44eb8478 req-8c8ae128-576c-4ccd-8b6f-4feaeb4c96de service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:22.203043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-141f7287-6984-475b-8734-5e8d44eb8478 req-8c8ae128-576c-4ccd-8b6f-4feaeb4c96de service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:22.211414 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-141f7287-6984-475b-8734-5e8d44eb8478 req-8c8ae128-576c-4ccd-8b6f-4feaeb4c96de service nova] Creating event network-changed:71156c1e-b551-4900-b358-8217224ddbb0 for instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 on n-h2-860892-1 Oct 11 04:37:22.220124 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-141f7287-6984-475b-8734-5e8d44eb8478 req-8c8ae128-576c-4ccd-8b6f-4feaeb4c96de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.289957 Oct 11 04:37:22.221512 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2961/5660] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:37:22.689640 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5154c698-929f-4abf-b8a8-41b634c9b38e tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 204 len: 0 microversion: 2.1 time: 0.690983 Oct 11 04:37:22.691277 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2700/5661] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:21 2022] DELETE /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:37:22.701141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fbec0b54-f82b-411f-baec-3e5075a1574a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:22.702714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fbec0b54-f82b-411f-baec-3e5075a1574a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:22.711992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbec0b54-f82b-411f-baec-3e5075a1574a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:22.712712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbec0b54-f82b-411f-baec-3e5075a1574a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:22.713313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbec0b54-f82b-411f-baec-3e5075a1574a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:22.714736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbec0b54-f82b-411f-baec-3e5075a1574a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:22.715695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbec0b54-f82b-411f-baec-3e5075a1574a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:22.716463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbec0b54-f82b-411f-baec-3e5075a1574a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:22.857820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c88f8202-459d-4634-b525-03fcebf78c89 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:22.861525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c88f8202-459d-4634-b525-03fcebf78c89 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:22.892464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c88f8202-459d-4634-b525-03fcebf78c89 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:22.897342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c88f8202-459d-4634-b525-03fcebf78c89 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:22.899057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c88f8202-459d-4634-b525-03fcebf78c89 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:22.901155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c88f8202-459d-4634-b525-03fcebf78c89 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:22.905262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c88f8202-459d-4634-b525-03fcebf78c89 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:22.911631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c88f8202-459d-4634-b525-03fcebf78c89 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:23.037906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fbec0b54-f82b-411f-baec-3e5075a1574a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:23.060816 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fbec0b54-f82b-411f-baec-3e5075a1574a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1673 microversion: 2.1 time: 0.361240 Oct 11 04:37:23.063490 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2962/5662] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:22 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1673 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:23.331132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c88f8202-459d-4634-b525-03fcebf78c89 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:23.346182 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c88f8202-459d-4634-b525-03fcebf78c89 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1489 microversion: 2.1 time: 0.514478 Oct 11 04:37:23.348290 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2701/5663] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:22 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1489 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:23.379514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5b1e21de-ff90-426c-9a65-2813a922b695 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Action: 'update', calling method: >, body: {"server": {"name": "tempest-\u00cd\u00f1st\u00e1\u00f1c\u00e9-1225093442"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:37:23.394915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5b1e21de-ff90-426c-9a65-2813a922b695 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:23.424431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1e21de-ff90-426c-9a65-2813a922b695 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:23.424791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1e21de-ff90-426c-9a65-2813a922b695 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:23.425668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1e21de-ff90-426c-9a65-2813a922b695 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:23.426642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1e21de-ff90-426c-9a65-2813a922b695 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:23.427315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1e21de-ff90-426c-9a65-2813a922b695 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:23.436485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b1e21de-ff90-426c-9a65-2813a922b695 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:23.687166 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5b1e21de-ff90-426c-9a65-2813a922b695 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "PUT /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1062 microversion: 2.1 time: 0.311786 Oct 11 04:37:23.687614 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2963/5664] 10.222.0.26 () {60 vars in 1256 bytes} [Tue Oct 11 04:37:23 2022] PUT /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1062 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:23.707056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-72ff36b1-dd37-4454-af07-ef53eff91f31 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:23.707807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-72ff36b1-dd37-4454-af07-ef53eff91f31 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:23.716159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72ff36b1-dd37-4454-af07-ef53eff91f31 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:23.716638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72ff36b1-dd37-4454-af07-ef53eff91f31 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:23.717435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72ff36b1-dd37-4454-af07-ef53eff91f31 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:23.718391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72ff36b1-dd37-4454-af07-ef53eff91f31 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:23.718850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72ff36b1-dd37-4454-af07-ef53eff91f31 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:23.719296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72ff36b1-dd37-4454-af07-ef53eff91f31 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:23.951165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-72ff36b1-dd37-4454-af07-ef53eff91f31 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:23.962027 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-72ff36b1-dd37-4454-af07-ef53eff91f31 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1489 microversion: 2.1 time: 0.258133 Oct 11 04:37:23.963269 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2702/5665] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:23 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1489 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:37:23.990131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7b47b4aa-cfc1-40f5-b52b-7567696c4e26 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:23.990777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7b47b4aa-cfc1-40f5-b52b-7567696c4e26 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:23.997123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b47b4aa-cfc1-40f5-b52b-7567696c4e26 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:23.997918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b47b4aa-cfc1-40f5-b52b-7567696c4e26 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:23.998548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b47b4aa-cfc1-40f5-b52b-7567696c4e26 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:23.999438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b47b4aa-cfc1-40f5-b52b-7567696c4e26 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:24.000151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b47b4aa-cfc1-40f5-b52b-7567696c4e26 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:24.000896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b47b4aa-cfc1-40f5-b52b-7567696c4e26 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:24.089714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dd89aed5-34b2-4386-8d59-5b7100d12fd7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:24.091295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dd89aed5-34b2-4386-8d59-5b7100d12fd7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:24.103744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd89aed5-34b2-4386-8d59-5b7100d12fd7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:24.104419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd89aed5-34b2-4386-8d59-5b7100d12fd7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:24.104931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd89aed5-34b2-4386-8d59-5b7100d12fd7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:24.105774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd89aed5-34b2-4386-8d59-5b7100d12fd7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:24.106362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd89aed5-34b2-4386-8d59-5b7100d12fd7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:24.115547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd89aed5-34b2-4386-8d59-5b7100d12fd7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:24.352926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dd89aed5-34b2-4386-8d59-5b7100d12fd7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:24.361534 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dd89aed5-34b2-4386-8d59-5b7100d12fd7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1673 microversion: 2.1 time: 0.276271 Oct 11 04:37:24.362181 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2703/5666] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:24 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1673 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:24.509031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7b47b4aa-cfc1-40f5-b52b-7567696c4e26 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:24.519281 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7b47b4aa-cfc1-40f5-b52b-7567696c4e26 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1489 microversion: 2.1 time: 0.533435 Oct 11 04:37:24.521511 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2964/5667] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:23 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1489 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:24.545538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7b4e9036-64fd-4ec9-9e10-137f0c93b1ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:24.546025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7b4e9036-64fd-4ec9-9e10-137f0c93b1ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:24.552130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b4e9036-64fd-4ec9-9e10-137f0c93b1ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:24.552884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b4e9036-64fd-4ec9-9e10-137f0c93b1ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:24.553320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b4e9036-64fd-4ec9-9e10-137f0c93b1ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:24.554024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b4e9036-64fd-4ec9-9e10-137f0c93b1ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:24.554498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b4e9036-64fd-4ec9-9e10-137f0c93b1ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:24.554919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b4e9036-64fd-4ec9-9e10-137f0c93b1ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:24.583954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7b4e9036-64fd-4ec9-9e10-137f0c93b1ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:37:24.601855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:24.910816 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7b4e9036-64fd-4ec9-9e10-137f0c93b1ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 204 len: 0 microversion: 2.1 time: 0.367009 Oct 11 04:37:24.921164 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2704/5668] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:24 2022] DELETE /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:37:24.927090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-efc5aeaa-f44b-4deb-9435-3eb4aeb79a4d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:24.929406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-efc5aeaa-f44b-4deb-9435-3eb4aeb79a4d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:24.935415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efc5aeaa-f44b-4deb-9435-3eb4aeb79a4d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:24.936327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efc5aeaa-f44b-4deb-9435-3eb4aeb79a4d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:24.936976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efc5aeaa-f44b-4deb-9435-3eb4aeb79a4d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:24.937862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efc5aeaa-f44b-4deb-9435-3eb4aeb79a4d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:24.938517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efc5aeaa-f44b-4deb-9435-3eb4aeb79a4d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:24.939133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efc5aeaa-f44b-4deb-9435-3eb4aeb79a4d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:25.313590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-efc5aeaa-f44b-4deb-9435-3eb4aeb79a4d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:25.321752 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-efc5aeaa-f44b-4deb-9435-3eb4aeb79a4d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1495 microversion: 2.1 time: 0.398636 Oct 11 04:37:25.329017 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2965/5669] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:24 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1495 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:25.387817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9cd9390-5103-44a7-894c-20dddcd73540 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:25.389399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9cd9390-5103-44a7-894c-20dddcd73540 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:25.396895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9cd9390-5103-44a7-894c-20dddcd73540 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:25.403543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9cd9390-5103-44a7-894c-20dddcd73540 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:25.403543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9cd9390-5103-44a7-894c-20dddcd73540 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:25.403543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9cd9390-5103-44a7-894c-20dddcd73540 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:25.403543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9cd9390-5103-44a7-894c-20dddcd73540 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:25.403543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9cd9390-5103-44a7-894c-20dddcd73540 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:25.953643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b9cd9390-5103-44a7-894c-20dddcd73540 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:25.961830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b9cd9390-5103-44a7-894c-20dddcd73540 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1673 microversion: 2.1 time: 0.578979 Oct 11 04:37:25.962723 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2705/5670] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:25 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1673 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:26.345302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8ee711c7-318b-4715-b78d-175910059a86 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:26.346938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8ee711c7-318b-4715-b78d-175910059a86 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:26.354236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee711c7-318b-4715-b78d-175910059a86 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:26.355977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee711c7-318b-4715-b78d-175910059a86 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:26.356807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee711c7-318b-4715-b78d-175910059a86 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:26.357931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee711c7-318b-4715-b78d-175910059a86 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:26.359139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee711c7-318b-4715-b78d-175910059a86 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:26.359665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee711c7-318b-4715-b78d-175910059a86 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:26.876815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8ee711c7-318b-4715-b78d-175910059a86 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:26.893712 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8ee711c7-318b-4715-b78d-175910059a86 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1495 microversion: 2.1 time: 0.552404 Oct 11 04:37:26.895120 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2966/5671] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:26 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1495 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:26.985598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f5ca04e-6865-4a5e-9e0a-06f0d45f9c34 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:26.986506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9f5ca04e-6865-4a5e-9e0a-06f0d45f9c34 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:26.994174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f5ca04e-6865-4a5e-9e0a-06f0d45f9c34 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:26.994799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f5ca04e-6865-4a5e-9e0a-06f0d45f9c34 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:26.995711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f5ca04e-6865-4a5e-9e0a-06f0d45f9c34 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:26.997078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f5ca04e-6865-4a5e-9e0a-06f0d45f9c34 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:26.997548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f5ca04e-6865-4a5e-9e0a-06f0d45f9c34 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:26.997980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f5ca04e-6865-4a5e-9e0a-06f0d45f9c34 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:27.183235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-ea1025a3-7640-4b8e-85c9-8fe2ccb234ed req-c06bc1a5-f5e1-4cf0-a4ac-2649452a2b0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc7fc59-8223-407c-ae32-73663f5ae0b9", "name": "network-vif-deleted", "tag": "beb1f2b6-4c8f-4e53-8eb9-fe789b434cfa"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:37:27.208715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ea1025a3-7640-4b8e-85c9-8fe2ccb234ed req-c06bc1a5-f5e1-4cf0-a4ac-2649452a2b0b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:27.213473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ea1025a3-7640-4b8e-85c9-8fe2ccb234ed req-c06bc1a5-f5e1-4cf0-a4ac-2649452a2b0b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:27.213473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ea1025a3-7640-4b8e-85c9-8fe2ccb234ed req-c06bc1a5-f5e1-4cf0-a4ac-2649452a2b0b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:27.224063 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-ea1025a3-7640-4b8e-85c9-8fe2ccb234ed req-c06bc1a5-f5e1-4cf0-a4ac-2649452a2b0b service nova] Creating event network-vif-deleted:beb1f2b6-4c8f-4e53-8eb9-fe789b434cfa for instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 on n-h1-860892-1 Oct 11 04:37:27.260110 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-ea1025a3-7640-4b8e-85c9-8fe2ccb234ed req-c06bc1a5-f5e1-4cf0-a4ac-2649452a2b0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080349 Oct 11 04:37:27.261327 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2967/5672] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:37:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:37:27.278911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9f5ca04e-6865-4a5e-9e0a-06f0d45f9c34 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:27.288405 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9f5ca04e-6865-4a5e-9e0a-06f0d45f9c34 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1673 microversion: 2.1 time: 0.306920 Oct 11 04:37:27.289314 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2706/5673] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:26 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1673 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:27.921990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:27.922717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:27.931330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:27.932084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:27.933043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:27.935490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:27.936581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:27.937514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:27.975842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:27.976351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:27.976787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:27.977240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lazy-loading 'fault' on Instance uuid 3fc7fc59-8223-407c-ae32-73663f5ae0b9 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:37:28.075284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:28.083036 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9daf2d87-d3e7-4927-a887-9e026ec049fe tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 200 len: 1310 microversion: 2.1 time: 0.165730 Oct 11 04:37:28.083652 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2968/5674] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:27 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 1310 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:28.329081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-18f69e55-9d8a-4875-816e-6dcd031fa245 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:28.329716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-18f69e55-9d8a-4875-816e-6dcd031fa245 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:28.338042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f69e55-9d8a-4875-816e-6dcd031fa245 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:28.338998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f69e55-9d8a-4875-816e-6dcd031fa245 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:28.339445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f69e55-9d8a-4875-816e-6dcd031fa245 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:28.340749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f69e55-9d8a-4875-816e-6dcd031fa245 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:28.341209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f69e55-9d8a-4875-816e-6dcd031fa245 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:28.341638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18f69e55-9d8a-4875-816e-6dcd031fa245 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:28.479127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18f69e55-9d8a-4875-816e-6dcd031fa245 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:28.479127 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-18f69e55-9d8a-4875-816e-6dcd031fa245 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1606 microversion: 2.1 time: 0.157696 Oct 11 04:37:28.491285 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2707/5675] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:28 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1606 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:28.547396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-9ce13e31-62aa-42d0-a3ca-24960e80b5ea req-82957aec-a4f2-40ca-bd15-c15667d2423e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0b45813-cd45-4fed-ae2b-9f2b1c5bc457", "name": "network-vif-deleted", "tag": "c01d4853-a4bd-4db8-a2bd-9014e950ba88"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:37:28.569293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9ce13e31-62aa-42d0-a3ca-24960e80b5ea req-82957aec-a4f2-40ca-bd15-c15667d2423e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:28.569774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9ce13e31-62aa-42d0-a3ca-24960e80b5ea req-82957aec-a4f2-40ca-bd15-c15667d2423e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:28.571101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9ce13e31-62aa-42d0-a3ca-24960e80b5ea req-82957aec-a4f2-40ca-bd15-c15667d2423e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:28.596239 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-9ce13e31-62aa-42d0-a3ca-24960e80b5ea req-82957aec-a4f2-40ca-bd15-c15667d2423e service nova] Creating event network-vif-deleted:c01d4853-a4bd-4db8-a2bd-9014e950ba88 for instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 on n-h1-860892-1 Oct 11 04:37:28.603838 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-9ce13e31-62aa-42d0-a3ca-24960e80b5ea req-82957aec-a4f2-40ca-bd15-c15667d2423e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061026 Oct 11 04:37:28.604465 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2969/5676] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:37:29.107560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.108343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.115569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.116067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.116560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.117311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.117825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.118474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.140642 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 HTTP/1.1 Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '3fc7fc59-8223-407c-ae32-73663f5ae0b9'} Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.142694 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.161036 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.161036 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.161036 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.161036 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.161036 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.161036 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.161036 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.161036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.161036 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-97384719-2003-4eb0-b4ee-06e449cb6b7a tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 404 len: 111 microversion: 2.1 time: 0.045036 Oct 11 04:37:29.161036 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2708/5677] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:29 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.169030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.174691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.178802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.179883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.180513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.181525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.182157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.182605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.199425 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 HTTP/1.1 Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '3fc7fc59-8223-407c-ae32-73663f5ae0b9'} Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.201124 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.205458 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-180437a2-6008-4388-9d48-0ed347ae71ea tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 404 len: 111 microversion: 2.1 time: 0.038913 Oct 11 04:37:29.211445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.212043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 3fc7fc59-8223-407c-ae32-73663f5ae0b9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.215434 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2970/5678] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:29 2022] DELETE /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.218893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.219629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.220285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.221153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.221767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.222382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.238721 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 HTTP/1.1 Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '3fc7fc59-8223-407c-ae32-73663f5ae0b9'} Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.240601 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.245000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.245000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.245000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.245000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.245000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.245000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. Oct 11 04:37:29.245000 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.245000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 3fc7fc59-8223-407c-ae32-73663f5ae0b9 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.245000 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0bb0ed98-a718-4a93-b39e-56f63357f3a3 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9" status: 404 len: 111 microversion: 2.1 time: 0.034590 Oct 11 04:37:29.251556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.252433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.256879 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2709/5679] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:29 2022] GET /compute/v2.1/servers/3fc7fc59-8223-407c-ae32-73663f5ae0b9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.259294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.259992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.260658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.261581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.262223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.262805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.279996 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf HTTP/1.1 Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '068559f3-6ff0-4f99-b4e3-5ac47e603ecf'} Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.281955 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:37:29.287174 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.287174 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.287174 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.287174 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.287174 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.287174 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.287174 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.287174 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.287174 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:37:29.287174 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.290445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.291587 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3fbe6490-9d6d-4690-b67b-14681830f363 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 404 len: 111 microversion: 2.1 time: 0.044173 Oct 11 04:37:29.300870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.301716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 068559f3-6ff0-4f99-b4e3-5ac47e603ecf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.307069 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2971/5680] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:29 2022] DELETE /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.309497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.312189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.312189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.312189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.312189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.312791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.335723 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf HTTP/1.1 Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '068559f3-6ff0-4f99-b4e3-5ac47e603ecf'} Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.338711 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.346493 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.346493 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.346493 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.346493 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.346493 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.346493 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. Oct 11 04:37:29.346493 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.349913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 068559f3-6ff0-4f99-b4e3-5ac47e603ecf could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.351178 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02f0bbd4-faad-4318-aed6-249390e8e8ec tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf" status: 404 len: 111 microversion: 2.1 time: 0.054394 Oct 11 04:37:29.361170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.361928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.369591 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2710/5681] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:29 2022] GET /compute/v2.1/servers/068559f3-6ff0-4f99-b4e3-5ac47e603ecf => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.370098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.370906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.371521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.372404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.373015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.373760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.394155 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 HTTP/1.1 Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '2f08acea-8a20-4fcf-936f-1f8414dda402'} Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.396273 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:37:29.403000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.403000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.403000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.403000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.403000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.403000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.403000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.403000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.403000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:37:29.403000 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.406742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.408423 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-65772a2b-f125-400f-9cc8-e82f0bc11636 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 404 len: 111 microversion: 2.1 time: 0.051712 Oct 11 04:37:29.421033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.422040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 2f08acea-8a20-4fcf-936f-1f8414dda402] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.427441 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2972/5682] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:29 2022] DELETE /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.429715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.430771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.431441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.433634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.434654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.435313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.454403 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 HTTP/1.1 Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '2f08acea-8a20-4fcf-936f-1f8414dda402'} Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.461823 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.468625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.468625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.468625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.468625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.468625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.468625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. Oct 11 04:37:29.468625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.468625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 2f08acea-8a20-4fcf-936f-1f8414dda402 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.468625 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d5ea3f78-1817-4ff7-890f-ecdbf1758442 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402" status: 404 len: 111 microversion: 2.1 time: 0.043608 Oct 11 04:37:29.469756 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2711/5683] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:29 2022] GET /compute/v2.1/servers/2f08acea-8a20-4fcf-936f-1f8414dda402 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.472473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.472975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.487552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.488737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.492263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.499238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.500001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.501605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.504228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.505129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.516083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.516892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.525148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.527043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.527854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.528520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.537499 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 HTTP/1.1 Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'f2e3ee58-f888-413a-9d48-8fd7ef276b07'} Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.539139 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:37:29.545119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.545119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.545119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.545119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.545119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.545119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.545119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.545119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.545119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:37:29.545119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.545119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.550701 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-54ee4ae0-0b44-461e-98f8-db5a65e2e9ba tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 404 len: 111 microversion: 2.1 time: 0.072956 Oct 11 04:37:29.551737 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2973/5684] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:29 2022] DELETE /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.561953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.561953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: f2e3ee58-f888-413a-9d48-8fd7ef276b07] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.576645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.577454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.578060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.580990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.581640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.582276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.590117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.590637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.591144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.594237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lazy-loading 'fault' on Instance uuid b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:37:29.615376 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 HTTP/1.1 Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'f2e3ee58-f888-413a-9d48-8fd7ef276b07'} Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.618076 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.623877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.623877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.623877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.623877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.623877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.623877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. Oct 11 04:37:29.623877 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.625505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance f2e3ee58-f888-413a-9d48-8fd7ef276b07 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.628835 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-609c66f4-b49a-4c08-be1e-7ce60f7580b8 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07" status: 404 len: 111 microversion: 2.1 time: 0.073100 Oct 11 04:37:29.631562 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2974/5685] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:29 2022] GET /compute/v2.1/servers/f2e3ee58-f888-413a-9d48-8fd7ef276b07 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:37:29.644713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.645603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.653622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.654493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.655049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.655957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.656594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.657280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.660528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '22e2c72c29774424b6c603bf36318512', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '483579a827a84b40b6fb4c3bd5b67360', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:29.669164 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b78e8718-00c3-4de6-8152-793d566d3483 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 200 len: 1328 microversion: 2.1 time: 0.170662 Oct 11 04:37:29.669747 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2712/5686] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:29 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 1328 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:29.680898 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 HTTP/1.1 Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1451d1bc-1e82-4436-8f11-4cc54dcd4ec8'} Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.682731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.691872 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5ddcec87-9dd9-4ef8-a442-77ce24a27527 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 404 len: 111 microversion: 2.1 time: 0.051769 Oct 11 04:37:29.696045 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2975/5687] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:29 2022] DELETE /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.732944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.733668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.736662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:29.750280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.751074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.751693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.752579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.753034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.753462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.795767 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 HTTP/1.1 Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1451d1bc-1e82-4436-8f11-4cc54dcd4ec8'} Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.797352 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.803453 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.803453 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.803453 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.803453 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.803453 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.803453 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. Oct 11 04:37:29.803453 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.803453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.803453 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0bbb7f07-19e7-45fa-a36e-8f109e66188d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8" status: 404 len: 111 microversion: 2.1 time: 0.101450 Oct 11 04:37:29.803453 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2713/5688] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:29 2022] GET /compute/v2.1/servers/1451d1bc-1e82-4436-8f11-4cc54dcd4ec8 => generated 111 bytes in 106 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.807569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.808068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.816577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.817064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.817496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.818209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.818657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.819074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.867912 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 HTTP/1.1 Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e2f3247f-ef76-46bd-ae1e-b2c1d10b0618'} Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.869509 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:37:29.874119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.874119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.874119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.874119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.874119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.874119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.874119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.874119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.874119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:37:29.874119 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.876912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.877870 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-796da06b-a583-4c59-9c88-201c270cd7b6 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 404 len: 111 microversion: 2.1 time: 0.074193 Oct 11 04:37:29.878864 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2976/5689] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:29 2022] DELETE /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.886730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.887456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: e2f3247f-ef76-46bd-ae1e-b2c1d10b0618] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.897184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.899361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.903449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.904488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:29.905165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:29.905908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:29.933091 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 HTTP/1.1 Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e2f3247f-ef76-46bd-ae1e-b2c1d10b0618'} Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.934647 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.941553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.941553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.941553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.941553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.941553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.941553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. Oct 11 04:37:29.941553 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.941553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.941553 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df353c53-3520-4913-b364-785cd38461fc tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618" status: 404 len: 111 microversion: 2.1 time: 0.055711 Oct 11 04:37:29.947816 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2714/5690] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:29 2022] GET /compute/v2.1/servers/e2f3247f-ef76-46bd-ae1e-b2c1d10b0618 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.956068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d083bead-a760-4b88-9191-0d4c975fb522 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.956565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d083bead-a760-4b88-9191-0d4c975fb522 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 69f275c4-7756-4009-ac0e-f0cc7412b12c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d083bead-a760-4b88-9191-0d4c975fb522 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d083bead-a760-4b88-9191-0d4c975fb522 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/69f275c4-7756-4009-ac0e-f0cc7412b12c HTTP/1.1 Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '69f275c4-7756-4009-ac0e-f0cc7412b12c'} Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.969933 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d083bead-a760-4b88-9191-0d4c975fb522 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d083bead-a760-4b88-9191-0d4c975fb522 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/69f275c4-7756-4009-ac0e-f0cc7412b12c" status: 404 len: 111 microversion: 2.1 time: 0.017255 Oct 11 04:37:29.978004 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2977/5691] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:29 2022] DELETE /compute/v2.1/servers/69f275c4-7756-4009-ac0e-f0cc7412b12c => generated 111 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:29.980470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5aff7714-4d50-4332-82cc-6ee3d1ae7380 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:29.980470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5aff7714-4d50-4332-82cc-6ee3d1ae7380 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 69f275c4-7756-4009-ac0e-f0cc7412b12c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:29.989087 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-5aff7714-4d50-4332-82cc-6ee3d1ae7380 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5aff7714-4d50-4332-82cc-6ee3d1ae7380 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/69f275c4-7756-4009-ac0e-f0cc7412b12c HTTP/1.1 Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '69f275c4-7756-4009-ac0e-f0cc7412b12c'} Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:29.990842 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:30.003450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:30.003450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:30.003450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:30.003450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. Oct 11 04:37:30.003450 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:30.003450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5aff7714-4d50-4332-82cc-6ee3d1ae7380 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 69f275c4-7756-4009-ac0e-f0cc7412b12c could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:30.003450 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5aff7714-4d50-4332-82cc-6ee3d1ae7380 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/69f275c4-7756-4009-ac0e-f0cc7412b12c" status: 404 len: 111 microversion: 2.1 time: 0.017370 Oct 11 04:37:30.006579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d8ce03e-088c-455f-a063-7a9a865b2e45 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:30.007092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d8ce03e-088c-455f-a063-7a9a865b2e45 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:30.020013 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2715/5692] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:29 2022] GET /compute/v2.1/servers/69f275c4-7756-4009-ac0e-f0cc7412b12c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:30.024695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d8ce03e-088c-455f-a063-7a9a865b2e45 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:30.026760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d8ce03e-088c-455f-a063-7a9a865b2e45 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:30.027947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d8ce03e-088c-455f-a063-7a9a865b2e45 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:30.029856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d8ce03e-088c-455f-a063-7a9a865b2e45 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:30.030605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d8ce03e-088c-455f-a063-7a9a865b2e45 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:30.031210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d8ce03e-088c-455f-a063-7a9a865b2e45 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:30.086731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d8ce03e-088c-455f-a063-7a9a865b2e45 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:37:30.621850 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d8ce03e-088c-455f-a063-7a9a865b2e45 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "DELETE /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 204 len: 0 microversion: 2.1 time: 0.618714 Oct 11 04:37:30.621850 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2978/5693] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:30 2022] DELETE /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 0 bytes in 620 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:37:30.631041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-40fdc7b6-9395-4659-991d-188f31cf6483 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:30.631787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-40fdc7b6-9395-4659-991d-188f31cf6483 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:30.650533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40fdc7b6-9395-4659-991d-188f31cf6483 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:30.653823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40fdc7b6-9395-4659-991d-188f31cf6483 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:30.653823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40fdc7b6-9395-4659-991d-188f31cf6483 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:30.654224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40fdc7b6-9395-4659-991d-188f31cf6483 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:30.655504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40fdc7b6-9395-4659-991d-188f31cf6483 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:30.656147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40fdc7b6-9395-4659-991d-188f31cf6483 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:30.713582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:30.714462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:30.723089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:30.723591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:30.724382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:30.725567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:30.727030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:30.727803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:30.764104 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] HTTP exception thrown: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Request method failure captured: Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 HTTP/1.1 Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPF1upEjEVWRbUy2PR7AoBTg_fKJ73H7rmgS4At6biFPXPQbajm6xKtNgxnB6dXbnvJFTIFv-Ql-Ua1ANx4PBITTQ1WTmCFFJgO-3rYaBPyJ3NlyQPglizDzqL0dBhEO75PdD4Hsf4cN2KcFkLEFKhsk9U1n-mAgPTXbVv-xsMazHjc Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}] Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 22e2c72c29774424b6c603bf36318512 Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'b0b45813-cd45-4fed-ae2b-9f2b1c5bc457'} Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:30.772007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:30.777586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:30.777586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:30.777586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:30.777586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:30.777586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:30.777586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:30.777586 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:30.780475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Returning 404 to user: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:30.782458 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b40285df-a5fd-41c7-92b6-c638917a2b22 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 404 len: 111 microversion: 2.1 time: 0.079263 Oct 11 04:37:30.783647 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2979/5694] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:30 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:30.792675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35cf391a-f079-4b4e-aec2-01ac596c44b7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '.version_select at 0x7fda18cda040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:30.901476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-40fdc7b6-9395-4659-991d-188f31cf6483 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:30.909618 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-40fdc7b6-9395-4659-991d-188f31cf6483 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1479 microversion: 2.1 time: 0.282803 Oct 11 04:37:30.910505 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2716/5695] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:30 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1479 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:30.943303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:30.943984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:30.950491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:30.952312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:30.952767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:30.953479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:30.953933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:30.954797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:30.973168 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-35cf391a-f079-4b4e-aec2-01ac596c44b7 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508188651" status: 202 len: 0 microversion: 2.1 time: 0.184730 Oct 11 04:37:30.974300 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2980/5696] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:37:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508188651 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:37:31.395172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:31.411785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:31.414148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:31.415646 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e7ffc15c-af8f-4686-a69a-e075761a422c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 2951 microversion: 2.42 time: 0.477185 Oct 11 04:37:31.416203 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2717/5697] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:37:30 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 2951 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:37:31.444719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d67914c-1f90-466f-976e-0ec57bf4999a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:31.445521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d67914c-1f90-466f-976e-0ec57bf4999a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:31.453656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d67914c-1f90-466f-976e-0ec57bf4999a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:31.454157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d67914c-1f90-466f-976e-0ec57bf4999a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:31.454627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d67914c-1f90-466f-976e-0ec57bf4999a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:31.455523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d67914c-1f90-466f-976e-0ec57bf4999a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:31.455978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d67914c-1f90-466f-976e-0ec57bf4999a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:31.456415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d67914c-1f90-466f-976e-0ec57bf4999a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:31.658537 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d67914c-1f90-466f-976e-0ec57bf4999a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377/os-interface" status: 200 len: 1828 microversion: 2.42 time: 0.218411 Oct 11 04:37:31.659847 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2981/5698] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Oct 11 04:37:31 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377/os-interface => generated 1828 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:37:31.935995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f3e5213-45af-4166-88ad-d59d3a02c7f7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:31.936591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f3e5213-45af-4166-88ad-d59d3a02c7f7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:31.945028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f3e5213-45af-4166-88ad-d59d3a02c7f7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:31.945522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f3e5213-45af-4166-88ad-d59d3a02c7f7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:31.945994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f3e5213-45af-4166-88ad-d59d3a02c7f7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:31.946725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f3e5213-45af-4166-88ad-d59d3a02c7f7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:31.947182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f3e5213-45af-4166-88ad-d59d3a02c7f7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:31.947619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f3e5213-45af-4166-88ad-d59d3a02c7f7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:32.154940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f3e5213-45af-4166-88ad-d59d3a02c7f7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:32.163945 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f3e5213-45af-4166-88ad-d59d3a02c7f7 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1479 microversion: 2.1 time: 0.231916 Oct 11 04:37:32.178214 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2718/5699] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:31 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1479 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:32.901364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-259a7dc9-a149-4ef7-829f-9cf2ed6bda86 req-b28d57de-1e8a-481c-bb36-ab902659f22c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "451260aa-21f7-42e6-b412-66610aad28ee", "name": "network-vif-deleted", "tag": "90a81ee1-9aac-4772-979d-b78a8ea22a38"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:37:32.928913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-259a7dc9-a149-4ef7-829f-9cf2ed6bda86 req-b28d57de-1e8a-481c-bb36-ab902659f22c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:32.936107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-259a7dc9-a149-4ef7-829f-9cf2ed6bda86 req-b28d57de-1e8a-481c-bb36-ab902659f22c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:32.936852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-259a7dc9-a149-4ef7-829f-9cf2ed6bda86 req-b28d57de-1e8a-481c-bb36-ab902659f22c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:32.956779 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-259a7dc9-a149-4ef7-829f-9cf2ed6bda86 req-b28d57de-1e8a-481c-bb36-ab902659f22c service nova] Creating event network-vif-deleted:90a81ee1-9aac-4772-979d-b78a8ea22a38 for instance 451260aa-21f7-42e6-b412-66610aad28ee on n-h1-860892-1 Oct 11 04:37:32.956779 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-259a7dc9-a149-4ef7-829f-9cf2ed6bda86 req-b28d57de-1e8a-481c-bb36-ab902659f22c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058583 Oct 11 04:37:32.956779 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2982/5700] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:37:33.193649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-37b6364c-e87a-4323-bbc4-337c07cae18d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:33.194501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-37b6364c-e87a-4323-bbc4-337c07cae18d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:33.213645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37b6364c-e87a-4323-bbc4-337c07cae18d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:33.216984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37b6364c-e87a-4323-bbc4-337c07cae18d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:33.219085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37b6364c-e87a-4323-bbc4-337c07cae18d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:33.220473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37b6364c-e87a-4323-bbc4-337c07cae18d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:33.222380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37b6364c-e87a-4323-bbc4-337c07cae18d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:33.225768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37b6364c-e87a-4323-bbc4-337c07cae18d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:33.339582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-37b6364c-e87a-4323-bbc4-337c07cae18d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '96880360d7994e09a1fd27193d2cd152', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f89aebc94ff4fb3922014b59e5b935a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:37:33.366942 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-37b6364c-e87a-4323-bbc4-337c07cae18d tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 200 len: 1277 microversion: 2.1 time: 0.181035 Oct 11 04:37:33.375435 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2719/5701] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:33 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 1277 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:37:34.394343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:34.395060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] [instance: 451260aa-21f7-42e6-b412-66610aad28ee] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:34.406419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:34.413981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:34.416662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:34.420659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:34.421519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:34.422754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:34.437771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:34.471207 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] HTTP exception thrown: Instance 451260aa-21f7-42e6-b412-66610aad28ee could not be found. Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Request method failure captured: Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee HTTP/1.1 Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIwq_97wYMK3yM4PCQDGruH1fJr3A3j9IvyO0C1AfdMR1etzmQKG5-7U9ETHCdFe-OZ3TyqxRHRQZRWVVDkM6HBZe_J2dL4skIuW_Sxh4t5aVFiJWuSLYbe7y2GqQTBEZdsyObV5JL1Yi8ivt97uAZosTCq8otIQ38crgnGyUNubnk Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5f89aebc94ff4fb3922014b59e5b935a"}]}] Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersTestJSON-1711133212 Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5f89aebc94ff4fb3922014b59e5b935a Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersTestJSON-1711133212 Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 96880360d7994e09a1fd27193d2cd152 Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersTestJSON-1711133212-project Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 451260aa-21f7-42e6-b412-66610aad28ee could not be found. Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '451260aa-21f7-42e6-b412-66610aad28ee'} Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 451260aa-21f7-42e6-b412-66610aad28ee could not be found. Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 451260aa-21f7-42e6-b412-66610aad28ee could not be found. Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:34.481217 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:34.485932 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:34.485932 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:34.485932 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:34.485932 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:34.485932 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:34.485932 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 451260aa-21f7-42e6-b412-66610aad28ee could not be found. Oct 11 04:37:34.485932 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:34.485932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] Returning 404 to user: Instance 451260aa-21f7-42e6-b412-66610aad28ee could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:34.485932 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d161fb2-be57-432e-a2cb-b15f88749b66 tempest-ServersTestJSON-1711133212 tempest-ServersTestJSON-1711133212-project] 10.222.0.26 "GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee" status: 404 len: 111 microversion: 2.1 time: 0.093837 Oct 11 04:37:34.508955 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2983/5702] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:34 2022] GET /compute/v2.1/servers/451260aa-21f7-42e6-b412-66610aad28ee => generated 111 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:43.273617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:43.274707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:43.282133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=13 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:43.288774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:43.289464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:43.291291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:43.299062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:43.299835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:43.300872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:43.339670 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] HTTP exception thrown: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Request method failure captured: Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 HTTP/1.1 Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPF1upEjEVWRbUy2PR7AoBTg_fKJ73H7rmgS4At6biFPXPQbajm6xKtNgxnB6dXbnvJFTIFv-Ql-Ua1ANx4PBITTQ1WTmCFFJgO-3rYaBPyJ3NlyQPglizDzqL0dBhEO75PdD4Hsf4cN2KcFkLEFKhsk9U1n-mAgPTXbVv-xsMazHjc Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}] Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 22e2c72c29774424b6c603bf36318512 Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'b0b45813-cd45-4fed-ae2b-9f2b1c5bc457'} Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:43.344536 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Returning 404 to user: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:43.348127 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2fd35004-ccd1-48c2-aa22-c0a0ce271af8 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 404 len: 111 microversion: 2.1 time: 0.077842 Oct 11 04:37:43.350852 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2720/5703] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:43 2022] DELETE /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 111 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:43.356983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:43.357662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: b0b45813-cd45-4fed-ae2b-9f2b1c5bc457] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:43.374928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:43.376484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:43.376985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:43.377431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:43.378153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:43.378664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:43.379105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] HTTP exception thrown: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Request method failure captured: Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 HTTP/1.1 Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPF1upEjEVWRbUy2PR7AoBTg_fKJ73H7rmgS4At6biFPXPQbajm6xKtNgxnB6dXbnvJFTIFv-Ql-Ua1ANx4PBITTQ1WTmCFFJgO-3rYaBPyJ3NlyQPglizDzqL0dBhEO75PdD4Hsf4cN2KcFkLEFKhsk9U1n-mAgPTXbVv-xsMazHjc Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}] Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 22e2c72c29774424b6c603bf36318512 Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'b0b45813-cd45-4fed-ae2b-9f2b1c5bc457'} Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:43.426433 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Returning 404 to user: Instance b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:43.429910 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-06cbbdb8-f81b-4235-9097-f7d5d25c7d9a tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457" status: 404 len: 111 microversion: 2.1 time: 0.073563 Oct 11 04:37:43.431063 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2984/5704] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:43 2022] GET /compute/v2.1/servers/b0b45813-cd45-4fed-ae2b-9f2b1c5bc457 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:48.262360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:48.263672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:48.271193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:48.271951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:48.272578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:48.273418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:48.274059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:48.274663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:48.300511 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] HTTP exception thrown: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Request method failure captured: Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 HTTP/1.1 Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPF1upEjEVWRbUy2PR7AoBTg_fKJ73H7rmgS4At6biFPXPQbajm6xKtNgxnB6dXbnvJFTIFv-Ql-Ua1ANx4PBITTQ1WTmCFFJgO-3rYaBPyJ3NlyQPglizDzqL0dBhEO75PdD4Hsf4cN2KcFkLEFKhsk9U1n-mAgPTXbVv-xsMazHjc Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}] Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 22e2c72c29774424b6c603bf36318512 Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '999777c2-2b4b-4ae8-ab23-7709485d2501'} Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:48.307069 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Returning 404 to user: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:48.310953 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3ba647d-fb07-44e6-96dc-de7c86e0c9a6 tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "DELETE /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 404 len: 111 microversion: 2.1 time: 0.048851 Oct 11 04:37:48.312952 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2721/5705] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:37:48 2022] DELETE /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:48.315478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:48.316619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] [instance: 999777c2-2b4b-4ae8-ab23-7709485d2501] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:48.333033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:48.333539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:48.333988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:48.335025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:48.335667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:48.336115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:48.388688 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] HTTP exception thrown: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Request method failure captured: Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 HTTP/1.1 Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPF1upEjEVWRbUy2PR7AoBTg_fKJ73H7rmgS4At6biFPXPQbajm6xKtNgxnB6dXbnvJFTIFv-Ql-Ua1ANx4PBITTQ1WTmCFFJgO-3rYaBPyJ3NlyQPglizDzqL0dBhEO75PdD4Hsf4cN2KcFkLEFKhsk9U1n-mAgPTXbVv-xsMazHjc Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/483579a827a84b40b6fb4c3bd5b67360"}]}] Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 483579a827a84b40b6fb4c3bd5b67360 Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeTestJSON-296985123 Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 22e2c72c29774424b6c603bf36318512 Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeTestJSON-296985123-project Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '999777c2-2b4b-4ae8-ab23-7709485d2501'} Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:37:48.391844 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:48.395505 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:37:48.395505 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:37:48.395505 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:37:48.395505 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:37:48.395505 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:37:48.395505 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. Oct 11 04:37:48.395505 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:37:48.395505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] Returning 404 to user: Instance 999777c2-2b4b-4ae8-ab23-7709485d2501 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:37:48.395505 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f833526e-5696-430a-b844-336fb0b0372f tempest-AttachVolumeTestJSON-296985123 tempest-AttachVolumeTestJSON-296985123-project] 10.222.0.26 "GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501" status: 404 len: 111 microversion: 2.1 time: 0.083244 Oct 11 04:37:48.403564 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2985/5706] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:37:48 2022] GET /compute/v2.1/servers/999777c2-2b4b-4ae8-ab23-7709485d2501 => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:37:55.735605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8568ee4f-fd6a-44eb-90d5-ccee87b5ce83 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:37:55.736134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8568ee4f-fd6a-44eb-90d5-ccee87b5ce83 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:55.755657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8568ee4f-fd6a-44eb-90d5-ccee87b5ce83 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:55.756400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8568ee4f-fd6a-44eb-90d5-ccee87b5ce83 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:55.756994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8568ee4f-fd6a-44eb-90d5-ccee87b5ce83 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:55.761888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8568ee4f-fd6a-44eb-90d5-ccee87b5ce83 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:55.762809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8568ee4f-fd6a-44eb-90d5-ccee87b5ce83 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:55.763649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8568ee4f-fd6a-44eb-90d5-ccee87b5ce83 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:55.788917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:37:55.824849 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8568ee4f-fd6a-44eb-90d5-ccee87b5ce83 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/ips" status: 200 len: 151 microversion: 2.1 time: 0.093303 Oct 11 04:37:55.837117 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2722/5707] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:37:55 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/ips => generated 151 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:37:59.419958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-08d95b15-8e92-4db6-b250-dce3499e9a39 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe862dc8-bf20-4f11-afb3-ab00da96b6a9"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:37:59.443158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-08d95b15-8e92-4db6-b250-dce3499e9a39 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:37:59.454701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d95b15-8e92-4db6-b250-dce3499e9a39 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:59.455236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d95b15-8e92-4db6-b250-dce3499e9a39 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:59.455677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d95b15-8e92-4db6-b250-dce3499e9a39 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:37:59.456387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d95b15-8e92-4db6-b250-dce3499e9a39 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:37:59.457018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d95b15-8e92-4db6-b250-dce3499e9a39 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:37:59.457475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08d95b15-8e92-4db6-b250-dce3499e9a39 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:00.203003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a55e1b7b-41e2-43e7-b4ce-a64b49007911 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Action: 'create', calling method: .version_select at 0x7fda1921b5e0>, body: {"keypair": {"name": "tempest-keypair-366717867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLc+wuVVF/ohNBh8j4/moYafgvCH/QDkWVWAb3HzxEZjNAtTfres0Jvz9OvD/sWBeYUuHD/OIuHyW1WlBwBgAojY+ldPcp+TFbfPNYf4vnreKfDhjsaMe/ngwZncTY5t3A=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:00.228068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a55e1b7b-41e2-43e7-b4ce-a64b49007911 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Getting quotas for project cbfd601e8ae449eaa5d8d21409c953a0. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:38:00.264525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a55e1b7b-41e2-43e7-b4ce-a64b49007911 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Getting quotas for user 9cdfb1cf8aeb4fa0859c4d954bdd6369 and project cbfd601e8ae449eaa5d8d21409c953a0. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:38:00.390766 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a55e1b7b-41e2-43e7-b4ce-a64b49007911 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.460616 Oct 11 04:38:00.392605 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2723/5708] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 11 04:37:59 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 463 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 04:38:00.547317 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-08d95b15-8e92-4db6-b250-dce3499e9a39 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.156020 Oct 11 04:38:00.553547 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2986/5709] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:37:59 2022] POST /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments => generated 194 bytes in 1158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:02.506567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5fc1c43a-2683-4999-af87-ee8ffc8c80b9 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Action: 'create', calling method: .version_select at 0x7fda18823280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-599338744"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:03.621563 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5fc1c43a-2683-4999-af87-ee8ffc8c80b9 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.318868 Oct 11 04:38:03.622821 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2724/5710] 10.222.0.26 () {60 vars in 1155 bytes} [Tue Oct 11 04:38:02 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1321 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 11 04:38:03.638779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-34f2e827-4baf-4100-a2ed-6932b6c5410c tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18c9fa60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:03.737115 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-34f2e827-4baf-4100-a2ed-6932b6c5410c tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758" status: 200 len: 344 microversion: 2.1 time: 0.104817 Oct 11 04:38:03.738734 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2987/5711] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:38:03 2022] GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:04.756345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-71d64f71-3242-4ed0-ae0e-29bd143bc0c0 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda188ba3a0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:04.857802 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-71d64f71-3242-4ed0-ae0e-29bd143bc0c0 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758" status: 200 len: 344 microversion: 2.1 time: 0.108505 Oct 11 04:38:04.858431 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2725/5712] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:38:04 2022] GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 => generated 344 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:05.732575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1140518500", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9ff1d26-97e4-4133-8d03-733f3c62a963"}], "security_groups": [{"name": "tempest-securitygroup--1471548506"}], "key_name": "tempest-keypair-366717867", "user_data": "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:05.873016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29b3785b-9634-49b7-987e-4e0f15af9cd3 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18823160>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:06.057194 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-29b3785b-9634-49b7-987e-4e0f15af9cd3 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758" status: 200 len: 345 microversion: 2.1 time: 0.189062 Oct 11 04:38:06.068169 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2726/5713] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:38:05 2022] GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 => generated 345 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:06.073909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-af3cfb51-3679-421a-90dc-03222d2cf2c8 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Action: 'create', calling method: .version_select at 0x7fda18a92670>, body: {"snapshot": {"volume_id": "ab7d98b8-98ec-4651-9856-bb66f86e2758", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1435205653"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:06.086048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] validate_networks() for [('d9ff1d26-97e4-4133-8d03-733f3c62a963', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:38:06.837085 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-af3cfb51-3679-421a-90dc-03222d2cf2c8 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.767563 Oct 11 04:38:06.840120 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2727/5714] 10.222.0.26 () {60 vars in 1162 bytes} [Tue Oct 11 04:38:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:06.859720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-487c9e53-ff83-4ae8-ae16-68705ff775bd tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18835550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:06.989474 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-487c9e53-ff83-4ae8-ae16-68705ff775bd tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144" status: 200 len: 287 microversion: 2.1 time: 0.137838 Oct 11 04:38:06.991317 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2728/5715] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:38:06 2022] GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144 => generated 287 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:07.010815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5571ed6f-a2b3-447a-8fcd-797c886db288 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18835700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:07.078520 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5571ed6f-a2b3-447a-8fcd-797c886db288 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.074194 Oct 11 04:38:07.080755 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2729/5716] 10.222.0.26 () {58 vars in 1140 bytes} [Tue Oct 11 04:38:07 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:07.095580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f37132db-6944-46d4-9bfb-99dd02441260 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18a929d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:07.158766 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f37132db-6944-46d4-9bfb-99dd02441260 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144" status: 200 len: 287 microversion: 2.1 time: 0.064050 Oct 11 04:38:07.158766 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2730/5717] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:38:07 2022] GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:38:07.638762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:38:07.639333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:38:07.649142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:38:07.649142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:38:07.649142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:38:07.658930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:07.659354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:07.659783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:07.662614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:07.663090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:07.663525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:07.707820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Getting quotas for project cbfd601e8ae449eaa5d8d21409c953a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:38:07.722776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Getting quotas for user 9cdfb1cf8aeb4fa0859c4d954bdd6369 and project cbfd601e8ae449eaa5d8d21409c953a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:38:07.759079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:38:07.764769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:38:08.025326 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-02eb9404-2577-4539-84d1-82a9a9825a55 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.298262 Oct 11 04:38:08.029642 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2988/5718] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:38:05 2022] POST /compute/v2.1/servers => generated 402 bytes in 2304 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:38:08.045370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3aae4d8a-8cff-4b8e-a013-cde0f90711dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:08.046783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3aae4d8a-8cff-4b8e-a013-cde0f90711dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:08.168487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fd441d05-4690-42c3-b5bd-537ed809749c tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18c9f8b0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:08.213708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3aae4d8a-8cff-4b8e-a013-cde0f90711dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:08.227802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3aae4d8a-8cff-4b8e-a013-cde0f90711dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:08.233086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3aae4d8a-8cff-4b8e-a013-cde0f90711dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:08.240090 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3aae4d8a-8cff-4b8e-a013-cde0f90711dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1281 microversion: 2.20 time: 0.199171 Oct 11 04:38:08.247144 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fd441d05-4690-42c3-b5bd-537ed809749c tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144" status: 200 len: 287 microversion: 2.1 time: 0.081843 Oct 11 04:38:08.248070 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2989/5720] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:38:08 2022] GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144 => generated 287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:38:08.248399 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2731/5720] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:08 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1281 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:38:09.279768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38405ccc-32a2-4c26-a85a-e9ffb3e60a68 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18cad700>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:09.297118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a1f7fbd-04f2-42f2-9068-3749ba30edd0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:09.298428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9a1f7fbd-04f2-42f2-9068-3749ba30edd0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:09.374969 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-38405ccc-32a2-4c26-a85a-e9ffb3e60a68 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144" status: 200 len: 287 microversion: 2.1 time: 0.115468 Oct 11 04:38:09.375616 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2990/5721] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:38:09 2022] GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:09.394385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9a1f7fbd-04f2-42f2-9068-3749ba30edd0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:09.403707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9a1f7fbd-04f2-42f2-9068-3749ba30edd0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:09.407784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9a1f7fbd-04f2-42f2-9068-3749ba30edd0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:09.413348 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9a1f7fbd-04f2-42f2-9068-3749ba30edd0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1281 microversion: 2.20 time: 0.137418 Oct 11 04:38:09.417269 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2732/5722] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:09 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1281 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:10.389065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef3d02a4-4729-48ec-ac6d-12ff19ffd38b tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18cac040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:10.435057 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef3d02a4-4729-48ec-ac6d-12ff19ffd38b tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144" status: 200 len: 288 microversion: 2.1 time: 0.050754 Oct 11 04:38:10.435761 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2991/5723] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:38:10 2022] GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144 => generated 288 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:10.442927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:10.449111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:10.454842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-888315dc-94a0-45f7-a4a7-fb1678b61c41 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18ca6ca0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:10.456754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:10.457411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:10.458001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:10.458916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:10.459505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:10.460072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:10.556298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:10.576710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:10.588186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:10.592801 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8ac76925-9d96-4982-bf36-2903167702ac tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1277 microversion: 2.20 time: 0.153791 Oct 11 04:38:10.608682 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2733/5724] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:10 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1277 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:10.668595 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-888315dc-94a0-45f7-a4a7-fb1678b61c41 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144" status: 202 len: 0 microversion: 2.1 time: 0.218118 Oct 11 04:38:10.669733 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2992/5725] 10.222.0.26 () {58 vars in 1254 bytes} [Tue Oct 11 04:38:10 2022] DELETE /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:38:10.677784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-584cc9fa-a8f9-446d-826d-7969a63e9714 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18837f70>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:10.734869 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-584cc9fa-a8f9-446d-826d-7969a63e9714 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144" status: 200 len: 287 microversion: 2.1 time: 0.061097 Oct 11 04:38:10.742691 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2734/5726] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:38:10 2022] GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144 => generated 287 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:11.625332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:11.625957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:11.634661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:11.636172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:11.636972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:11.643074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:11.643074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:11.643074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:11.745379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:11.752154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e1713e5c-5ba9-403e-93a9-8d9859b1b95d tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18837820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:11.778536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:11.786246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:11.789689 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-83e334c4-8d12-4efc-8c70-bdbaead69a58 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1341 microversion: 2.20 time: 0.172354 Oct 11 04:38:11.791920 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2993/5727] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:11 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1341 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:11.826760 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e1713e5c-5ba9-403e-93a9-8d9859b1b95d tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144" status: 200 len: 287 microversion: 2.1 time: 0.079302 Oct 11 04:38:11.832265 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2735/5728] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:38:11 2022] GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144 => generated 287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:12.820330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:12.821794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:12.829492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:12.830628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:12.831423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:12.832391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:12.834651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:12.840023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5e158b8e-459b-4a36-8e86-b1c507a60cfa tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18826ee0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:12.841222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:12.891513 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5e158b8e-459b-4a36-8e86-b1c507a60cfa tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144" status: 200 len: 287 microversion: 2.1 time: 0.055915 Oct 11 04:38:12.897059 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2736/5729] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:38:12 2022] GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144 => generated 287 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:12.952770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:12.958444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:12.960039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:12.963829 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-09873048-fe85-4a1b-9b13-de511e01ac79 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1339 microversion: 2.20 time: 0.146594 Oct 11 04:38:12.969416 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2994/5730] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:12 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1339 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:13.905547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69149d2e-463a-4aa6-97fc-375064efe3ee tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18a92280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:13.946130 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-69149d2e-463a-4aa6-97fc-375064efe3ee tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] HTTP exception thrown: Snapshot 047ecd17-c46d-40c6-96e5-83de4d7c9144 could not be found. Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69149d2e-463a-4aa6-97fc-375064efe3ee tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Request method failure captured: Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144 HTTP/1.1 Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPMqj749P2B06OkmkrxUwLAmCGjf3siPGXCoZyqQtCnfJD6WmcYQ5doWWvVdfoy2dbNGtT7QHfMmynLUXUROrEv3s8mwyQ6mda1Zae1ryI_3TYCUGXSWEr8E8QGl-dv5AGDwrOjLVEPPwJgPR0r9c6axDGFObtpdbI-jQcKc42tsJaE Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: e9f6380d176d42c3bf467cc475846f4d Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9f6380d176d42c3bf467cc475846f4d"}]}] Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: e9f6380d176d42c3bf467cc475846f4d Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-VolumesSnapshotsTestJSON-2133963786-project Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: d25dd161c2254cd9bb3f722c9fec544c Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133963786-project Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: exception: Snapshot 047ecd17-c46d-40c6-96e5-83de4d7c9144 could not be found. Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '047ecd17-c46d-40c6-96e5-83de4d7c9144'} Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 047ecd17-c46d-40c6-96e5-83de4d7c9144 could not be found. (HTTP 404) (Request-ID: req-d486615b-cda2-4d69-97a5-0d85f5bf1768) Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 04:38:13.963562 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 047ecd17-c46d-40c6-96e5-83de4d7c9144 could not be found. Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 047ecd17-c46d-40c6-96e5-83de4d7c9144 could not be found. Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 047ecd17-c46d-40c6-96e5-83de4d7c9144 could not be found. Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69149d2e-463a-4aa6-97fc-375064efe3ee tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Returning 404 to user: Snapshot 047ecd17-c46d-40c6-96e5-83de4d7c9144 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69149d2e-463a-4aa6-97fc-375064efe3ee tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144" status: 404 len: 111 microversion: 2.1 time: 0.064578 Oct 11 04:38:13.972957 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2737/5731] 10.222.0.26 () {58 vars in 1251 bytes} [Tue Oct 11 04:38:13 2022] GET /compute/v2.1/os-snapshots/047ecd17-c46d-40c6-96e5-83de4d7c9144 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:38:13.980940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3753b90e-4dcd-4f75-833b-fc502c981a85 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18cfe550>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:14.011253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:14.013116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:14.021236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:14.021900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:14.024340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:14.032016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:14.032016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:14.032016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:14.246165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:14.256354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:14.258158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:14.259611 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1f75b163-ba01-4eff-976d-0d3c8b3b9cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1407 microversion: 2.20 time: 0.257216 Oct 11 04:38:14.260787 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2738/5732] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:14 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:38:14.303090 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3753b90e-4dcd-4f75-833b-fc502c981a85 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758" status: 202 len: 0 microversion: 2.1 time: 0.332518 Oct 11 04:38:14.310982 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2995/5733] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:38:13 2022] DELETE /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:38:14.312819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d956345-bfb7-4689-8037-093d5f1004fa tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda188ba700>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:14.388319 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d956345-bfb7-4689-8037-093d5f1004fa tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758" status: 200 len: 344 microversion: 2.1 time: 0.079760 Oct 11 04:38:14.393291 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2739/5734] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:38:14 2022] GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:15.286923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:15.288367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:15.304566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:15.306070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:15.307913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:15.309662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:15.310992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:15.311641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:15.411367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-80b9e5ca-5ecc-4874-8170-815326fe534e tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda188c58b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:15.562527 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-80b9e5ca-5ecc-4874-8170-815326fe534e tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758" status: 200 len: 344 microversion: 2.1 time: 0.161671 Oct 11 04:38:15.570828 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2740/5735] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:38:15 2022] GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 => generated 344 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:15.668089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:15.695785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:15.704089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:15.705289 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8a5d5479-0644-4597-a105-55cca62882e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1407 microversion: 2.20 time: 0.424035 Oct 11 04:38:15.709888 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2996/5736] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:15 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1407 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:16.353268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8e057b57-715a-4f44-b4e6-3bacdc200103 req-049fad12-f522-44ca-8882-79ce00d0b0a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55886128-3370-4868-98e0-5b2b4e574871", "tag": "e148d4ee-0d06-4384-93e1-fa7e9028b8f1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:16.380334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8e057b57-715a-4f44-b4e6-3bacdc200103 req-049fad12-f522-44ca-8882-79ce00d0b0a0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:16.380334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8e057b57-715a-4f44-b4e6-3bacdc200103 req-049fad12-f522-44ca-8882-79ce00d0b0a0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:16.380334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8e057b57-715a-4f44-b4e6-3bacdc200103 req-049fad12-f522-44ca-8882-79ce00d0b0a0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:16.406059 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8e057b57-715a-4f44-b4e6-3bacdc200103 req-049fad12-f522-44ca-8882-79ce00d0b0a0 service nova] Creating event network-changed:e148d4ee-0d06-4384-93e1-fa7e9028b8f1 for instance 55886128-3370-4868-98e0-5b2b4e574871 on n-h1-860892-1 Oct 11 04:38:16.415722 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8e057b57-715a-4f44-b4e6-3bacdc200103 req-049fad12-f522-44ca-8882-79ce00d0b0a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066160 Oct 11 04:38:16.419042 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2741/5737] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:38:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:16.577247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-51ae8403-9b79-4088-90e0-710bd5fb2738 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18cda040>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:16.677798 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-51ae8403-9b79-4088-90e0-710bd5fb2738 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758" status: 200 len: 344 microversion: 2.1 time: 0.104415 Oct 11 04:38:16.678576 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2997/5738] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:38:16 2022] GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 => generated 344 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:16.736787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:16.738569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:16.757220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:16.757738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:16.764121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:16.764943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:16.768045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:16.768572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:17.018217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8c0234ae-fe40-493c-b262-6b982b4bd08f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: .version_select at 0x7fda18cacf70>, body: {"keypair": {"name": "tempest-keypair-2137260985", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHg9RsidDWxJzvijPLy/5gUwnRLKKx2mOG1S6IZ5uEA2gfy/NVcIJLUznWBjjaYv6FFI7taQU1muaN1LBupPjY6BCsCQ7QQwsA2hYcVc/fh+rnv7BB3mSl/1lc2EAtxylg=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:17.035450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:17.045234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-8c0234ae-fe40-493c-b262-6b982b4bd08f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:38:17.056621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-8c0234ae-fe40-493c-b262-6b982b4bd08f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for user 285715b491b34b90b2a3fcf0e268be46 and project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:38:17.058092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:17.061202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:17.061202 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9df31f8a-0e94-420d-b7ae-9cc9356f4521 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1407 microversion: 2.20 time: 0.329769 Oct 11 04:38:17.075797 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2742/5739] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:16 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1407 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:17.230371 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8c0234ae-fe40-493c-b262-6b982b4bd08f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.210623 Oct 11 04:38:17.230371 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2998/5740] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:38:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:38:17.692452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1caa38b-475d-467f-90a4-a1a009abcf66 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda1883e820>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:17.724024 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f1caa38b-475d-467f-90a4-a1a009abcf66 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] HTTP exception thrown: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1caa38b-475d-467f-90a4-a1a009abcf66 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Request method failure captured: Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 HTTP/1.1 Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPMqj749P2B06OkmkrxUwLAmCGjf3siPGXCoZyqQtCnfJD6WmcYQ5doWWvVdfoy2dbNGtT7QHfMmynLUXUROrEv3s8mwyQ6mda1Zae1ryI_3TYCUGXSWEr8E8QGl-dv5AGDwrOjLVEPPwJgPR0r9c6axDGFObtpdbI-jQcKc42tsJaE Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: e9f6380d176d42c3bf467cc475846f4d Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9f6380d176d42c3bf467cc475846f4d"}]}] Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: e9f6380d176d42c3bf467cc475846f4d Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-VolumesSnapshotsTestJSON-2133963786-project Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: d25dd161c2254cd9bb3f722c9fec544c Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133963786-project Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: exception: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'ab7d98b8-98ec-4651-9856-bb66f86e2758'} Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. (HTTP 404) (Request-ID: req-a9a26dda-f6e7-4305-a586-23be983ce2c2) Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 04:38:17.730606 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1caa38b-475d-467f-90a4-a1a009abcf66 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Returning 404 to user: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f1caa38b-475d-467f-90a4-a1a009abcf66 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758" status: 404 len: 109 microversion: 2.1 time: 0.043528 Oct 11 04:38:17.734507 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2743/5741] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:38:17 2022] GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:38:17.740339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:38:17.745220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2176afb3-be81-44eb-a96b-88bb91e671b7 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda18ca6820>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:17.784540 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-2176afb3-be81-44eb-a96b-88bb91e671b7 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] HTTP exception thrown: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2176afb3-be81-44eb-a96b-88bb91e671b7 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Request method failure captured: Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 HTTP/1.1 Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPMqj749P2B06OkmkrxUwLAmCGjf3siPGXCoZyqQtCnfJD6WmcYQ5doWWvVdfoy2dbNGtT7QHfMmynLUXUROrEv3s8mwyQ6mda1Zae1ryI_3TYCUGXSWEr8E8QGl-dv5AGDwrOjLVEPPwJgPR0r9c6axDGFObtpdbI-jQcKc42tsJaE Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: e9f6380d176d42c3bf467cc475846f4d Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9f6380d176d42c3bf467cc475846f4d"}]}] Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: e9f6380d176d42c3bf467cc475846f4d Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesSnapshotsTestJSON-2133963786-project Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: d25dd161c2254cd9bb3f722c9fec544c Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133963786-project Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: method: Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: exception: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'ab7d98b8-98ec-4651-9856-bb66f86e2758'} Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. (HTTP 404) (Request-ID: req-69c1d926-be56-4174-b76f-e4a7fe1a767b) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 04:38:17.787054 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2176afb3-be81-44eb-a96b-88bb91e671b7 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Returning 404 to user: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2176afb3-be81-44eb-a96b-88bb91e671b7 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758" status: 404 len: 109 microversion: 2.1 time: 0.049884 Oct 11 04:38:17.790884 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 2999/5742] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:38:17 2022] DELETE /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 => generated 109 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:38:17.800974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-da09c08d-3363-4154-b9a9-2e66c9397884 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Calling method '.version_select at 0x7fda1883e8b0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:17.831797 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-da09c08d-3363-4154-b9a9-2e66c9397884 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] HTTP exception thrown: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-da09c08d-3363-4154-b9a9-2e66c9397884 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Request method failure captured: Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 HTTP/1.1 Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPMqj749P2B06OkmkrxUwLAmCGjf3siPGXCoZyqQtCnfJD6WmcYQ5doWWvVdfoy2dbNGtT7QHfMmynLUXUROrEv3s8mwyQ6mda1Zae1ryI_3TYCUGXSWEr8E8QGl-dv5AGDwrOjLVEPPwJgPR0r9c6axDGFObtpdbI-jQcKc42tsJaE Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: e9f6380d176d42c3bf467cc475846f4d Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9f6380d176d42c3bf467cc475846f4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9f6380d176d42c3bf467cc475846f4d"}]}] Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: e9f6380d176d42c3bf467cc475846f4d Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-2133963786 Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-VolumesSnapshotsTestJSON-2133963786-project Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: d25dd161c2254cd9bb3f722c9fec544c Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-VolumesSnapshotsTestJSON-2133963786-project Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: method: Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: exception: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'ab7d98b8-98ec-4651-9856-bb66f86e2758'} Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. (HTTP 404) (Request-ID: req-916c43b6-a1d9-452f-8635-6178057c3e8a) Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 11 04:38:17.834592 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. Oct 11 04:38:17.837577 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:38:17.841724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-da09c08d-3363-4154-b9a9-2e66c9397884 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] Returning 404 to user: Volume ab7d98b8-98ec-4651-9856-bb66f86e2758 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:38:17.842805 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-da09c08d-3363-4154-b9a9-2e66c9397884 tempest-VolumesSnapshotsTestJSON-2133963786 tempest-VolumesSnapshotsTestJSON-2133963786-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758" status: 404 len: 109 microversion: 2.1 time: 0.047230 Oct 11 04:38:17.843864 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2744/5743] 10.222.0.26 () {58 vars in 1245 bytes} [Tue Oct 11 04:38:17 2022] GET /compute/v2.1/os-volumes/ab7d98b8-98ec-4651-9856-bb66f86e2758 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:38:18.089710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:18.090494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:18.103116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:18.103679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:18.106523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:18.106523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:18.109485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:18.109966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:18.350308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:18.360139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:18.361776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:18.363251 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9cda0ce9-3c8f-4eb3-9508-69626977d4ca tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1407 microversion: 2.20 time: 0.278799 Oct 11 04:38:18.363895 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3000/5744] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:18 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:19.390860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:19.391504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:19.399357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=34,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:38:19.401558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:19.402246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:19.402855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:19.411054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:19.411054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:19.411054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:19.411772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:38:19.575357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:19.583436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:19.584876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:19.585975 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5af55d1e-973d-4ac3-ae60-d1f7e811935d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1407 microversion: 2.20 time: 0.199516 Oct 11 04:38:19.586549 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2745/5745] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:19 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1407 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:20.612493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:20.614341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:20.621812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:20.622444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:20.623084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:20.623863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:20.624578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:20.625079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:20.957901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:20.970773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:20.976033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:20.977249 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1ef5a373-8a57-43fe-b380-cff4dc56e3f3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1407 microversion: 2.20 time: 0.370452 Oct 11 04:38:20.977928 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3001/5746] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:20 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1407 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:22.008178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:22.008956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:22.018743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:22.019589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:22.020399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:22.021396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:22.022039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:22.022607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:22.162467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-820587536", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "515fe902-bb8c-47e9-944d-01e95f3d351a"}], "security_groups": [{"name": "tempest-securitygroup--186010042"}], "key_name": "tempest-keypair-2137260985", "user_data": "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:22.325825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:22.336008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:22.339411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:22.340559 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-216cd7f8-eb93-4fd1-979e-69fd7ffb8459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1407 microversion: 2.20 time: 0.336494 Oct 11 04:38:22.341323 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2746/5747] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:22 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:22.414965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] validate_networks() for [('515fe902-bb8c-47e9-944d-01e95f3d351a', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:38:23.368964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:23.370999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:23.390727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:23.394968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:23.397042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:23.398679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:23.408518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:23.418042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:23.708984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:38:23.709462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:38:23.710467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:38:23.711094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:38:23.711828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:38:23.722087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:23.722803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:23.723476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:23.724410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:23.724860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:23.725566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:23.748440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:38:23.755033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for user 285715b491b34b90b2a3fcf0e268be46 and project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:38:23.777797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:38:23.777797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:38:23.778548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:23.789903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:23.794217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:23.798296 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-53100594-c8cf-4776-b200-22c700996515 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1407 microversion: 2.20 time: 0.433774 Oct 11 04:38:23.799099 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2747/5748] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:23 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:38:23.810885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-d5991986-9427-49a1-b3aa-90513464fb92 req-fe006010-48eb-485e-8612-778894f21c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55886128-3370-4868-98e0-5b2b4e574871", "name": "network-vif-plugged", "status": "completed", "tag": "e148d4ee-0d06-4384-93e1-fa7e9028b8f1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:23.823483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d5991986-9427-49a1-b3aa-90513464fb92 req-fe006010-48eb-485e-8612-778894f21c71 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:23.824139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d5991986-9427-49a1-b3aa-90513464fb92 req-fe006010-48eb-485e-8612-778894f21c71 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:23.824717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d5991986-9427-49a1-b3aa-90513464fb92 req-fe006010-48eb-485e-8612-778894f21c71 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:23.837075 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-d5991986-9427-49a1-b3aa-90513464fb92 req-fe006010-48eb-485e-8612-778894f21c71 service nova] Creating event network-vif-plugged:e148d4ee-0d06-4384-93e1-fa7e9028b8f1 for instance 55886128-3370-4868-98e0-5b2b4e574871 on n-h1-860892-1 Oct 11 04:38:23.843725 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-d5991986-9427-49a1-b3aa-90513464fb92 req-fe006010-48eb-485e-8612-778894f21c71 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041863 Oct 11 04:38:23.844622 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2748/5749] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:23.901132 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d692989a-df94-4db5-96e4-f1678f4813e7 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.745756 Oct 11 04:38:23.901994 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3002/5750] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:38:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 1747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:38:23.919270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2820b603-cf7e-44ac-81ad-95efb9a2f2bd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:23.922313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2820b603-cf7e-44ac-81ad-95efb9a2f2bd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:24.036367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2820b603-cf7e-44ac-81ad-95efb9a2f2bd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:24.052058 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2820b603-cf7e-44ac-81ad-95efb9a2f2bd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1241 microversion: 2.1 time: 0.141918 Oct 11 04:38:24.053510 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2749/5751] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:23 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1241 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:24.827306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:24.828493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:24.836739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:24.837230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:24.838825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:24.839545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:24.840004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:24.840894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:25.063776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:25.076830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cde50c54-9af5-424f-beea-289ed1c0838d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:25.077665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:25.078538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cde50c54-9af5-424f-beea-289ed1c0838d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:25.081807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:25.089619 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d694518-7aee-44c8-8a46-70c2b56909bc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1407 microversion: 2.20 time: 0.267194 Oct 11 04:38:25.091441 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3003/5752] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:24 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1407 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:25.170064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cde50c54-9af5-424f-beea-289ed1c0838d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:25.179224 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cde50c54-9af5-424f-beea-289ed1c0838d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1241 microversion: 2.1 time: 0.107440 Oct 11 04:38:25.180892 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2750/5753] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:25 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:26.117248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:26.117865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:26.134043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:26.134923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:26.141525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:26.142328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:26.143463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:26.143902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:26.203122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c1c32066-d09f-470d-9ee0-6d3f49d28d47 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:26.204668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c1c32066-d09f-470d-9ee0-6d3f49d28d47 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:26.213482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1c32066-d09f-470d-9ee0-6d3f49d28d47 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:26.214844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1c32066-d09f-470d-9ee0-6d3f49d28d47 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:26.215479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1c32066-d09f-470d-9ee0-6d3f49d28d47 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:26.216348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1c32066-d09f-470d-9ee0-6d3f49d28d47 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:26.216964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1c32066-d09f-470d-9ee0-6d3f49d28d47 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:26.217551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c1c32066-d09f-470d-9ee0-6d3f49d28d47 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:26.380379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c1c32066-d09f-470d-9ee0-6d3f49d28d47 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:26.404579 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c1c32066-d09f-470d-9ee0-6d3f49d28d47 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1293 microversion: 2.1 time: 0.205216 Oct 11 04:38:26.420611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:26.422087 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2751/5754] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:26 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1293 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:26.437479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:26.440427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:26.441644 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a77453ac-8c83-4216-8706-fee2066ae56c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1598 microversion: 2.20 time: 0.328544 Oct 11 04:38:26.442730 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3004/5755] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:38:26 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1598 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:38:26.472028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ded8b240-7223-4f0d-a399-e62fabbbf0c5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:26.472518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ded8b240-7223-4f0d-a399-e62fabbbf0c5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:26.479971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ded8b240-7223-4f0d-a399-e62fabbbf0c5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:26.482148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ded8b240-7223-4f0d-a399-e62fabbbf0c5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:26.482148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ded8b240-7223-4f0d-a399-e62fabbbf0c5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:26.482148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ded8b240-7223-4f0d-a399-e62fabbbf0c5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:26.482148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ded8b240-7223-4f0d-a399-e62fabbbf0c5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:26.482535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ded8b240-7223-4f0d-a399-e62fabbbf0c5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:26.574616 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ded8b240-7223-4f0d-a399-e62fabbbf0c5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106881 Oct 11 04:38:26.582504 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2752/5756] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Oct 11 04:38:26 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:38:27.434055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7488a063-45d4-41c9-a2af-c9f450f42c6b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:27.434761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7488a063-45d4-41c9-a2af-c9f450f42c6b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:27.446021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7488a063-45d4-41c9-a2af-c9f450f42c6b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:27.446530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7488a063-45d4-41c9-a2af-c9f450f42c6b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:27.446981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7488a063-45d4-41c9-a2af-c9f450f42c6b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:27.448227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7488a063-45d4-41c9-a2af-c9f450f42c6b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:27.454461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7488a063-45d4-41c9-a2af-c9f450f42c6b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:27.455293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7488a063-45d4-41c9-a2af-c9f450f42c6b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:27.624701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7488a063-45d4-41c9-a2af-c9f450f42c6b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:27.640519 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7488a063-45d4-41c9-a2af-c9f450f42c6b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1311 microversion: 2.1 time: 0.211205 Oct 11 04:38:27.650946 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3005/5757] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:27 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1311 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:28.380322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8f06f993-dbec-4f6b-8f95-9ec12b376929 req-fb4bffb8-09a1-4018-b9a0-458f4ed1bf7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55886128-3370-4868-98e0-5b2b4e574871", "tag": "e148d4ee-0d06-4384-93e1-fa7e9028b8f1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:28.413447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8f06f993-dbec-4f6b-8f95-9ec12b376929 req-fb4bffb8-09a1-4018-b9a0-458f4ed1bf7e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:28.415381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8f06f993-dbec-4f6b-8f95-9ec12b376929 req-fb4bffb8-09a1-4018-b9a0-458f4ed1bf7e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:28.416115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8f06f993-dbec-4f6b-8f95-9ec12b376929 req-fb4bffb8-09a1-4018-b9a0-458f4ed1bf7e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:28.436546 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8f06f993-dbec-4f6b-8f95-9ec12b376929 req-fb4bffb8-09a1-4018-b9a0-458f4ed1bf7e service nova] Creating event network-changed:e148d4ee-0d06-4384-93e1-fa7e9028b8f1 for instance 55886128-3370-4868-98e0-5b2b4e574871 on n-h1-860892-1 Oct 11 04:38:28.448993 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8f06f993-dbec-4f6b-8f95-9ec12b376929 req-fb4bffb8-09a1-4018-b9a0-458f4ed1bf7e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081199 Oct 11 04:38:28.450269 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2753/5758] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:38:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:28.666671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9683080b-4294-4bb8-878a-9c87dde59435 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:28.667284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9683080b-4294-4bb8-878a-9c87dde59435 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:28.677054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9683080b-4294-4bb8-878a-9c87dde59435 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:28.678924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9683080b-4294-4bb8-878a-9c87dde59435 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:28.679618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9683080b-4294-4bb8-878a-9c87dde59435 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:28.680545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9683080b-4294-4bb8-878a-9c87dde59435 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:28.682039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9683080b-4294-4bb8-878a-9c87dde59435 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:28.682769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9683080b-4294-4bb8-878a-9c87dde59435 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:28.855876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9683080b-4294-4bb8-878a-9c87dde59435 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:28.864470 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9683080b-4294-4bb8-878a-9c87dde59435 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1299 microversion: 2.1 time: 0.202116 Oct 11 04:38:28.879026 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3006/5759] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:28 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1299 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:29.890828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98bde9f7-3b9f-4d6b-8e82-d745d01d4587 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:29.892175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98bde9f7-3b9f-4d6b-8e82-d745d01d4587 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:29.898997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98bde9f7-3b9f-4d6b-8e82-d745d01d4587 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:29.899767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98bde9f7-3b9f-4d6b-8e82-d745d01d4587 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:29.900907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98bde9f7-3b9f-4d6b-8e82-d745d01d4587 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:29.901941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98bde9f7-3b9f-4d6b-8e82-d745d01d4587 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:29.902580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98bde9f7-3b9f-4d6b-8e82-d745d01d4587 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:29.903152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98bde9f7-3b9f-4d6b-8e82-d745d01d4587 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:30.142590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-98bde9f7-3b9f-4d6b-8e82-d745d01d4587 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:30.157645 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98bde9f7-3b9f-4d6b-8e82-d745d01d4587 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1366 microversion: 2.1 time: 0.272140 Oct 11 04:38:30.158646 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2754/5760] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:29 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1366 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:30.571253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e800c06c-34fa-4e3f-b21e-9d7c9cc19b50 req-ee1f1276-efed-4507-ab9f-dd39a9ed92cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e0e703-4870-42a0-b605-dae37d0c5b1b", "tag": "e7276f86-4ad1-4c27-87e1-b2e0e6572be3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:30.582816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=7 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:38:30.591337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e800c06c-34fa-4e3f-b21e-9d7c9cc19b50 req-ee1f1276-efed-4507-ab9f-dd39a9ed92cc service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:30.591337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e800c06c-34fa-4e3f-b21e-9d7c9cc19b50 req-ee1f1276-efed-4507-ab9f-dd39a9ed92cc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:30.591337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e800c06c-34fa-4e3f-b21e-9d7c9cc19b50 req-ee1f1276-efed-4507-ab9f-dd39a9ed92cc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:30.603141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:38:30.605477 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e800c06c-34fa-4e3f-b21e-9d7c9cc19b50 req-ee1f1276-efed-4507-ab9f-dd39a9ed92cc service nova] Creating event network-changed:e7276f86-4ad1-4c27-87e1-b2e0e6572be3 for instance 27e0e703-4870-42a0-b605-dae37d0c5b1b on n-h2-860892-1 Oct 11 04:38:30.613889 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e800c06c-34fa-4e3f-b21e-9d7c9cc19b50 req-ee1f1276-efed-4507-ab9f-dd39a9ed92cc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048276 Oct 11 04:38:30.614800 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3007/5761] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:31.185509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fc58ab07-75a8-485b-9798-c7f4a801d6b1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:31.186355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fc58ab07-75a8-485b-9798-c7f4a801d6b1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:31.194839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc58ab07-75a8-485b-9798-c7f4a801d6b1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:31.195430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc58ab07-75a8-485b-9798-c7f4a801d6b1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:31.196093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc58ab07-75a8-485b-9798-c7f4a801d6b1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:31.196890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc58ab07-75a8-485b-9798-c7f4a801d6b1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:31.198076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc58ab07-75a8-485b-9798-c7f4a801d6b1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:31.198726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc58ab07-75a8-485b-9798-c7f4a801d6b1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:31.491020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fc58ab07-75a8-485b-9798-c7f4a801d6b1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:31.508769 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fc58ab07-75a8-485b-9798-c7f4a801d6b1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1366 microversion: 2.1 time: 0.328816 Oct 11 04:38:31.510942 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2755/5762] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:31 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1366 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:32.536689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de6507d4-a1e1-4b24-a0a0-553cb490c4bc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:32.537538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-de6507d4-a1e1-4b24-a0a0-553cb490c4bc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:32.546097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de6507d4-a1e1-4b24-a0a0-553cb490c4bc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:32.548345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de6507d4-a1e1-4b24-a0a0-553cb490c4bc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:32.548345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de6507d4-a1e1-4b24-a0a0-553cb490c4bc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:32.548345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de6507d4-a1e1-4b24-a0a0-553cb490c4bc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:32.548345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de6507d4-a1e1-4b24-a0a0-553cb490c4bc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:32.548821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de6507d4-a1e1-4b24-a0a0-553cb490c4bc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:32.695237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-de6507d4-a1e1-4b24-a0a0-553cb490c4bc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:32.703400 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-de6507d4-a1e1-4b24-a0a0-553cb490c4bc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1366 microversion: 2.1 time: 0.171969 Oct 11 04:38:32.710920 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3008/5763] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:32 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:33.726430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0567ce88-fbec-49db-8764-9b1337d91097 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:33.727669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0567ce88-fbec-49db-8764-9b1337d91097 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:33.734560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0567ce88-fbec-49db-8764-9b1337d91097 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:33.735331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0567ce88-fbec-49db-8764-9b1337d91097 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:33.736170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0567ce88-fbec-49db-8764-9b1337d91097 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:33.737097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0567ce88-fbec-49db-8764-9b1337d91097 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:33.737747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0567ce88-fbec-49db-8764-9b1337d91097 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:33.738404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0567ce88-fbec-49db-8764-9b1337d91097 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:33.743539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=66 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:38:33.901870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0567ce88-fbec-49db-8764-9b1337d91097 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:33.912149 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0567ce88-fbec-49db-8764-9b1337d91097 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1366 microversion: 2.1 time: 0.189728 Oct 11 04:38:33.915338 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2756/5764] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:33 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:34.942991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-629c5b14-52fb-4bb7-a9c5-3b10e0099b0c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:34.944531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-629c5b14-52fb-4bb7-a9c5-3b10e0099b0c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:34.955539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:38:34.956224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=16 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:38:34.958398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-629c5b14-52fb-4bb7-a9c5-3b10e0099b0c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:34.958986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-629c5b14-52fb-4bb7-a9c5-3b10e0099b0c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:34.959566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-629c5b14-52fb-4bb7-a9c5-3b10e0099b0c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:34.960478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-629c5b14-52fb-4bb7-a9c5-3b10e0099b0c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:34.961074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-629c5b14-52fb-4bb7-a9c5-3b10e0099b0c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:34.961497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-629c5b14-52fb-4bb7-a9c5-3b10e0099b0c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:35.103715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-629c5b14-52fb-4bb7-a9c5-3b10e0099b0c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:35.111296 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-629c5b14-52fb-4bb7-a9c5-3b10e0099b0c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1366 microversion: 2.1 time: 0.174532 Oct 11 04:38:35.112059 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3009/5765] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:34 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:36.139691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fa58d979-b566-45ad-a43c-696c05d1b29a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:36.141202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fa58d979-b566-45ad-a43c-696c05d1b29a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:36.160890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:38:36.167196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa58d979-b566-45ad-a43c-696c05d1b29a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:36.169788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa58d979-b566-45ad-a43c-696c05d1b29a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:36.170857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa58d979-b566-45ad-a43c-696c05d1b29a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:36.172766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa58d979-b566-45ad-a43c-696c05d1b29a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:36.174223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa58d979-b566-45ad-a43c-696c05d1b29a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:36.174890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa58d979-b566-45ad-a43c-696c05d1b29a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:36.405781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa58d979-b566-45ad-a43c-696c05d1b29a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:36.413816 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fa58d979-b566-45ad-a43c-696c05d1b29a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1366 microversion: 2.1 time: 0.283053 Oct 11 04:38:36.414431 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2757/5766] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:36 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1366 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:36.711107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6e40233c-d450-45e0-8224-9bdd760e9808 req-8044d6d1-35f5-4d1c-be8f-60c59868cf03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e0e703-4870-42a0-b605-dae37d0c5b1b", "name": "network-vif-plugged", "status": "completed", "tag": "e7276f86-4ad1-4c27-87e1-b2e0e6572be3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:36.724971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6e40233c-d450-45e0-8224-9bdd760e9808 req-8044d6d1-35f5-4d1c-be8f-60c59868cf03 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:36.725679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6e40233c-d450-45e0-8224-9bdd760e9808 req-8044d6d1-35f5-4d1c-be8f-60c59868cf03 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:36.726353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6e40233c-d450-45e0-8224-9bdd760e9808 req-8044d6d1-35f5-4d1c-be8f-60c59868cf03 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:36.739467 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6e40233c-d450-45e0-8224-9bdd760e9808 req-8044d6d1-35f5-4d1c-be8f-60c59868cf03 service nova] Creating event network-vif-plugged:e7276f86-4ad1-4c27-87e1-b2e0e6572be3 for instance 27e0e703-4870-42a0-b605-dae37d0c5b1b on n-h2-860892-1 Oct 11 04:38:36.745019 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6e40233c-d450-45e0-8224-9bdd760e9808 req-8044d6d1-35f5-4d1c-be8f-60c59868cf03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037626 Oct 11 04:38:36.745653 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3010/5767] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:38:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:37.437595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e9fd0c5-1595-4ab9-9357-54e948fa9e58 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:37.438461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8e9fd0c5-1595-4ab9-9357-54e948fa9e58 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:37.446509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e9fd0c5-1595-4ab9-9357-54e948fa9e58 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:37.448172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e9fd0c5-1595-4ab9-9357-54e948fa9e58 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:37.448624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e9fd0c5-1595-4ab9-9357-54e948fa9e58 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:37.449370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e9fd0c5-1595-4ab9-9357-54e948fa9e58 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:37.449824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e9fd0c5-1595-4ab9-9357-54e948fa9e58 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:37.450285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e9fd0c5-1595-4ab9-9357-54e948fa9e58 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:37.668584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8e9fd0c5-1595-4ab9-9357-54e948fa9e58 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:37.677684 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8e9fd0c5-1595-4ab9-9357-54e948fa9e58 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1366 microversion: 2.1 time: 0.244064 Oct 11 04:38:37.679729 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2758/5768] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:37 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:38.708819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f38528f8-9313-4981-8dfb-b1982bcf5865 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:38.710076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f38528f8-9313-4981-8dfb-b1982bcf5865 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:38.734022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f38528f8-9313-4981-8dfb-b1982bcf5865 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:38.734570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f38528f8-9313-4981-8dfb-b1982bcf5865 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:38.735008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f38528f8-9313-4981-8dfb-b1982bcf5865 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:38.735715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f38528f8-9313-4981-8dfb-b1982bcf5865 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:38.737550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f38528f8-9313-4981-8dfb-b1982bcf5865 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:38.738159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f38528f8-9313-4981-8dfb-b1982bcf5865 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:38.989173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f38528f8-9313-4981-8dfb-b1982bcf5865 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:38:39.000121 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f38528f8-9313-4981-8dfb-b1982bcf5865 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1556 microversion: 2.1 time: 0.296911 Oct 11 04:38:39.001228 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3011/5769] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:38:38 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1556 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:38:39.026543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3e12003-8420-429f-a1d8-fd328197121a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:38:39.028128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d3e12003-8420-429f-a1d8-fd328197121a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:38:39.035909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e12003-8420-429f-a1d8-fd328197121a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:39.036969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e12003-8420-429f-a1d8-fd328197121a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:39.037756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e12003-8420-429f-a1d8-fd328197121a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:39.038702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e12003-8420-429f-a1d8-fd328197121a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:39.039353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e12003-8420-429f-a1d8-fd328197121a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:39.039958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e12003-8420-429f-a1d8-fd328197121a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:39.164386 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d3e12003-8420-429f-a1d8-fd328197121a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143543 Oct 11 04:38:39.165171 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2759/5770] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:38:39 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:38:41.204850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-06b8e711-ce00-464a-8e64-8e67a9be0fd9 req-bbeefec2-a372-4e50-b21e-11562ebd8d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27e0e703-4870-42a0-b605-dae37d0c5b1b", "tag": "e7276f86-4ad1-4c27-87e1-b2e0e6572be3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:38:41.233543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-06b8e711-ce00-464a-8e64-8e67a9be0fd9 req-bbeefec2-a372-4e50-b21e-11562ebd8d19 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:38:41.234295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-06b8e711-ce00-464a-8e64-8e67a9be0fd9 req-bbeefec2-a372-4e50-b21e-11562ebd8d19 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:38:41.235036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-06b8e711-ce00-464a-8e64-8e67a9be0fd9 req-bbeefec2-a372-4e50-b21e-11562ebd8d19 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:38:41.273952 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-06b8e711-ce00-464a-8e64-8e67a9be0fd9 req-bbeefec2-a372-4e50-b21e-11562ebd8d19 service nova] Creating event network-changed:e7276f86-4ad1-4c27-87e1-b2e0e6572be3 for instance 27e0e703-4870-42a0-b605-dae37d0c5b1b on n-h2-860892-1 Oct 11 04:38:41.284041 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-06b8e711-ce00-464a-8e64-8e67a9be0fd9 req-bbeefec2-a372-4e50-b21e-11562ebd8d19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084227 Oct 11 04:38:41.285398 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3012/5771] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:38:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:14.948885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=33 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:14.949637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=21 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:14.950721 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 11 04:39:14.955000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d9660ead-fa0a-47a3-aa54-0a69cb75e729 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:14.955522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d9660ead-fa0a-47a3-aa54-0a69cb75e729 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:14.963460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9660ead-fa0a-47a3-aa54-0a69cb75e729 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:14.963938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9660ead-fa0a-47a3-aa54-0a69cb75e729 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:14.969616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9660ead-fa0a-47a3-aa54-0a69cb75e729 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:14.969616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9660ead-fa0a-47a3-aa54-0a69cb75e729 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:14.969616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9660ead-fa0a-47a3-aa54-0a69cb75e729 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:14.969616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9660ead-fa0a-47a3-aa54-0a69cb75e729 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:14.991993 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d9660ead-fa0a-47a3-aa54-0a69cb75e729 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b/ips" status: 200 len: 150 microversion: 2.1 time: 0.045092 Oct 11 04:39:14.992670 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2760/5772] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:39:14 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:15.004352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=11 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:15.005075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=23 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:15.009989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe862dc8-bf20-4f11-afb3-ab00da96b6a9"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:15.012407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:15.019592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:15.020075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:15.020513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:15.021200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:15.021648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:15.022075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:15.106133 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Invalid volume: volume fe862dc8-bf20-4f11-afb3-ab00da96b6a9 is already attached to instances: e63dbf99-f394-4f8c-b8cd-4c44979d03d3 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b/os-volume_attachments HTTP/1.1 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 74 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: {"volumeAttachment": {"volumeId": "fe862dc8-bf20-4f11-afb3-ab00da96b6a9"}} Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid volume: volume fe862dc8-bf20-4f11-afb3-ab00da96b6a9 is already attached to instances: e63dbf99-f394-4f8c-b8cd-4c44979d03d3 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'server_id': '27e0e703-4870-42a0-b605-dae37d0c5b1b', 'body': {'volumeAttachment': {'volumeId': 'fe862dc8-bf20-4f11-afb3-ab00da96b6a9'}}} Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fe862dc8-bf20-4f11-afb3-ab00da96b6a9 is already attached to instances: e63dbf99-f394-4f8c-b8cd-4c44979d03d3 Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:39:15.107922 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fe862dc8-bf20-4f11-afb3-ab00da96b6a9 is already attached to instances: e63dbf99-f394-4f8c-b8cd-4c44979d03d3 Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fe862dc8-bf20-4f11-afb3-ab00da96b6a9 is already attached to instances: e63dbf99-f394-4f8c-b8cd-4c44979d03d3 Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 400 to user: Invalid volume: volume fe862dc8-bf20-4f11-afb3-ab00da96b6a9 is already attached to instances: e63dbf99-f394-4f8c-b8cd-4c44979d03d3 {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-503a887c-894b-424e-962b-e06f11be2c5a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.107190 Oct 11 04:39:15.111941 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3013/5773] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:39:15 2022] POST /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b/os-volume_attachments => generated 174 bytes in 108 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:39:15.120672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cc2b602a-512a-4545-90de-8e979dfa2520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:15.121366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cc2b602a-512a-4545-90de-8e979dfa2520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:15.128547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc2b602a-512a-4545-90de-8e979dfa2520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:15.129254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc2b602a-512a-4545-90de-8e979dfa2520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:15.129838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc2b602a-512a-4545-90de-8e979dfa2520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:15.130767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc2b602a-512a-4545-90de-8e979dfa2520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:15.131360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc2b602a-512a-4545-90de-8e979dfa2520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:15.131924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc2b602a-512a-4545-90de-8e979dfa2520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:15.160898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cc2b602a-512a-4545-90de-8e979dfa2520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:39:15.633611 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cc2b602a-512a-4545-90de-8e979dfa2520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 204 len: 0 microversion: 2.1 time: 0.518939 Oct 11 04:39:15.634548 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2761/5774] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:39:15 2022] DELETE /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:39:15.643020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44fd3a1b-f0f0-48d0-bdfc-2c2658f81bb1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:15.643662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44fd3a1b-f0f0-48d0-bdfc-2c2658f81bb1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:15.670983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fd3a1b-f0f0-48d0-bdfc-2c2658f81bb1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:15.671483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fd3a1b-f0f0-48d0-bdfc-2c2658f81bb1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:15.672358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fd3a1b-f0f0-48d0-bdfc-2c2658f81bb1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:15.672628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fd3a1b-f0f0-48d0-bdfc-2c2658f81bb1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:15.673084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fd3a1b-f0f0-48d0-bdfc-2c2658f81bb1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:15.673518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fd3a1b-f0f0-48d0-bdfc-2c2658f81bb1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:15.826484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44fd3a1b-f0f0-48d0-bdfc-2c2658f81bb1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:15.840555 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44fd3a1b-f0f0-48d0-bdfc-2c2658f81bb1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1681 microversion: 2.1 time: 0.201002 Oct 11 04:39:15.846328 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3014/5775] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:15 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:16.868437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c4c6703f-43e0-4429-ab7d-d8ffcfb507cd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:16.869859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c4c6703f-43e0-4429-ab7d-d8ffcfb507cd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:16.878108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4c6703f-43e0-4429-ab7d-d8ffcfb507cd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:16.878791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4c6703f-43e0-4429-ab7d-d8ffcfb507cd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:16.879618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4c6703f-43e0-4429-ab7d-d8ffcfb507cd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:16.880525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4c6703f-43e0-4429-ab7d-d8ffcfb507cd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:16.881204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4c6703f-43e0-4429-ab7d-d8ffcfb507cd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:16.881632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4c6703f-43e0-4429-ab7d-d8ffcfb507cd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:17.157990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c4c6703f-43e0-4429-ab7d-d8ffcfb507cd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:17.167983 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c4c6703f-43e0-4429-ab7d-d8ffcfb507cd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1681 microversion: 2.1 time: 0.305963 Oct 11 04:39:17.167983 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2762/5776] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:16 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1681 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:18.194160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ad34dfbf-8a74-4849-8f03-99aca6fed524 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:18.195370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ad34dfbf-8a74-4849-8f03-99aca6fed524 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:18.203900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad34dfbf-8a74-4849-8f03-99aca6fed524 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:18.208970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad34dfbf-8a74-4849-8f03-99aca6fed524 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:18.208970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad34dfbf-8a74-4849-8f03-99aca6fed524 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:18.208970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad34dfbf-8a74-4849-8f03-99aca6fed524 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:18.208970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad34dfbf-8a74-4849-8f03-99aca6fed524 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:18.208970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad34dfbf-8a74-4849-8f03-99aca6fed524 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:18.307995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ad34dfbf-8a74-4849-8f03-99aca6fed524 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:18.318497 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ad34dfbf-8a74-4849-8f03-99aca6fed524 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1614 microversion: 2.1 time: 0.129449 Oct 11 04:39:18.319138 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3015/5777] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:18 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1614 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:18.330364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-d056a12d-60d6-4573-ab74-61c71d019644 req-e93956d6-2974-4645-8d9c-a2ceb7978d0b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27e0e703-4870-42a0-b605-dae37d0c5b1b", "name": "network-vif-deleted", "tag": "e7276f86-4ad1-4c27-87e1-b2e0e6572be3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:18.350655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d056a12d-60d6-4573-ab74-61c71d019644 req-e93956d6-2974-4645-8d9c-a2ceb7978d0b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:18.351385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d056a12d-60d6-4573-ab74-61c71d019644 req-e93956d6-2974-4645-8d9c-a2ceb7978d0b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:18.352640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d056a12d-60d6-4573-ab74-61c71d019644 req-e93956d6-2974-4645-8d9c-a2ceb7978d0b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:18.379291 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-d056a12d-60d6-4573-ab74-61c71d019644 req-e93956d6-2974-4645-8d9c-a2ceb7978d0b service nova] Creating event network-vif-deleted:e7276f86-4ad1-4c27-87e1-b2e0e6572be3 for instance 27e0e703-4870-42a0-b605-dae37d0c5b1b on n-h2-860892-1 Oct 11 04:39:18.387900 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-d056a12d-60d6-4573-ab74-61c71d019644 req-e93956d6-2974-4645-8d9c-a2ceb7978d0b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065046 Oct 11 04:39:18.390277 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2763/5778] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:19.341016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:19.342274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:19.350167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:19.358759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:19.359220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:19.359975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:19.360607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:19.361557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:19.418830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:19.419528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:19.420446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:19.421051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lazy-loading 'fault' on Instance uuid 27e0e703-4870-42a0-b605-dae37d0c5b1b {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:39:19.468308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:19.486101 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c08d7c7a-1f1a-4ebe-9ccc-a67ca25b9ef8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 200 len: 1331 microversion: 2.1 time: 0.143758 Oct 11 04:39:19.486101 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3016/5779] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:19 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 1331 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:20.516630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:20.516630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:20.532686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:20.544662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:20.546213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:20.546213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:20.546550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:20.546870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:20.562808 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b HTTP/1.1 Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '27e0e703-4870-42a0-b605-dae37d0c5b1b'} Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:39:20.564571 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:39:20.574126 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:39:20.574126 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:39:20.574126 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:39:20.574126 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:39:20.574126 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:39:20.574126 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:39:20.574126 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:39:20.574126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:39:20.574126 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-16e19271-e328-4d03-96de-f4beef5dc561 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 404 len: 111 microversion: 2.1 time: 0.062000 Oct 11 04:39:20.574126 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2764/5780] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:20 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:39:20.580624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-71df2ced-405c-4098-8627-9e4615afaa57 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '.version_select at 0x7fda18cd9c10>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:20.703327 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-71df2ced-405c-4098-8627-9e4615afaa57 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137260985" status: 202 len: 0 microversion: 2.1 time: 0.131437 Oct 11 04:39:20.703922 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3017/5781] 10.222.0.26 () {58 vars in 1221 bytes} [Tue Oct 11 04:39:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137260985 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:39:21.890431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7f050e3a-a1ed-4134-af94-d3cb6147ffbe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:21.891474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7f050e3a-a1ed-4134-af94-d3cb6147ffbe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:21.900967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f050e3a-a1ed-4134-af94-d3cb6147ffbe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:21.901688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f050e3a-a1ed-4134-af94-d3cb6147ffbe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:21.904152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f050e3a-a1ed-4134-af94-d3cb6147ffbe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:21.904975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f050e3a-a1ed-4134-af94-d3cb6147ffbe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:21.905437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f050e3a-a1ed-4134-af94-d3cb6147ffbe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:21.905867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f050e3a-a1ed-4134-af94-d3cb6147ffbe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:22.010057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-7f050e3a-a1ed-4134-af94-d3cb6147ffbe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lazy-loading 'services' on Instance uuid e63dbf99-f394-4f8c-b8cd-4c44979d03d3 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:39:22.327404 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7f050e3a-a1ed-4134-af94-d3cb6147ffbe tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments/fe862dc8-bf20-4f11-afb3-ab00da96b6a9" status: 202 len: 0 microversion: 2.1 time: 0.440764 Oct 11 04:39:22.330139 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2765/5782] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:39:21 2022] DELETE /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments/fe862dc8-bf20-4f11-afb3-ab00da96b6a9 => generated 0 bytes in 442 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:39:22.337691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6ff5dd4-77e7-419d-8304-bf8bdcf71597 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:22.339966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6ff5dd4-77e7-419d-8304-bf8bdcf71597 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:22.347509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ff5dd4-77e7-419d-8304-bf8bdcf71597 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:22.347990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ff5dd4-77e7-419d-8304-bf8bdcf71597 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:22.348424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ff5dd4-77e7-419d-8304-bf8bdcf71597 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:22.349116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ff5dd4-77e7-419d-8304-bf8bdcf71597 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:22.349561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ff5dd4-77e7-419d-8304-bf8bdcf71597 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:22.349985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ff5dd4-77e7-419d-8304-bf8bdcf71597 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:22.386049 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6ff5dd4-77e7-419d-8304-bf8bdcf71597 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053002 Oct 11 04:39:22.389910 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3018/5783] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:39:22 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:23.402054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-423fd426-ef43-42fc-a499-f96ef82877b8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:23.404440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-423fd426-ef43-42fc-a499-f96ef82877b8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:23.412145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-423fd426-ef43-42fc-a499-f96ef82877b8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:23.412863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-423fd426-ef43-42fc-a499-f96ef82877b8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:23.413735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-423fd426-ef43-42fc-a499-f96ef82877b8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:23.415124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-423fd426-ef43-42fc-a499-f96ef82877b8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:23.415783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-423fd426-ef43-42fc-a499-f96ef82877b8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:23.416413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-423fd426-ef43-42fc-a499-f96ef82877b8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:23.452378 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-423fd426-ef43-42fc-a499-f96ef82877b8 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057232 Oct 11 04:39:23.459096 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2766/5784] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:39:23 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:24.473267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d448316-14a2-45fa-9392-316bdab55eac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:24.475498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d448316-14a2-45fa-9392-316bdab55eac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:24.488858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d448316-14a2-45fa-9392-316bdab55eac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:24.489549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d448316-14a2-45fa-9392-316bdab55eac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:24.495434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d448316-14a2-45fa-9392-316bdab55eac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:24.495434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d448316-14a2-45fa-9392-316bdab55eac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:24.495434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d448316-14a2-45fa-9392-316bdab55eac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:24.495434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d448316-14a2-45fa-9392-316bdab55eac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:24.550686 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d448316-14a2-45fa-9392-316bdab55eac tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081729 Oct 11 04:39:24.552086 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3019/5785] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:39:24 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:25.564230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c00ff3cd-bd85-4e6c-9959-64d4e859c990 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:25.566686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c00ff3cd-bd85-4e6c-9959-64d4e859c990 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:25.577307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00ff3cd-bd85-4e6c-9959-64d4e859c990 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:25.578120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00ff3cd-bd85-4e6c-9959-64d4e859c990 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:25.579596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00ff3cd-bd85-4e6c-9959-64d4e859c990 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:25.580771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00ff3cd-bd85-4e6c-9959-64d4e859c990 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:25.581405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00ff3cd-bd85-4e6c-9959-64d4e859c990 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:25.583535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00ff3cd-bd85-4e6c-9959-64d4e859c990 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:25.634446 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c00ff3cd-bd85-4e6c-9959-64d4e859c990 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074902 Oct 11 04:39:25.639503 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2767/5786] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:39:25 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:26.647223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9c76848a-7b9f-4efa-84fc-f18ec3ee3943 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:26.650503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9c76848a-7b9f-4efa-84fc-f18ec3ee3943 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:26.659165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c76848a-7b9f-4efa-84fc-f18ec3ee3943 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:26.668200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c76848a-7b9f-4efa-84fc-f18ec3ee3943 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:26.668200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c76848a-7b9f-4efa-84fc-f18ec3ee3943 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:26.668200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c76848a-7b9f-4efa-84fc-f18ec3ee3943 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:26.668200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c76848a-7b9f-4efa-84fc-f18ec3ee3943 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:26.668200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c76848a-7b9f-4efa-84fc-f18ec3ee3943 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:26.702660 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9c76848a-7b9f-4efa-84fc-f18ec3ee3943 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059603 Oct 11 04:39:26.703175 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3020/5787] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:39:26 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:27.716151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f69b4bb2-dce0-4710-b4a8-db6a0595b772 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:27.719024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f69b4bb2-dce0-4710-b4a8-db6a0595b772 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:27.727606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69b4bb2-dce0-4710-b4a8-db6a0595b772 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:27.728306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69b4bb2-dce0-4710-b4a8-db6a0595b772 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:27.730324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69b4bb2-dce0-4710-b4a8-db6a0595b772 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:27.730324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69b4bb2-dce0-4710-b4a8-db6a0595b772 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:27.730324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69b4bb2-dce0-4710-b4a8-db6a0595b772 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:27.730947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f69b4bb2-dce0-4710-b4a8-db6a0595b772 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:27.786653 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f69b4bb2-dce0-4710-b4a8-db6a0595b772 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074579 Oct 11 04:39:27.787261 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2768/5788] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:39:27 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments => generated 197 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:28.815351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fe99fc1e-e4d6-4446-ab97-8432c0f61bbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:28.819881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fe99fc1e-e4d6-4446-ab97-8432c0f61bbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:28.826469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe99fc1e-e4d6-4446-ab97-8432c0f61bbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:28.826917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe99fc1e-e4d6-4446-ab97-8432c0f61bbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:28.827331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe99fc1e-e4d6-4446-ab97-8432c0f61bbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:28.828033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe99fc1e-e4d6-4446-ab97-8432c0f61bbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:28.828486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe99fc1e-e4d6-4446-ab97-8432c0f61bbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:28.828906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe99fc1e-e4d6-4446-ab97-8432c0f61bbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:28.883875 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fe99fc1e-e4d6-4446-ab97-8432c0f61bbf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.086495 Oct 11 04:39:28.884854 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3021/5789] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:39:28 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3/os-volume_attachments => generated 25 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:39:28.973147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5fbfe5af-42d0-4ea8-9c8b-b76758d07a61 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:28.976872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5fbfe5af-42d0-4ea8-9c8b-b76758d07a61 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:28.985515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fbfe5af-42d0-4ea8-9c8b-b76758d07a61 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:28.986009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fbfe5af-42d0-4ea8-9c8b-b76758d07a61 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:28.986487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fbfe5af-42d0-4ea8-9c8b-b76758d07a61 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:28.988883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fbfe5af-42d0-4ea8-9c8b-b76758d07a61 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:28.989360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fbfe5af-42d0-4ea8-9c8b-b76758d07a61 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:28.989800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fbfe5af-42d0-4ea8-9c8b-b76758d07a61 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:29.026912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5fbfe5af-42d0-4ea8-9c8b-b76758d07a61 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:39:29.530974 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5fbfe5af-42d0-4ea8-9c8b-b76758d07a61 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 204 len: 0 microversion: 2.1 time: 0.562008 Oct 11 04:39:29.532212 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2769/5790] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:39:28 2022] DELETE /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:39:29.546890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a8927bd4-a11c-4e58-8e29-528ac81ce171 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:29.547657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a8927bd4-a11c-4e58-8e29-528ac81ce171 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:29.565857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8927bd4-a11c-4e58-8e29-528ac81ce171 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:29.566664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8927bd4-a11c-4e58-8e29-528ac81ce171 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:29.567267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8927bd4-a11c-4e58-8e29-528ac81ce171 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:29.572497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8927bd4-a11c-4e58-8e29-528ac81ce171 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:29.572980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8927bd4-a11c-4e58-8e29-528ac81ce171 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:29.573437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8927bd4-a11c-4e58-8e29-528ac81ce171 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:29.743801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8927bd4-a11c-4e58-8e29-528ac81ce171 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:29.754516 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a8927bd4-a11c-4e58-8e29-528ac81ce171 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1682 microversion: 2.1 time: 0.218156 Oct 11 04:39:29.755183 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3022/5791] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:29 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1682 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:30.786356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dc22466d-7f91-4fb3-894f-73003f822924 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:30.786356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dc22466d-7f91-4fb3-894f-73003f822924 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:30.797768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc22466d-7f91-4fb3-894f-73003f822924 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:30.799087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc22466d-7f91-4fb3-894f-73003f822924 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:30.799742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc22466d-7f91-4fb3-894f-73003f822924 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:30.800459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc22466d-7f91-4fb3-894f-73003f822924 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:30.800909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc22466d-7f91-4fb3-894f-73003f822924 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:30.801330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc22466d-7f91-4fb3-894f-73003f822924 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:30.943567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc22466d-7f91-4fb3-894f-73003f822924 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:30.952599 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dc22466d-7f91-4fb3-894f-73003f822924 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1682 microversion: 2.1 time: 0.176577 Oct 11 04:39:30.966596 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2770/5792] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:30 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1682 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:31.848336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f293ef1c-15dc-4183-bb7b-c9b9123a9c26 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:31.849576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f293ef1c-15dc-4183-bb7b-c9b9123a9c26 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:31.856798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f293ef1c-15dc-4183-bb7b-c9b9123a9c26 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:31.857544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f293ef1c-15dc-4183-bb7b-c9b9123a9c26 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:31.858046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f293ef1c-15dc-4183-bb7b-c9b9123a9c26 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:31.858861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f293ef1c-15dc-4183-bb7b-c9b9123a9c26 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:31.859351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f293ef1c-15dc-4183-bb7b-c9b9123a9c26 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:31.859776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f293ef1c-15dc-4183-bb7b-c9b9123a9c26 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:31.885014 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f293ef1c-15dc-4183-bb7b-c9b9123a9c26 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/ips" status: 200 len: 151 microversion: 2.20 time: 0.040515 Oct 11 04:39:31.885520 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3023/5793] 10.222.0.26 () {60 vars in 1289 bytes} [Tue Oct 11 04:39:31 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:39:31.976868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bb17be1-d8cb-4704-9739-1a7977eed603 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:31.977476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0bb17be1-d8cb-4704-9739-1a7977eed603 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:31.984218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb17be1-d8cb-4704-9739-1a7977eed603 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:31.984695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb17be1-d8cb-4704-9739-1a7977eed603 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:31.985125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb17be1-d8cb-4704-9739-1a7977eed603 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:31.985809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb17be1-d8cb-4704-9739-1a7977eed603 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:31.986294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb17be1-d8cb-4704-9739-1a7977eed603 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:31.986801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb17be1-d8cb-4704-9739-1a7977eed603 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:32.079611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0bb17be1-d8cb-4704-9739-1a7977eed603 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:32.087829 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0bb17be1-d8cb-4704-9739-1a7977eed603 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1614 microversion: 2.1 time: 0.114779 Oct 11 04:39:32.088721 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2771/5794] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:31 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1614 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:32.463452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7c567d72-5d81-44a6-bb00-b7f49a2683e3 req-685ec350-bc93-4d28-a289-68ed2926fa01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63dbf99-f394-4f8c-b8cd-4c44979d03d3", "name": "network-vif-deleted", "tag": "71156c1e-b551-4900-b358-8217224ddbb0"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:32.486113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7c567d72-5d81-44a6-bb00-b7f49a2683e3 req-685ec350-bc93-4d28-a289-68ed2926fa01 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:32.487331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7c567d72-5d81-44a6-bb00-b7f49a2683e3 req-685ec350-bc93-4d28-a289-68ed2926fa01 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:32.488336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7c567d72-5d81-44a6-bb00-b7f49a2683e3 req-685ec350-bc93-4d28-a289-68ed2926fa01 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:32.501553 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7c567d72-5d81-44a6-bb00-b7f49a2683e3 req-685ec350-bc93-4d28-a289-68ed2926fa01 service nova] Creating event network-vif-deleted:71156c1e-b551-4900-b358-8217224ddbb0 for instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 on n-h2-860892-1 Oct 11 04:39:32.510023 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7c567d72-5d81-44a6-bb00-b7f49a2683e3 req-685ec350-bc93-4d28-a289-68ed2926fa01 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053168 Oct 11 04:39:32.512461 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3024/5795] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:33.119724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:33.121303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:33.134569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:33.148989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:33.155237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:33.161329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:33.162075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:33.162704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:33.224959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:33.225521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:33.225879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:33.226735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lazy-loading 'fault' on Instance uuid e63dbf99-f394-4f8c-b8cd-4c44979d03d3 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:39:33.289734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:33.307324 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5338ac94-fe98-4683-8f88-8a256bd3d054 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 200 len: 1330 microversion: 2.1 time: 0.191472 Oct 11 04:39:33.322223 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2772/5796] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:33 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 1330 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:34.344751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:34.346490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:34.359515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:34.361580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:34.362577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:34.364510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:34.368752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:34.369232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:34.400736 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 HTTP/1.1 Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e63dbf99-f394-4f8c-b8cd-4c44979d03d3'} Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:39:34.402916 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:39:34.407005 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:39:34.407005 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:39:34.407005 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:39:34.407005 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:39:34.407005 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:39:34.407005 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:39:34.407005 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:39:34.412241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:39:34.412241 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-532e95ed-75db-498e-bb05-598073372e4b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 404 len: 111 microversion: 2.1 time: 0.077257 Oct 11 04:39:34.412241 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3025/5797] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:34 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:39:34.419535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a313949-ac1c-421a-8271-b6e9a901258a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '.version_select at 0x7fda187eb4c0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:34.666221 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9a313949-ac1c-421a-8271-b6e9a901258a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-605384260" status: 202 len: 0 microversion: 2.1 time: 0.247888 Oct 11 04:39:34.675271 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2773/5798] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:39:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-605384260 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:39:35.727863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0cde19d8-bc53-493a-a3a6-6cc3c643045c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:35.728932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0cde19d8-bc53-493a-a3a6-6cc3c643045c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:35.738662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cde19d8-bc53-493a-a3a6-6cc3c643045c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:35.739150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cde19d8-bc53-493a-a3a6-6cc3c643045c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:35.739591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cde19d8-bc53-493a-a3a6-6cc3c643045c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:35.740294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cde19d8-bc53-493a-a3a6-6cc3c643045c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:35.740774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cde19d8-bc53-493a-a3a6-6cc3c643045c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:35.741261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0cde19d8-bc53-493a-a3a6-6cc3c643045c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:35.772298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-0cde19d8-bc53-493a-a3a6-6cc3c643045c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lazy-loading 'flavor' on Instance uuid 55886128-3370-4868-98e0-5b2b4e574871 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:39:35.945724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a80813a1-5752-4bd1-bdcd-028eace97a7c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: .version_select at 0x7fda187a5280>, body: {"keypair": {"name": "tempest-keypair-664527614", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIKsKv0Mjr6IK9vzlM+cJviYjdltrLh1sQ6N8yPiEfyxWa7XAvXs3zMcC3ZCA6fJUJ0DN5tnLQg3F1L5sJ2+cpmz8gz+tSDzVeMOd++FPx3I1LbKfyBj7UyjG5xNSepwzA=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:35.968321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a80813a1-5752-4bd1-bdcd-028eace97a7c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:39:35.974763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a80813a1-5752-4bd1-bdcd-028eace97a7c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for user 285715b491b34b90b2a3fcf0e268be46 and project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:39:36.078041 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a80813a1-5752-4bd1-bdcd-028eace97a7c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.143470 Oct 11 04:39:36.078737 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2774/5799] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:39:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:36.404722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-08ef96c2-9b64-4a49-82e4-030bb04eb965 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:36.405298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-08ef96c2-9b64-4a49-82e4-030bb04eb965 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:36.419994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08ef96c2-9b64-4a49-82e4-030bb04eb965 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:36.420500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08ef96c2-9b64-4a49-82e4-030bb04eb965 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:36.420945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08ef96c2-9b64-4a49-82e4-030bb04eb965 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:36.421665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08ef96c2-9b64-4a49-82e4-030bb04eb965 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:36.422300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08ef96c2-9b64-4a49-82e4-030bb04eb965 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:36.422789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08ef96c2-9b64-4a49-82e4-030bb04eb965 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:36.455473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-08ef96c2-9b64-4a49-82e4-030bb04eb965 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:39:36.462701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:36.524727 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0cde19d8-bc53-493a-a3a6-6cc3c643045c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "POST /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/action" status: 202 len: 0 microversion: 2.20 time: 0.801354 Oct 11 04:39:36.525331 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3026/5800] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:39:35 2022] POST /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:39:36.534135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:36.534944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:36.542284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:36.542978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:36.543410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:36.544104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:36.544548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:36.545074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:36.722103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:36.730564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:36.732725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:36.733982 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9fd07c8c-598b-4d01-983a-8f9ceabf03b4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1723 microversion: 2.20 time: 0.204365 Oct 11 04:39:36.734665 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3027/5801] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:36 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1723 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:39:36.937711 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-08ef96c2-9b64-4a49-82e4-030bb04eb965 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 204 len: 0 microversion: 2.42 time: 0.857461 Oct 11 04:39:36.938864 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2775/5802] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:39:36 2022] DELETE /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 0 bytes in 859 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:39:36.947348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:36.948962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:36.959925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:36.960568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:36.961375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:36.962598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:36.963272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:36.963918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:37.221190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:37.234869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:37.236348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:37.237599 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-398ecfc0-1c56-4bd6-b247-75d92181d3d0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 2957 microversion: 2.42 time: 0.294236 Oct 11 04:39:37.238163 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3028/5803] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:36 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 2957 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:37.760964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:37.762352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:37.774553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:37.775272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:37.777838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:37.788350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:37.790148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:37.794573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:37.954181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:37.978229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:37.981499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:37.984583 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6aed5166-c02f-4471-89b3-0d8ac8c67e48 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1723 microversion: 2.20 time: 0.227710 Oct 11 04:39:37.985573 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2776/5804] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:37 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:38.267585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:38.268810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:38.280718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:38.281384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:38.292190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:38.292190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:38.292190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:38.292190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:38.609350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:38.612841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:38.619024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:38.620474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:38.621898 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-684aa571-92d1-4695-aebe-8173d3ed9df0 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 2957 microversion: 2.42 time: 0.359133 Oct 11 04:39:38.634789 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3029/5805] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:38 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 2957 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:39.013218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:39.014416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:39.021940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:39.022351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:39.024395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:39.026092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:39.027294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:39.028828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:39.240909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:39.243588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:39.245241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:39.246662 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d7e1cdf-8e11-4d5e-91c0-61cb09642dd7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1723 microversion: 2.20 time: 0.237551 Oct 11 04:39:39.247406 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2777/5806] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:39 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1723 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:39.653736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:39.654453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:39.666025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:39.667955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:39.668455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:39.672283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:39.672999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:39.673503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:40.003810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:40.018487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:40.021285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:40.024215 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-640fb51d-df70-4f41-8865-9c069479bf3f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 2957 microversion: 2.42 time: 0.377212 Oct 11 04:39:40.025409 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3030/5807] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:39 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 2957 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:40.276161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:40.280289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:40.287949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:40.289309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:40.289916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:40.290806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:40.291423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:40.297451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:40.547068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:40.557341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:40.558929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:40.560221 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-53345418-17d9-4bc7-93c1-f6f2b8457948 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1723 microversion: 2.20 time: 0.288385 Oct 11 04:39:40.561383 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2778/5808] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:40 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:40.634562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-116850053", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "515fe902-bb8c-47e9-944d-01e95f3d351a"}], "security_groups": [{"name": "tempest-securitygroup--1224701408"}], "key_name": "tempest-keypair-664527614", "user_data": "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:40.905341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] validate_networks() for [('515fe902-bb8c-47e9-944d-01e95f3d351a', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:39:41.063298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:41.064747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:41.071843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:41.074327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:41.074327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:41.074327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:41.074327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:41.075161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:41.696508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:41.713754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:41.715302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:41.717384 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cb051f47-89a7-4a0f-b923-a48e6110ed4e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 2936 microversion: 2.42 time: 0.660061 Oct 11 04:39:41.734219 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2779/5809] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:41 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 2936 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:39:41.734219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:41.734219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:41.738037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:41.738901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:41.739577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:41.740713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:41.742719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:41.743431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:42.018579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:42.059981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:42.059981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:42.059981 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-503ef315-ce99-45ad-8e56-91000132ab5a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1723 microversion: 2.20 time: 0.338341 Oct 11 04:39:42.061184 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2780/5810] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:41 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1723 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:42.142663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:39:42.143261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:39:42.143777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:39:42.144196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:39:42.144688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:39:42.168124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:42.168719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:42.169230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:42.170022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:42.170661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:42.171206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:42.195450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:39:42.201106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for user 285715b491b34b90b2a3fcf0e268be46 and project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:39:42.215336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:39:42.218505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:39:42.408244 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-20b3a1e2-6aa5-4b7c-a781-ad3302cf3f37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.778938 Oct 11 04:39:42.409096 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3031/5811] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:39:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1780 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:39:42.422612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-61c64f40-e5dc-480f-8b0e-50182f77b815 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:42.428723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-61c64f40-e5dc-480f-8b0e-50182f77b815 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:42.543661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-61c64f40-e5dc-480f-8b0e-50182f77b815 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:42.566457 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-61c64f40-e5dc-480f-8b0e-50182f77b815 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1240 microversion: 2.1 time: 0.147852 Oct 11 04:39:42.571945 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2781/5812] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:42 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1240 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:42.750879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:42.751549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:42.760957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:42.770944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:42.771769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:42.772898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:42.773623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:42.774469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:43.066669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:43.086544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:43.087614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:43.093239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:43.096282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:43.098115 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb13973f-b0dd-4e74-bdcb-87c6c65c12ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 2868 microversion: 2.42 time: 0.353047 Oct 11 04:39:43.099365 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3032/5813] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:42 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 2868 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:43.101753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:43.102386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:43.102835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:43.103567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:43.105027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:43.105465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:43.529077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-9ecf6aea-f598-45a1-b419-b03168e54885 req-253859c5-0104-486c-8685-b4dcc917cc64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-deleted", "tag": "8a2e3024-32a6-42ac-9aa6-31fac197b837"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:43.548816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9ecf6aea-f598-45a1-b419-b03168e54885 req-253859c5-0104-486c-8685-b4dcc917cc64 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:43.549314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9ecf6aea-f598-45a1-b419-b03168e54885 req-253859c5-0104-486c-8685-b4dcc917cc64 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:43.549754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9ecf6aea-f598-45a1-b419-b03168e54885 req-253859c5-0104-486c-8685-b4dcc917cc64 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:43.578134 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-9ecf6aea-f598-45a1-b419-b03168e54885 req-253859c5-0104-486c-8685-b4dcc917cc64 service nova] Creating event network-vif-deleted:8a2e3024-32a6-42ac-9aa6-31fac197b837 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:39:43.598096 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-9ecf6aea-f598-45a1-b419-b03168e54885 req-253859c5-0104-486c-8685-b4dcc917cc64 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079673 Oct 11 04:39:43.599537 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3033/5814] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:43.611878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-94375dc5-8b73-46f4-8a68-a2f7d0dd9d3e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:43.622165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-94375dc5-8b73-46f4-8a68-a2f7d0dd9d3e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:43.629448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94375dc5-8b73-46f4-8a68-a2f7d0dd9d3e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:43.631719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94375dc5-8b73-46f4-8a68-a2f7d0dd9d3e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:43.637304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94375dc5-8b73-46f4-8a68-a2f7d0dd9d3e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:43.638119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94375dc5-8b73-46f4-8a68-a2f7d0dd9d3e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:43.638633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94375dc5-8b73-46f4-8a68-a2f7d0dd9d3e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:43.639150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94375dc5-8b73-46f4-8a68-a2f7d0dd9d3e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:43.749155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-94375dc5-8b73-46f4-8a68-a2f7d0dd9d3e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:43.774051 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-94375dc5-8b73-46f4-8a68-a2f7d0dd9d3e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1244 microversion: 2.1 time: 0.172451 Oct 11 04:39:43.775846 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3034/5815] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:43 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1244 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:43.775983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:43.791569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:43.794410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:43.795920 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3e4b7b01-58f1-4ab5-87ca-01c7dc2b6ed2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1723 microversion: 2.20 time: 0.715301 Oct 11 04:39:43.806918 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2782/5816] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:43 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1723 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:39:44.135859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:44.137156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:44.186673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:44.187561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:44.188269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:44.189172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:44.189829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:44.190693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:44.445654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:44.468240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:44.476436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:44.477733 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e6336f1-7561-4b93-979a-fa6d461fd17a tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 2577 microversion: 2.42 time: 0.352678 Oct 11 04:39:44.520584 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3035/5817] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:44 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 2577 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:39:44.662954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-bb0c495f-cb3b-4d31-8fca-22a505267315 req-c0b63de9-ff8d-4d71-9b76-2ff04a2f058a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-unplugged", "status": "completed", "tag": "665442b9-2aa6-4687-b61d-1f39a176e14f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:44.684244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bb0c495f-cb3b-4d31-8fca-22a505267315 req-c0b63de9-ff8d-4d71-9b76-2ff04a2f058a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:44.686682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bb0c495f-cb3b-4d31-8fca-22a505267315 req-c0b63de9-ff8d-4d71-9b76-2ff04a2f058a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:44.689146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bb0c495f-cb3b-4d31-8fca-22a505267315 req-c0b63de9-ff8d-4d71-9b76-2ff04a2f058a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:44.702532 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-bb0c495f-cb3b-4d31-8fca-22a505267315 req-c0b63de9-ff8d-4d71-9b76-2ff04a2f058a service nova] Creating event network-vif-unplugged:665442b9-2aa6-4687-b61d-1f39a176e14f for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:39:44.707872 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-bb0c495f-cb3b-4d31-8fca-22a505267315 req-c0b63de9-ff8d-4d71-9b76-2ff04a2f058a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050377 Oct 11 04:39:44.708547 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2783/5818] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:39:44.802043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b1e0cdf-a573-42ed-9fab-d66c45ac1edf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:44.802708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b1e0cdf-a573-42ed-9fab-d66c45ac1edf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:44.828133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:44.828133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:44.836332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1e0cdf-a573-42ed-9fab-d66c45ac1edf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:44.836834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1e0cdf-a573-42ed-9fab-d66c45ac1edf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:44.837275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1e0cdf-a573-42ed-9fab-d66c45ac1edf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:44.839470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:44.840131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:44.840724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:44.841734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:44.842840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1e0cdf-a573-42ed-9fab-d66c45ac1edf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:44.843476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:44.844683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:44.851795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1e0cdf-a573-42ed-9fab-d66c45ac1edf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:44.855870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b1e0cdf-a573-42ed-9fab-d66c45ac1edf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:45.040452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b1e0cdf-a573-42ed-9fab-d66c45ac1edf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:45.079151 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b1e0cdf-a573-42ed-9fab-d66c45ac1edf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1292 microversion: 2.1 time: 0.277681 Oct 11 04:39:45.079843 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3036/5819] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:44 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1292 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:45.531441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:45.533172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:45.543383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:45.544166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:45.544773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:45.546138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:45.552189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:45.552189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:45.555418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:45.973179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:45.973179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:45.973179 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4adc45f2-97ff-4cca-b1df-dc1bbb81a261 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1723 microversion: 2.20 time: 0.745990 Oct 11 04:39:45.973179 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2784/5820] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:44 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1723 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:45.973179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-bfadf4c4-8419-40fb-9742-460b0a6057ea req-6fd8068c-91b1-4f6f-af08-931a816e929c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-deleted", "tag": "9e71def9-e943-4b32-a256-31fe7ded5fd0"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:45.973179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bfadf4c4-8419-40fb-9742-460b0a6057ea req-6fd8068c-91b1-4f6f-af08-931a816e929c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:45.973179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bfadf4c4-8419-40fb-9742-460b0a6057ea req-6fd8068c-91b1-4f6f-af08-931a816e929c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:45.973179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bfadf4c4-8419-40fb-9742-460b0a6057ea req-6fd8068c-91b1-4f6f-af08-931a816e929c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:45.973179 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-bfadf4c4-8419-40fb-9742-460b0a6057ea req-6fd8068c-91b1-4f6f-af08-931a816e929c service nova] Creating event network-vif-deleted:9e71def9-e943-4b32-a256-31fe7ded5fd0 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:39:45.973179 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-bfadf4c4-8419-40fb-9742-460b0a6057ea req-6fd8068c-91b1-4f6f-af08-931a816e929c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041365 Oct 11 04:39:45.973179 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2785/5821] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:39:45.977358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:45.977358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:45.977358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:45.977358 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e41023b3-4011-4b3a-8ee1-bfddad48d117 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 2530 microversion: 2.42 time: 0.292181 Oct 11 04:39:45.977358 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3037/5822] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:45 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 2530 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:46.107669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4d4b06d0-101c-4dcb-bb78-63b63f5c6872 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:46.111535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4d4b06d0-101c-4dcb-bb78-63b63f5c6872 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:46.117780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d4b06d0-101c-4dcb-bb78-63b63f5c6872 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:46.120170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d4b06d0-101c-4dcb-bb78-63b63f5c6872 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:46.122739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d4b06d0-101c-4dcb-bb78-63b63f5c6872 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:46.123687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d4b06d0-101c-4dcb-bb78-63b63f5c6872 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:46.125524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d4b06d0-101c-4dcb-bb78-63b63f5c6872 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:46.126658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d4b06d0-101c-4dcb-bb78-63b63f5c6872 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:46.601486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:46.602026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:46.614966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:46.616059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:46.616059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:46.619671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:46.620483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:46.637974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:47.093892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:47.109214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:47.110807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:47.112088 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9e2638ef-3cb5-44b0-99b3-c22f1749827a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1723 microversion: 2.20 time: 0.515353 Oct 11 04:39:47.113581 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3038/5823] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:46 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1723 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:47.138094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-de6d6cdd-2ae0-414f-a926-81952c8c0377 req-014b081a-7964-4fb7-a58a-552f09fd8b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-unplugged", "status": "completed", "tag": "f193892e-4606-44c5-8ce9-edc616f636e4"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:47.150038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-de6d6cdd-2ae0-414f-a926-81952c8c0377 req-014b081a-7964-4fb7-a58a-552f09fd8b8c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:47.150878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-de6d6cdd-2ae0-414f-a926-81952c8c0377 req-014b081a-7964-4fb7-a58a-552f09fd8b8c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:47.151511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-de6d6cdd-2ae0-414f-a926-81952c8c0377 req-014b081a-7964-4fb7-a58a-552f09fd8b8c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:47.154296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4d4b06d0-101c-4dcb-bb78-63b63f5c6872 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:47.165154 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4d4b06d0-101c-4dcb-bb78-63b63f5c6872 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1300 microversion: 2.1 time: 1.061634 Oct 11 04:39:47.166068 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2786/5824] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:46 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1300 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:47.176381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:47.177434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:47.179822 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-de6d6cdd-2ae0-414f-a926-81952c8c0377 req-014b081a-7964-4fb7-a58a-552f09fd8b8c service nova] Creating event network-vif-unplugged:f193892e-4606-44c5-8ce9-edc616f636e4 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:39:47.186025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:47.187983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:47.188883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:47.189511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:47.190366 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-de6d6cdd-2ae0-414f-a926-81952c8c0377 req-014b081a-7964-4fb7-a58a-552f09fd8b8c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060906 Oct 11 04:39:47.190783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:47.191443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:47.192069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:47.195559 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3039/5825] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:47.770442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5b974596-7d1e-47b9-80d9-6e0f7dba596c req-b0237401-5cd9-421b-b540-99d8393682ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-deleted", "tag": "10df1ea8-87de-47cc-85e2-c32ce043673a"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:47.773475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:47.788277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:47.791659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5b974596-7d1e-47b9-80d9-6e0f7dba596c req-b0237401-5cd9-421b-b540-99d8393682ca service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:47.793731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5b974596-7d1e-47b9-80d9-6e0f7dba596c req-b0237401-5cd9-421b-b540-99d8393682ca service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:47.798989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5b974596-7d1e-47b9-80d9-6e0f7dba596c req-b0237401-5cd9-421b-b540-99d8393682ca service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:47.818390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:47.821711 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5b974596-7d1e-47b9-80d9-6e0f7dba596c req-b0237401-5cd9-421b-b540-99d8393682ca service nova] Creating event network-vif-deleted:10df1ea8-87de-47cc-85e2-c32ce043673a for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:39:47.826411 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff9e56ac-debb-4993-bf8b-f55b4ad8837c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 2369 microversion: 2.42 time: 0.659142 Oct 11 04:39:47.837651 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5b974596-7d1e-47b9-80d9-6e0f7dba596c req-b0237401-5cd9-421b-b540-99d8393682ca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071945 Oct 11 04:39:47.838912 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3040/5826] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:47.844785 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2787/5827] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:47 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 2369 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:48.147385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:48.154286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:48.155790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:48.156463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:48.157087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:48.157979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:48.158628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:48.159278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:48.195610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68092e04-56d4-4108-b92f-7d1e4efb52ec tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:48.196392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68092e04-56d4-4108-b92f-7d1e4efb52ec tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:48.204305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68092e04-56d4-4108-b92f-7d1e4efb52ec tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:48.205408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68092e04-56d4-4108-b92f-7d1e4efb52ec tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:48.206163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68092e04-56d4-4108-b92f-7d1e4efb52ec tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:48.207300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68092e04-56d4-4108-b92f-7d1e4efb52ec tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:48.208843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68092e04-56d4-4108-b92f-7d1e4efb52ec tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:48.211032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68092e04-56d4-4108-b92f-7d1e4efb52ec tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:48.529543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:48.544242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:48.545730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:48.547038 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a8583da5-0595-4d89-a3b2-1a077b22b601 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1744 microversion: 2.20 time: 0.404059 Oct 11 04:39:48.558365 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3041/5828] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:48 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1744 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:48.718416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68092e04-56d4-4108-b92f-7d1e4efb52ec tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:48.728832 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68092e04-56d4-4108-b92f-7d1e4efb52ec tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1366 microversion: 2.1 time: 0.538873 Oct 11 04:39:48.730232 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2788/5829] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:48 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1366 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:48.858344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:48.858344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:48.872797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:48.874166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:48.875192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:48.875704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:48.877377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:48.878180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:48.878768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:49.392536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:49.415439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:49.417320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:49.438534 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af838bab-fe12-419f-ae2b-171381f5e50e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 2210 microversion: 2.42 time: 0.584994 Oct 11 04:39:49.439858 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3042/5830] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:48 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 2210 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:49.578048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:49.578705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:49.590106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:49.590625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:49.591075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:49.591788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:49.592247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:49.592679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:49.753251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a9e21ed-1a2a-4c5a-aaf7-12242dfccc3a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:49.754693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6a9e21ed-1a2a-4c5a-aaf7-12242dfccc3a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:49.760903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a9e21ed-1a2a-4c5a-aaf7-12242dfccc3a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:49.761398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a9e21ed-1a2a-4c5a-aaf7-12242dfccc3a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:49.761951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a9e21ed-1a2a-4c5a-aaf7-12242dfccc3a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:49.762715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a9e21ed-1a2a-4c5a-aaf7-12242dfccc3a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:49.770306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a9e21ed-1a2a-4c5a-aaf7-12242dfccc3a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:49.770766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a9e21ed-1a2a-4c5a-aaf7-12242dfccc3a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:50.090490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:50.102775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:50.105740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:50.107957 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-81126ce9-a452-436b-afe6-83423393f504 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1744 microversion: 2.20 time: 0.534058 Oct 11 04:39:50.110583 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2789/5831] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:49 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1744 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:50.115891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5b3f8009-933e-40ec-b073-e353ce065275 req-6d3c93d1-73bf-4954-a2ec-8208fa50a136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-deleted", "tag": "f193892e-4606-44c5-8ce9-edc616f636e4"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:50.131522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5b3f8009-933e-40ec-b073-e353ce065275 req-6d3c93d1-73bf-4954-a2ec-8208fa50a136 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:50.132526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5b3f8009-933e-40ec-b073-e353ce065275 req-6d3c93d1-73bf-4954-a2ec-8208fa50a136 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:50.133199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5b3f8009-933e-40ec-b073-e353ce065275 req-6d3c93d1-73bf-4954-a2ec-8208fa50a136 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:50.153735 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5b3f8009-933e-40ec-b073-e353ce065275 req-6d3c93d1-73bf-4954-a2ec-8208fa50a136 service nova] Creating event network-vif-deleted:f193892e-4606-44c5-8ce9-edc616f636e4 for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:39:50.161750 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5b3f8009-933e-40ec-b073-e353ce065275 req-6d3c93d1-73bf-4954-a2ec-8208fa50a136 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049081 Oct 11 04:39:50.162849 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2790/5832] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:50.167085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a9e21ed-1a2a-4c5a-aaf7-12242dfccc3a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:50.168980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c68afb49-f105-475b-b233-622da73a0602 req-4d7a80c2-86eb-449b-babb-d3949ff85445 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4bbbe5-3984-4e74-8958-d120a9bd63e7", "tag": "9b7e2c28-d133-427e-9ee1-9f088dab4ed3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:50.176651 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a9e21ed-1a2a-4c5a-aaf7-12242dfccc3a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1366 microversion: 2.1 time: 0.428278 Oct 11 04:39:50.181218 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3043/5833] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:49 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1366 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:50.191427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c68afb49-f105-475b-b233-622da73a0602 req-4d7a80c2-86eb-449b-babb-d3949ff85445 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:50.194528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c68afb49-f105-475b-b233-622da73a0602 req-4d7a80c2-86eb-449b-babb-d3949ff85445 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:50.194528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c68afb49-f105-475b-b233-622da73a0602 req-4d7a80c2-86eb-449b-babb-d3949ff85445 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:50.216562 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c68afb49-f105-475b-b233-622da73a0602 req-4d7a80c2-86eb-449b-babb-d3949ff85445 service nova] Creating event network-changed:9b7e2c28-d133-427e-9ee1-9f088dab4ed3 for instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 on n-h1-860892-1 Oct 11 04:39:50.225500 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c68afb49-f105-475b-b233-622da73a0602 req-4d7a80c2-86eb-449b-babb-d3949ff85445 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057503 Oct 11 04:39:50.225500 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2791/5834] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:50.480103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:50.481440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:50.489222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:50.490013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:50.490650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:50.491671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:50.492336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:50.492960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:50.938793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:50.957384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:50.958926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:50.963784 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22e5d58e-067c-441d-a2e4-35e0fbb21c41 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1985 microversion: 2.42 time: 0.487189 Oct 11 04:39:50.964844 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3044/5835] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:50 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1985 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:51.155237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:51.156520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:51.171946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:51.181231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:51.182003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:51.183013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:51.189578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:51.190448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:51.206915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c9a7cdc-485c-4645-80d4-a79d5575bbab tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:51.207707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6c9a7cdc-485c-4645-80d4-a79d5575bbab tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:51.219273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c9a7cdc-485c-4645-80d4-a79d5575bbab tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:51.221193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c9a7cdc-485c-4645-80d4-a79d5575bbab tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:51.221193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c9a7cdc-485c-4645-80d4-a79d5575bbab tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:51.221193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c9a7cdc-485c-4645-80d4-a79d5575bbab tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:51.221450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c9a7cdc-485c-4645-80d4-a79d5575bbab tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:51.221773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c9a7cdc-485c-4645-80d4-a79d5575bbab tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:51.493460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:51.503638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:51.520029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:51.527577 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02c6af8e-bf1e-4265-a362-134bf521fcec tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1744 microversion: 2.20 time: 0.389417 Oct 11 04:39:51.530667 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2792/5836] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:51 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1744 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:51.586376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6c9a7cdc-485c-4645-80d4-a79d5575bbab tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:51.596225 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6c9a7cdc-485c-4645-80d4-a79d5575bbab tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1366 microversion: 2.1 time: 0.395061 Oct 11 04:39:51.623903 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3045/5837] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:51 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1366 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:39:51.925011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-31fe3c41-82b4-4e34-bbb0-39ae8e6b685e req-94017c07-cc1d-4690-a3f3-8fb076dc5581 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55886128-3370-4868-98e0-5b2b4e574871", "name": "network-vif-plugged", "status": "completed", "tag": "e148d4ee-0d06-4384-93e1-fa7e9028b8f1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:51.940371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-31fe3c41-82b4-4e34-bbb0-39ae8e6b685e req-94017c07-cc1d-4690-a3f3-8fb076dc5581 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:51.942346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-31fe3c41-82b4-4e34-bbb0-39ae8e6b685e req-94017c07-cc1d-4690-a3f3-8fb076dc5581 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:51.945356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-31fe3c41-82b4-4e34-bbb0-39ae8e6b685e req-94017c07-cc1d-4690-a3f3-8fb076dc5581 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:51.963767 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-31fe3c41-82b4-4e34-bbb0-39ae8e6b685e req-94017c07-cc1d-4690-a3f3-8fb076dc5581 service nova] Creating event network-vif-plugged:e148d4ee-0d06-4384-93e1-fa7e9028b8f1 for instance 55886128-3370-4868-98e0-5b2b4e574871 on n-h1-860892-1 Oct 11 04:39:51.973441 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-31fe3c41-82b4-4e34-bbb0-39ae8e6b685e req-94017c07-cc1d-4690-a3f3-8fb076dc5581 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054674 Oct 11 04:39:51.974632 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2793/5838] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:51.989938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:51.991250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:52.003350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:52.003869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:52.005649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:52.005649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:52.005649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:52.005898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:52.087537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:52.103922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:52.105410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:52.108770 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-df844039-a8e7-43d9-bb80-473883dffe55 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.120895 Oct 11 04:39:52.109377 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3046/5839] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:51 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:52.313661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-809b10d0-acbb-4988-8c6f-3f5b2a2e2204 req-3c4c0983-4910-4615-b1ef-b7c023a558d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea1b9555-caed-49cc-a5f4-78af7b33f377", "name": "network-vif-deleted", "tag": "665442b9-2aa6-4687-b61d-1f39a176e14f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:52.334447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-809b10d0-acbb-4988-8c6f-3f5b2a2e2204 req-3c4c0983-4910-4615-b1ef-b7c023a558d0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:52.344166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-809b10d0-acbb-4988-8c6f-3f5b2a2e2204 req-3c4c0983-4910-4615-b1ef-b7c023a558d0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:52.344166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-809b10d0-acbb-4988-8c6f-3f5b2a2e2204 req-3c4c0983-4910-4615-b1ef-b7c023a558d0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:52.358886 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-809b10d0-acbb-4988-8c6f-3f5b2a2e2204 req-3c4c0983-4910-4615-b1ef-b7c023a558d0 service nova] Creating event network-vif-deleted:665442b9-2aa6-4687-b61d-1f39a176e14f for instance ea1b9555-caed-49cc-a5f4-78af7b33f377 on n-h2-860892-1 Oct 11 04:39:52.371153 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-809b10d0-acbb-4988-8c6f-3f5b2a2e2204 req-3c4c0983-4910-4615-b1ef-b7c023a558d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065506 Oct 11 04:39:52.374538 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2794/5840] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:52.559352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:52.560220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:52.566280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:52.567366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:52.569078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:52.569840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:52.570537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:52.571489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:52.572171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:52.572806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:52.635950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-06e4a716-68df-4875-bd05-a4145c07cd80 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:52.636683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-06e4a716-68df-4875-bd05-a4145c07cd80 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:52.638979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:52.653268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e4a716-68df-4875-bd05-a4145c07cd80 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:52.653481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e4a716-68df-4875-bd05-a4145c07cd80 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:52.654542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e4a716-68df-4875-bd05-a4145c07cd80 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:52.656580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e4a716-68df-4875-bd05-a4145c07cd80 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:52.657903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e4a716-68df-4875-bd05-a4145c07cd80 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:52.661991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-06e4a716-68df-4875-bd05-a4145c07cd80 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:52.852476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:52.861292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:52.862782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:52.867696 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb2725d0-6f2a-4e6f-94c1-940b4639d8c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1744 microversion: 2.20 time: 0.308724 Oct 11 04:39:52.867696 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3047/5841] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:52 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1744 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:53.020356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-06e4a716-68df-4875-bd05-a4145c07cd80 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:53.026075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:53.032746 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-06e4a716-68df-4875-bd05-a4145c07cd80 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1366 microversion: 2.1 time: 0.403414 Oct 11 04:39:53.034759 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2795/5842] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:52 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1366 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:39:53.137312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:53.138553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:53.147090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:53.148665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:53.149297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:53.150164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:53.150905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:53.151488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:53.240144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:53.261722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:53.266759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:53.268417 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-013d6d88-ecd7-4bf2-a25b-32da59e61af9 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.135103 Oct 11 04:39:53.269706 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3048/5843] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:53 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:53.891762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:53.892543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:53.909233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:53.913447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:53.923089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:53.923783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:53.924266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:53.924709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:54.058925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-18f1907a-96f3-42dc-a1e4-4cb7cc41c6ae tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:54.060145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-18f1907a-96f3-42dc-a1e4-4cb7cc41c6ae tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:54.066089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18f1907a-96f3-42dc-a1e4-4cb7cc41c6ae tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:54.066806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18f1907a-96f3-42dc-a1e4-4cb7cc41c6ae tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:54.067561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18f1907a-96f3-42dc-a1e4-4cb7cc41c6ae tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:54.068406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18f1907a-96f3-42dc-a1e4-4cb7cc41c6ae tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:54.069011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18f1907a-96f3-42dc-a1e4-4cb7cc41c6ae tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:54.070235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18f1907a-96f3-42dc-a1e4-4cb7cc41c6ae tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:54.074935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:39:54.175059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:54.184062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:54.197310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:54.200619 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4bceef3f-d389-4c3d-acda-507a0ad10091 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1744 microversion: 2.20 time: 0.314031 Oct 11 04:39:54.202415 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2796/5844] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:53 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1744 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:39:54.268062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-18f1907a-96f3-42dc-a1e4-4cb7cc41c6ae tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:54.282328 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-18f1907a-96f3-42dc-a1e4-4cb7cc41c6ae tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1366 microversion: 2.1 time: 0.226407 Oct 11 04:39:54.284918 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3049/5845] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:54 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1366 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:54.301246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:54.301867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:54.308652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:54.309272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:54.309663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:54.310531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:54.311295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:54.311732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:54.386589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:54.398359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:54.400127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:54.401148 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b6c8d217-ba20-4bfb-b480-b3af08756294 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.105120 Oct 11 04:39:54.401713 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2797/5846] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:54 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:55.229262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:55.229829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:55.249639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:55.259001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:55.259001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:55.259001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:55.259001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:55.260678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:55.307765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aacb737e-c714-4096-b78c-d510f2cd4311 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:55.308932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aacb737e-c714-4096-b78c-d510f2cd4311 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:55.316076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aacb737e-c714-4096-b78c-d510f2cd4311 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:55.316558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aacb737e-c714-4096-b78c-d510f2cd4311 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:55.323693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aacb737e-c714-4096-b78c-d510f2cd4311 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:55.324940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aacb737e-c714-4096-b78c-d510f2cd4311 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:55.326560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aacb737e-c714-4096-b78c-d510f2cd4311 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:55.333044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aacb737e-c714-4096-b78c-d510f2cd4311 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:55.586797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aacb737e-c714-4096-b78c-d510f2cd4311 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:55.602805 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aacb737e-c714-4096-b78c-d510f2cd4311 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1366 microversion: 2.1 time: 0.293816 Oct 11 04:39:55.603470 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2798/5847] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:55 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1366 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:55.614131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:55.614995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:55.627374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:55.628652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:55.630531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:55.632680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:55.637166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:55.637166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:55.655707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:55.674712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:55.680831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:55.682075 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3513b1eb-e591-4dea-9b1d-65dbb3fe18ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.458046 Oct 11 04:39:55.693228 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3050/5848] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:55 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:55.855396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:55.874875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:55.876285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:55.877522 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4ea03268-e80b-4a71-afc0-879bb26b13ed tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.272887 Oct 11 04:39:55.882676 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2799/5849] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:55 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:56.630632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3bcc5238-4a2e-4b52-aee0-07d667813548 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:56.631414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3bcc5238-4a2e-4b52-aee0-07d667813548 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:56.653659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc5238-4a2e-4b52-aee0-07d667813548 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:56.654159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc5238-4a2e-4b52-aee0-07d667813548 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:56.654629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc5238-4a2e-4b52-aee0-07d667813548 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:56.655350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc5238-4a2e-4b52-aee0-07d667813548 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:56.667101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc5238-4a2e-4b52-aee0-07d667813548 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:56.667777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc5238-4a2e-4b52-aee0-07d667813548 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:56.715598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:56.716793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:56.738057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:56.739338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:56.741747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:56.744795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:56.745935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:56.747420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:57.020690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3bcc5238-4a2e-4b52-aee0-07d667813548 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:57.032708 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3bcc5238-4a2e-4b52-aee0-07d667813548 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1366 microversion: 2.1 time: 0.408165 Oct 11 04:39:57.049212 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3051/5850] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:56 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1366 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:57.049212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:57.049508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:57.056220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:57.060732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:57.061487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:57.063825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:57.063825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:57.063825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:57.064096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:57.065969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:57.067568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:57.068772 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9285a446-d614-4fc5-8daf-5fd0ad2c90b8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.359881 Oct 11 04:39:57.069249 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2800/5851] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:56 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:57.198861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:57.215693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:57.219607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:57.222515 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30d52622-bb3e-4579-86f5-a30054a1184b tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.187247 Oct 11 04:39:57.235054 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3052/5852] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:57 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:57.966921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-964df3c9-b99c-4e13-a046-182bed21527f req-3e4769ab-f0f4-494b-a821-53fe2f412af3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4bbbe5-3984-4e74-8958-d120a9bd63e7", "name": "network-vif-plugged", "status": "completed", "tag": "9b7e2c28-d133-427e-9ee1-9f088dab4ed3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:39:57.982155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-964df3c9-b99c-4e13-a046-182bed21527f req-3e4769ab-f0f4-494b-a821-53fe2f412af3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:57.987398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-964df3c9-b99c-4e13-a046-182bed21527f req-3e4769ab-f0f4-494b-a821-53fe2f412af3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:57.990543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-964df3c9-b99c-4e13-a046-182bed21527f req-3e4769ab-f0f4-494b-a821-53fe2f412af3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:58.020184 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-964df3c9-b99c-4e13-a046-182bed21527f req-3e4769ab-f0f4-494b-a821-53fe2f412af3 service nova] Creating event network-vif-plugged:9b7e2c28-d133-427e-9ee1-9f088dab4ed3 for instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 on n-h1-860892-1 Oct 11 04:39:58.033960 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-964df3c9-b99c-4e13-a046-182bed21527f req-3e4769ab-f0f4-494b-a821-53fe2f412af3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067690 Oct 11 04:39:58.036487 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2801/5853] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:39:58.059285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ddc04e3-fb2c-4e8a-854d-d04d121e1bb0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:58.060528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5ddc04e3-fb2c-4e8a-854d-d04d121e1bb0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:58.097548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:58.098482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:58.133667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddc04e3-fb2c-4e8a-854d-d04d121e1bb0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:58.144050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddc04e3-fb2c-4e8a-854d-d04d121e1bb0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:58.146852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:58.147149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddc04e3-fb2c-4e8a-854d-d04d121e1bb0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:58.149204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddc04e3-fb2c-4e8a-854d-d04d121e1bb0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:58.149692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddc04e3-fb2c-4e8a-854d-d04d121e1bb0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:58.150215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:58.150679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:58.155204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:58.155395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ddc04e3-fb2c-4e8a-854d-d04d121e1bb0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:58.157617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:58.160860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:58.633041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:58.642802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:58.651807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:58.653129 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-297e50da-1649-4bc9-b5e2-7f3040a0ffee tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.561067 Oct 11 04:39:58.654039 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2802/5854] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:58 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:39:58.659375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:58.660120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:58.667151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:58.667832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:58.668600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:58.669515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:58.670138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:58.670867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:58.852595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:58.875399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5ddc04e3-fb2c-4e8a-854d-d04d121e1bb0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:58.878889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:58.881858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:39:58.884348 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5ddc04e3-fb2c-4e8a-854d-d04d121e1bb0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1366 microversion: 2.1 time: 0.830814 Oct 11 04:39:58.886081 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3053/5855] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:58 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1366 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:39:58.898993 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2aadf6e4-1aa0-47c7-82c1-fde89b475a96 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.234930 Oct 11 04:39:58.898993 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2803/5856] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:58 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:39:59.684217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:59.684860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:59.699603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:59.700116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:59.700568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:59.701301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:59.701755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:59.706862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:59.910402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1533a230-665c-4a6c-8177-07f81633592f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:39:59.911720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1533a230-665c-4a6c-8177-07f81633592f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:39:59.939351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1533a230-665c-4a6c-8177-07f81633592f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:59.939351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1533a230-665c-4a6c-8177-07f81633592f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:59.939351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1533a230-665c-4a6c-8177-07f81633592f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:39:59.939351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1533a230-665c-4a6c-8177-07f81633592f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:39:59.939351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1533a230-665c-4a6c-8177-07f81633592f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:39:59.939351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1533a230-665c-4a6c-8177-07f81633592f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:00.083941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:00.101266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:00.104985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:00.106235 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44c66665-3eac-4bf3-b746-9b5780d9fbe4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.426089 Oct 11 04:40:00.118214 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3054/5857] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:39:59 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:00.118214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:00.118214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:00.133880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:00.134422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:00.134875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:00.139361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:00.139938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:00.140641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:00.292428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:00.308494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:00.314136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:00.317136 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8d3d6b24-190e-4eab-ac29-9ef2269fa2c4 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.209355 Oct 11 04:40:00.342744 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3055/5858] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:00 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:00.388792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1533a230-665c-4a6c-8177-07f81633592f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:00.403052 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1533a230-665c-4a6c-8177-07f81633592f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1366 microversion: 2.1 time: 0.493998 Oct 11 04:40:00.403917 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2804/5859] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:39:59 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1366 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:40:01.137168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:01.137878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:01.157661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:01.158211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:01.158674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:01.161721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:01.162233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:01.162682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:01.351057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:01.351703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:01.362424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:01.362910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:01.363357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:01.364078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:01.364528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:01.368569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:01.472896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:01.486069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:01.488146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:01.489796 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d0a0122e-d9c1-4ebe-9451-92ccacd21fe8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.359225 Oct 11 04:40:01.491522 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3056/5860] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:01 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:01.496587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4bf2fdde-9922-411b-8d4e-6f967c150f5d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:01.497597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4bf2fdde-9922-411b-8d4e-6f967c150f5d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:01.506110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4bf2fdde-9922-411b-8d4e-6f967c150f5d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:01.525185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4bf2fdde-9922-411b-8d4e-6f967c150f5d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:01.526082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4bf2fdde-9922-411b-8d4e-6f967c150f5d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:01.527086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4bf2fdde-9922-411b-8d4e-6f967c150f5d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:01.527724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4bf2fdde-9922-411b-8d4e-6f967c150f5d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:01.528317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4bf2fdde-9922-411b-8d4e-6f967c150f5d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:01.534944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:01.561805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:01.564141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:01.565672 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-33a38c58-a861-456a-bbd5-c654f83dd77c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.218677 Oct 11 04:40:01.567321 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2805/5861] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:01 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:01.693478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4bf2fdde-9922-411b-8d4e-6f967c150f5d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:01.703049 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4bf2fdde-9922-411b-8d4e-6f967c150f5d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1556 microversion: 2.1 time: 0.210201 Oct 11 04:40:01.703831 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3057/5862] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:40:01 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1556 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:40:01.824823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-873b8a58-4b6f-45cc-b915-56765378e204 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:01.826523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-873b8a58-4b6f-45cc-b915-56765378e204 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:01.839642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873b8a58-4b6f-45cc-b915-56765378e204 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:01.842732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873b8a58-4b6f-45cc-b915-56765378e204 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:01.842732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873b8a58-4b6f-45cc-b915-56765378e204 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:01.842732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873b8a58-4b6f-45cc-b915-56765378e204 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:01.843820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873b8a58-4b6f-45cc-b915-56765378e204 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:01.845388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873b8a58-4b6f-45cc-b915-56765378e204 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:01.964091 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-873b8a58-4b6f-45cc-b915-56765378e204 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.146686 Oct 11 04:40:01.965285 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2806/5863] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:40:01 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-interface => generated 284 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:40:02.519621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:02.524186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:02.531635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:02.543078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:02.544153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:02.545497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:02.546385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:02.547355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:02.596997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:02.598213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:02.606119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:02.606860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:02.607406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:02.609284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:02.609869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:02.610422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:02.809164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:02.822625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:02.824712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:02.826166 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-209af684-f491-47cd-b269-55a70de4a6bf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.234390 Oct 11 04:40:02.827831 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2807/5864] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:02 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:02.841221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:02.869467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:02.876719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:02.880693 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b363f32d-ac33-40b9-8d2d-4c31fe732f38 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.363954 Oct 11 04:40:02.884222 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3058/5865] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:02 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:03.855097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:03.856332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:03.877777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:03.879350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:03.880251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:03.890140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:03.891254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:03.891954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:03.920386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:03.922384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:03.950996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:03.953750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:03.956033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:03.962297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:03.970280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:03.974261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:04.385709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:04.399884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:04.401946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:04.403182 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab19cd3a-acb6-4c11-afc3-1679c1db5705 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.488381 Oct 11 04:40:04.404437 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3059/5866] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:03 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:40:04.868339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:04.880313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:04.883511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:04.885325 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-95cdb1d1-9067-4b63-a2c2-8b11ffd9a5ba tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 1.034268 Oct 11 04:40:04.886389 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2808/5867] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:03 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:05.438676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:05.438676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:05.451908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c59ef596-29ec-4d17-9462-e7c1f9b1c2db req-6c2b6df1-c73c-4c88-818a-e534d060233b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd4bbbe5-3984-4e74-8958-d120a9bd63e7", "tag": "9b7e2c28-d133-427e-9ee1-9f088dab4ed3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:40:05.453538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:05.454035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:05.454501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:05.455208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:05.455661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:05.456219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:05.469184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c59ef596-29ec-4d17-9462-e7c1f9b1c2db req-6c2b6df1-c73c-4c88-818a-e534d060233b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:05.472490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c59ef596-29ec-4d17-9462-e7c1f9b1c2db req-6c2b6df1-c73c-4c88-818a-e534d060233b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:05.473108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c59ef596-29ec-4d17-9462-e7c1f9b1c2db req-6c2b6df1-c73c-4c88-818a-e534d060233b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:05.497155 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c59ef596-29ec-4d17-9462-e7c1f9b1c2db req-6c2b6df1-c73c-4c88-818a-e534d060233b service nova] Creating event network-changed:9b7e2c28-d133-427e-9ee1-9f088dab4ed3 for instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 on n-h1-860892-1 Oct 11 04:40:05.519372 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c59ef596-29ec-4d17-9462-e7c1f9b1c2db req-6c2b6df1-c73c-4c88-818a-e534d060233b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071696 Oct 11 04:40:05.524499 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2809/5868] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:40:05.920763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:05.921557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:05.929999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:05.930560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:05.931014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:05.935384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:05.935926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:05.938030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:06.129707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:06.155261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:06.166281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:06.167859 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cb455dcf-317d-4c41-b0f8-443ad35d013f tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.257395 Oct 11 04:40:06.197803 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2810/5869] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:05 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:06.547177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:06.562340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:06.570068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:06.573745 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-15a547d9-d332-4286-b53f-4ed1b65712e4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 1.145581 Oct 11 04:40:06.576203 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3060/5870] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:05 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:07.201087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:07.202308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:07.214057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:07.223659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:07.225743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:07.226556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:07.229222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:07.231298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:07.404232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:07.420205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:07.425451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:07.429598 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-820942fe-3cd8-4036-a4df-56cfb2631760 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.232488 Oct 11 04:40:07.450695 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2811/5871] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:07 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:07.605786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:07.606503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:07.618734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:07.621898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:07.622493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:07.624636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:07.625513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:07.632297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:08.039989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:08.070508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:08.072065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:08.073562 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ca53571e-5171-448a-8f65-d66a10ce1a1d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.471970 Oct 11 04:40:08.077422 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3061/5872] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:07 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:08.458502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:08.458502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:08.478542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:08.479176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:08.479729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:08.480664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:08.481296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:08.481899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:08.612598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:08.629405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:08.631749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:08.638181 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a5c891db-66d7-407a-83db-51bdbc4e89cf tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.186663 Oct 11 04:40:08.661686 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2812/5873] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:08 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:09.104872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:09.105706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:09.112890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:09.113512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:09.114040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:09.114895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:09.115447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:09.116668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:09.290309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:09.301242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:09.302663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:09.304245 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5924c89a-e09b-43a4-b951-85b835561235 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.205688 Oct 11 04:40:09.305181 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3062/5874] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:09 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:09.668356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:09.669121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:09.683208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:09.683850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:09.684426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:09.685304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:09.693438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:09.694280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:09.883096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:09.893680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:09.899506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:09.901054 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f51bc360-f272-416e-851b-7c61c79b599e tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.237088 Oct 11 04:40:09.902451 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2813/5875] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:09 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:10.333486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:10.335906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:10.367404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:10.370120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:10.374145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:10.375631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:10.380638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:10.381516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:10.749755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:10.767560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:10.773741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:10.775352 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-796fce01-a1f8-41c3-96e8-d0b80bd4af3a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.448269 Oct 11 04:40:10.776485 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3063/5876] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:10 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:10.949013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:10.953184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:10.991426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:10.996593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:10.997959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:11.003850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:11.004677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:11.008217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:11.071533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:40:11.171851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:11.179617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:11.182024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '92eb07c3e1e044a9b306385deb784876', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1be50887a9724000a57a65b62e36bef0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:11.183979 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a4627b20-ff2e-4e4f-8b0d-81adc93d58f8 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 200 len: 1604 microversion: 2.42 time: 0.256928 Oct 11 04:40:11.185189 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2814/5877] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:10 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 1604 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:11.805069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:11.805536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:11.819191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:11.819685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:11.820114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:11.820818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:11.821285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:11.821713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:12.213807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:12.215377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:12.232039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:12.238698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:12.239680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:12.242384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:12.243271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:12.245012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:12.256635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:12.282144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:12.285016 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] HTTP exception thrown: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Request method failure captured: Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 HTTP/1.1 Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIEgpIZkFEs51gPjeddWzTnnHCIjnpdETED0BYvXaUa-YmzWrdp0-gJx1GEkNnr6HBXyqBJBQGCny84uSAbqVMtY9mfPu63qc6hFw5UBauJV1Qo6aa8GInnoHtE7Dv2OHP1c07MaQGV8vs6KTY5ClYsghQN4Shyy7mIFhedM2H89HA Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 1be50887a9724000a57a65b62e36bef0 Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1765946831 Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be50887a9724000a57a65b62e36bef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be50887a9724000a57a65b62e36bef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be50887a9724000a57a65b62e36bef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be50887a9724000a57a65b62e36bef0"}]}] Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1765946831 Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 1be50887a9724000a57a65b62e36bef0 Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1765946831 Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TaggedBootDevicesTest_v242-1765946831-project Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 92eb07c3e1e044a9b306385deb784876 Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1765946831-project Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'ea1b9555-caed-49cc-a5f4-78af7b33f377'} Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:40:12.287509 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:40:12.293261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:40:12.293261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:40:12.293261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:40:12.293261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:40:12.293261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:40:12.293261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:40:12.293261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:12.293261 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:40:12.294797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:12.294797 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0042b49a-b44a-4b2e-8322-127bf23a17e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.494645 Oct 11 04:40:12.297768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Returning 404 to user: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:40:12.300090 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3e8ea8df-3bfd-41a2-9ea0-7776a3e9a55c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 404 len: 111 microversion: 2.42 time: 0.090781 Oct 11 04:40:12.301878 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2815/5878] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:12 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 111 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:40:12.308683 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3064/5879] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:11 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:12.317876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-33d64346-654a-4669-8b9b-77894f3c773c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '.version_select at 0x7fda191f5280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:12.445566 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-33d64346-654a-4669-8b9b-77894f3c773c tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219382750" status: 204 len: 0 microversion: 2.42 time: 0.137758 Oct 11 04:40:12.447678 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2816/5880] 10.222.0.26 () {60 vars in 1262 bytes} [Tue Oct 11 04:40:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1219382750 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:40:13.323473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:13.324709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:13.336159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:13.339072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:13.339591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:13.340333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:13.340794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:13.341228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:13.719353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:13.728113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:40:13.737629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:13.743628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:13.746620 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b23fdf9-9018-4d10-9c36-a188de382d17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.426966 Oct 11 04:40:13.766972 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3065/5881] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:13 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:14.775590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:14.776208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:14.794355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:14.794866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:14.795317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:14.796042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:14.796500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:14.796931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:15.217010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:15.232446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:15.234067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:15.238663 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ee528a1-f616-4607-a927-b853f4cba300 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.467756 Oct 11 04:40:15.280723 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2817/5882] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:14 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:16.277797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:16.278464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:16.466030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:16.466030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:16.466030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:16.466030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:16.466030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:16.466030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:16.638592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:16.655130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:16.656695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:16.658310 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a353fe4a-ccaf-44ee-9749-bed0c648e332 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.386890 Oct 11 04:40:16.678403 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3066/5883] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:16 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:17.688610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:17.689291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:17.697467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:17.697966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:17.698439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:17.699321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:17.699955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:17.700549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:18.641262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:18.652736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:18.654264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:18.655889 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6ae0bfe3-669d-4c8e-95d8-bfe28dd8d2a2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.972174 Oct 11 04:40:18.670320 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2818/5884] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:17 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:19.682722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:19.689161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:19.709693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:19.710212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:19.710663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:19.711395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:19.711860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:19.712299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:20.028199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:20.064936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:20.066924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:20.068460 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b6df5d13-205c-4910-b9ff-0b7e96e8d27b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1739 microversion: 2.20 time: 0.389841 Oct 11 04:40:20.069395 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3067/5885] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:19 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1739 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:21.104938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:21.105753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:21.117579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:21.119437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:21.120347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:21.121801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:21.123121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:21.123842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:21.485594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:21.502471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:21.505665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:21.507125 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8c10c8c7-d0ad-42de-95d0-0a99f051da14 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1721 microversion: 2.20 time: 0.411027 Oct 11 04:40:21.510699 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2819/5886] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:21 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1721 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:22.380672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:22.387187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:22.393668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=52 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:40:22.398222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:22.398222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:22.404057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:22.405162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:22.408415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:22.408970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:22.426992 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] HTTP exception thrown: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Request method failure captured: Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 HTTP/1.1 Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPIEgpIZkFEs51gPjeddWzTnnHCIjnpdETED0BYvXaUa-YmzWrdp0-gJx1GEkNnr6HBXyqBJBQGCny84uSAbqVMtY9mfPu63qc6hFw5UBauJV1Qo6aa8GInnoHtE7Dv2OHP1c07MaQGV8vs6KTY5ClYsghQN4Shyy7mIFhedM2H89HA Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 1be50887a9724000a57a65b62e36bef0 Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1765946831 Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be50887a9724000a57a65b62e36bef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be50887a9724000a57a65b62e36bef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be50887a9724000a57a65b62e36bef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be50887a9724000a57a65b62e36bef0"}]}] Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1765946831 Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 1be50887a9724000a57a65b62e36bef0 Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1765946831 Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TaggedBootDevicesTest_v242-1765946831-project Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 92eb07c3e1e044a9b306385deb784876 Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1765946831-project Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'ea1b9555-caed-49cc-a5f4-78af7b33f377'} Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:40:22.432683 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Returning 404 to user: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:40:22.437182 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-048a9cc2-7f6d-4309-ac18-b5f9f24e9789 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 404 len: 111 microversion: 2.42 time: 0.059545 Oct 11 04:40:22.438490 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3068/5887] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:40:22 2022] DELETE /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:40:22.442908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:22.443611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] [instance: ea1b9555-caed-49cc-a5f4-78af7b33f377] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:22.446479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:40:22.451640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:22.452371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:22.452895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:22.453779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:22.454262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:22.454701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:22.470568 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] HTTP exception thrown: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Request method failure captured: Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 HTTP/1.1 Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPIEgpIZkFEs51gPjeddWzTnnHCIjnpdETED0BYvXaUa-YmzWrdp0-gJx1GEkNnr6HBXyqBJBQGCny84uSAbqVMtY9mfPu63qc6hFw5UBauJV1Qo6aa8GInnoHtE7Dv2OHP1c07MaQGV8vs6KTY5ClYsghQN4Shyy7mIFhedM2H89HA Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.42 Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 1be50887a9724000a57a65b62e36bef0 Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-1765946831 Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/1be50887a9724000a57a65b62e36bef0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_1be50887a9724000a57a65b62e36bef0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be50887a9724000a57a65b62e36bef0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/1be50887a9724000a57a65b62e36bef0"}]}] Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TaggedBootDevicesTest_v242-1765946831 Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 1be50887a9724000a57a65b62e36bef0 Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-1765946831 Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TaggedBootDevicesTest_v242-1765946831-project Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 92eb07c3e1e044a9b306385deb784876 Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TaggedBootDevicesTest_v242-1765946831-project Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'ea1b9555-caed-49cc-a5f4-78af7b33f377'} Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:40:22.472950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:40:22.477370 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:40:22.477370 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:40:22.477370 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:40:22.477370 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:40:22.477370 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:40:22.477370 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:40:22.477370 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. Oct 11 04:40:22.477370 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:40:22.477370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] Returning 404 to user: Instance ea1b9555-caed-49cc-a5f4-78af7b33f377 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:40:22.477370 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-57779888-fc2b-4a9b-9944-72b3e4e6ed54 tempest-TaggedBootDevicesTest_v242-1765946831 tempest-TaggedBootDevicesTest_v242-1765946831-project] 10.222.0.26 "GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377" status: 404 len: 111 microversion: 2.42 time: 0.034725 Oct 11 04:40:22.477370 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2820/5888] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:22 2022] GET /compute/v2.1/servers/ea1b9555-caed-49cc-a5f4-78af7b33f377 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:40:22.540334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:22.541383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:22.548088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:22.548688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:22.549226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:22.550019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:22.557365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:22.557942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:22.729578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:22.739808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:22.744553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:22.746786 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-80e95565-2b36-4031-8254-2db89401b1f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1721 microversion: 2.20 time: 0.210220 Oct 11 04:40:22.747686 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3069/5889] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:22 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:23.773312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:23.774801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:23.787492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:23.791029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:23.792544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:23.794701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:23.796535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:23.797227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:23.868667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-48a1cc63-3263-45b1-a6ae-68e578cd45de req-401960f1-cef6-4d20-9032-a987e25cbf80 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55886128-3370-4868-98e0-5b2b4e574871", "name": "network-vif-unplugged", "status": "completed", "tag": "e148d4ee-0d06-4384-93e1-fa7e9028b8f1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:40:23.887431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-48a1cc63-3263-45b1-a6ae-68e578cd45de req-401960f1-cef6-4d20-9032-a987e25cbf80 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:23.888256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-48a1cc63-3263-45b1-a6ae-68e578cd45de req-401960f1-cef6-4d20-9032-a987e25cbf80 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:23.888853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-48a1cc63-3263-45b1-a6ae-68e578cd45de req-401960f1-cef6-4d20-9032-a987e25cbf80 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:23.906979 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-48a1cc63-3263-45b1-a6ae-68e578cd45de req-401960f1-cef6-4d20-9032-a987e25cbf80 service nova] Creating event network-vif-unplugged:e148d4ee-0d06-4384-93e1-fa7e9028b8f1 for instance 55886128-3370-4868-98e0-5b2b4e574871 on n-h1-860892-1 Oct 11 04:40:23.934819 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-48a1cc63-3263-45b1-a6ae-68e578cd45de req-401960f1-cef6-4d20-9032-a987e25cbf80 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.071008 Oct 11 04:40:23.936539 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3070/5890] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:40:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:40:24.045483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:24.064966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:24.066595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:24.068790 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c36cc44b-0ba5-4b1f-bf61-7020bd446a04 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1724 microversion: 2.20 time: 0.299919 Oct 11 04:40:24.069543 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2821/5891] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:23 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:24.097584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-10debb43-ec47-4eac-a600-54394e76c126 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9df427ec-83e3-4b36-90cd-508548ab17a8"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:40:24.101603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-10debb43-ec47-4eac-a600-54394e76c126 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:24.111466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10debb43-ec47-4eac-a600-54394e76c126 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:24.112187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10debb43-ec47-4eac-a600-54394e76c126 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:24.113241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10debb43-ec47-4eac-a600-54394e76c126 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:24.114172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10debb43-ec47-4eac-a600-54394e76c126 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:24.114823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10debb43-ec47-4eac-a600-54394e76c126 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:24.115442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10debb43-ec47-4eac-a600-54394e76c126 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:25.487768 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-10debb43-ec47-4eac-a600-54394e76c126 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "POST /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.391525 Oct 11 04:40:25.487768 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3071/5892] 10.222.0.26 () {62 vars in 1364 bytes} [Tue Oct 11 04:40:24 2022] POST /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments => generated 188 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:40:25.671112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69b686de-1a01-45ba-a24a-fa43471cea62 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:40:25.672387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69b686de-1a01-45ba-a24a-fa43471cea62 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:25.680024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69b686de-1a01-45ba-a24a-fa43471cea62 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:25.683570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69b686de-1a01-45ba-a24a-fa43471cea62 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:25.683570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69b686de-1a01-45ba-a24a-fa43471cea62 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:25.683570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69b686de-1a01-45ba-a24a-fa43471cea62 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:25.683570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69b686de-1a01-45ba-a24a-fa43471cea62 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:25.683570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69b686de-1a01-45ba-a24a-fa43471cea62 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:25.796107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69b686de-1a01-45ba-a24a-fa43471cea62 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120993) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 04:40:26.259861 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69b686de-1a01-45ba-a24a-fa43471cea62 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "POST /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/action" status: 202 len: 0 microversion: 2.20 time: 0.592668 Oct 11 04:40:26.261182 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2822/5893] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:40:25 2022] POST /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/action => generated 0 bytes in 594 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:40:26.269307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:26.270178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:26.279870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:26.280596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:26.281214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:26.282110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:26.282746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:26.283411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:26.480012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:26.491531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:26.493811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:26.495424 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-da0b5401-bad9-4df7-b542-5f72e6675eab tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1750 microversion: 2.20 time: 0.230094 Oct 11 04:40:26.496443 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3072/5894] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:26 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1750 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:27.527035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:27.527402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:27.545122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:27.550031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:27.550031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:27.550031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:27.550031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:27.550031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:27.969979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:27.987289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:27.989371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:27.990082 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35ce2adc-6d39-499f-8e2c-dd21bc5b0568 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1750 microversion: 2.20 time: 0.471537 Oct 11 04:40:27.996700 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2823/5895] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:27 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1750 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:29.027709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:29.029307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:29.037604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:29.044522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:29.045390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:29.046711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:29.048493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:29.050486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:29.473695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:29.483209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:29.496052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:29.497483 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e3510b7-c8a6-452c-ae42-3cee8262087e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1752 microversion: 2.20 time: 0.473977 Oct 11 04:40:29.498540 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3073/5896] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:29 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1752 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:40:30.532476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:30.533109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:30.544296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:30.547091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:30.550436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:30.551633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:30.552953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:30.554634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:31.061602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:31.071396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:31.079098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:31.080453 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ec2fb0df-760f-435c-b4cb-361e993d8467 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1752 microversion: 2.20 time: 0.552725 Oct 11 04:40:31.094587 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2824/5897] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:30 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1752 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:32.111328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:32.118002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:32.122895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:32.123397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:32.123818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:32.124514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:32.125023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:32.125605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:32.491938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:32.503207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:32.506460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:32.508575 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c7b1031f-00d2-4812-ad9c-dc4df2b7a0aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1752 microversion: 2.20 time: 0.401221 Oct 11 04:40:32.522329 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3074/5898] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:32 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1752 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:33.545496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:33.552887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:33.559739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:33.560528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:33.561394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:33.562621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:33.563318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:33.564207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:33.775471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:33.806606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:33.806606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:33.806606 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-44929d4e-39da-4fbc-8176-a546ad1f2308 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1752 microversion: 2.20 time: 0.271332 Oct 11 04:40:33.807385 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2825/5899] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:33 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1752 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:34.837842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:34.839062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:34.848652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:34.850112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:34.850931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:34.851841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:34.852508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:34.853617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:35.188197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:35.209650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:35.211617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:35.217635 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5002229-e697-4781-beb1-486ee5bb2476 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1752 microversion: 2.20 time: 0.384512 Oct 11 04:40:35.218604 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3075/5900] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:34 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1752 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:36.246377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:36.247030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:36.263222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:36.263765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:36.264255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:36.264988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:36.265454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:36.268767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:36.475680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:36.486574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:36.488544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:36.490754 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4cb34d50-d9bb-4498-96ea-9db9e97981e3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1752 microversion: 2.20 time: 0.248381 Oct 11 04:40:36.491426 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2826/5901] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:36 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1752 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:37.518027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:37.518673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:37.531243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:37.535881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:37.535881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:37.535881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:37.538514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:37.539185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:37.761619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:37.775570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:37.780825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:37.784714 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d6e043e-4d6b-4084-b679-b1cb70dc366a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.270786 Oct 11 04:40:37.787838 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3076/5902] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:37 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:38.625191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-072dd885-f460-4f40-8171-d4e2c40019f3 req-fe0c106e-d507-4c27-977f-fabdfe7d0aec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55886128-3370-4868-98e0-5b2b4e574871", "tag": "e148d4ee-0d06-4384-93e1-fa7e9028b8f1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:40:38.642221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-072dd885-f460-4f40-8171-d4e2c40019f3 req-fe0c106e-d507-4c27-977f-fabdfe7d0aec service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:38.642814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-072dd885-f460-4f40-8171-d4e2c40019f3 req-fe0c106e-d507-4c27-977f-fabdfe7d0aec service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:38.643151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-072dd885-f460-4f40-8171-d4e2c40019f3 req-fe0c106e-d507-4c27-977f-fabdfe7d0aec service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:38.666024 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-072dd885-f460-4f40-8171-d4e2c40019f3 req-fe0c106e-d507-4c27-977f-fabdfe7d0aec service nova] Creating event network-changed:e148d4ee-0d06-4384-93e1-fa7e9028b8f1 for instance 55886128-3370-4868-98e0-5b2b4e574871 on n-h2-860892-1 Oct 11 04:40:38.672024 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-072dd885-f460-4f40-8171-d4e2c40019f3 req-fe0c106e-d507-4c27-977f-fabdfe7d0aec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050636 Oct 11 04:40:38.673670 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2827/5903] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:40:38.817442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:38.818275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:38.825908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:38.826437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:38.826870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:38.827575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:38.828031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:38.828601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:39.199302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:39.208213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:39.209783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:39.211020 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d37c267a-4840-44de-ac0a-3152bc75f90a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.397691 Oct 11 04:40:39.230338 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3077/5904] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:38 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:40.240971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:40.241709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:40.260422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:40.260920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:40.268221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:40.270516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:40.271759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:40.278600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:40.844094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:40.854675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:40.856376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:40.858105 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e5354358-872a-432a-aaee-8b95d618cc89 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.621795 Oct 11 04:40:40.859122 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2828/5905] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:40 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:41.901338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:41.903076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:41.929176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:41.939979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:41.945670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:41.948441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:41.948934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:41.951386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:42.910512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:42.932510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:42.940326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:42.941751 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-25439a73-4ded-49ba-8834-d1ed9275201b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 1.058422 Oct 11 04:40:42.983418 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3078/5906] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:41 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 1103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:40:44.015064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:44.016137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:44.036710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:44.040752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:44.042411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:44.051066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:44.053946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:44.061329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:44.115287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:40:44.610276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:44.629371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:44.632139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:44.634207 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-82a07716-39a7-46b9-bdda-eb994f587858 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.623249 Oct 11 04:40:44.635442 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2829/5907] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:44 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:45.666144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:45.666789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:45.686022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:45.686572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:45.687082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:45.687808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:45.688276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:45.694787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:46.263238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:46.303306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:46.305956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:46.315064 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-42ccc6d2-e29f-4f3a-b8b8-1e1eab22a07d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.653328 Oct 11 04:40:46.330279 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3079/5908] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:45 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:47.346963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:47.348328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:47.376072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:47.377646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:47.379074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:47.388073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:47.389103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:47.395351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:47.727788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:47.745799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:47.749447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:47.750854 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bd34aa59-28a0-406c-9383-bd8801af6d1a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.408265 Oct 11 04:40:47.770230 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2830/5909] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:47 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:48.811772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:48.815257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:48.865882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:48.867628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:48.870559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:48.877538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:48.878825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:48.880495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:48.893260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=86,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:40:49.435876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:49.473790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:49.487207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:49.498874 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6f18d135-3c24-4350-8b44-25c6dd6ddefc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.707795 Oct 11 04:40:49.503946 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3080/5910] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:48 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:50.558586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:50.560079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:50.582812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:50.584250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:50.588349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:50.590004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:50.591364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:50.596236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:51.156239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:51.162636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:51.164115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:51.168084 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-882c39f7-c245-4a4d-8925-fc7d97bb7dc0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.614541 Oct 11 04:40:51.169676 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2831/5911] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:50 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:52.197705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:52.199008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:52.207390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:52.216548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:52.217307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:52.218397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:52.219906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:52.223162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:52.589739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:52.605826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:52.611814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:52.616244 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-725c6d84-9916-4ba3-80ca-366955c0e9fb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.422538 Oct 11 04:40:52.618154 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3081/5912] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:52 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:53.657806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:53.658595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:53.665468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:53.667833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:53.667833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:53.667833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:53.667833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:53.668382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:53.959611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:53.966544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:53.968229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:53.969462 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f15aa8d1-3ede-4f83-96ba-e5bfb27c5a17 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.317242 Oct 11 04:40:53.982125 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2832/5913] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:53 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:54.995841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:54.999091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:54.999539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=28 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:40:55.004316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:55.005338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:55.005833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:55.006557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:55.007007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:55.007426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:55.271673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:55.285509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:55.285509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:55.285509 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40308beb-6d0b-4bb0-b914-2562abc71ced tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.291928 Oct 11 04:40:55.285509 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3082/5914] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:54 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:56.309647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:56.310286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:56.313356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:40:56.318079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:56.318592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:56.319034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:56.319729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:56.320217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:56.320647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:56.514817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:56.528262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:56.529915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:56.531155 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce6b24e7-8d78-471e-8901-2c84af72d8cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.225571 Oct 11 04:40:56.531970 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2833/5915] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:56 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:57.557986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:57.558628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:57.565990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:57.566516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:57.566955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:57.567765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:57.568210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:57.568633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:57.737440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:57.746827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:57.748367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:57.749609 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6fd1c555-9182-46a0-bdb5-c6d2e35d8bf6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.195917 Oct 11 04:40:57.750210 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3083/5916] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:57 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:58.776503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:58.777073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:58.783707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:58.784191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:58.784637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:58.785334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:58.785789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:58.786760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:58.914555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:58.923158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:58.924602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:40:58.925805 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-39ee55f5-f7cf-466e-80a0-d7a3dbec52dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.153924 Oct 11 04:40:58.926425 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2834/5917] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:58 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:40:59.952049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:40:59.952747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:40:59.959655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:59.960139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:59.960766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:40:59.961569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:40:59.962022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:40:59.962474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:00.186755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:00.203123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:00.203123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:00.205008 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1a34ae8d-3b71-4dc3-88d2-b9b1a6fe75af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.256890 Oct 11 04:41:00.206306 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3084/5918] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:40:59 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:01.233007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:01.233822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:01.250731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:01.251330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:01.251779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:01.252594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:01.253184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:01.253685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:01.528205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:01.540591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:01.542580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:01.544630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a1ea812b-58e2-49d5-8022-4f7a5107e6af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.317213 Oct 11 04:41:01.545434 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2835/5919] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:01 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:02.572333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:02.573116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:02.580657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:02.581230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:02.581725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:02.582670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:02.583786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:02.584210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:02.824842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:02.837527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:02.839568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:02.841791 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d47aac9-ef53-4fb4-9970-2b858e81f4d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.275330 Oct 11 04:41:02.842985 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3085/5920] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:02 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:03.870454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:03.871726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:03.879857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:03.884636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:03.884636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:03.884636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:03.884636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:03.884636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:04.134355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:04.145043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:04.146573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:04.147780 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0b715a4c-9bfa-44cc-8b29-e8644fa6d532 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.285195 Oct 11 04:41:04.148351 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2836/5921] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:03 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:04.925683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b3cf9e1b-2090-4f6c-8211-4fd2d13245f1 req-4800c0c5-7a7f-46bc-9599-c600eaac3e19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55886128-3370-4868-98e0-5b2b4e574871", "name": "network-vif-plugged", "status": "completed", "tag": "e148d4ee-0d06-4384-93e1-fa7e9028b8f1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:04.944187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b3cf9e1b-2090-4f6c-8211-4fd2d13245f1 req-4800c0c5-7a7f-46bc-9599-c600eaac3e19 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:04.944670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b3cf9e1b-2090-4f6c-8211-4fd2d13245f1 req-4800c0c5-7a7f-46bc-9599-c600eaac3e19 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:04.949663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b3cf9e1b-2090-4f6c-8211-4fd2d13245f1 req-4800c0c5-7a7f-46bc-9599-c600eaac3e19 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:04.965507 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b3cf9e1b-2090-4f6c-8211-4fd2d13245f1 req-4800c0c5-7a7f-46bc-9599-c600eaac3e19 service nova] Creating event network-vif-plugged:e148d4ee-0d06-4384-93e1-fa7e9028b8f1 for instance 55886128-3370-4868-98e0-5b2b4e574871 on n-h2-860892-1 Oct 11 04:41:04.979027 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b3cf9e1b-2090-4f6c-8211-4fd2d13245f1 req-4800c0c5-7a7f-46bc-9599-c600eaac3e19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058043 Oct 11 04:41:04.979933 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3086/5922] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:41:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:05.183925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:05.186160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:05.210802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:05.211342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:05.211780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:05.212513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:05.212996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:05.213489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:05.600296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:05.618370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:05.622272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:05.623817 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02623fc0-a39a-4d20-ae6c-b4b15b47c64e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.454397 Oct 11 04:41:05.639943 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2837/5923] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:05 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:06.668241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:06.668942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:06.676643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:06.677126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:06.677565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:06.678489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:06.678944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:06.679376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:07.015179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:07.029864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:07.034895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:07.037613 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f48f4941-2a5e-48b7-bf50-89349aa84784 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.374011 Oct 11 04:41:07.038465 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3087/5924] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:06 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:07.869466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8768c771-61e9-43a8-8d31-25ed08dafab5 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:07.875811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8768c771-61e9-43a8-8d31-25ed08dafab5 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:07.888892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8768c771-61e9-43a8-8d31-25ed08dafab5 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:07.889396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8768c771-61e9-43a8-8d31-25ed08dafab5 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:07.889846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8768c771-61e9-43a8-8d31-25ed08dafab5 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:07.890609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8768c771-61e9-43a8-8d31-25ed08dafab5 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:07.891622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8768c771-61e9-43a8-8d31-25ed08dafab5 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:07.892060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8768c771-61e9-43a8-8d31-25ed08dafab5 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:07.923365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8768c771-61e9-43a8-8d31-25ed08dafab5 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/ips" status: 200 len: 150 microversion: 2.1 time: 0.057888 Oct 11 04:41:07.923858 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2838/5925] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:41:07 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/ips => generated 150 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:41:08.094352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:08.094352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:08.125970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:08.128951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:08.128951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:08.134868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:08.135742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:08.136939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:08.430651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:08.441141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:08.443693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:08.445341 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cfb9472b-651d-40b2-bd32-c771f8356059 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1808 microversion: 2.20 time: 0.378235 Oct 11 04:41:08.446562 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3088/5926] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:08 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1808 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:08.665165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1507110471", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "98d31b3b-395e-40e3-8163-31568d61b082"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:08.729440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] validate_networks() for [('98d31b3b-395e-40e3-8163-31568d61b082', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:41:09.224283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:41:09.224908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:41:09.225177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:41:09.225591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:41:09.226007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:41:09.237321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:09.238016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:09.238675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:09.239560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:09.240185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:09.240777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:09.262973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Getting quotas for project d487c5739cef471f88ff5a38cf4ef887. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:41:09.269555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Getting quotas for user cab5e2dbaf37437a8fc4d24ff21c85b0 and project d487c5739cef471f88ff5a38cf4ef887. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:41:09.286151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:41:09.291986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:41:09.455099 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a353b5a0-601b-49c1-b418-bf4a022e0226 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934652 Oct 11 04:41:09.455099 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2839/5927] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:41:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:41:09.474311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-686404d2-9ce9-4068-91a0-cc79d60f3461 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:09.490445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:09.491169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:09.500035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-686404d2-9ce9-4068-91a0-cc79d60f3461 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:09.508227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:09.508744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:09.509196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:09.509902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:09.515412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:09.516100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:09.559291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-686404d2-9ce9-4068-91a0-cc79d60f3461 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:09.583276 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-686404d2-9ce9-4068-91a0-cc79d60f3461 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1218 microversion: 2.1 time: 0.120537 Oct 11 04:41:09.586127 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3089/5928] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:09 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1218 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:09.826578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:09.836830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:09.838587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:09.839946 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-03d7c51f-fd8a-41cf-8835-9c95e98475c6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1795 microversion: 2.20 time: 0.369853 Oct 11 04:41:09.841011 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2840/5929] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:09 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1795 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:10.610405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4bd5531f-bd21-45c9-bb15-ef21be46cc9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:10.611735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4bd5531f-bd21-45c9-bb15-ef21be46cc9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:10.727180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4bd5531f-bd21-45c9-bb15-ef21be46cc9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:10.742457 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4bd5531f-bd21-45c9-bb15-ef21be46cc9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1218 microversion: 2.1 time: 0.136235 Oct 11 04:41:10.743277 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3090/5930] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:10 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1218 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:11.426049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0fb4e2d4-a5a2-4210-90c6-c0caf2ea2ab1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc085fdf-bb1d-4828-a2d8-07b43537365a"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:11.428984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0fb4e2d4-a5a2-4210-90c6-c0caf2ea2ab1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:11.440200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fb4e2d4-a5a2-4210-90c6-c0caf2ea2ab1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:11.440943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fb4e2d4-a5a2-4210-90c6-c0caf2ea2ab1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:11.442436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fb4e2d4-a5a2-4210-90c6-c0caf2ea2ab1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:11.443471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fb4e2d4-a5a2-4210-90c6-c0caf2ea2ab1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:11.444168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fb4e2d4-a5a2-4210-90c6-c0caf2ea2ab1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:11.444748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0fb4e2d4-a5a2-4210-90c6-c0caf2ea2ab1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:11.765997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-03d8b9c9-6d64-461d-9a34-4c77e30a1125 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:11.766891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-03d8b9c9-6d64-461d-9a34-4c77e30a1125 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:11.780736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d8b9c9-6d64-461d-9a34-4c77e30a1125 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:11.781234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d8b9c9-6d64-461d-9a34-4c77e30a1125 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:11.781675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d8b9c9-6d64-461d-9a34-4c77e30a1125 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:11.783069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d8b9c9-6d64-461d-9a34-4c77e30a1125 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:11.783535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d8b9c9-6d64-461d-9a34-4c77e30a1125 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:11.784227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03d8b9c9-6d64-461d-9a34-4c77e30a1125 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:11.881383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-03d8b9c9-6d64-461d-9a34-4c77e30a1125 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:11.890161 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-03d8b9c9-6d64-461d-9a34-4c77e30a1125 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1270 microversion: 2.1 time: 0.127710 Oct 11 04:41:11.890797 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3091/5931] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:11 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1270 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:12.914162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3750a754-84f2-441c-8734-3d9a99ce9843 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:12.914162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3750a754-84f2-441c-8734-3d9a99ce9843 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:12.920773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3750a754-84f2-441c-8734-3d9a99ce9843 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:12.921254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3750a754-84f2-441c-8734-3d9a99ce9843 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:12.921906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3750a754-84f2-441c-8734-3d9a99ce9843 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:12.922636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3750a754-84f2-441c-8734-3d9a99ce9843 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:12.923295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3750a754-84f2-441c-8734-3d9a99ce9843 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:12.923719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3750a754-84f2-441c-8734-3d9a99ce9843 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:12.959503 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0fb4e2d4-a5a2-4210-90c6-c0caf2ea2ab1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.535038 Oct 11 04:41:12.960724 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2841/5932] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:41:11 2022] POST /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments => generated 194 bytes in 1539 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:13.074740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3750a754-84f2-441c-8734-3d9a99ce9843 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:13.085939 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3750a754-84f2-441c-8734-3d9a99ce9843 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1278 microversion: 2.1 time: 0.176868 Oct 11 04:41:13.088493 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3092/5933] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:12 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1278 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:41:14.109672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8ecdf69b-15ef-4740-bc6b-29584dbf47ec tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:14.110421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8ecdf69b-15ef-4740-bc6b-29584dbf47ec tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:14.130234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdf69b-15ef-4740-bc6b-29584dbf47ec tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:14.130733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdf69b-15ef-4740-bc6b-29584dbf47ec tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:14.131173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdf69b-15ef-4740-bc6b-29584dbf47ec tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:14.132061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdf69b-15ef-4740-bc6b-29584dbf47ec tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:14.132675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdf69b-15ef-4740-bc6b-29584dbf47ec tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:14.133265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecdf69b-15ef-4740-bc6b-29584dbf47ec tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:14.500529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8ecdf69b-15ef-4740-bc6b-29584dbf47ec tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:14.511081 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8ecdf69b-15ef-4740-bc6b-29584dbf47ec tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1318 microversion: 2.1 time: 0.405664 Oct 11 04:41:14.517900 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2842/5934] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:14 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1318 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:15.383718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-bced5bea-a356-4786-b698-4232b8585d60 req-b7faccf5-9194-4f84-9369-bc6f492e658b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f8eff2c-d489-422a-adae-f563581c39a0", "tag": "4415657b-d9c9-4a7d-891d-239800cb8514"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:15.416165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bced5bea-a356-4786-b698-4232b8585d60 req-b7faccf5-9194-4f84-9369-bc6f492e658b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:15.416655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bced5bea-a356-4786-b698-4232b8585d60 req-b7faccf5-9194-4f84-9369-bc6f492e658b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:15.417134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bced5bea-a356-4786-b698-4232b8585d60 req-b7faccf5-9194-4f84-9369-bc6f492e658b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:15.440383 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-bced5bea-a356-4786-b698-4232b8585d60 req-b7faccf5-9194-4f84-9369-bc6f492e658b service nova] Creating event network-changed:4415657b-d9c9-4a7d-891d-239800cb8514 for instance 7f8eff2c-d489-422a-adae-f563581c39a0 on n-h2-860892-1 Oct 11 04:41:15.460079 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-bced5bea-a356-4786-b698-4232b8585d60 req-b7faccf5-9194-4f84-9369-bc6f492e658b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080508 Oct 11 04:41:15.461247 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3093/5935] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:15.536737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a2541759-39d6-4f72-bde4-0c604cc72547 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:15.537368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a2541759-39d6-4f72-bde4-0c604cc72547 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:15.548328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2541759-39d6-4f72-bde4-0c604cc72547 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:15.549097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2541759-39d6-4f72-bde4-0c604cc72547 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:15.549331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2541759-39d6-4f72-bde4-0c604cc72547 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:15.549950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2541759-39d6-4f72-bde4-0c604cc72547 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:15.550435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2541759-39d6-4f72-bde4-0c604cc72547 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:15.550868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2541759-39d6-4f72-bde4-0c604cc72547 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:15.883948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a2541759-39d6-4f72-bde4-0c604cc72547 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:15.892464 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a2541759-39d6-4f72-bde4-0c604cc72547 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1318 microversion: 2.1 time: 0.359668 Oct 11 04:41:15.906558 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2843/5936] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:15 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:16.921107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-37b63fb3-b6d8-4466-a527-792e4dbf5008 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:16.922508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-37b63fb3-b6d8-4466-a527-792e4dbf5008 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:16.935983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b63fb3-b6d8-4466-a527-792e4dbf5008 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:16.948154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b63fb3-b6d8-4466-a527-792e4dbf5008 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:16.948878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b63fb3-b6d8-4466-a527-792e4dbf5008 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:16.949878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b63fb3-b6d8-4466-a527-792e4dbf5008 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:16.950601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b63fb3-b6d8-4466-a527-792e4dbf5008 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:16.951270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b63fb3-b6d8-4466-a527-792e4dbf5008 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:17.153002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-37b63fb3-b6d8-4466-a527-792e4dbf5008 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:17.165090 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-37b63fb3-b6d8-4466-a527-792e4dbf5008 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1318 microversion: 2.1 time: 0.249729 Oct 11 04:41:17.167127 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3094/5937] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:16 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:18.188788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c43f4cc9-0d4d-4f3c-b4a1-dccb9af401f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:18.189401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c43f4cc9-0d4d-4f3c-b4a1-dccb9af401f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:18.197859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c43f4cc9-0d4d-4f3c-b4a1-dccb9af401f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:18.198618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c43f4cc9-0d4d-4f3c-b4a1-dccb9af401f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:18.203399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c43f4cc9-0d4d-4f3c-b4a1-dccb9af401f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:18.203399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c43f4cc9-0d4d-4f3c-b4a1-dccb9af401f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:18.203399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c43f4cc9-0d4d-4f3c-b4a1-dccb9af401f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:18.203399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c43f4cc9-0d4d-4f3c-b4a1-dccb9af401f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:18.379698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c43f4cc9-0d4d-4f3c-b4a1-dccb9af401f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:18.398409 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c43f4cc9-0d4d-4f3c-b4a1-dccb9af401f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1318 microversion: 2.1 time: 0.213313 Oct 11 04:41:18.399525 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2844/5938] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:18 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:19.424236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8a6ae24-5523-4ecc-bbf3-fdd0771234b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:19.425603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e8a6ae24-5523-4ecc-bbf3-fdd0771234b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:19.433789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a6ae24-5523-4ecc-bbf3-fdd0771234b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:19.434437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a6ae24-5523-4ecc-bbf3-fdd0771234b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:19.435595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a6ae24-5523-4ecc-bbf3-fdd0771234b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:19.436469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a6ae24-5523-4ecc-bbf3-fdd0771234b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:19.437141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a6ae24-5523-4ecc-bbf3-fdd0771234b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:19.437691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8a6ae24-5523-4ecc-bbf3-fdd0771234b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:19.622680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e8a6ae24-5523-4ecc-bbf3-fdd0771234b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:19.635370 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e8a6ae24-5523-4ecc-bbf3-fdd0771234b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1318 microversion: 2.1 time: 0.214574 Oct 11 04:41:19.646522 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3095/5939] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:19 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:20.655968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:20.656812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:20.661591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-32907d5d-515d-4f18-92d9-29f9a64be5d0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:20.666618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-32907d5d-515d-4f18-92d9-29f9a64be5d0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:20.668318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32907d5d-515d-4f18-92d9-29f9a64be5d0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:20.668801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32907d5d-515d-4f18-92d9-29f9a64be5d0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:20.669236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32907d5d-515d-4f18-92d9-29f9a64be5d0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:20.669921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32907d5d-515d-4f18-92d9-29f9a64be5d0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:20.670404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32907d5d-515d-4f18-92d9-29f9a64be5d0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:20.670829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32907d5d-515d-4f18-92d9-29f9a64be5d0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:20.676567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:20.856840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-32907d5d-515d-4f18-92d9-29f9a64be5d0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:20.866554 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-32907d5d-515d-4f18-92d9-29f9a64be5d0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1318 microversion: 2.1 time: 0.211483 Oct 11 04:41:20.867367 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2845/5940] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:20 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1318 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:21.893673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1ec2414f-327e-4ac5-93c1-d76ed4f58099 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:21.894545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1ec2414f-327e-4ac5-93c1-d76ed4f58099 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:21.897854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:21.903125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ec2414f-327e-4ac5-93c1-d76ed4f58099 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:21.903724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ec2414f-327e-4ac5-93c1-d76ed4f58099 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:21.904223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ec2414f-327e-4ac5-93c1-d76ed4f58099 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:21.904981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ec2414f-327e-4ac5-93c1-d76ed4f58099 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:21.905500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ec2414f-327e-4ac5-93c1-d76ed4f58099 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:21.905989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ec2414f-327e-4ac5-93c1-d76ed4f58099 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:22.048309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1ec2414f-327e-4ac5-93c1-d76ed4f58099 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:22.055925 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1ec2414f-327e-4ac5-93c1-d76ed4f58099 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1318 microversion: 2.1 time: 0.166974 Oct 11 04:41:22.056910 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3096/5941] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:21 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:23.010832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-645961ab-dee1-485b-a19a-ac25f5df708e req-8d901df2-9dc6-41e0-9ebe-e7f3c70b787a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8eff2c-d489-422a-adae-f563581c39a0", "name": "network-vif-plugged", "status": "completed", "tag": "4415657b-d9c9-4a7d-891d-239800cb8514"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:23.039018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-645961ab-dee1-485b-a19a-ac25f5df708e req-8d901df2-9dc6-41e0-9ebe-e7f3c70b787a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:23.039512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-645961ab-dee1-485b-a19a-ac25f5df708e req-8d901df2-9dc6-41e0-9ebe-e7f3c70b787a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:23.039955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-645961ab-dee1-485b-a19a-ac25f5df708e req-8d901df2-9dc6-41e0-9ebe-e7f3c70b787a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:23.061921 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-645961ab-dee1-485b-a19a-ac25f5df708e req-8d901df2-9dc6-41e0-9ebe-e7f3c70b787a service nova] Creating event network-vif-plugged:4415657b-d9c9-4a7d-891d-239800cb8514 for instance 7f8eff2c-d489-422a-adae-f563581c39a0 on n-h2-860892-1 Oct 11 04:41:23.072636 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-645961ab-dee1-485b-a19a-ac25f5df708e req-8d901df2-9dc6-41e0-9ebe-e7f3c70b787a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067821 Oct 11 04:41:23.075836 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2846/5942] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:41:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:23.087191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-171dda2f-1c8e-42cf-ac06-d24e37dde4d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:23.087191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-171dda2f-1c8e-42cf-ac06-d24e37dde4d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:23.096635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-171dda2f-1c8e-42cf-ac06-d24e37dde4d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:23.097417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-171dda2f-1c8e-42cf-ac06-d24e37dde4d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:23.101911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-171dda2f-1c8e-42cf-ac06-d24e37dde4d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:23.106371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-171dda2f-1c8e-42cf-ac06-d24e37dde4d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:23.107236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-171dda2f-1c8e-42cf-ac06-d24e37dde4d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:23.107931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-171dda2f-1c8e-42cf-ac06-d24e37dde4d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:23.648150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-171dda2f-1c8e-42cf-ac06-d24e37dde4d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:23.657330 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-171dda2f-1c8e-42cf-ac06-d24e37dde4d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1318 microversion: 2.1 time: 0.581237 Oct 11 04:41:23.673247 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3097/5943] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:23 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1318 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:24.682271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-de5f9af5-4210-47ab-aad8-dc6ab57baea4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:24.682962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-de5f9af5-4210-47ab-aad8-dc6ab57baea4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:24.692141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5f9af5-4210-47ab-aad8-dc6ab57baea4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:24.692958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5f9af5-4210-47ab-aad8-dc6ab57baea4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:24.693611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5f9af5-4210-47ab-aad8-dc6ab57baea4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:24.694500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5f9af5-4210-47ab-aad8-dc6ab57baea4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:24.695113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5f9af5-4210-47ab-aad8-dc6ab57baea4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:24.695690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5f9af5-4210-47ab-aad8-dc6ab57baea4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:24.923069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-de5f9af5-4210-47ab-aad8-dc6ab57baea4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:24.932608 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-de5f9af5-4210-47ab-aad8-dc6ab57baea4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1318 microversion: 2.1 time: 0.254565 Oct 11 04:41:24.933798 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2847/5944] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:24 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:25.957716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8ee306f2-137c-4262-bfc8-87c2ff282422 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:25.958433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8ee306f2-137c-4262-bfc8-87c2ff282422 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:25.965313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee306f2-137c-4262-bfc8-87c2ff282422 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:25.965824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee306f2-137c-4262-bfc8-87c2ff282422 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:25.966376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee306f2-137c-4262-bfc8-87c2ff282422 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:25.967221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee306f2-137c-4262-bfc8-87c2ff282422 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:25.967681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee306f2-137c-4262-bfc8-87c2ff282422 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:25.968111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ee306f2-137c-4262-bfc8-87c2ff282422 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:25.970823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=88 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:26.153766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8ee306f2-137c-4262-bfc8-87c2ff282422 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:26.164489 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8ee306f2-137c-4262-bfc8-87c2ff282422 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1507 microversion: 2.1 time: 0.211303 Oct 11 04:41:26.179711 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3098/5945] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:25 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1507 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:26.188984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c0368914-216a-4b8e-9b89-e32e2fa4854e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:26.190595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c0368914-216a-4b8e-9b89-e32e2fa4854e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:26.199882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0368914-216a-4b8e-9b89-e32e2fa4854e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.200687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0368914-216a-4b8e-9b89-e32e2fa4854e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.201942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0368914-216a-4b8e-9b89-e32e2fa4854e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.202881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0368914-216a-4b8e-9b89-e32e2fa4854e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.203547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0368914-216a-4b8e-9b89-e32e2fa4854e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.204140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0368914-216a-4b8e-9b89-e32e2fa4854e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.381431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c0368914-216a-4b8e-9b89-e32e2fa4854e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:26.392043 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c0368914-216a-4b8e-9b89-e32e2fa4854e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1507 microversion: 2.1 time: 0.207250 Oct 11 04:41:26.392974 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2848/5946] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:26 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1507 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:26.415383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:26.418443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:26.424940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.425429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.425895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.426788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.427079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.427671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.479655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc085fdf-bb1d-4828-a2d8-07b43537365a"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:26.490517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:26.497554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.498388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.498717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.500076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.500681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.501726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.568299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:41:26.568961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:41:26.569724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:41:26.570331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:41:26.570937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:41:26.700801 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Invalid volume: volume dc085fdf-bb1d-4828-a2d8-07b43537365a is already attached to instances: dd4bbbe5-3984-4e74-8958-d120a9bd63e7 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments HTTP/1.1 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 74 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: {"volumeAttachment": {"volumeId": "dc085fdf-bb1d-4828-a2d8-07b43537365a"}} Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: exception: Invalid volume: volume dc085fdf-bb1d-4828-a2d8-07b43537365a is already attached to instances: dd4bbbe5-3984-4e74-8958-d120a9bd63e7 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': 'dd4bbbe5-3984-4e74-8958-d120a9bd63e7', 'body': {'volumeAttachment': {'volumeId': 'dc085fdf-bb1d-4828-a2d8-07b43537365a'}}} Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume dc085fdf-bb1d-4828-a2d8-07b43537365a is already attached to instances: dd4bbbe5-3984-4e74-8958-d120a9bd63e7 Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:41:26.702625 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume dc085fdf-bb1d-4828-a2d8-07b43537365a is already attached to instances: dd4bbbe5-3984-4e74-8958-d120a9bd63e7 Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume dc085fdf-bb1d-4828-a2d8-07b43537365a is already attached to instances: dd4bbbe5-3984-4e74-8958-d120a9bd63e7 Oct 11 04:41:26.707477 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:26.710104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 400 to user: Invalid volume: volume dc085fdf-bb1d-4828-a2d8-07b43537365a is already attached to instances: dd4bbbe5-3984-4e74-8958-d120a9bd63e7 {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:41:26.713088 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-507e2806-64c2-46cd-b3ad-b6da77339737 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.235974 Oct 11 04:41:26.713088 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2849/5947] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:41:26 2022] POST /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments => generated 174 bytes in 237 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:41:26.782399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd56e605-50a3-44e2-994f-08a29ee49e22 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:26.783056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd56e605-50a3-44e2-994f-08a29ee49e22 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:26.801945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd56e605-50a3-44e2-994f-08a29ee49e22 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.801945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd56e605-50a3-44e2-994f-08a29ee49e22 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.801945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd56e605-50a3-44e2-994f-08a29ee49e22 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.803061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd56e605-50a3-44e2-994f-08a29ee49e22 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.803786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd56e605-50a3-44e2-994f-08a29ee49e22 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.804462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd56e605-50a3-44e2-994f-08a29ee49e22 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.810092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:26.824120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.826901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.827515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.828381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.830297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.830920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.891190 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cba9d1ff-0f2c-48a9-9924-a356376c06a8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "POST /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0/action" status: 202 len: 1109 microversion: 2.1 time: 0.479928 Oct 11 04:41:26.900894 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3099/5948] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:41:26 2022] POST /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0/action => generated 1109 bytes in 490 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 04:41:26.912645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c3a20fa5-5b1c-4e99-8a4c-e1cb77a48db3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:26.915484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c3a20fa5-5b1c-4e99-8a4c-e1cb77a48db3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:26.944688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a20fa5-5b1c-4e99-8a4c-e1cb77a48db3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.944688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a20fa5-5b1c-4e99-8a4c-e1cb77a48db3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.944688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a20fa5-5b1c-4e99-8a4c-e1cb77a48db3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.944688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a20fa5-5b1c-4e99-8a4c-e1cb77a48db3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:26.944688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a20fa5-5b1c-4e99-8a4c-e1cb77a48db3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:26.945100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a20fa5-5b1c-4e99-8a4c-e1cb77a48db3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:26.952513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-cd56e605-50a3-44e2-994f-08a29ee49e22 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lazy-loading 'services' on Instance uuid dd4bbbe5-3984-4e74-8958-d120a9bd63e7 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:41:27.104207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c3a20fa5-5b1c-4e99-8a4c-e1cb77a48db3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:27.111919 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c3a20fa5-5b1c-4e99-8a4c-e1cb77a48db3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.203535 Oct 11 04:41:27.112498 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3100/5949] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:26 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:41:27.404698 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd56e605-50a3-44e2-994f-08a29ee49e22 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments/dc085fdf-bb1d-4828-a2d8-07b43537365a" status: 202 len: 0 microversion: 2.1 time: 0.626297 Oct 11 04:41:27.405763 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2850/5950] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:41:26 2022] DELETE /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments/dc085fdf-bb1d-4828-a2d8-07b43537365a => generated 0 bytes in 628 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:41:27.420665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e300a76-f063-487d-8b49-094fb0694cf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:27.425057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e300a76-f063-487d-8b49-094fb0694cf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:27.434518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e300a76-f063-487d-8b49-094fb0694cf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:27.435169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e300a76-f063-487d-8b49-094fb0694cf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:27.435604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e300a76-f063-487d-8b49-094fb0694cf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:27.436324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e300a76-f063-487d-8b49-094fb0694cf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:27.436767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e300a76-f063-487d-8b49-094fb0694cf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:27.437178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e300a76-f063-487d-8b49-094fb0694cf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:27.471811 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e300a76-f063-487d-8b49-094fb0694cf3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060905 Oct 11 04:41:27.477417 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3101/5951] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:41:27 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:28.142236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6aeae406-940d-4061-9135-3ca9f89982b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:28.143079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6aeae406-940d-4061-9135-3ca9f89982b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:28.149853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aeae406-940d-4061-9135-3ca9f89982b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:28.150387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aeae406-940d-4061-9135-3ca9f89982b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:28.150831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aeae406-940d-4061-9135-3ca9f89982b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:28.151545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aeae406-940d-4061-9135-3ca9f89982b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:28.152001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aeae406-940d-4061-9135-3ca9f89982b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:28.152749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6aeae406-940d-4061-9135-3ca9f89982b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:28.365772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6aeae406-940d-4061-9135-3ca9f89982b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:28.382225 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6aeae406-940d-4061-9135-3ca9f89982b9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.247488 Oct 11 04:41:28.383278 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2851/5952] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:28 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:28.484898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f751aa5d-81d7-48a1-85e4-e17b5ed06e41 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:28.488878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f751aa5d-81d7-48a1-85e4-e17b5ed06e41 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:28.492703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=48 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:28.496368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f751aa5d-81d7-48a1-85e4-e17b5ed06e41 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:28.497331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f751aa5d-81d7-48a1-85e4-e17b5ed06e41 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:28.497981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f751aa5d-81d7-48a1-85e4-e17b5ed06e41 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:28.498922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f751aa5d-81d7-48a1-85e4-e17b5ed06e41 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:28.499779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f751aa5d-81d7-48a1-85e4-e17b5ed06e41 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:28.500289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f751aa5d-81d7-48a1-85e4-e17b5ed06e41 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:28.533476 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f751aa5d-81d7-48a1-85e4-e17b5ed06e41 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052499 Oct 11 04:41:28.534718 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3102/5953] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:41:28 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:29.901890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-58f72b1f-18fe-41c7-b680-32562b2b0ed0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:29.901890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-58f72b1f-18fe-41c7-b680-32562b2b0ed0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:29.901890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58f72b1f-18fe-41c7-b680-32562b2b0ed0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:29.901890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58f72b1f-18fe-41c7-b680-32562b2b0ed0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:29.901890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58f72b1f-18fe-41c7-b680-32562b2b0ed0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:29.901890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58f72b1f-18fe-41c7-b680-32562b2b0ed0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:29.901890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58f72b1f-18fe-41c7-b680-32562b2b0ed0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:29.901890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58f72b1f-18fe-41c7-b680-32562b2b0ed0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:29.904511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b846f8d1-2f0e-451e-88a2-6d82dd440fb2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:29.904511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b846f8d1-2f0e-451e-88a2-6d82dd440fb2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:29.904511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b846f8d1-2f0e-451e-88a2-6d82dd440fb2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:29.904511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b846f8d1-2f0e-451e-88a2-6d82dd440fb2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:29.904511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b846f8d1-2f0e-451e-88a2-6d82dd440fb2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:29.904511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b846f8d1-2f0e-451e-88a2-6d82dd440fb2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:29.904511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b846f8d1-2f0e-451e-88a2-6d82dd440fb2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:29.904511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b846f8d1-2f0e-451e-88a2-6d82dd440fb2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:29.906014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-58f72b1f-18fe-41c7-b680-32562b2b0ed0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:29.906014 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-58f72b1f-18fe-41c7-b680-32562b2b0ed0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.177835 Oct 11 04:41:29.906014 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2852/5954] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:29 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:29.906767 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b846f8d1-2f0e-451e-88a2-6d82dd440fb2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050387 Oct 11 04:41:29.906767 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3103/5955] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:41:29 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:41:30.828847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-52b94824-ff7a-4397-bc17-80eb4c7edaa0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:30.831241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-52b94824-ff7a-4397-bc17-80eb4c7edaa0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:30.842768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f753c7ce-2d13-4e3f-b288-95f566480ca7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:30.843586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f753c7ce-2d13-4e3f-b288-95f566480ca7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:30.847961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b94824-ff7a-4397-bc17-80eb4c7edaa0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:30.850751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b94824-ff7a-4397-bc17-80eb4c7edaa0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:30.852080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b94824-ff7a-4397-bc17-80eb4c7edaa0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:30.855444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f753c7ce-2d13-4e3f-b288-95f566480ca7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:30.856376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f753c7ce-2d13-4e3f-b288-95f566480ca7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:30.856509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b94824-ff7a-4397-bc17-80eb4c7edaa0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:30.856963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b94824-ff7a-4397-bc17-80eb4c7edaa0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:30.857297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f753c7ce-2d13-4e3f-b288-95f566480ca7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:30.857425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-52b94824-ff7a-4397-bc17-80eb4c7edaa0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:30.858290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f753c7ce-2d13-4e3f-b288-95f566480ca7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:30.859003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f753c7ce-2d13-4e3f-b288-95f566480ca7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:30.859624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f753c7ce-2d13-4e3f-b288-95f566480ca7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:30.911187 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-52b94824-ff7a-4397-bc17-80eb4c7edaa0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.086179 Oct 11 04:41:30.913161 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2853/5956] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:41:30 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:31.065995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f753c7ce-2d13-4e3f-b288-95f566480ca7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:31.076333 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f753c7ce-2d13-4e3f-b288-95f566480ca7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.240964 Oct 11 04:41:31.078274 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3104/5957] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:30 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:41:31.924848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae969541-0b59-49c8-90fd-e638fe8ad133 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:31.927719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ae969541-0b59-49c8-90fd-e638fe8ad133 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:31.930769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:31.936633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae969541-0b59-49c8-90fd-e638fe8ad133 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:31.937125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae969541-0b59-49c8-90fd-e638fe8ad133 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:31.937564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae969541-0b59-49c8-90fd-e638fe8ad133 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:31.938302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae969541-0b59-49c8-90fd-e638fe8ad133 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:31.938776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae969541-0b59-49c8-90fd-e638fe8ad133 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:31.939189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae969541-0b59-49c8-90fd-e638fe8ad133 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:31.970514 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ae969541-0b59-49c8-90fd-e638fe8ad133 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050247 Oct 11 04:41:31.971332 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2854/5958] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:41:31 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:32.102283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d9e7dc9-27a3-49ca-8f9b-045f9e97a027 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:32.103763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2d9e7dc9-27a3-49ca-8f9b-045f9e97a027 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:32.114659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d9e7dc9-27a3-49ca-8f9b-045f9e97a027 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:32.115664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d9e7dc9-27a3-49ca-8f9b-045f9e97a027 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:32.116586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d9e7dc9-27a3-49ca-8f9b-045f9e97a027 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:32.117462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d9e7dc9-27a3-49ca-8f9b-045f9e97a027 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:32.118113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d9e7dc9-27a3-49ca-8f9b-045f9e97a027 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:32.118950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d9e7dc9-27a3-49ca-8f9b-045f9e97a027 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:32.285152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d9e7dc9-27a3-49ca-8f9b-045f9e97a027 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:32.293990 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d9e7dc9-27a3-49ca-8f9b-045f9e97a027 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.197161 Oct 11 04:41:32.294827 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3105/5959] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:32 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:32.984013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-08026ea1-c667-4d97-a3fb-838c73dfca52 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:32.987191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-08026ea1-c667-4d97-a3fb-838c73dfca52 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:32.996694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08026ea1-c667-4d97-a3fb-838c73dfca52 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:33.002800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08026ea1-c667-4d97-a3fb-838c73dfca52 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:33.002800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08026ea1-c667-4d97-a3fb-838c73dfca52 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:33.002800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08026ea1-c667-4d97-a3fb-838c73dfca52 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:33.002800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08026ea1-c667-4d97-a3fb-838c73dfca52 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:33.002800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08026ea1-c667-4d97-a3fb-838c73dfca52 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:33.043154 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-08026ea1-c667-4d97-a3fb-838c73dfca52 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063121 Oct 11 04:41:33.044381 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2855/5960] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:41:32 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:33.318870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-056528d6-5a1f-4b22-b14a-a49e81c3f9d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:33.319489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-056528d6-5a1f-4b22-b14a-a49e81c3f9d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:33.327016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056528d6-5a1f-4b22-b14a-a49e81c3f9d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:33.327515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056528d6-5a1f-4b22-b14a-a49e81c3f9d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:33.328659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056528d6-5a1f-4b22-b14a-a49e81c3f9d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:33.329651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056528d6-5a1f-4b22-b14a-a49e81c3f9d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:33.330308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056528d6-5a1f-4b22-b14a-a49e81c3f9d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:33.330927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-056528d6-5a1f-4b22-b14a-a49e81c3f9d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:33.492732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-056528d6-5a1f-4b22-b14a-a49e81c3f9d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:33.500538 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-056528d6-5a1f-4b22-b14a-a49e81c3f9d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.186001 Oct 11 04:41:33.501395 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3106/5961] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:33 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:34.057474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5b0a8cb4-03aa-4109-9dd9-d15c00caaa95 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:34.061241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5b0a8cb4-03aa-4109-9dd9-d15c00caaa95 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:34.074841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b0a8cb4-03aa-4109-9dd9-d15c00caaa95 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:34.075326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b0a8cb4-03aa-4109-9dd9-d15c00caaa95 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:34.077842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b0a8cb4-03aa-4109-9dd9-d15c00caaa95 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:34.078794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b0a8cb4-03aa-4109-9dd9-d15c00caaa95 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:34.079119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b0a8cb4-03aa-4109-9dd9-d15c00caaa95 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:34.079555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b0a8cb4-03aa-4109-9dd9-d15c00caaa95 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:34.117313 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5b0a8cb4-03aa-4109-9dd9-d15c00caaa95 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063724 Oct 11 04:41:34.118751 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2856/5962] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:41:34 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7/os-volume_attachments => generated 25 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:41:34.206043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8350b770-12fd-413f-ad77-6d5a3bbc87a3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:34.207125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8350b770-12fd-413f-ad77-6d5a3bbc87a3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:34.216272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8350b770-12fd-413f-ad77-6d5a3bbc87a3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:34.216782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8350b770-12fd-413f-ad77-6d5a3bbc87a3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:34.217206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8350b770-12fd-413f-ad77-6d5a3bbc87a3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:34.217912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8350b770-12fd-413f-ad77-6d5a3bbc87a3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:34.218396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8350b770-12fd-413f-ad77-6d5a3bbc87a3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:34.218891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8350b770-12fd-413f-ad77-6d5a3bbc87a3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:34.254875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8350b770-12fd-413f-ad77-6d5a3bbc87a3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:41:34.525222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-583cc9d4-41b8-4352-ae92-544d6d3a4fcf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:34.526275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-583cc9d4-41b8-4352-ae92-544d6d3a4fcf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:34.536323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-583cc9d4-41b8-4352-ae92-544d6d3a4fcf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:34.539660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-583cc9d4-41b8-4352-ae92-544d6d3a4fcf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:34.540117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-583cc9d4-41b8-4352-ae92-544d6d3a4fcf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:34.540842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-583cc9d4-41b8-4352-ae92-544d6d3a4fcf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:34.541564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-583cc9d4-41b8-4352-ae92-544d6d3a4fcf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:34.542011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-583cc9d4-41b8-4352-ae92-544d6d3a4fcf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:34.685905 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8350b770-12fd-413f-ad77-6d5a3bbc87a3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 204 len: 0 microversion: 2.1 time: 0.481872 Oct 11 04:41:34.692381 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3107/5963] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:41:34 2022] DELETE /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 0 bytes in 488 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:41:34.706988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-583cc9d4-41b8-4352-ae92-544d6d3a4fcf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:34.711352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-301fb4a0-fdc9-4f7e-a672-09ddd9de1266 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:34.714417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-301fb4a0-fdc9-4f7e-a672-09ddd9de1266 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:34.733428 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-583cc9d4-41b8-4352-ae92-544d6d3a4fcf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.212821 Oct 11 04:41:34.735114 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2857/5964] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:34 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:41:34.753182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301fb4a0-fdc9-4f7e-a672-09ddd9de1266 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:34.754326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301fb4a0-fdc9-4f7e-a672-09ddd9de1266 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:34.754778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301fb4a0-fdc9-4f7e-a672-09ddd9de1266 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:34.759305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301fb4a0-fdc9-4f7e-a672-09ddd9de1266 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:34.759840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301fb4a0-fdc9-4f7e-a672-09ddd9de1266 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:34.778149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-301fb4a0-fdc9-4f7e-a672-09ddd9de1266 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:34.957006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-301fb4a0-fdc9-4f7e-a672-09ddd9de1266 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:34.966850 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-301fb4a0-fdc9-4f7e-a672-09ddd9de1266 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1681 microversion: 2.1 time: 0.269378 Oct 11 04:41:34.967879 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3108/5965] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:34 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1681 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:35.759751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce69ff42-c7d3-4d39-a986-47403f1e8282 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:35.760466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce69ff42-c7d3-4d39-a986-47403f1e8282 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:35.768055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce69ff42-c7d3-4d39-a986-47403f1e8282 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:35.768856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce69ff42-c7d3-4d39-a986-47403f1e8282 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:35.769516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce69ff42-c7d3-4d39-a986-47403f1e8282 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:35.770656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce69ff42-c7d3-4d39-a986-47403f1e8282 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:35.771112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce69ff42-c7d3-4d39-a986-47403f1e8282 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:35.771541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce69ff42-c7d3-4d39-a986-47403f1e8282 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:35.958933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce69ff42-c7d3-4d39-a986-47403f1e8282 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:35.967303 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce69ff42-c7d3-4d39-a986-47403f1e8282 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.211684 Oct 11 04:41:35.967987 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2858/5966] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:35 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:41:35.993141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1cae21ea-a6a1-4e94-945d-91c55513c310 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:35.993767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1cae21ea-a6a1-4e94-945d-91c55513c310 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:36.001272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cae21ea-a6a1-4e94-945d-91c55513c310 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:36.001765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cae21ea-a6a1-4e94-945d-91c55513c310 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:36.002214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cae21ea-a6a1-4e94-945d-91c55513c310 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:36.003034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cae21ea-a6a1-4e94-945d-91c55513c310 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:36.003520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cae21ea-a6a1-4e94-945d-91c55513c310 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:36.003944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cae21ea-a6a1-4e94-945d-91c55513c310 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:36.159201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1cae21ea-a6a1-4e94-945d-91c55513c310 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:36.167819 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1cae21ea-a6a1-4e94-945d-91c55513c310 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1681 microversion: 2.1 time: 0.178823 Oct 11 04:41:36.168409 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3109/5967] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:35 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:36.991391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-15b56329-336a-4284-9bb8-58218887ca8c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:36.995183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-15b56329-336a-4284-9bb8-58218887ca8c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:37.009765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15b56329-336a-4284-9bb8-58218887ca8c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:37.010549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15b56329-336a-4284-9bb8-58218887ca8c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:37.011154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15b56329-336a-4284-9bb8-58218887ca8c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:37.012043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15b56329-336a-4284-9bb8-58218887ca8c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:37.012654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15b56329-336a-4284-9bb8-58218887ca8c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:37.013239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15b56329-336a-4284-9bb8-58218887ca8c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:37.173244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-15b56329-336a-4284-9bb8-58218887ca8c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:37.181169 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-15b56329-336a-4284-9bb8-58218887ca8c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.193711 Oct 11 04:41:37.186286 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2859/5968] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:36 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:37.192698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13464739-5881-48d1-8871-dc801d1057d0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:37.193972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-13464739-5881-48d1-8871-dc801d1057d0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:37.202455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13464739-5881-48d1-8871-dc801d1057d0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:37.203177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13464739-5881-48d1-8871-dc801d1057d0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:37.203620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13464739-5881-48d1-8871-dc801d1057d0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:37.204319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13464739-5881-48d1-8871-dc801d1057d0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:37.204775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13464739-5881-48d1-8871-dc801d1057d0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:37.205198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13464739-5881-48d1-8871-dc801d1057d0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:37.569784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-13464739-5881-48d1-8871-dc801d1057d0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:37.583727 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-13464739-5881-48d1-8871-dc801d1057d0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1681 microversion: 2.1 time: 0.395946 Oct 11 04:41:37.584961 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3110/5969] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:37 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1681 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:37.700247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c00accc4-f53f-4dd0-ace4-6927cf2fffd3 req-ea644869-a964-4f28-a0e4-bb0e627a8e2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd4bbbe5-3984-4e74-8958-d120a9bd63e7", "name": "network-vif-deleted", "tag": "9b7e2c28-d133-427e-9ee1-9f088dab4ed3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:37.715246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c00accc4-f53f-4dd0-ace4-6927cf2fffd3 req-ea644869-a964-4f28-a0e4-bb0e627a8e2f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:37.718794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c00accc4-f53f-4dd0-ace4-6927cf2fffd3 req-ea644869-a964-4f28-a0e4-bb0e627a8e2f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:37.722137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c00accc4-f53f-4dd0-ace4-6927cf2fffd3 req-ea644869-a964-4f28-a0e4-bb0e627a8e2f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:37.742308 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c00accc4-f53f-4dd0-ace4-6927cf2fffd3 req-ea644869-a964-4f28-a0e4-bb0e627a8e2f service nova] Creating event network-vif-deleted:9b7e2c28-d133-427e-9ee1-9f088dab4ed3 for instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 on n-h1-860892-1 Oct 11 04:41:37.763604 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c00accc4-f53f-4dd0-ace4-6927cf2fffd3 req-ea644869-a964-4f28-a0e4-bb0e627a8e2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067073 Oct 11 04:41:37.767092 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2860/5970] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:38.205577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1220854a-63a3-4a55-9c84-b76ca7402526 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:38.206280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1220854a-63a3-4a55-9c84-b76ca7402526 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:38.214753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1220854a-63a3-4a55-9c84-b76ca7402526 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:38.216646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1220854a-63a3-4a55-9c84-b76ca7402526 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:38.217277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1220854a-63a3-4a55-9c84-b76ca7402526 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:38.218806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1220854a-63a3-4a55-9c84-b76ca7402526 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:38.219430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1220854a-63a3-4a55-9c84-b76ca7402526 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:38.220176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1220854a-63a3-4a55-9c84-b76ca7402526 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:38.223513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:38.489506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1220854a-63a3-4a55-9c84-b76ca7402526 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:38.499342 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1220854a-63a3-4a55-9c84-b76ca7402526 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.297927 Oct 11 04:41:38.517258 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3111/5971] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:38 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:38.609249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:38.610574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:38.618487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:38.619230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:38.619871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:38.620770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:38.621409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:38.624709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:38.674861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:38.682697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:38.682697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:38.682697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lazy-loading 'fault' on Instance uuid dd4bbbe5-3984-4e74-8958-d120a9bd63e7 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:41:38.724397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:38.734179 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-345f6737-6bcd-454a-a2e9-87f973db41cf tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 200 len: 1330 microversion: 2.1 time: 0.129626 Oct 11 04:41:38.735423 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2861/5972] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:38 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 1330 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:39.527309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-52b5b596-1929-401a-9880-84d3cca8a83e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:39.528101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-52b5b596-1929-401a-9880-84d3cca8a83e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:39.538108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b5b596-1929-401a-9880-84d3cca8a83e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:39.538632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b5b596-1929-401a-9880-84d3cca8a83e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:39.539071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b5b596-1929-401a-9880-84d3cca8a83e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:39.539781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b5b596-1929-401a-9880-84d3cca8a83e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:39.540229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b5b596-1929-401a-9880-84d3cca8a83e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:39.540650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b5b596-1929-401a-9880-84d3cca8a83e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:39.688598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-52b5b596-1929-401a-9880-84d3cca8a83e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:39.697327 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-52b5b596-1929-401a-9880-84d3cca8a83e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.175147 Oct 11 04:41:39.697982 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3112/5973] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:39 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:39.758246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:39.758808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:39.766477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:39.767216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:39.767856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:39.768549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:39.769552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:39.769979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:39.772790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:39.784795 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 HTTP/1.1 Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'dd4bbbe5-3984-4e74-8958-d120a9bd63e7'} Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:41:39.786487 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:39.791626 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:41:39.791626 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:41:39.791626 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:41:39.791626 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:41:39.791626 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:41:39.791626 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:41:39.791626 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:39.791626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:41:39.791626 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d7ed5744-65b7-4ec7-9132-8d615cbdc2e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 404 len: 111 microversion: 2.1 time: 0.033701 Oct 11 04:41:39.791626 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2862/5974] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:39 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:41:39.797075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b214fe86-f9b3-47b2-8102-1a6c4d978926 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '.version_select at 0x7fda18cb30d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:39.803571 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b214fe86-f9b3-47b2-8102-1a6c4d978926 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [691f8a8c-7df7-497f-bde1-33a440ea6a9b] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 04:41:40.461057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b6e113df-feb8-4212-b78d-baf81ccaf161 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:40.461568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b6e113df-feb8-4212-b78d-baf81ccaf161 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:40.470861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6e113df-feb8-4212-b78d-baf81ccaf161 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:40.471362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6e113df-feb8-4212-b78d-baf81ccaf161 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:40.471786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6e113df-feb8-4212-b78d-baf81ccaf161 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:40.472692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6e113df-feb8-4212-b78d-baf81ccaf161 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:40.473152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6e113df-feb8-4212-b78d-baf81ccaf161 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:40.482834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6e113df-feb8-4212-b78d-baf81ccaf161 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:40.535670 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b6e113df-feb8-4212-b78d-baf81ccaf161 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments/9df427ec-83e3-4b36-90cd-508548ab17a8" status: 200 len: 194 microversion: 2.20 time: 0.078487 Oct 11 04:41:40.538475 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2863/5975] 10.222.0.26 () {60 vars in 1454 bytes} [Tue Oct 11 04:41:40 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments/9df427ec-83e3-4b36-90cd-508548ab17a8 => generated 194 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:41:40.624945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c0cb0d48-815a-4d48-8142-95af8e025434 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:40.625697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c0cb0d48-815a-4d48-8142-95af8e025434 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:40.632784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0cb0d48-815a-4d48-8142-95af8e025434 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:40.633482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0cb0d48-815a-4d48-8142-95af8e025434 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:40.634105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0cb0d48-815a-4d48-8142-95af8e025434 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:40.634843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0cb0d48-815a-4d48-8142-95af8e025434 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:40.635407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0cb0d48-815a-4d48-8142-95af8e025434 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:40.636001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c0cb0d48-815a-4d48-8142-95af8e025434 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:40.726517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-c0cb0d48-815a-4d48-8142-95af8e025434 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lazy-loading 'services' on Instance uuid 55886128-3370-4868-98e0-5b2b4e574871 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:41:40.811989 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [None req-b214fe86-f9b3-47b2-8102-1a6c4d978926 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [691f8a8c-7df7-497f-bde1-33a440ea6a9b] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39788. Oct 11 04:41:40.971080 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b214fe86-f9b3-47b2-8102-1a6c4d978926 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-664527614" status: 202 len: 0 microversion: 2.1 time: 1.177751 Oct 11 04:41:40.971675 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3113/5976] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:41:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-664527614 => generated 0 bytes in 1179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:41:40.977836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c3ad8e53-7ce8-49b3-bc6f-f8859f2d7cab tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:40.978486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c3ad8e53-7ce8-49b3-bc6f-f8859f2d7cab tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:40.985316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3ad8e53-7ce8-49b3-bc6f-f8859f2d7cab tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:40.985804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3ad8e53-7ce8-49b3-bc6f-f8859f2d7cab tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:40.986465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3ad8e53-7ce8-49b3-bc6f-f8859f2d7cab tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:40.987174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3ad8e53-7ce8-49b3-bc6f-f8859f2d7cab tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:40.987686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3ad8e53-7ce8-49b3-bc6f-f8859f2d7cab tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:40.989041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3ad8e53-7ce8-49b3-bc6f-f8859f2d7cab tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:41.122208 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c0cb0d48-815a-4d48-8142-95af8e025434 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "DELETE /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments/9df427ec-83e3-4b36-90cd-508548ab17a8" status: 202 len: 0 microversion: 2.20 time: 0.500309 Oct 11 04:41:41.125252 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2864/5977] 10.222.0.26 () {60 vars in 1457 bytes} [Tue Oct 11 04:41:40 2022] DELETE /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments/9df427ec-83e3-4b36-90cd-508548ab17a8 => generated 0 bytes in 505 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:41:41.137301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3803d944-48f3-451a-a093-45b75408a909 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:41.139793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3803d944-48f3-451a-a093-45b75408a909 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:41.170245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3803d944-48f3-451a-a093-45b75408a909 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:41.170245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3803d944-48f3-451a-a093-45b75408a909 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:41.170245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3803d944-48f3-451a-a093-45b75408a909 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:41.173482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3803d944-48f3-451a-a093-45b75408a909 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:41.173993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3803d944-48f3-451a-a093-45b75408a909 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:41.174491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3803d944-48f3-451a-a093-45b75408a909 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:41.229860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c3ad8e53-7ce8-49b3-bc6f-f8859f2d7cab tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:41.241662 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c3ad8e53-7ce8-49b3-bc6f-f8859f2d7cab tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.268386 Oct 11 04:41:41.242173 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3803d944-48f3-451a-a093-45b75408a909 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.109163 Oct 11 04:41:41.242792 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2865/5978] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:41:41 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:41:41.256771 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3114/5979] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:40 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:42.282669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-55073f5e-9945-4b38-98fe-a525dfc54f06 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:42.286747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-feb7ffe4-7c20-4080-8cd1-960dfaebe780 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:42.288217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-feb7ffe4-7c20-4080-8cd1-960dfaebe780 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:42.293121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-55073f5e-9945-4b38-98fe-a525dfc54f06 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:42.305742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feb7ffe4-7c20-4080-8cd1-960dfaebe780 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:42.306557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feb7ffe4-7c20-4080-8cd1-960dfaebe780 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:42.308877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feb7ffe4-7c20-4080-8cd1-960dfaebe780 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:42.309381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55073f5e-9945-4b38-98fe-a525dfc54f06 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:42.309680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feb7ffe4-7c20-4080-8cd1-960dfaebe780 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:42.311644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55073f5e-9945-4b38-98fe-a525dfc54f06 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:42.311781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feb7ffe4-7c20-4080-8cd1-960dfaebe780 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:42.312318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-feb7ffe4-7c20-4080-8cd1-960dfaebe780 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:42.313966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55073f5e-9945-4b38-98fe-a525dfc54f06 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:42.314755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55073f5e-9945-4b38-98fe-a525dfc54f06 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:42.315244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55073f5e-9945-4b38-98fe-a525dfc54f06 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:42.317876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55073f5e-9945-4b38-98fe-a525dfc54f06 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:42.368269 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-55073f5e-9945-4b38-98fe-a525dfc54f06 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.094507 Oct 11 04:41:42.369157 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3115/5980] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:41:42 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:41:42.374795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb1d927a-3db9-4933-9260-82abf089d520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: .version_select at 0x7fda19325790>, body: {"keypair": {"name": "tempest-keypair-734027413", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPubdStmpnUVUBii8oBZhbYh8N0C1R0sMZ9QtOBt9mzoYS3g8TTrD9JsG0YtfF93kKOMEvwbV9s7MpLD0Yryy8ga5ldlcvKgyiPM7u97zI8PvySwe7zhWw2Dc/E0ZOGxOw=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:42.394096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-bb1d927a-3db9-4933-9260-82abf089d520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:41:42.399481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-bb1d927a-3db9-4933-9260-82abf089d520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for user 285715b491b34b90b2a3fcf0e268be46 and project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:41:42.494433 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb1d927a-3db9-4933-9260-82abf089d520 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.123717 Oct 11 04:41:42.495497 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3116/5981] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:41:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:42.541732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-feb7ffe4-7c20-4080-8cd1-960dfaebe780 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:42.552365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-feb7ffe4-7c20-4080-8cd1-960dfaebe780 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.279631 Oct 11 04:41:42.553368 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2866/5982] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:42 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:41:43.382087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fdf5fecc-df29-48d2-a923-2265afb5ac42 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:43.385261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fdf5fecc-df29-48d2-a923-2265afb5ac42 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:43.395847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdf5fecc-df29-48d2-a923-2265afb5ac42 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:43.396565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdf5fecc-df29-48d2-a923-2265afb5ac42 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:43.397198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdf5fecc-df29-48d2-a923-2265afb5ac42 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:43.398138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdf5fecc-df29-48d2-a923-2265afb5ac42 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:43.398803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdf5fecc-df29-48d2-a923-2265afb5ac42 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:43.401638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fdf5fecc-df29-48d2-a923-2265afb5ac42 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:43.440191 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fdf5fecc-df29-48d2-a923-2265afb5ac42 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063211 Oct 11 04:41:43.441537 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3117/5983] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:41:43 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:41:43.580191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b1354c7-f756-4980-9132-e142bdefa97f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:43.583438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b1354c7-f756-4980-9132-e142bdefa97f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:43.593561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b1354c7-f756-4980-9132-e142bdefa97f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:43.594068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b1354c7-f756-4980-9132-e142bdefa97f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:43.594765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b1354c7-f756-4980-9132-e142bdefa97f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:43.595491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b1354c7-f756-4980-9132-e142bdefa97f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:43.595953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b1354c7-f756-4980-9132-e142bdefa97f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:43.596387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b1354c7-f756-4980-9132-e142bdefa97f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:43.765366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b1354c7-f756-4980-9132-e142bdefa97f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:43.774830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b1354c7-f756-4980-9132-e142bdefa97f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.200342 Oct 11 04:41:43.774944 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2867/5984] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:43 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:44.454624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0fcbcf07-ecab-4c5d-999f-8185dafb5554 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:44.457487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0fcbcf07-ecab-4c5d-999f-8185dafb5554 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:44.471905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fcbcf07-ecab-4c5d-999f-8185dafb5554 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:44.473205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fcbcf07-ecab-4c5d-999f-8185dafb5554 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:44.474138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fcbcf07-ecab-4c5d-999f-8185dafb5554 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:44.482430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fcbcf07-ecab-4c5d-999f-8185dafb5554 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:44.482430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fcbcf07-ecab-4c5d-999f-8185dafb5554 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:44.482430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fcbcf07-ecab-4c5d-999f-8185dafb5554 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:44.514547 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0fcbcf07-ecab-4c5d-999f-8185dafb5554 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064515 Oct 11 04:41:44.520544 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3118/5985] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:41:44 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:41:44.799495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-56c7b3ca-604a-454e-b38c-7d245dbca388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:44.800310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-56c7b3ca-604a-454e-b38c-7d245dbca388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:44.807334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56c7b3ca-604a-454e-b38c-7d245dbca388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:44.807819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56c7b3ca-604a-454e-b38c-7d245dbca388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:44.808261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56c7b3ca-604a-454e-b38c-7d245dbca388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:44.808959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56c7b3ca-604a-454e-b38c-7d245dbca388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:44.809412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56c7b3ca-604a-454e-b38c-7d245dbca388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:44.809837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56c7b3ca-604a-454e-b38c-7d245dbca388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:45.043680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-56c7b3ca-604a-454e-b38c-7d245dbca388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:45.065637 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-56c7b3ca-604a-454e-b38c-7d245dbca388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.265395 Oct 11 04:41:45.066290 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2868/5986] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:44 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:45.528792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0e4cf85e-b8f7-4823-8aa8-a74a5eb288dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:45.531095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0e4cf85e-b8f7-4823-8aa8-a74a5eb288dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:45.538329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4cf85e-b8f7-4823-8aa8-a74a5eb288dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:45.538811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4cf85e-b8f7-4823-8aa8-a74a5eb288dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:45.539243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4cf85e-b8f7-4823-8aa8-a74a5eb288dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:45.539928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4cf85e-b8f7-4823-8aa8-a74a5eb288dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:45.540408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4cf85e-b8f7-4823-8aa8-a74a5eb288dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:45.540885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e4cf85e-b8f7-4823-8aa8-a74a5eb288dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:45.574484 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0e4cf85e-b8f7-4823-8aa8-a74a5eb288dd tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049493 Oct 11 04:41:45.575495 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3119/5987] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:41:45 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:41:46.093775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f2c8e8e-18d1-40fd-9eee-fb61a8f2f5ad tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:46.094558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f2c8e8e-18d1-40fd-9eee-fb61a8f2f5ad tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:46.101557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f2c8e8e-18d1-40fd-9eee-fb61a8f2f5ad tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:46.102162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f2c8e8e-18d1-40fd-9eee-fb61a8f2f5ad tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:46.102735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f2c8e8e-18d1-40fd-9eee-fb61a8f2f5ad tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:46.104340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f2c8e8e-18d1-40fd-9eee-fb61a8f2f5ad tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:46.104917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f2c8e8e-18d1-40fd-9eee-fb61a8f2f5ad tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:46.105563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f2c8e8e-18d1-40fd-9eee-fb61a8f2f5ad tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:46.250640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0f2c8e8e-18d1-40fd-9eee-fb61a8f2f5ad tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:46.259997 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f2c8e8e-18d1-40fd-9eee-fb61a8f2f5ad tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.169932 Oct 11 04:41:46.261482 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2869/5988] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:46 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:46.276178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-900355920", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "515fe902-bb8c-47e9-944d-01e95f3d351a"}], "security_groups": [{"name": "tempest-securitygroup--190612177"}], "key_name": "tempest-keypair-734027413", "user_data": "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:46.439002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] validate_networks() for [('515fe902-bb8c-47e9-944d-01e95f3d351a', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:41:46.587998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a2484079-6c27-4d41-9cea-b27a3e821009 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:46.590618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a2484079-6c27-4d41-9cea-b27a3e821009 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:46.597355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2484079-6c27-4d41-9cea-b27a3e821009 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:46.598065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2484079-6c27-4d41-9cea-b27a3e821009 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:46.598535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2484079-6c27-4d41-9cea-b27a3e821009 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:46.599244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2484079-6c27-4d41-9cea-b27a3e821009 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:46.599700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2484079-6c27-4d41-9cea-b27a3e821009 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:46.600134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2484079-6c27-4d41-9cea-b27a3e821009 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:46.639812 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a2484079-6c27-4d41-9cea-b27a3e821009 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056012 Oct 11 04:41:46.640835 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2870/5989] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:41:46 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:41:47.298559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e1991da-9da5-4d8e-9466-d90a31b66e3a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:47.302172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9e1991da-9da5-4d8e-9466-d90a31b66e3a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:47.327995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e1991da-9da5-4d8e-9466-d90a31b66e3a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:47.328734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e1991da-9da5-4d8e-9466-d90a31b66e3a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:47.329804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e1991da-9da5-4d8e-9466-d90a31b66e3a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:47.333569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e1991da-9da5-4d8e-9466-d90a31b66e3a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:47.337651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e1991da-9da5-4d8e-9466-d90a31b66e3a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:47.337651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e1991da-9da5-4d8e-9466-d90a31b66e3a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:47.445540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:41:47.446083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:41:47.446464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:41:47.447518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:41:47.447944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:41:47.462669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:47.464374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:47.465709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:47.466909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:47.468218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:47.472741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:47.531391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:41:47.541887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Getting quotas for user 285715b491b34b90b2a3fcf0e268be46 and project 5e112e065faf4ff0b3e486e2ab662af3. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:41:47.544401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9e1991da-9da5-4d8e-9466-d90a31b66e3a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:47.555692 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9e1991da-9da5-4d8e-9466-d90a31b66e3a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.273354 Oct 11 04:41:47.555692 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2871/5990] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:47 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:41:47.557097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:41:47.559527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:41:47.653096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-84886f62-bf8d-4fbd-9afd-06dd87226cc6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:47.655375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-84886f62-bf8d-4fbd-9afd-06dd87226cc6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:47.661723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84886f62-bf8d-4fbd-9afd-06dd87226cc6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:47.662227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84886f62-bf8d-4fbd-9afd-06dd87226cc6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:47.662667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84886f62-bf8d-4fbd-9afd-06dd87226cc6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:47.663361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84886f62-bf8d-4fbd-9afd-06dd87226cc6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:47.663919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84886f62-bf8d-4fbd-9afd-06dd87226cc6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:47.664244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84886f62-bf8d-4fbd-9afd-06dd87226cc6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:47.717209 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-84886f62-bf8d-4fbd-9afd-06dd87226cc6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.068152 Oct 11 04:41:47.723409 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2872/5991] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:41:47 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:41:47.723674 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-65b3d764-5d2e-472a-9cde-6adfe72d3c34 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.447744 Oct 11 04:41:47.723674 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3120/5992] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:41:46 2022] POST /compute/v2.1/servers => generated 401 bytes in 1449 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:41:47.734932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-305e79df-15f9-47fa-84eb-c65dfc263b40 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:47.734932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-305e79df-15f9-47fa-84eb-c65dfc263b40 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:47.826403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-305e79df-15f9-47fa-84eb-c65dfc263b40 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:47.835380 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-305e79df-15f9-47fa-84eb-c65dfc263b40 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1240 microversion: 2.1 time: 0.107626 Oct 11 04:41:47.835380 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2873/5993] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:47 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1240 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:47.856317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1f08df2f-7882-4d26-b943-d22323136b3f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:47.857064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1f08df2f-7882-4d26-b943-d22323136b3f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:47.865870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f08df2f-7882-4d26-b943-d22323136b3f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:47.869395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f08df2f-7882-4d26-b943-d22323136b3f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:47.870647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f08df2f-7882-4d26-b943-d22323136b3f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:47.871599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f08df2f-7882-4d26-b943-d22323136b3f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:47.872442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f08df2f-7882-4d26-b943-d22323136b3f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:47.874642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f08df2f-7882-4d26-b943-d22323136b3f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:47.905969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1f08df2f-7882-4d26-b943-d22323136b3f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:41:48.390860 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1f08df2f-7882-4d26-b943-d22323136b3f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "DELETE /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 204 len: 0 microversion: 2.20 time: 0.541803 Oct 11 04:41:48.392404 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3121/5994] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:41:47 2022] DELETE /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:41:48.406204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:48.408512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:48.416732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:48.417467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:48.418085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:48.418989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:48.419434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:48.420287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:48.577078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:48.578097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d964a3a3-72c5-4c5e-9139-698468fe3191 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:48.578894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d964a3a3-72c5-4c5e-9139-698468fe3191 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:48.587116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d964a3a3-72c5-4c5e-9139-698468fe3191 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:48.588911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:48.590439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:48.591660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d964a3a3-72c5-4c5e-9139-698468fe3191 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:48.591791 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f5f9f976-5df7-4f42-97f1-689c03dd468a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1723 microversion: 2.20 time: 0.190080 Oct 11 04:41:48.592257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d964a3a3-72c5-4c5e-9139-698468fe3191 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:48.592399 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2874/5995] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:48 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:48.593284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d964a3a3-72c5-4c5e-9139-698468fe3191 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:48.593754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d964a3a3-72c5-4c5e-9139-698468fe3191 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:48.594240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d964a3a3-72c5-4c5e-9139-698468fe3191 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:48.735835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d964a3a3-72c5-4c5e-9139-698468fe3191 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:48.745816 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d964a3a3-72c5-4c5e-9139-698468fe3191 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.172334 Oct 11 04:41:48.746506 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3122/5996] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:48 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:48.857260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3224ea31-b7ef-4597-b183-618954dc31c2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:48.857926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3224ea31-b7ef-4597-b183-618954dc31c2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:48.911511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3224ea31-b7ef-4597-b183-618954dc31c2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:48.918528 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3224ea31-b7ef-4597-b183-618954dc31c2 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1240 microversion: 2.1 time: 0.065261 Oct 11 04:41:48.919135 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2875/5997] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:48 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:49.624732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:49.625333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:49.633357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:49.641022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:49.641022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:49.641022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:49.641022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:49.641022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:49.788372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8bcf723-c57d-4809-a358-5684dffc980b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:49.789012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f8bcf723-c57d-4809-a358-5684dffc980b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:49.797724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8bcf723-c57d-4809-a358-5684dffc980b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:49.797724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8bcf723-c57d-4809-a358-5684dffc980b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:49.798171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8bcf723-c57d-4809-a358-5684dffc980b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:49.799016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8bcf723-c57d-4809-a358-5684dffc980b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:49.799363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8bcf723-c57d-4809-a358-5684dffc980b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:49.799916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8bcf723-c57d-4809-a358-5684dffc980b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:49.834603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:49.843650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:49.844985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:49.846225 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-96a55397-5819-49f4-865d-0680a3d8d10e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1723 microversion: 2.20 time: 0.225850 Oct 11 04:41:49.846818 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3123/5998] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:49 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1723 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:49.943734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-654fb4ce-7c18-4cba-aec8-9ac694966ad3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:49.944758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-654fb4ce-7c18-4cba-aec8-9ac694966ad3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:49.951660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654fb4ce-7c18-4cba-aec8-9ac694966ad3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:49.952261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654fb4ce-7c18-4cba-aec8-9ac694966ad3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:49.952671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654fb4ce-7c18-4cba-aec8-9ac694966ad3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:49.953401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654fb4ce-7c18-4cba-aec8-9ac694966ad3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:49.953855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654fb4ce-7c18-4cba-aec8-9ac694966ad3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:49.954432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654fb4ce-7c18-4cba-aec8-9ac694966ad3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:49.988316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f8bcf723-c57d-4809-a358-5684dffc980b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:49.998247 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f8bcf723-c57d-4809-a358-5684dffc980b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.232269 Oct 11 04:41:50.003238 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2876/5999] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:49 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:41:50.017392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-654fb4ce-7c18-4cba-aec8-9ac694966ad3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:50.025728 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-654fb4ce-7c18-4cba-aec8-9ac694966ad3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1236 microversion: 2.1 time: 0.087378 Oct 11 04:41:50.026324 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3124/6000] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:49 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1236 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:50.872903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:50.873572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:50.890770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:50.892819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:50.898301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:50.899388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:50.900021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:50.900642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:51.021509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a57f851c-d7c5-4d98-938f-acfddb49c289 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:51.022825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a57f851c-d7c5-4d98-938f-acfddb49c289 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:51.024024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:51.045453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a57f851c-d7c5-4d98-938f-acfddb49c289 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:51.049124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a57f851c-d7c5-4d98-938f-acfddb49c289 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:51.049124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a57f851c-d7c5-4d98-938f-acfddb49c289 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:51.049124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a57f851c-d7c5-4d98-938f-acfddb49c289 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:51.049124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a57f851c-d7c5-4d98-938f-acfddb49c289 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:51.049124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a57f851c-d7c5-4d98-938f-acfddb49c289 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:51.049643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:51.059248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:51.060839 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0b8ed13e-a5eb-4e0d-b9e4-6e259719a416 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1655 microversion: 2.20 time: 0.191920 Oct 11 04:41:51.072700 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2877/6001] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:50 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1655 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:51.077100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e66f38b9-5248-4f22-a137-e629ea202044 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:51.078315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e66f38b9-5248-4f22-a137-e629ea202044 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:51.091085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e66f38b9-5248-4f22-a137-e629ea202044 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:51.093023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e66f38b9-5248-4f22-a137-e629ea202044 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:51.093685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e66f38b9-5248-4f22-a137-e629ea202044 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:51.094816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e66f38b9-5248-4f22-a137-e629ea202044 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:51.096408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e66f38b9-5248-4f22-a137-e629ea202044 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:51.097336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e66f38b9-5248-4f22-a137-e629ea202044 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:51.230508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e66f38b9-5248-4f22-a137-e629ea202044 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:51.242418 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e66f38b9-5248-4f22-a137-e629ea202044 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1300 microversion: 2.1 time: 0.177335 Oct 11 04:41:51.245228 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2878/6002] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:51 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1300 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:51.400574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a57f851c-d7c5-4d98-938f-acfddb49c289 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:51.414762 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a57f851c-d7c5-4d98-938f-acfddb49c289 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.397609 Oct 11 04:41:51.415529 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3125/6003] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:51 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:41:51.668057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-025aa9e5-e9cb-4fb5-bb7a-371166be12a9 req-013aee4d-d5d1-4efb-b6e2-8308497c8b11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55886128-3370-4868-98e0-5b2b4e574871", "name": "network-vif-deleted", "tag": "e148d4ee-0d06-4384-93e1-fa7e9028b8f1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:51.681986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-025aa9e5-e9cb-4fb5-bb7a-371166be12a9 req-013aee4d-d5d1-4efb-b6e2-8308497c8b11 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:51.682864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-025aa9e5-e9cb-4fb5-bb7a-371166be12a9 req-013aee4d-d5d1-4efb-b6e2-8308497c8b11 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:51.683384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-025aa9e5-e9cb-4fb5-bb7a-371166be12a9 req-013aee4d-d5d1-4efb-b6e2-8308497c8b11 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:51.715305 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-025aa9e5-e9cb-4fb5-bb7a-371166be12a9 req-013aee4d-d5d1-4efb-b6e2-8308497c8b11 service nova] Creating event network-vif-deleted:e148d4ee-0d06-4384-93e1-fa7e9028b8f1 for instance 55886128-3370-4868-98e0-5b2b4e574871 on n-h2-860892-1 Oct 11 04:41:51.715305 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-025aa9e5-e9cb-4fb5-bb7a-371166be12a9 req-013aee4d-d5d1-4efb-b6e2-8308497c8b11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.288883 Oct 11 04:41:51.715305 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2879/6004] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:52.091411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:52.092174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:52.105904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:52.107596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:52.108679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:52.111033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:52.114052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:52.115599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:52.162548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:52.163408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:52.163982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:52.164806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lazy-loading 'fault' on Instance uuid 55886128-3370-4868-98e0-5b2b4e574871 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:41:52.228598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:52.239242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:52.250315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:52.253818 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f74ba4ca-6498-4185-83de-74c0fdfd6538 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 200 len: 1371 microversion: 2.20 time: 0.165160 Oct 11 04:41:52.255870 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3126/6005] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:52 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:41:52.281699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d2df22b2-c363-4746-b1e5-13d6148670f0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:52.282465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d2df22b2-c363-4746-b1e5-13d6148670f0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:52.291596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2df22b2-c363-4746-b1e5-13d6148670f0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:52.292355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2df22b2-c363-4746-b1e5-13d6148670f0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:52.292971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2df22b2-c363-4746-b1e5-13d6148670f0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:52.293875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2df22b2-c363-4746-b1e5-13d6148670f0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:52.294525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2df22b2-c363-4746-b1e5-13d6148670f0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:52.295166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2df22b2-c363-4746-b1e5-13d6148670f0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:52.401381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d2df22b2-c363-4746-b1e5-13d6148670f0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:52.413898 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d2df22b2-c363-4746-b1e5-13d6148670f0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1298 microversion: 2.1 time: 0.142107 Oct 11 04:41:52.414745 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2880/6006] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:52 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1298 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:52.439384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-512bf02d-a474-4f24-a6b7-80f96c84956e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:52.440115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-512bf02d-a474-4f24-a6b7-80f96c84956e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:52.446355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512bf02d-a474-4f24-a6b7-80f96c84956e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:52.447203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512bf02d-a474-4f24-a6b7-80f96c84956e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:52.447819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512bf02d-a474-4f24-a6b7-80f96c84956e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:52.448531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512bf02d-a474-4f24-a6b7-80f96c84956e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:52.448978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512bf02d-a474-4f24-a6b7-80f96c84956e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:52.449570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-512bf02d-a474-4f24-a6b7-80f96c84956e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:52.757011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-512bf02d-a474-4f24-a6b7-80f96c84956e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:52.771354 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-512bf02d-a474-4f24-a6b7-80f96c84956e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.330898 Oct 11 04:41:52.771354 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3127/6007] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:52 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:53.282864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:53.283481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:53.290523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:53.291138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:53.291581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:53.292275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:53.292729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:53.293152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:53.307861 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] HTTP exception thrown: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Request method failure captured: Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 HTTP/1.1 Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPMnFZ--kfNQpeWNIhHN1i8Uf4Kplgu5j8k8l0oKaqTBxeAxbnVfz-P6_YjuM5iyB9aH-ZTTuOshB2GyNxaDKqJQPxm07xOgeOI_jYvm6PyvPg9ZrGKZTos5iT2s2gzngMBhS1W9_eKljxTvAtPnWcaSuyReHttXdK3uVwUuSVRxpCg Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}] Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 9cdfb1cf8aeb4fa0859c4d954bdd6369 Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '55886128-3370-4868-98e0-5b2b4e574871'} Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:53.309539 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:41:53.318176 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:53.318176 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:41:53.318176 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:41:53.318176 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:41:53.318176 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:41:53.318176 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:41:53.318176 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:41:53.318176 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:41:53.318176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Returning 404 to user: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:41:53.318176 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f8ba3e04-50cd-4c41-86fe-18cb66370cfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 404 len: 111 microversion: 2.20 time: 0.032770 Oct 11 04:41:53.318176 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2881/6008] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:53 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:41:53.326486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-09b8b77d-f0ce-4f32-acb7-ade6a8c71a22 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '.version_select at 0x7fda194f9f70>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:53.468109 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-09b8b77d-f0ce-4f32-acb7-ade6a8c71a22 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-366717867" status: 204 len: 0 microversion: 2.20 time: 0.147746 Oct 11 04:41:53.469398 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3128/6009] 10.222.0.26 () {60 vars in 1259 bytes} [Tue Oct 11 04:41:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-366717867 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:41:53.786051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4b610595-bbf9-42d2-9c04-44341e598771 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:53.787255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4b610595-bbf9-42d2-9c04-44341e598771 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:53.797106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b610595-bbf9-42d2-9c04-44341e598771 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:53.797106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b610595-bbf9-42d2-9c04-44341e598771 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:53.797106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b610595-bbf9-42d2-9c04-44341e598771 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:53.797106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b610595-bbf9-42d2-9c04-44341e598771 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:53.797106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b610595-bbf9-42d2-9c04-44341e598771 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:53.797548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b610595-bbf9-42d2-9c04-44341e598771 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:53.800897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:53.801364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7f4ecaba-d93f-4328-86de-f81077385ff6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:53.801947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7f4ecaba-d93f-4328-86de-f81077385ff6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:53.835687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f4ecaba-d93f-4328-86de-f81077385ff6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:53.835687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f4ecaba-d93f-4328-86de-f81077385ff6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:53.835687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f4ecaba-d93f-4328-86de-f81077385ff6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:53.835687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f4ecaba-d93f-4328-86de-f81077385ff6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:53.835687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f4ecaba-d93f-4328-86de-f81077385ff6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:53.835687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f4ecaba-d93f-4328-86de-f81077385ff6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:53.870476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:54.091256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7f4ecaba-d93f-4328-86de-f81077385ff6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:54.107907 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7f4ecaba-d93f-4328-86de-f81077385ff6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1514 microversion: 2.1 time: 0.318068 Oct 11 04:41:54.109258 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3129/6010] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:53 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1514 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:54.189324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4b610595-bbf9-42d2-9c04-44341e598771 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:54.200533 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4b610595-bbf9-42d2-9c04-44341e598771 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1365 microversion: 2.1 time: 0.766811 Oct 11 04:41:54.201357 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2882/6011] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:53 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1365 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:54.328533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-9fd66135-af7c-4347-881c-ea209d2bd0b5 req-76668c18-ae19-4872-9342-614e7ad7267a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21e66f4-5fbe-4af0-99f5-0e0166317f10", "tag": "c6479db7-7758-41fa-b7a7-3dbbddc1665b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:54.335643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:54.340653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9fd66135-af7c-4347-881c-ea209d2bd0b5 req-76668c18-ae19-4872-9342-614e7ad7267a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:54.341438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9fd66135-af7c-4347-881c-ea209d2bd0b5 req-76668c18-ae19-4872-9342-614e7ad7267a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:54.342018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9fd66135-af7c-4347-881c-ea209d2bd0b5 req-76668c18-ae19-4872-9342-614e7ad7267a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:54.354969 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-9fd66135-af7c-4347-881c-ea209d2bd0b5 req-76668c18-ae19-4872-9342-614e7ad7267a service nova] Creating event network-changed:c6479db7-7758-41fa-b7a7-3dbbddc1665b for instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 on n-h1-860892-1 Oct 11 04:41:54.359950 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-9fd66135-af7c-4347-881c-ea209d2bd0b5 req-76668c18-ae19-4872-9342-614e7ad7267a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035266 Oct 11 04:41:54.360634 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3130/6012] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:41:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:54.801277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-141ea441-f20f-4e64-9843-26be5b5dddc5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Action: 'create', calling method: .version_select at 0x7fda18eae700>, body: {"keypair": {"name": "tempest-keypair-651188936", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCpYzHBWaziaxmJRGuEt8TjlvBurkoZ0BUVsPuxsXgf5BdvincfYVcRgNoFYYw1b5SVCi54AjBk2hmQXlFYELQftTJC1fGW9JA5hQqR8sb0wS8S+v1Cv0QuTgWOctG2xKQ=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:54.817935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-141ea441-f20f-4e64-9843-26be5b5dddc5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Getting quotas for project cbfd601e8ae449eaa5d8d21409c953a0. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:41:54.824269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-141ea441-f20f-4e64-9843-26be5b5dddc5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Getting quotas for user 9cdfb1cf8aeb4fa0859c4d954bdd6369 and project cbfd601e8ae449eaa5d8d21409c953a0. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:41:54.984510 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-141ea441-f20f-4e64-9843-26be5b5dddc5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.187045 Oct 11 04:41:54.990607 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2883/6013] 10.222.0.26 () {62 vars in 1200 bytes} [Tue Oct 11 04:41:54 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 194 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 11 04:41:55.136218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-07dc392b-94f6-47bf-b1da-d91d7699b169 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:55.137188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-07dc392b-94f6-47bf-b1da-d91d7699b169 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:55.158708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07dc392b-94f6-47bf-b1da-d91d7699b169 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:55.160731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07dc392b-94f6-47bf-b1da-d91d7699b169 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:55.161777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07dc392b-94f6-47bf-b1da-d91d7699b169 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:55.167246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07dc392b-94f6-47bf-b1da-d91d7699b169 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:55.168782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07dc392b-94f6-47bf-b1da-d91d7699b169 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:55.170591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07dc392b-94f6-47bf-b1da-d91d7699b169 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:55.223635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2eb53fd1-4d15-4b3e-9cfe-0770bbdb5edd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:55.224261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2eb53fd1-4d15-4b3e-9cfe-0770bbdb5edd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:55.242958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eb53fd1-4d15-4b3e-9cfe-0770bbdb5edd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:55.242958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eb53fd1-4d15-4b3e-9cfe-0770bbdb5edd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:55.242958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eb53fd1-4d15-4b3e-9cfe-0770bbdb5edd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:55.242958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eb53fd1-4d15-4b3e-9cfe-0770bbdb5edd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:55.242958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eb53fd1-4d15-4b3e-9cfe-0770bbdb5edd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:55.242958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2eb53fd1-4d15-4b3e-9cfe-0770bbdb5edd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:55.476409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-07dc392b-94f6-47bf-b1da-d91d7699b169 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:55.488821 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-07dc392b-94f6-47bf-b1da-d91d7699b169 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1520 microversion: 2.1 time: 0.359412 Oct 11 04:41:55.490806 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3131/6014] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:55 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1520 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:55.577802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2eb53fd1-4d15-4b3e-9cfe-0770bbdb5edd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:55.588332 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2eb53fd1-4d15-4b3e-9cfe-0770bbdb5edd tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1365 microversion: 2.1 time: 0.368302 Oct 11 04:41:55.589511 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2884/6015] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:55 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1365 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:56.512910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5bb58ab-5f8a-480c-9f4a-d137f37ba792 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:56.513527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5bb58ab-5f8a-480c-9f4a-d137f37ba792 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:56.540033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bb58ab-5f8a-480c-9f4a-d137f37ba792 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:56.540526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bb58ab-5f8a-480c-9f4a-d137f37ba792 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:56.541139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bb58ab-5f8a-480c-9f4a-d137f37ba792 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:56.542036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bb58ab-5f8a-480c-9f4a-d137f37ba792 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:56.542698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bb58ab-5f8a-480c-9f4a-d137f37ba792 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:56.543124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5bb58ab-5f8a-480c-9f4a-d137f37ba792 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:56.613803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-828b4b62-cb0b-4993-8167-e95410e69f1e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:56.615198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-828b4b62-cb0b-4993-8167-e95410e69f1e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:56.623293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828b4b62-cb0b-4993-8167-e95410e69f1e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:56.623784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828b4b62-cb0b-4993-8167-e95410e69f1e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:56.626848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828b4b62-cb0b-4993-8167-e95410e69f1e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:56.629243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828b4b62-cb0b-4993-8167-e95410e69f1e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:56.629243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828b4b62-cb0b-4993-8167-e95410e69f1e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:56.629511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828b4b62-cb0b-4993-8167-e95410e69f1e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:56.838924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-828b4b62-cb0b-4993-8167-e95410e69f1e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:56.851056 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-828b4b62-cb0b-4993-8167-e95410e69f1e tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1365 microversion: 2.1 time: 0.241479 Oct 11 04:41:56.865298 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2885/6016] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:56 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:56.866904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5bb58ab-5f8a-480c-9f4a-d137f37ba792 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:56.869670 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5bb58ab-5f8a-480c-9f4a-d137f37ba792 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1520 microversion: 2.1 time: 0.360815 Oct 11 04:41:56.870609 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3132/6017] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:56 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:57.878732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35793860-70d9-47db-8762-df04d96b7834 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:57.880041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-35793860-70d9-47db-8762-df04d96b7834 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:57.890798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35793860-70d9-47db-8762-df04d96b7834 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:57.891306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35793860-70d9-47db-8762-df04d96b7834 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:57.891756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35793860-70d9-47db-8762-df04d96b7834 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:57.896082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-66ef38b3-3b37-4ab9-bb79-2006ce95255a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:57.896605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35793860-70d9-47db-8762-df04d96b7834 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:57.896804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35793860-70d9-47db-8762-df04d96b7834 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:57.897261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35793860-70d9-47db-8762-df04d96b7834 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:57.897933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-66ef38b3-3b37-4ab9-bb79-2006ce95255a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:57.909224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:57.910960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=10 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:57.912957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66ef38b3-3b37-4ab9-bb79-2006ce95255a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:57.913502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66ef38b3-3b37-4ab9-bb79-2006ce95255a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:57.913997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66ef38b3-3b37-4ab9-bb79-2006ce95255a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:57.915258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66ef38b3-3b37-4ab9-bb79-2006ce95255a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:57.915725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66ef38b3-3b37-4ab9-bb79-2006ce95255a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:57.916153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66ef38b3-3b37-4ab9-bb79-2006ce95255a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:58.085730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35793860-70d9-47db-8762-df04d96b7834 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:58.113372 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35793860-70d9-47db-8762-df04d96b7834 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1365 microversion: 2.1 time: 0.239753 Oct 11 04:41:58.114045 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2886/6018] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:57 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1365 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:58.160590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-66ef38b3-3b37-4ab9-bb79-2006ce95255a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:58.187737 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-66ef38b3-3b37-4ab9-bb79-2006ce95255a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1520 microversion: 2.1 time: 0.296635 Oct 11 04:41:58.191978 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3133/6019] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:57 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1520 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:41:58.624435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-907925347", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d9ff1d26-97e4-4133-8d03-733f3c62a963"}], "security_groups": [{"name": "tempest-securitygroup--908977741"}], "key_name": "tempest-keypair-651188936", "user_data": "}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:58.755919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] validate_networks() for [('d9ff1d26-97e4-4133-8d03-733f3c62a963', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:41:59.146266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e85fd850-9647-402b-a86d-497943cd9df4 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:59.147197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e85fd850-9647-402b-a86d-497943cd9df4 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:59.167360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e85fd850-9647-402b-a86d-497943cd9df4 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:59.170513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e85fd850-9647-402b-a86d-497943cd9df4 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:59.170991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e85fd850-9647-402b-a86d-497943cd9df4 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:59.173141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e85fd850-9647-402b-a86d-497943cd9df4 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:59.174752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e85fd850-9647-402b-a86d-497943cd9df4 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:59.175294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e85fd850-9647-402b-a86d-497943cd9df4 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:59.307698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:41:59.308230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:41:59.308646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:41:59.309058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:41:59.309617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:41:59.323857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:59.324135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:59.324577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:59.325301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:59.325754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:59.326177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:59.356027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Getting quotas for project cbfd601e8ae449eaa5d8d21409c953a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:41:59.361640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Getting quotas for user 9cdfb1cf8aeb4fa0859c4d954bdd6369 and project cbfd601e8ae449eaa5d8d21409c953a0. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:41:59.374363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:41:59.376816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:41:59.475250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e85fd850-9647-402b-a86d-497943cd9df4 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:59.483593 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e85fd850-9647-402b-a86d-497943cd9df4 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1365 microversion: 2.1 time: 0.346378 Oct 11 04:41:59.485697 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3134/6020] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:59 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1365 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:59.489157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-78b9c399-5a7f-4f30-9b98-7be1658432cf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:59.490027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-78b9c399-5a7f-4f30-9b98-7be1658432cf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:59.495965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78b9c399-5a7f-4f30-9b98-7be1658432cf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:59.496449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78b9c399-5a7f-4f30-9b98-7be1658432cf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:59.496888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78b9c399-5a7f-4f30-9b98-7be1658432cf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:59.497582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78b9c399-5a7f-4f30-9b98-7be1658432cf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:59.498023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78b9c399-5a7f-4f30-9b98-7be1658432cf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:59.498724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78b9c399-5a7f-4f30-9b98-7be1658432cf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:59.568382 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d0a9a893-3664-4bbf-ac78-5bd35b9193ef tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.950225 Oct 11 04:41:59.569152 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2887/6021] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:41:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:41:59.696352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-78b9c399-5a7f-4f30-9b98-7be1658432cf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:59.705637 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-78b9c399-5a7f-4f30-9b98-7be1658432cf tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1520 microversion: 2.1 time: 0.220326 Oct 11 04:41:59.724432 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3135/6022] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:41:59 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1520 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:41:59.724432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48db69a9-c404-4b44-aff9-5b48ce542a97 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:41:59.724432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-48db69a9-c404-4b44-aff9-5b48ce542a97 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:41:59.772740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-0ac8d957-fa4b-4d45-bae9-87d0e677b205 req-684f021a-0e31-4e0f-a3c2-1075dd69616e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8eff2c-d489-422a-adae-f563581c39a0", "name": "network-vif-unplugged", "status": "completed", "tag": "4415657b-d9c9-4a7d-891d-239800cb8514"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:41:59.792958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:41:59.796132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0ac8d957-fa4b-4d45-bae9-87d0e677b205 req-684f021a-0e31-4e0f-a3c2-1075dd69616e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:41:59.797476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0ac8d957-fa4b-4d45-bae9-87d0e677b205 req-684f021a-0e31-4e0f-a3c2-1075dd69616e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:41:59.798105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0ac8d957-fa4b-4d45-bae9-87d0e677b205 req-684f021a-0e31-4e0f-a3c2-1075dd69616e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:41:59.813145 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-0ac8d957-fa4b-4d45-bae9-87d0e677b205 req-684f021a-0e31-4e0f-a3c2-1075dd69616e service nova] Creating event network-vif-unplugged:4415657b-d9c9-4a7d-891d-239800cb8514 for instance 7f8eff2c-d489-422a-adae-f563581c39a0 on n-h2-860892-1 Oct 11 04:41:59.818422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48db69a9-c404-4b44-aff9-5b48ce542a97 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:59.822585 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-0ac8d957-fa4b-4d45-bae9-87d0e677b205 req-684f021a-0e31-4e0f-a3c2-1075dd69616e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.249844 Oct 11 04:41:59.827835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48db69a9-c404-4b44-aff9-5b48ce542a97 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:59.829630 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2888/6023] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:41:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:41:59.830180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48db69a9-c404-4b44-aff9-5b48ce542a97 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:41:59.832634 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48db69a9-c404-4b44-aff9-5b48ce542a97 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1280 microversion: 2.20 time: 0.121007 Oct 11 04:41:59.833680 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3136/6024] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:41:59 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1280 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:42:00.524760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-71881c98-2f2d-4494-8fc3-9fa76bbc6e37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:00.526877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-71881c98-2f2d-4494-8fc3-9fa76bbc6e37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:00.537066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71881c98-2f2d-4494-8fc3-9fa76bbc6e37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:00.537066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71881c98-2f2d-4494-8fc3-9fa76bbc6e37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:00.537066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71881c98-2f2d-4494-8fc3-9fa76bbc6e37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:00.537066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71881c98-2f2d-4494-8fc3-9fa76bbc6e37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:00.537066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71881c98-2f2d-4494-8fc3-9fa76bbc6e37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:00.537749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71881c98-2f2d-4494-8fc3-9fa76bbc6e37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:00.731838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-227ea31c-4818-4928-89ab-abd388a19b79 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:00.732918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-227ea31c-4818-4928-89ab-abd388a19b79 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:00.733061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-71881c98-2f2d-4494-8fc3-9fa76bbc6e37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:00.741469 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-71881c98-2f2d-4494-8fc3-9fa76bbc6e37 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1365 microversion: 2.1 time: 0.238279 Oct 11 04:42:00.749211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-227ea31c-4818-4928-89ab-abd388a19b79 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:00.750260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-227ea31c-4818-4928-89ab-abd388a19b79 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:00.750650 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2889/6025] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:00 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1365 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:00.751334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-227ea31c-4818-4928-89ab-abd388a19b79 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:00.752453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-227ea31c-4818-4928-89ab-abd388a19b79 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:00.753135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-227ea31c-4818-4928-89ab-abd388a19b79 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:00.754021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-227ea31c-4818-4928-89ab-abd388a19b79 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:00.910961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:00.910961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:00.910961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:00.910961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:00.910961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:00.910961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:00.910961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:00.910961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:00.952234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-227ea31c-4818-4928-89ab-abd388a19b79 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:00.963727 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-227ea31c-4818-4928-89ab-abd388a19b79 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1520 microversion: 2.1 time: 0.236179 Oct 11 04:42:00.974737 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3137/6026] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:00 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1520 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:00.978315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:00.992498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:00.994144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:00.996876 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9504449e-1e2c-4768-bd15-46e9b2e5bfc4 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1284 microversion: 2.20 time: 0.142562 Oct 11 04:42:01.006033 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2890/6027] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:00 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:42:01.776610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ffe18942-3e60-4a27-9242-0d1e6aef0ac0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:01.777834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ffe18942-3e60-4a27-9242-0d1e6aef0ac0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:01.786655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffe18942-3e60-4a27-9242-0d1e6aef0ac0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:01.787390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffe18942-3e60-4a27-9242-0d1e6aef0ac0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:01.787834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffe18942-3e60-4a27-9242-0d1e6aef0ac0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:01.788548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffe18942-3e60-4a27-9242-0d1e6aef0ac0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:01.789037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffe18942-3e60-4a27-9242-0d1e6aef0ac0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:01.789463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffe18942-3e60-4a27-9242-0d1e6aef0ac0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:01.842484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6a6ca9af-934e-481a-a22c-0b8995e79467 req-b4108dcd-2c9d-45ce-af78-ea4d3abc5450 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21e66f4-5fbe-4af0-99f5-0e0166317f10", "name": "network-vif-plugged", "status": "completed", "tag": "c6479db7-7758-41fa-b7a7-3dbbddc1665b"}, {"server_uuid": "7f8eff2c-d489-422a-adae-f563581c39a0", "name": "network-vif-plugged", "status": "completed", "tag": "4415657b-d9c9-4a7d-891d-239800cb8514"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:01.863023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6a6ca9af-934e-481a-a22c-0b8995e79467 req-b4108dcd-2c9d-45ce-af78-ea4d3abc5450 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:01.863860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6a6ca9af-934e-481a-a22c-0b8995e79467 req-b4108dcd-2c9d-45ce-af78-ea4d3abc5450 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:01.864514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6a6ca9af-934e-481a-a22c-0b8995e79467 req-b4108dcd-2c9d-45ce-af78-ea4d3abc5450 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:01.882085 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6a6ca9af-934e-481a-a22c-0b8995e79467 req-b4108dcd-2c9d-45ce-af78-ea4d3abc5450 service nova] Creating event network-vif-plugged:c6479db7-7758-41fa-b7a7-3dbbddc1665b for instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 on n-h1-860892-1 Oct 11 04:42:01.888502 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6a6ca9af-934e-481a-a22c-0b8995e79467 req-b4108dcd-2c9d-45ce-af78-ea4d3abc5450 service nova] Creating event network-vif-plugged:4415657b-d9c9-4a7d-891d-239800cb8514 for instance 7f8eff2c-d489-422a-adae-f563581c39a0 on n-h2-860892-1 Oct 11 04:42:01.894113 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6a6ca9af-934e-481a-a22c-0b8995e79467 req-b4108dcd-2c9d-45ce-af78-ea4d3abc5450 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055615 Oct 11 04:42:01.896544 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2891/6028] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:01 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:42:01.994713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e29f2aef-4ac5-487a-92cd-e7234ef14b6d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:01.995695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e29f2aef-4ac5-487a-92cd-e7234ef14b6d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:02.022127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e29f2aef-4ac5-487a-92cd-e7234ef14b6d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:02.023003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e29f2aef-4ac5-487a-92cd-e7234ef14b6d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:02.023585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e29f2aef-4ac5-487a-92cd-e7234ef14b6d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:02.024605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e29f2aef-4ac5-487a-92cd-e7234ef14b6d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:02.028749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e29f2aef-4ac5-487a-92cd-e7234ef14b6d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:02.029477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e29f2aef-4ac5-487a-92cd-e7234ef14b6d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:02.177725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ffe18942-3e60-4a27-9242-0d1e6aef0ac0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:02.187721 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ffe18942-3e60-4a27-9242-0d1e6aef0ac0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1365 microversion: 2.1 time: 0.421523 Oct 11 04:42:02.189471 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3138/6029] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:01 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1365 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:02.211555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:02.214846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:02.224846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:02.225654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:02.226369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:02.228014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:02.228688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:02.229356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:02.236597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e29f2aef-4ac5-487a-92cd-e7234ef14b6d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:02.245839 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e29f2aef-4ac5-487a-92cd-e7234ef14b6d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1520 microversion: 2.1 time: 0.255919 Oct 11 04:42:02.250236 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2892/6030] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:01 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:42:02.307219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:02.318744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:02.320354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:02.321562 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2a95f0b7-5214-4051-8cd5-00a305343ae0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1332 microversion: 2.20 time: 0.128058 Oct 11 04:42:02.322528 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3139/6031] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:02 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1332 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:42:03.219121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ac7c7da-e510-469c-ab37-6ffc9c58dafc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:03.219746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ac7c7da-e510-469c-ab37-6ffc9c58dafc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:03.228885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac7c7da-e510-469c-ab37-6ffc9c58dafc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:03.234773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac7c7da-e510-469c-ab37-6ffc9c58dafc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:03.235236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac7c7da-e510-469c-ab37-6ffc9c58dafc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:03.235987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac7c7da-e510-469c-ab37-6ffc9c58dafc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:03.236448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac7c7da-e510-469c-ab37-6ffc9c58dafc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:03.236918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac7c7da-e510-469c-ab37-6ffc9c58dafc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:03.271656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6b341a14-40e8-47ea-aa4d-0e8f0142feb5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:03.273300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6b341a14-40e8-47ea-aa4d-0e8f0142feb5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:03.286180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b341a14-40e8-47ea-aa4d-0e8f0142feb5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:03.286705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b341a14-40e8-47ea-aa4d-0e8f0142feb5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:03.287519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b341a14-40e8-47ea-aa4d-0e8f0142feb5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:03.288236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b341a14-40e8-47ea-aa4d-0e8f0142feb5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:03.288691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b341a14-40e8-47ea-aa4d-0e8f0142feb5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:03.289122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b341a14-40e8-47ea-aa4d-0e8f0142feb5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:03.498529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ac7c7da-e510-469c-ab37-6ffc9c58dafc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:03.528147 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ac7c7da-e510-469c-ab37-6ffc9c58dafc tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1365 microversion: 2.1 time: 0.312814 Oct 11 04:42:03.539380 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2893/6032] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:03 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1365 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:03.552080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:03.552983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:03.559961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:03.560623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:03.561223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:03.562079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:03.562794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:03.563455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:03.619350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6b341a14-40e8-47ea-aa4d-0e8f0142feb5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:03.627489 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6b341a14-40e8-47ea-aa4d-0e8f0142feb5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1520 microversion: 2.1 time: 0.360440 Oct 11 04:42:03.628089 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3140/6033] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:03 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:42:03.633895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:03.643420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:03.645205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:03.646714 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4af263e9-ce76-4495-8db8-adc24e10ee8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1340 microversion: 2.20 time: 0.099648 Oct 11 04:42:03.647869 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2894/6034] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:03 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:42:04.557114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dd052555-ba7a-4867-96b2-5a3ec1b6c3c0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:04.558477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dd052555-ba7a-4867-96b2-5a3ec1b6c3c0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:04.566524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd052555-ba7a-4867-96b2-5a3ec1b6c3c0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:04.567236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd052555-ba7a-4867-96b2-5a3ec1b6c3c0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:04.570756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd052555-ba7a-4867-96b2-5a3ec1b6c3c0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:04.570756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd052555-ba7a-4867-96b2-5a3ec1b6c3c0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:04.570756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd052555-ba7a-4867-96b2-5a3ec1b6c3c0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:04.570756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd052555-ba7a-4867-96b2-5a3ec1b6c3c0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:04.664815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e03136f7-d88f-41f8-82e0-7a8bd99fe168 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:04.664815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e03136f7-d88f-41f8-82e0-7a8bd99fe168 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:04.664815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e03136f7-d88f-41f8-82e0-7a8bd99fe168 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:04.664815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e03136f7-d88f-41f8-82e0-7a8bd99fe168 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:04.664815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e03136f7-d88f-41f8-82e0-7a8bd99fe168 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:04.665618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e03136f7-d88f-41f8-82e0-7a8bd99fe168 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:04.665618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e03136f7-d88f-41f8-82e0-7a8bd99fe168 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:04.665861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e03136f7-d88f-41f8-82e0-7a8bd99fe168 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:04.888278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dd052555-ba7a-4867-96b2-5a3ec1b6c3c0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:04.900152 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dd052555-ba7a-4867-96b2-5a3ec1b6c3c0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1556 microversion: 2.1 time: 0.347583 Oct 11 04:42:04.903142 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3141/6035] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:04 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1556 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:04.923800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:04.923800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:04.932937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:04.933770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:04.934441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:04.935359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:04.936003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:04.936621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:05.041085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e03136f7-d88f-41f8-82e0-7a8bd99fe168 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:05.057896 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e03136f7-d88f-41f8-82e0-7a8bd99fe168 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1505 microversion: 2.1 time: 0.407152 Oct 11 04:42:05.061951 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2895/6036] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:04 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1505 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:42:05.076855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7951d71f-cf4e-40d1-82ef-f79f19ba8cc1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:05.077600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7951d71f-cf4e-40d1-82ef-f79f19ba8cc1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:05.085752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7951d71f-cf4e-40d1-82ef-f79f19ba8cc1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:05.098102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7951d71f-cf4e-40d1-82ef-f79f19ba8cc1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:05.098102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7951d71f-cf4e-40d1-82ef-f79f19ba8cc1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:05.098102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7951d71f-cf4e-40d1-82ef-f79f19ba8cc1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:05.098102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7951d71f-cf4e-40d1-82ef-f79f19ba8cc1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:05.098102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7951d71f-cf4e-40d1-82ef-f79f19ba8cc1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:05.233179 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7951d71f-cf4e-40d1-82ef-f79f19ba8cc1 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.166642 Oct 11 04:42:05.242487 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2896/6037] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:42:05 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-interface => generated 285 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:42:05.248049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d86611da-7192-4f6f-bc95-b53091b3b41e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:05.248694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d86611da-7192-4f6f-bc95-b53091b3b41e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:05.260353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d86611da-7192-4f6f-bc95-b53091b3b41e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:05.260858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d86611da-7192-4f6f-bc95-b53091b3b41e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:05.261409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d86611da-7192-4f6f-bc95-b53091b3b41e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:05.262455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d86611da-7192-4f6f-bc95-b53091b3b41e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:05.263075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d86611da-7192-4f6f-bc95-b53091b3b41e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:05.264104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d86611da-7192-4f6f-bc95-b53091b3b41e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:05.432014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d86611da-7192-4f6f-bc95-b53091b3b41e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:05.440202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:05.441242 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d86611da-7192-4f6f-bc95-b53091b3b41e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 200 len: 1505 microversion: 2.1 time: 0.197421 Oct 11 04:42:05.441833 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2897/6038] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:05 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:05.449839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:05.451594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:05.453759 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a40292b-8b0e-4915-a807-186e04c089af tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1405 microversion: 2.20 time: 0.549382 Oct 11 04:42:05.454592 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3142/6039] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:04 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1405 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:42:05.480269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1cb89fef-4fb4-4df2-9739-8a6690850a52 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:05.480779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1cb89fef-4fb4-4df2-9739-8a6690850a52 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:05.487294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1cb89fef-4fb4-4df2-9739-8a6690850a52 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:05.488024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1cb89fef-4fb4-4df2-9739-8a6690850a52 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:05.488465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1cb89fef-4fb4-4df2-9739-8a6690850a52 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:05.489365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1cb89fef-4fb4-4df2-9739-8a6690850a52 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:05.489989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1cb89fef-4fb4-4df2-9739-8a6690850a52 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:05.490441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1cb89fef-4fb4-4df2-9739-8a6690850a52 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:05.528817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1cb89fef-4fb4-4df2-9739-8a6690850a52 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:42:06.039177 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1cb89fef-4fb4-4df2-9739-8a6690850a52 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 204 len: 0 microversion: 2.1 time: 0.577696 Oct 11 04:42:06.042957 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2898/6040] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:42:05 2022] DELETE /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:42:06.264125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1491015379", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "98d31b3b-395e-40e3-8163-31568d61b082"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:06.345470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] validate_networks() for [('98d31b3b-395e-40e3-8163-31568d61b082', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:42:06.496933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:06.497946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:06.504412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:06.504937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:06.505383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:06.506145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:06.514660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:06.515122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:06.705391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:06.716497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:06.716497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:06.717596 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-928bb7e3-5850-4d9d-b325-e1830d5dc086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1405 microversion: 2.20 time: 0.227278 Oct 11 04:42:06.718165 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2899/6041] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:06 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:42:07.337846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:42:07.339090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:42:07.339785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:42:07.340651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:42:07.341556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:42:07.354677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:07.356223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:07.356964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:07.358077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:07.358935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:07.359556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:07.394299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Getting quotas for project d487c5739cef471f88ff5a38cf4ef887. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:42:07.403987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Getting quotas for user cab5e2dbaf37437a8fc4d24ff21c85b0 and project d487c5739cef471f88ff5a38cf4ef887. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:42:07.423505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:42:07.425682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:42:07.603913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-79730d95-0a41-43c4-bbf9-136fce1cf1e5 req-8c244b63-7bde-474b-8549-20bda95a5707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0fc2c3-6449-488b-8dc6-bf4db975a9ac", "tag": "eb01f976-4613-4ae1-93ed-3abbf2f61aca"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:07.635548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-79730d95-0a41-43c4-bbf9-136fce1cf1e5 req-8c244b63-7bde-474b-8549-20bda95a5707 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:07.635965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-79730d95-0a41-43c4-bbf9-136fce1cf1e5 req-8c244b63-7bde-474b-8549-20bda95a5707 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:07.638051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-79730d95-0a41-43c4-bbf9-136fce1cf1e5 req-8c244b63-7bde-474b-8549-20bda95a5707 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:07.665115 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-79730d95-0a41-43c4-bbf9-136fce1cf1e5 req-8c244b63-7bde-474b-8549-20bda95a5707 service nova] Creating event network-changed:eb01f976-4613-4ae1-93ed-3abbf2f61aca for instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac on n-h1-860892-1 Oct 11 04:42:07.671149 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-79730d95-0a41-43c4-bbf9-136fce1cf1e5 req-8c244b63-7bde-474b-8549-20bda95a5707 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071798 Oct 11 04:42:07.673467 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2900/6042] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:42:07.744525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:07.745643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:07.764693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:07.765441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:07.766075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:07.767914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:07.769344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:07.769940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:07.774831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:07.856450 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9e1fc640-5c44-43e2-81a6-a2d8d9c386b4 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.597824 Oct 11 04:42:07.871083 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3143/6043] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:42:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:42:07.882950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2640b516-c310-4941-9c99-8ab6a1012e46 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:07.884083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2640b516-c310-4941-9c99-8ab6a1012e46 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:08.039055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2640b516-c310-4941-9c99-8ab6a1012e46 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:08.048764 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2640b516-c310-4941-9c99-8ab6a1012e46 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1218 microversion: 2.1 time: 0.174312 Oct 11 04:42:08.053208 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3144/6044] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:07 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1218 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:08.265400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:08.282516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:08.293735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:08.300691 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ab44d94-a083-411b-b226-78c9a6cc0a8c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1405 microversion: 2.20 time: 0.560630 Oct 11 04:42:08.301876 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2901/6045] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:07 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1405 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:42:08.598936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-07a0f06a-f834-4a00-8a44-06fec9dd0f41 req-73a38ab9-f7cc-4c90-8f2b-98b08c7e9bf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f8eff2c-d489-422a-adae-f563581c39a0", "name": "network-vif-deleted", "tag": "4415657b-d9c9-4a7d-891d-239800cb8514"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:08.620028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-07a0f06a-f834-4a00-8a44-06fec9dd0f41 req-73a38ab9-f7cc-4c90-8f2b-98b08c7e9bf8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:08.621075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-07a0f06a-f834-4a00-8a44-06fec9dd0f41 req-73a38ab9-f7cc-4c90-8f2b-98b08c7e9bf8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:08.621813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-07a0f06a-f834-4a00-8a44-06fec9dd0f41 req-73a38ab9-f7cc-4c90-8f2b-98b08c7e9bf8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:08.642447 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-07a0f06a-f834-4a00-8a44-06fec9dd0f41 req-73a38ab9-f7cc-4c90-8f2b-98b08c7e9bf8 service nova] Creating event network-vif-deleted:4415657b-d9c9-4a7d-891d-239800cb8514 for instance 7f8eff2c-d489-422a-adae-f563581c39a0 on n-h2-860892-1 Oct 11 04:42:08.660062 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-07a0f06a-f834-4a00-8a44-06fec9dd0f41 req-73a38ab9-f7cc-4c90-8f2b-98b08c7e9bf8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065106 Oct 11 04:42:08.679112 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3145/6046] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:42:09.078542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5cbe8d7-dc67-4276-a29f-e23cf4976317 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:09.079170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d5cbe8d7-dc67-4276-a29f-e23cf4976317 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:09.202953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d5cbe8d7-dc67-4276-a29f-e23cf4976317 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:09.217135 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d5cbe8d7-dc67-4276-a29f-e23cf4976317 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1218 microversion: 2.1 time: 0.147387 Oct 11 04:42:09.226409 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2902/6047] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:09 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1218 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:09.329115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:09.329847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:09.336937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:09.337495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:09.337919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:09.338691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:09.339142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:09.339566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:09.518630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:09.533269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:09.535469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:09.536621 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0189d2a9-7f07-48e0-867a-563d7a26eb12 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1405 microversion: 2.20 time: 0.212168 Oct 11 04:42:09.537188 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3146/6048] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:09 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:42:09.696509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8b26b2f6-8d97-4919-934b-2ee075230afc req-57403024-5b8d-4b9f-9a63-fd7b7340f173 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a21e66f4-5fbe-4af0-99f5-0e0166317f10", "tag": "c6479db7-7758-41fa-b7a7-3dbbddc1665b"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:09.702476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:09.705311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8b26b2f6-8d97-4919-934b-2ee075230afc req-57403024-5b8d-4b9f-9a63-fd7b7340f173 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:09.706547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8b26b2f6-8d97-4919-934b-2ee075230afc req-57403024-5b8d-4b9f-9a63-fd7b7340f173 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:09.707078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8b26b2f6-8d97-4919-934b-2ee075230afc req-57403024-5b8d-4b9f-9a63-fd7b7340f173 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:09.718477 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8b26b2f6-8d97-4919-934b-2ee075230afc req-57403024-5b8d-4b9f-9a63-fd7b7340f173 service nova] Creating event network-changed:c6479db7-7758-41fa-b7a7-3dbbddc1665b for instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 on n-h1-860892-1 Oct 11 04:42:09.726123 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8b26b2f6-8d97-4919-934b-2ee075230afc req-57403024-5b8d-4b9f-9a63-fd7b7340f173 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038384 Oct 11 04:42:09.726123 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2903/6049] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:42:10.248040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-997704a5-231a-429c-80fe-46788192a444 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:10.249263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-997704a5-231a-429c-80fe-46788192a444 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:10.258321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997704a5-231a-429c-80fe-46788192a444 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:10.259977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997704a5-231a-429c-80fe-46788192a444 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:10.260600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997704a5-231a-429c-80fe-46788192a444 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:10.261555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997704a5-231a-429c-80fe-46788192a444 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:10.262173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997704a5-231a-429c-80fe-46788192a444 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:10.262790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-997704a5-231a-429c-80fe-46788192a444 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:10.344885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-997704a5-231a-429c-80fe-46788192a444 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:10.354493 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-997704a5-231a-429c-80fe-46788192a444 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1222 microversion: 2.1 time: 0.110203 Oct 11 04:42:10.366270 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3147/6050] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:10 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1222 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:10.562867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:10.563666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:10.570660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:10.571149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:10.571618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:10.572333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:10.572819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:10.573246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:10.802689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:10.815592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:10.818562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:10.820033 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cca3c438-0c5c-401c-ade6-0a9540655de3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1405 microversion: 2.20 time: 0.262860 Oct 11 04:42:10.821275 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2904/6051] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:10 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:42:11.379171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f0926729-b762-4bf8-85e1-b3b067b4a847 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:11.379609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f0926729-b762-4bf8-85e1-b3b067b4a847 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:11.389942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0926729-b762-4bf8-85e1-b3b067b4a847 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:11.390462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0926729-b762-4bf8-85e1-b3b067b4a847 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:11.390909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0926729-b762-4bf8-85e1-b3b067b4a847 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:11.391639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0926729-b762-4bf8-85e1-b3b067b4a847 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:11.392457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0926729-b762-4bf8-85e1-b3b067b4a847 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:11.393475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0926729-b762-4bf8-85e1-b3b067b4a847 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:11.561987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f0926729-b762-4bf8-85e1-b3b067b4a847 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:11.573338 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f0926729-b762-4bf8-85e1-b3b067b4a847 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1278 microversion: 2.1 time: 0.199271 Oct 11 04:42:11.574554 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3148/6052] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:11 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1278 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:11.851248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:11.852010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:11.860536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:11.861564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:11.863341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:11.864308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:11.864999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:11.865653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:12.103047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:12.116043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:12.118828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:12.120630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4643f950-76d5-4d81-a208-ddf5b6717f32 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1405 microversion: 2.20 time: 0.274697 Oct 11 04:42:12.121594 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2905/6053] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:11 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1405 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:42:12.601557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eccb5e76-3c18-4da6-a5f3-a7052c7059e9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:12.602150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eccb5e76-3c18-4da6-a5f3-a7052c7059e9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:12.624533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccb5e76-3c18-4da6-a5f3-a7052c7059e9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:12.625496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccb5e76-3c18-4da6-a5f3-a7052c7059e9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:12.626678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccb5e76-3c18-4da6-a5f3-a7052c7059e9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:12.628800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccb5e76-3c18-4da6-a5f3-a7052c7059e9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:12.630761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccb5e76-3c18-4da6-a5f3-a7052c7059e9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:12.631425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eccb5e76-3c18-4da6-a5f3-a7052c7059e9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:13.149061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:13.150339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:13.159709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:13.160443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:13.161038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:13.161984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:13.163284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:13.164181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:13.210484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eccb5e76-3c18-4da6-a5f3-a7052c7059e9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:13.222341 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eccb5e76-3c18-4da6-a5f3-a7052c7059e9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1276 microversion: 2.1 time: 0.626687 Oct 11 04:42:13.223900 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3149/6054] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:12 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1276 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:13.500343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:13.513006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:13.514509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:13.518834 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2c986665-5ca9-4f25-a54c-afc646c53c91 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1405 microversion: 2.20 time: 0.373571 Oct 11 04:42:13.540208 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2906/6055] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:13 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:42:14.250496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-01c223bd-2a03-4b7f-9e24-e0bfc8e9349b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:14.251116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-01c223bd-2a03-4b7f-9e24-e0bfc8e9349b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:14.258618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c223bd-2a03-4b7f-9e24-e0bfc8e9349b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:14.259186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c223bd-2a03-4b7f-9e24-e0bfc8e9349b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:14.259835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c223bd-2a03-4b7f-9e24-e0bfc8e9349b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:14.260756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c223bd-2a03-4b7f-9e24-e0bfc8e9349b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:14.261421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c223bd-2a03-4b7f-9e24-e0bfc8e9349b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:14.262002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01c223bd-2a03-4b7f-9e24-e0bfc8e9349b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:14.267766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:14.407262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-01c223bd-2a03-4b7f-9e24-e0bfc8e9349b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:14.427435 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-01c223bd-2a03-4b7f-9e24-e0bfc8e9349b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1318 microversion: 2.1 time: 0.180578 Oct 11 04:42:14.428626 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3150/6056] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:14 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:14.545126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:14.545733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:14.560428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:14.561174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:14.562178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:14.562971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:14.563576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:14.564152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:14.684088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-db4136f1-17b7-4402-841a-d240a3243c61 req-5f893902-8ba7-41b8-980c-8bba815e5097 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e166908f-75d7-4c0e-82e6-cb88690b8b6f", "tag": "f8dd10bb-4c5c-43cb-bdb0-faf2fdaa1829"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:14.719144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-db4136f1-17b7-4402-841a-d240a3243c61 req-5f893902-8ba7-41b8-980c-8bba815e5097 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:14.719771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-db4136f1-17b7-4402-841a-d240a3243c61 req-5f893902-8ba7-41b8-980c-8bba815e5097 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:14.720382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-db4136f1-17b7-4402-841a-d240a3243c61 req-5f893902-8ba7-41b8-980c-8bba815e5097 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:14.746461 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-db4136f1-17b7-4402-841a-d240a3243c61 req-5f893902-8ba7-41b8-980c-8bba815e5097 service nova] Creating event network-changed:f8dd10bb-4c5c-43cb-bdb0-faf2fdaa1829 for instance e166908f-75d7-4c0e-82e6-cb88690b8b6f on n-h2-860892-1 Oct 11 04:42:14.756836 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-db4136f1-17b7-4402-841a-d240a3243c61 req-5f893902-8ba7-41b8-980c-8bba815e5097 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077374 Oct 11 04:42:14.758770 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3151/6057] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:42:14.782017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-22862dce-9684-43c1-9c60-8d07673db53b req-35726a93-ea30-40d8-952b-2dd41013da91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0fc2c3-6449-488b-8dc6-bf4db975a9ac", "name": "network-vif-plugged", "status": "completed", "tag": "eb01f976-4613-4ae1-93ed-3abbf2f61aca"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:14.795170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-22862dce-9684-43c1-9c60-8d07673db53b req-35726a93-ea30-40d8-952b-2dd41013da91 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:14.795721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-22862dce-9684-43c1-9c60-8d07673db53b req-35726a93-ea30-40d8-952b-2dd41013da91 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:14.798659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-22862dce-9684-43c1-9c60-8d07673db53b req-35726a93-ea30-40d8-952b-2dd41013da91 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:14.810122 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-22862dce-9684-43c1-9c60-8d07673db53b req-35726a93-ea30-40d8-952b-2dd41013da91 service nova] Creating event network-vif-plugged:eb01f976-4613-4ae1-93ed-3abbf2f61aca for instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac on n-h1-860892-1 Oct 11 04:42:14.815909 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-22862dce-9684-43c1-9c60-8d07673db53b req-35726a93-ea30-40d8-952b-2dd41013da91 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038184 Oct 11 04:42:14.816516 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3152/6058] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:42:14.821241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:14.829802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:14.832076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:14.833379 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-22535bd0-1c7e-463b-ba3d-39e51630a4d2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1405 microversion: 2.20 time: 0.292148 Oct 11 04:42:14.834023 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2907/6059] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:14 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1405 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:42:15.452092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-619babbe-1481-4e22-a53c-b0c1c05db293 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:15.452789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-619babbe-1481-4e22-a53c-b0c1c05db293 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:15.460411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-619babbe-1481-4e22-a53c-b0c1c05db293 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:15.460891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-619babbe-1481-4e22-a53c-b0c1c05db293 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:15.461325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-619babbe-1481-4e22-a53c-b0c1c05db293 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:15.462016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-619babbe-1481-4e22-a53c-b0c1c05db293 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:15.462496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-619babbe-1481-4e22-a53c-b0c1c05db293 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:15.462922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-619babbe-1481-4e22-a53c-b0c1c05db293 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:15.667345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-619babbe-1481-4e22-a53c-b0c1c05db293 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:15.676462 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-619babbe-1481-4e22-a53c-b0c1c05db293 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1318 microversion: 2.1 time: 0.228652 Oct 11 04:42:15.692320 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3153/6060] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:15 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:15.869513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:15.870573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:15.885661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:15.886661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:15.887654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:15.888442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:15.889010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:15.889544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:16.081587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:16.108911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:16.119142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:16.120417 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3f24fa08-7089-4f33-be7e-3d275ac398c2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1405 microversion: 2.20 time: 0.265905 Oct 11 04:42:16.121003 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2908/6061] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:15 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1405 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:42:16.398488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-397252377", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "72cb2bdc-e2d1-46c3-b976-14e6b59a4123"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:16.458741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] validate_networks() for [('72cb2bdc-e2d1-46c3-b976-14e6b59a4123', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:42:16.699747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-79f85f3c-583e-4642-a0a6-3e960f819e8d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:16.700684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-79f85f3c-583e-4642-a0a6-3e960f819e8d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:16.708403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79f85f3c-583e-4642-a0a6-3e960f819e8d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:16.709140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79f85f3c-583e-4642-a0a6-3e960f819e8d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:16.709749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79f85f3c-583e-4642-a0a6-3e960f819e8d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:16.710629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79f85f3c-583e-4642-a0a6-3e960f819e8d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:16.711234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79f85f3c-583e-4642-a0a6-3e960f819e8d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:16.711855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79f85f3c-583e-4642-a0a6-3e960f819e8d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:16.894877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-79f85f3c-583e-4642-a0a6-3e960f819e8d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:16.905198 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-79f85f3c-583e-4642-a0a6-3e960f819e8d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1318 microversion: 2.1 time: 0.209133 Oct 11 04:42:16.920023 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2909/6062] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:16 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:16.951238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:42:16.951666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:42:16.952368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:42:16.952783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:42:16.953199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:42:16.976478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:16.976977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:16.977418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:16.978156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:16.978658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:16.979098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:17.040403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Getting quotas for project 00f5cb3632074eb99ed10b6ea9003c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:42:17.046418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Getting quotas for user 7a8665c19a49498092d9c1b96e8b438c and project 00f5cb3632074eb99ed10b6ea9003c9f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:42:17.060335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:42:17.062702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:42:17.149247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:17.149899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:17.156256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:17.156747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:17.157191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:17.158011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:17.158728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:17.159163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:17.190995 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5f2b47bf-bc78-4da8-b0d1-cee32bfc34dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.938428 Oct 11 04:42:17.197744 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3154/6063] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:42:16 2022] POST /compute/v2.1/servers => generated 380 bytes in 940 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:42:17.203465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a4a3954-4f33-433b-b605-e6a910c77bfc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:17.204584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a4a3954-4f33-433b-b605-e6a910c77bfc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:17.277443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a4a3954-4f33-433b-b605-e6a910c77bfc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:17.288650 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a4a3954-4f33-433b-b605-e6a910c77bfc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1213 microversion: 2.1 time: 0.088774 Oct 11 04:42:17.290408 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3155/6064] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:17 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:42:17.348842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:17.355883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:17.357644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:17.359078 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fbfa1639-7e88-4063-91b9-9d836101ac72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1597 microversion: 2.20 time: 0.213874 Oct 11 04:42:17.359802 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2910/6065] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:42:17 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1597 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:42:17.385709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b5294421-ef6d-4fe3-ab3e-7675c96c07e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:17.394153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b5294421-ef6d-4fe3-ab3e-7675c96c07e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:17.394153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5294421-ef6d-4fe3-ab3e-7675c96c07e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:17.394847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5294421-ef6d-4fe3-ab3e-7675c96c07e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:17.395362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5294421-ef6d-4fe3-ab3e-7675c96c07e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:17.396310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5294421-ef6d-4fe3-ab3e-7675c96c07e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:17.396839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5294421-ef6d-4fe3-ab3e-7675c96c07e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:17.397339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5294421-ef6d-4fe3-ab3e-7675c96c07e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:17.498000 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b5294421-ef6d-4fe3-ab3e-7675c96c07e9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.117018 Oct 11 04:42:17.499001 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3156/6066] 10.222.0.26 () {60 vars in 1316 bytes} [Tue Oct 11 04:42:17 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/os-interface => generated 285 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:42:17.935798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90d576a4-a96c-4433-9405-bf4e3c0c0652 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:17.936425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90d576a4-a96c-4433-9405-bf4e3c0c0652 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:17.945018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d576a4-a96c-4433-9405-bf4e3c0c0652 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:17.945587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d576a4-a96c-4433-9405-bf4e3c0c0652 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:17.946325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d576a4-a96c-4433-9405-bf4e3c0c0652 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:17.947400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d576a4-a96c-4433-9405-bf4e3c0c0652 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:17.948041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d576a4-a96c-4433-9405-bf4e3c0c0652 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:17.957383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90d576a4-a96c-4433-9405-bf4e3c0c0652 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:18.105864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90d576a4-a96c-4433-9405-bf4e3c0c0652 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:18.115057 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90d576a4-a96c-4433-9405-bf4e3c0c0652 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1318 microversion: 2.1 time: 0.183437 Oct 11 04:42:18.115983 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2911/6067] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:17 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:18.319823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f00f12df-80e8-46a6-8756-543ca00b82dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:18.330001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f00f12df-80e8-46a6-8756-543ca00b82dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:18.401206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f00f12df-80e8-46a6-8756-543ca00b82dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:18.408531 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f00f12df-80e8-46a6-8756-543ca00b82dc tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1213 microversion: 2.1 time: 0.100384 Oct 11 04:42:18.409613 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3157/6068] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:18 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1213 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:18.709389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f7b21280-e9c8-43ff-a175-2cbc814d3d0a req-44699779-c1ff-4da2-b1e7-a72c723ad044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f0fc2c3-6449-488b-8dc6-bf4db975a9ac", "tag": "eb01f976-4613-4ae1-93ed-3abbf2f61aca"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:18.719436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f7b21280-e9c8-43ff-a175-2cbc814d3d0a req-44699779-c1ff-4da2-b1e7-a72c723ad044 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:18.720094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f7b21280-e9c8-43ff-a175-2cbc814d3d0a req-44699779-c1ff-4da2-b1e7-a72c723ad044 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:18.720614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f7b21280-e9c8-43ff-a175-2cbc814d3d0a req-44699779-c1ff-4da2-b1e7-a72c723ad044 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:18.733966 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f7b21280-e9c8-43ff-a175-2cbc814d3d0a req-44699779-c1ff-4da2-b1e7-a72c723ad044 service nova] Creating event network-changed:eb01f976-4613-4ae1-93ed-3abbf2f61aca for instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac on n-h1-860892-1 Oct 11 04:42:18.739438 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f7b21280-e9c8-43ff-a175-2cbc814d3d0a req-44699779-c1ff-4da2-b1e7-a72c723ad044 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033879 Oct 11 04:42:18.740364 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2912/6069] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:42:19.139047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e15bcee3-3aaa-4074-9206-288b8b901aee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:19.140437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e15bcee3-3aaa-4074-9206-288b8b901aee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:19.150046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e15bcee3-3aaa-4074-9206-288b8b901aee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:19.150959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e15bcee3-3aaa-4074-9206-288b8b901aee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:19.151660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e15bcee3-3aaa-4074-9206-288b8b901aee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:19.152962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e15bcee3-3aaa-4074-9206-288b8b901aee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:19.153688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e15bcee3-3aaa-4074-9206-288b8b901aee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:19.154383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e15bcee3-3aaa-4074-9206-288b8b901aee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:19.430856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=16 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:19.435053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b4039cea-a420-4a20-96fd-b41c270c4d45 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:19.436113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b4039cea-a420-4a20-96fd-b41c270c4d45 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:19.447708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4039cea-a420-4a20-96fd-b41c270c4d45 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:19.458010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4039cea-a420-4a20-96fd-b41c270c4d45 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:19.458513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4039cea-a420-4a20-96fd-b41c270c4d45 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:19.461947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4039cea-a420-4a20-96fd-b41c270c4d45 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:19.462455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4039cea-a420-4a20-96fd-b41c270c4d45 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:19.462881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4039cea-a420-4a20-96fd-b41c270c4d45 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:19.585191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b4039cea-a420-4a20-96fd-b41c270c4d45 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:19.608294 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b4039cea-a420-4a20-96fd-b41c270c4d45 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1209 microversion: 2.1 time: 0.179256 Oct 11 04:42:19.613966 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2913/6070] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:19 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1209 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:19.750750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e15bcee3-3aaa-4074-9206-288b8b901aee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:19.762822 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e15bcee3-3aaa-4074-9206-288b8b901aee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1318 microversion: 2.1 time: 0.628210 Oct 11 04:42:19.763724 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3158/6071] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:19 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1318 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:20.636561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-405a66cb-f91c-4697-8633-a4cce40a051e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:20.637175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-405a66cb-f91c-4697-8633-a4cce40a051e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:20.645819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-405a66cb-f91c-4697-8633-a4cce40a051e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:20.646354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-405a66cb-f91c-4697-8633-a4cce40a051e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:20.653047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-405a66cb-f91c-4697-8633-a4cce40a051e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:20.653792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-405a66cb-f91c-4697-8633-a4cce40a051e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:20.654290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-405a66cb-f91c-4697-8633-a4cce40a051e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:20.654719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-405a66cb-f91c-4697-8633-a4cce40a051e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:20.729316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-405a66cb-f91c-4697-8633-a4cce40a051e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:20.739265 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-405a66cb-f91c-4697-8633-a4cce40a051e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1273 microversion: 2.1 time: 0.106681 Oct 11 04:42:20.740611 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2914/6072] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:20 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1273 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:20.785722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f60f3ef5-d6b3-425e-a220-4d70b4b063cb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:20.786364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f60f3ef5-d6b3-425e-a220-4d70b4b063cb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:20.793340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f60f3ef5-d6b3-425e-a220-4d70b4b063cb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:20.793828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f60f3ef5-d6b3-425e-a220-4d70b4b063cb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:20.794286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f60f3ef5-d6b3-425e-a220-4d70b4b063cb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:20.794981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f60f3ef5-d6b3-425e-a220-4d70b4b063cb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:20.795431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f60f3ef5-d6b3-425e-a220-4d70b4b063cb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:20.795855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f60f3ef5-d6b3-425e-a220-4d70b4b063cb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:21.015291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f60f3ef5-d6b3-425e-a220-4d70b4b063cb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:21.037228 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f60f3ef5-d6b3-425e-a220-4d70b4b063cb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1318 microversion: 2.1 time: 0.255094 Oct 11 04:42:21.038576 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3159/6073] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:20 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:21.455544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-4a79495c-4254-43f2-905e-715af059d2fc req-fe6b6bdc-41f9-4df4-a142-2d8391e9a156 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e166908f-75d7-4c0e-82e6-cb88690b8b6f", "name": "network-vif-plugged", "status": "completed", "tag": "f8dd10bb-4c5c-43cb-bdb0-faf2fdaa1829"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:21.465706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4a79495c-4254-43f2-905e-715af059d2fc req-fe6b6bdc-41f9-4df4-a142-2d8391e9a156 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:21.466407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4a79495c-4254-43f2-905e-715af059d2fc req-fe6b6bdc-41f9-4df4-a142-2d8391e9a156 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:21.466915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4a79495c-4254-43f2-905e-715af059d2fc req-fe6b6bdc-41f9-4df4-a142-2d8391e9a156 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:21.478163 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-4a79495c-4254-43f2-905e-715af059d2fc req-fe6b6bdc-41f9-4df4-a142-2d8391e9a156 service nova] Creating event network-vif-plugged:f8dd10bb-4c5c-43cb-bdb0-faf2fdaa1829 for instance e166908f-75d7-4c0e-82e6-cb88690b8b6f on n-h2-860892-1 Oct 11 04:42:21.483251 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-4a79495c-4254-43f2-905e-715af059d2fc req-fe6b6bdc-41f9-4df4-a142-2d8391e9a156 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031842 Oct 11 04:42:21.483871 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2915/6074] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:42:21.764104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d5b221bc-0549-4085-bc4b-6e3d0e3e5b0f tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:21.764785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d5b221bc-0549-4085-bc4b-6e3d0e3e5b0f tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:21.771379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b221bc-0549-4085-bc4b-6e3d0e3e5b0f tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:21.772135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b221bc-0549-4085-bc4b-6e3d0e3e5b0f tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:21.772656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b221bc-0549-4085-bc4b-6e3d0e3e5b0f tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:21.774062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b221bc-0549-4085-bc4b-6e3d0e3e5b0f tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:21.774639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b221bc-0549-4085-bc4b-6e3d0e3e5b0f tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:21.775128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5b221bc-0549-4085-bc4b-6e3d0e3e5b0f tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:21.908255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d5b221bc-0549-4085-bc4b-6e3d0e3e5b0f tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:21.916852 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d5b221bc-0549-4085-bc4b-6e3d0e3e5b0f tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1313 microversion: 2.1 time: 0.156816 Oct 11 04:42:21.917428 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3160/6075] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:21 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:22.068108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cc939df-0ae5-42d8-915e-2506b140f572 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:22.069427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2cc939df-0ae5-42d8-915e-2506b140f572 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:22.076519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc939df-0ae5-42d8-915e-2506b140f572 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:22.077020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc939df-0ae5-42d8-915e-2506b140f572 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:22.077466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc939df-0ae5-42d8-915e-2506b140f572 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:22.078178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc939df-0ae5-42d8-915e-2506b140f572 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:22.078840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc939df-0ae5-42d8-915e-2506b140f572 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:22.079433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cc939df-0ae5-42d8-915e-2506b140f572 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:22.308925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2cc939df-0ae5-42d8-915e-2506b140f572 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:22.317430 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2cc939df-0ae5-42d8-915e-2506b140f572 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1318 microversion: 2.1 time: 0.255085 Oct 11 04:42:22.330533 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2916/6076] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:22 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1318 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:22.889038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-9da94379-7ff0-450f-ab00-48d9ead7ebe0 req-2530a802-cf00-421a-8e02-95238b6bde05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e45f9751-ff42-43a0-b35b-6c8cb5f8dc55", "tag": "d4716b5a-2473-448f-83da-9dd90435a0e3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:22.900945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9da94379-7ff0-450f-ab00-48d9ead7ebe0 req-2530a802-cf00-421a-8e02-95238b6bde05 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:22.901429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9da94379-7ff0-450f-ab00-48d9ead7ebe0 req-2530a802-cf00-421a-8e02-95238b6bde05 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:22.902062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9da94379-7ff0-450f-ab00-48d9ead7ebe0 req-2530a802-cf00-421a-8e02-95238b6bde05 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:22.914284 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-9da94379-7ff0-450f-ab00-48d9ead7ebe0 req-2530a802-cf00-421a-8e02-95238b6bde05 service nova] Creating event network-changed:d4716b5a-2473-448f-83da-9dd90435a0e3 for instance e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 on n-h2-860892-1 Oct 11 04:42:22.919324 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-9da94379-7ff0-450f-ab00-48d9ead7ebe0 req-2530a802-cf00-421a-8e02-95238b6bde05 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034146 Oct 11 04:42:22.920033 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3161/6077] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:42:22.939172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3089f0d2-d1f7-4527-85ba-dedf4c22f2e6 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:22.942471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3089f0d2-d1f7-4527-85ba-dedf4c22f2e6 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:22.955671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3089f0d2-d1f7-4527-85ba-dedf4c22f2e6 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:22.956195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3089f0d2-d1f7-4527-85ba-dedf4c22f2e6 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:22.956645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3089f0d2-d1f7-4527-85ba-dedf4c22f2e6 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:22.957381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3089f0d2-d1f7-4527-85ba-dedf4c22f2e6 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:22.963672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3089f0d2-d1f7-4527-85ba-dedf4c22f2e6 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:22.964146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3089f0d2-d1f7-4527-85ba-dedf4c22f2e6 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:23.204232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3089f0d2-d1f7-4527-85ba-dedf4c22f2e6 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:23.212998 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3089f0d2-d1f7-4527-85ba-dedf4c22f2e6 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1313 microversion: 2.1 time: 0.277913 Oct 11 04:42:23.213974 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2917/6078] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:22 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:23.341175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4de0866a-eae0-4e15-835e-68760c2304c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:23.345815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4de0866a-eae0-4e15-835e-68760c2304c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:23.345815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:23.349593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de0866a-eae0-4e15-835e-68760c2304c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:23.350089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de0866a-eae0-4e15-835e-68760c2304c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:23.350565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de0866a-eae0-4e15-835e-68760c2304c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:23.351279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de0866a-eae0-4e15-835e-68760c2304c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:23.351834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de0866a-eae0-4e15-835e-68760c2304c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:23.352266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de0866a-eae0-4e15-835e-68760c2304c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:23.516301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4de0866a-eae0-4e15-835e-68760c2304c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:23.527043 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4de0866a-eae0-4e15-835e-68760c2304c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1508 microversion: 2.1 time: 0.189925 Oct 11 04:42:23.529208 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3162/6079] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:23 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:23.550182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dc882b1a-5305-4a2b-a546-e821ed8ed930 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:23.550820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dc882b1a-5305-4a2b-a546-e821ed8ed930 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:23.556986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc882b1a-5305-4a2b-a546-e821ed8ed930 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:23.558288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc882b1a-5305-4a2b-a546-e821ed8ed930 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:23.563228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc882b1a-5305-4a2b-a546-e821ed8ed930 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:23.563228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc882b1a-5305-4a2b-a546-e821ed8ed930 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:23.563228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc882b1a-5305-4a2b-a546-e821ed8ed930 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:23.563228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc882b1a-5305-4a2b-a546-e821ed8ed930 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:23.793391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc882b1a-5305-4a2b-a546-e821ed8ed930 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:23.805664 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dc882b1a-5305-4a2b-a546-e821ed8ed930 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1508 microversion: 2.1 time: 0.259881 Oct 11 04:42:23.806272 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2918/6080] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:23 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:23.836790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-68f15f5a-55f9-4b34-91fc-9dc2dfe84388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:23.841176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-68f15f5a-55f9-4b34-91fc-9dc2dfe84388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:23.857659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68f15f5a-55f9-4b34-91fc-9dc2dfe84388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:23.862379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68f15f5a-55f9-4b34-91fc-9dc2dfe84388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:23.862379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68f15f5a-55f9-4b34-91fc-9dc2dfe84388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:23.862379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68f15f5a-55f9-4b34-91fc-9dc2dfe84388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:23.862379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68f15f5a-55f9-4b34-91fc-9dc2dfe84388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:23.862379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68f15f5a-55f9-4b34-91fc-9dc2dfe84388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.050562 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-68f15f5a-55f9-4b34-91fc-9dc2dfe84388 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "PUT /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1080 microversion: 2.1 time: 0.223986 Oct 11 04:42:24.051689 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3163/6081] 10.222.0.26 () {60 vars in 1256 bytes} [Tue Oct 11 04:42:23 2022] PUT /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1080 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:24.069396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d83a960-006d-4db0-82f0-6b4798a55471 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:24.070017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0d83a960-006d-4db0-82f0-6b4798a55471 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:24.077178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d83a960-006d-4db0-82f0-6b4798a55471 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.077675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d83a960-006d-4db0-82f0-6b4798a55471 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.078129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d83a960-006d-4db0-82f0-6b4798a55471 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.078926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d83a960-006d-4db0-82f0-6b4798a55471 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.079390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d83a960-006d-4db0-82f0-6b4798a55471 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.079827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d83a960-006d-4db0-82f0-6b4798a55471 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.228083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0d83a960-006d-4db0-82f0-6b4798a55471 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:24.237207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9dcb70bc-e2b8-42f3-8495-76c4c08f7e6e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:24.238468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9dcb70bc-e2b8-42f3-8495-76c4c08f7e6e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:24.240272 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0d83a960-006d-4db0-82f0-6b4798a55471 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1506 microversion: 2.1 time: 0.174634 Oct 11 04:42:24.241244 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2919/6082] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:24 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1506 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:24.252660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dcb70bc-e2b8-42f3-8495-76c4c08f7e6e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.253394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dcb70bc-e2b8-42f3-8495-76c4c08f7e6e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.253997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dcb70bc-e2b8-42f3-8495-76c4c08f7e6e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.254996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dcb70bc-e2b8-42f3-8495-76c4c08f7e6e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.255595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dcb70bc-e2b8-42f3-8495-76c4c08f7e6e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.256220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9dcb70bc-e2b8-42f3-8495-76c4c08f7e6e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.268754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8311aec-bf0c-4c48-badb-d58391b0fc83 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:24.269385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f8311aec-bf0c-4c48-badb-d58391b0fc83 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:24.287697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8311aec-bf0c-4c48-badb-d58391b0fc83 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.290064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8311aec-bf0c-4c48-badb-d58391b0fc83 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.290601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8311aec-bf0c-4c48-badb-d58391b0fc83 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.291553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8311aec-bf0c-4c48-badb-d58391b0fc83 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.292028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8311aec-bf0c-4c48-badb-d58391b0fc83 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.292469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8311aec-bf0c-4c48-badb-d58391b0fc83 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.417238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9dcb70bc-e2b8-42f3-8495-76c4c08f7e6e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:24.426568 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9dcb70bc-e2b8-42f3-8495-76c4c08f7e6e tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1313 microversion: 2.1 time: 0.193267 Oct 11 04:42:24.427446 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3164/6083] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:24 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:24.452910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f8311aec-bf0c-4c48-badb-d58391b0fc83 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:24.455775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:24.461941 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f8311aec-bf0c-4c48-badb-d58391b0fc83 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1506 microversion: 2.1 time: 0.199629 Oct 11 04:42:24.462544 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2920/6084] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:24 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1506 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:24.484442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:24.487286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:24.493426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.493984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.494569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.495333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.495857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.496351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.581151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:42:24.581584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:42:24.582058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:42:24.582583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:42:24.583004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:42:24.844482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:24.851525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.852174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.854439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.855237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.856053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.856481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.887460 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-036a1246-194e-48bf-b8ed-40fcc53bda76 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "POST /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f/action" status: 202 len: 1112 microversion: 2.1 time: 0.407018 Oct 11 04:42:24.888105 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3165/6085] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:42:24 2022] POST /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f/action => generated 1112 bytes in 408 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Oct 11 04:42:24.911119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07721419-ed3b-4bef-8986-b20660cb47aa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:24.911907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-07721419-ed3b-4bef-8986-b20660cb47aa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:24.918433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07721419-ed3b-4bef-8986-b20660cb47aa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.918935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07721419-ed3b-4bef-8986-b20660cb47aa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.919382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07721419-ed3b-4bef-8986-b20660cb47aa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:24.920147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07721419-ed3b-4bef-8986-b20660cb47aa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:24.920613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07721419-ed3b-4bef-8986-b20660cb47aa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:24.921045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07721419-ed3b-4bef-8986-b20660cb47aa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:25.072145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-07721419-ed3b-4bef-8986-b20660cb47aa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:25.080994 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-07721419-ed3b-4bef-8986-b20660cb47aa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.173914 Oct 11 04:42:25.081768 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2921/6086] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:24 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:25.453333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8eacba3d-d018-498a-9331-8fa8c7e5de4a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:25.455274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8eacba3d-d018-498a-9331-8fa8c7e5de4a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:25.465015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8eacba3d-d018-498a-9331-8fa8c7e5de4a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:25.465772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8eacba3d-d018-498a-9331-8fa8c7e5de4a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:25.466409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8eacba3d-d018-498a-9331-8fa8c7e5de4a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:25.467316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8eacba3d-d018-498a-9331-8fa8c7e5de4a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:25.467994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8eacba3d-d018-498a-9331-8fa8c7e5de4a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:25.468688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8eacba3d-d018-498a-9331-8fa8c7e5de4a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:25.668866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8eacba3d-d018-498a-9331-8fa8c7e5de4a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:25.676924 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8eacba3d-d018-498a-9331-8fa8c7e5de4a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1313 microversion: 2.1 time: 0.230698 Oct 11 04:42:25.677503 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3166/6087] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:25 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:26.104979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-97add426-5a51-4619-8672-338aef256150 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:26.109927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-97add426-5a51-4619-8672-338aef256150 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:26.112551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97add426-5a51-4619-8672-338aef256150 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:26.113031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97add426-5a51-4619-8672-338aef256150 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:26.113469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97add426-5a51-4619-8672-338aef256150 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:26.114155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97add426-5a51-4619-8672-338aef256150 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:26.114631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97add426-5a51-4619-8672-338aef256150 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:26.115056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-97add426-5a51-4619-8672-338aef256150 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:26.274567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-97add426-5a51-4619-8672-338aef256150 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:26.282914 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-97add426-5a51-4619-8672-338aef256150 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.181780 Oct 11 04:42:26.287907 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2922/6088] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:26 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:26.700847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4cf11685-7e58-470e-b907-f551d7a93f84 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:26.702427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4cf11685-7e58-470e-b907-f551d7a93f84 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:26.710617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cf11685-7e58-470e-b907-f551d7a93f84 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:26.717110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cf11685-7e58-470e-b907-f551d7a93f84 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:26.717110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cf11685-7e58-470e-b907-f551d7a93f84 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:26.717110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cf11685-7e58-470e-b907-f551d7a93f84 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:26.717110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cf11685-7e58-470e-b907-f551d7a93f84 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:26.717110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cf11685-7e58-470e-b907-f551d7a93f84 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:26.855602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4cf11685-7e58-470e-b907-f551d7a93f84 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:26.864411 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4cf11685-7e58-470e-b907-f551d7a93f84 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1313 microversion: 2.1 time: 0.167779 Oct 11 04:42:26.865068 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3167/6089] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:26 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:27.306297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bd411bd3-400d-463b-a6eb-6b609019fbb3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:27.306913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bd411bd3-400d-463b-a6eb-6b609019fbb3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:27.315034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd411bd3-400d-463b-a6eb-6b609019fbb3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:27.315521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd411bd3-400d-463b-a6eb-6b609019fbb3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:27.316166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd411bd3-400d-463b-a6eb-6b609019fbb3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:27.317120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd411bd3-400d-463b-a6eb-6b609019fbb3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:27.317742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd411bd3-400d-463b-a6eb-6b609019fbb3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:27.318176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd411bd3-400d-463b-a6eb-6b609019fbb3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:27.462061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd411bd3-400d-463b-a6eb-6b609019fbb3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:27.470713 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bd411bd3-400d-463b-a6eb-6b609019fbb3 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.168172 Oct 11 04:42:27.471301 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2923/6090] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:27 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:27.887968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b7d8ccf2-b58c-45e6-912a-65c220ceaa73 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:27.898625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b7d8ccf2-b58c-45e6-912a-65c220ceaa73 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:27.898625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:27.898625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7d8ccf2-b58c-45e6-912a-65c220ceaa73 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:27.898625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7d8ccf2-b58c-45e6-912a-65c220ceaa73 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:27.898625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7d8ccf2-b58c-45e6-912a-65c220ceaa73 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:27.899500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7d8ccf2-b58c-45e6-912a-65c220ceaa73 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:27.899500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7d8ccf2-b58c-45e6-912a-65c220ceaa73 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:27.899845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7d8ccf2-b58c-45e6-912a-65c220ceaa73 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:28.050851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b7d8ccf2-b58c-45e6-912a-65c220ceaa73 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:28.058723 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b7d8ccf2-b58c-45e6-912a-65c220ceaa73 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1313 microversion: 2.1 time: 0.174598 Oct 11 04:42:28.059290 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3168/6091] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:27 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:28.494328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4ca20ed3-4856-4cbf-8bc0-e7979dd319ba tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:28.494977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4ca20ed3-4856-4cbf-8bc0-e7979dd319ba tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:28.501629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca20ed3-4856-4cbf-8bc0-e7979dd319ba tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:28.502642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca20ed3-4856-4cbf-8bc0-e7979dd319ba tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:28.503123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca20ed3-4856-4cbf-8bc0-e7979dd319ba tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:28.503826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca20ed3-4856-4cbf-8bc0-e7979dd319ba tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:28.504284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca20ed3-4856-4cbf-8bc0-e7979dd319ba tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:28.504713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4ca20ed3-4856-4cbf-8bc0-e7979dd319ba tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:28.645147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4ca20ed3-4856-4cbf-8bc0-e7979dd319ba tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:28.653670 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4ca20ed3-4856-4cbf-8bc0-e7979dd319ba tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.162602 Oct 11 04:42:28.653670 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2924/6092] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:28 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:29.081198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-77088b77-b7f3-47cc-a098-2923324c6fef tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:29.081823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-77088b77-b7f3-47cc-a098-2923324c6fef tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:29.084145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=20 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:29.090753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77088b77-b7f3-47cc-a098-2923324c6fef tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:29.091958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77088b77-b7f3-47cc-a098-2923324c6fef tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:29.091958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77088b77-b7f3-47cc-a098-2923324c6fef tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:29.092419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77088b77-b7f3-47cc-a098-2923324c6fef tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:29.092878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77088b77-b7f3-47cc-a098-2923324c6fef tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:29.093311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77088b77-b7f3-47cc-a098-2923324c6fef tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:29.098010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:29.230121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-77088b77-b7f3-47cc-a098-2923324c6fef tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:29.238406 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-77088b77-b7f3-47cc-a098-2923324c6fef tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1313 microversion: 2.1 time: 0.161392 Oct 11 04:42:29.238986 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3169/6093] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:29 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:29.483479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-b3f0e9cd-230f-40d6-9aec-eb7b9f4626f4 req-5fdc7d3f-fc6d-453e-97ad-9f78bbb521c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e45f9751-ff42-43a0-b35b-6c8cb5f8dc55", "name": "network-vif-plugged", "status": "completed", "tag": "d4716b5a-2473-448f-83da-9dd90435a0e3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:29.493404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b3f0e9cd-230f-40d6-9aec-eb7b9f4626f4 req-5fdc7d3f-fc6d-453e-97ad-9f78bbb521c6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:29.493953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b3f0e9cd-230f-40d6-9aec-eb7b9f4626f4 req-5fdc7d3f-fc6d-453e-97ad-9f78bbb521c6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:29.494474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b3f0e9cd-230f-40d6-9aec-eb7b9f4626f4 req-5fdc7d3f-fc6d-453e-97ad-9f78bbb521c6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:29.506862 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-b3f0e9cd-230f-40d6-9aec-eb7b9f4626f4 req-5fdc7d3f-fc6d-453e-97ad-9f78bbb521c6 service nova] Creating event network-vif-plugged:d4716b5a-2473-448f-83da-9dd90435a0e3 for instance e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 on n-h2-860892-1 Oct 11 04:42:29.512238 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-b3f0e9cd-230f-40d6-9aec-eb7b9f4626f4 req-5fdc7d3f-fc6d-453e-97ad-9f78bbb521c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045377 Oct 11 04:42:29.513253 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2925/6094] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:42:29.677704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d832108-2ce7-4cc9-a1d5-66984ef60b61 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:29.678354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d832108-2ce7-4cc9-a1d5-66984ef60b61 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:29.684764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d832108-2ce7-4cc9-a1d5-66984ef60b61 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:29.685266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d832108-2ce7-4cc9-a1d5-66984ef60b61 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:29.685727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d832108-2ce7-4cc9-a1d5-66984ef60b61 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:29.686448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d832108-2ce7-4cc9-a1d5-66984ef60b61 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:29.687074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d832108-2ce7-4cc9-a1d5-66984ef60b61 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:29.687664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d832108-2ce7-4cc9-a1d5-66984ef60b61 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:29.829539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d832108-2ce7-4cc9-a1d5-66984ef60b61 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:29.838211 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d832108-2ce7-4cc9-a1d5-66984ef60b61 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.165207 Oct 11 04:42:29.839090 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3170/6095] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:29 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:30.262340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b5737ce-3ab8-4c3f-8c6e-ccd060006bb5 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:30.263462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2b5737ce-3ab8-4c3f-8c6e-ccd060006bb5 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:30.270745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b5737ce-3ab8-4c3f-8c6e-ccd060006bb5 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:30.271232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b5737ce-3ab8-4c3f-8c6e-ccd060006bb5 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:30.271667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b5737ce-3ab8-4c3f-8c6e-ccd060006bb5 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:30.272359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b5737ce-3ab8-4c3f-8c6e-ccd060006bb5 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:30.272812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b5737ce-3ab8-4c3f-8c6e-ccd060006bb5 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:30.273234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b5737ce-3ab8-4c3f-8c6e-ccd060006bb5 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:30.407783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2b5737ce-3ab8-4c3f-8c6e-ccd060006bb5 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:30.416354 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b5737ce-3ab8-4c3f-8c6e-ccd060006bb5 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1313 microversion: 2.1 time: 0.159100 Oct 11 04:42:30.417099 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2926/6096] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:30 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:30.862536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e568f90e-d1db-45e6-bb7c-525ed8173643 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:30.863161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e568f90e-d1db-45e6-bb7c-525ed8173643 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:30.871134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e568f90e-d1db-45e6-bb7c-525ed8173643 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:30.871940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e568f90e-d1db-45e6-bb7c-525ed8173643 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:30.872542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e568f90e-d1db-45e6-bb7c-525ed8173643 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:30.873431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e568f90e-d1db-45e6-bb7c-525ed8173643 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:30.873895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e568f90e-d1db-45e6-bb7c-525ed8173643 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:30.874354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e568f90e-d1db-45e6-bb7c-525ed8173643 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:31.013815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e568f90e-d1db-45e6-bb7c-525ed8173643 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:31.023286 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e568f90e-d1db-45e6-bb7c-525ed8173643 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.166173 Oct 11 04:42:31.023867 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3171/6097] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:30 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:31.443134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5c7f068-0c05-46d5-bbc7-523798470d43 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:31.443692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d5c7f068-0c05-46d5-bbc7-523798470d43 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:31.450635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c7f068-0c05-46d5-bbc7-523798470d43 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:31.451129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c7f068-0c05-46d5-bbc7-523798470d43 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:31.451566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c7f068-0c05-46d5-bbc7-523798470d43 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:31.452287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c7f068-0c05-46d5-bbc7-523798470d43 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:31.452760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c7f068-0c05-46d5-bbc7-523798470d43 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:31.453219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c7f068-0c05-46d5-bbc7-523798470d43 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:31.593439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d5c7f068-0c05-46d5-bbc7-523798470d43 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:31.601405 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d5c7f068-0c05-46d5-bbc7-523798470d43 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1497 microversion: 2.1 time: 0.162902 Oct 11 04:42:31.601981 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2927/6098] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:31 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1497 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:32.047366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-adff1a3d-8402-4922-823c-0f09aefc03c0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:32.047988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-adff1a3d-8402-4922-823c-0f09aefc03c0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:32.055033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-adff1a3d-8402-4922-823c-0f09aefc03c0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:32.055511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-adff1a3d-8402-4922-823c-0f09aefc03c0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:32.055949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-adff1a3d-8402-4922-823c-0f09aefc03c0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:32.056637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-adff1a3d-8402-4922-823c-0f09aefc03c0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:32.057089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-adff1a3d-8402-4922-823c-0f09aefc03c0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:32.057516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-adff1a3d-8402-4922-823c-0f09aefc03c0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:32.191789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-adff1a3d-8402-4922-823c-0f09aefc03c0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:32.199822 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-adff1a3d-8402-4922-823c-0f09aefc03c0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.156779 Oct 11 04:42:32.200413 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3172/6099] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:32 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:33.224614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb2a596f-1d6e-4085-a5a3-aa4e684d1b9e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:33.225246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fb2a596f-1d6e-4085-a5a3-aa4e684d1b9e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:33.228011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:33.232769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb2a596f-1d6e-4085-a5a3-aa4e684d1b9e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:33.237368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb2a596f-1d6e-4085-a5a3-aa4e684d1b9e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:33.237368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb2a596f-1d6e-4085-a5a3-aa4e684d1b9e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:33.237368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb2a596f-1d6e-4085-a5a3-aa4e684d1b9e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:33.237368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb2a596f-1d6e-4085-a5a3-aa4e684d1b9e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:33.237368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb2a596f-1d6e-4085-a5a3-aa4e684d1b9e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:33.391212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb2a596f-1d6e-4085-a5a3-aa4e684d1b9e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:33.404994 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb2a596f-1d6e-4085-a5a3-aa4e684d1b9e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.184896 Oct 11 04:42:33.408559 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2928/6100] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:33 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:34.432538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-508b0319-50c4-4356-98b9-fcf6a8edeb9a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:34.440198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-508b0319-50c4-4356-98b9-fcf6a8edeb9a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:34.441486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508b0319-50c4-4356-98b9-fcf6a8edeb9a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:34.441486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508b0319-50c4-4356-98b9-fcf6a8edeb9a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:34.441931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508b0319-50c4-4356-98b9-fcf6a8edeb9a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:34.442644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508b0319-50c4-4356-98b9-fcf6a8edeb9a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:34.443093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508b0319-50c4-4356-98b9-fcf6a8edeb9a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:34.443517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508b0319-50c4-4356-98b9-fcf6a8edeb9a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:34.581012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-508b0319-50c4-4356-98b9-fcf6a8edeb9a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:34.589671 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-508b0319-50c4-4356-98b9-fcf6a8edeb9a tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.161046 Oct 11 04:42:34.590305 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3173/6101] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:34 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:35.613536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-20c7527f-c41f-47c6-9662-258df80d7533 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:35.614272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-20c7527f-c41f-47c6-9662-258df80d7533 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:35.625024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20c7527f-c41f-47c6-9662-258df80d7533 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:35.625591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20c7527f-c41f-47c6-9662-258df80d7533 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:35.626040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20c7527f-c41f-47c6-9662-258df80d7533 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:35.626785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20c7527f-c41f-47c6-9662-258df80d7533 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:35.627246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20c7527f-c41f-47c6-9662-258df80d7533 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:35.627707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20c7527f-c41f-47c6-9662-258df80d7533 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:35.805757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-20c7527f-c41f-47c6-9662-258df80d7533 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:35.830512 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-20c7527f-c41f-47c6-9662-258df80d7533 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.219001 Oct 11 04:42:35.834814 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2929/6102] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:35 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:36.859787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f7aab579-fdab-40bb-a3a0-6d9fac34f9d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:36.866057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f7aab579-fdab-40bb-a3a0-6d9fac34f9d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:36.870673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aab579-fdab-40bb-a3a0-6d9fac34f9d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:36.872708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aab579-fdab-40bb-a3a0-6d9fac34f9d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:36.873343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aab579-fdab-40bb-a3a0-6d9fac34f9d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:36.874251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aab579-fdab-40bb-a3a0-6d9fac34f9d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:36.874866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aab579-fdab-40bb-a3a0-6d9fac34f9d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:36.875454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7aab579-fdab-40bb-a3a0-6d9fac34f9d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:37.049062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f7aab579-fdab-40bb-a3a0-6d9fac34f9d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:37.063568 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f7aab579-fdab-40bb-a3a0-6d9fac34f9d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.207510 Oct 11 04:42:37.064164 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3174/6103] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:36 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:37.113781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8abc759b-115c-48fd-ab48-c0484845a38a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:37.114305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8abc759b-115c-48fd-ab48-c0484845a38a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:37.122021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8abc759b-115c-48fd-ab48-c0484845a38a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:37.122531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8abc759b-115c-48fd-ab48-c0484845a38a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:37.123346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8abc759b-115c-48fd-ab48-c0484845a38a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:37.123901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8abc759b-115c-48fd-ab48-c0484845a38a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:37.124351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8abc759b-115c-48fd-ab48-c0484845a38a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:37.124772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8abc759b-115c-48fd-ab48-c0484845a38a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:37.156182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8abc759b-115c-48fd-ab48-c0484845a38a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:42:37.506344 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8abc759b-115c-48fd-ab48-c0484845a38a tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 204 len: 0 microversion: 2.1 time: 0.396796 Oct 11 04:42:37.507174 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2930/6104] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:42:37 2022] DELETE /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:42:37.515598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f993e1f-af49-45be-b2d9-f27c912c9db8 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:37.520548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f993e1f-af49-45be-b2d9-f27c912c9db8 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:37.522728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f993e1f-af49-45be-b2d9-f27c912c9db8 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:37.523400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f993e1f-af49-45be-b2d9-f27c912c9db8 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:37.524021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f993e1f-af49-45be-b2d9-f27c912c9db8 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:37.524888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f993e1f-af49-45be-b2d9-f27c912c9db8 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:37.525509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f993e1f-af49-45be-b2d9-f27c912c9db8 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:37.526757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f993e1f-af49-45be-b2d9-f27c912c9db8 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:37.668059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2f993e1f-af49-45be-b2d9-f27c912c9db8 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:37.676393 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f993e1f-af49-45be-b2d9-f27c912c9db8 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1503 microversion: 2.1 time: 0.164628 Oct 11 04:42:37.676968 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3175/6105] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:37 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:38.087885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-21798fa4-d464-482f-acaa-a816aa21a7ac tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:38.088585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-21798fa4-d464-482f-acaa-a816aa21a7ac tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:38.094679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21798fa4-d464-482f-acaa-a816aa21a7ac tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:38.095163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21798fa4-d464-482f-acaa-a816aa21a7ac tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:38.095603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21798fa4-d464-482f-acaa-a816aa21a7ac tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:38.099285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21798fa4-d464-482f-acaa-a816aa21a7ac tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:38.099285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21798fa4-d464-482f-acaa-a816aa21a7ac tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:38.099285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21798fa4-d464-482f-acaa-a816aa21a7ac tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:38.235403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-21798fa4-d464-482f-acaa-a816aa21a7ac tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:38.243118 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-21798fa4-d464-482f-acaa-a816aa21a7ac tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.159701 Oct 11 04:42:38.243680 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2931/6106] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:38 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:38.699043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0b32fe34-a528-4f9d-b7d0-7f7d461261cb tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:38.699688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0b32fe34-a528-4f9d-b7d0-7f7d461261cb tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:38.707043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b32fe34-a528-4f9d-b7d0-7f7d461261cb tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:38.707531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b32fe34-a528-4f9d-b7d0-7f7d461261cb tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:38.711018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b32fe34-a528-4f9d-b7d0-7f7d461261cb tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:38.711018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b32fe34-a528-4f9d-b7d0-7f7d461261cb tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:38.711018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b32fe34-a528-4f9d-b7d0-7f7d461261cb tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:38.711018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0b32fe34-a528-4f9d-b7d0-7f7d461261cb tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:38.845511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0b32fe34-a528-4f9d-b7d0-7f7d461261cb tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:38.854512 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0b32fe34-a528-4f9d-b7d0-7f7d461261cb tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1503 microversion: 2.1 time: 0.159193 Oct 11 04:42:38.855102 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3176/6107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:38 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1503 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:39.270146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f519b194-eec4-4a26-9925-78daddc76a75 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:39.270796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f519b194-eec4-4a26-9925-78daddc76a75 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:39.278146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f519b194-eec4-4a26-9925-78daddc76a75 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:39.278794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f519b194-eec4-4a26-9925-78daddc76a75 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:39.279231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f519b194-eec4-4a26-9925-78daddc76a75 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:39.279940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f519b194-eec4-4a26-9925-78daddc76a75 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:39.280390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f519b194-eec4-4a26-9925-78daddc76a75 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:39.281018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f519b194-eec4-4a26-9925-78daddc76a75 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:39.453956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f519b194-eec4-4a26-9925-78daddc76a75 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:39.463042 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f519b194-eec4-4a26-9925-78daddc76a75 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.200361 Oct 11 04:42:39.463622 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2932/6108] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:39 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:39.512007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-52f89dd1-5d66-4e3a-8996-5e4dc06ddff3 req-14eeb0c2-0007-44e9-9dcb-ec570b75530e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e45f9751-ff42-43a0-b35b-6c8cb5f8dc55", "name": "network-vif-deleted", "tag": "d4716b5a-2473-448f-83da-9dd90435a0e3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:39.525801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-52f89dd1-5d66-4e3a-8996-5e4dc06ddff3 req-14eeb0c2-0007-44e9-9dcb-ec570b75530e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:39.530611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-52f89dd1-5d66-4e3a-8996-5e4dc06ddff3 req-14eeb0c2-0007-44e9-9dcb-ec570b75530e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:39.531055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-52f89dd1-5d66-4e3a-8996-5e4dc06ddff3 req-14eeb0c2-0007-44e9-9dcb-ec570b75530e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:39.543169 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-52f89dd1-5d66-4e3a-8996-5e4dc06ddff3 req-14eeb0c2-0007-44e9-9dcb-ec570b75530e service nova] Creating event network-vif-deleted:d4716b5a-2473-448f-83da-9dd90435a0e3 for instance e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 on n-h2-860892-1 Oct 11 04:42:39.559377 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-52f89dd1-5d66-4e3a-8996-5e4dc06ddff3 req-14eeb0c2-0007-44e9-9dcb-ec570b75530e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051068 Oct 11 04:42:39.559960 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3177/6109] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:42:39.880400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:39.881027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:39.898160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:39.902557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:39.902557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:39.902557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:39.902557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:39.902557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:39.940610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:39.941446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:39.941806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:39.942475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lazy-loading 'fault' on Instance uuid e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:42:39.988159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7a8665c19a49498092d9c1b96e8b438c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00f5cb3632074eb99ed10b6ea9003c9f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:39.996153 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-828bf35c-7e09-4d3a-b7f5-f38f033d2459 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 200 len: 1303 microversion: 2.1 time: 0.121687 Oct 11 04:42:39.996844 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2933/6110] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:39 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:40.490872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3c8a4507-3c61-4ae6-886c-65827cb9ce36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:40.491597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3c8a4507-3c61-4ae6-886c-65827cb9ce36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:40.497896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c8a4507-3c61-4ae6-886c-65827cb9ce36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:40.498648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c8a4507-3c61-4ae6-886c-65827cb9ce36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:40.499095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c8a4507-3c61-4ae6-886c-65827cb9ce36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:40.499858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c8a4507-3c61-4ae6-886c-65827cb9ce36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:40.500478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c8a4507-3c61-4ae6-886c-65827cb9ce36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:40.501103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c8a4507-3c61-4ae6-886c-65827cb9ce36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:40.663633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3c8a4507-3c61-4ae6-886c-65827cb9ce36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:40.672131 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3c8a4507-3c61-4ae6-886c-65827cb9ce36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.188359 Oct 11 04:42:40.672715 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3178/6111] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:40 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:41.019911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:41.020548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] [instance: e45f9751-ff42-43a0-b35b-6c8cb5f8dc55] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:41.027237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:41.027712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:41.028148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:41.028829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:41.029277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:41.029696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:41.044350 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] HTTP exception thrown: Instance e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 could not be found. Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Request method failure captured: Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 HTTP/1.1 Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPQk4o5kopLw6cHr_I3PXCiHUgL_hqLu7X15Cy9ExE9ieIFp7z622xM3h_ibHmB44gCNtS_hR7fuc9Rzr8HoBAnSh5GDmzvnIkVG3FqQxCB4W_nV0ZA-ockNcUieNWP8_en_QxA7IvIL7XI4o4Mm_wsyHWrcq-eM37-qKXPwWLVjEw4 Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 00f5cb3632074eb99ed10b6ea9003c9f Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-VolumesActionsTest-1173242878 Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/00f5cb3632074eb99ed10b6ea9003c9f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_00f5cb3632074eb99ed10b6ea9003c9f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00f5cb3632074eb99ed10b6ea9003c9f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/00f5cb3632074eb99ed10b6ea9003c9f"}]}] Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-VolumesActionsTest-1173242878 Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 00f5cb3632074eb99ed10b6ea9003c9f Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-VolumesActionsTest-1173242878 Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-VolumesActionsTest-1173242878-project Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 7a8665c19a49498092d9c1b96e8b438c Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-VolumesActionsTest-1173242878-project Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 could not be found. Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e45f9751-ff42-43a0-b35b-6c8cb5f8dc55'} Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 could not be found. Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 could not be found. Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:42:41.046076 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:42:41.052198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:42:41.052198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:42:41.052198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:42:41.052198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:42:41.052198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:42:41.052198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 could not be found. Oct 11 04:42:41.052198 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:42:41.052198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] Returning 404 to user: Instance e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:42:41.052198 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-67e3009c-688c-428c-9cf4-ed718d04f079 tempest-VolumesActionsTest-1173242878 tempest-VolumesActionsTest-1173242878-project] 10.222.0.26 "GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55" status: 404 len: 111 microversion: 2.1 time: 0.031789 Oct 11 04:42:41.052198 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2934/6112] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:41 2022] GET /compute/v2.1/servers/e45f9751-ff42-43a0-b35b-6c8cb5f8dc55 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:42:41.719448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-245adcba-681e-4774-bb29-87969adccf0b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:41.720248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-245adcba-681e-4774-bb29-87969adccf0b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:41.728324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245adcba-681e-4774-bb29-87969adccf0b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:41.731479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245adcba-681e-4774-bb29-87969adccf0b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:41.731479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245adcba-681e-4774-bb29-87969adccf0b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:41.731479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245adcba-681e-4774-bb29-87969adccf0b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:41.731479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245adcba-681e-4774-bb29-87969adccf0b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:41.731479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245adcba-681e-4774-bb29-87969adccf0b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:41.928173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-245adcba-681e-4774-bb29-87969adccf0b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:41.937361 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-245adcba-681e-4774-bb29-87969adccf0b tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.244650 Oct 11 04:42:41.938367 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3179/6113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:41 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:42.962868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5faafe9c-37de-49c1-8946-c2be4fcef403 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:42.963740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5faafe9c-37de-49c1-8946-c2be4fcef403 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:42.972433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faafe9c-37de-49c1-8946-c2be4fcef403 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:42.973029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faafe9c-37de-49c1-8946-c2be4fcef403 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:42.973604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faafe9c-37de-49c1-8946-c2be4fcef403 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:42.974590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faafe9c-37de-49c1-8946-c2be4fcef403 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:42.975129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faafe9c-37de-49c1-8946-c2be4fcef403 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:42.975768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faafe9c-37de-49c1-8946-c2be4fcef403 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:43.151719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5faafe9c-37de-49c1-8946-c2be4fcef403 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:43.161310 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5faafe9c-37de-49c1-8946-c2be4fcef403 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.203296 Oct 11 04:42:43.179133 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2935/6114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:42 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:44.186952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e6efd604-fc8e-4a85-9a35-2ca37191b870 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:44.187655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e6efd604-fc8e-4a85-9a35-2ca37191b870 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:44.195549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6efd604-fc8e-4a85-9a35-2ca37191b870 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:44.196039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6efd604-fc8e-4a85-9a35-2ca37191b870 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:44.196478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6efd604-fc8e-4a85-9a35-2ca37191b870 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:44.197188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6efd604-fc8e-4a85-9a35-2ca37191b870 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:44.198043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6efd604-fc8e-4a85-9a35-2ca37191b870 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:44.198150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e6efd604-fc8e-4a85-9a35-2ca37191b870 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:44.371245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e6efd604-fc8e-4a85-9a35-2ca37191b870 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:44.385316 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e6efd604-fc8e-4a85-9a35-2ca37191b870 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.202259 Oct 11 04:42:44.386147 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3180/6115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:44 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:45.417792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2884fbc0-a710-4e18-b80a-c1075cda436f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:45.418620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2884fbc0-a710-4e18-b80a-c1075cda436f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:45.428381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2884fbc0-a710-4e18-b80a-c1075cda436f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:45.429126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2884fbc0-a710-4e18-b80a-c1075cda436f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:45.429681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2884fbc0-a710-4e18-b80a-c1075cda436f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:45.430779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2884fbc0-a710-4e18-b80a-c1075cda436f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:45.431432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2884fbc0-a710-4e18-b80a-c1075cda436f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:45.432050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2884fbc0-a710-4e18-b80a-c1075cda436f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:46.003306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2884fbc0-a710-4e18-b80a-c1075cda436f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:46.006890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:46.014210 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2884fbc0-a710-4e18-b80a-c1075cda436f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.601033 Oct 11 04:42:46.014868 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2936/6116] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:45 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:47.042776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c1712d36-46bc-4b2d-a41f-016d0f87a5f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:47.044279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c1712d36-46bc-4b2d-a41f-016d0f87a5f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:47.053679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1712d36-46bc-4b2d-a41f-016d0f87a5f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:47.063528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1712d36-46bc-4b2d-a41f-016d0f87a5f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:47.063528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1712d36-46bc-4b2d-a41f-016d0f87a5f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:47.063528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1712d36-46bc-4b2d-a41f-016d0f87a5f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:47.063528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1712d36-46bc-4b2d-a41f-016d0f87a5f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:47.063528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1712d36-46bc-4b2d-a41f-016d0f87a5f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:47.220408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c1712d36-46bc-4b2d-a41f-016d0f87a5f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:47.230293 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c1712d36-46bc-4b2d-a41f-016d0f87a5f1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.193788 Oct 11 04:42:47.231597 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3181/6117] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:47 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:48.255238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1bf51c8-dee7-48d4-b891-810e65a12fcd tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:48.255828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f1bf51c8-dee7-48d4-b891-810e65a12fcd tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:48.263576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1bf51c8-dee7-48d4-b891-810e65a12fcd tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:48.264058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1bf51c8-dee7-48d4-b891-810e65a12fcd tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:48.264564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1bf51c8-dee7-48d4-b891-810e65a12fcd tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:48.265265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1bf51c8-dee7-48d4-b891-810e65a12fcd tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:48.265917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1bf51c8-dee7-48d4-b891-810e65a12fcd tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:48.266547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1bf51c8-dee7-48d4-b891-810e65a12fcd tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:48.468422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f1bf51c8-dee7-48d4-b891-810e65a12fcd tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:48.498679 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f1bf51c8-dee7-48d4-b891-810e65a12fcd tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.228205 Oct 11 04:42:48.498679 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2937/6118] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:48 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:49.513236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d729cdc-aa59-44e4-8082-a7725213de7e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:49.514950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d729cdc-aa59-44e4-8082-a7725213de7e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:49.533294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d729cdc-aa59-44e4-8082-a7725213de7e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:49.553472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d729cdc-aa59-44e4-8082-a7725213de7e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.020s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:49.561804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d729cdc-aa59-44e4-8082-a7725213de7e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:49.562600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d729cdc-aa59-44e4-8082-a7725213de7e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:49.563074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d729cdc-aa59-44e4-8082-a7725213de7e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:49.563513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d729cdc-aa59-44e4-8082-a7725213de7e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:50.176453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d729cdc-aa59-44e4-8082-a7725213de7e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:50.190949 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d729cdc-aa59-44e4-8082-a7725213de7e tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.680880 Oct 11 04:42:50.191973 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3182/6119] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:49 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:51.224188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-199e5a42-d430-451c-a77e-2dad8309fb97 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:51.225029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-199e5a42-d430-451c-a77e-2dad8309fb97 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:51.235662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-199e5a42-d430-451c-a77e-2dad8309fb97 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:51.236947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-199e5a42-d430-451c-a77e-2dad8309fb97 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:51.236947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-199e5a42-d430-451c-a77e-2dad8309fb97 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:51.237356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-199e5a42-d430-451c-a77e-2dad8309fb97 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:51.238048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-199e5a42-d430-451c-a77e-2dad8309fb97 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:51.238252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-199e5a42-d430-451c-a77e-2dad8309fb97 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:51.396375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-199e5a42-d430-451c-a77e-2dad8309fb97 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:51.404488 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-199e5a42-d430-451c-a77e-2dad8309fb97 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1517 microversion: 2.1 time: 0.186027 Oct 11 04:42:51.405124 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2938/6120] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:51 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1517 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:52.428701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c29b5302-1b7f-4d3a-ae37-ea6962433551 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:52.429447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c29b5302-1b7f-4d3a-ae37-ea6962433551 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:52.436896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c29b5302-1b7f-4d3a-ae37-ea6962433551 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:52.437473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c29b5302-1b7f-4d3a-ae37-ea6962433551 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:52.438081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c29b5302-1b7f-4d3a-ae37-ea6962433551 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:52.438917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c29b5302-1b7f-4d3a-ae37-ea6962433551 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:52.439374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c29b5302-1b7f-4d3a-ae37-ea6962433551 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:52.440429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c29b5302-1b7f-4d3a-ae37-ea6962433551 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:52.640011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c29b5302-1b7f-4d3a-ae37-ea6962433551 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:52.648329 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c29b5302-1b7f-4d3a-ae37-ea6962433551 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1523 microversion: 2.1 time: 0.223735 Oct 11 04:42:52.648901 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3183/6121] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:52 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1523 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:53.672248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef661e7f-da72-470d-9680-07fc81464a50 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:53.672864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef661e7f-da72-470d-9680-07fc81464a50 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:53.680365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef661e7f-da72-470d-9680-07fc81464a50 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:53.680869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef661e7f-da72-470d-9680-07fc81464a50 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:53.681315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef661e7f-da72-470d-9680-07fc81464a50 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:53.682035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef661e7f-da72-470d-9680-07fc81464a50 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:53.682525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef661e7f-da72-470d-9680-07fc81464a50 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:53.682953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef661e7f-da72-470d-9680-07fc81464a50 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:53.857991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef661e7f-da72-470d-9680-07fc81464a50 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:53.867126 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef661e7f-da72-470d-9680-07fc81464a50 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1523 microversion: 2.1 time: 0.198786 Oct 11 04:42:53.867586 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2939/6122] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:53 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1523 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:54.891927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-64536499-ef8f-4876-bbcd-36e036b751df tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:54.892564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-64536499-ef8f-4876-bbcd-36e036b751df tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:54.897536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=48 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:42:54.905146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64536499-ef8f-4876-bbcd-36e036b751df tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:54.905146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64536499-ef8f-4876-bbcd-36e036b751df tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:54.905146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64536499-ef8f-4876-bbcd-36e036b751df tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:54.905146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64536499-ef8f-4876-bbcd-36e036b751df tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:54.905146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64536499-ef8f-4876-bbcd-36e036b751df tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:54.905146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64536499-ef8f-4876-bbcd-36e036b751df tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:55.041331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-64536499-ef8f-4876-bbcd-36e036b751df tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:55.051267 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-64536499-ef8f-4876-bbcd-36e036b751df tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1523 microversion: 2.1 time: 0.163930 Oct 11 04:42:55.051995 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3184/6123] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:54 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:55.611897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-87f5d805-48bf-4579-9aa7-d8f5364e6a2e req-4cb5c8b2-082f-4da3-97af-4e34d9e5279f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e166908f-75d7-4c0e-82e6-cb88690b8b6f", "name": "network-vif-unplugged", "status": "completed", "tag": "f8dd10bb-4c5c-43cb-bdb0-faf2fdaa1829"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:55.625408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-87f5d805-48bf-4579-9aa7-d8f5364e6a2e req-4cb5c8b2-082f-4da3-97af-4e34d9e5279f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:55.625941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-87f5d805-48bf-4579-9aa7-d8f5364e6a2e req-4cb5c8b2-082f-4da3-97af-4e34d9e5279f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:55.626397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-87f5d805-48bf-4579-9aa7-d8f5364e6a2e req-4cb5c8b2-082f-4da3-97af-4e34d9e5279f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:55.642470 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-87f5d805-48bf-4579-9aa7-d8f5364e6a2e req-4cb5c8b2-082f-4da3-97af-4e34d9e5279f service nova] Creating event network-vif-unplugged:f8dd10bb-4c5c-43cb-bdb0-faf2fdaa1829 for instance e166908f-75d7-4c0e-82e6-cb88690b8b6f on n-h2-860892-1 Oct 11 04:42:55.649354 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-87f5d805-48bf-4579-9aa7-d8f5364e6a2e req-4cb5c8b2-082f-4da3-97af-4e34d9e5279f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040949 Oct 11 04:42:55.650166 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2940/6124] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:42:56.075958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-45943bbb-43bf-421c-87df-72f9e826fd9c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:56.076624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45943bbb-43bf-421c-87df-72f9e826fd9c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:56.084136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45943bbb-43bf-421c-87df-72f9e826fd9c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:56.084627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45943bbb-43bf-421c-87df-72f9e826fd9c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:56.085343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45943bbb-43bf-421c-87df-72f9e826fd9c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:56.086040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45943bbb-43bf-421c-87df-72f9e826fd9c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:56.086531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45943bbb-43bf-421c-87df-72f9e826fd9c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:56.091125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45943bbb-43bf-421c-87df-72f9e826fd9c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:56.331637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45943bbb-43bf-421c-87df-72f9e826fd9c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:56.353765 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-45943bbb-43bf-421c-87df-72f9e826fd9c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1523 microversion: 2.1 time: 0.282314 Oct 11 04:42:56.356531 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3185/6125] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:56 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1523 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:57.379829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ec121fe-bd0a-431e-95b9-e185f58994d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:57.381340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ec121fe-bd0a-431e-95b9-e185f58994d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:57.388943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec121fe-bd0a-431e-95b9-e185f58994d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:57.389909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec121fe-bd0a-431e-95b9-e185f58994d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:57.390547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec121fe-bd0a-431e-95b9-e185f58994d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:57.391476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec121fe-bd0a-431e-95b9-e185f58994d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:57.392054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec121fe-bd0a-431e-95b9-e185f58994d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:57.392506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec121fe-bd0a-431e-95b9-e185f58994d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:57.620640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ec121fe-bd0a-431e-95b9-e185f58994d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:57.632631 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ec121fe-bd0a-431e-95b9-e185f58994d7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1523 microversion: 2.1 time: 0.257161 Oct 11 04:42:57.634231 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2941/6126] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:57 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1523 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:42:57.668585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-63154e9f-b617-4dd3-9be5-6b485d43077b req-262eee27-9b94-486b-9763-b074a0b830cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e166908f-75d7-4c0e-82e6-cb88690b8b6f", "name": "network-vif-plugged", "status": "completed", "tag": "f8dd10bb-4c5c-43cb-bdb0-faf2fdaa1829"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:42:57.694890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-63154e9f-b617-4dd3-9be5-6b485d43077b req-262eee27-9b94-486b-9763-b074a0b830cf service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:57.695649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-63154e9f-b617-4dd3-9be5-6b485d43077b req-262eee27-9b94-486b-9763-b074a0b830cf service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:57.696238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-63154e9f-b617-4dd3-9be5-6b485d43077b req-262eee27-9b94-486b-9763-b074a0b830cf service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:57.719572 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-63154e9f-b617-4dd3-9be5-6b485d43077b req-262eee27-9b94-486b-9763-b074a0b830cf service nova] Creating event network-vif-plugged:f8dd10bb-4c5c-43cb-bdb0-faf2fdaa1829 for instance e166908f-75d7-4c0e-82e6-cb88690b8b6f on n-h2-860892-1 Oct 11 04:42:57.725406 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-63154e9f-b617-4dd3-9be5-6b485d43077b req-262eee27-9b94-486b-9763-b074a0b830cf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060502 Oct 11 04:42:57.726817 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3186/6127] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:42:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:42:58.657200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b163a0e0-83f7-478c-9e4a-bef923228cae tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:42:58.658950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b163a0e0-83f7-478c-9e4a-bef923228cae tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:42:58.671415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b163a0e0-83f7-478c-9e4a-bef923228cae tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:58.679048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b163a0e0-83f7-478c-9e4a-bef923228cae tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:58.679800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b163a0e0-83f7-478c-9e4a-bef923228cae tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:58.686461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b163a0e0-83f7-478c-9e4a-bef923228cae tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:42:58.689250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b163a0e0-83f7-478c-9e4a-bef923228cae tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:42:58.690510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b163a0e0-83f7-478c-9e4a-bef923228cae tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:42:59.092432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b163a0e0-83f7-478c-9e4a-bef923228cae tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:42:59.102061 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b163a0e0-83f7-478c-9e4a-bef923228cae tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1523 microversion: 2.1 time: 0.448774 Oct 11 04:42:59.102684 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2942/6128] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:42:58 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1523 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:00.133659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5f0446b-5b7c-4339-9b35-2392e75d8ec0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:00.135048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c5f0446b-5b7c-4339-9b35-2392e75d8ec0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:00.145965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5f0446b-5b7c-4339-9b35-2392e75d8ec0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:00.146735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5f0446b-5b7c-4339-9b35-2392e75d8ec0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:00.147592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5f0446b-5b7c-4339-9b35-2392e75d8ec0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:00.149017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5f0446b-5b7c-4339-9b35-2392e75d8ec0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:00.149641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5f0446b-5b7c-4339-9b35-2392e75d8ec0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:00.150289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5f0446b-5b7c-4339-9b35-2392e75d8ec0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:00.156010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:00.448501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5f0446b-5b7c-4339-9b35-2392e75d8ec0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:00.457086 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c5f0446b-5b7c-4339-9b35-2392e75d8ec0 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1508 microversion: 2.1 time: 0.327469 Oct 11 04:43:00.473439 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3187/6129] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:00 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1508 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:00.484535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cdac92a0-7b7c-4d4b-96ab-d3dfaaf3ba84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:00.485159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cdac92a0-7b7c-4d4b-96ab-d3dfaaf3ba84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:00.495407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdac92a0-7b7c-4d4b-96ab-d3dfaaf3ba84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:00.499010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdac92a0-7b7c-4d4b-96ab-d3dfaaf3ba84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:00.499718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdac92a0-7b7c-4d4b-96ab-d3dfaaf3ba84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:00.501039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdac92a0-7b7c-4d4b-96ab-d3dfaaf3ba84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:00.501716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdac92a0-7b7c-4d4b-96ab-d3dfaaf3ba84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:00.502789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cdac92a0-7b7c-4d4b-96ab-d3dfaaf3ba84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:00.725956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cdac92a0-7b7c-4d4b-96ab-d3dfaaf3ba84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:00.738244 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cdac92a0-7b7c-4d4b-96ab-d3dfaaf3ba84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 200 len: 1508 microversion: 2.1 time: 0.258736 Oct 11 04:43:00.740344 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2943/6130] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:00 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 1508 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:00.763886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-234eacfa-558f-4ddc-aefa-47f936713f84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:00.764511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-234eacfa-558f-4ddc-aefa-47f936713f84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:00.778310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-234eacfa-558f-4ddc-aefa-47f936713f84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:00.779203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-234eacfa-558f-4ddc-aefa-47f936713f84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:00.780186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-234eacfa-558f-4ddc-aefa-47f936713f84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:00.781651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-234eacfa-558f-4ddc-aefa-47f936713f84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:00.784370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-234eacfa-558f-4ddc-aefa-47f936713f84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:00.798970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-234eacfa-558f-4ddc-aefa-47f936713f84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:00.849400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-234eacfa-558f-4ddc-aefa-47f936713f84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:43:01.295837 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-234eacfa-558f-4ddc-aefa-47f936713f84 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 204 len: 0 microversion: 2.1 time: 0.537999 Oct 11 04:43:01.298809 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3188/6131] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:43:00 2022] DELETE /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 0 bytes in 540 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:43:01.516128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1022888684", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "98d31b3b-395e-40e3-8163-31568d61b082"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:01.592645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] validate_networks() for [('98d31b3b-395e-40e3-8163-31568d61b082', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:43:02.107413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:43:02.112189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:43:02.113538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:43:02.114354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:43:02.121182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:43:02.146086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:02.147976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:02.148736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:02.152457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:02.152457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:02.152457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:02.209919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Getting quotas for project d487c5739cef471f88ff5a38cf4ef887. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:43:02.220734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Getting quotas for user cab5e2dbaf37437a8fc4d24ff21c85b0 and project d487c5739cef471f88ff5a38cf4ef887. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:43:02.250637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:43:02.253992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:43:02.465558 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8cb5ba82-ac68-4104-ac45-2a3e2244a0d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.953290 Oct 11 04:43:02.466864 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2944/6132] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:43:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:43:02.478685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-63cb12d7-d9ac-4f26-aca2-c0bbacd46cd2 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:02.479936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-63cb12d7-d9ac-4f26-aca2-c0bbacd46cd2 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:02.567317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-63cb12d7-d9ac-4f26-aca2-c0bbacd46cd2 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:02.588723 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-63cb12d7-d9ac-4f26-aca2-c0bbacd46cd2 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1218 microversion: 2.1 time: 0.114491 Oct 11 04:43:02.605716 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3189/6133] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:02 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:03.614541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-318b7ad2-9b6c-4964-95d6-93ff4d9d40d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:03.628412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-318b7ad2-9b6c-4964-95d6-93ff4d9d40d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:03.676034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-318b7ad2-9b6c-4964-95d6-93ff4d9d40d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:03.694113 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-318b7ad2-9b6c-4964-95d6-93ff4d9d40d1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1218 microversion: 2.1 time: 0.080659 Oct 11 04:43:03.706819 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2945/6134] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:03 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1218 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:03.894773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-0dcdc8b7-8583-4f4f-9541-e4d32a0b4b9d req-18393ab6-7f4f-4ed0-bed2-f338caef0ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e166908f-75d7-4c0e-82e6-cb88690b8b6f", "name": "network-vif-deleted", "tag": "f8dd10bb-4c5c-43cb-bdb0-faf2fdaa1829"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:03.915059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0dcdc8b7-8583-4f4f-9541-e4d32a0b4b9d req-18393ab6-7f4f-4ed0-bed2-f338caef0ae5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:03.917102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0dcdc8b7-8583-4f4f-9541-e4d32a0b4b9d req-18393ab6-7f4f-4ed0-bed2-f338caef0ae5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:03.917844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0dcdc8b7-8583-4f4f-9541-e4d32a0b4b9d req-18393ab6-7f4f-4ed0-bed2-f338caef0ae5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:03.938624 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-0dcdc8b7-8583-4f4f-9541-e4d32a0b4b9d req-18393ab6-7f4f-4ed0-bed2-f338caef0ae5 service nova] Creating event network-vif-deleted:f8dd10bb-4c5c-43cb-bdb0-faf2fdaa1829 for instance e166908f-75d7-4c0e-82e6-cb88690b8b6f on n-h2-860892-1 Oct 11 04:43:03.945919 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-0dcdc8b7-8583-4f4f-9541-e4d32a0b4b9d req-18393ab6-7f4f-4ed0-bed2-f338caef0ae5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055561 Oct 11 04:43:03.947322 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3190/6135] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:43:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:04.713946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-747e9d35-9730-4c11-b612-142a2d07f760 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:04.714950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-747e9d35-9730-4c11-b612-142a2d07f760 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:04.722045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-747e9d35-9730-4c11-b612-142a2d07f760 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:04.722615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-747e9d35-9730-4c11-b612-142a2d07f760 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:04.723116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-747e9d35-9730-4c11-b612-142a2d07f760 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:04.724014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-747e9d35-9730-4c11-b612-142a2d07f760 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:04.724477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-747e9d35-9730-4c11-b612-142a2d07f760 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:04.724921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-747e9d35-9730-4c11-b612-142a2d07f760 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:04.788512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-747e9d35-9730-4c11-b612-142a2d07f760 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:04.796764 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-747e9d35-9730-4c11-b612-142a2d07f760 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1214 microversion: 2.1 time: 0.087764 Oct 11 04:43:04.797345 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2946/6136] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:04 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1214 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:05.821989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c15439a7-bbff-430e-adc1-4967ce2e7bee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:05.823372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c15439a7-bbff-430e-adc1-4967ce2e7bee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:05.831848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c15439a7-bbff-430e-adc1-4967ce2e7bee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:05.832896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c15439a7-bbff-430e-adc1-4967ce2e7bee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:05.833556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c15439a7-bbff-430e-adc1-4967ce2e7bee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:05.834512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c15439a7-bbff-430e-adc1-4967ce2e7bee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:05.835513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c15439a7-bbff-430e-adc1-4967ce2e7bee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:05.840477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c15439a7-bbff-430e-adc1-4967ce2e7bee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:05.962689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c15439a7-bbff-430e-adc1-4967ce2e7bee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:05.991592 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c15439a7-bbff-430e-adc1-4967ce2e7bee tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1278 microversion: 2.1 time: 0.158712 Oct 11 04:43:05.993368 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3191/6137] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:05 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1278 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:07.017452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-be5838b8-0178-4f57-b763-22ac6a45c738 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:07.019533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-be5838b8-0178-4f57-b763-22ac6a45c738 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:07.027379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be5838b8-0178-4f57-b763-22ac6a45c738 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:07.028197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be5838b8-0178-4f57-b763-22ac6a45c738 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:07.029044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be5838b8-0178-4f57-b763-22ac6a45c738 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:07.030088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be5838b8-0178-4f57-b763-22ac6a45c738 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:07.030704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be5838b8-0178-4f57-b763-22ac6a45c738 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:07.031490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-be5838b8-0178-4f57-b763-22ac6a45c738 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:07.133194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-be5838b8-0178-4f57-b763-22ac6a45c738 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:07.145065 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-be5838b8-0178-4f57-b763-22ac6a45c738 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1276 microversion: 2.1 time: 0.131768 Oct 11 04:43:07.146017 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2947/6138] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:07 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1276 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:08.170746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-993bc935-4c95-4127-92bd-0dac2fe8a8e7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:08.172017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-993bc935-4c95-4127-92bd-0dac2fe8a8e7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:08.180288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc935-4c95-4127-92bd-0dac2fe8a8e7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:08.181065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc935-4c95-4127-92bd-0dac2fe8a8e7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:08.181724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc935-4c95-4127-92bd-0dac2fe8a8e7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:08.182746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc935-4c95-4127-92bd-0dac2fe8a8e7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:08.183526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc935-4c95-4127-92bd-0dac2fe8a8e7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:08.184173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-993bc935-4c95-4127-92bd-0dac2fe8a8e7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:08.540678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-993bc935-4c95-4127-92bd-0dac2fe8a8e7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:08.552944 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-993bc935-4c95-4127-92bd-0dac2fe8a8e7 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1318 microversion: 2.1 time: 0.387733 Oct 11 04:43:08.553592 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3192/6139] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:08 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1318 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:09.561025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c49213f9-c1cf-4bdf-8091-6986d027ef54 req-1b591d58-ea95-4119-9c0e-d791f7c215e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "de54625a-46a9-4f22-abd5-8445dc30e9e7", "tag": "650c32a6-c3dc-4faa-9102-32b377c7422a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:09.575889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-66526c17-bd6a-43b5-9c54-a12c78964caa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:09.577154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-66526c17-bd6a-43b5-9c54-a12c78964caa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:09.588959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:09.593444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66526c17-bd6a-43b5-9c54-a12c78964caa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:09.593444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66526c17-bd6a-43b5-9c54-a12c78964caa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:09.593444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66526c17-bd6a-43b5-9c54-a12c78964caa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:09.593444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66526c17-bd6a-43b5-9c54-a12c78964caa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:09.596287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c49213f9-c1cf-4bdf-8091-6986d027ef54 req-1b591d58-ea95-4119-9c0e-d791f7c215e1 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:09.597014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c49213f9-c1cf-4bdf-8091-6986d027ef54 req-1b591d58-ea95-4119-9c0e-d791f7c215e1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:09.597726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66526c17-bd6a-43b5-9c54-a12c78964caa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:09.598980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66526c17-bd6a-43b5-9c54-a12c78964caa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:09.599327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c49213f9-c1cf-4bdf-8091-6986d027ef54 req-1b591d58-ea95-4119-9c0e-d791f7c215e1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:09.628998 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c49213f9-c1cf-4bdf-8091-6986d027ef54 req-1b591d58-ea95-4119-9c0e-d791f7c215e1 service nova] Creating event network-changed:650c32a6-c3dc-4faa-9102-32b377c7422a for instance de54625a-46a9-4f22-abd5-8445dc30e9e7 on n-h1-860892-1 Oct 11 04:43:09.641926 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c49213f9-c1cf-4bdf-8091-6986d027ef54 req-1b591d58-ea95-4119-9c0e-d791f7c215e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.352853 Oct 11 04:43:09.644219 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2948/6140] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:43:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:43:10.003033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-66526c17-bd6a-43b5-9c54-a12c78964caa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:10.020198 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-66526c17-bd6a-43b5-9c54-a12c78964caa tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1318 microversion: 2.1 time: 0.444584 Oct 11 04:43:10.024059 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3193/6141] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:09 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1318 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:11.050292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-004f8d30-5d73-478f-a172-3c12bfe2cbc8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:11.051017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-004f8d30-5d73-478f-a172-3c12bfe2cbc8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:11.065060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004f8d30-5d73-478f-a172-3c12bfe2cbc8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:11.065896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004f8d30-5d73-478f-a172-3c12bfe2cbc8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:11.066592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004f8d30-5d73-478f-a172-3c12bfe2cbc8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:11.067914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004f8d30-5d73-478f-a172-3c12bfe2cbc8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:11.068973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004f8d30-5d73-478f-a172-3c12bfe2cbc8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:11.069646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-004f8d30-5d73-478f-a172-3c12bfe2cbc8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:11.483400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-004f8d30-5d73-478f-a172-3c12bfe2cbc8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:11.494019 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-004f8d30-5d73-478f-a172-3c12bfe2cbc8 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1318 microversion: 2.1 time: 0.447887 Oct 11 04:43:11.506239 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2949/6142] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:11 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1318 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:12.368428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db1db75e-9fbd-4298-a369-2584b76beb83 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Action: 'create', calling method: >, body: {"aggregate": {"name": "tempest-aggregate-scenario-236401648", "availability_zone": "foo_zone"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:12.372584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.aggregate [None req-db1db75e-9fbd-4298-a369-2584b76beb83 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Generated uuid caef6309-6cb8-43b3-ae8a-2b68220aa318 for aggregate {{(pid=120994) create /opt/stack/nova/nova/objects/aggregate.py:298}} Oct 11 04:43:12.505170 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-db1db75e-9fbd-4298-a369-2584b76beb83 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates" status: 200 len: 208 microversion: 2.1 time: 0.201089 Oct 11 04:43:12.506109 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3194/6143] 10.222.0.26 () {60 vars in 1164 bytes} [Tue Oct 11 04:43:12 2022] POST /compute/v2.1/os-aggregates => generated 208 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:12.535027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4fc42fdb-be20-4610-888b-4362e81f9f33 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:12.535865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4fc42fdb-be20-4610-888b-4362e81f9f33 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:12.542890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-718859f2-9c40-4d8e-8c03-efff76b40021 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"meta_key": "meta_value"}}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:12.546959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:12.575482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fc42fdb-be20-4610-888b-4362e81f9f33 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:12.575482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fc42fdb-be20-4610-888b-4362e81f9f33 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:12.575482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fc42fdb-be20-4610-888b-4362e81f9f33 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:12.575482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fc42fdb-be20-4610-888b-4362e81f9f33 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:12.575482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fc42fdb-be20-4610-888b-4362e81f9f33 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:12.575482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fc42fdb-be20-4610-888b-4362e81f9f33 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:12.615297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:12.705664 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-718859f2-9c40-4d8e-8c03-efff76b40021 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 318 microversion: 2.1 time: 0.180313 Oct 11 04:43:12.707338 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2950/6144] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:43:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:12.720105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-148cb43b-58e2-432e-8b4b-180cc95bd5a8 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:12.727118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-58e2-432e-8b4b-180cc95bd5a8 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:12.727890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-58e2-432e-8b4b-180cc95bd5a8 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:12.728487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-58e2-432e-8b4b-180cc95bd5a8 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:12.729435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-58e2-432e-8b4b-180cc95bd5a8 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:12.731097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-58e2-432e-8b4b-180cc95bd5a8 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:12.732803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-148cb43b-58e2-432e-8b4b-180cc95bd5a8 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:12.769655 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-148cb43b-58e2-432e-8b4b-180cc95bd5a8 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] 10.222.0.26 "GET /compute/v2.1/os-services?binary=nova-compute" status: 200 len: 380 microversion: 2.1 time: 0.054107 Oct 11 04:43:12.771723 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2951/6145] 10.222.0.26 () {58 vars in 1176 bytes} [Tue Oct 11 04:43:12 2022] GET /compute/v2.1/os-services?binary=nova-compute => generated 380 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:43:12.784431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2c9662f5-d287-4a5c-9923-debf77c154d0 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:12.812015 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2c9662f5-d287-4a5c-9923-debf77c154d0 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates" status: 200 len: 297 microversion: 2.1 time: 0.032498 Oct 11 04:43:12.813269 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2952/6146] 10.222.0.26 () {58 vars in 1143 bytes} [Tue Oct 11 04:43:12 2022] GET /compute/v2.1/os-aggregates => generated 297 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:12.825881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f17f7abb-e635-41f7-bb37-16b3bfa85683 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Action: 'action', calling method: >, body: {"add_host": {"host": "n-h2-860892-1"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:12.838703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f17f7abb-e635-41f7-bb37-16b3bfa85683 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:12.839834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f17f7abb-e635-41f7-bb37-16b3bfa85683 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:12.840692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f17f7abb-e635-41f7-bb37-16b3bfa85683 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:12.918023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4fc42fdb-be20-4610-888b-4362e81f9f33 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:12.928593 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4fc42fdb-be20-4610-888b-4362e81f9f33 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1318 microversion: 2.1 time: 0.403563 Oct 11 04:43:12.929803 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3195/6147] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:12 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1318 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:13.384538 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f17f7abb-e635-41f7-bb37-16b3bfa85683 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 309 microversion: 2.1 time: 0.562740 Oct 11 04:43:13.393468 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2953/6148] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:43:12 2022] POST /compute/v2.1/os-aggregates/19/action => generated 309 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:43:13.398159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13e638dc-a466-4f78-b0f9-53c875f13bbe tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:13.415331 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-13e638dc-a466-4f78-b0f9-53c875f13bbe tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 309 microversion: 2.1 time: 0.021030 Oct 11 04:43:13.416211 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3196/6149] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:43:13 2022] GET /compute/v2.1/os-aggregates/19 => generated 309 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:43:13.428126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-79ec3185-8164-4d61-a50f-5ce90c1b98ab tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Action: 'update', calling method: >, body: {"aggregate": {"name": "tempest-renamed-aggregate-scenario-750181569", "availability_zone": "foo_zone"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:13.540146 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-79ec3185-8164-4d61-a50f-5ce90c1b98ab tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] 10.222.0.26 "PUT /compute/v2.1/os-aggregates/19" status: 200 len: 341 microversion: 2.1 time: 0.115763 Oct 11 04:43:13.540727 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2954/6150] 10.222.0.26 () {60 vars in 1173 bytes} [Tue Oct 11 04:43:13 2022] PUT /compute/v2.1/os-aggregates/19 => generated 341 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:13.553312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-555dcb76-2f70-49a3-b2b9-c661f36cc641 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Action: 'action', calling method: >, body: {"set_metadata": {"metadata": {"foo": "bar"}}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:13.655682 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-555dcb76-2f70-49a3-b2b9-c661f36cc641 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 355 microversion: 2.1 time: 0.107137 Oct 11 04:43:13.656542 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3197/6151] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:43:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 355 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:43:13.670029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35e7b2ce-44f6-4a1a-b4c0-d866a1583d86 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:13.692633 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35e7b2ce-44f6-4a1a-b4c0-d866a1583d86 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] 10.222.0.26 "GET /compute/v2.1/os-aggregates/19" status: 200 len: 355 microversion: 2.1 time: 0.027100 Oct 11 04:43:13.699503 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2955/6152] 10.222.0.26 () {58 vars in 1152 bytes} [Tue Oct 11 04:43:13 2022] GET /compute/v2.1/os-aggregates/19 => generated 355 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:13.713019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-adebb50a-b18f-4160-adff-09b24747a2d4 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Action: 'action', calling method: >, body: {"remove_host": {"host": "n-h2-860892-1"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:13.724998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-adebb50a-b18f-4160-adff-09b24747a2d4 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:13.725496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-adebb50a-b18f-4160-adff-09b24747a2d4 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:13.729999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-adebb50a-b18f-4160-adff-09b24747a2d4 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:13.952799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-47a1d371-d700-4fad-9295-3fcddde7f84f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:13.953606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-47a1d371-d700-4fad-9295-3fcddde7f84f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:13.956781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:13.960495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47a1d371-d700-4fad-9295-3fcddde7f84f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:13.960986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47a1d371-d700-4fad-9295-3fcddde7f84f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:13.961521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47a1d371-d700-4fad-9295-3fcddde7f84f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:13.962345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47a1d371-d700-4fad-9295-3fcddde7f84f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:13.962805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47a1d371-d700-4fad-9295-3fcddde7f84f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:13.963236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47a1d371-d700-4fad-9295-3fcddde7f84f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:14.133013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-47a1d371-d700-4fad-9295-3fcddde7f84f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:14.141725 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-47a1d371-d700-4fad-9295-3fcddde7f84f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1318 microversion: 2.1 time: 0.192757 Oct 11 04:43:14.155671 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2956/6153] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:13 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1318 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:43:14.178531 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-adebb50a-b18f-4160-adff-09b24747a2d4 tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] 10.222.0.26 "POST /compute/v2.1/os-aggregates/19/action" status: 200 len: 340 microversion: 2.1 time: 0.469505 Oct 11 04:43:14.179733 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3198/6154] 10.222.0.26 () {60 vars in 1194 bytes} [Tue Oct 11 04:43:13 2022] POST /compute/v2.1/os-aggregates/19/action => generated 340 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:14.192017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-33dbc764-72f3-4ca8-91f9-97082c8936ee tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:14.310815 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-33dbc764-72f3-4ca8-91f9-97082c8936ee tempest-TestAggregatesBasicOps-1012355937 tempest-TestAggregatesBasicOps-1012355937-project-admin] 10.222.0.26 "DELETE /compute/v2.1/os-aggregates/19" status: 200 len: 0 microversion: 2.1 time: 0.123256 Oct 11 04:43:14.311890 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2957/6155] 10.222.0.26 () {58 vars in 1155 bytes} [Tue Oct 11 04:43:14 2022] DELETE /compute/v2.1/os-aggregates/19 => generated 0 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 355 bytes (1 switches on core 0) Oct 11 04:43:15.169529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7a3a3e3a-a7e5-4d54-93e3-2a9ec67434c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:15.170054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7a3a3e3a-a7e5-4d54-93e3-2a9ec67434c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:15.179717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a3a3e3a-a7e5-4d54-93e3-2a9ec67434c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:15.188358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a3a3e3a-a7e5-4d54-93e3-2a9ec67434c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:15.188358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a3a3e3a-a7e5-4d54-93e3-2a9ec67434c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:15.188358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a3a3e3a-a7e5-4d54-93e3-2a9ec67434c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:15.188358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a3a3e3a-a7e5-4d54-93e3-2a9ec67434c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:15.188358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a3a3e3a-a7e5-4d54-93e3-2a9ec67434c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:15.442871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7a3a3e3a-a7e5-4d54-93e3-2a9ec67434c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:15.451624 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7a3a3e3a-a7e5-4d54-93e3-2a9ec67434c5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1318 microversion: 2.1 time: 0.287879 Oct 11 04:43:15.462179 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3199/6156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:15 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1318 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:16.487566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9735f007-63c6-4de5-a540-810315cf79d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:16.494847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9735f007-63c6-4de5-a540-810315cf79d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:16.535533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9735f007-63c6-4de5-a540-810315cf79d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:16.536035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9735f007-63c6-4de5-a540-810315cf79d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:16.536484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9735f007-63c6-4de5-a540-810315cf79d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:16.537203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9735f007-63c6-4de5-a540-810315cf79d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:16.537666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9735f007-63c6-4de5-a540-810315cf79d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:16.538099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9735f007-63c6-4de5-a540-810315cf79d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:16.875526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9735f007-63c6-4de5-a540-810315cf79d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:16.902730 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9735f007-63c6-4de5-a540-810315cf79d6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1318 microversion: 2.1 time: 0.422133 Oct 11 04:43:16.909173 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2958/6157] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:16 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1318 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:17.199711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f32c99aa-6fe0-4563-8466-0e86c231c726 req-25539d3f-bca2-47f9-9e98-b2c6403a3968 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de54625a-46a9-4f22-abd5-8445dc30e9e7", "name": "network-vif-plugged", "status": "completed", "tag": "650c32a6-c3dc-4faa-9102-32b377c7422a"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:17.218079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f32c99aa-6fe0-4563-8466-0e86c231c726 req-25539d3f-bca2-47f9-9e98-b2c6403a3968 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:17.218665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f32c99aa-6fe0-4563-8466-0e86c231c726 req-25539d3f-bca2-47f9-9e98-b2c6403a3968 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:17.219305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f32c99aa-6fe0-4563-8466-0e86c231c726 req-25539d3f-bca2-47f9-9e98-b2c6403a3968 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:17.233743 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-f32c99aa-6fe0-4563-8466-0e86c231c726 req-25539d3f-bca2-47f9-9e98-b2c6403a3968 service nova] Creating event network-vif-plugged:650c32a6-c3dc-4faa-9102-32b377c7422a for instance de54625a-46a9-4f22-abd5-8445dc30e9e7 on n-h1-860892-1 Oct 11 04:43:17.239951 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f32c99aa-6fe0-4563-8466-0e86c231c726 req-25539d3f-bca2-47f9-9e98-b2c6403a3968 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044240 Oct 11 04:43:17.246920 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3200/6158] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:43:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:17.930733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ad6e3a55-fa63-4c10-9ea9-cdf7251fbd09 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:17.931349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ad6e3a55-fa63-4c10-9ea9-cdf7251fbd09 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:17.946633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad6e3a55-fa63-4c10-9ea9-cdf7251fbd09 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:17.947390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad6e3a55-fa63-4c10-9ea9-cdf7251fbd09 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:17.947996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad6e3a55-fa63-4c10-9ea9-cdf7251fbd09 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:17.948886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad6e3a55-fa63-4c10-9ea9-cdf7251fbd09 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:17.949501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad6e3a55-fa63-4c10-9ea9-cdf7251fbd09 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:17.950091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ad6e3a55-fa63-4c10-9ea9-cdf7251fbd09 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:18.193133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ad6e3a55-fa63-4c10-9ea9-cdf7251fbd09 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:18.212215 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ad6e3a55-fa63-4c10-9ea9-cdf7251fbd09 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1318 microversion: 2.1 time: 0.285107 Oct 11 04:43:18.213256 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2959/6159] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:17 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1318 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:19.235864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2086b55a-6128-41c8-bd75-03dd799e6f45 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:19.236590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2086b55a-6128-41c8-bd75-03dd799e6f45 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:19.244710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2086b55a-6128-41c8-bd75-03dd799e6f45 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:19.245292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2086b55a-6128-41c8-bd75-03dd799e6f45 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:19.245846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2086b55a-6128-41c8-bd75-03dd799e6f45 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:19.247067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2086b55a-6128-41c8-bd75-03dd799e6f45 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:19.247607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2086b55a-6128-41c8-bd75-03dd799e6f45 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:19.248400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2086b55a-6128-41c8-bd75-03dd799e6f45 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:19.421133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2086b55a-6128-41c8-bd75-03dd799e6f45 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:19.430523 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2086b55a-6128-41c8-bd75-03dd799e6f45 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1508 microversion: 2.1 time: 0.198803 Oct 11 04:43:19.431736 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3201/6160] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:19 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:43:19.452960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5312c2b-d178-4ba1-96a6-63c1dd226e36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:19.454177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c5312c2b-d178-4ba1-96a6-63c1dd226e36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:19.461732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5312c2b-d178-4ba1-96a6-63c1dd226e36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:19.462443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5312c2b-d178-4ba1-96a6-63c1dd226e36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:19.463034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5312c2b-d178-4ba1-96a6-63c1dd226e36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:19.463929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5312c2b-d178-4ba1-96a6-63c1dd226e36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:19.464541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5312c2b-d178-4ba1-96a6-63c1dd226e36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:19.465122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5312c2b-d178-4ba1-96a6-63c1dd226e36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:19.709414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c5312c2b-d178-4ba1-96a6-63c1dd226e36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:19.719948 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c5312c2b-d178-4ba1-96a6-63c1dd226e36 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1508 microversion: 2.1 time: 0.270693 Oct 11 04:43:19.721088 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2960/6161] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:19 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:19.743599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-693bf414-c40e-400c-b856-23295aff6881 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:19.746063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-693bf414-c40e-400c-b856-23295aff6881 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:19.752935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-693bf414-c40e-400c-b856-23295aff6881 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:19.753441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-693bf414-c40e-400c-b856-23295aff6881 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:19.753876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-693bf414-c40e-400c-b856-23295aff6881 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:19.754634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-693bf414-c40e-400c-b856-23295aff6881 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:19.755086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-693bf414-c40e-400c-b856-23295aff6881 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:19.755507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-693bf414-c40e-400c-b856-23295aff6881 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:19.928549 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-693bf414-c40e-400c-b856-23295aff6881 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "PUT /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1080 microversion: 2.1 time: 0.188769 Oct 11 04:43:19.929233 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3202/6162] 10.222.0.26 () {60 vars in 1256 bytes} [Tue Oct 11 04:43:19 2022] PUT /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1080 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:19.958848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3b79c60f-de9e-4eb2-967e-3ac7bcbeccfb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:19.959604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3b79c60f-de9e-4eb2-967e-3ac7bcbeccfb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:19.967263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b79c60f-de9e-4eb2-967e-3ac7bcbeccfb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:19.968189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b79c60f-de9e-4eb2-967e-3ac7bcbeccfb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:19.968655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b79c60f-de9e-4eb2-967e-3ac7bcbeccfb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:19.970039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b79c60f-de9e-4eb2-967e-3ac7bcbeccfb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:19.971157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b79c60f-de9e-4eb2-967e-3ac7bcbeccfb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:19.972065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b79c60f-de9e-4eb2-967e-3ac7bcbeccfb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:20.185646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3b79c60f-de9e-4eb2-967e-3ac7bcbeccfb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:20.194960 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3b79c60f-de9e-4eb2-967e-3ac7bcbeccfb tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1506 microversion: 2.1 time: 0.240858 Oct 11 04:43:20.195551 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2961/6163] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:19 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1506 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:20.218292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5a2f0f6-9ce3-4a2b-8322-9ad72b9fe22c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:20.218947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c5a2f0f6-9ce3-4a2b-8322-9ad72b9fe22c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:20.230040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5a2f0f6-9ce3-4a2b-8322-9ad72b9fe22c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:20.230821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5a2f0f6-9ce3-4a2b-8322-9ad72b9fe22c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:20.231445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5a2f0f6-9ce3-4a2b-8322-9ad72b9fe22c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:20.232335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5a2f0f6-9ce3-4a2b-8322-9ad72b9fe22c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:20.233003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5a2f0f6-9ce3-4a2b-8322-9ad72b9fe22c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:20.233666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5a2f0f6-9ce3-4a2b-8322-9ad72b9fe22c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:20.490217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5a2f0f6-9ce3-4a2b-8322-9ad72b9fe22c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:20.498882 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c5a2f0f6-9ce3-4a2b-8322-9ad72b9fe22c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1506 microversion: 2.1 time: 0.284514 Oct 11 04:43:20.499548 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3203/6164] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:20 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1506 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:43:20.521553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef65482e-f714-43da-a2aa-03fede0a235c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "MANUAL"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:20.525364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef65482e-f714-43da-a2aa-03fede0a235c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:20.532298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef65482e-f714-43da-a2aa-03fede0a235c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:20.533065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef65482e-f714-43da-a2aa-03fede0a235c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:20.533495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef65482e-f714-43da-a2aa-03fede0a235c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:20.534406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef65482e-f714-43da-a2aa-03fede0a235c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:20.534853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef65482e-f714-43da-a2aa-03fede0a235c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:20.535444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef65482e-f714-43da-a2aa-03fede0a235c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:20.551647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:20.706266 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef65482e-f714-43da-a2aa-03fede0a235c tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "PUT /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1082 microversion: 2.1 time: 0.187684 Oct 11 04:43:20.708113 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2962/6165] 10.222.0.26 () {60 vars in 1256 bytes} [Tue Oct 11 04:43:20 2022] PUT /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1082 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:20.727197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fb570092-b3c4-4463-a517-768d666d6b1f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:20.728100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fb570092-b3c4-4463-a517-768d666d6b1f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:20.735685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb570092-b3c4-4463-a517-768d666d6b1f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:20.737000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb570092-b3c4-4463-a517-768d666d6b1f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:20.737775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb570092-b3c4-4463-a517-768d666d6b1f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:20.739135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb570092-b3c4-4463-a517-768d666d6b1f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:20.739805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb570092-b3c4-4463-a517-768d666d6b1f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:20.740439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb570092-b3c4-4463-a517-768d666d6b1f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:20.791045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-069ffb20-0d68-4f2f-aac4-ddb5e14f020b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:20.791904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-069ffb20-0d68-4f2f-aac4-ddb5e14f020b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:20.799273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069ffb20-0d68-4f2f-aac4-ddb5e14f020b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:20.800354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069ffb20-0d68-4f2f-aac4-ddb5e14f020b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:20.801610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069ffb20-0d68-4f2f-aac4-ddb5e14f020b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:20.802629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069ffb20-0d68-4f2f-aac4-ddb5e14f020b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:20.803374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069ffb20-0d68-4f2f-aac4-ddb5e14f020b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:20.805563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069ffb20-0d68-4f2f-aac4-ddb5e14f020b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:20.833751 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-069ffb20-0d68-4f2f-aac4-ddb5e14f020b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/ips" status: 200 len: 151 microversion: 2.1 time: 0.047293 Oct 11 04:43:20.835259 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2963/6166] 10.222.0.26 () {58 vars in 1248 bytes} [Tue Oct 11 04:43:20 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:21.067623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fb570092-b3c4-4463-a517-768d666d6b1f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:21.076735 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fb570092-b3c4-4463-a517-768d666d6b1f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1508 microversion: 2.1 time: 0.353514 Oct 11 04:43:21.077734 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3204/6167] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:20 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1508 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:21.107733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b4ae18b7-e867-4a29-b1fd-b95fcf3936af tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:21.108457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b4ae18b7-e867-4a29-b1fd-b95fcf3936af tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:21.117242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4ae18b7-e867-4a29-b1fd-b95fcf3936af tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:21.117805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4ae18b7-e867-4a29-b1fd-b95fcf3936af tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:21.118261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4ae18b7-e867-4a29-b1fd-b95fcf3936af tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:21.119143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4ae18b7-e867-4a29-b1fd-b95fcf3936af tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:21.119711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4ae18b7-e867-4a29-b1fd-b95fcf3936af tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:21.120652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4ae18b7-e867-4a29-b1fd-b95fcf3936af tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:21.377366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b4ae18b7-e867-4a29-b1fd-b95fcf3936af tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:21.378152 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b4ae18b7-e867-4a29-b1fd-b95fcf3936af tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1508 microversion: 2.1 time: 0.280021 Oct 11 04:43:21.382889 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2964/6168] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:21 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1508 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:21.405123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ebda91dd-f064-4766-ac92-9f89a38fc0f5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:21.405727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ebda91dd-f064-4766-ac92-9f89a38fc0f5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:21.419553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebda91dd-f064-4766-ac92-9f89a38fc0f5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:21.419939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebda91dd-f064-4766-ac92-9f89a38fc0f5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:21.420464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebda91dd-f064-4766-ac92-9f89a38fc0f5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:21.421256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebda91dd-f064-4766-ac92-9f89a38fc0f5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:21.421818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebda91dd-f064-4766-ac92-9f89a38fc0f5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:21.422341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebda91dd-f064-4766-ac92-9f89a38fc0f5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:21.482162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ebda91dd-f064-4766-ac92-9f89a38fc0f5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:43:21.776518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:22.180328 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ebda91dd-f064-4766-ac92-9f89a38fc0f5 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "DELETE /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 204 len: 0 microversion: 2.1 time: 0.778826 Oct 11 04:43:22.183299 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3205/6169] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:43:21 2022] DELETE /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 0 bytes in 783 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:43:22.193062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-912c186b-627e-4447-80db-f704762c0a9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:22.194128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-912c186b-627e-4447-80db-f704762c0a9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:22.200774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-912c186b-627e-4447-80db-f704762c0a9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:22.201245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-912c186b-627e-4447-80db-f704762c0a9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:22.201885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-912c186b-627e-4447-80db-f704762c0a9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:22.202896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-912c186b-627e-4447-80db-f704762c0a9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:22.203557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-912c186b-627e-4447-80db-f704762c0a9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:22.204212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-912c186b-627e-4447-80db-f704762c0a9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:22.241329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-912c186b-627e-4447-80db-f704762c0a9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:43:22.300643 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.compute.api [None req-912c186b-627e-4447-80db-f704762c0a9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Instance is already in deleting state, ignoring this request Oct 11 04:43:22.301471 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-912c186b-627e-4447-80db-f704762c0a9d tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "DELETE /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 204 len: 0 microversion: 2.1 time: 0.112371 Oct 11 04:43:22.302060 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2965/6170] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:43:22 2022] DELETE /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:43:22.311718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b39a18b-54a4-44cf-905f-aa69277a9c4f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:22.312623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b39a18b-54a4-44cf-905f-aa69277a9c4f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:22.324550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39a18b-54a4-44cf-905f-aa69277a9c4f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:22.324550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39a18b-54a4-44cf-905f-aa69277a9c4f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:22.324550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39a18b-54a4-44cf-905f-aa69277a9c4f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:22.324550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39a18b-54a4-44cf-905f-aa69277a9c4f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:22.324550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39a18b-54a4-44cf-905f-aa69277a9c4f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:22.324550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b39a18b-54a4-44cf-905f-aa69277a9c4f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:22.599704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b39a18b-54a4-44cf-905f-aa69277a9c4f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:22.627460 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b39a18b-54a4-44cf-905f-aa69277a9c4f tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1514 microversion: 2.1 time: 0.306449 Oct 11 04:43:22.628126 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3206/6171] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:22 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1514 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:43:23.654993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-37f621cb-f3d3-4052-a70d-3dfd9e83aba9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:23.655621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-37f621cb-f3d3-4052-a70d-3dfd9e83aba9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:23.657742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:23.674397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37f621cb-f3d3-4052-a70d-3dfd9e83aba9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:23.675503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37f621cb-f3d3-4052-a70d-3dfd9e83aba9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:23.676151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37f621cb-f3d3-4052-a70d-3dfd9e83aba9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:23.677437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37f621cb-f3d3-4052-a70d-3dfd9e83aba9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:23.678223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37f621cb-f3d3-4052-a70d-3dfd9e83aba9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:23.679185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37f621cb-f3d3-4052-a70d-3dfd9e83aba9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:23.893998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-37f621cb-f3d3-4052-a70d-3dfd9e83aba9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:23.902103 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-37f621cb-f3d3-4052-a70d-3dfd9e83aba9 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1514 microversion: 2.1 time: 0.251000 Oct 11 04:43:23.902739 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2966/6172] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:23 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1514 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:24.067734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0a9d2dd8-8116-4416-bd6b-b8f8b60eaa67 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2e7d4842-2ec3-4336-a24a-9f074672ae93"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:24.071393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0a9d2dd8-8116-4416-bd6b-b8f8b60eaa67 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:24.081244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a9d2dd8-8116-4416-bd6b-b8f8b60eaa67 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:24.081970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a9d2dd8-8116-4416-bd6b-b8f8b60eaa67 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:24.082488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a9d2dd8-8116-4416-bd6b-b8f8b60eaa67 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:24.088433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a9d2dd8-8116-4416-bd6b-b8f8b60eaa67 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:24.093814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a9d2dd8-8116-4416-bd6b-b8f8b60eaa67 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:24.093814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a9d2dd8-8116-4416-bd6b-b8f8b60eaa67 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:24.236969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-20473d48-3d9b-4e54-bdf8-148194506ec3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:24.237944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-20473d48-3d9b-4e54-bdf8-148194506ec3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:24.254051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20473d48-3d9b-4e54-bdf8-148194506ec3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:24.254051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20473d48-3d9b-4e54-bdf8-148194506ec3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:24.254051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20473d48-3d9b-4e54-bdf8-148194506ec3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:24.254051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20473d48-3d9b-4e54-bdf8-148194506ec3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:24.255408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20473d48-3d9b-4e54-bdf8-148194506ec3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:24.260238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-20473d48-3d9b-4e54-bdf8-148194506ec3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:24.297659 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-20473d48-3d9b-4e54-bdf8-148194506ec3 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/ips" status: 200 len: 151 microversion: 2.20 time: 0.414180 Oct 11 04:43:24.307154 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3207/6173] 10.222.0.26 () {60 vars in 1289 bytes} [Tue Oct 11 04:43:23 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/ips => generated 151 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:43:24.886561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-871a5502-0db5-414b-b7f3-a2f9fa70c971 req-3161fb2c-bbc6-4794-8618-a5b245ab18fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "de54625a-46a9-4f22-abd5-8445dc30e9e7", "name": "network-vif-deleted", "tag": "650c32a6-c3dc-4faa-9102-32b377c7422a"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:24.902411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-871a5502-0db5-414b-b7f3-a2f9fa70c971 req-3161fb2c-bbc6-4794-8618-a5b245ab18fb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:24.903684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-871a5502-0db5-414b-b7f3-a2f9fa70c971 req-3161fb2c-bbc6-4794-8618-a5b245ab18fb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:24.904445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-871a5502-0db5-414b-b7f3-a2f9fa70c971 req-3161fb2c-bbc6-4794-8618-a5b245ab18fb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:24.944817 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-871a5502-0db5-414b-b7f3-a2f9fa70c971 req-3161fb2c-bbc6-4794-8618-a5b245ab18fb service nova] Creating event network-vif-deleted:650c32a6-c3dc-4faa-9102-32b377c7422a for instance de54625a-46a9-4f22-abd5-8445dc30e9e7 on n-h1-860892-1 Oct 11 04:43:24.952084 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-871a5502-0db5-414b-b7f3-a2f9fa70c971 req-3161fb2c-bbc6-4794-8618-a5b245ab18fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071578 Oct 11 04:43:24.953662 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3208/6174] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:24.963413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae17fd0c-4060-4657-beec-064133fa0de1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:24.964251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae17fd0c-4060-4657-beec-064133fa0de1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:24.971342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae17fd0c-4060-4657-beec-064133fa0de1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:24.972322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae17fd0c-4060-4657-beec-064133fa0de1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:24.972931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae17fd0c-4060-4657-beec-064133fa0de1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:24.973916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae17fd0c-4060-4657-beec-064133fa0de1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:24.974699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae17fd0c-4060-4657-beec-064133fa0de1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:24.975296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae17fd0c-4060-4657-beec-064133fa0de1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:25.107045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae17fd0c-4060-4657-beec-064133fa0de1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:25.112839 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae17fd0c-4060-4657-beec-064133fa0de1 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1472 microversion: 2.1 time: 0.156371 Oct 11 04:43:25.113721 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3209/6175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:24 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1472 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:25.890219 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0a9d2dd8-8116-4416-bd6b-b8f8b60eaa67 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "POST /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.828195 Oct 11 04:43:25.890868 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2967/6176] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:43:24 2022] POST /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments => generated 194 bytes in 1830 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:43:26.137175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:26.138094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:26.151585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:26.153101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:26.153621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:26.154069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:26.154856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:26.155369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:26.155806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:26.193894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:26.194499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:26.195018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:26.196272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lazy-loading 'fault' on Instance uuid de54625a-46a9-4f22-abd5-8445dc30e9e7 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:43:26.246511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cab5e2dbaf37437a8fc4d24ff21c85b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd487c5739cef471f88ff5a38cf4ef887', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:26.255178 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dabe471c-005d-4a15-b03c-6073f43d5420 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 200 len: 1308 microversion: 2.1 time: 0.122637 Oct 11 04:43:26.258110 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3210/6177] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:26 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 1308 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:27.281550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:27.282305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: de54625a-46a9-4f22-abd5-8445dc30e9e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:27.308760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:27.309858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:27.321809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:27.321809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:27.321809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:27.321809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:27.341845 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] HTTP exception thrown: Instance de54625a-46a9-4f22-abd5-8445dc30e9e7 could not be found. Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Request method failure captured: Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 HTTP/1.1 Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPPkw9Tm2jHfDHKit1LriC52DMjP_9V_IFi_Ln1mCV5u77tW29JbM7ZWmpj8rd3gKLgtbKiYXhBbQct6hI7kInNDjgtmDB2p371spAmpty3ZxZEjfII5ozsci3nA2YCajVNvtXAHYtpZWjACFB-1JeLk0pq2zc_DHh2jC5vtBqK1Sl0 Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d487c5739cef471f88ff5a38cf4ef887 Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d487c5739cef471f88ff5a38cf4ef887"}]}] Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d487c5739cef471f88ff5a38cf4ef887 Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerDiskConfigTestJSON-1891061898-project Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: cab5e2dbaf37437a8fc4d24ff21c85b0 Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerDiskConfigTestJSON-1891061898-project Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance de54625a-46a9-4f22-abd5-8445dc30e9e7 could not be found. Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'de54625a-46a9-4f22-abd5-8445dc30e9e7'} Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance de54625a-46a9-4f22-abd5-8445dc30e9e7 could not be found. Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance de54625a-46a9-4f22-abd5-8445dc30e9e7 could not be found. Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:27.343583 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.348838 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.348838 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:27.348838 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:27.348838 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:43:27.348838 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:43:27.348838 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance de54625a-46a9-4f22-abd5-8445dc30e9e7 could not be found. Oct 11 04:43:27.348838 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.349803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Returning 404 to user: Instance de54625a-46a9-4f22-abd5-8445dc30e9e7 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:43:27.351424 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-841c4f52-944d-44b2-98ce-6c80af434359 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7" status: 404 len: 111 microversion: 2.1 time: 0.076120 Oct 11 04:43:27.352097 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2968/6178] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:27 2022] GET /compute/v2.1/servers/de54625a-46a9-4f22-abd5-8445dc30e9e7 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:43:27.362784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:27.364126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:27.376831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:27.376831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:27.376831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:27.376831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:27.376831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:27.376831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:27.428936 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] HTTP exception thrown: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Request method failure captured: Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f HTTP/1.1 Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPPkw9Tm2jHfDHKit1LriC52DMjP_9V_IFi_Ln1mCV5u77tW29JbM7ZWmpj8rd3gKLgtbKiYXhBbQct6hI7kInNDjgtmDB2p371spAmpty3ZxZEjfII5ozsci3nA2YCajVNvtXAHYtpZWjACFB-1JeLk0pq2zc_DHh2jC5vtBqK1Sl0 Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d487c5739cef471f88ff5a38cf4ef887 Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d487c5739cef471f88ff5a38cf4ef887"}]}] Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d487c5739cef471f88ff5a38cf4ef887 Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerDiskConfigTestJSON-1891061898-project Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: cab5e2dbaf37437a8fc4d24ff21c85b0 Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerDiskConfigTestJSON-1891061898-project Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e166908f-75d7-4c0e-82e6-cb88690b8b6f'} Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:43:27.430809 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Returning 404 to user: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:43:27.435349 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3ee011b1-c6fd-418b-b611-4dc2bc7bdf51 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 404 len: 111 microversion: 2.1 time: 0.075689 Oct 11 04:43:27.442237 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3211/6179] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:43:27 2022] DELETE /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:43:27.448845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:27.458993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: e166908f-75d7-4c0e-82e6-cb88690b8b6f] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:27.458993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:27.458993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:27.459466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:27.460420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:27.460978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:27.461861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:27.481166 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] HTTP exception thrown: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Request method failure captured: Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f HTTP/1.1 Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPPkw9Tm2jHfDHKit1LriC52DMjP_9V_IFi_Ln1mCV5u77tW29JbM7ZWmpj8rd3gKLgtbKiYXhBbQct6hI7kInNDjgtmDB2p371spAmpty3ZxZEjfII5ozsci3nA2YCajVNvtXAHYtpZWjACFB-1JeLk0pq2zc_DHh2jC5vtBqK1Sl0 Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d487c5739cef471f88ff5a38cf4ef887 Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d487c5739cef471f88ff5a38cf4ef887"}]}] Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d487c5739cef471f88ff5a38cf4ef887 Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerDiskConfigTestJSON-1891061898-project Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: cab5e2dbaf37437a8fc4d24ff21c85b0 Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerDiskConfigTestJSON-1891061898-project Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e166908f-75d7-4c0e-82e6-cb88690b8b6f'} Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:27.483476 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.491920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.491920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:27.491920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:27.491920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:43:27.491920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:43:27.491920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. Oct 11 04:43:27.491920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.491920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Returning 404 to user: Instance e166908f-75d7-4c0e-82e6-cb88690b8b6f could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:43:27.491920 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-04055699-b235-4284-9954-9c70a2a807b6 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f" status: 404 len: 111 microversion: 2.1 time: 0.042007 Oct 11 04:43:27.491920 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2969/6180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:27 2022] GET /compute/v2.1/servers/e166908f-75d7-4c0e-82e6-cb88690b8b6f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:43:27.503311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:27.503311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:27.520236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:27.520857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:27.522738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:27.524011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:27.524621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:27.525249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:27.579203 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] HTTP exception thrown: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Request method failure captured: Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 HTTP/1.1 Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPPkw9Tm2jHfDHKit1LriC52DMjP_9V_IFi_Ln1mCV5u77tW29JbM7ZWmpj8rd3gKLgtbKiYXhBbQct6hI7kInNDjgtmDB2p371spAmpty3ZxZEjfII5ozsci3nA2YCajVNvtXAHYtpZWjACFB-1JeLk0pq2zc_DHh2jC5vtBqK1Sl0 Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d487c5739cef471f88ff5a38cf4ef887 Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d487c5739cef471f88ff5a38cf4ef887"}]}] Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d487c5739cef471f88ff5a38cf4ef887 Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerDiskConfigTestJSON-1891061898-project Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: cab5e2dbaf37437a8fc4d24ff21c85b0 Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerDiskConfigTestJSON-1891061898-project Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '7f8eff2c-d489-422a-adae-f563581c39a0'} Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:43:27.584182 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Returning 404 to user: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dc980ed0-3526-45d5-8932-f66a3be2e478 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 404 len: 111 microversion: 2.1 time: 0.091594 Oct 11 04:43:27.587971 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3212/6181] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:43:27 2022] DELETE /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:43:27.594360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:27.596386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] [instance: 7f8eff2c-d489-422a-adae-f563581c39a0] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:27.603404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:27.603890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:27.604330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:27.605035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:27.605489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:27.605947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:27.654357 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] HTTP exception thrown: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Request method failure captured: Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 HTTP/1.1 Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPPkw9Tm2jHfDHKit1LriC52DMjP_9V_IFi_Ln1mCV5u77tW29JbM7ZWmpj8rd3gKLgtbKiYXhBbQct6hI7kInNDjgtmDB2p371spAmpty3ZxZEjfII5ozsci3nA2YCajVNvtXAHYtpZWjACFB-1JeLk0pq2zc_DHh2jC5vtBqK1Sl0 Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d487c5739cef471f88ff5a38cf4ef887 Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d487c5739cef471f88ff5a38cf4ef887"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d487c5739cef471f88ff5a38cf4ef887"}]}] Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d487c5739cef471f88ff5a38cf4ef887 Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-1891061898 Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerDiskConfigTestJSON-1891061898-project Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: cab5e2dbaf37437a8fc4d24ff21c85b0 Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerDiskConfigTestJSON-1891061898-project Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '7f8eff2c-d489-422a-adae-f563581c39a0'} Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:27.656268 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.660853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:27.660853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:27.660853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:27.660853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:43:27.660853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:43:27.660853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. Oct 11 04:43:27.660853 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:27.660853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] Returning 404 to user: Instance 7f8eff2c-d489-422a-adae-f563581c39a0 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:43:27.660853 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eaa65ef9-47c0-4e62-84b4-9848951e7788 tempest-ServerDiskConfigTestJSON-1891061898 tempest-ServerDiskConfigTestJSON-1891061898-project] 10.222.0.26 "GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0" status: 404 len: 111 microversion: 2.1 time: 0.068670 Oct 11 04:43:27.667777 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2970/6182] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:27 2022] GET /compute/v2.1/servers/7f8eff2c-d489-422a-adae-f563581c39a0 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:43:28.284617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a1947293-4722-4a52-b77c-b62711e7f7aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:28.285927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a1947293-4722-4a52-b77c-b62711e7f7aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:28.308194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1947293-4722-4a52-b77c-b62711e7f7aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:28.310131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1947293-4722-4a52-b77c-b62711e7f7aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:28.310694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1947293-4722-4a52-b77c-b62711e7f7aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:28.313125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1947293-4722-4a52-b77c-b62711e7f7aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:28.315360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1947293-4722-4a52-b77c-b62711e7f7aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:28.316785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a1947293-4722-4a52-b77c-b62711e7f7aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:28.374773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-a1947293-4722-4a52-b77c-b62711e7f7aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lazy-loading 'flavor' on Instance uuid 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:43:29.243428 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a1947293-4722-4a52-b77c-b62711e7f7aa tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "POST /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/action" status: 202 len: 0 microversion: 2.20 time: 0.962344 Oct 11 04:43:29.246503 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3213/6183] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:43:28 2022] POST /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/action => generated 0 bytes in 969 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:43:29.255026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:29.255644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:29.270878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:29.277585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:29.283628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:29.289636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:29.290920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:29.291386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:29.783537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:29.801083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:29.814722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:29.816436 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f800619-27f8-4cc3-9ab6-9c46e642c0dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.565519 Oct 11 04:43:29.820509 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2971/6184] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:29 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:30.856923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:30.859022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:30.866474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:30.867075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:30.867625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:30.868515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:30.878886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:30.879560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:31.179004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:31.203100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:31.222254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:31.223679 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ddcbc9e-31fa-4dca-9f7b-a472169d508d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.373556 Oct 11 04:43:31.224680 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3214/6185] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:30 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:32.252141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:32.259650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:32.279479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:32.282930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:32.282930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:32.282930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:32.282930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:32.282930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:32.527926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:32.562042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:32.570682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:32.572986 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f98e73df-6d67-4382-ba7c-0ddbee38934f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.325349 Oct 11 04:43:32.573668 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2972/6186] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:32 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:33.604523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:33.605441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:33.611767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:33.612261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:33.612922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:33.613562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:33.614025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:33.614586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:33.759483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:33.768812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:33.770320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:33.771530 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a9b39785-3fec-4980-981e-cc46a2c735ce tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.172695 Oct 11 04:43:33.772102 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3215/6187] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:33 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:34.802432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:34.803043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:34.808999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:34.809473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:34.809906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:34.810637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:34.811085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:34.811507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:34.956363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:34.964578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:34.966018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:34.967263 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5cc94d96-0d09-4762-af82-15eb748becfb tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.171559 Oct 11 04:43:34.967816 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2973/6188] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:34 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:35.993001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:35.993596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:36.000590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:36.001099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:36.001532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:36.002347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:36.002797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:36.003222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:36.190553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:36.198943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:36.200387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:36.201549 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e528381b-5c4f-402e-90c2-38e8b13ab67a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.212550 Oct 11 04:43:36.202164 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3216/6189] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:35 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:37.227634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:37.228883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:37.251467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:37.251976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:37.252444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:37.253181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:37.253652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:37.254130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:37.441882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:37.451747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:37.453334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:37.455547 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ea035a07-4e89-4c9d-82d9-2a4088122095 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.232151 Oct 11 04:43:37.455946 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2974/6190] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:37 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:38.481484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:38.482214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:38.514993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:38.516670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:38.517160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:38.517938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:38.518695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:38.527538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:38.704368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:38.717202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:38.724526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:38.726844 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef27609a-f295-49c9-9878-38c7e74a5884 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.249334 Oct 11 04:43:38.748313 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3217/6191] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:38 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:39.755090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:39.756368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:39.778364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:39.779302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:39.786784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:39.786784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:39.786784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:39.786784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:40.251812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:40.272659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:40.277480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:40.278925 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b3d207e6-0a5e-4fca-8a8c-f26116e1cc9f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.528357 Oct 11 04:43:40.279869 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2975/6192] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:39 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:40.340039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-77c61e6e-6713-46cb-9769-f661b8557170 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:40.341185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-77c61e6e-6713-46cb-9769-f661b8557170 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:40.348871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77c61e6e-6713-46cb-9769-f661b8557170 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:40.350317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77c61e6e-6713-46cb-9769-f661b8557170 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:40.351019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77c61e6e-6713-46cb-9769-f661b8557170 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:40.351993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77c61e6e-6713-46cb-9769-f661b8557170 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:40.352670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77c61e6e-6713-46cb-9769-f661b8557170 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:40.353307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77c61e6e-6713-46cb-9769-f661b8557170 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:40.460463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-77c61e6e-6713-46cb-9769-f661b8557170 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lazy-loading 'services' on Instance uuid a21e66f4-5fbe-4af0-99f5-0e0166317f10 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:43:40.820168 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-77c61e6e-6713-46cb-9769-f661b8557170 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments/2e7d4842-2ec3-4336-a24a-9f074672ae93" status: 202 len: 0 microversion: 2.1 time: 0.480721 Oct 11 04:43:40.820168 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3218/6193] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:43:40 2022] DELETE /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments/2e7d4842-2ec3-4336-a24a-9f074672ae93 => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:43:40.825712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c38d7ab-e36a-4f73-9991-6d9ca91cba60 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:40.835191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c38d7ab-e36a-4f73-9991-6d9ca91cba60 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:40.864383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c38d7ab-e36a-4f73-9991-6d9ca91cba60 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:40.864899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c38d7ab-e36a-4f73-9991-6d9ca91cba60 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:40.865344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c38d7ab-e36a-4f73-9991-6d9ca91cba60 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:40.866070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c38d7ab-e36a-4f73-9991-6d9ca91cba60 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:40.866563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c38d7ab-e36a-4f73-9991-6d9ca91cba60 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:40.866993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c38d7ab-e36a-4f73-9991-6d9ca91cba60 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:40.948934 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8c38d7ab-e36a-4f73-9991-6d9ca91cba60 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127055 Oct 11 04:43:40.951085 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2976/6194] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:43:40 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments => generated 197 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:41.307589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:41.309100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:41.319040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:41.319590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:41.320164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:41.321565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:41.322076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:41.323166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:41.549962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:41.565345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:41.567161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:41.569005 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-239b01c7-27ec-4777-ab5f-ba428114b77d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.267518 Oct 11 04:43:41.585350 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3219/6195] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:41 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:41.965424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-416acba4-317c-4244-9e26-1a995a2b6882 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:41.972437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-416acba4-317c-4244-9e26-1a995a2b6882 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:41.972437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=2,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:41.980213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-416acba4-317c-4244-9e26-1a995a2b6882 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:41.981135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-416acba4-317c-4244-9e26-1a995a2b6882 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:41.981819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-416acba4-317c-4244-9e26-1a995a2b6882 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:41.982812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-416acba4-317c-4244-9e26-1a995a2b6882 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:41.983710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-416acba4-317c-4244-9e26-1a995a2b6882 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:41.984738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-416acba4-317c-4244-9e26-1a995a2b6882 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:42.029869 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-416acba4-317c-4244-9e26-1a995a2b6882 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066515 Oct 11 04:43:42.029869 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2977/6196] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:43:41 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:42.599464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:42.600368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:42.615160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:42.616889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:42.616889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:42.616889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:42.617535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:42.618121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:42.832262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:42.847878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:42.850224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:42.852787 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eee4df37-e1ac-49a1-a164-629bf6b9c9d0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.257209 Oct 11 04:43:42.854244 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3220/6197] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:42 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:43.041155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-101bb893-7987-4682-9d9b-0713817d2c89 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:43.043399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-101bb893-7987-4682-9d9b-0713817d2c89 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:43.072925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101bb893-7987-4682-9d9b-0713817d2c89 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:43.073459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101bb893-7987-4682-9d9b-0713817d2c89 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:43.073919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101bb893-7987-4682-9d9b-0713817d2c89 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:43.081972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101bb893-7987-4682-9d9b-0713817d2c89 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:43.082545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101bb893-7987-4682-9d9b-0713817d2c89 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:43.083002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-101bb893-7987-4682-9d9b-0713817d2c89 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:43.160585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:43.197324 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-101bb893-7987-4682-9d9b-0713817d2c89 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.160762 Oct 11 04:43:43.198286 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2978/6198] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:43:43 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:43.881636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:43.882414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:43.889649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:43.895568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:43.895568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:43.895568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:43.895568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:43.895568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:43.995043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsTestJSON-server-1425358088", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "7f7c8b9f-7783-4387-b630-784ba860b096"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:44.090684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] validate_networks() for [('7f7c8b9f-7783-4387-b630-784ba860b096', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:43:44.202025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:44.217770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:44.219357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:44.221072 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-88910043-3877-467a-81f3-7e884e72de02 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.344162 Oct 11 04:43:44.222374 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2979/6199] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:43 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:44.234498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-94fe77a8-0081-411b-8c9c-632c395ae96b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:44.240732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-94fe77a8-0081-411b-8c9c-632c395ae96b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:44.249894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94fe77a8-0081-411b-8c9c-632c395ae96b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:44.250438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94fe77a8-0081-411b-8c9c-632c395ae96b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:44.250970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94fe77a8-0081-411b-8c9c-632c395ae96b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:44.251943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94fe77a8-0081-411b-8c9c-632c395ae96b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:44.252581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94fe77a8-0081-411b-8c9c-632c395ae96b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:44.253217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-94fe77a8-0081-411b-8c9c-632c395ae96b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:44.296317 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-94fe77a8-0081-411b-8c9c-632c395ae96b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072466 Oct 11 04:43:44.297174 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2980/6200] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:43:44 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:44.847356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:43:44.847793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:43:44.848287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:43:44.848704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:43:44.849124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:43:44.864633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:44.865414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:44.866036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:44.867007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:44.867469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:44.867932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:44.888938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Getting quotas for project a7c42eecf2704af8a1be99e8b7aa0a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:43:44.908069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Getting quotas for user c029143f08c1451d90fe757514507b13 and project a7c42eecf2704af8a1be99e8b7aa0a8d. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:43:44.936077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:43:44.939053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:43:45.122161 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.383763 Oct 11 04:43:45.123059 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3221/6201] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:43:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1389 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:43:45.143359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-541f83b8-1fb8-4035-a952-35e479f8bfd5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:45.144256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-541f83b8-1fb8-4035-a952-35e479f8bfd5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:45.215555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-541f83b8-1fb8-4035-a952-35e479f8bfd5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:45.223832 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-541f83b8-1fb8-4035-a952-35e479f8bfd5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1217 microversion: 2.1 time: 0.090237 Oct 11 04:43:45.235996 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2981/6202] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:45 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1217 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:45.252018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:45.252579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:45.258965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:45.259456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:45.259892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:45.260625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:45.261078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:45.261553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:45.270401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:45.309082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98312af9-d9cf-4c4d-8860-855b69914304 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:45.311540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98312af9-d9cf-4c4d-8860-855b69914304 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:45.329423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98312af9-d9cf-4c4d-8860-855b69914304 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:45.329945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98312af9-d9cf-4c4d-8860-855b69914304 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:45.330602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98312af9-d9cf-4c4d-8860-855b69914304 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:45.332365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98312af9-d9cf-4c4d-8860-855b69914304 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:45.332826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98312af9-d9cf-4c4d-8860-855b69914304 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:45.333372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98312af9-d9cf-4c4d-8860-855b69914304 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:45.437263 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98312af9-d9cf-4c4d-8860-855b69914304 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.127723 Oct 11 04:43:45.438013 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2982/6203] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:43:45 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments => generated 197 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:45.488600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:45.499243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:45.501958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:45.503489 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e93de359-ee5e-4016-a320-6a621c79e6ed tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.258197 Oct 11 04:43:45.504140 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3222/6204] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:45 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:43:46.248175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bd31e8c2-f28d-496a-a946-5ca9b7252362 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:46.248806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bd31e8c2-f28d-496a-a946-5ca9b7252362 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:46.316755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd31e8c2-f28d-496a-a946-5ca9b7252362 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:46.328608 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bd31e8c2-f28d-496a-a946-5ca9b7252362 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1217 microversion: 2.1 time: 0.084367 Oct 11 04:43:46.332774 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2983/6205] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:46 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1217 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:46.450288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-62147e94-c460-417d-a62e-2e289988a5e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:46.454574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-62147e94-c460-417d-a62e-2e289988a5e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:46.462202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62147e94-c460-417d-a62e-2e289988a5e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:46.462932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62147e94-c460-417d-a62e-2e289988a5e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:46.464308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62147e94-c460-417d-a62e-2e289988a5e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:46.464814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62147e94-c460-417d-a62e-2e289988a5e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:46.465449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62147e94-c460-417d-a62e-2e289988a5e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:46.466042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62147e94-c460-417d-a62e-2e289988a5e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:46.530062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:46.530796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:46.538324 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-62147e94-c460-417d-a62e-2e289988a5e3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092895 Oct 11 04:43:46.539612 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3223/6206] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:43:46 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments => generated 197 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:46.545743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:46.546975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:46.548229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:46.549335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:46.550001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:46.563909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:46.814329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:46.823430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:46.825558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:46.827029 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-135f3a08-fd26-4a34-b211-9a168e1f0086 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1742 microversion: 2.20 time: 0.301891 Oct 11 04:43:46.828179 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2984/6207] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:46 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1742 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:47.353607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a9485c6-047d-4e75-bb6c-f88fd4536a02 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:47.354531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a9485c6-047d-4e75-bb6c-f88fd4536a02 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:47.366495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a9485c6-047d-4e75-bb6c-f88fd4536a02 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:47.369944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a9485c6-047d-4e75-bb6c-f88fd4536a02 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:47.370740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a9485c6-047d-4e75-bb6c-f88fd4536a02 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:47.375836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a9485c6-047d-4e75-bb6c-f88fd4536a02 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:47.376781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a9485c6-047d-4e75-bb6c-f88fd4536a02 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:47.379252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a9485c6-047d-4e75-bb6c-f88fd4536a02 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:47.470733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a9485c6-047d-4e75-bb6c-f88fd4536a02 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:47.484929 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a9485c6-047d-4e75-bb6c-f88fd4536a02 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1213 microversion: 2.1 time: 0.135737 Oct 11 04:43:47.486278 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3224/6208] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:47 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1213 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:47.552804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68fb8a99-7d5d-4ad3-8de6-3207aa352a4a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:47.559835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68fb8a99-7d5d-4ad3-8de6-3207aa352a4a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:47.582973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68fb8a99-7d5d-4ad3-8de6-3207aa352a4a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:47.591831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68fb8a99-7d5d-4ad3-8de6-3207aa352a4a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:47.592447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68fb8a99-7d5d-4ad3-8de6-3207aa352a4a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:47.594078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68fb8a99-7d5d-4ad3-8de6-3207aa352a4a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:47.596830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68fb8a99-7d5d-4ad3-8de6-3207aa352a4a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:47.606263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68fb8a99-7d5d-4ad3-8de6-3207aa352a4a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:47.661921 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68fb8a99-7d5d-4ad3-8de6-3207aa352a4a tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.114348 Oct 11 04:43:47.663269 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2985/6209] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:43:47 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments => generated 197 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:47.853167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:47.853787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:47.864926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:47.865586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:47.865977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:47.866709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:47.867457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:47.868102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:48.052045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:48.061704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:48.068799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:48.070201 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-141fba01-b33e-49e4-952e-c454bff8b859 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1742 microversion: 2.20 time: 0.220992 Oct 11 04:43:48.090821 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3225/6210] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:47 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1742 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:48.517370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5b84dd1-f8b4-406b-9220-b69c2dda807e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:48.518004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c5b84dd1-f8b4-406b-9220-b69c2dda807e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:48.542356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5b84dd1-f8b4-406b-9220-b69c2dda807e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:48.542898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5b84dd1-f8b4-406b-9220-b69c2dda807e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:48.543518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5b84dd1-f8b4-406b-9220-b69c2dda807e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:48.544771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5b84dd1-f8b4-406b-9220-b69c2dda807e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:48.544771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5b84dd1-f8b4-406b-9220-b69c2dda807e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:48.545073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5b84dd1-f8b4-406b-9220-b69c2dda807e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:48.655971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c5b84dd1-f8b4-406b-9220-b69c2dda807e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:48.666322 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c5b84dd1-f8b4-406b-9220-b69c2dda807e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1277 microversion: 2.1 time: 0.158015 Oct 11 04:43:48.675217 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2986/6211] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:48 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1277 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:48.691759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-020b7f0e-4cbc-4370-a3d5-23a88a8ad158 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:48.694350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-020b7f0e-4cbc-4370-a3d5-23a88a8ad158 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:48.701955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-020b7f0e-4cbc-4370-a3d5-23a88a8ad158 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:48.703778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-020b7f0e-4cbc-4370-a3d5-23a88a8ad158 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:48.704232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-020b7f0e-4cbc-4370-a3d5-23a88a8ad158 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:48.715360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-020b7f0e-4cbc-4370-a3d5-23a88a8ad158 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:48.715924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-020b7f0e-4cbc-4370-a3d5-23a88a8ad158 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:48.716958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-020b7f0e-4cbc-4370-a3d5-23a88a8ad158 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:48.764825 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-020b7f0e-4cbc-4370-a3d5-23a88a8ad158 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.093417 Oct 11 04:43:48.765820 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3226/6212] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 04:43:48 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 11 04:43:49.009107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-bef26651-f073-47fb-acc8-08d5dfd62184 req-327015bd-6946-42d2-8245-098f543b35e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0fc2c3-6449-488b-8dc6-bf4db975a9ac", "name": "network-vif-plugged", "status": "completed", "tag": "eb01f976-4613-4ae1-93ed-3abbf2f61aca"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:49.037825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bef26651-f073-47fb-acc8-08d5dfd62184 req-327015bd-6946-42d2-8245-098f543b35e1 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:49.038594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bef26651-f073-47fb-acc8-08d5dfd62184 req-327015bd-6946-42d2-8245-098f543b35e1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:49.039223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bef26651-f073-47fb-acc8-08d5dfd62184 req-327015bd-6946-42d2-8245-098f543b35e1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:49.057943 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-bef26651-f073-47fb-acc8-08d5dfd62184 req-327015bd-6946-42d2-8245-098f543b35e1 service nova] Creating event network-vif-plugged:eb01f976-4613-4ae1-93ed-3abbf2f61aca for instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac on n-h1-860892-1 Oct 11 04:43:49.064852 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-bef26651-f073-47fb-acc8-08d5dfd62184 req-327015bd-6946-42d2-8245-098f543b35e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059328 Oct 11 04:43:49.070681 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2987/6213] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:43:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:49.098363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:49.098986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:49.105646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:49.114892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9ee2bd02-07c6-43ed-a65c-5ce54fb08f2f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:49.115484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9ee2bd02-07c6-43ed-a65c-5ce54fb08f2f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:49.135353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:49.135353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:49.135353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:49.135353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:49.135353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:49.142591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ee2bd02-07c6-43ed-a65c-5ce54fb08f2f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:49.151721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ee2bd02-07c6-43ed-a65c-5ce54fb08f2f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:49.152240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ee2bd02-07c6-43ed-a65c-5ce54fb08f2f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:49.158115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ee2bd02-07c6-43ed-a65c-5ce54fb08f2f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:49.159148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ee2bd02-07c6-43ed-a65c-5ce54fb08f2f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:49.160897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ee2bd02-07c6-43ed-a65c-5ce54fb08f2f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:49.210166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9ee2bd02-07c6-43ed-a65c-5ce54fb08f2f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:43:49.409919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:49.418928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:49.420611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:49.422078 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ba3610a2-2e92-41b0-a90c-62fd1c3d909f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1742 microversion: 2.20 time: 0.328442 Oct 11 04:43:49.423256 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3227/6214] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:49 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1742 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:49.694354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8d77be87-52a8-4aae-a44a-276af450701b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:49.694924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8d77be87-52a8-4aae-a44a-276af450701b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:49.702218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d77be87-52a8-4aae-a44a-276af450701b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:49.702717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d77be87-52a8-4aae-a44a-276af450701b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:49.705041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d77be87-52a8-4aae-a44a-276af450701b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:49.705041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d77be87-52a8-4aae-a44a-276af450701b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:49.705041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d77be87-52a8-4aae-a44a-276af450701b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:49.705041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d77be87-52a8-4aae-a44a-276af450701b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:49.749432 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9ee2bd02-07c6-43ed-a65c-5ce54fb08f2f tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 204 len: 0 microversion: 2.1 time: 0.637967 Oct 11 04:43:49.756111 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2988/6215] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:43:49 2022] DELETE /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 0 bytes in 643 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:43:49.779699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb162086-62a0-4342-b65a-43fa9fbab68c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:49.780570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fb162086-62a0-4342-b65a-43fa9fbab68c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:49.788000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb162086-62a0-4342-b65a-43fa9fbab68c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:49.789545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb162086-62a0-4342-b65a-43fa9fbab68c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:49.790585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb162086-62a0-4342-b65a-43fa9fbab68c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:49.791542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb162086-62a0-4342-b65a-43fa9fbab68c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:49.792467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb162086-62a0-4342-b65a-43fa9fbab68c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:49.793220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb162086-62a0-4342-b65a-43fa9fbab68c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:49.885955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8d77be87-52a8-4aae-a44a-276af450701b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:49.895354 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8d77be87-52a8-4aae-a44a-276af450701b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1317 microversion: 2.1 time: 0.205065 Oct 11 04:43:49.900797 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3228/6216] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:49 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1317 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:43:50.084841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb162086-62a0-4342-b65a-43fa9fbab68c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:50.100382 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb162086-62a0-4342-b65a-43fa9fbab68c tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1681 microversion: 2.1 time: 0.336103 Oct 11 04:43:50.101356 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2989/6217] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:49 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1681 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:50.451960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:50.452577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:50.459455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:50.460146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:50.460596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:50.461297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:50.461925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:50.462405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:50.666381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:50.675095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:50.676876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:50.678027 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e98e6f8a-0888-470e-8bdb-269da39c4d8f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.230007 Oct 11 04:43:50.678634 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3229/6218] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:50 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:50.920328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-71421111-9c7d-43d4-b4b8-9861370b0ed3 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:50.921403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-71421111-9c7d-43d4-b4b8-9861370b0ed3 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:50.928587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71421111-9c7d-43d4-b4b8-9861370b0ed3 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:50.929078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71421111-9c7d-43d4-b4b8-9861370b0ed3 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:50.929512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71421111-9c7d-43d4-b4b8-9861370b0ed3 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:50.930450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71421111-9c7d-43d4-b4b8-9861370b0ed3 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:50.931196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71421111-9c7d-43d4-b4b8-9861370b0ed3 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:50.931628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71421111-9c7d-43d4-b4b8-9861370b0ed3 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:51.128878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-78f86a69-ff98-4eb0-b0fc-2571565054ee tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:51.129496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-78f86a69-ff98-4eb0-b0fc-2571565054ee tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:51.139419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78f86a69-ff98-4eb0-b0fc-2571565054ee tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:51.140252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78f86a69-ff98-4eb0-b0fc-2571565054ee tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:51.141906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78f86a69-ff98-4eb0-b0fc-2571565054ee tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:51.142890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78f86a69-ff98-4eb0-b0fc-2571565054ee tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:51.143802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78f86a69-ff98-4eb0-b0fc-2571565054ee tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:51.145879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78f86a69-ff98-4eb0-b0fc-2571565054ee tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:51.182352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-71421111-9c7d-43d4-b4b8-9861370b0ed3 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:51.210023 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-71421111-9c7d-43d4-b4b8-9861370b0ed3 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1317 microversion: 2.1 time: 0.293599 Oct 11 04:43:51.213190 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2990/6219] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:50 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1317 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:51.323104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-97af446c-5870-4eb8-a4cc-4d8ebfbd69a6 req-b6553c96-cde3-4ae5-a158-85ffb53862e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c8cf835-1d40-42a9-8790-c6abc09be9d4", "tag": "2a995600-8633-4aa9-9342-98f08ecadcab"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:51.343787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-97af446c-5870-4eb8-a4cc-4d8ebfbd69a6 req-b6553c96-cde3-4ae5-a158-85ffb53862e2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:51.345657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-97af446c-5870-4eb8-a4cc-4d8ebfbd69a6 req-b6553c96-cde3-4ae5-a158-85ffb53862e2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:51.348523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-97af446c-5870-4eb8-a4cc-4d8ebfbd69a6 req-b6553c96-cde3-4ae5-a158-85ffb53862e2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:51.386762 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-97af446c-5870-4eb8-a4cc-4d8ebfbd69a6 req-b6553c96-cde3-4ae5-a158-85ffb53862e2 service nova] Creating event network-changed:2a995600-8633-4aa9-9342-98f08ecadcab for instance 5c8cf835-1d40-42a9-8790-c6abc09be9d4 on n-h2-860892-1 Oct 11 04:43:51.394639 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-97af446c-5870-4eb8-a4cc-4d8ebfbd69a6 req-b6553c96-cde3-4ae5-a158-85ffb53862e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076424 Oct 11 04:43:51.397883 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2991/6220] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:43:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:43:51.518058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-78f86a69-ff98-4eb0-b0fc-2571565054ee tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:51.536196 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-78f86a69-ff98-4eb0-b0fc-2571565054ee tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1681 microversion: 2.1 time: 0.408358 Oct 11 04:43:51.537047 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3230/6221] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:51 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1681 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:43:51.705804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:51.707126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:51.716919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:51.722258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:51.723920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:51.724885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:51.728080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:51.728885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:52.238113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-76920cb6-b464-4f76-8994-69f6cbd85e89 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:52.238888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-76920cb6-b464-4f76-8994-69f6cbd85e89 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:52.253897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76920cb6-b464-4f76-8994-69f6cbd85e89 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:52.256708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76920cb6-b464-4f76-8994-69f6cbd85e89 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:52.258533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76920cb6-b464-4f76-8994-69f6cbd85e89 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:52.259659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76920cb6-b464-4f76-8994-69f6cbd85e89 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:52.260408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76920cb6-b464-4f76-8994-69f6cbd85e89 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:52.262005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-76920cb6-b464-4f76-8994-69f6cbd85e89 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:52.396001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:52.411998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:52.414285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:52.416845 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b1be5b5e-e607-4775-bae6-024e1cc0793e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.715648 Oct 11 04:43:52.430938 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2992/6222] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:51 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:52.558138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-76920cb6-b464-4f76-8994-69f6cbd85e89 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:52.561496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67d9b733-6fbd-461c-8c7b-3b89c6b2d3c3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:52.562115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67d9b733-6fbd-461c-8c7b-3b89c6b2d3c3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:52.571820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67d9b733-6fbd-461c-8c7b-3b89c6b2d3c3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:52.571998 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-76920cb6-b464-4f76-8994-69f6cbd85e89 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1317 microversion: 2.1 time: 0.338625 Oct 11 04:43:52.575365 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3231/6223] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:52 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1317 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:52.577202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67d9b733-6fbd-461c-8c7b-3b89c6b2d3c3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:52.577767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67d9b733-6fbd-461c-8c7b-3b89c6b2d3c3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:52.580361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67d9b733-6fbd-461c-8c7b-3b89c6b2d3c3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:52.581001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67d9b733-6fbd-461c-8c7b-3b89c6b2d3c3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:52.581640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67d9b733-6fbd-461c-8c7b-3b89c6b2d3c3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:53.450031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:53.451424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:53.457955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:53.459255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:53.459914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:53.461586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:53.462970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:53.463681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:53.499402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-67d9b733-6fbd-461c-8c7b-3b89c6b2d3c3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:53.515535 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-67d9b733-6fbd-461c-8c7b-3b89c6b2d3c3 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1681 microversion: 2.1 time: 0.958374 Oct 11 04:43:53.516823 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2993/6224] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:52 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1681 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:43:53.602520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8ecb8522-ff70-4d52-9e43-97d99513ce20 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:53.603456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8ecb8522-ff70-4d52-9e43-97d99513ce20 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:53.616698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecb8522-ff70-4d52-9e43-97d99513ce20 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:53.621359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecb8522-ff70-4d52-9e43-97d99513ce20 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:53.622883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecb8522-ff70-4d52-9e43-97d99513ce20 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:53.624271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecb8522-ff70-4d52-9e43-97d99513ce20 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:53.624750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecb8522-ff70-4d52-9e43-97d99513ce20 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:53.625194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ecb8522-ff70-4d52-9e43-97d99513ce20 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:53.804403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:53.817961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:53.819786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:53.821167 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a8768b6e-47b9-4007-a947-9de22a244f4b tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.376832 Oct 11 04:43:53.834743 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3232/6225] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:53 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:43:54.059704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8ecb8522-ff70-4d52-9e43-97d99513ce20 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:54.071100 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8ecb8522-ff70-4d52-9e43-97d99513ce20 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1317 microversion: 2.1 time: 0.473101 Oct 11 04:43:54.072403 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2994/6226] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:53 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1317 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:54.496643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-915d63cb-f95c-48df-9aea-c4ef918aae25 req-c99925f1-d7e7-4232-907d-59b3278c55ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a21e66f4-5fbe-4af0-99f5-0e0166317f10", "name": "network-vif-deleted", "tag": "c6479db7-7758-41fa-b7a7-3dbbddc1665b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:43:54.519924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-915d63cb-f95c-48df-9aea-c4ef918aae25 req-c99925f1-d7e7-4232-907d-59b3278c55ae service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:54.521334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-915d63cb-f95c-48df-9aea-c4ef918aae25 req-c99925f1-d7e7-4232-907d-59b3278c55ae service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:54.524221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-915d63cb-f95c-48df-9aea-c4ef918aae25 req-c99925f1-d7e7-4232-907d-59b3278c55ae service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:54.543296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b1ba65b6-f016-4a84-ade0-da55a19b22a0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:54.543296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b1ba65b6-f016-4a84-ade0-da55a19b22a0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:54.552210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1ba65b6-f016-4a84-ade0-da55a19b22a0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:54.556750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1ba65b6-f016-4a84-ade0-da55a19b22a0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:54.557498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1ba65b6-f016-4a84-ade0-da55a19b22a0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:54.558492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1ba65b6-f016-4a84-ade0-da55a19b22a0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:54.560698 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-915d63cb-f95c-48df-9aea-c4ef918aae25 req-c99925f1-d7e7-4232-907d-59b3278c55ae service nova] Creating event network-vif-deleted:c6479db7-7758-41fa-b7a7-3dbbddc1665b for instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 on n-h1-860892-1 Oct 11 04:43:54.561697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1ba65b6-f016-4a84-ade0-da55a19b22a0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:54.563100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1ba65b6-f016-4a84-ade0-da55a19b22a0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:54.589274 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-915d63cb-f95c-48df-9aea-c4ef918aae25 req-c99925f1-d7e7-4232-907d-59b3278c55ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095264 Oct 11 04:43:54.591123 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3233/6227] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:43:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:43:54.725363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b1ba65b6-f016-4a84-ade0-da55a19b22a0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:54.740162 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b1ba65b6-f016-4a84-ade0-da55a19b22a0 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1614 microversion: 2.1 time: 0.202852 Oct 11 04:43:54.746578 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2995/6228] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:54 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1614 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:54.851843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:54.857501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:54.872720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:54.874233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:54.874697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:54.875990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:54.880922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:54.881410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:54.882268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:54.986286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:55.104449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-36c0722e-9e28-44eb-9d30-d487e2f36bed tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:55.105956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-36c0722e-9e28-44eb-9d30-d487e2f36bed tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:55.128753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36c0722e-9e28-44eb-9d30-d487e2f36bed tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:55.129367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36c0722e-9e28-44eb-9d30-d487e2f36bed tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:55.131405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36c0722e-9e28-44eb-9d30-d487e2f36bed tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:55.136194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36c0722e-9e28-44eb-9d30-d487e2f36bed tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:55.138021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36c0722e-9e28-44eb-9d30-d487e2f36bed tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:55.138662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-36c0722e-9e28-44eb-9d30-d487e2f36bed tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:55.185971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:55.295551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:55.307815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:55.309561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:55.311200 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-57ed2127-ad34-4951-b8d7-5ead794bb03d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.464323 Oct 11 04:43:55.313422 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3234/6229] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:54 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:55.429309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-36c0722e-9e28-44eb-9d30-d487e2f36bed tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:55.446276 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-36c0722e-9e28-44eb-9d30-d487e2f36bed tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1317 microversion: 2.1 time: 0.346858 Oct 11 04:43:55.448182 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2996/6230] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:55 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1317 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:55.771694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:55.772324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:55.800448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:55.800979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:55.806001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:55.809475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:55.809981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:55.810487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:55.897788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:55.898642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:55.899487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:55.904966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lazy-loading 'fault' on Instance uuid a21e66f4-5fbe-4af0-99f5-0e0166317f10 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:43:55.967182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '285715b491b34b90b2a3fcf0e268be46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5e112e065faf4ff0b3e486e2ab662af3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:55.976384 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea048a5f-9fd0-43c3-b0f3-e290fe2ec394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 200 len: 1330 microversion: 2.1 time: 0.211241 Oct 11 04:43:55.980338 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3235/6231] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:55 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 1330 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:56.343468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:56.344713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:56.347896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:56.357396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:56.358340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:56.358946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:56.360460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:56.361170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:56.361928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:56.473305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f48014e7-3282-4f97-baa8-421c4bf079ac tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:56.473702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f48014e7-3282-4f97-baa8-421c4bf079ac tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:56.487886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48014e7-3282-4f97-baa8-421c4bf079ac tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:56.488713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48014e7-3282-4f97-baa8-421c4bf079ac tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:56.489520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48014e7-3282-4f97-baa8-421c4bf079ac tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:56.490293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48014e7-3282-4f97-baa8-421c4bf079ac tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:56.490757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48014e7-3282-4f97-baa8-421c4bf079ac tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:56.491227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f48014e7-3282-4f97-baa8-421c4bf079ac tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:56.580254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:56.603486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:56.612192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:56.613425 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0a5817af-2751-426e-9dff-6498eba87573 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.275088 Oct 11 04:43:56.614237 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2997/6232] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:56 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:56.758331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f48014e7-3282-4f97-baa8-421c4bf079ac tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:56.771483 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f48014e7-3282-4f97-baa8-421c4bf079ac tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1317 microversion: 2.1 time: 0.302404 Oct 11 04:43:56.786306 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3236/6233] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:56 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1317 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:43:57.005144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:57.006538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:57.013614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:57.014111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:57.014581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:57.015294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:57.015752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:57.016184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:57.046423 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 HTTP/1.1 Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'a21e66f4-5fbe-4af0-99f5-0e0166317f10'} Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:43:57.049046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:57.054500 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:43:57.054500 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:43:57.054500 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:43:57.054500 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:43:57.054500 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:43:57.054500 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:43:57.054500 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:43:57.056677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:43:57.057778 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ef07da6-b7e1-4dde-b1fc-adc24244ff97 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 404 len: 111 microversion: 2.1 time: 0.056694 Oct 11 04:43:57.062152 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2998/6234] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:56 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:43:57.073679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-561844c4-1112-41e3-b99d-20ec6062bd96 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '.version_select at 0x7fda19569940>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:57.248568 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-561844c4-1112-41e3-b99d-20ec6062bd96 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-734027413" status: 202 len: 0 microversion: 2.1 time: 0.179423 Oct 11 04:43:57.249390 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3237/6235] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 04:43:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-734027413 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:43:57.642594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:57.643221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:57.651065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:57.651756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:57.652375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:57.653144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:57.653795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:57.654465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:57.799763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-63512045-1ad9-43e4-8449-bf689e4ff8c5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:57.801087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-63512045-1ad9-43e4-8449-bf689e4ff8c5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:57.822574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63512045-1ad9-43e4-8449-bf689e4ff8c5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:57.823102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63512045-1ad9-43e4-8449-bf689e4ff8c5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:57.823555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63512045-1ad9-43e4-8449-bf689e4ff8c5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:57.824286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63512045-1ad9-43e4-8449-bf689e4ff8c5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:57.824902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63512045-1ad9-43e4-8449-bf689e4ff8c5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:57.825333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63512045-1ad9-43e4-8449-bf689e4ff8c5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:57.979544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:57.993317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:57.995434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:57.997038 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-50ab7cb4-0399-4bfa-80cf-9dc11696f57e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.359983 Oct 11 04:43:57.998115 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 2999/6236] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:57 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:58.342891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-63512045-1ad9-43e4-8449-bf689e4ff8c5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:58.352368 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-63512045-1ad9-43e4-8449-bf689e4ff8c5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1317 microversion: 2.1 time: 0.557172 Oct 11 04:43:58.370919 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3238/6237] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:57 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1317 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:43:59.024474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:59.025111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:59.035030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:59.038811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:59.039434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:59.040322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:59.040946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:59.042928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:59.295200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:59.308026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:59.309114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:59.310696 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1a9317e0-2563-46d8-8ae6-942f4d46ac57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.290383 Oct 11 04:43:59.311754 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3000/6238] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:43:59 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:43:59.379099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d0cb2604-4691-48ee-bb21-64a34e5c3c26 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:43:59.379784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d0cb2604-4691-48ee-bb21-64a34e5c3c26 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:43:59.396716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:43:59.406293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cb2604-4691-48ee-bb21-64a34e5c3c26 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:59.406834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cb2604-4691-48ee-bb21-64a34e5c3c26 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:59.407272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cb2604-4691-48ee-bb21-64a34e5c3c26 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:59.408698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cb2604-4691-48ee-bb21-64a34e5c3c26 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:43:59.410120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cb2604-4691-48ee-bb21-64a34e5c3c26 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:43:59.412440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d0cb2604-4691-48ee-bb21-64a34e5c3c26 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:43:59.731084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d0cb2604-4691-48ee-bb21-64a34e5c3c26 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:43:59.739949 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d0cb2604-4691-48ee-bb21-64a34e5c3c26 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1317 microversion: 2.1 time: 0.366113 Oct 11 04:43:59.760014 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3239/6239] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:43:59 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1317 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:44:00.217132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6b17062b-d9dc-426d-8893-432e5b9cdc06 req-3f2be2e3-be36-4418-a5f3-184d6596b57f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8cf835-1d40-42a9-8790-c6abc09be9d4", "name": "network-vif-plugged", "status": "completed", "tag": "2a995600-8633-4aa9-9342-98f08ecadcab"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:44:00.219981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6b17062b-d9dc-426d-8893-432e5b9cdc06 req-3f2be2e3-be36-4418-a5f3-184d6596b57f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:00.220570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6b17062b-d9dc-426d-8893-432e5b9cdc06 req-3f2be2e3-be36-4418-a5f3-184d6596b57f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:00.221097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6b17062b-d9dc-426d-8893-432e5b9cdc06 req-3f2be2e3-be36-4418-a5f3-184d6596b57f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:00.233930 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6b17062b-d9dc-426d-8893-432e5b9cdc06 req-3f2be2e3-be36-4418-a5f3-184d6596b57f service nova] Creating event network-vif-plugged:2a995600-8633-4aa9-9342-98f08ecadcab for instance 5c8cf835-1d40-42a9-8790-c6abc09be9d4 on n-h2-860892-1 Oct 11 04:44:00.240830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6b17062b-d9dc-426d-8893-432e5b9cdc06 req-3f2be2e3-be36-4418-a5f3-184d6596b57f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035950 Oct 11 04:44:00.244561 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3001/6240] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:44:00.341366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:00.342254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:00.372361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:00.373264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:00.377641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:00.378624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:00.380476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:00.383546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:00.429971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:44:00.632962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:00.645242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:00.647482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:00.650142 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-25c4add7-a036-4bb5-8688-76f5cd964598 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.311662 Oct 11 04:44:00.651272 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3240/6241] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:00 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:00.765506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12ae12db-5d10-4cd3-9c31-c979bc234a90 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:00.766407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-12ae12db-5d10-4cd3-9c31-c979bc234a90 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:00.786373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12ae12db-5d10-4cd3-9c31-c979bc234a90 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:00.786889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12ae12db-5d10-4cd3-9c31-c979bc234a90 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:00.787321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12ae12db-5d10-4cd3-9c31-c979bc234a90 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:00.788035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12ae12db-5d10-4cd3-9c31-c979bc234a90 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:00.788543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12ae12db-5d10-4cd3-9c31-c979bc234a90 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:00.788919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12ae12db-5d10-4cd3-9c31-c979bc234a90 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:00.986666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-12ae12db-5d10-4cd3-9c31-c979bc234a90 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:01.004917 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-12ae12db-5d10-4cd3-9c31-c979bc234a90 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1317 microversion: 2.1 time: 0.243615 Oct 11 04:44:01.005505 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3002/6242] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:00 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1317 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:44:01.681512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:01.684548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:01.692942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:01.693760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:01.694466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:01.695411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:01.696094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:01.697137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:01.887376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:01.897674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:01.899225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:01.900853 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-94fc41cb-e57a-4bf1-b83b-fa5ee6ac1873 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.223503 Oct 11 04:44:01.917762 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3241/6243] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:01 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:02.029891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f5f15c30-04f4-44e4-857b-19205124cabb tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:02.032069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f5f15c30-04f4-44e4-857b-19205124cabb tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:02.040621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f15c30-04f4-44e4-857b-19205124cabb tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:02.041485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f15c30-04f4-44e4-857b-19205124cabb tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:02.042355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f15c30-04f4-44e4-857b-19205124cabb tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:02.043391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f15c30-04f4-44e4-857b-19205124cabb tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:02.044114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f15c30-04f4-44e4-857b-19205124cabb tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:02.044767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5f15c30-04f4-44e4-857b-19205124cabb tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:02.273759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5f15c30-04f4-44e4-857b-19205124cabb tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:02.291423 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f5f15c30-04f4-44e4-857b-19205124cabb tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1505 microversion: 2.1 time: 0.266216 Oct 11 04:44:02.292142 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3003/6244] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:02 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1505 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:44:02.316324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0d3e5adc-f831-469d-8cb6-c19920b1952e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:02.317291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0d3e5adc-f831-469d-8cb6-c19920b1952e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:02.323841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3e5adc-f831-469d-8cb6-c19920b1952e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:02.324607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3e5adc-f831-469d-8cb6-c19920b1952e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:02.325346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3e5adc-f831-469d-8cb6-c19920b1952e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:02.326361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3e5adc-f831-469d-8cb6-c19920b1952e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:02.327167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3e5adc-f831-469d-8cb6-c19920b1952e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:02.327770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3e5adc-f831-469d-8cb6-c19920b1952e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:02.379955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0d3e5adc-f831-469d-8cb6-c19920b1952e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-instance-actions:events failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:02.381354 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0d3e5adc-f831-469d-8cb6-c19920b1952e tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4/os-instance-actions/req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b" status: 200 len: 313 microversion: 2.1 time: 0.069215 Oct 11 04:44:02.382501 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3242/6245] 10.222.0.26 () {58 vars in 1419 bytes} [Tue Oct 11 04:44:02 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4/os-instance-actions/req-ea7e8db2-622a-4ec1-a2cd-9ae6d212509b => generated 313 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:44:02.398434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d10170ae-1ff8-4e3d-bb55-b6df996a31b5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:44:02.401075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d10170ae-1ff8-4e3d-bb55-b6df996a31b5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:02.419903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d10170ae-1ff8-4e3d-bb55-b6df996a31b5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:02.420764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d10170ae-1ff8-4e3d-bb55-b6df996a31b5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:02.421512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d10170ae-1ff8-4e3d-bb55-b6df996a31b5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:02.422538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d10170ae-1ff8-4e3d-bb55-b6df996a31b5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:02.423226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d10170ae-1ff8-4e3d-bb55-b6df996a31b5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:02.423864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d10170ae-1ff8-4e3d-bb55-b6df996a31b5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:02.898389 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d10170ae-1ff8-4e3d-bb55-b6df996a31b5 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "POST /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4/action" status: 202 len: 0 microversion: 2.1 time: 0.500939 Oct 11 04:44:02.908983 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3004/6246] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:44:02 2022] POST /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:44:02.914135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9a40d338-1bc4-43eb-afc9-622c84eb213b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:02.914790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9a40d338-1bc4-43eb-afc9-622c84eb213b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:02.922662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a40d338-1bc4-43eb-afc9-622c84eb213b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:02.923439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a40d338-1bc4-43eb-afc9-622c84eb213b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:02.924039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a40d338-1bc4-43eb-afc9-622c84eb213b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:02.939954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:02.940671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:02.942832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a40d338-1bc4-43eb-afc9-622c84eb213b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:02.943428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a40d338-1bc4-43eb-afc9-622c84eb213b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:02.944089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a40d338-1bc4-43eb-afc9-622c84eb213b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:02.954641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:02.960642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:02.960642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:02.960642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:02.960940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:02.961134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:03.175193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9a40d338-1bc4-43eb-afc9-622c84eb213b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:03.175388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:03.183459 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9a40d338-1bc4-43eb-afc9-622c84eb213b tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1507 microversion: 2.1 time: 0.273100 Oct 11 04:44:03.184307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:03.184474 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3243/6247] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:02 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1507 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:44:03.185763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:03.187017 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8576a19a-6ac0-432f-88db-d3ab355cc289 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.252235 Oct 11 04:44:03.188372 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3005/6248] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:02 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:03.779777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:03.780343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:03.795041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:03.799199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:03.799199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:03.799199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:03.799199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:03.799798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:03.820519 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 HTTP/1.1 Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'a21e66f4-5fbe-4af0-99f5-0e0166317f10'} Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:03.822616 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce8532c0-aef7-41f5-b903-063b417701ba tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 404 len: 111 microversion: 2.1 time: 0.049346 Oct 11 04:44:03.830963 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3244/6249] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:44:03 2022] DELETE /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:44:03.840980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:03.842204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: a21e66f4-5fbe-4af0-99f5-0e0166317f10] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:03.849264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:03.849763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:03.850247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:03.854232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:03.854232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:03.854232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:03.869002 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 HTTP/1.1 Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'a21e66f4-5fbe-4af0-99f5-0e0166317f10'} Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:03.871212 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:03.876516 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:03.876516 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:03.876516 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:03.876516 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:03.876516 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:03.876516 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. Oct 11 04:44:03.876516 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:03.876516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance a21e66f4-5fbe-4af0-99f5-0e0166317f10 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:03.877438 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f4977b34-a851-47e8-b53f-9e75f31f7bfa tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10" status: 404 len: 111 microversion: 2.1 time: 0.046364 Oct 11 04:44:03.880098 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3006/6250] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:03 2022] GET /compute/v2.1/servers/a21e66f4-5fbe-4af0-99f5-0e0166317f10 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:44:04.218093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f1c4f573-fe78-4374-ac3e-a6961281307f tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:04.222062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:04.224396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:04.224624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f1c4f573-fe78-4374-ac3e-a6961281307f tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:04.251999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1c4f573-fe78-4374-ac3e-a6961281307f tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:04.254237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:04.254910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1c4f573-fe78-4374-ac3e-a6961281307f tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:04.255582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:04.260217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1c4f573-fe78-4374-ac3e-a6961281307f tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:04.261151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1c4f573-fe78-4374-ac3e-a6961281307f tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:04.262089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:04.263021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:04.263654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1c4f573-fe78-4374-ac3e-a6961281307f tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:04.265438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:04.266097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1c4f573-fe78-4374-ac3e-a6961281307f tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:04.266710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:04.533736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:04.553470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:04.561766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:04.566090 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7dc2dcc7-bb2c-42cd-9392-a18b11434490 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.355217 Oct 11 04:44:04.579294 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3007/6251] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:04 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:04.607871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f1c4f573-fe78-4374-ac3e-a6961281307f tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:04.616325 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f1c4f573-fe78-4374-ac3e-a6961281307f tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1512 microversion: 2.1 time: 0.409179 Oct 11 04:44:04.619131 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3245/6252] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:04 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1512 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:44:05.594511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:05.595944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:05.616573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:05.617071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:05.617937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:05.618232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:05.618678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:05.619404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:05.646633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e394260a-b973-405f-8340-cd2962626c36 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:05.647802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e394260a-b973-405f-8340-cd2962626c36 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:05.664741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e394260a-b973-405f-8340-cd2962626c36 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:05.665523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e394260a-b973-405f-8340-cd2962626c36 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:05.666150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e394260a-b973-405f-8340-cd2962626c36 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:05.667095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e394260a-b973-405f-8340-cd2962626c36 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:05.667722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e394260a-b973-405f-8340-cd2962626c36 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:05.668323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e394260a-b973-405f-8340-cd2962626c36 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:05.845087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:05.863661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:05.865454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:05.866886 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-04e610ec-294f-4bdc-b3dc-7219a04e5def tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.277522 Oct 11 04:44:05.867980 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3008/6253] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:05 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:05.932642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e394260a-b973-405f-8340-cd2962626c36 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:05.945157 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e394260a-b973-405f-8340-cd2962626c36 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1505 microversion: 2.1 time: 0.302480 Oct 11 04:44:05.955976 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3246/6254] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:05 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:44:05.976203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-876b6c9b-8154-448e-9e89-c1deb7a7c930 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '.version_select at 0x7fda19b15ca0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:05.976769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-876b6c9b-8154-448e-9e89-c1deb7a7c930 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:05.993710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-876b6c9b-8154-448e-9e89-c1deb7a7c930 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:05.994231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-876b6c9b-8154-448e-9e89-c1deb7a7c930 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:05.994691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-876b6c9b-8154-448e-9e89-c1deb7a7c930 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:05.995387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-876b6c9b-8154-448e-9e89-c1deb7a7c930 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:05.995910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-876b6c9b-8154-448e-9e89-c1deb7a7c930 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:05.996344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-876b6c9b-8154-448e-9e89-c1deb7a7c930 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:06.065853 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-876b6c9b-8154-448e-9e89-c1deb7a7c930 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4/os-instance-actions" status: 200 len: 611 microversion: 2.1 time: 0.093400 Oct 11 04:44:06.066487 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3009/6255] 10.222.0.26 () {58 vars in 1296 bytes} [Tue Oct 11 04:44:05 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4/os-instance-actions => generated 611 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:44:06.079599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c7372354-958c-47bd-b6fd-63fd337f36fa tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:06.080096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c7372354-958c-47bd-b6fd-63fd337f36fa tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:06.086358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7372354-958c-47bd-b6fd-63fd337f36fa tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:06.087200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7372354-958c-47bd-b6fd-63fd337f36fa tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:06.087820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7372354-958c-47bd-b6fd-63fd337f36fa tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:06.088582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7372354-958c-47bd-b6fd-63fd337f36fa tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:06.089112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7372354-958c-47bd-b6fd-63fd337f36fa tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:06.089602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7372354-958c-47bd-b6fd-63fd337f36fa tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:06.117862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c7372354-958c-47bd-b6fd-63fd337f36fa tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:44:06.484228 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c7372354-958c-47bd-b6fd-63fd337f36fa tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 204 len: 0 microversion: 2.1 time: 0.408785 Oct 11 04:44:06.546277 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3247/6256] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:44:06 2022] DELETE /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:44:06.554962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aa4f0ae7-0344-48ce-86e0-beacff9b5595 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:06.556052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aa4f0ae7-0344-48ce-86e0-beacff9b5595 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:06.566779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa4f0ae7-0344-48ce-86e0-beacff9b5595 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:06.567588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa4f0ae7-0344-48ce-86e0-beacff9b5595 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:06.568235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa4f0ae7-0344-48ce-86e0-beacff9b5595 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:06.568946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa4f0ae7-0344-48ce-86e0-beacff9b5595 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:06.569573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa4f0ae7-0344-48ce-86e0-beacff9b5595 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:06.570070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa4f0ae7-0344-48ce-86e0-beacff9b5595 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:07.195459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aa4f0ae7-0344-48ce-86e0-beacff9b5595 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:07.195459 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aa4f0ae7-0344-48ce-86e0-beacff9b5595 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1511 microversion: 2.1 time: 0.220758 Oct 11 04:44:07.195459 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3010/6257] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:06 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1511 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:44:07.196990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:07.196990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:07.196990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:07.196990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:07.196990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:07.196990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:07.196990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:07.196990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:07.196990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:07.196990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:07.198431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:07.198431 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a871b688-315c-4dfe-bbc5-623c4854e459 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.171845 Oct 11 04:44:07.198431 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3248/6258] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:06 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:08.232445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-40d9913b-8936-4fac-a8ff-2bb4fb796711 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:08.235590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:08.237198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:08.237460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-40d9913b-8936-4fac-a8ff-2bb4fb796711 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:08.256752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40d9913b-8936-4fac-a8ff-2bb4fb796711 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.259843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.260348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.260789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.261393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40d9913b-8936-4fac-a8ff-2bb4fb796711 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.262149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40d9913b-8936-4fac-a8ff-2bb4fb796711 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.263562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.270285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40d9913b-8936-4fac-a8ff-2bb4fb796711 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.271160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.272014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40d9913b-8936-4fac-a8ff-2bb4fb796711 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.272529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-40d9913b-8936-4fac-a8ff-2bb4fb796711 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.272906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.391639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-40d9913b-8936-4fac-a8ff-2bb4fb796711 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:08.423965 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-40d9913b-8936-4fac-a8ff-2bb4fb796711 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1469 microversion: 2.1 time: 0.199752 Oct 11 04:44:08.426248 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3011/6259] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:08 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1469 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:44:08.509318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:08.532986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:08.535115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:08.536536 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-654e0b84-b446-4f39-a664-c3830c417cf1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.313155 Oct 11 04:44:08.537097 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3249/6260] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:08 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:08.590519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:08.590519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:08.597870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.598631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.599354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.600388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.601204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.602129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.632508 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 HTTP/1.1 Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'dd4bbbe5-3984-4e74-8958-d120a9bd63e7'} Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:08.635449 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:08.640059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:44:08.640059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.640059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:08.640059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.640059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.640059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:08.640059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:08.640059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:08.640059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:08.640059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:44:08.640059 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.642134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:08.649464 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9e820fe9-c9bb-4a9e-97f1-fe627f01a91d tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 404 len: 111 microversion: 2.1 time: 0.060637 Oct 11 04:44:08.649464 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3012/6261] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:44:08 2022] DELETE /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:44:08.657333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:08.658632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: dd4bbbe5-3984-4e74-8958-d120a9bd63e7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:08.668793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.675217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.675814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.676993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.679473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.679922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.702383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-eb92928e-cabb-4216-a0da-119466c15b0a req-da1260f9-f7f0-4877-98e9-d5a146868c74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c8cf835-1d40-42a9-8790-c6abc09be9d4", "name": "network-vif-deleted", "tag": "2a995600-8633-4aa9-9342-98f08ecadcab"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:44:08.722793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-eb92928e-cabb-4216-a0da-119466c15b0a req-da1260f9-f7f0-4877-98e9-d5a146868c74 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.723415 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:44:08.723759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-eb92928e-cabb-4216-a0da-119466c15b0a req-da1260f9-f7f0-4877-98e9-d5a146868c74 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.724361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-eb92928e-cabb-4216-a0da-119466c15b0a req-da1260f9-f7f0-4877-98e9-d5a146868c74 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 HTTP/1.1 Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'dd4bbbe5-3984-4e74-8958-d120a9bd63e7'} Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:08.726577 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.731258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.731258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:08.731258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:08.731258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:08.731258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:08.731258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. Oct 11 04:44:08.731258 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.733096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance dd4bbbe5-3984-4e74-8958-d120a9bd63e7 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:08.736944 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-23a51f0f-b57b-41b9-b9ca-ecce9c700887 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7" status: 404 len: 111 microversion: 2.1 time: 0.081602 Oct 11 04:44:08.740677 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3250/6262] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:08 2022] GET /compute/v2.1/servers/dd4bbbe5-3984-4e74-8958-d120a9bd63e7 => generated 111 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:44:08.749548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:08.750090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:08.755075 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-eb92928e-cabb-4216-a0da-119466c15b0a req-da1260f9-f7f0-4877-98e9-d5a146868c74 service nova] Creating event network-vif-deleted:2a995600-8633-4aa9-9342-98f08ecadcab for instance 5c8cf835-1d40-42a9-8790-c6abc09be9d4 on n-h2-860892-1 Oct 11 04:44:08.764436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.764436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.764835 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-eb92928e-cabb-4216-a0da-119466c15b0a req-da1260f9-f7f0-4877-98e9-d5a146868c74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072981 Oct 11 04:44:08.764942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.765040 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3013/6263] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:44:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:44:08.768094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.768588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.769290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.800387 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b HTTP/1.1 Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '27e0e703-4870-42a0-b605-dae37d0c5b1b'} Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:08.801988 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:08.806667 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:44:08.806667 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.806667 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:08.806667 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.806667 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.806667 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:08.806667 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:08.806667 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:08.806667 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:08.806667 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:44:08.806667 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.812706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:08.814840 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6930e31d-7436-4e4b-832f-210673a4772b tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 404 len: 111 microversion: 2.1 time: 0.072010 Oct 11 04:44:08.819458 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3251/6264] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:44:08 2022] DELETE /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:44:08.827609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:08.828365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: 27e0e703-4870-42a0-b605-dae37d0c5b1b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:08.847246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.847746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.848190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.848911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:08.849372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:08.849805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:08.885208 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b HTTP/1.1 Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '27e0e703-4870-42a0-b605-dae37d0c5b1b'} Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:08.886939 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.895485 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:08.895485 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:08.895485 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:08.895485 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:08.895485 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:08.895485 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. Oct 11 04:44:08.895485 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:08.895485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance 27e0e703-4870-42a0-b605-dae37d0c5b1b could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:08.895485 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3f7a8c5e-82da-4e0b-8db1-ae6f4e28d394 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b" status: 404 len: 111 microversion: 2.1 time: 0.064927 Oct 11 04:44:08.895485 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3014/6265] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:08 2022] GET /compute/v2.1/servers/27e0e703-4870-42a0-b605-dae37d0c5b1b => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:44:09.451287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:09.452805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:09.461245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:09.461891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:09.462475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:09.463446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:09.464026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:09.464593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:09.554381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:09.554381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:09.554381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:09.554381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lazy-loading 'fault' on Instance uuid 5c8cf835-1d40-42a9-8790-c6abc09be9d4 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:44:09.564747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:09.566086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:09.575203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:09.576096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:09.576711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:09.578656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:09.579296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:09.579934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:09.614113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c029143f08c1451d90fe757514507b13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7c42eecf2704af8a1be99e8b7aa0a8d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:09.624586 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aba7a225-d79c-4932-818e-4b1cb9e1b0e1 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 200 len: 1307 microversion: 2.1 time: 0.177016 Oct 11 04:44:09.639798 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3252/6266] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:09 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 1307 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:44:09.914122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:09.929834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:09.934445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:09.936731 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e947f728-7e77-4273-addb-67eced98cef8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1737 microversion: 2.20 time: 0.376955 Oct 11 04:44:09.938663 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3015/6267] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:09 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1737 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:10.655030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:10.655965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] [instance: 5c8cf835-1d40-42a9-8790-c6abc09be9d4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:10.663824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:10.664434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:10.664979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:10.665835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:10.666424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:10.667080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:10.682225 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] HTTP exception thrown: Instance 5c8cf835-1d40-42a9-8790-c6abc09be9d4 could not be found. Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Request method failure captured: Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 HTTP/1.1 Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPR_ndBahBUHdyt9qSXpQK-cnt1u0gKqpKNBrkS9vUb0WnBj-T6luf-PPu4SSs70tfDInYDzxRu_DKqqm84vRjG_BfiRAJe5ATqmB_WRDZTpPWrLzIrk9M64vdk7H71sqkuDb0ZWjDri9twJWopH0kGK9Qwc9u1r-6K8jwHhSXyPA-4 Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: a7c42eecf2704af8a1be99e8b7aa0a8d Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-InstanceActionsTestJSON-1750564575 Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a7c42eecf2704af8a1be99e8b7aa0a8d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a7c42eecf2704af8a1be99e8b7aa0a8d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7c42eecf2704af8a1be99e8b7aa0a8d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a7c42eecf2704af8a1be99e8b7aa0a8d"}]}] Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-InstanceActionsTestJSON-1750564575 Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: a7c42eecf2704af8a1be99e8b7aa0a8d Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-InstanceActionsTestJSON-1750564575 Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-InstanceActionsTestJSON-1750564575-project Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: c029143f08c1451d90fe757514507b13 Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-InstanceActionsTestJSON-1750564575-project Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 5c8cf835-1d40-42a9-8790-c6abc09be9d4 could not be found. Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '5c8cf835-1d40-42a9-8790-c6abc09be9d4'} Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c8cf835-1d40-42a9-8790-c6abc09be9d4 could not be found. Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c8cf835-1d40-42a9-8790-c6abc09be9d4 could not be found. Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:10.684197 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:10.689984 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:10.689984 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:10.689984 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:10.689984 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:10.689984 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:10.689984 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c8cf835-1d40-42a9-8790-c6abc09be9d4 could not be found. Oct 11 04:44:10.689984 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:10.689984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] Returning 404 to user: Instance 5c8cf835-1d40-42a9-8790-c6abc09be9d4 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:10.691150 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-748c1192-b699-4010-a4be-49120e1d0917 tempest-InstanceActionsTestJSON-1750564575 tempest-InstanceActionsTestJSON-1750564575-project] 10.222.0.26 "GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4" status: 404 len: 111 microversion: 2.1 time: 0.040019 Oct 11 04:44:10.691957 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3253/6268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:10 2022] GET /compute/v2.1/servers/5c8cf835-1d40-42a9-8790-c6abc09be9d4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:44:10.964827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:10.966325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:10.974040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:10.974866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:10.976118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:10.977145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:10.977794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:10.978366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:10.982871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:44:11.259727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:11.272690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:11.274961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:11.276613 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-95fa6679-ff5c-4f93-8188-70c85802d273 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1719 microversion: 2.20 time: 0.316153 Oct 11 04:44:11.277915 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3016/6269] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:10 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1719 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:44:12.307973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:12.307973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:12.314876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:12.315655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:12.316546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:12.317769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:12.318485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:12.319103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:12.585422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:12.585422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:12.585422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:12.585422 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e57dd45b-931f-4094-84fe-8842e0b47d57 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1719 microversion: 2.20 time: 0.274178 Oct 11 04:44:12.585422 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3254/6270] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:12 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1719 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:13.603510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:13.604049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:13.619630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:13.620129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:13.620585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:13.621312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:13.621777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:13.633510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:13.647676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:13.650145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:13.667381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:13.672401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:13.673874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:13.674930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:13.675611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:13.676835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:13.699006 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 HTTP/1.1 Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e63dbf99-f394-4f8c-b8cd-4c44979d03d3'} Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:13.701937 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:13.707159 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:44:13.707159 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:13.707159 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:13.707159 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:13.707159 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:13.707159 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:13.707159 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:13.707159 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:13.707159 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:13.707159 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:44:13.707159 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:13.709521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:13.712194 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-058db824-fd6a-446a-bc5e-cdfde0873923 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 404 len: 111 microversion: 2.1 time: 0.067454 Oct 11 04:44:13.717470 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3255/6271] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:44:13 2022] DELETE /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:44:13.724104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:13.724975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] [instance: e63dbf99-f394-4f8c-b8cd-4c44979d03d3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:13.733344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:13.734855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:13.735483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:13.736510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:13.737126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:13.737869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:13.758248 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] HTTP exception thrown: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Request method failure captured: Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 HTTP/1.1 Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPLlBbWG3u1SF8Calo0kJRQZ4-TCHBriWeHmUgV1RE81oIDFwywR0h0DYptNnELOr6Cq7T9AWeGS1F6xUnfL5CcR5DHR-cmBZbalwVZl_6CCU_5CLRSd43YJyg7wJ7qmlm3bidpgD8qeLJAFYcKj8D3e1sF0kk_IbIUthT6MsHrkoDA Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5e112e065faf4ff0b3e486e2ab662af3"}]}] Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 5e112e065faf4ff0b3e486e2ab662af3 Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-271459927 Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 285715b491b34b90b2a3fcf0e268be46 Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeNegativeTest-271459927-project Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e63dbf99-f394-4f8c-b8cd-4c44979d03d3'} Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:13.760927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:13.765498 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:13.765498 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:13.765498 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:13.765498 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:13.765498 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:13.765498 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. Oct 11 04:44:13.765498 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:13.765498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] Returning 404 to user: Instance e63dbf99-f394-4f8c-b8cd-4c44979d03d3 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:13.765498 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-646c2596-3f59-494d-94af-e50686696ff9 tempest-AttachVolumeNegativeTest-271459927 tempest-AttachVolumeNegativeTest-271459927-project] 10.222.0.26 "GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3" status: 404 len: 111 microversion: 2.1 time: 0.042584 Oct 11 04:44:13.774324 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3256/6272] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:44:13 2022] GET /compute/v2.1/servers/e63dbf99-f394-4f8c-b8cd-4c44979d03d3 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:44:13.905616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:13.919341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:13.921138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:13.924720 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-244f0ae7-3da5-4628-9997-e24b7e7311dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1722 microversion: 2.20 time: 0.325161 Oct 11 04:44:13.927341 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3017/6273] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:13 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:13.952270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3e0db6e7-cad1-49e3-9950-f43d313d3c72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6941aa3-c7c2-4b77-8c77-476acb6c8182"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:44:13.955098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3e0db6e7-cad1-49e3-9950-f43d313d3c72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:13.965935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e0db6e7-cad1-49e3-9950-f43d313d3c72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:13.969749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e0db6e7-cad1-49e3-9950-f43d313d3c72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:13.970340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e0db6e7-cad1-49e3-9950-f43d313d3c72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:13.970946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e0db6e7-cad1-49e3-9950-f43d313d3c72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:13.971399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e0db6e7-cad1-49e3-9950-f43d313d3c72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:13.976565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3e0db6e7-cad1-49e3-9950-f43d313d3c72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:14.720972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:44:15.000201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c38361e6-6ff0-4769-9a13-cf9f9270ac97 req-e5289e4f-55a1-4adc-8a98-2d02fe0ad385 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0fc2c3-6449-488b-8dc6-bf4db975a9ac", "name": "network-vif-unplugged", "status": "completed", "tag": "eb01f976-4613-4ae1-93ed-3abbf2f61aca"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:44:15.008731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:44:15.015227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c38361e6-6ff0-4769-9a13-cf9f9270ac97 req-e5289e4f-55a1-4adc-8a98-2d02fe0ad385 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:15.015479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c38361e6-6ff0-4769-9a13-cf9f9270ac97 req-e5289e4f-55a1-4adc-8a98-2d02fe0ad385 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:15.015841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c38361e6-6ff0-4769-9a13-cf9f9270ac97 req-e5289e4f-55a1-4adc-8a98-2d02fe0ad385 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:15.041082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.compute.server_external_events [req-c38361e6-6ff0-4769-9a13-cf9f9270ac97 req-e5289e4f-55a1-4adc-8a98-2d02fe0ad385 service nova] Unable to find a host for instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac. Dropping event network-vif-unplugged {{(pid=120993) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 04:44:15.041864 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c38361e6-6ff0-4769-9a13-cf9f9270ac97 req-e5289e4f-55a1-4adc-8a98-2d02fe0ad385 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.045596 Oct 11 04:44:15.043055 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3018/6274] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:44:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 48 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 11 04:44:15.431230 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3e0db6e7-cad1-49e3-9950-f43d313d3c72 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "POST /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.483478 Oct 11 04:44:15.438104 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3257/6275] 10.222.0.26 () {62 vars in 1364 bytes} [Tue Oct 11 04:44:13 2022] POST /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/os-volume_attachments => generated 188 bytes in 1491 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:44:15.677495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bdfe3eaf-2a0d-4b0f-b479-910192079b41 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:15.678417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bdfe3eaf-2a0d-4b0f-b479-910192079b41 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:15.686517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfe3eaf-2a0d-4b0f-b479-910192079b41 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:15.687000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfe3eaf-2a0d-4b0f-b479-910192079b41 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:15.688559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfe3eaf-2a0d-4b0f-b479-910192079b41 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:15.690599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfe3eaf-2a0d-4b0f-b479-910192079b41 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:15.691462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfe3eaf-2a0d-4b0f-b479-910192079b41 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:15.692087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bdfe3eaf-2a0d-4b0f-b479-910192079b41 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:16.766057 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bdfe3eaf-2a0d-4b0f-b479-910192079b41 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/os-volume_attachments/b6941aa3-c7c2-4b77-8c77-476acb6c8182" status: 202 len: 0 microversion: 2.20 time: 1.092853 Oct 11 04:44:16.767757 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3019/6276] 10.222.0.26 () {60 vars in 1457 bytes} [Tue Oct 11 04:44:15 2022] DELETE /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/os-volume_attachments/b6941aa3-c7c2-4b77-8c77-476acb6c8182 => generated 0 bytes in 1097 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:44:16.875954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-11dc55c8-75fd-4676-a7ad-061bb2c7ff09 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:44:16.877723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-11dc55c8-75fd-4676-a7ad-061bb2c7ff09 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:16.887547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11dc55c8-75fd-4676-a7ad-061bb2c7ff09 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:16.888305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11dc55c8-75fd-4676-a7ad-061bb2c7ff09 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:16.888982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11dc55c8-75fd-4676-a7ad-061bb2c7ff09 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:16.889921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11dc55c8-75fd-4676-a7ad-061bb2c7ff09 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:16.891131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11dc55c8-75fd-4676-a7ad-061bb2c7ff09 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:16.891780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11dc55c8-75fd-4676-a7ad-061bb2c7ff09 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:16.953570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-11dc55c8-75fd-4676-a7ad-061bb2c7ff09 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120994) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 04:44:17.304834 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-11dc55c8-75fd-4676-a7ad-061bb2c7ff09 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "POST /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/action" status: 202 len: 0 microversion: 2.20 time: 0.433122 Oct 11 04:44:17.318671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:17.319689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:17.322511 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3258/6277] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:44:16 2022] POST /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/action => generated 0 bytes in 451 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:44:17.328676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:17.329470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:17.330155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:17.331117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:17.331785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:17.332708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:17.670025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:17.697548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:17.711371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:17.726702 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb50cbaf-5e93-435f-8997-196c0a498e15 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1670 microversion: 2.20 time: 0.409387 Oct 11 04:44:17.731097 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3020/6278] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:17 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1670 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:18.762576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:18.762937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:18.772422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:18.773228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:18.773925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:18.774682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:18.775134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:18.775655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:19.081971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:19.094814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:19.097006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:19.106885 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d28d314-722c-43bf-84cf-13d49268db83 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1670 microversion: 2.20 time: 0.352074 Oct 11 04:44:19.107872 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3259/6279] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:18 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1670 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:20.147448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:20.148914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:20.177290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:20.179080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:20.182370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:20.190336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:20.190336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:20.190336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:20.770847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:20.785301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:20.792146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:20.793763 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-273c3e21-114f-466a-a088-0b8c445f9060 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.658701 Oct 11 04:44:20.811166 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3021/6280] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:20 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:21.834282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:21.834935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:21.847475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:21.859748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:21.860093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:21.860857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:21.861505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:21.862126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:22.354131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:22.363769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:22.369487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:22.375896 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7a714f40-0031-4b5d-94ff-b97729eed050 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.548864 Oct 11 04:44:22.377232 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3260/6281] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:21 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:23.417937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:23.418618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:23.441560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:23.442333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:23.443402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:23.446274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:23.447169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:23.448722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:23.763719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:23.776194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:23.791215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:23.791215 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-67dfcf93-1938-425f-b39a-0ec99addb3e1 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.374803 Oct 11 04:44:23.791215 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3022/6282] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:23 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:24.818696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:24.823346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:24.846969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:24.847522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:24.847967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:24.848735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:24.849295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:24.849736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:25.176027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:25.196173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:25.201847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:25.210842 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48e22d6c-efa3-4ab8-8728-424d2801b74f tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.396753 Oct 11 04:44:25.213863 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3261/6283] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:24 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:26.245673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:26.247121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:26.269505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:26.269505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:26.269505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:26.284348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:26.285140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:26.290808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:27.223072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:27.240971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:27.240971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:27.240971 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b05d562-b7c1-4482-8cbe-1044492195dc tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.997379 Oct 11 04:44:27.240971 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3023/6284] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:26 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 1000 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:28.270990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:28.271624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:28.301326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:28.302677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:28.303862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:28.306020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:28.308925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:28.309735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:29.339079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:29.354344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:29.360754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:29.364905 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4e8344c0-0f8f-4ed4-90c2-c6c365aa4097 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 1.100169 Oct 11 04:44:29.367761 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3262/6285] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:28 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:30.397249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:30.401313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:30.409176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:30.409657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:30.410125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:30.415072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:30.415553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:30.415983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:30.831804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:30.849380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:30.851087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:30.855308 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9f366e33-14ec-4831-ad3a-f23aab2976b6 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.462084 Oct 11 04:44:30.856489 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3024/6286] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:30 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:31.886371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:31.887633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:31.895761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:44:31.897194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:31.897667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:31.900542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:31.901285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:31.901746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:31.902168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:32.071953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:32.087175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:32.088934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:32.090691 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e8ec5969-dfc2-40f7-9d14-005675a225f8 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.208377 Oct 11 04:44:32.091383 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3263/6287] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:31 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:32.413490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-InstanceActionsV221TestJSON-server-1857089291", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "328c695b-d133-41c5-a647-1bfb410d0439"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:44:32.583833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] validate_networks() for [('328c695b-d133-41c5-a647-1bfb410d0439', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:44:33.128356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:33.132271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:33.160949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:33.175036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:33.176348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:33.178817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:33.180442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:33.182624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:33.527994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:44:33.529102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:44:33.529793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:44:33.530488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:44:33.532694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:44:33.542912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:33.543683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:33.544295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:33.545206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:33.545843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:33.546703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:33.588553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:33.593766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Getting quotas for project d5aa14702fc44954aadb1e3f7ffa5c5f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:44:33.601641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:33.611620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:33.612901 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff9c1e04-1b1b-4dee-b03b-194099fb1e7e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.491763 Oct 11 04:44:33.615107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Getting quotas for user 517218d0618e41a0829603df6f769d74 and project d5aa14702fc44954aadb1e3f7ffa5c5f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:44:33.617047 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3264/6288] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:33 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:44:33.651440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:44:33.657715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:44:34.248693 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5b7cfb7b-2b46-4336-b142-f6339c247983 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.21 time: 2.121142 Oct 11 04:44:34.258079 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3025/6289] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:44:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 2132 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:44:34.262367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f2b66d58-15d5-4f30-a549-153eadd505dc tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:34.262855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f2b66d58-15d5-4f30-a549-153eadd505dc tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:34.428269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2b66d58-15d5-4f30-a549-153eadd505dc tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:34.437330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2b66d58-15d5-4f30-a549-153eadd505dc tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:34.439811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2b66d58-15d5-4f30-a549-153eadd505dc tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:34.442560 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f2b66d58-15d5-4f30-a549-153eadd505dc tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1259 microversion: 2.21 time: 0.183435 Oct 11 04:44:34.447122 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3265/6290] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:34 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1259 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:34.646533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:34.647591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:34.658285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:34.658786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:34.663163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:34.664039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:34.664705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:34.669114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:34.921739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:34.937436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:34.940983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:34.940983 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ab1c1e4f-f307-4e4c-8bce-bf775c084452 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.299321 Oct 11 04:44:34.949906 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3026/6291] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:34 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:35.472395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1fcee4d2-21a1-4d2b-85c8-10376a402b09 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:35.473258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1fcee4d2-21a1-4d2b-85c8-10376a402b09 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:35.559686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1fcee4d2-21a1-4d2b-85c8-10376a402b09 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:35.577745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1fcee4d2-21a1-4d2b-85c8-10376a402b09 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:35.579711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1fcee4d2-21a1-4d2b-85c8-10376a402b09 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:35.580957 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1fcee4d2-21a1-4d2b-85c8-10376a402b09 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1259 microversion: 2.21 time: 0.114718 Oct 11 04:44:35.595315 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3266/6292] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:35 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1259 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:35.977238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:35.977847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:35.985728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:35.986251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:35.998847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:35.998847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:35.998847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:35.998847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:36.127616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:36.135983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:36.142657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:36.143838 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c602eb1c-98d7-447f-a9e4-400a7f1cbe43 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.170574 Oct 11 04:44:36.144705 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3027/6293] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:35 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:36.608174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f884f765-92ae-4c23-a9c5-62a0f6345ced tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:36.609777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f884f765-92ae-4c23-a9c5-62a0f6345ced tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:36.734593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f884f765-92ae-4c23-a9c5-62a0f6345ced tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:36.750445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f884f765-92ae-4c23-a9c5-62a0f6345ced tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:36.752707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f884f765-92ae-4c23-a9c5-62a0f6345ced tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:36.753972 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f884f765-92ae-4c23-a9c5-62a0f6345ced tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1259 microversion: 2.21 time: 0.149740 Oct 11 04:44:36.754920 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3267/6294] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:36 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:37.171375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:37.171979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:37.181680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:37.182344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:37.182626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:37.183720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:37.184515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:37.185219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:37.355000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:37.365723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:37.368392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:37.369751 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f0e62ebb-3ff0-4516-aaa8-17b490efedb5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.202503 Oct 11 04:44:37.386241 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3028/6295] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:37 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:37.788334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:37.789672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:37.807206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:37.808655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:37.815055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:37.816754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:37.817428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:37.818275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:37.911594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:37.922538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:37.924007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:37.925138 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6aff278d-c1dd-41a7-9a26-fc5fd62d55b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1255 microversion: 2.21 time: 0.142695 Oct 11 04:44:37.925750 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3268/6296] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:37 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1255 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:44:38.398860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:38.399479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:38.409620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:38.410865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:38.411952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:38.413307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:38.414578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:38.416837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:38.619275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:38.630351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:38.633671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:38.636407 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bf6936b7-3fa0-4cb0-81af-878b59363e30 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.242113 Oct 11 04:44:38.639756 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3029/6297] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:38 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:38.962022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:38.962666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:38.971823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:38.972313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:38.972753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:38.973452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:38.984540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:38.985301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:39.085857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:39.097475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:39.099384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:39.100819 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce400902-8d50-4570-a25b-4d0cfeaafdaa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1319 microversion: 2.21 time: 0.152315 Oct 11 04:44:39.101920 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3269/6298] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:38 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:44:39.662027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:39.663210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:39.675865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:39.675865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:39.675865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:39.675865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:39.676809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:39.677529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:40.023889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:40.040899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:40.042860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:40.044136 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-78431a4a-7066-42b5-bd60-b8e1fb32317e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.385926 Oct 11 04:44:40.044740 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3030/6299] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:39 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:40.131748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:40.132356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:40.141630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:40.142360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:40.147983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:40.147983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:40.147983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:40.148788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:40.418886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:40.427550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:40.428996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:40.430541 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-69a8d8f2-53c2-4960-94b1-7d7667cd9068 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1359 microversion: 2.21 time: 0.302593 Oct 11 04:44:40.434383 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3270/6300] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:40 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:41.070699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:41.072287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:41.090102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:41.092032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:41.099935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:41.099935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:41.100570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:41.101194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:41.139600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:44:41.358440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:41.370972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:41.373216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:41.375437 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3143b32c-edb0-481e-a172-0ab5fe271506 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.308883 Oct 11 04:44:41.377316 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3031/6301] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:41 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:41.456906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:41.457519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:41.464738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:41.465234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:41.465710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:41.466494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:41.466981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:41.467434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:41.508299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-26e18b04-1a48-4b00-804d-7e0476400487 req-0eb2fb56-6652-4e18-9bd4-9c10a7b32db4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be93a956-4e95-467a-84df-14936ec35200", "tag": "19e27e71-e7ed-482b-a103-28cc90ed2a87"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:44:41.523891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-26e18b04-1a48-4b00-804d-7e0476400487 req-0eb2fb56-6652-4e18-9bd4-9c10a7b32db4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:41.524577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-26e18b04-1a48-4b00-804d-7e0476400487 req-0eb2fb56-6652-4e18-9bd4-9c10a7b32db4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:41.525173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-26e18b04-1a48-4b00-804d-7e0476400487 req-0eb2fb56-6652-4e18-9bd4-9c10a7b32db4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:41.546618 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-26e18b04-1a48-4b00-804d-7e0476400487 req-0eb2fb56-6652-4e18-9bd4-9c10a7b32db4 service nova] Creating event network-changed:19e27e71-e7ed-482b-a103-28cc90ed2a87 for instance be93a956-4e95-467a-84df-14936ec35200 on n-h2-860892-1 Oct 11 04:44:41.552602 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-26e18b04-1a48-4b00-804d-7e0476400487 req-0eb2fb56-6652-4e18-9bd4-9c10a7b32db4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049476 Oct 11 04:44:41.554098 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3032/6302] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:44:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:44:41.724707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:41.744448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:41.752715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:41.755039 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f179873-906d-485f-b560-cff016eaa16b tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1359 microversion: 2.21 time: 0.302716 Oct 11 04:44:41.761987 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3271/6303] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:41 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1359 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:42.406580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:42.408060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:42.428014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:42.429618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:42.431415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:42.433308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:42.434542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:42.435746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:42.620518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:42.629192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:42.630719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:42.632169 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-88082302-ead5-4a0a-b715-e51639ab4c3d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.230221 Oct 11 04:44:42.632734 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3033/6304] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:42 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:42.789876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:42.790931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:42.798398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:42.799117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:42.799748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:42.800451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:42.800907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:42.801379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:42.944744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:42.956727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:42.958560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:42.960143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-21174ba3-ec93-4d08-b8dd-653a60878362 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1359 microversion: 2.21 time: 0.174901 Oct 11 04:44:42.961295 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3272/6305] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:42 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:43.150834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-78d41219-c7aa-4aa0-b602-5f2fdb307001 req-9a35898d-0db8-41e6-b762-7ddb7754fe27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0fc2c3-6449-488b-8dc6-bf4db975a9ac", "name": "network-vif-plugged", "status": "completed", "tag": "eb01f976-4613-4ae1-93ed-3abbf2f61aca"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:44:43.161511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-78d41219-c7aa-4aa0-b602-5f2fdb307001 req-9a35898d-0db8-41e6-b762-7ddb7754fe27 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:43.162304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-78d41219-c7aa-4aa0-b602-5f2fdb307001 req-9a35898d-0db8-41e6-b762-7ddb7754fe27 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:43.162907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-78d41219-c7aa-4aa0-b602-5f2fdb307001 req-9a35898d-0db8-41e6-b762-7ddb7754fe27 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:43.175160 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-78d41219-c7aa-4aa0-b602-5f2fdb307001 req-9a35898d-0db8-41e6-b762-7ddb7754fe27 service nova] Creating event network-vif-plugged:eb01f976-4613-4ae1-93ed-3abbf2f61aca for instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac on n-h1-860892-1 Oct 11 04:44:43.180333 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-78d41219-c7aa-4aa0-b602-5f2fdb307001 req-9a35898d-0db8-41e6-b762-7ddb7754fe27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033173 Oct 11 04:44:43.181140 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3034/6306] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:44:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:44:43.659410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:43.660587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:43.669845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:43.670505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:43.671065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:43.671852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:43.672368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:43.673265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:43.854099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:43.865323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:43.884219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:43.884219 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bc073f95-1600-4a48-b41a-6ea5c17bae4c tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.214407 Oct 11 04:44:43.884219 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3273/6307] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:43 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:43.990949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:43.993274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:43.996674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:44:43.997360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:44:44.001662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:44.002145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:44.002623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:44.003345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:44.003970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:44.004390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:44.280135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:44.280135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:44.280135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:44.280135 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a91d066b-a5ee-4d07-815e-261756cb878d tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1359 microversion: 2.21 time: 0.235607 Oct 11 04:44:44.280135 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3035/6308] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:43 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1359 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:44.893802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:44.895116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:44.902686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:44.903708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:44.904263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:44.905843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:44.906532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:44.907200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:45.071103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:45.073267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:44:45.081486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:45.083436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:45.085254 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d3d147fd-92f2-4d8e-afeb-5ce752686876 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.195415 Oct 11 04:44:45.085254 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3274/6309] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:44 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:45.264060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:45.264060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:45.265282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:45.265540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:45.269025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:45.270176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:45.270806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:45.271379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:45.480793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:45.497398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:45.497398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:45.498106 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9f343069-8b5b-4e4b-a06d-d9fb7fc43ed4 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1359 microversion: 2.21 time: 0.251730 Oct 11 04:44:45.499558 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3036/6310] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:45 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1359 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:46.125810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:46.127382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:46.142152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:46.143296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:46.144224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:46.145583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:46.146302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:46.147225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:46.443204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:46.460158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:46.464550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:46.468836 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7108282c-22fc-4daa-aa29-889b3b15e4cf tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1728 microversion: 2.20 time: 0.348332 Oct 11 04:44:46.468836 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3275/6311] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:46 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1728 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:46.526606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:46.527233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:46.537851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:44:46.539239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:46.541458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:46.541913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:46.542680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:46.543232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:46.549700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:46.810883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:46.826800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:46.828308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:46.829477 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bcd7ae9f-0e68-4e40-bd56-8026fc05ba82 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1359 microversion: 2.21 time: 0.308517 Oct 11 04:44:46.832552 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3037/6312] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:46 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1359 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:47.493850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:47.496724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:47.503325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:44:47.505703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:47.506214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:47.509937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:47.511226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:47.511996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:47.512602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:47.691192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:47.700583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:47.704626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:47.708695 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c95c1941-c8cd-432b-b2b2-4891a3c5262d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1715 microversion: 2.20 time: 0.217232 Oct 11 04:44:47.709844 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3276/6313] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:47 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1715 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:47.872069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:47.872707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:47.882393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:47.883038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:47.883488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:47.884206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:47.884670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:47.885096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:48.047854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c561e492-9e34-4e42-a3de-0c507890db7e req-6001fa84-b1ea-4f06-b38a-3ce1b6895427 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be93a956-4e95-467a-84df-14936ec35200", "name": "network-vif-plugged", "status": "completed", "tag": "19e27e71-e7ed-482b-a103-28cc90ed2a87"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:44:48.075072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c561e492-9e34-4e42-a3de-0c507890db7e req-6001fa84-b1ea-4f06-b38a-3ce1b6895427 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:48.080808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c561e492-9e34-4e42-a3de-0c507890db7e req-6001fa84-b1ea-4f06-b38a-3ce1b6895427 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:48.080808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c561e492-9e34-4e42-a3de-0c507890db7e req-6001fa84-b1ea-4f06-b38a-3ce1b6895427 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:48.093302 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c561e492-9e34-4e42-a3de-0c507890db7e req-6001fa84-b1ea-4f06-b38a-3ce1b6895427 service nova] Creating event network-vif-plugged:19e27e71-e7ed-482b-a103-28cc90ed2a87 for instance be93a956-4e95-467a-84df-14936ec35200 on n-h2-860892-1 Oct 11 04:44:48.098889 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c561e492-9e34-4e42-a3de-0c507890db7e req-6001fa84-b1ea-4f06-b38a-3ce1b6895427 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055484 Oct 11 04:44:48.100125 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3277/6314] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:44:48.115671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:48.121850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:48.123347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:48.125170 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b4e0d67c-3350-4106-aafd-eab25d0a2259 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1359 microversion: 2.21 time: 0.262197 Oct 11 04:44:48.125729 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3038/6315] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:47 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:49.151174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:49.152874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:49.164589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:49.165305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:49.166063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:49.166984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:49.167504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:49.167938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:49.340916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:49.352499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:49.354017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:49.355268 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9ba9cd5e-2ae2-4a82-8840-f719791ac739 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1359 microversion: 2.21 time: 0.209775 Oct 11 04:44:49.356217 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3278/6316] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:49 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1359 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:50.382372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:50.384157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:50.394405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:50.395678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:50.397076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:50.398947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:50.399602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:50.400346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:50.571881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:50.597839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:50.600974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:50.603886 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f7a0082-55b8-4a21-895f-406a98c07fbd tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1552 microversion: 2.21 time: 0.226843 Oct 11 04:44:50.607212 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3039/6317] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:50 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1552 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:50.647073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-59689837-155b-4fba-9f7d-f30c005bba46 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:50.647564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-59689837-155b-4fba-9f7d-f30c005bba46 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:50.654892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59689837-155b-4fba-9f7d-f30c005bba46 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:50.655380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59689837-155b-4fba-9f7d-f30c005bba46 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:50.657041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59689837-155b-4fba-9f7d-f30c005bba46 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:50.657041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59689837-155b-4fba-9f7d-f30c005bba46 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:50.657041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59689837-155b-4fba-9f7d-f30c005bba46 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:50.657368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59689837-155b-4fba-9f7d-f30c005bba46 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:50.687280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-59689837-155b-4fba-9f7d-f30c005bba46 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:44:51.103401 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-59689837-155b-4fba-9f7d-f30c005bba46 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 204 len: 0 microversion: 2.21 time: 0.460765 Oct 11 04:44:51.106357 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3279/6318] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:44:50 2022] DELETE /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:44:51.113505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:51.114255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:51.123207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:51.123809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:51.124384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:51.131025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:51.131733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:51.132466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:51.363463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:51.372631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:51.374464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:51.376225 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e482e9cb-45c6-4173-834a-32e22189ddd9 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1558 microversion: 2.21 time: 0.267771 Oct 11 04:44:51.376800 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3040/6319] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:51 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1558 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:52.403446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:52.411181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:52.411594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:52.412083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:52.412506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:52.413195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:52.413643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:52.414067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:52.617448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:52.629395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:52.632200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:52.637170 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-57e6f360-6609-4ad8-9233-dca7bb2cce39 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1558 microversion: 2.21 time: 0.235980 Oct 11 04:44:52.638745 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3280/6320] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:52 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1558 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:44:53.489500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-0c8a59d0-5c26-4a09-acaa-36057d4a9b21 req-783b2250-ea64-4897-8335-5cd7bc3342f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be93a956-4e95-467a-84df-14936ec35200", "name": "network-vif-deleted", "tag": "19e27e71-e7ed-482b-a103-28cc90ed2a87"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:44:53.502686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0c8a59d0-5c26-4a09-acaa-36057d4a9b21 req-783b2250-ea64-4897-8335-5cd7bc3342f6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:53.503433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0c8a59d0-5c26-4a09-acaa-36057d4a9b21 req-783b2250-ea64-4897-8335-5cd7bc3342f6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:53.504032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0c8a59d0-5c26-4a09-acaa-36057d4a9b21 req-783b2250-ea64-4897-8335-5cd7bc3342f6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:53.522287 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-0c8a59d0-5c26-4a09-acaa-36057d4a9b21 req-783b2250-ea64-4897-8335-5cd7bc3342f6 service nova] Creating event network-vif-deleted:19e27e71-e7ed-482b-a103-28cc90ed2a87 for instance be93a956-4e95-467a-84df-14936ec35200 on n-h2-860892-1 Oct 11 04:44:53.529907 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-0c8a59d0-5c26-4a09-acaa-36057d4a9b21 req-783b2250-ea64-4897-8335-5cd7bc3342f6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042504 Oct 11 04:44:53.529907 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3041/6321] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:44:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:44:53.663325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:53.664523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:53.672039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:53.672585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:53.673029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:53.673720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:53.674414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:53.675017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:53.758312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:53.767831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:53.771714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '517218d0618e41a0829603df6f769d74', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5aa14702fc44954aadb1e3f7ffa5c5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:44:53.771714 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff5376e2-87a9-4769-b6e8-5a0fc5f248f6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 200 len: 1344 microversion: 2.21 time: 0.111413 Oct 11 04:44:53.771714 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3281/6322] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:53 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 1344 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:44:54.824922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:54.825744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:54.833961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:54.834509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:54.835334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:54.836374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:54.837023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:54.837463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:54.854934 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] HTTP exception thrown: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Request method failure captured: Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 HTTP/1.1 Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPSvFUbLIiP6ewfwbp5rhVvlgFR7_D6GcxfQQbgrIMFwHt0TvjEgumDXuCLN2y6Cw0qO-cSytZ2p6N-KqH1IUliZEUefYlGXPdqaCiWrlcRkIXytMFilzMyCtqcBMvMsLC0Ugn9sxWISoUFmK8_pP2qqjagPUt57dcWUyhpAHbXzkmI Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d5aa14702fc44954aadb1e3f7ffa5c5f Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1973096552 Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d5aa14702fc44954aadb1e3f7ffa5c5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d5aa14702fc44954aadb1e3f7ffa5c5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d5aa14702fc44954aadb1e3f7ffa5c5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d5aa14702fc44954aadb1e3f7ffa5c5f"}]}] Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-InstanceActionsV221TestJSON-1973096552 Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d5aa14702fc44954aadb1e3f7ffa5c5f Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1973096552 Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-InstanceActionsV221TestJSON-1973096552-project Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 517218d0618e41a0829603df6f769d74 Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-InstanceActionsV221TestJSON-1973096552-project Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'be93a956-4e95-467a-84df-14936ec35200'} Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:54.857329 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:54.864096 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:54.864096 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:54.864096 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:54.864096 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:54.864096 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:54.864096 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:54.864096 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:54.864096 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:54.865991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Returning 404 to user: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:54.866919 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8220bcfa-6987-40b8-925a-4790178559fa tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 404 len: 111 microversion: 2.21 time: 0.074712 Oct 11 04:44:54.867524 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3042/6323] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:54 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:44:54.885999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e30c86d9-1964-4eeb-a4ad-e80271390378 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '.version_select at 0x7fda193cc310>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:54.887216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e30c86d9-1964-4eeb-a4ad-e80271390378 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:54.900155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c86d9-1964-4eeb-a4ad-e80271390378 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:54.900916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c86d9-1964-4eeb-a4ad-e80271390378 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:54.901791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c86d9-1964-4eeb-a4ad-e80271390378 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:54.903094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c86d9-1964-4eeb-a4ad-e80271390378 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:54.905066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c86d9-1964-4eeb-a4ad-e80271390378 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:54.905623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e30c86d9-1964-4eeb-a4ad-e80271390378 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:55.017812 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e30c86d9-1964-4eeb-a4ad-e80271390378 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200/os-instance-actions" status: 200 len: 611 microversion: 2.21 time: 0.144461 Oct 11 04:44:55.029074 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3282/6324] 10.222.0.26 () {60 vars in 1337 bytes} [Tue Oct 11 04:44:54 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200/os-instance-actions => generated 611 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:44:55.032624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:55.033133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:55.042921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:55.044168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:55.044586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:55.045802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:55.046281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:55.046705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:55.062212 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] HTTP exception thrown: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Request method failure captured: Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 HTTP/1.1 Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPSvFUbLIiP6ewfwbp5rhVvlgFR7_D6GcxfQQbgrIMFwHt0TvjEgumDXuCLN2y6Cw0qO-cSytZ2p6N-KqH1IUliZEUefYlGXPdqaCiWrlcRkIXytMFilzMyCtqcBMvMsLC0Ugn9sxWISoUFmK8_pP2qqjagPUt57dcWUyhpAHbXzkmI Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: d5aa14702fc44954aadb1e3f7ffa5c5f Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1973096552 Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d5aa14702fc44954aadb1e3f7ffa5c5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d5aa14702fc44954aadb1e3f7ffa5c5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d5aa14702fc44954aadb1e3f7ffa5c5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d5aa14702fc44954aadb1e3f7ffa5c5f"}]}] Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-InstanceActionsV221TestJSON-1973096552 Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: d5aa14702fc44954aadb1e3f7ffa5c5f Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1973096552 Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-InstanceActionsV221TestJSON-1973096552-project Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 517218d0618e41a0829603df6f769d74 Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-InstanceActionsV221TestJSON-1973096552-project Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'be93a956-4e95-467a-84df-14936ec35200'} Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:55.063947 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Returning 404 to user: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5c048e47-302f-459e-9f46-5b341697ab63 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "DELETE /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 404 len: 111 microversion: 2.21 time: 0.037333 Oct 11 04:44:55.076569 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3043/6325] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:44:55 2022] DELETE /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:44:55.080466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:44:55.081086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] [instance: be93a956-4e95-467a-84df-14936ec35200] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:44:55.087350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:55.087900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:55.088405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:55.089130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:44:55.089618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:44:55.092300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:44:55.104693 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] HTTP exception thrown: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Request method failure captured: Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 HTTP/1.1 Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPSvFUbLIiP6ewfwbp5rhVvlgFR7_D6GcxfQQbgrIMFwHt0TvjEgumDXuCLN2y6Cw0qO-cSytZ2p6N-KqH1IUliZEUefYlGXPdqaCiWrlcRkIXytMFilzMyCtqcBMvMsLC0Ugn9sxWISoUFmK8_pP2qqjagPUt57dcWUyhpAHbXzkmI Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.21 Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: d5aa14702fc44954aadb1e3f7ffa5c5f Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-InstanceActionsV221TestJSON-1973096552 Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d5aa14702fc44954aadb1e3f7ffa5c5f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d5aa14702fc44954aadb1e3f7ffa5c5f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d5aa14702fc44954aadb1e3f7ffa5c5f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d5aa14702fc44954aadb1e3f7ffa5c5f"}]}] Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-InstanceActionsV221TestJSON-1973096552 Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: d5aa14702fc44954aadb1e3f7ffa5c5f Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-InstanceActionsV221TestJSON-1973096552 Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-InstanceActionsV221TestJSON-1973096552-project Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 517218d0618e41a0829603df6f769d74 Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-InstanceActionsV221TestJSON-1973096552-project Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'be93a956-4e95-467a-84df-14936ec35200'} Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:55.106460 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:44:55.113957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:55.113957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:44:55.113957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:44:55.113957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:44:55.113957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:44:55.113957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:44:55.113957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. Oct 11 04:44:55.113957 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:44:55.113957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] Returning 404 to user: Instance be93a956-4e95-467a-84df-14936ec35200 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:44:55.113957 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-88d77fb3-c65b-442c-87a5-f89b4ca808b6 tempest-InstanceActionsV221TestJSON-1973096552 tempest-InstanceActionsV221TestJSON-1973096552-project] 10.222.0.26 "GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200" status: 404 len: 111 microversion: 2.21 time: 0.031582 Oct 11 04:44:55.113957 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3283/6326] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:44:55 2022] GET /compute/v2.1/servers/be93a956-4e95-467a-84df-14936ec35200 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:45:10.719146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=13 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:10.719978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=54 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:10.853928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7299c479-890d-4baf-b389-28283c55425d tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] Action: 'create', calling method: .version_select at 0x7fda19bc5af0>, body: {"server_group": {"name": "server-group", "policy": "affinity"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:45:10.871859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-7299c479-890d-4baf-b389-28283c55425d tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] Getting quotas for project 0e2f1c90e7834c33ba4bac71b50e784f. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:45:10.877515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-7299c479-890d-4baf-b389-28283c55425d tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] Getting quotas for user 9e8cb211bbd74ccdada6b2604fa72682 and project 0e2f1c90e7834c33ba4bac71b50e784f. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:45:11.062908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-7299c479-890d-4baf-b389-28283c55425d tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] Getting quotas for project 0e2f1c90e7834c33ba4bac71b50e784f. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:45:11.068023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-7299c479-890d-4baf-b389-28283c55425d tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] Getting quotas for user 9e8cb211bbd74ccdada6b2604fa72682 and project 0e2f1c90e7834c33ba4bac71b50e784f. Resources: {'server_groups'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:45:11.082648 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7299c479-890d-4baf-b389-28283c55425d tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] 10.222.0.26 "POST /compute/v2.1/os-server-groups" status: 200 len: 235 microversion: 2.64 time: 0.368756 Oct 11 04:45:11.083249 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3044/6327] 10.222.0.26 () {62 vars in 1214 bytes} [Tue Oct 11 04:45:10 2022] POST /compute/v2.1/os-server-groups => generated 235 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:45:11.094512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31eb4b1e-7144-42d4-b851-23340e0077d1 tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:11.105628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:11.105628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:11.110627 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31eb4b1e-7144-42d4-b851-23340e0077d1 tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups" status: 200 len: 238 microversion: 2.64 time: 0.020094 Oct 11 04:45:11.111424 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3284/6328] 10.222.0.26 () {60 vars in 1193 bytes} [Tue Oct 11 04:45:11 2022] GET /compute/v2.1/os-server-groups => generated 238 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:45:11.123801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-353c9e32-d921-41c9-bbfe-f2fb36f58aea tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:11.138179 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-353c9e32-d921-41c9-bbfe-f2fb36f58aea tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] 10.222.0.26 "GET /compute/v2.1/os-server-groups/a2f536d8-580a-41dd-bcf5-b44b546a1aec" status: 200 len: 235 microversion: 2.64 time: 0.019199 Oct 11 04:45:11.145337 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3045/6329] 10.222.0.26 () {60 vars in 1304 bytes} [Tue Oct 11 04:45:11 2022] GET /compute/v2.1/os-server-groups/a2f536d8-580a-41dd-bcf5-b44b546a1aec => generated 235 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:45:11.153357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dc3f1fb3-b824-4fea-8f88-05d490e1d17a tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:11.387849 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dc3f1fb3-b824-4fea-8f88-05d490e1d17a tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/a2f536d8-580a-41dd-bcf5-b44b546a1aec" status: 204 len: 0 microversion: 2.64 time: 0.240126 Oct 11 04:45:11.388563 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3285/6330] 10.222.0.26 () {60 vars in 1307 bytes} [Tue Oct 11 04:45:11 2022] DELETE /compute/v2.1/os-server-groups/a2f536d8-580a-41dd-bcf5-b44b546a1aec => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:45:11.398249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d95a828b-8512-4f1d-b282-b4ff508aeee4 tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:11.405110 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d95a828b-8512-4f1d-b282-b4ff508aeee4 tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] HTTP exception thrown: Instance group a2f536d8-580a-41dd-bcf5-b44b546a1aec could not be found. Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d95a828b-8512-4f1d-b282-b4ff508aeee4 tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] Request method failure captured: Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/os-server-groups/a2f536d8-580a-41dd-bcf5-b44b546a1aec HTTP/1.1 Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPTWg858941GUEliNpaTk-6IDobb3t6IM_Iag2OyE110otpqq8n7hUXIRzeF9gbI-TS8lTs03dg2X_Q5MQ5ceynGoZrT52dIAvqfXnN5QH0C80gTGXqEozeUGdjzMnDnijYZo0yTcyNBeIh8j6URroDHC8MLv1Z7lywusd2Yt2JZq3U Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.64 Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 0e2f1c90e7834c33ba4bac71b50e784f Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerGroup264TestJSON-1903138826 Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0e2f1c90e7834c33ba4bac71b50e784f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0e2f1c90e7834c33ba4bac71b50e784f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0e2f1c90e7834c33ba4bac71b50e784f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0e2f1c90e7834c33ba4bac71b50e784f"}]}] Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerGroup264TestJSON-1903138826 Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 0e2f1c90e7834c33ba4bac71b50e784f Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerGroup264TestJSON-1903138826 Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerGroup264TestJSON-1903138826-project Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 9e8cb211bbd74ccdada6b2604fa72682 Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerGroup264TestJSON-1903138826-project Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance group a2f536d8-580a-41dd-bcf5-b44b546a1aec could not be found. Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'a2f536d8-580a-41dd-bcf5-b44b546a1aec'} Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 139, in delete Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi sg = objects.InstanceGroup.get_by_uuid(context, id) Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 373, in get_by_uuid Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_group = cls._get_from_db_by_uuid(context, uuid) Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1010, in wrapper Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return fn(*args, **kwargs) Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/instance_group.py", line 228, in _get_from_db_by_uuid Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceGroupNotFound(group_uuid=uuid) Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceGroupNotFound: Instance group a2f536d8-580a-41dd-bcf5-b44b546a1aec could not be found. Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/server_groups.py", line 141, in delete Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance group a2f536d8-580a-41dd-bcf5-b44b546a1aec could not be found. Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:11.406713 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:11.411414 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:45:11.411414 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:45:11.411414 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:45:11.411414 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:45:11.411414 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance group a2f536d8-580a-41dd-bcf5-b44b546a1aec could not be found. Oct 11 04:45:11.411414 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:11.411414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d95a828b-8512-4f1d-b282-b4ff508aeee4 tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] Returning 404 to user: Instance group a2f536d8-580a-41dd-bcf5-b44b546a1aec could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:45:11.411414 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d95a828b-8512-4f1d-b282-b4ff508aeee4 tempest-ServerGroup264TestJSON-1903138826 tempest-ServerGroup264TestJSON-1903138826-project] 10.222.0.26 "DELETE /compute/v2.1/os-server-groups/a2f536d8-580a-41dd-bcf5-b44b546a1aec" status: 404 len: 117 microversion: 2.64 time: 0.014259 Oct 11 04:45:11.411414 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3046/6331] 10.222.0.26 () {60 vars in 1307 bytes} [Tue Oct 11 04:45:11 2022] DELETE /compute/v2.1/os-server-groups/a2f536d8-580a-41dd-bcf5-b44b546a1aec => generated 117 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:45:26.210364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-358193104", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:45:26.300291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] validate_networks() for [('ffe9fdce-3fd4-4eef-95dd-c03e9808bf86', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:45:26.792341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:45:26.792762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:45:26.793241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:45:26.793657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:45:26.794106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:45:26.803870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:26.804359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:26.804809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:26.805527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:26.805980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:26.806439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:26.824974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Getting quotas for project 86019ef4f0ae45228aa7ede8079c2dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:45:26.830699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Getting quotas for user 0539f747d9024059876461607f48c0a5 and project 86019ef4f0ae45228aa7ede8079c2dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:45:26.844539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:45:26.846924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:45:26.999616 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b0f75ad7-e7b8-41a8-8d00-79550437ff11 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.932386 Oct 11 04:45:27.001172 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3286/6332] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:45:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:45:27.013399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-995437bb-185e-4491-9bc5-ffee17590fc3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:27.014018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-995437bb-185e-4491-9bc5-ffee17590fc3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:27.016978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:27.173531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-995437bb-185e-4491-9bc5-ffee17590fc3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:27.183764 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-995437bb-185e-4491-9bc5-ffee17590fc3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1213 microversion: 2.1 time: 0.174523 Oct 11 04:45:27.185142 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3047/6333] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:27 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1213 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:28.210687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dd3b59d1-870e-4d58-953b-fd680c8dd60f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:28.211445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dd3b59d1-870e-4d58-953b-fd680c8dd60f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:28.358114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dd3b59d1-870e-4d58-953b-fd680c8dd60f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:28.365724 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dd3b59d1-870e-4d58-953b-fd680c8dd60f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1213 microversion: 2.1 time: 0.159612 Oct 11 04:45:28.369100 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3287/6334] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:28 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1213 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:29.400270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f514daa4-2d27-4a70-9b5d-1a753ad53eb1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:29.400782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f514daa4-2d27-4a70-9b5d-1a753ad53eb1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:29.414973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f514daa4-2d27-4a70-9b5d-1a753ad53eb1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:29.424866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f514daa4-2d27-4a70-9b5d-1a753ad53eb1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:29.425441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f514daa4-2d27-4a70-9b5d-1a753ad53eb1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:29.426388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f514daa4-2d27-4a70-9b5d-1a753ad53eb1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:29.426725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f514daa4-2d27-4a70-9b5d-1a753ad53eb1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:29.427159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f514daa4-2d27-4a70-9b5d-1a753ad53eb1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:29.525882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f514daa4-2d27-4a70-9b5d-1a753ad53eb1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:29.543291 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f514daa4-2d27-4a70-9b5d-1a753ad53eb1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1209 microversion: 2.1 time: 0.148241 Oct 11 04:45:29.544872 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3048/6335] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:29 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1209 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:30.568794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eff5b69c-b648-4ac6-abf6-731118533fc0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:30.569981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eff5b69c-b648-4ac6-abf6-731118533fc0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:30.585768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff5b69c-b648-4ac6-abf6-731118533fc0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:30.586806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff5b69c-b648-4ac6-abf6-731118533fc0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:30.587616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff5b69c-b648-4ac6-abf6-731118533fc0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:30.588551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff5b69c-b648-4ac6-abf6-731118533fc0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:30.589246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff5b69c-b648-4ac6-abf6-731118533fc0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:30.589878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eff5b69c-b648-4ac6-abf6-731118533fc0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:30.692035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eff5b69c-b648-4ac6-abf6-731118533fc0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:30.700247 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eff5b69c-b648-4ac6-abf6-731118533fc0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1273 microversion: 2.1 time: 0.136486 Oct 11 04:45:30.702412 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3288/6336] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:30 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1273 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:45:31.732205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46af58a7-46e2-4098-a431-6b282598131d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:31.732205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-46af58a7-46e2-4098-a431-6b282598131d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:31.735418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46af58a7-46e2-4098-a431-6b282598131d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:31.735905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46af58a7-46e2-4098-a431-6b282598131d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:31.736347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46af58a7-46e2-4098-a431-6b282598131d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:31.737069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46af58a7-46e2-4098-a431-6b282598131d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:31.737529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46af58a7-46e2-4098-a431-6b282598131d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:31.737968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46af58a7-46e2-4098-a431-6b282598131d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:32.017712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-46af58a7-46e2-4098-a431-6b282598131d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:32.026894 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-46af58a7-46e2-4098-a431-6b282598131d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1313 microversion: 2.1 time: 0.302928 Oct 11 04:45:32.027790 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3049/6337] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:31 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1313 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:33.002470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6bb408dd-1c1b-4ce6-80dd-598c7145a4cc req-e4f05d6c-c1f0-4d55-91c0-7c1e90342853 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca", "tag": "f6eeffc5-7644-4587-8a4f-40ce1795af46"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:45:33.015841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6bb408dd-1c1b-4ce6-80dd-598c7145a4cc req-e4f05d6c-c1f0-4d55-91c0-7c1e90342853 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:33.016369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6bb408dd-1c1b-4ce6-80dd-598c7145a4cc req-e4f05d6c-c1f0-4d55-91c0-7c1e90342853 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:33.020728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6bb408dd-1c1b-4ce6-80dd-598c7145a4cc req-e4f05d6c-c1f0-4d55-91c0-7c1e90342853 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:33.038085 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6bb408dd-1c1b-4ce6-80dd-598c7145a4cc req-e4f05d6c-c1f0-4d55-91c0-7c1e90342853 service nova] Creating event network-changed:f6eeffc5-7644-4587-8a4f-40ce1795af46 for instance fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca on n-h2-860892-1 Oct 11 04:45:33.045054 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6bb408dd-1c1b-4ce6-80dd-598c7145a4cc req-e4f05d6c-c1f0-4d55-91c0-7c1e90342853 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052126 Oct 11 04:45:33.046471 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3289/6338] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:45:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:45:33.055406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b31066fb-0f2f-4dfc-8710-63831192056f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:33.055406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b31066fb-0f2f-4dfc-8710-63831192056f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:33.067937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b31066fb-0f2f-4dfc-8710-63831192056f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:33.068440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b31066fb-0f2f-4dfc-8710-63831192056f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:33.068881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b31066fb-0f2f-4dfc-8710-63831192056f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:33.070453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b31066fb-0f2f-4dfc-8710-63831192056f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:33.071672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b31066fb-0f2f-4dfc-8710-63831192056f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:33.072292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b31066fb-0f2f-4dfc-8710-63831192056f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:33.331968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b31066fb-0f2f-4dfc-8710-63831192056f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:33.336063 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b31066fb-0f2f-4dfc-8710-63831192056f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1313 microversion: 2.1 time: 0.286898 Oct 11 04:45:33.349342 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3050/6339] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:33 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1313 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:34.363417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-483f558f-9263-4ee1-96a9-b32516329156 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:34.364412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-483f558f-9263-4ee1-96a9-b32516329156 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:34.376266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-483f558f-9263-4ee1-96a9-b32516329156 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:34.376752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-483f558f-9263-4ee1-96a9-b32516329156 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:34.377187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-483f558f-9263-4ee1-96a9-b32516329156 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:34.378128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-483f558f-9263-4ee1-96a9-b32516329156 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:34.378609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-483f558f-9263-4ee1-96a9-b32516329156 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:34.379084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-483f558f-9263-4ee1-96a9-b32516329156 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:34.698810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-483f558f-9263-4ee1-96a9-b32516329156 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:34.707140 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-483f558f-9263-4ee1-96a9-b32516329156 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1313 microversion: 2.1 time: 0.348859 Oct 11 04:45:34.707760 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3290/6340] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:34 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:35.729333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1212f847-b08e-4348-a16d-454b191646c6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:35.730054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1212f847-b08e-4348-a16d-454b191646c6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:35.737810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1212f847-b08e-4348-a16d-454b191646c6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:35.738350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1212f847-b08e-4348-a16d-454b191646c6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:35.738794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1212f847-b08e-4348-a16d-454b191646c6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:35.739493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1212f847-b08e-4348-a16d-454b191646c6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:35.739952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1212f847-b08e-4348-a16d-454b191646c6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:35.740380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1212f847-b08e-4348-a16d-454b191646c6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:35.880612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1212f847-b08e-4348-a16d-454b191646c6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:35.889209 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1212f847-b08e-4348-a16d-454b191646c6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1313 microversion: 2.1 time: 0.164159 Oct 11 04:45:35.890206 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3051/6341] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:35 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:36.798565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1119531443", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:45:36.818092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:36.857543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:45:36.912238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6a0e58f7-7f64-46f9-8f66-ad3fb9459149 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:36.912859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6a0e58f7-7f64-46f9-8f66-ad3fb9459149 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:36.920248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a0e58f7-7f64-46f9-8f66-ad3fb9459149 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:36.920736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a0e58f7-7f64-46f9-8f66-ad3fb9459149 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:36.921176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a0e58f7-7f64-46f9-8f66-ad3fb9459149 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:36.921867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a0e58f7-7f64-46f9-8f66-ad3fb9459149 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:36.922363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a0e58f7-7f64-46f9-8f66-ad3fb9459149 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:36.922795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a0e58f7-7f64-46f9-8f66-ad3fb9459149 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:37.067993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6a0e58f7-7f64-46f9-8f66-ad3fb9459149 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:37.077269 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6a0e58f7-7f64-46f9-8f66-ad3fb9459149 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1313 microversion: 2.1 time: 0.168766 Oct 11 04:45:37.077852 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3052/6342] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:36 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:45:37.159690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:45:37.160199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:45:37.160579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:45:37.160989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:45:37.161488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:45:37.171567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:37.172056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:37.172496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:37.175314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:37.175314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:37.175314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:37.192723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Getting quotas for project c9aadc7d8e6f41429585e35b87e12436. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:45:37.202840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Getting quotas for user 6ac06f41fef54f8183536266179b3b3a and project c9aadc7d8e6f41429585e35b87e12436. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:45:37.211285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:45:37.213605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:45:37.553217 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c71d9adf-d6cb-4598-988b-e553fac0766c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.758722 Oct 11 04:45:37.560458 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3291/6343] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:45:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 760 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:45:37.566511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-37616c18-04d9-4363-8fc6-00a1e8e8c111 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:37.567296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-37616c18-04d9-4363-8fc6-00a1e8e8c111 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:37.635059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-37616c18-04d9-4363-8fc6-00a1e8e8c111 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:37.644245 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-37616c18-04d9-4363-8fc6-00a1e8e8c111 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1215 microversion: 2.1 time: 0.082336 Oct 11 04:45:37.645744 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3053/6344] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:37 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:38.104176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0c509eca-afc8-42e6-b437-a7897e6ef784 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:38.105295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0c509eca-afc8-42e6-b437-a7897e6ef784 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:38.115431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c509eca-afc8-42e6-b437-a7897e6ef784 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:38.116788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c509eca-afc8-42e6-b437-a7897e6ef784 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:38.117457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c509eca-afc8-42e6-b437-a7897e6ef784 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:38.118527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c509eca-afc8-42e6-b437-a7897e6ef784 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:38.119290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c509eca-afc8-42e6-b437-a7897e6ef784 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:38.119940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c509eca-afc8-42e6-b437-a7897e6ef784 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:38.265344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0c509eca-afc8-42e6-b437-a7897e6ef784 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:38.274282 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0c509eca-afc8-42e6-b437-a7897e6ef784 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1313 microversion: 2.1 time: 0.177684 Oct 11 04:45:38.282642 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3292/6345] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:38 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1313 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:38.667912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fdf18065-c5bd-4f26-a7f3-839fca3412a6 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:38.668503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fdf18065-c5bd-4f26-a7f3-839fca3412a6 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:38.722034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fdf18065-c5bd-4f26-a7f3-839fca3412a6 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:38.728925 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fdf18065-c5bd-4f26-a7f3-839fca3412a6 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1215 microversion: 2.1 time: 0.065302 Oct 11 04:45:38.729483 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3054/6346] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:38 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1215 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:39.297007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5343c2dc-c073-45e7-a772-b4876d13f8b6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:39.297691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5343c2dc-c073-45e7-a772-b4876d13f8b6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:39.304493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5343c2dc-c073-45e7-a772-b4876d13f8b6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:39.305046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5343c2dc-c073-45e7-a772-b4876d13f8b6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:39.305565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5343c2dc-c073-45e7-a772-b4876d13f8b6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:39.306334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5343c2dc-c073-45e7-a772-b4876d13f8b6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:39.306850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5343c2dc-c073-45e7-a772-b4876d13f8b6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:39.307278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5343c2dc-c073-45e7-a772-b4876d13f8b6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:39.447551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5343c2dc-c073-45e7-a772-b4876d13f8b6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:39.456018 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5343c2dc-c073-45e7-a772-b4876d13f8b6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1313 microversion: 2.1 time: 0.162787 Oct 11 04:45:39.456634 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3293/6347] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:39 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:39.753662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b1d0bea-26bf-4bfc-96c0-a91651e224f4 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:39.754447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0b1d0bea-26bf-4bfc-96c0-a91651e224f4 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:39.761290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b1d0bea-26bf-4bfc-96c0-a91651e224f4 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:39.761764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b1d0bea-26bf-4bfc-96c0-a91651e224f4 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:39.762259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b1d0bea-26bf-4bfc-96c0-a91651e224f4 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:39.763706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b1d0bea-26bf-4bfc-96c0-a91651e224f4 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:39.764171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b1d0bea-26bf-4bfc-96c0-a91651e224f4 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:39.764605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b1d0bea-26bf-4bfc-96c0-a91651e224f4 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:39.830323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b1d0bea-26bf-4bfc-96c0-a91651e224f4 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:39.838133 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0b1d0bea-26bf-4bfc-96c0-a91651e224f4 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1267 microversion: 2.1 time: 0.088678 Oct 11 04:45:39.838729 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3055/6348] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:39 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:40.329646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6e8f4a50-781d-4cd2-930c-697184637924 req-2987b42a-e5c4-4835-9360-c3d41127e735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca", "name": "network-vif-plugged", "status": "completed", "tag": "f6eeffc5-7644-4587-8a4f-40ce1795af46"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:45:40.342459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6e8f4a50-781d-4cd2-930c-697184637924 req-2987b42a-e5c4-4835-9360-c3d41127e735 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:40.342459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6e8f4a50-781d-4cd2-930c-697184637924 req-2987b42a-e5c4-4835-9360-c3d41127e735 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:40.342459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6e8f4a50-781d-4cd2-930c-697184637924 req-2987b42a-e5c4-4835-9360-c3d41127e735 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:40.353377 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6e8f4a50-781d-4cd2-930c-697184637924 req-2987b42a-e5c4-4835-9360-c3d41127e735 service nova] Creating event network-vif-plugged:f6eeffc5-7644-4587-8a4f-40ce1795af46 for instance fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca on n-h2-860892-1 Oct 11 04:45:40.358554 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6e8f4a50-781d-4cd2-930c-697184637924 req-2987b42a-e5c4-4835-9360-c3d41127e735 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033086 Oct 11 04:45:40.359210 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3294/6349] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:45:40.480215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eb58e7ef-9964-4780-9b97-5167ad102688 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:40.481871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eb58e7ef-9964-4780-9b97-5167ad102688 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:40.488643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb58e7ef-9964-4780-9b97-5167ad102688 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:40.489372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb58e7ef-9964-4780-9b97-5167ad102688 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:40.490046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb58e7ef-9964-4780-9b97-5167ad102688 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:40.490760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb58e7ef-9964-4780-9b97-5167ad102688 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:40.491383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb58e7ef-9964-4780-9b97-5167ad102688 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:40.491979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eb58e7ef-9964-4780-9b97-5167ad102688 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:40.868530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8949883d-eb11-49f8-9dd7-50ae94b165d2 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:40.869273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8949883d-eb11-49f8-9dd7-50ae94b165d2 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:40.876172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8949883d-eb11-49f8-9dd7-50ae94b165d2 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:40.876660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8949883d-eb11-49f8-9dd7-50ae94b165d2 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:40.877102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8949883d-eb11-49f8-9dd7-50ae94b165d2 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:40.877803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8949883d-eb11-49f8-9dd7-50ae94b165d2 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:40.878977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8949883d-eb11-49f8-9dd7-50ae94b165d2 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:40.879882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8949883d-eb11-49f8-9dd7-50ae94b165d2 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:40.901166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eb58e7ef-9964-4780-9b97-5167ad102688 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:40.912909 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eb58e7ef-9964-4780-9b97-5167ad102688 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1313 microversion: 2.1 time: 0.436514 Oct 11 04:45:40.913566 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3056/6350] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:40 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1313 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:40.959354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8949883d-eb11-49f8-9dd7-50ae94b165d2 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:40.969443 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8949883d-eb11-49f8-9dd7-50ae94b165d2 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1273 microversion: 2.1 time: 0.105179 Oct 11 04:45:40.970355 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3295/6351] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:40 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1273 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:45:41.938282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-47cfd406-94e0-4c35-99fd-2b9f292a2742 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:41.939700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-47cfd406-94e0-4c35-99fd-2b9f292a2742 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:41.946542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47cfd406-94e0-4c35-99fd-2b9f292a2742 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:41.947184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47cfd406-94e0-4c35-99fd-2b9f292a2742 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:41.948942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47cfd406-94e0-4c35-99fd-2b9f292a2742 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:41.949708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47cfd406-94e0-4c35-99fd-2b9f292a2742 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:41.950744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47cfd406-94e0-4c35-99fd-2b9f292a2742 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:41.951383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47cfd406-94e0-4c35-99fd-2b9f292a2742 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:41.995746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dfc9b9c8-f5cc-4ee2-9c83-db80e010cc67 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:41.996369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dfc9b9c8-f5cc-4ee2-9c83-db80e010cc67 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:42.005121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc9b9c8-f5cc-4ee2-9c83-db80e010cc67 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:42.005954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc9b9c8-f5cc-4ee2-9c83-db80e010cc67 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:42.006432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc9b9c8-f5cc-4ee2-9c83-db80e010cc67 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:42.007132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc9b9c8-f5cc-4ee2-9c83-db80e010cc67 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:42.007816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc9b9c8-f5cc-4ee2-9c83-db80e010cc67 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:42.008413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfc9b9c8-f5cc-4ee2-9c83-db80e010cc67 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:42.166523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dfc9b9c8-f5cc-4ee2-9c83-db80e010cc67 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:42.187170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-47cfd406-94e0-4c35-99fd-2b9f292a2742 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:42.200058 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dfc9b9c8-f5cc-4ee2-9c83-db80e010cc67 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1315 microversion: 2.1 time: 0.209845 Oct 11 04:45:42.200671 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3296/6352] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:41 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:45:42.202317 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-47cfd406-94e0-4c35-99fd-2b9f292a2742 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1500 microversion: 2.1 time: 0.269644 Oct 11 04:45:42.202952 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3057/6353] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:41 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1500 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:42.240886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36a1b7de-27d4-4e8f-96c0-28dcdd3d5f7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:45:42.243630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-36a1b7de-27d4-4e8f-96c0-28dcdd3d5f7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:42.250624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36a1b7de-27d4-4e8f-96c0-28dcdd3d5f7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:42.252954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36a1b7de-27d4-4e8f-96c0-28dcdd3d5f7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:42.252954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36a1b7de-27d4-4e8f-96c0-28dcdd3d5f7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:42.252954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36a1b7de-27d4-4e8f-96c0-28dcdd3d5f7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:42.252954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36a1b7de-27d4-4e8f-96c0-28dcdd3d5f7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:42.253456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36a1b7de-27d4-4e8f-96c0-28dcdd3d5f7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:42.279123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-36a1b7de-27d4-4e8f-96c0-28dcdd3d5f7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lazy-loading 'flavor' on Instance uuid fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:45:42.585223 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-36a1b7de-27d4-4e8f-96c0-28dcdd3d5f7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "POST /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca/action" status: 200 len: 32 microversion: 2.1 time: 0.349319 Oct 11 04:45:42.586110 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3297/6354] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:45:42 2022] POST /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca/action => generated 32 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:45:42.605326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ee6841dd-faaf-4bd8-8ba8-651f19f2da2a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:42.606120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ee6841dd-faaf-4bd8-8ba8-651f19f2da2a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:42.613095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee6841dd-faaf-4bd8-8ba8-651f19f2da2a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:42.613591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee6841dd-faaf-4bd8-8ba8-651f19f2da2a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:42.614035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee6841dd-faaf-4bd8-8ba8-651f19f2da2a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:42.614855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee6841dd-faaf-4bd8-8ba8-651f19f2da2a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:42.615510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee6841dd-faaf-4bd8-8ba8-651f19f2da2a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:42.615948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee6841dd-faaf-4bd8-8ba8-651f19f2da2a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:43.124831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-634a1b29-501f-4ba0-b64d-2857f6b0cf2e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:43.127134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-634a1b29-501f-4ba0-b64d-2857f6b0cf2e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:43.134534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-634a1b29-501f-4ba0-b64d-2857f6b0cf2e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:43.135114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-634a1b29-501f-4ba0-b64d-2857f6b0cf2e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:43.135554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-634a1b29-501f-4ba0-b64d-2857f6b0cf2e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:43.136261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-634a1b29-501f-4ba0-b64d-2857f6b0cf2e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:43.136709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-634a1b29-501f-4ba0-b64d-2857f6b0cf2e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:43.137132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-634a1b29-501f-4ba0-b64d-2857f6b0cf2e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:43.171984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-634a1b29-501f-4ba0-b64d-2857f6b0cf2e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053238 Oct 11 04:45:43.178653 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3298/6355] 10.222.0.26 () {60 vars in 1343 bytes} [Tue Oct 11 04:45:43 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:43.223084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-26a61ae2-da2a-4577-a476-ad1cb9d40307 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:43.223859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-26a61ae2-da2a-4577-a476-ad1cb9d40307 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:43.266894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26a61ae2-da2a-4577-a476-ad1cb9d40307 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:43.268509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26a61ae2-da2a-4577-a476-ad1cb9d40307 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:43.269144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26a61ae2-da2a-4577-a476-ad1cb9d40307 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:43.270633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26a61ae2-da2a-4577-a476-ad1cb9d40307 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:43.271318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26a61ae2-da2a-4577-a476-ad1cb9d40307 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:43.272167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-26a61ae2-da2a-4577-a476-ad1cb9d40307 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:43.310446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ee6841dd-faaf-4bd8-8ba8-651f19f2da2a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:43.339703 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ee6841dd-faaf-4bd8-8ba8-651f19f2da2a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.740247 Oct 11 04:45:43.343192 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3058/6356] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:42 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:43.354901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-54043def-186a-4705-88ea-50c9975a97f5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:43.356421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-54043def-186a-4705-88ea-50c9975a97f5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:43.370270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54043def-186a-4705-88ea-50c9975a97f5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:43.371049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54043def-186a-4705-88ea-50c9975a97f5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:43.372668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54043def-186a-4705-88ea-50c9975a97f5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:43.373916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54043def-186a-4705-88ea-50c9975a97f5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:43.374571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54043def-186a-4705-88ea-50c9975a97f5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:43.375163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54043def-186a-4705-88ea-50c9975a97f5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:43.408254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-54043def-186a-4705-88ea-50c9975a97f5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:45:43.469300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-26a61ae2-da2a-4577-a476-ad1cb9d40307 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:43.479737 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-26a61ae2-da2a-4577-a476-ad1cb9d40307 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1315 microversion: 2.1 time: 0.260640 Oct 11 04:45:43.497551 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3299/6357] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:43 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1315 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:45:43.503169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-17b5f165-9658-4128-a31f-4d3ecf4fe568 req-b9c430d0-5fed-420b-83d3-f159b75d2826 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ad579b9-91b9-4686-a1dc-a40895faa33b", "tag": "1b369f10-26b2-4ed9-bd87-46ec8e23cd8b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:45:43.519547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-17b5f165-9658-4128-a31f-4d3ecf4fe568 req-b9c430d0-5fed-420b-83d3-f159b75d2826 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:43.520542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-17b5f165-9658-4128-a31f-4d3ecf4fe568 req-b9c430d0-5fed-420b-83d3-f159b75d2826 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:43.521996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-17b5f165-9658-4128-a31f-4d3ecf4fe568 req-b9c430d0-5fed-420b-83d3-f159b75d2826 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:43.538983 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-17b5f165-9658-4128-a31f-4d3ecf4fe568 req-b9c430d0-5fed-420b-83d3-f159b75d2826 service nova] Creating event network-changed:1b369f10-26b2-4ed9-bd87-46ec8e23cd8b for instance 7ad579b9-91b9-4686-a1dc-a40895faa33b on n-h1-860892-1 Oct 11 04:45:43.544746 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-17b5f165-9658-4128-a31f-4d3ecf4fe568 req-b9c430d0-5fed-420b-83d3-f159b75d2826 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051579 Oct 11 04:45:43.545363 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3300/6358] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:45:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:45:43.788272 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-54043def-186a-4705-88ea-50c9975a97f5 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 204 len: 0 microversion: 2.20 time: 0.442864 Oct 11 04:45:43.790610 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3059/6359] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:45:43 2022] DELETE /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 0 bytes in 446 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:45:43.799876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:43.801100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:43.807815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:43.808316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:43.808763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:43.810089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:43.810613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:43.811228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:43.959010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:43.969094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:43.971635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:43.973456 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-245a71a6-e9f8-43a0-a681-63882dbc7e8e tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.177876 Oct 11 04:45:43.978230 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3301/6360] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:45:43 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:45:44.373687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f1dc502-f0b9-4d64-a98e-386db4bcaa65 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:44.373687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2f1dc502-f0b9-4d64-a98e-386db4bcaa65 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:44.376735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f1dc502-f0b9-4d64-a98e-386db4bcaa65 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:44.376735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f1dc502-f0b9-4d64-a98e-386db4bcaa65 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:44.376735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f1dc502-f0b9-4d64-a98e-386db4bcaa65 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:44.377585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f1dc502-f0b9-4d64-a98e-386db4bcaa65 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:44.378064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f1dc502-f0b9-4d64-a98e-386db4bcaa65 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:44.378413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f1dc502-f0b9-4d64-a98e-386db4bcaa65 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:44.503977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-77e960b0-a803-4ef4-8a25-64b1a06570ac tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:44.505404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-77e960b0-a803-4ef4-8a25-64b1a06570ac tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:44.512548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77e960b0-a803-4ef4-8a25-64b1a06570ac tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:44.513039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77e960b0-a803-4ef4-8a25-64b1a06570ac tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:44.513520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77e960b0-a803-4ef4-8a25-64b1a06570ac tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:44.514258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77e960b0-a803-4ef4-8a25-64b1a06570ac tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:44.514907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77e960b0-a803-4ef4-8a25-64b1a06570ac tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:44.515497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-77e960b0-a803-4ef4-8a25-64b1a06570ac tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:44.525345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f1dc502-f0b9-4d64-a98e-386db4bcaa65 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:44.534398 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f1dc502-f0b9-4d64-a98e-386db4bcaa65 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.170047 Oct 11 04:45:44.535216 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3060/6361] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:44 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:44.668731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-77e960b0-a803-4ef4-8a25-64b1a06570ac tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:44.676572 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-77e960b0-a803-4ef4-8a25-64b1a06570ac tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1315 microversion: 2.1 time: 0.176546 Oct 11 04:45:44.677138 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3302/6362] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:44 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:45:45.000869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:45.003213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:45.007998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:45.008483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:45.008925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:45.009619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:45.010073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:45.010525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:45.153037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:45.163736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:45.165496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:45.167054 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00af6a26-4014-4cc5-b1d6-e440ad31419a tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.170644 Oct 11 04:45:45.179595 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3061/6363] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:45:44 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:45:45.561055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d5779d5d-96b4-40aa-a096-23f22594c9e2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:45.561673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d5779d5d-96b4-40aa-a096-23f22594c9e2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:45.568675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5779d5d-96b4-40aa-a096-23f22594c9e2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:45.569161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5779d5d-96b4-40aa-a096-23f22594c9e2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:45.569595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5779d5d-96b4-40aa-a096-23f22594c9e2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:45.570323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5779d5d-96b4-40aa-a096-23f22594c9e2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:45.570962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5779d5d-96b4-40aa-a096-23f22594c9e2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:45.571389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5779d5d-96b4-40aa-a096-23f22594c9e2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:45.700507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-478d4b8e-9d1d-4035-9bbb-c761b0685ced tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:45.701115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-478d4b8e-9d1d-4035-9bbb-c761b0685ced tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:45.712024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478d4b8e-9d1d-4035-9bbb-c761b0685ced tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:45.712935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478d4b8e-9d1d-4035-9bbb-c761b0685ced tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:45.713733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478d4b8e-9d1d-4035-9bbb-c761b0685ced tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:45.714827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478d4b8e-9d1d-4035-9bbb-c761b0685ced tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:45.716192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478d4b8e-9d1d-4035-9bbb-c761b0685ced tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:45.717009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478d4b8e-9d1d-4035-9bbb-c761b0685ced tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:45.734527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d5779d5d-96b4-40aa-a096-23f22594c9e2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:45.743503 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d5779d5d-96b4-40aa-a096-23f22594c9e2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.186607 Oct 11 04:45:45.749518 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3303/6364] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:45 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:45.880530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-478d4b8e-9d1d-4035-9bbb-c761b0685ced tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:45.888813 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-478d4b8e-9d1d-4035-9bbb-c761b0685ced tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1315 microversion: 2.1 time: 0.192409 Oct 11 04:45:45.889406 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3062/6365] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:45 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:46.199372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:46.200640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:46.207287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:46.207769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:46.208202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:46.208931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:46.209377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:46.209798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:46.356235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:46.360033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:46.365424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:46.368252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:46.372505 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-879fa140-253b-4983-832b-32cec620d7a7 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.174636 Oct 11 04:45:46.372505 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3304/6366] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:45:46 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:45:46.766115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-141147cb-0b87-4f9a-a9d2-69e113349262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:46.767502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-141147cb-0b87-4f9a-a9d2-69e113349262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:46.775400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141147cb-0b87-4f9a-a9d2-69e113349262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:46.776269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141147cb-0b87-4f9a-a9d2-69e113349262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:46.785477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141147cb-0b87-4f9a-a9d2-69e113349262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:46.786739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141147cb-0b87-4f9a-a9d2-69e113349262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:46.787447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141147cb-0b87-4f9a-a9d2-69e113349262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:46.788106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-141147cb-0b87-4f9a-a9d2-69e113349262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:46.915969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bea36733-2bc7-486e-ac9f-36901d7f5569 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:46.918010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bea36733-2bc7-486e-ac9f-36901d7f5569 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:46.929163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bea36733-2bc7-486e-ac9f-36901d7f5569 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:46.930545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bea36733-2bc7-486e-ac9f-36901d7f5569 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:46.931335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bea36733-2bc7-486e-ac9f-36901d7f5569 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:46.933511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bea36733-2bc7-486e-ac9f-36901d7f5569 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:46.934935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bea36733-2bc7-486e-ac9f-36901d7f5569 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:46.936282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bea36733-2bc7-486e-ac9f-36901d7f5569 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:46.984797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-141147cb-0b87-4f9a-a9d2-69e113349262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:46.996476 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-141147cb-0b87-4f9a-a9d2-69e113349262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.234312 Oct 11 04:45:46.999109 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3063/6367] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:46 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:47.183542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:47.190434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bea36733-2bc7-486e-ac9f-36901d7f5569 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:47.203147 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bea36733-2bc7-486e-ac9f-36901d7f5569 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1315 microversion: 2.1 time: 0.294217 Oct 11 04:45:47.204027 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3305/6368] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:46 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1315 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:47.401152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:47.402812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:47.416510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:47.420062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:47.420874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:47.425640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:47.426455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:47.427092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:47.831795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:47.838105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:47.841172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:47.845967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:47.854854 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f4806e4e-e10c-4f3b-b05d-23891ebda552 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1721 microversion: 2.20 time: 0.461759 Oct 11 04:45:47.856132 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3064/6369] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:45:47 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1721 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:45:48.022232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7bb5b91c-4c1c-4dd3-8e2e-699cf2e24dc8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:48.024146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7bb5b91c-4c1c-4dd3-8e2e-699cf2e24dc8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:48.031528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=14 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:48.035611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bb5b91c-4c1c-4dd3-8e2e-699cf2e24dc8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:48.036776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bb5b91c-4c1c-4dd3-8e2e-699cf2e24dc8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:48.037438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bb5b91c-4c1c-4dd3-8e2e-699cf2e24dc8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:48.038407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bb5b91c-4c1c-4dd3-8e2e-699cf2e24dc8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:48.039080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bb5b91c-4c1c-4dd3-8e2e-699cf2e24dc8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:48.039703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bb5b91c-4c1c-4dd3-8e2e-699cf2e24dc8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:48.227122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b30ee47e-a190-4dad-9526-a93c536f17c0 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:48.228312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b30ee47e-a190-4dad-9526-a93c536f17c0 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:48.236618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b30ee47e-a190-4dad-9526-a93c536f17c0 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:48.237535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b30ee47e-a190-4dad-9526-a93c536f17c0 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:48.238252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b30ee47e-a190-4dad-9526-a93c536f17c0 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:48.243077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b30ee47e-a190-4dad-9526-a93c536f17c0 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:48.243794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b30ee47e-a190-4dad-9526-a93c536f17c0 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:48.244461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b30ee47e-a190-4dad-9526-a93c536f17c0 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:48.354447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7bb5b91c-4c1c-4dd3-8e2e-699cf2e24dc8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:48.364393 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7bb5b91c-4c1c-4dd3-8e2e-699cf2e24dc8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.346852 Oct 11 04:45:48.378223 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3306/6370] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:48 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:48.424489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b30ee47e-a190-4dad-9526-a93c536f17c0 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:48.435349 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b30ee47e-a190-4dad-9526-a93c536f17c0 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1315 microversion: 2.1 time: 0.210110 Oct 11 04:45:48.435349 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3065/6371] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:48 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1315 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:45:48.698426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-fdebc360-57db-4f82-a281-e1102fd8ffd5 req-5183b647-5376-40b0-9570-ba1b86b4d772 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f0fc2c3-6449-488b-8dc6-bf4db975a9ac", "name": "network-vif-deleted", "tag": "eb01f976-4613-4ae1-93ed-3abbf2f61aca"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:45:48.714415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fdebc360-57db-4f82-a281-e1102fd8ffd5 req-5183b647-5376-40b0-9570-ba1b86b4d772 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:48.715021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fdebc360-57db-4f82-a281-e1102fd8ffd5 req-5183b647-5376-40b0-9570-ba1b86b4d772 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:48.715491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fdebc360-57db-4f82-a281-e1102fd8ffd5 req-5183b647-5376-40b0-9570-ba1b86b4d772 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:48.729698 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-fdebc360-57db-4f82-a281-e1102fd8ffd5 req-5183b647-5376-40b0-9570-ba1b86b4d772 service nova] Creating event network-vif-deleted:eb01f976-4613-4ae1-93ed-3abbf2f61aca for instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac on n-h1-860892-1 Oct 11 04:45:48.737073 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-fdebc360-57db-4f82-a281-e1102fd8ffd5 req-5183b647-5376-40b0-9570-ba1b86b4d772 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042652 Oct 11 04:45:48.738275 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3307/6372] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:45:48.884477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:48.904318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:48.915554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:48.920346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:48.921000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:48.922542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:48.924491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:48.925229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:48.925892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:49.022354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:49.037098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:49.039972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:49.041971 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ac00a9b2-c290-4a3b-8453-541b45c31cb0 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1365 microversion: 2.20 time: 0.162566 Oct 11 04:45:49.043234 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3066/6373] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:45:48 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:45:49.391994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b8c997ef-e824-4717-88fd-4d9a8b9cd77f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:49.392694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b8c997ef-e824-4717-88fd-4d9a8b9cd77f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:49.404678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8c997ef-e824-4717-88fd-4d9a8b9cd77f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:49.407759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8c997ef-e824-4717-88fd-4d9a8b9cd77f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:49.408239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8c997ef-e824-4717-88fd-4d9a8b9cd77f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:49.408973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8c997ef-e824-4717-88fd-4d9a8b9cd77f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:49.409431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8c997ef-e824-4717-88fd-4d9a8b9cd77f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:49.409855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8c997ef-e824-4717-88fd-4d9a8b9cd77f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:49.467327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d9494a17-f37b-4f13-b63d-685a742503fd tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:49.469096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d9494a17-f37b-4f13-b63d-685a742503fd tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:49.507272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9494a17-f37b-4f13-b63d-685a742503fd tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:49.508568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9494a17-f37b-4f13-b63d-685a742503fd tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:49.509167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9494a17-f37b-4f13-b63d-685a742503fd tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:49.510167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9494a17-f37b-4f13-b63d-685a742503fd tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:49.510799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9494a17-f37b-4f13-b63d-685a742503fd tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:49.511378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9494a17-f37b-4f13-b63d-685a742503fd tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:49.700224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b8c997ef-e824-4717-88fd-4d9a8b9cd77f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:49.709894 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b8c997ef-e824-4717-88fd-4d9a8b9cd77f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.322713 Oct 11 04:45:49.712482 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3308/6374] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:49 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:49.735808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4afedddc-c6ee-4e5f-a1fd-e7ff1d3540be req-3f1fa112-2498-4368-885a-f64aa77f578b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad579b9-91b9-4686-a1dc-a40895faa33b", "name": "network-vif-plugged", "status": "completed", "tag": "1b369f10-26b2-4ed9-bd87-46ec8e23cd8b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:45:49.757161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4afedddc-c6ee-4e5f-a1fd-e7ff1d3540be req-3f1fa112-2498-4368-885a-f64aa77f578b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:49.757720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4afedddc-c6ee-4e5f-a1fd-e7ff1d3540be req-3f1fa112-2498-4368-885a-f64aa77f578b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:49.758256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4afedddc-c6ee-4e5f-a1fd-e7ff1d3540be req-3f1fa112-2498-4368-885a-f64aa77f578b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:49.772791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d9494a17-f37b-4f13-b63d-685a742503fd tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:49.774846 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4afedddc-c6ee-4e5f-a1fd-e7ff1d3540be req-3f1fa112-2498-4368-885a-f64aa77f578b service nova] Creating event network-vif-plugged:1b369f10-26b2-4ed9-bd87-46ec8e23cd8b for instance 7ad579b9-91b9-4686-a1dc-a40895faa33b on n-h1-860892-1 Oct 11 04:45:49.780192 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4afedddc-c6ee-4e5f-a1fd-e7ff1d3540be req-3f1fa112-2498-4368-885a-f64aa77f578b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051759 Oct 11 04:45:49.781219 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3309/6375] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:45:49.782546 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d9494a17-f37b-4f13-b63d-685a742503fd tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1315 microversion: 2.1 time: 0.325101 Oct 11 04:45:49.784365 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3067/6376] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:49 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:50.071836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:50.072883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:50.082698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:50.083514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:50.084240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:50.085157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:50.085873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:50.086583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:50.129712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:50.130430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:50.131032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:50.131718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lazy-loading 'fault' on Instance uuid 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:45:50.185407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:50.194217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:50.195695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9cdfb1cf8aeb4fa0859c4d954bdd6369', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbfd601e8ae449eaa5d8d21409c953a0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:50.197700 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-da50bfe1-39ce-4fc3-9fac-d871b934492d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 200 len: 1370 microversion: 2.20 time: 0.133324 Oct 11 04:45:50.203039 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3310/6377] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:45:50 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 1370 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:45:50.741908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9d9bd8d5-a0bc-49c0-b273-7c42cbc7b647 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:50.742672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9d9bd8d5-a0bc-49c0-b273-7c42cbc7b647 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:50.749637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d9bd8d5-a0bc-49c0-b273-7c42cbc7b647 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:50.750122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d9bd8d5-a0bc-49c0-b273-7c42cbc7b647 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:50.750592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d9bd8d5-a0bc-49c0-b273-7c42cbc7b647 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:50.753749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d9bd8d5-a0bc-49c0-b273-7c42cbc7b647 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:50.753749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d9bd8d5-a0bc-49c0-b273-7c42cbc7b647 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:50.753749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d9bd8d5-a0bc-49c0-b273-7c42cbc7b647 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:50.807587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3196f5d8-7973-460e-b80d-013a072cf599 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:50.808217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3196f5d8-7973-460e-b80d-013a072cf599 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:50.815501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3196f5d8-7973-460e-b80d-013a072cf599 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:50.815983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3196f5d8-7973-460e-b80d-013a072cf599 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:50.816417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3196f5d8-7973-460e-b80d-013a072cf599 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:50.817105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3196f5d8-7973-460e-b80d-013a072cf599 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:50.817556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3196f5d8-7973-460e-b80d-013a072cf599 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:50.817976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3196f5d8-7973-460e-b80d-013a072cf599 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:50.998923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9d9bd8d5-a0bc-49c0-b273-7c42cbc7b647 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:51.015460 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9d9bd8d5-a0bc-49c0-b273-7c42cbc7b647 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.274933 Oct 11 04:45:51.018023 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3068/6378] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:50 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:51.238311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:51.240578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:51.256471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3196f5d8-7973-460e-b80d-013a072cf599 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:51.256933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:51.257771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:51.259730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:51.266361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:51.266972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:51.268586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:51.278377 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3196f5d8-7973-460e-b80d-013a072cf599 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1315 microversion: 2.1 time: 0.474451 Oct 11 04:45:51.279319 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3311/6379] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:50 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:45:51.295799 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] HTTP exception thrown: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Request method failure captured: Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac HTTP/1.1 Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPMnFZ--kfNQpeWNIhHN1i8Uf4Kplgu5j8k8l0oKaqTBxeAxbnVfz-P6_YjuM5iyB9aH-ZTTuOshB2GyNxaDKqJQPxm07xOgeOI_jYvm6PyvPg9ZrGKZTos5iT2s2gzngMBhS1W9_eKljxTvAtPnWcaSuyReHttXdK3uVwUuSVRxpCg Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}] Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 9cdfb1cf8aeb4fa0859c4d954bdd6369 Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '0f0fc2c3-6449-488b-8dc6-bf4db975a9ac'} Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:51.299646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:45:51.312369 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:51.312369 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:51.312369 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:45:51.312369 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:45:51.312369 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:45:51.312369 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:45:51.312369 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:51.312369 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:51.312369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Returning 404 to user: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:45:51.312369 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-53bcb258-a0e7-4620-9c71-ee577b5cd500 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 404 len: 111 microversion: 2.20 time: 0.069178 Oct 11 04:45:51.312369 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3069/6380] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:45:51 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 111 bytes in 71 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:45:51.313334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-51cd3fdb-c949-470c-8bde-ddc5bd3c9c59 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '.version_select at 0x7fda19411280>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:51.415634 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-51cd3fdb-c949-470c-8bde-ddc5bd3c9c59 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-651188936" status: 204 len: 0 microversion: 2.20 time: 0.109211 Oct 11 04:45:51.416238 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3312/6381] 10.222.0.26 () {60 vars in 1259 bytes} [Tue Oct 11 04:45:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-651188936 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:45:52.041183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ae1c5ab-d901-4be6-b774-97a6d812f9cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:52.041805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ae1c5ab-d901-4be6-b774-97a6d812f9cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:52.050398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ae1c5ab-d901-4be6-b774-97a6d812f9cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:52.053719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ae1c5ab-d901-4be6-b774-97a6d812f9cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:52.055377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ae1c5ab-d901-4be6-b774-97a6d812f9cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:52.057935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ae1c5ab-d901-4be6-b774-97a6d812f9cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:52.058695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ae1c5ab-d901-4be6-b774-97a6d812f9cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:52.063331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ae1c5ab-d901-4be6-b774-97a6d812f9cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:52.301726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d2b78985-8b9e-43ff-9351-6a274a1cb1ea tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:52.304042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d2b78985-8b9e-43ff-9351-6a274a1cb1ea tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:52.309736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=90,nova_api:DELETE=4,nova_api:INSERT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:52.342902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2b78985-8b9e-43ff-9351-6a274a1cb1ea tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:52.343622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2b78985-8b9e-43ff-9351-6a274a1cb1ea tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:52.345674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2b78985-8b9e-43ff-9351-6a274a1cb1ea tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:52.347112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2b78985-8b9e-43ff-9351-6a274a1cb1ea tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:52.348005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2b78985-8b9e-43ff-9351-6a274a1cb1ea tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:52.348581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2b78985-8b9e-43ff-9351-6a274a1cb1ea tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:52.361915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3ae1c5ab-d901-4be6-b774-97a6d812f9cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:52.369842 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ae1c5ab-d901-4be6-b774-97a6d812f9cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.332935 Oct 11 04:45:52.370810 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3070/6382] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:52 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:52.544614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d2b78985-8b9e-43ff-9351-6a274a1cb1ea tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:52.554483 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d2b78985-8b9e-43ff-9351-6a274a1cb1ea tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1465 microversion: 2.1 time: 0.257341 Oct 11 04:45:52.566621 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3313/6383] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:52 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1465 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:45:52.608837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2e209e07-c7a1-44aa-9842-95c4f81597dc tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:52.609580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2e209e07-c7a1-44aa-9842-95c4f81597dc tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:52.615758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e209e07-c7a1-44aa-9842-95c4f81597dc tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:52.616338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e209e07-c7a1-44aa-9842-95c4f81597dc tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:52.616843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e209e07-c7a1-44aa-9842-95c4f81597dc tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:52.617543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e209e07-c7a1-44aa-9842-95c4f81597dc tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:52.618134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e209e07-c7a1-44aa-9842-95c4f81597dc tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:52.618768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e209e07-c7a1-44aa-9842-95c4f81597dc tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:52.645703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2e209e07-c7a1-44aa-9842-95c4f81597dc tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:45:52.985724 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2e209e07-c7a1-44aa-9842-95c4f81597dc tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 204 len: 0 microversion: 2.1 time: 0.381187 Oct 11 04:45:52.997816 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3071/6384] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:45:52 2022] DELETE /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:45:52.998103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6ef750a7-43c3-423e-9fd0-8c608baca913 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:52.998103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6ef750a7-43c3-423e-9fd0-8c608baca913 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:53.009060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ef750a7-43c3-423e-9fd0-8c608baca913 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:53.010799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ef750a7-43c3-423e-9fd0-8c608baca913 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:53.011451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ef750a7-43c3-423e-9fd0-8c608baca913 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:53.015396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ef750a7-43c3-423e-9fd0-8c608baca913 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:53.016121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ef750a7-43c3-423e-9fd0-8c608baca913 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:53.017544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6ef750a7-43c3-423e-9fd0-8c608baca913 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:53.186263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6ef750a7-43c3-423e-9fd0-8c608baca913 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:53.201886 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6ef750a7-43c3-423e-9fd0-8c608baca913 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1471 microversion: 2.1 time: 0.210400 Oct 11 04:45:53.202505 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3314/6385] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:52 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1471 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:53.394025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3130d2fb-10cc-4105-8b07-a3ece4a0a998 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:53.395044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3130d2fb-10cc-4105-8b07-a3ece4a0a998 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:53.399919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:45:53.403690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3130d2fb-10cc-4105-8b07-a3ece4a0a998 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:53.404170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3130d2fb-10cc-4105-8b07-a3ece4a0a998 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:53.404807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3130d2fb-10cc-4105-8b07-a3ece4a0a998 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:53.405762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3130d2fb-10cc-4105-8b07-a3ece4a0a998 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:53.406400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3130d2fb-10cc-4105-8b07-a3ece4a0a998 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:53.406888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3130d2fb-10cc-4105-8b07-a3ece4a0a998 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:53.579450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3130d2fb-10cc-4105-8b07-a3ece4a0a998 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:53.589328 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3130d2fb-10cc-4105-8b07-a3ece4a0a998 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.199643 Oct 11 04:45:53.590975 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3072/6386] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:53 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:54.230598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dff41ddf-90c4-415f-a701-a34605b1f773 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:54.237228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dff41ddf-90c4-415f-a701-a34605b1f773 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:54.256301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dff41ddf-90c4-415f-a701-a34605b1f773 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:54.257705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dff41ddf-90c4-415f-a701-a34605b1f773 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:54.260179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dff41ddf-90c4-415f-a701-a34605b1f773 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:54.261327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dff41ddf-90c4-415f-a701-a34605b1f773 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:54.262001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dff41ddf-90c4-415f-a701-a34605b1f773 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:54.263269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dff41ddf-90c4-415f-a701-a34605b1f773 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:54.452322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dff41ddf-90c4-415f-a701-a34605b1f773 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:54.460706 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dff41ddf-90c4-415f-a701-a34605b1f773 tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1471 microversion: 2.1 time: 0.236381 Oct 11 04:45:54.461832 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3315/6387] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:54 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:54.615652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fa2eb168-9800-4072-866a-3b3d8c20b58f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:54.616876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fa2eb168-9800-4072-866a-3b3d8c20b58f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:54.625047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa2eb168-9800-4072-866a-3b3d8c20b58f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:54.625559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa2eb168-9800-4072-866a-3b3d8c20b58f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:54.625997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa2eb168-9800-4072-866a-3b3d8c20b58f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:54.626765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa2eb168-9800-4072-866a-3b3d8c20b58f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:54.627216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa2eb168-9800-4072-866a-3b3d8c20b58f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:54.627638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa2eb168-9800-4072-866a-3b3d8c20b58f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:54.858530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa2eb168-9800-4072-866a-3b3d8c20b58f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:54.867531 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fa2eb168-9800-4072-866a-3b3d8c20b58f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.257751 Oct 11 04:45:54.868122 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3073/6388] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:54 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:55.120552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-377a2186-73a1-4706-8d64-999109477837 req-06851823-b705-474e-ad09-82bd74ea4798 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ad579b9-91b9-4686-a1dc-a40895faa33b", "name": "network-vif-deleted", "tag": "1b369f10-26b2-4ed9-bd87-46ec8e23cd8b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:45:55.134769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-377a2186-73a1-4706-8d64-999109477837 req-06851823-b705-474e-ad09-82bd74ea4798 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:55.136752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-377a2186-73a1-4706-8d64-999109477837 req-06851823-b705-474e-ad09-82bd74ea4798 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:55.137801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-377a2186-73a1-4706-8d64-999109477837 req-06851823-b705-474e-ad09-82bd74ea4798 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:55.153319 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-377a2186-73a1-4706-8d64-999109477837 req-06851823-b705-474e-ad09-82bd74ea4798 service nova] Creating event network-vif-deleted:1b369f10-26b2-4ed9-bd87-46ec8e23cd8b for instance 7ad579b9-91b9-4686-a1dc-a40895faa33b on n-h1-860892-1 Oct 11 04:45:55.169087 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-377a2186-73a1-4706-8d64-999109477837 req-06851823-b705-474e-ad09-82bd74ea4798 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048467 Oct 11 04:45:55.169298 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3316/6389] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:45:55.485646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:55.487171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:55.493768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:55.494282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:55.494721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:55.495411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:55.495864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:55.496319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:55.552856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:55.553279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:55.553714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:55.554329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lazy-loading 'fault' on Instance uuid 7ad579b9-91b9-4686-a1dc-a40895faa33b {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:45:55.610457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ac06f41fef54f8183536266179b3b3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c9aadc7d8e6f41429585e35b87e12436', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:55.621123 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-49c48a5a-ebe8-4dc3-bc49-5e0ae0f34e2c tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 200 len: 1305 microversion: 2.1 time: 0.139879 Oct 11 04:45:55.623835 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3074/6390] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:55 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 1305 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:55.894510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b90cd202-aced-439f-a6aa-61f229005fa6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:55.896035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b90cd202-aced-439f-a6aa-61f229005fa6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:55.904948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90cd202-aced-439f-a6aa-61f229005fa6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:55.905779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90cd202-aced-439f-a6aa-61f229005fa6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:55.906966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90cd202-aced-439f-a6aa-61f229005fa6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:55.907946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90cd202-aced-439f-a6aa-61f229005fa6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:55.908643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90cd202-aced-439f-a6aa-61f229005fa6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:55.909268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b90cd202-aced-439f-a6aa-61f229005fa6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:55.960255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:55.960858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:55.968297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:55.974506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:55.974506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:55.974506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:55.974506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:55.974880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:55.991083 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] HTTP exception thrown: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Request method failure captured: Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac HTTP/1.1 Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPMnFZ--kfNQpeWNIhHN1i8Uf4Kplgu5j8k8l0oKaqTBxeAxbnVfz-P6_YjuM5iyB9aH-ZTTuOshB2GyNxaDKqJQPxm07xOgeOI_jYvm6PyvPg9ZrGKZTos5iT2s2gzngMBhS1W9_eKljxTvAtPnWcaSuyReHttXdK3uVwUuSVRxpCg Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}] Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 9cdfb1cf8aeb4fa0859c4d954bdd6369 Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '0f0fc2c3-6449-488b-8dc6-bf4db975a9ac'} Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:45:55.992891 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Returning 404 to user: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d57bcc8d-473f-4af3-8d12-3867cc220852 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 404 len: 111 microversion: 2.20 time: 0.038256 Oct 11 04:45:55.997977 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3075/6391] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:45:55 2022] DELETE /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 11 04:45:56.013090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:56.013974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:56.022591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:56.045397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:56.047662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:56.047662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:56.047889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:56.048171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:56.088599 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] HTTP exception thrown: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Request method failure captured: Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac HTTP/1.1 Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPMnFZ--kfNQpeWNIhHN1i8Uf4Kplgu5j8k8l0oKaqTBxeAxbnVfz-P6_YjuM5iyB9aH-ZTTuOshB2GyNxaDKqJQPxm07xOgeOI_jYvm6PyvPg9ZrGKZTos5iT2s2gzngMBhS1W9_eKljxTvAtPnWcaSuyReHttXdK3uVwUuSVRxpCg Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}] Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 9cdfb1cf8aeb4fa0859c4d954bdd6369 Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '0f0fc2c3-6449-488b-8dc6-bf4db975a9ac'} Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:56.094938 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:45:56.099512 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:56.099512 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:56.099512 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:45:56.099512 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:45:56.099512 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:45:56.099512 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:45:56.099512 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. Oct 11 04:45:56.099512 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:56.101154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Returning 404 to user: Instance 0f0fc2c3-6449-488b-8dc6-bf4db975a9ac could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:45:56.107499 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-50706a3f-56de-4a16-beca-a2268133ea4d tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac" status: 404 len: 111 microversion: 2.20 time: 0.100201 Oct 11 04:45:56.108095 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3076/6392] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:45:55 2022] GET /compute/v2.1/servers/0f0fc2c3-6449-488b-8dc6-bf4db975a9ac => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:45:56.156544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b90cd202-aced-439f-a6aa-61f229005fa6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:56.168555 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b90cd202-aced-439f-a6aa-61f229005fa6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.278824 Oct 11 04:45:56.173330 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3317/6393] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:55 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:56.654007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:56.654786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] [instance: 7ad579b9-91b9-4686-a1dc-a40895faa33b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:56.666021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:56.666021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:56.666021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:56.671754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:56.672615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:56.673334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:56.694173 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] HTTP exception thrown: Instance 7ad579b9-91b9-4686-a1dc-a40895faa33b could not be found. Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Request method failure captured: Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b HTTP/1.1 Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPTtntJZKqDtlKUm4o-T6lyQD3cPp2g2xcpi4dl3SZBEYzVLdJwPnZQ9-6r4rX3ZArKeTudnOzHzOXjTjCrRcBCbRNQ15locG27_vuHDMfx88W2-9_6BXTxdXnG1H8fCt6DJ5ajWqJcprSK6EkAH_WM1VG25JKtyXo91rcGY8WLQxI0 Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: c9aadc7d8e6f41429585e35b87e12436 Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-VolumesNegativeTest-309727210 Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/c9aadc7d8e6f41429585e35b87e12436"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_c9aadc7d8e6f41429585e35b87e12436"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c9aadc7d8e6f41429585e35b87e12436"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/c9aadc7d8e6f41429585e35b87e12436"}]}] Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-VolumesNegativeTest-309727210 Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: c9aadc7d8e6f41429585e35b87e12436 Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-VolumesNegativeTest-309727210 Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-VolumesNegativeTest-309727210-project Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 6ac06f41fef54f8183536266179b3b3a Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-VolumesNegativeTest-309727210-project Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 7ad579b9-91b9-4686-a1dc-a40895faa33b could not be found. Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '7ad579b9-91b9-4686-a1dc-a40895faa33b'} Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ad579b9-91b9-4686-a1dc-a40895faa33b could not be found. Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ad579b9-91b9-4686-a1dc-a40895faa33b could not be found. Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:45:56.697093 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:56.704976 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:45:56.704976 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:45:56.704976 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:45:56.704976 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:45:56.704976 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:45:56.704976 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ad579b9-91b9-4686-a1dc-a40895faa33b could not be found. Oct 11 04:45:56.704976 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:45:56.704976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] Returning 404 to user: Instance 7ad579b9-91b9-4686-a1dc-a40895faa33b could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:45:56.706592 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a61b1f94-4576-43fc-a3a7-7dacccef179a tempest-VolumesNegativeTest-309727210 tempest-VolumesNegativeTest-309727210-project] 10.222.0.26 "GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b" status: 404 len: 111 microversion: 2.1 time: 0.051605 Oct 11 04:45:56.707671 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3077/6394] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:56 2022] GET /compute/v2.1/servers/7ad579b9-91b9-4686-a1dc-a40895faa33b => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:45:57.336305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-47ff7b11-a3ef-43fa-89cf-d71a10fafa92 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:57.336305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-47ff7b11-a3ef-43fa-89cf-d71a10fafa92 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:57.336305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47ff7b11-a3ef-43fa-89cf-d71a10fafa92 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:57.336305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47ff7b11-a3ef-43fa-89cf-d71a10fafa92 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:57.336305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47ff7b11-a3ef-43fa-89cf-d71a10fafa92 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:57.336305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47ff7b11-a3ef-43fa-89cf-d71a10fafa92 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:57.336305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47ff7b11-a3ef-43fa-89cf-d71a10fafa92 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:57.336305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47ff7b11-a3ef-43fa-89cf-d71a10fafa92 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:57.341377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-47ff7b11-a3ef-43fa-89cf-d71a10fafa92 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:57.349630 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-47ff7b11-a3ef-43fa-89cf-d71a10fafa92 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.160621 Oct 11 04:45:57.350452 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3318/6395] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:57 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:58.377959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5b7b23a6-c111-488a-b0f8-0738ce1e7fb7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:58.382744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5b7b23a6-c111-488a-b0f8-0738ce1e7fb7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:58.398903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7b23a6-c111-488a-b0f8-0738ce1e7fb7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:58.399392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7b23a6-c111-488a-b0f8-0738ce1e7fb7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:58.399826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7b23a6-c111-488a-b0f8-0738ce1e7fb7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:58.400518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7b23a6-c111-488a-b0f8-0738ce1e7fb7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:58.400964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7b23a6-c111-488a-b0f8-0738ce1e7fb7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:58.401756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b7b23a6-c111-488a-b0f8-0738ce1e7fb7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:58.628722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5b7b23a6-c111-488a-b0f8-0738ce1e7fb7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:58.638541 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5b7b23a6-c111-488a-b0f8-0738ce1e7fb7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.267400 Oct 11 04:45:58.654896 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3078/6396] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:58 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:45:59.665921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b811475-b6c2-43ce-ac95-bcbcbecb1531 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:45:59.666674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b811475-b6c2-43ce-ac95-bcbcbecb1531 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:45:59.674589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b811475-b6c2-43ce-ac95-bcbcbecb1531 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:59.677615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b811475-b6c2-43ce-ac95-bcbcbecb1531 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:59.678068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b811475-b6c2-43ce-ac95-bcbcbecb1531 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:59.686218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b811475-b6c2-43ce-ac95-bcbcbecb1531 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:45:59.686700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b811475-b6c2-43ce-ac95-bcbcbecb1531 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:45:59.687145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b811475-b6c2-43ce-ac95-bcbcbecb1531 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:45:59.826635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9b811475-b6c2-43ce-ac95-bcbcbecb1531 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:45:59.834895 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b811475-b6c2-43ce-ac95-bcbcbecb1531 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.172762 Oct 11 04:45:59.835692 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3319/6397] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:45:59 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:00.783023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:00.784449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:00.791264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:00.791754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:00.792186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:00.792891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:00.793505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:00.793939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:00.808200 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] HTTP exception thrown: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Request method failure captured: Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 HTTP/1.1 Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPMnFZ--kfNQpeWNIhHN1i8Uf4Kplgu5j8k8l0oKaqTBxeAxbnVfz-P6_YjuM5iyB9aH-ZTTuOshB2GyNxaDKqJQPxm07xOgeOI_jYvm6PyvPg9ZrGKZTos5iT2s2gzngMBhS1W9_eKljxTvAtPnWcaSuyReHttXdK3uVwUuSVRxpCg Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}] Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 9cdfb1cf8aeb4fa0859c4d954bdd6369 Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '55886128-3370-4868-98e0-5b2b4e574871'} Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:46:00.810350 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Returning 404 to user: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce079f7a-f4b1-4a6a-b488-5066232c8ca9 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "DELETE /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 404 len: 111 microversion: 2.20 time: 0.032771 Oct 11 04:46:00.815584 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3079/6398] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:46:00 2022] DELETE /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:46:00.820721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:00.821336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] [instance: 55886128-3370-4868-98e0-5b2b4e574871] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:00.833091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:00.833715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:00.834021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:00.834762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:00.835229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:00.835664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:00.850701 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] HTTP exception thrown: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Request method failure captured: Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 HTTP/1.1 Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPMnFZ--kfNQpeWNIhHN1i8Uf4Kplgu5j8k8l0oKaqTBxeAxbnVfz-P6_YjuM5iyB9aH-ZTTuOshB2GyNxaDKqJQPxm07xOgeOI_jYvm6PyvPg9ZrGKZTos5iT2s2gzngMBhS1W9_eKljxTvAtPnWcaSuyReHttXdK3uVwUuSVRxpCg Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.20 Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cbfd601e8ae449eaa5d8d21409c953a0"}]}] Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: cbfd601e8ae449eaa5d8d21409c953a0 Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1704357332 Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 9cdfb1cf8aeb4fa0859c4d954bdd6369 Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1704357332-project Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '55886128-3370-4868-98e0-5b2b4e574871'} Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:46:00.854055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:46:00.860406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:46:00.860406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:46:00.860406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:46:00.860406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:46:00.860406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:46:00.860406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:46:00.860406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. Oct 11 04:46:00.860406 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:46:00.862066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] Returning 404 to user: Instance 55886128-3370-4868-98e0-5b2b4e574871 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:46:00.863028 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e20da5d1-11fc-4f6e-a7c8-9873e91199e2 tempest-AttachVolumeShelveTestJSON-1704357332 tempest-AttachVolumeShelveTestJSON-1704357332-project] 10.222.0.26 "GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871" status: 404 len: 111 microversion: 2.20 time: 0.046047 Oct 11 04:46:00.863813 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3320/6399] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:46:00 2022] GET /compute/v2.1/servers/55886128-3370-4868-98e0-5b2b4e574871 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:46:00.867613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d37928d4-2741-4223-a021-d3a4ba8990bc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:00.867613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d37928d4-2741-4223-a021-d3a4ba8990bc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:00.883081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d37928d4-2741-4223-a021-d3a4ba8990bc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:00.889571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d37928d4-2741-4223-a021-d3a4ba8990bc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:00.889571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d37928d4-2741-4223-a021-d3a4ba8990bc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:00.890245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d37928d4-2741-4223-a021-d3a4ba8990bc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:00.890942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d37928d4-2741-4223-a021-d3a4ba8990bc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:00.893297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d37928d4-2741-4223-a021-d3a4ba8990bc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:01.086852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d37928d4-2741-4223-a021-d3a4ba8990bc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:01.094964 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d37928d4-2741-4223-a021-d3a4ba8990bc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.235084 Oct 11 04:46:01.095548 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3080/6400] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:00 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:02.119458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6fdf2339-381a-4d3b-a20c-73c72adf0e4a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:02.119458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6fdf2339-381a-4d3b-a20c-73c72adf0e4a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:02.127695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fdf2339-381a-4d3b-a20c-73c72adf0e4a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:02.128668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fdf2339-381a-4d3b-a20c-73c72adf0e4a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:02.129369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fdf2339-381a-4d3b-a20c-73c72adf0e4a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:02.130358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fdf2339-381a-4d3b-a20c-73c72adf0e4a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:02.131536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fdf2339-381a-4d3b-a20c-73c72adf0e4a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:02.132429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6fdf2339-381a-4d3b-a20c-73c72adf0e4a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:02.353548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6fdf2339-381a-4d3b-a20c-73c72adf0e4a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:02.367072 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6fdf2339-381a-4d3b-a20c-73c72adf0e4a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.252141 Oct 11 04:46:02.367923 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3321/6401] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:02 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:03.394677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-457eb734-b3c4-471e-9ae3-79bbc68693d4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:03.395548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-457eb734-b3c4-471e-9ae3-79bbc68693d4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:03.419727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-457eb734-b3c4-471e-9ae3-79bbc68693d4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:03.422362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-457eb734-b3c4-471e-9ae3-79bbc68693d4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:03.423095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-457eb734-b3c4-471e-9ae3-79bbc68693d4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:03.423822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-457eb734-b3c4-471e-9ae3-79bbc68693d4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:03.424333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-457eb734-b3c4-471e-9ae3-79bbc68693d4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:03.424711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-457eb734-b3c4-471e-9ae3-79bbc68693d4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:03.727031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-457eb734-b3c4-471e-9ae3-79bbc68693d4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:03.739020 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-457eb734-b3c4-471e-9ae3-79bbc68693d4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.347353 Oct 11 04:46:03.742806 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3081/6402] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:03 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:04.766968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dee2702d-02a7-496a-9221-17e22d4fe2e6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:04.767863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dee2702d-02a7-496a-9221-17e22d4fe2e6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:04.782777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee2702d-02a7-496a-9221-17e22d4fe2e6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:04.794857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee2702d-02a7-496a-9221-17e22d4fe2e6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:04.794857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee2702d-02a7-496a-9221-17e22d4fe2e6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:04.794857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee2702d-02a7-496a-9221-17e22d4fe2e6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:04.794857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee2702d-02a7-496a-9221-17e22d4fe2e6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:04.794857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee2702d-02a7-496a-9221-17e22d4fe2e6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:05.009809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dee2702d-02a7-496a-9221-17e22d4fe2e6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:05.024005 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dee2702d-02a7-496a-9221-17e22d4fe2e6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.261270 Oct 11 04:46:05.025195 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3322/6403] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:04 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:06.053032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eee03204-a54f-4ee2-972d-a5de0ffec735 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:06.053032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eee03204-a54f-4ee2-972d-a5de0ffec735 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:06.061225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eee03204-a54f-4ee2-972d-a5de0ffec735 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:06.061714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eee03204-a54f-4ee2-972d-a5de0ffec735 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:06.062402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eee03204-a54f-4ee2-972d-a5de0ffec735 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:06.063115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eee03204-a54f-4ee2-972d-a5de0ffec735 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:06.063572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eee03204-a54f-4ee2-972d-a5de0ffec735 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:06.063998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eee03204-a54f-4ee2-972d-a5de0ffec735 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:06.248983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eee03204-a54f-4ee2-972d-a5de0ffec735 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:06.252918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:46:06.259344 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eee03204-a54f-4ee2-972d-a5de0ffec735 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.215227 Oct 11 04:46:06.259930 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3082/6404] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:06 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:07.287842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8fa42fb6-0e7b-47c9-858c-c7d160138cd3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:07.288530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8fa42fb6-0e7b-47c9-858c-c7d160138cd3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:07.295824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8fa42fb6-0e7b-47c9-858c-c7d160138cd3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:07.296412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8fa42fb6-0e7b-47c9-858c-c7d160138cd3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:07.296928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8fa42fb6-0e7b-47c9-858c-c7d160138cd3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:07.297687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8fa42fb6-0e7b-47c9-858c-c7d160138cd3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:07.298238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8fa42fb6-0e7b-47c9-858c-c7d160138cd3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:07.298736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8fa42fb6-0e7b-47c9-858c-c7d160138cd3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:07.470014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8fa42fb6-0e7b-47c9-858c-c7d160138cd3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:07.478445 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8fa42fb6-0e7b-47c9-858c-c7d160138cd3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.194660 Oct 11 04:46:07.479059 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3323/6405] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:07 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:08.504705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dc93f905-2aa0-4938-93ef-3ec88090f9c4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:08.507058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dc93f905-2aa0-4938-93ef-3ec88090f9c4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:08.537950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc93f905-2aa0-4938-93ef-3ec88090f9c4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:08.539435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc93f905-2aa0-4938-93ef-3ec88090f9c4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:08.543032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc93f905-2aa0-4938-93ef-3ec88090f9c4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:08.552865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc93f905-2aa0-4938-93ef-3ec88090f9c4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:08.558642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc93f905-2aa0-4938-93ef-3ec88090f9c4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:08.558642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc93f905-2aa0-4938-93ef-3ec88090f9c4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:08.775062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc93f905-2aa0-4938-93ef-3ec88090f9c4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:08.784635 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dc93f905-2aa0-4938-93ef-3ec88090f9c4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.285567 Oct 11 04:46:08.785263 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3083/6406] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:08 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:09.132081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5b021739-92a9-4539-b565-465bdde2d5ef tempest-PortsAdminExtendedAttrsTestJSON-746526222 tempest-PortsAdminExtendedAttrsTestJSON-746526222-project-admin] Calling method '.version_select at 0x7fda193ce0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:09.139297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b021739-92a9-4539-b565-465bdde2d5ef tempest-PortsAdminExtendedAttrsTestJSON-746526222 tempest-PortsAdminExtendedAttrsTestJSON-746526222-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:09.139809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b021739-92a9-4539-b565-465bdde2d5ef tempest-PortsAdminExtendedAttrsTestJSON-746526222 tempest-PortsAdminExtendedAttrsTestJSON-746526222-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:09.140264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b021739-92a9-4539-b565-465bdde2d5ef tempest-PortsAdminExtendedAttrsTestJSON-746526222 tempest-PortsAdminExtendedAttrsTestJSON-746526222-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:09.168880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b021739-92a9-4539-b565-465bdde2d5ef tempest-PortsAdminExtendedAttrsTestJSON-746526222 tempest-PortsAdminExtendedAttrsTestJSON-746526222-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:09.169942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b021739-92a9-4539-b565-465bdde2d5ef tempest-PortsAdminExtendedAttrsTestJSON-746526222 tempest-PortsAdminExtendedAttrsTestJSON-746526222-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:09.170456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b021739-92a9-4539-b565-465bdde2d5ef tempest-PortsAdminExtendedAttrsTestJSON-746526222 tempest-PortsAdminExtendedAttrsTestJSON-746526222-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:09.190483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b021739-92a9-4539-b565-465bdde2d5ef tempest-PortsAdminExtendedAttrsTestJSON-746526222 tempest-PortsAdminExtendedAttrsTestJSON-746526222-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:09.191302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b021739-92a9-4539-b565-465bdde2d5ef tempest-PortsAdminExtendedAttrsTestJSON-746526222 tempest-PortsAdminExtendedAttrsTestJSON-746526222-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:09.191923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b021739-92a9-4539-b565-465bdde2d5ef tempest-PortsAdminExtendedAttrsTestJSON-746526222 tempest-PortsAdminExtendedAttrsTestJSON-746526222-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:09.195734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:46:09.200774 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5b021739-92a9-4539-b565-465bdde2d5ef tempest-PortsAdminExtendedAttrsTestJSON-746526222 tempest-PortsAdminExtendedAttrsTestJSON-746526222-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.356268 Oct 11 04:46:09.202224 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3324/6407] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:46:08 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:46:09.808762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8eea8d15-59c9-4bcc-b388-df0d5719873e tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:09.809409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8eea8d15-59c9-4bcc-b388-df0d5719873e tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:09.817775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eea8d15-59c9-4bcc-b388-df0d5719873e tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:09.819122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eea8d15-59c9-4bcc-b388-df0d5719873e tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:09.825256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eea8d15-59c9-4bcc-b388-df0d5719873e tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:09.825256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eea8d15-59c9-4bcc-b388-df0d5719873e tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:09.825256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eea8d15-59c9-4bcc-b388-df0d5719873e tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:09.825256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8eea8d15-59c9-4bcc-b388-df0d5719873e tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:10.173372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8eea8d15-59c9-4bcc-b388-df0d5719873e tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:10.181356 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8eea8d15-59c9-4bcc-b388-df0d5719873e tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.377224 Oct 11 04:46:10.181927 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3084/6408] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:09 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:11.209449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-785df391-0928-49fc-b0b3-6e560bdc6a62 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:11.210062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-785df391-0928-49fc-b0b3-6e560bdc6a62 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:11.231842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-785df391-0928-49fc-b0b3-6e560bdc6a62 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:11.233226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-785df391-0928-49fc-b0b3-6e560bdc6a62 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:11.234719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-785df391-0928-49fc-b0b3-6e560bdc6a62 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:11.240586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-785df391-0928-49fc-b0b3-6e560bdc6a62 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:11.247339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-785df391-0928-49fc-b0b3-6e560bdc6a62 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:11.248042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-785df391-0928-49fc-b0b3-6e560bdc6a62 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:11.583426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-785df391-0928-49fc-b0b3-6e560bdc6a62 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:11.597010 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-785df391-0928-49fc-b0b3-6e560bdc6a62 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1506 microversion: 2.1 time: 0.391948 Oct 11 04:46:11.597602 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3325/6409] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:11 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1506 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:12.620318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-426a9a04-8261-4cc8-bb56-25155834acee tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:12.620922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-426a9a04-8261-4cc8-bb56-25155834acee tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:12.627625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426a9a04-8261-4cc8-bb56-25155834acee tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:12.628391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426a9a04-8261-4cc8-bb56-25155834acee tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:12.629005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426a9a04-8261-4cc8-bb56-25155834acee tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:12.629885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426a9a04-8261-4cc8-bb56-25155834acee tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:12.630594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426a9a04-8261-4cc8-bb56-25155834acee tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:12.631191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-426a9a04-8261-4cc8-bb56-25155834acee tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:12.927653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-426a9a04-8261-4cc8-bb56-25155834acee tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:12.935696 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-426a9a04-8261-4cc8-bb56-25155834acee tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1486 microversion: 2.1 time: 0.320216 Oct 11 04:46:12.936286 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3085/6410] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:12 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1486 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:13.071540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueTestJSON-server-962626314", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:46:13.159070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] validate_networks() for [('ffe9fdce-3fd4-4eef-95dd-c03e9808bf86', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:46:13.841942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:46:13.842408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:46:13.842935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:46:13.843356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:46:13.843773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:46:13.867110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:13.867615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:13.868053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:13.868785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:13.873322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:13.873792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:13.912215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Getting quotas for project 86019ef4f0ae45228aa7ede8079c2dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:46:13.917349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Getting quotas for user 0539f747d9024059876461607f48c0a5 and project 86019ef4f0ae45228aa7ede8079c2dad. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:46:13.934926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:46:13.937516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:46:14.168939 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1b5c5a33-68a1-4005-a9fc-f09554a0a3da tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.100280 Oct 11 04:46:14.189915 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3326/6411] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:46:13 2022] POST /compute/v2.1/servers => generated 383 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:46:14.199850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b36bf7f9-2c9e-4d0c-9005-eda6b68cde45 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:14.204886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b36bf7f9-2c9e-4d0c-9005-eda6b68cde45 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:14.335315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b36bf7f9-2c9e-4d0c-9005-eda6b68cde45 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:14.353366 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b36bf7f9-2c9e-4d0c-9005-eda6b68cde45 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1213 microversion: 2.1 time: 0.147332 Oct 11 04:46:14.353366 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3086/6412] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:14 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1213 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:15.371513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc9bb247-7fe0-445d-9e06-16c6f5c7a04d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:15.372712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cc9bb247-7fe0-445d-9e06-16c6f5c7a04d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:15.449061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cc9bb247-7fe0-445d-9e06-16c6f5c7a04d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:15.468112 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc9bb247-7fe0-445d-9e06-16c6f5c7a04d tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1213 microversion: 2.1 time: 0.100837 Oct 11 04:46:15.469690 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3327/6413] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:15 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1213 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:16.494584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b6012751-ffea-4630-8b21-2d4202ed9d86 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:16.495809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b6012751-ffea-4630-8b21-2d4202ed9d86 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:16.504069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6012751-ffea-4630-8b21-2d4202ed9d86 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:16.504574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6012751-ffea-4630-8b21-2d4202ed9d86 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:16.505019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6012751-ffea-4630-8b21-2d4202ed9d86 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:16.505789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6012751-ffea-4630-8b21-2d4202ed9d86 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:16.506309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6012751-ffea-4630-8b21-2d4202ed9d86 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:16.506744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6012751-ffea-4630-8b21-2d4202ed9d86 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:16.694439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b6012751-ffea-4630-8b21-2d4202ed9d86 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:16.708365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b6012751-ffea-4630-8b21-2d4202ed9d86 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1265 microversion: 2.1 time: 0.219541 Oct 11 04:46:16.724618 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3087/6414] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:16 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1265 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:17.734935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-756daa46-9f3e-424e-bad0-cd3f11f4e6a1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:17.736293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-756daa46-9f3e-424e-bad0-cd3f11f4e6a1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:17.746372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-756daa46-9f3e-424e-bad0-cd3f11f4e6a1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:17.755719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-756daa46-9f3e-424e-bad0-cd3f11f4e6a1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:17.760149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-756daa46-9f3e-424e-bad0-cd3f11f4e6a1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:17.760149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-756daa46-9f3e-424e-bad0-cd3f11f4e6a1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:17.760149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-756daa46-9f3e-424e-bad0-cd3f11f4e6a1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:17.760149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-756daa46-9f3e-424e-bad0-cd3f11f4e6a1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:17.872251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-756daa46-9f3e-424e-bad0-cd3f11f4e6a1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:17.882421 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-756daa46-9f3e-424e-bad0-cd3f11f4e6a1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1283 microversion: 2.1 time: 0.151467 Oct 11 04:46:17.883798 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3328/6415] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:17 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1283 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:18.913733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-18a62842-50b0-4f71-a22e-9e81ddc6ba53 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:18.916897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-18a62842-50b0-4f71-a22e-9e81ddc6ba53 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:18.933463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a62842-50b0-4f71-a22e-9e81ddc6ba53 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:18.935283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a62842-50b0-4f71-a22e-9e81ddc6ba53 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:18.935902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a62842-50b0-4f71-a22e-9e81ddc6ba53 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:18.937751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a62842-50b0-4f71-a22e-9e81ddc6ba53 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:18.939195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a62842-50b0-4f71-a22e-9e81ddc6ba53 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:18.939907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18a62842-50b0-4f71-a22e-9e81ddc6ba53 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:19.241897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18a62842-50b0-4f71-a22e-9e81ddc6ba53 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:19.252894 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-18a62842-50b0-4f71-a22e-9e81ddc6ba53 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1313 microversion: 2.1 time: 0.348714 Oct 11 04:46:19.253834 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3088/6416] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:18 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1313 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:19.992726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-bb2711f5-61b3-4bf5-9581-c1f33994d40b req-1063a5be-3b26-4acd-aaea-8bb601edf044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd0e672f-59ce-444d-a99a-0b9a5a657258", "tag": "a137e011-e546-45b4-a03b-0d0fff982b24"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:46:20.006666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bb2711f5-61b3-4bf5-9581-c1f33994d40b req-1063a5be-3b26-4acd-aaea-8bb601edf044 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:20.007171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bb2711f5-61b3-4bf5-9581-c1f33994d40b req-1063a5be-3b26-4acd-aaea-8bb601edf044 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:20.007611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bb2711f5-61b3-4bf5-9581-c1f33994d40b req-1063a5be-3b26-4acd-aaea-8bb601edf044 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:20.021912 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-bb2711f5-61b3-4bf5-9581-c1f33994d40b req-1063a5be-3b26-4acd-aaea-8bb601edf044 service nova] Creating event network-changed:a137e011-e546-45b4-a03b-0d0fff982b24 for instance dd0e672f-59ce-444d-a99a-0b9a5a657258 on n-h1-860892-1 Oct 11 04:46:20.028282 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-bb2711f5-61b3-4bf5-9581-c1f33994d40b req-1063a5be-3b26-4acd-aaea-8bb601edf044 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041366 Oct 11 04:46:20.031208 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3329/6417] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:46:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:46:20.277336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0aa0678e-0e41-406e-996e-b8a75628156a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:20.279582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0aa0678e-0e41-406e-996e-b8a75628156a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:20.287949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa0678e-0e41-406e-996e-b8a75628156a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:20.288510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa0678e-0e41-406e-996e-b8a75628156a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:20.289184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa0678e-0e41-406e-996e-b8a75628156a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:20.290131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa0678e-0e41-406e-996e-b8a75628156a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:20.290847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa0678e-0e41-406e-996e-b8a75628156a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:20.292298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa0678e-0e41-406e-996e-b8a75628156a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:20.513173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0aa0678e-0e41-406e-996e-b8a75628156a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:20.532290 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0aa0678e-0e41-406e-996e-b8a75628156a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1313 microversion: 2.1 time: 0.259436 Oct 11 04:46:20.533490 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3089/6418] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:20 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1313 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:21.560347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04851a35-67eb-4e56-8582-17b5442ba97b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:21.561636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-04851a35-67eb-4e56-8582-17b5442ba97b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:21.573159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04851a35-67eb-4e56-8582-17b5442ba97b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:21.581700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04851a35-67eb-4e56-8582-17b5442ba97b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:21.584422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04851a35-67eb-4e56-8582-17b5442ba97b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:21.585623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04851a35-67eb-4e56-8582-17b5442ba97b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:21.589277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04851a35-67eb-4e56-8582-17b5442ba97b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:21.590152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04851a35-67eb-4e56-8582-17b5442ba97b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:21.825752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-04851a35-67eb-4e56-8582-17b5442ba97b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:21.833708 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04851a35-67eb-4e56-8582-17b5442ba97b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1313 microversion: 2.1 time: 0.278816 Oct 11 04:46:21.839728 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3330/6419] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:21 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1313 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:22.858633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c58f2e0a-eb7e-452e-a701-f598285b000a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:22.859244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c58f2e0a-eb7e-452e-a701-f598285b000a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:22.866967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58f2e0a-eb7e-452e-a701-f598285b000a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:22.867447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58f2e0a-eb7e-452e-a701-f598285b000a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:22.867882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58f2e0a-eb7e-452e-a701-f598285b000a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:22.868570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58f2e0a-eb7e-452e-a701-f598285b000a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:22.869022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58f2e0a-eb7e-452e-a701-f598285b000a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:22.870029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c58f2e0a-eb7e-452e-a701-f598285b000a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:23.092140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c58f2e0a-eb7e-452e-a701-f598285b000a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:23.100818 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c58f2e0a-eb7e-452e-a701-f598285b000a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1313 microversion: 2.1 time: 0.246863 Oct 11 04:46:23.101396 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3090/6420] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:22 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1313 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:24.125181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30a7766f-f18f-4a56-8d79-b204437f787c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:24.125670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30a7766f-f18f-4a56-8d79-b204437f787c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:24.128806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:46:24.130044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:46:24.135860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30a7766f-f18f-4a56-8d79-b204437f787c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:24.135860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30a7766f-f18f-4a56-8d79-b204437f787c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:24.136291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30a7766f-f18f-4a56-8d79-b204437f787c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:24.136917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30a7766f-f18f-4a56-8d79-b204437f787c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:24.137377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30a7766f-f18f-4a56-8d79-b204437f787c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:24.137807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30a7766f-f18f-4a56-8d79-b204437f787c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:24.302160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30a7766f-f18f-4a56-8d79-b204437f787c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:24.311519 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30a7766f-f18f-4a56-8d79-b204437f787c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1313 microversion: 2.1 time: 0.190383 Oct 11 04:46:24.312098 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3331/6421] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:24 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:46:25.334358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-634b4a91-8323-49ad-a937-091e2ff7ce2c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:25.335814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-634b4a91-8323-49ad-a937-091e2ff7ce2c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:25.338559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:46:25.343290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-634b4a91-8323-49ad-a937-091e2ff7ce2c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:25.343769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-634b4a91-8323-49ad-a937-091e2ff7ce2c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:25.344448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-634b4a91-8323-49ad-a937-091e2ff7ce2c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:25.345355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-634b4a91-8323-49ad-a937-091e2ff7ce2c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:25.346047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-634b4a91-8323-49ad-a937-091e2ff7ce2c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:25.346711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-634b4a91-8323-49ad-a937-091e2ff7ce2c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:25.513478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-634b4a91-8323-49ad-a937-091e2ff7ce2c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:25.528003 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-634b4a91-8323-49ad-a937-091e2ff7ce2c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1313 microversion: 2.1 time: 0.196639 Oct 11 04:46:25.528984 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3091/6422] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:25 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1313 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:25.752648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1759d9a7-5ba2-49e2-9604-78b1bf207199 req-1b4f84de-0da5-45a4-a6d5-8b859a39d26d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0e672f-59ce-444d-a99a-0b9a5a657258", "name": "network-vif-plugged", "status": "completed", "tag": "a137e011-e546-45b4-a03b-0d0fff982b24"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:46:25.768668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:46:25.771163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1759d9a7-5ba2-49e2-9604-78b1bf207199 req-1b4f84de-0da5-45a4-a6d5-8b859a39d26d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:25.771752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1759d9a7-5ba2-49e2-9604-78b1bf207199 req-1b4f84de-0da5-45a4-a6d5-8b859a39d26d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:25.772919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1759d9a7-5ba2-49e2-9604-78b1bf207199 req-1b4f84de-0da5-45a4-a6d5-8b859a39d26d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:25.788432 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1759d9a7-5ba2-49e2-9604-78b1bf207199 req-1b4f84de-0da5-45a4-a6d5-8b859a39d26d service nova] Creating event network-vif-plugged:a137e011-e546-45b4-a03b-0d0fff982b24 for instance dd0e672f-59ce-444d-a99a-0b9a5a657258 on n-h1-860892-1 Oct 11 04:46:25.794646 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1759d9a7-5ba2-49e2-9604-78b1bf207199 req-1b4f84de-0da5-45a4-a6d5-8b859a39d26d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046788 Oct 11 04:46:25.795432 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3332/6423] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:46:26.560460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0e13bcf9-b899-4d71-8237-db940a402fa0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:26.566428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0e13bcf9-b899-4d71-8237-db940a402fa0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:26.566428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=44 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:46:26.575325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e13bcf9-b899-4d71-8237-db940a402fa0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:26.575856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e13bcf9-b899-4d71-8237-db940a402fa0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:26.576340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e13bcf9-b899-4d71-8237-db940a402fa0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:26.577058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e13bcf9-b899-4d71-8237-db940a402fa0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:26.577517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e13bcf9-b899-4d71-8237-db940a402fa0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:26.578302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e13bcf9-b899-4d71-8237-db940a402fa0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:26.742399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0e13bcf9-b899-4d71-8237-db940a402fa0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:26.751272 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0e13bcf9-b899-4d71-8237-db940a402fa0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1313 microversion: 2.1 time: 0.201496 Oct 11 04:46:26.752136 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3092/6424] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:26 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1313 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:27.776414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6953c5b9-1fb4-486a-b8a8-514c320084e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:27.777087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6953c5b9-1fb4-486a-b8a8-514c320084e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:27.791420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6953c5b9-1fb4-486a-b8a8-514c320084e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:27.791420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6953c5b9-1fb4-486a-b8a8-514c320084e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:27.791420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6953c5b9-1fb4-486a-b8a8-514c320084e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:27.791420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6953c5b9-1fb4-486a-b8a8-514c320084e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:27.791420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6953c5b9-1fb4-486a-b8a8-514c320084e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:27.791420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6953c5b9-1fb4-486a-b8a8-514c320084e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:27.937356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6953c5b9-1fb4-486a-b8a8-514c320084e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:27.945622 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6953c5b9-1fb4-486a-b8a8-514c320084e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1499 microversion: 2.1 time: 0.174215 Oct 11 04:46:27.946418 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3333/6425] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:27 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1499 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:27.969777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7d98c70-9769-4f08-8942-5b9907a3bef4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:46:27.972143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a7d98c70-9769-4f08-8942-5b9907a3bef4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:27.978876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7d98c70-9769-4f08-8942-5b9907a3bef4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:27.979355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7d98c70-9769-4f08-8942-5b9907a3bef4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:27.979978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7d98c70-9769-4f08-8942-5b9907a3bef4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:27.980952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7d98c70-9769-4f08-8942-5b9907a3bef4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:27.981404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7d98c70-9769-4f08-8942-5b9907a3bef4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:27.982017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7d98c70-9769-4f08-8942-5b9907a3bef4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:28.016079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-a7d98c70-9769-4f08-8942-5b9907a3bef4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lazy-loading 'flavor' on Instance uuid dd0e672f-59ce-444d-a99a-0b9a5a657258 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:46:28.729518 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a7d98c70-9769-4f08-8942-5b9907a3bef4 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "POST /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258/action" status: 200 len: 32 microversion: 2.1 time: 0.763307 Oct 11 04:46:28.734527 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3093/6426] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:46:27 2022] POST /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258/action => generated 32 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 04:46:28.742220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c2e0bac2-09bc-4b3a-ba29-1c9b19a125e0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:28.743427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c2e0bac2-09bc-4b3a-ba29-1c9b19a125e0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:28.754793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e0bac2-09bc-4b3a-ba29-1c9b19a125e0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:28.756163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e0bac2-09bc-4b3a-ba29-1c9b19a125e0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:28.757018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e0bac2-09bc-4b3a-ba29-1c9b19a125e0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:28.758013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e0bac2-09bc-4b3a-ba29-1c9b19a125e0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:28.758792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e0bac2-09bc-4b3a-ba29-1c9b19a125e0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:28.760333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2e0bac2-09bc-4b3a-ba29-1c9b19a125e0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:28.908230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c2e0bac2-09bc-4b3a-ba29-1c9b19a125e0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:28.916230 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c2e0bac2-09bc-4b3a-ba29-1c9b19a125e0 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.180358 Oct 11 04:46:28.917115 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3334/6427] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:28 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:29.941122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b7dff729-228d-48db-b2b2-62e55355a7c7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:29.941955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b7dff729-228d-48db-b2b2-62e55355a7c7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:29.956233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7dff729-228d-48db-b2b2-62e55355a7c7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:29.957189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7dff729-228d-48db-b2b2-62e55355a7c7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:29.957833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7dff729-228d-48db-b2b2-62e55355a7c7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:29.958984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7dff729-228d-48db-b2b2-62e55355a7c7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:29.960547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7dff729-228d-48db-b2b2-62e55355a7c7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:29.972549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b7dff729-228d-48db-b2b2-62e55355a7c7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:30.132201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b7dff729-228d-48db-b2b2-62e55355a7c7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:30.142912 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b7dff729-228d-48db-b2b2-62e55355a7c7 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.204743 Oct 11 04:46:30.142912 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3094/6428] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:29 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:31.168134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-05c3784e-d08b-40f5-9244-97f444ebd1cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:31.168997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-05c3784e-d08b-40f5-9244-97f444ebd1cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:31.177091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05c3784e-d08b-40f5-9244-97f444ebd1cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:31.189448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05c3784e-d08b-40f5-9244-97f444ebd1cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:31.189448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05c3784e-d08b-40f5-9244-97f444ebd1cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:31.189448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05c3784e-d08b-40f5-9244-97f444ebd1cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:31.189448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05c3784e-d08b-40f5-9244-97f444ebd1cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:31.189448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05c3784e-d08b-40f5-9244-97f444ebd1cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:31.633466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-05c3784e-d08b-40f5-9244-97f444ebd1cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:31.646690 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-05c3784e-d08b-40f5-9244-97f444ebd1cc tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.482277 Oct 11 04:46:31.646824 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3335/6429] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:31 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:46:32.670127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6693724-496c-4427-9bd6-3d20286fc799 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:32.671416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f6693724-496c-4427-9bd6-3d20286fc799 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:32.678225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6693724-496c-4427-9bd6-3d20286fc799 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:32.682085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6693724-496c-4427-9bd6-3d20286fc799 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:32.682673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6693724-496c-4427-9bd6-3d20286fc799 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:32.683635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6693724-496c-4427-9bd6-3d20286fc799 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:32.684300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6693724-496c-4427-9bd6-3d20286fc799 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:32.685179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6693724-496c-4427-9bd6-3d20286fc799 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:32.838894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f6693724-496c-4427-9bd6-3d20286fc799 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:32.847146 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f6693724-496c-4427-9bd6-3d20286fc799 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.181831 Oct 11 04:46:32.847948 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3095/6430] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:32 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:46:33.873594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5481fada-360d-4901-b942-3789986257e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:33.874340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5481fada-360d-4901-b942-3789986257e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:33.881961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5481fada-360d-4901-b942-3789986257e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:33.882561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5481fada-360d-4901-b942-3789986257e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:33.883201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5481fada-360d-4901-b942-3789986257e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:33.883948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5481fada-360d-4901-b942-3789986257e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:33.884427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5481fada-360d-4901-b942-3789986257e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:33.885140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5481fada-360d-4901-b942-3789986257e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:34.029333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5481fada-360d-4901-b942-3789986257e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:34.040017 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5481fada-360d-4901-b942-3789986257e3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.171092 Oct 11 04:46:34.055550 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3336/6431] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:33 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:35.065042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6d96fe1f-a145-4f4a-ab77-16b69581401f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:35.067788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6d96fe1f-a145-4f4a-ab77-16b69581401f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:35.073306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d96fe1f-a145-4f4a-ab77-16b69581401f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:35.073796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d96fe1f-a145-4f4a-ab77-16b69581401f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:35.074451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d96fe1f-a145-4f4a-ab77-16b69581401f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:35.075313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d96fe1f-a145-4f4a-ab77-16b69581401f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:35.076001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d96fe1f-a145-4f4a-ab77-16b69581401f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:35.076604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d96fe1f-a145-4f4a-ab77-16b69581401f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:35.242051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6d96fe1f-a145-4f4a-ab77-16b69581401f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:35.255871 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6d96fe1f-a145-4f4a-ab77-16b69581401f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.194687 Oct 11 04:46:35.256567 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3096/6432] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:35 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:36.285306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af578110-ae34-4c35-b514-823eb54dff7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:36.286259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af578110-ae34-4c35-b514-823eb54dff7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:36.295034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af578110-ae34-4c35-b514-823eb54dff7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:36.295645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af578110-ae34-4c35-b514-823eb54dff7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:36.296439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af578110-ae34-4c35-b514-823eb54dff7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:36.297371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af578110-ae34-4c35-b514-823eb54dff7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:36.297905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af578110-ae34-4c35-b514-823eb54dff7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:36.298376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af578110-ae34-4c35-b514-823eb54dff7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:36.516612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-af578110-ae34-4c35-b514-823eb54dff7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:36.527448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af578110-ae34-4c35-b514-823eb54dff7c tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.245329 Oct 11 04:46:36.527860 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3337/6433] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:36 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:37.550686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3a30a1f9-8896-42d9-90fa-d38e53d476b9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:37.551302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3a30a1f9-8896-42d9-90fa-d38e53d476b9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:37.560583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a30a1f9-8896-42d9-90fa-d38e53d476b9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:37.561076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a30a1f9-8896-42d9-90fa-d38e53d476b9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:37.561707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a30a1f9-8896-42d9-90fa-d38e53d476b9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:37.562649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a30a1f9-8896-42d9-90fa-d38e53d476b9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:37.563106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a30a1f9-8896-42d9-90fa-d38e53d476b9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:37.563536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a30a1f9-8896-42d9-90fa-d38e53d476b9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:37.795625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3a30a1f9-8896-42d9-90fa-d38e53d476b9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:37.805545 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3a30a1f9-8896-42d9-90fa-d38e53d476b9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.258741 Oct 11 04:46:37.807067 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3097/6434] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:37 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:38.829379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13145aef-6461-4875-ad80-d43ffd681e78 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:38.830111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-13145aef-6461-4875-ad80-d43ffd681e78 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:38.839068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13145aef-6461-4875-ad80-d43ffd681e78 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:38.839828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13145aef-6461-4875-ad80-d43ffd681e78 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:38.840267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13145aef-6461-4875-ad80-d43ffd681e78 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:38.841187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13145aef-6461-4875-ad80-d43ffd681e78 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:38.841645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13145aef-6461-4875-ad80-d43ffd681e78 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:38.842075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13145aef-6461-4875-ad80-d43ffd681e78 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:39.008268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-13145aef-6461-4875-ad80-d43ffd681e78 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:39.039492 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-13145aef-6461-4875-ad80-d43ffd681e78 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.195872 Oct 11 04:46:39.039492 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3338/6435] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:38 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:40.060442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-230d4291-b068-4873-b3fa-ff5e332018eb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:40.061549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-230d4291-b068-4873-b3fa-ff5e332018eb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:40.068311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230d4291-b068-4873-b3fa-ff5e332018eb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:40.069141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230d4291-b068-4873-b3fa-ff5e332018eb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:40.069141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230d4291-b068-4873-b3fa-ff5e332018eb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:40.070102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230d4291-b068-4873-b3fa-ff5e332018eb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:40.070585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230d4291-b068-4873-b3fa-ff5e332018eb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:40.071669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-230d4291-b068-4873-b3fa-ff5e332018eb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:40.082304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:46:40.257393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-230d4291-b068-4873-b3fa-ff5e332018eb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:40.270134 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-230d4291-b068-4873-b3fa-ff5e332018eb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.213495 Oct 11 04:46:40.270809 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3098/6436] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:40 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:41.293983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2dadd4c9-0d25-45fe-be00-7339a034fc9a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:41.295273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2dadd4c9-0d25-45fe-be00-7339a034fc9a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:41.302427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2dadd4c9-0d25-45fe-be00-7339a034fc9a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:41.302915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2dadd4c9-0d25-45fe-be00-7339a034fc9a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:41.303855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2dadd4c9-0d25-45fe-be00-7339a034fc9a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:41.304045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2dadd4c9-0d25-45fe-be00-7339a034fc9a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:41.304688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2dadd4c9-0d25-45fe-be00-7339a034fc9a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:41.305108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2dadd4c9-0d25-45fe-be00-7339a034fc9a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:41.310445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=67 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:46:41.447740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2dadd4c9-0d25-45fe-be00-7339a034fc9a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:41.455872 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2dadd4c9-0d25-45fe-be00-7339a034fc9a tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.165717 Oct 11 04:46:41.456453 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3339/6437] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:41 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:42.481779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9330e38a-8fc5-497f-bdd4-5bc2c17c40fb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:42.481779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9330e38a-8fc5-497f-bdd4-5bc2c17c40fb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:42.488881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9330e38a-8fc5-497f-bdd4-5bc2c17c40fb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:42.489369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9330e38a-8fc5-497f-bdd4-5bc2c17c40fb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:42.489812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9330e38a-8fc5-497f-bdd4-5bc2c17c40fb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:42.490544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9330e38a-8fc5-497f-bdd4-5bc2c17c40fb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:42.491008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9330e38a-8fc5-497f-bdd4-5bc2c17c40fb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:42.491435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9330e38a-8fc5-497f-bdd4-5bc2c17c40fb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:42.634468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9330e38a-8fc5-497f-bdd4-5bc2c17c40fb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:42.642942 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9330e38a-8fc5-497f-bdd4-5bc2c17c40fb tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.166927 Oct 11 04:46:42.643508 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3099/6438] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:42 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:43.667716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8d643df8-24d8-436a-8ce0-27dc78e91844 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:43.668247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8d643df8-24d8-436a-8ce0-27dc78e91844 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:43.675333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d643df8-24d8-436a-8ce0-27dc78e91844 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:43.675817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d643df8-24d8-436a-8ce0-27dc78e91844 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:43.676253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d643df8-24d8-436a-8ce0-27dc78e91844 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:43.676969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d643df8-24d8-436a-8ce0-27dc78e91844 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:43.677421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d643df8-24d8-436a-8ce0-27dc78e91844 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:43.677844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8d643df8-24d8-436a-8ce0-27dc78e91844 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:43.809430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8d643df8-24d8-436a-8ce0-27dc78e91844 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:43.817212 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8d643df8-24d8-436a-8ce0-27dc78e91844 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.154028 Oct 11 04:46:43.818141 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3340/6439] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:43 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:44.840873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e87be5cf-b5a5-4672-8e89-dfb38f5e1611 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:44.841497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e87be5cf-b5a5-4672-8e89-dfb38f5e1611 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:44.848682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e87be5cf-b5a5-4672-8e89-dfb38f5e1611 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:44.849391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e87be5cf-b5a5-4672-8e89-dfb38f5e1611 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:44.850091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e87be5cf-b5a5-4672-8e89-dfb38f5e1611 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:44.850984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e87be5cf-b5a5-4672-8e89-dfb38f5e1611 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:44.851603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e87be5cf-b5a5-4672-8e89-dfb38f5e1611 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:44.852731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e87be5cf-b5a5-4672-8e89-dfb38f5e1611 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:45.130125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e87be5cf-b5a5-4672-8e89-dfb38f5e1611 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:45.140746 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e87be5cf-b5a5-4672-8e89-dfb38f5e1611 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.304435 Oct 11 04:46:45.158135 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3100/6440] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:44 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:46.166786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-18a3d15c-fabf-4d73-8df0-7c710b96d818 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:46.167404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-18a3d15c-fabf-4d73-8df0-7c710b96d818 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:46.180907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18a3d15c-fabf-4d73-8df0-7c710b96d818 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:46.181522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18a3d15c-fabf-4d73-8df0-7c710b96d818 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:46.183041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18a3d15c-fabf-4d73-8df0-7c710b96d818 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:46.184083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18a3d15c-fabf-4d73-8df0-7c710b96d818 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:46.197386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18a3d15c-fabf-4d73-8df0-7c710b96d818 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:46.203118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18a3d15c-fabf-4d73-8df0-7c710b96d818 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:46.501614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-18a3d15c-fabf-4d73-8df0-7c710b96d818 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:46.515173 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-18a3d15c-fabf-4d73-8df0-7c710b96d818 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.353618 Oct 11 04:46:46.521301 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3341/6441] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:46 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:47.548174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cb68c682-8111-4df1-bb11-544188b83262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:47.548858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cb68c682-8111-4df1-bb11-544188b83262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:47.561515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb68c682-8111-4df1-bb11-544188b83262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:47.563429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb68c682-8111-4df1-bb11-544188b83262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:47.564651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb68c682-8111-4df1-bb11-544188b83262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:47.567868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb68c682-8111-4df1-bb11-544188b83262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:47.568834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb68c682-8111-4df1-bb11-544188b83262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:47.569451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cb68c682-8111-4df1-bb11-544188b83262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:48.197081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cb68c682-8111-4df1-bb11-544188b83262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:48.213481 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cb68c682-8111-4df1-bb11-544188b83262 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.664612 Oct 11 04:46:48.214219 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3101/6442] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:47 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:49.240678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e14d785-8328-4c26-8994-092db31fae7b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:49.241979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e14d785-8328-4c26-8994-092db31fae7b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:49.279471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e14d785-8328-4c26-8994-092db31fae7b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:49.285377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e14d785-8328-4c26-8994-092db31fae7b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:49.285847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e14d785-8328-4c26-8994-092db31fae7b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:49.287776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e14d785-8328-4c26-8994-092db31fae7b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:49.288278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e14d785-8328-4c26-8994-092db31fae7b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:49.288717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e14d785-8328-4c26-8994-092db31fae7b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:49.558100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e14d785-8328-4c26-8994-092db31fae7b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:49.568131 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e14d785-8328-4c26-8994-092db31fae7b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.332258 Oct 11 04:46:49.578217 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3342/6443] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:49 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:50.595302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-42a16771-f319-4a4b-ad52-11fd546a3030 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:50.595947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-42a16771-f319-4a4b-ad52-11fd546a3030 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:50.603489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42a16771-f319-4a4b-ad52-11fd546a3030 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:50.603973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42a16771-f319-4a4b-ad52-11fd546a3030 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:50.604412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42a16771-f319-4a4b-ad52-11fd546a3030 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:50.605114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42a16771-f319-4a4b-ad52-11fd546a3030 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:50.605566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42a16771-f319-4a4b-ad52-11fd546a3030 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:50.605989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42a16771-f319-4a4b-ad52-11fd546a3030 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:50.801411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-42a16771-f319-4a4b-ad52-11fd546a3030 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:50.815354 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-42a16771-f319-4a4b-ad52-11fd546a3030 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.224082 Oct 11 04:46:50.816258 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3102/6444] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:50 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:51.839986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-12f8b478-841d-4a71-ad28-250beb64dd18 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:51.840599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-12f8b478-841d-4a71-ad28-250beb64dd18 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:51.847840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12f8b478-841d-4a71-ad28-250beb64dd18 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:51.848355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12f8b478-841d-4a71-ad28-250beb64dd18 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:51.848982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12f8b478-841d-4a71-ad28-250beb64dd18 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:51.849851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12f8b478-841d-4a71-ad28-250beb64dd18 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:51.850331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12f8b478-841d-4a71-ad28-250beb64dd18 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:51.850765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12f8b478-841d-4a71-ad28-250beb64dd18 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:51.987459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-12f8b478-841d-4a71-ad28-250beb64dd18 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:51.995316 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-12f8b478-841d-4a71-ad28-250beb64dd18 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.159176 Oct 11 04:46:51.996173 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3343/6445] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:51 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:53.020339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-acf55e83-3ba1-4d2d-97e9-b95dec3fcfd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:53.020990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-acf55e83-3ba1-4d2d-97e9-b95dec3fcfd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:53.028377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acf55e83-3ba1-4d2d-97e9-b95dec3fcfd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:53.028870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acf55e83-3ba1-4d2d-97e9-b95dec3fcfd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:53.029313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acf55e83-3ba1-4d2d-97e9-b95dec3fcfd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:53.030015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acf55e83-3ba1-4d2d-97e9-b95dec3fcfd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:53.030503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acf55e83-3ba1-4d2d-97e9-b95dec3fcfd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:53.030933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acf55e83-3ba1-4d2d-97e9-b95dec3fcfd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:53.201706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-acf55e83-3ba1-4d2d-97e9-b95dec3fcfd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:53.210336 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-acf55e83-3ba1-4d2d-97e9-b95dec3fcfd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.194077 Oct 11 04:46:53.211740 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3103/6446] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:53 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:54.234026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ad58043c-44d0-486a-9383-b1329f4c5ab3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:54.234664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ad58043c-44d0-486a-9383-b1329f4c5ab3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:54.242207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad58043c-44d0-486a-9383-b1329f4c5ab3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:54.242749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad58043c-44d0-486a-9383-b1329f4c5ab3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:54.243207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad58043c-44d0-486a-9383-b1329f4c5ab3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:54.244074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad58043c-44d0-486a-9383-b1329f4c5ab3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:54.244542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad58043c-44d0-486a-9383-b1329f4c5ab3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:54.244986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad58043c-44d0-486a-9383-b1329f4c5ab3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:54.406086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ad58043c-44d0-486a-9383-b1329f4c5ab3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:54.414095 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ad58043c-44d0-486a-9383-b1329f4c5ab3 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.184210 Oct 11 04:46:54.416597 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3344/6447] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:54 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:46:55.440792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a896a495-085f-4246-b67f-a479bd4f40a2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:55.442070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a896a495-085f-4246-b67f-a479bd4f40a2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:55.450287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a896a495-085f-4246-b67f-a479bd4f40a2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:55.450790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a896a495-085f-4246-b67f-a479bd4f40a2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:55.451226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a896a495-085f-4246-b67f-a479bd4f40a2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:55.451957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a896a495-085f-4246-b67f-a479bd4f40a2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:55.452797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a896a495-085f-4246-b67f-a479bd4f40a2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:55.453531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a896a495-085f-4246-b67f-a479bd4f40a2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:55.681588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a896a495-085f-4246-b67f-a479bd4f40a2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:55.689827 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a896a495-085f-4246-b67f-a479bd4f40a2 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.254125 Oct 11 04:46:55.690432 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3104/6448] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:55 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:56.714584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3bf67b5-b86d-4309-9d83-2defa04079b1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:56.715183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3bf67b5-b86d-4309-9d83-2defa04079b1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:56.724405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3bf67b5-b86d-4309-9d83-2defa04079b1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:56.725241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3bf67b5-b86d-4309-9d83-2defa04079b1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:56.726077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3bf67b5-b86d-4309-9d83-2defa04079b1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:56.727425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3bf67b5-b86d-4309-9d83-2defa04079b1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:56.728087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3bf67b5-b86d-4309-9d83-2defa04079b1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:56.728711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3bf67b5-b86d-4309-9d83-2defa04079b1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:56.925981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3bf67b5-b86d-4309-9d83-2defa04079b1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:56.943272 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3bf67b5-b86d-4309-9d83-2defa04079b1 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.233050 Oct 11 04:46:56.945263 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3345/6449] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:56 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:57.977624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b578b44b-843c-4405-847f-ba17f58f6771 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:57.977624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b578b44b-843c-4405-847f-ba17f58f6771 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:57.984133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=26 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:46:57.985527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b578b44b-843c-4405-847f-ba17f58f6771 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:57.986033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b578b44b-843c-4405-847f-ba17f58f6771 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:57.986482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b578b44b-843c-4405-847f-ba17f58f6771 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:57.987189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b578b44b-843c-4405-847f-ba17f58f6771 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:57.987640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b578b44b-843c-4405-847f-ba17f58f6771 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:57.988259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b578b44b-843c-4405-847f-ba17f58f6771 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:58.168194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b578b44b-843c-4405-847f-ba17f58f6771 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:58.175930 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b578b44b-843c-4405-847f-ba17f58f6771 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1485 microversion: 2.1 time: 0.203674 Oct 11 04:46:58.176498 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3105/6450] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:57 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1485 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:58.201256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0c89c93a-6d87-41d8-b395-762dd7f99143 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:46:58.201800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0c89c93a-6d87-41d8-b395-762dd7f99143 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:58.204486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=30 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:46:58.209256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c89c93a-6d87-41d8-b395-762dd7f99143 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:58.209750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c89c93a-6d87-41d8-b395-762dd7f99143 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:58.210730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c89c93a-6d87-41d8-b395-762dd7f99143 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:58.211432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c89c93a-6d87-41d8-b395-762dd7f99143 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:58.211888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c89c93a-6d87-41d8-b395-762dd7f99143 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:58.212316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0c89c93a-6d87-41d8-b395-762dd7f99143 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:58.582856 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0c89c93a-6d87-41d8-b395-762dd7f99143 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "POST /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258/action" status: 202 len: 0 microversion: 2.1 time: 0.378917 Oct 11 04:46:58.582856 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3346/6451] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:46:58 2022] POST /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:46:58.592557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fd484814-4748-4851-82cf-91647bc5e493 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:58.599688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fd484814-4748-4851-82cf-91647bc5e493 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:58.612747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd484814-4748-4851-82cf-91647bc5e493 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:58.613636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd484814-4748-4851-82cf-91647bc5e493 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:58.614343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd484814-4748-4851-82cf-91647bc5e493 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:58.615938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd484814-4748-4851-82cf-91647bc5e493 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:58.616668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd484814-4748-4851-82cf-91647bc5e493 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:58.618010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd484814-4748-4851-82cf-91647bc5e493 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:58.837515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fd484814-4748-4851-82cf-91647bc5e493 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:46:58.873270 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fd484814-4748-4851-82cf-91647bc5e493 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1493 microversion: 2.1 time: 0.285231 Oct 11 04:46:58.874344 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3106/6452] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:58 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1493 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:46:59.907776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cab86fc3-3f4b-4987-87da-17d5be546585 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:46:59.909538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cab86fc3-3f4b-4987-87da-17d5be546585 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:46:59.941621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cab86fc3-3f4b-4987-87da-17d5be546585 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:59.948437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cab86fc3-3f4b-4987-87da-17d5be546585 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:59.949152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cab86fc3-3f4b-4987-87da-17d5be546585 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:46:59.951021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cab86fc3-3f4b-4987-87da-17d5be546585 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:46:59.958399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cab86fc3-3f4b-4987-87da-17d5be546585 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:46:59.959293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cab86fc3-3f4b-4987-87da-17d5be546585 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:00.246441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cab86fc3-3f4b-4987-87da-17d5be546585 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:00.254943 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cab86fc3-3f4b-4987-87da-17d5be546585 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1493 microversion: 2.1 time: 0.354069 Oct 11 04:47:00.255541 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3347/6453] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:46:59 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1493 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:47:01.281808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7dfa92c9-45b4-4984-a024-38d2109f64f6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:01.283018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7dfa92c9-45b4-4984-a024-38d2109f64f6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:01.295476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dfa92c9-45b4-4984-a024-38d2109f64f6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:01.297613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dfa92c9-45b4-4984-a024-38d2109f64f6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:01.297613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dfa92c9-45b4-4984-a024-38d2109f64f6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:01.297613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dfa92c9-45b4-4984-a024-38d2109f64f6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:01.307746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dfa92c9-45b4-4984-a024-38d2109f64f6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:01.308897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7dfa92c9-45b4-4984-a024-38d2109f64f6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:01.635113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7dfa92c9-45b4-4984-a024-38d2109f64f6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:01.644508 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7dfa92c9-45b4-4984-a024-38d2109f64f6 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1493 microversion: 2.1 time: 0.368624 Oct 11 04:47:01.645558 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3107/6454] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:01 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1493 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:47:02.672434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d63b111c-51b1-4220-954d-6019cba6e566 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:02.673723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d63b111c-51b1-4220-954d-6019cba6e566 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:02.689791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d63b111c-51b1-4220-954d-6019cba6e566 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:02.690600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d63b111c-51b1-4220-954d-6019cba6e566 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:02.691034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d63b111c-51b1-4220-954d-6019cba6e566 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:02.692007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d63b111c-51b1-4220-954d-6019cba6e566 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:02.692467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d63b111c-51b1-4220-954d-6019cba6e566 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:02.692890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d63b111c-51b1-4220-954d-6019cba6e566 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:03.057781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d63b111c-51b1-4220-954d-6019cba6e566 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:03.071420 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d63b111c-51b1-4220-954d-6019cba6e566 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1499 microversion: 2.1 time: 0.402856 Oct 11 04:47:03.076354 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3348/6455] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:02 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1499 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:47:03.106539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d7326a4a-b169-44aa-9ee5-0c281fd5b824 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:03.107691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d7326a4a-b169-44aa-9ee5-0c281fd5b824 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:03.119234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7326a4a-b169-44aa-9ee5-0c281fd5b824 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:03.119973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7326a4a-b169-44aa-9ee5-0c281fd5b824 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:03.121661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7326a4a-b169-44aa-9ee5-0c281fd5b824 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:03.125704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7326a4a-b169-44aa-9ee5-0c281fd5b824 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:03.125704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7326a4a-b169-44aa-9ee5-0c281fd5b824 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:03.125704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7326a4a-b169-44aa-9ee5-0c281fd5b824 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:03.164394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d7326a4a-b169-44aa-9ee5-0c281fd5b824 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:47:03.690875 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d7326a4a-b169-44aa-9ee5-0c281fd5b824 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 204 len: 0 microversion: 2.1 time: 0.589134 Oct 11 04:47:03.691472 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3108/6456] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:47:03 2022] DELETE /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:47:03.704914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-03606a60-b6a8-4509-99b9-bc1316e95c9f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:03.704914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-03606a60-b6a8-4509-99b9-bc1316e95c9f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:03.710549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03606a60-b6a8-4509-99b9-bc1316e95c9f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:03.713436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03606a60-b6a8-4509-99b9-bc1316e95c9f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:03.717068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03606a60-b6a8-4509-99b9-bc1316e95c9f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:03.718068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03606a60-b6a8-4509-99b9-bc1316e95c9f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:03.720469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03606a60-b6a8-4509-99b9-bc1316e95c9f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:03.721123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03606a60-b6a8-4509-99b9-bc1316e95c9f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:04.062156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-03606a60-b6a8-4509-99b9-bc1316e95c9f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:04.071305 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-03606a60-b6a8-4509-99b9-bc1316e95c9f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.375330 Oct 11 04:47:04.098720 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3349/6457] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:03 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:47:05.107836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5804331e-fc6a-45ba-8f1c-c334656c0128 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:05.109187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5804331e-fc6a-45ba-8f1c-c334656c0128 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:05.122653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5804331e-fc6a-45ba-8f1c-c334656c0128 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:05.125695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5804331e-fc6a-45ba-8f1c-c334656c0128 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:05.130162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5804331e-fc6a-45ba-8f1c-c334656c0128 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:05.130162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5804331e-fc6a-45ba-8f1c-c334656c0128 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:05.130162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5804331e-fc6a-45ba-8f1c-c334656c0128 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:05.130162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5804331e-fc6a-45ba-8f1c-c334656c0128 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:05.812391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5804331e-fc6a-45ba-8f1c-c334656c0128 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:05.828782 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5804331e-fc6a-45ba-8f1c-c334656c0128 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.727496 Oct 11 04:47:05.830689 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3109/6458] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:05 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 730 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:47:06.859673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3f8811e4-0ecf-4f2d-b907-afba15d5960f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:06.861210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3f8811e4-0ecf-4f2d-b907-afba15d5960f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:06.874938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f8811e4-0ecf-4f2d-b907-afba15d5960f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:06.878336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f8811e4-0ecf-4f2d-b907-afba15d5960f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:06.879153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f8811e4-0ecf-4f2d-b907-afba15d5960f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:06.882007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f8811e4-0ecf-4f2d-b907-afba15d5960f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:06.882760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f8811e4-0ecf-4f2d-b907-afba15d5960f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:06.883461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f8811e4-0ecf-4f2d-b907-afba15d5960f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:07.191779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3f8811e4-0ecf-4f2d-b907-afba15d5960f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:07.206919 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3f8811e4-0ecf-4f2d-b907-afba15d5960f tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1505 microversion: 2.1 time: 0.355658 Oct 11 04:47:07.207885 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3350/6459] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:06 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1505 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:47:07.674577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-fce9be96-a9f1-4bd2-ae67-d5bfb1f41a5c req-ba56e288-2005-4a3d-b591-a4ef8ab15a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd0e672f-59ce-444d-a99a-0b9a5a657258", "name": "network-vif-deleted", "tag": "a137e011-e546-45b4-a03b-0d0fff982b24"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:47:07.692396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fce9be96-a9f1-4bd2-ae67-d5bfb1f41a5c req-ba56e288-2005-4a3d-b591-a4ef8ab15a26 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:07.692974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fce9be96-a9f1-4bd2-ae67-d5bfb1f41a5c req-ba56e288-2005-4a3d-b591-a4ef8ab15a26 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:07.693554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fce9be96-a9f1-4bd2-ae67-d5bfb1f41a5c req-ba56e288-2005-4a3d-b591-a4ef8ab15a26 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:07.707087 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-fce9be96-a9f1-4bd2-ae67-d5bfb1f41a5c req-ba56e288-2005-4a3d-b591-a4ef8ab15a26 service nova] Creating event network-vif-deleted:a137e011-e546-45b4-a03b-0d0fff982b24 for instance dd0e672f-59ce-444d-a99a-0b9a5a657258 on n-h1-860892-1 Oct 11 04:47:07.713120 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-fce9be96-a9f1-4bd2-ae67-d5bfb1f41a5c req-ba56e288-2005-4a3d-b591-a4ef8ab15a26 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042207 Oct 11 04:47:07.713873 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3110/6460] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:47:08.233723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:08.234483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:08.246131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:08.247739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:08.248443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:08.251394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:08.252090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:08.254421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:08.341491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:08.341968 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:08.346648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:08.348697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lazy-loading 'fault' on Instance uuid dd0e672f-59ce-444d-a99a-0b9a5a657258 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:47:08.476992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:08.502005 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04f897cf-a81a-4343-9166-c66849a253e9 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 200 len: 1303 microversion: 2.1 time: 0.267126 Oct 11 04:47:08.502685 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3351/6461] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:08 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 1303 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:47:09.531346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:09.532098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: dd0e672f-59ce-444d-a99a-0b9a5a657258] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:09.539441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:09.539936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:09.540382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:09.541087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:09.541597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:09.541975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:09.557538 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] HTTP exception thrown: Instance dd0e672f-59ce-444d-a99a-0b9a5a657258 could not be found. Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Request method failure captured: Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 HTTP/1.1 Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPTls2ECaJulxSvxPpNiyXS0hhKpGP-mfaNmRHNKn2U2aq9hnKNfg0ok50QW16tKD7dppdJwvGNs9Kbe6s7nlpsBMH0MqFNwNy7uI85gy1dGCnOMtHhEHYvng_3xkhE99GN-WYLITqSDr2XnedpcF4qNjUsKk4TOmp_n4e-Gxx48Lds Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 86019ef4f0ae45228aa7ede8079c2dad Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerRescueTestJSON-1681057449 Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86019ef4f0ae45228aa7ede8079c2dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86019ef4f0ae45228aa7ede8079c2dad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86019ef4f0ae45228aa7ede8079c2dad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86019ef4f0ae45228aa7ede8079c2dad"}]}] Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerRescueTestJSON-1681057449 Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 86019ef4f0ae45228aa7ede8079c2dad Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerRescueTestJSON-1681057449 Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerRescueTestJSON-1681057449-project Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 0539f747d9024059876461607f48c0a5 Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerRescueTestJSON-1681057449-project Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance dd0e672f-59ce-444d-a99a-0b9a5a657258 could not be found. Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'dd0e672f-59ce-444d-a99a-0b9a5a657258'} Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd0e672f-59ce-444d-a99a-0b9a5a657258 could not be found. Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd0e672f-59ce-444d-a99a-0b9a5a657258 could not be found. Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:47:09.559103 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:47:09.564372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:47:09.564372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:47:09.564372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:47:09.564372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:47:09.564372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:47:09.564372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd0e672f-59ce-444d-a99a-0b9a5a657258 could not be found. Oct 11 04:47:09.564372 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:47:09.564372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Returning 404 to user: Instance dd0e672f-59ce-444d-a99a-0b9a5a657258 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:47:09.564372 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7492781b-c91b-4528-934f-861575ba3225 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258" status: 404 len: 111 microversion: 2.1 time: 0.037062 Oct 11 04:47:09.564372 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3111/6462] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:09 2022] GET /compute/v2.1/servers/dd0e672f-59ce-444d-a99a-0b9a5a657258 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:47:09.569358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-94a751dd-9ad2-47d7-b704-08830eb51038 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:09.569837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-94a751dd-9ad2-47d7-b704-08830eb51038 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:09.577365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a751dd-9ad2-47d7-b704-08830eb51038 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:09.577883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a751dd-9ad2-47d7-b704-08830eb51038 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:09.578347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a751dd-9ad2-47d7-b704-08830eb51038 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:09.579068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a751dd-9ad2-47d7-b704-08830eb51038 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:09.579488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a751dd-9ad2-47d7-b704-08830eb51038 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:09.579907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94a751dd-9ad2-47d7-b704-08830eb51038 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:09.614536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-94a751dd-9ad2-47d7-b704-08830eb51038 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:47:09.736732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:47:09.987760 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-94a751dd-9ad2-47d7-b704-08830eb51038 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 204 len: 0 microversion: 2.1 time: 0.422033 Oct 11 04:47:09.988702 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3352/6463] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:47:09 2022] DELETE /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:47:09.997664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f41ac65-4510-4a83-8ce2-c49d6fdc081b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:09.999963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f41ac65-4510-4a83-8ce2-c49d6fdc081b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:10.013438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f41ac65-4510-4a83-8ce2-c49d6fdc081b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:10.020903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f41ac65-4510-4a83-8ce2-c49d6fdc081b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:10.022242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f41ac65-4510-4a83-8ce2-c49d6fdc081b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:10.023652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f41ac65-4510-4a83-8ce2-c49d6fdc081b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:10.024580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f41ac65-4510-4a83-8ce2-c49d6fdc081b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:10.024961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f41ac65-4510-4a83-8ce2-c49d6fdc081b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:10.339768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f41ac65-4510-4a83-8ce2-c49d6fdc081b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:10.348843 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f41ac65-4510-4a83-8ce2-c49d6fdc081b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1492 microversion: 2.1 time: 0.355722 Oct 11 04:47:10.350384 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3112/6464] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:09 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1492 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:47:11.380420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a2e7e2ad-5b59-4c45-909b-151c6fa58589 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:11.380420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a2e7e2ad-5b59-4c45-909b-151c6fa58589 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:11.384893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2e7e2ad-5b59-4c45-909b-151c6fa58589 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:11.385498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2e7e2ad-5b59-4c45-909b-151c6fa58589 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:11.385941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2e7e2ad-5b59-4c45-909b-151c6fa58589 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:11.387297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2e7e2ad-5b59-4c45-909b-151c6fa58589 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:11.388017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2e7e2ad-5b59-4c45-909b-151c6fa58589 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:11.388457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2e7e2ad-5b59-4c45-909b-151c6fa58589 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:11.602158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a2e7e2ad-5b59-4c45-909b-151c6fa58589 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:11.618782 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a2e7e2ad-5b59-4c45-909b-151c6fa58589 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1492 microversion: 2.1 time: 0.247805 Oct 11 04:47:11.619409 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3353/6465] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:11 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1492 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:47:12.645043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-49f82d1a-293c-4ebe-9ebd-49fa2e254bd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:12.645876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-49f82d1a-293c-4ebe-9ebd-49fa2e254bd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:12.660397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f82d1a-293c-4ebe-9ebd-49fa2e254bd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:12.661208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f82d1a-293c-4ebe-9ebd-49fa2e254bd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:12.661846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f82d1a-293c-4ebe-9ebd-49fa2e254bd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:12.662730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f82d1a-293c-4ebe-9ebd-49fa2e254bd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:12.663344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f82d1a-293c-4ebe-9ebd-49fa2e254bd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:12.666985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f82d1a-293c-4ebe-9ebd-49fa2e254bd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:12.824593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-49f82d1a-293c-4ebe-9ebd-49fa2e254bd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:12.838288 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-49f82d1a-293c-4ebe-9ebd-49fa2e254bd8 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1450 microversion: 2.1 time: 0.197558 Oct 11 04:47:12.854217 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3113/6466] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:12 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1450 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:47:13.100147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5ff3da17-5759-4bd9-82f7-bcf9c7cba83b req-568606fa-67e1-4dac-9a86-e2e1cb491523 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca", "name": "network-vif-deleted", "tag": "f6eeffc5-7644-4587-8a4f-40ce1795af46"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:47:13.111826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5ff3da17-5759-4bd9-82f7-bcf9c7cba83b req-568606fa-67e1-4dac-9a86-e2e1cb491523 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:13.112326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5ff3da17-5759-4bd9-82f7-bcf9c7cba83b req-568606fa-67e1-4dac-9a86-e2e1cb491523 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:13.112752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5ff3da17-5759-4bd9-82f7-bcf9c7cba83b req-568606fa-67e1-4dac-9a86-e2e1cb491523 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:13.126645 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5ff3da17-5759-4bd9-82f7-bcf9c7cba83b req-568606fa-67e1-4dac-9a86-e2e1cb491523 service nova] Creating event network-vif-deleted:f6eeffc5-7644-4587-8a4f-40ce1795af46 for instance fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca on n-h2-860892-1 Oct 11 04:47:13.132828 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5ff3da17-5759-4bd9-82f7-bcf9c7cba83b req-568606fa-67e1-4dac-9a86-e2e1cb491523 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.244509 Oct 11 04:47:13.134737 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3354/6467] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:47:13.864188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:13.865077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:13.875353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:13.875846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:13.876362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:13.877074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:13.877527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:13.878990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:13.903619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:47:13.924977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:13.925728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:13.926356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:13.927154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lazy-loading 'fault' on Instance uuid fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:47:13.973240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0539f747d9024059876461607f48c0a5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86019ef4f0ae45228aa7ede8079c2dad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:13.982513 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ed731c62-2d48-4298-9e61-1a90cbcf213b tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 200 len: 1303 microversion: 2.1 time: 0.122162 Oct 11 04:47:13.986815 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3114/6468] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:13 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 1303 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:47:15.008364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:15.009072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] [instance: fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:15.015990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:15.016474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:15.016911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:15.017929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:15.018420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:15.018846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:15.032365 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] HTTP exception thrown: Instance fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca could not be found. Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Request method failure captured: Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca HTTP/1.1 Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPTls2ECaJulxSvxPpNiyXS0hhKpGP-mfaNmRHNKn2U2aq9hnKNfg0ok50QW16tKD7dppdJwvGNs9Kbe6s7nlpsBMH0MqFNwNy7uI85gy1dGCnOMtHhEHYvng_3xkhE99GN-WYLITqSDr2XnedpcF4qNjUsKk4TOmp_n4e-Gxx48Lds Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 86019ef4f0ae45228aa7ede8079c2dad Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerRescueTestJSON-1681057449 Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/86019ef4f0ae45228aa7ede8079c2dad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_86019ef4f0ae45228aa7ede8079c2dad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86019ef4f0ae45228aa7ede8079c2dad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/86019ef4f0ae45228aa7ede8079c2dad"}]}] Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerRescueTestJSON-1681057449 Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 86019ef4f0ae45228aa7ede8079c2dad Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerRescueTestJSON-1681057449 Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerRescueTestJSON-1681057449-project Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 0539f747d9024059876461607f48c0a5 Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerRescueTestJSON-1681057449-project Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca could not be found. Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca'} Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca could not be found. Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca could not be found. Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:47:15.034775 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:47:15.038849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:47:15.038849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:47:15.038849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:47:15.038849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:47:15.038849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:47:15.038849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca could not be found. Oct 11 04:47:15.038849 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:47:15.038849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] Returning 404 to user: Instance fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:47:15.038849 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-25be8ee7-5200-42c7-95b1-d426108fe790 tempest-ServerRescueTestJSON-1681057449 tempest-ServerRescueTestJSON-1681057449-project] 10.222.0.26 "GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca" status: 404 len: 111 microversion: 2.1 time: 0.033785 Oct 11 04:47:15.038849 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3355/6469] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:47:15 2022] GET /compute/v2.1/servers/fc4cbe1a-6bef-4b93-8dfe-923637c9e8ca => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:47:23.268659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-1250808060", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": "none"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:47:23.377111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:47:23.377821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:47:23.379007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:47:23.379560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:47:23.380185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:47:23.390542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:23.391033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:23.391464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:23.392183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:23.392928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:23.393304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:23.413098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Getting quotas for project 8d5989b30c524868857d8f93e7855b2f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:47:23.419136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Getting quotas for user 80de66dd45b9417d99d35031fb754223 and project 8d5989b30c524868857d8f93e7855b2f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:47:23.433328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:47:23.436311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: ed3a5171-3f07-4673-85cd-f20e95da6190] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:47:23.645896 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1adc6bf9-0228-438f-a391-c6d44c9579a6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.607380 Oct 11 04:47:23.647534 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3115/6470] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:47:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 610 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:47:23.658676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5997e5f9-cdef-46fc-9412-62da3951eff1 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:23.659296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5997e5f9-cdef-46fc-9412-62da3951eff1 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: ed3a5171-3f07-4673-85cd-f20e95da6190] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:23.749571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5997e5f9-cdef-46fc-9412-62da3951eff1 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:23.757591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5997e5f9-cdef-46fc-9412-62da3951eff1 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:23.759045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5997e5f9-cdef-46fc-9412-62da3951eff1 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:23.760192 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5997e5f9-cdef-46fc-9412-62da3951eff1 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190" status: 200 len: 1278 microversion: 2.47 time: 0.105443 Oct 11 04:47:23.772014 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3356/6471] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:23 2022] GET /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190 => generated 1278 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:23.988780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerShowV247Test-server-586534898", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": "none"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:47:24.133325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:47:24.136325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:47:24.138434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:47:24.139358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:47:24.140170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:47:24.162276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:24.163045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:24.163673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:24.164628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:24.165481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:24.166163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:24.195001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Getting quotas for project 8d5989b30c524868857d8f93e7855b2f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:47:24.202779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Getting quotas for user 80de66dd45b9417d99d35031fb754223 and project 8d5989b30c524868857d8f93e7855b2f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:47:24.233400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:47:24.236265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:47:24.559874 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3815da6-a648-4c1c-968e-da07320b6ba2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.47 time: 0.578394 Oct 11 04:47:24.566906 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3116/6472] 10.222.0.26 () {62 vars in 1188 bytes} [Tue Oct 11 04:47:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 11 04:47:24.583270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40c0d1e9-ffa4-41be-a882-424a9cf95a0c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Action: 'update', calling method: >, body: {"server": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:47:24.594724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-40c0d1e9-ffa4-41be-a882-424a9cf95a0c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:24.711922 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40c0d1e9-ffa4-41be-a882-424a9cf95a0c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "PUT /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 991 microversion: 2.47 time: 0.136779 Oct 11 04:47:24.712881 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3357/6473] 10.222.0.26 () {62 vars in 1297 bytes} [Tue Oct 11 04:47:24 2022] PUT /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 991 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 11 04:47:24.734473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ccec5ebf-0807-49e8-a403-dc830c77f9ca tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:24.739889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ccec5ebf-0807-49e8-a403-dc830c77f9ca tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:24.799819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ccec5ebf-0807-49e8-a403-dc830c77f9ca tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:24.811754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ccec5ebf-0807-49e8-a403-dc830c77f9ca tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:24.813596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ccec5ebf-0807-49e8-a403-dc830c77f9ca tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:24.816675 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ccec5ebf-0807-49e8-a403-dc830c77f9ca tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1277 microversion: 2.47 time: 0.087703 Oct 11 04:47:24.829466 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3117/6474] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:24 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:25.847878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0fbe0d30-ab92-4255-9fb2-113f303f4c43 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:25.850817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0fbe0d30-ab92-4255-9fb2-113f303f4c43 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:25.861921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=10 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:47:26.047045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0fbe0d30-ab92-4255-9fb2-113f303f4c43 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:26.056065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0fbe0d30-ab92-4255-9fb2-113f303f4c43 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:26.057524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0fbe0d30-ab92-4255-9fb2-113f303f4c43 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:26.058845 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0fbe0d30-ab92-4255-9fb2-113f303f4c43 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1277 microversion: 2.47 time: 0.216432 Oct 11 04:47:26.059566 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3358/6475] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:25 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1277 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:27.085676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:27.086988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:27.095771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:27.096259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:27.096693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:27.097624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:27.098203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:27.099232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:27.207721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:27.220952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:27.221988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:27.224507 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5e2ed09b-fa69-44df-90c0-1424462e1486 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1329 microversion: 2.47 time: 0.142424 Oct 11 04:47:27.225220 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3118/6476] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:27 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1329 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:28.261365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:28.262629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:28.276846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:28.277511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:28.278099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:28.278973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:28.279575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:28.280376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:28.437144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:28.452668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:28.454681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:28.456036 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dcb3ad07-a6f4-489f-bfe8-6723a797e56a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1337 microversion: 2.47 time: 0.206803 Oct 11 04:47:28.477223 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3359/6477] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:28 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1337 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:29.495711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:29.496350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:29.507879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:29.508407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:29.508854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:29.509585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:29.510045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:29.510501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:29.712264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:29.723239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:29.724702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:29.726640 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-194ed4f9-16a9-4982-af14-eeac476fc942 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1335 microversion: 2.47 time: 0.235064 Oct 11 04:47:29.727314 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3119/6478] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:29 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1335 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:30.767606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:30.768273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:30.775974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:47:30.786171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:30.787478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:30.788169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:30.790573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:30.792206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:30.793002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:31.072725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:31.083384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:31.085307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:31.094685 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-392c6e50-d471-4904-965f-363228706a61 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1335 microversion: 2.47 time: 0.331951 Oct 11 04:47:31.095296 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3360/6479] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:30 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1335 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:32.123783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:32.124402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:32.127189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:47:32.142683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:32.143427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:32.143870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:32.144584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:32.149100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:32.149100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:32.265130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:32.284192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:32.286386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:32.293387 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f0d3baa3-b0cd-46a5-88ce-b7ad8916ea5f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1335 microversion: 2.47 time: 0.173428 Oct 11 04:47:32.314739 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3120/6480] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:32 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1335 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:33.331713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:33.331713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:33.334998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:33.342516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:33.343139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:33.343921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:33.344392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:33.344819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:33.433067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:33.444516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:33.446327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:33.447903 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-be6cb63b-d48e-4de4-a30a-ea6f4d701091 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1335 microversion: 2.47 time: 0.129516 Oct 11 04:47:33.449123 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3361/6481] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:33 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1335 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:34.480740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:34.481352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:34.485886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:47:34.503218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:34.503218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:34.503218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:34.503218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:34.503218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:34.503218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:34.673546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:34.686990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:34.688680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:34.689916 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-99f5731b-3682-485f-87c4-d3786d54449e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1335 microversion: 2.47 time: 0.217562 Oct 11 04:47:34.690513 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3121/6482] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:34 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1335 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:35.717951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:35.718615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:35.727291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:35.727826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:35.728276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:35.729172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:35.729650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:35.730087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:35.809647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:35.820078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:35.821561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:35.822781 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2b73649e-8220-409f-9a71-decf3388e890 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1356 microversion: 2.47 time: 0.109552 Oct 11 04:47:35.823357 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3362/6483] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:35 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1356 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:35.857275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:47:35.859224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:35.863364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=14 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:47:35.869411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:35.870098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:35.870720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:35.871593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:35.872198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:35.872772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:36.028227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:47:36.038322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:47:36.042294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:47:36.044606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:47:36.045038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:47:36.428382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:36.444344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:36.444849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:36.445296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:36.446010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:36.446504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:36.446937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:36.492189 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-894d3ef9-f321-44a9-aa67-c39e1c2c65cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "POST /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5/action" status: 202 len: 1078 microversion: 2.47 time: 0.647371 Oct 11 04:47:36.493502 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3122/6484] 10.222.0.26 () {62 vars in 1319 bytes} [Tue Oct 11 04:47:35 2022] POST /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5/action => generated 1078 bytes in 649 msecs (HTTP/1.1 202) 10 headers in 454 bytes (1 switches on core 0) Oct 11 04:47:36.513624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:36.515017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:36.521029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:47:36.522800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:36.523442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:36.524030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:36.524922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:36.525629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:36.528231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:36.624280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:36.637562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:36.639321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:36.640955 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e942378b-6297-4689-9107-e041a9218275 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.131358 Oct 11 04:47:36.642275 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3363/6485] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:36 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:37.670587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:37.671211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:37.678218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:37.678723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:37.679161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:37.679857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:37.680468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:37.681073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:37.813738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:37.825668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:37.833192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:37.835300 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e58a2718-da81-4106-b677-943ea3aeccdd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.170234 Oct 11 04:47:37.836607 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3123/6486] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:37 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:38.868673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:38.869281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:38.887882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:38.892306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:38.893106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:38.894041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:38.897219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:38.897970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:39.102675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:39.117515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:39.120201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:39.121699 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-684883da-61a0-4c82-b89a-c1af0446c8cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.259807 Oct 11 04:47:39.126590 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3364/6487] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:38 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:40.151950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:40.153199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:40.158743 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 04:47:40.167449 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 04:47:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 (ip 10.222.0.26) !!! Oct 11 04:47:40.179425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:40.180593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:40.181751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:40.183395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:40.184808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:40.188587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:40.442004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:40.450775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:40.452208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:40.453385 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4933e86c-3299-47ab-8bd9-cde0e3a21ffe tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.305608 Oct 11 04:47:40.453942 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3124/6488] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:40 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:41.495198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:41.495831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:41.507458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:41.508214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:41.508663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:41.509375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:41.509830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:41.510278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:41.620665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:41.630750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:41.636018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:41.640419 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-655116bd-c206-4ee6-bfb0-bdaa90b6865c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.160819 Oct 11 04:47:41.646589 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3365/6489] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:41 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:47:42.673225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:42.674605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:42.683704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:42.688541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:42.690787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:42.692260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:42.696534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:42.697189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:42.810140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:42.821990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:42.823967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:42.825297 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3207e1c2-83db-45c6-9ef6-83f6ac410d8e tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.156254 Oct 11 04:47:42.826338 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3125/6490] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:42 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:43.853318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:43.855253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:43.871820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:43.872885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:43.873660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:43.874856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:43.875778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:43.877293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:43.971186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:43.982118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:43.984402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:43.985596 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fbb9c770-4446-465c-bbba-39646fa8d3ae tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.138336 Oct 11 04:47:43.986158 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3366/6491] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:43 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:45.015092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:45.015805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:45.035249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:45.038551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:45.039100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:45.041267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:45.041936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:45.042558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:45.153479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:45.180311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:45.184670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:45.185909 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3d36ea7-4d76-4706-b1d4-97bb3cbe05a5 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.177323 Oct 11 04:47:45.195121 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3126/6492] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:45 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:46.213991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:46.215207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:46.249643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:46.251740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:46.254157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:46.256454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:46.258812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:46.259422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:46.492212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:46.510497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:46.514736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:46.537579 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a380171-d1ff-4b86-9214-6f8075701f3b tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.314778 Oct 11 04:47:46.546721 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3367/6493] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:46 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:47.565975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:47.567311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:47.580743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:47.582904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:47.583577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:47.589229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:47.589957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:47.590654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:47.815243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:47.825264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:47.838208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:47.843119 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b2287c8-f702-422e-826d-5332aa7c2920 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.278538 Oct 11 04:47:47.843119 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3127/6494] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:47 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:48.870132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:48.870776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:48.890314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:48.895272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:48.895272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:48.895272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:48.895272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:48.895272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:49.048440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:49.060865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:49.062963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:49.064911 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-36e10229-26d9-46b5-a7e8-1879fcb7a59d tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.198567 Oct 11 04:47:49.065838 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3368/6495] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:48 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:47:50.093133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:50.094811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:50.103842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:50.104564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:50.105194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:50.106431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:50.107051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:50.108240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:50.359368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:50.373124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:50.377550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:50.379914 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f90bb18-2c25-443e-bc0c-8ba6396ff4b6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.291414 Oct 11 04:47:50.382706 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3128/6496] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:50 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:51.417212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:51.417891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:51.441235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:51.442118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:51.442727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:51.443759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:51.444444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:51.445025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:51.573044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:51.593387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:51.600141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:51.603761 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-79407569-a775-4cab-be09-da09327a7980 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.193162 Oct 11 04:47:51.607035 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3369/6497] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:51 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:52.644224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:52.645956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:52.664188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:52.668888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:52.670477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:52.677129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:52.680181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:52.683913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:52.850427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:52.883802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:52.883802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:52.898967 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8a550389-df6e-47a9-98f8-dd57ef83d280 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.263395 Oct 11 04:47:52.899584 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3129/6498] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:52 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:53.928109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:53.928731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:53.947791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:53.959028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:53.959958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:53.960900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:53.961532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:53.962307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:54.167990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:54.184240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:54.188027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:54.189476 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72c23dfb-70d6-4775-aeb1-d89808b1b501 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.265529 Oct 11 04:47:54.191150 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3370/6499] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:53 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:55.218952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:55.220496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:55.229043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:55.233317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:55.237717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:55.239596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:55.240475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:55.241548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:55.256832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:47:55.390770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:55.406026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:55.408310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:55.416282 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68c0691a-0520-4b9e-8248-7b8bce57b5f0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.201083 Oct 11 04:47:55.431667 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3130/6500] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:55 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:56.446276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:56.448822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:56.457348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:56.458649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:56.459304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:56.460226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:56.460684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:56.461343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:56.587919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:56.598921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:56.600863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:56.602810 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f2a68a82-3dab-40a7-b2e2-ad6b7ed7c228 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.163068 Oct 11 04:47:56.603553 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3371/6501] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:56 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:57.631833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:57.632504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:57.641199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:57.642069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:57.642609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:57.643993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:57.644637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:57.644981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:57.729135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:57.739857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:57.741539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:57.743093 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09d434f1-b800-4ca5-b6e1-2e11410379cc tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.115948 Oct 11 04:47:57.743761 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3131/6502] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:57 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:47:58.794133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:47:58.794133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:47:58.802179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:58.805207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:58.809570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:58.812506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:47:58.813021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:47:58.815624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:47:59.038359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:59.050172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:59.060115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:47:59.069523 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-38bc572d-92e0-4788-9271-fedbc97aabd6 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.296179 Oct 11 04:47:59.070223 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3372/6503] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:47:58 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:00.101222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:00.102490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:00.132288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:00.133120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:00.133715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:00.134664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:00.135288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:00.135916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:00.398322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:00.413132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:00.414995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:00.420141 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d3e07677-2c4d-40f1-afc4-c953dd1b60cd tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.324069 Oct 11 04:48:00.421103 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3132/6504] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:00 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:01.448630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:01.449384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:01.462876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:01.463884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:01.464928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:01.466065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:01.466807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:01.467664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:01.473390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=85 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:48:02.108295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:02.119321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:02.123034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:02.124238 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d2dd9474-9aef-4e5e-9b69-a9fe4a76e9ea tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.680269 Oct 11 04:48:02.124807 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3373/6505] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:01 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:03.156556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:03.157193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:03.178089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:03.178607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:03.179042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:03.179743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:03.183515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:03.183974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:03.697868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:03.711812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:03.713892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:03.717319 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5dd010ab-a9de-4fd3-82a9-bd1f2a23c6a0 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1365 microversion: 2.47 time: 0.568300 Oct 11 04:48:03.719332 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3133/6506] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:03 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1365 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:04.747597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:04.747597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:04.754266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:04.759694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:04.761908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:04.762467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:04.763432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:04.763936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:04.873097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:04.882773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:04.884577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:04.886859 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-df5c1964-2cbd-4596-8541-7f943dcf69e3 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1371 microversion: 2.47 time: 0.147241 Oct 11 04:48:04.887612 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3374/6507] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:04 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:05.916132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:05.920383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:05.925707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:05.926244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:05.926969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:05.927817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:05.928392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:05.929164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:06.038963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:06.063928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:06.069057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:06.076035 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4c3d0dca-e30f-4445-a0b6-83b3a105b38f tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1371 microversion: 2.47 time: 0.159695 Oct 11 04:48:06.076035 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3134/6508] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:05 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:07.103853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:07.104544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:07.118599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=30 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:48:07.120205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:07.120867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:07.122418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:07.123148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:07.123617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:07.124085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:07.202053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:07.212134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:07.213860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:07.220517 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b9e1ad3a-b350-43e6-a559-4e25b27c2c73 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1371 microversion: 2.47 time: 0.116801 Oct 11 04:48:07.220517 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3375/6509] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:07 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1371 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:08.244653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:08.245540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:08.250721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=34 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:48:08.254950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:08.255569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:08.257418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:08.267690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:08.268781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:08.269474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:08.369428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:08.380134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:08.382622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:08.384335 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0a4307eb-d1ae-4231-b067-d764871095ad tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1371 microversion: 2.47 time: 0.145997 Oct 11 04:48:08.385492 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3135/6510] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:08 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:09.413651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:09.414319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:09.425419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:09.426215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:09.427173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:09.428200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:09.428857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:09.429480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:09.732806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:09.755981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:09.761090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:09.762627 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e5567c0-b0e2-4830-93fb-cae0579942e2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1356 microversion: 2.47 time: 0.353325 Oct 11 04:48:09.763683 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3376/6511] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:09 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1356 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:09.791039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:09.796844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:09.798018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Searching by: {'deleted': False, 'project_id': '8d5989b30c524868857d8f93e7855b2f'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 04:48:09.805609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:09.806162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:09.817141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:09.817141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:09.817141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:09.817141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:09.953221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Listed batch of 2 results from cell out of 1000 limit. Returned 2 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 04:48:10.037429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:10.044881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:10.045449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:10.045889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:10.057780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:10.059235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:10.103471 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ece9fb61-1662-4985-bff6-e71803ddddf9 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/detail" status: 200 len: 2706 microversion: 2.47 time: 0.316480 Oct 11 04:48:10.104657 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3136/6512] 10.222.0.26 () {60 vars in 1187 bytes} [Tue Oct 11 04:48:09 2022] GET /compute/v2.1/servers/detail => generated 2706 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:48:10.141760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-712aa2cc-f028-4612-8ecc-ae158f65de53 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:10.143270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-712aa2cc-f028-4612-8ecc-ae158f65de53 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:10.151374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-712aa2cc-f028-4612-8ecc-ae158f65de53 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:10.152208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-712aa2cc-f028-4612-8ecc-ae158f65de53 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:10.152562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-712aa2cc-f028-4612-8ecc-ae158f65de53 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:10.153627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-712aa2cc-f028-4612-8ecc-ae158f65de53 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:10.154253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-712aa2cc-f028-4612-8ecc-ae158f65de53 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:10.154826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-712aa2cc-f028-4612-8ecc-ae158f65de53 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:10.188495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-712aa2cc-f028-4612-8ecc-ae158f65de53 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:48:10.698457 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-712aa2cc-f028-4612-8ecc-ae158f65de53 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "DELETE /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 204 len: 0 microversion: 2.47 time: 0.560497 Oct 11 04:48:10.699985 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3377/6513] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:48:10 2022] DELETE /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 0 bytes in 563 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:48:10.710566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:10.711606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:10.722635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:10.724649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:10.726519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:10.727888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:10.734599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:10.734599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:10.856668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:10.884596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:10.884596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:10.884596 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-215eac53-1c19-4789-ab86-bea70abac54a tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1362 microversion: 2.47 time: 0.174427 Oct 11 04:48:10.884596 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3137/6514] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:10 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1362 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:11.905756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:11.906542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:11.915123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:11.915616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:11.916059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:11.916756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:11.917216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:11.917647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:12.014390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:12.029656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:12.031143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:12.039540 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4b8dc4a4-c7ec-4d4f-91b4-5701a9c62756 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1362 microversion: 2.47 time: 0.137995 Oct 11 04:48:12.040419 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3378/6515] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:11 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1362 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:13.068353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:13.068983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:13.083022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:13.083664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:13.084220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:13.088969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:13.089526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:13.090024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:13.131394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:13.132122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:13.132959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:13.133588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lazy-loading 'fault' on Instance uuid 18e3fcf9-341e-40ec-8125-b783df241cf5 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:48:13.220677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:13.234817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:13.236882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:13.238147 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4cce422e-c36f-4ad2-befd-a62a2d8b1199 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 200 len: 1367 microversion: 2.47 time: 0.174727 Oct 11 04:48:13.238741 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3138/6516] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:13 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 1367 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:14.273642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:14.274300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: 18e3fcf9-341e-40ec-8125-b783df241cf5] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:14.287811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:14.290558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:14.295144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:14.295144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:14.295144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:14.295144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:14.314439 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] HTTP exception thrown: Instance 18e3fcf9-341e-40ec-8125-b783df241cf5 could not be found. Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Request method failure captured: Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 HTTP/1.1 Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPVadG6_7JCE_mlQD6CPM38wCUZDQ9fz48O5qBWiE8cPyek_z3IsudYusquEkbXUZ6e5UV2chCywolcuFcGHn6NfIaRG8pLRGq4ur1KBrcpokCa2BwA3VRHrBHRl0hXWfKw6jpBQAFKyqdelbcuRc8pjPss4kkUGy1j_MteNNiVCKGI Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 8d5989b30c524868857d8f93e7855b2f Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerShowV247Test-721312243 Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d5989b30c524868857d8f93e7855b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d5989b30c524868857d8f93e7855b2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d5989b30c524868857d8f93e7855b2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d5989b30c524868857d8f93e7855b2f"}]}] Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerShowV247Test-721312243 Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 8d5989b30c524868857d8f93e7855b2f Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerShowV247Test-721312243 Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerShowV247Test-721312243-project Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 80de66dd45b9417d99d35031fb754223 Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerShowV247Test-721312243-project Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 18e3fcf9-341e-40ec-8125-b783df241cf5 could not be found. Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '18e3fcf9-341e-40ec-8125-b783df241cf5'} Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18e3fcf9-341e-40ec-8125-b783df241cf5 could not be found. Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18e3fcf9-341e-40ec-8125-b783df241cf5 could not be found. Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:48:14.316451 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:48:14.338306 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:48:14.338306 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:48:14.338306 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:48:14.338306 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:48:14.338306 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:48:14.338306 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18e3fcf9-341e-40ec-8125-b783df241cf5 could not be found. Oct 11 04:48:14.338306 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:48:14.338306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Returning 404 to user: Instance 18e3fcf9-341e-40ec-8125-b783df241cf5 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:48:14.338306 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d9065e2f-ba04-42c6-926f-df30d1a1c052 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5" status: 404 len: 111 microversion: 2.47 time: 0.048278 Oct 11 04:48:14.340114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7141114a-ac13-4ace-99e3-9083d1bf5fc2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:14.343188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7141114a-ac13-4ace-99e3-9083d1bf5fc2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: ed3a5171-3f07-4673-85cd-f20e95da6190] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:14.354346 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3379/6517] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:14 2022] GET /compute/v2.1/servers/18e3fcf9-341e-40ec-8125-b783df241cf5 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:48:14.358896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7141114a-ac13-4ace-99e3-9083d1bf5fc2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:14.359333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7141114a-ac13-4ace-99e3-9083d1bf5fc2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:14.372509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7141114a-ac13-4ace-99e3-9083d1bf5fc2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:14.372509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7141114a-ac13-4ace-99e3-9083d1bf5fc2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:14.372509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7141114a-ac13-4ace-99e3-9083d1bf5fc2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:14.372509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7141114a-ac13-4ace-99e3-9083d1bf5fc2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:14.427303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7141114a-ac13-4ace-99e3-9083d1bf5fc2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: ed3a5171-3f07-4673-85cd-f20e95da6190] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:48:14.813238 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7141114a-ac13-4ace-99e3-9083d1bf5fc2 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190" status: 204 len: 0 microversion: 2.47 time: 0.484498 Oct 11 04:48:14.814253 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3139/6518] 10.222.0.26 () {60 vars in 1280 bytes} [Tue Oct 11 04:48:14 2022] DELETE /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 11 04:48:14.827712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:14.830807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: ed3a5171-3f07-4673-85cd-f20e95da6190] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:14.838699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:14.842855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:14.843370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:14.845839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:14.845839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:14.846506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:15.174647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:15.190041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:15.193121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:15.196529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1527178953", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "ef3fbffe-34c0-470f-ac70-373e314ff4cb"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:48:15.199111 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-39ddf79b-3961-4c1e-bddd-96ee0564649c tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190" status: 200 len: 1363 microversion: 2.47 time: 0.380025 Oct 11 04:48:15.199704 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3380/6519] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:14 2022] GET /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190 => generated 1363 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:48:15.305504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] validate_networks() for [('ef3fbffe-34c0-470f-ac70-373e314ff4cb', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:48:16.227624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:16.228924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: ed3a5171-3f07-4673-85cd-f20e95da6190] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:16.236716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:16.237489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:16.244472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:16.244472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:16.244472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:16.244472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:16.546310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:16.563093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:16.584088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:16.585937 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d4ae864-861a-4197-8a63-80a239c4e1ab tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190" status: 200 len: 1363 microversion: 2.47 time: 0.362437 Oct 11 04:48:16.609996 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3381/6520] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:16 2022] GET /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190 => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 11 04:48:17.031118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:48:17.031583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:48:17.032005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:48:17.032847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:48:17.033422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:48:17.057575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:17.062407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:17.062407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:17.064621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:17.068211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:17.070440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:17.134734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Getting quotas for project e390dec4a5084a2cadd229dadbdb46fa. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:48:17.142355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Getting quotas for user 98816664bcab450dab5abf6bb70915d7 and project e390dec4a5084a2cadd229dadbdb46fa. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:48:17.207159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:48:17.222792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:48:17.573528 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f687eadf-d6bf-412b-9583-fbb5866071e5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.381462 Oct 11 04:48:17.586835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-05805392-24d4-4784-b2a3-49b5ea1898ac tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:17.591580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-05805392-24d4-4784-b2a3-49b5ea1898ac tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:17.597803 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3140/6521] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:48:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 2407 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:48:17.628356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:17.629170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: ed3a5171-3f07-4673-85cd-f20e95da6190] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:17.652189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:17.652189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:17.652189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:17.657794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:17.658488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:17.658933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:17.710939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:17.711429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:17.711865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:17.712322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lazy-loading 'fault' on Instance uuid ed3a5171-3f07-4673-85cd-f20e95da6190 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:48:17.721120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-05805392-24d4-4784-b2a3-49b5ea1898ac tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:17.732071 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-05805392-24d4-4784-b2a3-49b5ea1898ac tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1219 microversion: 2.1 time: 0.147737 Oct 11 04:48:17.749297 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3382/6522] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:17 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1219 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:18.409159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:18.416658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:18.418108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '80de66dd45b9417d99d35031fb754223', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d5989b30c524868857d8f93e7855b2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:18.419330 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02e8a5ed-9a62-42e8-a05c-1431ccf97188 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190" status: 200 len: 1368 microversion: 2.47 time: 0.806170 Oct 11 04:48:18.431050 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3141/6523] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:17 2022] GET /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190 => generated 1368 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 11 04:48:18.758394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-07a76dd5-4add-48f9-a401-2e5c7d8f6256 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:18.759060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-07a76dd5-4add-48f9-a401-2e5c7d8f6256 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:18.902907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-07a76dd5-4add-48f9-a401-2e5c7d8f6256 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:18.910664 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-07a76dd5-4add-48f9-a401-2e5c7d8f6256 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1219 microversion: 2.1 time: 0.156414 Oct 11 04:48:18.930228 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3383/6524] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:18 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1219 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:19.449486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:19.450327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] [instance: ed3a5171-3f07-4673-85cd-f20e95da6190] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:19.473496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:19.473496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:19.473496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:19.473496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:19.473496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:19.473496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:19.488627 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] HTTP exception thrown: Instance ed3a5171-3f07-4673-85cd-f20e95da6190 could not be found. Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Request method failure captured: Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190 HTTP/1.1 Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPVadG6_7JCE_mlQD6CPM38wCUZDQ9fz48O5qBWiE8cPyek_z3IsudYusquEkbXUZ6e5UV2chCywolcuFcGHn6NfIaRG8pLRGq4ur1KBrcpokCa2BwA3VRHrBHRl0hXWfKw6jpBQAFKyqdelbcuRc8pjPss4kkUGy1j_MteNNiVCKGI Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Openstack-Nova-Api-Version: 2.47 Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 8d5989b30c524868857d8f93e7855b2f Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerShowV247Test-721312243 Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/8d5989b30c524868857d8f93e7855b2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_8d5989b30c524868857d8f93e7855b2f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d5989b30c524868857d8f93e7855b2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/8d5989b30c524868857d8f93e7855b2f"}]}] Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerShowV247Test-721312243 Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 8d5989b30c524868857d8f93e7855b2f Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerShowV247Test-721312243 Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerShowV247Test-721312243-project Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 80de66dd45b9417d99d35031fb754223 Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerShowV247Test-721312243-project Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance ed3a5171-3f07-4673-85cd-f20e95da6190 could not be found. Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'ed3a5171-3f07-4673-85cd-f20e95da6190'} Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ed3a5171-3f07-4673-85cd-f20e95da6190 could not be found. Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ed3a5171-3f07-4673-85cd-f20e95da6190 could not be found. Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:48:19.490886 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:48:19.496530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:48:19.496530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:48:19.496530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:48:19.496530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:48:19.496530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:48:19.496530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ed3a5171-3f07-4673-85cd-f20e95da6190 could not be found. Oct 11 04:48:19.496530 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:48:19.496530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] Returning 404 to user: Instance ed3a5171-3f07-4673-85cd-f20e95da6190 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:48:19.496530 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-55f3dbbf-f2c1-4546-8408-53c7a06c7403 tempest-ServerShowV247Test-721312243 tempest-ServerShowV247Test-721312243-project] 10.222.0.26 "GET /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190" status: 404 len: 111 microversion: 2.47 time: 0.046851 Oct 11 04:48:19.500147 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3142/6525] 10.222.0.26 () {60 vars in 1277 bytes} [Tue Oct 11 04:48:19 2022] GET /compute/v2.1/servers/ed3a5171-3f07-4673-85cd-f20e95da6190 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 11 04:48:19.941906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-42926bda-07d0-4ef9-86c5-1e863ba197b3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:19.943799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-42926bda-07d0-4ef9-86c5-1e863ba197b3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:19.973955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42926bda-07d0-4ef9-86c5-1e863ba197b3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:19.984463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42926bda-07d0-4ef9-86c5-1e863ba197b3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:19.989070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42926bda-07d0-4ef9-86c5-1e863ba197b3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:19.994688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42926bda-07d0-4ef9-86c5-1e863ba197b3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:19.996234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42926bda-07d0-4ef9-86c5-1e863ba197b3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:19.998265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42926bda-07d0-4ef9-86c5-1e863ba197b3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:21.048012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-42926bda-07d0-4ef9-86c5-1e863ba197b3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:21.057965 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-42926bda-07d0-4ef9-86c5-1e863ba197b3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1271 microversion: 2.1 time: 1.123878 Oct 11 04:48:21.058289 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3384/6526] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:19 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1271 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:22.083953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eca6ab89-ab28-47c0-8d04-18cc7569b3c6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:22.084579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eca6ab89-ab28-47c0-8d04-18cc7569b3c6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:22.100059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eca6ab89-ab28-47c0-8d04-18cc7569b3c6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:22.100512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eca6ab89-ab28-47c0-8d04-18cc7569b3c6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:22.100995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eca6ab89-ab28-47c0-8d04-18cc7569b3c6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:22.101717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eca6ab89-ab28-47c0-8d04-18cc7569b3c6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:22.102236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eca6ab89-ab28-47c0-8d04-18cc7569b3c6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:22.102736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eca6ab89-ab28-47c0-8d04-18cc7569b3c6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:22.424314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eca6ab89-ab28-47c0-8d04-18cc7569b3c6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:22.436859 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eca6ab89-ab28-47c0-8d04-18cc7569b3c6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1319 microversion: 2.1 time: 0.359574 Oct 11 04:48:22.467188 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3143/6527] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:22 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1319 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:23.476137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef3ebf85-38dc-41d8-9891-9ada6ec82a76 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:23.476978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef3ebf85-38dc-41d8-9891-9ada6ec82a76 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:23.486030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3ebf85-38dc-41d8-9891-9ada6ec82a76 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:23.486550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3ebf85-38dc-41d8-9891-9ada6ec82a76 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:23.486980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3ebf85-38dc-41d8-9891-9ada6ec82a76 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:23.487683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3ebf85-38dc-41d8-9891-9ada6ec82a76 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:23.488153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3ebf85-38dc-41d8-9891-9ada6ec82a76 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:23.488576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3ebf85-38dc-41d8-9891-9ada6ec82a76 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:23.565106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-830a534a-d7b0-4fd2-be22-8b76b3846313 req-842bec9c-52a9-4484-a515-a2cc9613b160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6974dad9-af93-4f4d-82db-d5d77c439edf", "tag": "32b48e0a-9343-4d1a-8890-c1614e28f8a2"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:48:23.582646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-830a534a-d7b0-4fd2-be22-8b76b3846313 req-842bec9c-52a9-4484-a515-a2cc9613b160 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:23.583150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-830a534a-d7b0-4fd2-be22-8b76b3846313 req-842bec9c-52a9-4484-a515-a2cc9613b160 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:23.583781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-830a534a-d7b0-4fd2-be22-8b76b3846313 req-842bec9c-52a9-4484-a515-a2cc9613b160 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:23.597190 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-830a534a-d7b0-4fd2-be22-8b76b3846313 req-842bec9c-52a9-4484-a515-a2cc9613b160 service nova] Creating event network-changed:32b48e0a-9343-4d1a-8890-c1614e28f8a2 for instance 6974dad9-af93-4f4d-82db-d5d77c439edf on n-h2-860892-1 Oct 11 04:48:23.602877 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-830a534a-d7b0-4fd2-be22-8b76b3846313 req-842bec9c-52a9-4484-a515-a2cc9613b160 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046835 Oct 11 04:48:23.604032 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3144/6528] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:48:23.714919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef3ebf85-38dc-41d8-9891-9ada6ec82a76 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:23.725692 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef3ebf85-38dc-41d8-9891-9ada6ec82a76 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1319 microversion: 2.1 time: 0.253696 Oct 11 04:48:23.738800 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3385/6529] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:23 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:24.758734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6de29ae7-d5ec-4f33-970d-08695a87dd13 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:24.759447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6de29ae7-d5ec-4f33-970d-08695a87dd13 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:24.768576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de29ae7-d5ec-4f33-970d-08695a87dd13 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:24.769129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de29ae7-d5ec-4f33-970d-08695a87dd13 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:24.769654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de29ae7-d5ec-4f33-970d-08695a87dd13 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:24.770468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de29ae7-d5ec-4f33-970d-08695a87dd13 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:24.771102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de29ae7-d5ec-4f33-970d-08695a87dd13 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:24.771865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6de29ae7-d5ec-4f33-970d-08695a87dd13 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:25.090008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6de29ae7-d5ec-4f33-970d-08695a87dd13 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:25.090008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:48:25.102421 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6de29ae7-d5ec-4f33-970d-08695a87dd13 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1319 microversion: 2.1 time: 0.356889 Oct 11 04:48:25.103168 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3145/6530] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:24 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1319 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:26.125816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-da2cff3e-a904-40a0-872d-fbe08908164d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:26.128511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-da2cff3e-a904-40a0-872d-fbe08908164d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:26.133841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da2cff3e-a904-40a0-872d-fbe08908164d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:26.133841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da2cff3e-a904-40a0-872d-fbe08908164d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:26.134169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da2cff3e-a904-40a0-872d-fbe08908164d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:26.134904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da2cff3e-a904-40a0-872d-fbe08908164d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:26.135362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da2cff3e-a904-40a0-872d-fbe08908164d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:26.135795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da2cff3e-a904-40a0-872d-fbe08908164d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:26.454751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-da2cff3e-a904-40a0-872d-fbe08908164d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:26.475026 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-da2cff3e-a904-40a0-872d-fbe08908164d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1319 microversion: 2.1 time: 0.353923 Oct 11 04:48:26.475627 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3386/6531] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:26 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1319 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:27.501022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f69a595-a750-4755-8971-ec9e9fc37d06 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:27.501802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9f69a595-a750-4755-8971-ec9e9fc37d06 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:27.512062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:48:27.512062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:48:27.516257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f69a595-a750-4755-8971-ec9e9fc37d06 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:27.519806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f69a595-a750-4755-8971-ec9e9fc37d06 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:27.520538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f69a595-a750-4755-8971-ec9e9fc37d06 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:27.527679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f69a595-a750-4755-8971-ec9e9fc37d06 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:27.529728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f69a595-a750-4755-8971-ec9e9fc37d06 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:27.532980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9f69a595-a750-4755-8971-ec9e9fc37d06 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:27.763403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9f69a595-a750-4755-8971-ec9e9fc37d06 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:27.773330 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9f69a595-a750-4755-8971-ec9e9fc37d06 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1319 microversion: 2.1 time: 0.276255 Oct 11 04:48:27.774162 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3146/6532] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:27 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1319 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:28.797172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-50647e88-fd9c-48ca-ad81-0f1d2d23227a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:28.798581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50647e88-fd9c-48ca-ad81-0f1d2d23227a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:28.806424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50647e88-fd9c-48ca-ad81-0f1d2d23227a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:28.807309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50647e88-fd9c-48ca-ad81-0f1d2d23227a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:28.808287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50647e88-fd9c-48ca-ad81-0f1d2d23227a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:28.809166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50647e88-fd9c-48ca-ad81-0f1d2d23227a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:28.809813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50647e88-fd9c-48ca-ad81-0f1d2d23227a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:28.810537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50647e88-fd9c-48ca-ad81-0f1d2d23227a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:28.910102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:48:29.089492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-50647e88-fd9c-48ca-ad81-0f1d2d23227a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:29.127741 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-50647e88-fd9c-48ca-ad81-0f1d2d23227a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1319 microversion: 2.1 time: 0.334190 Oct 11 04:48:29.136999 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3387/6533] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:28 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1319 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:30.157027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-384023fe-f7c6-4ced-b054-6618841affca tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:30.158445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-384023fe-f7c6-4ced-b054-6618841affca tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:30.184914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-384023fe-f7c6-4ced-b054-6618841affca tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:30.185163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-384023fe-f7c6-4ced-b054-6618841affca tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:30.185802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-384023fe-f7c6-4ced-b054-6618841affca tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:30.196946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-384023fe-f7c6-4ced-b054-6618841affca tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:30.197689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-384023fe-f7c6-4ced-b054-6618841affca tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:30.198315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-384023fe-f7c6-4ced-b054-6618841affca tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:30.650785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-384023fe-f7c6-4ced-b054-6618841affca tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:30.659383 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-384023fe-f7c6-4ced-b054-6618841affca tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1319 microversion: 2.1 time: 0.508353 Oct 11 04:48:30.660349 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3147/6534] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:30 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1319 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:31.689355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b873a20-ac0e-4075-8468-ddad40bd0ca2 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:31.689967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b873a20-ac0e-4075-8468-ddad40bd0ca2 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:31.714259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b873a20-ac0e-4075-8468-ddad40bd0ca2 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:31.714765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b873a20-ac0e-4075-8468-ddad40bd0ca2 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:31.715207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b873a20-ac0e-4075-8468-ddad40bd0ca2 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:31.715933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b873a20-ac0e-4075-8468-ddad40bd0ca2 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:31.716365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b873a20-ac0e-4075-8468-ddad40bd0ca2 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:31.719440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b873a20-ac0e-4075-8468-ddad40bd0ca2 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:31.726295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:48:32.071376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ca17c9c3-83b9-4365-bea4-852025bf4963 req-824e4da5-7535-44dc-9ed5-136e934e22ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6974dad9-af93-4f4d-82db-d5d77c439edf", "name": "network-vif-plugged", "status": "completed", "tag": "32b48e0a-9343-4d1a-8890-c1614e28f8a2"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:48:32.101953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ca17c9c3-83b9-4365-bea4-852025bf4963 req-824e4da5-7535-44dc-9ed5-136e934e22ce service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:32.117093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ca17c9c3-83b9-4365-bea4-852025bf4963 req-824e4da5-7535-44dc-9ed5-136e934e22ce service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:32.117093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ca17c9c3-83b9-4365-bea4-852025bf4963 req-824e4da5-7535-44dc-9ed5-136e934e22ce service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:32.130484 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ca17c9c3-83b9-4365-bea4-852025bf4963 req-824e4da5-7535-44dc-9ed5-136e934e22ce service nova] Creating event network-vif-plugged:32b48e0a-9343-4d1a-8890-c1614e28f8a2 for instance 6974dad9-af93-4f4d-82db-d5d77c439edf on n-h2-860892-1 Oct 11 04:48:32.136893 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ca17c9c3-83b9-4365-bea4-852025bf4963 req-824e4da5-7535-44dc-9ed5-136e934e22ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.280549 Oct 11 04:48:32.138351 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3148/6535] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:48:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:48:32.214931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b873a20-ac0e-4075-8468-ddad40bd0ca2 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:32.225173 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b873a20-ac0e-4075-8468-ddad40bd0ca2 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1319 microversion: 2.1 time: 0.546478 Oct 11 04:48:32.226018 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3388/6536] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:31 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1319 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:33.252985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-27332616-b4a1-490a-885d-873a7cdf2935 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:33.253604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-27332616-b4a1-490a-885d-873a7cdf2935 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:33.261615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27332616-b4a1-490a-885d-873a7cdf2935 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:33.262270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27332616-b4a1-490a-885d-873a7cdf2935 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:33.262711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27332616-b4a1-490a-885d-873a7cdf2935 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:33.263408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27332616-b4a1-490a-885d-873a7cdf2935 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:33.263864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27332616-b4a1-490a-885d-873a7cdf2935 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:33.264289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27332616-b4a1-490a-885d-873a7cdf2935 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:33.624019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-27332616-b4a1-490a-885d-873a7cdf2935 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:33.632878 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-27332616-b4a1-490a-885d-873a7cdf2935 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1319 microversion: 2.1 time: 0.384944 Oct 11 04:48:33.633696 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3149/6537] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:33 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1319 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:48:34.659159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6857068d-68be-4e0f-a118-88963780e546 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:48:34.660302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6857068d-68be-4e0f-a118-88963780e546 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:48:34.667798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6857068d-68be-4e0f-a118-88963780e546 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:34.671326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6857068d-68be-4e0f-a118-88963780e546 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:34.671326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6857068d-68be-4e0f-a118-88963780e546 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:34.671326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6857068d-68be-4e0f-a118-88963780e546 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:48:34.671326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6857068d-68be-4e0f-a118-88963780e546 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:48:34.671326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6857068d-68be-4e0f-a118-88963780e546 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:48:34.909633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6857068d-68be-4e0f-a118-88963780e546 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:48:34.919395 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6857068d-68be-4e0f-a118-88963780e546 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1507 microversion: 2.1 time: 0.264896 Oct 11 04:48:34.920238 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3389/6538] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:48:34 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1507 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:49:14.097115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d93fb9db-c9ce-457a-927d-0cb19fc0c41b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9641e889-ecd4-4ff3-a7f5-0727ed952050", "device": "/dev/sdb"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:49:14.097115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d93fb9db-c9ce-457a-927d-0cb19fc0c41b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:49:14.107643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:49:14.108878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=21 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:49:14.110679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d93fb9db-c9ce-457a-927d-0cb19fc0c41b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:14.111393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d93fb9db-c9ce-457a-927d-0cb19fc0c41b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:14.112327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d93fb9db-c9ce-457a-927d-0cb19fc0c41b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:14.113328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d93fb9db-c9ce-457a-927d-0cb19fc0c41b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:14.114014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d93fb9db-c9ce-457a-927d-0cb19fc0c41b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:14.114691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d93fb9db-c9ce-457a-927d-0cb19fc0c41b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:15.322055 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d93fb9db-c9ce-457a-927d-0cb19fc0c41b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "POST /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.231663 Oct 11 04:49:15.323440 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3150/6539] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:49:14 2022] POST /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf/os-volume_attachments => generated 194 bytes in 1234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:49:42.799768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:49:42.806521 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 04:49:42.806906 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 04:49:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.26) !!! Oct 11 04:49:42.809282 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 04:49:42.809520 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 04:49:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.26) !!! Oct 11 04:49:43.094325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c21675a5-8237-44de-a65d-2e2a4a98bbf1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Action: 'create', calling method: .version_select at 0x7fda19374d30>, body: {"keypair": {"name": "tempest-TestSecurityGroupsBasicOps-997522340", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOO06Q0vQ8/6yfkXBezNoJyWiBqdOeqfyinbjxT8PmgZivjfRkryj/rcm7evDjDo22aC5Fb3g8bzF6fyIA1naazn5pre21ZP06JZBtrZQi2nLE5avLhOD/2rvT/fhisFNg=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:49:43.114483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c21675a5-8237-44de-a65d-2e2a4a98bbf1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Getting quotas for project 21b57322474547e89bdbbd521a214720. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:49:43.119263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c21675a5-8237-44de-a65d-2e2a4a98bbf1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Getting quotas for user a2c6082e11c3414ebcbd31f1edca2ac9 and project 21b57322474547e89bdbbd521a214720. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:49:43.251379 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c21675a5-8237-44de-a65d-2e2a4a98bbf1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.457840 Oct 11 04:49:43.258279 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3390/6540] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:49:42 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:49:51.770609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2a2d75d-3704-49eb-a2ee-9e65619373c8 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:49:51.773847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b2a2d75d-3704-49eb-a2ee-9e65619373c8 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:49:51.782675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2a2d75d-3704-49eb-a2ee-9e65619373c8 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:51.784356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2a2d75d-3704-49eb-a2ee-9e65619373c8 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:51.787930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2a2d75d-3704-49eb-a2ee-9e65619373c8 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:51.788688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2a2d75d-3704-49eb-a2ee-9e65619373c8 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:51.789158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2a2d75d-3704-49eb-a2ee-9e65619373c8 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:51.791705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2a2d75d-3704-49eb-a2ee-9e65619373c8 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:51.845521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9644cd97-356a-436e-bf0c-d389b8a6527a tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325-project-admin] Calling method '.version_select at 0x7fda1921bf70>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:49:51.847325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9644cd97-356a-436e-bf0c-d389b8a6527a tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:51.847815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9644cd97-356a-436e-bf0c-d389b8a6527a tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:51.848248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9644cd97-356a-436e-bf0c-d389b8a6527a tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:51.880285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9644cd97-356a-436e-bf0c-d389b8a6527a tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:51.880285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9644cd97-356a-436e-bf0c-d389b8a6527a tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:51.880285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9644cd97-356a-436e-bf0c-d389b8a6527a tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:51.883944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9644cd97-356a-436e-bf0c-d389b8a6527a tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:51.884425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9644cd97-356a-436e-bf0c-d389b8a6527a tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:51.884895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9644cd97-356a-436e-bf0c-d389b8a6527a tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:51.891248 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9644cd97-356a-436e-bf0c-d389b8a6527a tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325 tempest-PortsAdminExtendedAttrsIpV6TestJSON-753603325-project-admin] 10.222.0.26 "GET /compute/v2.1/os-hypervisors" status: 200 len: 191 microversion: 2.1 time: 0.210081 Oct 11 04:49:51.891836 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3151/6541] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 04:49:51 2022] GET /compute/v2.1/os-hypervisors => generated 191 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:49:51.920886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-b2a2d75d-3704-49eb-a2ee-9e65619373c8 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lazy-loading 'services' on Instance uuid 6974dad9-af93-4f4d-82db-d5d77c439edf {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:49:52.218589 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2a2d75d-3704-49eb-a2ee-9e65619373c8 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf/os-volume_attachments/9641e889-ecd4-4ff3-a7f5-0727ed952050" status: 202 len: 0 microversion: 2.1 time: 0.452075 Oct 11 04:49:52.219498 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3391/6542] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:49:51 2022] DELETE /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf/os-volume_attachments/9641e889-ecd4-4ff3-a7f5-0727ed952050 => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 04:49:55.057423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-tempest-TestSecurityGroupsBasicOps-561128707-access_point-427265386", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "2a67147d-e99c-4bea-a499-d01f27026c46"}], "key_name": "tempest-TestSecurityGroupsBasicOps-997522340", "security_groups": [{"name": "tempest-secgroup_access--1267038549"}, {"name": "tempest-secgroup_general--420335465"}]}, "os:scheduler_hints": {"different_host": []}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:49:55.320918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] validate_networks() for [('2a67147d-e99c-4bea-a499-d01f27026c46', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:49:56.210755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:49:56.211865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:49:56.212615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:49:56.213285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:49:56.213761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:49:56.228860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:56.232502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:56.232502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:56.232502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:56.232502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:56.232502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:56.253107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Getting quotas for project 21b57322474547e89bdbbd521a214720. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:49:56.259995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Getting quotas for user a2c6082e11c3414ebcbd31f1edca2ac9 and project 21b57322474547e89bdbbd521a214720. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:49:56.279587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:49:56.281888 n-d-860892-1 devstack@n-api.service[120993]: WARNING nova.utils [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Hostname tempest-server-tempest-TestSecurityGroupsBasicOps-561128707-access_point-427265386 is longer than 63, truncate it to tempest-server-tempest-TestSecurityGroupsBasicOps-561128707-acc Oct 11 04:49:56.282960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:49:56.451060 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cf0af5f5-ac08-4b5b-aee4-24bb26e6e27a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 457 microversion: 2.1 time: 1.398655 Oct 11 04:49:56.457993 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3152/6543] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:49:55 2022] POST /compute/v2.1/servers => generated 457 bytes in 1400 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:49:56.467174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:49:56.472219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9ce6dc48-5017-411a-ac81-730319fd07b0 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:49:56.475190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9ce6dc48-5017-411a-ac81-730319fd07b0 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:49:56.557595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9ce6dc48-5017-411a-ac81-730319fd07b0 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:49:56.566490 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9ce6dc48-5017-411a-ac81-730319fd07b0 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1292 microversion: 2.1 time: 0.106612 Oct 11 04:49:56.571479 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3392/6544] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:49:56 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1292 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:49:57.589783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-51ce50f2-9daa-4384-a7d9-c9026b92a0eb tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:49:57.590542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-51ce50f2-9daa-4384-a7d9-c9026b92a0eb tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:49:57.689267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-51ce50f2-9daa-4384-a7d9-c9026b92a0eb tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:49:57.696478 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-51ce50f2-9daa-4384-a7d9-c9026b92a0eb tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1292 microversion: 2.1 time: 0.110997 Oct 11 04:49:57.697060 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3153/6545] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:49:57 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1292 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:49:58.718763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b36d048a-c385-467f-8e59-183fca315d38 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:49:58.719376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b36d048a-c385-467f-8e59-183fca315d38 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:49:58.809465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b36d048a-c385-467f-8e59-183fca315d38 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:49:58.812371 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b36d048a-c385-467f-8e59-183fca315d38 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1292 microversion: 2.1 time: 0.097310 Oct 11 04:49:58.813202 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3393/6546] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:49:58 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1292 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:49:58.895933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-63432cc4-31d7-4e46-9eb1-20ff2aee3887 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:49:58.896520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-63432cc4-31d7-4e46-9eb1-20ff2aee3887 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:49:58.906148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63432cc4-31d7-4e46-9eb1-20ff2aee3887 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:58.906740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63432cc4-31d7-4e46-9eb1-20ff2aee3887 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:58.907165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63432cc4-31d7-4e46-9eb1-20ff2aee3887 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:58.908283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63432cc4-31d7-4e46-9eb1-20ff2aee3887 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:58.908741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63432cc4-31d7-4e46-9eb1-20ff2aee3887 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:58.909163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63432cc4-31d7-4e46-9eb1-20ff2aee3887 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:58.938931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-63432cc4-31d7-4e46-9eb1-20ff2aee3887 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:49:59.393957 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-63432cc4-31d7-4e46-9eb1-20ff2aee3887 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 204 len: 0 microversion: 2.1 time: 0.502185 Oct 11 04:49:59.394412 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3154/6547] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:49:58 2022] DELETE /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 0 bytes in 504 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:49:59.403401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f7c9310-1209-4eec-8c33-b41843e3f6e0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:49:59.404026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f7c9310-1209-4eec-8c33-b41843e3f6e0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:49:59.410577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f7c9310-1209-4eec-8c33-b41843e3f6e0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:59.416247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f7c9310-1209-4eec-8c33-b41843e3f6e0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:59.416247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f7c9310-1209-4eec-8c33-b41843e3f6e0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:59.416247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f7c9310-1209-4eec-8c33-b41843e3f6e0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:49:59.416247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f7c9310-1209-4eec-8c33-b41843e3f6e0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:49:59.416247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f7c9310-1209-4eec-8c33-b41843e3f6e0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:49:59.581015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2f7c9310-1209-4eec-8c33-b41843e3f6e0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:49:59.589620 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f7c9310-1209-4eec-8c33-b41843e3f6e0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1513 microversion: 2.1 time: 0.190685 Oct 11 04:49:59.590335 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3394/6548] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:49:59 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1513 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:49:59.837182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-083927bb-b5ee-46be-b2e3-37ce130cddbf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:49:59.838499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-083927bb-b5ee-46be-b2e3-37ce130cddbf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:49:59.894317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-083927bb-b5ee-46be-b2e3-37ce130cddbf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:49:59.908284 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-083927bb-b5ee-46be-b2e3-37ce130cddbf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1292 microversion: 2.1 time: 0.075414 Oct 11 04:49:59.914338 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3155/6549] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:49:59 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1292 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:00.613863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-598db005-7e0b-4536-8f6a-2487ba18c05c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:00.614588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-598db005-7e0b-4536-8f6a-2487ba18c05c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:00.622307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-598db005-7e0b-4536-8f6a-2487ba18c05c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:00.622794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-598db005-7e0b-4536-8f6a-2487ba18c05c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:00.623227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-598db005-7e0b-4536-8f6a-2487ba18c05c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:00.623923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-598db005-7e0b-4536-8f6a-2487ba18c05c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:00.624372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-598db005-7e0b-4536-8f6a-2487ba18c05c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:00.624793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-598db005-7e0b-4536-8f6a-2487ba18c05c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:00.873409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-598db005-7e0b-4536-8f6a-2487ba18c05c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:00.881375 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-598db005-7e0b-4536-8f6a-2487ba18c05c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1513 microversion: 2.1 time: 0.271451 Oct 11 04:50:00.881946 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3395/6550] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:00 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1513 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:00.934228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0ed3b359-78a7-4237-9ad8-ffecbab08951 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:00.934840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0ed3b359-78a7-4237-9ad8-ffecbab08951 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:01.008970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0ed3b359-78a7-4237-9ad8-ffecbab08951 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:01.016749 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0ed3b359-78a7-4237-9ad8-ffecbab08951 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1292 microversion: 2.1 time: 0.086502 Oct 11 04:50:01.017332 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3156/6551] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:00 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1292 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:01.576580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-31aa68c3-0e71-4ab4-a66a-95f5bd494ee1 req-44751163-a90c-40b9-baca-ec4369266f23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6974dad9-af93-4f4d-82db-d5d77c439edf", "name": "network-vif-deleted", "tag": "32b48e0a-9343-4d1a-8890-c1614e28f8a2"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:50:01.586376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-31aa68c3-0e71-4ab4-a66a-95f5bd494ee1 req-44751163-a90c-40b9-baca-ec4369266f23 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:01.592479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-31aa68c3-0e71-4ab4-a66a-95f5bd494ee1 req-44751163-a90c-40b9-baca-ec4369266f23 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:01.592479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-31aa68c3-0e71-4ab4-a66a-95f5bd494ee1 req-44751163-a90c-40b9-baca-ec4369266f23 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:01.597870 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-31aa68c3-0e71-4ab4-a66a-95f5bd494ee1 req-44751163-a90c-40b9-baca-ec4369266f23 service nova] Creating event network-vif-deleted:32b48e0a-9343-4d1a-8890-c1614e28f8a2 for instance 6974dad9-af93-4f4d-82db-d5d77c439edf on n-h2-860892-1 Oct 11 04:50:01.602762 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-31aa68c3-0e71-4ab4-a66a-95f5bd494ee1 req-44751163-a90c-40b9-baca-ec4369266f23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030664 Oct 11 04:50:01.603342 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3396/6552] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:50:01.904281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8a96cc7b-4708-4f10-a043-ee4c9a7324e3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:01.904906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8a96cc7b-4708-4f10-a043-ee4c9a7324e3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:01.911357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a96cc7b-4708-4f10-a043-ee4c9a7324e3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:01.911835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a96cc7b-4708-4f10-a043-ee4c9a7324e3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:01.912268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a96cc7b-4708-4f10-a043-ee4c9a7324e3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:01.912988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a96cc7b-4708-4f10-a043-ee4c9a7324e3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:01.913436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a96cc7b-4708-4f10-a043-ee4c9a7324e3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:01.913857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8a96cc7b-4708-4f10-a043-ee4c9a7324e3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:01.978828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8a96cc7b-4708-4f10-a043-ee4c9a7324e3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:01.987128 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8a96cc7b-4708-4f10-a043-ee4c9a7324e3 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 200 len: 1304 microversion: 2.1 time: 0.086699 Oct 11 04:50:01.989097 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3157/6553] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:01 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 1304 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:02.042316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-66500764-da8c-466b-afc4-b5ff081d7d36 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:02.043024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-66500764-da8c-466b-afc4-b5ff081d7d36 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:02.049148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66500764-da8c-466b-afc4-b5ff081d7d36 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:02.049637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66500764-da8c-466b-afc4-b5ff081d7d36 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:02.050075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66500764-da8c-466b-afc4-b5ff081d7d36 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:02.050794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66500764-da8c-466b-afc4-b5ff081d7d36 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:02.051246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66500764-da8c-466b-afc4-b5ff081d7d36 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:02.051669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66500764-da8c-466b-afc4-b5ff081d7d36 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:02.127206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-66500764-da8c-466b-afc4-b5ff081d7d36 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:02.135926 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-66500764-da8c-466b-afc4-b5ff081d7d36 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1296 microversion: 2.1 time: 0.099228 Oct 11 04:50:02.136638 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3397/6554] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:02 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:03.013775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:03.014391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: 6974dad9-af93-4f4d-82db-d5d77c439edf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:03.021901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:03.027451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:03.027451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:03.027451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:03.027451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:03.027451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:03.040631 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] HTTP exception thrown: Instance 6974dad9-af93-4f4d-82db-d5d77c439edf could not be found. Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Request method failure captured: Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf HTTP/1.1 Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPUTCCrtnjLUHXjzJqkQZH0eJjsLWqNwk5V9biGDtRaPLaeihdMXJfVsmawyFLYUUfz4dgXCHMEo8tzorgf-s-LohjjRgRjpj3S6FUGCjjnzz2QCQNXtJE_xQM76mkotFKWw-eV0TMj7gb7ohMoFSPfY0RiGJUNd4J-gNx6nL7pjUmg Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: e390dec4a5084a2cadd229dadbdb46fa Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-VolumesSnapshotTestJSON-112440802 Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e390dec4a5084a2cadd229dadbdb46fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e390dec4a5084a2cadd229dadbdb46fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e390dec4a5084a2cadd229dadbdb46fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e390dec4a5084a2cadd229dadbdb46fa"}]}] Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-VolumesSnapshotTestJSON-112440802 Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: e390dec4a5084a2cadd229dadbdb46fa Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-112440802 Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-VolumesSnapshotTestJSON-112440802-project Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 98816664bcab450dab5abf6bb70915d7 Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-VolumesSnapshotTestJSON-112440802-project Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 6974dad9-af93-4f4d-82db-d5d77c439edf could not be found. Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '6974dad9-af93-4f4d-82db-d5d77c439edf'} Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6974dad9-af93-4f4d-82db-d5d77c439edf could not be found. Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6974dad9-af93-4f4d-82db-d5d77c439edf could not be found. Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:50:03.042323 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:50:03.046897 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:50:03.046897 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:50:03.046897 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:50:03.046897 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:50:03.046897 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:50:03.046897 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6974dad9-af93-4f4d-82db-d5d77c439edf could not be found. Oct 11 04:50:03.046897 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:50:03.046897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Returning 404 to user: Instance 6974dad9-af93-4f4d-82db-d5d77c439edf could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:50:03.046897 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d42a884e-01a5-4175-98af-da25c14ab9ed tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf" status: 404 len: 111 microversion: 2.1 time: 0.034601 Oct 11 04:50:03.046897 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3158/6555] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:03 2022] GET /compute/v2.1/servers/6974dad9-af93-4f4d-82db-d5d77c439edf => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:50:03.160463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e32a1d9-a0f0-4bc1-9e63-d26b26a480da tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:03.161083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e32a1d9-a0f0-4bc1-9e63-d26b26a480da tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:03.168545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e32a1d9-a0f0-4bc1-9e63-d26b26a480da tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:03.169028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e32a1d9-a0f0-4bc1-9e63-d26b26a480da tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:03.169464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e32a1d9-a0f0-4bc1-9e63-d26b26a480da tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:03.170162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e32a1d9-a0f0-4bc1-9e63-d26b26a480da tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:03.170640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e32a1d9-a0f0-4bc1-9e63-d26b26a480da tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:03.171066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e32a1d9-a0f0-4bc1-9e63-d26b26a480da tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:03.235606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e32a1d9-a0f0-4bc1-9e63-d26b26a480da tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:03.243852 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e32a1d9-a0f0-4bc1-9e63-d26b26a480da tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1344 microversion: 2.1 time: 0.087283 Oct 11 04:50:03.249050 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3398/6556] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:03 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1344 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:04.268888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ff05dbe-0617-40b5-8570-732368a638d8 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:04.269500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ff05dbe-0617-40b5-8570-732368a638d8 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:04.282546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ff05dbe-0617-40b5-8570-732368a638d8 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:04.296330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ff05dbe-0617-40b5-8570-732368a638d8 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:04.296330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ff05dbe-0617-40b5-8570-732368a638d8 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:04.296330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ff05dbe-0617-40b5-8570-732368a638d8 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:04.296330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ff05dbe-0617-40b5-8570-732368a638d8 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:04.296330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ff05dbe-0617-40b5-8570-732368a638d8 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:04.378423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3ff05dbe-0617-40b5-8570-732368a638d8 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:04.388034 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ff05dbe-0617-40b5-8570-732368a638d8 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1350 microversion: 2.1 time: 0.122369 Oct 11 04:50:04.390516 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3159/6557] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:04 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1350 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:05.435750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a8b412c1-36ac-4533-9fa6-80782acf4524 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:05.440343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a8b412c1-36ac-4533-9fa6-80782acf4524 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:05.457429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8b412c1-36ac-4533-9fa6-80782acf4524 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:05.457917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8b412c1-36ac-4533-9fa6-80782acf4524 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:05.458465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8b412c1-36ac-4533-9fa6-80782acf4524 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:05.462474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8b412c1-36ac-4533-9fa6-80782acf4524 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:05.463000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8b412c1-36ac-4533-9fa6-80782acf4524 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:05.463437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8b412c1-36ac-4533-9fa6-80782acf4524 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:05.668337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8b412c1-36ac-4533-9fa6-80782acf4524 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:05.681975 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a8b412c1-36ac-4533-9fa6-80782acf4524 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1469 microversion: 2.1 time: 0.265682 Oct 11 04:50:05.685680 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3399/6558] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:05 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1469 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:06.052540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2a9b3fdf-b27b-45be-9642-b5019dff9a96 req-7a4150dd-20f4-4b6b-afbe-a632f36aac92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc426c32-c378-4b3c-a917-1ab5bf65d828", "tag": "0dd63779-0d12-41ad-914d-d2ad81661db3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:50:06.063109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2a9b3fdf-b27b-45be-9642-b5019dff9a96 req-7a4150dd-20f4-4b6b-afbe-a632f36aac92 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:06.063590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2a9b3fdf-b27b-45be-9642-b5019dff9a96 req-7a4150dd-20f4-4b6b-afbe-a632f36aac92 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:06.068367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2a9b3fdf-b27b-45be-9642-b5019dff9a96 req-7a4150dd-20f4-4b6b-afbe-a632f36aac92 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:06.075050 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2a9b3fdf-b27b-45be-9642-b5019dff9a96 req-7a4150dd-20f4-4b6b-afbe-a632f36aac92 service nova] Creating event network-changed:0dd63779-0d12-41ad-914d-d2ad81661db3 for instance cc426c32-c378-4b3c-a917-1ab5bf65d828 on n-h1-860892-1 Oct 11 04:50:06.079984 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2a9b3fdf-b27b-45be-9642-b5019dff9a96 req-7a4150dd-20f4-4b6b-afbe-a632f36aac92 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.195855 Oct 11 04:50:06.080576 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3160/6559] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:50:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:50:06.709068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-06fbe459-8c35-483f-9eab-229f706cbb94 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:06.709677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-06fbe459-8c35-483f-9eab-229f706cbb94 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:06.718257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06fbe459-8c35-483f-9eab-229f706cbb94 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:06.718916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06fbe459-8c35-483f-9eab-229f706cbb94 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:06.719604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06fbe459-8c35-483f-9eab-229f706cbb94 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:06.720715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06fbe459-8c35-483f-9eab-229f706cbb94 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:06.721263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06fbe459-8c35-483f-9eab-229f706cbb94 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:06.721853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-06fbe459-8c35-483f-9eab-229f706cbb94 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:06.882448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-06fbe459-8c35-483f-9eab-229f706cbb94 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:06.891803 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-06fbe459-8c35-483f-9eab-229f706cbb94 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1469 microversion: 2.1 time: 0.186562 Oct 11 04:50:06.892424 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3400/6560] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:06 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1469 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:07.912185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:07.918222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0210a9bb-9937-403e-a29a-1cfaaafbcd4a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:07.918999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0210a9bb-9937-403e-a29a-1cfaaafbcd4a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:07.925526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0210a9bb-9937-403e-a29a-1cfaaafbcd4a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:07.926072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0210a9bb-9937-403e-a29a-1cfaaafbcd4a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:07.926591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0210a9bb-9937-403e-a29a-1cfaaafbcd4a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:07.927426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0210a9bb-9937-403e-a29a-1cfaaafbcd4a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:07.927875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0210a9bb-9937-403e-a29a-1cfaaafbcd4a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:07.928359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0210a9bb-9937-403e-a29a-1cfaaafbcd4a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:08.264479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0210a9bb-9937-403e-a29a-1cfaaafbcd4a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:08.275358 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0210a9bb-9937-403e-a29a-1cfaaafbcd4a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1469 microversion: 2.1 time: 0.363267 Oct 11 04:50:08.285475 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3161/6561] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:07 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1469 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:09.300372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-68bb9a47-6cab-4cb3-bc72-534172d77faf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:09.301044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-68bb9a47-6cab-4cb3-bc72-534172d77faf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:09.303991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:09.309132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bb9a47-6cab-4cb3-bc72-534172d77faf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:09.309620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bb9a47-6cab-4cb3-bc72-534172d77faf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:09.310053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bb9a47-6cab-4cb3-bc72-534172d77faf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:09.310777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bb9a47-6cab-4cb3-bc72-534172d77faf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:09.311253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bb9a47-6cab-4cb3-bc72-534172d77faf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:09.311686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68bb9a47-6cab-4cb3-bc72-534172d77faf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:09.487033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68bb9a47-6cab-4cb3-bc72-534172d77faf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:09.496432 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-68bb9a47-6cab-4cb3-bc72-534172d77faf tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1469 microversion: 2.1 time: 0.200096 Oct 11 04:50:09.497424 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3401/6562] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:09 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1469 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:50:10.520820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a2654db8-e8b6-48f9-80ff-b7764e003a07 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:10.522009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a2654db8-e8b6-48f9-80ff-b7764e003a07 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:10.529354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2654db8-e8b6-48f9-80ff-b7764e003a07 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:10.529858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2654db8-e8b6-48f9-80ff-b7764e003a07 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:10.530350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2654db8-e8b6-48f9-80ff-b7764e003a07 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:10.531047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2654db8-e8b6-48f9-80ff-b7764e003a07 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:10.531491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2654db8-e8b6-48f9-80ff-b7764e003a07 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:10.532146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2654db8-e8b6-48f9-80ff-b7764e003a07 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:10.767697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a2654db8-e8b6-48f9-80ff-b7764e003a07 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:10.776532 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a2654db8-e8b6-48f9-80ff-b7764e003a07 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1469 microversion: 2.1 time: 0.259411 Oct 11 04:50:10.777605 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3162/6563] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:10 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1469 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:11.802929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-994e209a-e381-43f4-bf28-1eef2cd4a06b tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:11.804233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-994e209a-e381-43f4-bf28-1eef2cd4a06b tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:11.816683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-994e209a-e381-43f4-bf28-1eef2cd4a06b tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:11.817978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-994e209a-e381-43f4-bf28-1eef2cd4a06b tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:11.818617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-994e209a-e381-43f4-bf28-1eef2cd4a06b tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:11.819521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-994e209a-e381-43f4-bf28-1eef2cd4a06b tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:11.820140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-994e209a-e381-43f4-bf28-1eef2cd4a06b tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:11.821244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-994e209a-e381-43f4-bf28-1eef2cd4a06b tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:11.928751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1018235648", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "ef3fbffe-34c0-470f-ac70-373e314ff4cb"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:50:11.948989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=12 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:11.996288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-994e209a-e381-43f4-bf28-1eef2cd4a06b tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:12.004048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] validate_networks() for [('ef3fbffe-34c0-470f-ac70-373e314ff4cb', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:50:12.004901 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-994e209a-e381-43f4-bf28-1eef2cd4a06b tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1469 microversion: 2.1 time: 0.207436 Oct 11 04:50:12.006579 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3402/6564] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:11 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1469 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:12.377568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:50:12.378077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:50:12.378634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:50:12.379083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:50:12.379499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:50:12.389397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:12.389863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:12.390329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:12.391084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:12.391488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:12.391911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:12.415548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Getting quotas for project e390dec4a5084a2cadd229dadbdb46fa. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:50:12.421177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Getting quotas for user 98816664bcab450dab5abf6bb70915d7 and project e390dec4a5084a2cadd229dadbdb46fa. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:50:12.435166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:50:12.437697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:50:12.545184 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68cee660-6555-41ac-ab74-ca8f565a20c0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620154 Oct 11 04:50:12.550360 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3163/6565] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:50:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 626 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 04:50:12.557833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6ab2e1a7-e47d-47e4-b42a-884acad2e7ad tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:12.558478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6ab2e1a7-e47d-47e4-b42a-884acad2e7ad tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:12.641098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ca5c0099-4cf2-498b-bc03-54bdbd143ad0 req-f796d6d2-d396-42c0-9026-f6fb7f8ec909 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc426c32-c378-4b3c-a917-1ab5bf65d828", "name": "network-vif-plugged", "status": "completed", "tag": "0dd63779-0d12-41ad-914d-d2ad81661db3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:50:12.658502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ca5c0099-4cf2-498b-bc03-54bdbd143ad0 req-f796d6d2-d396-42c0-9026-f6fb7f8ec909 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:12.658970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ca5c0099-4cf2-498b-bc03-54bdbd143ad0 req-f796d6d2-d396-42c0-9026-f6fb7f8ec909 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:12.659994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ca5c0099-4cf2-498b-bc03-54bdbd143ad0 req-f796d6d2-d396-42c0-9026-f6fb7f8ec909 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:12.665959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6ab2e1a7-e47d-47e4-b42a-884acad2e7ad tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:12.673593 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6ab2e1a7-e47d-47e4-b42a-884acad2e7ad tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1219 microversion: 2.1 time: 0.119774 Oct 11 04:50:12.675693 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3403/6566] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:12 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1219 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:12.688445 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ca5c0099-4cf2-498b-bc03-54bdbd143ad0 req-f796d6d2-d396-42c0-9026-f6fb7f8ec909 service nova] Creating event network-vif-plugged:0dd63779-0d12-41ad-914d-d2ad81661db3 for instance cc426c32-c378-4b3c-a917-1ab5bf65d828 on n-h1-860892-1 Oct 11 04:50:12.695173 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ca5c0099-4cf2-498b-bc03-54bdbd143ad0 req-f796d6d2-d396-42c0-9026-f6fb7f8ec909 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060021 Oct 11 04:50:12.702375 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3164/6567] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:50:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:50:13.027657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-881fe366-5827-476a-907c-d6ed3e8fd06e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:13.028321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-881fe366-5827-476a-907c-d6ed3e8fd06e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:13.035689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-881fe366-5827-476a-907c-d6ed3e8fd06e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:13.036176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-881fe366-5827-476a-907c-d6ed3e8fd06e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:13.036619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-881fe366-5827-476a-907c-d6ed3e8fd06e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:13.037311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-881fe366-5827-476a-907c-d6ed3e8fd06e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:13.037965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-881fe366-5827-476a-907c-d6ed3e8fd06e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:13.038457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-881fe366-5827-476a-907c-d6ed3e8fd06e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:13.187151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-881fe366-5827-476a-907c-d6ed3e8fd06e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:13.195141 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-881fe366-5827-476a-907c-d6ed3e8fd06e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1469 microversion: 2.1 time: 0.171536 Oct 11 04:50:13.198571 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3404/6568] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:13 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:13.699623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fd7c607f-7590-487d-bd34-2c7e649ec7d5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:13.701562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fd7c607f-7590-487d-bd34-2c7e649ec7d5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:13.709861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd7c607f-7590-487d-bd34-2c7e649ec7d5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:13.710431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd7c607f-7590-487d-bd34-2c7e649ec7d5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:13.710874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd7c607f-7590-487d-bd34-2c7e649ec7d5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:13.712635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd7c607f-7590-487d-bd34-2c7e649ec7d5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:13.713304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd7c607f-7590-487d-bd34-2c7e649ec7d5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:13.713899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd7c607f-7590-487d-bd34-2c7e649ec7d5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:13.786608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fd7c607f-7590-487d-bd34-2c7e649ec7d5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:13.795459 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fd7c607f-7590-487d-bd34-2c7e649ec7d5 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1223 microversion: 2.1 time: 0.101992 Oct 11 04:50:13.796154 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3165/6569] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:13 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1223 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:14.219585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-05b239a2-9b29-4ef0-b9bc-27a0597e0654 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:14.220319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-05b239a2-9b29-4ef0-b9bc-27a0597e0654 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:14.227355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05b239a2-9b29-4ef0-b9bc-27a0597e0654 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:14.227857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05b239a2-9b29-4ef0-b9bc-27a0597e0654 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:14.228281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05b239a2-9b29-4ef0-b9bc-27a0597e0654 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:14.229122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05b239a2-9b29-4ef0-b9bc-27a0597e0654 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:14.229743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05b239a2-9b29-4ef0-b9bc-27a0597e0654 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:14.230178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05b239a2-9b29-4ef0-b9bc-27a0597e0654 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:14.410252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-05b239a2-9b29-4ef0-b9bc-27a0597e0654 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:14.418504 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-05b239a2-9b29-4ef0-b9bc-27a0597e0654 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1469 microversion: 2.1 time: 0.202645 Oct 11 04:50:14.419225 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3405/6570] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:14 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1469 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:14.818824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1178b04c-1949-44c7-a785-ffc4ed90998a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:14.819434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1178b04c-1949-44c7-a785-ffc4ed90998a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:14.826418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1178b04c-1949-44c7-a785-ffc4ed90998a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:14.827097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1178b04c-1949-44c7-a785-ffc4ed90998a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:14.827321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1178b04c-1949-44c7-a785-ffc4ed90998a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:14.828024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1178b04c-1949-44c7-a785-ffc4ed90998a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:14.828474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1178b04c-1949-44c7-a785-ffc4ed90998a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:14.828892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1178b04c-1949-44c7-a785-ffc4ed90998a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:14.896059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1178b04c-1949-44c7-a785-ffc4ed90998a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:14.912967 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1178b04c-1949-44c7-a785-ffc4ed90998a tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1279 microversion: 2.1 time: 0.098039 Oct 11 04:50:14.915553 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3166/6571] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:14 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1279 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:15.442740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ec0ccc52-a182-4964-a592-b33c83be5eef tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:15.443356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ec0ccc52-a182-4964-a592-b33c83be5eef tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:15.459545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0ccc52-a182-4964-a592-b33c83be5eef tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:15.462366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0ccc52-a182-4964-a592-b33c83be5eef tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:15.462810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0ccc52-a182-4964-a592-b33c83be5eef tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:15.464322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0ccc52-a182-4964-a592-b33c83be5eef tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:15.464971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0ccc52-a182-4964-a592-b33c83be5eef tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:15.465666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0ccc52-a182-4964-a592-b33c83be5eef tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:15.674466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ec0ccc52-a182-4964-a592-b33c83be5eef tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:15.683325 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ec0ccc52-a182-4964-a592-b33c83be5eef tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1642 microversion: 2.1 time: 0.244893 Oct 11 04:50:15.684092 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3406/6572] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:15 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1642 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:15.708681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-76a4fd3e-4dcd-4ba1-afc6-a96b6d922757 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:15.709573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-76a4fd3e-4dcd-4ba1-afc6-a96b6d922757 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:15.717148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76a4fd3e-4dcd-4ba1-afc6-a96b6d922757 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:15.717635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76a4fd3e-4dcd-4ba1-afc6-a96b6d922757 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:15.718071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76a4fd3e-4dcd-4ba1-afc6-a96b6d922757 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:15.718973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76a4fd3e-4dcd-4ba1-afc6-a96b6d922757 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:15.719495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76a4fd3e-4dcd-4ba1-afc6-a96b6d922757 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:15.719929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76a4fd3e-4dcd-4ba1-afc6-a96b6d922757 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:15.939299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44fe0e5a-ba0e-4a50-9e4b-4f4d0f7a7ee1 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:15.939871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44fe0e5a-ba0e-4a50-9e4b-4f4d0f7a7ee1 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:15.946921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fe0e5a-ba0e-4a50-9e4b-4f4d0f7a7ee1 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:15.955242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fe0e5a-ba0e-4a50-9e4b-4f4d0f7a7ee1 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:15.955242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fe0e5a-ba0e-4a50-9e4b-4f4d0f7a7ee1 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:15.955242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fe0e5a-ba0e-4a50-9e4b-4f4d0f7a7ee1 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:15.955242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fe0e5a-ba0e-4a50-9e4b-4f4d0f7a7ee1 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:15.955242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44fe0e5a-ba0e-4a50-9e4b-4f4d0f7a7ee1 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:15.968631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-76a4fd3e-4dcd-4ba1-afc6-a96b6d922757 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:15.984363 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-76a4fd3e-4dcd-4ba1-afc6-a96b6d922757 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1642 microversion: 2.1 time: 0.278033 Oct 11 04:50:15.985845 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3167/6573] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:15 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1642 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:16.012346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-577b2ae9-a580-40df-9503-6d7f811ad4b9 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:16.013213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-577b2ae9-a580-40df-9503-6d7f811ad4b9 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:16.027249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-577b2ae9-a580-40df-9503-6d7f811ad4b9 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:16.028016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-577b2ae9-a580-40df-9503-6d7f811ad4b9 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:16.028470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-577b2ae9-a580-40df-9503-6d7f811ad4b9 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:16.031888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-577b2ae9-a580-40df-9503-6d7f811ad4b9 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:16.035475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-577b2ae9-a580-40df-9503-6d7f811ad4b9 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:16.035475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-577b2ae9-a580-40df-9503-6d7f811ad4b9 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:16.182018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44fe0e5a-ba0e-4a50-9e4b-4f4d0f7a7ee1 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:16.190009 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44fe0e5a-ba0e-4a50-9e4b-4f4d0f7a7ee1 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1319 microversion: 2.1 time: 0.254541 Oct 11 04:50:16.194337 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3407/6574] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:15 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:16.737528 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-577b2ae9-a580-40df-9503-6d7f811ad4b9 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1793 microversion: 2.1 time: 0.729403 Oct 11 04:50:16.738665 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3168/6575] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:16 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1793 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:17.221268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-003b8679-f0b8-484d-a2b2-a76b045ee127 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:17.222137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-003b8679-f0b8-484d-a2b2-a76b045ee127 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:17.237906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-003b8679-f0b8-484d-a2b2-a76b045ee127 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:17.238363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-003b8679-f0b8-484d-a2b2-a76b045ee127 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:17.238842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-003b8679-f0b8-484d-a2b2-a76b045ee127 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:17.239585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-003b8679-f0b8-484d-a2b2-a76b045ee127 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:17.240264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-003b8679-f0b8-484d-a2b2-a76b045ee127 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:17.240900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-003b8679-f0b8-484d-a2b2-a76b045ee127 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:17.248385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6a4a557c-f90c-45da-987b-e507e1b333c6 req-3285169a-3921-4b8a-9281-f7a60a418b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a32b2183-7b0d-4bde-b865-23336ba0337e", "tag": "e9c7cb82-7298-4a7b-9335-5a30b168b885"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:50:17.268320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6a4a557c-f90c-45da-987b-e507e1b333c6 req-3285169a-3921-4b8a-9281-f7a60a418b37 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:17.271072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6a4a557c-f90c-45da-987b-e507e1b333c6 req-3285169a-3921-4b8a-9281-f7a60a418b37 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:17.271673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6a4a557c-f90c-45da-987b-e507e1b333c6 req-3285169a-3921-4b8a-9281-f7a60a418b37 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:17.317033 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6a4a557c-f90c-45da-987b-e507e1b333c6 req-3285169a-3921-4b8a-9281-f7a60a418b37 service nova] Creating event network-changed:e9c7cb82-7298-4a7b-9335-5a30b168b885 for instance a32b2183-7b0d-4bde-b865-23336ba0337e on n-h2-860892-1 Oct 11 04:50:17.332656 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6a4a557c-f90c-45da-987b-e507e1b333c6 req-3285169a-3921-4b8a-9281-f7a60a418b37 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088880 Oct 11 04:50:17.334130 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3169/6576] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:50:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:50:17.531162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-003b8679-f0b8-484d-a2b2-a76b045ee127 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:17.533523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:17.540695 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-003b8679-f0b8-484d-a2b2-a76b045ee127 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1319 microversion: 2.1 time: 0.323925 Oct 11 04:50:17.541812 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3408/6577] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:17 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1319 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:18.570123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-86acbca7-e988-4e09-978f-f213d2c28b02 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:18.571471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-86acbca7-e988-4e09-978f-f213d2c28b02 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:18.584505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86acbca7-e988-4e09-978f-f213d2c28b02 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:18.584992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86acbca7-e988-4e09-978f-f213d2c28b02 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:18.587913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86acbca7-e988-4e09-978f-f213d2c28b02 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:18.588659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86acbca7-e988-4e09-978f-f213d2c28b02 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:18.592922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86acbca7-e988-4e09-978f-f213d2c28b02 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:18.593765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86acbca7-e988-4e09-978f-f213d2c28b02 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:18.635332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:19.494603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-86acbca7-e988-4e09-978f-f213d2c28b02 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:19.507727 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-86acbca7-e988-4e09-978f-f213d2c28b02 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1319 microversion: 2.1 time: 0.942267 Oct 11 04:50:19.509467 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3170/6578] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:18 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1319 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:20.115991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2b4d7c1d-c742-4635-8fd4-c140247a3da8 req-458b4e47-44c4-4e30-b273-76797ea971be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc426c32-c378-4b3c-a917-1ab5bf65d828", "tag": "0dd63779-0d12-41ad-914d-d2ad81661db3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:50:20.137044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2b4d7c1d-c742-4635-8fd4-c140247a3da8 req-458b4e47-44c4-4e30-b273-76797ea971be service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:20.143593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2b4d7c1d-c742-4635-8fd4-c140247a3da8 req-458b4e47-44c4-4e30-b273-76797ea971be service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:20.144270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2b4d7c1d-c742-4635-8fd4-c140247a3da8 req-458b4e47-44c4-4e30-b273-76797ea971be service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:20.164992 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2b4d7c1d-c742-4635-8fd4-c140247a3da8 req-458b4e47-44c4-4e30-b273-76797ea971be service nova] Creating event network-changed:0dd63779-0d12-41ad-914d-d2ad81661db3 for instance cc426c32-c378-4b3c-a917-1ab5bf65d828 on n-h1-860892-1 Oct 11 04:50:20.180977 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2b4d7c1d-c742-4635-8fd4-c140247a3da8 req-458b4e47-44c4-4e30-b273-76797ea971be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068751 Oct 11 04:50:20.184480 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3409/6579] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:50:20.537005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2bb6e92e-a059-4be4-a235-70ebafcc3bbb tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:20.538386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2bb6e92e-a059-4be4-a235-70ebafcc3bbb tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:20.559484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bb6e92e-a059-4be4-a235-70ebafcc3bbb tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:20.566636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bb6e92e-a059-4be4-a235-70ebafcc3bbb tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:20.566636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bb6e92e-a059-4be4-a235-70ebafcc3bbb tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:20.566636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bb6e92e-a059-4be4-a235-70ebafcc3bbb tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:20.566636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bb6e92e-a059-4be4-a235-70ebafcc3bbb tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:20.566636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2bb6e92e-a059-4be4-a235-70ebafcc3bbb tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:20.955928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2bb6e92e-a059-4be4-a235-70ebafcc3bbb tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:20.966296 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2bb6e92e-a059-4be4-a235-70ebafcc3bbb tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1319 microversion: 2.1 time: 0.437843 Oct 11 04:50:20.967611 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3171/6580] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:20 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1319 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:50:22.010298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-886e44cc-d679-4279-9216-76c38e8b9e5d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:22.011540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-886e44cc-d679-4279-9216-76c38e8b9e5d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:22.022710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886e44cc-d679-4279-9216-76c38e8b9e5d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:22.027229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886e44cc-d679-4279-9216-76c38e8b9e5d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:22.028349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886e44cc-d679-4279-9216-76c38e8b9e5d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:22.042599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886e44cc-d679-4279-9216-76c38e8b9e5d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:22.042599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886e44cc-d679-4279-9216-76c38e8b9e5d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:22.042599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-886e44cc-d679-4279-9216-76c38e8b9e5d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:22.643584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-886e44cc-d679-4279-9216-76c38e8b9e5d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:22.652792 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-886e44cc-d679-4279-9216-76c38e8b9e5d tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1319 microversion: 2.1 time: 0.663491 Oct 11 04:50:22.653980 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3410/6581] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:21 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1319 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:23.555910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a4e46262-fdac-42fe-9ad2-303695ae9744 req-c7e7b536-94a4-449c-a74c-656f1f1de9b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a32b2183-7b0d-4bde-b865-23336ba0337e", "name": "network-vif-plugged", "status": "completed", "tag": "e9c7cb82-7298-4a7b-9335-5a30b168b885"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:50:23.584953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:23.588277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a4e46262-fdac-42fe-9ad2-303695ae9744 req-c7e7b536-94a4-449c-a74c-656f1f1de9b3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:23.589220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a4e46262-fdac-42fe-9ad2-303695ae9744 req-c7e7b536-94a4-449c-a74c-656f1f1de9b3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:23.589837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a4e46262-fdac-42fe-9ad2-303695ae9744 req-c7e7b536-94a4-449c-a74c-656f1f1de9b3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:23.604003 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a4e46262-fdac-42fe-9ad2-303695ae9744 req-c7e7b536-94a4-449c-a74c-656f1f1de9b3 service nova] Creating event network-vif-plugged:e9c7cb82-7298-4a7b-9335-5a30b168b885 for instance a32b2183-7b0d-4bde-b865-23336ba0337e on n-h2-860892-1 Oct 11 04:50:23.609475 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a4e46262-fdac-42fe-9ad2-303695ae9744 req-c7e7b536-94a4-449c-a74c-656f1f1de9b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059482 Oct 11 04:50:23.610793 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3172/6582] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:50:23.676837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4e8771ba-2e45-48c9-9667-3036d7ea249e tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:23.677398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4e8771ba-2e45-48c9-9667-3036d7ea249e tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:23.683912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:23.687448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8771ba-2e45-48c9-9667-3036d7ea249e tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:23.688535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8771ba-2e45-48c9-9667-3036d7ea249e tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:23.689126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8771ba-2e45-48c9-9667-3036d7ea249e tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:23.690095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8771ba-2e45-48c9-9667-3036d7ea249e tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:23.690816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8771ba-2e45-48c9-9667-3036d7ea249e tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:23.691465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e8771ba-2e45-48c9-9667-3036d7ea249e tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:23.988977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4e8771ba-2e45-48c9-9667-3036d7ea249e tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:23.997770 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4e8771ba-2e45-48c9-9667-3036d7ea249e tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1319 microversion: 2.1 time: 0.325304 Oct 11 04:50:24.008165 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3411/6583] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:23 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:25.018513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:25.024204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-17852af1-b2ab-4502-8740-cb22e3d0e6f0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:25.025008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-17852af1-b2ab-4502-8740-cb22e3d0e6f0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:25.031877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17852af1-b2ab-4502-8740-cb22e3d0e6f0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:25.032369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17852af1-b2ab-4502-8740-cb22e3d0e6f0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:25.032807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17852af1-b2ab-4502-8740-cb22e3d0e6f0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:25.033509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17852af1-b2ab-4502-8740-cb22e3d0e6f0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:25.033950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17852af1-b2ab-4502-8740-cb22e3d0e6f0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:25.034400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17852af1-b2ab-4502-8740-cb22e3d0e6f0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:25.177819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-17852af1-b2ab-4502-8740-cb22e3d0e6f0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:25.187170 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-17852af1-b2ab-4502-8740-cb22e3d0e6f0 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1507 microversion: 2.1 time: 0.169371 Oct 11 04:50:25.187953 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3173/6584] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:25 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:25.212277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8c4b2223-04d3-43db-9c71-3bbd719080e6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bb2dc08c-a946-48d9-a63d-34039b7f9285", "device": "/dev/sdb"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:50:25.214781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8c4b2223-04d3-43db-9c71-3bbd719080e6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:25.222513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c4b2223-04d3-43db-9c71-3bbd719080e6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:25.223000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c4b2223-04d3-43db-9c71-3bbd719080e6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:25.223437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c4b2223-04d3-43db-9c71-3bbd719080e6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:25.224136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c4b2223-04d3-43db-9c71-3bbd719080e6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:25.224602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c4b2223-04d3-43db-9c71-3bbd719080e6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:25.225017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c4b2223-04d3-43db-9c71-3bbd719080e6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:26.058809 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8c4b2223-04d3-43db-9c71-3bbd719080e6 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "POST /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.850540 Oct 11 04:50:26.085899 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3412/6585] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:50:25 2022] POST /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:50:52.052673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4adda41e-ac5c-44fe-b35b-0cbf193b7533 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:52.054081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4adda41e-ac5c-44fe-b35b-0cbf193b7533 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:52.057781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:52.058509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=16 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:52.062693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adda41e-ac5c-44fe-b35b-0cbf193b7533 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:52.063171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adda41e-ac5c-44fe-b35b-0cbf193b7533 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:52.063752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adda41e-ac5c-44fe-b35b-0cbf193b7533 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:52.064472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adda41e-ac5c-44fe-b35b-0cbf193b7533 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:52.064919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adda41e-ac5c-44fe-b35b-0cbf193b7533 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:52.065499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4adda41e-ac5c-44fe-b35b-0cbf193b7533 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:52.284884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-4adda41e-ac5c-44fe-b35b-0cbf193b7533 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lazy-loading 'services' on Instance uuid a32b2183-7b0d-4bde-b865-23336ba0337e {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:50:52.495154 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4adda41e-ac5c-44fe-b35b-0cbf193b7533 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e/os-volume_attachments/bb2dc08c-a946-48d9-a63d-34039b7f9285" status: 202 len: 0 microversion: 2.1 time: 0.446512 Oct 11 04:50:52.495989 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3174/6586] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:50:52 2022] DELETE /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e/os-volume_attachments/bb2dc08c-a946-48d9-a63d-34039b7f9285 => generated 0 bytes in 448 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:50:58.049047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cb467cd3-ac7a-48a9-aad7-d30d16b49990 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:58.050356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cb467cd3-ac7a-48a9-aad7-d30d16b49990 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:58.060007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:58.060730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:50:58.064040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb467cd3-ac7a-48a9-aad7-d30d16b49990 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:58.064852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb467cd3-ac7a-48a9-aad7-d30d16b49990 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:58.065773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb467cd3-ac7a-48a9-aad7-d30d16b49990 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:58.066770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb467cd3-ac7a-48a9-aad7-d30d16b49990 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:58.074300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb467cd3-ac7a-48a9-aad7-d30d16b49990 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:58.074300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cb467cd3-ac7a-48a9-aad7-d30d16b49990 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:58.105576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cb467cd3-ac7a-48a9-aad7-d30d16b49990 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:50:58.485949 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cb467cd3-ac7a-48a9-aad7-d30d16b49990 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 204 len: 0 microversion: 2.1 time: 0.441213 Oct 11 04:50:58.487350 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3413/6587] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:50:58 2022] DELETE /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 0 bytes in 444 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:50:58.499844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a58ddf60-4690-460a-882e-4e9e264d8bc7 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:58.502217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a58ddf60-4690-460a-882e-4e9e264d8bc7 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:58.513978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58ddf60-4690-460a-882e-4e9e264d8bc7 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:58.518824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58ddf60-4690-460a-882e-4e9e264d8bc7 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:58.525037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58ddf60-4690-460a-882e-4e9e264d8bc7 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:58.525037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58ddf60-4690-460a-882e-4e9e264d8bc7 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:58.525037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58ddf60-4690-460a-882e-4e9e264d8bc7 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:58.525037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58ddf60-4690-460a-882e-4e9e264d8bc7 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:58.716875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a58ddf60-4690-460a-882e-4e9e264d8bc7 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:50:58.730675 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a58ddf60-4690-460a-882e-4e9e264d8bc7 tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1513 microversion: 2.1 time: 0.238911 Oct 11 04:50:58.732687 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3175/6588] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:58 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1513 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:50:59.756411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3d0aa77e-5fe1-446a-8d2f-eef61c2c1f8c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:50:59.757114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3d0aa77e-5fe1-446a-8d2f-eef61c2c1f8c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:50:59.764728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d0aa77e-5fe1-446a-8d2f-eef61c2c1f8c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:59.765209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d0aa77e-5fe1-446a-8d2f-eef61c2c1f8c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:59.765643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d0aa77e-5fe1-446a-8d2f-eef61c2c1f8c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:50:59.766365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d0aa77e-5fe1-446a-8d2f-eef61c2c1f8c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:50:59.766853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d0aa77e-5fe1-446a-8d2f-eef61c2c1f8c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:50:59.767273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d0aa77e-5fe1-446a-8d2f-eef61c2c1f8c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:00.078894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3d0aa77e-5fe1-446a-8d2f-eef61c2c1f8c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:00.088619 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3d0aa77e-5fe1-446a-8d2f-eef61c2c1f8c tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1513 microversion: 2.1 time: 0.336628 Oct 11 04:51:00.089214 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3414/6589] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:50:59 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1513 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:01.112198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-60a69233-4539-4bea-9f8b-29d40fb78edc tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:01.112844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-60a69233-4539-4bea-9f8b-29d40fb78edc tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:01.120237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60a69233-4539-4bea-9f8b-29d40fb78edc tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:01.120716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60a69233-4539-4bea-9f8b-29d40fb78edc tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:01.121156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60a69233-4539-4bea-9f8b-29d40fb78edc tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:01.121848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60a69233-4539-4bea-9f8b-29d40fb78edc tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:01.122329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60a69233-4539-4bea-9f8b-29d40fb78edc tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:01.122752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60a69233-4539-4bea-9f8b-29d40fb78edc tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:01.236524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-60a69233-4539-4bea-9f8b-29d40fb78edc tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:01.248011 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-60a69233-4539-4bea-9f8b-29d40fb78edc tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1471 microversion: 2.1 time: 0.138150 Oct 11 04:51:01.248011 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3176/6590] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:01 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1471 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:01.281164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6df17e79-6268-445f-a1ac-d618b98fe4bf req-8468749a-d31c-4a89-a810-95d9d8fdb666 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a32b2183-7b0d-4bde-b865-23336ba0337e", "name": "network-vif-deleted", "tag": "e9c7cb82-7298-4a7b-9335-5a30b168b885"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:51:01.293478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6df17e79-6268-445f-a1ac-d618b98fe4bf req-8468749a-d31c-4a89-a810-95d9d8fdb666 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:01.294266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6df17e79-6268-445f-a1ac-d618b98fe4bf req-8468749a-d31c-4a89-a810-95d9d8fdb666 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:01.294921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6df17e79-6268-445f-a1ac-d618b98fe4bf req-8468749a-d31c-4a89-a810-95d9d8fdb666 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:01.310059 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6df17e79-6268-445f-a1ac-d618b98fe4bf req-8468749a-d31c-4a89-a810-95d9d8fdb666 service nova] Creating event network-vif-deleted:e9c7cb82-7298-4a7b-9335-5a30b168b885 for instance a32b2183-7b0d-4bde-b865-23336ba0337e on n-h2-860892-1 Oct 11 04:51:01.313271 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6df17e79-6268-445f-a1ac-d618b98fe4bf req-8468749a-d31c-4a89-a810-95d9d8fdb666 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038954 Oct 11 04:51:01.313972 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3415/6591] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:51:02.269955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:02.273885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:02.278370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:02.278981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:02.279517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:02.280334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:02.280885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:02.281568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:02.315385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:02.316013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:02.316582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:02.317120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lazy-loading 'fault' on Instance uuid a32b2183-7b0d-4bde-b865-23336ba0337e {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:51:02.372323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '98816664bcab450dab5abf6bb70915d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e390dec4a5084a2cadd229dadbdb46fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:02.382048 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-628e70eb-bbc0-4510-8760-d227164c0e0b tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 200 len: 1309 microversion: 2.1 time: 0.116229 Oct 11 04:51:02.382760 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3177/6592] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:02 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:03.407831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:03.408596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] [instance: a32b2183-7b0d-4bde-b865-23336ba0337e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:03.423847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:03.424349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:03.424791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:03.425490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:03.425941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:03.426394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:03.444664 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] HTTP exception thrown: Instance a32b2183-7b0d-4bde-b865-23336ba0337e could not be found. Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Request method failure captured: Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e HTTP/1.1 Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPUTCCrtnjLUHXjzJqkQZH0eJjsLWqNwk5V9biGDtRaPLaeihdMXJfVsmawyFLYUUfz4dgXCHMEo8tzorgf-s-LohjjRgRjpj3S6FUGCjjnzz2QCQNXtJE_xQM76mkotFKWw-eV0TMj7gb7ohMoFSPfY0RiGJUNd4J-gNx6nL7pjUmg Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: e390dec4a5084a2cadd229dadbdb46fa Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesSnapshotTestJSON-112440802 Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e390dec4a5084a2cadd229dadbdb46fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e390dec4a5084a2cadd229dadbdb46fa"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e390dec4a5084a2cadd229dadbdb46fa"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e390dec4a5084a2cadd229dadbdb46fa"}]}] Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesSnapshotTestJSON-112440802 Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: e390dec4a5084a2cadd229dadbdb46fa Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-112440802 Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesSnapshotTestJSON-112440802-project Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 98816664bcab450dab5abf6bb70915d7 Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesSnapshotTestJSON-112440802-project Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance a32b2183-7b0d-4bde-b865-23336ba0337e could not be found. Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'a32b2183-7b0d-4bde-b865-23336ba0337e'} Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a32b2183-7b0d-4bde-b865-23336ba0337e could not be found. Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a32b2183-7b0d-4bde-b865-23336ba0337e could not be found. Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:51:03.446904 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:51:03.451524 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:51:03.451524 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:51:03.451524 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:51:03.451524 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:51:03.451524 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:51:03.451524 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a32b2183-7b0d-4bde-b865-23336ba0337e could not be found. Oct 11 04:51:03.451524 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:51:03.453204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] Returning 404 to user: Instance a32b2183-7b0d-4bde-b865-23336ba0337e could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:51:03.454078 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f126f503-2550-476c-8a8e-ffc30dacf9ff tempest-VolumesSnapshotTestJSON-112440802 tempest-VolumesSnapshotTestJSON-112440802-project] 10.222.0.26 "GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e" status: 404 len: 111 microversion: 2.1 time: 0.051371 Oct 11 04:51:03.454685 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3416/6593] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:03 2022] GET /compute/v2.1/servers/a32b2183-7b0d-4bde-b865-23336ba0337e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:51:27.831583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=10 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:27.832329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=29,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:28.077966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce4dfd7e-be9f-4ebb-a45b-f9a473560bd6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'create', calling method: .version_select at 0x7fda187ba160>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1350225556", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBhpbTjo7ifkfC9z1vdxDZRGj9F62lt2XZtpbP3aE6kUdju3CoyK+33rPRHVsdoIIL+dk4PqHVDaIU9jrFruaOsKCLNB/WR7h/ZkV3nNDPcypjq6gfZszXy1PCiL+oUmYw=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:51:28.101440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ce4dfd7e-be9f-4ebb-a45b-f9a473560bd6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for project e30500ead1404e5188c6d90e5b302742. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:51:28.109065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ce4dfd7e-be9f-4ebb-a45b-f9a473560bd6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for user a95598cd3fe04a0abff7aac9f0c49bff and project e30500ead1404e5188c6d90e5b302742. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:51:28.133157 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ce4dfd7e-be9f-4ebb-a45b-f9a473560bd6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [e97bebfd-ed87-4f8d-a2d1-630722a087bb] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 04:51:29.148677 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [None req-ce4dfd7e-be9f-4ebb-a45b-f9a473560bd6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [e97bebfd-ed87-4f8d-a2d1-630722a087bb] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 54138. Oct 11 04:51:29.235346 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce4dfd7e-be9f-4ebb-a45b-f9a473560bd6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 1.409376 Oct 11 04:51:29.236426 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3178/6594] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:51:27 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 1411 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:51:34.186770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-server-smoke-1433576228", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "4550b35d-40f3-471e-b4c5-7c53a3ee67ff"}], "key_name": "tempest-TestSecurityGroupsBasicOps-997522340", "security_groups": []}, "os:scheduler_hints": {"different_host": ["cc426c32-c378-4b3c-a917-1ab5bf65d828"]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool [-] Exception during reset or similar: pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query (timed out)') Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 732, in _read_bytes Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool data = self._rfile.read(num_bytes) Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/lib/python3.8/socket.py", line 669, in readinto Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool return self._sock.recv_into(b) Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 376, in recv_into Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool return self._recv_loop(self.fd.recv_into, 0, buffer, nbytes, flags) Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 364, in _recv_loop Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool self._read_trampoline() Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 332, in _read_trampoline Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool self._trampoline( Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/greenio/base.py", line 211, in _trampoline Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool return trampoline(fd, read=read, write=write, timeout=timeout, Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/__init__.py", line 159, in trampoline Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool return hub.switch() Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 313, in switch Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool return self.greenlet.switch() Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool socket.timeout: timed out Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool During handling of the above exception, another exception occurred: Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool Traceback (most recent call last): Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 739, in _finalize_fairy Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool fairy._reset(pool) Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/pool/base.py", line 988, in _reset Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool pool._dialect.do_rollback(self) Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 682, in do_rollback Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool dbapi_connection.rollback() Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 480, in rollback Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool self._read_ok_packet() Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 443, in _read_ok_packet Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool pkt = self._read_packet() Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 692, in _read_packet Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool packet_header = self._read_bytes(4) Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 738, in _read_bytes Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool raise err.OperationalError( Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query (timed out)') Oct 11 04:51:34.249106 n-d-860892-1 devstack@n-api.service[120994]: ERROR sqlalchemy.pool.impl.QueuePool Oct 11 04:51:34.252211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:34.252211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=24,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:34.307308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] validate_networks() for [('4550b35d-40f3-471e-b4c5-7c53a3ee67ff', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:51:34.988608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:51:34.989343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:51:34.990047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:51:34.990690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:51:34.991446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:51:35.006965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:35.007752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:35.008377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:35.009485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:35.010116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:35.011329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:35.038274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Getting quotas for project 21b57322474547e89bdbbd521a214720. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:51:35.044801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Getting quotas for user a2c6082e11c3414ebcbd31f1edca2ac9 and project 21b57322474547e89bdbbd521a214720. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:51:35.061850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:51:35.064861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:51:35.237347 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f1dd3435-7e66-44bd-a71a-9adbcd33a33f tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 361 microversion: 2.1 time: 1.062289 Oct 11 04:51:35.238755 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3417/6595] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:51:34 2022] POST /compute/v2.1/servers => generated 361 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:51:35.250173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4a724722-d61d-4c72-9e2a-60befd9b72a2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:35.251510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4a724722-d61d-4c72-9e2a-60befd9b72a2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:35.434658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4a724722-d61d-4c72-9e2a-60befd9b72a2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:35.443845 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4a724722-d61d-4c72-9e2a-60befd9b72a2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1241 microversion: 2.1 time: 0.198151 Oct 11 04:51:35.446902 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3179/6596] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:35 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1241 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:36.474095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-53efdf91-b7c7-4048-891b-5dcfe9764c28 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:36.474987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-53efdf91-b7c7-4048-891b-5dcfe9764c28 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:36.491168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53efdf91-b7c7-4048-891b-5dcfe9764c28 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:36.491998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53efdf91-b7c7-4048-891b-5dcfe9764c28 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:36.492099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53efdf91-b7c7-4048-891b-5dcfe9764c28 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:36.492932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53efdf91-b7c7-4048-891b-5dcfe9764c28 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:36.493392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53efdf91-b7c7-4048-891b-5dcfe9764c28 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:36.493883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53efdf91-b7c7-4048-891b-5dcfe9764c28 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:36.651646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-53efdf91-b7c7-4048-891b-5dcfe9764c28 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:36.661908 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-53efdf91-b7c7-4048-891b-5dcfe9764c28 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1245 microversion: 2.1 time: 0.192803 Oct 11 04:51:36.663211 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3418/6597] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:36 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1245 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:37.684922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-516e0daf-9ca2-4f16-9023-6885aab6bce1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:37.686338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-516e0daf-9ca2-4f16-9023-6885aab6bce1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:37.701986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-516e0daf-9ca2-4f16-9023-6885aab6bce1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:37.706920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-516e0daf-9ca2-4f16-9023-6885aab6bce1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:37.707453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-516e0daf-9ca2-4f16-9023-6885aab6bce1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:37.710731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-516e0daf-9ca2-4f16-9023-6885aab6bce1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:37.711000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-516e0daf-9ca2-4f16-9023-6885aab6bce1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:37.713535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-516e0daf-9ca2-4f16-9023-6885aab6bce1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:37.887115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-516e0daf-9ca2-4f16-9023-6885aab6bce1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:37.900933 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-516e0daf-9ca2-4f16-9023-6885aab6bce1 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1301 microversion: 2.1 time: 0.215624 Oct 11 04:51:37.902168 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3180/6598] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:37 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1301 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:38.924739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-089e90c7-43e4-4e22-9dfa-d7ce238f7bc7 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:38.925988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-089e90c7-43e4-4e22-9dfa-d7ce238f7bc7 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:38.935721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089e90c7-43e4-4e22-9dfa-d7ce238f7bc7 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:38.937762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089e90c7-43e4-4e22-9dfa-d7ce238f7bc7 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:38.952383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089e90c7-43e4-4e22-9dfa-d7ce238f7bc7 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:38.953428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089e90c7-43e4-4e22-9dfa-d7ce238f7bc7 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:38.955095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089e90c7-43e4-4e22-9dfa-d7ce238f7bc7 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:38.963052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089e90c7-43e4-4e22-9dfa-d7ce238f7bc7 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:39.159991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-089e90c7-43e4-4e22-9dfa-d7ce238f7bc7 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:39.165936 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-089e90c7-43e4-4e22-9dfa-d7ce238f7bc7 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1299 microversion: 2.1 time: 0.245041 Oct 11 04:51:39.168541 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3419/6599] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:38 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1299 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:40.205303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-93d39d71-95d7-4065-ba00-85870fba8463 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:40.205886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-93d39d71-95d7-4065-ba00-85870fba8463 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:40.225523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93d39d71-95d7-4065-ba00-85870fba8463 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:40.227834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93d39d71-95d7-4065-ba00-85870fba8463 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:40.228465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93d39d71-95d7-4065-ba00-85870fba8463 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:40.233187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93d39d71-95d7-4065-ba00-85870fba8463 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:40.233944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93d39d71-95d7-4065-ba00-85870fba8463 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:40.234575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93d39d71-95d7-4065-ba00-85870fba8463 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:40.470046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-93d39d71-95d7-4065-ba00-85870fba8463 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:40.482698 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-93d39d71-95d7-4065-ba00-85870fba8463 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1299 microversion: 2.1 time: 0.281238 Oct 11 04:51:40.483881 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3181/6600] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:40 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1299 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:41.534724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca927fb9-6e94-4bc8-9b40-681a65c22a7e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:41.537454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ca927fb9-6e94-4bc8-9b40-681a65c22a7e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:41.569389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca927fb9-6e94-4bc8-9b40-681a65c22a7e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:41.569893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca927fb9-6e94-4bc8-9b40-681a65c22a7e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:41.570988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca927fb9-6e94-4bc8-9b40-681a65c22a7e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:41.571798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca927fb9-6e94-4bc8-9b40-681a65c22a7e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:41.574975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca927fb9-6e94-4bc8-9b40-681a65c22a7e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:41.575778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca927fb9-6e94-4bc8-9b40-681a65c22a7e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:41.704087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ca927fb9-6e94-4bc8-9b40-681a65c22a7e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:41.717979 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ca927fb9-6e94-4bc8-9b40-681a65c22a7e tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1299 microversion: 2.1 time: 0.215647 Oct 11 04:51:41.721088 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3420/6601] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:41 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1299 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:41.993743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6d2b9289-3962-4cac-9c68-b004822222eb req-53fd0b25-ec74-46c4-b165-307b1170851a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9bdbf1f9-4e98-4700-8ae0-0a3809f635f1", "tag": "88b3d6d9-3595-4dc2-9268-44d69c1b7726"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:51:42.012477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d2b9289-3962-4cac-9c68-b004822222eb req-53fd0b25-ec74-46c4-b165-307b1170851a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:42.012477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d2b9289-3962-4cac-9c68-b004822222eb req-53fd0b25-ec74-46c4-b165-307b1170851a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:42.012477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d2b9289-3962-4cac-9c68-b004822222eb req-53fd0b25-ec74-46c4-b165-307b1170851a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:42.028833 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6d2b9289-3962-4cac-9c68-b004822222eb req-53fd0b25-ec74-46c4-b165-307b1170851a service nova] Creating event network-changed:88b3d6d9-3595-4dc2-9268-44d69c1b7726 for instance 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 on n-h2-860892-1 Oct 11 04:51:42.036412 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6d2b9289-3962-4cac-9c68-b004822222eb req-53fd0b25-ec74-46c4-b165-307b1170851a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047809 Oct 11 04:51:42.038081 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3182/6602] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:51:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:51:42.760110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6842a408-2a73-4aa8-8ed9-276fa66c669a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:42.760110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6842a408-2a73-4aa8-8ed9-276fa66c669a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:42.760110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6842a408-2a73-4aa8-8ed9-276fa66c669a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:42.760110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6842a408-2a73-4aa8-8ed9-276fa66c669a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:42.760110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6842a408-2a73-4aa8-8ed9-276fa66c669a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:42.760110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6842a408-2a73-4aa8-8ed9-276fa66c669a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:42.760110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6842a408-2a73-4aa8-8ed9-276fa66c669a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:42.761310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6842a408-2a73-4aa8-8ed9-276fa66c669a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:42.898222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6842a408-2a73-4aa8-8ed9-276fa66c669a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:42.906435 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6842a408-2a73-4aa8-8ed9-276fa66c669a tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1299 microversion: 2.1 time: 0.166431 Oct 11 04:51:42.907837 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3421/6603] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:42 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:43.932860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9d009682-7bcd-490b-adf4-2a038e5cbe27 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:43.936597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9d009682-7bcd-490b-adf4-2a038e5cbe27 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:43.942329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d009682-7bcd-490b-adf4-2a038e5cbe27 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:43.942925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d009682-7bcd-490b-adf4-2a038e5cbe27 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:43.944004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d009682-7bcd-490b-adf4-2a038e5cbe27 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:43.944918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d009682-7bcd-490b-adf4-2a038e5cbe27 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:43.945686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d009682-7bcd-490b-adf4-2a038e5cbe27 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:43.946437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d009682-7bcd-490b-adf4-2a038e5cbe27 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:44.081847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9d009682-7bcd-490b-adf4-2a038e5cbe27 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:44.095561 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9d009682-7bcd-490b-adf4-2a038e5cbe27 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1299 microversion: 2.1 time: 0.161626 Oct 11 04:51:44.096758 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3183/6604] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:43 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:44.834329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1402841349", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "d6c393c4-ac5c-4a84-a7c0-a800dea2dedf"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1350225556", "security_groups": [{"name": "tempest-secgroup-smoke-2005212556"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:51:44.956259 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] validate_networks() for [('d6c393c4-ac5c-4a84-a7c0-a800dea2dedf', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:51:45.021536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:45.057184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:45.121218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f497322f-f899-4d76-a090-64ac2caadc45 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:45.121834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f497322f-f899-4d76-a090-64ac2caadc45 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:45.134056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f497322f-f899-4d76-a090-64ac2caadc45 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:45.134717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f497322f-f899-4d76-a090-64ac2caadc45 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:45.135176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f497322f-f899-4d76-a090-64ac2caadc45 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:45.135920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f497322f-f899-4d76-a090-64ac2caadc45 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:45.136644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f497322f-f899-4d76-a090-64ac2caadc45 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:45.137462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f497322f-f899-4d76-a090-64ac2caadc45 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:45.233576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f497322f-f899-4d76-a090-64ac2caadc45 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:45.250271 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f497322f-f899-4d76-a090-64ac2caadc45 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1299 microversion: 2.1 time: 0.133393 Oct 11 04:51:45.250958 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3184/6605] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:45 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1299 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:45.442704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:51:45.446088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:51:45.446088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:51:45.446088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:51:45.446088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:51:45.458421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:45.458979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:45.459482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:45.460456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:45.460980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:45.461476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:45.480380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for project e30500ead1404e5188c6d90e5b302742. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:51:45.485558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for user a95598cd3fe04a0abff7aac9f0c49bff and project e30500ead1404e5188c6d90e5b302742. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:51:45.498613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:51:45.500878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:51:45.651220 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c8aefd8e-fb76-46fc-8127-b063265514e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.818850 Oct 11 04:51:45.651220 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3422/6606] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:51:44 2022] POST /compute/v2.1/servers => generated 406 bytes in 821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:51:45.655892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-db78f5f8-a16f-467f-85be-cb7c5d309085 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:45.656508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-db78f5f8-a16f-467f-85be-cb7c5d309085 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:45.659005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:45.721490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-db78f5f8-a16f-467f-85be-cb7c5d309085 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:45.729360 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-db78f5f8-a16f-467f-85be-cb7c5d309085 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1267 microversion: 2.1 time: 0.077227 Oct 11 04:51:45.730116 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3185/6607] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:45 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1267 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:46.281177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c3a8e579-9f13-4e08-8ba5-4f3623b338b6 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:46.281856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c3a8e579-9f13-4e08-8ba5-4f3623b338b6 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:46.294667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a8e579-9f13-4e08-8ba5-4f3623b338b6 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:46.295153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a8e579-9f13-4e08-8ba5-4f3623b338b6 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:46.295767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a8e579-9f13-4e08-8ba5-4f3623b338b6 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:46.296665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a8e579-9f13-4e08-8ba5-4f3623b338b6 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:46.297269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a8e579-9f13-4e08-8ba5-4f3623b338b6 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:46.297846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3a8e579-9f13-4e08-8ba5-4f3623b338b6 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:46.439211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c3a8e579-9f13-4e08-8ba5-4f3623b338b6 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:46.448649 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c3a8e579-9f13-4e08-8ba5-4f3623b338b6 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1299 microversion: 2.1 time: 0.172508 Oct 11 04:51:46.449796 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3423/6608] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:46 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1299 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:46.753942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eb5baf51-e635-4a1f-ad5d-e28441e905c6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:46.808827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eb5baf51-e635-4a1f-ad5d-e28441e905c6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:46.899858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eb5baf51-e635-4a1f-ad5d-e28441e905c6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:46.913629 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eb5baf51-e635-4a1f-ad5d-e28441e905c6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1267 microversion: 2.1 time: 0.164646 Oct 11 04:51:46.915431 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3186/6609] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:46 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:47.476342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b8255313-8faf-426e-9a40-f41eef667957 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:47.477055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b8255313-8faf-426e-9a40-f41eef667957 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:47.489527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8255313-8faf-426e-9a40-f41eef667957 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:47.490024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8255313-8faf-426e-9a40-f41eef667957 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:47.502356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8255313-8faf-426e-9a40-f41eef667957 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:47.503214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8255313-8faf-426e-9a40-f41eef667957 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:47.503700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8255313-8faf-426e-9a40-f41eef667957 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:47.507058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8255313-8faf-426e-9a40-f41eef667957 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:47.681046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b8255313-8faf-426e-9a40-f41eef667957 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:47.691238 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b8255313-8faf-426e-9a40-f41eef667957 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1299 microversion: 2.1 time: 0.222340 Oct 11 04:51:47.707999 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3424/6610] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:47 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:47.939006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f5facf0-3a33-402b-8b44-9917f0f93f26 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:47.940142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f5facf0-3a33-402b-8b44-9917f0f93f26 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:47.949571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f5facf0-3a33-402b-8b44-9917f0f93f26 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:47.950070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f5facf0-3a33-402b-8b44-9917f0f93f26 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:47.950563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f5facf0-3a33-402b-8b44-9917f0f93f26 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:47.951276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f5facf0-3a33-402b-8b44-9917f0f93f26 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:47.951726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f5facf0-3a33-402b-8b44-9917f0f93f26 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:47.952478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f5facf0-3a33-402b-8b44-9917f0f93f26 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:48.029253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f5facf0-3a33-402b-8b44-9917f0f93f26 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:48.037131 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f5facf0-3a33-402b-8b44-9917f0f93f26 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1263 microversion: 2.1 time: 0.102918 Oct 11 04:51:48.038385 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3187/6611] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:47 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1263 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:48.173447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4955ac80-8908-49a4-92d1-a5ef41aca8ba req-2c1b50c1-73b2-4472-874b-6f534528df71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bdbf1f9-4e98-4700-8ae0-0a3809f635f1", "name": "network-vif-plugged", "status": "completed", "tag": "88b3d6d9-3595-4dc2-9268-44d69c1b7726"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:51:48.184483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4955ac80-8908-49a4-92d1-a5ef41aca8ba req-2c1b50c1-73b2-4472-874b-6f534528df71 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:48.185165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4955ac80-8908-49a4-92d1-a5ef41aca8ba req-2c1b50c1-73b2-4472-874b-6f534528df71 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:48.185769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4955ac80-8908-49a4-92d1-a5ef41aca8ba req-2c1b50c1-73b2-4472-874b-6f534528df71 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:48.198244 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4955ac80-8908-49a4-92d1-a5ef41aca8ba req-2c1b50c1-73b2-4472-874b-6f534528df71 service nova] Creating event network-vif-plugged:88b3d6d9-3595-4dc2-9268-44d69c1b7726 for instance 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 on n-h2-860892-1 Oct 11 04:51:48.203676 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4955ac80-8908-49a4-92d1-a5ef41aca8ba req-2c1b50c1-73b2-4472-874b-6f534528df71 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034353 Oct 11 04:51:48.204803 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3425/6612] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:51:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:51:48.715147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c8177e0d-36c6-406b-a53f-1e4680bf6c02 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:48.716058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c8177e0d-36c6-406b-a53f-1e4680bf6c02 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:48.723316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8177e0d-36c6-406b-a53f-1e4680bf6c02 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:48.723794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8177e0d-36c6-406b-a53f-1e4680bf6c02 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:48.724224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8177e0d-36c6-406b-a53f-1e4680bf6c02 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:48.724909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8177e0d-36c6-406b-a53f-1e4680bf6c02 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:48.725350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8177e0d-36c6-406b-a53f-1e4680bf6c02 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:48.725767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8177e0d-36c6-406b-a53f-1e4680bf6c02 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:48.845171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c8177e0d-36c6-406b-a53f-1e4680bf6c02 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:48.863969 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c8177e0d-36c6-406b-a53f-1e4680bf6c02 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1299 microversion: 2.1 time: 0.152776 Oct 11 04:51:48.865215 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3188/6613] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:48 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1299 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:51:49.072496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e1216d06-92db-4e04-a42f-1eeae146f644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:49.072496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e1216d06-92db-4e04-a42f-1eeae146f644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:49.088656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1216d06-92db-4e04-a42f-1eeae146f644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:49.089812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1216d06-92db-4e04-a42f-1eeae146f644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:49.090380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1216d06-92db-4e04-a42f-1eeae146f644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:49.091253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1216d06-92db-4e04-a42f-1eeae146f644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:49.092037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1216d06-92db-4e04-a42f-1eeae146f644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:49.092560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1216d06-92db-4e04-a42f-1eeae146f644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:49.213269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e1216d06-92db-4e04-a42f-1eeae146f644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:49.229571 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e1216d06-92db-4e04-a42f-1eeae146f644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1337 microversion: 2.1 time: 0.170815 Oct 11 04:51:49.230479 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3426/6614] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:49 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1337 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:49.889733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5469df8f-288f-43e6-b003-7bbfec4cff18 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:49.890357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5469df8f-288f-43e6-b003-7bbfec4cff18 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:49.904986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5469df8f-288f-43e6-b003-7bbfec4cff18 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:49.904986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5469df8f-288f-43e6-b003-7bbfec4cff18 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:49.904986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5469df8f-288f-43e6-b003-7bbfec4cff18 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:49.904986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5469df8f-288f-43e6-b003-7bbfec4cff18 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:49.904986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5469df8f-288f-43e6-b003-7bbfec4cff18 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:49.904986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5469df8f-288f-43e6-b003-7bbfec4cff18 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:50.014730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5469df8f-288f-43e6-b003-7bbfec4cff18 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:50.023589 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5469df8f-288f-43e6-b003-7bbfec4cff18 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1470 microversion: 2.1 time: 0.138826 Oct 11 04:51:50.024209 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3189/6615] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:49 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1470 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:50.052979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-532c5b54-6498-4633-84f1-44ea33e54418 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:50.053598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-532c5b54-6498-4633-84f1-44ea33e54418 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:50.059677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532c5b54-6498-4633-84f1-44ea33e54418 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:50.060174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532c5b54-6498-4633-84f1-44ea33e54418 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:50.060588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532c5b54-6498-4633-84f1-44ea33e54418 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:50.061271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532c5b54-6498-4633-84f1-44ea33e54418 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:50.061727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532c5b54-6498-4633-84f1-44ea33e54418 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:50.062145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-532c5b54-6498-4633-84f1-44ea33e54418 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:50.220039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-532c5b54-6498-4633-84f1-44ea33e54418 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:50.231921 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-532c5b54-6498-4633-84f1-44ea33e54418 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1470 microversion: 2.1 time: 0.186315 Oct 11 04:51:50.232513 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3427/6616] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:50 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1470 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:50.254042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ac217f9d-abd3-40bd-8d3e-065cf6063e6f tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:50.254955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ac217f9d-abd3-40bd-8d3e-065cf6063e6f tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:50.257282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc1190f0-a148-4147-a554-6fe62fcffe0d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:50.258215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cc1190f0-a148-4147-a554-6fe62fcffe0d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:50.261746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac217f9d-abd3-40bd-8d3e-065cf6063e6f tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:50.262492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac217f9d-abd3-40bd-8d3e-065cf6063e6f tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:50.263108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac217f9d-abd3-40bd-8d3e-065cf6063e6f tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:50.263807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac217f9d-abd3-40bd-8d3e-065cf6063e6f tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:50.264422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac217f9d-abd3-40bd-8d3e-065cf6063e6f tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:50.265014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac217f9d-abd3-40bd-8d3e-065cf6063e6f tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:50.266742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc1190f0-a148-4147-a554-6fe62fcffe0d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:50.267423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc1190f0-a148-4147-a554-6fe62fcffe0d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:50.268581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc1190f0-a148-4147-a554-6fe62fcffe0d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:50.269449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc1190f0-a148-4147-a554-6fe62fcffe0d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:50.269898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc1190f0-a148-4147-a554-6fe62fcffe0d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:50.270360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cc1190f0-a148-4147-a554-6fe62fcffe0d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:50.360698 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ac217f9d-abd3-40bd-8d3e-065cf6063e6f tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1621 microversion: 2.1 time: 0.110877 Oct 11 04:51:50.362035 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3190/6617] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:50 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1621 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:50.385411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bb37bfcc-37d2-4783-81df-158e60f786c2 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:50.387472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bb37bfcc-37d2-4783-81df-158e60f786c2 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:50.394802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb37bfcc-37d2-4783-81df-158e60f786c2 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:50.395544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb37bfcc-37d2-4783-81df-158e60f786c2 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:50.397912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb37bfcc-37d2-4783-81df-158e60f786c2 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:50.397912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb37bfcc-37d2-4783-81df-158e60f786c2 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:50.397912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb37bfcc-37d2-4783-81df-158e60f786c2 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:50.397912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb37bfcc-37d2-4783-81df-158e60f786c2 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:50.506030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cc1190f0-a148-4147-a554-6fe62fcffe0d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:50.521594 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc1190f0-a148-4147-a554-6fe62fcffe0d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1393 microversion: 2.1 time: 0.268134 Oct 11 04:51:50.522903 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3428/6618] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:50 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1393 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:51:50.555190 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bb37bfcc-37d2-4783-81df-158e60f786c2 tempest-TestSecurityGroupsBasicOps-619390090 tempest-TestSecurityGroupsBasicOps-619390090-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1911 microversion: 2.1 time: 0.175048 Oct 11 04:51:50.566232 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3191/6619] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:50 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1911 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:50.624449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d443c4f-3dff-48eb-afdf-cdd0b8b5b125 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:50.625162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d443c4f-3dff-48eb-afdf-cdd0b8b5b125 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:50.632087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d443c4f-3dff-48eb-afdf-cdd0b8b5b125 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:50.632576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d443c4f-3dff-48eb-afdf-cdd0b8b5b125 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:50.633185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d443c4f-3dff-48eb-afdf-cdd0b8b5b125 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:50.633868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d443c4f-3dff-48eb-afdf-cdd0b8b5b125 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:50.634378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d443c4f-3dff-48eb-afdf-cdd0b8b5b125 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:50.634812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d443c4f-3dff-48eb-afdf-cdd0b8b5b125 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:50.661242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d443c4f-3dff-48eb-afdf-cdd0b8b5b125 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:51:51.036879 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d443c4f-3dff-48eb-afdf-cdd0b8b5b125 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 204 len: 0 microversion: 2.1 time: 0.416667 Oct 11 04:51:51.048405 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3429/6620] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:51:50 2022] DELETE /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:51:51.049379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6bacd23d-67af-46d7-93f4-a7ff6e7c3ba2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:51.052168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6bacd23d-67af-46d7-93f4-a7ff6e7c3ba2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:51.057151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bacd23d-67af-46d7-93f4-a7ff6e7c3ba2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:51.057786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bacd23d-67af-46d7-93f4-a7ff6e7c3ba2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:51.058307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bacd23d-67af-46d7-93f4-a7ff6e7c3ba2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:51.059071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bacd23d-67af-46d7-93f4-a7ff6e7c3ba2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:51.059582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bacd23d-67af-46d7-93f4-a7ff6e7c3ba2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:51.060096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bacd23d-67af-46d7-93f4-a7ff6e7c3ba2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:51.084904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c1d3b110-c83a-443d-bfea-a9f3e376488a req-9e66f528-c4b6-469c-bd08-4c4ef6fe78bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da9a3ae-5412-4d1d-9d69-3c018e14d9e4", "tag": "b1187e42-2711-461e-9375-1ecae8093b67"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:51:51.095783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c1d3b110-c83a-443d-bfea-a9f3e376488a req-9e66f528-c4b6-469c-bd08-4c4ef6fe78bb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:51.096673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c1d3b110-c83a-443d-bfea-a9f3e376488a req-9e66f528-c4b6-469c-bd08-4c4ef6fe78bb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:51.096673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c1d3b110-c83a-443d-bfea-a9f3e376488a req-9e66f528-c4b6-469c-bd08-4c4ef6fe78bb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:51.115871 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c1d3b110-c83a-443d-bfea-a9f3e376488a req-9e66f528-c4b6-469c-bd08-4c4ef6fe78bb service nova] Creating event network-changed:b1187e42-2711-461e-9375-1ecae8093b67 for instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 on n-h1-860892-1 Oct 11 04:51:51.121652 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c1d3b110-c83a-443d-bfea-a9f3e376488a req-9e66f528-c4b6-469c-bd08-4c4ef6fe78bb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040910 Oct 11 04:51:51.122565 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3430/6621] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:51:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:51:51.191888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6bacd23d-67af-46d7-93f4-a7ff6e7c3ba2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:51.200473 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6bacd23d-67af-46d7-93f4-a7ff6e7c3ba2 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1476 microversion: 2.1 time: 0.157346 Oct 11 04:51:51.201342 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3192/6622] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:51 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1476 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:51.549635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6df102d1-a544-4328-b9b5-aa0592aac13c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:51.550366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6df102d1-a544-4328-b9b5-aa0592aac13c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:51.557023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df102d1-a544-4328-b9b5-aa0592aac13c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:51.557509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df102d1-a544-4328-b9b5-aa0592aac13c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:51.557956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df102d1-a544-4328-b9b5-aa0592aac13c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:51.558687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df102d1-a544-4328-b9b5-aa0592aac13c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:51.559140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df102d1-a544-4328-b9b5-aa0592aac13c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:51.559565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6df102d1-a544-4328-b9b5-aa0592aac13c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:51.790576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6df102d1-a544-4328-b9b5-aa0592aac13c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:51.795857 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6df102d1-a544-4328-b9b5-aa0592aac13c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1393 microversion: 2.1 time: 0.250483 Oct 11 04:51:51.796432 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3431/6623] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:51 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1393 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:52.229171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-47debe72-53fc-4183-b7e9-face47036365 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:52.230355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-47debe72-53fc-4183-b7e9-face47036365 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:52.237381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47debe72-53fc-4183-b7e9-face47036365 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:52.238114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47debe72-53fc-4183-b7e9-face47036365 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:52.238965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47debe72-53fc-4183-b7e9-face47036365 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:52.239835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47debe72-53fc-4183-b7e9-face47036365 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:52.240449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47debe72-53fc-4183-b7e9-face47036365 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:52.241169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47debe72-53fc-4183-b7e9-face47036365 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:52.327594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-47debe72-53fc-4183-b7e9-face47036365 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:52.335453 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-47debe72-53fc-4183-b7e9-face47036365 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1476 microversion: 2.1 time: 0.111498 Oct 11 04:51:52.336045 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3193/6624] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:52 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1476 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:52.820557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-646b84d8-29ba-41ec-a0ed-3c0c9cde44c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:52.821757 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-646b84d8-29ba-41ec-a0ed-3c0c9cde44c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:52.835908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646b84d8-29ba-41ec-a0ed-3c0c9cde44c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:52.840287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646b84d8-29ba-41ec-a0ed-3c0c9cde44c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:52.840936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646b84d8-29ba-41ec-a0ed-3c0c9cde44c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:52.841855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646b84d8-29ba-41ec-a0ed-3c0c9cde44c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:52.842513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646b84d8-29ba-41ec-a0ed-3c0c9cde44c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:52.843843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-646b84d8-29ba-41ec-a0ed-3c0c9cde44c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:52.940495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-688341ef-2f4c-48c2-9e10-7303ba084e78 req-0b782de3-8555-4947-bd65-be2fb6487c42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9bdbf1f9-4e98-4700-8ae0-0a3809f635f1", "name": "network-vif-deleted", "tag": "88b3d6d9-3595-4dc2-9268-44d69c1b7726"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:51:52.955854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-688341ef-2f4c-48c2-9e10-7303ba084e78 req-0b782de3-8555-4947-bd65-be2fb6487c42 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:52.960582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-688341ef-2f4c-48c2-9e10-7303ba084e78 req-0b782de3-8555-4947-bd65-be2fb6487c42 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:52.960582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-688341ef-2f4c-48c2-9e10-7303ba084e78 req-0b782de3-8555-4947-bd65-be2fb6487c42 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:52.977014 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-688341ef-2f4c-48c2-9e10-7303ba084e78 req-0b782de3-8555-4947-bd65-be2fb6487c42 service nova] Creating event network-vif-deleted:88b3d6d9-3595-4dc2-9268-44d69c1b7726 for instance 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 on n-h2-860892-1 Oct 11 04:51:52.988077 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-688341ef-2f4c-48c2-9e10-7303ba084e78 req-0b782de3-8555-4947-bd65-be2fb6487c42 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053382 Oct 11 04:51:52.991712 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3194/6625] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:51:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:51:53.047395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-646b84d8-29ba-41ec-a0ed-3c0c9cde44c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:53.059546 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-646b84d8-29ba-41ec-a0ed-3c0c9cde44c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1393 microversion: 2.1 time: 0.243681 Oct 11 04:51:53.060140 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3432/6626] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:52 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1393 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:51:53.469151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:53.478347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:53.487520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:53.488407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:53.488843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:53.489909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:53.490541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:53.491279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:53.532564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:53.533098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:53.533541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:53.533993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lazy-loading 'fault' on Instance uuid 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:51:53.577967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:53.585738 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-efa158e8-c541-4d33-a044-85fd099d3380 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 200 len: 1331 microversion: 2.1 time: 0.123181 Oct 11 04:51:53.586651 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3195/6627] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:53 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 1331 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:54.086908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22e0537c-adfa-4a9d-b7a6-be3be65e87f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:54.087754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22e0537c-adfa-4a9d-b7a6-be3be65e87f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:54.096153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e0537c-adfa-4a9d-b7a6-be3be65e87f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:54.096706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e0537c-adfa-4a9d-b7a6-be3be65e87f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:54.097146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e0537c-adfa-4a9d-b7a6-be3be65e87f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:54.097850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e0537c-adfa-4a9d-b7a6-be3be65e87f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:54.098347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e0537c-adfa-4a9d-b7a6-be3be65e87f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:54.098778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22e0537c-adfa-4a9d-b7a6-be3be65e87f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:54.238010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22e0537c-adfa-4a9d-b7a6-be3be65e87f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:54.246473 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22e0537c-adfa-4a9d-b7a6-be3be65e87f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1393 microversion: 2.1 time: 0.163465 Oct 11 04:51:54.247419 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3433/6628] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:54 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1393 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:54.609029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:54.609642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:54.616902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:54.617379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:54.617813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:54.618521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:54.618966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:54.619388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:54.632650 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] HTTP exception thrown: Instance 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 could not be found. Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Request method failure captured: Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 HTTP/1.1 Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPXkka0VCIG-p9hMBnRzCgeV-pUWdRP9n5iukTf4oBu97RJGrTb0icVgQXPl9qgIG-39Mlj37iK5Ye69Qm7UoQCVdlasEyh7ikjY2va9YHJQsZcIDNrIBxneA7BKFxytWVWY7kerC_H0FeO-XD9evSni9RpooMeqSDLXm0KP1Jf-oxs Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 21b57322474547e89bdbbd521a214720 Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-561128707 Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21b57322474547e89bdbbd521a214720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21b57322474547e89bdbbd521a214720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21b57322474547e89bdbbd521a214720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21b57322474547e89bdbbd521a214720"}]}] Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestSecurityGroupsBasicOps-561128707 Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 21b57322474547e89bdbbd521a214720 Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-561128707 Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestSecurityGroupsBasicOps-561128707-project Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a2c6082e11c3414ebcbd31f1edca2ac9 Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestSecurityGroupsBasicOps-561128707-project Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 could not be found. Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '9bdbf1f9-4e98-4700-8ae0-0a3809f635f1'} Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 could not be found. Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 could not be found. Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:51:54.634338 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:51:54.641253 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:51:54.641253 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:51:54.641253 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:51:54.641253 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:51:54.641253 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:51:54.641253 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 could not be found. Oct 11 04:51:54.641253 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:51:54.641253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Returning 404 to user: Instance 9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:51:54.641253 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0859dfd7-22ec-4696-b70c-071a150922d3 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1" status: 404 len: 111 microversion: 2.1 time: 0.030545 Oct 11 04:51:54.641253 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3196/6629] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:54 2022] GET /compute/v2.1/servers/9bdbf1f9-4e98-4700-8ae0-0a3809f635f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:51:55.271999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-41f3c982-875a-403e-870b-fdfc475c1a37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:55.273221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-41f3c982-875a-403e-870b-fdfc475c1a37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:55.283513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41f3c982-875a-403e-870b-fdfc475c1a37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:55.284107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41f3c982-875a-403e-870b-fdfc475c1a37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:55.284781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41f3c982-875a-403e-870b-fdfc475c1a37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:55.285489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41f3c982-875a-403e-870b-fdfc475c1a37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:55.285946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41f3c982-875a-403e-870b-fdfc475c1a37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:55.286490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41f3c982-875a-403e-870b-fdfc475c1a37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:55.312448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:55.469469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:55.493462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:55.532726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-41f3c982-875a-403e-870b-fdfc475c1a37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:55.541436 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-41f3c982-875a-403e-870b-fdfc475c1a37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1393 microversion: 2.1 time: 0.274357 Oct 11 04:51:55.542038 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3434/6630] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:55 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1393 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:56.565203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-254f36ea-d578-4914-902e-2f3555acedf3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:56.565855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-254f36ea-d578-4914-902e-2f3555acedf3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:56.578239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254f36ea-d578-4914-902e-2f3555acedf3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:56.578705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254f36ea-d578-4914-902e-2f3555acedf3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:56.579093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254f36ea-d578-4914-902e-2f3555acedf3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:56.580325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254f36ea-d578-4914-902e-2f3555acedf3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:56.580778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254f36ea-d578-4914-902e-2f3555acedf3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:56.581197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-254f36ea-d578-4914-902e-2f3555acedf3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:56.790159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-254f36ea-d578-4914-902e-2f3555acedf3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:56.799170 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-254f36ea-d578-4914-902e-2f3555acedf3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1393 microversion: 2.1 time: 0.238153 Oct 11 04:51:56.813788 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3197/6631] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:56 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1393 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:57.824100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3a8da0f5-20f6-42d5-b775-fda898e7fa38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:57.824973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3a8da0f5-20f6-42d5-b775-fda898e7fa38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:57.838598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8da0f5-20f6-42d5-b775-fda898e7fa38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:57.839220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8da0f5-20f6-42d5-b775-fda898e7fa38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:57.839851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8da0f5-20f6-42d5-b775-fda898e7fa38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:57.840849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8da0f5-20f6-42d5-b775-fda898e7fa38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:57.841519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8da0f5-20f6-42d5-b775-fda898e7fa38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:57.842023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3a8da0f5-20f6-42d5-b775-fda898e7fa38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:58.075578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3a8da0f5-20f6-42d5-b775-fda898e7fa38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:58.116932 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3a8da0f5-20f6-42d5-b775-fda898e7fa38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1393 microversion: 2.1 time: 0.280371 Oct 11 04:51:58.116932 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3435/6632] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:57 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1393 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:51:59.133180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5051db6-4c96-4f0b-a83a-02b77bb74e95 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:51:59.134935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-73c88d8d-3de1-4789-af66-2be0b15ef753 req-7200a56b-fa7c-4beb-9970-d39c05e181f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da9a3ae-5412-4d1d-9d69-3c018e14d9e4", "name": "network-vif-plugged", "status": "completed", "tag": "b1187e42-2711-461e-9375-1ecae8093b67"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:51:59.140796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5051db6-4c96-4f0b-a83a-02b77bb74e95 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:51:59.151316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5051db6-4c96-4f0b-a83a-02b77bb74e95 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:59.152010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5051db6-4c96-4f0b-a83a-02b77bb74e95 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:59.153718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5051db6-4c96-4f0b-a83a-02b77bb74e95 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:59.154278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:59.158788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5051db6-4c96-4f0b-a83a-02b77bb74e95 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:59.159098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:59.159193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5051db6-4c96-4f0b-a83a-02b77bb74e95 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:59.159193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5051db6-4c96-4f0b-a83a-02b77bb74e95 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:59.161125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-73c88d8d-3de1-4789-af66-2be0b15ef753 req-7200a56b-fa7c-4beb-9970-d39c05e181f0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:51:59.164122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-73c88d8d-3de1-4789-af66-2be0b15ef753 req-7200a56b-fa7c-4beb-9970-d39c05e181f0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:51:59.164780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-73c88d8d-3de1-4789-af66-2be0b15ef753 req-7200a56b-fa7c-4beb-9970-d39c05e181f0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:51:59.170250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=87 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:51:59.198280 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-73c88d8d-3de1-4789-af66-2be0b15ef753 req-7200a56b-fa7c-4beb-9970-d39c05e181f0 service nova] Creating event network-vif-plugged:b1187e42-2711-461e-9375-1ecae8093b67 for instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 on n-h1-860892-1 Oct 11 04:51:59.208557 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-73c88d8d-3de1-4789-af66-2be0b15ef753 req-7200a56b-fa7c-4beb-9970-d39c05e181f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084297 Oct 11 04:51:59.209548 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3198/6633] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:51:59.538640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5051db6-4c96-4f0b-a83a-02b77bb74e95 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:51:59.549670 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5051db6-4c96-4f0b-a83a-02b77bb74e95 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1393 microversion: 2.1 time: 0.424806 Oct 11 04:51:59.550630 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3436/6634] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:51:59 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1393 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:00.421806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d78a32a8-3ae9-40af-a21d-98e5856e3acd tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:00.431477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6c754178-c86c-484a-96d6-b068a9279d50 req-b129d7bd-83df-4f99-9836-ce77169aed48 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cc426c32-c378-4b3c-a917-1ab5bf65d828", "tag": "0dd63779-0d12-41ad-914d-d2ad81661db3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:00.435040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d78a32a8-3ae9-40af-a21d-98e5856e3acd tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:00.458748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78a32a8-3ae9-40af-a21d-98e5856e3acd tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:00.460540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6c754178-c86c-484a-96d6-b068a9279d50 req-b129d7bd-83df-4f99-9836-ce77169aed48 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:00.461097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78a32a8-3ae9-40af-a21d-98e5856e3acd tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:00.461671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78a32a8-3ae9-40af-a21d-98e5856e3acd tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:00.476486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6c754178-c86c-484a-96d6-b068a9279d50 req-b129d7bd-83df-4f99-9836-ce77169aed48 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:00.476486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6c754178-c86c-484a-96d6-b068a9279d50 req-b129d7bd-83df-4f99-9836-ce77169aed48 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:00.476729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78a32a8-3ae9-40af-a21d-98e5856e3acd tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:00.476729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78a32a8-3ae9-40af-a21d-98e5856e3acd tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:00.476729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78a32a8-3ae9-40af-a21d-98e5856e3acd tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:00.477312 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6c754178-c86c-484a-96d6-b068a9279d50 req-b129d7bd-83df-4f99-9836-ce77169aed48 service nova] Creating event network-changed:0dd63779-0d12-41ad-914d-d2ad81661db3 for instance cc426c32-c378-4b3c-a917-1ab5bf65d828 on n-h1-860892-1 Oct 11 04:52:00.487568 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6c754178-c86c-484a-96d6-b068a9279d50 req-b129d7bd-83df-4f99-9836-ce77169aed48 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062789 Oct 11 04:52:00.488473 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3437/6635] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:52:00.522042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d78a32a8-3ae9-40af-a21d-98e5856e3acd tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:52:00.573370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0aef235c-4a94-48bc-b677-b9787776d070 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:00.574240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0aef235c-4a94-48bc-b677-b9787776d070 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:00.585432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aef235c-4a94-48bc-b677-b9787776d070 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:00.585934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aef235c-4a94-48bc-b677-b9787776d070 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:00.586583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aef235c-4a94-48bc-b677-b9787776d070 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:00.587482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aef235c-4a94-48bc-b677-b9787776d070 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:00.587959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aef235c-4a94-48bc-b677-b9787776d070 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:00.588395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0aef235c-4a94-48bc-b677-b9787776d070 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:00.843291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0aef235c-4a94-48bc-b677-b9787776d070 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:00.854731 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0aef235c-4a94-48bc-b677-b9787776d070 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1393 microversion: 2.1 time: 0.285418 Oct 11 04:52:00.876748 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d78a32a8-3ae9-40af-a21d-98e5856e3acd tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "DELETE /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 204 len: 0 microversion: 2.1 time: 0.459874 Oct 11 04:52:00.884015 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3199/6636] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:52:00 2022] DELETE /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:52:00.884651 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3438/6637] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:00 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1393 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:00.893613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-47c03b63-b4c9-438e-8ad7-aa77532fe9ae tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:00.894363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-47c03b63-b4c9-438e-8ad7-aa77532fe9ae tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:00.909778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c03b63-b4c9-438e-8ad7-aa77532fe9ae tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:00.910281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c03b63-b4c9-438e-8ad7-aa77532fe9ae tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:00.910722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c03b63-b4c9-438e-8ad7-aa77532fe9ae tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:00.911408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c03b63-b4c9-438e-8ad7-aa77532fe9ae tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:00.911859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c03b63-b4c9-438e-8ad7-aa77532fe9ae tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:00.912284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c03b63-b4c9-438e-8ad7-aa77532fe9ae tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:01.157110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-47c03b63-b4c9-438e-8ad7-aa77532fe9ae tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:01.165903 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-47c03b63-b4c9-438e-8ad7-aa77532fe9ae tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1766 microversion: 2.1 time: 0.277399 Oct 11 04:52:01.166507 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3200/6638] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:00 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1766 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:01.881615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1448f819-156e-485a-8771-28d05541b13b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:01.882972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1448f819-156e-485a-8771-28d05541b13b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:01.890814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1448f819-156e-485a-8771-28d05541b13b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:01.891325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1448f819-156e-485a-8771-28d05541b13b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:01.891932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1448f819-156e-485a-8771-28d05541b13b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:01.892630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1448f819-156e-485a-8771-28d05541b13b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:01.893092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1448f819-156e-485a-8771-28d05541b13b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:01.893538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1448f819-156e-485a-8771-28d05541b13b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:02.189808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5bfd1b3-63b4-49af-ac63-19b28455b208 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:02.190443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d5bfd1b3-63b4-49af-ac63-19b28455b208 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:02.197454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5bfd1b3-63b4-49af-ac63-19b28455b208 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:02.199174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5bfd1b3-63b4-49af-ac63-19b28455b208 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:02.199174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5bfd1b3-63b4-49af-ac63-19b28455b208 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:02.199174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5bfd1b3-63b4-49af-ac63-19b28455b208 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:02.199575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5bfd1b3-63b4-49af-ac63-19b28455b208 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:02.199826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5bfd1b3-63b4-49af-ac63-19b28455b208 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:02.441979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d5bfd1b3-63b4-49af-ac63-19b28455b208 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:02.441979 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d5bfd1b3-63b4-49af-ac63-19b28455b208 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1766 microversion: 2.1 time: 0.246476 Oct 11 04:52:02.441979 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3201/6639] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:02 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1766 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:52:02.557172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1448f819-156e-485a-8771-28d05541b13b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:02.566119 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1448f819-156e-485a-8771-28d05541b13b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1565 microversion: 2.1 time: 0.688316 Oct 11 04:52:02.571930 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3439/6640] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:01 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1565 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:52:02.615941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1d46c41f-742b-499f-a588-7e13a77b4303 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:02.616693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1d46c41f-742b-499f-a588-7e13a77b4303 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:02.625522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d46c41f-742b-499f-a588-7e13a77b4303 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:02.626028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d46c41f-742b-499f-a588-7e13a77b4303 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:02.626519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d46c41f-742b-499f-a588-7e13a77b4303 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:02.627223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d46c41f-742b-499f-a588-7e13a77b4303 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:02.634926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d46c41f-742b-499f-a588-7e13a77b4303 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:02.635628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d46c41f-742b-499f-a588-7e13a77b4303 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:02.940819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1d46c41f-742b-499f-a588-7e13a77b4303 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:02.949822 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1d46c41f-742b-499f-a588-7e13a77b4303 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1565 microversion: 2.1 time: 0.337694 Oct 11 04:52:02.950648 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3202/6641] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:02 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1565 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:03.458483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f4cc206a-e7da-45de-abb3-2a938ad7c14c tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:03.459849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f4cc206a-e7da-45de-abb3-2a938ad7c14c tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:03.467158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4cc206a-e7da-45de-abb3-2a938ad7c14c tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:03.467972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4cc206a-e7da-45de-abb3-2a938ad7c14c tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:03.468706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4cc206a-e7da-45de-abb3-2a938ad7c14c tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:03.469607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4cc206a-e7da-45de-abb3-2a938ad7c14c tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:03.470853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4cc206a-e7da-45de-abb3-2a938ad7c14c tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:03.471495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4cc206a-e7da-45de-abb3-2a938ad7c14c tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:03.606142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f4cc206a-e7da-45de-abb3-2a938ad7c14c tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:03.608753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-010ade55-6aa2-451b-b1b6-50669b4c2bbe req-2e61f868-a3e1-4275-a649-8adad6ccdf0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cc426c32-c378-4b3c-a917-1ab5bf65d828", "name": "network-vif-deleted", "tag": "0dd63779-0d12-41ad-914d-d2ad81661db3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:03.622180 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f4cc206a-e7da-45de-abb3-2a938ad7c14c tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1529 microversion: 2.1 time: 0.167692 Oct 11 04:52:03.630868 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3440/6642] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:03 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1529 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:03.631131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-010ade55-6aa2-451b-b1b6-50669b4c2bbe req-2e61f868-a3e1-4275-a649-8adad6ccdf0c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:03.631131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-010ade55-6aa2-451b-b1b6-50669b4c2bbe req-2e61f868-a3e1-4275-a649-8adad6ccdf0c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:03.631131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-010ade55-6aa2-451b-b1b6-50669b4c2bbe req-2e61f868-a3e1-4275-a649-8adad6ccdf0c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:03.643691 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-010ade55-6aa2-451b-b1b6-50669b4c2bbe req-2e61f868-a3e1-4275-a649-8adad6ccdf0c service nova] Creating event network-vif-deleted:0dd63779-0d12-41ad-914d-d2ad81661db3 for instance cc426c32-c378-4b3c-a917-1ab5bf65d828 on n-h1-860892-1 Oct 11 04:52:03.649645 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-010ade55-6aa2-451b-b1b6-50669b4c2bbe req-2e61f868-a3e1-4275-a649-8adad6ccdf0c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047117 Oct 11 04:52:03.658467 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3203/6643] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:52:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:52:04.658403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:04.664888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:04.684132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:04.686508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:04.687809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:04.689365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:04.694431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:04.697670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:04.739813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:04.740675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:04.741434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:04.742466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lazy-loading 'fault' on Instance uuid cc426c32-c378-4b3c-a917-1ab5bf65d828 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:52:04.813321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a2c6082e11c3414ebcbd31f1edca2ac9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '21b57322474547e89bdbbd521a214720', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:04.822993 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2770af8b-8277-4944-b96f-c60be0ac1fde tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 200 len: 1382 microversion: 2.1 time: 0.177300 Oct 11 04:52:04.824854 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3441/6644] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:04 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 1382 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:05.223574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-78c92984-86c0-43d8-9b1f-e27632ac7d3d req-0a7ec17d-de4c-4bd0-933d-38979fd3c31d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da9a3ae-5412-4d1d-9d69-3c018e14d9e4", "tag": "b1187e42-2711-461e-9375-1ecae8093b67"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:05.226791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29caeebd-923d-49ba-8b3d-481842cbecd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:05.228097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-29caeebd-923d-49ba-8b3d-481842cbecd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:05.239821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:05.246931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29caeebd-923d-49ba-8b3d-481842cbecd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:05.252286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29caeebd-923d-49ba-8b3d-481842cbecd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:05.252286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29caeebd-923d-49ba-8b3d-481842cbecd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:05.252286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29caeebd-923d-49ba-8b3d-481842cbecd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:05.252991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29caeebd-923d-49ba-8b3d-481842cbecd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:05.253404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-78c92984-86c0-43d8-9b1f-e27632ac7d3d req-0a7ec17d-de4c-4bd0-933d-38979fd3c31d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:05.253897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29caeebd-923d-49ba-8b3d-481842cbecd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:05.254817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-78c92984-86c0-43d8-9b1f-e27632ac7d3d req-0a7ec17d-de4c-4bd0-933d-38979fd3c31d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:05.256733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-78c92984-86c0-43d8-9b1f-e27632ac7d3d req-0a7ec17d-de4c-4bd0-933d-38979fd3c31d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:05.274219 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-78c92984-86c0-43d8-9b1f-e27632ac7d3d req-0a7ec17d-de4c-4bd0-933d-38979fd3c31d service nova] Creating event network-changed:b1187e42-2711-461e-9375-1ecae8093b67 for instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 on n-h1-860892-1 Oct 11 04:52:05.279746 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-78c92984-86c0-43d8-9b1f-e27632ac7d3d req-0a7ec17d-de4c-4bd0-933d-38979fd3c31d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060191 Oct 11 04:52:05.287371 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3442/6645] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:52:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:52:05.693324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-29caeebd-923d-49ba-8b3d-481842cbecd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:05.704791 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-29caeebd-923d-49ba-8b3d-481842cbecd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1565 microversion: 2.1 time: 0.490082 Oct 11 04:52:05.711072 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3204/6646] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:05 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1565 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:05.852247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:05.857802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] [instance: cc426c32-c378-4b3c-a917-1ab5bf65d828] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:05.863237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:05.863999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:05.864658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:05.866082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:05.867198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:05.867782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:05.889505 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] HTTP exception thrown: Instance cc426c32-c378-4b3c-a917-1ab5bf65d828 could not be found. Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Request method failure captured: Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 HTTP/1.1 Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPXkka0VCIG-p9hMBnRzCgeV-pUWdRP9n5iukTf4oBu97RJGrTb0icVgQXPl9qgIG-39Mlj37iK5Ye69Qm7UoQCVdlasEyh7ikjY2va9YHJQsZcIDNrIBxneA7BKFxytWVWY7kerC_H0FeO-XD9evSni9RpooMeqSDLXm0KP1Jf-oxs Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 21b57322474547e89bdbbd521a214720 Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestSecurityGroupsBasicOps-561128707 Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/21b57322474547e89bdbbd521a214720"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_21b57322474547e89bdbbd521a214720"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21b57322474547e89bdbbd521a214720"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/21b57322474547e89bdbbd521a214720"}]}] Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestSecurityGroupsBasicOps-561128707 Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 21b57322474547e89bdbbd521a214720 Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestSecurityGroupsBasicOps-561128707 Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestSecurityGroupsBasicOps-561128707-project Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a2c6082e11c3414ebcbd31f1edca2ac9 Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestSecurityGroupsBasicOps-561128707-project Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance cc426c32-c378-4b3c-a917-1ab5bf65d828 could not be found. Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'cc426c32-c378-4b3c-a917-1ab5bf65d828'} Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cc426c32-c378-4b3c-a917-1ab5bf65d828 could not be found. Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cc426c32-c378-4b3c-a917-1ab5bf65d828 could not be found. Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:52:05.892489 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:52:05.897840 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:52:05.897840 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:52:05.897840 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:52:05.897840 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:52:05.897840 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:52:05.897840 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cc426c32-c378-4b3c-a917-1ab5bf65d828 could not be found. Oct 11 04:52:05.897840 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:52:05.901584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Returning 404 to user: Instance cc426c32-c378-4b3c-a917-1ab5bf65d828 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:52:05.902904 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8dbcfd33-64c9-467c-ac8c-1e17b8a9da55 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828" status: 404 len: 111 microversion: 2.1 time: 0.058378 Oct 11 04:52:05.914552 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3443/6647] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:05 2022] GET /compute/v2.1/servers/cc426c32-c378-4b3c-a917-1ab5bf65d828 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:52:10.740785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a5d8dd35-8570-428e-a568-0811dd2c4b67 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] Calling method '.version_select at 0x7fda191b74c0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:10.865456 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a5d8dd35-8570-428e-a568-0811dd2c4b67 tempest-TestSecurityGroupsBasicOps-561128707 tempest-TestSecurityGroupsBasicOps-561128707-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-997522340" status: 202 len: 0 microversion: 2.1 time: 0.128628 Oct 11 04:52:10.866271 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3205/6648] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 04:52:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSecurityGroupsBasicOps-997522340 => generated 0 bytes in 131 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:52:29.965111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=46 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:30.117109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bf3db4ca-8915-441d-af95-d123b88ded87 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:30.119089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf3db4ca-8915-441d-af95-d123b88ded87 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:30.119575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf3db4ca-8915-441d-af95-d123b88ded87 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:30.120071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf3db4ca-8915-441d-af95-d123b88ded87 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:30.120743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf3db4ca-8915-441d-af95-d123b88ded87 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:30.121439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf3db4ca-8915-441d-af95-d123b88ded87 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:30.121807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf3db4ca-8915-441d-af95-d123b88ded87 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:30.154140 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bf3db4ca-8915-441d-af95-d123b88ded87 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/os-availability-zone/detail" status: 200 len: 612 microversion: 2.1 time: 0.194572 Oct 11 04:52:30.154758 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3444/6649] 10.222.0.26 () {58 vars in 1185 bytes} [Tue Oct 11 04:52:29 2022] GET /compute/v2.1/os-availability-zone/detail => generated 612 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:52:30.272630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-672340955", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "availability_zone": "nova:n-h1-860892-1", "networks": [{"uuid": "32c2e13e-5443-4784-9124-1c6d02aa0f07"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:30.281271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:30.282032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:30.387140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] validate_networks() for [('32c2e13e-5443-4784-9124-1c6d02aa0f07', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:52:30.833762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:52:30.834611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:52:30.835086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:52:30.839742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:52:30.840729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:52:30.852660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:30.853707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:30.854331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:30.855815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:30.856489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:30.857555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:30.887106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Getting quotas for project a57d7836ffce44f2b7010eeb4469556a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:52:30.892929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Getting quotas for user 6daa3906c5454addb4c36f8049478a29 and project a57d7836ffce44f2b7010eeb4469556a. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:52:30.907487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:52:30.909829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:52:31.071985 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-208150e8-3d6c-4c2e-a760-53a0eed9c410 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.806254 Oct 11 04:52:31.072946 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3206/6650] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:52:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:52:31.088088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0bc3bbc9-b3ce-426e-8375-737c8c707acd tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:31.090726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0bc3bbc9-b3ce-426e-8375-737c8c707acd tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:31.208002 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0bc3bbc9-b3ce-426e-8375-737c8c707acd tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1328 microversion: 2.1 time: 0.126384 Oct 11 04:52:31.208678 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3445/6651] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:31 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1328 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:32.238798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c2336d5d-fd05-4120-becf-52e05d6dc5b3 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:32.240198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c2336d5d-fd05-4120-becf-52e05d6dc5b3 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:32.330543 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c2336d5d-fd05-4120-becf-52e05d6dc5b3 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1328 microversion: 2.1 time: 0.097241 Oct 11 04:52:32.333032 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3207/6652] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:32 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1328 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:33.357502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-662c7204-aa43-4cce-8f0b-d55e6afd5312 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:33.362596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-662c7204-aa43-4cce-8f0b-d55e6afd5312 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:33.369910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662c7204-aa43-4cce-8f0b-d55e6afd5312 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:33.370657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662c7204-aa43-4cce-8f0b-d55e6afd5312 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:33.371267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662c7204-aa43-4cce-8f0b-d55e6afd5312 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:33.372537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662c7204-aa43-4cce-8f0b-d55e6afd5312 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:33.373307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662c7204-aa43-4cce-8f0b-d55e6afd5312 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:33.373741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-662c7204-aa43-4cce-8f0b-d55e6afd5312 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:33.454602 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-662c7204-aa43-4cce-8f0b-d55e6afd5312 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1415 microversion: 2.1 time: 0.102773 Oct 11 04:52:33.472654 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3446/6653] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:33 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1415 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:34.489078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3894f0f-4653-46a3-8dc8-76507878bd07 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:34.489814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3894f0f-4653-46a3-8dc8-76507878bd07 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:34.505540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3894f0f-4653-46a3-8dc8-76507878bd07 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:34.506038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3894f0f-4653-46a3-8dc8-76507878bd07 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:34.506646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3894f0f-4653-46a3-8dc8-76507878bd07 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:34.507347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3894f0f-4653-46a3-8dc8-76507878bd07 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:34.507801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3894f0f-4653-46a3-8dc8-76507878bd07 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:34.508399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3894f0f-4653-46a3-8dc8-76507878bd07 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:34.622379 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3894f0f-4653-46a3-8dc8-76507878bd07 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1433 microversion: 2.1 time: 0.137010 Oct 11 04:52:34.623333 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3208/6654] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:34 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1433 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:35.139883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-390fe508-1565-4f8b-a18b-a292054a2852 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:35.145550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-390fe508-1565-4f8b-a18b-a292054a2852 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:35.168989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390fe508-1565-4f8b-a18b-a292054a2852 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:35.171159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390fe508-1565-4f8b-a18b-a292054a2852 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:35.171939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390fe508-1565-4f8b-a18b-a292054a2852 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:35.173106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390fe508-1565-4f8b-a18b-a292054a2852 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:35.174400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390fe508-1565-4f8b-a18b-a292054a2852 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:35.174818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390fe508-1565-4f8b-a18b-a292054a2852 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:35.258435 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-390fe508-1565-4f8b-a18b-a292054a2852 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4/action" status: 200 len: 24567 microversion: 2.1 time: 0.122499 Oct 11 04:52:35.268902 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3447/6655] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:52:35 2022] POST /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4/action => generated 24567 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:52:35.647394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f764542-5785-422a-baa2-f10859d864ad tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:35.648594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2f764542-5785-422a-baa2-f10859d864ad tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:35.655275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f764542-5785-422a-baa2-f10859d864ad tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:35.656319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f764542-5785-422a-baa2-f10859d864ad tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:35.656969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f764542-5785-422a-baa2-f10859d864ad tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:35.657665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f764542-5785-422a-baa2-f10859d864ad tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:35.658112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f764542-5785-422a-baa2-f10859d864ad tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:35.658552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f764542-5785-422a-baa2-f10859d864ad tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:35.915242 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f764542-5785-422a-baa2-f10859d864ad tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1463 microversion: 2.1 time: 0.271932 Oct 11 04:52:35.916015 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3209/6656] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:35 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1463 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:36.695390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c6cf8818-9c73-4ac0-b44d-f8bb764637d7 req-83acd39b-19a7-4e38-8837-e2caf3395a83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b47ce839-e8e4-45a5-9cc8-c755e09e1d9a", "tag": "16820218-64cb-422b-8e09-76ab26e6e9ea"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:36.705888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c6cf8818-9c73-4ac0-b44d-f8bb764637d7 req-83acd39b-19a7-4e38-8837-e2caf3395a83 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:36.706325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c6cf8818-9c73-4ac0-b44d-f8bb764637d7 req-83acd39b-19a7-4e38-8837-e2caf3395a83 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:36.706759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c6cf8818-9c73-4ac0-b44d-f8bb764637d7 req-83acd39b-19a7-4e38-8837-e2caf3395a83 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:36.716762 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c6cf8818-9c73-4ac0-b44d-f8bb764637d7 req-83acd39b-19a7-4e38-8837-e2caf3395a83 service nova] Creating event network-changed:16820218-64cb-422b-8e09-76ab26e6e9ea for instance b47ce839-e8e4-45a5-9cc8-c755e09e1d9a on n-h1-860892-1 Oct 11 04:52:36.721517 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c6cf8818-9c73-4ac0-b44d-f8bb764637d7 req-83acd39b-19a7-4e38-8837-e2caf3395a83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.254358 Oct 11 04:52:36.722111 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3448/6657] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:52:36.938703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e2badbe6-5b8e-4f17-bd37-7ad4fdcb26e5 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:36.939307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e2badbe6-5b8e-4f17-bd37-7ad4fdcb26e5 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:36.947127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2badbe6-5b8e-4f17-bd37-7ad4fdcb26e5 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:36.947613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2badbe6-5b8e-4f17-bd37-7ad4fdcb26e5 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:36.951412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2badbe6-5b8e-4f17-bd37-7ad4fdcb26e5 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:36.952151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2badbe6-5b8e-4f17-bd37-7ad4fdcb26e5 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:36.953797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2badbe6-5b8e-4f17-bd37-7ad4fdcb26e5 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:36.954262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2badbe6-5b8e-4f17-bd37-7ad4fdcb26e5 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:37.111233 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e2badbe6-5b8e-4f17-bd37-7ad4fdcb26e5 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1463 microversion: 2.1 time: 0.176785 Oct 11 04:52:37.115925 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3210/6658] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:36 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1463 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:38.136383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-01824c60-eaf0-440c-84e4-0df3a01e87f7 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:38.137078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-01824c60-eaf0-440c-84e4-0df3a01e87f7 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:38.143700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01824c60-eaf0-440c-84e4-0df3a01e87f7 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:38.144176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01824c60-eaf0-440c-84e4-0df3a01e87f7 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:38.144610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01824c60-eaf0-440c-84e4-0df3a01e87f7 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:38.145294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01824c60-eaf0-440c-84e4-0df3a01e87f7 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:38.145738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01824c60-eaf0-440c-84e4-0df3a01e87f7 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:38.146203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01824c60-eaf0-440c-84e4-0df3a01e87f7 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:38.278998 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-01824c60-eaf0-440c-84e4-0df3a01e87f7 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1463 microversion: 2.1 time: 0.147600 Oct 11 04:52:38.279593 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3449/6659] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:38 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1463 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:39.310613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b1f69522-336c-4f2a-b084-fbdeab3fd11a tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:39.311255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b1f69522-336c-4f2a-b084-fbdeab3fd11a tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:39.318644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1f69522-336c-4f2a-b084-fbdeab3fd11a tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:39.319328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1f69522-336c-4f2a-b084-fbdeab3fd11a tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:39.319835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1f69522-336c-4f2a-b084-fbdeab3fd11a tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:39.320709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1f69522-336c-4f2a-b084-fbdeab3fd11a tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:39.321225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1f69522-336c-4f2a-b084-fbdeab3fd11a tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:39.321830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1f69522-336c-4f2a-b084-fbdeab3fd11a tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:39.530885 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b1f69522-336c-4f2a-b084-fbdeab3fd11a tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1463 microversion: 2.1 time: 0.223682 Oct 11 04:52:39.531988 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3211/6660] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:39 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1463 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:40.555053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-59e4b061-4f4e-407b-91e3-092e25a5b75e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:40.555772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-59e4b061-4f4e-407b-91e3-092e25a5b75e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:40.558624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:40.563576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59e4b061-4f4e-407b-91e3-092e25a5b75e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:40.566746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59e4b061-4f4e-407b-91e3-092e25a5b75e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:40.566746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59e4b061-4f4e-407b-91e3-092e25a5b75e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:40.566746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59e4b061-4f4e-407b-91e3-092e25a5b75e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:40.566746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59e4b061-4f4e-407b-91e3-092e25a5b75e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:40.566746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59e4b061-4f4e-407b-91e3-092e25a5b75e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:40.693907 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-59e4b061-4f4e-407b-91e3-092e25a5b75e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1463 microversion: 2.1 time: 0.142629 Oct 11 04:52:40.694519 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3450/6661] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:40 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1463 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:41.717178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98776c33-0657-403e-ad09-5fe6afafb04d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:41.718449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98776c33-0657-403e-ad09-5fe6afafb04d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:41.721178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:41.726123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98776c33-0657-403e-ad09-5fe6afafb04d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:41.726799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98776c33-0657-403e-ad09-5fe6afafb04d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:41.727186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98776c33-0657-403e-ad09-5fe6afafb04d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:41.727885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98776c33-0657-403e-ad09-5fe6afafb04d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:41.728342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98776c33-0657-403e-ad09-5fe6afafb04d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:41.728789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98776c33-0657-403e-ad09-5fe6afafb04d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:41.859959 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98776c33-0657-403e-ad09-5fe6afafb04d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1463 microversion: 2.1 time: 0.146581 Oct 11 04:52:41.860536 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3212/6662] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:41 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1463 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:42.882283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5c8affb-0d30-435d-a717-62c87ea3096b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:42.882929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5c8affb-0d30-435d-a717-62c87ea3096b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:42.885411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:42.891313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5c8affb-0d30-435d-a717-62c87ea3096b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:42.891818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5c8affb-0d30-435d-a717-62c87ea3096b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:42.892247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5c8affb-0d30-435d-a717-62c87ea3096b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:42.892951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5c8affb-0d30-435d-a717-62c87ea3096b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:42.893408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5c8affb-0d30-435d-a717-62c87ea3096b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:42.893835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5c8affb-0d30-435d-a717-62c87ea3096b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:43.046841 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5c8affb-0d30-435d-a717-62c87ea3096b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1463 microversion: 2.1 time: 0.168345 Oct 11 04:52:43.055615 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3451/6663] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:42 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1463 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:43.210728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-0f3a8489-d989-42cb-b60e-a258f0287f86 req-724d4f6e-2097-4094-b520-de1c72dc1a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47ce839-e8e4-45a5-9cc8-c755e09e1d9a", "name": "network-vif-plugged", "status": "completed", "tag": "16820218-64cb-422b-8e09-76ab26e6e9ea"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:43.215980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:43.223196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0f3a8489-d989-42cb-b60e-a258f0287f86 req-724d4f6e-2097-4094-b520-de1c72dc1a0e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:43.223675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0f3a8489-d989-42cb-b60e-a258f0287f86 req-724d4f6e-2097-4094-b520-de1c72dc1a0e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:43.224142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0f3a8489-d989-42cb-b60e-a258f0287f86 req-724d4f6e-2097-4094-b520-de1c72dc1a0e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:43.235551 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-0f3a8489-d989-42cb-b60e-a258f0287f86 req-724d4f6e-2097-4094-b520-de1c72dc1a0e service nova] Creating event network-vif-plugged:16820218-64cb-422b-8e09-76ab26e6e9ea for instance b47ce839-e8e4-45a5-9cc8-c755e09e1d9a on n-h1-860892-1 Oct 11 04:52:43.240638 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-0f3a8489-d989-42cb-b60e-a258f0287f86 req-724d4f6e-2097-4094-b520-de1c72dc1a0e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033682 Oct 11 04:52:43.241219 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3213/6664] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:52:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:52:44.071143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-285d0d9d-f28a-4a3e-bd71-a427cc26848d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:44.072297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-285d0d9d-f28a-4a3e-bd71-a427cc26848d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:44.079802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-285d0d9d-f28a-4a3e-bd71-a427cc26848d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:44.080290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-285d0d9d-f28a-4a3e-bd71-a427cc26848d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:44.080733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-285d0d9d-f28a-4a3e-bd71-a427cc26848d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:44.081430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-285d0d9d-f28a-4a3e-bd71-a427cc26848d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:44.081883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-285d0d9d-f28a-4a3e-bd71-a427cc26848d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:44.082328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-285d0d9d-f28a-4a3e-bd71-a427cc26848d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:44.283254 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-285d0d9d-f28a-4a3e-bd71-a427cc26848d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1463 microversion: 2.1 time: 0.216307 Oct 11 04:52:44.283983 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3452/6665] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:44 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1463 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:45.308120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-459b91e8-71d4-41a4-a7ac-2f3c252f61e2 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:45.308813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-459b91e8-71d4-41a4-a7ac-2f3c252f61e2 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:45.315538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-459b91e8-71d4-41a4-a7ac-2f3c252f61e2 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:45.316015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-459b91e8-71d4-41a4-a7ac-2f3c252f61e2 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:45.316442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-459b91e8-71d4-41a4-a7ac-2f3c252f61e2 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:45.317127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-459b91e8-71d4-41a4-a7ac-2f3c252f61e2 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:45.317578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-459b91e8-71d4-41a4-a7ac-2f3c252f61e2 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:45.317993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-459b91e8-71d4-41a4-a7ac-2f3c252f61e2 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:45.447909 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-459b91e8-71d4-41a4-a7ac-2f3c252f61e2 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1649 microversion: 2.1 time: 0.144671 Oct 11 04:52:45.448486 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3214/6666] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:45 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1649 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:45.471943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-09a70393-9a25-471d-84f7-7e784680c309 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:45.472554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-09a70393-9a25-471d-84f7-7e784680c309 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:45.479466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a70393-9a25-471d-84f7-7e784680c309 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:45.479929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a70393-9a25-471d-84f7-7e784680c309 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:45.480360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a70393-9a25-471d-84f7-7e784680c309 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:45.481040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a70393-9a25-471d-84f7-7e784680c309 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:45.481486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a70393-9a25-471d-84f7-7e784680c309 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:45.481904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09a70393-9a25-471d-84f7-7e784680c309 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:45.611753 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-09a70393-9a25-471d-84f7-7e784680c309 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1649 microversion: 2.1 time: 0.144529 Oct 11 04:52:45.612328 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3453/6667] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:45 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1649 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:45.633458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-657cfc71-efc2-4195-be09-760439df4d54 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:45.640348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-657cfc71-efc2-4195-be09-760439df4d54 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:45.640348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-657cfc71-efc2-4195-be09-760439df4d54 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:45.640731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-657cfc71-efc2-4195-be09-760439df4d54 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:45.641168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-657cfc71-efc2-4195-be09-760439df4d54 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:45.642027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-657cfc71-efc2-4195-be09-760439df4d54 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:45.642504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-657cfc71-efc2-4195-be09-760439df4d54 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:45.642929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-657cfc71-efc2-4195-be09-760439df4d54 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:45.770083 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-657cfc71-efc2-4195-be09-760439df4d54 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1649 microversion: 2.1 time: 0.140230 Oct 11 04:52:45.770687 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3215/6668] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:45 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1649 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:52:45.881156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestServerMultinode-server-1403152006", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "availability_zone": "nova:n-h2-860892-1", "networks": [{"uuid": "32c2e13e-5443-4784-9124-1c6d02aa0f07"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:45.941620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] validate_networks() for [('32c2e13e-5443-4784-9124-1c6d02aa0f07', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:52:46.694418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:52:46.695161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:52:46.697431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:52:46.698297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:52:46.698908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:52:46.729542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:46.729542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:46.729542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:46.730456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:46.731004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:46.731503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:46.752005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Getting quotas for project a57d7836ffce44f2b7010eeb4469556a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:52:46.757902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Getting quotas for user 6daa3906c5454addb4c36f8049478a29 and project a57d7836ffce44f2b7010eeb4469556a. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:52:46.772207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:52:46.774816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:52:46.912943 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-275fbd03-46cd-43e0-9db4-cc69a073335d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.035273 Oct 11 04:52:46.925690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69fccc05-8c7c-4a7c-9793-353735170acf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:46.926927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69fccc05-8c7c-4a7c-9793-353735170acf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:46.932092 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3454/6669] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:52:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 1055 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:52:47.018169 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69fccc05-8c7c-4a7c-9793-353735170acf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1329 microversion: 2.1 time: 0.096529 Oct 11 04:52:47.035101 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3216/6670] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:46 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1329 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:48.041508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-14b7e98b-2786-4b87-a41e-863b15e79f9b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:48.042145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-14b7e98b-2786-4b87-a41e-863b15e79f9b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:48.049801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14b7e98b-2786-4b87-a41e-863b15e79f9b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:48.050414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14b7e98b-2786-4b87-a41e-863b15e79f9b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:48.050852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14b7e98b-2786-4b87-a41e-863b15e79f9b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:48.051535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14b7e98b-2786-4b87-a41e-863b15e79f9b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:48.051982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14b7e98b-2786-4b87-a41e-863b15e79f9b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:48.052403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14b7e98b-2786-4b87-a41e-863b15e79f9b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:48.124618 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-14b7e98b-2786-4b87-a41e-863b15e79f9b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1346 microversion: 2.1 time: 0.086162 Oct 11 04:52:48.125190 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3455/6671] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:48 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1346 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:48.413120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesBackupsTest-instance-1941020879", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:48.465718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] validate_networks() for None {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:52:48.660329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:52:48.660758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:52:48.661295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:52:48.661706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:52:48.662118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:52:48.671835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:48.672317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:48.672755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:48.673479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:48.673937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:48.674392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:48.692070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Getting quotas for project 041b2743be5a4f6e892a85d37c5f9287. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:52:48.697252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Getting quotas for user e75e6bc4829e482aaf3d6667773b1423 and project 041b2743be5a4f6e892a85d37c5f9287. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:52:48.709419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:52:48.711747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:52:48.835630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68384bde-2874-464f-8045-84285a277a31 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.426368 Oct 11 04:52:48.836279 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3217/6672] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:52:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 428 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:52:48.848407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-14acaf8f-d535-49b2-83de-ce3b8b6a8ac2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:48.849018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-14acaf8f-d535-49b2-83de-ce3b8b6a8ac2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:48.902994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-14acaf8f-d535-49b2-83de-ce3b8b6a8ac2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:48.910641 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-14acaf8f-d535-49b2-83de-ce3b8b6a8ac2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1214 microversion: 2.1 time: 0.066459 Oct 11 04:52:48.911212 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3456/6673] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:48 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:49.147321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-368061fb-5043-445c-8159-8e1d34fc6d0d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:49.147985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-368061fb-5043-445c-8159-8e1d34fc6d0d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:49.154030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-368061fb-5043-445c-8159-8e1d34fc6d0d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:49.154567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-368061fb-5043-445c-8159-8e1d34fc6d0d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:49.155776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-368061fb-5043-445c-8159-8e1d34fc6d0d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:49.156464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-368061fb-5043-445c-8159-8e1d34fc6d0d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:49.156923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-368061fb-5043-445c-8159-8e1d34fc6d0d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:49.157379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-368061fb-5043-445c-8159-8e1d34fc6d0d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:49.228525 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-368061fb-5043-445c-8159-8e1d34fc6d0d tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1416 microversion: 2.1 time: 0.085022 Oct 11 04:52:49.229299 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3218/6674] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:49 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1416 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:49.942551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-556f4f13-d16f-4ba6-842b-574de39e90c3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:49.943345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-556f4f13-d16f-4ba6-842b-574de39e90c3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:49.962660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-556f4f13-d16f-4ba6-842b-574de39e90c3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:49.963149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-556f4f13-d16f-4ba6-842b-574de39e90c3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:49.963602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-556f4f13-d16f-4ba6-842b-574de39e90c3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:49.964480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-556f4f13-d16f-4ba6-842b-574de39e90c3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:49.964936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-556f4f13-d16f-4ba6-842b-574de39e90c3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:49.965396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-556f4f13-d16f-4ba6-842b-574de39e90c3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:50.031108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-556f4f13-d16f-4ba6-842b-574de39e90c3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:50.040864 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-556f4f13-d16f-4ba6-842b-574de39e90c3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1218 microversion: 2.1 time: 0.109589 Oct 11 04:52:50.040864 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3457/6675] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:49 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:50.252774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-71bbe637-bb7b-4ff0-9e1c-be83da662d30 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:50.253489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-71bbe637-bb7b-4ff0-9e1c-be83da662d30 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:50.260024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71bbe637-bb7b-4ff0-9e1c-be83da662d30 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:50.260751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71bbe637-bb7b-4ff0-9e1c-be83da662d30 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:50.261181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71bbe637-bb7b-4ff0-9e1c-be83da662d30 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:50.262035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71bbe637-bb7b-4ff0-9e1c-be83da662d30 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:50.262531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71bbe637-bb7b-4ff0-9e1c-be83da662d30 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:50.262897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71bbe637-bb7b-4ff0-9e1c-be83da662d30 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:50.488485 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-71bbe637-bb7b-4ff0-9e1c-be83da662d30 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1464 microversion: 2.1 time: 0.240517 Oct 11 04:52:50.489249 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3219/6676] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:50 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1464 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:51.063186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-50765917-2508-4dda-b771-2aba5e30b186 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:51.063816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50765917-2508-4dda-b771-2aba5e30b186 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:51.070716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50765917-2508-4dda-b771-2aba5e30b186 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:51.071178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50765917-2508-4dda-b771-2aba5e30b186 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:51.071617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50765917-2508-4dda-b771-2aba5e30b186 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:51.072299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50765917-2508-4dda-b771-2aba5e30b186 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:51.072749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50765917-2508-4dda-b771-2aba5e30b186 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:51.073174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50765917-2508-4dda-b771-2aba5e30b186 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:51.108135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-4837d90f-9ba9-4a34-9d7a-4db23a4af85a req-2f5e6f00-88c3-4d88-8c56-1c2e447bad52 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4f44fd3-481e-4e35-9aae-99be40f9c015", "tag": "93f49d6a-561c-4122-ab46-7fc5a52ecd13"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:51.119328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4837d90f-9ba9-4a34-9d7a-4db23a4af85a req-2f5e6f00-88c3-4d88-8c56-1c2e447bad52 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:51.120466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4837d90f-9ba9-4a34-9d7a-4db23a4af85a req-2f5e6f00-88c3-4d88-8c56-1c2e447bad52 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:51.121118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4837d90f-9ba9-4a34-9d7a-4db23a4af85a req-2f5e6f00-88c3-4d88-8c56-1c2e447bad52 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:51.133820 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-4837d90f-9ba9-4a34-9d7a-4db23a4af85a req-2f5e6f00-88c3-4d88-8c56-1c2e447bad52 service nova] Creating event network-changed:93f49d6a-561c-4122-ab46-7fc5a52ecd13 for instance d4f44fd3-481e-4e35-9aae-99be40f9c015 on n-h2-860892-1 Oct 11 04:52:51.139614 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-4837d90f-9ba9-4a34-9d7a-4db23a4af85a req-2f5e6f00-88c3-4d88-8c56-1c2e447bad52 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035547 Oct 11 04:52:51.140530 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3220/6677] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:52:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:52:51.146842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-50765917-2508-4dda-b771-2aba5e30b186 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:51.151719 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-50765917-2508-4dda-b771-2aba5e30b186 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1266 microversion: 2.1 time: 0.093261 Oct 11 04:52:51.152527 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3458/6678] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:51 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:51.514792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-891e05db-2ee5-4c26-a5d0-22ca0c34bfee tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:51.516193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-891e05db-2ee5-4c26-a5d0-22ca0c34bfee tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:51.524551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-891e05db-2ee5-4c26-a5d0-22ca0c34bfee tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:51.525121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-891e05db-2ee5-4c26-a5d0-22ca0c34bfee tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:51.525719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-891e05db-2ee5-4c26-a5d0-22ca0c34bfee tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:51.526598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-891e05db-2ee5-4c26-a5d0-22ca0c34bfee tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:51.527050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-891e05db-2ee5-4c26-a5d0-22ca0c34bfee tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:51.527471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-891e05db-2ee5-4c26-a5d0-22ca0c34bfee tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:51.758197 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-891e05db-2ee5-4c26-a5d0-22ca0c34bfee tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1464 microversion: 2.1 time: 0.248121 Oct 11 04:52:51.758868 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3221/6679] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:51 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1464 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:52.175639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04d963e6-abe4-48cc-bcc7-be30268ff11a tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:52.176260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-04d963e6-abe4-48cc-bcc7-be30268ff11a tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:52.183237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d963e6-abe4-48cc-bcc7-be30268ff11a tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:52.183724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d963e6-abe4-48cc-bcc7-be30268ff11a tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:52.184158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d963e6-abe4-48cc-bcc7-be30268ff11a tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:52.184863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d963e6-abe4-48cc-bcc7-be30268ff11a tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:52.185318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d963e6-abe4-48cc-bcc7-be30268ff11a tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:52.186402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04d963e6-abe4-48cc-bcc7-be30268ff11a tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:52.251208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-04d963e6-abe4-48cc-bcc7-be30268ff11a tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:52.260098 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04d963e6-abe4-48cc-bcc7-be30268ff11a tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1272 microversion: 2.1 time: 0.088453 Oct 11 04:52:52.260944 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3459/6680] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:52 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1272 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:52.780833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1a2414c5-90f1-4077-8a3d-61284ff1f59b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:52.781447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1a2414c5-90f1-4077-8a3d-61284ff1f59b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:52.788780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a2414c5-90f1-4077-8a3d-61284ff1f59b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:52.789268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a2414c5-90f1-4077-8a3d-61284ff1f59b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:52.789707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a2414c5-90f1-4077-8a3d-61284ff1f59b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:52.790471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a2414c5-90f1-4077-8a3d-61284ff1f59b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:52.790927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a2414c5-90f1-4077-8a3d-61284ff1f59b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:52.791386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a2414c5-90f1-4077-8a3d-61284ff1f59b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:52.916990 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1a2414c5-90f1-4077-8a3d-61284ff1f59b tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1464 microversion: 2.1 time: 0.139875 Oct 11 04:52:52.917560 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3222/6681] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:52 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1464 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:53.282759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72d78287-6488-4b6f-81af-4755d3296db4 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:53.283488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72d78287-6488-4b6f-81af-4755d3296db4 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:53.290355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72d78287-6488-4b6f-81af-4755d3296db4 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:53.290847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72d78287-6488-4b6f-81af-4755d3296db4 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:53.291283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72d78287-6488-4b6f-81af-4755d3296db4 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:53.291987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72d78287-6488-4b6f-81af-4755d3296db4 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:53.292441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72d78287-6488-4b6f-81af-4755d3296db4 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:53.292867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72d78287-6488-4b6f-81af-4755d3296db4 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:53.425920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72d78287-6488-4b6f-81af-4755d3296db4 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:53.434246 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72d78287-6488-4b6f-81af-4755d3296db4 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1314 microversion: 2.1 time: 0.155339 Oct 11 04:52:53.434835 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3460/6682] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:53 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:53.767022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-7e916aea-b9fa-4731-98a6-900da7656d88 req-58b7586c-cf77-4cfd-af68-bc63c03c3563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "124ded3e-9ebe-439b-b28c-2157a10f2153", "tag": "de285a00-d8f5-470e-8f0a-4de03013972e"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:53.777065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7e916aea-b9fa-4731-98a6-900da7656d88 req-58b7586c-cf77-4cfd-af68-bc63c03c3563 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:53.777541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7e916aea-b9fa-4731-98a6-900da7656d88 req-58b7586c-cf77-4cfd-af68-bc63c03c3563 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:53.777971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7e916aea-b9fa-4731-98a6-900da7656d88 req-58b7586c-cf77-4cfd-af68-bc63c03c3563 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:53.789909 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7e916aea-b9fa-4731-98a6-900da7656d88 req-58b7586c-cf77-4cfd-af68-bc63c03c3563 service nova] Creating event network-changed:de285a00-d8f5-470e-8f0a-4de03013972e for instance 124ded3e-9ebe-439b-b28c-2157a10f2153 on n-h2-860892-1 Oct 11 04:52:53.794644 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-7e916aea-b9fa-4731-98a6-900da7656d88 req-58b7586c-cf77-4cfd-af68-bc63c03c3563 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031379 Oct 11 04:52:53.795858 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3223/6683] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:52:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:52:53.940128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2cc87141-a2aa-4de1-a7e3-5a923ed7e633 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:53.940826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2cc87141-a2aa-4de1-a7e3-5a923ed7e633 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:53.948361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc87141-a2aa-4de1-a7e3-5a923ed7e633 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:53.948856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc87141-a2aa-4de1-a7e3-5a923ed7e633 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:53.949293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc87141-a2aa-4de1-a7e3-5a923ed7e633 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:53.950001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc87141-a2aa-4de1-a7e3-5a923ed7e633 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:53.950477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc87141-a2aa-4de1-a7e3-5a923ed7e633 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:53.950900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2cc87141-a2aa-4de1-a7e3-5a923ed7e633 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:54.093560 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2cc87141-a2aa-4de1-a7e3-5a923ed7e633 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1464 microversion: 2.1 time: 0.157081 Oct 11 04:52:54.106932 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3461/6684] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:53 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1464 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:54.458111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-82108ba7-ecca-451e-8d40-cedf51717ad7 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:54.458837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-82108ba7-ecca-451e-8d40-cedf51717ad7 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:54.465412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82108ba7-ecca-451e-8d40-cedf51717ad7 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:54.465601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82108ba7-ecca-451e-8d40-cedf51717ad7 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:54.466389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82108ba7-ecca-451e-8d40-cedf51717ad7 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:54.467081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82108ba7-ecca-451e-8d40-cedf51717ad7 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:54.467531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82108ba7-ecca-451e-8d40-cedf51717ad7 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:54.467947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-82108ba7-ecca-451e-8d40-cedf51717ad7 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:54.687608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-82108ba7-ecca-451e-8d40-cedf51717ad7 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:54.695361 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-82108ba7-ecca-451e-8d40-cedf51717ad7 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1314 microversion: 2.1 time: 0.241599 Oct 11 04:52:54.695928 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3224/6685] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:54 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:55.118101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d1cc1625-8ee5-4342-830c-a99f1c293f6f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:55.118751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d1cc1625-8ee5-4342-830c-a99f1c293f6f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:55.126291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1cc1625-8ee5-4342-830c-a99f1c293f6f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:55.126773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1cc1625-8ee5-4342-830c-a99f1c293f6f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:55.127210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1cc1625-8ee5-4342-830c-a99f1c293f6f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:55.127893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1cc1625-8ee5-4342-830c-a99f1c293f6f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:55.128343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1cc1625-8ee5-4342-830c-a99f1c293f6f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:55.128766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d1cc1625-8ee5-4342-830c-a99f1c293f6f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:55.256050 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d1cc1625-8ee5-4342-830c-a99f1c293f6f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1464 microversion: 2.1 time: 0.141661 Oct 11 04:52:55.256615 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3462/6686] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:55 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1464 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:55.718145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c5c42f86-dac1-49e6-bba5-78b9fd751499 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:55.718774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c5c42f86-dac1-49e6-bba5-78b9fd751499 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:55.725480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c42f86-dac1-49e6-bba5-78b9fd751499 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:55.725954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c42f86-dac1-49e6-bba5-78b9fd751499 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:55.726425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c42f86-dac1-49e6-bba5-78b9fd751499 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:55.727103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c42f86-dac1-49e6-bba5-78b9fd751499 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:55.727546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c42f86-dac1-49e6-bba5-78b9fd751499 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:55.727964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c5c42f86-dac1-49e6-bba5-78b9fd751499 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:55.857049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c5c42f86-dac1-49e6-bba5-78b9fd751499 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:55.865254 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c5c42f86-dac1-49e6-bba5-78b9fd751499 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1314 microversion: 2.1 time: 0.151330 Oct 11 04:52:55.865811 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3225/6687] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:55 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:56.192104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-11de8b5b-57c3-49cc-8fa8-5ddb768ba97b req-da443bc8-bb37-49a5-8c26-93f9f9394bd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f44fd3-481e-4e35-9aae-99be40f9c015", "name": "network-vif-plugged", "status": "completed", "tag": "93f49d6a-561c-4122-ab46-7fc5a52ecd13"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:52:56.202484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-11de8b5b-57c3-49cc-8fa8-5ddb768ba97b req-da443bc8-bb37-49a5-8c26-93f9f9394bd0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:56.203466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-11de8b5b-57c3-49cc-8fa8-5ddb768ba97b req-da443bc8-bb37-49a5-8c26-93f9f9394bd0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:56.203929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-11de8b5b-57c3-49cc-8fa8-5ddb768ba97b req-da443bc8-bb37-49a5-8c26-93f9f9394bd0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:56.214738 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-11de8b5b-57c3-49cc-8fa8-5ddb768ba97b req-da443bc8-bb37-49a5-8c26-93f9f9394bd0 service nova] Creating event network-vif-plugged:93f49d6a-561c-4122-ab46-7fc5a52ecd13 for instance d4f44fd3-481e-4e35-9aae-99be40f9c015 on n-h2-860892-1 Oct 11 04:52:56.220469 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-11de8b5b-57c3-49cc-8fa8-5ddb768ba97b req-da443bc8-bb37-49a5-8c26-93f9f9394bd0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032076 Oct 11 04:52:56.221049 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3463/6688] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:52:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:52:56.279726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-491ad7ea-f12f-4c1b-a3a2-71887fa2e3e8 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:56.280343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-491ad7ea-f12f-4c1b-a3a2-71887fa2e3e8 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:56.287670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-491ad7ea-f12f-4c1b-a3a2-71887fa2e3e8 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:56.288158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-491ad7ea-f12f-4c1b-a3a2-71887fa2e3e8 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:56.288594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-491ad7ea-f12f-4c1b-a3a2-71887fa2e3e8 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:56.289287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-491ad7ea-f12f-4c1b-a3a2-71887fa2e3e8 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:56.289734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-491ad7ea-f12f-4c1b-a3a2-71887fa2e3e8 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:56.290152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-491ad7ea-f12f-4c1b-a3a2-71887fa2e3e8 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:56.445606 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-491ad7ea-f12f-4c1b-a3a2-71887fa2e3e8 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1464 microversion: 2.1 time: 0.170320 Oct 11 04:52:56.446169 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3226/6689] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:56 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1464 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:56.886075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:56.890289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-827aba63-bd19-472a-ba73-acdd073dc284 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:56.891022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-827aba63-bd19-472a-ba73-acdd073dc284 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:56.897007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-827aba63-bd19-472a-ba73-acdd073dc284 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:56.897478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-827aba63-bd19-472a-ba73-acdd073dc284 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:56.900941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-827aba63-bd19-472a-ba73-acdd073dc284 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:56.900941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-827aba63-bd19-472a-ba73-acdd073dc284 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:56.900941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-827aba63-bd19-472a-ba73-acdd073dc284 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:56.900941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-827aba63-bd19-472a-ba73-acdd073dc284 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:57.032848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-827aba63-bd19-472a-ba73-acdd073dc284 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:57.040457 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-827aba63-bd19-472a-ba73-acdd073dc284 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1314 microversion: 2.1 time: 0.155633 Oct 11 04:52:57.041023 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3464/6690] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:56 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:57.467627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3929b14e-f982-41ab-aaa9-50407ec70560 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:57.468236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3929b14e-f982-41ab-aaa9-50407ec70560 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:57.475716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3929b14e-f982-41ab-aaa9-50407ec70560 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:57.476190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3929b14e-f982-41ab-aaa9-50407ec70560 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:57.476624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3929b14e-f982-41ab-aaa9-50407ec70560 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:57.477304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3929b14e-f982-41ab-aaa9-50407ec70560 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:57.477744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3929b14e-f982-41ab-aaa9-50407ec70560 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:57.478164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3929b14e-f982-41ab-aaa9-50407ec70560 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:57.606907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=100 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:57.611488 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3929b14e-f982-41ab-aaa9-50407ec70560 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1464 microversion: 2.1 time: 0.147525 Oct 11 04:52:57.612062 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3227/6691] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:57 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1464 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:52:58.063551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7a624b8d-c366-4e8d-9599-539af6467dc2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:58.064208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7a624b8d-c366-4e8d-9599-539af6467dc2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:58.070971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a624b8d-c366-4e8d-9599-539af6467dc2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:58.071461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a624b8d-c366-4e8d-9599-539af6467dc2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:58.071961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a624b8d-c366-4e8d-9599-539af6467dc2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:58.072870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a624b8d-c366-4e8d-9599-539af6467dc2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:58.073450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a624b8d-c366-4e8d-9599-539af6467dc2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:58.073737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7a624b8d-c366-4e8d-9599-539af6467dc2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:58.092531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:58.210925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7a624b8d-c366-4e8d-9599-539af6467dc2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:58.218378 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7a624b8d-c366-4e8d-9599-539af6467dc2 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1314 microversion: 2.1 time: 0.159291 Oct 11 04:52:58.218963 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3465/6692] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:58 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:58.635020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e2e1b8e2-1f38-4da4-ae91-43c9aa0183fc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:58.635907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e2e1b8e2-1f38-4da4-ae91-43c9aa0183fc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:58.643564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2e1b8e2-1f38-4da4-ae91-43c9aa0183fc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:58.643971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2e1b8e2-1f38-4da4-ae91-43c9aa0183fc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:58.644404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2e1b8e2-1f38-4da4-ae91-43c9aa0183fc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:58.645086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2e1b8e2-1f38-4da4-ae91-43c9aa0183fc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:58.645533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2e1b8e2-1f38-4da4-ae91-43c9aa0183fc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:58.645956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e2e1b8e2-1f38-4da4-ae91-43c9aa0183fc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:58.682000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:58.703915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:58.770114 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e2e1b8e2-1f38-4da4-ae91-43c9aa0183fc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1649 microversion: 2.1 time: 0.139647 Oct 11 04:52:58.770722 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3228/6693] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:58 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1649 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:58.792018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2c669b76-6434-42f9-ba88-5fc91902c8cc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:58.792634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2c669b76-6434-42f9-ba88-5fc91902c8cc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:58.799009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c669b76-6434-42f9-ba88-5fc91902c8cc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:58.799490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c669b76-6434-42f9-ba88-5fc91902c8cc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:58.799935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c669b76-6434-42f9-ba88-5fc91902c8cc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:58.800620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c669b76-6434-42f9-ba88-5fc91902c8cc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:58.801075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c669b76-6434-42f9-ba88-5fc91902c8cc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:58.801498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2c669b76-6434-42f9-ba88-5fc91902c8cc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:58.908042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:52:58.928326 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2c669b76-6434-42f9-ba88-5fc91902c8cc tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1649 microversion: 2.1 time: 0.140028 Oct 11 04:52:58.928903 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3466/6694] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:58 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1649 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:58.950297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-49f68071-9e18-4794-9131-17b11a471f73 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:58.950917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-49f68071-9e18-4794-9131-17b11a471f73 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:58.956836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f68071-9e18-4794-9131-17b11a471f73 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:58.957319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f68071-9e18-4794-9131-17b11a471f73 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:58.957766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f68071-9e18-4794-9131-17b11a471f73 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:58.958679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f68071-9e18-4794-9131-17b11a471f73 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:58.959138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f68071-9e18-4794-9131-17b11a471f73 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:58.959566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-49f68071-9e18-4794-9131-17b11a471f73 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:59.089844 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-49f68071-9e18-4794-9131-17b11a471f73 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1649 microversion: 2.1 time: 0.143037 Oct 11 04:52:59.090483 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3229/6695] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:58 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1649 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:59.113117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7157b1d9-d4c9-4549-9213-bb8a0a146c3f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:59.113606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7157b1d9-d4c9-4549-9213-bb8a0a146c3f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:59.120700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7157b1d9-d4c9-4549-9213-bb8a0a146c3f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:59.122096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7157b1d9-d4c9-4549-9213-bb8a0a146c3f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:59.122096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7157b1d9-d4c9-4549-9213-bb8a0a146c3f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:59.122319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7157b1d9-d4c9-4549-9213-bb8a0a146c3f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:59.122771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7157b1d9-d4c9-4549-9213-bb8a0a146c3f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:59.123198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7157b1d9-d4c9-4549-9213-bb8a0a146c3f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:59.148628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7157b1d9-d4c9-4549-9213-bb8a0a146c3f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:52:59.241007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7d6b4248-5d4c-44f2-b546-283117e1828b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:59.241691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7d6b4248-5d4c-44f2-b546-283117e1828b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:59.247881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d6b4248-5d4c-44f2-b546-283117e1828b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:59.248406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d6b4248-5d4c-44f2-b546-283117e1828b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:59.249520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d6b4248-5d4c-44f2-b546-283117e1828b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:59.250892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d6b4248-5d4c-44f2-b546-283117e1828b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:59.251351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d6b4248-5d4c-44f2-b546-283117e1828b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:59.251774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7d6b4248-5d4c-44f2-b546-283117e1828b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:59.384514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7d6b4248-5d4c-44f2-b546-283117e1828b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:52:59.392463 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7d6b4248-5d4c-44f2-b546-283117e1828b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1314 microversion: 2.1 time: 0.155284 Oct 11 04:52:59.392983 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3230/6696] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:59 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:52:59.491288 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7157b1d9-d4c9-4549-9213-bb8a0a146c3f tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 204 len: 0 microversion: 2.1 time: 0.381866 Oct 11 04:52:59.491799 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3467/6697] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:52:59 2022] DELETE /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:52:59.500428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6316ddce-c574-47e8-91c8-cff5e63830cf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:52:59.501033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6316ddce-c574-47e8-91c8-cff5e63830cf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:52:59.507303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6316ddce-c574-47e8-91c8-cff5e63830cf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:59.507811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6316ddce-c574-47e8-91c8-cff5e63830cf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:59.508245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6316ddce-c574-47e8-91c8-cff5e63830cf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:59.508973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6316ddce-c574-47e8-91c8-cff5e63830cf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:52:59.509416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6316ddce-c574-47e8-91c8-cff5e63830cf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:52:59.509834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6316ddce-c574-47e8-91c8-cff5e63830cf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:52:59.635730 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6316ddce-c574-47e8-91c8-cff5e63830cf tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1655 microversion: 2.1 time: 0.138757 Oct 11 04:52:59.636301 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3231/6698] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:52:59 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1655 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:00.217123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-82e461c7-69a1-4b17-985b-ef0503d11f49 req-1dc46759-2750-457a-ab6c-b04da6dd11e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124ded3e-9ebe-439b-b28c-2157a10f2153", "name": "network-vif-plugged", "status": "completed", "tag": "de285a00-d8f5-470e-8f0a-4de03013972e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:53:00.223369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:53:00.229926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82e461c7-69a1-4b17-985b-ef0503d11f49 req-1dc46759-2750-457a-ab6c-b04da6dd11e6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:00.230434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82e461c7-69a1-4b17-985b-ef0503d11f49 req-1dc46759-2750-457a-ab6c-b04da6dd11e6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:00.230861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82e461c7-69a1-4b17-985b-ef0503d11f49 req-1dc46759-2750-457a-ab6c-b04da6dd11e6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:00.241898 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-82e461c7-69a1-4b17-985b-ef0503d11f49 req-1dc46759-2750-457a-ab6c-b04da6dd11e6 service nova] Creating event network-vif-plugged:de285a00-d8f5-470e-8f0a-4de03013972e for instance 124ded3e-9ebe-439b-b28c-2157a10f2153 on n-h2-860892-1 Oct 11 04:53:00.246730 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-82e461c7-69a1-4b17-985b-ef0503d11f49 req-1dc46759-2750-457a-ab6c-b04da6dd11e6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033592 Oct 11 04:53:00.247316 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3468/6699] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:53:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:53:00.415454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cbd3680-a4be-4076-bae8-812528003782 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:00.416180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2cbd3680-a4be-4076-bae8-812528003782 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:00.423587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cbd3680-a4be-4076-bae8-812528003782 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:00.424147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cbd3680-a4be-4076-bae8-812528003782 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:00.424654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cbd3680-a4be-4076-bae8-812528003782 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:00.425412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cbd3680-a4be-4076-bae8-812528003782 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:00.425933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cbd3680-a4be-4076-bae8-812528003782 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:00.426650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cbd3680-a4be-4076-bae8-812528003782 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:00.660926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1bdb32a9-4335-4167-806b-79bb9eab2c84 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:00.661662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1bdb32a9-4335-4167-806b-79bb9eab2c84 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:00.668197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bdb32a9-4335-4167-806b-79bb9eab2c84 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:00.668675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bdb32a9-4335-4167-806b-79bb9eab2c84 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:00.669107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bdb32a9-4335-4167-806b-79bb9eab2c84 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:00.669796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bdb32a9-4335-4167-806b-79bb9eab2c84 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:00.670267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bdb32a9-4335-4167-806b-79bb9eab2c84 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:00.670691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1bdb32a9-4335-4167-806b-79bb9eab2c84 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:00.678432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2cbd3680-a4be-4076-bae8-812528003782 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:00.686526 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2cbd3680-a4be-4076-bae8-812528003782 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1314 microversion: 2.1 time: 0.274898 Oct 11 04:53:00.687888 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3232/6700] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:00 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1314 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:00.796310 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1bdb32a9-4335-4167-806b-79bb9eab2c84 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1655 microversion: 2.1 time: 0.140412 Oct 11 04:53:00.797392 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3469/6701] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:00 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1655 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:53:01.440377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-209823d8-e8eb-4ace-8b09-910fd3261621 req-c511d262-e9a6-409e-b76d-7d5c73ef0ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4f44fd3-481e-4e35-9aae-99be40f9c015", "name": "network-vif-deleted", "tag": "93f49d6a-561c-4122-ab46-7fc5a52ecd13"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:53:01.450051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:53:01.455462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-209823d8-e8eb-4ace-8b09-910fd3261621 req-c511d262-e9a6-409e-b76d-7d5c73ef0ecb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:01.456012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-209823d8-e8eb-4ace-8b09-910fd3261621 req-c511d262-e9a6-409e-b76d-7d5c73ef0ecb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:01.456698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-209823d8-e8eb-4ace-8b09-910fd3261621 req-c511d262-e9a6-409e-b76d-7d5c73ef0ecb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:01.471367 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-209823d8-e8eb-4ace-8b09-910fd3261621 req-c511d262-e9a6-409e-b76d-7d5c73ef0ecb service nova] Creating event network-vif-deleted:93f49d6a-561c-4122-ab46-7fc5a52ecd13 for instance d4f44fd3-481e-4e35-9aae-99be40f9c015 on n-h2-860892-1 Oct 11 04:53:01.476743 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-209823d8-e8eb-4ace-8b09-910fd3261621 req-c511d262-e9a6-409e-b76d-7d5c73ef0ecb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041151 Oct 11 04:53:01.477889 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3233/6702] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:53:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:53:01.710084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8dd6ed2b-ffd1-4087-ada4-aa0650bb0fbf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:01.710666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8dd6ed2b-ffd1-4087-ada4-aa0650bb0fbf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:01.719175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd6ed2b-ffd1-4087-ada4-aa0650bb0fbf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:01.719660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd6ed2b-ffd1-4087-ada4-aa0650bb0fbf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:01.720087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd6ed2b-ffd1-4087-ada4-aa0650bb0fbf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:01.720971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd6ed2b-ffd1-4087-ada4-aa0650bb0fbf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:01.721418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd6ed2b-ffd1-4087-ada4-aa0650bb0fbf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:01.722957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8dd6ed2b-ffd1-4087-ada4-aa0650bb0fbf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:01.820913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:01.821613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:01.828035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:01.828513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:01.828946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:01.829638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:01.830083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:01.830532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:01.862948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8dd6ed2b-ffd1-4087-ada4-aa0650bb0fbf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:01.863120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:01.863496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:01.863933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:01.864384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lazy-loading 'fault' on Instance uuid d4f44fd3-481e-4e35-9aae-99be40f9c015 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:53:01.873803 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8dd6ed2b-ffd1-4087-ada4-aa0650bb0fbf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1314 microversion: 2.1 time: 0.167808 Oct 11 04:53:01.875036 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3470/6703] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:01 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:01.917663 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-860915e5-6e6e-4a43-bc5f-0396f79587ed tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 200 len: 1454 microversion: 2.1 time: 0.101012 Oct 11 04:53:01.918232 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3234/6704] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:01 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 1454 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:53:02.897683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-679eeff2-0897-4834-a5c6-8b37bf564a3b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:02.898327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-679eeff2-0897-4834-a5c6-8b37bf564a3b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:02.905152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-679eeff2-0897-4834-a5c6-8b37bf564a3b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:02.905627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-679eeff2-0897-4834-a5c6-8b37bf564a3b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:02.906067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-679eeff2-0897-4834-a5c6-8b37bf564a3b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:02.906770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-679eeff2-0897-4834-a5c6-8b37bf564a3b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:02.907217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-679eeff2-0897-4834-a5c6-8b37bf564a3b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:02.907659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-679eeff2-0897-4834-a5c6-8b37bf564a3b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:02.941309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:02.941924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: d4f44fd3-481e-4e35-9aae-99be40f9c015] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:02.948891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:02.949375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:02.949814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:02.950542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:02.950995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:02.951422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:02.965217 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] HTTP exception thrown: Instance d4f44fd3-481e-4e35-9aae-99be40f9c015 could not be found. Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Request method failure captured: Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 HTTP/1.1 Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPaNruQqckFg6q-_xq8HgljW9sX31UPTjO7C6OmzOIL1vN9-nOJjn0Gf5f5Uw5lfIcrdy2nYMA9HInmn8sje3HLZfy_JUutnmVnWq7Niql7JIl5K5HM8Ztm1pbOZH5IOwULnVJQC5eFKKpzBjZUskneNVqm2VUBCclU2Xz1RVz7JweY Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: a57d7836ffce44f2b7010eeb4469556a Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestServerMultinode-647739085 Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a57d7836ffce44f2b7010eeb4469556a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a57d7836ffce44f2b7010eeb4469556a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a57d7836ffce44f2b7010eeb4469556a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a57d7836ffce44f2b7010eeb4469556a"}]}] Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestServerMultinode-647739085 Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: a57d7836ffce44f2b7010eeb4469556a Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestServerMultinode-647739085 Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestServerMultinode-647739085-project-admin Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 6daa3906c5454addb4c36f8049478a29 Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestServerMultinode-647739085-project-admin Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance d4f44fd3-481e-4e35-9aae-99be40f9c015 could not be found. Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'd4f44fd3-481e-4e35-9aae-99be40f9c015'} Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4f44fd3-481e-4e35-9aae-99be40f9c015 could not be found. Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4f44fd3-481e-4e35-9aae-99be40f9c015 could not be found. Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:53:02.966922 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:53:02.971098 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:53:02.971098 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:53:02.971098 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:53:02.971098 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:53:02.971098 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:53:02.971098 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4f44fd3-481e-4e35-9aae-99be40f9c015 could not be found. Oct 11 04:53:02.971098 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:53:02.971098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Returning 404 to user: Instance d4f44fd3-481e-4e35-9aae-99be40f9c015 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:53:02.971098 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9a197b09-40f6-4915-8193-e209cee79b80 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015" status: 404 len: 111 microversion: 2.1 time: 0.031291 Oct 11 04:53:02.971098 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3235/6705] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:02 2022] GET /compute/v2.1/servers/d4f44fd3-481e-4e35-9aae-99be40f9c015 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:53:02.976719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-facd8a4b-1306-443b-8cec-9d6069cf5b6e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:02.977216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-facd8a4b-1306-443b-8cec-9d6069cf5b6e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:02.983006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-facd8a4b-1306-443b-8cec-9d6069cf5b6e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:02.983491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-facd8a4b-1306-443b-8cec-9d6069cf5b6e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:02.984476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-facd8a4b-1306-443b-8cec-9d6069cf5b6e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:02.985168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-facd8a4b-1306-443b-8cec-9d6069cf5b6e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:02.985629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-facd8a4b-1306-443b-8cec-9d6069cf5b6e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:02.986082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-facd8a4b-1306-443b-8cec-9d6069cf5b6e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:03.011842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-facd8a4b-1306-443b-8cec-9d6069cf5b6e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:53:03.039370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-679eeff2-0897-4834-a5c6-8b37bf564a3b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:03.047563 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-679eeff2-0897-4834-a5c6-8b37bf564a3b tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1463 microversion: 2.1 time: 0.153895 Oct 11 04:53:03.048132 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3471/6706] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:02 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1463 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:03.070387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8030c28f-95cc-45de-9908-4cc619892353 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e451eb8e-1d41-470e-8290-974f54e82f06", "device": "/dev/sdb"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:53:03.072798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8030c28f-95cc-45de-9908-4cc619892353 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:03.078878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8030c28f-95cc-45de-9908-4cc619892353 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:03.079367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8030c28f-95cc-45de-9908-4cc619892353 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:03.079806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8030c28f-95cc-45de-9908-4cc619892353 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:03.080499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8030c28f-95cc-45de-9908-4cc619892353 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:03.080954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8030c28f-95cc-45de-9908-4cc619892353 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:03.081377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8030c28f-95cc-45de-9908-4cc619892353 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:03.314484 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-facd8a4b-1306-443b-8cec-9d6069cf5b6e tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "DELETE /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 204 len: 0 microversion: 2.1 time: 0.340909 Oct 11 04:53:03.315078 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3236/6707] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:53:02 2022] DELETE /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 04:53:03.323147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2797cc64-8b35-41f9-8b86-d433e3058555 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:03.323843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2797cc64-8b35-41f9-8b86-d433e3058555 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:03.329729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2797cc64-8b35-41f9-8b86-d433e3058555 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:03.330254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2797cc64-8b35-41f9-8b86-d433e3058555 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:03.330931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2797cc64-8b35-41f9-8b86-d433e3058555 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:03.331350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2797cc64-8b35-41f9-8b86-d433e3058555 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:03.331805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2797cc64-8b35-41f9-8b86-d433e3058555 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:03.332272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2797cc64-8b35-41f9-8b86-d433e3058555 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:03.461768 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2797cc64-8b35-41f9-8b86-d433e3058555 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1655 microversion: 2.1 time: 0.142331 Oct 11 04:53:03.462334 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3237/6708] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:03 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1655 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:53:03.757831 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8030c28f-95cc-45de-9908-4cc619892353 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "POST /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.691135 Oct 11 04:53:03.758391 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3472/6709] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 04:53:03 2022] POST /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153/os-volume_attachments => generated 194 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:53:04.484979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f32b5b0-7507-4237-a55b-944842ef3fce tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:04.485722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5f32b5b0-7507-4237-a55b-944842ef3fce tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:04.493387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f32b5b0-7507-4237-a55b-944842ef3fce tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:04.493880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f32b5b0-7507-4237-a55b-944842ef3fce tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:04.494347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f32b5b0-7507-4237-a55b-944842ef3fce tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:04.495049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f32b5b0-7507-4237-a55b-944842ef3fce tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:04.495506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f32b5b0-7507-4237-a55b-944842ef3fce tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:04.496161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f32b5b0-7507-4237-a55b-944842ef3fce tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:04.627430 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5f32b5b0-7507-4237-a55b-944842ef3fce tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1655 microversion: 2.1 time: 0.146293 Oct 11 04:53:04.628008 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3238/6710] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:04 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1655 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:05.475916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-bc37ef53-586d-4726-84b8-2e179bc9af3d req-aed172cd-340a-4511-a3d2-f2dff2b22410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b47ce839-e8e4-45a5-9cc8-c755e09e1d9a", "name": "network-vif-deleted", "tag": "16820218-64cb-422b-8e09-76ab26e6e9ea"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:53:05.486408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bc37ef53-586d-4726-84b8-2e179bc9af3d req-aed172cd-340a-4511-a3d2-f2dff2b22410 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:05.486881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bc37ef53-586d-4726-84b8-2e179bc9af3d req-aed172cd-340a-4511-a3d2-f2dff2b22410 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:05.487309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bc37ef53-586d-4726-84b8-2e179bc9af3d req-aed172cd-340a-4511-a3d2-f2dff2b22410 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:05.501574 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-bc37ef53-586d-4726-84b8-2e179bc9af3d req-aed172cd-340a-4511-a3d2-f2dff2b22410 service nova] Creating event network-vif-deleted:16820218-64cb-422b-8e09-76ab26e6e9ea for instance b47ce839-e8e4-45a5-9cc8-c755e09e1d9a on n-h1-860892-1 Oct 11 04:53:05.507166 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-bc37ef53-586d-4726-84b8-2e179bc9af3d req-aed172cd-340a-4511-a3d2-f2dff2b22410 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038365 Oct 11 04:53:05.509926 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3473/6711] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:53:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:53:05.652459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb370e30-53e1-422f-9ebd-7162b4b5dab4 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:05.653267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fb370e30-53e1-422f-9ebd-7162b4b5dab4 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:05.661010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb370e30-53e1-422f-9ebd-7162b4b5dab4 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:05.661488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb370e30-53e1-422f-9ebd-7162b4b5dab4 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:05.661923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb370e30-53e1-422f-9ebd-7162b4b5dab4 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:05.662647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb370e30-53e1-422f-9ebd-7162b4b5dab4 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:05.663094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb370e30-53e1-422f-9ebd-7162b4b5dab4 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:05.663535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb370e30-53e1-422f-9ebd-7162b4b5dab4 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:05.733586 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb370e30-53e1-422f-9ebd-7162b4b5dab4 tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 200 len: 1448 microversion: 2.1 time: 0.085445 Oct 11 04:53:05.734698 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3239/6712] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:05 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 1448 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:05.747806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e56f924c-2778-4870-8c85-cd4158d9010e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:05.748495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e56f924c-2778-4870-8c85-cd4158d9010e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:05.757470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f924c-2778-4870-8c85-cd4158d9010e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:05.757952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f924c-2778-4870-8c85-cd4158d9010e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:05.758511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f924c-2778-4870-8c85-cd4158d9010e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:05.759208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f924c-2778-4870-8c85-cd4158d9010e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:05.759662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f924c-2778-4870-8c85-cd4158d9010e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:05.760083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e56f924c-2778-4870-8c85-cd4158d9010e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:06.138413 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e56f924c-2778-4870-8c85-cd4158d9010e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1835 microversion: 2.1 time: 0.394548 Oct 11 04:53:06.139112 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3474/6713] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:05 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1835 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:06.161859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-484434b5-0748-46d5-9daa-392c6208942b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:06.162539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-484434b5-0748-46d5-9daa-392c6208942b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:06.168947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-484434b5-0748-46d5-9daa-392c6208942b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:06.169490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-484434b5-0748-46d5-9daa-392c6208942b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:06.170269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-484434b5-0748-46d5-9daa-392c6208942b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:06.177014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-484434b5-0748-46d5-9daa-392c6208942b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:06.177014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-484434b5-0748-46d5-9daa-392c6208942b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:06.177014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-484434b5-0748-46d5-9daa-392c6208942b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:06.327130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-484434b5-0748-46d5-9daa-392c6208942b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:06.335614 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-484434b5-0748-46d5-9daa-392c6208942b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1684 microversion: 2.1 time: 0.177904 Oct 11 04:53:06.336183 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3240/6714] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:06 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1684 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:06.447725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a499123-e650-44b4-82dd-36c2ca93650b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:53:06.450027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1a499123-e650-44b4-82dd-36c2ca93650b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:06.456400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a499123-e650-44b4-82dd-36c2ca93650b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:06.461372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a499123-e650-44b4-82dd-36c2ca93650b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:06.461372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a499123-e650-44b4-82dd-36c2ca93650b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:06.461372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a499123-e650-44b4-82dd-36c2ca93650b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:06.461372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a499123-e650-44b4-82dd-36c2ca93650b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:06.461372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a499123-e650-44b4-82dd-36c2ca93650b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:06.509575 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1a499123-e650-44b4-82dd-36c2ca93650b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4/action" status: 200 len: 32635 microversion: 2.1 time: 0.065673 Oct 11 04:53:06.511385 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3475/6715] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:53:06 2022] POST /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4/action => generated 32635 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:53:06.738916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:53:06.739512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:06.746490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:06.747073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:06.747559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:06.748313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:06.748824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:06.749343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:06.757239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:06.758307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] [instance: b47ce839-e8e4-45a5-9cc8-c755e09e1d9a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:06.766165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:06.766766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:06.767205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:06.768078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:06.768714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:06.769192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:06.784490 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] HTTP exception thrown: Instance b47ce839-e8e4-45a5-9cc8-c755e09e1d9a could not be found. Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Request method failure captured: Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a HTTP/1.1 Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPaNruQqckFg6q-_xq8HgljW9sX31UPTjO7C6OmzOIL1vN9-nOJjn0Gf5f5Uw5lfIcrdy2nYMA9HInmn8sje3HLZfy_JUutnmVnWq7Niql7JIl5K5HM8Ztm1pbOZH5IOwULnVJQC5eFKKpzBjZUskneNVqm2VUBCclU2Xz1RVz7JweY Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: a57d7836ffce44f2b7010eeb4469556a Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestServerMultinode-647739085 Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a57d7836ffce44f2b7010eeb4469556a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a57d7836ffce44f2b7010eeb4469556a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a57d7836ffce44f2b7010eeb4469556a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a57d7836ffce44f2b7010eeb4469556a"}]}] Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestServerMultinode-647739085 Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: a57d7836ffce44f2b7010eeb4469556a Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestServerMultinode-647739085 Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestServerMultinode-647739085-project-admin Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 6daa3906c5454addb4c36f8049478a29 Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestServerMultinode-647739085-project-admin Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance b47ce839-e8e4-45a5-9cc8-c755e09e1d9a could not be found. Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'b47ce839-e8e4-45a5-9cc8-c755e09e1d9a'} Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b47ce839-e8e4-45a5-9cc8-c755e09e1d9a could not be found. Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b47ce839-e8e4-45a5-9cc8-c755e09e1d9a could not be found. Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:53:06.786152 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:53:06.790879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:53:06.790879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:53:06.790879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:53:06.790879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:53:06.790879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:53:06.790879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b47ce839-e8e4-45a5-9cc8-c755e09e1d9a could not be found. Oct 11 04:53:06.790879 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:53:06.790879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] Returning 404 to user: Instance b47ce839-e8e4-45a5-9cc8-c755e09e1d9a could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:53:06.790879 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2a742d65-22a5-46dc-bca1-8002aa587cba tempest-TestServerMultinode-647739085 tempest-TestServerMultinode-647739085-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a" status: 404 len: 111 microversion: 2.1 time: 0.034420 Oct 11 04:53:06.793289 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3476/6716] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:06 2022] GET /compute/v2.1/servers/b47ce839-e8e4-45a5-9cc8-c755e09e1d9a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 04:53:06.840290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dc066a2f21494281bedc1e7d84a6601f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559b05f0ddc74f48a3dc4d8d435a52aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:06.840893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] flavor_id is None. Assuming migration. {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 04:53:06.841328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 04:53:07.279920 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3f9645e-9f24-4a1c-922e-5b13060df819 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4/action" status: 202 len: 0 microversion: 2.1 time: 0.544698 Oct 11 04:53:07.280820 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3241/6717] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:53:06 2022] POST /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4/action => generated 0 bytes in 546 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:53:07.293129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dba06730-f771-4476-a9e0-3899d5ae01df tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:07.293129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dba06730-f771-4476-a9e0-3899d5ae01df tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:07.297811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dba06730-f771-4476-a9e0-3899d5ae01df tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:07.298470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dba06730-f771-4476-a9e0-3899d5ae01df tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:07.299014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dba06730-f771-4476-a9e0-3899d5ae01df tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:07.299973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dba06730-f771-4476-a9e0-3899d5ae01df tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:07.300644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dba06730-f771-4476-a9e0-3899d5ae01df tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:07.301271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dba06730-f771-4476-a9e0-3899d5ae01df tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:07.548047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dba06730-f771-4476-a9e0-3899d5ae01df tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:07.559872 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dba06730-f771-4476-a9e0-3899d5ae01df tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1693 microversion: 2.1 time: 0.274727 Oct 11 04:53:07.561120 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3477/6718] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:07 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1693 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:08.585338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-481c477d-88cb-4832-a704-292d812829dc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:08.586225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-481c477d-88cb-4832-a704-292d812829dc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:08.594054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-481c477d-88cb-4832-a704-292d812829dc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:08.595374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-481c477d-88cb-4832-a704-292d812829dc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:08.595374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-481c477d-88cb-4832-a704-292d812829dc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:08.596757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-481c477d-88cb-4832-a704-292d812829dc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:08.597450 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-481c477d-88cb-4832-a704-292d812829dc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:08.598202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-481c477d-88cb-4832-a704-292d812829dc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:08.622618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:53:08.843107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-481c477d-88cb-4832-a704-292d812829dc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:08.853319 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-481c477d-88cb-4832-a704-292d812829dc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1693 microversion: 2.1 time: 0.272959 Oct 11 04:53:08.858021 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3242/6719] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:08 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1693 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:09.876969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4f414975-cc30-477e-839e-77ca9b3ce05d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:09.878282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4f414975-cc30-477e-839e-77ca9b3ce05d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:09.886086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f414975-cc30-477e-839e-77ca9b3ce05d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:09.886609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f414975-cc30-477e-839e-77ca9b3ce05d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:09.887263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f414975-cc30-477e-839e-77ca9b3ce05d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:09.888012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f414975-cc30-477e-839e-77ca9b3ce05d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:09.888525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f414975-cc30-477e-839e-77ca9b3ce05d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:09.889114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f414975-cc30-477e-839e-77ca9b3ce05d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:10.078253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4f414975-cc30-477e-839e-77ca9b3ce05d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:10.093331 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4f414975-cc30-477e-839e-77ca9b3ce05d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1693 microversion: 2.1 time: 0.219631 Oct 11 04:53:10.093963 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3478/6720] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:09 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1693 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:11.120860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68526ae0-17b1-4761-90f9-b69cd5daee1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:11.122530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68526ae0-17b1-4761-90f9-b69cd5daee1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:11.130624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68526ae0-17b1-4761-90f9-b69cd5daee1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:11.131367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68526ae0-17b1-4761-90f9-b69cd5daee1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:11.132224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68526ae0-17b1-4761-90f9-b69cd5daee1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:11.132926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68526ae0-17b1-4761-90f9-b69cd5daee1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:11.133658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68526ae0-17b1-4761-90f9-b69cd5daee1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:11.134316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68526ae0-17b1-4761-90f9-b69cd5daee1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:11.829531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68526ae0-17b1-4761-90f9-b69cd5daee1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:11.835821 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68526ae0-17b1-4761-90f9-b69cd5daee1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1698 microversion: 2.1 time: 0.719734 Oct 11 04:53:11.836308 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3243/6721] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:11 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1698 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:12.860847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ebc02233-c9b2-46d5-ac42-a6ed82b6ea97 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:12.861465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ebc02233-c9b2-46d5-ac42-a6ed82b6ea97 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:12.868385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc02233-c9b2-46d5-ac42-a6ed82b6ea97 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:12.869086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc02233-c9b2-46d5-ac42-a6ed82b6ea97 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:12.870009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc02233-c9b2-46d5-ac42-a6ed82b6ea97 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:12.870761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc02233-c9b2-46d5-ac42-a6ed82b6ea97 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:12.871222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc02233-c9b2-46d5-ac42-a6ed82b6ea97 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:12.872649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebc02233-c9b2-46d5-ac42-a6ed82b6ea97 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:13.051991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ebc02233-c9b2-46d5-ac42-a6ed82b6ea97 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:13.060584 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ebc02233-c9b2-46d5-ac42-a6ed82b6ea97 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1698 microversion: 2.1 time: 0.205201 Oct 11 04:53:13.062103 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3479/6722] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:12 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1698 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:14.084799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-12b0602c-4a1c-4e61-954d-d1ab9bfa3010 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:14.085409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-12b0602c-4a1c-4e61-954d-d1ab9bfa3010 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:14.105153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12b0602c-4a1c-4e61-954d-d1ab9bfa3010 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:14.105654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12b0602c-4a1c-4e61-954d-d1ab9bfa3010 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:14.106092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12b0602c-4a1c-4e61-954d-d1ab9bfa3010 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:14.106830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12b0602c-4a1c-4e61-954d-d1ab9bfa3010 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:14.107284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12b0602c-4a1c-4e61-954d-d1ab9bfa3010 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:14.107713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-12b0602c-4a1c-4e61-954d-d1ab9bfa3010 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:14.276653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-12b0602c-4a1c-4e61-954d-d1ab9bfa3010 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:14.285495 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-12b0602c-4a1c-4e61-954d-d1ab9bfa3010 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1698 microversion: 2.1 time: 0.204574 Oct 11 04:53:14.287872 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3244/6723] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:14 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1698 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:15.310365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d338adb6-915a-4ac8-8706-9efd91f0f007 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:15.311205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d338adb6-915a-4ac8-8706-9efd91f0f007 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:15.314257 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 04:53:15.314414 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 04:53:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 (ip 10.222.0.26) !!! Oct 11 04:53:15.321170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d338adb6-915a-4ac8-8706-9efd91f0f007 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:15.323929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d338adb6-915a-4ac8-8706-9efd91f0f007 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:15.323929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d338adb6-915a-4ac8-8706-9efd91f0f007 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:15.323929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d338adb6-915a-4ac8-8706-9efd91f0f007 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:15.323929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d338adb6-915a-4ac8-8706-9efd91f0f007 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:15.323929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d338adb6-915a-4ac8-8706-9efd91f0f007 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:15.471713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d338adb6-915a-4ac8-8706-9efd91f0f007 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:15.486947 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d338adb6-915a-4ac8-8706-9efd91f0f007 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1698 microversion: 2.1 time: 0.173899 Oct 11 04:53:15.486947 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3480/6724] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:15 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1698 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:16.507033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d4769ebd-82dc-40d2-9bca-da0817507423 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:16.507850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d4769ebd-82dc-40d2-9bca-da0817507423 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:16.532407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4769ebd-82dc-40d2-9bca-da0817507423 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:16.533136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4769ebd-82dc-40d2-9bca-da0817507423 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:16.533725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4769ebd-82dc-40d2-9bca-da0817507423 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:16.534660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4769ebd-82dc-40d2-9bca-da0817507423 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:16.535400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4769ebd-82dc-40d2-9bca-da0817507423 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:16.535990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4769ebd-82dc-40d2-9bca-da0817507423 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:16.677705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d4769ebd-82dc-40d2-9bca-da0817507423 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:16.685664 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d4769ebd-82dc-40d2-9bca-da0817507423 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1698 microversion: 2.1 time: 0.183775 Oct 11 04:53:16.687005 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3245/6725] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:16 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1698 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:17.710345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6ab4aee-6b4d-415b-a738-307c88202db8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:17.710885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6ab4aee-6b4d-415b-a738-307c88202db8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:17.717786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ab4aee-6b4d-415b-a738-307c88202db8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:17.718314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ab4aee-6b4d-415b-a738-307c88202db8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:17.718934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ab4aee-6b4d-415b-a738-307c88202db8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:17.719636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ab4aee-6b4d-415b-a738-307c88202db8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:17.720088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ab4aee-6b4d-415b-a738-307c88202db8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:17.720514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6ab4aee-6b4d-415b-a738-307c88202db8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:17.740995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:53:17.881509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6ab4aee-6b4d-415b-a738-307c88202db8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:17.889667 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6ab4aee-6b4d-415b-a738-307c88202db8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1698 microversion: 2.1 time: 0.183380 Oct 11 04:53:17.890261 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3481/6726] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:17 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1698 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:18.913090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c9afec1f-08c8-401c-bc5d-53192431aee6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:18.914152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c9afec1f-08c8-401c-bc5d-53192431aee6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:18.922240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9afec1f-08c8-401c-bc5d-53192431aee6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:18.923163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9afec1f-08c8-401c-bc5d-53192431aee6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:18.923722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9afec1f-08c8-401c-bc5d-53192431aee6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:18.924757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9afec1f-08c8-401c-bc5d-53192431aee6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:18.925337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9afec1f-08c8-401c-bc5d-53192431aee6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:18.925898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9afec1f-08c8-401c-bc5d-53192431aee6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:19.090797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c9afec1f-08c8-401c-bc5d-53192431aee6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:19.100489 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c9afec1f-08c8-401c-bc5d-53192431aee6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1698 microversion: 2.1 time: 0.191485 Oct 11 04:53:19.102537 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3246/6727] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:18 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1698 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:20.125241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ceacf6e7-0e81-41da-8864-2e753527c64e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:20.126507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ceacf6e7-0e81-41da-8864-2e753527c64e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:20.133987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ceacf6e7-0e81-41da-8864-2e753527c64e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:20.134709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ceacf6e7-0e81-41da-8864-2e753527c64e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:20.135400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ceacf6e7-0e81-41da-8864-2e753527c64e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:20.136101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ceacf6e7-0e81-41da-8864-2e753527c64e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:20.136549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ceacf6e7-0e81-41da-8864-2e753527c64e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:20.139640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ceacf6e7-0e81-41da-8864-2e753527c64e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:20.379886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ceacf6e7-0e81-41da-8864-2e753527c64e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:20.388722 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ceacf6e7-0e81-41da-8864-2e753527c64e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1698 microversion: 2.1 time: 0.268243 Oct 11 04:53:20.390232 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3482/6728] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:20 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1698 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:21.416422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-71d50bbf-2ab5-4315-8935-a52fbc2b0392 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:21.417046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-71d50bbf-2ab5-4315-8935-a52fbc2b0392 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:21.425010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d50bbf-2ab5-4315-8935-a52fbc2b0392 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:21.425502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d50bbf-2ab5-4315-8935-a52fbc2b0392 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:21.425971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d50bbf-2ab5-4315-8935-a52fbc2b0392 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:21.426704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d50bbf-2ab5-4315-8935-a52fbc2b0392 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:21.427158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d50bbf-2ab5-4315-8935-a52fbc2b0392 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:21.428679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71d50bbf-2ab5-4315-8935-a52fbc2b0392 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:21.594574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-71d50bbf-2ab5-4315-8935-a52fbc2b0392 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:21.616840 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-71d50bbf-2ab5-4315-8935-a52fbc2b0392 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1698 microversion: 2.1 time: 0.192501 Oct 11 04:53:21.617318 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3247/6729] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:21 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1698 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:22.628720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4cab986c-24e2-49e1-a9c9-8f4c23391c38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:22.629367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4cab986c-24e2-49e1-a9c9-8f4c23391c38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:22.636782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cab986c-24e2-49e1-a9c9-8f4c23391c38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:22.638594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cab986c-24e2-49e1-a9c9-8f4c23391c38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:22.638594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cab986c-24e2-49e1-a9c9-8f4c23391c38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:22.638594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cab986c-24e2-49e1-a9c9-8f4c23391c38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:22.639475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cab986c-24e2-49e1-a9c9-8f4c23391c38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:22.643012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4cab986c-24e2-49e1-a9c9-8f4c23391c38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:22.836982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4cab986c-24e2-49e1-a9c9-8f4c23391c38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:22.847275 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4cab986c-24e2-49e1-a9c9-8f4c23391c38 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1698 microversion: 2.1 time: 0.222416 Oct 11 04:53:22.847855 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3483/6730] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:22 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1698 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:23.871671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35f58544-49e1-4b1e-ab1b-a86ec341a424 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:23.872359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-35f58544-49e1-4b1e-ab1b-a86ec341a424 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:23.886412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f58544-49e1-4b1e-ab1b-a86ec341a424 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:23.886971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f58544-49e1-4b1e-ab1b-a86ec341a424 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:23.891898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f58544-49e1-4b1e-ab1b-a86ec341a424 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:23.893083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f58544-49e1-4b1e-ab1b-a86ec341a424 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:23.893569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f58544-49e1-4b1e-ab1b-a86ec341a424 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:23.894043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35f58544-49e1-4b1e-ab1b-a86ec341a424 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:24.207032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35f58544-49e1-4b1e-ab1b-a86ec341a424 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:24.219099 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35f58544-49e1-4b1e-ab1b-a86ec341a424 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1697 microversion: 2.1 time: 0.351794 Oct 11 04:53:24.222417 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3248/6731] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:23 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1697 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:24.316676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-eb9c3371-6024-45ca-81c4-8af85b30c33b req-99545ffd-a7d7-454b-a160-53fdc8b7de11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da9a3ae-5412-4d1d-9d69-3c018e14d9e4", "name": "network-vif-unplugged", "status": "completed", "tag": "b1187e42-2711-461e-9375-1ecae8093b67"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:53:24.349057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-eb9c3371-6024-45ca-81c4-8af85b30c33b req-99545ffd-a7d7-454b-a160-53fdc8b7de11 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:24.351840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-eb9c3371-6024-45ca-81c4-8af85b30c33b req-99545ffd-a7d7-454b-a160-53fdc8b7de11 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:24.356945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-eb9c3371-6024-45ca-81c4-8af85b30c33b req-99545ffd-a7d7-454b-a160-53fdc8b7de11 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:24.394625 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-eb9c3371-6024-45ca-81c4-8af85b30c33b req-99545ffd-a7d7-454b-a160-53fdc8b7de11 service nova] Creating event network-vif-unplugged:b1187e42-2711-461e-9375-1ecae8093b67 for instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 on n-h2-860892-1 Oct 11 04:53:24.408649 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-eb9c3371-6024-45ca-81c4-8af85b30c33b req-99545ffd-a7d7-454b-a160-53fdc8b7de11 service nova] Instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:53:24.430509 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-eb9c3371-6024-45ca-81c4-8af85b30c33b req-99545ffd-a7d7-454b-a160-53fdc8b7de11 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.118300 Oct 11 04:53:24.431476 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3484/6732] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:53:24 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:53:25.253968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6bed339e-dafe-45c7-892d-e381e24d34d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:25.255477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6bed339e-dafe-45c7-892d-e381e24d34d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:25.264329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bed339e-dafe-45c7-892d-e381e24d34d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:25.265410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bed339e-dafe-45c7-892d-e381e24d34d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:25.266575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bed339e-dafe-45c7-892d-e381e24d34d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:25.267616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bed339e-dafe-45c7-892d-e381e24d34d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:25.268361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bed339e-dafe-45c7-892d-e381e24d34d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:25.273491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6bed339e-dafe-45c7-892d-e381e24d34d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:25.522059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6bed339e-dafe-45c7-892d-e381e24d34d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:25.534006 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6bed339e-dafe-45c7-892d-e381e24d34d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1697 microversion: 2.1 time: 0.290652 Oct 11 04:53:25.534630 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3249/6733] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:25 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1697 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:26.448611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b17b8dec-03b2-4a59-ad4f-9cb03ee6e691 req-cf963464-3523-4d37-b36d-8112758d2518 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da9a3ae-5412-4d1d-9d69-3c018e14d9e4", "tag": "b1187e42-2711-461e-9375-1ecae8093b67"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:53:26.458885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b17b8dec-03b2-4a59-ad4f-9cb03ee6e691 req-cf963464-3523-4d37-b36d-8112758d2518 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:26.459361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b17b8dec-03b2-4a59-ad4f-9cb03ee6e691 req-cf963464-3523-4d37-b36d-8112758d2518 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:26.459789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b17b8dec-03b2-4a59-ad4f-9cb03ee6e691 req-cf963464-3523-4d37-b36d-8112758d2518 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:26.473484 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b17b8dec-03b2-4a59-ad4f-9cb03ee6e691 req-cf963464-3523-4d37-b36d-8112758d2518 service nova] Creating event network-changed:b1187e42-2711-461e-9375-1ecae8093b67 for instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 on n-h2-860892-1 Oct 11 04:53:26.479376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-b17b8dec-03b2-4a59-ad4f-9cb03ee6e691 req-cf963464-3523-4d37-b36d-8112758d2518 service nova] Instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:53:26.493026 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b17b8dec-03b2-4a59-ad4f-9cb03ee6e691 req-cf963464-3523-4d37-b36d-8112758d2518 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049286 Oct 11 04:53:26.498030 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3485/6734] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:53:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:53:26.557137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e6c01da3-4f3b-41a4-92da-e0e3063a54c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:26.558469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e6c01da3-4f3b-41a4-92da-e0e3063a54c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:26.565707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6c01da3-4f3b-41a4-92da-e0e3063a54c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:26.566432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6c01da3-4f3b-41a4-92da-e0e3063a54c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:26.567111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6c01da3-4f3b-41a4-92da-e0e3063a54c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:26.568005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6c01da3-4f3b-41a4-92da-e0e3063a54c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:26.568637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6c01da3-4f3b-41a4-92da-e0e3063a54c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:26.569295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6c01da3-4f3b-41a4-92da-e0e3063a54c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:26.895764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e6c01da3-4f3b-41a4-92da-e0e3063a54c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:26.903714 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e6c01da3-4f3b-41a4-92da-e0e3063a54c5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1695 microversion: 2.1 time: 0.350495 Oct 11 04:53:26.904373 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3250/6735] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:26 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1695 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:27.936487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f6cd8ac-a42c-4281-a9ec-27a56e6eb75a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:27.937256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f6cd8ac-a42c-4281-a9ec-27a56e6eb75a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:27.945418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6cd8ac-a42c-4281-a9ec-27a56e6eb75a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:27.946345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6cd8ac-a42c-4281-a9ec-27a56e6eb75a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:27.946949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6cd8ac-a42c-4281-a9ec-27a56e6eb75a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:27.947830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6cd8ac-a42c-4281-a9ec-27a56e6eb75a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:27.948886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6cd8ac-a42c-4281-a9ec-27a56e6eb75a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:27.949521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f6cd8ac-a42c-4281-a9ec-27a56e6eb75a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:28.204749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f6cd8ac-a42c-4281-a9ec-27a56e6eb75a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:28.224952 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f6cd8ac-a42c-4281-a9ec-27a56e6eb75a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1695 microversion: 2.1 time: 0.295516 Oct 11 04:53:28.231909 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3486/6736] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:27 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1695 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:29.254770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1027f961-11d6-45c2-b9ed-1ee08113ea62 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:29.256064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1027f961-11d6-45c2-b9ed-1ee08113ea62 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:29.265486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1027f961-11d6-45c2-b9ed-1ee08113ea62 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:29.266318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1027f961-11d6-45c2-b9ed-1ee08113ea62 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:29.266964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1027f961-11d6-45c2-b9ed-1ee08113ea62 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:29.267971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1027f961-11d6-45c2-b9ed-1ee08113ea62 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:29.268624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1027f961-11d6-45c2-b9ed-1ee08113ea62 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:29.269409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1027f961-11d6-45c2-b9ed-1ee08113ea62 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:29.466574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1027f961-11d6-45c2-b9ed-1ee08113ea62 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:29.494483 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1027f961-11d6-45c2-b9ed-1ee08113ea62 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1692 microversion: 2.1 time: 0.225700 Oct 11 04:53:29.494483 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3251/6737] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:29 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1692 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:29.500435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6b7c0e29-93ce-4c88-a907-08fbba763101 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:53:29.501059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6b7c0e29-93ce-4c88-a907-08fbba763101 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:29.519967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b7c0e29-93ce-4c88-a907-08fbba763101 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:29.520561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b7c0e29-93ce-4c88-a907-08fbba763101 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:29.521280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b7c0e29-93ce-4c88-a907-08fbba763101 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:29.522527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b7c0e29-93ce-4c88-a907-08fbba763101 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:29.523262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b7c0e29-93ce-4c88-a907-08fbba763101 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:29.523922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b7c0e29-93ce-4c88-a907-08fbba763101 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:29.901358 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6b7c0e29-93ce-4c88-a907-08fbba763101 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4/action" status: 204 len: 0 microversion: 2.1 time: 0.404587 Oct 11 04:53:29.902011 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3487/6738] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:53:29 2022] POST /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4/action => generated 0 bytes in 408 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:53:29.912269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-30c274f9-29a5-497e-8d13-81a39cc3b050 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:29.912988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-30c274f9-29a5-497e-8d13-81a39cc3b050 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:29.944652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c274f9-29a5-497e-8d13-81a39cc3b050 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:29.950413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c274f9-29a5-497e-8d13-81a39cc3b050 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:29.951779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c274f9-29a5-497e-8d13-81a39cc3b050 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:29.952629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c274f9-29a5-497e-8d13-81a39cc3b050 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:29.954478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c274f9-29a5-497e-8d13-81a39cc3b050 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:29.956979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30c274f9-29a5-497e-8d13-81a39cc3b050 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:30.240369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-30c274f9-29a5-497e-8d13-81a39cc3b050 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:30.284931 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-30c274f9-29a5-497e-8d13-81a39cc3b050 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1692 microversion: 2.1 time: 0.377133 Oct 11 04:53:30.286489 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3252/6739] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:29 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1692 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:30.553302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-54201a40-c75f-4ff5-8915-8e894e3af4c5 req-3af95df0-f963-4ef0-b5e4-0116702d0805 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da9a3ae-5412-4d1d-9d69-3c018e14d9e4", "name": "network-vif-plugged", "status": "completed", "tag": "b1187e42-2711-461e-9375-1ecae8093b67"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:53:30.582104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-54201a40-c75f-4ff5-8915-8e894e3af4c5 req-3af95df0-f963-4ef0-b5e4-0116702d0805 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:30.583842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-54201a40-c75f-4ff5-8915-8e894e3af4c5 req-3af95df0-f963-4ef0-b5e4-0116702d0805 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:30.584299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-54201a40-c75f-4ff5-8915-8e894e3af4c5 req-3af95df0-f963-4ef0-b5e4-0116702d0805 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:30.606820 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-54201a40-c75f-4ff5-8915-8e894e3af4c5 req-3af95df0-f963-4ef0-b5e4-0116702d0805 service nova] Creating event network-vif-plugged:b1187e42-2711-461e-9375-1ecae8093b67 for instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 on n-h2-860892-1 Oct 11 04:53:30.617240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-54201a40-c75f-4ff5-8915-8e894e3af4c5 req-3af95df0-f963-4ef0-b5e4-0116702d0805 service nova] Instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:53:30.629962 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-54201a40-c75f-4ff5-8915-8e894e3af4c5 req-3af95df0-f963-4ef0-b5e4-0116702d0805 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090046 Oct 11 04:53:30.647368 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3488/6740] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:53:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:53:31.317867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d659f31c-8fe1-4bd3-9475-2bf97ee3ce3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:31.319177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d659f31c-8fe1-4bd3-9475-2bf97ee3ce3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:31.330335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d659f31c-8fe1-4bd3-9475-2bf97ee3ce3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:31.332767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d659f31c-8fe1-4bd3-9475-2bf97ee3ce3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:31.333328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d659f31c-8fe1-4bd3-9475-2bf97ee3ce3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:31.334356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d659f31c-8fe1-4bd3-9475-2bf97ee3ce3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:31.335117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d659f31c-8fe1-4bd3-9475-2bf97ee3ce3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:31.335720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d659f31c-8fe1-4bd3-9475-2bf97ee3ce3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:31.690724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d659f31c-8fe1-4bd3-9475-2bf97ee3ce3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:31.699215 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d659f31c-8fe1-4bd3-9475-2bf97ee3ce3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1692 microversion: 2.1 time: 0.390069 Oct 11 04:53:31.700101 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3253/6741] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:31 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1692 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:32.725050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6b8d039c-dedc-4962-8c43-f47cfceac434 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:32.725764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6b8d039c-dedc-4962-8c43-f47cfceac434 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:32.733916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=42 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:53:32.735848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b8d039c-dedc-4962-8c43-f47cfceac434 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:32.736408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b8d039c-dedc-4962-8c43-f47cfceac434 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:32.737052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b8d039c-dedc-4962-8c43-f47cfceac434 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:32.737761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b8d039c-dedc-4962-8c43-f47cfceac434 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:32.738241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b8d039c-dedc-4962-8c43-f47cfceac434 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:32.738670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6b8d039c-dedc-4962-8c43-f47cfceac434 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:32.903037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6b8d039c-dedc-4962-8c43-f47cfceac434 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:32.915001 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6b8d039c-dedc-4962-8c43-f47cfceac434 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1692 microversion: 2.1 time: 0.194453 Oct 11 04:53:32.915953 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3489/6742] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:32 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1692 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:33.938414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c6efa280-7826-445b-abeb-3881e8848db4 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:53:33.938940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c6efa280-7826-445b-abeb-3881e8848db4 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:33.941560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:53:33.946494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6efa280-7826-445b-abeb-3881e8848db4 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:33.947161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6efa280-7826-445b-abeb-3881e8848db4 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:33.947614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6efa280-7826-445b-abeb-3881e8848db4 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:33.948311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6efa280-7826-445b-abeb-3881e8848db4 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:33.948760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6efa280-7826-445b-abeb-3881e8848db4 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:33.949208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6efa280-7826-445b-abeb-3881e8848db4 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:34.089138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c6efa280-7826-445b-abeb-3881e8848db4 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:53:34.097960 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c6efa280-7826-445b-abeb-3881e8848db4 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1684 microversion: 2.1 time: 0.163585 Oct 11 04:53:34.098647 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3254/6743] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:53:33 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1684 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:53:54.281388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9ec6d163-3ca7-499a-a0a6-4210ea227aad tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:53:54.283663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9ec6d163-3ca7-499a-a0a6-4210ea227aad tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:53:54.286598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:53:54.291748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ec6d163-3ca7-499a-a0a6-4210ea227aad tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:54.308734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ec6d163-3ca7-499a-a0a6-4210ea227aad tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:54.308734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ec6d163-3ca7-499a-a0a6-4210ea227aad tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:54.308734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ec6d163-3ca7-499a-a0a6-4210ea227aad tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:53:54.308734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ec6d163-3ca7-499a-a0a6-4210ea227aad tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:53:54.308734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9ec6d163-3ca7-499a-a0a6-4210ea227aad tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:53:54.495606 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9ec6d163-3ca7-499a-a0a6-4210ea227aad tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4/action" status: 200 len: 24571 microversion: 2.1 time: 0.217996 Oct 11 04:53:54.496267 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3490/6744] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:53:54 2022] POST /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4/action => generated 24571 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:54:01.031367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1d6b7d2a-11b4-48c2-89b5-40a57cb20772 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:01.032267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1d6b7d2a-11b4-48c2-89b5-40a57cb20772 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:01.034676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=76 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:01.040315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d6b7d2a-11b4-48c2-89b5-40a57cb20772 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:01.040801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d6b7d2a-11b4-48c2-89b5-40a57cb20772 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:01.043267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d6b7d2a-11b4-48c2-89b5-40a57cb20772 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:01.043267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d6b7d2a-11b4-48c2-89b5-40a57cb20772 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:01.043267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d6b7d2a-11b4-48c2-89b5-40a57cb20772 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:01.043267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d6b7d2a-11b4-48c2-89b5-40a57cb20772 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:01.204736 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1d6b7d2a-11b4-48c2-89b5-40a57cb20772 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1835 microversion: 2.1 time: 0.178352 Oct 11 04:54:01.205412 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3255/6745] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:01 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1835 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:02.275957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-db723411-b923-4061-9db2-080611238add tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:02.277074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-db723411-b923-4061-9db2-080611238add tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:02.285140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db723411-b923-4061-9db2-080611238add tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:02.285584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-63d75b16-b96e-4ebb-af83-24a4d185ae24 req-d16bc0ab-2d4a-42d0-9b22-4d2451736897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4da9a3ae-5412-4d1d-9d69-3c018e14d9e4", "tag": "b1187e42-2711-461e-9375-1ecae8093b67"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:54:02.286443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db723411-b923-4061-9db2-080611238add tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:02.287062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db723411-b923-4061-9db2-080611238add tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:02.288215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db723411-b923-4061-9db2-080611238add tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:02.288851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db723411-b923-4061-9db2-080611238add tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:02.289433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-db723411-b923-4061-9db2-080611238add tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:02.301579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-63d75b16-b96e-4ebb-af83-24a4d185ae24 req-d16bc0ab-2d4a-42d0-9b22-4d2451736897 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:02.302569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-63d75b16-b96e-4ebb-af83-24a4d185ae24 req-d16bc0ab-2d4a-42d0-9b22-4d2451736897 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:02.303109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-63d75b16-b96e-4ebb-af83-24a4d185ae24 req-d16bc0ab-2d4a-42d0-9b22-4d2451736897 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:02.320930 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-63d75b16-b96e-4ebb-af83-24a4d185ae24 req-d16bc0ab-2d4a-42d0-9b22-4d2451736897 service nova] Creating event network-changed:b1187e42-2711-461e-9375-1ecae8093b67 for instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 on n-h2-860892-1 Oct 11 04:54:02.321637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-db723411-b923-4061-9db2-080611238add tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:54:02.328613 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-63d75b16-b96e-4ebb-af83-24a4d185ae24 req-d16bc0ab-2d4a-42d0-9b22-4d2451736897 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048023 Oct 11 04:54:02.333071 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3256/6746] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:54:02.672681 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-db723411-b923-4061-9db2-080611238add tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 204 len: 0 microversion: 2.1 time: 0.400272 Oct 11 04:54:02.682515 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3491/6747] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:54:02 2022] DELETE /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:54:02.684190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b741bfcc-a778-4415-9b20-e0ceed6da573 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:02.685843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b741bfcc-a778-4415-9b20-e0ceed6da573 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:02.704525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b741bfcc-a778-4415-9b20-e0ceed6da573 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:02.705348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b741bfcc-a778-4415-9b20-e0ceed6da573 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:02.706106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b741bfcc-a778-4415-9b20-e0ceed6da573 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:02.707088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b741bfcc-a778-4415-9b20-e0ceed6da573 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:02.709092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b741bfcc-a778-4415-9b20-e0ceed6da573 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:02.709754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b741bfcc-a778-4415-9b20-e0ceed6da573 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:02.906025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b741bfcc-a778-4415-9b20-e0ceed6da573 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:02.915157 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b741bfcc-a778-4415-9b20-e0ceed6da573 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1690 microversion: 2.1 time: 0.235624 Oct 11 04:54:02.925541 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3257/6748] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:02 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1690 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:03.943011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b7318eb7-b245-4de3-807e-8c1f37ad6817 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:03.943719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b7318eb7-b245-4de3-807e-8c1f37ad6817 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:03.962161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7318eb7-b245-4de3-807e-8c1f37ad6817 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:03.962161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7318eb7-b245-4de3-807e-8c1f37ad6817 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:03.962161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7318eb7-b245-4de3-807e-8c1f37ad6817 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:03.962161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7318eb7-b245-4de3-807e-8c1f37ad6817 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:03.962161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7318eb7-b245-4de3-807e-8c1f37ad6817 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:03.962741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7318eb7-b245-4de3-807e-8c1f37ad6817 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:04.122597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b7318eb7-b245-4de3-807e-8c1f37ad6817 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:04.132671 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b7318eb7-b245-4de3-807e-8c1f37ad6817 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1690 microversion: 2.1 time: 0.197992 Oct 11 04:54:04.133269 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3492/6749] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:03 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1690 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:04.646708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ca307c8d-68b5-4235-ac09-54a0813dfafc req-e85f72b2-0ad0-44b6-9915-2a9486dfe424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4da9a3ae-5412-4d1d-9d69-3c018e14d9e4", "name": "network-vif-deleted", "tag": "b1187e42-2711-461e-9375-1ecae8093b67"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:54:04.656908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ca307c8d-68b5-4235-ac09-54a0813dfafc req-e85f72b2-0ad0-44b6-9915-2a9486dfe424 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:04.662673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ca307c8d-68b5-4235-ac09-54a0813dfafc req-e85f72b2-0ad0-44b6-9915-2a9486dfe424 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:04.662673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ca307c8d-68b5-4235-ac09-54a0813dfafc req-e85f72b2-0ad0-44b6-9915-2a9486dfe424 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:04.668894 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ca307c8d-68b5-4235-ac09-54a0813dfafc req-e85f72b2-0ad0-44b6-9915-2a9486dfe424 service nova] Creating event network-vif-deleted:b1187e42-2711-461e-9375-1ecae8093b67 for instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 on n-h2-860892-1 Oct 11 04:54:04.674335 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ca307c8d-68b5-4235-ac09-54a0813dfafc req-e85f72b2-0ad0-44b6-9915-2a9486dfe424 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031178 Oct 11 04:54:04.674938 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3258/6750] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:54:05.158902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:05.159516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:05.168518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:05.169246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:05.169894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:05.170799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:05.171406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:05.172019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:05.459181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:05.459659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:05.460093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:05.460537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lazy-loading 'fault' on Instance uuid 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:54:05.506117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:05.514716 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-673fd629-e777-4d99-90df-4ab456235f68 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 200 len: 1357 microversion: 2.1 time: 0.362646 Oct 11 04:54:05.516476 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3493/6751] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:05 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 1357 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:06.541785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:06.542702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:06.549116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:06.549595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:06.550031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:06.550816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:06.551270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:06.551693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:06.567304 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] HTTP exception thrown: Instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 could not be found. Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Request method failure captured: Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 HTTP/1.1 Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPZOmLgKK4_rGEqcfRvPG5-B5jE_W_hW1umV2HHwPr_-PqoXoTuO9xWNfdwCvuqkk__W92sbX-UegCPlkKHZuWEcPWyxSAwVWciQca_oOy5hP9AgxPmgCoSu03wcwoIUyN1G_-hkFHXD5HmBCbCjYiW7gnXKdJKE6dp4Z_oLc05Ol4A Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: e30500ead1404e5188c6d90e5b302742 Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e30500ead1404e5188c6d90e5b302742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e30500ead1404e5188c6d90e5b302742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e30500ead1404e5188c6d90e5b302742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e30500ead1404e5188c6d90e5b302742"}]}] Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: e30500ead1404e5188c6d90e5b302742 Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestNetworkAdvancedServerOps-1013665673-project Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a95598cd3fe04a0abff7aac9f0c49bff Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1013665673-project Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 could not be found. Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '4da9a3ae-5412-4d1d-9d69-3c018e14d9e4'} Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 could not be found. Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 could not be found. Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:54:06.571027 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:54:06.575796 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:54:06.575796 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:54:06.575796 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:54:06.575796 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:54:06.575796 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:54:06.575796 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:54:06.575796 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 could not be found. Oct 11 04:54:06.575796 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:54:06.575796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Returning 404 to user: Instance 4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:54:06.575796 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c241d7bd-5c6c-4404-8b2e-92d61afd72e1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4" status: 404 len: 111 microversion: 2.1 time: 0.033977 Oct 11 04:54:06.575796 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3259/6752] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:06 2022] GET /compute/v2.1/servers/4da9a3ae-5412-4d1d-9d69-3c018e14d9e4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:54:11.155487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-771c9e49-3e96-467f-90e2-140439817940 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '.version_select at 0x7fda18b0a0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:11.262273 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-771c9e49-3e96-467f-90e2-140439817940 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1350225556" status: 202 len: 0 microversion: 2.1 time: 0.111133 Oct 11 04:54:11.276193 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3494/6753] 10.222.0.26 () {58 vars in 1284 bytes} [Tue Oct 11 04:54:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1350225556 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:54:11.294181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-254758cd-8292-463b-a6da-1fdc119133b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'create', calling method: .version_select at 0x7fda18642700>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-383267252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBArDBLW8pwfjCDYcQNiy8iVoocVw2QJaw/D/V7zB6zXxUZfQfDKNJrW8xFSrSm3H/g/DHaCT+fF6fvXIYYq/4Zur1+PxD8JkXtyWJlSHWl5D+1AqgayAuePoFap8wfXYwA=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:54:11.311658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-254758cd-8292-463b-a6da-1fdc119133b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for project e30500ead1404e5188c6d90e5b302742. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:54:11.319003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-254758cd-8292-463b-a6da-1fdc119133b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for user a95598cd3fe04a0abff7aac9f0c49bff and project e30500ead1404e5188c6d90e5b302742. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:54:11.439674 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-254758cd-8292-463b-a6da-1fdc119133b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.149843 Oct 11 04:54:11.440406 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3260/6754] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:54:11 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:54:21.396147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1749419448", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "a4dc20b1-aa3c-4865-8b31-dda63a219743"}], "key_name": "tempest-TestNetworkAdvancedServerOps-383267252", "security_groups": [{"name": "tempest-secgroup-smoke-2010801119"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:54:21.415928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:21.416889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:21.620279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] validate_networks() for [('a4dc20b1-aa3c-4865-8b31-dda63a219743', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:54:22.287587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:54:22.288123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:54:22.288721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:54:22.289228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:54:22.289926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:54:22.308101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:22.309490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:22.310528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:22.312418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:22.313281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:22.314655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:22.391618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for project e30500ead1404e5188c6d90e5b302742. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:54:22.400215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for user a95598cd3fe04a0abff7aac9f0c49bff and project e30500ead1404e5188c6d90e5b302742. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:54:22.417215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:54:22.419863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:54:22.584572 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-81330b92-f688-4f8a-bc77-177dc7a10dca tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.189261 Oct 11 04:54:22.592267 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3495/6755] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:54:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1205 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:54:22.597275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff574605-288b-47c3-aa36-b15893627588 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:22.598721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff574605-288b-47c3-aa36-b15893627588 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:22.609210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=18 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:22.610983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:22.611825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=22,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:22.692453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff574605-288b-47c3-aa36-b15893627588 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:22.707642 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff574605-288b-47c3-aa36-b15893627588 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1266 microversion: 2.1 time: 0.114188 Oct 11 04:54:22.710260 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3261/6756] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:22 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1266 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:23.732886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de42da22-f807-4c47-8a65-2f590407efab tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:23.734229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-de42da22-f807-4c47-8a65-2f590407efab tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:23.743924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de42da22-f807-4c47-8a65-2f590407efab tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:23.744707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de42da22-f807-4c47-8a65-2f590407efab tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:23.745563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de42da22-f807-4c47-8a65-2f590407efab tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:23.746645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de42da22-f807-4c47-8a65-2f590407efab tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:23.747319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de42da22-f807-4c47-8a65-2f590407efab tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:23.747998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de42da22-f807-4c47-8a65-2f590407efab tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:23.843661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-de42da22-f807-4c47-8a65-2f590407efab tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:23.866030 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-de42da22-f807-4c47-8a65-2f590407efab tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1270 microversion: 2.1 time: 0.137561 Oct 11 04:54:23.867445 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3496/6757] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:23 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1270 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:24.891493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b5fc3c4d-0e3f-4ede-8d9c-0979e638b379 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:24.893677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b5fc3c4d-0e3f-4ede-8d9c-0979e638b379 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:24.906240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5fc3c4d-0e3f-4ede-8d9c-0979e638b379 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:24.906240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5fc3c4d-0e3f-4ede-8d9c-0979e638b379 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:24.906240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5fc3c4d-0e3f-4ede-8d9c-0979e638b379 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:24.906240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5fc3c4d-0e3f-4ede-8d9c-0979e638b379 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:24.906240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5fc3c4d-0e3f-4ede-8d9c-0979e638b379 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:24.906240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5fc3c4d-0e3f-4ede-8d9c-0979e638b379 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:24.987366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b5fc3c4d-0e3f-4ede-8d9c-0979e638b379 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:24.996257 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b5fc3c4d-0e3f-4ede-8d9c-0979e638b379 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1318 microversion: 2.1 time: 0.109985 Oct 11 04:54:25.010222 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3262/6758] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:24 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1318 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:26.020610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-74d51270-b266-4c21-b5b2-da5241587494 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:26.021233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-74d51270-b266-4c21-b5b2-da5241587494 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:26.032461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74d51270-b266-4c21-b5b2-da5241587494 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:26.033636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74d51270-b266-4c21-b5b2-da5241587494 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:26.034088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74d51270-b266-4c21-b5b2-da5241587494 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:26.035103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74d51270-b266-4c21-b5b2-da5241587494 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:26.035564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74d51270-b266-4c21-b5b2-da5241587494 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:26.036528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74d51270-b266-4c21-b5b2-da5241587494 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:26.109016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-74d51270-b266-4c21-b5b2-da5241587494 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:26.117052 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-74d51270-b266-4c21-b5b2-da5241587494 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1324 microversion: 2.1 time: 0.100382 Oct 11 04:54:26.127395 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3497/6759] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:26 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1324 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:27.142627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a31251ef-585f-486b-b02c-899683471227 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:27.143934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a31251ef-585f-486b-b02c-899683471227 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:27.155138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a31251ef-585f-486b-b02c-899683471227 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:27.155669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a31251ef-585f-486b-b02c-899683471227 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:27.159619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a31251ef-585f-486b-b02c-899683471227 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:27.160376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a31251ef-585f-486b-b02c-899683471227 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:27.171563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a31251ef-585f-486b-b02c-899683471227 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:27.172309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a31251ef-585f-486b-b02c-899683471227 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:27.332959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a31251ef-585f-486b-b02c-899683471227 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:27.342237 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a31251ef-585f-486b-b02c-899683471227 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1392 microversion: 2.1 time: 0.203763 Oct 11 04:54:27.342237 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3263/6760] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:27 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1392 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:27.373139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-483fae2d-97e4-46d2-9e5e-faaa3f88115a req-4d3505a3-dbdc-460b-a7fa-f8575ab63fa4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2369767a-41e2-407d-97f6-5cb376e2d11e", "tag": "afec165a-ca76-4663-ab00-f26d63c60664"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:54:27.378938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-483fae2d-97e4-46d2-9e5e-faaa3f88115a req-4d3505a3-dbdc-460b-a7fa-f8575ab63fa4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:27.379616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-483fae2d-97e4-46d2-9e5e-faaa3f88115a req-4d3505a3-dbdc-460b-a7fa-f8575ab63fa4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:27.380235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-483fae2d-97e4-46d2-9e5e-faaa3f88115a req-4d3505a3-dbdc-460b-a7fa-f8575ab63fa4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:27.392166 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-483fae2d-97e4-46d2-9e5e-faaa3f88115a req-4d3505a3-dbdc-460b-a7fa-f8575ab63fa4 service nova] Creating event network-changed:afec165a-ca76-4663-ab00-f26d63c60664 for instance 2369767a-41e2-407d-97f6-5cb376e2d11e on n-h1-860892-1 Oct 11 04:54:27.397560 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-483fae2d-97e4-46d2-9e5e-faaa3f88115a req-4d3505a3-dbdc-460b-a7fa-f8575ab63fa4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033653 Oct 11 04:54:27.398282 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3498/6761] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:54:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:54:28.365033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f5938242-7c20-441e-a521-69b1088c5315 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:28.365663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f5938242-7c20-441e-a521-69b1088c5315 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:28.372717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5938242-7c20-441e-a521-69b1088c5315 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:28.373210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5938242-7c20-441e-a521-69b1088c5315 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:28.374329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5938242-7c20-441e-a521-69b1088c5315 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:28.375041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5938242-7c20-441e-a521-69b1088c5315 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:28.375496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5938242-7c20-441e-a521-69b1088c5315 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:28.376072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5938242-7c20-441e-a521-69b1088c5315 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:28.521431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5938242-7c20-441e-a521-69b1088c5315 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:28.534941 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f5938242-7c20-441e-a521-69b1088c5315 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1392 microversion: 2.1 time: 0.173743 Oct 11 04:54:28.535531 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3264/6762] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:28 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:29.560534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bf78758b-beca-420a-991b-42850076cfd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:29.561465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bf78758b-beca-420a-991b-42850076cfd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:29.567921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78758b-beca-420a-991b-42850076cfd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:29.568432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78758b-beca-420a-991b-42850076cfd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:29.568832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78758b-beca-420a-991b-42850076cfd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:29.569525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78758b-beca-420a-991b-42850076cfd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:29.570018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78758b-beca-420a-991b-42850076cfd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:29.570471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bf78758b-beca-420a-991b-42850076cfd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:29.724402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bf78758b-beca-420a-991b-42850076cfd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:29.732324 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bf78758b-beca-420a-991b-42850076cfd7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1392 microversion: 2.1 time: 0.176890 Oct 11 04:54:29.733169 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3499/6763] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:29 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1392 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:30.755800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-56486ac5-0727-4a62-9ae6-46355294e757 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:30.756486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-56486ac5-0727-4a62-9ae6-46355294e757 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:30.764984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56486ac5-0727-4a62-9ae6-46355294e757 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:30.765799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56486ac5-0727-4a62-9ae6-46355294e757 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:30.766419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56486ac5-0727-4a62-9ae6-46355294e757 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:30.767194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56486ac5-0727-4a62-9ae6-46355294e757 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:30.767723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56486ac5-0727-4a62-9ae6-46355294e757 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:30.768337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56486ac5-0727-4a62-9ae6-46355294e757 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:30.922813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-56486ac5-0727-4a62-9ae6-46355294e757 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:30.930515 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-56486ac5-0727-4a62-9ae6-46355294e757 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1392 microversion: 2.1 time: 0.179025 Oct 11 04:54:30.931097 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3265/6764] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:30 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1392 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:31.953212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d5e7281-1c01-4501-9808-3c7e8a287e61 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:31.953820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d5e7281-1c01-4501-9808-3c7e8a287e61 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:31.961450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5e7281-1c01-4501-9808-3c7e8a287e61 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:31.962085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5e7281-1c01-4501-9808-3c7e8a287e61 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:31.962669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5e7281-1c01-4501-9808-3c7e8a287e61 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:31.963485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5e7281-1c01-4501-9808-3c7e8a287e61 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:31.964048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5e7281-1c01-4501-9808-3c7e8a287e61 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:31.964721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d5e7281-1c01-4501-9808-3c7e8a287e61 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:32.101581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d5e7281-1c01-4501-9808-3c7e8a287e61 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:32.111652 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d5e7281-1c01-4501-9808-3c7e8a287e61 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1392 microversion: 2.1 time: 0.162568 Oct 11 04:54:32.112263 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3500/6765] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:31 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1392 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:33.141016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2c63559f-c239-4859-a869-605eaa3acf42 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:33.141720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2c63559f-c239-4859-a869-605eaa3acf42 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:33.149828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c63559f-c239-4859-a869-605eaa3acf42 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:33.150693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c63559f-c239-4859-a869-605eaa3acf42 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:33.151335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c63559f-c239-4859-a869-605eaa3acf42 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:33.152242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c63559f-c239-4859-a869-605eaa3acf42 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:33.152886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c63559f-c239-4859-a869-605eaa3acf42 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:33.153587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c63559f-c239-4859-a869-605eaa3acf42 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:33.292108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c63559f-c239-4859-a869-605eaa3acf42 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:33.301547 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2c63559f-c239-4859-a869-605eaa3acf42 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1392 microversion: 2.1 time: 0.164956 Oct 11 04:54:33.302763 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3266/6766] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:33 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1392 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:33.743222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:33.744773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:33.884001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4f7f054f-1a3d-4d64-8183-b7b387864e02 req-51507dc0-b5ce-4b7f-914e-c2238d77bd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2369767a-41e2-407d-97f6-5cb376e2d11e", "name": "network-vif-plugged", "status": "completed", "tag": "afec165a-ca76-4663-ab00-f26d63c60664"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:54:33.909275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4f7f054f-1a3d-4d64-8183-b7b387864e02 req-51507dc0-b5ce-4b7f-914e-c2238d77bd88 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:33.912247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4f7f054f-1a3d-4d64-8183-b7b387864e02 req-51507dc0-b5ce-4b7f-914e-c2238d77bd88 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:33.912907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4f7f054f-1a3d-4d64-8183-b7b387864e02 req-51507dc0-b5ce-4b7f-914e-c2238d77bd88 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:33.936794 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4f7f054f-1a3d-4d64-8183-b7b387864e02 req-51507dc0-b5ce-4b7f-914e-c2238d77bd88 service nova] Creating event network-vif-plugged:afec165a-ca76-4663-ab00-f26d63c60664 for instance 2369767a-41e2-407d-97f6-5cb376e2d11e on n-h1-860892-1 Oct 11 04:54:33.943150 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4f7f054f-1a3d-4d64-8183-b7b387864e02 req-51507dc0-b5ce-4b7f-914e-c2238d77bd88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.210159 Oct 11 04:54:33.943787 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3501/6767] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:54:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:54:34.325089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-54af35ea-bfdf-4489-abdb-63733655059f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:34.326607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-54af35ea-bfdf-4489-abdb-63733655059f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:34.333651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54af35ea-bfdf-4489-abdb-63733655059f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:34.334265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54af35ea-bfdf-4489-abdb-63733655059f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:34.338766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54af35ea-bfdf-4489-abdb-63733655059f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:34.338766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54af35ea-bfdf-4489-abdb-63733655059f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:34.338766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54af35ea-bfdf-4489-abdb-63733655059f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:34.338766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54af35ea-bfdf-4489-abdb-63733655059f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:34.472442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-54af35ea-bfdf-4489-abdb-63733655059f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:34.481741 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-54af35ea-bfdf-4489-abdb-63733655059f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1392 microversion: 2.1 time: 0.160662 Oct 11 04:54:34.494615 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3267/6768] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:34 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1392 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:35.510028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2051c431-6989-4b8e-a5ec-4abf7d4980bd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:35.511736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2051c431-6989-4b8e-a5ec-4abf7d4980bd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:35.519897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2051c431-6989-4b8e-a5ec-4abf7d4980bd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:35.520525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2051c431-6989-4b8e-a5ec-4abf7d4980bd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:35.524243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2051c431-6989-4b8e-a5ec-4abf7d4980bd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:35.524243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2051c431-6989-4b8e-a5ec-4abf7d4980bd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:35.524243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2051c431-6989-4b8e-a5ec-4abf7d4980bd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:35.524243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2051c431-6989-4b8e-a5ec-4abf7d4980bd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:35.676992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2051c431-6989-4b8e-a5ec-4abf7d4980bd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:35.685774 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2051c431-6989-4b8e-a5ec-4abf7d4980bd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1392 microversion: 2.1 time: 0.184308 Oct 11 04:54:35.686607 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3502/6769] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:35 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1392 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:36.708413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-22684c6c-2b01-4a47-8d68-9196fd064e28 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:36.708940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-22684c6c-2b01-4a47-8d68-9196fd064e28 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:36.710982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:36.717415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22684c6c-2b01-4a47-8d68-9196fd064e28 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:36.717908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22684c6c-2b01-4a47-8d68-9196fd064e28 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:36.718377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22684c6c-2b01-4a47-8d68-9196fd064e28 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:36.719185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22684c6c-2b01-4a47-8d68-9196fd064e28 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:36.719640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22684c6c-2b01-4a47-8d68-9196fd064e28 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:36.720081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22684c6c-2b01-4a47-8d68-9196fd064e28 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:36.872654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-22684c6c-2b01-4a47-8d68-9196fd064e28 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:36.881413 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-22684c6c-2b01-4a47-8d68-9196fd064e28 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1564 microversion: 2.1 time: 0.177123 Oct 11 04:54:36.882113 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3268/6770] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:36 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1564 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:36.904255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-74cc6bcc-6795-4250-afdf-d2e86fddb9a2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:36.904857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-74cc6bcc-6795-4250-afdf-d2e86fddb9a2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:36.911747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74cc6bcc-6795-4250-afdf-d2e86fddb9a2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:36.912228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74cc6bcc-6795-4250-afdf-d2e86fddb9a2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:36.912659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74cc6bcc-6795-4250-afdf-d2e86fddb9a2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:36.913344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74cc6bcc-6795-4250-afdf-d2e86fddb9a2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:36.913791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74cc6bcc-6795-4250-afdf-d2e86fddb9a2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:36.914230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-74cc6bcc-6795-4250-afdf-d2e86fddb9a2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:37.059636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-74cc6bcc-6795-4250-afdf-d2e86fddb9a2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:37.068379 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-74cc6bcc-6795-4250-afdf-d2e86fddb9a2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1564 microversion: 2.1 time: 0.167975 Oct 11 04:54:37.068991 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3503/6771] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:36 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1564 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:39.635064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9095d0c2-74ff-4b63-9270-9d25cdcb6649 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:39.640328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c0bcf55c-ee48-4e00-9271-eabcf77d0b2c req-fba18e7d-9959-43cd-913d-bef28a3b0d41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2369767a-41e2-407d-97f6-5cb376e2d11e", "tag": "afec165a-ca76-4663-ab00-f26d63c60664"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:54:39.642986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9095d0c2-74ff-4b63-9270-9d25cdcb6649 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:39.662266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9095d0c2-74ff-4b63-9270-9d25cdcb6649 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:39.662266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9095d0c2-74ff-4b63-9270-9d25cdcb6649 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:39.662266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9095d0c2-74ff-4b63-9270-9d25cdcb6649 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:39.662266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9095d0c2-74ff-4b63-9270-9d25cdcb6649 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:39.662266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9095d0c2-74ff-4b63-9270-9d25cdcb6649 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:39.662266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9095d0c2-74ff-4b63-9270-9d25cdcb6649 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:39.667465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c0bcf55c-ee48-4e00-9271-eabcf77d0b2c req-fba18e7d-9959-43cd-913d-bef28a3b0d41 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:39.669129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c0bcf55c-ee48-4e00-9271-eabcf77d0b2c req-fba18e7d-9959-43cd-913d-bef28a3b0d41 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:39.672317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c0bcf55c-ee48-4e00-9271-eabcf77d0b2c req-fba18e7d-9959-43cd-913d-bef28a3b0d41 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:39.700411 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c0bcf55c-ee48-4e00-9271-eabcf77d0b2c req-fba18e7d-9959-43cd-913d-bef28a3b0d41 service nova] Creating event network-changed:afec165a-ca76-4663-ab00-f26d63c60664 for instance 2369767a-41e2-407d-97f6-5cb376e2d11e on n-h1-860892-1 Oct 11 04:54:39.712541 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c0bcf55c-ee48-4e00-9271-eabcf77d0b2c req-fba18e7d-9959-43cd-913d-bef28a3b0d41 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075779 Oct 11 04:54:39.714906 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3504/6772] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:54:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:54:39.995168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9095d0c2-74ff-4b63-9270-9d25cdcb6649 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:40.007570 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9095d0c2-74ff-4b63-9270-9d25cdcb6649 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1564 microversion: 2.1 time: 0.376634 Oct 11 04:54:40.022795 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3269/6773] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:39 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1564 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:51.701453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a4685d7a-e03e-4dd3-9cd7-63d9edcca4bf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:51.702120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a4685d7a-e03e-4dd3-9cd7-63d9edcca4bf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:51.704734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:51.705753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=44 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:51.710528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4685d7a-e03e-4dd3-9cd7-63d9edcca4bf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:51.711003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4685d7a-e03e-4dd3-9cd7-63d9edcca4bf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:51.711434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4685d7a-e03e-4dd3-9cd7-63d9edcca4bf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:51.712117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4685d7a-e03e-4dd3-9cd7-63d9edcca4bf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:51.712565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4685d7a-e03e-4dd3-9cd7-63d9edcca4bf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:51.712988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4685d7a-e03e-4dd3-9cd7-63d9edcca4bf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:51.794947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-a4685d7a-e03e-4dd3-9cd7-63d9edcca4bf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lazy-loading 'services' on Instance uuid 124ded3e-9ebe-439b-b28c-2157a10f2153 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:54:52.017411 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a4685d7a-e03e-4dd3-9cd7-63d9edcca4bf tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "DELETE /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153/os-volume_attachments/e451eb8e-1d41-470e-8290-974f54e82f06" status: 202 len: 0 microversion: 2.1 time: 0.320178 Oct 11 04:54:52.017981 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3505/6774] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 04:54:51 2022] DELETE /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153/os-volume_attachments/e451eb8e-1d41-470e-8290-974f54e82f06 => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:54:57.418245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b458c2d-bd8b-4129-9e45-0409ae71a0e9 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:57.418775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b458c2d-bd8b-4129-9e45-0409ae71a0e9 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:57.421605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=20 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:57.422267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=48 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:54:57.427679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b458c2d-bd8b-4129-9e45-0409ae71a0e9 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:57.428151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b458c2d-bd8b-4129-9e45-0409ae71a0e9 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:57.428590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b458c2d-bd8b-4129-9e45-0409ae71a0e9 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:57.429328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b458c2d-bd8b-4129-9e45-0409ae71a0e9 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:57.429783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b458c2d-bd8b-4129-9e45-0409ae71a0e9 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:57.430225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b458c2d-bd8b-4129-9e45-0409ae71a0e9 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:57.455317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b458c2d-bd8b-4129-9e45-0409ae71a0e9 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:54:57.721730 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b458c2d-bd8b-4129-9e45-0409ae71a0e9 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "DELETE /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 204 len: 0 microversion: 2.1 time: 0.307065 Oct 11 04:54:57.722357 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3270/6775] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:54:57 2022] DELETE /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:54:57.732617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-19ef8cbc-787b-47be-ac6f-c180a5bbad59 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:57.733321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-19ef8cbc-787b-47be-ac6f-c180a5bbad59 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:57.740081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19ef8cbc-787b-47be-ac6f-c180a5bbad59 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:57.740566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19ef8cbc-787b-47be-ac6f-c180a5bbad59 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:57.741004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19ef8cbc-787b-47be-ac6f-c180a5bbad59 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:57.741699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19ef8cbc-787b-47be-ac6f-c180a5bbad59 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:57.742168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19ef8cbc-787b-47be-ac6f-c180a5bbad59 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:57.742620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19ef8cbc-787b-47be-ac6f-c180a5bbad59 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:57.876473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-19ef8cbc-787b-47be-ac6f-c180a5bbad59 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:57.884579 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-19ef8cbc-787b-47be-ac6f-c180a5bbad59 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1469 microversion: 2.1 time: 0.157517 Oct 11 04:54:57.885163 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3506/6776] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:57 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:54:58.909852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b1e3f8c2-1b81-46f4-9c11-20761917f0f0 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:54:58.910585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b1e3f8c2-1b81-46f4-9c11-20761917f0f0 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:54:58.917009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1e3f8c2-1b81-46f4-9c11-20761917f0f0 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:58.917490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1e3f8c2-1b81-46f4-9c11-20761917f0f0 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:58.917930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1e3f8c2-1b81-46f4-9c11-20761917f0f0 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:58.918644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1e3f8c2-1b81-46f4-9c11-20761917f0f0 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:58.919101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1e3f8c2-1b81-46f4-9c11-20761917f0f0 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:58.919529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1e3f8c2-1b81-46f4-9c11-20761917f0f0 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:59.050953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b1e3f8c2-1b81-46f4-9c11-20761917f0f0 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:54:59.058718 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b1e3f8c2-1b81-46f4-9c11-20761917f0f0 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1469 microversion: 2.1 time: 0.153342 Oct 11 04:54:59.059304 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3271/6777] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:54:58 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:54:59.730042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-ee115f42-4b9d-40e7-ac00-d3bd1018fb10 req-e60ca2b7-27fd-4dd3-a9d9-2b27102f2357 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "124ded3e-9ebe-439b-b28c-2157a10f2153", "name": "network-vif-deleted", "tag": "de285a00-d8f5-470e-8f0a-4de03013972e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:54:59.740954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ee115f42-4b9d-40e7-ac00-d3bd1018fb10 req-e60ca2b7-27fd-4dd3-a9d9-2b27102f2357 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:54:59.741613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ee115f42-4b9d-40e7-ac00-d3bd1018fb10 req-e60ca2b7-27fd-4dd3-a9d9-2b27102f2357 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:54:59.741853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ee115f42-4b9d-40e7-ac00-d3bd1018fb10 req-e60ca2b7-27fd-4dd3-a9d9-2b27102f2357 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:54:59.753281 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-ee115f42-4b9d-40e7-ac00-d3bd1018fb10 req-e60ca2b7-27fd-4dd3-a9d9-2b27102f2357 service nova] Creating event network-vif-deleted:de285a00-d8f5-470e-8f0a-4de03013972e for instance 124ded3e-9ebe-439b-b28c-2157a10f2153 on n-h2-860892-1 Oct 11 04:54:59.758119 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-ee115f42-4b9d-40e7-ac00-d3bd1018fb10 req-e60ca2b7-27fd-4dd3-a9d9-2b27102f2357 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031983 Oct 11 04:54:59.758747 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3507/6778] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:54:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:55:00.081493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ac5b90c-e8b3-4b57-9847-de772b0b4aa3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:00.082732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ac5b90c-e8b3-4b57-9847-de772b0b4aa3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:00.093497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac5b90c-e8b3-4b57-9847-de772b0b4aa3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:00.097857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac5b90c-e8b3-4b57-9847-de772b0b4aa3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:00.097857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac5b90c-e8b3-4b57-9847-de772b0b4aa3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:00.097857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac5b90c-e8b3-4b57-9847-de772b0b4aa3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:00.097857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac5b90c-e8b3-4b57-9847-de772b0b4aa3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:00.103862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ac5b90c-e8b3-4b57-9847-de772b0b4aa3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:00.187192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ac5b90c-e8b3-4b57-9847-de772b0b4aa3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e75e6bc4829e482aaf3d6667773b1423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '041b2743be5a4f6e892a85d37c5f9287', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:00.197061 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ac5b90c-e8b3-4b57-9847-de772b0b4aa3 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 200 len: 1299 microversion: 2.1 time: 0.119871 Oct 11 04:55:00.197633 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3272/6779] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:00 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 1299 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:01.221808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:01.222573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] [instance: 124ded3e-9ebe-439b-b28c-2157a10f2153] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:01.228707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:01.236474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:01.236474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:01.236474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:01.236474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:01.236474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:01.245494 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] HTTP exception thrown: Instance 124ded3e-9ebe-439b-b28c-2157a10f2153 could not be found. Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Request method failure captured: Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 HTTP/1.1 Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPadPeMRzS1-GJepT-W5sgAL32s4ZYPD6UsHeAzW4KzdlxrY09rHyC4-zbmvlIp7otMEVXo-QKF2oEQkGgJYA-q6MtvNxzIc5VVGPaCdgPU6hh-dw17DPIsl3xLJgUwUOf4qP-bvYOx8A6GWmX5QZoB7f_hVvOX7qjxOANEHQ5crtqE Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 041b2743be5a4f6e892a85d37c5f9287 Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-VolumesBackupsTest-1020971932 Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/041b2743be5a4f6e892a85d37c5f9287"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_041b2743be5a4f6e892a85d37c5f9287"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/041b2743be5a4f6e892a85d37c5f9287"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/041b2743be5a4f6e892a85d37c5f9287"}]}] Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-VolumesBackupsTest-1020971932 Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 041b2743be5a4f6e892a85d37c5f9287 Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-VolumesBackupsTest-1020971932 Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-VolumesBackupsTest-1020971932-project Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: e75e6bc4829e482aaf3d6667773b1423 Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-VolumesBackupsTest-1020971932-project Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 124ded3e-9ebe-439b-b28c-2157a10f2153 could not be found. Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '124ded3e-9ebe-439b-b28c-2157a10f2153'} Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 124ded3e-9ebe-439b-b28c-2157a10f2153 could not be found. Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 124ded3e-9ebe-439b-b28c-2157a10f2153 could not be found. Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:55:01.247220 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:55:01.252716 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:55:01.252716 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:55:01.252716 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:55:01.252716 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:55:01.252716 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:55:01.252716 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 124ded3e-9ebe-439b-b28c-2157a10f2153 could not be found. Oct 11 04:55:01.252716 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:55:01.252716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] Returning 404 to user: Instance 124ded3e-9ebe-439b-b28c-2157a10f2153 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:55:01.252716 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7b949bfa-63d2-4fe5-9649-eb14380773a8 tempest-VolumesBackupsTest-1020971932 tempest-VolumesBackupsTest-1020971932-project] 10.222.0.26 "GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153" status: 404 len: 111 microversion: 2.1 time: 0.032476 Oct 11 04:55:01.252716 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3508/6780] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:01 2022] GET /compute/v2.1/servers/124ded3e-9ebe-439b-b28c-2157a10f2153 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:55:10.405962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ed3cb8e7-0001-4f2b-82d0-e2e106c7fc8d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:55:10.408427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ed3cb8e7-0001-4f2b-82d0-e2e106c7fc8d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:10.411342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:55:10.412330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:55:10.417064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed3cb8e7-0001-4f2b-82d0-e2e106c7fc8d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:10.417551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed3cb8e7-0001-4f2b-82d0-e2e106c7fc8d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:10.417996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed3cb8e7-0001-4f2b-82d0-e2e106c7fc8d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:10.418762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed3cb8e7-0001-4f2b-82d0-e2e106c7fc8d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:10.419254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed3cb8e7-0001-4f2b-82d0-e2e106c7fc8d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:10.419692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ed3cb8e7-0001-4f2b-82d0-e2e106c7fc8d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:10.471233 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ed3cb8e7-0001-4f2b-82d0-e2e106c7fc8d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e/action" status: 200 len: 24569 microversion: 2.1 time: 0.069606 Oct 11 04:55:10.471887 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3273/6781] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:55:10 2022] POST /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e/action => generated 24569 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:55:40.916001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-42c41835-6735-40d8-96a9-a430d4839662 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:40.916629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-42c41835-6735-40d8-96a9-a430d4839662 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:40.918853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:55:40.919873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:55:40.924617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42c41835-6735-40d8-96a9-a430d4839662 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:40.925052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42c41835-6735-40d8-96a9-a430d4839662 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:40.925879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42c41835-6735-40d8-96a9-a430d4839662 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:40.926806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42c41835-6735-40d8-96a9-a430d4839662 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:40.927474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42c41835-6735-40d8-96a9-a430d4839662 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:40.928073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42c41835-6735-40d8-96a9-a430d4839662 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:41.076955 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-42c41835-6735-40d8-96a9-a430d4839662 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1834 microversion: 2.1 time: 0.165272 Oct 11 04:55:41.077505 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3509/6782] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:40 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1834 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:41.102150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d66b7aea-15ac-411e-bc39-9d44c84982b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:41.102950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d66b7aea-15ac-411e-bc39-9d44c84982b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:41.110948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d66b7aea-15ac-411e-bc39-9d44c84982b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:41.111434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d66b7aea-15ac-411e-bc39-9d44c84982b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:41.111874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d66b7aea-15ac-411e-bc39-9d44c84982b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:41.112571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d66b7aea-15ac-411e-bc39-9d44c84982b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:41.113026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d66b7aea-15ac-411e-bc39-9d44c84982b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:41.113452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d66b7aea-15ac-411e-bc39-9d44c84982b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:41.271602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d66b7aea-15ac-411e-bc39-9d44c84982b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:41.280706 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d66b7aea-15ac-411e-bc39-9d44c84982b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1683 microversion: 2.1 time: 0.183334 Oct 11 04:55:41.283840 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3274/6783] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:41 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:41.385874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6853e772-c69b-4b8d-be62-da232fd31f44 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:55:41.389054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6853e772-c69b-4b8d-be62-da232fd31f44 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:41.395304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6853e772-c69b-4b8d-be62-da232fd31f44 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:41.395774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6853e772-c69b-4b8d-be62-da232fd31f44 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:41.396210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6853e772-c69b-4b8d-be62-da232fd31f44 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:41.396887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6853e772-c69b-4b8d-be62-da232fd31f44 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:41.397375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6853e772-c69b-4b8d-be62-da232fd31f44 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:41.397756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6853e772-c69b-4b8d-be62-da232fd31f44 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:41.453778 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6853e772-c69b-4b8d-be62-da232fd31f44 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e/action" status: 200 len: 32636 microversion: 2.1 time: 0.072157 Oct 11 04:55:41.461482 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3510/6784] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:55:41 2022] POST /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e/action => generated 32636 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:55:41.626439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Action: 'action', calling method: >, body: {"migrate": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:55:41.626943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:41.633418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:41.634159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:41.634827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:41.635528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:41.635984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:41.636409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:41.665361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': 'dc066a2f21494281bedc1e7d84a6601f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '559b05f0ddc74f48a3dc4d8d435a52aa', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:41.665957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] flavor_id is None. Assuming migration. {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4196}} Oct 11 04:55:41.666438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Old instance type m1.heat2, new instance type m1.heat2 {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 04:55:42.140571 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fadde55d-3ea3-41ac-96df-93fe4d2b36b9 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e/action" status: 202 len: 0 microversion: 2.1 time: 0.517892 Oct 11 04:55:42.144344 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3275/6785] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:55:41 2022] POST /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e/action => generated 0 bytes in 520 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:55:42.150765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e1940796-32db-4717-bf28-f4c215d24c90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:42.151464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e1940796-32db-4717-bf28-f4c215d24c90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:42.159656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1940796-32db-4717-bf28-f4c215d24c90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:42.160082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1940796-32db-4717-bf28-f4c215d24c90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:42.160521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1940796-32db-4717-bf28-f4c215d24c90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:42.161891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1940796-32db-4717-bf28-f4c215d24c90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:42.162408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1940796-32db-4717-bf28-f4c215d24c90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:42.163048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e1940796-32db-4717-bf28-f4c215d24c90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:42.326153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e1940796-32db-4717-bf28-f4c215d24c90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:42.334069 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e1940796-32db-4717-bf28-f4c215d24c90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1692 microversion: 2.1 time: 0.188378 Oct 11 04:55:42.334674 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3511/6786] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:42 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1692 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:43.385657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6ea0c0e7-ff6e-48c6-9322-4853fc65ad22 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:43.385657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6ea0c0e7-ff6e-48c6-9322-4853fc65ad22 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:43.385657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ea0c0e7-ff6e-48c6-9322-4853fc65ad22 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:43.385657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ea0c0e7-ff6e-48c6-9322-4853fc65ad22 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:43.385657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ea0c0e7-ff6e-48c6-9322-4853fc65ad22 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:43.385657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ea0c0e7-ff6e-48c6-9322-4853fc65ad22 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:43.385657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ea0c0e7-ff6e-48c6-9322-4853fc65ad22 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:43.385657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ea0c0e7-ff6e-48c6-9322-4853fc65ad22 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:43.536594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6ea0c0e7-ff6e-48c6-9322-4853fc65ad22 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:43.546398 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6ea0c0e7-ff6e-48c6-9322-4853fc65ad22 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1692 microversion: 2.1 time: 0.192538 Oct 11 04:55:43.546970 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3276/6787] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:43 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1692 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:44.568832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a6d83664-10ac-492f-afc4-e107ef9f9baf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:44.569454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a6d83664-10ac-492f-afc4-e107ef9f9baf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:44.577454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d83664-10ac-492f-afc4-e107ef9f9baf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:44.577942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d83664-10ac-492f-afc4-e107ef9f9baf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:44.578487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d83664-10ac-492f-afc4-e107ef9f9baf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:44.580430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d83664-10ac-492f-afc4-e107ef9f9baf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:44.580892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d83664-10ac-492f-afc4-e107ef9f9baf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:44.581325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d83664-10ac-492f-afc4-e107ef9f9baf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:44.764417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a6d83664-10ac-492f-afc4-e107ef9f9baf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:44.772601 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a6d83664-10ac-492f-afc4-e107ef9f9baf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1692 microversion: 2.1 time: 0.207664 Oct 11 04:55:44.773174 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3512/6788] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:44 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1692 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:45.796548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9556d075-66f6-419f-80cb-0d06bd1399cc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:45.797178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9556d075-66f6-419f-80cb-0d06bd1399cc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:45.804002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9556d075-66f6-419f-80cb-0d06bd1399cc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:45.804817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9556d075-66f6-419f-80cb-0d06bd1399cc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:45.805514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9556d075-66f6-419f-80cb-0d06bd1399cc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:45.806314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9556d075-66f6-419f-80cb-0d06bd1399cc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:45.806971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9556d075-66f6-419f-80cb-0d06bd1399cc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:45.807626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9556d075-66f6-419f-80cb-0d06bd1399cc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:45.998284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9556d075-66f6-419f-80cb-0d06bd1399cc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:46.006055 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9556d075-66f6-419f-80cb-0d06bd1399cc tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1692 microversion: 2.1 time: 0.213585 Oct 11 04:55:46.006649 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3277/6789] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:45 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1692 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:47.030064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5f86ae4c-6190-46eb-b70a-1b62f6c9b7af tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:47.030708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5f86ae4c-6190-46eb-b70a-1b62f6c9b7af tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:47.037489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f86ae4c-6190-46eb-b70a-1b62f6c9b7af tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:47.038209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f86ae4c-6190-46eb-b70a-1b62f6c9b7af tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:47.039005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f86ae4c-6190-46eb-b70a-1b62f6c9b7af tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:47.039717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f86ae4c-6190-46eb-b70a-1b62f6c9b7af tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:47.040177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f86ae4c-6190-46eb-b70a-1b62f6c9b7af tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:47.040608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f86ae4c-6190-46eb-b70a-1b62f6c9b7af tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:47.224548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5f86ae4c-6190-46eb-b70a-1b62f6c9b7af tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:47.234077 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5f86ae4c-6190-46eb-b70a-1b62f6c9b7af tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1697 microversion: 2.1 time: 0.207896 Oct 11 04:55:47.245689 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3513/6790] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:47 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1697 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:55:48.259322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c09e5cc7-741d-46c0-9897-79ae47e85812 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:48.260106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c09e5cc7-741d-46c0-9897-79ae47e85812 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:48.267925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c09e5cc7-741d-46c0-9897-79ae47e85812 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:48.268533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c09e5cc7-741d-46c0-9897-79ae47e85812 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:48.269237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c09e5cc7-741d-46c0-9897-79ae47e85812 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:48.270445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c09e5cc7-741d-46c0-9897-79ae47e85812 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:48.271099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c09e5cc7-741d-46c0-9897-79ae47e85812 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:48.271718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c09e5cc7-741d-46c0-9897-79ae47e85812 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:48.416700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c09e5cc7-741d-46c0-9897-79ae47e85812 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:48.425268 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c09e5cc7-741d-46c0-9897-79ae47e85812 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1697 microversion: 2.1 time: 0.170308 Oct 11 04:55:48.425832 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3278/6791] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:48 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1697 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:49.449106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fafe9f76-0a7e-44ab-9082-5817fa31e5e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:49.449721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fafe9f76-0a7e-44ab-9082-5817fa31e5e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:49.456776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafe9f76-0a7e-44ab-9082-5817fa31e5e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:49.457301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafe9f76-0a7e-44ab-9082-5817fa31e5e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:49.457716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafe9f76-0a7e-44ab-9082-5817fa31e5e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:49.458453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafe9f76-0a7e-44ab-9082-5817fa31e5e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:49.458900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafe9f76-0a7e-44ab-9082-5817fa31e5e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:49.459324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fafe9f76-0a7e-44ab-9082-5817fa31e5e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:49.604095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fafe9f76-0a7e-44ab-9082-5817fa31e5e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:49.613234 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fafe9f76-0a7e-44ab-9082-5817fa31e5e5 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1697 microversion: 2.1 time: 0.168206 Oct 11 04:55:49.622280 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3514/6792] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:49 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:50.644381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2150c9d0-cc5a-4b33-ad2f-a4f3efeedd82 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:50.644925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2150c9d0-cc5a-4b33-ad2f-a4f3efeedd82 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:50.653168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2150c9d0-cc5a-4b33-ad2f-a4f3efeedd82 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:50.653923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2150c9d0-cc5a-4b33-ad2f-a4f3efeedd82 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:50.654644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2150c9d0-cc5a-4b33-ad2f-a4f3efeedd82 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:50.655329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2150c9d0-cc5a-4b33-ad2f-a4f3efeedd82 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:50.656149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2150c9d0-cc5a-4b33-ad2f-a4f3efeedd82 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:50.656578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2150c9d0-cc5a-4b33-ad2f-a4f3efeedd82 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:50.803116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2150c9d0-cc5a-4b33-ad2f-a4f3efeedd82 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:50.811563 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2150c9d0-cc5a-4b33-ad2f-a4f3efeedd82 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1697 microversion: 2.1 time: 0.171134 Oct 11 04:55:50.812241 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3279/6793] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:50 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1697 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:51.837134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-534e0af4-e9d7-4186-8f31-f762233c25ee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:51.837887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-534e0af4-e9d7-4186-8f31-f762233c25ee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:51.845487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-534e0af4-e9d7-4186-8f31-f762233c25ee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:51.853236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-534e0af4-e9d7-4186-8f31-f762233c25ee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:51.853894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-534e0af4-e9d7-4186-8f31-f762233c25ee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:51.854681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-534e0af4-e9d7-4186-8f31-f762233c25ee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:51.855187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-534e0af4-e9d7-4186-8f31-f762233c25ee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:51.856148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-534e0af4-e9d7-4186-8f31-f762233c25ee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:52.015007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-534e0af4-e9d7-4186-8f31-f762233c25ee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:52.025093 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-534e0af4-e9d7-4186-8f31-f762233c25ee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1697 microversion: 2.1 time: 0.191722 Oct 11 04:55:52.025969 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3515/6794] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:51 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1697 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:53.048892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3a150eca-e8b6-4672-9b9f-a9a804ca936e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:53.049504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3a150eca-e8b6-4672-9b9f-a9a804ca936e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:53.056645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a150eca-e8b6-4672-9b9f-a9a804ca936e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:53.057089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a150eca-e8b6-4672-9b9f-a9a804ca936e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:53.057528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a150eca-e8b6-4672-9b9f-a9a804ca936e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:53.058426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a150eca-e8b6-4672-9b9f-a9a804ca936e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:53.058698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a150eca-e8b6-4672-9b9f-a9a804ca936e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:53.059334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a150eca-e8b6-4672-9b9f-a9a804ca936e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:53.349560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3a150eca-e8b6-4672-9b9f-a9a804ca936e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:53.350833 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3a150eca-e8b6-4672-9b9f-a9a804ca936e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1697 microversion: 2.1 time: 0.305849 Oct 11 04:55:53.351408 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3280/6795] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:53 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1697 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:54.376150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e687ab30-f070-422e-84c9-ee996b127f1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:54.376708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e687ab30-f070-422e-84c9-ee996b127f1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:54.384516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e687ab30-f070-422e-84c9-ee996b127f1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:54.385001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e687ab30-f070-422e-84c9-ee996b127f1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:54.385473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e687ab30-f070-422e-84c9-ee996b127f1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:54.386701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e687ab30-f070-422e-84c9-ee996b127f1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:54.387206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e687ab30-f070-422e-84c9-ee996b127f1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:54.387667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e687ab30-f070-422e-84c9-ee996b127f1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:54.525996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e687ab30-f070-422e-84c9-ee996b127f1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:54.535374 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e687ab30-f070-422e-84c9-ee996b127f1f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1697 microversion: 2.1 time: 0.163297 Oct 11 04:55:54.535955 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3516/6796] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:54 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1697 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:55.559113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7e0d6c92-0f5f-40f3-bf43-2c12582c4583 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:55.559725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7e0d6c92-0f5f-40f3-bf43-2c12582c4583 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:55.566929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e0d6c92-0f5f-40f3-bf43-2c12582c4583 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:55.567457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e0d6c92-0f5f-40f3-bf43-2c12582c4583 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:55.567871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e0d6c92-0f5f-40f3-bf43-2c12582c4583 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:55.568590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e0d6c92-0f5f-40f3-bf43-2c12582c4583 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:55.569042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e0d6c92-0f5f-40f3-bf43-2c12582c4583 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:55.569469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e0d6c92-0f5f-40f3-bf43-2c12582c4583 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:55.728948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7e0d6c92-0f5f-40f3-bf43-2c12582c4583 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:55.738244 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7e0d6c92-0f5f-40f3-bf43-2c12582c4583 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1697 microversion: 2.1 time: 0.183037 Oct 11 04:55:55.738940 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3281/6797] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:55 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1697 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:56.763028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b947802-5ebc-4173-bee4-600ab587c154 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:56.764284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b947802-5ebc-4173-bee4-600ab587c154 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:56.771674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b947802-5ebc-4173-bee4-600ab587c154 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:56.772441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b947802-5ebc-4173-bee4-600ab587c154 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:56.773156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b947802-5ebc-4173-bee4-600ab587c154 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:56.774149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b947802-5ebc-4173-bee4-600ab587c154 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:56.774817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b947802-5ebc-4173-bee4-600ab587c154 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:56.775447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b947802-5ebc-4173-bee4-600ab587c154 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:56.917436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9b947802-5ebc-4173-bee4-600ab587c154 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:56.926453 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b947802-5ebc-4173-bee4-600ab587c154 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1697 microversion: 2.1 time: 0.168012 Oct 11 04:55:56.927082 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3517/6798] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:56 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1697 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:57.951726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d332d24b-a14c-4157-bc96-b1bcafef174a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:57.953794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d332d24b-a14c-4157-bc96-b1bcafef174a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:57.962232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d332d24b-a14c-4157-bc96-b1bcafef174a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:57.963013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d332d24b-a14c-4157-bc96-b1bcafef174a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:57.963449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d332d24b-a14c-4157-bc96-b1bcafef174a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:57.964154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d332d24b-a14c-4157-bc96-b1bcafef174a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:57.965219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d332d24b-a14c-4157-bc96-b1bcafef174a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:57.966212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d332d24b-a14c-4157-bc96-b1bcafef174a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:58.107389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d332d24b-a14c-4157-bc96-b1bcafef174a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:58.115265 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d332d24b-a14c-4157-bc96-b1bcafef174a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1697 microversion: 2.1 time: 0.167703 Oct 11 04:55:58.115833 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3282/6799] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:57 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1697 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:55:58.709733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e767ed24-03b4-4d80-bd68-886571eedf42 req-f138fff8-ac67-4ddb-833c-5f4c0425cc35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2369767a-41e2-407d-97f6-5cb376e2d11e", "name": "network-vif-unplugged", "status": "completed", "tag": "afec165a-ca76-4663-ab00-f26d63c60664"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:55:58.722388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e767ed24-03b4-4d80-bd68-886571eedf42 req-f138fff8-ac67-4ddb-833c-5f4c0425cc35 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:58.723034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e767ed24-03b4-4d80-bd68-886571eedf42 req-f138fff8-ac67-4ddb-833c-5f4c0425cc35 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:58.723485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e767ed24-03b4-4d80-bd68-886571eedf42 req-f138fff8-ac67-4ddb-833c-5f4c0425cc35 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:58.736615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e767ed24-03b4-4d80-bd68-886571eedf42 req-f138fff8-ac67-4ddb-833c-5f4c0425cc35 service nova] Creating event network-vif-unplugged:afec165a-ca76-4663-ab00-f26d63c60664 for instance 2369767a-41e2-407d-97f6-5cb376e2d11e on n-h2-860892-1 Oct 11 04:55:58.742044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-e767ed24-03b4-4d80-bd68-886571eedf42 req-f138fff8-ac67-4ddb-833c-5f4c0425cc35 service nova] Instance 2369767a-41e2-407d-97f6-5cb376e2d11e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:55:58.753000 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e767ed24-03b4-4d80-bd68-886571eedf42 req-f138fff8-ac67-4ddb-833c-5f4c0425cc35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048840 Oct 11 04:55:58.753607 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3518/6800] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:55:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:55:59.140118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16c6a35c-16ec-4c36-ba58-9db0f05eda37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:55:59.140782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-16c6a35c-16ec-4c36-ba58-9db0f05eda37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:55:59.147634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16c6a35c-16ec-4c36-ba58-9db0f05eda37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:59.148308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16c6a35c-16ec-4c36-ba58-9db0f05eda37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:59.148769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16c6a35c-16ec-4c36-ba58-9db0f05eda37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:59.149502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16c6a35c-16ec-4c36-ba58-9db0f05eda37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:55:59.151002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16c6a35c-16ec-4c36-ba58-9db0f05eda37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:55:59.151484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16c6a35c-16ec-4c36-ba58-9db0f05eda37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:55:59.311265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-16c6a35c-16ec-4c36-ba58-9db0f05eda37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:55:59.319269 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-16c6a35c-16ec-4c36-ba58-9db0f05eda37 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1696 microversion: 2.1 time: 0.183535 Oct 11 04:55:59.321263 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3283/6801] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:55:59 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1696 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:00.344117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c614800d-8baf-43d8-88bc-9c7d12c21ed0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:00.345518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c614800d-8baf-43d8-88bc-9c7d12c21ed0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:00.355503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c614800d-8baf-43d8-88bc-9c7d12c21ed0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:00.356620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c614800d-8baf-43d8-88bc-9c7d12c21ed0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:00.357149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c614800d-8baf-43d8-88bc-9c7d12c21ed0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:00.357946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c614800d-8baf-43d8-88bc-9c7d12c21ed0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:00.358665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c614800d-8baf-43d8-88bc-9c7d12c21ed0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:00.370299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c614800d-8baf-43d8-88bc-9c7d12c21ed0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:00.597607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c614800d-8baf-43d8-88bc-9c7d12c21ed0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:00.605583 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c614800d-8baf-43d8-88bc-9c7d12c21ed0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1696 microversion: 2.1 time: 0.265782 Oct 11 04:56:00.606433 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3519/6802] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:00 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1696 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:00.768390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-4d1568a8-2f73-42ad-9f6b-0d5985668c18 req-ecdb94d6-6a15-4642-ab4a-70c3c59c5c98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2369767a-41e2-407d-97f6-5cb376e2d11e", "tag": "afec165a-ca76-4663-ab00-f26d63c60664"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:00.780184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4d1568a8-2f73-42ad-9f6b-0d5985668c18 req-ecdb94d6-6a15-4642-ab4a-70c3c59c5c98 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:00.780658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4d1568a8-2f73-42ad-9f6b-0d5985668c18 req-ecdb94d6-6a15-4642-ab4a-70c3c59c5c98 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:00.781082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4d1568a8-2f73-42ad-9f6b-0d5985668c18 req-ecdb94d6-6a15-4642-ab4a-70c3c59c5c98 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:00.793544 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-4d1568a8-2f73-42ad-9f6b-0d5985668c18 req-ecdb94d6-6a15-4642-ab4a-70c3c59c5c98 service nova] Creating event network-changed:afec165a-ca76-4663-ab00-f26d63c60664 for instance 2369767a-41e2-407d-97f6-5cb376e2d11e on n-h2-860892-1 Oct 11 04:56:00.798862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-4d1568a8-2f73-42ad-9f6b-0d5985668c18 req-ecdb94d6-6a15-4642-ab4a-70c3c59c5c98 service nova] Instance 2369767a-41e2-407d-97f6-5cb376e2d11e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:56:00.810922 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-4d1568a8-2f73-42ad-9f6b-0d5985668c18 req-ecdb94d6-6a15-4642-ab4a-70c3c59c5c98 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046245 Oct 11 04:56:00.811520 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3284/6803] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:56:01.629496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fa200d23-a510-4f47-b065-b1e155725da1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:01.630451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fa200d23-a510-4f47-b065-b1e155725da1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:01.639091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa200d23-a510-4f47-b065-b1e155725da1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:01.639691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa200d23-a510-4f47-b065-b1e155725da1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:01.640262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa200d23-a510-4f47-b065-b1e155725da1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:01.641078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa200d23-a510-4f47-b065-b1e155725da1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:01.641627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa200d23-a510-4f47-b065-b1e155725da1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:01.642147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa200d23-a510-4f47-b065-b1e155725da1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:01.795242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fa200d23-a510-4f47-b065-b1e155725da1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:01.803656 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fa200d23-a510-4f47-b065-b1e155725da1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1694 microversion: 2.1 time: 0.178217 Oct 11 04:56:01.804242 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3520/6804] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:01 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1694 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:02.834279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-18feb417-7826-462c-b3c4-4823896c0e78 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:02.835018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-18feb417-7826-462c-b3c4-4823896c0e78 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:02.847952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18feb417-7826-462c-b3c4-4823896c0e78 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:02.848438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18feb417-7826-462c-b3c4-4823896c0e78 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:02.848900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18feb417-7826-462c-b3c4-4823896c0e78 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:02.849601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18feb417-7826-462c-b3c4-4823896c0e78 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:02.850059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18feb417-7826-462c-b3c4-4823896c0e78 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:02.850512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-18feb417-7826-462c-b3c4-4823896c0e78 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:02.985934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18feb417-7826-462c-b3c4-4823896c0e78 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:02.994328 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-18feb417-7826-462c-b3c4-4823896c0e78 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1691 microversion: 2.1 time: 0.170154 Oct 11 04:56:02.994899 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3285/6805] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:02 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1691 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:03.017630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8849a9d5-01f6-4a47-9452-792e678b1613 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:03.018788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8849a9d5-01f6-4a47-9452-792e678b1613 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:03.038081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8849a9d5-01f6-4a47-9452-792e678b1613 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:03.040998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8849a9d5-01f6-4a47-9452-792e678b1613 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:03.041655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8849a9d5-01f6-4a47-9452-792e678b1613 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:03.042436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8849a9d5-01f6-4a47-9452-792e678b1613 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:03.044960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8849a9d5-01f6-4a47-9452-792e678b1613 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:03.045406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8849a9d5-01f6-4a47-9452-792e678b1613 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:03.417787 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8849a9d5-01f6-4a47-9452-792e678b1613 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e/action" status: 202 len: 0 microversion: 2.1 time: 0.403563 Oct 11 04:56:03.422055 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3521/6806] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:56:03 2022] POST /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:56:03.427457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aac9ab1b-22d1-44c6-ade6-bb6a1df19216 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:03.432414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aac9ab1b-22d1-44c6-ade6-bb6a1df19216 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:03.435281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aac9ab1b-22d1-44c6-ade6-bb6a1df19216 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:03.435934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aac9ab1b-22d1-44c6-ade6-bb6a1df19216 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:03.436495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aac9ab1b-22d1-44c6-ade6-bb6a1df19216 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:03.437376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aac9ab1b-22d1-44c6-ade6-bb6a1df19216 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:03.437883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aac9ab1b-22d1-44c6-ade6-bb6a1df19216 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:03.438341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aac9ab1b-22d1-44c6-ade6-bb6a1df19216 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:03.673830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aac9ab1b-22d1-44c6-ade6-bb6a1df19216 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:03.682735 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aac9ab1b-22d1-44c6-ade6-bb6a1df19216 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1690 microversion: 2.1 time: 0.259683 Oct 11 04:56:03.686766 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3286/6807] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:03 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1690 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:56:04.710676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-25755ed5-0911-43fd-81d5-286b36701f35 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:04.712395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-25755ed5-0911-43fd-81d5-286b36701f35 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:04.721373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25755ed5-0911-43fd-81d5-286b36701f35 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:04.722093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25755ed5-0911-43fd-81d5-286b36701f35 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:04.722567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25755ed5-0911-43fd-81d5-286b36701f35 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:04.723343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25755ed5-0911-43fd-81d5-286b36701f35 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:04.723984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25755ed5-0911-43fd-81d5-286b36701f35 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:04.724418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-25755ed5-0911-43fd-81d5-286b36701f35 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:04.864976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-25755ed5-0911-43fd-81d5-286b36701f35 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:04.875547 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-25755ed5-0911-43fd-81d5-286b36701f35 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1690 microversion: 2.1 time: 0.169316 Oct 11 04:56:04.876139 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3522/6808] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:04 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:05.256428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2c57096c-351c-4a58-93e8-2243ccdc6d2d req-7b07d972-d319-4477-9633-a0ab07389a2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2369767a-41e2-407d-97f6-5cb376e2d11e", "name": "network-vif-plugged", "status": "completed", "tag": "afec165a-ca76-4663-ab00-f26d63c60664"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:05.268495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2c57096c-351c-4a58-93e8-2243ccdc6d2d req-7b07d972-d319-4477-9633-a0ab07389a2b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:05.268980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2c57096c-351c-4a58-93e8-2243ccdc6d2d req-7b07d972-d319-4477-9633-a0ab07389a2b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:05.269417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2c57096c-351c-4a58-93e8-2243ccdc6d2d req-7b07d972-d319-4477-9633-a0ab07389a2b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:05.282111 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2c57096c-351c-4a58-93e8-2243ccdc6d2d req-7b07d972-d319-4477-9633-a0ab07389a2b service nova] Creating event network-vif-plugged:afec165a-ca76-4663-ab00-f26d63c60664 for instance 2369767a-41e2-407d-97f6-5cb376e2d11e on n-h2-860892-1 Oct 11 04:56:05.287431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-2c57096c-351c-4a58-93e8-2243ccdc6d2d req-7b07d972-d319-4477-9633-a0ab07389a2b service nova] Instance 2369767a-41e2-407d-97f6-5cb376e2d11e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:56:05.298905 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2c57096c-351c-4a58-93e8-2243ccdc6d2d req-7b07d972-d319-4477-9633-a0ab07389a2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046290 Oct 11 04:56:05.299445 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3287/6809] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:56:05.612628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-21608927-da7d-4dd6-bcc3-acc713df94f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Action: 'create', calling method: .version_select at 0x7fda192a5670>, body: {"keypair": {"name": "tempest-TestVolumeBackupRestore-1020703580", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB8arvaZbxRwqKpQQbzDrEQBDSzxCJhaWC0Cj4IjcKBo+gjTzubuZkHUvIp5/VVuCf4v5qPNgyLr2lMemtS2+y40UTlNd5I3spsqaLuqhOutK7swn4Ya7EOJCiUz20jr1Q=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:05.628773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-21608927-da7d-4dd6-bcc3-acc713df94f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Getting quotas for project 0b57b7bff5c2402d824f43124fd29af8. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:56:05.635042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-21608927-da7d-4dd6-bcc3-acc713df94f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Getting quotas for user c930196998114174bc75f2b4d48f41ae and project 0b57b7bff5c2402d824f43124fd29af8. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:56:05.801629 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-21608927-da7d-4dd6-bcc3-acc713df94f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.192821 Oct 11 04:56:05.802449 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3523/6810] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:56:05 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:56:05.902362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a4c02019-ffe1-494e-a744-6977fc68e9e9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:05.903261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a4c02019-ffe1-494e-a744-6977fc68e9e9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:05.911017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c02019-ffe1-494e-a744-6977fc68e9e9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:05.912119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c02019-ffe1-494e-a744-6977fc68e9e9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:05.912719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c02019-ffe1-494e-a744-6977fc68e9e9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:05.913544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c02019-ffe1-494e-a744-6977fc68e9e9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:05.914125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c02019-ffe1-494e-a744-6977fc68e9e9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:05.914590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a4c02019-ffe1-494e-a744-6977fc68e9e9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:06.174182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a4c02019-ffe1-494e-a744-6977fc68e9e9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:06.177760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:56:06.182463 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a4c02019-ffe1-494e-a744-6977fc68e9e9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1690 microversion: 2.1 time: 0.286371 Oct 11 04:56:06.183053 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3288/6811] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:05 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1690 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:07.180644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a756f182-1d6f-4d78-b4ae-acdb10671282 req-51844d4e-8f08-4af8-8d16-335340d92a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2369767a-41e2-407d-97f6-5cb376e2d11e", "name": "network-vif-unplugged", "status": "completed", "tag": "afec165a-ca76-4663-ab00-f26d63c60664"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:07.192637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a756f182-1d6f-4d78-b4ae-acdb10671282 req-51844d4e-8f08-4af8-8d16-335340d92a3d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:07.193048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a756f182-1d6f-4d78-b4ae-acdb10671282 req-51844d4e-8f08-4af8-8d16-335340d92a3d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:07.193478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a756f182-1d6f-4d78-b4ae-acdb10671282 req-51844d4e-8f08-4af8-8d16-335340d92a3d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:07.205339 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a756f182-1d6f-4d78-b4ae-acdb10671282 req-51844d4e-8f08-4af8-8d16-335340d92a3d service nova] Creating event network-vif-unplugged:afec165a-ca76-4663-ab00-f26d63c60664 for instance 2369767a-41e2-407d-97f6-5cb376e2d11e on n-h1-860892-1 Oct 11 04:56:07.206169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09bd0f2f-49f7-4b38-b214-73abaf63d233 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:07.206913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09bd0f2f-49f7-4b38-b214-73abaf63d233 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:07.211300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-a756f182-1d6f-4d78-b4ae-acdb10671282 req-51844d4e-8f08-4af8-8d16-335340d92a3d service nova] Instance 2369767a-41e2-407d-97f6-5cb376e2d11e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:56:07.223441 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a756f182-1d6f-4d78-b4ae-acdb10671282 req-51844d4e-8f08-4af8-8d16-335340d92a3d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.047466 Oct 11 04:56:07.224045 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3524/6812] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:56:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:56:07.226538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd0f2f-49f7-4b38-b214-73abaf63d233 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:07.227103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd0f2f-49f7-4b38-b214-73abaf63d233 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:07.227465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd0f2f-49f7-4b38-b214-73abaf63d233 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:07.228179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd0f2f-49f7-4b38-b214-73abaf63d233 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:07.228666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd0f2f-49f7-4b38-b214-73abaf63d233 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:07.229094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09bd0f2f-49f7-4b38-b214-73abaf63d233 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:07.502755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09bd0f2f-49f7-4b38-b214-73abaf63d233 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:07.526460 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09bd0f2f-49f7-4b38-b214-73abaf63d233 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1690 microversion: 2.1 time: 0.324298 Oct 11 04:56:07.527055 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3289/6813] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:07 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1690 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:56:08.550954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e10cf00-31e8-41c6-9e88-f97c629c4bb6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:08.561137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e10cf00-31e8-41c6-9e88-f97c629c4bb6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:08.561137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e10cf00-31e8-41c6-9e88-f97c629c4bb6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:08.561137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e10cf00-31e8-41c6-9e88-f97c629c4bb6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:08.561137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e10cf00-31e8-41c6-9e88-f97c629c4bb6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:08.561563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e10cf00-31e8-41c6-9e88-f97c629c4bb6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:08.561814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e10cf00-31e8-41c6-9e88-f97c629c4bb6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:08.562263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e10cf00-31e8-41c6-9e88-f97c629c4bb6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:08.712397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e10cf00-31e8-41c6-9e88-f97c629c4bb6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:08.715322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:56:08.721905 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e10cf00-31e8-41c6-9e88-f97c629c4bb6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1690 microversion: 2.1 time: 0.175351 Oct 11 04:56:08.722552 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3525/6814] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:08 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:08.852291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBackupRestore-server-540746714", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "47e8c603-db0f-403b-b15f-d4534dd69455", "source_type": "volume", "destination_type": "volume", "boot_index": 0}], "key_name": "tempest-TestVolumeBackupRestore-1020703580", "security_groups": [{"name": "tempest-secgroup-smoke-118342424"}], "networks": [{"uuid": "c91cd006-1a05-421f-ad92-d0a146d34acc"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:08.975162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] validate_networks() for [('c91cd006-1a05-421f-ad92-d0a146d34acc', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:56:09.245497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6899287a-550d-4830-bde0-6d2e9d6c5a0b req-cb454c1f-884b-4dfa-8456-e3133538a336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2369767a-41e2-407d-97f6-5cb376e2d11e", "tag": "afec165a-ca76-4663-ab00-f26d63c60664"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:09.256326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6899287a-550d-4830-bde0-6d2e9d6c5a0b req-cb454c1f-884b-4dfa-8456-e3133538a336 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:09.256893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6899287a-550d-4830-bde0-6d2e9d6c5a0b req-cb454c1f-884b-4dfa-8456-e3133538a336 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:09.257423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6899287a-550d-4830-bde0-6d2e9d6c5a0b req-cb454c1f-884b-4dfa-8456-e3133538a336 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:09.270867 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6899287a-550d-4830-bde0-6d2e9d6c5a0b req-cb454c1f-884b-4dfa-8456-e3133538a336 service nova] Creating event network-changed:afec165a-ca76-4663-ab00-f26d63c60664 for instance 2369767a-41e2-407d-97f6-5cb376e2d11e on n-h1-860892-1 Oct 11 04:56:09.276439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-6899287a-550d-4830-bde0-6d2e9d6c5a0b req-cb454c1f-884b-4dfa-8456-e3133538a336 service nova] Instance 2369767a-41e2-407d-97f6-5cb376e2d11e is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 04:56:09.288219 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6899287a-550d-4830-bde0-6d2e9d6c5a0b req-cb454c1f-884b-4dfa-8456-e3133538a336 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046900 Oct 11 04:56:09.289228 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3526/6815] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:56:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:56:09.745482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a51e1d9-f2ad-45c9-a467-3da94098e377 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:09.747458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1a51e1d9-f2ad-45c9-a467-3da94098e377 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:09.755078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a51e1d9-f2ad-45c9-a467-3da94098e377 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:09.755560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a51e1d9-f2ad-45c9-a467-3da94098e377 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:09.756205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a51e1d9-f2ad-45c9-a467-3da94098e377 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:09.756902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a51e1d9-f2ad-45c9-a467-3da94098e377 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:09.757522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a51e1d9-f2ad-45c9-a467-3da94098e377 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:09.757946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a51e1d9-f2ad-45c9-a467-3da94098e377 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:09.779951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:56:09.781283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:56:09.781910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:56:09.782693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:56:09.783219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:56:09.795088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:09.795882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:09.796565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:09.797854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:09.798708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:09.799604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:09.826110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Getting quotas for project 0b57b7bff5c2402d824f43124fd29af8. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:56:09.832313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Getting quotas for user c930196998114174bc75f2b4d48f41ae and project 0b57b7bff5c2402d824f43124fd29af8. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:56:09.901932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:56:09.904815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='47e8c603-db0f-403b-b15f-d4534dd69455',volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:56:09.947576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1a51e1d9-f2ad-45c9-a467-3da94098e377 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:09.958650 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1a51e1d9-f2ad-45c9-a467-3da94098e377 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1690 microversion: 2.1 time: 0.217322 Oct 11 04:56:09.959364 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3527/6816] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:09 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1690 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:56:10.368179 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-16bf1c48-3a1e-47f7-b67b-ccac155c9b80 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.519051 Oct 11 04:56:10.369090 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3290/6817] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:56:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:56:10.381097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a355dd69-4f0d-4a43-b522-3cdac7222828 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:10.381716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a355dd69-4f0d-4a43-b522-3cdac7222828 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:10.437799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a355dd69-4f0d-4a43-b522-3cdac7222828 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:10.445275 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a355dd69-4f0d-4a43-b522-3cdac7222828 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1098 microversion: 2.1 time: 0.068023 Oct 11 04:56:10.460531 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3528/6818] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:10 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1098 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:10.983952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4681a2ea-1b66-41a7-a545-e8a1bc8dd4c3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:10.984602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4681a2ea-1b66-41a7-a545-e8a1bc8dd4c3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:10.990938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4681a2ea-1b66-41a7-a545-e8a1bc8dd4c3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:10.991551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4681a2ea-1b66-41a7-a545-e8a1bc8dd4c3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:10.991984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4681a2ea-1b66-41a7-a545-e8a1bc8dd4c3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:10.992679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4681a2ea-1b66-41a7-a545-e8a1bc8dd4c3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:10.993132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4681a2ea-1b66-41a7-a545-e8a1bc8dd4c3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:10.993557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4681a2ea-1b66-41a7-a545-e8a1bc8dd4c3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:11.190029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4681a2ea-1b66-41a7-a545-e8a1bc8dd4c3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:11.201386 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4681a2ea-1b66-41a7-a545-e8a1bc8dd4c3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1690 microversion: 2.1 time: 0.222538 Oct 11 04:56:11.202238 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3291/6819] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:10 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1690 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:11.468854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-55fbed54-7694-4464-870e-2f88c8eb5b49 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:11.469473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-55fbed54-7694-4464-870e-2f88c8eb5b49 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:11.472507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:56:11.545906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-55fbed54-7694-4464-870e-2f88c8eb5b49 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:11.556288 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-55fbed54-7694-4464-870e-2f88c8eb5b49 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1098 microversion: 2.1 time: 0.091973 Oct 11 04:56:11.556902 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3529/6820] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:11 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1098 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:12.225353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-342617e9-f663-45d9-bce1-960ee1c638b8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:12.226139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-342617e9-f663-45d9-bce1-960ee1c638b8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:12.229968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:56:12.234452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-342617e9-f663-45d9-bce1-960ee1c638b8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:12.235005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-342617e9-f663-45d9-bce1-960ee1c638b8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:12.235515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-342617e9-f663-45d9-bce1-960ee1c638b8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:12.236276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-342617e9-f663-45d9-bce1-960ee1c638b8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:12.236800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-342617e9-f663-45d9-bce1-960ee1c638b8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:12.237303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-342617e9-f663-45d9-bce1-960ee1c638b8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:12.379707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-342617e9-f663-45d9-bce1-960ee1c638b8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:12.388910 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-342617e9-f663-45d9-bce1-960ee1c638b8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1683 microversion: 2.1 time: 0.167716 Oct 11 04:56:12.389550 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3292/6821] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:12 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:12.580049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7620218f-accb-4fbb-9cfe-1246f442af3b tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:12.581359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7620218f-accb-4fbb-9cfe-1246f442af3b tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:12.592355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7620218f-accb-4fbb-9cfe-1246f442af3b tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:12.593192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7620218f-accb-4fbb-9cfe-1246f442af3b tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:12.593835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7620218f-accb-4fbb-9cfe-1246f442af3b tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:12.595045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7620218f-accb-4fbb-9cfe-1246f442af3b tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:12.595695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7620218f-accb-4fbb-9cfe-1246f442af3b tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:12.596311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7620218f-accb-4fbb-9cfe-1246f442af3b tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:12.669190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7620218f-accb-4fbb-9cfe-1246f442af3b tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:12.677647 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7620218f-accb-4fbb-9cfe-1246f442af3b tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1196 microversion: 2.1 time: 0.101576 Oct 11 04:56:12.678272 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3530/6822] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:12 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1196 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:13.705995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2395db89-655d-489e-b3a2-213af310177f tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:13.707238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2395db89-655d-489e-b3a2-213af310177f tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:13.715466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2395db89-655d-489e-b3a2-213af310177f tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:13.716197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2395db89-655d-489e-b3a2-213af310177f tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:13.716640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2395db89-655d-489e-b3a2-213af310177f tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:13.717541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2395db89-655d-489e-b3a2-213af310177f tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:13.717990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2395db89-655d-489e-b3a2-213af310177f tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:13.718462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2395db89-655d-489e-b3a2-213af310177f tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:13.782022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2395db89-655d-489e-b3a2-213af310177f tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:13.789988 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2395db89-655d-489e-b3a2-213af310177f tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1214 microversion: 2.1 time: 0.088615 Oct 11 04:56:13.802239 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3293/6823] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:13 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:56:14.304741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-89bb7160-5def-4ab4-9603-17d0a1caa9b7 req-17d0c03f-3327-4547-8630-5ccdceb3da56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2369767a-41e2-407d-97f6-5cb376e2d11e", "name": "network-vif-plugged", "status": "completed", "tag": "afec165a-ca76-4663-ab00-f26d63c60664"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:14.321931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-89bb7160-5def-4ab4-9603-17d0a1caa9b7 req-17d0c03f-3327-4547-8630-5ccdceb3da56 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:14.326906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-89bb7160-5def-4ab4-9603-17d0a1caa9b7 req-17d0c03f-3327-4547-8630-5ccdceb3da56 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:14.327359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-89bb7160-5def-4ab4-9603-17d0a1caa9b7 req-17d0c03f-3327-4547-8630-5ccdceb3da56 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:14.350617 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-89bb7160-5def-4ab4-9603-17d0a1caa9b7 req-17d0c03f-3327-4547-8630-5ccdceb3da56 service nova] Creating event network-vif-plugged:afec165a-ca76-4663-ab00-f26d63c60664 for instance 2369767a-41e2-407d-97f6-5cb376e2d11e on n-h1-860892-1 Oct 11 04:56:14.360306 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-89bb7160-5def-4ab4-9603-17d0a1caa9b7 req-17d0c03f-3327-4547-8630-5ccdceb3da56 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059425 Oct 11 04:56:14.360929 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3531/6824] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:56:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:56:14.822015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-66f35d40-922e-4461-a1cb-196a6b3d1d54 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:14.822693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-66f35d40-922e-4461-a1cb-196a6b3d1d54 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:14.835749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66f35d40-922e-4461-a1cb-196a6b3d1d54 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:14.837327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66f35d40-922e-4461-a1cb-196a6b3d1d54 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:14.838076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66f35d40-922e-4461-a1cb-196a6b3d1d54 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:14.839527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66f35d40-922e-4461-a1cb-196a6b3d1d54 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:14.842072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66f35d40-922e-4461-a1cb-196a6b3d1d54 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:14.842735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-66f35d40-922e-4461-a1cb-196a6b3d1d54 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:15.021353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-66f35d40-922e-4461-a1cb-196a6b3d1d54 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:15.029814 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-66f35d40-922e-4461-a1cb-196a6b3d1d54 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1281 microversion: 2.1 time: 0.218254 Oct 11 04:56:15.030534 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3294/6825] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:14 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1281 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:15.079322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-84dff047-32b5-4813-8909-ce6f25e959bb req-95e450e7-f37e-4735-919a-1bf49c320a26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278", "tag": "ab7b8b9c-a65f-4854-9919-ff1c8812c324"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:15.094276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-84dff047-32b5-4813-8909-ce6f25e959bb req-95e450e7-f37e-4735-919a-1bf49c320a26 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:15.097046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-84dff047-32b5-4813-8909-ce6f25e959bb req-95e450e7-f37e-4735-919a-1bf49c320a26 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:15.097836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-84dff047-32b5-4813-8909-ce6f25e959bb req-95e450e7-f37e-4735-919a-1bf49c320a26 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:15.117539 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-84dff047-32b5-4813-8909-ce6f25e959bb req-95e450e7-f37e-4735-919a-1bf49c320a26 service nova] Creating event network-changed:ab7b8b9c-a65f-4854-9919-ff1c8812c324 for instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 on n-h2-860892-1 Oct 11 04:56:15.128572 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-84dff047-32b5-4813-8909-ce6f25e959bb req-95e450e7-f37e-4735-919a-1bf49c320a26 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051711 Oct 11 04:56:15.128572 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3532/6826] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:56:16.053907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-db0c1def-5c10-4be7-a4b3-303d5a41cd43 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:16.054712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-db0c1def-5c10-4be7-a4b3-303d5a41cd43 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:16.062821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0c1def-5c10-4be7-a4b3-303d5a41cd43 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:16.063431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0c1def-5c10-4be7-a4b3-303d5a41cd43 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:16.063974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0c1def-5c10-4be7-a4b3-303d5a41cd43 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:16.064805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0c1def-5c10-4be7-a4b3-303d5a41cd43 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:16.065356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0c1def-5c10-4be7-a4b3-303d5a41cd43 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:16.065884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-db0c1def-5c10-4be7-a4b3-303d5a41cd43 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:16.222589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-db0c1def-5c10-4be7-a4b3-303d5a41cd43 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:16.231880 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-db0c1def-5c10-4be7-a4b3-303d5a41cd43 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1281 microversion: 2.1 time: 0.182887 Oct 11 04:56:16.232585 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3295/6827] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:16 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1281 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:17.257135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2deadfef-8ab8-41d9-a86b-2d358a990f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:17.258025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2deadfef-8ab8-41d9-a86b-2d358a990f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:17.266555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2deadfef-8ab8-41d9-a86b-2d358a990f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:17.267274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2deadfef-8ab8-41d9-a86b-2d358a990f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:17.267814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2deadfef-8ab8-41d9-a86b-2d358a990f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:17.268682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2deadfef-8ab8-41d9-a86b-2d358a990f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:17.269385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2deadfef-8ab8-41d9-a86b-2d358a990f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:17.269917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2deadfef-8ab8-41d9-a86b-2d358a990f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:17.422430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2deadfef-8ab8-41d9-a86b-2d358a990f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:17.431060 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2deadfef-8ab8-41d9-a86b-2d358a990f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1281 microversion: 2.1 time: 0.179253 Oct 11 04:56:17.431953 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3533/6828] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:17 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1281 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:18.454917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dabe47e9-22ed-41d3-888d-efdc96856c4e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:18.456162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dabe47e9-22ed-41d3-888d-efdc96856c4e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:18.463021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dabe47e9-22ed-41d3-888d-efdc96856c4e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:18.465636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dabe47e9-22ed-41d3-888d-efdc96856c4e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:18.465636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dabe47e9-22ed-41d3-888d-efdc96856c4e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:18.465636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dabe47e9-22ed-41d3-888d-efdc96856c4e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:18.465920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dabe47e9-22ed-41d3-888d-efdc96856c4e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:18.466152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dabe47e9-22ed-41d3-888d-efdc96856c4e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:18.615355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dabe47e9-22ed-41d3-888d-efdc96856c4e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:18.623623 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dabe47e9-22ed-41d3-888d-efdc96856c4e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1281 microversion: 2.1 time: 0.172667 Oct 11 04:56:18.624443 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3296/6829] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:18 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1281 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:56:19.646669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d86ee942-94ca-42ff-8c06-47915e010869 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:19.647314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d86ee942-94ca-42ff-8c06-47915e010869 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:19.654745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d86ee942-94ca-42ff-8c06-47915e010869 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:19.655227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d86ee942-94ca-42ff-8c06-47915e010869 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:19.655667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d86ee942-94ca-42ff-8c06-47915e010869 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:19.656353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d86ee942-94ca-42ff-8c06-47915e010869 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:19.656809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d86ee942-94ca-42ff-8c06-47915e010869 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:19.657232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d86ee942-94ca-42ff-8c06-47915e010869 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:19.792135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d86ee942-94ca-42ff-8c06-47915e010869 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:19.800779 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d86ee942-94ca-42ff-8c06-47915e010869 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1269 microversion: 2.1 time: 0.158022 Oct 11 04:56:19.801365 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3534/6830] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:19 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1269 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:20.825042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-39cc3088-0c54-4ccf-b6a0-25d16d0e49aa tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:20.825661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-39cc3088-0c54-4ccf-b6a0-25d16d0e49aa tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:20.828375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:56:20.829031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:56:20.833799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39cc3088-0c54-4ccf-b6a0-25d16d0e49aa tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:20.834314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39cc3088-0c54-4ccf-b6a0-25d16d0e49aa tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:20.834756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39cc3088-0c54-4ccf-b6a0-25d16d0e49aa tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:20.835448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39cc3088-0c54-4ccf-b6a0-25d16d0e49aa tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:20.835902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39cc3088-0c54-4ccf-b6a0-25d16d0e49aa tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:20.836329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39cc3088-0c54-4ccf-b6a0-25d16d0e49aa tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:20.971950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-39cc3088-0c54-4ccf-b6a0-25d16d0e49aa tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:20.980084 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-39cc3088-0c54-4ccf-b6a0-25d16d0e49aa tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1269 microversion: 2.1 time: 0.158940 Oct 11 04:56:20.981221 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3297/6831] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:20 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:22.003568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fa9788a6-75a0-45b7-aa8e-b1c5e2efe3ff tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:22.004298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fa9788a6-75a0-45b7-aa8e-b1c5e2efe3ff tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:22.007261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:56:22.013116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9788a6-75a0-45b7-aa8e-b1c5e2efe3ff tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:22.019026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9788a6-75a0-45b7-aa8e-b1c5e2efe3ff tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:22.019026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9788a6-75a0-45b7-aa8e-b1c5e2efe3ff tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:22.019026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9788a6-75a0-45b7-aa8e-b1c5e2efe3ff tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:22.019026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9788a6-75a0-45b7-aa8e-b1c5e2efe3ff tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:22.019026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa9788a6-75a0-45b7-aa8e-b1c5e2efe3ff tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:22.150680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fa9788a6-75a0-45b7-aa8e-b1c5e2efe3ff tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:22.159064 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fa9788a6-75a0-45b7-aa8e-b1c5e2efe3ff tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1269 microversion: 2.1 time: 0.159539 Oct 11 04:56:22.159635 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3535/6832] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:21 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1269 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:23.180830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c00e8a17-6340-4f3c-9e9b-5d652fa0095e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:23.181445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c00e8a17-6340-4f3c-9e9b-5d652fa0095e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:23.188364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e8a17-6340-4f3c-9e9b-5d652fa0095e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:23.188841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e8a17-6340-4f3c-9e9b-5d652fa0095e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:23.189283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e8a17-6340-4f3c-9e9b-5d652fa0095e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:23.189969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e8a17-6340-4f3c-9e9b-5d652fa0095e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:23.190511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e8a17-6340-4f3c-9e9b-5d652fa0095e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:23.190989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e8a17-6340-4f3c-9e9b-5d652fa0095e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:23.324941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c00e8a17-6340-4f3c-9e9b-5d652fa0095e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:23.332757 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c00e8a17-6340-4f3c-9e9b-5d652fa0095e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1269 microversion: 2.1 time: 0.155861 Oct 11 04:56:23.333324 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3298/6833] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:23 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:24.357188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-17377438-0e02-4c59-9b63-813fc505e6e3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:24.357813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-17377438-0e02-4c59-9b63-813fc505e6e3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:24.365129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17377438-0e02-4c59-9b63-813fc505e6e3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:24.365617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17377438-0e02-4c59-9b63-813fc505e6e3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:24.366062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17377438-0e02-4c59-9b63-813fc505e6e3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:24.366795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17377438-0e02-4c59-9b63-813fc505e6e3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:24.367253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17377438-0e02-4c59-9b63-813fc505e6e3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:24.367682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17377438-0e02-4c59-9b63-813fc505e6e3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:24.500526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-17377438-0e02-4c59-9b63-813fc505e6e3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:24.508354 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-17377438-0e02-4c59-9b63-813fc505e6e3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1269 microversion: 2.1 time: 0.155873 Oct 11 04:56:24.509431 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3536/6834] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:24 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:25.533737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-de2e5945-733a-4f7c-a111-6fea8fb4cb33 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:25.535014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-de2e5945-733a-4f7c-a111-6fea8fb4cb33 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:25.541793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de2e5945-733a-4f7c-a111-6fea8fb4cb33 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:25.542687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de2e5945-733a-4f7c-a111-6fea8fb4cb33 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:25.543365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de2e5945-733a-4f7c-a111-6fea8fb4cb33 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:25.544336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de2e5945-733a-4f7c-a111-6fea8fb4cb33 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:25.545008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de2e5945-733a-4f7c-a111-6fea8fb4cb33 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:25.545651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de2e5945-733a-4f7c-a111-6fea8fb4cb33 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:25.683442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-de2e5945-733a-4f7c-a111-6fea8fb4cb33 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:25.691812 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-de2e5945-733a-4f7c-a111-6fea8fb4cb33 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1269 microversion: 2.1 time: 0.162959 Oct 11 04:56:25.692422 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3299/6835] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:25 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1269 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:26.715883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-de21d885-61e1-4892-8e3c-e8b5f0fe6f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:26.716599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-de21d885-61e1-4892-8e3c-e8b5f0fe6f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:26.723137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de21d885-61e1-4892-8e3c-e8b5f0fe6f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:26.723621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de21d885-61e1-4892-8e3c-e8b5f0fe6f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:26.724051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de21d885-61e1-4892-8e3c-e8b5f0fe6f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:26.724750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de21d885-61e1-4892-8e3c-e8b5f0fe6f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:26.725383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de21d885-61e1-4892-8e3c-e8b5f0fe6f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:26.725820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-de21d885-61e1-4892-8e3c-e8b5f0fe6f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:26.858867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-de21d885-61e1-4892-8e3c-e8b5f0fe6f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:26.866875 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-de21d885-61e1-4892-8e3c-e8b5f0fe6f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1269 microversion: 2.1 time: 0.155783 Oct 11 04:56:26.871931 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3537/6836] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:26 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1269 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:27.890081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f30704d9-40a8-48ea-84c2-b0f8eea191f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:27.890732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f30704d9-40a8-48ea-84c2-b0f8eea191f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:27.897849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30704d9-40a8-48ea-84c2-b0f8eea191f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:27.898373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30704d9-40a8-48ea-84c2-b0f8eea191f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:27.898814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30704d9-40a8-48ea-84c2-b0f8eea191f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:27.899519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30704d9-40a8-48ea-84c2-b0f8eea191f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:27.899973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30704d9-40a8-48ea-84c2-b0f8eea191f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:27.900401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f30704d9-40a8-48ea-84c2-b0f8eea191f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:28.039239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f30704d9-40a8-48ea-84c2-b0f8eea191f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:28.047115 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f30704d9-40a8-48ea-84c2-b0f8eea191f6 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1269 microversion: 2.1 time: 0.161000 Oct 11 04:56:28.047693 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3300/6837] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:27 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1269 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:29.070391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-214d1197-b0b8-4719-bbdf-384cd852ac41 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:29.071065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-214d1197-b0b8-4719-bbdf-384cd852ac41 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:29.078466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-214d1197-b0b8-4719-bbdf-384cd852ac41 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:29.078950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-214d1197-b0b8-4719-bbdf-384cd852ac41 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:29.079389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-214d1197-b0b8-4719-bbdf-384cd852ac41 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:29.080081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-214d1197-b0b8-4719-bbdf-384cd852ac41 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:29.080537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-214d1197-b0b8-4719-bbdf-384cd852ac41 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:29.080961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-214d1197-b0b8-4719-bbdf-384cd852ac41 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:29.222263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-214d1197-b0b8-4719-bbdf-384cd852ac41 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:29.231046 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-214d1197-b0b8-4719-bbdf-384cd852ac41 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1269 microversion: 2.1 time: 0.164609 Oct 11 04:56:29.231907 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3538/6838] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:29 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1269 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:29.405474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e2d866ea-3ea3-41fe-a6d1-7fe1ec488bff req-c2e00cc2-6958-4bb9-b4e9-94bfdb5967b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278", "name": "network-vif-plugged", "status": "completed", "tag": "ab7b8b9c-a65f-4854-9919-ff1c8812c324"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:29.415796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e2d866ea-3ea3-41fe-a6d1-7fe1ec488bff req-c2e00cc2-6958-4bb9-b4e9-94bfdb5967b7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:29.416285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e2d866ea-3ea3-41fe-a6d1-7fe1ec488bff req-c2e00cc2-6958-4bb9-b4e9-94bfdb5967b7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:29.416719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e2d866ea-3ea3-41fe-a6d1-7fe1ec488bff req-c2e00cc2-6958-4bb9-b4e9-94bfdb5967b7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:29.427544 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e2d866ea-3ea3-41fe-a6d1-7fe1ec488bff req-c2e00cc2-6958-4bb9-b4e9-94bfdb5967b7 service nova] Creating event network-vif-plugged:ab7b8b9c-a65f-4854-9919-ff1c8812c324 for instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 on n-h2-860892-1 Oct 11 04:56:29.432450 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e2d866ea-3ea3-41fe-a6d1-7fe1ec488bff req-c2e00cc2-6958-4bb9-b4e9-94bfdb5967b7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030850 Oct 11 04:56:29.433023 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3301/6839] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:56:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:56:30.254580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5f9743a3-546b-4456-b037-482ac934a65d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:30.255210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5f9743a3-546b-4456-b037-482ac934a65d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:30.262432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f9743a3-546b-4456-b037-482ac934a65d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:30.262974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f9743a3-546b-4456-b037-482ac934a65d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:30.263414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f9743a3-546b-4456-b037-482ac934a65d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:30.264105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f9743a3-546b-4456-b037-482ac934a65d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:30.264557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f9743a3-546b-4456-b037-482ac934a65d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:30.264984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f9743a3-546b-4456-b037-482ac934a65d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:30.398481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5f9743a3-546b-4456-b037-482ac934a65d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:30.407177 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5f9743a3-546b-4456-b037-482ac934a65d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1269 microversion: 2.1 time: 0.156722 Oct 11 04:56:30.407748 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3539/6840] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:30 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1269 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:31.431942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-af14ac64-a588-4ef9-a135-65cc04c6015c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:31.432687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-af14ac64-a588-4ef9-a135-65cc04c6015c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:31.439000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af14ac64-a588-4ef9-a135-65cc04c6015c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:31.439487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af14ac64-a588-4ef9-a135-65cc04c6015c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:31.439929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af14ac64-a588-4ef9-a135-65cc04c6015c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:31.440627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af14ac64-a588-4ef9-a135-65cc04c6015c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:31.441083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af14ac64-a588-4ef9-a135-65cc04c6015c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:31.441515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-af14ac64-a588-4ef9-a135-65cc04c6015c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:31.574016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-af14ac64-a588-4ef9-a135-65cc04c6015c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:31.581888 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-af14ac64-a588-4ef9-a135-65cc04c6015c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1458 microversion: 2.1 time: 0.155374 Oct 11 04:56:31.582491 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3302/6841] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:31 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1458 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:31.605255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a4373ea3-55c5-4d78-8de9-fc415af828de tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:56:31.605873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a4373ea3-55c5-4d78-8de9-fc415af828de tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:31.613343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4373ea3-55c5-4d78-8de9-fc415af828de tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:31.613830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4373ea3-55c5-4d78-8de9-fc415af828de tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:31.614295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4373ea3-55c5-4d78-8de9-fc415af828de tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:31.614994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4373ea3-55c5-4d78-8de9-fc415af828de tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:31.615449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4373ea3-55c5-4d78-8de9-fc415af828de tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:31.615880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a4373ea3-55c5-4d78-8de9-fc415af828de tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:31.750416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a4373ea3-55c5-4d78-8de9-fc415af828de tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:56:31.758462 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a4373ea3-55c5-4d78-8de9-fc415af828de tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1458 microversion: 2.1 time: 0.156984 Oct 11 04:56:31.759301 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3540/6842] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:56:31 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1458 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:56:33.911865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ab898cd4-5414-40f1-82ad-166bc895d375 req-498cc83a-7896-4ab1-bd9e-37994db43529 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278", "tag": "ab7b8b9c-a65f-4854-9919-ff1c8812c324"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:33.923317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ab898cd4-5414-40f1-82ad-166bc895d375 req-498cc83a-7896-4ab1-bd9e-37994db43529 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:33.924226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ab898cd4-5414-40f1-82ad-166bc895d375 req-498cc83a-7896-4ab1-bd9e-37994db43529 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:33.925728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ab898cd4-5414-40f1-82ad-166bc895d375 req-498cc83a-7896-4ab1-bd9e-37994db43529 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:33.941835 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ab898cd4-5414-40f1-82ad-166bc895d375 req-498cc83a-7896-4ab1-bd9e-37994db43529 service nova] Creating event network-changed:ab7b8b9c-a65f-4854-9919-ff1c8812c324 for instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 on n-h2-860892-1 Oct 11 04:56:33.952176 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ab898cd4-5414-40f1-82ad-166bc895d375 req-498cc83a-7896-4ab1-bd9e-37994db43529 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139269 Oct 11 04:56:33.953493 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3303/6843] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:56:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:56:36.335606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-95cb4946-054f-4591-b0d3-260aeb9b3445 req-a44895a7-b1e2-47e9-9e2f-7cfa4cbe9181 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278", "tag": "ab7b8b9c-a65f-4854-9919-ff1c8812c324"}, {"name": "network-changed", "server_uuid": "204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278", "tag": "ab7b8b9c-a65f-4854-9919-ff1c8812c324"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:36.346878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-95cb4946-054f-4591-b0d3-260aeb9b3445 req-a44895a7-b1e2-47e9-9e2f-7cfa4cbe9181 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:36.347357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-95cb4946-054f-4591-b0d3-260aeb9b3445 req-a44895a7-b1e2-47e9-9e2f-7cfa4cbe9181 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:36.347969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-95cb4946-054f-4591-b0d3-260aeb9b3445 req-a44895a7-b1e2-47e9-9e2f-7cfa4cbe9181 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:36.360037 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-95cb4946-054f-4591-b0d3-260aeb9b3445 req-a44895a7-b1e2-47e9-9e2f-7cfa4cbe9181 service nova] Creating event network-changed:ab7b8b9c-a65f-4854-9919-ff1c8812c324 for instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 on n-h2-860892-1 Oct 11 04:56:36.360543 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-95cb4946-054f-4591-b0d3-260aeb9b3445 req-a44895a7-b1e2-47e9-9e2f-7cfa4cbe9181 service nova] Creating event network-changed:ab7b8b9c-a65f-4854-9919-ff1c8812c324 for instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 on n-h2-860892-1 Oct 11 04:56:36.366420 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-95cb4946-054f-4591-b0d3-260aeb9b3445 req-a44895a7-b1e2-47e9-9e2f-7cfa4cbe9181 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.034589 Oct 11 04:56:36.367521 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3541/6844] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:56:36 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:56:44.636569 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 04:56:44.637113 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 04:56:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e/action (ip 10.222.0.26) !!! Oct 11 04:56:44.638526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=23 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:56:44.639310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=78 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:56:44.697979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5bb32969-5e98-4955-be6a-099b00d6f1f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:56:44.700789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5bb32969-5e98-4955-be6a-099b00d6f1f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:56:44.710350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bb32969-5e98-4955-be6a-099b00d6f1f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:44.710840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bb32969-5e98-4955-be6a-099b00d6f1f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:44.711293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bb32969-5e98-4955-be6a-099b00d6f1f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:44.711995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bb32969-5e98-4955-be6a-099b00d6f1f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:56:44.712455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bb32969-5e98-4955-be6a-099b00d6f1f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:56:44.712889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bb32969-5e98-4955-be6a-099b00d6f1f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:56:44.787749 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5bb32969-5e98-4955-be6a-099b00d6f1f2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e/action" status: 200 len: 63078 microversion: 2.1 time: 0.153087 Oct 11 04:56:44.788419 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3304/6845] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:56:44 2022] POST /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e/action => generated 63078 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:57:07.840296 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 04:57:07.840806 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 04:57:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e (ip 10.222.0.26) !!! Oct 11 04:57:07.842634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=27 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:07.843381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=71 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:07.963704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2691e7a-2475-4a1f-98d8-3fdcb84eeb02 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:07.964405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b2691e7a-2475-4a1f-98d8-3fdcb84eeb02 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:07.972750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2691e7a-2475-4a1f-98d8-3fdcb84eeb02 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:07.973228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2691e7a-2475-4a1f-98d8-3fdcb84eeb02 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:07.973662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2691e7a-2475-4a1f-98d8-3fdcb84eeb02 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:07.974374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2691e7a-2475-4a1f-98d8-3fdcb84eeb02 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:07.974844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2691e7a-2475-4a1f-98d8-3fdcb84eeb02 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:07.975268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2691e7a-2475-4a1f-98d8-3fdcb84eeb02 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:08.112788 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2691e7a-2475-4a1f-98d8-3fdcb84eeb02 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1834 microversion: 2.1 time: 0.275809 Oct 11 04:57:08.113388 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3542/6846] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:07 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1834 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:09.136609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cfa55cb2-55a6-4a99-8091-68e5f1e131eb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:09.137078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cfa55cb2-55a6-4a99-8091-68e5f1e131eb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:09.139637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:09.140561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:09.144207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-105b7307-d0d1-45ef-bcb2-cea83ba497a1 req-12ce704b-5f16-4a7f-9148-7c52c132d7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2369767a-41e2-407d-97f6-5cb376e2d11e", "tag": "afec165a-ca76-4663-ab00-f26d63c60664"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:57:09.147308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa55cb2-55a6-4a99-8091-68e5f1e131eb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:09.148066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa55cb2-55a6-4a99-8091-68e5f1e131eb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:09.148748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa55cb2-55a6-4a99-8091-68e5f1e131eb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:09.149706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa55cb2-55a6-4a99-8091-68e5f1e131eb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:09.150428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa55cb2-55a6-4a99-8091-68e5f1e131eb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:09.151045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfa55cb2-55a6-4a99-8091-68e5f1e131eb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:09.155758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-105b7307-d0d1-45ef-bcb2-cea83ba497a1 req-12ce704b-5f16-4a7f-9148-7c52c132d7d4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:09.157241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-105b7307-d0d1-45ef-bcb2-cea83ba497a1 req-12ce704b-5f16-4a7f-9148-7c52c132d7d4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:09.157941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-105b7307-d0d1-45ef-bcb2-cea83ba497a1 req-12ce704b-5f16-4a7f-9148-7c52c132d7d4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:09.170507 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-105b7307-d0d1-45ef-bcb2-cea83ba497a1 req-12ce704b-5f16-4a7f-9148-7c52c132d7d4 service nova] Creating event network-changed:afec165a-ca76-4663-ab00-f26d63c60664 for instance 2369767a-41e2-407d-97f6-5cb376e2d11e on n-h1-860892-1 Oct 11 04:57:09.176685 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-105b7307-d0d1-45ef-bcb2-cea83ba497a1 req-12ce704b-5f16-4a7f-9148-7c52c132d7d4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036544 Oct 11 04:57:09.178799 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3543/6847] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:57:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:57:09.179870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cfa55cb2-55a6-4a99-8091-68e5f1e131eb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:57:09.627317 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cfa55cb2-55a6-4a99-8091-68e5f1e131eb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 204 len: 0 microversion: 2.1 time: 0.495250 Oct 11 04:57:09.631355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3305/6848] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:57:09 2022] DELETE /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 0 bytes in 497 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:57:09.640235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-241ff670-fb8c-4cac-b931-562a126928ac tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:09.641204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-241ff670-fb8c-4cac-b931-562a126928ac tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:09.648035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241ff670-fb8c-4cac-b931-562a126928ac tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:09.648549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241ff670-fb8c-4cac-b931-562a126928ac tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:09.649177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241ff670-fb8c-4cac-b931-562a126928ac tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:09.660101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241ff670-fb8c-4cac-b931-562a126928ac tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:09.660546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241ff670-fb8c-4cac-b931-562a126928ac tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:09.660999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-241ff670-fb8c-4cac-b931-562a126928ac tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:09.814696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-241ff670-fb8c-4cac-b931-562a126928ac tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:09.823935 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-241ff670-fb8c-4cac-b931-562a126928ac tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1689 microversion: 2.1 time: 0.191195 Oct 11 04:57:09.824577 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3544/6849] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:09 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1689 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:10.848460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-47c8ef2f-d265-4749-9f9b-a03b3ccef401 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:10.849298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-47c8ef2f-d265-4749-9f9b-a03b3ccef401 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:10.861258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c8ef2f-d265-4749-9f9b-a03b3ccef401 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:10.861756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c8ef2f-d265-4749-9f9b-a03b3ccef401 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:10.862298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c8ef2f-d265-4749-9f9b-a03b3ccef401 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:10.863325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c8ef2f-d265-4749-9f9b-a03b3ccef401 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:10.863783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c8ef2f-d265-4749-9f9b-a03b3ccef401 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:10.864404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47c8ef2f-d265-4749-9f9b-a03b3ccef401 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:11.014977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-47c8ef2f-d265-4749-9f9b-a03b3ccef401 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:11.023730 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-47c8ef2f-d265-4749-9f9b-a03b3ccef401 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1570 microversion: 2.1 time: 0.179554 Oct 11 04:57:11.024296 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3306/6850] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:10 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:11.828728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-8d437425-6ddb-4e33-b083-0d1b45000982 req-babf4a88-3235-42ef-b580-f816c931f5be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2369767a-41e2-407d-97f6-5cb376e2d11e", "name": "network-vif-deleted", "tag": "afec165a-ca76-4663-ab00-f26d63c60664"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:57:11.839335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8d437425-6ddb-4e33-b083-0d1b45000982 req-babf4a88-3235-42ef-b580-f816c931f5be service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:11.844378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8d437425-6ddb-4e33-b083-0d1b45000982 req-babf4a88-3235-42ef-b580-f816c931f5be service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:11.844378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8d437425-6ddb-4e33-b083-0d1b45000982 req-babf4a88-3235-42ef-b580-f816c931f5be service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:11.851723 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8d437425-6ddb-4e33-b083-0d1b45000982 req-babf4a88-3235-42ef-b580-f816c931f5be service nova] Creating event network-vif-deleted:afec165a-ca76-4663-ab00-f26d63c60664 for instance 2369767a-41e2-407d-97f6-5cb376e2d11e on n-h1-860892-1 Oct 11 04:57:11.856527 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-8d437425-6ddb-4e33-b083-0d1b45000982 req-babf4a88-3235-42ef-b580-f816c931f5be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031810 Oct 11 04:57:11.857120 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3545/6851] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:57:12.046831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-58c9af50-dc6a-48b3-8396-60e35f1c6520 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:12.048072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-58c9af50-dc6a-48b3-8396-60e35f1c6520 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:12.056135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58c9af50-dc6a-48b3-8396-60e35f1c6520 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:12.076220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58c9af50-dc6a-48b3-8396-60e35f1c6520 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:12.076220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58c9af50-dc6a-48b3-8396-60e35f1c6520 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:12.076220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58c9af50-dc6a-48b3-8396-60e35f1c6520 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:12.076220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58c9af50-dc6a-48b3-8396-60e35f1c6520 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:12.076220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-58c9af50-dc6a-48b3-8396-60e35f1c6520 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:12.124023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-58c9af50-dc6a-48b3-8396-60e35f1c6520 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:12.133266 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-58c9af50-dc6a-48b3-8396-60e35f1c6520 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 200 len: 1351 microversion: 2.1 time: 0.091113 Oct 11 04:57:12.135057 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3307/6852] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:12 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:13.161449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:13.162244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 2369767a-41e2-407d-97f6-5cb376e2d11e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:13.169105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:13.169663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:13.170990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:13.170990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:13.171315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:13.171743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:13.187453 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] HTTP exception thrown: Instance 2369767a-41e2-407d-97f6-5cb376e2d11e could not be found. Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Request method failure captured: Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e HTTP/1.1 Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPZOmLgKK4_rGEqcfRvPG5-B5jE_W_hW1umV2HHwPr_-PqoXoTuO9xWNfdwCvuqkk__W92sbX-UegCPlkKHZuWEcPWyxSAwVWciQca_oOy5hP9AgxPmgCoSu03wcwoIUyN1G_-hkFHXD5HmBCbCjYiW7gnXKdJKE6dp4Z_oLc05Ol4A Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: e30500ead1404e5188c6d90e5b302742 Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e30500ead1404e5188c6d90e5b302742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e30500ead1404e5188c6d90e5b302742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e30500ead1404e5188c6d90e5b302742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e30500ead1404e5188c6d90e5b302742"}]}] Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: e30500ead1404e5188c6d90e5b302742 Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestNetworkAdvancedServerOps-1013665673-project Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a95598cd3fe04a0abff7aac9f0c49bff Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1013665673-project Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 2369767a-41e2-407d-97f6-5cb376e2d11e could not be found. Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '2369767a-41e2-407d-97f6-5cb376e2d11e'} Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2369767a-41e2-407d-97f6-5cb376e2d11e could not be found. Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2369767a-41e2-407d-97f6-5cb376e2d11e could not be found. Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:57:13.190088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:57:13.195554 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:57:13.195554 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:57:13.195554 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:57:13.195554 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:57:13.195554 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:57:13.195554 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:57:13.195554 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2369767a-41e2-407d-97f6-5cb376e2d11e could not be found. Oct 11 04:57:13.195554 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:57:13.195554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Returning 404 to user: Instance 2369767a-41e2-407d-97f6-5cb376e2d11e could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:57:13.195554 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3f070052-d4c4-4904-9907-bbd670c2b1fb tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e" status: 404 len: 111 microversion: 2.1 time: 0.036079 Oct 11 04:57:13.195554 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3546/6853] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:13 2022] GET /compute/v2.1/servers/2369767a-41e2-407d-97f6-5cb376e2d11e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:57:17.334895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ae2ce1b-d504-43ef-b064-b8fe82c24d00 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '.version_select at 0x7fda18642550>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:17.514105 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ae2ce1b-d504-43ef-b064-b8fe82c24d00 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-383267252" status: 202 len: 0 microversion: 2.1 time: 0.183061 Oct 11 04:57:17.519086 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3308/6854] 10.222.0.26 () {58 vars in 1281 bytes} [Tue Oct 11 04:57:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-383267252 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:57:17.553008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-42699233-6f69-4961-9a7c-2781be49eac2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'create', calling method: .version_select at 0x7fda18da4670>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1422481425", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLeRHRKC4gKDKJVbw5pidF8rDRVt+ULOnbic640ezaNYFzTbwZys+PIny1mlq9lNHoloxZuaWTM/5ZV327LqsqPaEiIqjUKr/Z7ysVe4l0nJ40G8CGXIvU7i685jRuXuOw=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:57:17.569252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-42699233-6f69-4961-9a7c-2781be49eac2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for project e30500ead1404e5188c6d90e5b302742. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:57:17.575310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-42699233-6f69-4961-9a7c-2781be49eac2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for user a95598cd3fe04a0abff7aac9f0c49bff and project e30500ead1404e5188c6d90e5b302742. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:57:17.723470 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-42699233-6f69-4961-9a7c-2781be49eac2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.174504 Oct 11 04:57:17.724116 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3547/6855] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:57:17 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:57:28.186211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:28.186995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:28.193289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1135481248", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "8c2c42f0-eca8-4026-b1ac-73a345e457aa"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1422481425", "security_groups": [{"name": "tempest-secgroup-smoke-867802344"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:57:28.344615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] validate_networks() for [('8c2c42f0-eca8-4026-b1ac-73a345e457aa', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:57:28.848561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:57:28.851068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:57:28.851681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:57:28.852221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:57:28.852784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:57:28.862529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:28.863952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:28.864639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:28.865621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:28.866324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:28.866998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:28.889949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for project e30500ead1404e5188c6d90e5b302742. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:57:28.897272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for user a95598cd3fe04a0abff7aac9f0c49bff and project e30500ead1404e5188c6d90e5b302742. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:57:28.912984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:57:28.928692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:57:29.151115 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1765d73b-d3b9-45e5-9407-31df15948c15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.964294 Oct 11 04:57:29.152903 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3309/6856] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:57:28 2022] POST /compute/v2.1/servers => generated 405 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:57:29.166623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cc98bb82-9d3b-4ce3-94cc-9d05b7f8a426 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:29.172798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cc98bb82-9d3b-4ce3-94cc-9d05b7f8a426 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:29.193558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=18 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:29.195215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:29.197910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:29.292343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cc98bb82-9d3b-4ce3-94cc-9d05b7f8a426 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:29.307942 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cc98bb82-9d3b-4ce3-94cc-9d05b7f8a426 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1267 microversion: 2.1 time: 0.146721 Oct 11 04:57:29.330517 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3548/6857] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:29 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:30.334795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-641ee02a-4a54-4db2-9bf9-e5d751385dcd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:30.335509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-641ee02a-4a54-4db2-9bf9-e5d751385dcd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:30.396876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-641ee02a-4a54-4db2-9bf9-e5d751385dcd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:30.404793 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-641ee02a-4a54-4db2-9bf9-e5d751385dcd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1267 microversion: 2.1 time: 0.074956 Oct 11 04:57:30.405651 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3310/6858] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:30 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1267 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:57:31.429280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c944ee42-0a12-4287-99f5-dde27f2d7f1b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:31.430295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c944ee42-0a12-4287-99f5-dde27f2d7f1b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:31.438928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c944ee42-0a12-4287-99f5-dde27f2d7f1b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:31.439499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c944ee42-0a12-4287-99f5-dde27f2d7f1b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:31.440173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c944ee42-0a12-4287-99f5-dde27f2d7f1b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:31.441464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c944ee42-0a12-4287-99f5-dde27f2d7f1b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:31.442019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c944ee42-0a12-4287-99f5-dde27f2d7f1b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:31.442542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c944ee42-0a12-4287-99f5-dde27f2d7f1b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:31.516423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c944ee42-0a12-4287-99f5-dde27f2d7f1b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:31.526802 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c944ee42-0a12-4287-99f5-dde27f2d7f1b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1319 microversion: 2.1 time: 0.101563 Oct 11 04:57:31.527756 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3549/6859] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:31 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1319 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:32.550721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c318494e-cb96-4b03-bce5-e1c85201b1f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:32.553007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c318494e-cb96-4b03-bce5-e1c85201b1f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:32.558299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c318494e-cb96-4b03-bce5-e1c85201b1f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:32.558801 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c318494e-cb96-4b03-bce5-e1c85201b1f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:32.559246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c318494e-cb96-4b03-bce5-e1c85201b1f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:32.559944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c318494e-cb96-4b03-bce5-e1c85201b1f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:32.560404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c318494e-cb96-4b03-bce5-e1c85201b1f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:32.560842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c318494e-cb96-4b03-bce5-e1c85201b1f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:32.629609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c318494e-cb96-4b03-bce5-e1c85201b1f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:32.637800 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c318494e-cb96-4b03-bce5-e1c85201b1f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1325 microversion: 2.1 time: 0.091630 Oct 11 04:57:32.638420 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3311/6860] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:32 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1325 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:33.665630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c23e377e-8864-45de-9cd5-ba3f5c546c53 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:33.666241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c23e377e-8864-45de-9cd5-ba3f5c546c53 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:33.672923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c23e377e-8864-45de-9cd5-ba3f5c546c53 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:33.673412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c23e377e-8864-45de-9cd5-ba3f5c546c53 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:33.673851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c23e377e-8864-45de-9cd5-ba3f5c546c53 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:33.674586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c23e377e-8864-45de-9cd5-ba3f5c546c53 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:33.675096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c23e377e-8864-45de-9cd5-ba3f5c546c53 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:33.676046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c23e377e-8864-45de-9cd5-ba3f5c546c53 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:33.835299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c23e377e-8864-45de-9cd5-ba3f5c546c53 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:33.843754 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c23e377e-8864-45de-9cd5-ba3f5c546c53 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1392 microversion: 2.1 time: 0.182828 Oct 11 04:57:33.844339 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3550/6861] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:33 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1392 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:57:34.069671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-9b7ab279-1b12-4b8e-8bd7-699fad7b1a6d req-01a9144d-5b89-4dd6-95a6-ffc86ce8bdea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea20fda-b6ae-4ea1-9fb4-69598388152c", "tag": "76b589bd-9542-447f-bbdb-99d1e40e6f28"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:57:34.080491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9b7ab279-1b12-4b8e-8bd7-699fad7b1a6d req-01a9144d-5b89-4dd6-95a6-ffc86ce8bdea service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:34.082163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9b7ab279-1b12-4b8e-8bd7-699fad7b1a6d req-01a9144d-5b89-4dd6-95a6-ffc86ce8bdea service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:34.082690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9b7ab279-1b12-4b8e-8bd7-699fad7b1a6d req-01a9144d-5b89-4dd6-95a6-ffc86ce8bdea service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:34.094968 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-9b7ab279-1b12-4b8e-8bd7-699fad7b1a6d req-01a9144d-5b89-4dd6-95a6-ffc86ce8bdea service nova] Creating event network-changed:76b589bd-9542-447f-bbdb-99d1e40e6f28 for instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c on n-h1-860892-1 Oct 11 04:57:34.101095 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-9b7ab279-1b12-4b8e-8bd7-699fad7b1a6d req-01a9144d-5b89-4dd6-95a6-ffc86ce8bdea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037471 Oct 11 04:57:34.101782 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3312/6862] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:57:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:57:34.868151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-740e3769-31f6-4a2d-981e-6bdf30ee1a91 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:34.868767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-740e3769-31f6-4a2d-981e-6bdf30ee1a91 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:34.876566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-740e3769-31f6-4a2d-981e-6bdf30ee1a91 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:34.876990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-740e3769-31f6-4a2d-981e-6bdf30ee1a91 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:34.877439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-740e3769-31f6-4a2d-981e-6bdf30ee1a91 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:34.878143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-740e3769-31f6-4a2d-981e-6bdf30ee1a91 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:34.878665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-740e3769-31f6-4a2d-981e-6bdf30ee1a91 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:34.879266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-740e3769-31f6-4a2d-981e-6bdf30ee1a91 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:35.016893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-740e3769-31f6-4a2d-981e-6bdf30ee1a91 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:35.025511 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-740e3769-31f6-4a2d-981e-6bdf30ee1a91 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1392 microversion: 2.1 time: 0.161338 Oct 11 04:57:35.026134 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3551/6863] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:34 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:57:36.051071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7aabbffd-f7f9-49a4-a9a4-a9acfb104bbf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:36.052018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7aabbffd-f7f9-49a4-a9a4-a9acfb104bbf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:36.058708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7aabbffd-f7f9-49a4-a9a4-a9acfb104bbf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:36.060376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7aabbffd-f7f9-49a4-a9a4-a9acfb104bbf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:36.060376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7aabbffd-f7f9-49a4-a9a4-a9acfb104bbf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:36.060742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7aabbffd-f7f9-49a4-a9a4-a9acfb104bbf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:36.061297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7aabbffd-f7f9-49a4-a9a4-a9acfb104bbf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:36.061961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7aabbffd-f7f9-49a4-a9a4-a9acfb104bbf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:36.198173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7aabbffd-f7f9-49a4-a9a4-a9acfb104bbf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:36.205919 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7aabbffd-f7f9-49a4-a9a4-a9acfb104bbf tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1392 microversion: 2.1 time: 0.160683 Oct 11 04:57:36.207108 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3313/6864] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:36 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1392 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:37.229364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-769a5f38-3363-4715-b391-f97d9cbe8e4d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:37.230024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-769a5f38-3363-4715-b391-f97d9cbe8e4d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:37.237046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-769a5f38-3363-4715-b391-f97d9cbe8e4d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:37.237534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-769a5f38-3363-4715-b391-f97d9cbe8e4d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:37.237970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-769a5f38-3363-4715-b391-f97d9cbe8e4d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:37.239400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-769a5f38-3363-4715-b391-f97d9cbe8e4d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:37.239903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-769a5f38-3363-4715-b391-f97d9cbe8e4d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:37.240347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-769a5f38-3363-4715-b391-f97d9cbe8e4d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:37.391169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-769a5f38-3363-4715-b391-f97d9cbe8e4d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:37.399504 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-769a5f38-3363-4715-b391-f97d9cbe8e4d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1392 microversion: 2.1 time: 0.174006 Oct 11 04:57:37.400176 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3552/6865] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:37 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1392 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:38.426488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4951266-cc6b-496b-94e0-63ef28ee02d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:38.426488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f4951266-cc6b-496b-94e0-63ef28ee02d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:38.431262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4951266-cc6b-496b-94e0-63ef28ee02d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:38.431866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4951266-cc6b-496b-94e0-63ef28ee02d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:38.432305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4951266-cc6b-496b-94e0-63ef28ee02d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:38.433045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4951266-cc6b-496b-94e0-63ef28ee02d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:38.433472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4951266-cc6b-496b-94e0-63ef28ee02d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:38.434071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4951266-cc6b-496b-94e0-63ef28ee02d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:38.582162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4951266-cc6b-496b-94e0-63ef28ee02d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:38.590238 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f4951266-cc6b-496b-94e0-63ef28ee02d2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1392 microversion: 2.1 time: 0.171022 Oct 11 04:57:38.590816 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3314/6866] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:38 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1392 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:39.619723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92514873-1852-4b6e-98d0-c5c3afbce116 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:39.620513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-92514873-1852-4b6e-98d0-c5c3afbce116 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:39.623264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:39.628204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92514873-1852-4b6e-98d0-c5c3afbce116 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:39.628687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92514873-1852-4b6e-98d0-c5c3afbce116 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:39.629645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92514873-1852-4b6e-98d0-c5c3afbce116 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:39.630360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92514873-1852-4b6e-98d0-c5c3afbce116 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:39.630813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92514873-1852-4b6e-98d0-c5c3afbce116 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:39.631240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92514873-1852-4b6e-98d0-c5c3afbce116 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:39.766682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-92514873-1852-4b6e-98d0-c5c3afbce116 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:39.774584 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-92514873-1852-4b6e-98d0-c5c3afbce116 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1392 microversion: 2.1 time: 0.158830 Oct 11 04:57:39.775163 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3553/6867] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:39 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:40.461044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5f73d12c-b4f2-4348-9dd5-06ee5b394635 req-e0fef6f2-828a-4d86-94ec-91a132f0ab56 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea20fda-b6ae-4ea1-9fb4-69598388152c", "name": "network-vif-plugged", "status": "completed", "tag": "76b589bd-9542-447f-bbdb-99d1e40e6f28"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:57:40.470108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:40.471773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:57:40.478281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5f73d12c-b4f2-4348-9dd5-06ee5b394635 req-e0fef6f2-828a-4d86-94ec-91a132f0ab56 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:40.478766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5f73d12c-b4f2-4348-9dd5-06ee5b394635 req-e0fef6f2-828a-4d86-94ec-91a132f0ab56 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:40.479301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5f73d12c-b4f2-4348-9dd5-06ee5b394635 req-e0fef6f2-828a-4d86-94ec-91a132f0ab56 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:40.490595 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5f73d12c-b4f2-4348-9dd5-06ee5b394635 req-e0fef6f2-828a-4d86-94ec-91a132f0ab56 service nova] Creating event network-vif-plugged:76b589bd-9542-447f-bbdb-99d1e40e6f28 for instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c on n-h1-860892-1 Oct 11 04:57:40.495864 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5f73d12c-b4f2-4348-9dd5-06ee5b394635 req-e0fef6f2-828a-4d86-94ec-91a132f0ab56 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039047 Oct 11 04:57:40.496469 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3315/6868] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:57:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:57:40.797196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6919e799-8ccb-451b-820a-2c9763cb28e6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:40.797946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6919e799-8ccb-451b-820a-2c9763cb28e6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:40.804939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6919e799-8ccb-451b-820a-2c9763cb28e6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:40.805432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6919e799-8ccb-451b-820a-2c9763cb28e6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:40.805874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6919e799-8ccb-451b-820a-2c9763cb28e6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:40.806597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6919e799-8ccb-451b-820a-2c9763cb28e6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:40.807051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6919e799-8ccb-451b-820a-2c9763cb28e6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:40.807478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6919e799-8ccb-451b-820a-2c9763cb28e6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:40.940464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6919e799-8ccb-451b-820a-2c9763cb28e6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:40.948811 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6919e799-8ccb-451b-820a-2c9763cb28e6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1392 microversion: 2.1 time: 0.155600 Oct 11 04:57:40.949386 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3554/6869] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:40 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:41.974954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f3b3a4b5-213a-4e25-9195-f9aa087fdef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:41.975975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f3b3a4b5-213a-4e25-9195-f9aa087fdef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:41.983032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3b3a4b5-213a-4e25-9195-f9aa087fdef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:41.983518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3b3a4b5-213a-4e25-9195-f9aa087fdef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:41.984175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3b3a4b5-213a-4e25-9195-f9aa087fdef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:41.984887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3b3a4b5-213a-4e25-9195-f9aa087fdef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:41.985340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3b3a4b5-213a-4e25-9195-f9aa087fdef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:41.985822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3b3a4b5-213a-4e25-9195-f9aa087fdef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:42.136512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f3b3a4b5-213a-4e25-9195-f9aa087fdef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:42.144641 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f3b3a4b5-213a-4e25-9195-f9aa087fdef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1392 microversion: 2.1 time: 0.175447 Oct 11 04:57:42.145210 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3316/6870] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:41 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1392 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:43.167691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13e7e4a8-02ad-4e4a-8df9-79362fe10d3c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:43.168243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-13e7e4a8-02ad-4e4a-8df9-79362fe10d3c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:43.175204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e7e4a8-02ad-4e4a-8df9-79362fe10d3c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:43.175722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e7e4a8-02ad-4e4a-8df9-79362fe10d3c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:43.176159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e7e4a8-02ad-4e4a-8df9-79362fe10d3c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:43.176849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e7e4a8-02ad-4e4a-8df9-79362fe10d3c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:43.177300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e7e4a8-02ad-4e4a-8df9-79362fe10d3c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:43.177723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13e7e4a8-02ad-4e4a-8df9-79362fe10d3c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:43.315668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-13e7e4a8-02ad-4e4a-8df9-79362fe10d3c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:43.323957 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-13e7e4a8-02ad-4e4a-8df9-79362fe10d3c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1564 microversion: 2.1 time: 0.160619 Oct 11 04:57:43.326340 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3555/6871] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:43 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:43.346827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-30ba737d-0c0f-4a69-9484-594dc364fd3e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:43.350923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-30ba737d-0c0f-4a69-9484-594dc364fd3e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:43.354820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30ba737d-0c0f-4a69-9484-594dc364fd3e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:43.355310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30ba737d-0c0f-4a69-9484-594dc364fd3e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:43.355875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30ba737d-0c0f-4a69-9484-594dc364fd3e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:43.356549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30ba737d-0c0f-4a69-9484-594dc364fd3e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:43.357004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30ba737d-0c0f-4a69-9484-594dc364fd3e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:43.357432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-30ba737d-0c0f-4a69-9484-594dc364fd3e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:43.494682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-30ba737d-0c0f-4a69-9484-594dc364fd3e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:43.502749 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-30ba737d-0c0f-4a69-9484-594dc364fd3e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1564 microversion: 2.1 time: 0.159855 Oct 11 04:57:43.503319 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3317/6872] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:43 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:46.398457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-42cb1a72-1116-409e-9fed-12de2e172115 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:46.399006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-42cb1a72-1116-409e-9fed-12de2e172115 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:46.405769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42cb1a72-1116-409e-9fed-12de2e172115 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:46.406540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42cb1a72-1116-409e-9fed-12de2e172115 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:46.407534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42cb1a72-1116-409e-9fed-12de2e172115 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:46.408498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42cb1a72-1116-409e-9fed-12de2e172115 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:46.409177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42cb1a72-1116-409e-9fed-12de2e172115 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:46.410113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-42cb1a72-1116-409e-9fed-12de2e172115 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:46.462004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-42cb1a72-1116-409e-9fed-12de2e172115 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:57:46.633615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-0400030f-ef9d-46ae-a0e1-3de30c6e5df6 req-49845c58-b58c-40bd-9f45-7d75f204f437 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278", "tag": "ab7b8b9c-a65f-4854-9919-ff1c8812c324"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:57:46.653789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0400030f-ef9d-46ae-a0e1-3de30c6e5df6 req-49845c58-b58c-40bd-9f45-7d75f204f437 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:46.658589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0400030f-ef9d-46ae-a0e1-3de30c6e5df6 req-49845c58-b58c-40bd-9f45-7d75f204f437 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:46.659143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0400030f-ef9d-46ae-a0e1-3de30c6e5df6 req-49845c58-b58c-40bd-9f45-7d75f204f437 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:46.700802 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-0400030f-ef9d-46ae-a0e1-3de30c6e5df6 req-49845c58-b58c-40bd-9f45-7d75f204f437 service nova] Creating event network-changed:ab7b8b9c-a65f-4854-9919-ff1c8812c324 for instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 on n-h2-860892-1 Oct 11 04:57:46.709765 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-0400030f-ef9d-46ae-a0e1-3de30c6e5df6 req-49845c58-b58c-40bd-9f45-7d75f204f437 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.261610 Oct 11 04:57:46.710785 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3318/6873] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:57:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:57:46.720470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-85e65e66-16e8-4eba-9af7-5ad64ba58cc9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:46.721178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-85e65e66-16e8-4eba-9af7-5ad64ba58cc9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:46.728817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85e65e66-16e8-4eba-9af7-5ad64ba58cc9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:46.729466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85e65e66-16e8-4eba-9af7-5ad64ba58cc9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:46.729765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85e65e66-16e8-4eba-9af7-5ad64ba58cc9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:46.730522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85e65e66-16e8-4eba-9af7-5ad64ba58cc9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:46.730977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85e65e66-16e8-4eba-9af7-5ad64ba58cc9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:46.731797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85e65e66-16e8-4eba-9af7-5ad64ba58cc9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:46.950211 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-42cb1a72-1116-409e-9fed-12de2e172115 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "DELETE /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 204 len: 0 microversion: 2.1 time: 0.556010 Oct 11 04:57:46.961966 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3556/6874] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:57:46 2022] DELETE /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 0 bytes in 565 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:57:46.968006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a8ab5d35-a720-4099-853e-32d90f09b68e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:46.969057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a8ab5d35-a720-4099-853e-32d90f09b68e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:46.988712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8ab5d35-a720-4099-853e-32d90f09b68e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:46.989542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8ab5d35-a720-4099-853e-32d90f09b68e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:46.989981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8ab5d35-a720-4099-853e-32d90f09b68e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:46.990943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8ab5d35-a720-4099-853e-32d90f09b68e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:46.991584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8ab5d35-a720-4099-853e-32d90f09b68e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:46.992180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a8ab5d35-a720-4099-853e-32d90f09b68e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:47.049644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-85e65e66-16e8-4eba-9af7-5ad64ba58cc9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:47.062653 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-85e65e66-16e8-4eba-9af7-5ad64ba58cc9 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1564 microversion: 2.1 time: 0.346653 Oct 11 04:57:47.078615 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3319/6875] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:46 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1564 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:47.247376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a8ab5d35-a720-4099-853e-32d90f09b68e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:47.258841 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a8ab5d35-a720-4099-853e-32d90f09b68e tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1583 microversion: 2.1 time: 0.294655 Oct 11 04:57:47.259488 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3557/6876] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:46 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1583 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:48.284063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9aaab41f-bf4d-4431-972b-e5567b5ea2c4 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:48.284687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9aaab41f-bf4d-4431-972b-e5567b5ea2c4 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:48.292377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aaab41f-bf4d-4431-972b-e5567b5ea2c4 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:48.292866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aaab41f-bf4d-4431-972b-e5567b5ea2c4 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:48.293308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aaab41f-bf4d-4431-972b-e5567b5ea2c4 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:48.294008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aaab41f-bf4d-4431-972b-e5567b5ea2c4 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:48.294501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aaab41f-bf4d-4431-972b-e5567b5ea2c4 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:48.294942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aaab41f-bf4d-4431-972b-e5567b5ea2c4 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:48.579285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9aaab41f-bf4d-4431-972b-e5567b5ea2c4 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:48.587646 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9aaab41f-bf4d-4431-972b-e5567b5ea2c4 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1583 microversion: 2.1 time: 0.307750 Oct 11 04:57:48.588224 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3320/6877] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:48 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1583 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:48.726222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-483638d6-fcaa-4e1c-b145-b7acf4d3890d req-3ab541e0-0889-40c4-a648-39d97061d187 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea20fda-b6ae-4ea1-9fb4-69598388152c", "tag": "76b589bd-9542-447f-bbdb-99d1e40e6f28"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:57:48.738392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-483638d6-fcaa-4e1c-b145-b7acf4d3890d req-3ab541e0-0889-40c4-a648-39d97061d187 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:48.738392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-483638d6-fcaa-4e1c-b145-b7acf4d3890d req-3ab541e0-0889-40c4-a648-39d97061d187 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:48.738803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-483638d6-fcaa-4e1c-b145-b7acf4d3890d req-3ab541e0-0889-40c4-a648-39d97061d187 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:48.750739 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-483638d6-fcaa-4e1c-b145-b7acf4d3890d req-3ab541e0-0889-40c4-a648-39d97061d187 service nova] Creating event network-changed:76b589bd-9542-447f-bbdb-99d1e40e6f28 for instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c on n-h1-860892-1 Oct 11 04:57:48.755902 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-483638d6-fcaa-4e1c-b145-b7acf4d3890d req-3ab541e0-0889-40c4-a648-39d97061d187 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034127 Oct 11 04:57:48.756569 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3558/6878] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:57:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:57:49.613837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-72afee25-572b-444c-80d5-92f21d977771 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:49.614536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-72afee25-572b-444c-80d5-92f21d977771 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:49.621952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72afee25-572b-444c-80d5-92f21d977771 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:49.622499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72afee25-572b-444c-80d5-92f21d977771 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:49.622971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72afee25-572b-444c-80d5-92f21d977771 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:49.623647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72afee25-572b-444c-80d5-92f21d977771 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:49.624095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72afee25-572b-444c-80d5-92f21d977771 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:49.624523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-72afee25-572b-444c-80d5-92f21d977771 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:49.689178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-72afee25-572b-444c-80d5-92f21d977771 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:49.697830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-72afee25-572b-444c-80d5-92f21d977771 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1229 microversion: 2.1 time: 0.087932 Oct 11 04:57:49.700474 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3321/6879] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:49 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1229 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:50.722696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-88117e91-5cdd-4eaa-b1be-7edaac229f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:50.723335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-88117e91-5cdd-4eaa-b1be-7edaac229f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:50.730035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88117e91-5cdd-4eaa-b1be-7edaac229f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:50.730559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88117e91-5cdd-4eaa-b1be-7edaac229f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:50.730993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88117e91-5cdd-4eaa-b1be-7edaac229f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:50.731683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88117e91-5cdd-4eaa-b1be-7edaac229f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:50.732198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88117e91-5cdd-4eaa-b1be-7edaac229f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:50.732620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88117e91-5cdd-4eaa-b1be-7edaac229f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:50.788918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-af08914e-d7af-4c04-85dd-b9a2b7d2c3bc req-ea6dcaa6-76f2-480d-9bfc-7cb65b2b5f9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278", "name": "network-vif-deleted", "tag": "ab7b8b9c-a65f-4854-9919-ff1c8812c324"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:57:50.804077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af08914e-d7af-4c04-85dd-b9a2b7d2c3bc req-ea6dcaa6-76f2-480d-9bfc-7cb65b2b5f9a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:50.804788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af08914e-d7af-4c04-85dd-b9a2b7d2c3bc req-ea6dcaa6-76f2-480d-9bfc-7cb65b2b5f9a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:50.805410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-af08914e-d7af-4c04-85dd-b9a2b7d2c3bc req-ea6dcaa6-76f2-480d-9bfc-7cb65b2b5f9a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:50.806023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-88117e91-5cdd-4eaa-b1be-7edaac229f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:50.814462 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-88117e91-5cdd-4eaa-b1be-7edaac229f78 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1229 microversion: 2.1 time: 0.097362 Oct 11 04:57:50.815521 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3559/6880] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:50 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1229 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:50.818687 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-af08914e-d7af-4c04-85dd-b9a2b7d2c3bc req-ea6dcaa6-76f2-480d-9bfc-7cb65b2b5f9a service nova] Creating event network-vif-deleted:ab7b8b9c-a65f-4854-9919-ff1c8812c324 for instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 on n-h2-860892-1 Oct 11 04:57:50.828702 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-af08914e-d7af-4c04-85dd-b9a2b7d2c3bc req-ea6dcaa6-76f2-480d-9bfc-7cb65b2b5f9a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043581 Oct 11 04:57:50.829828 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3322/6881] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:57:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 04:57:51.839281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0d3affef-2026-4fb6-a4b8-83fee50cd5f3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:51.839900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0d3affef-2026-4fb6-a4b8-83fee50cd5f3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:51.846846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3affef-2026-4fb6-a4b8-83fee50cd5f3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:51.847332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3affef-2026-4fb6-a4b8-83fee50cd5f3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:51.847783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3affef-2026-4fb6-a4b8-83fee50cd5f3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:51.848482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3affef-2026-4fb6-a4b8-83fee50cd5f3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:51.848937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3affef-2026-4fb6-a4b8-83fee50cd5f3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:51.850017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0d3affef-2026-4fb6-a4b8-83fee50cd5f3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:51.912739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0d3affef-2026-4fb6-a4b8-83fee50cd5f3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:51.920695 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0d3affef-2026-4fb6-a4b8-83fee50cd5f3 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1229 microversion: 2.1 time: 0.085294 Oct 11 04:57:51.921266 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3560/6882] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:51 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1229 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:52.946976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-85298eb5-669d-442f-a20c-f7de116c462d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:52.947824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-85298eb5-669d-442f-a20c-f7de116c462d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:52.957347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85298eb5-669d-442f-a20c-f7de116c462d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:52.958348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85298eb5-669d-442f-a20c-f7de116c462d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:52.959600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85298eb5-669d-442f-a20c-f7de116c462d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:52.960320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85298eb5-669d-442f-a20c-f7de116c462d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:52.960776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85298eb5-669d-442f-a20c-f7de116c462d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:52.961329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85298eb5-669d-442f-a20c-f7de116c462d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:53.030322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-85298eb5-669d-442f-a20c-f7de116c462d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:53.040135 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-85298eb5-669d-442f-a20c-f7de116c462d tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1229 microversion: 2.1 time: 0.099066 Oct 11 04:57:53.040782 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3323/6883] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:52 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1229 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:57:54.064612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:54.065249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:54.072930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:54.073448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:54.073884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:54.074915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:54.075374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:54.075803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:54.109229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:54.109742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:54.110152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:54.110629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lazy-loading 'fault' on Instance uuid 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:57:54.152918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c930196998114174bc75f2b4d48f41ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b57b7bff5c2402d824f43124fd29af8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:57:54.161410 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1ddc55f3-f03d-43af-83fc-b278360f4228 tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 200 len: 1234 microversion: 2.1 time: 0.101797 Oct 11 04:57:54.162026 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3561/6884] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:54 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 1234 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:57:55.199930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:55.200550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] [instance: 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:57:55.207469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:55.207949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:55.208391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:55.209688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:57:55.210142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:57:55.210596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:57:55.224041 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] HTTP exception thrown: Instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 could not be found. Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Request method failure captured: Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 HTTP/1.1 Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPbEWKuHx_TxcEbIWI4OmjfT3RN_Ebk-5sh42ds2H7nIemEDhUZ2ViNDmoABqbCzVgsp1-8ys9F1nJ4tQ5j3q_Ul3MpeHbU2xzgFUv4TQyqR5k5p31xTZpBNd8TA9AiDfCjTVgymsxlb_ZpjZKAeh6gB5wo-zOvD_ahem_9PrANMwTs Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 0b57b7bff5c2402d824f43124fd29af8 Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestVolumeBackupRestore-1614333793 Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b57b7bff5c2402d824f43124fd29af8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b57b7bff5c2402d824f43124fd29af8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b57b7bff5c2402d824f43124fd29af8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b57b7bff5c2402d824f43124fd29af8"}]}] Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestVolumeBackupRestore-1614333793 Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 0b57b7bff5c2402d824f43124fd29af8 Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestVolumeBackupRestore-1614333793 Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestVolumeBackupRestore-1614333793-project Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: c930196998114174bc75f2b4d48f41ae Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestVolumeBackupRestore-1614333793-project Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 could not be found. Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278'} Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 could not be found. Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 could not be found. Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:57:55.225757 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:57:55.230382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:57:55.230382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:57:55.230382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:57:55.230382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:57:55.230382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:57:55.230382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 could not be found. Oct 11 04:57:55.230382 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 04:57:55.230382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Returning 404 to user: Instance 204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:57:55.230382 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-682a9be7-6f6c-425f-a0fd-a41b4fd00e7c tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278" status: 404 len: 111 microversion: 2.1 time: 0.031121 Oct 11 04:57:55.230382 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3324/6885] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:57:55 2022] GET /compute/v2.1/servers/204cbc7a-d8aa-4d5f-8ba1-1dfa2d0bd278 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:57:55.457714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aa825f44-4196-4778-bdd4-84b156f3cdbc tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] Calling method '.version_select at 0x7fda1a038ee0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:57:55.553485 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aa825f44-4196-4778-bdd4-84b156f3cdbc tempest-TestVolumeBackupRestore-1614333793 tempest-TestVolumeBackupRestore-1614333793-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1020703580" status: 202 len: 0 microversion: 2.1 time: 0.099974 Oct 11 04:57:55.554079 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3562/6886] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 04:57:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBackupRestore-1020703580 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:58:18.433402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7e42ab5d-8a6c-4951-b678-668d73241d1c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:58:18.435558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7e42ab5d-8a6c-4951-b678-668d73241d1c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:18.438002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:58:18.438700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=66 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:58:18.443421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e42ab5d-8a6c-4951-b678-668d73241d1c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:18.443908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e42ab5d-8a6c-4951-b678-668d73241d1c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:18.444518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e42ab5d-8a6c-4951-b678-668d73241d1c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:18.445039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e42ab5d-8a6c-4951-b678-668d73241d1c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:18.445507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e42ab5d-8a6c-4951-b678-668d73241d1c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:18.445921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e42ab5d-8a6c-4951-b678-668d73241d1c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:18.505345 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7e42ab5d-8a6c-4951-b678-668d73241d1c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c/action" status: 200 len: 24573 microversion: 2.1 time: 0.076188 Oct 11 04:58:18.506120 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3325/6887] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:58:18 2022] POST /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c/action => generated 24573 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:58:48.932812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:58:48.933667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:58:48.938290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c6c6204-445e-4e55-a8c2-4ee2595a82b3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:58:48.938949 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c6c6204-445e-4e55-a8c2-4ee2595a82b3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:48.946061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6c6204-445e-4e55-a8c2-4ee2595a82b3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:48.947248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6c6204-445e-4e55-a8c2-4ee2595a82b3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:48.947711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6c6204-445e-4e55-a8c2-4ee2595a82b3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:48.948404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6c6204-445e-4e55-a8c2-4ee2595a82b3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:48.948859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6c6204-445e-4e55-a8c2-4ee2595a82b3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:48.949279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c6c6204-445e-4e55-a8c2-4ee2595a82b3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:49.087146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5c6c6204-445e-4e55-a8c2-4ee2595a82b3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:58:49.094975 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c6c6204-445e-4e55-a8c2-4ee2595a82b3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1681 microversion: 2.1 time: 0.165174 Oct 11 04:58:49.095557 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3563/6888] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:58:48 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:58:49.193354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d2f23690-67d1-4139-b6b2-d88680d2023e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:58:49.195679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d2f23690-67d1-4139-b6b2-d88680d2023e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:49.205698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2f23690-67d1-4139-b6b2-d88680d2023e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:49.206180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2f23690-67d1-4139-b6b2-d88680d2023e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:49.206648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2f23690-67d1-4139-b6b2-d88680d2023e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:49.207481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2f23690-67d1-4139-b6b2-d88680d2023e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:49.207942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2f23690-67d1-4139-b6b2-d88680d2023e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:49.208370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2f23690-67d1-4139-b6b2-d88680d2023e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:49.263176 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d2f23690-67d1-4139-b6b2-d88680d2023e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c/action" status: 200 len: 32639 microversion: 2.1 time: 0.073965 Oct 11 04:58:49.263843 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3326/6889] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:58:49 2022] POST /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c/action => generated 32639 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:58:49.437778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5c937ba2-e974-4c1a-8cb6-6c284dc0892e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:58:49.438542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5c937ba2-e974-4c1a-8cb6-6c284dc0892e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:49.445124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c937ba2-e974-4c1a-8cb6-6c284dc0892e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:49.445622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c937ba2-e974-4c1a-8cb6-6c284dc0892e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:49.446066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c937ba2-e974-4c1a-8cb6-6c284dc0892e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:49.446843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c937ba2-e974-4c1a-8cb6-6c284dc0892e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:49.447303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c937ba2-e974-4c1a-8cb6-6c284dc0892e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:49.447730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5c937ba2-e974-4c1a-8cb6-6c284dc0892e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:49.592477 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5c937ba2-e974-4c1a-8cb6-6c284dc0892e tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1832 microversion: 2.1 time: 0.159067 Oct 11 04:58:49.593081 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3564/6890] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:58:49 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1832 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:58:49.623361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8749db77-4111-4590-b5ef-b912eee0db9a tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Action: 'action', calling method: >, body: {"os-migrateLive": {"host": null, "block_migration": true, "disk_over_commit": false}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:58:49.625916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8749db77-4111-4590-b5ef-b912eee0db9a tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:49.633393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8749db77-4111-4590-b5ef-b912eee0db9a tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:49.633932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8749db77-4111-4590-b5ef-b912eee0db9a tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:49.634403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8749db77-4111-4590-b5ef-b912eee0db9a tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:49.635085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8749db77-4111-4590-b5ef-b912eee0db9a tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:49.635529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8749db77-4111-4590-b5ef-b912eee0db9a tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:49.635947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8749db77-4111-4590-b5ef-b912eee0db9a tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:49.661022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-8749db77-4111-4590-b5ef-b912eee0db9a tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lazy-loading 'flavor' on Instance uuid 4ea20fda-b6ae-4ea1-9fb4-69598388152c {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 04:58:49.673763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8749db77-4111-4590-b5ef-b912eee0db9a tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Going to try to live migrate instance to another host {{(pid=120993) live_migrate /opt/stack/nova/nova/compute/api.py:5482}} Oct 11 04:58:52.632252 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8749db77-4111-4590-b5ef-b912eee0db9a tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c/action" status: 202 len: 0 microversion: 2.1 time: 3.013691 Oct 11 04:58:52.632926 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3327/6891] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:58:49 2022] POST /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c/action => generated 0 bytes in 3015 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:58:52.642726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ac05675-1d44-49d7-b3e0-8d577c4fe637 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:58:52.643342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5ac05675-1d44-49d7-b3e0-8d577c4fe637 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:52.650986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ac05675-1d44-49d7-b3e0-8d577c4fe637 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:52.651473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ac05675-1d44-49d7-b3e0-8d577c4fe637 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:52.651905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ac05675-1d44-49d7-b3e0-8d577c4fe637 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:52.652593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ac05675-1d44-49d7-b3e0-8d577c4fe637 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:52.653046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ac05675-1d44-49d7-b3e0-8d577c4fe637 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:52.653470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ac05675-1d44-49d7-b3e0-8d577c4fe637 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:52.801390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5ac05675-1d44-49d7-b3e0-8d577c4fe637 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:58:52.811013 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5ac05675-1d44-49d7-b3e0-8d577c4fe637 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1691 microversion: 2.1 time: 0.172287 Oct 11 04:58:52.811631 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3565/6892] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:58:52 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:58:53.835840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d358362f-9036-48e0-a5e9-1f8b1bc2bebd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:58:53.836460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d358362f-9036-48e0-a5e9-1f8b1bc2bebd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:53.843946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d358362f-9036-48e0-a5e9-1f8b1bc2bebd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:53.844423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d358362f-9036-48e0-a5e9-1f8b1bc2bebd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:53.844858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d358362f-9036-48e0-a5e9-1f8b1bc2bebd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:53.845546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d358362f-9036-48e0-a5e9-1f8b1bc2bebd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:53.845995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d358362f-9036-48e0-a5e9-1f8b1bc2bebd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:53.846453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d358362f-9036-48e0-a5e9-1f8b1bc2bebd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:54.055179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d358362f-9036-48e0-a5e9-1f8b1bc2bebd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:58:54.063799 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d358362f-9036-48e0-a5e9-1f8b1bc2bebd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1691 microversion: 2.1 time: 0.231914 Oct 11 04:58:54.064367 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3328/6893] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:58:53 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1691 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:58:54.148804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e54346ca-e8c3-46d4-b8ae-9c84fbad6f43 req-a9214736-e876-4d39-991f-6858004d448f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea20fda-b6ae-4ea1-9fb4-69598388152c", "name": "network-vif-unplugged", "status": "completed", "tag": "76b589bd-9542-447f-bbdb-99d1e40e6f28"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:58:54.159444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e54346ca-e8c3-46d4-b8ae-9c84fbad6f43 req-a9214736-e876-4d39-991f-6858004d448f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:54.159919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e54346ca-e8c3-46d4-b8ae-9c84fbad6f43 req-a9214736-e876-4d39-991f-6858004d448f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:54.160363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e54346ca-e8c3-46d4-b8ae-9c84fbad6f43 req-a9214736-e876-4d39-991f-6858004d448f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:54.171820 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e54346ca-e8c3-46d4-b8ae-9c84fbad6f43 req-a9214736-e876-4d39-991f-6858004d448f service nova] Creating event network-vif-unplugged:76b589bd-9542-447f-bbdb-99d1e40e6f28 for instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c on n-h1-860892-1 Oct 11 04:58:54.176972 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e54346ca-e8c3-46d4-b8ae-9c84fbad6f43 req-a9214736-e876-4d39-991f-6858004d448f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032408 Oct 11 04:58:54.177555 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3566/6894] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:58:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:58:55.110563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e3386245-8e0f-44f8-aa44-86da621bd487 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:58:55.110563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e3386245-8e0f-44f8-aa44-86da621bd487 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:55.110563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3386245-8e0f-44f8-aa44-86da621bd487 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:55.110563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3386245-8e0f-44f8-aa44-86da621bd487 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:55.110563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3386245-8e0f-44f8-aa44-86da621bd487 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:55.110563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3386245-8e0f-44f8-aa44-86da621bd487 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:55.110563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3386245-8e0f-44f8-aa44-86da621bd487 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:55.110563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e3386245-8e0f-44f8-aa44-86da621bd487 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:55.237028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e3386245-8e0f-44f8-aa44-86da621bd487 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:58:55.246131 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e3386245-8e0f-44f8-aa44-86da621bd487 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1691 microversion: 2.1 time: 0.162413 Oct 11 04:58:55.246830 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3329/6895] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:58:55 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1691 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:58:56.193235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7ce30335-7f47-4736-b046-46b51f94a79d req-4be1502d-a386-4ec4-8be9-47f5a33fd76a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea20fda-b6ae-4ea1-9fb4-69598388152c", "tag": "76b589bd-9542-447f-bbdb-99d1e40e6f28"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:58:56.203466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7ce30335-7f47-4736-b046-46b51f94a79d req-4be1502d-a386-4ec4-8be9-47f5a33fd76a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:56.203939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7ce30335-7f47-4736-b046-46b51f94a79d req-4be1502d-a386-4ec4-8be9-47f5a33fd76a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:56.205309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7ce30335-7f47-4736-b046-46b51f94a79d req-4be1502d-a386-4ec4-8be9-47f5a33fd76a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:56.218554 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7ce30335-7f47-4736-b046-46b51f94a79d req-4be1502d-a386-4ec4-8be9-47f5a33fd76a service nova] Creating event network-changed:76b589bd-9542-447f-bbdb-99d1e40e6f28 for instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c on n-h1-860892-1 Oct 11 04:58:56.223985 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7ce30335-7f47-4736-b046-46b51f94a79d req-4be1502d-a386-4ec4-8be9-47f5a33fd76a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035707 Oct 11 04:58:56.224632 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3567/6896] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:58:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:58:56.269007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d25f346a-ee4b-4401-9b25-da29c128a3ce tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:58:56.269744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d25f346a-ee4b-4401-9b25-da29c128a3ce tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:56.276753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d25f346a-ee4b-4401-9b25-da29c128a3ce tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:56.277315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d25f346a-ee4b-4401-9b25-da29c128a3ce tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:56.277826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d25f346a-ee4b-4401-9b25-da29c128a3ce tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:56.278775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d25f346a-ee4b-4401-9b25-da29c128a3ce tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:56.279083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d25f346a-ee4b-4401-9b25-da29c128a3ce tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:56.279514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d25f346a-ee4b-4401-9b25-da29c128a3ce tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:56.528196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d25f346a-ee4b-4401-9b25-da29c128a3ce tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:58:56.545042 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d25f346a-ee4b-4401-9b25-da29c128a3ce tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1691 microversion: 2.1 time: 0.279809 Oct 11 04:58:56.545674 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3330/6897] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:58:56 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1691 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:58:57.574418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0fc81b5d-f1ef-4673-b5ac-ac71bb362c6a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:58:57.575039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0fc81b5d-f1ef-4673-b5ac-ac71bb362c6a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:57.581232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fc81b5d-f1ef-4673-b5ac-ac71bb362c6a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:57.581712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fc81b5d-f1ef-4673-b5ac-ac71bb362c6a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:57.582619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fc81b5d-f1ef-4673-b5ac-ac71bb362c6a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:57.583051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fc81b5d-f1ef-4673-b5ac-ac71bb362c6a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:57.583505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fc81b5d-f1ef-4673-b5ac-ac71bb362c6a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:57.583930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fc81b5d-f1ef-4673-b5ac-ac71bb362c6a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:57.725734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0fc81b5d-f1ef-4673-b5ac-ac71bb362c6a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:58:57.734411 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0fc81b5d-f1ef-4673-b5ac-ac71bb362c6a tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1691 microversion: 2.1 time: 0.165690 Oct 11 04:58:57.737031 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3568/6898] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:58:57 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1691 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:58:58.757006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-547033d7-f9f1-43eb-88b5-19c4907cb86d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:58:58.757617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-547033d7-f9f1-43eb-88b5-19c4907cb86d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:58.765414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-547033d7-f9f1-43eb-88b5-19c4907cb86d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:58.766296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-547033d7-f9f1-43eb-88b5-19c4907cb86d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:58.766738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-547033d7-f9f1-43eb-88b5-19c4907cb86d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:58.767706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-547033d7-f9f1-43eb-88b5-19c4907cb86d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:58.768163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-547033d7-f9f1-43eb-88b5-19c4907cb86d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:58.768594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-547033d7-f9f1-43eb-88b5-19c4907cb86d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:58.912958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-547033d7-f9f1-43eb-88b5-19c4907cb86d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:58:58.922335 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-547033d7-f9f1-43eb-88b5-19c4907cb86d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1691 microversion: 2.1 time: 0.169279 Oct 11 04:58:58.922998 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3331/6899] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:58:58 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1691 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:58:59.946702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-73e5188d-b1a2-4635-b487-26a2ad451644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:58:59.954398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-73e5188d-b1a2-4635-b487-26a2ad451644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:58:59.954398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73e5188d-b1a2-4635-b487-26a2ad451644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:59.955207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73e5188d-b1a2-4635-b487-26a2ad451644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:59.955788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73e5188d-b1a2-4635-b487-26a2ad451644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:58:59.956128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73e5188d-b1a2-4635-b487-26a2ad451644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:58:59.956562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73e5188d-b1a2-4635-b487-26a2ad451644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:58:59.956988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73e5188d-b1a2-4635-b487-26a2ad451644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:00.111424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-73e5188d-b1a2-4635-b487-26a2ad451644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:00.124577 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-73e5188d-b1a2-4635-b487-26a2ad451644 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1691 microversion: 2.1 time: 0.177243 Oct 11 04:59:00.124577 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3569/6900] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:58:59 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1691 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:01.143299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29e62c6d-0e27-4596-b975-02cb7587314b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:01.144050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-29e62c6d-0e27-4596-b975-02cb7587314b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:01.151780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e62c6d-0e27-4596-b975-02cb7587314b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:01.157805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e62c6d-0e27-4596-b975-02cb7587314b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:01.157805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e62c6d-0e27-4596-b975-02cb7587314b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:01.157805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e62c6d-0e27-4596-b975-02cb7587314b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:01.157805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e62c6d-0e27-4596-b975-02cb7587314b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:01.157805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29e62c6d-0e27-4596-b975-02cb7587314b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:01.385024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-29e62c6d-0e27-4596-b975-02cb7587314b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:01.392719 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-29e62c6d-0e27-4596-b975-02cb7587314b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1691 microversion: 2.1 time: 0.253333 Oct 11 04:59:01.393289 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3332/6901] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:01 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1691 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:02.420451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4dd079f6-c3ad-4727-8e24-86f0381e10b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:02.421072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4dd079f6-c3ad-4727-8e24-86f0381e10b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:02.428013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dd079f6-c3ad-4727-8e24-86f0381e10b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:02.428495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dd079f6-c3ad-4727-8e24-86f0381e10b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:02.428932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dd079f6-c3ad-4727-8e24-86f0381e10b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:02.429617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dd079f6-c3ad-4727-8e24-86f0381e10b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:02.430626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dd079f6-c3ad-4727-8e24-86f0381e10b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:02.431056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4dd079f6-c3ad-4727-8e24-86f0381e10b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:02.571806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4dd079f6-c3ad-4727-8e24-86f0381e10b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:02.580047 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4dd079f6-c3ad-4727-8e24-86f0381e10b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1681 microversion: 2.1 time: 0.163602 Oct 11 04:59:02.580621 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3570/6902] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:02 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1681 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:02.603061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d9867738-d48e-4475-b578-f494e0829ea4 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:02.604398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d9867738-d48e-4475-b578-f494e0829ea4 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:02.612583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9867738-d48e-4475-b578-f494e0829ea4 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:02.613137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9867738-d48e-4475-b578-f494e0829ea4 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:02.613625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9867738-d48e-4475-b578-f494e0829ea4 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:02.614477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9867738-d48e-4475-b578-f494e0829ea4 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:02.614982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9867738-d48e-4475-b578-f494e0829ea4 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:02.615478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9867738-d48e-4475-b578-f494e0829ea4 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:02.765334 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d9867738-d48e-4475-b578-f494e0829ea4 tempest-TestNetworkAdvancedServerOps-538492517 tempest-TestNetworkAdvancedServerOps-538492517-project-admin] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1832 microversion: 2.1 time: 0.166376 Oct 11 04:59:02.774860 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3333/6903] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:02 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1832 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:02.788727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea0f91bc-db88-4ede-980d-54c627628ef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:02.789936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea0f91bc-db88-4ede-980d-54c627628ef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:02.796958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea0f91bc-db88-4ede-980d-54c627628ef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:02.797862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea0f91bc-db88-4ede-980d-54c627628ef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:02.797862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea0f91bc-db88-4ede-980d-54c627628ef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:02.798606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea0f91bc-db88-4ede-980d-54c627628ef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:02.799059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea0f91bc-db88-4ede-980d-54c627628ef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:02.799485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea0f91bc-db88-4ede-980d-54c627628ef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:02.938889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ea0f91bc-db88-4ede-980d-54c627628ef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:02.947437 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea0f91bc-db88-4ede-980d-54c627628ef7 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1681 microversion: 2.1 time: 0.162618 Oct 11 04:59:02.948678 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3571/6904] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:02 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 04:59:03.060836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6ccd581a-5c32-4dc5-bb33-99d21b9fc27c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:59:03.063252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6ccd581a-5c32-4dc5-bb33-99d21b9fc27c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:03.069467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ccd581a-5c32-4dc5-bb33-99d21b9fc27c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:03.069964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ccd581a-5c32-4dc5-bb33-99d21b9fc27c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:03.070970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ccd581a-5c32-4dc5-bb33-99d21b9fc27c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:03.071705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ccd581a-5c32-4dc5-bb33-99d21b9fc27c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:03.072158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ccd581a-5c32-4dc5-bb33-99d21b9fc27c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:03.072794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ccd581a-5c32-4dc5-bb33-99d21b9fc27c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:03.125370 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6ccd581a-5c32-4dc5-bb33-99d21b9fc27c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c/action" status: 200 len: 38621 microversion: 2.1 time: 0.068526 Oct 11 04:59:03.132768 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3334/6905] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 04:59:03 2022] POST /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c/action => generated 38621 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 04:59:04.227809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-efd687d3-a4d7-482b-8c8b-b5f2da9d1b19 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:04.228713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-efd687d3-a4d7-482b-8c8b-b5f2da9d1b19 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:04.230179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-b19e2714-4013-414a-9724-0afbe85f19d2 req-7821eb0b-3d7c-40d5-87eb-ee9e55bb6ed7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ea20fda-b6ae-4ea1-9fb4-69598388152c", "tag": "76b589bd-9542-447f-bbdb-99d1e40e6f28"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:59:04.236430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd687d3-a4d7-482b-8c8b-b5f2da9d1b19 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:04.236999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd687d3-a4d7-482b-8c8b-b5f2da9d1b19 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:04.237759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd687d3-a4d7-482b-8c8b-b5f2da9d1b19 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:04.238596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd687d3-a4d7-482b-8c8b-b5f2da9d1b19 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:04.239202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd687d3-a4d7-482b-8c8b-b5f2da9d1b19 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:04.239706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efd687d3-a4d7-482b-8c8b-b5f2da9d1b19 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:04.249128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b19e2714-4013-414a-9724-0afbe85f19d2 req-7821eb0b-3d7c-40d5-87eb-ee9e55bb6ed7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:04.249609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b19e2714-4013-414a-9724-0afbe85f19d2 req-7821eb0b-3d7c-40d5-87eb-ee9e55bb6ed7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:04.250042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b19e2714-4013-414a-9724-0afbe85f19d2 req-7821eb0b-3d7c-40d5-87eb-ee9e55bb6ed7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:04.274332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-efd687d3-a4d7-482b-8c8b-b5f2da9d1b19 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 04:59:04.277925 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-b19e2714-4013-414a-9724-0afbe85f19d2 req-7821eb0b-3d7c-40d5-87eb-ee9e55bb6ed7 service nova] Creating event network-changed:76b589bd-9542-447f-bbdb-99d1e40e6f28 for instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c on n-h2-860892-1 Oct 11 04:59:04.284129 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-b19e2714-4013-414a-9724-0afbe85f19d2 req-7821eb0b-3d7c-40d5-87eb-ee9e55bb6ed7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057944 Oct 11 04:59:04.285374 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3335/6906] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:59:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:59:04.704639 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-efd687d3-a4d7-482b-8c8b-b5f2da9d1b19 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 204 len: 0 microversion: 2.1 time: 0.479386 Oct 11 04:59:04.709729 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3572/6907] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 04:59:04 2022] DELETE /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 0 bytes in 484 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 04:59:04.716155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eaef2f48-ab7d-496e-8f14-c243ed5c3e0c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:04.716866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eaef2f48-ab7d-496e-8f14-c243ed5c3e0c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:04.724351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaef2f48-ab7d-496e-8f14-c243ed5c3e0c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:04.724811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaef2f48-ab7d-496e-8f14-c243ed5c3e0c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:04.725252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaef2f48-ab7d-496e-8f14-c243ed5c3e0c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:04.726131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaef2f48-ab7d-496e-8f14-c243ed5c3e0c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:04.726723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaef2f48-ab7d-496e-8f14-c243ed5c3e0c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:04.727916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaef2f48-ab7d-496e-8f14-c243ed5c3e0c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:04.926616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eaef2f48-ab7d-496e-8f14-c243ed5c3e0c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:04.935317 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eaef2f48-ab7d-496e-8f14-c243ed5c3e0c tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1687 microversion: 2.1 time: 0.224104 Oct 11 04:59:04.936269 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3336/6908] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:04 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1687 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:05.963097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c613d397-85a0-40de-b991-7aa9c396ab70 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:05.964135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c613d397-85a0-40de-b991-7aa9c396ab70 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:05.972947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c613d397-85a0-40de-b991-7aa9c396ab70 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:05.972947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c613d397-85a0-40de-b991-7aa9c396ab70 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:05.973307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c613d397-85a0-40de-b991-7aa9c396ab70 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:05.973994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c613d397-85a0-40de-b991-7aa9c396ab70 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:05.974476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c613d397-85a0-40de-b991-7aa9c396ab70 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:05.974901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c613d397-85a0-40de-b991-7aa9c396ab70 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:06.048163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c613d397-85a0-40de-b991-7aa9c396ab70 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:06.055289 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c613d397-85a0-40de-b991-7aa9c396ab70 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 200 len: 1503 microversion: 2.1 time: 0.098361 Oct 11 04:59:06.057853 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3573/6909] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:05 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 1503 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:06.300984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ba06713f-a0f3-4267-b783-88e734455b4a req-fd4c96d9-74c4-4ad3-9c81-0c7c82e9e917 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ea20fda-b6ae-4ea1-9fb4-69598388152c", "name": "network-vif-deleted", "tag": "76b589bd-9542-447f-bbdb-99d1e40e6f28"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:59:06.312293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ba06713f-a0f3-4267-b783-88e734455b4a req-fd4c96d9-74c4-4ad3-9c81-0c7c82e9e917 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:06.312771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ba06713f-a0f3-4267-b783-88e734455b4a req-fd4c96d9-74c4-4ad3-9c81-0c7c82e9e917 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:06.313239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ba06713f-a0f3-4267-b783-88e734455b4a req-fd4c96d9-74c4-4ad3-9c81-0c7c82e9e917 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:06.325052 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ba06713f-a0f3-4267-b783-88e734455b4a req-fd4c96d9-74c4-4ad3-9c81-0c7c82e9e917 service nova] Creating event network-vif-deleted:76b589bd-9542-447f-bbdb-99d1e40e6f28 for instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c on n-h2-860892-1 Oct 11 04:59:06.329887 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ba06713f-a0f3-4267-b783-88e734455b4a req-fd4c96d9-74c4-4ad3-9c81-0c7c82e9e917 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033123 Oct 11 04:59:06.334653 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3337/6910] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:59:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:59:07.080762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:07.081315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 4ea20fda-b6ae-4ea1-9fb4-69598388152c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:07.088299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:07.088791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:07.089257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:07.089969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:07.090495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:07.090927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:07.105523 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] HTTP exception thrown: Instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c could not be found. Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Request method failure captured: Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c HTTP/1.1 Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPZOmLgKK4_rGEqcfRvPG5-B5jE_W_hW1umV2HHwPr_-PqoXoTuO9xWNfdwCvuqkk__W92sbX-UegCPlkKHZuWEcPWyxSAwVWciQca_oOy5hP9AgxPmgCoSu03wcwoIUyN1G_-hkFHXD5HmBCbCjYiW7gnXKdJKE6dp4Z_oLc05Ol4A Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: e30500ead1404e5188c6d90e5b302742 Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e30500ead1404e5188c6d90e5b302742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e30500ead1404e5188c6d90e5b302742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e30500ead1404e5188c6d90e5b302742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e30500ead1404e5188c6d90e5b302742"}]}] Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: e30500ead1404e5188c6d90e5b302742 Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestNetworkAdvancedServerOps-1013665673-project Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a95598cd3fe04a0abff7aac9f0c49bff Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1013665673-project Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c could not be found. Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '4ea20fda-b6ae-4ea1-9fb4-69598388152c'} Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c could not be found. Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c could not be found. Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:59:07.107367 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 04:59:07.114731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:59:07.114731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 04:59:07.114731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 04:59:07.114731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 04:59:07.114731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 04:59:07.114731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 04:59:07.114731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c could not be found. Oct 11 04:59:07.114731 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 04:59:07.114731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Returning 404 to user: Instance 4ea20fda-b6ae-4ea1-9fb4-69598388152c could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 04:59:07.114731 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0ec0bbe6-697e-413a-b614-5a4980ddd685 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c" status: 404 len: 111 microversion: 2.1 time: 0.032126 Oct 11 04:59:07.114731 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3574/6911] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:07 2022] GET /compute/v2.1/servers/4ea20fda-b6ae-4ea1-9fb4-69598388152c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 04:59:10.971110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bca5687c-11f7-4f41-b148-589d6df0d7fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '.version_select at 0x7fda18760a60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:11.097077 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bca5687c-11f7-4f41-b148-589d6df0d7fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1422481425" status: 202 len: 0 microversion: 2.1 time: 0.131168 Oct 11 04:59:11.097722 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3338/6912] 10.222.0.26 () {58 vars in 1284 bytes} [Tue Oct 11 04:59:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1422481425 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 04:59:11.130018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8d0060e7-3052-46c8-bad8-aa6fc4487912 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'create', calling method: .version_select at 0x7fda1a0380d0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-1068534364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBChoi3vNyi7ctnaTH7gc0kyGYyh6VanUciAZmOlJFYvpX7nTqzUvhU1iCRQYQ4bBxqly2Q0QtWrjuNuiI0B04suAyYAEUhG1qd6gv7/a56HVHBxh4T/O51HmRfi6J2iijQ=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:59:11.149609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-8d0060e7-3052-46c8-bad8-aa6fc4487912 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for project e30500ead1404e5188c6d90e5b302742. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:59:11.156790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-8d0060e7-3052-46c8-bad8-aa6fc4487912 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for user a95598cd3fe04a0abff7aac9f0c49bff and project e30500ead1404e5188c6d90e5b302742. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:59:11.262777 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8d0060e7-3052-46c8-bad8-aa6fc4487912 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.136775 Oct 11 04:59:11.263659 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3575/6913] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 04:59:11 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:59:20.436875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:59:20.446689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-2093015949", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "f1939a18-a060-4331-a3e0-7bcca5c8e686"}], "key_name": "tempest-TestNetworkAdvancedServerOps-1068534364", "security_groups": [{"name": "tempest-secgroup-smoke-69220672"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:59:20.457876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:59:20.586406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] validate_networks() for [('f1939a18-a060-4331-a3e0-7bcca5c8e686', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 04:59:21.329250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 04:59:21.330753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 04:59:21.331427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 04:59:21.332030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 04:59:21.332624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 04:59:21.343437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:21.348360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:21.348360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:21.348360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:21.348360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:21.348360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:21.405073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for project e30500ead1404e5188c6d90e5b302742. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 04:59:21.421300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Getting quotas for user a95598cd3fe04a0abff7aac9f0c49bff and project e30500ead1404e5188c6d90e5b302742. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 04:59:21.453843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 04:59:21.458460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 04:59:21.670807 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4fb0e844-efa8-451d-9784-0020fa404a83 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.235492 Oct 11 04:59:21.672221 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3339/6914] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 04:59:20 2022] POST /compute/v2.1/servers => generated 404 bytes in 1238 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 04:59:21.684263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-949df37b-53ad-44a2-b694-845066c31fba tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:21.685514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-949df37b-53ad-44a2-b694-845066c31fba tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:21.695337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:59:21.699378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:59:21.701487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:59:21.761822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-949df37b-53ad-44a2-b694-845066c31fba tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:21.772504 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-949df37b-53ad-44a2-b694-845066c31fba tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1267 microversion: 2.1 time: 0.090445 Oct 11 04:59:21.786582 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3576/6915] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:21 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1267 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:22.797376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-23d9ebd5-a3fd-4c7b-add6-247be9f2d959 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:22.798665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-23d9ebd5-a3fd-4c7b-add6-247be9f2d959 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:22.804953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23d9ebd5-a3fd-4c7b-add6-247be9f2d959 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:22.805446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23d9ebd5-a3fd-4c7b-add6-247be9f2d959 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:22.805945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23d9ebd5-a3fd-4c7b-add6-247be9f2d959 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:22.806682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23d9ebd5-a3fd-4c7b-add6-247be9f2d959 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:22.807141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23d9ebd5-a3fd-4c7b-add6-247be9f2d959 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:22.807589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-23d9ebd5-a3fd-4c7b-add6-247be9f2d959 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:22.888016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-23d9ebd5-a3fd-4c7b-add6-247be9f2d959 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:22.898658 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-23d9ebd5-a3fd-4c7b-add6-247be9f2d959 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1271 microversion: 2.1 time: 0.104848 Oct 11 04:59:22.898658 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3340/6916] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:22 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1271 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:23.921501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0fd2e7a0-0f3a-4176-b132-2505a8133756 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:23.927060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0fd2e7a0-0f3a-4176-b132-2505a8133756 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:23.932958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd2e7a0-0f3a-4176-b132-2505a8133756 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:23.933456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd2e7a0-0f3a-4176-b132-2505a8133756 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:23.933905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd2e7a0-0f3a-4176-b132-2505a8133756 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:23.934641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd2e7a0-0f3a-4176-b132-2505a8133756 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:23.935099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd2e7a0-0f3a-4176-b132-2505a8133756 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:23.935542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0fd2e7a0-0f3a-4176-b132-2505a8133756 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:24.006524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0fd2e7a0-0f3a-4176-b132-2505a8133756 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:24.014526 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0fd2e7a0-0f3a-4176-b132-2505a8133756 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1319 microversion: 2.1 time: 0.097944 Oct 11 04:59:24.015111 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3577/6917] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:23 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1319 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:25.037829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fa30052f-dd71-45f6-b64b-9f2470629acd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:25.038577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fa30052f-dd71-45f6-b64b-9f2470629acd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:25.045957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa30052f-dd71-45f6-b64b-9f2470629acd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:25.046564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa30052f-dd71-45f6-b64b-9f2470629acd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:25.047012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa30052f-dd71-45f6-b64b-9f2470629acd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:25.047718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa30052f-dd71-45f6-b64b-9f2470629acd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:25.048176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa30052f-dd71-45f6-b64b-9f2470629acd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:25.048606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa30052f-dd71-45f6-b64b-9f2470629acd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:25.247898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa30052f-dd71-45f6-b64b-9f2470629acd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:25.256036 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fa30052f-dd71-45f6-b64b-9f2470629acd tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1391 microversion: 2.1 time: 0.222067 Oct 11 04:59:25.265942 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3341/6918] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:25 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1391 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:25.952790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a28fdec7-396b-4d49-91d1-1df1ad7a5bec req-dcee8488-7d63-441f-b2c8-faf4bb88e3e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "452c465e-1b1b-47c7-9ca3-a8a47914389a", "tag": "ecf1dec2-849d-436a-b3b2-eb9b94cf4550"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:59:25.965451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a28fdec7-396b-4d49-91d1-1df1ad7a5bec req-dcee8488-7d63-441f-b2c8-faf4bb88e3e9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:25.966438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a28fdec7-396b-4d49-91d1-1df1ad7a5bec req-dcee8488-7d63-441f-b2c8-faf4bb88e3e9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:25.966639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a28fdec7-396b-4d49-91d1-1df1ad7a5bec req-dcee8488-7d63-441f-b2c8-faf4bb88e3e9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:25.979432 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a28fdec7-396b-4d49-91d1-1df1ad7a5bec req-dcee8488-7d63-441f-b2c8-faf4bb88e3e9 service nova] Creating event network-changed:ecf1dec2-849d-436a-b3b2-eb9b94cf4550 for instance 452c465e-1b1b-47c7-9ca3-a8a47914389a on n-h1-860892-1 Oct 11 04:59:25.984780 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a28fdec7-396b-4d49-91d1-1df1ad7a5bec req-dcee8488-7d63-441f-b2c8-faf4bb88e3e9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036448 Oct 11 04:59:25.985387 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3578/6919] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:59:26.281030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2cfb9559-5b37-488a-972b-a61deab9a297 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:26.281725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2cfb9559-5b37-488a-972b-a61deab9a297 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:26.291654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfb9559-5b37-488a-972b-a61deab9a297 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:26.291654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfb9559-5b37-488a-972b-a61deab9a297 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:26.291654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfb9559-5b37-488a-972b-a61deab9a297 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:26.291654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfb9559-5b37-488a-972b-a61deab9a297 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:26.291654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfb9559-5b37-488a-972b-a61deab9a297 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:26.291654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2cfb9559-5b37-488a-972b-a61deab9a297 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:26.527438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2cfb9559-5b37-488a-972b-a61deab9a297 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:26.535854 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2cfb9559-5b37-488a-972b-a61deab9a297 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1391 microversion: 2.1 time: 0.259404 Oct 11 04:59:26.546278 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3342/6920] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:26 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1391 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:27.560229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e53b88ff-e0d3-4578-856b-06710d81ede3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:27.560939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e53b88ff-e0d3-4578-856b-06710d81ede3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:27.568451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e53b88ff-e0d3-4578-856b-06710d81ede3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:27.568940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e53b88ff-e0d3-4578-856b-06710d81ede3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:27.570072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e53b88ff-e0d3-4578-856b-06710d81ede3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:27.570801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e53b88ff-e0d3-4578-856b-06710d81ede3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:27.571258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e53b88ff-e0d3-4578-856b-06710d81ede3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:27.571690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e53b88ff-e0d3-4578-856b-06710d81ede3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:27.704865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e53b88ff-e0d3-4578-856b-06710d81ede3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:27.713444 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e53b88ff-e0d3-4578-856b-06710d81ede3 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1391 microversion: 2.1 time: 0.158144 Oct 11 04:59:27.714027 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3579/6921] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:27 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:28.736394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-628ad2a8-96e6-4ebe-a7cb-2078cb12b952 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:28.737019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-628ad2a8-96e6-4ebe-a7cb-2078cb12b952 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:28.744463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628ad2a8-96e6-4ebe-a7cb-2078cb12b952 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:28.744949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628ad2a8-96e6-4ebe-a7cb-2078cb12b952 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:28.745394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628ad2a8-96e6-4ebe-a7cb-2078cb12b952 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:28.746093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628ad2a8-96e6-4ebe-a7cb-2078cb12b952 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:28.746582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628ad2a8-96e6-4ebe-a7cb-2078cb12b952 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:28.747015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-628ad2a8-96e6-4ebe-a7cb-2078cb12b952 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:28.884020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-628ad2a8-96e6-4ebe-a7cb-2078cb12b952 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:28.892051 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-628ad2a8-96e6-4ebe-a7cb-2078cb12b952 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1391 microversion: 2.1 time: 0.159621 Oct 11 04:59:28.892611 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3343/6922] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:28 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:29.914772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d5825133-90da-40d5-9801-fc4ede2936c2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:29.915590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d5825133-90da-40d5-9801-fc4ede2936c2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:29.922600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5825133-90da-40d5-9801-fc4ede2936c2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:29.928418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5825133-90da-40d5-9801-fc4ede2936c2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:29.928418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5825133-90da-40d5-9801-fc4ede2936c2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:29.928418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5825133-90da-40d5-9801-fc4ede2936c2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:29.928418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5825133-90da-40d5-9801-fc4ede2936c2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:29.928418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d5825133-90da-40d5-9801-fc4ede2936c2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:30.062139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d5825133-90da-40d5-9801-fc4ede2936c2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:30.070305 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d5825133-90da-40d5-9801-fc4ede2936c2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1391 microversion: 2.1 time: 0.159889 Oct 11 04:59:30.070915 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3580/6923] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:29 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:31.094443 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8c87222c-ad8b-4292-a38e-a80278912484 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:31.095139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8c87222c-ad8b-4292-a38e-a80278912484 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:31.101728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c87222c-ad8b-4292-a38e-a80278912484 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:31.102231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c87222c-ad8b-4292-a38e-a80278912484 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:31.102679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c87222c-ad8b-4292-a38e-a80278912484 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:31.103497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c87222c-ad8b-4292-a38e-a80278912484 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:31.103957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c87222c-ad8b-4292-a38e-a80278912484 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:31.104378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8c87222c-ad8b-4292-a38e-a80278912484 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:31.240006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8c87222c-ad8b-4292-a38e-a80278912484 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:31.248408 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8c87222c-ad8b-4292-a38e-a80278912484 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1391 microversion: 2.1 time: 0.158132 Oct 11 04:59:31.249113 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3344/6924] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:31 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:32.271585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e63b18e2-51d0-437b-8c97-21a9434b6e30 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:32.273012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e63b18e2-51d0-437b-8c97-21a9434b6e30 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:32.279998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e63b18e2-51d0-437b-8c97-21a9434b6e30 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:32.280471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e63b18e2-51d0-437b-8c97-21a9434b6e30 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:32.281082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e63b18e2-51d0-437b-8c97-21a9434b6e30 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:32.281692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e63b18e2-51d0-437b-8c97-21a9434b6e30 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:32.282139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e63b18e2-51d0-437b-8c97-21a9434b6e30 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:32.282590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e63b18e2-51d0-437b-8c97-21a9434b6e30 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:32.431914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e63b18e2-51d0-437b-8c97-21a9434b6e30 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:32.440056 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e63b18e2-51d0-437b-8c97-21a9434b6e30 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1391 microversion: 2.1 time: 0.172327 Oct 11 04:59:32.440639 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3581/6925] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:32 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1391 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:33.143735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-eae3fe9c-b56e-4c01-b8a3-fa2018c04253 req-adf07f63-3501-4578-9e8e-f77502051a6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "452c465e-1b1b-47c7-9ca3-a8a47914389a", "name": "network-vif-plugged", "status": "completed", "tag": "ecf1dec2-849d-436a-b3b2-eb9b94cf4550"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:59:33.149594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:59:33.150329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:59:33.157156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-eae3fe9c-b56e-4c01-b8a3-fa2018c04253 req-adf07f63-3501-4578-9e8e-f77502051a6c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:33.160549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-eae3fe9c-b56e-4c01-b8a3-fa2018c04253 req-adf07f63-3501-4578-9e8e-f77502051a6c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:33.160549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-eae3fe9c-b56e-4c01-b8a3-fa2018c04253 req-adf07f63-3501-4578-9e8e-f77502051a6c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:33.169866 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-eae3fe9c-b56e-4c01-b8a3-fa2018c04253 req-adf07f63-3501-4578-9e8e-f77502051a6c service nova] Creating event network-vif-plugged:ecf1dec2-849d-436a-b3b2-eb9b94cf4550 for instance 452c465e-1b1b-47c7-9ca3-a8a47914389a on n-h1-860892-1 Oct 11 04:59:33.174937 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-eae3fe9c-b56e-4c01-b8a3-fa2018c04253 req-adf07f63-3501-4578-9e8e-f77502051a6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035245 Oct 11 04:59:33.175530 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3345/6926] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:59:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:59:33.463435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0bbb32af-d5ab-42b0-b273-91f0606d71b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:33.464034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0bbb32af-d5ab-42b0-b273-91f0606d71b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:33.471165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bbb32af-d5ab-42b0-b273-91f0606d71b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:33.471659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bbb32af-d5ab-42b0-b273-91f0606d71b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:33.472104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bbb32af-d5ab-42b0-b273-91f0606d71b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:33.472808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bbb32af-d5ab-42b0-b273-91f0606d71b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:33.473266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bbb32af-d5ab-42b0-b273-91f0606d71b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:33.473730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0bbb32af-d5ab-42b0-b273-91f0606d71b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:33.610535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0bbb32af-d5ab-42b0-b273-91f0606d71b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:33.619272 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0bbb32af-d5ab-42b0-b273-91f0606d71b2 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1391 microversion: 2.1 time: 0.160021 Oct 11 04:59:33.619954 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3582/6927] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:33 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:34.644476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-92460d8f-73df-43a8-a2c7-dbda72bb6dec tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:34.645175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-92460d8f-73df-43a8-a2c7-dbda72bb6dec tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:34.660739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92460d8f-73df-43a8-a2c7-dbda72bb6dec tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:34.664063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92460d8f-73df-43a8-a2c7-dbda72bb6dec tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:34.664063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92460d8f-73df-43a8-a2c7-dbda72bb6dec tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:34.664063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92460d8f-73df-43a8-a2c7-dbda72bb6dec tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:34.664063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92460d8f-73df-43a8-a2c7-dbda72bb6dec tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:34.664063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-92460d8f-73df-43a8-a2c7-dbda72bb6dec tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:34.806319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-92460d8f-73df-43a8-a2c7-dbda72bb6dec tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:34.814236 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-92460d8f-73df-43a8-a2c7-dbda72bb6dec tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1391 microversion: 2.1 time: 0.175516 Oct 11 04:59:34.816076 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3346/6928] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:34 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1391 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:35.837018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b995d797-1059-4d57-b89b-f6733ac159fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:35.837738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b995d797-1059-4d57-b89b-f6733ac159fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:35.839782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 04:59:35.845530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b995d797-1059-4d57-b89b-f6733ac159fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:35.846079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b995d797-1059-4d57-b89b-f6733ac159fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:35.846626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b995d797-1059-4d57-b89b-f6733ac159fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:35.847396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b995d797-1059-4d57-b89b-f6733ac159fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:35.847917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b995d797-1059-4d57-b89b-f6733ac159fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:35.848405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b995d797-1059-4d57-b89b-f6733ac159fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:35.999607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b995d797-1059-4d57-b89b-f6733ac159fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:36.012573 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b995d797-1059-4d57-b89b-f6733ac159fa tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1563 microversion: 2.1 time: 0.174755 Oct 11 04:59:36.012573 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3583/6929] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:35 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1563 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:36.041377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bee5e82-d726-4cf6-9365-b1b54f60f8f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:36.041377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0bee5e82-d726-4cf6-9365-b1b54f60f8f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:36.042716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bee5e82-d726-4cf6-9365-b1b54f60f8f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:36.043283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bee5e82-d726-4cf6-9365-b1b54f60f8f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:36.043793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bee5e82-d726-4cf6-9365-b1b54f60f8f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:36.044557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bee5e82-d726-4cf6-9365-b1b54f60f8f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:36.045205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bee5e82-d726-4cf6-9365-b1b54f60f8f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:36.045636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bee5e82-d726-4cf6-9365-b1b54f60f8f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:36.190994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0bee5e82-d726-4cf6-9365-b1b54f60f8f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:36.199279 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0bee5e82-d726-4cf6-9365-b1b54f60f8f6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1563 microversion: 2.1 time: 0.170064 Oct 11 04:59:36.200356 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3347/6930] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:36 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 04:59:38.570530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-34cb7491-ae89-477b-bc6c-fd4736ef2f24 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 04:59:38.572549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6a971e5e-6b52-443f-8a63-10c599ef1479 req-224eba32-470c-4590-ac5a-43e178116a58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "452c465e-1b1b-47c7-9ca3-a8a47914389a", "tag": "ecf1dec2-849d-436a-b3b2-eb9b94cf4550"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 04:59:38.573478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-34cb7491-ae89-477b-bc6c-fd4736ef2f24 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 04:59:38.584332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6a971e5e-6b52-443f-8a63-10c599ef1479 req-224eba32-470c-4590-ac5a-43e178116a58 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:38.585254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6a971e5e-6b52-443f-8a63-10c599ef1479 req-224eba32-470c-4590-ac5a-43e178116a58 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:38.585930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6a971e5e-6b52-443f-8a63-10c599ef1479 req-224eba32-470c-4590-ac5a-43e178116a58 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:38.586440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34cb7491-ae89-477b-bc6c-fd4736ef2f24 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:38.586935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34cb7491-ae89-477b-bc6c-fd4736ef2f24 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:38.588000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34cb7491-ae89-477b-bc6c-fd4736ef2f24 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:38.588713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34cb7491-ae89-477b-bc6c-fd4736ef2f24 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 04:59:38.589169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34cb7491-ae89-477b-bc6c-fd4736ef2f24 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 04:59:38.589796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34cb7491-ae89-477b-bc6c-fd4736ef2f24 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 04:59:38.603249 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6a971e5e-6b52-443f-8a63-10c599ef1479 req-224eba32-470c-4590-ac5a-43e178116a58 service nova] Creating event network-changed:ecf1dec2-849d-436a-b3b2-eb9b94cf4550 for instance 452c465e-1b1b-47c7-9ca3-a8a47914389a on n-h1-860892-1 Oct 11 04:59:38.615199 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6a971e5e-6b52-443f-8a63-10c599ef1479 req-224eba32-470c-4590-ac5a-43e178116a58 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046627 Oct 11 04:59:38.618572 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3348/6931] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 04:59:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 04:59:38.744536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-34cb7491-ae89-477b-bc6c-fd4736ef2f24 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 04:59:38.752704 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-34cb7491-ae89-477b-bc6c-fd4736ef2f24 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1563 microversion: 2.1 time: 0.189258 Oct 11 04:59:38.753658 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3584/6932] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 04:59:38 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1563 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:10.049305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:00:10.050055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=48 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:00:10.054946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-14fc9b81-a207-4e07-9da9-7112946bcb8b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:00:10.057206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-14fc9b81-a207-4e07-9da9-7112946bcb8b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:10.063377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14fc9b81-a207-4e07-9da9-7112946bcb8b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:10.063860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14fc9b81-a207-4e07-9da9-7112946bcb8b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:10.064300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14fc9b81-a207-4e07-9da9-7112946bcb8b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:10.064993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14fc9b81-a207-4e07-9da9-7112946bcb8b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:10.065446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14fc9b81-a207-4e07-9da9-7112946bcb8b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:10.065876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-14fc9b81-a207-4e07-9da9-7112946bcb8b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:10.124935 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-14fc9b81-a207-4e07-9da9-7112946bcb8b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a/action" status: 200 len: 24569 microversion: 2.1 time: 0.077620 Oct 11 05:00:10.125575 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3349/6933] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:00:10 2022] POST /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a/action => generated 24569 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:00:40.556428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=20 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:00:40.557307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=44 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:00:40.558600 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:00:40.558750 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:00:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a/action (ip 10.222.0.26) !!! Oct 11 05:00:40.563071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"rebuild": {"imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:00:40.571849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:40.573637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:40.574120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:40.574605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:40.575294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:40.575749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:40.576167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:40.660084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:00:40.660504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:00:40.660984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:00:40.661436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:00:40.661861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:00:40.879460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:40.886309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:40.886794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:40.887282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:40.887985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:40.888433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:40.888851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:40.916926 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1316e2a2-5253-4d94-883f-7e6e345eab15 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a/action" status: 202 len: 1138 microversion: 2.1 time: 0.362451 Oct 11 05:00:40.917943 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3585/6934] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:00:40 2022] POST /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a/action => generated 1138 bytes in 364 msecs (HTTP/1.1 202) 10 headers in 452 bytes (2 switches on core 0) Oct 11 05:00:40.937740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ee122fd9-4433-4a68-a186-5dda304747b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:40.940576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ee122fd9-4433-4a68-a186-5dda304747b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:40.941083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:00:40.948223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee122fd9-4433-4a68-a186-5dda304747b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:40.948709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee122fd9-4433-4a68-a186-5dda304747b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:40.949152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee122fd9-4433-4a68-a186-5dda304747b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:40.949860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee122fd9-4433-4a68-a186-5dda304747b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:40.950337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee122fd9-4433-4a68-a186-5dda304747b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:40.950770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ee122fd9-4433-4a68-a186-5dda304747b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:41.092026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ee122fd9-4433-4a68-a186-5dda304747b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:41.099759 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ee122fd9-4433-4a68-a186-5dda304747b1 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1691 microversion: 2.1 time: 0.166745 Oct 11 05:00:41.100314 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3350/6935] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:40 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1691 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:42.123339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-089b900c-8a5a-4c68-a92c-b9fb8c8944b6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:42.123991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-089b900c-8a5a-4c68-a92c-b9fb8c8944b6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:42.131811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089b900c-8a5a-4c68-a92c-b9fb8c8944b6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:42.132805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089b900c-8a5a-4c68-a92c-b9fb8c8944b6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:42.133691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089b900c-8a5a-4c68-a92c-b9fb8c8944b6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:42.134775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089b900c-8a5a-4c68-a92c-b9fb8c8944b6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:42.134889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089b900c-8a5a-4c68-a92c-b9fb8c8944b6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:42.135301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-089b900c-8a5a-4c68-a92c-b9fb8c8944b6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:42.380300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-089b900c-8a5a-4c68-a92c-b9fb8c8944b6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:42.389930 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-089b900c-8a5a-4c68-a92c-b9fb8c8944b6 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1691 microversion: 2.1 time: 0.270577 Oct 11 05:00:42.390552 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3586/6936] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:42 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1691 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:43.412967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98295575-45df-4e3b-ac37-a4dd9a8d3e06 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:43.414056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98295575-45df-4e3b-ac37-a4dd9a8d3e06 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:43.423163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98295575-45df-4e3b-ac37-a4dd9a8d3e06 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:43.429573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98295575-45df-4e3b-ac37-a4dd9a8d3e06 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:43.429573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98295575-45df-4e3b-ac37-a4dd9a8d3e06 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:43.429573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98295575-45df-4e3b-ac37-a4dd9a8d3e06 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:43.429573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98295575-45df-4e3b-ac37-a4dd9a8d3e06 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:43.429573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98295575-45df-4e3b-ac37-a4dd9a8d3e06 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:43.609236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-98295575-45df-4e3b-ac37-a4dd9a8d3e06 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:43.618110 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98295575-45df-4e3b-ac37-a4dd9a8d3e06 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1691 microversion: 2.1 time: 0.209020 Oct 11 05:00:43.621451 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3351/6937] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:43 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:44.642590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ee5de05-b902-4c96-bb67-08cb7e5a8f54 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:44.643360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3ee5de05-b902-4c96-bb67-08cb7e5a8f54 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:44.655675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee5de05-b902-4c96-bb67-08cb7e5a8f54 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:44.655675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee5de05-b902-4c96-bb67-08cb7e5a8f54 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:44.655675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee5de05-b902-4c96-bb67-08cb7e5a8f54 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:44.655675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee5de05-b902-4c96-bb67-08cb7e5a8f54 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:44.655675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee5de05-b902-4c96-bb67-08cb7e5a8f54 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:44.656876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3ee5de05-b902-4c96-bb67-08cb7e5a8f54 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:44.887750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3ee5de05-b902-4c96-bb67-08cb7e5a8f54 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:44.897189 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3ee5de05-b902-4c96-bb67-08cb7e5a8f54 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1691 microversion: 2.1 time: 0.258477 Oct 11 05:00:44.897843 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3587/6938] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:44 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1691 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:45.920573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bf8ba0d8-9079-457b-ac39-5c1381e87727 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:45.921182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bf8ba0d8-9079-457b-ac39-5c1381e87727 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:45.928109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf8ba0d8-9079-457b-ac39-5c1381e87727 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:45.929336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf8ba0d8-9079-457b-ac39-5c1381e87727 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:45.929336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf8ba0d8-9079-457b-ac39-5c1381e87727 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:45.930335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf8ba0d8-9079-457b-ac39-5c1381e87727 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:45.930789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf8ba0d8-9079-457b-ac39-5c1381e87727 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:45.931213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf8ba0d8-9079-457b-ac39-5c1381e87727 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:46.073894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf8ba0d8-9079-457b-ac39-5c1381e87727 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:46.081643 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bf8ba0d8-9079-457b-ac39-5c1381e87727 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1691 microversion: 2.1 time: 0.164947 Oct 11 05:00:46.082553 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3352/6939] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:45 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1691 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:47.105253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3d618938-f7c7-47b0-a533-c86c5134ddd0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:47.105921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3d618938-f7c7-47b0-a533-c86c5134ddd0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:47.115775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d618938-f7c7-47b0-a533-c86c5134ddd0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:47.117035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d618938-f7c7-47b0-a533-c86c5134ddd0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:47.117692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d618938-f7c7-47b0-a533-c86c5134ddd0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:47.118662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d618938-f7c7-47b0-a533-c86c5134ddd0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:47.119325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d618938-f7c7-47b0-a533-c86c5134ddd0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:47.120185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d618938-f7c7-47b0-a533-c86c5134ddd0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:47.652423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3d618938-f7c7-47b0-a533-c86c5134ddd0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:47.661390 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3d618938-f7c7-47b0-a533-c86c5134ddd0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1691 microversion: 2.1 time: 0.559389 Oct 11 05:00:47.666234 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3588/6940] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:47 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1691 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:48.684806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5b6ee6ae-1b46-4441-acad-23245f9fc3e0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:48.686059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5b6ee6ae-1b46-4441-acad-23245f9fc3e0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:48.693185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee6ae-1b46-4441-acad-23245f9fc3e0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:48.694654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee6ae-1b46-4441-acad-23245f9fc3e0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:48.695285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee6ae-1b46-4441-acad-23245f9fc3e0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:48.696020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee6ae-1b46-4441-acad-23245f9fc3e0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:48.696953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee6ae-1b46-4441-acad-23245f9fc3e0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:48.697398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5b6ee6ae-1b46-4441-acad-23245f9fc3e0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:48.922813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5b6ee6ae-1b46-4441-acad-23245f9fc3e0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:48.931987 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5b6ee6ae-1b46-4441-acad-23245f9fc3e0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1691 microversion: 2.1 time: 0.251296 Oct 11 05:00:48.932574 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3353/6941] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:48 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1691 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:49.960380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ac9bd6e8-fdc5-48b5-ab07-14327ac6773b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:49.962262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ac9bd6e8-fdc5-48b5-ab07-14327ac6773b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:49.992414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac9bd6e8-fdc5-48b5-ab07-14327ac6773b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:49.992414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac9bd6e8-fdc5-48b5-ab07-14327ac6773b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:49.994512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac9bd6e8-fdc5-48b5-ab07-14327ac6773b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:49.995578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac9bd6e8-fdc5-48b5-ab07-14327ac6773b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:49.996077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac9bd6e8-fdc5-48b5-ab07-14327ac6773b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:49.996530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac9bd6e8-fdc5-48b5-ab07-14327ac6773b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:50.181389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ac9bd6e8-fdc5-48b5-ab07-14327ac6773b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:50.190590 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ac9bd6e8-fdc5-48b5-ab07-14327ac6773b tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1691 microversion: 2.1 time: 0.237910 Oct 11 05:00:50.191514 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3589/6942] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:49 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1691 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:00:51.217877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d554cc74-966e-4e55-b140-f0693ea0e2c0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:51.219872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d554cc74-966e-4e55-b140-f0693ea0e2c0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:51.229479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d554cc74-966e-4e55-b140-f0693ea0e2c0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:51.230430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d554cc74-966e-4e55-b140-f0693ea0e2c0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:51.231224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d554cc74-966e-4e55-b140-f0693ea0e2c0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:51.232070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d554cc74-966e-4e55-b140-f0693ea0e2c0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:51.232769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d554cc74-966e-4e55-b140-f0693ea0e2c0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:51.233461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d554cc74-966e-4e55-b140-f0693ea0e2c0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:51.453937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d554cc74-966e-4e55-b140-f0693ea0e2c0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:51.468749 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d554cc74-966e-4e55-b140-f0693ea0e2c0 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1691 microversion: 2.1 time: 0.255929 Oct 11 05:00:51.471277 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3354/6943] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:51 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1691 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:52.494151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e567535d-77a2-4de4-911d-0116fa7314d8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:52.494726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e567535d-77a2-4de4-911d-0116fa7314d8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:52.501669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567535d-77a2-4de4-911d-0116fa7314d8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:52.502150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567535d-77a2-4de4-911d-0116fa7314d8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:52.502618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567535d-77a2-4de4-911d-0116fa7314d8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:52.503305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567535d-77a2-4de4-911d-0116fa7314d8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:52.503755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567535d-77a2-4de4-911d-0116fa7314d8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:52.504178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e567535d-77a2-4de4-911d-0116fa7314d8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:52.643265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e567535d-77a2-4de4-911d-0116fa7314d8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:52.651289 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e567535d-77a2-4de4-911d-0116fa7314d8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1691 microversion: 2.1 time: 0.161751 Oct 11 05:00:52.651869 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3590/6944] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:52 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:53.675578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e4d01c4c-eeb5-4d2a-b5d5-fc4e582f9f0e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:53.676776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e4d01c4c-eeb5-4d2a-b5d5-fc4e582f9f0e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:53.685172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d01c4c-eeb5-4d2a-b5d5-fc4e582f9f0e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:53.685661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d01c4c-eeb5-4d2a-b5d5-fc4e582f9f0e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:53.686319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d01c4c-eeb5-4d2a-b5d5-fc4e582f9f0e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:53.687203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d01c4c-eeb5-4d2a-b5d5-fc4e582f9f0e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:53.687787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d01c4c-eeb5-4d2a-b5d5-fc4e582f9f0e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:53.688373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4d01c4c-eeb5-4d2a-b5d5-fc4e582f9f0e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:54.043999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e4d01c4c-eeb5-4d2a-b5d5-fc4e582f9f0e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:54.051710 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e4d01c4c-eeb5-4d2a-b5d5-fc4e582f9f0e tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1697 microversion: 2.1 time: 0.380138 Oct 11 05:00:54.052675 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3355/6945] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:53 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1697 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:00:55.076404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1c92df7-0fca-45a1-b41a-f3273a67d663 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:55.077023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b1c92df7-0fca-45a1-b41a-f3273a67d663 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:55.083623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1c92df7-0fca-45a1-b41a-f3273a67d663 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:55.084115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1c92df7-0fca-45a1-b41a-f3273a67d663 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:55.084551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1c92df7-0fca-45a1-b41a-f3273a67d663 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:55.085814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1c92df7-0fca-45a1-b41a-f3273a67d663 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:55.086305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1c92df7-0fca-45a1-b41a-f3273a67d663 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:55.086735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1c92df7-0fca-45a1-b41a-f3273a67d663 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:55.225648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b1c92df7-0fca-45a1-b41a-f3273a67d663 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:55.234107 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b1c92df7-0fca-45a1-b41a-f3273a67d663 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1697 microversion: 2.1 time: 0.161767 Oct 11 05:00:55.234723 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3591/6946] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:55 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:55.415117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-32bb8308-2d3d-47dd-bee4-8556c0b58b68 req-9748473c-328d-4ecd-aab2-47dd45a7e707 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "452c465e-1b1b-47c7-9ca3-a8a47914389a", "name": "network-vif-unplugged", "status": "completed", "tag": "ecf1dec2-849d-436a-b3b2-eb9b94cf4550"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:00:55.464867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-32bb8308-2d3d-47dd-bee4-8556c0b58b68 req-9748473c-328d-4ecd-aab2-47dd45a7e707 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:55.468078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-32bb8308-2d3d-47dd-bee4-8556c0b58b68 req-9748473c-328d-4ecd-aab2-47dd45a7e707 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:55.470318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-32bb8308-2d3d-47dd-bee4-8556c0b58b68 req-9748473c-328d-4ecd-aab2-47dd45a7e707 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:55.483992 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-32bb8308-2d3d-47dd-bee4-8556c0b58b68 req-9748473c-328d-4ecd-aab2-47dd45a7e707 service nova] Creating event network-vif-unplugged:ecf1dec2-849d-436a-b3b2-eb9b94cf4550 for instance 452c465e-1b1b-47c7-9ca3-a8a47914389a on n-h1-860892-1 Oct 11 05:00:55.490250 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-32bb8308-2d3d-47dd-bee4-8556c0b58b68 req-9748473c-328d-4ecd-aab2-47dd45a7e707 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.147470 Oct 11 05:00:55.491747 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3356/6947] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:00:55 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:00:55.742687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2015143900", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "01f5adb5-ac8f-4108-9413-b3ef4416703d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:00:55.808049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] validate_networks() for [('dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:00:56.250810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:00:56.251263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:00:56.251691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:00:56.252102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:00:56.252510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:00:56.257587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-de5b1ca7-56da-4a23-ae73-a41d47c1baee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:56.258656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-de5b1ca7-56da-4a23-ae73-a41d47c1baee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:56.261677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:56.262158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:56.262628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:56.263348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:56.263796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:56.264217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:56.265168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5b1ca7-56da-4a23-ae73-a41d47c1baee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:56.265653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5b1ca7-56da-4a23-ae73-a41d47c1baee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:56.266093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5b1ca7-56da-4a23-ae73-a41d47c1baee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:56.266810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5b1ca7-56da-4a23-ae73-a41d47c1baee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:56.267264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5b1ca7-56da-4a23-ae73-a41d47c1baee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:56.267695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-de5b1ca7-56da-4a23-ae73-a41d47c1baee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:56.281576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:00:56.286846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for user 5a1c61d68e1a479bb0dc096271f4cbde and project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:00:56.351013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:00:56.351013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='01f5adb5-ac8f-4108-9413-b3ef4416703d',volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:00:56.406837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-de5b1ca7-56da-4a23-ae73-a41d47c1baee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:56.414580 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-de5b1ca7-56da-4a23-ae73-a41d47c1baee tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1697 microversion: 2.1 time: 0.161227 Oct 11 05:00:56.415147 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3357/6948] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:56 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:56.768218 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2896a96b-60bd-47b0-a39b-3663488dbd1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.030060 Oct 11 05:00:56.768871 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3592/6949] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:00:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 1031 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:00:56.780260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f63aa94d-bf9f-4f3b-98a8-8f7dc9255923 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:56.780811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f63aa94d-bf9f-4f3b-98a8-8f7dc9255923 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:56.834647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f63aa94d-bf9f-4f3b-98a8-8f7dc9255923 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:56.842093 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f63aa94d-bf9f-4f3b-98a8-8f7dc9255923 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1057 microversion: 2.1 time: 0.065752 Oct 11 05:00:56.842705 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3358/6950] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:56 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1057 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:57.446435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fa6bcf6a-bcd5-4fda-812e-02527f097705 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:57.446435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fa6bcf6a-bcd5-4fda-812e-02527f097705 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:57.451470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa6bcf6a-bcd5-4fda-812e-02527f097705 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:57.451963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa6bcf6a-bcd5-4fda-812e-02527f097705 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:57.452395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa6bcf6a-bcd5-4fda-812e-02527f097705 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:57.454390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa6bcf6a-bcd5-4fda-812e-02527f097705 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:57.454877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa6bcf6a-bcd5-4fda-812e-02527f097705 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:57.455319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fa6bcf6a-bcd5-4fda-812e-02527f097705 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:57.613311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fa6bcf6a-bcd5-4fda-812e-02527f097705 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:57.621841 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fa6bcf6a-bcd5-4fda-812e-02527f097705 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1682 microversion: 2.1 time: 0.188817 Oct 11 05:00:57.622444 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3593/6951] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:57 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:00:57.865257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9aa9ec45-ed0a-469f-a998-2597a92e8717 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:57.865882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9aa9ec45-ed0a-469f-a998-2597a92e8717 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:57.924054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9aa9ec45-ed0a-469f-a998-2597a92e8717 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:57.931228 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9aa9ec45-ed0a-469f-a998-2597a92e8717 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1057 microversion: 2.1 time: 0.070088 Oct 11 05:00:57.931804 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3359/6952] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:57 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1057 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:58.954314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d1ac391-e9bb-4575-85e4-e191eea49521 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:00:58.954939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d1ac391-e9bb-4575-85e4-e191eea49521 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:00:58.961787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1ac391-e9bb-4575-85e4-e191eea49521 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:58.962310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1ac391-e9bb-4575-85e4-e191eea49521 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:58.965971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1ac391-e9bb-4575-85e4-e191eea49521 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:58.965971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1ac391-e9bb-4575-85e4-e191eea49521 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:58.965971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1ac391-e9bb-4575-85e4-e191eea49521 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:58.965971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d1ac391-e9bb-4575-85e4-e191eea49521 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:59.025952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7d1ac391-e9bb-4575-85e4-e191eea49521 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:00:59.033750 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d1ac391-e9bb-4575-85e4-e191eea49521 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1155 microversion: 2.1 time: 0.083380 Oct 11 05:00:59.034349 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3594/6953] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:00:58 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1155 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:00:59.451247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a4d49af6-bbb2-447f-9af0-2a4b5c9e852a req-39ed80c8-a246-47ac-b024-18ed26869d40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "452c465e-1b1b-47c7-9ca3-a8a47914389a", "name": "network-vif-plugged", "status": "completed", "tag": "ecf1dec2-849d-436a-b3b2-eb9b94cf4550"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:00:59.464314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a4d49af6-bbb2-447f-9af0-2a4b5c9e852a req-39ed80c8-a246-47ac-b024-18ed26869d40 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:00:59.465173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a4d49af6-bbb2-447f-9af0-2a4b5c9e852a req-39ed80c8-a246-47ac-b024-18ed26869d40 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:00:59.465875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a4d49af6-bbb2-447f-9af0-2a4b5c9e852a req-39ed80c8-a246-47ac-b024-18ed26869d40 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:00:59.481440 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a4d49af6-bbb2-447f-9af0-2a4b5c9e852a req-39ed80c8-a246-47ac-b024-18ed26869d40 service nova] Creating event network-vif-plugged:ecf1dec2-849d-436a-b3b2-eb9b94cf4550 for instance 452c465e-1b1b-47c7-9ca3-a8a47914389a on n-h1-860892-1 Oct 11 05:00:59.489132 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a4d49af6-bbb2-447f-9af0-2a4b5c9e852a req-39ed80c8-a246-47ac-b024-18ed26869d40 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041436 Oct 11 05:00:59.489925 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3360/6954] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:01:00.057681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a111aec8-6102-410a-bf25-be97e8405e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:00.058936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a111aec8-6102-410a-bf25-be97e8405e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:00.066503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a111aec8-6102-410a-bf25-be97e8405e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:00.067439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a111aec8-6102-410a-bf25-be97e8405e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:00.067875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a111aec8-6102-410a-bf25-be97e8405e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:00.068770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a111aec8-6102-410a-bf25-be97e8405e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:00.069234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a111aec8-6102-410a-bf25-be97e8405e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:00.069667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a111aec8-6102-410a-bf25-be97e8405e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:00.315643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a111aec8-6102-410a-bf25-be97e8405e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:00.321848 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a111aec8-6102-410a-bf25-be97e8405e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1215 microversion: 2.1 time: 0.268714 Oct 11 05:01:00.322983 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3595/6955] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:00 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1215 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:01.089207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-cf28c81c-08a4-44e8-a9e4-518c4d796862 req-4fa125ea-0c20-4a41-8c98-ea3d8ce0958d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "165226f3-3399-45af-90a3-bc89f481ecaf", "tag": "d83241ce-edb9-43f3-8d14-91dc1d77984c"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:01:01.101583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cf28c81c-08a4-44e8-a9e4-518c4d796862 req-4fa125ea-0c20-4a41-8c98-ea3d8ce0958d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:01.103007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cf28c81c-08a4-44e8-a9e4-518c4d796862 req-4fa125ea-0c20-4a41-8c98-ea3d8ce0958d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:01.103682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cf28c81c-08a4-44e8-a9e4-518c4d796862 req-4fa125ea-0c20-4a41-8c98-ea3d8ce0958d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:01.119545 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-cf28c81c-08a4-44e8-a9e4-518c4d796862 req-4fa125ea-0c20-4a41-8c98-ea3d8ce0958d service nova] Creating event network-changed:d83241ce-edb9-43f3-8d14-91dc1d77984c for instance 165226f3-3399-45af-90a3-bc89f481ecaf on n-h2-860892-1 Oct 11 05:01:01.124936 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-cf28c81c-08a4-44e8-a9e4-518c4d796862 req-4fa125ea-0c20-4a41-8c98-ea3d8ce0958d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040863 Oct 11 05:01:01.126107 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3361/6956] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:01:01.348941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fc68b91a-f052-4df3-a416-4e7b611f2d24 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:01.349712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fc68b91a-f052-4df3-a416-4e7b611f2d24 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:01.357195 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc68b91a-f052-4df3-a416-4e7b611f2d24 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:01.357764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc68b91a-f052-4df3-a416-4e7b611f2d24 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:01.358305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc68b91a-f052-4df3-a416-4e7b611f2d24 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:01.359088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc68b91a-f052-4df3-a416-4e7b611f2d24 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:01.359617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc68b91a-f052-4df3-a416-4e7b611f2d24 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:01.360155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc68b91a-f052-4df3-a416-4e7b611f2d24 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:01.502735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fc68b91a-f052-4df3-a416-4e7b611f2d24 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:01.516578 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fc68b91a-f052-4df3-a416-4e7b611f2d24 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1215 microversion: 2.1 time: 0.174023 Oct 11 05:01:01.517510 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3596/6957] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:01 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1215 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:02.540826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b704a6d7-5a7a-43db-9301-cb0f7b846fa5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:02.541520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b704a6d7-5a7a-43db-9301-cb0f7b846fa5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:02.547771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b704a6d7-5a7a-43db-9301-cb0f7b846fa5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:02.548248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b704a6d7-5a7a-43db-9301-cb0f7b846fa5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:02.548679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b704a6d7-5a7a-43db-9301-cb0f7b846fa5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:02.549357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b704a6d7-5a7a-43db-9301-cb0f7b846fa5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:02.549804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b704a6d7-5a7a-43db-9301-cb0f7b846fa5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:02.550252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b704a6d7-5a7a-43db-9301-cb0f7b846fa5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:02.686972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b704a6d7-5a7a-43db-9301-cb0f7b846fa5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:02.695459 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b704a6d7-5a7a-43db-9301-cb0f7b846fa5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1215 microversion: 2.1 time: 0.159802 Oct 11 05:01:02.701449 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3362/6958] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:02 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:03.718985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab0344a3-1bcc-4a5f-aef1-2cb99c87671f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:03.719605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab0344a3-1bcc-4a5f-aef1-2cb99c87671f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:03.727241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab0344a3-1bcc-4a5f-aef1-2cb99c87671f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:03.727729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab0344a3-1bcc-4a5f-aef1-2cb99c87671f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:03.728169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab0344a3-1bcc-4a5f-aef1-2cb99c87671f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:03.728893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab0344a3-1bcc-4a5f-aef1-2cb99c87671f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:03.729350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab0344a3-1bcc-4a5f-aef1-2cb99c87671f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:03.729777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab0344a3-1bcc-4a5f-aef1-2cb99c87671f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:03.862495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ab0344a3-1bcc-4a5f-aef1-2cb99c87671f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:03.870550 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab0344a3-1bcc-4a5f-aef1-2cb99c87671f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1215 microversion: 2.1 time: 0.155573 Oct 11 05:01:03.871168 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3597/6959] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:03 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1215 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:04.893867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bfba2ddb-601b-4813-ab0d-66071b1b8f19 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:04.894553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bfba2ddb-601b-4813-ab0d-66071b1b8f19 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:04.901230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfba2ddb-601b-4813-ab0d-66071b1b8f19 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:04.901714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfba2ddb-601b-4813-ab0d-66071b1b8f19 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:04.902152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfba2ddb-601b-4813-ab0d-66071b1b8f19 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:04.902854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfba2ddb-601b-4813-ab0d-66071b1b8f19 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:04.903300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfba2ddb-601b-4813-ab0d-66071b1b8f19 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:04.903721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfba2ddb-601b-4813-ab0d-66071b1b8f19 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:05.034361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bfba2ddb-601b-4813-ab0d-66071b1b8f19 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:05.042923 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bfba2ddb-601b-4813-ab0d-66071b1b8f19 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1215 microversion: 2.1 time: 0.152960 Oct 11 05:01:05.043497 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3363/6960] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:04 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1215 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:06.065358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e299ede-11cb-43e7-b8b2-f8719bb79422 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:06.066064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e299ede-11cb-43e7-b8b2-f8719bb79422 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:06.073780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e299ede-11cb-43e7-b8b2-f8719bb79422 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:06.074298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e299ede-11cb-43e7-b8b2-f8719bb79422 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:06.074735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e299ede-11cb-43e7-b8b2-f8719bb79422 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:06.075420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e299ede-11cb-43e7-b8b2-f8719bb79422 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:06.075872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e299ede-11cb-43e7-b8b2-f8719bb79422 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:06.076297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e299ede-11cb-43e7-b8b2-f8719bb79422 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:06.206874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e299ede-11cb-43e7-b8b2-f8719bb79422 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:06.215186 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e299ede-11cb-43e7-b8b2-f8719bb79422 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1203 microversion: 2.1 time: 0.153818 Oct 11 05:01:06.215763 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3598/6961] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:06 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:07.237253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb770230-38bd-4bd1-8909-956217a7e88f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:07.237770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fb770230-38bd-4bd1-8909-956217a7e88f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:07.245137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb770230-38bd-4bd1-8909-956217a7e88f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:07.245615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb770230-38bd-4bd1-8909-956217a7e88f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:07.246077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb770230-38bd-4bd1-8909-956217a7e88f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:07.246901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb770230-38bd-4bd1-8909-956217a7e88f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:07.247360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb770230-38bd-4bd1-8909-956217a7e88f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:07.247785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb770230-38bd-4bd1-8909-956217a7e88f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:07.378013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb770230-38bd-4bd1-8909-956217a7e88f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:07.386054 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb770230-38bd-4bd1-8909-956217a7e88f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1203 microversion: 2.1 time: 0.152833 Oct 11 05:01:07.386646 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3364/6962] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:07 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:08.408970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e16766af-fa97-40a5-b7a6-e000997e8aeb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:08.409511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e16766af-fa97-40a5-b7a6-e000997e8aeb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:08.411360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:08.412053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:08.418239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e16766af-fa97-40a5-b7a6-e000997e8aeb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:08.418743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e16766af-fa97-40a5-b7a6-e000997e8aeb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:08.419180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e16766af-fa97-40a5-b7a6-e000997e8aeb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:08.419873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e16766af-fa97-40a5-b7a6-e000997e8aeb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:08.420328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e16766af-fa97-40a5-b7a6-e000997e8aeb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:08.420754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e16766af-fa97-40a5-b7a6-e000997e8aeb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:08.548232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e16766af-fa97-40a5-b7a6-e000997e8aeb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:08.557235 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e16766af-fa97-40a5-b7a6-e000997e8aeb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1203 microversion: 2.1 time: 0.152240 Oct 11 05:01:08.557895 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3599/6963] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:08 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1203 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:09.579964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-04a324a9-5657-4f37-846e-6cdd438913e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:09.580585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-04a324a9-5657-4f37-846e-6cdd438913e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:09.582588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:09.588412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04a324a9-5657-4f37-846e-6cdd438913e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:09.588892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04a324a9-5657-4f37-846e-6cdd438913e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:09.589337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04a324a9-5657-4f37-846e-6cdd438913e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:09.590028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04a324a9-5657-4f37-846e-6cdd438913e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:09.590510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04a324a9-5657-4f37-846e-6cdd438913e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:09.590989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04a324a9-5657-4f37-846e-6cdd438913e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:09.801621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-04a324a9-5657-4f37-846e-6cdd438913e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:09.809359 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-04a324a9-5657-4f37-846e-6cdd438913e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1203 microversion: 2.1 time: 0.233424 Oct 11 05:01:09.809934 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3365/6964] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:09 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1203 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:10.832431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a0dc12a-0ba3-40af-bde3-a9921b678537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:10.833047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6a0dc12a-0ba3-40af-bde3-a9921b678537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:10.835819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:10.840575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a0dc12a-0ba3-40af-bde3-a9921b678537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:10.841504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a0dc12a-0ba3-40af-bde3-a9921b678537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:10.841946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a0dc12a-0ba3-40af-bde3-a9921b678537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:10.842667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a0dc12a-0ba3-40af-bde3-a9921b678537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:10.843120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a0dc12a-0ba3-40af-bde3-a9921b678537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:10.843547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a0dc12a-0ba3-40af-bde3-a9921b678537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:10.846076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:10.982113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a0dc12a-0ba3-40af-bde3-a9921b678537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:10.990008 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a0dc12a-0ba3-40af-bde3-a9921b678537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1203 microversion: 2.1 time: 0.161536 Oct 11 05:01:10.991291 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3600/6965] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:10 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1203 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:12.013458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-01eafe14-f4d3-41b3-8566-02f8d585edaf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:12.014107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-01eafe14-f4d3-41b3-8566-02f8d585edaf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:12.016915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=39 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:12.021595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01eafe14-f4d3-41b3-8566-02f8d585edaf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:12.022077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01eafe14-f4d3-41b3-8566-02f8d585edaf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:12.022549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01eafe14-f4d3-41b3-8566-02f8d585edaf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:12.023232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01eafe14-f4d3-41b3-8566-02f8d585edaf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:12.023686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01eafe14-f4d3-41b3-8566-02f8d585edaf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:12.024111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01eafe14-f4d3-41b3-8566-02f8d585edaf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:12.027966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=73 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:12.150493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-01eafe14-f4d3-41b3-8566-02f8d585edaf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:12.158288 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-01eafe14-f4d3-41b3-8566-02f8d585edaf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1203 microversion: 2.1 time: 0.148682 Oct 11 05:01:12.158849 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3366/6966] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:12 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1203 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:01:13.182175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e58af025-3b14-4e97-ac00-bfb2852eb635 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:13.182727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e58af025-3b14-4e97-ac00-bfb2852eb635 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:13.189686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58af025-3b14-4e97-ac00-bfb2852eb635 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:13.190181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58af025-3b14-4e97-ac00-bfb2852eb635 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:13.190644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58af025-3b14-4e97-ac00-bfb2852eb635 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:13.191336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58af025-3b14-4e97-ac00-bfb2852eb635 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:13.191785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58af025-3b14-4e97-ac00-bfb2852eb635 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:13.192206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e58af025-3b14-4e97-ac00-bfb2852eb635 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:13.318847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e58af025-3b14-4e97-ac00-bfb2852eb635 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:13.326578 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e58af025-3b14-4e97-ac00-bfb2852eb635 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1203 microversion: 2.1 time: 0.149580 Oct 11 05:01:13.327156 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3601/6967] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:13 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:14.350010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e45b6111-f4c5-4ea1-8e3a-45a0534c8113 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:14.350587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e45b6111-f4c5-4ea1-8e3a-45a0534c8113 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:14.357478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45b6111-f4c5-4ea1-8e3a-45a0534c8113 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:14.360750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45b6111-f4c5-4ea1-8e3a-45a0534c8113 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:14.360750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45b6111-f4c5-4ea1-8e3a-45a0534c8113 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:14.360750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45b6111-f4c5-4ea1-8e3a-45a0534c8113 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:14.360750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45b6111-f4c5-4ea1-8e3a-45a0534c8113 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:14.360750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e45b6111-f4c5-4ea1-8e3a-45a0534c8113 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:14.492182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e45b6111-f4c5-4ea1-8e3a-45a0534c8113 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:14.499911 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e45b6111-f4c5-4ea1-8e3a-45a0534c8113 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1203 microversion: 2.1 time: 0.154074 Oct 11 05:01:14.500478 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3367/6968] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:14 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1203 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:14.764616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-bedce800-7dc6-42bd-9ed2-6dc2809617df req-95cae385-c159-455b-83d2-087c46e05e22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165226f3-3399-45af-90a3-bc89f481ecaf", "name": "network-vif-plugged", "status": "completed", "tag": "d83241ce-edb9-43f3-8d14-91dc1d77984c"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:01:14.776249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bedce800-7dc6-42bd-9ed2-6dc2809617df req-95cae385-c159-455b-83d2-087c46e05e22 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:14.776724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bedce800-7dc6-42bd-9ed2-6dc2809617df req-95cae385-c159-455b-83d2-087c46e05e22 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:14.777150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-bedce800-7dc6-42bd-9ed2-6dc2809617df req-95cae385-c159-455b-83d2-087c46e05e22 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:14.789218 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-bedce800-7dc6-42bd-9ed2-6dc2809617df req-95cae385-c159-455b-83d2-087c46e05e22 service nova] Creating event network-vif-plugged:d83241ce-edb9-43f3-8d14-91dc1d77984c for instance 165226f3-3399-45af-90a3-bc89f481ecaf on n-h2-860892-1 Oct 11 05:01:14.794660 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-bedce800-7dc6-42bd-9ed2-6dc2809617df req-95cae385-c159-455b-83d2-087c46e05e22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033985 Oct 11 05:01:14.795262 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3602/6969] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:01:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:01:15.522757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f146fc90-b01c-49ee-a1e6-c78c60003d70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:15.523378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f146fc90-b01c-49ee-a1e6-c78c60003d70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:15.530214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f146fc90-b01c-49ee-a1e6-c78c60003d70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:15.530708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f146fc90-b01c-49ee-a1e6-c78c60003d70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:15.531149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f146fc90-b01c-49ee-a1e6-c78c60003d70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:15.531837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f146fc90-b01c-49ee-a1e6-c78c60003d70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:15.532295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f146fc90-b01c-49ee-a1e6-c78c60003d70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:15.532719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f146fc90-b01c-49ee-a1e6-c78c60003d70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:15.660844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f146fc90-b01c-49ee-a1e6-c78c60003d70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:15.668665 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f146fc90-b01c-49ee-a1e6-c78c60003d70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1203 microversion: 2.1 time: 0.149873 Oct 11 05:01:15.669262 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3368/6970] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:15 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1203 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:16.692322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-67c709e8-4453-402c-9a2b-bd2643650e3a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:16.693025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-67c709e8-4453-402c-9a2b-bd2643650e3a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:16.700354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67c709e8-4453-402c-9a2b-bd2643650e3a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:16.700843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67c709e8-4453-402c-9a2b-bd2643650e3a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:16.701271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67c709e8-4453-402c-9a2b-bd2643650e3a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:16.701960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67c709e8-4453-402c-9a2b-bd2643650e3a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:16.702443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67c709e8-4453-402c-9a2b-bd2643650e3a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:16.702875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-67c709e8-4453-402c-9a2b-bd2643650e3a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:16.842442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-67c709e8-4453-402c-9a2b-bd2643650e3a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:16.850692 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-67c709e8-4453-402c-9a2b-bd2643650e3a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1390 microversion: 2.1 time: 0.162676 Oct 11 05:01:16.851266 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3603/6971] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:16 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1390 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:16.876146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f390715-1bce-46b8-bbf6-2728841bbf70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:16.876835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5f390715-1bce-46b8-bbf6-2728841bbf70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:16.884447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f390715-1bce-46b8-bbf6-2728841bbf70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:16.884921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f390715-1bce-46b8-bbf6-2728841bbf70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:16.885354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f390715-1bce-46b8-bbf6-2728841bbf70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:16.886037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f390715-1bce-46b8-bbf6-2728841bbf70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:16.886511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f390715-1bce-46b8-bbf6-2728841bbf70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:16.886928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f390715-1bce-46b8-bbf6-2728841bbf70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:17.020836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5f390715-1bce-46b8-bbf6-2728841bbf70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:17.028537 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5f390715-1bce-46b8-bbf6-2728841bbf70 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1390 microversion: 2.1 time: 0.156578 Oct 11 05:01:17.029101 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3369/6972] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:16 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1390 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:17.050155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b3d5463-cbf6-4a60-9a81-b22cfb03c181 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:17.050761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b3d5463-cbf6-4a60-9a81-b22cfb03c181 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:17.057182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3d5463-cbf6-4a60-9a81-b22cfb03c181 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:17.057667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3d5463-cbf6-4a60-9a81-b22cfb03c181 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:17.058106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3d5463-cbf6-4a60-9a81-b22cfb03c181 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:17.058826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3d5463-cbf6-4a60-9a81-b22cfb03c181 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:17.059287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3d5463-cbf6-4a60-9a81-b22cfb03c181 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:17.059713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b3d5463-cbf6-4a60-9a81-b22cfb03c181 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:17.191074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9b3d5463-cbf6-4a60-9a81-b22cfb03c181 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:17.199474 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b3d5463-cbf6-4a60-9a81-b22cfb03c181 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1390 microversion: 2.1 time: 0.153393 Oct 11 05:01:17.200027 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3604/6973] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:17 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1390 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:17.221024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5fca4522-d47e-429a-9845-e955d763d52a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:17.224360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5fca4522-d47e-429a-9845-e955d763d52a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:17.227562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fca4522-d47e-429a-9845-e955d763d52a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:17.228043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fca4522-d47e-429a-9845-e955d763d52a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:17.228477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fca4522-d47e-429a-9845-e955d763d52a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:17.229159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fca4522-d47e-429a-9845-e955d763d52a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:17.229610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fca4522-d47e-429a-9845-e955d763d52a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:17.230075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fca4522-d47e-429a-9845-e955d763d52a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:17.254369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5fca4522-d47e-429a-9845-e955d763d52a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:01:17.571830 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5fca4522-d47e-429a-9845-e955d763d52a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 204 len: 0 microversion: 2.1 time: 0.354394 Oct 11 05:01:17.572502 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3370/6974] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:01:17 2022] DELETE /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:01:17.580680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-be710946-037c-462f-8169-5570eafac3bb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:17.585661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-be710946-037c-462f-8169-5570eafac3bb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:17.587432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be710946-037c-462f-8169-5570eafac3bb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:17.587911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be710946-037c-462f-8169-5570eafac3bb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:17.588338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be710946-037c-462f-8169-5570eafac3bb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:17.589014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be710946-037c-462f-8169-5570eafac3bb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:17.589463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be710946-037c-462f-8169-5570eafac3bb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:17.589880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be710946-037c-462f-8169-5570eafac3bb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:17.716449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be710946-037c-462f-8169-5570eafac3bb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:17.724225 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-be710946-037c-462f-8169-5570eafac3bb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1396 microversion: 2.1 time: 0.147481 Oct 11 05:01:17.724792 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3605/6975] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:17 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1396 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:18.748500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3a79a3e9-40ee-40aa-89ba-bf07d78c5fc4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:18.749190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3a79a3e9-40ee-40aa-89ba-bf07d78c5fc4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:18.756676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a79a3e9-40ee-40aa-89ba-bf07d78c5fc4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:18.757712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a79a3e9-40ee-40aa-89ba-bf07d78c5fc4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:18.758155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a79a3e9-40ee-40aa-89ba-bf07d78c5fc4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:18.759122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a79a3e9-40ee-40aa-89ba-bf07d78c5fc4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:18.759569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a79a3e9-40ee-40aa-89ba-bf07d78c5fc4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:18.759992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a79a3e9-40ee-40aa-89ba-bf07d78c5fc4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:18.886730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3a79a3e9-40ee-40aa-89ba-bf07d78c5fc4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:18.894518 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3a79a3e9-40ee-40aa-89ba-bf07d78c5fc4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1396 microversion: 2.1 time: 0.150223 Oct 11 05:01:18.895088 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3371/6976] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:18 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1396 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:19.585535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-8af903ca-e49b-441f-9405-fb0cefd1528b req-7ee8a636-d5be-437d-956e-cdda50df8cca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "165226f3-3399-45af-90a3-bc89f481ecaf", "name": "network-vif-deleted", "tag": "d83241ce-edb9-43f3-8d14-91dc1d77984c"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:01:19.596430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8af903ca-e49b-441f-9405-fb0cefd1528b req-7ee8a636-d5be-437d-956e-cdda50df8cca service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:19.601020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8af903ca-e49b-441f-9405-fb0cefd1528b req-7ee8a636-d5be-437d-956e-cdda50df8cca service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:19.601020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8af903ca-e49b-441f-9405-fb0cefd1528b req-7ee8a636-d5be-437d-956e-cdda50df8cca service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:19.610794 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8af903ca-e49b-441f-9405-fb0cefd1528b req-7ee8a636-d5be-437d-956e-cdda50df8cca service nova] Creating event network-vif-deleted:d83241ce-edb9-43f3-8d14-91dc1d77984c for instance 165226f3-3399-45af-90a3-bc89f481ecaf on n-h2-860892-1 Oct 11 05:01:19.617330 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-8af903ca-e49b-441f-9405-fb0cefd1528b req-7ee8a636-d5be-437d-956e-cdda50df8cca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034869 Oct 11 05:01:19.617963 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3606/6977] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:01:19.917666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-02ceb4b7-551e-4f67-ad14-5e610c593243 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:19.918307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-02ceb4b7-551e-4f67-ad14-5e610c593243 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:19.925278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02ceb4b7-551e-4f67-ad14-5e610c593243 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:19.925769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02ceb4b7-551e-4f67-ad14-5e610c593243 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:19.926226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02ceb4b7-551e-4f67-ad14-5e610c593243 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:19.926959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02ceb4b7-551e-4f67-ad14-5e610c593243 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:19.927418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02ceb4b7-551e-4f67-ad14-5e610c593243 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:19.927855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-02ceb4b7-551e-4f67-ad14-5e610c593243 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:19.990627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-02ceb4b7-551e-4f67-ad14-5e610c593243 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:19.998510 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-02ceb4b7-551e-4f67-ad14-5e610c593243 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1188 microversion: 2.1 time: 0.085308 Oct 11 05:01:19.999087 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3372/6978] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:19 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1188 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:21.021617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-61aa4e12-932d-4599-8923-92bee4e4ae3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:21.022902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-61aa4e12-932d-4599-8923-92bee4e4ae3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:21.030170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61aa4e12-932d-4599-8923-92bee4e4ae3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:21.030755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61aa4e12-932d-4599-8923-92bee4e4ae3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:21.031260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61aa4e12-932d-4599-8923-92bee4e4ae3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:21.032018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61aa4e12-932d-4599-8923-92bee4e4ae3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:21.032560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61aa4e12-932d-4599-8923-92bee4e4ae3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:21.033054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-61aa4e12-932d-4599-8923-92bee4e4ae3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:21.099238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-61aa4e12-932d-4599-8923-92bee4e4ae3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:21.107747 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-61aa4e12-932d-4599-8923-92bee4e4ae3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1188 microversion: 2.1 time: 0.090381 Oct 11 05:01:21.108412 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3607/6979] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:21 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1188 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:22.130697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d237767b-3788-41cb-bc17-638c8a6e3442 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:22.131325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d237767b-3788-41cb-bc17-638c8a6e3442 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:22.138506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d237767b-3788-41cb-bc17-638c8a6e3442 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:22.138987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d237767b-3788-41cb-bc17-638c8a6e3442 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:22.139422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d237767b-3788-41cb-bc17-638c8a6e3442 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:22.140111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d237767b-3788-41cb-bc17-638c8a6e3442 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:22.140560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d237767b-3788-41cb-bc17-638c8a6e3442 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:22.140984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d237767b-3788-41cb-bc17-638c8a6e3442 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:22.204935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d237767b-3788-41cb-bc17-638c8a6e3442 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:22.213401 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d237767b-3788-41cb-bc17-638c8a6e3442 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1188 microversion: 2.1 time: 0.086791 Oct 11 05:01:22.213967 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3373/6980] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:22 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1188 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:23.237008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3c978b4-d3e3-46ea-9d24-e73676bb4e9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:23.237630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3c978b4-d3e3-46ea-9d24-e73676bb4e9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:23.245256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c978b4-d3e3-46ea-9d24-e73676bb4e9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:23.245750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c978b4-d3e3-46ea-9d24-e73676bb4e9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:23.246197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c978b4-d3e3-46ea-9d24-e73676bb4e9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:23.246905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c978b4-d3e3-46ea-9d24-e73676bb4e9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:23.247359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c978b4-d3e3-46ea-9d24-e73676bb4e9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:23.247785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c978b4-d3e3-46ea-9d24-e73676bb4e9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:23.309297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3c978b4-d3e3-46ea-9d24-e73676bb4e9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:23.317297 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3c978b4-d3e3-46ea-9d24-e73676bb4e9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1188 microversion: 2.1 time: 0.084402 Oct 11 05:01:23.317860 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3608/6981] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:23 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1188 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:24.340823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:24.341437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:24.348359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:24.348840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:24.349273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:24.349956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:24.350483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:24.350905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:24.382445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:24.382916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:24.383607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:24.384046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lazy-loading 'fault' on Instance uuid 165226f3-3399-45af-90a3-bc89f481ecaf {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:01:24.424130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:24.431979 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d3ae1205-d261-4ffc-a3a6-1e67824b0937 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 200 len: 1193 microversion: 2.1 time: 0.095185 Oct 11 05:01:24.432543 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3374/6982] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:24 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 1193 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:25.457061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:25.457674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 165226f3-3399-45af-90a3-bc89f481ecaf] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:25.464409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:25.464901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:25.465343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:25.466074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:25.466557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:25.466984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:25.480220 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance 165226f3-3399-45af-90a3-bc89f481ecaf could not be found. Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf HTTP/1.1 Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 165226f3-3399-45af-90a3-bc89f481ecaf could not be found. Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '165226f3-3399-45af-90a3-bc89f481ecaf'} Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 165226f3-3399-45af-90a3-bc89f481ecaf could not be found. Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 165226f3-3399-45af-90a3-bc89f481ecaf could not be found. Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:01:25.481862 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:01:25.485864 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:01:25.485864 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:01:25.485864 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:01:25.485864 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:01:25.485864 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:01:25.485864 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 165226f3-3399-45af-90a3-bc89f481ecaf could not be found. Oct 11 05:01:25.485864 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:01:25.485864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance 165226f3-3399-45af-90a3-bc89f481ecaf could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:01:25.485864 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30b7fd54-df8b-4ea9-bf20-929963aac12d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf" status: 404 len: 111 microversion: 2.1 time: 0.030311 Oct 11 05:01:25.485864 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3609/6983] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:25 2022] GET /compute/v2.1/servers/165226f3-3399-45af-90a3-bc89f481ecaf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:01:31.863895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f2d78cd5-5475-4db2-9693-447cfdc30b4f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:01:31.866143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f2d78cd5-5475-4db2-9693-447cfdc30b4f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:31.872946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2d78cd5-5475-4db2-9693-447cfdc30b4f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:31.873478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2d78cd5-5475-4db2-9693-447cfdc30b4f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:31.873915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2d78cd5-5475-4db2-9693-447cfdc30b4f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:31.874632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2d78cd5-5475-4db2-9693-447cfdc30b4f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:31.875085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2d78cd5-5475-4db2-9693-447cfdc30b4f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:31.875509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2d78cd5-5475-4db2-9693-447cfdc30b4f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:31.928293 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f2d78cd5-5475-4db2-9693-447cfdc30b4f tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "POST /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a/action" status: 200 len: 24574 microversion: 2.1 time: 0.068393 Oct 11 05:01:31.928921 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3375/6984] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:01:31 2022] POST /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a/action => generated 24574 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:01:32.254091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-67930863", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "9c9423e5-18a2-46e0-9182-3652d5c46612", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:01:32.314079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] validate_networks() for [('dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:01:32.677002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:01:32.677460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:01:32.677939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:01:32.679027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:01:32.679476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:01:32.688310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:32.693120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:32.693120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:32.693120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:32.693120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:32.693120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:32.707657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:01:32.713420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for user 5a1c61d68e1a479bb0dc096271f4cbde and project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:01:32.769686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:01:32.772307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9c9423e5-18a2-46e0-9182-3652d5c46612',volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:01:33.172538 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2f571441-77e1-4e30-93bf-e986b755954b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.922339 Oct 11 05:01:33.173191 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3610/6985] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:01:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:01:33.185288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fdc11cbb-e8e5-4890-a6a1-8aa0db0a504d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:33.186237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fdc11cbb-e8e5-4890-a6a1-8aa0db0a504d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:33.245390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fdc11cbb-e8e5-4890-a6a1-8aa0db0a504d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:33.254238 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fdc11cbb-e8e5-4890-a6a1-8aa0db0a504d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1055 microversion: 2.1 time: 0.073308 Oct 11 05:01:33.254812 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3376/6986] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:33 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1055 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:34.278666 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9d8f2aee-00b9-4321-8deb-2fca83d059cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:34.279291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9d8f2aee-00b9-4321-8deb-2fca83d059cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:34.285298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d8f2aee-00b9-4321-8deb-2fca83d059cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:34.285783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d8f2aee-00b9-4321-8deb-2fca83d059cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:34.286310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d8f2aee-00b9-4321-8deb-2fca83d059cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:34.287005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d8f2aee-00b9-4321-8deb-2fca83d059cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:34.288136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d8f2aee-00b9-4321-8deb-2fca83d059cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:34.288575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9d8f2aee-00b9-4321-8deb-2fca83d059cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:34.349551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9d8f2aee-00b9-4321-8deb-2fca83d059cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:34.358802 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9d8f2aee-00b9-4321-8deb-2fca83d059cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1105 microversion: 2.1 time: 0.084943 Oct 11 05:01:34.359383 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3611/6987] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:34 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1105 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:35.381478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6ba713da-0d82-4f52-a83f-62e97d0c4486 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:35.382227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6ba713da-0d82-4f52-a83f-62e97d0c4486 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:35.389800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ba713da-0d82-4f52-a83f-62e97d0c4486 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:35.392637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ba713da-0d82-4f52-a83f-62e97d0c4486 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:35.392637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ba713da-0d82-4f52-a83f-62e97d0c4486 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:35.392637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ba713da-0d82-4f52-a83f-62e97d0c4486 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:35.392637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ba713da-0d82-4f52-a83f-62e97d0c4486 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:35.392637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6ba713da-0d82-4f52-a83f-62e97d0c4486 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:35.472196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6ba713da-0d82-4f52-a83f-62e97d0c4486 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:35.480880 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6ba713da-0d82-4f52-a83f-62e97d0c4486 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1171 microversion: 2.1 time: 0.103618 Oct 11 05:01:35.481496 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3377/6988] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:35 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1171 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:36.511163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0809e48b-194b-4b00-ab31-2c2d43ed0f39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:36.513668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0809e48b-194b-4b00-ab31-2c2d43ed0f39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:36.526692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809e48b-194b-4b00-ab31-2c2d43ed0f39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:36.527533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809e48b-194b-4b00-ab31-2c2d43ed0f39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:36.528079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809e48b-194b-4b00-ab31-2c2d43ed0f39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:36.529020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809e48b-194b-4b00-ab31-2c2d43ed0f39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:36.529755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809e48b-194b-4b00-ab31-2c2d43ed0f39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:36.530312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0809e48b-194b-4b00-ab31-2c2d43ed0f39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:36.680641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0809e48b-194b-4b00-ab31-2c2d43ed0f39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:36.690877 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0809e48b-194b-4b00-ab31-2c2d43ed0f39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1213 microversion: 2.1 time: 0.186935 Oct 11 05:01:36.691948 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3612/6989] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:36 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1213 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:36.795593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-95b98a5a-e633-4bc2-b878-a66049466f1b req-05d5c6e6-3814-4ea4-8dde-a8bd4a62c4fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dfd36536-3e29-4054-97b7-56f5294d97af", "tag": "6f8dbf59-bf3d-43a3-87fa-a02ff6c6e908"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:01:36.805940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-95b98a5a-e633-4bc2-b878-a66049466f1b req-05d5c6e6-3814-4ea4-8dde-a8bd4a62c4fb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:36.806502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-95b98a5a-e633-4bc2-b878-a66049466f1b req-05d5c6e6-3814-4ea4-8dde-a8bd4a62c4fb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:36.807111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-95b98a5a-e633-4bc2-b878-a66049466f1b req-05d5c6e6-3814-4ea4-8dde-a8bd4a62c4fb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:36.818683 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-95b98a5a-e633-4bc2-b878-a66049466f1b req-05d5c6e6-3814-4ea4-8dde-a8bd4a62c4fb service nova] Creating event network-changed:6f8dbf59-bf3d-43a3-87fa-a02ff6c6e908 for instance dfd36536-3e29-4054-97b7-56f5294d97af on n-h2-860892-1 Oct 11 05:01:36.823886 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-95b98a5a-e633-4bc2-b878-a66049466f1b req-05d5c6e6-3814-4ea4-8dde-a8bd4a62c4fb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032162 Oct 11 05:01:36.824494 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3378/6990] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:01:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:01:37.714568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a3f64bba-e6bc-48ae-bdc1-8fcdcc0382d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:37.715111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a3f64bba-e6bc-48ae-bdc1-8fcdcc0382d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:37.722150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3f64bba-e6bc-48ae-bdc1-8fcdcc0382d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:37.722662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3f64bba-e6bc-48ae-bdc1-8fcdcc0382d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:37.723096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3f64bba-e6bc-48ae-bdc1-8fcdcc0382d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:37.723787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3f64bba-e6bc-48ae-bdc1-8fcdcc0382d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:37.724238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3f64bba-e6bc-48ae-bdc1-8fcdcc0382d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:37.724663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3f64bba-e6bc-48ae-bdc1-8fcdcc0382d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:37.855670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a3f64bba-e6bc-48ae-bdc1-8fcdcc0382d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:37.863631 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a3f64bba-e6bc-48ae-bdc1-8fcdcc0382d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1213 microversion: 2.1 time: 0.153128 Oct 11 05:01:37.864682 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3613/6991] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:37 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1213 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:01:38.889123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9d89e901-84ac-4d55-ae17-facbc55fb35d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:38.889820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9d89e901-84ac-4d55-ae17-facbc55fb35d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:38.896536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d89e901-84ac-4d55-ae17-facbc55fb35d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:38.897045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d89e901-84ac-4d55-ae17-facbc55fb35d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:38.897483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d89e901-84ac-4d55-ae17-facbc55fb35d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:38.898163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d89e901-84ac-4d55-ae17-facbc55fb35d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:38.898637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d89e901-84ac-4d55-ae17-facbc55fb35d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:38.899054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d89e901-84ac-4d55-ae17-facbc55fb35d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:39.030917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9d89e901-84ac-4d55-ae17-facbc55fb35d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:39.038760 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9d89e901-84ac-4d55-ae17-facbc55fb35d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1213 microversion: 2.1 time: 0.154036 Oct 11 05:01:39.039344 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3379/6992] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:38 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1213 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:40.061243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-60438521-6190-440b-83cd-e94615f6e68a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:40.061865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-60438521-6190-440b-83cd-e94615f6e68a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:40.069199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60438521-6190-440b-83cd-e94615f6e68a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:40.069570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60438521-6190-440b-83cd-e94615f6e68a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:40.070016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60438521-6190-440b-83cd-e94615f6e68a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:40.070747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60438521-6190-440b-83cd-e94615f6e68a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:40.071203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60438521-6190-440b-83cd-e94615f6e68a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:40.071918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60438521-6190-440b-83cd-e94615f6e68a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:40.205731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-60438521-6190-440b-83cd-e94615f6e68a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:40.214051 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-60438521-6190-440b-83cd-e94615f6e68a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1213 microversion: 2.1 time: 0.156769 Oct 11 05:01:40.214664 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3614/6993] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:40 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1213 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:41.236940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9d2bc979-5f2c-4257-a6c1-7ce5000ce009 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:41.237562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9d2bc979-5f2c-4257-a6c1-7ce5000ce009 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:41.244399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d2bc979-5f2c-4257-a6c1-7ce5000ce009 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:41.244958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d2bc979-5f2c-4257-a6c1-7ce5000ce009 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:41.245399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d2bc979-5f2c-4257-a6c1-7ce5000ce009 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:41.246089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d2bc979-5f2c-4257-a6c1-7ce5000ce009 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:41.246573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d2bc979-5f2c-4257-a6c1-7ce5000ce009 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:41.246995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d2bc979-5f2c-4257-a6c1-7ce5000ce009 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:41.376912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9d2bc979-5f2c-4257-a6c1-7ce5000ce009 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:41.385440 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9d2bc979-5f2c-4257-a6c1-7ce5000ce009 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1201 microversion: 2.1 time: 0.152430 Oct 11 05:01:41.386010 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3380/6994] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:41 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1201 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:42.408568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b96cb8e9-5eec-4a3e-9887-410c81b25538 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:42.409215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b96cb8e9-5eec-4a3e-9887-410c81b25538 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:42.411997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:42.416754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b96cb8e9-5eec-4a3e-9887-410c81b25538 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:42.417230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b96cb8e9-5eec-4a3e-9887-410c81b25538 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:42.417663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b96cb8e9-5eec-4a3e-9887-410c81b25538 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:42.418382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b96cb8e9-5eec-4a3e-9887-410c81b25538 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:42.418835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b96cb8e9-5eec-4a3e-9887-410c81b25538 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:42.419298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b96cb8e9-5eec-4a3e-9887-410c81b25538 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:42.421790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=74 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:42.551373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b96cb8e9-5eec-4a3e-9887-410c81b25538 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:42.559571 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b96cb8e9-5eec-4a3e-9887-410c81b25538 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1201 microversion: 2.1 time: 0.155050 Oct 11 05:01:42.560135 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3615/6995] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:42 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1201 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:43.583454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b0d9fa80-2c5c-4eef-96ba-9a7b71afdc9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:43.584590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b0d9fa80-2c5c-4eef-96ba-9a7b71afdc9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:43.587473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:43.588115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:43.592755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9fa80-2c5c-4eef-96ba-9a7b71afdc9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:43.593258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9fa80-2c5c-4eef-96ba-9a7b71afdc9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:43.593695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9fa80-2c5c-4eef-96ba-9a7b71afdc9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:43.594405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9fa80-2c5c-4eef-96ba-9a7b71afdc9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:43.594856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9fa80-2c5c-4eef-96ba-9a7b71afdc9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:43.595273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b0d9fa80-2c5c-4eef-96ba-9a7b71afdc9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:43.597756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:43.727777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b0d9fa80-2c5c-4eef-96ba-9a7b71afdc9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:43.735480 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b0d9fa80-2c5c-4eef-96ba-9a7b71afdc9f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1201 microversion: 2.1 time: 0.155943 Oct 11 05:01:43.736092 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3381/6996] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:43 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1201 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:44.758594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9bb5cadc-b24d-452e-aea7-48de84af7684 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:44.759168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9bb5cadc-b24d-452e-aea7-48de84af7684 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:44.760983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:44.761652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:01:44.767497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bb5cadc-b24d-452e-aea7-48de84af7684 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:44.768112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bb5cadc-b24d-452e-aea7-48de84af7684 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:44.768392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bb5cadc-b24d-452e-aea7-48de84af7684 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:44.769075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bb5cadc-b24d-452e-aea7-48de84af7684 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:44.769523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bb5cadc-b24d-452e-aea7-48de84af7684 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:44.769944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bb5cadc-b24d-452e-aea7-48de84af7684 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:44.897335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9bb5cadc-b24d-452e-aea7-48de84af7684 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:44.905133 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9bb5cadc-b24d-452e-aea7-48de84af7684 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1201 microversion: 2.1 time: 0.151588 Oct 11 05:01:44.905698 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3616/6997] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:44 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1201 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:45.928077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f9f8d774-5cfc-478c-8d3a-3cf70cdfeed0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:45.928691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f9f8d774-5cfc-478c-8d3a-3cf70cdfeed0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:45.936063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f8d774-5cfc-478c-8d3a-3cf70cdfeed0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:45.936547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f8d774-5cfc-478c-8d3a-3cf70cdfeed0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:45.936986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f8d774-5cfc-478c-8d3a-3cf70cdfeed0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:45.937679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f8d774-5cfc-478c-8d3a-3cf70cdfeed0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:45.938135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f8d774-5cfc-478c-8d3a-3cf70cdfeed0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:45.938583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f9f8d774-5cfc-478c-8d3a-3cf70cdfeed0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:46.067746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f9f8d774-5cfc-478c-8d3a-3cf70cdfeed0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:46.075962 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f9f8d774-5cfc-478c-8d3a-3cf70cdfeed0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1201 microversion: 2.1 time: 0.152259 Oct 11 05:01:46.076635 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3382/6998] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:45 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1201 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:47.099277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c9c68203-eef5-4540-bcc2-f93fcc8f5dca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:47.100403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c9c68203-eef5-4540-bcc2-f93fcc8f5dca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:47.107295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9c68203-eef5-4540-bcc2-f93fcc8f5dca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:47.107780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9c68203-eef5-4540-bcc2-f93fcc8f5dca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:47.108223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9c68203-eef5-4540-bcc2-f93fcc8f5dca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:47.108912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9c68203-eef5-4540-bcc2-f93fcc8f5dca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:47.109424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9c68203-eef5-4540-bcc2-f93fcc8f5dca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:47.109865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9c68203-eef5-4540-bcc2-f93fcc8f5dca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:47.251959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c9c68203-eef5-4540-bcc2-f93fcc8f5dca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:47.260553 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c9c68203-eef5-4540-bcc2-f93fcc8f5dca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1201 microversion: 2.1 time: 0.165209 Oct 11 05:01:47.264485 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3617/6999] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:47 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1201 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:48.283765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e864c0b8-d93b-4834-acf0-3f28410dec26 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:48.284390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e864c0b8-d93b-4834-acf0-3f28410dec26 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:48.291432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e864c0b8-d93b-4834-acf0-3f28410dec26 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:48.291923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e864c0b8-d93b-4834-acf0-3f28410dec26 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:48.292371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e864c0b8-d93b-4834-acf0-3f28410dec26 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:48.293075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e864c0b8-d93b-4834-acf0-3f28410dec26 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:48.293535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e864c0b8-d93b-4834-acf0-3f28410dec26 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:48.293968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e864c0b8-d93b-4834-acf0-3f28410dec26 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:48.422532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e864c0b8-d93b-4834-acf0-3f28410dec26 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:48.430269 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e864c0b8-d93b-4834-acf0-3f28410dec26 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1201 microversion: 2.1 time: 0.150439 Oct 11 05:01:48.430839 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3383/7000] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:48 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1201 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:49.453189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1725dd45-62dc-44fd-97e4-16c43225a278 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:49.453876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1725dd45-62dc-44fd-97e4-16c43225a278 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:49.461230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1725dd45-62dc-44fd-97e4-16c43225a278 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:49.461713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1725dd45-62dc-44fd-97e4-16c43225a278 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:49.462153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1725dd45-62dc-44fd-97e4-16c43225a278 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:49.462870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1725dd45-62dc-44fd-97e4-16c43225a278 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:49.463327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1725dd45-62dc-44fd-97e4-16c43225a278 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:49.463753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1725dd45-62dc-44fd-97e4-16c43225a278 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:49.594391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1725dd45-62dc-44fd-97e4-16c43225a278 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:49.602746 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1725dd45-62dc-44fd-97e4-16c43225a278 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1201 microversion: 2.1 time: 0.153498 Oct 11 05:01:49.603316 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3618/7001] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:49 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1201 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:50.624863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c00e9268-a16c-4b49-9a61-558cffa6da33 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:50.625475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c00e9268-a16c-4b49-9a61-558cffa6da33 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:50.632347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e9268-a16c-4b49-9a61-558cffa6da33 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:50.632824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e9268-a16c-4b49-9a61-558cffa6da33 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:50.633537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e9268-a16c-4b49-9a61-558cffa6da33 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:50.634232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e9268-a16c-4b49-9a61-558cffa6da33 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:50.634682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e9268-a16c-4b49-9a61-558cffa6da33 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:50.635101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c00e9268-a16c-4b49-9a61-558cffa6da33 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:50.768362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c00e9268-a16c-4b49-9a61-558cffa6da33 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:50.776543 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c00e9268-a16c-4b49-9a61-558cffa6da33 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1201 microversion: 2.1 time: 0.155530 Oct 11 05:01:50.779939 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3384/7002] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:50 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1201 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:51.081500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6a6eb849-bf81-40b5-af89-61cb4ee7a250 req-94a232cd-1ca9-402d-b928-652931b20f33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd36536-3e29-4054-97b7-56f5294d97af", "name": "network-vif-plugged", "status": "completed", "tag": "6f8dbf59-bf3d-43a3-87fa-a02ff6c6e908"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:01:51.092793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6a6eb849-bf81-40b5-af89-61cb4ee7a250 req-94a232cd-1ca9-402d-b928-652931b20f33 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:51.093299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6a6eb849-bf81-40b5-af89-61cb4ee7a250 req-94a232cd-1ca9-402d-b928-652931b20f33 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:51.093733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6a6eb849-bf81-40b5-af89-61cb4ee7a250 req-94a232cd-1ca9-402d-b928-652931b20f33 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:51.105601 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6a6eb849-bf81-40b5-af89-61cb4ee7a250 req-94a232cd-1ca9-402d-b928-652931b20f33 service nova] Creating event network-vif-plugged:6f8dbf59-bf3d-43a3-87fa-a02ff6c6e908 for instance dfd36536-3e29-4054-97b7-56f5294d97af on n-h2-860892-1 Oct 11 05:01:51.110840 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6a6eb849-bf81-40b5-af89-61cb4ee7a250 req-94a232cd-1ca9-402d-b928-652931b20f33 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033127 Oct 11 05:01:51.111471 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3619/7003] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:01:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:01:51.800123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0ec76c5b-8307-4c05-9f08-464d814c009a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:51.800676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0ec76c5b-8307-4c05-9f08-464d814c009a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:51.807976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ec76c5b-8307-4c05-9f08-464d814c009a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:51.808456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ec76c5b-8307-4c05-9f08-464d814c009a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:51.808893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ec76c5b-8307-4c05-9f08-464d814c009a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:51.809580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ec76c5b-8307-4c05-9f08-464d814c009a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:51.810035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ec76c5b-8307-4c05-9f08-464d814c009a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:51.810499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ec76c5b-8307-4c05-9f08-464d814c009a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:51.936919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0ec76c5b-8307-4c05-9f08-464d814c009a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:51.945130 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0ec76c5b-8307-4c05-9f08-464d814c009a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1201 microversion: 2.1 time: 0.149006 Oct 11 05:01:51.945703 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3385/7004] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:51 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1201 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:52.969723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b340745a-6b59-46c1-beb8-5c8221b81a43 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:52.970443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b340745a-6b59-46c1-beb8-5c8221b81a43 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:52.977285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b340745a-6b59-46c1-beb8-5c8221b81a43 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:52.977763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b340745a-6b59-46c1-beb8-5c8221b81a43 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:52.978211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b340745a-6b59-46c1-beb8-5c8221b81a43 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:52.978892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b340745a-6b59-46c1-beb8-5c8221b81a43 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:52.979339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b340745a-6b59-46c1-beb8-5c8221b81a43 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:52.979758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b340745a-6b59-46c1-beb8-5c8221b81a43 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:53.112046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b340745a-6b59-46c1-beb8-5c8221b81a43 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:53.119884 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b340745a-6b59-46c1-beb8-5c8221b81a43 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1388 microversion: 2.1 time: 0.155364 Oct 11 05:01:53.120450 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3620/7005] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:52 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1388 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:01:53.141865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c91c4eb0-cef1-4a1a-9196-8a1c87992e00 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:53.142506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c91c4eb0-cef1-4a1a-9196-8a1c87992e00 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:53.149767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c91c4eb0-cef1-4a1a-9196-8a1c87992e00 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:53.150303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c91c4eb0-cef1-4a1a-9196-8a1c87992e00 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:53.150748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c91c4eb0-cef1-4a1a-9196-8a1c87992e00 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:53.151444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c91c4eb0-cef1-4a1a-9196-8a1c87992e00 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:53.151901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c91c4eb0-cef1-4a1a-9196-8a1c87992e00 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:53.152331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c91c4eb0-cef1-4a1a-9196-8a1c87992e00 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:53.282567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c91c4eb0-cef1-4a1a-9196-8a1c87992e00 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:53.291042 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c91c4eb0-cef1-4a1a-9196-8a1c87992e00 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1388 microversion: 2.1 time: 0.153030 Oct 11 05:01:53.291612 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3386/7006] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:53 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1388 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:53.312898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7cae58b6-cbf0-4123-8245-424b51c9f70a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:53.313519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7cae58b6-cbf0-4123-8245-424b51c9f70a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:53.319734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cae58b6-cbf0-4123-8245-424b51c9f70a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:53.320220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cae58b6-cbf0-4123-8245-424b51c9f70a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:53.320683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cae58b6-cbf0-4123-8245-424b51c9f70a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:53.321454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cae58b6-cbf0-4123-8245-424b51c9f70a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:53.321910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cae58b6-cbf0-4123-8245-424b51c9f70a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:53.322400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cae58b6-cbf0-4123-8245-424b51c9f70a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:53.451144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7cae58b6-cbf0-4123-8245-424b51c9f70a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:53.459685 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7cae58b6-cbf0-4123-8245-424b51c9f70a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1388 microversion: 2.1 time: 0.150668 Oct 11 05:01:53.460258 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3621/7007] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:53 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1388 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:53.481430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2aaf842a-2c85-4111-acde-b96436813fbf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:53.481978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2aaf842a-2c85-4111-acde-b96436813fbf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:53.487980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aaf842a-2c85-4111-acde-b96436813fbf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:53.488459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aaf842a-2c85-4111-acde-b96436813fbf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:53.488897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aaf842a-2c85-4111-acde-b96436813fbf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:53.489582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aaf842a-2c85-4111-acde-b96436813fbf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:53.490035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aaf842a-2c85-4111-acde-b96436813fbf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:53.490488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2aaf842a-2c85-4111-acde-b96436813fbf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:53.518148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2aaf842a-2c85-4111-acde-b96436813fbf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:01:53.805347 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2aaf842a-2c85-4111-acde-b96436813fbf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 204 len: 0 microversion: 2.1 time: 0.327466 Oct 11 05:01:53.805867 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3387/7008] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:01:53 2022] DELETE /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 0 bytes in 329 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:01:53.814282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c65e5d29-eb33-46c7-aa33-36cbab82e8b6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:53.822300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c65e5d29-eb33-46c7-aa33-36cbab82e8b6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:53.822300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c65e5d29-eb33-46c7-aa33-36cbab82e8b6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:53.822516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c65e5d29-eb33-46c7-aa33-36cbab82e8b6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:53.822928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c65e5d29-eb33-46c7-aa33-36cbab82e8b6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:53.823656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c65e5d29-eb33-46c7-aa33-36cbab82e8b6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:53.824109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c65e5d29-eb33-46c7-aa33-36cbab82e8b6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:53.824532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c65e5d29-eb33-46c7-aa33-36cbab82e8b6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:53.952321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c65e5d29-eb33-46c7-aa33-36cbab82e8b6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:53.960177 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c65e5d29-eb33-46c7-aa33-36cbab82e8b6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1394 microversion: 2.1 time: 0.149951 Oct 11 05:01:53.960742 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3622/7009] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:53 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1394 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:54.983205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff4569dc-191d-48f0-86d9-8fda15f6c16f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:54.983933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff4569dc-191d-48f0-86d9-8fda15f6c16f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:54.990802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff4569dc-191d-48f0-86d9-8fda15f6c16f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:54.991307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff4569dc-191d-48f0-86d9-8fda15f6c16f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:54.991731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff4569dc-191d-48f0-86d9-8fda15f6c16f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:54.992421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff4569dc-191d-48f0-86d9-8fda15f6c16f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:54.992878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff4569dc-191d-48f0-86d9-8fda15f6c16f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:54.993306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff4569dc-191d-48f0-86d9-8fda15f6c16f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:55.119713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff4569dc-191d-48f0-86d9-8fda15f6c16f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:55.127537 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff4569dc-191d-48f0-86d9-8fda15f6c16f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1394 microversion: 2.1 time: 0.148667 Oct 11 05:01:55.128128 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3388/7010] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:54 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1394 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:55.755721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-9bd7b86a-f450-4a00-8290-9ae8faf8460e req-24757f63-2ed6-4d42-acbf-04b4a764f18e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dfd36536-3e29-4054-97b7-56f5294d97af", "name": "network-vif-deleted", "tag": "6f8dbf59-bf3d-43a3-87fa-a02ff6c6e908"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:01:55.767714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9bd7b86a-f450-4a00-8290-9ae8faf8460e req-24757f63-2ed6-4d42-acbf-04b4a764f18e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:55.768230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9bd7b86a-f450-4a00-8290-9ae8faf8460e req-24757f63-2ed6-4d42-acbf-04b4a764f18e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:55.772762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9bd7b86a-f450-4a00-8290-9ae8faf8460e req-24757f63-2ed6-4d42-acbf-04b4a764f18e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:55.781301 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-9bd7b86a-f450-4a00-8290-9ae8faf8460e req-24757f63-2ed6-4d42-acbf-04b4a764f18e service nova] Creating event network-vif-deleted:6f8dbf59-bf3d-43a3-87fa-a02ff6c6e908 for instance dfd36536-3e29-4054-97b7-56f5294d97af on n-h2-860892-1 Oct 11 05:01:55.787284 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-9bd7b86a-f450-4a00-8290-9ae8faf8460e req-24757f63-2ed6-4d42-acbf-04b4a764f18e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034876 Oct 11 05:01:55.787901 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3623/7011] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:01:56.151952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6399b4d2-467d-4b4b-a700-ceb9b4f4901c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:56.152564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6399b4d2-467d-4b4b-a700-ceb9b4f4901c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:56.159516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6399b4d2-467d-4b4b-a700-ceb9b4f4901c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:56.159998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6399b4d2-467d-4b4b-a700-ceb9b4f4901c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:56.160427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6399b4d2-467d-4b4b-a700-ceb9b4f4901c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:56.161142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6399b4d2-467d-4b4b-a700-ceb9b4f4901c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:56.162232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6399b4d2-467d-4b4b-a700-ceb9b4f4901c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:56.162662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6399b4d2-467d-4b4b-a700-ceb9b4f4901c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:56.223344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6399b4d2-467d-4b4b-a700-ceb9b4f4901c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:56.231891 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6399b4d2-467d-4b4b-a700-ceb9b4f4901c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1186 microversion: 2.1 time: 0.083913 Oct 11 05:01:56.232393 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3389/7012] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:56 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:57.256399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-79a9f850-bf66-4151-b70b-f89b74e3cb85 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:57.257104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-79a9f850-bf66-4151-b70b-f89b74e3cb85 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:57.264108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79a9f850-bf66-4151-b70b-f89b74e3cb85 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:57.264594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79a9f850-bf66-4151-b70b-f89b74e3cb85 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:57.265039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79a9f850-bf66-4151-b70b-f89b74e3cb85 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:57.265765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79a9f850-bf66-4151-b70b-f89b74e3cb85 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:57.266243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79a9f850-bf66-4151-b70b-f89b74e3cb85 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:57.266697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79a9f850-bf66-4151-b70b-f89b74e3cb85 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:57.335376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-79a9f850-bf66-4151-b70b-f89b74e3cb85 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:57.343325 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-79a9f850-bf66-4151-b70b-f89b74e3cb85 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1186 microversion: 2.1 time: 0.092083 Oct 11 05:01:57.343910 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3624/7013] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:57 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1186 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:58.367485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1f401a7-7e96-4748-913a-5abe7763544d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:58.368223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f1f401a7-7e96-4748-913a-5abe7763544d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:58.375376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f401a7-7e96-4748-913a-5abe7763544d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:58.375863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f401a7-7e96-4748-913a-5abe7763544d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:58.376360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f401a7-7e96-4748-913a-5abe7763544d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:58.377055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f401a7-7e96-4748-913a-5abe7763544d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:58.377513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f401a7-7e96-4748-913a-5abe7763544d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:58.377947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f401a7-7e96-4748-913a-5abe7763544d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:58.440534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f1f401a7-7e96-4748-913a-5abe7763544d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:58.449421 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f1f401a7-7e96-4748-913a-5abe7763544d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1186 microversion: 2.1 time: 0.086294 Oct 11 05:01:58.462227 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3390/7014] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:58 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1186 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:01:59.472693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d93b824a-8858-42dd-b0c1-78cf22f73662 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:01:59.473303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d93b824a-8858-42dd-b0c1-78cf22f73662 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:01:59.480268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93b824a-8858-42dd-b0c1-78cf22f73662 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:59.480748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93b824a-8858-42dd-b0c1-78cf22f73662 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:59.481182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93b824a-8858-42dd-b0c1-78cf22f73662 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:59.481870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93b824a-8858-42dd-b0c1-78cf22f73662 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:01:59.482349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93b824a-8858-42dd-b0c1-78cf22f73662 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:01:59.482776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d93b824a-8858-42dd-b0c1-78cf22f73662 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:01:59.543944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d93b824a-8858-42dd-b0c1-78cf22f73662 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:01:59.551864 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d93b824a-8858-42dd-b0c1-78cf22f73662 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1186 microversion: 2.1 time: 0.083091 Oct 11 05:01:59.552522 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3625/7015] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:01:59 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:00.574928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:00.575554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:00.582412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:00.582906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:00.583350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:00.584042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:00.584500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:00.584933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:00.614339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:00.615302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:00.615772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:00.616218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lazy-loading 'fault' on Instance uuid dfd36536-3e29-4054-97b7-56f5294d97af {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:02:00.661875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:00.669874 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a851f816-eff3-4ce1-988d-3dc4c10dc4da tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 200 len: 1191 microversion: 2.1 time: 0.098810 Oct 11 05:02:00.670484 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3391/7016] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:00 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 1191 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:01.692919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:01.693538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: dfd36536-3e29-4054-97b7-56f5294d97af] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:01.700430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:01.700925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:01.701366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:01.702060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:01.702551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:01.702988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:01.716237 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance dfd36536-3e29-4054-97b7-56f5294d97af could not be found. Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af HTTP/1.1 Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance dfd36536-3e29-4054-97b7-56f5294d97af could not be found. Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'dfd36536-3e29-4054-97b7-56f5294d97af'} Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dfd36536-3e29-4054-97b7-56f5294d97af could not be found. Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dfd36536-3e29-4054-97b7-56f5294d97af could not be found. Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:02:01.717826 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:02:01.721394 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:02:01.721394 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:02:01.721394 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:02:01.721394 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:02:01.721394 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:02:01.721394 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dfd36536-3e29-4054-97b7-56f5294d97af could not be found. Oct 11 05:02:01.721394 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:02:01.721394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance dfd36536-3e29-4054-97b7-56f5294d97af could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:02:01.721394 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-54570a87-3bbe-455a-b375-552e68dbb37e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af" status: 404 len: 111 microversion: 2.1 time: 0.030262 Oct 11 05:02:01.721394 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3626/7017] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:01 2022] GET /compute/v2.1/servers/dfd36536-3e29-4054-97b7-56f5294d97af => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:02:03.187806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-869835e6-3932-4e02-acac-37eabf55bed8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:03.189095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-869835e6-3932-4e02-acac-37eabf55bed8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:03.209292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-869835e6-3932-4e02-acac-37eabf55bed8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:03.214827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-869835e6-3932-4e02-acac-37eabf55bed8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:03.215294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-869835e6-3932-4e02-acac-37eabf55bed8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:03.216059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-869835e6-3932-4e02-acac-37eabf55bed8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:03.217317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-869835e6-3932-4e02-acac-37eabf55bed8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:03.217766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-869835e6-3932-4e02-acac-37eabf55bed8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:03.251983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-869835e6-3932-4e02-acac-37eabf55bed8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:02:03.275582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2c91ff7a-52fd-4b8b-941e-15bbf2a3e918 req-0b4fc4b3-aa9b-4a99-8198-7982850c42cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "452c465e-1b1b-47c7-9ca3-a8a47914389a", "tag": "ecf1dec2-849d-436a-b3b2-eb9b94cf4550"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:02:03.291094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2c91ff7a-52fd-4b8b-941e-15bbf2a3e918 req-0b4fc4b3-aa9b-4a99-8198-7982850c42cd service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:03.291902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2c91ff7a-52fd-4b8b-941e-15bbf2a3e918 req-0b4fc4b3-aa9b-4a99-8198-7982850c42cd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:03.292560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2c91ff7a-52fd-4b8b-941e-15bbf2a3e918 req-0b4fc4b3-aa9b-4a99-8198-7982850c42cd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:03.305191 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2c91ff7a-52fd-4b8b-941e-15bbf2a3e918 req-0b4fc4b3-aa9b-4a99-8198-7982850c42cd service nova] Creating event network-changed:ecf1dec2-849d-436a-b3b2-eb9b94cf4550 for instance 452c465e-1b1b-47c7-9ca3-a8a47914389a on n-h1-860892-1 Oct 11 05:02:03.311051 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2c91ff7a-52fd-4b8b-941e-15bbf2a3e918 req-0b4fc4b3-aa9b-4a99-8198-7982850c42cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125934 Oct 11 05:02:03.311841 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3627/7018] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:02:03.663808 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-869835e6-3932-4e02-acac-37eabf55bed8 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "DELETE /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 204 len: 0 microversion: 2.1 time: 0.481240 Oct 11 05:02:03.670380 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3392/7019] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:02:03 2022] DELETE /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 0 bytes in 485 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:02:03.674700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8110b0c2-680b-48d3-9cfe-eb38bc5e9e84 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:03.675699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8110b0c2-680b-48d3-9cfe-eb38bc5e9e84 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:03.682747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8110b0c2-680b-48d3-9cfe-eb38bc5e9e84 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:03.683548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8110b0c2-680b-48d3-9cfe-eb38bc5e9e84 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:03.684213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8110b0c2-680b-48d3-9cfe-eb38bc5e9e84 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:03.685174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8110b0c2-680b-48d3-9cfe-eb38bc5e9e84 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:03.685833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8110b0c2-680b-48d3-9cfe-eb38bc5e9e84 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:03.686488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8110b0c2-680b-48d3-9cfe-eb38bc5e9e84 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:03.833902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8110b0c2-680b-48d3-9cfe-eb38bc5e9e84 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:03.841981 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8110b0c2-680b-48d3-9cfe-eb38bc5e9e84 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1688 microversion: 2.1 time: 0.171450 Oct 11 05:02:03.842595 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3628/7020] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:03 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1688 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:02:04.867020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46b615c2-8a3f-4da8-8d20-17512b153b07 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:04.867719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-46b615c2-8a3f-4da8-8d20-17512b153b07 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:04.874550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b615c2-8a3f-4da8-8d20-17512b153b07 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:04.875030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b615c2-8a3f-4da8-8d20-17512b153b07 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:04.875471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b615c2-8a3f-4da8-8d20-17512b153b07 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:04.876160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b615c2-8a3f-4da8-8d20-17512b153b07 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:04.876617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b615c2-8a3f-4da8-8d20-17512b153b07 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:04.877040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46b615c2-8a3f-4da8-8d20-17512b153b07 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:05.059223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-46b615c2-8a3f-4da8-8d20-17512b153b07 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:05.067007 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-46b615c2-8a3f-4da8-8d20-17512b153b07 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1688 microversion: 2.1 time: 0.204371 Oct 11 05:02:05.068206 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3393/7021] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:04 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1688 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:05.724944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b6464053-8c37-4e3d-89aa-06875175e0d1 req-bf03e098-ada1-4973-8a8f-e223f7648587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "452c465e-1b1b-47c7-9ca3-a8a47914389a", "name": "network-vif-deleted", "tag": "ecf1dec2-849d-436a-b3b2-eb9b94cf4550"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:02:05.744175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6464053-8c37-4e3d-89aa-06875175e0d1 req-bf03e098-ada1-4973-8a8f-e223f7648587 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:05.744726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6464053-8c37-4e3d-89aa-06875175e0d1 req-bf03e098-ada1-4973-8a8f-e223f7648587 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:05.745168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b6464053-8c37-4e3d-89aa-06875175e0d1 req-bf03e098-ada1-4973-8a8f-e223f7648587 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:05.758643 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b6464053-8c37-4e3d-89aa-06875175e0d1 req-bf03e098-ada1-4973-8a8f-e223f7648587 service nova] Creating event network-vif-deleted:ecf1dec2-849d-436a-b3b2-eb9b94cf4550 for instance 452c465e-1b1b-47c7-9ca3-a8a47914389a on n-h1-860892-1 Oct 11 05:02:05.763822 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b6464053-8c37-4e3d-89aa-06875175e0d1 req-bf03e098-ada1-4973-8a8f-e223f7648587 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043631 Oct 11 05:02:05.766447 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3629/7022] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:02:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:02:06.091162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:06.092492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:06.107369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:06.107996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:06.111555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:06.121467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:06.122797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:06.123846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:06.150065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:02:06.164649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:06.165231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:06.165745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:06.166328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lazy-loading 'fault' on Instance uuid 452c465e-1b1b-47c7-9ca3-a8a47914389a {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:02:06.213315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a95598cd3fe04a0abff7aac9f0c49bff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e30500ead1404e5188c6d90e5b302742', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:06.225254 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7c26ec35-1567-4e56-a9c2-c8c237c61a90 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 200 len: 1357 microversion: 2.1 time: 0.138018 Oct 11 05:02:06.225858 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3394/7023] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:06 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 1357 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:07.258490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:07.259952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [instance: 452c465e-1b1b-47c7-9ca3-a8a47914389a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:07.266714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:07.267200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:07.267638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:07.268337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:07.268789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:07.269376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:07.283649 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] HTTP exception thrown: Instance 452c465e-1b1b-47c7-9ca3-a8a47914389a could not be found. Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Request method failure captured: Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a HTTP/1.1 Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPZOmLgKK4_rGEqcfRvPG5-B5jE_W_hW1umV2HHwPr_-PqoXoTuO9xWNfdwCvuqkk__W92sbX-UegCPlkKHZuWEcPWyxSAwVWciQca_oOy5hP9AgxPmgCoSu03wcwoIUyN1G_-hkFHXD5HmBCbCjYiW7gnXKdJKE6dp4Z_oLc05Ol4A Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: e30500ead1404e5188c6d90e5b302742 Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e30500ead1404e5188c6d90e5b302742"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e30500ead1404e5188c6d90e5b302742"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e30500ead1404e5188c6d90e5b302742"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e30500ead1404e5188c6d90e5b302742"}]}] Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: e30500ead1404e5188c6d90e5b302742 Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-1013665673 Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestNetworkAdvancedServerOps-1013665673-project Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a95598cd3fe04a0abff7aac9f0c49bff Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestNetworkAdvancedServerOps-1013665673-project Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 452c465e-1b1b-47c7-9ca3-a8a47914389a could not be found. Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '452c465e-1b1b-47c7-9ca3-a8a47914389a'} Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 452c465e-1b1b-47c7-9ca3-a8a47914389a could not be found. Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 452c465e-1b1b-47c7-9ca3-a8a47914389a could not be found. Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:02:07.285339 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:02:07.289919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:02:07.289919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:02:07.289919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:02:07.289919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:02:07.289919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:02:07.289919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:02:07.289919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 452c465e-1b1b-47c7-9ca3-a8a47914389a could not be found. Oct 11 05:02:07.289919 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:02:07.291158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Returning 404 to user: Instance 452c465e-1b1b-47c7-9ca3-a8a47914389a could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:02:07.292030 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ca50028d-2094-4053-91cd-1ee898c53c3d tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a" status: 404 len: 111 microversion: 2.1 time: 0.039091 Oct 11 05:02:07.292891 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3630/7024] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:07 2022] GET /compute/v2.1/servers/452c465e-1b1b-47c7-9ca3-a8a47914389a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:02:11.346932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-89f54228-24a5-4127-b685-0563a36dad36 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] Calling method '.version_select at 0x7fda1a2660d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:11.352699 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [None req-89f54228-24a5-4127-b685-0563a36dad36 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [e97bebfd-ed87-4f8d-a2d1-630722a087bb] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:02:12.361210 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [None req-89f54228-24a5-4127-b685-0563a36dad36 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] [e97bebfd-ed87-4f8d-a2d1-630722a087bb] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 34690. Oct 11 05:02:12.447150 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-89f54228-24a5-4127-b685-0563a36dad36 tempest-TestNetworkAdvancedServerOps-1013665673 tempest-TestNetworkAdvancedServerOps-1013665673-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1068534364" status: 202 len: 0 microversion: 2.1 time: 1.104255 Oct 11 05:02:12.447858 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3395/7025] 10.222.0.26 () {58 vars in 1284 bytes} [Tue Oct 11 05:02:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-1068534364 => generated 0 bytes in 1106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:02:37.565132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-563197168", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "c30aefc5-e85d-41c5-b14b-efec25bb1992", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:02:37.576027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=31 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:02:37.579045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=71 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:02:37.579045 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:02:37.579045 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:02:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Oct 11 05:02:37.659705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] validate_networks() for [('dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:02:38.030823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:02:38.031250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:02:38.031725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:02:38.032133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:02:38.032544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:02:38.041444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:38.041922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:38.042394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:38.043118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:38.043569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:38.043992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:38.061243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:02:38.066507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for user 5a1c61d68e1a479bb0dc096271f4cbde and project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:02:38.079173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:02:38.081213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='c30aefc5-e85d-41c5-b14b-efec25bb1992',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:02:38.263986 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-262e4727-b39e-4aa0-a12f-ab01f769a464 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.702708 Oct 11 05:02:38.264916 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3631/7026] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:02:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:02:38.274113 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:02:38.274655 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:02:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 (ip 10.222.0.26) !!! Oct 11 05:02:38.276384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=7 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:02:38.277121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:02:38.287004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-518e0ed9-5ce4-44f0-8752-61e2c9fe39e7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:38.287004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-518e0ed9-5ce4-44f0-8752-61e2c9fe39e7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:38.341132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-518e0ed9-5ce4-44f0-8752-61e2c9fe39e7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:38.350469 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-518e0ed9-5ce4-44f0-8752-61e2c9fe39e7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1056 microversion: 2.1 time: 0.076179 Oct 11 05:02:38.350469 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3396/7027] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:38 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1056 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:39.371411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7971fdb3-2bd7-4cd6-8d83-99c8dc72f9f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:39.372005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7971fdb3-2bd7-4cd6-8d83-99c8dc72f9f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:39.380347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7971fdb3-2bd7-4cd6-8d83-99c8dc72f9f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:39.380840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7971fdb3-2bd7-4cd6-8d83-99c8dc72f9f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:39.381285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7971fdb3-2bd7-4cd6-8d83-99c8dc72f9f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:39.381979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7971fdb3-2bd7-4cd6-8d83-99c8dc72f9f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:39.382465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7971fdb3-2bd7-4cd6-8d83-99c8dc72f9f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:39.382895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7971fdb3-2bd7-4cd6-8d83-99c8dc72f9f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:39.444786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7971fdb3-2bd7-4cd6-8d83-99c8dc72f9f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:39.453421 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7971fdb3-2bd7-4cd6-8d83-99c8dc72f9f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1060 microversion: 2.1 time: 0.086763 Oct 11 05:02:39.454051 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3632/7028] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:39 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1060 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:40.476746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3b89c5c4-f440-455f-8864-00d58ce7526c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:40.477459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3b89c5c4-f440-455f-8864-00d58ce7526c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:40.485269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b89c5c4-f440-455f-8864-00d58ce7526c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:40.485868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b89c5c4-f440-455f-8864-00d58ce7526c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:40.486392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b89c5c4-f440-455f-8864-00d58ce7526c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:40.487093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b89c5c4-f440-455f-8864-00d58ce7526c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:40.487552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b89c5c4-f440-455f-8864-00d58ce7526c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:40.487977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b89c5c4-f440-455f-8864-00d58ce7526c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:40.560759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3b89c5c4-f440-455f-8864-00d58ce7526c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:40.568569 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3b89c5c4-f440-455f-8864-00d58ce7526c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1116 microversion: 2.1 time: 0.096665 Oct 11 05:02:40.569135 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3397/7029] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:40 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1116 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:41.592017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f4db322a-9e68-4a8c-a4d2-da5f5bade24d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:41.592836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f4db322a-9e68-4a8c-a4d2-da5f5bade24d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:41.599897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4db322a-9e68-4a8c-a4d2-da5f5bade24d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:41.600514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4db322a-9e68-4a8c-a4d2-da5f5bade24d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:41.601245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4db322a-9e68-4a8c-a4d2-da5f5bade24d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:41.602208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4db322a-9e68-4a8c-a4d2-da5f5bade24d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:41.602771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4db322a-9e68-4a8c-a4d2-da5f5bade24d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:41.603880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4db322a-9e68-4a8c-a4d2-da5f5bade24d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:41.753493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f4db322a-9e68-4a8c-a4d2-da5f5bade24d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:41.763885 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f4db322a-9e68-4a8c-a4d2-da5f5bade24d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.176813 Oct 11 05:02:41.778338 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3633/7030] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:41 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:42.133222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-188d3faf-3f3b-4652-b7c3-c3f3ab6edd04 req-e5507e86-d675-4357-a9f1-edbe98d3aa3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2", "tag": "c351da75-430d-4ae0-b48e-a220c11ed968"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:02:42.145826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-188d3faf-3f3b-4652-b7c3-c3f3ab6edd04 req-e5507e86-d675-4357-a9f1-edbe98d3aa3a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:42.146480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-188d3faf-3f3b-4652-b7c3-c3f3ab6edd04 req-e5507e86-d675-4357-a9f1-edbe98d3aa3a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:42.147279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-188d3faf-3f3b-4652-b7c3-c3f3ab6edd04 req-e5507e86-d675-4357-a9f1-edbe98d3aa3a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:42.171699 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-188d3faf-3f3b-4652-b7c3-c3f3ab6edd04 req-e5507e86-d675-4357-a9f1-edbe98d3aa3a service nova] Creating event network-changed:c351da75-430d-4ae0-b48e-a220c11ed968 for instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 on n-h1-860892-1 Oct 11 05:02:42.177803 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-188d3faf-3f3b-4652-b7c3-c3f3ab6edd04 req-e5507e86-d675-4357-a9f1-edbe98d3aa3a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049329 Oct 11 05:02:42.178777 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3398/7031] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:02:42.787727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9757d743-89c4-4d1c-a132-912ff91702cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:42.788698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9757d743-89c4-4d1c-a132-912ff91702cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:42.796140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9757d743-89c4-4d1c-a132-912ff91702cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:42.796641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9757d743-89c4-4d1c-a132-912ff91702cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:42.797081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9757d743-89c4-4d1c-a132-912ff91702cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:42.797787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9757d743-89c4-4d1c-a132-912ff91702cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:42.798274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9757d743-89c4-4d1c-a132-912ff91702cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:42.798850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9757d743-89c4-4d1c-a132-912ff91702cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:42.960806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9757d743-89c4-4d1c-a132-912ff91702cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:42.968957 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9757d743-89c4-4d1c-a132-912ff91702cf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.185397 Oct 11 05:02:42.969529 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3634/7032] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:42 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:43.992491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-935cf028-8729-4422-8967-e37c98afa94f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:43.993188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-935cf028-8729-4422-8967-e37c98afa94f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:44.001096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-935cf028-8729-4422-8967-e37c98afa94f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:44.001578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-935cf028-8729-4422-8967-e37c98afa94f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:44.002020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-935cf028-8729-4422-8967-e37c98afa94f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:44.002747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-935cf028-8729-4422-8967-e37c98afa94f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:44.003199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-935cf028-8729-4422-8967-e37c98afa94f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:44.003621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-935cf028-8729-4422-8967-e37c98afa94f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:44.143142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-935cf028-8729-4422-8967-e37c98afa94f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:44.151141 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-935cf028-8729-4422-8967-e37c98afa94f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.162886 Oct 11 05:02:44.151737 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3399/7033] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:43 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:45.173854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6cf27bdb-ab7f-4050-b860-3bc4e14eb3ee tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:45.174510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6cf27bdb-ab7f-4050-b860-3bc4e14eb3ee tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:45.181395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cf27bdb-ab7f-4050-b860-3bc4e14eb3ee tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:45.181878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cf27bdb-ab7f-4050-b860-3bc4e14eb3ee tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:45.182351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cf27bdb-ab7f-4050-b860-3bc4e14eb3ee tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:45.183046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cf27bdb-ab7f-4050-b860-3bc4e14eb3ee tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:45.183501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cf27bdb-ab7f-4050-b860-3bc4e14eb3ee tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:45.183927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cf27bdb-ab7f-4050-b860-3bc4e14eb3ee tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:45.333028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6cf27bdb-ab7f-4050-b860-3bc4e14eb3ee tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:45.341266 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6cf27bdb-ab7f-4050-b860-3bc4e14eb3ee tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.171413 Oct 11 05:02:45.341862 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3635/7034] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:45 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:46.363596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bc367162-a645-4338-8717-c123fb6611b5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:46.364238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bc367162-a645-4338-8717-c123fb6611b5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:46.371430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc367162-a645-4338-8717-c123fb6611b5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:46.371918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc367162-a645-4338-8717-c123fb6611b5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:46.372357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc367162-a645-4338-8717-c123fb6611b5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:46.373075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc367162-a645-4338-8717-c123fb6611b5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:46.373527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc367162-a645-4338-8717-c123fb6611b5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:46.373983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bc367162-a645-4338-8717-c123fb6611b5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:46.521017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bc367162-a645-4338-8717-c123fb6611b5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:46.529539 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bc367162-a645-4338-8717-c123fb6611b5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.169847 Oct 11 05:02:46.530269 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3400/7035] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:46 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:47.554862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9a417252-d4fd-4fc1-84a4-443d40f42f3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:47.555476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9a417252-d4fd-4fc1-84a4-443d40f42f3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:47.562208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a417252-d4fd-4fc1-84a4-443d40f42f3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:47.562817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a417252-d4fd-4fc1-84a4-443d40f42f3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:47.563131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a417252-d4fd-4fc1-84a4-443d40f42f3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:47.563816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a417252-d4fd-4fc1-84a4-443d40f42f3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:47.564269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a417252-d4fd-4fc1-84a4-443d40f42f3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:47.564692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9a417252-d4fd-4fc1-84a4-443d40f42f3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:47.701144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9a417252-d4fd-4fc1-84a4-443d40f42f3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:47.709061 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9a417252-d4fd-4fc1-84a4-443d40f42f3e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.158887 Oct 11 05:02:47.709639 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3636/7036] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:47 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:48.734903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bda9622f-1f5f-4b9e-b614-4bd4ef672b0f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:48.735454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bda9622f-1f5f-4b9e-b614-4bd4ef672b0f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:48.738298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:02:48.743207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bda9622f-1f5f-4b9e-b614-4bd4ef672b0f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:48.743687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bda9622f-1f5f-4b9e-b614-4bd4ef672b0f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:48.744124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bda9622f-1f5f-4b9e-b614-4bd4ef672b0f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:48.744812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bda9622f-1f5f-4b9e-b614-4bd4ef672b0f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:48.745266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bda9622f-1f5f-4b9e-b614-4bd4ef672b0f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:48.745690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bda9622f-1f5f-4b9e-b614-4bd4ef672b0f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:48.885041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bda9622f-1f5f-4b9e-b614-4bd4ef672b0f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:48.893523 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bda9622f-1f5f-4b9e-b614-4bd4ef672b0f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.163522 Oct 11 05:02:48.897678 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3401/7037] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:48 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:49.916302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13b5124a-d634-4c14-af16-6ca3c124dbf4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:49.916911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-13b5124a-d634-4c14-af16-6ca3c124dbf4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:49.918787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:02:49.919455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:02:49.925341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13b5124a-d634-4c14-af16-6ca3c124dbf4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:49.931663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13b5124a-d634-4c14-af16-6ca3c124dbf4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:49.931663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13b5124a-d634-4c14-af16-6ca3c124dbf4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:49.931663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13b5124a-d634-4c14-af16-6ca3c124dbf4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:49.931663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13b5124a-d634-4c14-af16-6ca3c124dbf4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:49.931663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13b5124a-d634-4c14-af16-6ca3c124dbf4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:50.065164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-13b5124a-d634-4c14-af16-6ca3c124dbf4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:50.072878 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-13b5124a-d634-4c14-af16-6ca3c124dbf4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.160498 Oct 11 05:02:50.075189 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3637/7038] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:49 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:51.096461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e8d74be-8df5-4b4a-8f45-029ac099eca8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:51.097110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4e8d74be-8df5-4b4a-8f45-029ac099eca8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:51.104044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e8d74be-8df5-4b4a-8f45-029ac099eca8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:51.104528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e8d74be-8df5-4b4a-8f45-029ac099eca8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:51.104970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e8d74be-8df5-4b4a-8f45-029ac099eca8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:51.106223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e8d74be-8df5-4b4a-8f45-029ac099eca8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:51.106637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e8d74be-8df5-4b4a-8f45-029ac099eca8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:51.107170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e8d74be-8df5-4b4a-8f45-029ac099eca8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:51.243057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4e8d74be-8df5-4b4a-8f45-029ac099eca8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:51.251630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4e8d74be-8df5-4b4a-8f45-029ac099eca8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.158992 Oct 11 05:02:51.252951 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3402/7039] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:51 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:52.276229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ffb5afba-a0ae-4818-85ff-0fed4c99f1d7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:52.276843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ffb5afba-a0ae-4818-85ff-0fed4c99f1d7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:52.285668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffb5afba-a0ae-4818-85ff-0fed4c99f1d7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:52.286164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffb5afba-a0ae-4818-85ff-0fed4c99f1d7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:52.286646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffb5afba-a0ae-4818-85ff-0fed4c99f1d7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:52.287358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffb5afba-a0ae-4818-85ff-0fed4c99f1d7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:52.287828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffb5afba-a0ae-4818-85ff-0fed4c99f1d7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:52.288263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ffb5afba-a0ae-4818-85ff-0fed4c99f1d7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:52.423405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ffb5afba-a0ae-4818-85ff-0fed4c99f1d7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:52.431753 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ffb5afba-a0ae-4818-85ff-0fed4c99f1d7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.158885 Oct 11 05:02:52.436903 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3638/7040] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:52 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:53.454342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1a29a3fe-5e6a-4a40-be98-41b7e36ece90 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:53.454959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1a29a3fe-5e6a-4a40-be98-41b7e36ece90 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:53.461744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a29a3fe-5e6a-4a40-be98-41b7e36ece90 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:53.462253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a29a3fe-5e6a-4a40-be98-41b7e36ece90 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:53.462693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a29a3fe-5e6a-4a40-be98-41b7e36ece90 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:53.463376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a29a3fe-5e6a-4a40-be98-41b7e36ece90 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:53.463828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a29a3fe-5e6a-4a40-be98-41b7e36ece90 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:53.464252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1a29a3fe-5e6a-4a40-be98-41b7e36ece90 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:53.605148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1a29a3fe-5e6a-4a40-be98-41b7e36ece90 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:53.613582 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1a29a3fe-5e6a-4a40-be98-41b7e36ece90 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.163201 Oct 11 05:02:53.614182 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3403/7041] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:53 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:54.637737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-572ced57-a8d4-4266-9621-c0275299738b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:54.638409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-572ced57-a8d4-4266-9621-c0275299738b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:54.645340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-572ced57-a8d4-4266-9621-c0275299738b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:54.645820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-572ced57-a8d4-4266-9621-c0275299738b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:54.646279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-572ced57-a8d4-4266-9621-c0275299738b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:54.646971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-572ced57-a8d4-4266-9621-c0275299738b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:54.647427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-572ced57-a8d4-4266-9621-c0275299738b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:54.647854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-572ced57-a8d4-4266-9621-c0275299738b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:54.784549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-572ced57-a8d4-4266-9621-c0275299738b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:54.792593 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-572ced57-a8d4-4266-9621-c0275299738b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.159339 Oct 11 05:02:54.793179 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3639/7042] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:54 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:55.817347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7bef09b-1692-4277-b013-5ad3e63d85a0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:55.818075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a7bef09b-1692-4277-b013-5ad3e63d85a0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:55.827258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7bef09b-1692-4277-b013-5ad3e63d85a0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:55.828081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7bef09b-1692-4277-b013-5ad3e63d85a0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:55.828853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7bef09b-1692-4277-b013-5ad3e63d85a0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:55.829751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7bef09b-1692-4277-b013-5ad3e63d85a0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:55.830217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7bef09b-1692-4277-b013-5ad3e63d85a0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:55.830699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7bef09b-1692-4277-b013-5ad3e63d85a0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:55.972847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a7bef09b-1692-4277-b013-5ad3e63d85a0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:55.980858 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a7bef09b-1692-4277-b013-5ad3e63d85a0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.167418 Oct 11 05:02:55.981427 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3404/7043] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:55 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:57.004340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c20bdb6d-7fff-4df8-9a81-706055f4a310 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:57.004997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c20bdb6d-7fff-4df8-9a81-706055f4a310 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:57.012563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c20bdb6d-7fff-4df8-9a81-706055f4a310 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:57.013053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c20bdb6d-7fff-4df8-9a81-706055f4a310 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:57.013518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c20bdb6d-7fff-4df8-9a81-706055f4a310 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:57.014239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c20bdb6d-7fff-4df8-9a81-706055f4a310 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:57.014696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c20bdb6d-7fff-4df8-9a81-706055f4a310 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:57.015128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c20bdb6d-7fff-4df8-9a81-706055f4a310 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:57.148074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c20bdb6d-7fff-4df8-9a81-706055f4a310 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:57.155793 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c20bdb6d-7fff-4df8-9a81-706055f4a310 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.155430 Oct 11 05:02:57.156368 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3640/7044] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:56 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:58.180572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e51777cb-b8d0-429a-925a-2e40df6c9264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:58.181305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e51777cb-b8d0-429a-925a-2e40df6c9264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:58.188287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e51777cb-b8d0-429a-925a-2e40df6c9264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:58.188774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e51777cb-b8d0-429a-925a-2e40df6c9264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:58.189221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e51777cb-b8d0-429a-925a-2e40df6c9264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:58.189909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e51777cb-b8d0-429a-925a-2e40df6c9264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:58.190405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e51777cb-b8d0-429a-925a-2e40df6c9264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:58.190831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e51777cb-b8d0-429a-925a-2e40df6c9264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:58.329582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e51777cb-b8d0-429a-925a-2e40df6c9264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:58.337508 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e51777cb-b8d0-429a-925a-2e40df6c9264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.161873 Oct 11 05:02:58.338073 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3405/7045] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:58 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:02:59.363302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-14facf8b-4aa0-42c7-b59f-7d16288b0c57 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:02:59.363917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-14facf8b-4aa0-42c7-b59f-7d16288b0c57 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:02:59.370831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14facf8b-4aa0-42c7-b59f-7d16288b0c57 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:59.371314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14facf8b-4aa0-42c7-b59f-7d16288b0c57 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:59.371752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14facf8b-4aa0-42c7-b59f-7d16288b0c57 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:59.372442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14facf8b-4aa0-42c7-b59f-7d16288b0c57 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:02:59.372898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14facf8b-4aa0-42c7-b59f-7d16288b0c57 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:02:59.373473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14facf8b-4aa0-42c7-b59f-7d16288b0c57 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:02:59.515167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-14facf8b-4aa0-42c7-b59f-7d16288b0c57 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:02:59.523616 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-14facf8b-4aa0-42c7-b59f-7d16288b0c57 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.164739 Oct 11 05:02:59.524328 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3641/7046] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:02:59 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:00.548672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6a4d50e8-748b-4135-8051-257738021e35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:00.549279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6a4d50e8-748b-4135-8051-257738021e35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:00.555864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a4d50e8-748b-4135-8051-257738021e35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:00.556345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a4d50e8-748b-4135-8051-257738021e35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:00.556777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a4d50e8-748b-4135-8051-257738021e35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:00.557562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a4d50e8-748b-4135-8051-257738021e35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:00.558016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a4d50e8-748b-4135-8051-257738021e35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:00.558456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a4d50e8-748b-4135-8051-257738021e35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:00.694115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6a4d50e8-748b-4135-8051-257738021e35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:00.702051 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6a4d50e8-748b-4135-8051-257738021e35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.157457 Oct 11 05:03:00.702665 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3406/7047] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:00 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:01.726776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72bd3026-45d4-49ec-84bd-f223d26bd3b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:01.727676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72bd3026-45d4-49ec-84bd-f223d26bd3b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:01.735829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72bd3026-45d4-49ec-84bd-f223d26bd3b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:01.737322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72bd3026-45d4-49ec-84bd-f223d26bd3b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:01.737912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72bd3026-45d4-49ec-84bd-f223d26bd3b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:01.738646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72bd3026-45d4-49ec-84bd-f223d26bd3b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:01.739430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72bd3026-45d4-49ec-84bd-f223d26bd3b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:01.740222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72bd3026-45d4-49ec-84bd-f223d26bd3b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:01.903518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72bd3026-45d4-49ec-84bd-f223d26bd3b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:01.911934 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72bd3026-45d4-49ec-84bd-f223d26bd3b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.189291 Oct 11 05:03:01.912702 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3642/7048] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:01 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:02.934958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-73615402-ff6d-43c1-9b95-2ebe68c6d5ed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:02.936717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73615402-ff6d-43c1-9b95-2ebe68c6d5ed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:02.943424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73615402-ff6d-43c1-9b95-2ebe68c6d5ed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:02.944012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73615402-ff6d-43c1-9b95-2ebe68c6d5ed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:02.944456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73615402-ff6d-43c1-9b95-2ebe68c6d5ed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:02.945154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73615402-ff6d-43c1-9b95-2ebe68c6d5ed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:02.945608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73615402-ff6d-43c1-9b95-2ebe68c6d5ed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:02.946036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73615402-ff6d-43c1-9b95-2ebe68c6d5ed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:03.089195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73615402-ff6d-43c1-9b95-2ebe68c6d5ed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:03.097890 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-73615402-ff6d-43c1-9b95-2ebe68c6d5ed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.167097 Oct 11 05:03:03.098491 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3407/7049] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:02 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:04.121369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f49a6fd0-80e8-4cd1-a219-d11ba69d8222 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:04.121985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f49a6fd0-80e8-4cd1-a219-d11ba69d8222 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:04.128930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49a6fd0-80e8-4cd1-a219-d11ba69d8222 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:04.129411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49a6fd0-80e8-4cd1-a219-d11ba69d8222 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:04.129854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49a6fd0-80e8-4cd1-a219-d11ba69d8222 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:04.130572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49a6fd0-80e8-4cd1-a219-d11ba69d8222 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:04.131025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49a6fd0-80e8-4cd1-a219-d11ba69d8222 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:04.131454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49a6fd0-80e8-4cd1-a219-d11ba69d8222 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:04.258963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f49a6fd0-80e8-4cd1-a219-d11ba69d8222 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:04.266830 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f49a6fd0-80e8-4cd1-a219-d11ba69d8222 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.149377 Oct 11 05:03:04.267434 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3643/7050] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:04 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:03:05.290419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-86d9c480-54ba-45e9-ae7e-65281341a110 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:05.291037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-86d9c480-54ba-45e9-ae7e-65281341a110 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:05.297854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86d9c480-54ba-45e9-ae7e-65281341a110 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:05.298369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86d9c480-54ba-45e9-ae7e-65281341a110 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:05.298811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86d9c480-54ba-45e9-ae7e-65281341a110 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:05.299517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86d9c480-54ba-45e9-ae7e-65281341a110 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:05.299954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86d9c480-54ba-45e9-ae7e-65281341a110 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:05.300387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86d9c480-54ba-45e9-ae7e-65281341a110 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:05.430679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-86d9c480-54ba-45e9-ae7e-65281341a110 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:05.436356 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-86d9c480-54ba-45e9-ae7e-65281341a110 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.149935 Oct 11 05:03:05.436927 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3408/7051] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:05 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:06.459629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-153b457b-0bc3-4a6e-a425-a56d7d7589f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:06.460416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-153b457b-0bc3-4a6e-a425-a56d7d7589f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:06.467597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-153b457b-0bc3-4a6e-a425-a56d7d7589f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:06.468089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-153b457b-0bc3-4a6e-a425-a56d7d7589f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:06.468529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-153b457b-0bc3-4a6e-a425-a56d7d7589f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:06.469269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-153b457b-0bc3-4a6e-a425-a56d7d7589f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:06.469730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-153b457b-0bc3-4a6e-a425-a56d7d7589f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:06.470170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-153b457b-0bc3-4a6e-a425-a56d7d7589f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:06.609454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-153b457b-0bc3-4a6e-a425-a56d7d7589f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:06.617847 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-153b457b-0bc3-4a6e-a425-a56d7d7589f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.162224 Oct 11 05:03:06.618453 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3644/7052] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:06 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:07.641179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d626461d-04d1-4e85-ae10-b12b2d80811b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:07.641803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d626461d-04d1-4e85-ae10-b12b2d80811b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:07.649648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d626461d-04d1-4e85-ae10-b12b2d80811b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:07.650142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d626461d-04d1-4e85-ae10-b12b2d80811b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:07.650607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d626461d-04d1-4e85-ae10-b12b2d80811b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:07.651316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d626461d-04d1-4e85-ae10-b12b2d80811b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:07.651771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d626461d-04d1-4e85-ae10-b12b2d80811b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:07.652197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d626461d-04d1-4e85-ae10-b12b2d80811b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:07.784566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d626461d-04d1-4e85-ae10-b12b2d80811b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:07.792748 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d626461d-04d1-4e85-ae10-b12b2d80811b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.155569 Oct 11 05:03:07.793439 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3409/7053] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:07 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:08.815028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b7a50781-5911-41d1-b9ea-f103804b1b49 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:08.815647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b7a50781-5911-41d1-b9ea-f103804b1b49 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:08.818498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:03:08.823298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a50781-5911-41d1-b9ea-f103804b1b49 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:08.823786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a50781-5911-41d1-b9ea-f103804b1b49 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:08.824208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a50781-5911-41d1-b9ea-f103804b1b49 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:08.824887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a50781-5911-41d1-b9ea-f103804b1b49 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:08.825372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a50781-5911-41d1-b9ea-f103804b1b49 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:08.825795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b7a50781-5911-41d1-b9ea-f103804b1b49 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:08.828417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=81 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:03:08.957455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b7a50781-5911-41d1-b9ea-f103804b1b49 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:08.965302 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b7a50781-5911-41d1-b9ea-f103804b1b49 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.154270 Oct 11 05:03:08.965873 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3645/7054] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:08 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:09.988687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7b7e83b7-fdb5-4ff3-a1fa-b1a63b3c997d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:09.989424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7b7e83b7-fdb5-4ff3-a1fa-b1a63b3c997d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:09.996219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b7e83b7-fdb5-4ff3-a1fa-b1a63b3c997d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:09.996720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b7e83b7-fdb5-4ff3-a1fa-b1a63b3c997d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:09.997162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b7e83b7-fdb5-4ff3-a1fa-b1a63b3c997d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:09.997872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b7e83b7-fdb5-4ff3-a1fa-b1a63b3c997d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:09.998363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b7e83b7-fdb5-4ff3-a1fa-b1a63b3c997d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:09.998796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7b7e83b7-fdb5-4ff3-a1fa-b1a63b3c997d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:10.136174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7b7e83b7-fdb5-4ff3-a1fa-b1a63b3c997d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:10.144072 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7b7e83b7-fdb5-4ff3-a1fa-b1a63b3c997d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.160156 Oct 11 05:03:10.144716 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3410/7055] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:09 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:03:11.167377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ebbae3e9-59a6-4a9f-87e4-a6034819ee83 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:11.167954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ebbae3e9-59a6-4a9f-87e4-a6034819ee83 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:11.174928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebbae3e9-59a6-4a9f-87e4-a6034819ee83 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:11.175414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebbae3e9-59a6-4a9f-87e4-a6034819ee83 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:11.175856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebbae3e9-59a6-4a9f-87e4-a6034819ee83 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:11.176557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebbae3e9-59a6-4a9f-87e4-a6034819ee83 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:11.177017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebbae3e9-59a6-4a9f-87e4-a6034819ee83 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:11.177448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebbae3e9-59a6-4a9f-87e4-a6034819ee83 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:11.307694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ebbae3e9-59a6-4a9f-87e4-a6034819ee83 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:11.315402 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ebbae3e9-59a6-4a9f-87e4-a6034819ee83 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1168 microversion: 2.1 time: 0.152482 Oct 11 05:03:11.316512 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3646/7056] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:11 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1168 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:12.338918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-04f49795-95ed-46a2-aabc-12eabcf966e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:12.339530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-04f49795-95ed-46a2-aabc-12eabcf966e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:12.346449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04f49795-95ed-46a2-aabc-12eabcf966e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:12.349115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04f49795-95ed-46a2-aabc-12eabcf966e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:12.349115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04f49795-95ed-46a2-aabc-12eabcf966e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:12.349115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04f49795-95ed-46a2-aabc-12eabcf966e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:12.349115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04f49795-95ed-46a2-aabc-12eabcf966e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:12.349518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-04f49795-95ed-46a2-aabc-12eabcf966e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:12.351940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=81 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:03:12.478923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-04f49795-95ed-46a2-aabc-12eabcf966e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:12.486610 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-04f49795-95ed-46a2-aabc-12eabcf966e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1202 microversion: 2.1 time: 0.151649 Oct 11 05:03:12.487185 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3411/7057] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:12 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:13.509710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2fba1d0d-66d5-4228-b331-521c49348701 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:13.510353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2fba1d0d-66d5-4228-b331-521c49348701 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:13.517558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fba1d0d-66d5-4228-b331-521c49348701 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:13.518045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fba1d0d-66d5-4228-b331-521c49348701 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:13.518587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fba1d0d-66d5-4228-b331-521c49348701 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:13.519300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fba1d0d-66d5-4228-b331-521c49348701 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:13.519753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fba1d0d-66d5-4228-b331-521c49348701 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:13.520641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2fba1d0d-66d5-4228-b331-521c49348701 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:13.655908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2fba1d0d-66d5-4228-b331-521c49348701 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:13.664389 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2fba1d0d-66d5-4228-b331-521c49348701 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1202 microversion: 2.1 time: 0.158782 Oct 11 05:03:13.664985 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3647/7058] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:13 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:14.687557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-56ad7901-4e49-4e63-aca8-4c9338d3ef1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:14.688173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-56ad7901-4e49-4e63-aca8-4c9338d3ef1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:14.691526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=35 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:03:14.696251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56ad7901-4e49-4e63-aca8-4c9338d3ef1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:14.696733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56ad7901-4e49-4e63-aca8-4c9338d3ef1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:14.697171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56ad7901-4e49-4e63-aca8-4c9338d3ef1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:14.697868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56ad7901-4e49-4e63-aca8-4c9338d3ef1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:14.698355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56ad7901-4e49-4e63-aca8-4c9338d3ef1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:14.698782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-56ad7901-4e49-4e63-aca8-4c9338d3ef1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:14.834519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-56ad7901-4e49-4e63-aca8-4c9338d3ef1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:14.842340 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-56ad7901-4e49-4e63-aca8-4c9338d3ef1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1202 microversion: 2.1 time: 0.158597 Oct 11 05:03:14.842934 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3412/7059] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:14 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1202 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:15.865010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-000a6d0c-0df0-4096-b420-4036b0ff3c9a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:15.865624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-000a6d0c-0df0-4096-b420-4036b0ff3c9a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:15.872491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-000a6d0c-0df0-4096-b420-4036b0ff3c9a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:15.872971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-000a6d0c-0df0-4096-b420-4036b0ff3c9a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:15.873406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-000a6d0c-0df0-4096-b420-4036b0ff3c9a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:15.874092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-000a6d0c-0df0-4096-b420-4036b0ff3c9a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:15.874571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-000a6d0c-0df0-4096-b420-4036b0ff3c9a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:15.875003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-000a6d0c-0df0-4096-b420-4036b0ff3c9a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:16.004720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-000a6d0c-0df0-4096-b420-4036b0ff3c9a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:16.013016 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-000a6d0c-0df0-4096-b420-4036b0ff3c9a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1202 microversion: 2.1 time: 0.152020 Oct 11 05:03:16.013599 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3648/7060] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:15 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1202 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:17.036933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d4183e50-f2f9-4143-9c8c-ed0a385f2b80 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:17.037665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d4183e50-f2f9-4143-9c8c-ed0a385f2b80 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:17.044518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4183e50-f2f9-4143-9c8c-ed0a385f2b80 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:17.044997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4183e50-f2f9-4143-9c8c-ed0a385f2b80 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:17.045429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4183e50-f2f9-4143-9c8c-ed0a385f2b80 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:17.046107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4183e50-f2f9-4143-9c8c-ed0a385f2b80 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:17.046582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4183e50-f2f9-4143-9c8c-ed0a385f2b80 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:17.047002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4183e50-f2f9-4143-9c8c-ed0a385f2b80 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:17.173486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d4183e50-f2f9-4143-9c8c-ed0a385f2b80 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:17.181224 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d4183e50-f2f9-4143-9c8c-ed0a385f2b80 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1202 microversion: 2.1 time: 0.148816 Oct 11 05:03:17.181995 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3413/7061] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:17 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:18.204187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-53755506-06c1-4e24-bc43-a7717735f04c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:18.204808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-53755506-06c1-4e24-bc43-a7717735f04c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:18.211350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53755506-06c1-4e24-bc43-a7717735f04c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:18.211833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53755506-06c1-4e24-bc43-a7717735f04c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:18.212299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53755506-06c1-4e24-bc43-a7717735f04c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:18.212993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53755506-06c1-4e24-bc43-a7717735f04c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:18.213451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53755506-06c1-4e24-bc43-a7717735f04c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:18.213881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-53755506-06c1-4e24-bc43-a7717735f04c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:18.345270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-53755506-06c1-4e24-bc43-a7717735f04c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:18.353657 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-53755506-06c1-4e24-bc43-a7717735f04c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1202 microversion: 2.1 time: 0.153880 Oct 11 05:03:18.357935 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3649/7062] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:18 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:19.377302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9686f88d-29b6-430f-ac1f-e23a438884fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:19.377950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9686f88d-29b6-430f-ac1f-e23a438884fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:19.385667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9686f88d-29b6-430f-ac1f-e23a438884fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:19.386149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9686f88d-29b6-430f-ac1f-e23a438884fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:19.386617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9686f88d-29b6-430f-ac1f-e23a438884fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:19.387309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9686f88d-29b6-430f-ac1f-e23a438884fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:19.387763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9686f88d-29b6-430f-ac1f-e23a438884fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:19.388191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9686f88d-29b6-430f-ac1f-e23a438884fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:19.514331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9686f88d-29b6-430f-ac1f-e23a438884fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:19.522383 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9686f88d-29b6-430f-ac1f-e23a438884fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1202 microversion: 2.1 time: 0.149217 Oct 11 05:03:19.522955 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3414/7063] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:19 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1202 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:20.544629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-64e92143-fbc7-4e55-ac52-b5f3e894ceae tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:20.545242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-64e92143-fbc7-4e55-ac52-b5f3e894ceae tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:20.552108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e92143-fbc7-4e55-ac52-b5f3e894ceae tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:20.552587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e92143-fbc7-4e55-ac52-b5f3e894ceae tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:20.553019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e92143-fbc7-4e55-ac52-b5f3e894ceae tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:20.553701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e92143-fbc7-4e55-ac52-b5f3e894ceae tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:20.554149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e92143-fbc7-4e55-ac52-b5f3e894ceae tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:20.554596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64e92143-fbc7-4e55-ac52-b5f3e894ceae tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:20.682431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-64e92143-fbc7-4e55-ac52-b5f3e894ceae tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:20.690067 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-64e92143-fbc7-4e55-ac52-b5f3e894ceae tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1202 microversion: 2.1 time: 0.149356 Oct 11 05:03:20.691320 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3650/7064] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:20 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1202 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:21.713371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-08eb3bf9-124a-4692-8591-c65f66910653 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:21.713983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-08eb3bf9-124a-4692-8591-c65f66910653 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:21.720793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08eb3bf9-124a-4692-8591-c65f66910653 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:21.721271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08eb3bf9-124a-4692-8591-c65f66910653 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:21.722365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08eb3bf9-124a-4692-8591-c65f66910653 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:21.723092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08eb3bf9-124a-4692-8591-c65f66910653 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:21.723579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08eb3bf9-124a-4692-8591-c65f66910653 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:21.724004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-08eb3bf9-124a-4692-8591-c65f66910653 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:21.855654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-08eb3bf9-124a-4692-8591-c65f66910653 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:21.863467 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-08eb3bf9-124a-4692-8591-c65f66910653 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1202 microversion: 2.1 time: 0.153990 Oct 11 05:03:21.864043 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3415/7065] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:21 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1202 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:22.074624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d608bbd1-3775-4949-b845-79bd6d2bb235 req-5e730646-2e39-40e2-973b-9777b56eb68e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2", "name": "network-vif-plugged", "status": "completed", "tag": "c351da75-430d-4ae0-b48e-a220c11ed968"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:03:22.085695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d608bbd1-3775-4949-b845-79bd6d2bb235 req-5e730646-2e39-40e2-973b-9777b56eb68e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:22.086662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d608bbd1-3775-4949-b845-79bd6d2bb235 req-5e730646-2e39-40e2-973b-9777b56eb68e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:22.087106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d608bbd1-3775-4949-b845-79bd6d2bb235 req-5e730646-2e39-40e2-973b-9777b56eb68e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:22.098083 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d608bbd1-3775-4949-b845-79bd6d2bb235 req-5e730646-2e39-40e2-973b-9777b56eb68e service nova] Creating event network-vif-plugged:c351da75-430d-4ae0-b48e-a220c11ed968 for instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 on n-h1-860892-1 Oct 11 05:03:22.103109 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d608bbd1-3775-4949-b845-79bd6d2bb235 req-5e730646-2e39-40e2-973b-9777b56eb68e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032371 Oct 11 05:03:22.109290 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3651/7066] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:03:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:03:22.886654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff595da6-19c8-407b-a7e4-d1c2d64f9129 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:22.887283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff595da6-19c8-407b-a7e4-d1c2d64f9129 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:22.894172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff595da6-19c8-407b-a7e4-d1c2d64f9129 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:22.894691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff595da6-19c8-407b-a7e4-d1c2d64f9129 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:22.895133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff595da6-19c8-407b-a7e4-d1c2d64f9129 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:22.895827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff595da6-19c8-407b-a7e4-d1c2d64f9129 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:22.896283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff595da6-19c8-407b-a7e4-d1c2d64f9129 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:22.896715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff595da6-19c8-407b-a7e4-d1c2d64f9129 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:23.025203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff595da6-19c8-407b-a7e4-d1c2d64f9129 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:23.032891 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff595da6-19c8-407b-a7e4-d1c2d64f9129 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1202 microversion: 2.1 time: 0.150525 Oct 11 05:03:23.033459 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3416/7067] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:22 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1202 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:24.056908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-92fe2c2c-8539-4e06-b0a1-7c2b202efa3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:24.057606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-92fe2c2c-8539-4e06-b0a1-7c2b202efa3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:24.063890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92fe2c2c-8539-4e06-b0a1-7c2b202efa3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:24.064365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92fe2c2c-8539-4e06-b0a1-7c2b202efa3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:24.064793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92fe2c2c-8539-4e06-b0a1-7c2b202efa3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:24.066074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92fe2c2c-8539-4e06-b0a1-7c2b202efa3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:24.066553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92fe2c2c-8539-4e06-b0a1-7c2b202efa3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:24.066976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-92fe2c2c-8539-4e06-b0a1-7c2b202efa3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:24.200450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-92fe2c2c-8539-4e06-b0a1-7c2b202efa3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:24.208918 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-92fe2c2c-8539-4e06-b0a1-7c2b202efa3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1388 microversion: 2.1 time: 0.157190 Oct 11 05:03:24.209495 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3652/7068] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:24 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1388 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:24.230701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-518f2396-0d6f-4e10-8dea-a18d2668b6c9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:24.231319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-518f2396-0d6f-4e10-8dea-a18d2668b6c9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:24.238010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-518f2396-0d6f-4e10-8dea-a18d2668b6c9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:24.238521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-518f2396-0d6f-4e10-8dea-a18d2668b6c9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:24.238959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-518f2396-0d6f-4e10-8dea-a18d2668b6c9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:24.239636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-518f2396-0d6f-4e10-8dea-a18d2668b6c9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:24.240086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-518f2396-0d6f-4e10-8dea-a18d2668b6c9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:24.240509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-518f2396-0d6f-4e10-8dea-a18d2668b6c9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:24.370313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-518f2396-0d6f-4e10-8dea-a18d2668b6c9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:24.378533 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-518f2396-0d6f-4e10-8dea-a18d2668b6c9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1388 microversion: 2.1 time: 0.151103 Oct 11 05:03:24.379108 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3417/7069] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:24 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1388 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:24.401089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-508baff0-4ba7-4093-968c-b1b6799eb6c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:24.401714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-508baff0-4ba7-4093-968c-b1b6799eb6c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:24.407773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508baff0-4ba7-4093-968c-b1b6799eb6c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:24.408262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508baff0-4ba7-4093-968c-b1b6799eb6c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:24.408710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508baff0-4ba7-4093-968c-b1b6799eb6c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:24.409407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508baff0-4ba7-4093-968c-b1b6799eb6c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:24.409864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508baff0-4ba7-4093-968c-b1b6799eb6c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:24.410327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-508baff0-4ba7-4093-968c-b1b6799eb6c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:24.537323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-508baff0-4ba7-4093-968c-b1b6799eb6c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:24.545222 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-508baff0-4ba7-4093-968c-b1b6799eb6c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1388 microversion: 2.1 time: 0.148180 Oct 11 05:03:24.545831 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3653/7070] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:24 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1388 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:24.624378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-730cb195-bacf-4dcc-bd89-556a9b407bd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:24.624882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-730cb195-bacf-4dcc-bd89-556a9b407bd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:24.631414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-730cb195-bacf-4dcc-bd89-556a9b407bd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:24.631897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-730cb195-bacf-4dcc-bd89-556a9b407bd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:24.632332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-730cb195-bacf-4dcc-bd89-556a9b407bd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:24.633021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-730cb195-bacf-4dcc-bd89-556a9b407bd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:24.633730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-730cb195-bacf-4dcc-bd89-556a9b407bd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:24.634160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-730cb195-bacf-4dcc-bd89-556a9b407bd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:24.661388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-730cb195-bacf-4dcc-bd89-556a9b407bd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:03:24.944552 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-730cb195-bacf-4dcc-bd89-556a9b407bd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 204 len: 0 microversion: 2.1 time: 0.323621 Oct 11 05:03:24.945063 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3418/7071] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:03:24 2022] DELETE /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:03:24.955082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0353b1ec-142d-40aa-abe6-508d71aaf097 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:24.955667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0353b1ec-142d-40aa-abe6-508d71aaf097 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:24.961578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0353b1ec-142d-40aa-abe6-508d71aaf097 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:24.962051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0353b1ec-142d-40aa-abe6-508d71aaf097 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:24.962528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0353b1ec-142d-40aa-abe6-508d71aaf097 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:24.963206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0353b1ec-142d-40aa-abe6-508d71aaf097 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:24.963655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0353b1ec-142d-40aa-abe6-508d71aaf097 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:24.964078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0353b1ec-142d-40aa-abe6-508d71aaf097 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:25.100704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0353b1ec-142d-40aa-abe6-508d71aaf097 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:25.108484 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0353b1ec-142d-40aa-abe6-508d71aaf097 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1394 microversion: 2.1 time: 0.157283 Oct 11 05:03:25.109050 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3654/7072] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:24 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1394 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:26.133078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4beb100-dfdf-4b23-8299-e51818170149 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:26.134048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f4beb100-dfdf-4b23-8299-e51818170149 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:26.140856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb100-dfdf-4b23-8299-e51818170149 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:26.141343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb100-dfdf-4b23-8299-e51818170149 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:26.141787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb100-dfdf-4b23-8299-e51818170149 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:26.142510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb100-dfdf-4b23-8299-e51818170149 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:26.142968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb100-dfdf-4b23-8299-e51818170149 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:26.143397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4beb100-dfdf-4b23-8299-e51818170149 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:26.271790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4beb100-dfdf-4b23-8299-e51818170149 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:26.279614 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f4beb100-dfdf-4b23-8299-e51818170149 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1394 microversion: 2.1 time: 0.151597 Oct 11 05:03:26.280185 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3419/7073] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:26 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1394 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:27.084492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-0f926853-4cfb-42c2-bfe5-6b0799a2899f req-a77cb307-0462-4760-9e87-3acbb58ed34b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2", "name": "network-vif-deleted", "tag": "c351da75-430d-4ae0-b48e-a220c11ed968"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:03:27.095423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0f926853-4cfb-42c2-bfe5-6b0799a2899f req-a77cb307-0462-4760-9e87-3acbb58ed34b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:27.095897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0f926853-4cfb-42c2-bfe5-6b0799a2899f req-a77cb307-0462-4760-9e87-3acbb58ed34b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:27.096323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0f926853-4cfb-42c2-bfe5-6b0799a2899f req-a77cb307-0462-4760-9e87-3acbb58ed34b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:27.108915 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-0f926853-4cfb-42c2-bfe5-6b0799a2899f req-a77cb307-0462-4760-9e87-3acbb58ed34b service nova] Creating event network-vif-deleted:c351da75-430d-4ae0-b48e-a220c11ed968 for instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 on n-h1-860892-1 Oct 11 05:03:27.114312 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-0f926853-4cfb-42c2-bfe5-6b0799a2899f req-a77cb307-0462-4760-9e87-3acbb58ed34b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034080 Oct 11 05:03:27.116270 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3655/7074] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:03:27.302513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bec5bdb5-3a92-4e0e-9bc3-2cc463e9aa2d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:27.303274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bec5bdb5-3a92-4e0e-9bc3-2cc463e9aa2d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:27.310790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bec5bdb5-3a92-4e0e-9bc3-2cc463e9aa2d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:27.311369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bec5bdb5-3a92-4e0e-9bc3-2cc463e9aa2d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:27.311810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bec5bdb5-3a92-4e0e-9bc3-2cc463e9aa2d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:27.312630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bec5bdb5-3a92-4e0e-9bc3-2cc463e9aa2d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:27.313086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bec5bdb5-3a92-4e0e-9bc3-2cc463e9aa2d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:27.313507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bec5bdb5-3a92-4e0e-9bc3-2cc463e9aa2d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:27.376280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bec5bdb5-3a92-4e0e-9bc3-2cc463e9aa2d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:27.385193 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bec5bdb5-3a92-4e0e-9bc3-2cc463e9aa2d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1187 microversion: 2.1 time: 0.086700 Oct 11 05:03:27.385910 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3420/7075] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:27 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1187 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:28.410693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-96812f45-a2ba-455e-ab9c-d61152181271 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:28.411429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-96812f45-a2ba-455e-ab9c-d61152181271 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:28.417579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96812f45-a2ba-455e-ab9c-d61152181271 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:28.418054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96812f45-a2ba-455e-ab9c-d61152181271 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:28.418520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96812f45-a2ba-455e-ab9c-d61152181271 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:28.419201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96812f45-a2ba-455e-ab9c-d61152181271 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:28.419681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96812f45-a2ba-455e-ab9c-d61152181271 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:28.420107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96812f45-a2ba-455e-ab9c-d61152181271 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:28.484027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-96812f45-a2ba-455e-ab9c-d61152181271 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:28.492635 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-96812f45-a2ba-455e-ab9c-d61152181271 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1187 microversion: 2.1 time: 0.087201 Oct 11 05:03:28.493214 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3656/7076] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:28 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:29.516493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b640fef-2144-4489-af46-d3c4ab681233 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:29.517211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b640fef-2144-4489-af46-d3c4ab681233 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:29.524816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b640fef-2144-4489-af46-d3c4ab681233 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:29.525309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b640fef-2144-4489-af46-d3c4ab681233 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:29.525747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b640fef-2144-4489-af46-d3c4ab681233 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:29.526485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b640fef-2144-4489-af46-d3c4ab681233 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:29.526938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b640fef-2144-4489-af46-d3c4ab681233 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:29.527360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b640fef-2144-4489-af46-d3c4ab681233 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:29.596100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b640fef-2144-4489-af46-d3c4ab681233 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:29.604846 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b640fef-2144-4489-af46-d3c4ab681233 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1187 microversion: 2.1 time: 0.092421 Oct 11 05:03:29.605445 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3421/7077] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:29 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1187 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:30.629097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-686800e1-039b-482a-87c2-463cceae23ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:30.629639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-686800e1-039b-482a-87c2-463cceae23ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:30.636982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-686800e1-039b-482a-87c2-463cceae23ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:30.637383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-686800e1-039b-482a-87c2-463cceae23ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:30.637813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-686800e1-039b-482a-87c2-463cceae23ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:30.638559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-686800e1-039b-482a-87c2-463cceae23ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:30.639013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-686800e1-039b-482a-87c2-463cceae23ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:30.639438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-686800e1-039b-482a-87c2-463cceae23ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:30.700989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-686800e1-039b-482a-87c2-463cceae23ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:30.709147 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-686800e1-039b-482a-87c2-463cceae23ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1187 microversion: 2.1 time: 0.084695 Oct 11 05:03:30.709922 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3657/7078] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:30 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1187 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:31.731862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:31.732477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:31.739603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:31.740092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:31.740534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:31.741228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:31.741680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:31.742110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:31.775947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:31.776423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:31.776852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:31.777297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lazy-loading 'fault' on Instance uuid 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:03:31.818697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:03:31.826844 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-21f9cb78-8e7a-4eac-9b84-8110e53e26e2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 200 len: 1192 microversion: 2.1 time: 0.098899 Oct 11 05:03:31.827415 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3422/7079] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:31 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 1192 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:03:32.851600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:32.852281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:32.859873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:32.860396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:32.860837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:32.861542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:32.861995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:32.862479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:32.877220 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 HTTP/1.1 Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2'} Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:03:32.879108 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:03:32.882943 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:03:32.882943 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:03:32.882943 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:03:32.882943 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:03:32.882943 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:03:32.882943 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:32.882943 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:03:32.882943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:03:32.882943 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e2d0f270-1b0c-484b-b133-e427f3bb1a96 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 404 len: 111 microversion: 2.1 time: 0.034100 Oct 11 05:03:32.882943 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3658/7080] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:32 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:03:35.033422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:35.033931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:35.041067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:35.041567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:35.042011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:35.042762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:35.043224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:35.043661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:35.059056 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 HTTP/1.1 Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2'} Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:03:35.060808 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-623082fb-35a6-4489-aef5-899991cabf73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 404 len: 111 microversion: 2.1 time: 0.032749 Oct 11 05:03:35.065308 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3423/7081] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:03:35 2022] DELETE /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:03:35.071842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:03:35.072456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:03:35.080227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:35.080717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:35.081158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:35.081887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:03:35.082363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:03:35.082788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:03:35.097438 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 HTTP/1.1 Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2'} Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:03:35.099071 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:03:35.103642 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:03:35.103642 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:03:35.103642 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:03:35.103642 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:03:35.103642 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:03:35.103642 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. Oct 11 05:03:35.103642 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:03:35.103642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance 1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:03:35.103642 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-15b2fe87-78ee-4a3c-bf27-36ad01c7cbe3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2" status: 404 len: 111 microversion: 2.1 time: 0.032658 Oct 11 05:03:35.103642 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3659/7082] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:03:35 2022] GET /compute/v2.1/servers/1704f8bc-f9e0-49aa-a9bc-bbb7f909ffe2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:04:07.977654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-795216147", "imageRef": "", "flavorRef": "452", "block_device_mapping_v2": [{"uuid": "d905e4fb-b827-4a70-a187-12f0bd57e43b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:04:07.988016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:07.988853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:08.040304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] validate_networks() for [('dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:04:08.513319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:04:08.513739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:04:08.514234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:04:08.514644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:04:08.515055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:04:08.525293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:08.525785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:08.526283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:08.527015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:08.527460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:08.527882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:08.545238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:04:08.550531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for user 5a1c61d68e1a479bb0dc096271f4cbde and project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:04:08.607893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:04:08.609992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d905e4fb-b827-4a70-a187-12f0bd57e43b',volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:04:08.963196 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98579faf-f285-47df-add2-84b710d21206 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.989614 Oct 11 05:04:08.963841 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3424/7083] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:04:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:04:08.975203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b9f24c1f-dede-4972-8353-388cdee62046 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:08.975819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b9f24c1f-dede-4972-8353-388cdee62046 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:08.977930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=29 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:08.978630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=73 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:09.032032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b9f24c1f-dede-4972-8353-388cdee62046 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:09.039649 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b9f24c1f-dede-4972-8353-388cdee62046 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1070 microversion: 2.1 time: 0.068655 Oct 11 05:04:09.043508 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3660/7084] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:08 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1070 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:10.062778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e10b9902-b70d-49df-80af-aa6a2303955a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:10.063406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e10b9902-b70d-49df-80af-aa6a2303955a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:10.069592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e10b9902-b70d-49df-80af-aa6a2303955a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:10.070078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e10b9902-b70d-49df-80af-aa6a2303955a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:10.070554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e10b9902-b70d-49df-80af-aa6a2303955a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:10.071252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e10b9902-b70d-49df-80af-aa6a2303955a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:10.071708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e10b9902-b70d-49df-80af-aa6a2303955a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:10.072147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e10b9902-b70d-49df-80af-aa6a2303955a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:10.134570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e10b9902-b70d-49df-80af-aa6a2303955a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:10.142363 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e10b9902-b70d-49df-80af-aa6a2303955a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1120 microversion: 2.1 time: 0.084594 Oct 11 05:04:10.142937 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3425/7085] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:10 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1120 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:11.166583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c63d793f-d170-4d94-bd9d-f39b6523507e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:11.167237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c63d793f-d170-4d94-bd9d-f39b6523507e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:11.176313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c63d793f-d170-4d94-bd9d-f39b6523507e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:11.176954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c63d793f-d170-4d94-bd9d-f39b6523507e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:11.177399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c63d793f-d170-4d94-bd9d-f39b6523507e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:11.178107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c63d793f-d170-4d94-bd9d-f39b6523507e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:11.178598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c63d793f-d170-4d94-bd9d-f39b6523507e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:11.179034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c63d793f-d170-4d94-bd9d-f39b6523507e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:11.244910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c63d793f-d170-4d94-bd9d-f39b6523507e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:11.253212 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c63d793f-d170-4d94-bd9d-f39b6523507e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1176 microversion: 2.1 time: 0.091685 Oct 11 05:04:11.266360 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3661/7086] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:11 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1176 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:12.278074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4788b13e-7277-4f81-9df0-e4f69184d960 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:12.279125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4788b13e-7277-4f81-9df0-e4f69184d960 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:12.286700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4788b13e-7277-4f81-9df0-e4f69184d960 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:12.287186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4788b13e-7277-4f81-9df0-e4f69184d960 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:12.288292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4788b13e-7277-4f81-9df0-e4f69184d960 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:12.288624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4788b13e-7277-4f81-9df0-e4f69184d960 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:12.289226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4788b13e-7277-4f81-9df0-e4f69184d960 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:12.289696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4788b13e-7277-4f81-9df0-e4f69184d960 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:12.689463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-04a100ed-109d-48e6-ad53-26bfaab522b1 req-54c5632b-d41b-4aa3-a8de-2c9f9129229d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5d08f45-2b8e-4256-82c8-f369ebea0e1e", "tag": "1483eaca-dc18-4183-afa8-0d728f23648e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:04:12.710104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-04a100ed-109d-48e6-ad53-26bfaab522b1 req-54c5632b-d41b-4aa3-a8de-2c9f9129229d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:12.710958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-04a100ed-109d-48e6-ad53-26bfaab522b1 req-54c5632b-d41b-4aa3-a8de-2c9f9129229d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:12.713449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-04a100ed-109d-48e6-ad53-26bfaab522b1 req-54c5632b-d41b-4aa3-a8de-2c9f9129229d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:12.732715 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-04a100ed-109d-48e6-ad53-26bfaab522b1 req-54c5632b-d41b-4aa3-a8de-2c9f9129229d service nova] Creating event network-changed:1483eaca-dc18-4183-afa8-0d728f23648e for instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e on n-h1-860892-1 Oct 11 05:04:12.740503 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-04a100ed-109d-48e6-ad53-26bfaab522b1 req-54c5632b-d41b-4aa3-a8de-2c9f9129229d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068725 Oct 11 05:04:12.742682 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3662/7087] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:04:12.769555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4788b13e-7277-4f81-9df0-e4f69184d960 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:12.779020 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4788b13e-7277-4f81-9df0-e4f69184d960 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1228 microversion: 2.1 time: 0.506274 Oct 11 05:04:12.799110 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3426/7088] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:12 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1228 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:13.807632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-025521b8-e3e5-4bfd-a8d5-0c4182d49de2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:13.808337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-025521b8-e3e5-4bfd-a8d5-0c4182d49de2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:13.815416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-025521b8-e3e5-4bfd-a8d5-0c4182d49de2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:13.815849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-025521b8-e3e5-4bfd-a8d5-0c4182d49de2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:13.816282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-025521b8-e3e5-4bfd-a8d5-0c4182d49de2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:13.816965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-025521b8-e3e5-4bfd-a8d5-0c4182d49de2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:13.817413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-025521b8-e3e5-4bfd-a8d5-0c4182d49de2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:13.817837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-025521b8-e3e5-4bfd-a8d5-0c4182d49de2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:13.954081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-025521b8-e3e5-4bfd-a8d5-0c4182d49de2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:13.962832 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-025521b8-e3e5-4bfd-a8d5-0c4182d49de2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1228 microversion: 2.1 time: 0.159427 Oct 11 05:04:13.963427 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3663/7089] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:13 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1228 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:14.986199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cfebecfb-a1a7-4360-8882-6ea99b325af6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:14.986960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cfebecfb-a1a7-4360-8882-6ea99b325af6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:14.994305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfebecfb-a1a7-4360-8882-6ea99b325af6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:14.994848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfebecfb-a1a7-4360-8882-6ea99b325af6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:14.995351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfebecfb-a1a7-4360-8882-6ea99b325af6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:14.996104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfebecfb-a1a7-4360-8882-6ea99b325af6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:14.996632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfebecfb-a1a7-4360-8882-6ea99b325af6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:14.997117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cfebecfb-a1a7-4360-8882-6ea99b325af6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:15.127268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cfebecfb-a1a7-4360-8882-6ea99b325af6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:15.135764 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cfebecfb-a1a7-4360-8882-6ea99b325af6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1228 microversion: 2.1 time: 0.153545 Oct 11 05:04:15.136356 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3427/7090] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:14 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1228 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:16.158531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ebe131cd-5413-482d-ac24-d1bc23f5070e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:16.159175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ebe131cd-5413-482d-ac24-d1bc23f5070e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:16.165744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe131cd-5413-482d-ac24-d1bc23f5070e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:16.166254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe131cd-5413-482d-ac24-d1bc23f5070e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:16.166694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe131cd-5413-482d-ac24-d1bc23f5070e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:16.167384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe131cd-5413-482d-ac24-d1bc23f5070e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:16.168207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe131cd-5413-482d-ac24-d1bc23f5070e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:16.168631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe131cd-5413-482d-ac24-d1bc23f5070e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:16.300391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ebe131cd-5413-482d-ac24-d1bc23f5070e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:16.308287 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ebe131cd-5413-482d-ac24-d1bc23f5070e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1228 microversion: 2.1 time: 0.153911 Oct 11 05:04:16.308850 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3664/7091] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:16 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1228 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:17.330810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f2c7bf69-0aff-481d-a7d1-90820da857b2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:17.331435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f2c7bf69-0aff-481d-a7d1-90820da857b2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:17.338302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2c7bf69-0aff-481d-a7d1-90820da857b2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:17.338789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2c7bf69-0aff-481d-a7d1-90820da857b2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:17.339231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2c7bf69-0aff-481d-a7d1-90820da857b2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:17.339920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2c7bf69-0aff-481d-a7d1-90820da857b2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:17.340374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2c7bf69-0aff-481d-a7d1-90820da857b2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:17.340799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2c7bf69-0aff-481d-a7d1-90820da857b2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:17.471410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f2c7bf69-0aff-481d-a7d1-90820da857b2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:17.479643 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f2c7bf69-0aff-481d-a7d1-90820da857b2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1216 microversion: 2.1 time: 0.153074 Oct 11 05:04:17.480213 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3428/7092] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:17 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:18.502960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8de13089-8426-469f-a28f-ee89e665c51a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:18.503601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8de13089-8426-469f-a28f-ee89e665c51a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:18.512139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8de13089-8426-469f-a28f-ee89e665c51a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:18.512623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8de13089-8426-469f-a28f-ee89e665c51a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:18.513062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8de13089-8426-469f-a28f-ee89e665c51a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:18.513764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8de13089-8426-469f-a28f-ee89e665c51a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:18.514240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8de13089-8426-469f-a28f-ee89e665c51a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:18.514672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8de13089-8426-469f-a28f-ee89e665c51a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:18.645369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8de13089-8426-469f-a28f-ee89e665c51a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:18.653256 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8de13089-8426-469f-a28f-ee89e665c51a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1216 microversion: 2.1 time: 0.154216 Oct 11 05:04:18.653833 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3665/7093] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:18 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:19.676601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-601dfe7e-81d1-4dbc-8803-be4256203d39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:19.677248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-601dfe7e-81d1-4dbc-8803-be4256203d39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:19.680778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:19.690035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:19.690035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-601dfe7e-81d1-4dbc-8803-be4256203d39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:19.690035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-601dfe7e-81d1-4dbc-8803-be4256203d39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:19.690035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-601dfe7e-81d1-4dbc-8803-be4256203d39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:19.690035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-601dfe7e-81d1-4dbc-8803-be4256203d39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:19.690035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-601dfe7e-81d1-4dbc-8803-be4256203d39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:19.690035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-601dfe7e-81d1-4dbc-8803-be4256203d39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:19.817105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-601dfe7e-81d1-4dbc-8803-be4256203d39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:19.825532 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-601dfe7e-81d1-4dbc-8803-be4256203d39 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1216 microversion: 2.1 time: 0.152864 Oct 11 05:04:19.826094 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3429/7094] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:19 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1216 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:20.848555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4de8a867-3e20-4a6e-a089-d729335460cb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:20.849207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4de8a867-3e20-4a6e-a089-d729335460cb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:20.851227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:20.857417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de8a867-3e20-4a6e-a089-d729335460cb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:20.861933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de8a867-3e20-4a6e-a089-d729335460cb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:20.861933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de8a867-3e20-4a6e-a089-d729335460cb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:20.861933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de8a867-3e20-4a6e-a089-d729335460cb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:20.861933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de8a867-3e20-4a6e-a089-d729335460cb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:20.861933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4de8a867-3e20-4a6e-a089-d729335460cb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:20.990226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4de8a867-3e20-4a6e-a089-d729335460cb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:20.998638 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4de8a867-3e20-4a6e-a089-d729335460cb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1216 microversion: 2.1 time: 0.153975 Oct 11 05:04:20.999220 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3666/7095] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:20 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1216 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:22.020932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9a9644c9-dbba-4159-bb12-4447a0739a9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:22.021546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9a9644c9-dbba-4159-bb12-4447a0739a9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:22.028430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a9644c9-dbba-4159-bb12-4447a0739a9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:22.028937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a9644c9-dbba-4159-bb12-4447a0739a9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:22.029370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a9644c9-dbba-4159-bb12-4447a0739a9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:22.030049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a9644c9-dbba-4159-bb12-4447a0739a9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:22.030606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a9644c9-dbba-4159-bb12-4447a0739a9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:22.031066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9a9644c9-dbba-4159-bb12-4447a0739a9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:22.160284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9a9644c9-dbba-4159-bb12-4447a0739a9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:22.167962 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9a9644c9-dbba-4159-bb12-4447a0739a9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1216 microversion: 2.1 time: 0.150969 Oct 11 05:04:22.168547 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3430/7096] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:22 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:23.190010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-645f7bd7-c528-483c-a6a7-ee54ec011880 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:23.190663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-645f7bd7-c528-483c-a6a7-ee54ec011880 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:23.198137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-645f7bd7-c528-483c-a6a7-ee54ec011880 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:23.198653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-645f7bd7-c528-483c-a6a7-ee54ec011880 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:23.199095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-645f7bd7-c528-483c-a6a7-ee54ec011880 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:23.199793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-645f7bd7-c528-483c-a6a7-ee54ec011880 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:23.200274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-645f7bd7-c528-483c-a6a7-ee54ec011880 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:23.200706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-645f7bd7-c528-483c-a6a7-ee54ec011880 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:23.327513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-645f7bd7-c528-483c-a6a7-ee54ec011880 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:23.335420 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-645f7bd7-c528-483c-a6a7-ee54ec011880 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1216 microversion: 2.1 time: 0.149418 Oct 11 05:04:23.336007 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3667/7097] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:23 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1216 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:24.359111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cf1ee4a5-8609-4ae1-b302-412bba50381e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:24.359758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf1ee4a5-8609-4ae1-b302-412bba50381e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:24.366853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1ee4a5-8609-4ae1-b302-412bba50381e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:24.368004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1ee4a5-8609-4ae1-b302-412bba50381e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:24.368004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1ee4a5-8609-4ae1-b302-412bba50381e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:24.368580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1ee4a5-8609-4ae1-b302-412bba50381e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:24.369040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1ee4a5-8609-4ae1-b302-412bba50381e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:24.369469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf1ee4a5-8609-4ae1-b302-412bba50381e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:24.501444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cf1ee4a5-8609-4ae1-b302-412bba50381e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:24.509565 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cf1ee4a5-8609-4ae1-b302-412bba50381e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1216 microversion: 2.1 time: 0.154492 Oct 11 05:04:24.510162 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3431/7098] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:24 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1216 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:04:25.531816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-24f490dc-4c8a-444f-a7eb-e36b4bcec4e4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:25.532444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-24f490dc-4c8a-444f-a7eb-e36b4bcec4e4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:25.539203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24f490dc-4c8a-444f-a7eb-e36b4bcec4e4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:25.539686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24f490dc-4c8a-444f-a7eb-e36b4bcec4e4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:25.540129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24f490dc-4c8a-444f-a7eb-e36b4bcec4e4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:25.540817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24f490dc-4c8a-444f-a7eb-e36b4bcec4e4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:25.541275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24f490dc-4c8a-444f-a7eb-e36b4bcec4e4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:25.541705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-24f490dc-4c8a-444f-a7eb-e36b4bcec4e4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:25.672328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-24f490dc-4c8a-444f-a7eb-e36b4bcec4e4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:25.680092 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-24f490dc-4c8a-444f-a7eb-e36b4bcec4e4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1216 microversion: 2.1 time: 0.152234 Oct 11 05:04:25.680665 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3668/7099] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:25 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1216 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:26.295849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c1483ea2-99d8-403d-97f6-1fdc7b9acddb req-8adf9435-7dfb-42ea-8b19-dd4822b1aefe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d08f45-2b8e-4256-82c8-f369ebea0e1e", "name": "network-vif-plugged", "status": "completed", "tag": "1483eaca-dc18-4183-afa8-0d728f23648e"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:04:26.307036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c1483ea2-99d8-403d-97f6-1fdc7b9acddb req-8adf9435-7dfb-42ea-8b19-dd4822b1aefe service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:26.307588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c1483ea2-99d8-403d-97f6-1fdc7b9acddb req-8adf9435-7dfb-42ea-8b19-dd4822b1aefe service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:26.311821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c1483ea2-99d8-403d-97f6-1fdc7b9acddb req-8adf9435-7dfb-42ea-8b19-dd4822b1aefe service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:26.319193 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c1483ea2-99d8-403d-97f6-1fdc7b9acddb req-8adf9435-7dfb-42ea-8b19-dd4822b1aefe service nova] Creating event network-vif-plugged:1483eaca-dc18-4183-afa8-0d728f23648e for instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e on n-h1-860892-1 Oct 11 05:04:26.324319 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c1483ea2-99d8-403d-97f6-1fdc7b9acddb req-8adf9435-7dfb-42ea-8b19-dd4822b1aefe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032844 Oct 11 05:04:26.324904 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3432/7100] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:04:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:04:26.702822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea6226d7-3326-4eb6-987c-4192e5d515ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:26.703363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea6226d7-3326-4eb6-987c-4192e5d515ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:26.710359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea6226d7-3326-4eb6-987c-4192e5d515ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:26.710847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea6226d7-3326-4eb6-987c-4192e5d515ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:26.711279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea6226d7-3326-4eb6-987c-4192e5d515ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:26.712021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea6226d7-3326-4eb6-987c-4192e5d515ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:26.712477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea6226d7-3326-4eb6-987c-4192e5d515ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:26.712903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea6226d7-3326-4eb6-987c-4192e5d515ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:26.842062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ea6226d7-3326-4eb6-987c-4192e5d515ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:26.849897 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea6226d7-3326-4eb6-987c-4192e5d515ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1216 microversion: 2.1 time: 0.151140 Oct 11 05:04:26.850490 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3669/7101] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:26 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1216 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:27.874278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ea7f47e6-fb2f-4778-82bf-a9b5f9a55798 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:27.875105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ea7f47e6-fb2f-4778-82bf-a9b5f9a55798 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:27.881636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea7f47e6-fb2f-4778-82bf-a9b5f9a55798 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:27.882127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea7f47e6-fb2f-4778-82bf-a9b5f9a55798 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:27.882593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea7f47e6-fb2f-4778-82bf-a9b5f9a55798 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:27.884113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea7f47e6-fb2f-4778-82bf-a9b5f9a55798 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:27.884567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea7f47e6-fb2f-4778-82bf-a9b5f9a55798 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:27.884996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ea7f47e6-fb2f-4778-82bf-a9b5f9a55798 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:28.018542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ea7f47e6-fb2f-4778-82bf-a9b5f9a55798 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:28.026362 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ea7f47e6-fb2f-4778-82bf-a9b5f9a55798 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1216 microversion: 2.1 time: 0.157329 Oct 11 05:04:28.026936 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3433/7102] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:27 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1216 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:29.048691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6758817d-a5ac-42b9-9a45-a88e08025ad1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:29.049305 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6758817d-a5ac-42b9-9a45-a88e08025ad1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:29.056192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6758817d-a5ac-42b9-9a45-a88e08025ad1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:29.056678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6758817d-a5ac-42b9-9a45-a88e08025ad1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:29.057115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6758817d-a5ac-42b9-9a45-a88e08025ad1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:29.057802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6758817d-a5ac-42b9-9a45-a88e08025ad1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:29.058285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6758817d-a5ac-42b9-9a45-a88e08025ad1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:29.058715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6758817d-a5ac-42b9-9a45-a88e08025ad1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:29.187357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6758817d-a5ac-42b9-9a45-a88e08025ad1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:29.195121 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6758817d-a5ac-42b9-9a45-a88e08025ad1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1402 microversion: 2.1 time: 0.150379 Oct 11 05:04:29.196192 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3670/7103] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:29 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1402 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:29.217741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69caac4f-b789-4110-9c29-3814b023305c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:29.218393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69caac4f-b789-4110-9c29-3814b023305c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:29.224818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69caac4f-b789-4110-9c29-3814b023305c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:29.225294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69caac4f-b789-4110-9c29-3814b023305c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:29.225725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69caac4f-b789-4110-9c29-3814b023305c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:29.226486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69caac4f-b789-4110-9c29-3814b023305c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:29.226937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69caac4f-b789-4110-9c29-3814b023305c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:29.227359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69caac4f-b789-4110-9c29-3814b023305c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:29.359770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-69caac4f-b789-4110-9c29-3814b023305c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:29.367488 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69caac4f-b789-4110-9c29-3814b023305c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1402 microversion: 2.1 time: 0.153795 Oct 11 05:04:29.368054 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3434/7104] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:29 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1402 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:29.390341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-1895436068"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:04:29.392646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:29.399283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:29.399761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:29.400193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:29.400872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:29.401319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:29.401739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:29.492511 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.api [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Attempting to quiesce instance before volume snapshot. Oct 11 05:04:29.569916 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.api [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Skipping quiescing instance because the operation is not supported by the underlying compute driver. Oct 11 05:04:29.797773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Creating snapshot from volume d905e4fb-b827-4a70-a187-12f0bd57e43b. {{(pid=120994) snapshot_instance /opt/stack/nova/nova/compute/api.py:3509}} Oct 11 05:04:31.332371 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9c25c299-edab-442f-a1c8-b430aa0ef809 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "POST /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e/action" status: 202 len: 0 microversion: 2.1 time: 1.945814 Oct 11 05:04:31.333294 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3671/7105] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:04:29 2022] POST /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e/action => generated 0 bytes in 1947 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 05:04:32.493051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-411463910", "imageRef": "f4fd15c0-dc0a-46cc-a2df-f982044bc69d", "flavorRef": "452", "networks": [{"uuid": "dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:04:32.549075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] validate_networks() for [('dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:04:32.924779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:04:32.925142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:04:32.925638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:04:32.926045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:04:32.926473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:04:32.936222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:32.936702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:32.937139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:32.937898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:32.938390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:32.938819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:32.955451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:04:32.960636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for user 5a1c61d68e1a479bb0dc096271f4cbde and project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:04:32.972783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:04:32.975441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/sda',device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='4b6bd159-7974-4d8b-8898-646cecb2b648',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:04:33.117560 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-969c13f5-0c67-4fc3-9f41-54539a1f521a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.628178 Oct 11 05:04:33.118240 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3435/7106] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:04:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:04:33.131059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-195baf18-163f-48d1-bf25-74bc12fb89f9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:33.131788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-195baf18-163f-48d1-bf25-74bc12fb89f9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:33.186912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-195baf18-163f-48d1-bf25-74bc12fb89f9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:33.194395 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-195baf18-163f-48d1-bf25-74bc12fb89f9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1229 microversion: 2.1 time: 0.068622 Oct 11 05:04:33.194962 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3672/7107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:33 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1229 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:34.218242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eaab486e-d5f6-4d2d-af7a-e242084f59ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:34.218847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eaab486e-d5f6-4d2d-af7a-e242084f59ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:34.224956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaab486e-d5f6-4d2d-af7a-e242084f59ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:34.225429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaab486e-d5f6-4d2d-af7a-e242084f59ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:34.225858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaab486e-d5f6-4d2d-af7a-e242084f59ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:34.226571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaab486e-d5f6-4d2d-af7a-e242084f59ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:34.227022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaab486e-d5f6-4d2d-af7a-e242084f59ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:34.227445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eaab486e-d5f6-4d2d-af7a-e242084f59ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:34.291212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eaab486e-d5f6-4d2d-af7a-e242084f59ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:34.298851 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eaab486e-d5f6-4d2d-af7a-e242084f59ab tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1233 microversion: 2.1 time: 0.085552 Oct 11 05:04:34.299421 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3436/7108] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:34 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1233 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:35.322158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-55860bc5-c63b-4239-9e03-edba0d4277e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:35.322934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-55860bc5-c63b-4239-9e03-edba0d4277e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:35.330459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55860bc5-c63b-4239-9e03-edba0d4277e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:35.333673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55860bc5-c63b-4239-9e03-edba0d4277e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:35.333673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55860bc5-c63b-4239-9e03-edba0d4277e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:35.333673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55860bc5-c63b-4239-9e03-edba0d4277e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:35.333673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55860bc5-c63b-4239-9e03-edba0d4277e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:35.333673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-55860bc5-c63b-4239-9e03-edba0d4277e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:35.400214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-55860bc5-c63b-4239-9e03-edba0d4277e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:35.408637 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-55860bc5-c63b-4239-9e03-edba0d4277e3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1289 microversion: 2.1 time: 0.091048 Oct 11 05:04:35.409409 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3673/7109] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:35 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1289 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:36.432113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0b3c3543-1fb4-42a0-8788-ad558218177e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:36.432734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0b3c3543-1fb4-42a0-8788-ad558218177e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:36.439664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b3c3543-1fb4-42a0-8788-ad558218177e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:36.440328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b3c3543-1fb4-42a0-8788-ad558218177e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:36.440770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b3c3543-1fb4-42a0-8788-ad558218177e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:36.441656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b3c3543-1fb4-42a0-8788-ad558218177e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:36.442305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b3c3543-1fb4-42a0-8788-ad558218177e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:36.442739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0b3c3543-1fb4-42a0-8788-ad558218177e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:36.631657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0b3c3543-1fb4-42a0-8788-ad558218177e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:36.640014 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0b3c3543-1fb4-42a0-8788-ad558218177e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.212323 Oct 11 05:04:36.640797 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3437/7110] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:36 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:37.356507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-857562d3-091d-4597-8b7c-e01e90044280 req-cfb42cd8-5558-4635-b46c-7a166b7c68fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0fbac44d-3bac-491e-b197-1492394e68b2", "tag": "f293bfcc-d8a1-4e44-8d04-7ffbba99c150"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:04:37.368654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-857562d3-091d-4597-8b7c-e01e90044280 req-cfb42cd8-5558-4635-b46c-7a166b7c68fd service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:37.369359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-857562d3-091d-4597-8b7c-e01e90044280 req-cfb42cd8-5558-4635-b46c-7a166b7c68fd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:37.369884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-857562d3-091d-4597-8b7c-e01e90044280 req-cfb42cd8-5558-4635-b46c-7a166b7c68fd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:37.381634 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-857562d3-091d-4597-8b7c-e01e90044280 req-cfb42cd8-5558-4635-b46c-7a166b7c68fd service nova] Creating event network-changed:f293bfcc-d8a1-4e44-8d04-7ffbba99c150 for instance 0fbac44d-3bac-491e-b197-1492394e68b2 on n-h2-860892-1 Oct 11 05:04:37.388886 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-857562d3-091d-4597-8b7c-e01e90044280 req-cfb42cd8-5558-4635-b46c-7a166b7c68fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201662 Oct 11 05:04:37.393381 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3674/7111] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:04:37.665831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9790e7c-4620-4d32-b7fd-18331b7cc6f5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:37.666507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9790e7c-4620-4d32-b7fd-18331b7cc6f5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:37.673041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9790e7c-4620-4d32-b7fd-18331b7cc6f5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:37.673526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9790e7c-4620-4d32-b7fd-18331b7cc6f5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:37.673969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9790e7c-4620-4d32-b7fd-18331b7cc6f5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:37.674836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9790e7c-4620-4d32-b7fd-18331b7cc6f5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:37.675298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9790e7c-4620-4d32-b7fd-18331b7cc6f5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:37.675730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9790e7c-4620-4d32-b7fd-18331b7cc6f5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:37.846153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b9790e7c-4620-4d32-b7fd-18331b7cc6f5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:37.854528 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b9790e7c-4620-4d32-b7fd-18331b7cc6f5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.193489 Oct 11 05:04:37.855102 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3438/7112] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:37 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:38.877874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3d6a2bb-0efc-443f-a956-8c080c5cfa56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:38.878658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3d6a2bb-0efc-443f-a956-8c080c5cfa56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:38.886343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3d6a2bb-0efc-443f-a956-8c080c5cfa56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:38.886879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3d6a2bb-0efc-443f-a956-8c080c5cfa56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:38.887341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3d6a2bb-0efc-443f-a956-8c080c5cfa56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:38.888060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3d6a2bb-0efc-443f-a956-8c080c5cfa56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:38.888523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3d6a2bb-0efc-443f-a956-8c080c5cfa56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:38.888969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3d6a2bb-0efc-443f-a956-8c080c5cfa56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:39.042474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3d6a2bb-0efc-443f-a956-8c080c5cfa56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:39.052618 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3d6a2bb-0efc-443f-a956-8c080c5cfa56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.178663 Oct 11 05:04:39.053020 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3675/7113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:38 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:40.078714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9054419-1f22-4fb6-af7a-426c2c8608d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:40.079410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e9054419-1f22-4fb6-af7a-426c2c8608d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:40.081969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:40.087237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9054419-1f22-4fb6-af7a-426c2c8608d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:40.087736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9054419-1f22-4fb6-af7a-426c2c8608d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:40.088174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9054419-1f22-4fb6-af7a-426c2c8608d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:40.088849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9054419-1f22-4fb6-af7a-426c2c8608d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:40.089294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9054419-1f22-4fb6-af7a-426c2c8608d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:40.089714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9054419-1f22-4fb6-af7a-426c2c8608d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:40.092266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=79 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:40.227377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9054419-1f22-4fb6-af7a-426c2c8608d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:40.243553 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9054419-1f22-4fb6-af7a-426c2c8608d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.162525 Oct 11 05:04:40.243553 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3439/7114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:40 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:41.261046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca4af6bf-62fe-4a50-90aa-5e7317c503d4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:41.261677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ca4af6bf-62fe-4a50-90aa-5e7317c503d4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:41.264663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=37 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:41.269517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca4af6bf-62fe-4a50-90aa-5e7317c503d4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:41.270084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca4af6bf-62fe-4a50-90aa-5e7317c503d4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:41.270565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca4af6bf-62fe-4a50-90aa-5e7317c503d4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:41.271315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca4af6bf-62fe-4a50-90aa-5e7317c503d4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:41.271854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca4af6bf-62fe-4a50-90aa-5e7317c503d4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:41.272303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca4af6bf-62fe-4a50-90aa-5e7317c503d4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:41.276857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:41.409136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ca4af6bf-62fe-4a50-90aa-5e7317c503d4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:41.417427 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ca4af6bf-62fe-4a50-90aa-5e7317c503d4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.161273 Oct 11 05:04:41.418014 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3676/7115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:41 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:42.440891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98673af2-fd0d-48f7-83ca-bb5e142c8d47 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:42.441510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98673af2-fd0d-48f7-83ca-bb5e142c8d47 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:42.449182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98673af2-fd0d-48f7-83ca-bb5e142c8d47 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:42.449665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98673af2-fd0d-48f7-83ca-bb5e142c8d47 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:42.450108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98673af2-fd0d-48f7-83ca-bb5e142c8d47 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:42.450836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98673af2-fd0d-48f7-83ca-bb5e142c8d47 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:42.451297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98673af2-fd0d-48f7-83ca-bb5e142c8d47 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:42.451747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98673af2-fd0d-48f7-83ca-bb5e142c8d47 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:42.588154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-98673af2-fd0d-48f7-83ca-bb5e142c8d47 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:42.596019 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98673af2-fd0d-48f7-83ca-bb5e142c8d47 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.159437 Oct 11 05:04:42.596594 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3440/7116] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:42 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:43.619709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-633cff3f-d2d3-415d-a979-11cdee9df026 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:43.620336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-633cff3f-d2d3-415d-a979-11cdee9df026 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:43.623043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:43.627974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-633cff3f-d2d3-415d-a979-11cdee9df026 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:43.628467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-633cff3f-d2d3-415d-a979-11cdee9df026 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:43.634814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-633cff3f-d2d3-415d-a979-11cdee9df026 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:43.634814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-633cff3f-d2d3-415d-a979-11cdee9df026 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:43.634814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-633cff3f-d2d3-415d-a979-11cdee9df026 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:43.634814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-633cff3f-d2d3-415d-a979-11cdee9df026 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:43.777271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-633cff3f-d2d3-415d-a979-11cdee9df026 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:43.785254 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-633cff3f-d2d3-415d-a979-11cdee9df026 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.169465 Oct 11 05:04:43.785816 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3677/7117] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:43 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:44.807968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4fbefc94-0b5e-4143-9d8c-b428741bb52f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:44.809435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4fbefc94-0b5e-4143-9d8c-b428741bb52f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:44.811507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:44.812173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:04:44.817967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fbefc94-0b5e-4143-9d8c-b428741bb52f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:44.822339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fbefc94-0b5e-4143-9d8c-b428741bb52f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:44.822339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fbefc94-0b5e-4143-9d8c-b428741bb52f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:44.822339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fbefc94-0b5e-4143-9d8c-b428741bb52f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:44.822339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fbefc94-0b5e-4143-9d8c-b428741bb52f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:44.822339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fbefc94-0b5e-4143-9d8c-b428741bb52f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:44.959214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4fbefc94-0b5e-4143-9d8c-b428741bb52f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:44.967394 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4fbefc94-0b5e-4143-9d8c-b428741bb52f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.163344 Oct 11 05:04:44.967992 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3441/7118] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:44 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:45.990912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3fb48aee-3ce8-4ff5-ad93-ea5c1be6f69b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:46.044325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3fb48aee-3ce8-4ff5-ad93-ea5c1be6f69b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:46.044325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fb48aee-3ce8-4ff5-ad93-ea5c1be6f69b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:46.044325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fb48aee-3ce8-4ff5-ad93-ea5c1be6f69b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:46.044325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fb48aee-3ce8-4ff5-ad93-ea5c1be6f69b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:46.044325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fb48aee-3ce8-4ff5-ad93-ea5c1be6f69b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:46.044325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fb48aee-3ce8-4ff5-ad93-ea5c1be6f69b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:46.044325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fb48aee-3ce8-4ff5-ad93-ea5c1be6f69b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:46.137574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3fb48aee-3ce8-4ff5-ad93-ea5c1be6f69b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:46.145525 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3fb48aee-3ce8-4ff5-ad93-ea5c1be6f69b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.158654 Oct 11 05:04:46.146098 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3678/7119] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:45 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:47.171307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98fad34e-98f4-4485-96dd-d6d1fb794065 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:47.171863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98fad34e-98f4-4485-96dd-d6d1fb794065 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:47.182071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98fad34e-98f4-4485-96dd-d6d1fb794065 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:47.182588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98fad34e-98f4-4485-96dd-d6d1fb794065 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:47.183052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98fad34e-98f4-4485-96dd-d6d1fb794065 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:47.183749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98fad34e-98f4-4485-96dd-d6d1fb794065 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:47.184321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98fad34e-98f4-4485-96dd-d6d1fb794065 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:47.184776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98fad34e-98f4-4485-96dd-d6d1fb794065 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:47.333752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-98fad34e-98f4-4485-96dd-d6d1fb794065 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:47.343141 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98fad34e-98f4-4485-96dd-d6d1fb794065 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.175252 Oct 11 05:04:47.343141 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3442/7120] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:47 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:48.364991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b763c579-d81b-4560-abc6-012207c713a8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:48.365657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b763c579-d81b-4560-abc6-012207c713a8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:48.373977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b763c579-d81b-4560-abc6-012207c713a8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:48.375588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b763c579-d81b-4560-abc6-012207c713a8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:48.375588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b763c579-d81b-4560-abc6-012207c713a8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:48.375823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b763c579-d81b-4560-abc6-012207c713a8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:48.376077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b763c579-d81b-4560-abc6-012207c713a8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:48.376515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b763c579-d81b-4560-abc6-012207c713a8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:48.507470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b763c579-d81b-4560-abc6-012207c713a8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:48.518062 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b763c579-d81b-4560-abc6-012207c713a8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.156817 Oct 11 05:04:48.518735 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3679/7121] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:48 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:49.540873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b5e3b7e9-9d75-4665-9ded-39c0ce4e357f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:49.541547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b5e3b7e9-9d75-4665-9ded-39c0ce4e357f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:49.548555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5e3b7e9-9d75-4665-9ded-39c0ce4e357f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:49.549031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5e3b7e9-9d75-4665-9ded-39c0ce4e357f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:49.549465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5e3b7e9-9d75-4665-9ded-39c0ce4e357f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:49.550145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5e3b7e9-9d75-4665-9ded-39c0ce4e357f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:49.550618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5e3b7e9-9d75-4665-9ded-39c0ce4e357f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:49.551043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5e3b7e9-9d75-4665-9ded-39c0ce4e357f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:49.690227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b5e3b7e9-9d75-4665-9ded-39c0ce4e357f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:49.697993 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b5e3b7e9-9d75-4665-9ded-39c0ce4e357f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.161018 Oct 11 05:04:49.699278 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3443/7122] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:49 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:50.723325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-100cba0f-dd3e-49df-a40f-b9e5cac32586 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:50.724180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-100cba0f-dd3e-49df-a40f-b9e5cac32586 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:50.732098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-100cba0f-dd3e-49df-a40f-b9e5cac32586 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:50.732593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-100cba0f-dd3e-49df-a40f-b9e5cac32586 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:50.733300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-100cba0f-dd3e-49df-a40f-b9e5cac32586 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:50.734006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-100cba0f-dd3e-49df-a40f-b9e5cac32586 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:50.734496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-100cba0f-dd3e-49df-a40f-b9e5cac32586 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:50.734936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-100cba0f-dd3e-49df-a40f-b9e5cac32586 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:50.872137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-100cba0f-dd3e-49df-a40f-b9e5cac32586 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:50.880229 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-100cba0f-dd3e-49df-a40f-b9e5cac32586 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.160977 Oct 11 05:04:50.880795 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3680/7123] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:50 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:51.906998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b2a7ee95-b009-4725-829d-4b252d0bbae3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:51.907616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b2a7ee95-b009-4725-829d-4b252d0bbae3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:51.914514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee95-b009-4725-829d-4b252d0bbae3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:51.914994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee95-b009-4725-829d-4b252d0bbae3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:51.915435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee95-b009-4725-829d-4b252d0bbae3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:51.916123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee95-b009-4725-829d-4b252d0bbae3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:51.916610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee95-b009-4725-829d-4b252d0bbae3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:51.917038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2a7ee95-b009-4725-829d-4b252d0bbae3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:52.048516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b2a7ee95-b009-4725-829d-4b252d0bbae3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:52.057933 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b2a7ee95-b009-4725-829d-4b252d0bbae3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.154792 Oct 11 05:04:52.060756 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3444/7124] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:51 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:53.080558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-50263233-72ea-464e-b124-7d3ac70686a1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:53.081178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50263233-72ea-464e-b124-7d3ac70686a1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:53.088815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50263233-72ea-464e-b124-7d3ac70686a1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:53.090361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50263233-72ea-464e-b124-7d3ac70686a1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:53.090361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50263233-72ea-464e-b124-7d3ac70686a1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:53.091340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50263233-72ea-464e-b124-7d3ac70686a1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:53.091822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50263233-72ea-464e-b124-7d3ac70686a1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:53.092273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50263233-72ea-464e-b124-7d3ac70686a1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:53.225471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-50263233-72ea-464e-b124-7d3ac70686a1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:53.234004 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-50263233-72ea-464e-b124-7d3ac70686a1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.157817 Oct 11 05:04:53.234604 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3681/7125] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:53 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:54.257776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-77a06de0-17ef-4476-88c8-7716ba9a6567 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:54.258415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-77a06de0-17ef-4476-88c8-7716ba9a6567 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:54.265538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a06de0-17ef-4476-88c8-7716ba9a6567 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:54.266010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a06de0-17ef-4476-88c8-7716ba9a6567 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:54.266515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a06de0-17ef-4476-88c8-7716ba9a6567 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:54.267196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a06de0-17ef-4476-88c8-7716ba9a6567 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:54.267644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a06de0-17ef-4476-88c8-7716ba9a6567 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:54.268064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a06de0-17ef-4476-88c8-7716ba9a6567 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:54.407168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-77a06de0-17ef-4476-88c8-7716ba9a6567 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:54.416618 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-77a06de0-17ef-4476-88c8-7716ba9a6567 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.162701 Oct 11 05:04:54.417779 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3445/7126] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:54 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:55.440940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-81baa117-da2c-4a80-95bb-f6d38ca62e52 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:55.441569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-81baa117-da2c-4a80-95bb-f6d38ca62e52 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:55.448694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81baa117-da2c-4a80-95bb-f6d38ca62e52 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:55.449184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81baa117-da2c-4a80-95bb-f6d38ca62e52 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:55.449632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81baa117-da2c-4a80-95bb-f6d38ca62e52 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:55.450371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81baa117-da2c-4a80-95bb-f6d38ca62e52 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:55.450842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81baa117-da2c-4a80-95bb-f6d38ca62e52 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:55.451284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81baa117-da2c-4a80-95bb-f6d38ca62e52 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:55.588881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-81baa117-da2c-4a80-95bb-f6d38ca62e52 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:55.597479 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-81baa117-da2c-4a80-95bb-f6d38ca62e52 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.160387 Oct 11 05:04:55.598060 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3682/7127] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:55 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:56.621244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-352e2656-64ca-4be7-a284-b4a15fbceb7a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:56.621905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-352e2656-64ca-4be7-a284-b4a15fbceb7a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:56.628979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-352e2656-64ca-4be7-a284-b4a15fbceb7a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:56.629461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-352e2656-64ca-4be7-a284-b4a15fbceb7a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:56.629940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-352e2656-64ca-4be7-a284-b4a15fbceb7a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:56.630661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-352e2656-64ca-4be7-a284-b4a15fbceb7a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:56.631114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-352e2656-64ca-4be7-a284-b4a15fbceb7a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:56.631540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-352e2656-64ca-4be7-a284-b4a15fbceb7a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:56.769638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-352e2656-64ca-4be7-a284-b4a15fbceb7a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:56.777483 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-352e2656-64ca-4be7-a284-b4a15fbceb7a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.160682 Oct 11 05:04:56.778002 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3446/7128] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:56 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:57.800509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82fee815-6d1a-47ea-b557-780963776217 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:57.801098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82fee815-6d1a-47ea-b557-780963776217 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:57.808612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fee815-6d1a-47ea-b557-780963776217 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:57.809109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fee815-6d1a-47ea-b557-780963776217 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:57.809567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fee815-6d1a-47ea-b557-780963776217 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:57.810292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fee815-6d1a-47ea-b557-780963776217 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:57.810759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fee815-6d1a-47ea-b557-780963776217 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:57.811199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fee815-6d1a-47ea-b557-780963776217 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:57.942728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82fee815-6d1a-47ea-b557-780963776217 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:57.950582 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82fee815-6d1a-47ea-b557-780963776217 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.154194 Oct 11 05:04:57.951155 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3683/7129] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:57 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:04:58.974477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f4f4fb33-44dc-4480-b8fe-2e582b5fcf08 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:04:58.975224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f4f4fb33-44dc-4480-b8fe-2e582b5fcf08 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:04:58.983286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f4fb33-44dc-4480-b8fe-2e582b5fcf08 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:58.983764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f4fb33-44dc-4480-b8fe-2e582b5fcf08 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:58.984195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f4fb33-44dc-4480-b8fe-2e582b5fcf08 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:58.984890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f4fb33-44dc-4480-b8fe-2e582b5fcf08 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:04:58.985330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f4fb33-44dc-4480-b8fe-2e582b5fcf08 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:04:58.985755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f4f4fb33-44dc-4480-b8fe-2e582b5fcf08 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:04:59.131459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f4f4fb33-44dc-4480-b8fe-2e582b5fcf08 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:04:59.142713 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f4f4fb33-44dc-4480-b8fe-2e582b5fcf08 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.172490 Oct 11 05:04:59.143350 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3447/7130] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:04:58 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:00.165940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e3c77a0-f121-4f39-bc6b-cbbb2fa18c16 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:00.166601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e3c77a0-f121-4f39-bc6b-cbbb2fa18c16 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:00.173643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3c77a0-f121-4f39-bc6b-cbbb2fa18c16 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:00.174140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3c77a0-f121-4f39-bc6b-cbbb2fa18c16 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:00.174688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3c77a0-f121-4f39-bc6b-cbbb2fa18c16 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:00.175390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3c77a0-f121-4f39-bc6b-cbbb2fa18c16 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:00.175858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3c77a0-f121-4f39-bc6b-cbbb2fa18c16 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:00.176298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e3c77a0-f121-4f39-bc6b-cbbb2fa18c16 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:00.317628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e3c77a0-f121-4f39-bc6b-cbbb2fa18c16 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:00.326041 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e3c77a0-f121-4f39-bc6b-cbbb2fa18c16 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.164068 Oct 11 05:05:00.326636 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3684/7131] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:00 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:01.349496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7e353f1c-864f-4247-9b64-0b25e1de72c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:01.350106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7e353f1c-864f-4247-9b64-0b25e1de72c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:01.357317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e353f1c-864f-4247-9b64-0b25e1de72c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:01.357790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e353f1c-864f-4247-9b64-0b25e1de72c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:01.358318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e353f1c-864f-4247-9b64-0b25e1de72c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:01.359291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e353f1c-864f-4247-9b64-0b25e1de72c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:01.359742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e353f1c-864f-4247-9b64-0b25e1de72c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:01.360165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e353f1c-864f-4247-9b64-0b25e1de72c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:01.497537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7e353f1c-864f-4247-9b64-0b25e1de72c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:01.505324 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7e353f1c-864f-4247-9b64-0b25e1de72c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.160274 Oct 11 05:05:01.505892 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3448/7132] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:01 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:02.529521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-99a07c61-d614-400d-b500-2f6205f9a2e6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:02.530151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-99a07c61-d614-400d-b500-2f6205f9a2e6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:02.537052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99a07c61-d614-400d-b500-2f6205f9a2e6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:02.537545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99a07c61-d614-400d-b500-2f6205f9a2e6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:02.537995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99a07c61-d614-400d-b500-2f6205f9a2e6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:02.538735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99a07c61-d614-400d-b500-2f6205f9a2e6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:02.539203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99a07c61-d614-400d-b500-2f6205f9a2e6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:02.539641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99a07c61-d614-400d-b500-2f6205f9a2e6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:03.013182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-99a07c61-d614-400d-b500-2f6205f9a2e6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:03.020926 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-99a07c61-d614-400d-b500-2f6205f9a2e6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.495869 Oct 11 05:05:03.021548 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3685/7133] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:02 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:04.044903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3eaef849-87b5-4a11-9054-5f85d8dbc4ce tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:04.045552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3eaef849-87b5-4a11-9054-5f85d8dbc4ce tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:04.052507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3eaef849-87b5-4a11-9054-5f85d8dbc4ce tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:04.052985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3eaef849-87b5-4a11-9054-5f85d8dbc4ce tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:04.053419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3eaef849-87b5-4a11-9054-5f85d8dbc4ce tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:04.054104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3eaef849-87b5-4a11-9054-5f85d8dbc4ce tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:04.054585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3eaef849-87b5-4a11-9054-5f85d8dbc4ce tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:04.055011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3eaef849-87b5-4a11-9054-5f85d8dbc4ce tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:04.204539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3eaef849-87b5-4a11-9054-5f85d8dbc4ce tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:04.212675 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3eaef849-87b5-4a11-9054-5f85d8dbc4ce tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.171645 Oct 11 05:05:04.216147 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3449/7134] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:04 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:05.236282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0f5330f-3366-44f1-aead-8cf8cb411a7f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:05.236900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c0f5330f-3366-44f1-aead-8cf8cb411a7f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:05.243942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f5330f-3366-44f1-aead-8cf8cb411a7f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:05.244432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f5330f-3366-44f1-aead-8cf8cb411a7f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:05.252020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f5330f-3366-44f1-aead-8cf8cb411a7f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:05.252020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f5330f-3366-44f1-aead-8cf8cb411a7f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:05.252020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f5330f-3366-44f1-aead-8cf8cb411a7f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:05.252020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0f5330f-3366-44f1-aead-8cf8cb411a7f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:05.378397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0f5330f-3366-44f1-aead-8cf8cb411a7f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:05.387485 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c0f5330f-3366-44f1-aead-8cf8cb411a7f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.154420 Oct 11 05:05:05.388088 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3686/7135] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:05 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:06.410606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3b2bd214-eac0-4af8-abf7-a17d047b63b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:06.411240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3b2bd214-eac0-4af8-abf7-a17d047b63b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:06.418088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b2bd214-eac0-4af8-abf7-a17d047b63b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:06.421533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b2bd214-eac0-4af8-abf7-a17d047b63b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:06.421533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b2bd214-eac0-4af8-abf7-a17d047b63b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:06.421533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b2bd214-eac0-4af8-abf7-a17d047b63b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:06.421533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b2bd214-eac0-4af8-abf7-a17d047b63b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:06.421533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3b2bd214-eac0-4af8-abf7-a17d047b63b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:06.555660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3b2bd214-eac0-4af8-abf7-a17d047b63b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:06.565284 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3b2bd214-eac0-4af8-abf7-a17d047b63b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.158651 Oct 11 05:05:06.570963 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3450/7136] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:06 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:07.592819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c304885c-087f-47ce-9718-e17ad65d6eaa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:07.593451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c304885c-087f-47ce-9718-e17ad65d6eaa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:07.600654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c304885c-087f-47ce-9718-e17ad65d6eaa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:07.601164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c304885c-087f-47ce-9718-e17ad65d6eaa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:07.601617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c304885c-087f-47ce-9718-e17ad65d6eaa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:07.602344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c304885c-087f-47ce-9718-e17ad65d6eaa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:07.602802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c304885c-087f-47ce-9718-e17ad65d6eaa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:07.603779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c304885c-087f-47ce-9718-e17ad65d6eaa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:07.738899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c304885c-087f-47ce-9718-e17ad65d6eaa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:07.747037 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c304885c-087f-47ce-9718-e17ad65d6eaa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.158794 Oct 11 05:05:07.750954 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3687/7137] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:07 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:08.770347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e302cad-228b-4768-8338-ab83ef8322d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:08.771019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4e302cad-228b-4768-8338-ab83ef8322d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:08.777751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e302cad-228b-4768-8338-ab83ef8322d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:08.778265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e302cad-228b-4768-8338-ab83ef8322d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:08.778710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e302cad-228b-4768-8338-ab83ef8322d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:08.779398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e302cad-228b-4768-8338-ab83ef8322d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:08.779888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e302cad-228b-4768-8338-ab83ef8322d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:08.780317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e302cad-228b-4768-8338-ab83ef8322d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:08.909786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4e302cad-228b-4768-8338-ab83ef8322d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:08.917479 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4e302cad-228b-4768-8338-ab83ef8322d5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.151114 Oct 11 05:05:08.918613 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3451/7138] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:08 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:09.940900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d4cbca7a-91f3-4166-9658-c5f143478018 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:09.941533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d4cbca7a-91f3-4166-9658-c5f143478018 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:09.948437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4cbca7a-91f3-4166-9658-c5f143478018 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:09.949573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4cbca7a-91f3-4166-9658-c5f143478018 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:09.950039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4cbca7a-91f3-4166-9658-c5f143478018 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:09.950777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4cbca7a-91f3-4166-9658-c5f143478018 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:09.951248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4cbca7a-91f3-4166-9658-c5f143478018 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:09.951694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4cbca7a-91f3-4166-9658-c5f143478018 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:10.084630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d4cbca7a-91f3-4166-9658-c5f143478018 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:10.092755 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d4cbca7a-91f3-4166-9658-c5f143478018 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.155773 Oct 11 05:05:10.093348 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3688/7139] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:09 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:11.115908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bf1659cb-f84a-47df-9552-1d3e2548baa8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:11.116531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bf1659cb-f84a-47df-9552-1d3e2548baa8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:11.119322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=26 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:05:11.124425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1659cb-f84a-47df-9552-1d3e2548baa8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:11.124911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1659cb-f84a-47df-9552-1d3e2548baa8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:11.125426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1659cb-f84a-47df-9552-1d3e2548baa8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:11.126122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1659cb-f84a-47df-9552-1d3e2548baa8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:11.127198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1659cb-f84a-47df-9552-1d3e2548baa8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:11.127626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bf1659cb-f84a-47df-9552-1d3e2548baa8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:11.131854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=78 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:05:11.262523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bf1659cb-f84a-47df-9552-1d3e2548baa8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:11.270379 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bf1659cb-f84a-47df-9552-1d3e2548baa8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.158434 Oct 11 05:05:11.270968 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3452/7140] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:11 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:12.294710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ecd9fcc3-d9f9-4324-b91d-d2e55bf0638e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:12.295535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ecd9fcc3-d9f9-4324-b91d-d2e55bf0638e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:12.298389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=26 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:05:12.303902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecd9fcc3-d9f9-4324-b91d-d2e55bf0638e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:12.304412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecd9fcc3-d9f9-4324-b91d-d2e55bf0638e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:12.304893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecd9fcc3-d9f9-4324-b91d-d2e55bf0638e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:12.305841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecd9fcc3-d9f9-4324-b91d-d2e55bf0638e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:12.306342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecd9fcc3-d9f9-4324-b91d-d2e55bf0638e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:12.306864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ecd9fcc3-d9f9-4324-b91d-d2e55bf0638e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:12.309632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=78 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:05:12.523997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ecd9fcc3-d9f9-4324-b91d-d2e55bf0638e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:12.534255 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ecd9fcc3-d9f9-4324-b91d-d2e55bf0638e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.243989 Oct 11 05:05:12.534883 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3689/7141] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:12 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:13.556403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-38b8c0b6-63d5-4b22-a1ed-6d3a1f34e455 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:13.557081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-38b8c0b6-63d5-4b22-a1ed-6d3a1f34e455 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:13.565096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b8c0b6-63d5-4b22-a1ed-6d3a1f34e455 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:13.567601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b8c0b6-63d5-4b22-a1ed-6d3a1f34e455 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:13.567601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b8c0b6-63d5-4b22-a1ed-6d3a1f34e455 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:13.567601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b8c0b6-63d5-4b22-a1ed-6d3a1f34e455 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:13.567601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b8c0b6-63d5-4b22-a1ed-6d3a1f34e455 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:13.567601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-38b8c0b6-63d5-4b22-a1ed-6d3a1f34e455 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:13.701607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-38b8c0b6-63d5-4b22-a1ed-6d3a1f34e455 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:13.709720 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-38b8c0b6-63d5-4b22-a1ed-6d3a1f34e455 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.157290 Oct 11 05:05:13.710533 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3453/7142] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:13 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:05:14.733710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8264b867-81cb-45ad-b78f-a5d5df4df361 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:14.734480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8264b867-81cb-45ad-b78f-a5d5df4df361 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:14.741981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8264b867-81cb-45ad-b78f-a5d5df4df361 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:14.742530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8264b867-81cb-45ad-b78f-a5d5df4df361 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:14.742990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8264b867-81cb-45ad-b78f-a5d5df4df361 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:14.743713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8264b867-81cb-45ad-b78f-a5d5df4df361 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:14.744184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8264b867-81cb-45ad-b78f-a5d5df4df361 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:14.744627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8264b867-81cb-45ad-b78f-a5d5df4df361 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:14.879081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8264b867-81cb-45ad-b78f-a5d5df4df361 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:14.886988 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8264b867-81cb-45ad-b78f-a5d5df4df361 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1341 microversion: 2.1 time: 0.157881 Oct 11 05:05:14.887563 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3690/7143] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:14 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1341 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:15.909122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9ca9750b-e3c4-4b01-9fbb-9567a3e129ba tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:15.909750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9ca9750b-e3c4-4b01-9fbb-9567a3e129ba tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:15.916727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ca9750b-e3c4-4b01-9fbb-9567a3e129ba tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:15.917218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ca9750b-e3c4-4b01-9fbb-9567a3e129ba tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:15.917661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ca9750b-e3c4-4b01-9fbb-9567a3e129ba tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:15.918388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ca9750b-e3c4-4b01-9fbb-9567a3e129ba tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:15.918850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ca9750b-e3c4-4b01-9fbb-9567a3e129ba tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:15.919347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ca9750b-e3c4-4b01-9fbb-9567a3e129ba tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:16.047705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9ca9750b-e3c4-4b01-9fbb-9567a3e129ba tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:16.055487 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9ca9750b-e3c4-4b01-9fbb-9567a3e129ba tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1375 microversion: 2.1 time: 0.150305 Oct 11 05:05:16.056056 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3454/7144] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:15 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1375 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:17.078946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4042d5fb-714e-40ae-a696-d1865c786c5e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:17.079601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4042d5fb-714e-40ae-a696-d1865c786c5e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:17.086366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4042d5fb-714e-40ae-a696-d1865c786c5e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:17.086868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4042d5fb-714e-40ae-a696-d1865c786c5e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:17.087321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4042d5fb-714e-40ae-a696-d1865c786c5e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:17.088024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4042d5fb-714e-40ae-a696-d1865c786c5e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:17.088493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4042d5fb-714e-40ae-a696-d1865c786c5e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:17.088937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4042d5fb-714e-40ae-a696-d1865c786c5e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:17.222027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4042d5fb-714e-40ae-a696-d1865c786c5e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:17.229811 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4042d5fb-714e-40ae-a696-d1865c786c5e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1375 microversion: 2.1 time: 0.154770 Oct 11 05:05:17.230421 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3691/7145] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:17 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:18.253148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-780d152f-48cb-4480-a93e-29edd6ac6aa4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:18.253764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-780d152f-48cb-4480-a93e-29edd6ac6aa4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:18.260988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-780d152f-48cb-4480-a93e-29edd6ac6aa4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:18.261472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-780d152f-48cb-4480-a93e-29edd6ac6aa4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:18.262653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-780d152f-48cb-4480-a93e-29edd6ac6aa4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:18.263495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-780d152f-48cb-4480-a93e-29edd6ac6aa4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:18.263890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-780d152f-48cb-4480-a93e-29edd6ac6aa4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:18.264321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-780d152f-48cb-4480-a93e-29edd6ac6aa4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:18.399934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-780d152f-48cb-4480-a93e-29edd6ac6aa4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:18.407723 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-780d152f-48cb-4480-a93e-29edd6ac6aa4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1375 microversion: 2.1 time: 0.158521 Oct 11 05:05:18.408302 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3455/7146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:18 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1375 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:19.431135 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4ed76bff-77a8-48df-b71e-8bfba179f936 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:19.431763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4ed76bff-77a8-48df-b71e-8bfba179f936 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:19.438724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed76bff-77a8-48df-b71e-8bfba179f936 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:19.439224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed76bff-77a8-48df-b71e-8bfba179f936 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:19.439673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed76bff-77a8-48df-b71e-8bfba179f936 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:19.440525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed76bff-77a8-48df-b71e-8bfba179f936 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:19.440826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed76bff-77a8-48df-b71e-8bfba179f936 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:19.441262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4ed76bff-77a8-48df-b71e-8bfba179f936 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:19.571533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4ed76bff-77a8-48df-b71e-8bfba179f936 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:19.580012 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4ed76bff-77a8-48df-b71e-8bfba179f936 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1375 microversion: 2.1 time: 0.152914 Oct 11 05:05:19.580592 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3692/7147] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:19 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1375 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:20.603586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d9ad3eaf-664e-4f80-90b3-bd0e36d7a2ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:20.604194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d9ad3eaf-664e-4f80-90b3-bd0e36d7a2ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:20.611310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9ad3eaf-664e-4f80-90b3-bd0e36d7a2ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:20.611788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9ad3eaf-664e-4f80-90b3-bd0e36d7a2ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:20.612224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9ad3eaf-664e-4f80-90b3-bd0e36d7a2ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:20.612904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9ad3eaf-664e-4f80-90b3-bd0e36d7a2ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:20.613353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9ad3eaf-664e-4f80-90b3-bd0e36d7a2ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:20.613778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9ad3eaf-664e-4f80-90b3-bd0e36d7a2ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:20.744662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d9ad3eaf-664e-4f80-90b3-bd0e36d7a2ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:20.753160 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d9ad3eaf-664e-4f80-90b3-bd0e36d7a2ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1375 microversion: 2.1 time: 0.153458 Oct 11 05:05:20.753732 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3456/7148] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:20 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1375 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:21.776532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33c0d349-cf30-44a5-8dbe-f599b1b2de68 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:21.777088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-33c0d349-cf30-44a5-8dbe-f599b1b2de68 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:21.783926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c0d349-cf30-44a5-8dbe-f599b1b2de68 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:21.784426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c0d349-cf30-44a5-8dbe-f599b1b2de68 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:21.784875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c0d349-cf30-44a5-8dbe-f599b1b2de68 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:21.785572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c0d349-cf30-44a5-8dbe-f599b1b2de68 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:21.786035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c0d349-cf30-44a5-8dbe-f599b1b2de68 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:21.786565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c0d349-cf30-44a5-8dbe-f599b1b2de68 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:21.924343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-33c0d349-cf30-44a5-8dbe-f599b1b2de68 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:21.932458 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-33c0d349-cf30-44a5-8dbe-f599b1b2de68 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1375 microversion: 2.1 time: 0.160119 Oct 11 05:05:21.933034 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3693/7149] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:21 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1375 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:22.956353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5fe26c1a-9849-4b64-a727-9dd3c080e545 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:22.956993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5fe26c1a-9849-4b64-a727-9dd3c080e545 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:22.964855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fe26c1a-9849-4b64-a727-9dd3c080e545 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:22.965944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fe26c1a-9849-4b64-a727-9dd3c080e545 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:22.966428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fe26c1a-9849-4b64-a727-9dd3c080e545 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:22.967143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fe26c1a-9849-4b64-a727-9dd3c080e545 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:22.967589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fe26c1a-9849-4b64-a727-9dd3c080e545 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:22.968010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5fe26c1a-9849-4b64-a727-9dd3c080e545 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:23.100977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5fe26c1a-9849-4b64-a727-9dd3c080e545 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:23.108777 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5fe26c1a-9849-4b64-a727-9dd3c080e545 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1375 microversion: 2.1 time: 0.156674 Oct 11 05:05:23.109338 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3457/7150] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:22 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1375 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:24.131972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b060fdcf-6803-403b-8bcb-fb8284e4337a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:24.132524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b060fdcf-6803-403b-8bcb-fb8284e4337a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:24.140083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b060fdcf-6803-403b-8bcb-fb8284e4337a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:24.140586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b060fdcf-6803-403b-8bcb-fb8284e4337a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:24.141039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b060fdcf-6803-403b-8bcb-fb8284e4337a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:24.141817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b060fdcf-6803-403b-8bcb-fb8284e4337a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:24.142332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b060fdcf-6803-403b-8bcb-fb8284e4337a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:24.142776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b060fdcf-6803-403b-8bcb-fb8284e4337a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:24.272712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b060fdcf-6803-403b-8bcb-fb8284e4337a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:24.282109 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b060fdcf-6803-403b-8bcb-fb8284e4337a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1375 microversion: 2.1 time: 0.154499 Oct 11 05:05:24.283249 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3694/7151] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:24 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1375 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:25.304716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-57b230cc-12e4-4692-9152-a6fb7b0ae5d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:25.305254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-57b230cc-12e4-4692-9152-a6fb7b0ae5d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:25.312821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57b230cc-12e4-4692-9152-a6fb7b0ae5d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:25.313298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57b230cc-12e4-4692-9152-a6fb7b0ae5d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:25.313772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57b230cc-12e4-4692-9152-a6fb7b0ae5d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:25.314488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57b230cc-12e4-4692-9152-a6fb7b0ae5d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:25.317491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57b230cc-12e4-4692-9152-a6fb7b0ae5d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:25.317491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-57b230cc-12e4-4692-9152-a6fb7b0ae5d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:25.443400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-57b230cc-12e4-4692-9152-a6fb7b0ae5d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:25.451245 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-57b230cc-12e4-4692-9152-a6fb7b0ae5d0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1375 microversion: 2.1 time: 0.150687 Oct 11 05:05:25.451823 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3458/7152] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:25 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1375 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:25.773950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-45b90f27-f0d1-4a80-b7bf-34d70cf2d356 req-1c3d23d6-f835-420a-9816-d250aecb5ef5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbac44d-3bac-491e-b197-1492394e68b2", "name": "network-vif-plugged", "status": "completed", "tag": "f293bfcc-d8a1-4e44-8d04-7ffbba99c150"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:05:25.784551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-45b90f27-f0d1-4a80-b7bf-34d70cf2d356 req-1c3d23d6-f835-420a-9816-d250aecb5ef5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:25.785090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-45b90f27-f0d1-4a80-b7bf-34d70cf2d356 req-1c3d23d6-f835-420a-9816-d250aecb5ef5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:25.785535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-45b90f27-f0d1-4a80-b7bf-34d70cf2d356 req-1c3d23d6-f835-420a-9816-d250aecb5ef5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:25.797032 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-45b90f27-f0d1-4a80-b7bf-34d70cf2d356 req-1c3d23d6-f835-420a-9816-d250aecb5ef5 service nova] Creating event network-vif-plugged:f293bfcc-d8a1-4e44-8d04-7ffbba99c150 for instance 0fbac44d-3bac-491e-b197-1492394e68b2 on n-h2-860892-1 Oct 11 05:05:25.802030 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-45b90f27-f0d1-4a80-b7bf-34d70cf2d356 req-1c3d23d6-f835-420a-9816-d250aecb5ef5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032036 Oct 11 05:05:25.802619 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3695/7153] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:05:26.474395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09fdd9e8-c8af-465c-9ba8-2753bc90360b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:26.475032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09fdd9e8-c8af-465c-9ba8-2753bc90360b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:26.481827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09fdd9e8-c8af-465c-9ba8-2753bc90360b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:26.482345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09fdd9e8-c8af-465c-9ba8-2753bc90360b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:26.482788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09fdd9e8-c8af-465c-9ba8-2753bc90360b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:26.483475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09fdd9e8-c8af-465c-9ba8-2753bc90360b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:26.483932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09fdd9e8-c8af-465c-9ba8-2753bc90360b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:26.484364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09fdd9e8-c8af-465c-9ba8-2753bc90360b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:26.619859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09fdd9e8-c8af-465c-9ba8-2753bc90360b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:26.628002 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09fdd9e8-c8af-465c-9ba8-2753bc90360b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1375 microversion: 2.1 time: 0.157484 Oct 11 05:05:26.634467 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3459/7154] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:26 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1375 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:27.653745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f9bdd8e-4fca-4321-a75e-1b3916af613d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:27.654878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6f9bdd8e-4fca-4321-a75e-1b3916af613d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:27.661237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f9bdd8e-4fca-4321-a75e-1b3916af613d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:27.661744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f9bdd8e-4fca-4321-a75e-1b3916af613d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:27.662221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f9bdd8e-4fca-4321-a75e-1b3916af613d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:27.662919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f9bdd8e-4fca-4321-a75e-1b3916af613d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:27.663382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f9bdd8e-4fca-4321-a75e-1b3916af613d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:27.663820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f9bdd8e-4fca-4321-a75e-1b3916af613d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:27.793679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6f9bdd8e-4fca-4321-a75e-1b3916af613d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:27.801554 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6f9bdd8e-4fca-4321-a75e-1b3916af613d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1561 microversion: 2.1 time: 0.154091 Oct 11 05:05:27.802126 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3696/7155] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:27 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:27.826681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0ab15831-a800-46cf-9a70-f9af07bcb8f2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:27.827296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0ab15831-a800-46cf-9a70-f9af07bcb8f2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:27.833987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ab15831-a800-46cf-9a70-f9af07bcb8f2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:27.834499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ab15831-a800-46cf-9a70-f9af07bcb8f2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:27.834936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ab15831-a800-46cf-9a70-f9af07bcb8f2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:27.835616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ab15831-a800-46cf-9a70-f9af07bcb8f2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:27.836067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ab15831-a800-46cf-9a70-f9af07bcb8f2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:27.836488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0ab15831-a800-46cf-9a70-f9af07bcb8f2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:27.971780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0ab15831-a800-46cf-9a70-f9af07bcb8f2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:27.980088 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0ab15831-a800-46cf-9a70-f9af07bcb8f2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1561 microversion: 2.1 time: 0.157902 Oct 11 05:05:27.981038 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3460/7156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:27 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1561 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:28.061970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4a150527-086b-47c1-be96-75007b292e73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:28.062538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4a150527-086b-47c1-be96-75007b292e73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:28.068761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a150527-086b-47c1-be96-75007b292e73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:28.069265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a150527-086b-47c1-be96-75007b292e73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:28.069716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a150527-086b-47c1-be96-75007b292e73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:28.070450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a150527-086b-47c1-be96-75007b292e73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:28.070920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a150527-086b-47c1-be96-75007b292e73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:28.071359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a150527-086b-47c1-be96-75007b292e73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:28.098473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4a150527-086b-47c1-be96-75007b292e73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:05:28.366158 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4a150527-086b-47c1-be96-75007b292e73 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 204 len: 0 microversion: 2.1 time: 0.308161 Oct 11 05:05:28.366928 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3697/7157] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:05:28 2022] DELETE /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:05:28.375637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c32d05f4-7e7d-42b7-86d2-c8beb7907e0a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:28.376270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c32d05f4-7e7d-42b7-86d2-c8beb7907e0a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:28.382503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c32d05f4-7e7d-42b7-86d2-c8beb7907e0a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:28.382987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c32d05f4-7e7d-42b7-86d2-c8beb7907e0a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:28.383457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c32d05f4-7e7d-42b7-86d2-c8beb7907e0a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:28.384409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c32d05f4-7e7d-42b7-86d2-c8beb7907e0a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:28.384868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c32d05f4-7e7d-42b7-86d2-c8beb7907e0a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:28.385300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c32d05f4-7e7d-42b7-86d2-c8beb7907e0a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:28.520877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c32d05f4-7e7d-42b7-86d2-c8beb7907e0a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:28.528743 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c32d05f4-7e7d-42b7-86d2-c8beb7907e0a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1567 microversion: 2.1 time: 0.157670 Oct 11 05:05:28.529315 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3461/7158] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:28 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:29.553529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-40e5ca02-7f9b-4b08-92fd-d57dd181f298 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:29.555753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-40e5ca02-7f9b-4b08-92fd-d57dd181f298 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:29.561705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40e5ca02-7f9b-4b08-92fd-d57dd181f298 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:29.562213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40e5ca02-7f9b-4b08-92fd-d57dd181f298 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:29.562665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40e5ca02-7f9b-4b08-92fd-d57dd181f298 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:29.563421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40e5ca02-7f9b-4b08-92fd-d57dd181f298 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:29.563883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40e5ca02-7f9b-4b08-92fd-d57dd181f298 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:29.564318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-40e5ca02-7f9b-4b08-92fd-d57dd181f298 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:29.698316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-40e5ca02-7f9b-4b08-92fd-d57dd181f298 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:29.706853 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-40e5ca02-7f9b-4b08-92fd-d57dd181f298 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1567 microversion: 2.1 time: 0.157745 Oct 11 05:05:29.707427 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3698/7159] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:29 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:30.352359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-25b055d3-58ea-437e-9c90-b51cc92668d1 req-808dd409-65aa-4a28-b0ce-de2390349354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0fbac44d-3bac-491e-b197-1492394e68b2", "name": "network-vif-deleted", "tag": "f293bfcc-d8a1-4e44-8d04-7ffbba99c150"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:05:30.365049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-25b055d3-58ea-437e-9c90-b51cc92668d1 req-808dd409-65aa-4a28-b0ce-de2390349354 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:30.365537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-25b055d3-58ea-437e-9c90-b51cc92668d1 req-808dd409-65aa-4a28-b0ce-de2390349354 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:30.365981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-25b055d3-58ea-437e-9c90-b51cc92668d1 req-808dd409-65aa-4a28-b0ce-de2390349354 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:30.379899 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-25b055d3-58ea-437e-9c90-b51cc92668d1 req-808dd409-65aa-4a28-b0ce-de2390349354 service nova] Creating event network-vif-deleted:f293bfcc-d8a1-4e44-8d04-7ffbba99c150 for instance 0fbac44d-3bac-491e-b197-1492394e68b2 on n-h2-860892-1 Oct 11 05:05:30.386019 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-25b055d3-58ea-437e-9c90-b51cc92668d1 req-808dd409-65aa-4a28-b0ce-de2390349354 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040572 Oct 11 05:05:30.389856 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3462/7160] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:05:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:05:30.730478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e35c3881-b08d-4c4b-a81c-c94edca91cd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:30.731239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e35c3881-b08d-4c4b-a81c-c94edca91cd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:30.738706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e35c3881-b08d-4c4b-a81c-c94edca91cd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:30.742838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e35c3881-b08d-4c4b-a81c-c94edca91cd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:30.742838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e35c3881-b08d-4c4b-a81c-c94edca91cd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:30.742838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e35c3881-b08d-4c4b-a81c-c94edca91cd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:30.742838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e35c3881-b08d-4c4b-a81c-c94edca91cd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:30.742838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e35c3881-b08d-4c4b-a81c-c94edca91cd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:30.810020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e35c3881-b08d-4c4b-a81c-c94edca91cd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:30.818003 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e35c3881-b08d-4c4b-a81c-c94edca91cd9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1360 microversion: 2.1 time: 0.091601 Oct 11 05:05:30.818768 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3699/7161] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:30 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1360 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:31.841704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-64b2d661-3bb0-429b-9c00-33091b3d0d9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:31.842451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-64b2d661-3bb0-429b-9c00-33091b3d0d9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:31.849714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64b2d661-3bb0-429b-9c00-33091b3d0d9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:31.850216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64b2d661-3bb0-429b-9c00-33091b3d0d9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:31.850650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64b2d661-3bb0-429b-9c00-33091b3d0d9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:31.851335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64b2d661-3bb0-429b-9c00-33091b3d0d9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:31.851784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64b2d661-3bb0-429b-9c00-33091b3d0d9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:31.852205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-64b2d661-3bb0-429b-9c00-33091b3d0d9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:31.920899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-64b2d661-3bb0-429b-9c00-33091b3d0d9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:31.928963 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-64b2d661-3bb0-429b-9c00-33091b3d0d9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1360 microversion: 2.1 time: 0.091529 Oct 11 05:05:31.929544 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3463/7162] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:31 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1360 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:32.953471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3fe6c015-cd5f-475d-9c02-9c7e4741eedf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:32.954118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3fe6c015-cd5f-475d-9c02-9c7e4741eedf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:32.961465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fe6c015-cd5f-475d-9c02-9c7e4741eedf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:32.961971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fe6c015-cd5f-475d-9c02-9c7e4741eedf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:32.962486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fe6c015-cd5f-475d-9c02-9c7e4741eedf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:32.963415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fe6c015-cd5f-475d-9c02-9c7e4741eedf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:32.963889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fe6c015-cd5f-475d-9c02-9c7e4741eedf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:32.964333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3fe6c015-cd5f-475d-9c02-9c7e4741eedf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:33.031581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3fe6c015-cd5f-475d-9c02-9c7e4741eedf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:33.039706 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3fe6c015-cd5f-475d-9c02-9c7e4741eedf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1360 microversion: 2.1 time: 0.090873 Oct 11 05:05:33.040276 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3700/7163] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:32 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1360 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:34.063089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f9734f1-708b-4b1d-ad6b-08487e3deb56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:34.063706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5f9734f1-708b-4b1d-ad6b-08487e3deb56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:34.070768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f9734f1-708b-4b1d-ad6b-08487e3deb56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:34.071248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f9734f1-708b-4b1d-ad6b-08487e3deb56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:34.071691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f9734f1-708b-4b1d-ad6b-08487e3deb56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:34.072426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f9734f1-708b-4b1d-ad6b-08487e3deb56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:34.072875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f9734f1-708b-4b1d-ad6b-08487e3deb56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:34.073298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f9734f1-708b-4b1d-ad6b-08487e3deb56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:34.136572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5f9734f1-708b-4b1d-ad6b-08487e3deb56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:34.144425 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5f9734f1-708b-4b1d-ad6b-08487e3deb56 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1360 microversion: 2.1 time: 0.085331 Oct 11 05:05:34.144991 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3464/7164] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:34 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1360 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:35.167900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:35.168761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:35.176218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:35.180599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:35.180599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:35.180599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:35.180599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:35.180599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:35.212171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:35.212683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:35.213168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:35.213607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lazy-loading 'fault' on Instance uuid 0fbac44d-3bac-491e-b197-1492394e68b2 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:05:35.263224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:35.271486 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3787c0cb-c9f5-479c-80fc-ad9ffd4541b8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 200 len: 1365 microversion: 2.1 time: 0.107386 Oct 11 05:05:35.272067 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3701/7165] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:35 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 1365 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:36.296935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:36.297549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:36.304480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:36.304960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:36.305396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:36.306089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:36.306568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:36.306997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:36.322044 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 HTTP/1.1 Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '0fbac44d-3bac-491e-b197-1492394e68b2'} Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:36.326988 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:36.331594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:36.331594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:36.331594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:36.331594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:05:36.331594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:05:36.331594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:36.331594 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:36.331594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:05:36.331594 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e665a086-d819-49b2-a4d4-5f13a3c4fbed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 404 len: 111 microversion: 2.1 time: 0.032424 Oct 11 05:05:36.331594 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3465/7166] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:36 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:05:40.684444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1ee450da-3a43-4d94-98a9-8b3187af758e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:40.685452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1ee450da-3a43-4d94-98a9-8b3187af758e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:40.692471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ee450da-3a43-4d94-98a9-8b3187af758e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:40.692971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ee450da-3a43-4d94-98a9-8b3187af758e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:40.693423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ee450da-3a43-4d94-98a9-8b3187af758e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:40.694127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ee450da-3a43-4d94-98a9-8b3187af758e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:40.694625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ee450da-3a43-4d94-98a9-8b3187af758e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:40.695084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1ee450da-3a43-4d94-98a9-8b3187af758e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:40.720531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1ee450da-3a43-4d94-98a9-8b3187af758e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:05:40.843381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:05:41.189056 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1ee450da-3a43-4d94-98a9-8b3187af758e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 204 len: 0 microversion: 2.1 time: 0.508038 Oct 11 05:05:41.189960 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3702/7167] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:05:40 2022] DELETE /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 0 bytes in 510 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:05:41.198240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68a976a3-da8d-41c3-aa68-1b708b741209 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:41.198938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68a976a3-da8d-41c3-aa68-1b708b741209 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:41.201388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=28 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:05:41.206406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a976a3-da8d-41c3-aa68-1b708b741209 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:41.206887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a976a3-da8d-41c3-aa68-1b708b741209 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:41.207320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a976a3-da8d-41c3-aa68-1b708b741209 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:41.208001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a976a3-da8d-41c3-aa68-1b708b741209 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:41.208454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a976a3-da8d-41c3-aa68-1b708b741209 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:41.208872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a976a3-da8d-41c3-aa68-1b708b741209 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:41.211432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=76 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:05:41.337687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68a976a3-da8d-41c3-aa68-1b708b741209 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:41.346300 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68a976a3-da8d-41c3-aa68-1b708b741209 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1408 microversion: 2.1 time: 0.152007 Oct 11 05:05:41.346870 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3466/7168] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:41 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:42.371014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3df6d0ca-42c4-42d4-b8ab-7300aaeb1fbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:42.371778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3df6d0ca-42c4-42d4-b8ab-7300aaeb1fbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:42.375070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:05:42.380638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3df6d0ca-42c4-42d4-b8ab-7300aaeb1fbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:42.381174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3df6d0ca-42c4-42d4-b8ab-7300aaeb1fbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:42.381626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3df6d0ca-42c4-42d4-b8ab-7300aaeb1fbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:42.382435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3df6d0ca-42c4-42d4-b8ab-7300aaeb1fbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:42.382903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3df6d0ca-42c4-42d4-b8ab-7300aaeb1fbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:42.383344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3df6d0ca-42c4-42d4-b8ab-7300aaeb1fbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:42.515000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3df6d0ca-42c4-42d4-b8ab-7300aaeb1fbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:42.522969 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3df6d0ca-42c4-42d4-b8ab-7300aaeb1fbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1408 microversion: 2.1 time: 0.156309 Oct 11 05:05:42.523541 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3703/7169] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:42 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1408 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:43.355760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-505f883e-dcfa-4fee-8597-68f4db85ddd8 req-f506115a-2d53-4a4e-8313-90dc5892678b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5d08f45-2b8e-4256-82c8-f369ebea0e1e", "name": "network-vif-deleted", "tag": "1483eaca-dc18-4183-afa8-0d728f23648e"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:05:43.366503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-505f883e-dcfa-4fee-8597-68f4db85ddd8 req-f506115a-2d53-4a4e-8313-90dc5892678b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:43.366980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-505f883e-dcfa-4fee-8597-68f4db85ddd8 req-f506115a-2d53-4a4e-8313-90dc5892678b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:43.367414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-505f883e-dcfa-4fee-8597-68f4db85ddd8 req-f506115a-2d53-4a4e-8313-90dc5892678b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:43.378695 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-505f883e-dcfa-4fee-8597-68f4db85ddd8 req-f506115a-2d53-4a4e-8313-90dc5892678b service nova] Creating event network-vif-deleted:1483eaca-dc18-4183-afa8-0d728f23648e for instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e on n-h1-860892-1 Oct 11 05:05:43.384318 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-505f883e-dcfa-4fee-8597-68f4db85ddd8 req-f506115a-2d53-4a4e-8313-90dc5892678b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032182 Oct 11 05:05:43.385234 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3467/7170] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:05:43.545878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33cafea9-4fec-422e-9311-138b5673a8c8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:43.546529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-33cafea9-4fec-422e-9311-138b5673a8c8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:43.553389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33cafea9-4fec-422e-9311-138b5673a8c8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:43.553821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33cafea9-4fec-422e-9311-138b5673a8c8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:43.554294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33cafea9-4fec-422e-9311-138b5673a8c8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:43.555001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33cafea9-4fec-422e-9311-138b5673a8c8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:43.555464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33cafea9-4fec-422e-9311-138b5673a8c8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:43.555923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33cafea9-4fec-422e-9311-138b5673a8c8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:43.627505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-33cafea9-4fec-422e-9311-138b5673a8c8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:43.636080 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-33cafea9-4fec-422e-9311-138b5673a8c8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1201 microversion: 2.1 time: 0.093933 Oct 11 05:05:43.637515 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3704/7171] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:43 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1201 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:44.660379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff67af01-82fb-45a6-b221-9a1dfe8dcbc1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:44.661021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff67af01-82fb-45a6-b221-9a1dfe8dcbc1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:44.668169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff67af01-82fb-45a6-b221-9a1dfe8dcbc1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:44.668646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff67af01-82fb-45a6-b221-9a1dfe8dcbc1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:44.669078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff67af01-82fb-45a6-b221-9a1dfe8dcbc1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:44.669766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff67af01-82fb-45a6-b221-9a1dfe8dcbc1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:44.670241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff67af01-82fb-45a6-b221-9a1dfe8dcbc1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:44.670668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff67af01-82fb-45a6-b221-9a1dfe8dcbc1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:44.733370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff67af01-82fb-45a6-b221-9a1dfe8dcbc1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:44.741969 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff67af01-82fb-45a6-b221-9a1dfe8dcbc1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1201 microversion: 2.1 time: 0.085943 Oct 11 05:05:44.742552 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3468/7172] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:44 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:45.764911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2da013ce-906c-4c38-bfc5-9e713382e76e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:45.765531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2da013ce-906c-4c38-bfc5-9e713382e76e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:45.773640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da013ce-906c-4c38-bfc5-9e713382e76e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:45.774127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da013ce-906c-4c38-bfc5-9e713382e76e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:45.774719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da013ce-906c-4c38-bfc5-9e713382e76e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:45.775429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da013ce-906c-4c38-bfc5-9e713382e76e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:45.775897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da013ce-906c-4c38-bfc5-9e713382e76e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:45.776335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2da013ce-906c-4c38-bfc5-9e713382e76e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:45.847570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2da013ce-906c-4c38-bfc5-9e713382e76e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:45.856131 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2da013ce-906c-4c38-bfc5-9e713382e76e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1201 microversion: 2.1 time: 0.095154 Oct 11 05:05:45.856902 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3705/7173] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:45 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1201 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:46.880452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9aafe8f6-865b-468e-8747-56d8c2572429 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:46.881111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9aafe8f6-865b-468e-8747-56d8c2572429 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:46.890311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aafe8f6-865b-468e-8747-56d8c2572429 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:46.890795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aafe8f6-865b-468e-8747-56d8c2572429 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:46.893289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aafe8f6-865b-468e-8747-56d8c2572429 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:46.893289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aafe8f6-865b-468e-8747-56d8c2572429 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:46.893289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aafe8f6-865b-468e-8747-56d8c2572429 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:46.893289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9aafe8f6-865b-468e-8747-56d8c2572429 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:46.972321 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9aafe8f6-865b-468e-8747-56d8c2572429 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:46.981012 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9aafe8f6-865b-468e-8747-56d8c2572429 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1201 microversion: 2.1 time: 0.104465 Oct 11 05:05:46.981792 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3469/7174] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:46 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1201 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:48.005169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:48.005894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:48.013879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:48.015095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:48.015555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:48.019629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:48.019629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:48.019629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:48.048775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:48.049193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:48.049644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:48.050107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lazy-loading 'fault' on Instance uuid c5d08f45-2b8e-4256-82c8-f369ebea0e1e {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:05:48.091717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:05:48.099839 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8ad5596b-9910-4ead-89fb-cb3b0ba245f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 200 len: 1206 microversion: 2.1 time: 0.099340 Oct 11 05:05:48.100512 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3706/7175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:47 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 1206 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:05:49.123036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:49.124221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:49.131169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:49.131644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:49.132080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:49.132762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:49.133212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:49.133635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:49.147113 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e HTTP/1.1 Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'c5d08f45-2b8e-4256-82c8-f369ebea0e1e'} Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:49.148731 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:49.153046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:49.153046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:49.153046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:49.153046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:05:49.153046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:05:49.153046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:49.153046 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:49.153046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:05:49.153046 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c853c731-fa73-47e1-b9a2-1645979c08a3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 404 len: 111 microversion: 2.1 time: 0.030996 Oct 11 05:05:49.153046 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3470/7176] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:49 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:05:51.421014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:51.421641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:51.429090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:51.429594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:51.430050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:51.430844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:51.431498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:51.431981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:51.447392 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 HTTP/1.1 Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '0fbac44d-3bac-491e-b197-1492394e68b2'} Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:05:51.449130 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31271adc-77e5-4a9e-9a2d-06d53322ebed tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 404 len: 111 microversion: 2.1 time: 0.034056 Oct 11 05:05:51.453036 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3707/7177] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:05:51 2022] DELETE /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:05:51.459522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:51.460124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 0fbac44d-3bac-491e-b197-1492394e68b2] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:51.467323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:51.467814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:51.468315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:51.469027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:51.469482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:51.469909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:51.484951 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 HTTP/1.1 Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '0fbac44d-3bac-491e-b197-1492394e68b2'} Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:51.486550 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:51.490162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:51.490162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:51.490162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:51.490162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:05:51.490162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:05:51.490162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. Oct 11 05:05:51.490162 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:51.490162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance 0fbac44d-3bac-491e-b197-1492394e68b2 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:05:51.490162 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d16af8e8-c02e-40dd-a583-d8bf06abd81c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2" status: 404 len: 111 microversion: 2.1 time: 0.032340 Oct 11 05:05:51.490162 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3471/7178] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:51 2022] GET /compute/v2.1/servers/0fbac44d-3bac-491e-b197-1492394e68b2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:05:52.128953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:52.129471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:52.135690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:52.136188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:52.136640 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:52.137342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:52.137808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:52.138302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:52.151692 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e HTTP/1.1 Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'c5d08f45-2b8e-4256-82c8-f369ebea0e1e'} Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:05:52.153248 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d124c57d-30ba-4767-863e-2418913c55fe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 404 len: 111 microversion: 2.1 time: 0.029637 Oct 11 05:05:52.157908 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3708/7179] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:05:52 2022] DELETE /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 05:05:52.164349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:05:52.164972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: c5d08f45-2b8e-4256-82c8-f369ebea0e1e] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:05:52.171490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:52.171977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:52.172415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:52.173141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:05:52.173661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:05:52.174035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:05:52.188827 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e HTTP/1.1 Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'c5d08f45-2b8e-4256-82c8-f369ebea0e1e'} Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:05:52.190404 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:52.194547 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:05:52.194547 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:05:52.194547 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:05:52.194547 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:05:52.194547 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:05:52.194547 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. Oct 11 05:05:52.194547 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:05:52.194547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance c5d08f45-2b8e-4256-82c8-f369ebea0e1e could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:05:52.194547 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-191d6394-d4f1-4d5a-9346-7c03a5100fd1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e" status: 404 len: 111 microversion: 2.1 time: 0.032209 Oct 11 05:05:52.194547 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3472/7180] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:05:52 2022] GET /compute/v2.1/servers/c5d08f45-2b8e-4256-82c8-f369ebea0e1e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:05:52.274364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e5717ba-59a1-4d00-a572-65bd196936bd tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Action: 'create', calling method: .version_select at 0x7fda19185160>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1047921920", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCT9Tadzd4EYXDzWzo/tFsA8tgsGzKbJEib2a5vW0c3qvdR/1dsmrjgzrCrmAZOnNWDrbvQA/cnM0Pb2O77ygLDnp96pfpMxQz37msLJAPETEzkyKmlkouJaPLHdv6g2tg=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:05:52.289866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6e5717ba-59a1-4d00-a572-65bd196936bd tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for project eb3af7529f52488f978ab296d9d4bf65. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:05:52.295068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6e5717ba-59a1-4d00-a572-65bd196936bd tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for user 5a1c61d68e1a479bb0dc096271f4cbde and project eb3af7529f52488f978ab296d9d4bf65. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:05:52.308498 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6e5717ba-59a1-4d00-a572-65bd196936bd tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [691f8a8c-7df7-497f-bde1-33a440ea6a9b] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:05:53.315554 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [None req-6e5717ba-59a1-4d00-a572-65bd196936bd tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [691f8a8c-7df7-497f-bde1-33a440ea6a9b] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 35566. Oct 11 05:05:53.417633 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e5717ba-59a1-4d00-a572-65bd196936bd tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 1.147396 Oct 11 05:05:53.418248 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3709/7181] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:05:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:06:23.141970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1728341875", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1047921920", "security_groups": [{"name": "tempest-secgroup-smoke-1075802136"}], "block_device_mapping_v2": [{"uuid": "e7ebc77b-18db-45de-b1b4-8e9c2fde1600", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:06:23.153714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=13 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:06:23.154548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=25 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:06:23.316638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] validate_networks() for [('dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:06:23.682168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:06:23.682616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:06:23.683088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:06:23.683633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:06:23.684102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:06:23.693487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:23.693957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:23.694425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:23.695138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:23.695585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:23.696007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:23.712273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:06:23.717474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for user 5a1c61d68e1a479bb0dc096271f4cbde and project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:06:23.774976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:06:23.777093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7ebc77b-18db-45de-b1b4-8e9c2fde1600',volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:06:24.184599 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c9f8285b-8f16-4b2d-8064-52802aadb295 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.046792 Oct 11 05:06:24.185596 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3473/7182] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:06:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1048 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:06:24.194766 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:06:24.195269 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:06:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 (ip 10.222.0.26) !!! Oct 11 05:06:24.196361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=30 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:06:24.197187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:06:24.197813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:06:24.208657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d50b53c2-7bee-4e5e-9d62-7586a9cb3070 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:24.208657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d50b53c2-7bee-4e5e-9d62-7586a9cb3070 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:24.329096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d50b53c2-7bee-4e5e-9d62-7586a9cb3070 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:24.337104 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d50b53c2-7bee-4e5e-9d62-7586a9cb3070 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1095 microversion: 2.1 time: 0.144459 Oct 11 05:06:24.337666 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3710/7183] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:24 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1095 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:06:25.361735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-28ff9930-b455-4668-8b38-dd4ea46aea17 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:25.362396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-28ff9930-b455-4668-8b38-dd4ea46aea17 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:25.368687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28ff9930-b455-4668-8b38-dd4ea46aea17 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:25.369164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28ff9930-b455-4668-8b38-dd4ea46aea17 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:25.369596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28ff9930-b455-4668-8b38-dd4ea46aea17 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:25.370313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28ff9930-b455-4668-8b38-dd4ea46aea17 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:25.370768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28ff9930-b455-4668-8b38-dd4ea46aea17 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:25.371250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28ff9930-b455-4668-8b38-dd4ea46aea17 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:25.434763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-28ff9930-b455-4668-8b38-dd4ea46aea17 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:25.443384 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-28ff9930-b455-4668-8b38-dd4ea46aea17 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1137 microversion: 2.1 time: 0.086468 Oct 11 05:06:25.444081 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3474/7184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:25 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1137 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:26.467677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-47a40140-e766-40ae-8c75-e31d68598e8c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:26.468471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-47a40140-e766-40ae-8c75-e31d68598e8c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:26.476216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a40140-e766-40ae-8c75-e31d68598e8c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:26.476834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a40140-e766-40ae-8c75-e31d68598e8c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:26.477498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a40140-e766-40ae-8c75-e31d68598e8c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:26.479176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a40140-e766-40ae-8c75-e31d68598e8c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:26.479807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a40140-e766-40ae-8c75-e31d68598e8c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:26.480214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a40140-e766-40ae-8c75-e31d68598e8c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:26.555558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-47a40140-e766-40ae-8c75-e31d68598e8c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:26.563840 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-47a40140-e766-40ae-8c75-e31d68598e8c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1211 microversion: 2.1 time: 0.100272 Oct 11 05:06:26.564679 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3711/7185] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:26 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1211 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:27.587960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e9ddfb8-631b-4152-adbe-f802a662bdbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:27.588571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9e9ddfb8-631b-4152-adbe-f802a662bdbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:27.595731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfb8-631b-4152-adbe-f802a662bdbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:27.596218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfb8-631b-4152-adbe-f802a662bdbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:27.597196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfb8-631b-4152-adbe-f802a662bdbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:27.598017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfb8-631b-4152-adbe-f802a662bdbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:27.598749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfb8-631b-4152-adbe-f802a662bdbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:27.602279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e9ddfb8-631b-4152-adbe-f802a662bdbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:27.752843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9e9ddfb8-631b-4152-adbe-f802a662bdbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:27.761578 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9e9ddfb8-631b-4152-adbe-f802a662bdbb tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1279 microversion: 2.1 time: 0.177458 Oct 11 05:06:27.767946 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3475/7186] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:27 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1279 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:27.972631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b536aff2-0eed-4304-ace8-ef883c4ed6a9 req-8c9d1c10-9ce9-4adf-b497-1e4189c214b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d639ff-9924-43ba-9bd4-687cdad0c265", "tag": "38d7b78b-32b5-43f6-b50f-abb824e2b41c"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:06:27.982511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b536aff2-0eed-4304-ace8-ef883c4ed6a9 req-8c9d1c10-9ce9-4adf-b497-1e4189c214b4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:27.983006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b536aff2-0eed-4304-ace8-ef883c4ed6a9 req-8c9d1c10-9ce9-4adf-b497-1e4189c214b4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:27.984941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b536aff2-0eed-4304-ace8-ef883c4ed6a9 req-8c9d1c10-9ce9-4adf-b497-1e4189c214b4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:27.995455 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b536aff2-0eed-4304-ace8-ef883c4ed6a9 req-8c9d1c10-9ce9-4adf-b497-1e4189c214b4 service nova] Creating event network-changed:38d7b78b-32b5-43f6-b50f-abb824e2b41c for instance 19d639ff-9924-43ba-9bd4-687cdad0c265 on n-h1-860892-1 Oct 11 05:06:28.000871 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b536aff2-0eed-4304-ace8-ef883c4ed6a9 req-8c9d1c10-9ce9-4adf-b497-1e4189c214b4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032401 Oct 11 05:06:28.001471 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3712/7187] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:06:28.785317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dd287c52-450b-45c2-b804-1581347955e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:28.786050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dd287c52-450b-45c2-b804-1581347955e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:28.793078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd287c52-450b-45c2-b804-1581347955e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:28.793655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd287c52-450b-45c2-b804-1581347955e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:28.794166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd287c52-450b-45c2-b804-1581347955e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:28.794978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd287c52-450b-45c2-b804-1581347955e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:28.795437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd287c52-450b-45c2-b804-1581347955e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:28.795863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd287c52-450b-45c2-b804-1581347955e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:28.933418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dd287c52-450b-45c2-b804-1581347955e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:28.941393 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dd287c52-450b-45c2-b804-1581347955e8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1279 microversion: 2.1 time: 0.161064 Oct 11 05:06:28.942072 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3476/7188] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:28 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:29.966420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-941f531d-5813-412e-a5eb-992726270313 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:29.968028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-941f531d-5813-412e-a5eb-992726270313 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:29.974792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-941f531d-5813-412e-a5eb-992726270313 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:29.975283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-941f531d-5813-412e-a5eb-992726270313 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:29.975727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-941f531d-5813-412e-a5eb-992726270313 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:29.976420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-941f531d-5813-412e-a5eb-992726270313 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:29.976883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-941f531d-5813-412e-a5eb-992726270313 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:29.977318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-941f531d-5813-412e-a5eb-992726270313 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:30.115892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-941f531d-5813-412e-a5eb-992726270313 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:30.123839 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-941f531d-5813-412e-a5eb-992726270313 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1279 microversion: 2.1 time: 0.162596 Oct 11 05:06:30.124441 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3713/7189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:29 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:31.147147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-19833d57-5853-4972-ad5b-24b859a4b1a7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:31.147763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-19833d57-5853-4972-ad5b-24b859a4b1a7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:31.154784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19833d57-5853-4972-ad5b-24b859a4b1a7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:31.155276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19833d57-5853-4972-ad5b-24b859a4b1a7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:31.155712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19833d57-5853-4972-ad5b-24b859a4b1a7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:31.156399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19833d57-5853-4972-ad5b-24b859a4b1a7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:31.156847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19833d57-5853-4972-ad5b-24b859a4b1a7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:31.157266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19833d57-5853-4972-ad5b-24b859a4b1a7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:31.287794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-19833d57-5853-4972-ad5b-24b859a4b1a7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:31.295682 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-19833d57-5853-4972-ad5b-24b859a4b1a7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1279 microversion: 2.1 time: 0.152415 Oct 11 05:06:31.296256 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3477/7190] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:31 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1279 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:32.319532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f9b6c06d-9c98-4b7f-b27f-64389699b7b4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:32.320185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f9b6c06d-9c98-4b7f-b27f-64389699b7b4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:32.327093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9b6c06d-9c98-4b7f-b27f-64389699b7b4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:32.332844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9b6c06d-9c98-4b7f-b27f-64389699b7b4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:32.332844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9b6c06d-9c98-4b7f-b27f-64389699b7b4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:32.332844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9b6c06d-9c98-4b7f-b27f-64389699b7b4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:32.332844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9b6c06d-9c98-4b7f-b27f-64389699b7b4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:32.332844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9b6c06d-9c98-4b7f-b27f-64389699b7b4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:32.459636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f9b6c06d-9c98-4b7f-b27f-64389699b7b4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:32.467276 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f9b6c06d-9c98-4b7f-b27f-64389699b7b4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1267 microversion: 2.1 time: 0.152268 Oct 11 05:06:32.467845 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3714/7191] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:32 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:33.490171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-10ca3aa9-c3d6-4fe6-a727-2fe37d4551f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:33.490799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-10ca3aa9-c3d6-4fe6-a727-2fe37d4551f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:33.497631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ca3aa9-c3d6-4fe6-a727-2fe37d4551f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:33.498105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ca3aa9-c3d6-4fe6-a727-2fe37d4551f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:33.498570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ca3aa9-c3d6-4fe6-a727-2fe37d4551f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:33.499252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ca3aa9-c3d6-4fe6-a727-2fe37d4551f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:33.499702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ca3aa9-c3d6-4fe6-a727-2fe37d4551f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:33.500123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-10ca3aa9-c3d6-4fe6-a727-2fe37d4551f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:33.632147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-10ca3aa9-c3d6-4fe6-a727-2fe37d4551f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:33.640022 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-10ca3aa9-c3d6-4fe6-a727-2fe37d4551f7 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1267 microversion: 2.1 time: 0.153840 Oct 11 05:06:33.640586 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3478/7192] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:33 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:34.663787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-47a167e8-898d-4cc7-bca0-f6da8867f839 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:34.664355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-47a167e8-898d-4cc7-bca0-f6da8867f839 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:34.667296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:06:34.672168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a167e8-898d-4cc7-bca0-f6da8867f839 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:34.677132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a167e8-898d-4cc7-bca0-f6da8867f839 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:34.677132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a167e8-898d-4cc7-bca0-f6da8867f839 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:34.677132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a167e8-898d-4cc7-bca0-f6da8867f839 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:34.677132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a167e8-898d-4cc7-bca0-f6da8867f839 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:34.677132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-47a167e8-898d-4cc7-bca0-f6da8867f839 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:34.809631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-47a167e8-898d-4cc7-bca0-f6da8867f839 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:34.817450 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-47a167e8-898d-4cc7-bca0-f6da8867f839 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1267 microversion: 2.1 time: 0.158170 Oct 11 05:06:34.818045 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3715/7193] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:34 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:35.840115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0208183a-bbbc-4c90-881f-ec58eb244314 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:35.840715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0208183a-bbbc-4c90-881f-ec58eb244314 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:35.842614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:06:35.843272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:06:35.849002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0208183a-bbbc-4c90-881f-ec58eb244314 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:35.849476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0208183a-bbbc-4c90-881f-ec58eb244314 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:35.849906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0208183a-bbbc-4c90-881f-ec58eb244314 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:35.850621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0208183a-bbbc-4c90-881f-ec58eb244314 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:35.851069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0208183a-bbbc-4c90-881f-ec58eb244314 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:35.851490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0208183a-bbbc-4c90-881f-ec58eb244314 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:35.982492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0208183a-bbbc-4c90-881f-ec58eb244314 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:35.990248 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0208183a-bbbc-4c90-881f-ec58eb244314 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1267 microversion: 2.1 time: 0.154045 Oct 11 05:06:35.990827 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3479/7194] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:35 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:37.013204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-880796da-499f-4010-9e03-e54183a1f853 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:37.013838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-880796da-499f-4010-9e03-e54183a1f853 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:37.020832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-880796da-499f-4010-9e03-e54183a1f853 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:37.021331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-880796da-499f-4010-9e03-e54183a1f853 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:37.021789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-880796da-499f-4010-9e03-e54183a1f853 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:37.022529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-880796da-499f-4010-9e03-e54183a1f853 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:37.023001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-880796da-499f-4010-9e03-e54183a1f853 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:37.023445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-880796da-499f-4010-9e03-e54183a1f853 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:37.152360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-880796da-499f-4010-9e03-e54183a1f853 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:37.160066 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-880796da-499f-4010-9e03-e54183a1f853 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1267 microversion: 2.1 time: 0.151075 Oct 11 05:06:37.160645 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3716/7195] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:37 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:38.182935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c502aad-7320-4eb7-929a-b4207a238eb6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:38.183544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5c502aad-7320-4eb7-929a-b4207a238eb6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:38.189957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c502aad-7320-4eb7-929a-b4207a238eb6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:38.190466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c502aad-7320-4eb7-929a-b4207a238eb6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:38.190902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c502aad-7320-4eb7-929a-b4207a238eb6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:38.191578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c502aad-7320-4eb7-929a-b4207a238eb6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:38.192546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c502aad-7320-4eb7-929a-b4207a238eb6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:38.192965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c502aad-7320-4eb7-929a-b4207a238eb6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:38.322393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5c502aad-7320-4eb7-929a-b4207a238eb6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:38.330058 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5c502aad-7320-4eb7-929a-b4207a238eb6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1267 microversion: 2.1 time: 0.151211 Oct 11 05:06:38.332174 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3480/7196] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:38 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:39.354020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b8d7f5d-ebdb-4a8e-95f2-71db3e52ff99 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:39.354672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b8d7f5d-ebdb-4a8e-95f2-71db3e52ff99 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:39.361698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b8d7f5d-ebdb-4a8e-95f2-71db3e52ff99 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:39.362206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b8d7f5d-ebdb-4a8e-95f2-71db3e52ff99 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:39.362657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b8d7f5d-ebdb-4a8e-95f2-71db3e52ff99 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:39.363350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b8d7f5d-ebdb-4a8e-95f2-71db3e52ff99 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:39.363817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b8d7f5d-ebdb-4a8e-95f2-71db3e52ff99 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:39.364250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b8d7f5d-ebdb-4a8e-95f2-71db3e52ff99 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:39.497638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b8d7f5d-ebdb-4a8e-95f2-71db3e52ff99 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:39.505323 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b8d7f5d-ebdb-4a8e-95f2-71db3e52ff99 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1267 microversion: 2.1 time: 0.155346 Oct 11 05:06:39.505892 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3717/7197] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:39 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:40.528414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-86390eb4-0f1e-4d42-bd97-3e494c08df3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:40.529030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-86390eb4-0f1e-4d42-bd97-3e494c08df3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:40.536366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86390eb4-0f1e-4d42-bd97-3e494c08df3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:40.536839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86390eb4-0f1e-4d42-bd97-3e494c08df3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:40.537270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86390eb4-0f1e-4d42-bd97-3e494c08df3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:40.537945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86390eb4-0f1e-4d42-bd97-3e494c08df3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:40.538423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86390eb4-0f1e-4d42-bd97-3e494c08df3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:40.538845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86390eb4-0f1e-4d42-bd97-3e494c08df3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:40.673855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-86390eb4-0f1e-4d42-bd97-3e494c08df3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:40.678451 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-86390eb4-0f1e-4d42-bd97-3e494c08df3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1267 microversion: 2.1 time: 0.153929 Oct 11 05:06:40.679020 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3481/7198] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:40 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:41.700879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef3e7d78-d6d7-4b68-9e94-b23d896f26c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:41.701513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef3e7d78-d6d7-4b68-9e94-b23d896f26c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:41.708951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3e7d78-d6d7-4b68-9e94-b23d896f26c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:41.709444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3e7d78-d6d7-4b68-9e94-b23d896f26c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:41.709899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3e7d78-d6d7-4b68-9e94-b23d896f26c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:41.710644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3e7d78-d6d7-4b68-9e94-b23d896f26c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:41.711109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3e7d78-d6d7-4b68-9e94-b23d896f26c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:41.711550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef3e7d78-d6d7-4b68-9e94-b23d896f26c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:41.841967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef3e7d78-d6d7-4b68-9e94-b23d896f26c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:41.849799 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef3e7d78-d6d7-4b68-9e94-b23d896f26c4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1267 microversion: 2.1 time: 0.152802 Oct 11 05:06:41.850410 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3718/7199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:41 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:42.872361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9bfe1237-fa78-4bfe-9074-4abd616822ac tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:42.872984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9bfe1237-fa78-4bfe-9074-4abd616822ac tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:42.879901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bfe1237-fa78-4bfe-9074-4abd616822ac tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:42.880388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bfe1237-fa78-4bfe-9074-4abd616822ac tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:42.880967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bfe1237-fa78-4bfe-9074-4abd616822ac tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:42.881692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bfe1237-fa78-4bfe-9074-4abd616822ac tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:42.882150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bfe1237-fa78-4bfe-9074-4abd616822ac tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:42.882607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9bfe1237-fa78-4bfe-9074-4abd616822ac tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:43.023996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9bfe1237-fa78-4bfe-9074-4abd616822ac tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:43.032289 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9bfe1237-fa78-4bfe-9074-4abd616822ac tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1267 microversion: 2.1 time: 0.163888 Oct 11 05:06:43.032865 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3482/7200] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:42 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:43.077169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-fb21fb63-0b40-46ca-97ef-2bee280800ff req-651bd0d6-4376-4cd5-b9f7-a7133ac4db3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d639ff-9924-43ba-9bd4-687cdad0c265", "name": "network-vif-plugged", "status": "completed", "tag": "38d7b78b-32b5-43f6-b50f-abb824e2b41c"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:06:43.087232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb21fb63-0b40-46ca-97ef-2bee280800ff req-651bd0d6-4376-4cd5-b9f7-a7133ac4db3e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:43.087751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb21fb63-0b40-46ca-97ef-2bee280800ff req-651bd0d6-4376-4cd5-b9f7-a7133ac4db3e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:43.088198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb21fb63-0b40-46ca-97ef-2bee280800ff req-651bd0d6-4376-4cd5-b9f7-a7133ac4db3e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:43.103607 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-fb21fb63-0b40-46ca-97ef-2bee280800ff req-651bd0d6-4376-4cd5-b9f7-a7133ac4db3e service nova] Creating event network-vif-plugged:38d7b78b-32b5-43f6-b50f-abb824e2b41c for instance 19d639ff-9924-43ba-9bd4-687cdad0c265 on n-h1-860892-1 Oct 11 05:06:43.108627 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-fb21fb63-0b40-46ca-97ef-2bee280800ff req-651bd0d6-4376-4cd5-b9f7-a7133ac4db3e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098485 Oct 11 05:06:43.117096 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3719/7201] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:06:44.055216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09dff6f2-d0a2-417e-8e7f-539fe929c80f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:44.055802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09dff6f2-d0a2-417e-8e7f-539fe929c80f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:44.062622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dff6f2-d0a2-417e-8e7f-539fe929c80f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:44.063099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dff6f2-d0a2-417e-8e7f-539fe929c80f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:44.063538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dff6f2-d0a2-417e-8e7f-539fe929c80f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:44.064218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dff6f2-d0a2-417e-8e7f-539fe929c80f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:44.065044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dff6f2-d0a2-417e-8e7f-539fe929c80f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:44.065497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dff6f2-d0a2-417e-8e7f-539fe929c80f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:44.202474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09dff6f2-d0a2-417e-8e7f-539fe929c80f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:44.210242 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09dff6f2-d0a2-417e-8e7f-539fe929c80f tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1267 microversion: 2.1 time: 0.159423 Oct 11 05:06:44.210803 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3483/7202] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:44 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:45.235016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d40de83f-51c7-4096-bb06-519f26510fd3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:45.235754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d40de83f-51c7-4096-bb06-519f26510fd3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:45.242483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d40de83f-51c7-4096-bb06-519f26510fd3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:45.242994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d40de83f-51c7-4096-bb06-519f26510fd3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:45.243440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d40de83f-51c7-4096-bb06-519f26510fd3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:45.244137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d40de83f-51c7-4096-bb06-519f26510fd3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:45.244661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d40de83f-51c7-4096-bb06-519f26510fd3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:45.245075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d40de83f-51c7-4096-bb06-519f26510fd3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:45.379289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d40de83f-51c7-4096-bb06-519f26510fd3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:45.387833 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d40de83f-51c7-4096-bb06-519f26510fd3 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1453 microversion: 2.1 time: 0.158105 Oct 11 05:06:45.388407 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3720/7203] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:45 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1453 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:45.410381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-469f45df-fe7d-4e73-baec-613403667b2e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:06:45.410994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-469f45df-fe7d-4e73-baec-613403667b2e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:06:45.417778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-469f45df-fe7d-4e73-baec-613403667b2e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:45.418294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-469f45df-fe7d-4e73-baec-613403667b2e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:45.418732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-469f45df-fe7d-4e73-baec-613403667b2e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:45.419411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-469f45df-fe7d-4e73-baec-613403667b2e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:45.419859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-469f45df-fe7d-4e73-baec-613403667b2e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:45.420280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-469f45df-fe7d-4e73-baec-613403667b2e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:45.553632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-469f45df-fe7d-4e73-baec-613403667b2e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:06:45.560685 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-469f45df-fe7d-4e73-baec-613403667b2e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1453 microversion: 2.1 time: 0.154635 Oct 11 05:06:45.561287 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3484/7204] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:06:45 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:06:47.618660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7088654c-b6d4-4c42-b3fa-1e133e38cf87 req-ff67eea6-da1e-4035-868c-7b1bf4e9e0ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19d639ff-9924-43ba-9bd4-687cdad0c265", "tag": "38d7b78b-32b5-43f6-b50f-abb824e2b41c"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:06:47.628693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7088654c-b6d4-4c42-b3fa-1e133e38cf87 req-ff67eea6-da1e-4035-868c-7b1bf4e9e0ff service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:06:47.629267 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7088654c-b6d4-4c42-b3fa-1e133e38cf87 req-ff67eea6-da1e-4035-868c-7b1bf4e9e0ff service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:06:47.629822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7088654c-b6d4-4c42-b3fa-1e133e38cf87 req-ff67eea6-da1e-4035-868c-7b1bf4e9e0ff service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:06:47.641890 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7088654c-b6d4-4c42-b3fa-1e133e38cf87 req-ff67eea6-da1e-4035-868c-7b1bf4e9e0ff service nova] Creating event network-changed:38d7b78b-32b5-43f6-b50f-abb824e2b41c for instance 19d639ff-9924-43ba-9bd4-687cdad0c265 on n-h1-860892-1 Oct 11 05:06:47.647493 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7088654c-b6d4-4c42-b3fa-1e133e38cf87 req-ff67eea6-da1e-4035-868c-7b1bf4e9e0ff service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033288 Oct 11 05:06:47.648330 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3721/7205] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:09:14.247141 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 05:09:14.248116 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 05:09:14.248960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:09:14.249773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=68 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:09:14.250536 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:09:14.250677 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:09:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 (ip 10.222.0.26) !!! Oct 11 05:09:14.252491 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:09:14.252618 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:09:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 (ip 10.222.0.26) !!! Oct 11 05:09:14.254631 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:09:14.260768 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:09:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 (ip 10.222.0.26) !!! Oct 11 05:09:14.260768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-832784de-19dd-4b77-81b2-1012aeeae254 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:14.260768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-832784de-19dd-4b77-81b2-1012aeeae254 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:14.278431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-832784de-19dd-4b77-81b2-1012aeeae254 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:14.279066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-832784de-19dd-4b77-81b2-1012aeeae254 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:14.279397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-832784de-19dd-4b77-81b2-1012aeeae254 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:14.280112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-832784de-19dd-4b77-81b2-1012aeeae254 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:14.280584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-832784de-19dd-4b77-81b2-1012aeeae254 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:14.281004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-832784de-19dd-4b77-81b2-1012aeeae254 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:14.306083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-832784de-19dd-4b77-81b2-1012aeeae254 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:09:14.676124 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-832784de-19dd-4b77-81b2-1012aeeae254 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 204 len: 0 microversion: 2.1 time: 0.431805 Oct 11 05:09:14.676758 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3485/7206] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:09:14 2022] DELETE /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:09:14.683580 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:09:14.684797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=26 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:09:14.685548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=54 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:09:14.686800 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:09:14.686941 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:09:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 (ip 10.222.0.26) !!! Oct 11 05:09:14.692452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-71758e7b-ecb1-492b-8d4a-29ce5c58cbe1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:14.697571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-71758e7b-ecb1-492b-8d4a-29ce5c58cbe1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:14.700094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71758e7b-ecb1-492b-8d4a-29ce5c58cbe1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:14.700584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71758e7b-ecb1-492b-8d4a-29ce5c58cbe1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:14.701031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71758e7b-ecb1-492b-8d4a-29ce5c58cbe1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:14.701820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71758e7b-ecb1-492b-8d4a-29ce5c58cbe1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:14.702306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71758e7b-ecb1-492b-8d4a-29ce5c58cbe1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:14.702745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-71758e7b-ecb1-492b-8d4a-29ce5c58cbe1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:15.054181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-71758e7b-ecb1-492b-8d4a-29ce5c58cbe1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:15.062740 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-71758e7b-ecb1-492b-8d4a-29ce5c58cbe1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1577 microversion: 2.1 time: 0.381592 Oct 11 05:09:15.063386 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3722/7207] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:14 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1577 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:16.086916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f8d63c0-e20c-423c-afbc-f6f87844c8ea tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:16.087612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f8d63c0-e20c-423c-afbc-f6f87844c8ea tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:16.097318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f8d63c0-e20c-423c-afbc-f6f87844c8ea tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:16.097796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f8d63c0-e20c-423c-afbc-f6f87844c8ea tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:16.098261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f8d63c0-e20c-423c-afbc-f6f87844c8ea tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:16.098977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f8d63c0-e20c-423c-afbc-f6f87844c8ea tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:16.099430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f8d63c0-e20c-423c-afbc-f6f87844c8ea tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:16.099851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f8d63c0-e20c-423c-afbc-f6f87844c8ea tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:16.109200 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 35886. Oct 11 05:09:16.121442 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 35884. Oct 11 05:09:16.358772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0f8d63c0-e20c-423c-afbc-f6f87844c8ea tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:16.366553 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f8d63c0-e20c-423c-afbc-f6f87844c8ea tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1577 microversion: 2.1 time: 0.283944 Oct 11 05:09:16.367123 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3486/7208] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:16 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1577 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:17.390736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f255a22-b25a-4e59-8e91-1ba20d865be8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:17.391262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f255a22-b25a-4e59-8e91-1ba20d865be8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:17.399517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f255a22-b25a-4e59-8e91-1ba20d865be8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:17.400019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f255a22-b25a-4e59-8e91-1ba20d865be8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:17.400463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f255a22-b25a-4e59-8e91-1ba20d865be8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:17.401404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f255a22-b25a-4e59-8e91-1ba20d865be8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:17.401869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f255a22-b25a-4e59-8e91-1ba20d865be8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:17.402334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f255a22-b25a-4e59-8e91-1ba20d865be8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:17.420002 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 35898. Oct 11 05:09:17.499859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f255a22-b25a-4e59-8e91-1ba20d865be8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:17.513193 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f255a22-b25a-4e59-8e91-1ba20d865be8 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1509 microversion: 2.1 time: 0.125654 Oct 11 05:09:17.514621 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3723/7209] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:17 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1509 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:17.584702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ae88fcc3-0523-429c-9c05-186ea9b65cba req-f6ec5406-37ad-4931-91a1-0a6f5ecf04f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19d639ff-9924-43ba-9bd4-687cdad0c265", "name": "network-vif-deleted", "tag": "38d7b78b-32b5-43f6-b50f-abb824e2b41c"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:09:17.595019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ae88fcc3-0523-429c-9c05-186ea9b65cba req-f6ec5406-37ad-4931-91a1-0a6f5ecf04f4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:17.595503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ae88fcc3-0523-429c-9c05-186ea9b65cba req-f6ec5406-37ad-4931-91a1-0a6f5ecf04f4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:17.595942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ae88fcc3-0523-429c-9c05-186ea9b65cba req-f6ec5406-37ad-4931-91a1-0a6f5ecf04f4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:17.608875 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ae88fcc3-0523-429c-9c05-186ea9b65cba req-f6ec5406-37ad-4931-91a1-0a6f5ecf04f4 service nova] Creating event network-vif-deleted:38d7b78b-32b5-43f6-b50f-abb824e2b41c for instance 19d639ff-9924-43ba-9bd4-687cdad0c265 on n-h1-860892-1 Oct 11 05:09:17.614271 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ae88fcc3-0523-429c-9c05-186ea9b65cba req-f6ec5406-37ad-4931-91a1-0a6f5ecf04f4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121410 Oct 11 05:09:17.618441 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3487/7210] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:09:18.537131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56ed34e5-0779-4566-a9fc-962936ff0da4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:18.537768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-56ed34e5-0779-4566-a9fc-962936ff0da4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:18.545454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56ed34e5-0779-4566-a9fc-962936ff0da4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:18.545958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56ed34e5-0779-4566-a9fc-962936ff0da4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:18.546459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56ed34e5-0779-4566-a9fc-962936ff0da4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:18.547215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56ed34e5-0779-4566-a9fc-962936ff0da4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:18.547689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56ed34e5-0779-4566-a9fc-962936ff0da4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:18.548130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56ed34e5-0779-4566-a9fc-962936ff0da4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:18.617045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-56ed34e5-0779-4566-a9fc-962936ff0da4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:18.626868 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-56ed34e5-0779-4566-a9fc-962936ff0da4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1226 microversion: 2.1 time: 0.093652 Oct 11 05:09:18.628171 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3724/7211] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:18 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:19.651481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6dcf9b1f-ba92-4910-99ea-cb91b2ef47bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:19.652312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6dcf9b1f-ba92-4910-99ea-cb91b2ef47bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:19.660091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dcf9b1f-ba92-4910-99ea-cb91b2ef47bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:19.660754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dcf9b1f-ba92-4910-99ea-cb91b2ef47bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:19.661336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dcf9b1f-ba92-4910-99ea-cb91b2ef47bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:19.662770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dcf9b1f-ba92-4910-99ea-cb91b2ef47bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:19.663315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dcf9b1f-ba92-4910-99ea-cb91b2ef47bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:19.663758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dcf9b1f-ba92-4910-99ea-cb91b2ef47bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:19.735064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6dcf9b1f-ba92-4910-99ea-cb91b2ef47bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:19.743183 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6dcf9b1f-ba92-4910-99ea-cb91b2ef47bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1226 microversion: 2.1 time: 0.096058 Oct 11 05:09:19.743852 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3488/7212] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:19 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1226 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:20.766935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0f811aea-e078-493c-b519-fd1fec605a55 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:20.767551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0f811aea-e078-493c-b519-fd1fec605a55 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:20.774563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f811aea-e078-493c-b519-fd1fec605a55 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:20.774998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f811aea-e078-493c-b519-fd1fec605a55 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:20.775446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f811aea-e078-493c-b519-fd1fec605a55 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:20.776139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f811aea-e078-493c-b519-fd1fec605a55 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:20.776602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f811aea-e078-493c-b519-fd1fec605a55 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:20.777034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f811aea-e078-493c-b519-fd1fec605a55 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:20.843386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0f811aea-e078-493c-b519-fd1fec605a55 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:20.851871 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0f811aea-e078-493c-b519-fd1fec605a55 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1226 microversion: 2.1 time: 0.088729 Oct 11 05:09:20.852473 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3725/7213] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:20 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:21.874887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:21.875498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:21.882422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:21.882908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:21.883346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:21.884037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:21.884488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:21.884911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:21.916758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:21.917234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:21.917667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:21.918114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lazy-loading 'fault' on Instance uuid 19d639ff-9924-43ba-9bd4-687cdad0c265 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:09:21.959843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:21.967833 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-05a0058d-ee59-4081-86b9-b50d0d30dabe tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 200 len: 1231 microversion: 2.1 time: 0.097376 Oct 11 05:09:21.968389 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3489/7214] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:21 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 1231 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:22.991157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:22.991745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:22.998597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:22.999093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:22.999543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:23.000238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:23.000706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:23.001145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:23.017976 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 HTTP/1.1 Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '19d639ff-9924-43ba-9bd4-687cdad0c265'} Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:09:23.019670 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:09:23.023886 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:09:23.023886 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:09:23.023886 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:09:23.023886 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:09:23.023886 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:09:23.023886 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:09:23.023886 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:09:23.023886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:09:23.023886 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7d75dbc3-6a0b-4bbe-ab34-016a31fbc7c5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 404 len: 111 microversion: 2.1 time: 0.033977 Oct 11 05:09:23.023886 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3726/7215] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:22 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:09:23.070304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2086435696", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1047921920", "security_groups": [{"name": "tempest-secgroup-smoke-1075802136"}], "block_device_mapping_v2": [{"uuid": "e7ebc77b-18db-45de-b1b4-8e9c2fde1600", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:09:23.184485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] validate_networks() for [('dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:09:23.640745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:09:23.641170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:09:23.641642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:09:23.642066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:09:23.642485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:09:23.651133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:23.651612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:23.652038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:23.652748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:23.653194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:23.653612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:23.670292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:09:23.675539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for user 5a1c61d68e1a479bb0dc096271f4cbde and project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:09:23.733029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:09:23.735178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e7ebc77b-18db-45de-b1b4-8e9c2fde1600',volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:09:24.129662 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4c9d6022-f2e2-4d34-bb28-259039754802 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.063264 Oct 11 05:09:24.130689 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3490/7216] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:09:23 2022] POST /compute/v2.1/servers => generated 406 bytes in 1065 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:09:24.141948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7c1535f1-fb41-4b6a-9db1-8c85aac33537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:24.142761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7c1535f1-fb41-4b6a-9db1-8c85aac33537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:24.198790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7c1535f1-fb41-4b6a-9db1-8c85aac33537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:24.207298 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7c1535f1-fb41-4b6a-9db1-8c85aac33537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1095 microversion: 2.1 time: 0.069238 Oct 11 05:09:24.207861 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3727/7217] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:24 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:25.231082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ecd7dbcf-b8dd-4916-b401-89e60d77951c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:25.231702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ecd7dbcf-b8dd-4916-b401-89e60d77951c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:25.238736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd7dbcf-b8dd-4916-b401-89e60d77951c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:25.239228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd7dbcf-b8dd-4916-b401-89e60d77951c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:25.239678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd7dbcf-b8dd-4916-b401-89e60d77951c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:25.240368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd7dbcf-b8dd-4916-b401-89e60d77951c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:25.240823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd7dbcf-b8dd-4916-b401-89e60d77951c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:25.241250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecd7dbcf-b8dd-4916-b401-89e60d77951c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:25.303190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ecd7dbcf-b8dd-4916-b401-89e60d77951c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:25.311576 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ecd7dbcf-b8dd-4916-b401-89e60d77951c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1145 microversion: 2.1 time: 0.085102 Oct 11 05:09:25.312147 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3491/7218] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:25 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1145 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:26.334613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e4c41b51-376e-4041-a505-b1bac50b4cda tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:26.335268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e4c41b51-376e-4041-a505-b1bac50b4cda tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:26.342294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4c41b51-376e-4041-a505-b1bac50b4cda tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:26.342801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4c41b51-376e-4041-a505-b1bac50b4cda tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:26.343254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4c41b51-376e-4041-a505-b1bac50b4cda tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:26.343961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4c41b51-376e-4041-a505-b1bac50b4cda tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:26.344435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4c41b51-376e-4041-a505-b1bac50b4cda tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:26.344880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4c41b51-376e-4041-a505-b1bac50b4cda tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:26.449060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e4c41b51-376e-4041-a505-b1bac50b4cda tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:26.457744 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e4c41b51-376e-4041-a505-b1bac50b4cda tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1211 microversion: 2.1 time: 0.127223 Oct 11 05:09:26.458486 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3728/7219] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:26 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1211 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:27.481374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-918b5d01-7018-4c46-904f-643daf8b1e3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:27.482126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-918b5d01-7018-4c46-904f-643daf8b1e3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:27.489819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-918b5d01-7018-4c46-904f-643daf8b1e3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:27.490525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-918b5d01-7018-4c46-904f-643daf8b1e3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:27.491037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-918b5d01-7018-4c46-904f-643daf8b1e3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:27.491821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-918b5d01-7018-4c46-904f-643daf8b1e3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:27.492530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-918b5d01-7018-4c46-904f-643daf8b1e3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:27.493063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-918b5d01-7018-4c46-904f-643daf8b1e3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:27.645434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-918b5d01-7018-4c46-904f-643daf8b1e3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:27.653802 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-918b5d01-7018-4c46-904f-643daf8b1e3b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1279 microversion: 2.1 time: 0.177016 Oct 11 05:09:27.654412 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3492/7220] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:27 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1279 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:28.027943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b23ebd64-19be-4f85-9a4c-303e42389b51 req-95d868aa-08c2-4603-974f-450503b7db04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119b35f6-1b21-40e6-84c5-484adf6f456a", "tag": "ffabf5f8-3fa3-42c3-92a9-751b5af20398"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:09:28.038408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b23ebd64-19be-4f85-9a4c-303e42389b51 req-95d868aa-08c2-4603-974f-450503b7db04 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:28.038933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b23ebd64-19be-4f85-9a4c-303e42389b51 req-95d868aa-08c2-4603-974f-450503b7db04 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:28.039382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b23ebd64-19be-4f85-9a4c-303e42389b51 req-95d868aa-08c2-4603-974f-450503b7db04 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:28.051005 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b23ebd64-19be-4f85-9a4c-303e42389b51 req-95d868aa-08c2-4603-974f-450503b7db04 service nova] Creating event network-changed:ffabf5f8-3fa3-42c3-92a9-751b5af20398 for instance 119b35f6-1b21-40e6-84c5-484adf6f456a on n-h1-860892-1 Oct 11 05:09:28.056191 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b23ebd64-19be-4f85-9a4c-303e42389b51 req-95d868aa-08c2-4603-974f-450503b7db04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032381 Oct 11 05:09:28.056834 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3729/7221] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:09:28.677503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ed8c0f6-095e-4f23-82eb-a3df5de01c27 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:28.678912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ed8c0f6-095e-4f23-82eb-a3df5de01c27 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:28.686885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ed8c0f6-095e-4f23-82eb-a3df5de01c27 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:28.687446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ed8c0f6-095e-4f23-82eb-a3df5de01c27 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:28.687894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ed8c0f6-095e-4f23-82eb-a3df5de01c27 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:28.688677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ed8c0f6-095e-4f23-82eb-a3df5de01c27 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:28.689139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ed8c0f6-095e-4f23-82eb-a3df5de01c27 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:28.689634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ed8c0f6-095e-4f23-82eb-a3df5de01c27 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:28.838082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ed8c0f6-095e-4f23-82eb-a3df5de01c27 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:28.847409 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ed8c0f6-095e-4f23-82eb-a3df5de01c27 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1279 microversion: 2.1 time: 0.174098 Oct 11 05:09:28.847996 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3493/7222] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:28 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1279 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:29.872780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fd810ecc-8ab3-4709-9450-486ca791aed1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:29.873495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fd810ecc-8ab3-4709-9450-486ca791aed1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:29.879776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd810ecc-8ab3-4709-9450-486ca791aed1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:29.880271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd810ecc-8ab3-4709-9450-486ca791aed1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:29.880721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd810ecc-8ab3-4709-9450-486ca791aed1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:29.881417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd810ecc-8ab3-4709-9450-486ca791aed1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:29.881885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd810ecc-8ab3-4709-9450-486ca791aed1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:29.882358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd810ecc-8ab3-4709-9450-486ca791aed1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:30.020313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fd810ecc-8ab3-4709-9450-486ca791aed1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:30.028144 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fd810ecc-8ab3-4709-9450-486ca791aed1 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1279 microversion: 2.1 time: 0.161031 Oct 11 05:09:30.028719 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3730/7223] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:29 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:31.050269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5cf082ca-e876-4184-b8fd-90446cfb44bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:31.050888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5cf082ca-e876-4184-b8fd-90446cfb44bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:31.057945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cf082ca-e876-4184-b8fd-90446cfb44bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:31.058465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cf082ca-e876-4184-b8fd-90446cfb44bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:31.059532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cf082ca-e876-4184-b8fd-90446cfb44bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:31.060228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cf082ca-e876-4184-b8fd-90446cfb44bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:31.060682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cf082ca-e876-4184-b8fd-90446cfb44bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:31.061146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5cf082ca-e876-4184-b8fd-90446cfb44bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:31.198994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5cf082ca-e876-4184-b8fd-90446cfb44bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:31.206791 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5cf082ca-e876-4184-b8fd-90446cfb44bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1279 microversion: 2.1 time: 0.160634 Oct 11 05:09:31.207379 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3494/7224] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:31 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1279 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:32.229085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4516b13b-2b54-4fe7-8f83-94e5a29fde7b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:32.229720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4516b13b-2b54-4fe7-8f83-94e5a29fde7b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:32.236736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4516b13b-2b54-4fe7-8f83-94e5a29fde7b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:32.237236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4516b13b-2b54-4fe7-8f83-94e5a29fde7b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:32.237691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4516b13b-2b54-4fe7-8f83-94e5a29fde7b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:32.239468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4516b13b-2b54-4fe7-8f83-94e5a29fde7b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:32.240061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4516b13b-2b54-4fe7-8f83-94e5a29fde7b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:32.240556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4516b13b-2b54-4fe7-8f83-94e5a29fde7b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:32.368885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4516b13b-2b54-4fe7-8f83-94e5a29fde7b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:32.377206 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4516b13b-2b54-4fe7-8f83-94e5a29fde7b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.152096 Oct 11 05:09:32.377793 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3731/7225] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:32 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:33.400621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ba0f543-90cd-4d99-a9e5-60e8e28eee7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:33.401232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ba0f543-90cd-4d99-a9e5-60e8e28eee7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:33.408661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba0f543-90cd-4d99-a9e5-60e8e28eee7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:33.409136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba0f543-90cd-4d99-a9e5-60e8e28eee7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:33.409569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba0f543-90cd-4d99-a9e5-60e8e28eee7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:33.410274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba0f543-90cd-4d99-a9e5-60e8e28eee7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:33.410722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba0f543-90cd-4d99-a9e5-60e8e28eee7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:33.411139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ba0f543-90cd-4d99-a9e5-60e8e28eee7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:33.543816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3ba0f543-90cd-4d99-a9e5-60e8e28eee7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:33.551653 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ba0f543-90cd-4d99-a9e5-60e8e28eee7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.154900 Oct 11 05:09:33.552223 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3495/7226] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:33 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:34.588120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48e4553f-9513-4dd7-a307-3a80f4eff28e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:34.588750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-48e4553f-9513-4dd7-a307-3a80f4eff28e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:34.592099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:09:34.597172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e4553f-9513-4dd7-a307-3a80f4eff28e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:34.597725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e4553f-9513-4dd7-a307-3a80f4eff28e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:34.598172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e4553f-9513-4dd7-a307-3a80f4eff28e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:34.598904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e4553f-9513-4dd7-a307-3a80f4eff28e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:34.599412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e4553f-9513-4dd7-a307-3a80f4eff28e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:34.599860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48e4553f-9513-4dd7-a307-3a80f4eff28e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:34.733321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48e4553f-9513-4dd7-a307-3a80f4eff28e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:34.741108 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48e4553f-9513-4dd7-a307-3a80f4eff28e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.156942 Oct 11 05:09:34.741673 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3732/7227] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:34 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:35.763998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ecbe9191-73a6-45b8-9036-f0e870e4e165 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:35.764606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ecbe9191-73a6-45b8-9036-f0e870e4e165 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:35.766643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:09:35.767305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:09:35.773041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecbe9191-73a6-45b8-9036-f0e870e4e165 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:35.773459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecbe9191-73a6-45b8-9036-f0e870e4e165 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:35.773914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecbe9191-73a6-45b8-9036-f0e870e4e165 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:35.774632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecbe9191-73a6-45b8-9036-f0e870e4e165 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:35.775079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecbe9191-73a6-45b8-9036-f0e870e4e165 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:35.775499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ecbe9191-73a6-45b8-9036-f0e870e4e165 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:35.907528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ecbe9191-73a6-45b8-9036-f0e870e4e165 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:35.915234 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ecbe9191-73a6-45b8-9036-f0e870e4e165 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.155598 Oct 11 05:09:35.915802 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3496/7228] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:35 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:36.939014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8bcffefd-3afe-42c3-a21d-1f014ec25d9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:36.939652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8bcffefd-3afe-42c3-a21d-1f014ec25d9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:36.946705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bcffefd-3afe-42c3-a21d-1f014ec25d9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:36.947208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bcffefd-3afe-42c3-a21d-1f014ec25d9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:36.947683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bcffefd-3afe-42c3-a21d-1f014ec25d9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:36.948392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bcffefd-3afe-42c3-a21d-1f014ec25d9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:36.948866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bcffefd-3afe-42c3-a21d-1f014ec25d9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:36.949314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bcffefd-3afe-42c3-a21d-1f014ec25d9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:37.081920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8bcffefd-3afe-42c3-a21d-1f014ec25d9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:37.089701 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8bcffefd-3afe-42c3-a21d-1f014ec25d9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.154629 Oct 11 05:09:37.090321 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3733/7229] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:36 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:38.112481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1f435af-4ee7-40c5-9748-09c0c8df14f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:38.113092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f1f435af-4ee7-40c5-9748-09c0c8df14f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:38.119944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f435af-4ee7-40c5-9748-09c0c8df14f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:38.120422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f435af-4ee7-40c5-9748-09c0c8df14f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:38.120858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f435af-4ee7-40c5-9748-09c0c8df14f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:38.122119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f435af-4ee7-40c5-9748-09c0c8df14f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:38.122595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f435af-4ee7-40c5-9748-09c0c8df14f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:38.123019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1f435af-4ee7-40c5-9748-09c0c8df14f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:38.256128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f1f435af-4ee7-40c5-9748-09c0c8df14f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:38.264695 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f1f435af-4ee7-40c5-9748-09c0c8df14f6 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.156139 Oct 11 05:09:38.265263 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3497/7230] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:38 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:39.286961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cdf430ec-87ba-4c6d-98d8-5594dadaaa51 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:39.287584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cdf430ec-87ba-4c6d-98d8-5594dadaaa51 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:39.294388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf430ec-87ba-4c6d-98d8-5594dadaaa51 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:39.294879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf430ec-87ba-4c6d-98d8-5594dadaaa51 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:39.295321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf430ec-87ba-4c6d-98d8-5594dadaaa51 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:39.296012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf430ec-87ba-4c6d-98d8-5594dadaaa51 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:39.296472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf430ec-87ba-4c6d-98d8-5594dadaaa51 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:39.296905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cdf430ec-87ba-4c6d-98d8-5594dadaaa51 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:39.425132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cdf430ec-87ba-4c6d-98d8-5594dadaaa51 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:39.433032 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cdf430ec-87ba-4c6d-98d8-5594dadaaa51 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.149984 Oct 11 05:09:39.433593 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3734/7231] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:39 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:40.455785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fc2e17fa-016a-43f0-ad78-6701632b7c5a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:40.456427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fc2e17fa-016a-43f0-ad78-6701632b7c5a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:40.463286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc2e17fa-016a-43f0-ad78-6701632b7c5a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:40.463775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc2e17fa-016a-43f0-ad78-6701632b7c5a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:40.464206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc2e17fa-016a-43f0-ad78-6701632b7c5a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:40.464886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc2e17fa-016a-43f0-ad78-6701632b7c5a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:40.465845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc2e17fa-016a-43f0-ad78-6701632b7c5a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:40.466296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc2e17fa-016a-43f0-ad78-6701632b7c5a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:40.596915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fc2e17fa-016a-43f0-ad78-6701632b7c5a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:40.604824 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fc2e17fa-016a-43f0-ad78-6701632b7c5a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.152993 Oct 11 05:09:40.605383 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3498/7232] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:40 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:41.628815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9dfff2d-1e8b-4158-90a8-0f13be72d4aa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:41.629385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e9dfff2d-1e8b-4158-90a8-0f13be72d4aa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:41.636490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9dfff2d-1e8b-4158-90a8-0f13be72d4aa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:41.637019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9dfff2d-1e8b-4158-90a8-0f13be72d4aa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:41.637472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9dfff2d-1e8b-4158-90a8-0f13be72d4aa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:41.638214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9dfff2d-1e8b-4158-90a8-0f13be72d4aa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:41.638781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9dfff2d-1e8b-4158-90a8-0f13be72d4aa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:41.639223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9dfff2d-1e8b-4158-90a8-0f13be72d4aa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:41.776675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e9dfff2d-1e8b-4158-90a8-0f13be72d4aa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:41.784494 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e9dfff2d-1e8b-4158-90a8-0f13be72d4aa tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.159871 Oct 11 05:09:41.785068 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3735/7233] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:41 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:42.807538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d12251d-efdb-45c0-8f3c-a7e451270552 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:42.808166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0d12251d-efdb-45c0-8f3c-a7e451270552 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:42.815727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d12251d-efdb-45c0-8f3c-a7e451270552 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:42.816206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d12251d-efdb-45c0-8f3c-a7e451270552 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:42.816641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d12251d-efdb-45c0-8f3c-a7e451270552 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:42.817326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d12251d-efdb-45c0-8f3c-a7e451270552 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:42.817778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d12251d-efdb-45c0-8f3c-a7e451270552 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:42.818208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d12251d-efdb-45c0-8f3c-a7e451270552 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:42.952348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0d12251d-efdb-45c0-8f3c-a7e451270552 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:42.960098 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0d12251d-efdb-45c0-8f3c-a7e451270552 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.156671 Oct 11 05:09:42.960664 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3499/7234] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:42 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:43.982459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68238d74-69be-4fcf-8f0e-6af241f9486b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:43.983068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68238d74-69be-4fcf-8f0e-6af241f9486b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:43.990017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68238d74-69be-4fcf-8f0e-6af241f9486b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:43.990538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68238d74-69be-4fcf-8f0e-6af241f9486b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:43.990977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68238d74-69be-4fcf-8f0e-6af241f9486b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:43.991672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68238d74-69be-4fcf-8f0e-6af241f9486b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:43.992343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68238d74-69be-4fcf-8f0e-6af241f9486b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:43.992771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68238d74-69be-4fcf-8f0e-6af241f9486b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:44.016873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-fb8c8ae3-163e-4774-8c9b-ff87a3fbc164 req-59965f28-9c5b-47fd-9ff2-7936f6445aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119b35f6-1b21-40e6-84c5-484adf6f456a", "name": "network-vif-plugged", "status": "completed", "tag": "ffabf5f8-3fa3-42c3-92a9-751b5af20398"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:09:44.028855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb8c8ae3-163e-4774-8c9b-ff87a3fbc164 req-59965f28-9c5b-47fd-9ff2-7936f6445aa6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:44.029407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb8c8ae3-163e-4774-8c9b-ff87a3fbc164 req-59965f28-9c5b-47fd-9ff2-7936f6445aa6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:44.030034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fb8c8ae3-163e-4774-8c9b-ff87a3fbc164 req-59965f28-9c5b-47fd-9ff2-7936f6445aa6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:44.042352 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-fb8c8ae3-163e-4774-8c9b-ff87a3fbc164 req-59965f28-9c5b-47fd-9ff2-7936f6445aa6 service nova] Creating event network-vif-plugged:ffabf5f8-3fa3-42c3-92a9-751b5af20398 for instance 119b35f6-1b21-40e6-84c5-484adf6f456a on n-h1-860892-1 Oct 11 05:09:44.047740 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-fb8c8ae3-163e-4774-8c9b-ff87a3fbc164 req-59965f28-9c5b-47fd-9ff2-7936f6445aa6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089690 Oct 11 05:09:44.048351 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3736/7235] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:09:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:09:44.147473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68238d74-69be-4fcf-8f0e-6af241f9486b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:44.151095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:09:44.155712 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68238d74-69be-4fcf-8f0e-6af241f9486b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.177147 Oct 11 05:09:44.158026 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3500/7236] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:43 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:09:45.179881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-89d3108a-0ee3-4579-8221-7b0cc7235fa0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:45.180603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-89d3108a-0ee3-4579-8221-7b0cc7235fa0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:45.182598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=33 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:09:45.188104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89d3108a-0ee3-4579-8221-7b0cc7235fa0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:45.188604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89d3108a-0ee3-4579-8221-7b0cc7235fa0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:45.189071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89d3108a-0ee3-4579-8221-7b0cc7235fa0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:45.189773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89d3108a-0ee3-4579-8221-7b0cc7235fa0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:45.190270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89d3108a-0ee3-4579-8221-7b0cc7235fa0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:45.190727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-89d3108a-0ee3-4579-8221-7b0cc7235fa0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:45.194713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=73 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:09:45.326921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-89d3108a-0ee3-4579-8221-7b0cc7235fa0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:45.334777 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-89d3108a-0ee3-4579-8221-7b0cc7235fa0 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1267 microversion: 2.1 time: 0.160136 Oct 11 05:09:45.335358 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3737/7237] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:45 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:46.358669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b478a45c-b350-432c-b2a1-a3d31d275e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:46.359279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b478a45c-b350-432c-b2a1-a3d31d275e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:46.361375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:09:46.366425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b478a45c-b350-432c-b2a1-a3d31d275e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:46.366905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b478a45c-b350-432c-b2a1-a3d31d275e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:46.367342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b478a45c-b350-432c-b2a1-a3d31d275e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:46.368016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b478a45c-b350-432c-b2a1-a3d31d275e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:46.368464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b478a45c-b350-432c-b2a1-a3d31d275e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:46.368889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b478a45c-b350-432c-b2a1-a3d31d275e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:46.502731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b478a45c-b350-432c-b2a1-a3d31d275e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:46.511513 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b478a45c-b350-432c-b2a1-a3d31d275e1b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1453 microversion: 2.1 time: 0.157269 Oct 11 05:09:46.512813 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3501/7238] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:46 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:46.534222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3610d286-b100-42cf-84d1-b0b55c119537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:09:46.534871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3610d286-b100-42cf-84d1-b0b55c119537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:09:46.541246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3610d286-b100-42cf-84d1-b0b55c119537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:46.541743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3610d286-b100-42cf-84d1-b0b55c119537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:46.542313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3610d286-b100-42cf-84d1-b0b55c119537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:46.543028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3610d286-b100-42cf-84d1-b0b55c119537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:46.543496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3610d286-b100-42cf-84d1-b0b55c119537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:46.543933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3610d286-b100-42cf-84d1-b0b55c119537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:46.676524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3610d286-b100-42cf-84d1-b0b55c119537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:09:46.685065 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3610d286-b100-42cf-84d1-b0b55c119537 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1453 microversion: 2.1 time: 0.154842 Oct 11 05:09:46.685653 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3738/7239] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:09:46 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:09:48.933461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-988cc9e4-4a4e-4ccf-895e-1bcc83d24c17 req-9f01f003-f087-49b0-9382-6a5ca805a9c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119b35f6-1b21-40e6-84c5-484adf6f456a", "tag": "ffabf5f8-3fa3-42c3-92a9-751b5af20398"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:09:48.943002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-988cc9e4-4a4e-4ccf-895e-1bcc83d24c17 req-9f01f003-f087-49b0-9382-6a5ca805a9c5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:09:48.943476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-988cc9e4-4a4e-4ccf-895e-1bcc83d24c17 req-9f01f003-f087-49b0-9382-6a5ca805a9c5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:09:48.943902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-988cc9e4-4a4e-4ccf-895e-1bcc83d24c17 req-9f01f003-f087-49b0-9382-6a5ca805a9c5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:09:48.960138 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-988cc9e4-4a4e-4ccf-895e-1bcc83d24c17 req-9f01f003-f087-49b0-9382-6a5ca805a9c5 service nova] Creating event network-changed:ffabf5f8-3fa3-42c3-92a9-751b5af20398 for instance 119b35f6-1b21-40e6-84c5-484adf6f456a on n-h1-860892-1 Oct 11 05:09:48.965757 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-988cc9e4-4a4e-4ccf-895e-1bcc83d24c17 req-9f01f003-f087-49b0-9382-6a5ca805a9c5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082997 Oct 11 05:09:48.966411 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3502/7240] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:12:18.958454 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc2e98b3-7f64-4104-93f2-3fa6b98fc453] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 05:12:18.964160 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 05:12:18.964160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:12:18.964160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=11 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:12:18.964160 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:12:18.964160 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:12:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Oct 11 05:12:18.964160 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:12:18.964160 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:12:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Oct 11 05:12:18.964160 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:12:18.964160 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:12:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.26) !!! Oct 11 05:12:18.969523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1726702231", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1047921920", "security_groups": [{"name": "tempest-secgroup-smoke-1075802136"}], "block_device_mapping_v2": [{"uuid": "aa3bb67b-0c32-4629-b7f1-56b374200144", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:12:19.086383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] validate_networks() for [('dbda7cfc-e8c5-4d56-8a0f-f6b52c60314f', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:12:19.560784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:12:19.560784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:12:19.561003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:12:19.561316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:12:19.561769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:12:19.575794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:19.576292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:19.576748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:19.577500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:19.577972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:19.578444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:19.599340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:12:19.605257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Getting quotas for user 5a1c61d68e1a479bb0dc096271f4cbde and project eb3af7529f52488f978ab296d9d4bf65. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:12:19.667174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:12:19.669324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='aa3bb67b-0c32-4629-b7f1-56b374200144',volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:12:19.985587 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36190. Oct 11 05:12:19.986436 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc2e98b3-7f64-4104-93f2-3fa6b98fc453] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36188. Oct 11 05:12:20.232146 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab389ba9-7ae7-4dae-b7da-444c4f1c4b66 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.275731 Oct 11 05:12:20.237968 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3739/7241] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:12:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 1277 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:12:20.242383 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:12:20.248001 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:12:20.248001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:12:20.248001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:12:20.248001 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:12:20.248001 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:12:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 (ip 10.222.0.26) !!! Oct 11 05:12:20.248001 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:12:20.248001 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:12:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 (ip 10.222.0.26) !!! Oct 11 05:12:20.248001 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:12:20.248543 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:12:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 (ip 10.222.0.26) !!! Oct 11 05:12:20.258446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f83422ed-6a22-4842-80c3-2e0894c3c5bd tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:20.259156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f83422ed-6a22-4842-80c3-2e0894c3c5bd tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:20.330699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f83422ed-6a22-4842-80c3-2e0894c3c5bd tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:20.341899 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f83422ed-6a22-4842-80c3-2e0894c3c5bd tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1095 microversion: 2.1 time: 0.101501 Oct 11 05:12:20.342504 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3503/7242] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:20 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1095 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:21.363921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0401cdce-0773-41bf-bc79-3e9de377fde9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:21.364544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0401cdce-0773-41bf-bc79-3e9de377fde9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:21.420993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0401cdce-0773-41bf-bc79-3e9de377fde9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:21.432082 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0401cdce-0773-41bf-bc79-3e9de377fde9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1095 microversion: 2.1 time: 0.072119 Oct 11 05:12:21.432649 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3740/7243] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:21 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1095 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:22.454354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-681b090f-0da6-4ea0-93cf-130d13b51038 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:22.454969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-681b090f-0da6-4ea0-93cf-130d13b51038 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:22.464046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-681b090f-0da6-4ea0-93cf-130d13b51038 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:22.464538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-681b090f-0da6-4ea0-93cf-130d13b51038 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:22.465029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-681b090f-0da6-4ea0-93cf-130d13b51038 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:22.465732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-681b090f-0da6-4ea0-93cf-130d13b51038 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:22.466201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-681b090f-0da6-4ea0-93cf-130d13b51038 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:22.466644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-681b090f-0da6-4ea0-93cf-130d13b51038 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:22.483616 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36244. Oct 11 05:12:22.488452 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36246. Oct 11 05:12:22.535718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-681b090f-0da6-4ea0-93cf-130d13b51038 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:22.544156 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-681b090f-0da6-4ea0-93cf-130d13b51038 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1145 microversion: 2.1 time: 0.093849 Oct 11 05:12:22.544725 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3504/7244] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:22 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1145 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:12:23.568247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a21cab4-46d1-4abc-9690-a5ca4176c491 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:23.569356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6a21cab4-46d1-4abc-9690-a5ca4176c491 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:23.576702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a21cab4-46d1-4abc-9690-a5ca4176c491 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:23.578393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a21cab4-46d1-4abc-9690-a5ca4176c491 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:23.578393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a21cab4-46d1-4abc-9690-a5ca4176c491 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:23.578888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a21cab4-46d1-4abc-9690-a5ca4176c491 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:23.579455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a21cab4-46d1-4abc-9690-a5ca4176c491 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:23.580728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a21cab4-46d1-4abc-9690-a5ca4176c491 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:23.645197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a21cab4-46d1-4abc-9690-a5ca4176c491 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:23.653706 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a21cab4-46d1-4abc-9690-a5ca4176c491 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1201 microversion: 2.1 time: 0.089737 Oct 11 05:12:23.654297 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3741/7245] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:23 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:24.677012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-458f291e-d219-4fe2-a26d-78ca90faeb32 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:24.677613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-458f291e-d219-4fe2-a26d-78ca90faeb32 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:24.688650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-458f291e-d219-4fe2-a26d-78ca90faeb32 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:24.689460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-458f291e-d219-4fe2-a26d-78ca90faeb32 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:24.690065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-458f291e-d219-4fe2-a26d-78ca90faeb32 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:24.690831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-458f291e-d219-4fe2-a26d-78ca90faeb32 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:24.691291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-458f291e-d219-4fe2-a26d-78ca90faeb32 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:24.691781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-458f291e-d219-4fe2-a26d-78ca90faeb32 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:24.890057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-458f291e-d219-4fe2-a26d-78ca90faeb32 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:24.898083 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-458f291e-d219-4fe2-a26d-78ca90faeb32 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1279 microversion: 2.1 time: 0.225258 Oct 11 05:12:24.898842 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3505/7246] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:24 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1279 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:25.364624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b45531e1-0c59-4f38-8d57-9dfd1083d760 req-f8094532-aa16-4a1b-8981-fa9267d9a4ac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12f090d-1adb-441b-b638-1f1aa22a75b7", "tag": "a0e4f496-e50a-4051-8c53-b6d7b91a8469"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:12:25.375328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b45531e1-0c59-4f38-8d57-9dfd1083d760 req-f8094532-aa16-4a1b-8981-fa9267d9a4ac service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:25.375846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b45531e1-0c59-4f38-8d57-9dfd1083d760 req-f8094532-aa16-4a1b-8981-fa9267d9a4ac service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:25.379289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b45531e1-0c59-4f38-8d57-9dfd1083d760 req-f8094532-aa16-4a1b-8981-fa9267d9a4ac service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:25.388906 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b45531e1-0c59-4f38-8d57-9dfd1083d760 req-f8094532-aa16-4a1b-8981-fa9267d9a4ac service nova] Creating event network-changed:a0e4f496-e50a-4051-8c53-b6d7b91a8469 for instance a12f090d-1adb-441b-b638-1f1aa22a75b7 on n-h2-860892-1 Oct 11 05:12:25.395214 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b45531e1-0c59-4f38-8d57-9dfd1083d760 req-f8094532-aa16-4a1b-8981-fa9267d9a4ac service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034272 Oct 11 05:12:25.396126 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3742/7247] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:12:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:12:25.926457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4b857a81-e53e-4ec0-90c0-561b29b66c9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:25.927072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4b857a81-e53e-4ec0-90c0-561b29b66c9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:25.934440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b857a81-e53e-4ec0-90c0-561b29b66c9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:25.934931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b857a81-e53e-4ec0-90c0-561b29b66c9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:25.935373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b857a81-e53e-4ec0-90c0-561b29b66c9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:25.936072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b857a81-e53e-4ec0-90c0-561b29b66c9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:25.936530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b857a81-e53e-4ec0-90c0-561b29b66c9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:25.936958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b857a81-e53e-4ec0-90c0-561b29b66c9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:26.157951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4b857a81-e53e-4ec0-90c0-561b29b66c9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:26.166369 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4b857a81-e53e-4ec0-90c0-561b29b66c9e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1279 microversion: 2.1 time: 0.243299 Oct 11 05:12:26.166959 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3506/7248] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:25 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1279 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:27.192170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d198071-d90a-4893-9843-8e7803f90b7d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:27.192721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2d198071-d90a-4893-9843-8e7803f90b7d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:27.199179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d198071-d90a-4893-9843-8e7803f90b7d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:27.199673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d198071-d90a-4893-9843-8e7803f90b7d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:27.200124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d198071-d90a-4893-9843-8e7803f90b7d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:27.200826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d198071-d90a-4893-9843-8e7803f90b7d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:27.201293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d198071-d90a-4893-9843-8e7803f90b7d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:27.201734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d198071-d90a-4893-9843-8e7803f90b7d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:27.338182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d198071-d90a-4893-9843-8e7803f90b7d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:27.346164 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d198071-d90a-4893-9843-8e7803f90b7d tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1279 microversion: 2.1 time: 0.159326 Oct 11 05:12:27.346961 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3743/7249] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:27 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:28.369805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b17d697-a199-468f-83f0-15ded7ecd7be tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:28.370600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6b17d697-a199-468f-83f0-15ded7ecd7be tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:28.377418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b17d697-a199-468f-83f0-15ded7ecd7be tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:28.377899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b17d697-a199-468f-83f0-15ded7ecd7be tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:28.378362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b17d697-a199-468f-83f0-15ded7ecd7be tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:28.379099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b17d697-a199-468f-83f0-15ded7ecd7be tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:28.379555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b17d697-a199-468f-83f0-15ded7ecd7be tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:28.379983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b17d697-a199-468f-83f0-15ded7ecd7be tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:28.517853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6b17d697-a199-468f-83f0-15ded7ecd7be tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:28.527230 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b17d697-a199-468f-83f0-15ded7ecd7be tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1279 microversion: 2.1 time: 0.161978 Oct 11 05:12:28.527956 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3507/7250] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:28 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1279 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:29.550663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9525e526-7e79-4094-9999-b7eed4ae3b35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:29.551289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9525e526-7e79-4094-9999-b7eed4ae3b35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:29.558309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9525e526-7e79-4094-9999-b7eed4ae3b35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:29.558805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9525e526-7e79-4094-9999-b7eed4ae3b35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:29.559258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9525e526-7e79-4094-9999-b7eed4ae3b35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:29.559962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9525e526-7e79-4094-9999-b7eed4ae3b35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:29.560433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9525e526-7e79-4094-9999-b7eed4ae3b35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:29.560874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9525e526-7e79-4094-9999-b7eed4ae3b35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:29.590774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:12:29.702753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9525e526-7e79-4094-9999-b7eed4ae3b35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:29.710620 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9525e526-7e79-4094-9999-b7eed4ae3b35 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1267 microversion: 2.1 time: 0.163874 Oct 11 05:12:29.711615 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3744/7251] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:29 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:30.738159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-541c64c4-4f3c-4efa-8f96-d7549ad9c383 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:30.738911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-541c64c4-4f3c-4efa-8f96-d7549ad9c383 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:30.741898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:12:30.747366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-541c64c4-4f3c-4efa-8f96-d7549ad9c383 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:30.748536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-541c64c4-4f3c-4efa-8f96-d7549ad9c383 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:30.748536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-541c64c4-4f3c-4efa-8f96-d7549ad9c383 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:30.748988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-541c64c4-4f3c-4efa-8f96-d7549ad9c383 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:30.749437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-541c64c4-4f3c-4efa-8f96-d7549ad9c383 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:30.749856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-541c64c4-4f3c-4efa-8f96-d7549ad9c383 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:30.887910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-541c64c4-4f3c-4efa-8f96-d7549ad9c383 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:30.895724 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-541c64c4-4f3c-4efa-8f96-d7549ad9c383 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1267 microversion: 2.1 time: 0.161616 Oct 11 05:12:30.896326 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3508/7252] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:30 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:31.919700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7ac2c7dd-fb63-43bf-aa51-ce4848a1e81e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:31.920380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7ac2c7dd-fb63-43bf-aa51-ce4848a1e81e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:31.923121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:12:31.927998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac2c7dd-fb63-43bf-aa51-ce4848a1e81e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:31.928498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac2c7dd-fb63-43bf-aa51-ce4848a1e81e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:31.928950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac2c7dd-fb63-43bf-aa51-ce4848a1e81e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:31.929654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac2c7dd-fb63-43bf-aa51-ce4848a1e81e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:31.930124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac2c7dd-fb63-43bf-aa51-ce4848a1e81e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:31.930586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7ac2c7dd-fb63-43bf-aa51-ce4848a1e81e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:32.062391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7ac2c7dd-fb63-43bf-aa51-ce4848a1e81e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:32.070138 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7ac2c7dd-fb63-43bf-aa51-ce4848a1e81e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1267 microversion: 2.1 time: 0.154971 Oct 11 05:12:32.075704 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3745/7253] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:31 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:33.093699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bd37534-7bad-442e-aecc-ee244df7cde4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:33.094368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0bd37534-7bad-442e-aecc-ee244df7cde4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:33.101156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bd37534-7bad-442e-aecc-ee244df7cde4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:33.101630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bd37534-7bad-442e-aecc-ee244df7cde4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:33.102063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bd37534-7bad-442e-aecc-ee244df7cde4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:33.102768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bd37534-7bad-442e-aecc-ee244df7cde4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:33.103220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bd37534-7bad-442e-aecc-ee244df7cde4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:33.103675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bd37534-7bad-442e-aecc-ee244df7cde4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:33.239724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0bd37534-7bad-442e-aecc-ee244df7cde4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:33.248354 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0bd37534-7bad-442e-aecc-ee244df7cde4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1267 microversion: 2.1 time: 0.158588 Oct 11 05:12:33.248913 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3509/7254] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:33 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:34.271809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a84e663-3f6d-473e-bef8-98b02efcd264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:34.272503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a84e663-3f6d-473e-bef8-98b02efcd264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:34.279374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a84e663-3f6d-473e-bef8-98b02efcd264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:34.279873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a84e663-3f6d-473e-bef8-98b02efcd264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:34.280336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a84e663-3f6d-473e-bef8-98b02efcd264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:34.281037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a84e663-3f6d-473e-bef8-98b02efcd264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:34.281503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a84e663-3f6d-473e-bef8-98b02efcd264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:34.281947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a84e663-3f6d-473e-bef8-98b02efcd264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:34.411755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a84e663-3f6d-473e-bef8-98b02efcd264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:34.419888 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a84e663-3f6d-473e-bef8-98b02efcd264 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1267 microversion: 2.1 time: 0.152002 Oct 11 05:12:34.420455 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3746/7255] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:34 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:35.442920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d49605c2-fd85-496b-9393-e7672dbd77dc tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:35.443532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d49605c2-fd85-496b-9393-e7672dbd77dc tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:35.451240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d49605c2-fd85-496b-9393-e7672dbd77dc tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:35.451732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d49605c2-fd85-496b-9393-e7672dbd77dc tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:35.452252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d49605c2-fd85-496b-9393-e7672dbd77dc tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:35.452949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d49605c2-fd85-496b-9393-e7672dbd77dc tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:35.453410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d49605c2-fd85-496b-9393-e7672dbd77dc tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:35.453840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d49605c2-fd85-496b-9393-e7672dbd77dc tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:35.584903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d49605c2-fd85-496b-9393-e7672dbd77dc tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:35.592635 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d49605c2-fd85-496b-9393-e7672dbd77dc tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1267 microversion: 2.1 time: 0.153733 Oct 11 05:12:35.593235 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3510/7256] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:35 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:36.615460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b72ca23f-a12b-4ddd-9951-1c435961bd61 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:36.616084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b72ca23f-a12b-4ddd-9951-1c435961bd61 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:36.623046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b72ca23f-a12b-4ddd-9951-1c435961bd61 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:36.623536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b72ca23f-a12b-4ddd-9951-1c435961bd61 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:36.623982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b72ca23f-a12b-4ddd-9951-1c435961bd61 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:36.624729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b72ca23f-a12b-4ddd-9951-1c435961bd61 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:36.625187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b72ca23f-a12b-4ddd-9951-1c435961bd61 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:36.625620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b72ca23f-a12b-4ddd-9951-1c435961bd61 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:36.762678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b72ca23f-a12b-4ddd-9951-1c435961bd61 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:36.770461 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b72ca23f-a12b-4ddd-9951-1c435961bd61 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1267 microversion: 2.1 time: 0.159160 Oct 11 05:12:36.770977 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3747/7257] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:36 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:37.792977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ab380036-8e0f-4396-95f6-e9d1e719212b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:37.793609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ab380036-8e0f-4396-95f6-e9d1e719212b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:37.801466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab380036-8e0f-4396-95f6-e9d1e719212b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:37.801573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab380036-8e0f-4396-95f6-e9d1e719212b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:37.802026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab380036-8e0f-4396-95f6-e9d1e719212b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:37.802749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab380036-8e0f-4396-95f6-e9d1e719212b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:37.803205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab380036-8e0f-4396-95f6-e9d1e719212b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:37.803636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ab380036-8e0f-4396-95f6-e9d1e719212b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:37.941526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ab380036-8e0f-4396-95f6-e9d1e719212b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:37.949396 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ab380036-8e0f-4396-95f6-e9d1e719212b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1267 microversion: 2.1 time: 0.160426 Oct 11 05:12:37.951979 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3511/7258] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:37 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:38.972367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27636076-523f-448b-93df-6ddce7d80f4e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:38.973021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-27636076-523f-448b-93df-6ddce7d80f4e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:38.979793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27636076-523f-448b-93df-6ddce7d80f4e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:38.980283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27636076-523f-448b-93df-6ddce7d80f4e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:38.980754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27636076-523f-448b-93df-6ddce7d80f4e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:38.981452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27636076-523f-448b-93df-6ddce7d80f4e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:38.981917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27636076-523f-448b-93df-6ddce7d80f4e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:38.982385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27636076-523f-448b-93df-6ddce7d80f4e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:39.112368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-27636076-523f-448b-93df-6ddce7d80f4e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:39.120136 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-27636076-523f-448b-93df-6ddce7d80f4e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1267 microversion: 2.1 time: 0.151647 Oct 11 05:12:39.120722 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3748/7259] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:38 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:39.849386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a252a212-86a9-47ea-9deb-cae3d98b6060 req-ce739867-3936-4be9-84a4-0022f4bb18f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12f090d-1adb-441b-b638-1f1aa22a75b7", "name": "network-vif-plugged", "status": "completed", "tag": "a0e4f496-e50a-4051-8c53-b6d7b91a8469"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:12:39.859939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a252a212-86a9-47ea-9deb-cae3d98b6060 req-ce739867-3936-4be9-84a4-0022f4bb18f0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:39.860414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a252a212-86a9-47ea-9deb-cae3d98b6060 req-ce739867-3936-4be9-84a4-0022f4bb18f0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:39.860849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a252a212-86a9-47ea-9deb-cae3d98b6060 req-ce739867-3936-4be9-84a4-0022f4bb18f0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:39.872203 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a252a212-86a9-47ea-9deb-cae3d98b6060 req-ce739867-3936-4be9-84a4-0022f4bb18f0 service nova] Creating event network-vif-plugged:a0e4f496-e50a-4051-8c53-b6d7b91a8469 for instance a12f090d-1adb-441b-b638-1f1aa22a75b7 on n-h2-860892-1 Oct 11 05:12:39.878928 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a252a212-86a9-47ea-9deb-cae3d98b6060 req-ce739867-3936-4be9-84a4-0022f4bb18f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033435 Oct 11 05:12:39.879528 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3512/7260] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:12:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:12:40.143308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-116c096b-bc00-4766-98f0-bd49d2b74dc2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:40.144005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-116c096b-bc00-4766-98f0-bd49d2b74dc2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:40.150899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-116c096b-bc00-4766-98f0-bd49d2b74dc2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:40.151391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-116c096b-bc00-4766-98f0-bd49d2b74dc2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:40.195548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-116c096b-bc00-4766-98f0-bd49d2b74dc2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:40.195548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-116c096b-bc00-4766-98f0-bd49d2b74dc2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:40.195548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-116c096b-bc00-4766-98f0-bd49d2b74dc2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:40.195548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-116c096b-bc00-4766-98f0-bd49d2b74dc2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:40.288018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-116c096b-bc00-4766-98f0-bd49d2b74dc2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:40.296260 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-116c096b-bc00-4766-98f0-bd49d2b74dc2 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1267 microversion: 2.1 time: 0.157498 Oct 11 05:12:40.298727 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3749/7261] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:40 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:41.320782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8aee2b2d-ee39-43cd-adeb-c3824600d9bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:41.321479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8aee2b2d-ee39-43cd-adeb-c3824600d9bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:41.328377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aee2b2d-ee39-43cd-adeb-c3824600d9bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:41.328858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aee2b2d-ee39-43cd-adeb-c3824600d9bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:41.329322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aee2b2d-ee39-43cd-adeb-c3824600d9bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:41.330008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aee2b2d-ee39-43cd-adeb-c3824600d9bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:41.330501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aee2b2d-ee39-43cd-adeb-c3824600d9bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:41.330924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8aee2b2d-ee39-43cd-adeb-c3824600d9bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:41.465556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8aee2b2d-ee39-43cd-adeb-c3824600d9bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:41.473489 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8aee2b2d-ee39-43cd-adeb-c3824600d9bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1453 microversion: 2.1 time: 0.157984 Oct 11 05:12:41.475787 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3513/7262] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:41 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:41.495246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d36d5626-570e-4cc7-9358-8a7e3da60387 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:12:41.495871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d36d5626-570e-4cc7-9358-8a7e3da60387 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:12:41.503276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d36d5626-570e-4cc7-9358-8a7e3da60387 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:41.503765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d36d5626-570e-4cc7-9358-8a7e3da60387 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:41.504213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d36d5626-570e-4cc7-9358-8a7e3da60387 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:41.504905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d36d5626-570e-4cc7-9358-8a7e3da60387 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:41.505366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d36d5626-570e-4cc7-9358-8a7e3da60387 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:41.505801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d36d5626-570e-4cc7-9358-8a7e3da60387 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:41.636905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d36d5626-570e-4cc7-9358-8a7e3da60387 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:12:41.645254 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d36d5626-570e-4cc7-9358-8a7e3da60387 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1453 microversion: 2.1 time: 0.153836 Oct 11 05:12:41.645831 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3750/7263] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:12:41 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:12:43.946236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e6823499-f8cb-41aa-8278-641e4d7a0beb req-888cadaa-9db0-4268-b60f-f013ec160b04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12f090d-1adb-441b-b638-1f1aa22a75b7", "tag": "a0e4f496-e50a-4051-8c53-b6d7b91a8469"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:12:43.955985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e6823499-f8cb-41aa-8278-641e4d7a0beb req-888cadaa-9db0-4268-b60f-f013ec160b04 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:12:43.956541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e6823499-f8cb-41aa-8278-641e4d7a0beb req-888cadaa-9db0-4268-b60f-f013ec160b04 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:12:43.957130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e6823499-f8cb-41aa-8278-641e4d7a0beb req-888cadaa-9db0-4268-b60f-f013ec160b04 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:12:43.968467 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e6823499-f8cb-41aa-8278-641e4d7a0beb req-888cadaa-9db0-4268-b60f-f013ec160b04 service nova] Creating event network-changed:a0e4f496-e50a-4051-8c53-b6d7b91a8469 for instance a12f090d-1adb-441b-b638-1f1aa22a75b7 on n-h2-860892-1 Oct 11 05:12:43.973604 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e6823499-f8cb-41aa-8278-641e4d7a0beb req-888cadaa-9db0-4268-b60f-f013ec160b04 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080153 Oct 11 05:12:43.974262 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3514/7264] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:15:01.741236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:15:01.742452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=58 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:15:01.744611 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 05:15:01.746231 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] AMQP server on 10.222.0.26:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Oct 11 05:15:01.747256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=26 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:15:01.748662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=58 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:15:01.750297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3bcc9b6d-5671-44d8-bc27-38895afe9470 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:01.761053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3bcc9b6d-5671-44d8-bc27-38895afe9470 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:01.761053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc9b6d-5671-44d8-bc27-38895afe9470 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:01.761053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc9b6d-5671-44d8-bc27-38895afe9470 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:01.761053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc9b6d-5671-44d8-bc27-38895afe9470 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:01.761053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc9b6d-5671-44d8-bc27-38895afe9470 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:01.761053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc9b6d-5671-44d8-bc27-38895afe9470 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:01.761053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3bcc9b6d-5671-44d8-bc27-38895afe9470 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:01.788089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3bcc9b6d-5671-44d8-bc27-38895afe9470 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:15:01.871446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f2df9007-e668-4a20-b872-b9fe7ccb5b3e req-20cc5691-32ed-4bdc-9165-3b279d04dd6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a12f090d-1adb-441b-b638-1f1aa22a75b7", "tag": "a0e4f496-e50a-4051-8c53-b6d7b91a8469"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:15:01.885167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f2df9007-e668-4a20-b872-b9fe7ccb5b3e req-20cc5691-32ed-4bdc-9165-3b279d04dd6a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:01.885648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f2df9007-e668-4a20-b872-b9fe7ccb5b3e req-20cc5691-32ed-4bdc-9165-3b279d04dd6a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:01.886079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f2df9007-e668-4a20-b872-b9fe7ccb5b3e req-20cc5691-32ed-4bdc-9165-3b279d04dd6a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:01.896945 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f2df9007-e668-4a20-b872-b9fe7ccb5b3e req-20cc5691-32ed-4bdc-9165-3b279d04dd6a service nova] Creating event network-changed:a0e4f496-e50a-4051-8c53-b6d7b91a8469 for instance a12f090d-1adb-441b-b638-1f1aa22a75b7 on n-h2-860892-1 Oct 11 05:15:01.904626 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f2df9007-e668-4a20-b872-b9fe7ccb5b3e req-20cc5691-32ed-4bdc-9165-3b279d04dd6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.160869 Oct 11 05:15:01.904626 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3515/7265] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:15:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:15:02.072876 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3bcc9b6d-5671-44d8-bc27-38895afe9470 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 204 len: 0 microversion: 2.1 time: 0.333392 Oct 11 05:15:02.077817 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3751/7266] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:15:01 2022] DELETE /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:15:02.084358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bba7d456-4b09-4e1c-8e31-1f03ab621d5b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:02.085189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bba7d456-4b09-4e1c-8e31-1f03ab621d5b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:02.093041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bba7d456-4b09-4e1c-8e31-1f03ab621d5b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:02.093632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bba7d456-4b09-4e1c-8e31-1f03ab621d5b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:02.094317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bba7d456-4b09-4e1c-8e31-1f03ab621d5b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:02.095294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bba7d456-4b09-4e1c-8e31-1f03ab621d5b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:02.095823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bba7d456-4b09-4e1c-8e31-1f03ab621d5b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:02.096484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bba7d456-4b09-4e1c-8e31-1f03ab621d5b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:02.335481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bba7d456-4b09-4e1c-8e31-1f03ab621d5b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:02.344321 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bba7d456-4b09-4e1c-8e31-1f03ab621d5b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1578 microversion: 2.1 time: 0.264965 Oct 11 05:15:02.344990 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3516/7267] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:02 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1578 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:03.370885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-afdb4590-0b6f-4364-b22e-be780584b6bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:03.371928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-afdb4590-0b6f-4364-b22e-be780584b6bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:03.379661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-afdb4590-0b6f-4364-b22e-be780584b6bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:03.381442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-afdb4590-0b6f-4364-b22e-be780584b6bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:03.381442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-afdb4590-0b6f-4364-b22e-be780584b6bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:03.381664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-afdb4590-0b6f-4364-b22e-be780584b6bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:03.381986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-afdb4590-0b6f-4364-b22e-be780584b6bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:03.382454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-afdb4590-0b6f-4364-b22e-be780584b6bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:03.592052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-afdb4590-0b6f-4364-b22e-be780584b6bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:03.600291 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-afdb4590-0b6f-4364-b22e-be780584b6bf tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1578 microversion: 2.1 time: 0.233789 Oct 11 05:15:03.601168 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3752/7268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:03 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1578 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:04.111480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-0b454ecd-4677-4dd1-9467-891e73748674 req-e220bd3e-8c95-4214-b07b-3bc868676629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a12f090d-1adb-441b-b638-1f1aa22a75b7", "name": "network-vif-deleted", "tag": "a0e4f496-e50a-4051-8c53-b6d7b91a8469"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:15:04.126814 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36378. Oct 11 05:15:04.133958 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36376. Oct 11 05:15:04.138453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0b454ecd-4677-4dd1-9467-891e73748674 req-e220bd3e-8c95-4214-b07b-3bc868676629 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:04.142608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0b454ecd-4677-4dd1-9467-891e73748674 req-e220bd3e-8c95-4214-b07b-3bc868676629 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:04.142608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0b454ecd-4677-4dd1-9467-891e73748674 req-e220bd3e-8c95-4214-b07b-3bc868676629 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:04.151133 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-0b454ecd-4677-4dd1-9467-891e73748674 req-e220bd3e-8c95-4214-b07b-3bc868676629 service nova] Creating event network-vif-deleted:a0e4f496-e50a-4051-8c53-b6d7b91a8469 for instance a12f090d-1adb-441b-b638-1f1aa22a75b7 on n-h2-860892-1 Oct 11 05:15:04.156120 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-0b454ecd-4677-4dd1-9467-891e73748674 req-e220bd3e-8c95-4214-b07b-3bc868676629 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048386 Oct 11 05:15:04.156723 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3517/7269] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:15:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:15:04.624787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8a0d46cc-5cea-4ebe-b979-d2d73d45f364 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:04.625333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8a0d46cc-5cea-4ebe-b979-d2d73d45f364 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:04.632165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a0d46cc-5cea-4ebe-b979-d2d73d45f364 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:04.632663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a0d46cc-5cea-4ebe-b979-d2d73d45f364 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:04.633781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a0d46cc-5cea-4ebe-b979-d2d73d45f364 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:04.634524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a0d46cc-5cea-4ebe-b979-d2d73d45f364 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:04.634992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a0d46cc-5cea-4ebe-b979-d2d73d45f364 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:04.635435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a0d46cc-5cea-4ebe-b979-d2d73d45f364 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:04.704751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8a0d46cc-5cea-4ebe-b979-d2d73d45f364 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:04.712724 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8a0d46cc-5cea-4ebe-b979-d2d73d45f364 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1226 microversion: 2.1 time: 0.092093 Oct 11 05:15:04.713302 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3753/7270] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:04 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1226 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:05.737028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f593f9d-c105-4280-9991-4853b028c574 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:05.737731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f593f9d-c105-4280-9991-4853b028c574 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:05.744041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f593f9d-c105-4280-9991-4853b028c574 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:05.744522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f593f9d-c105-4280-9991-4853b028c574 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:05.744961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f593f9d-c105-4280-9991-4853b028c574 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:05.745652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f593f9d-c105-4280-9991-4853b028c574 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:05.746102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f593f9d-c105-4280-9991-4853b028c574 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:05.746554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f593f9d-c105-4280-9991-4853b028c574 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:05.810257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0f593f9d-c105-4280-9991-4853b028c574 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:05.818243 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f593f9d-c105-4280-9991-4853b028c574 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1226 microversion: 2.1 time: 0.086384 Oct 11 05:15:05.818823 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3518/7271] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:05 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1226 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:06.841617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d6fb1653-8b31-4be5-8811-2bdce64512ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:06.842269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d6fb1653-8b31-4be5-8811-2bdce64512ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:06.848978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6fb1653-8b31-4be5-8811-2bdce64512ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:06.849487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6fb1653-8b31-4be5-8811-2bdce64512ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:06.849944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6fb1653-8b31-4be5-8811-2bdce64512ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:06.850686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6fb1653-8b31-4be5-8811-2bdce64512ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:06.851157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6fb1653-8b31-4be5-8811-2bdce64512ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:06.851600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6fb1653-8b31-4be5-8811-2bdce64512ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:06.915105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d6fb1653-8b31-4be5-8811-2bdce64512ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:06.923014 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d6fb1653-8b31-4be5-8811-2bdce64512ec tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1226 microversion: 2.1 time: 0.085320 Oct 11 05:15:06.923592 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3754/7272] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:06 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:07.946231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dd387231-4415-49c2-9abb-c41202f24646 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:07.946817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dd387231-4415-49c2-9abb-c41202f24646 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:07.953578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd387231-4415-49c2-9abb-c41202f24646 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:07.954059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd387231-4415-49c2-9abb-c41202f24646 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:07.954526 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd387231-4415-49c2-9abb-c41202f24646 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:07.955217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd387231-4415-49c2-9abb-c41202f24646 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:07.955664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd387231-4415-49c2-9abb-c41202f24646 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:07.956090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dd387231-4415-49c2-9abb-c41202f24646 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:08.018504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dd387231-4415-49c2-9abb-c41202f24646 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:08.026921 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dd387231-4415-49c2-9abb-c41202f24646 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1226 microversion: 2.1 time: 0.085247 Oct 11 05:15:08.027491 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3519/7273] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:07 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:09.049416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:09.050045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:09.057459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:09.057959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:09.058436 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:09.059144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:09.059613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:09.060053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:09.091962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:09.092465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:09.092919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:09.122981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lazy-loading 'fault' on Instance uuid a12f090d-1adb-441b-b638-1f1aa22a75b7 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:15:09.134291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:09.142700 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b569f773-43f4-4e7e-bae1-7ce87107a8b9 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 200 len: 1231 microversion: 2.1 time: 0.097264 Oct 11 05:15:09.143275 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3755/7274] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:09 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 1231 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:10.171333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:10.171869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: a12f090d-1adb-441b-b638-1f1aa22a75b7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:10.178847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:10.179326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:10.179760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:10.180471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:10.180951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:10.181395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:10.194742 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance a12f090d-1adb-441b-b638-1f1aa22a75b7 could not be found. Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 HTTP/1.1 Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance a12f090d-1adb-441b-b638-1f1aa22a75b7 could not be found. Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'a12f090d-1adb-441b-b638-1f1aa22a75b7'} Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a12f090d-1adb-441b-b638-1f1aa22a75b7 could not be found. Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a12f090d-1adb-441b-b638-1f1aa22a75b7 could not be found. Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:15:10.196870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:15:10.201489 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:10.201489 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:15:10.201489 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:15:10.201489 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:15:10.201489 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:15:10.201489 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a12f090d-1adb-441b-b638-1f1aa22a75b7 could not be found. Oct 11 05:15:10.201489 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:15:10.201489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance a12f090d-1adb-441b-b638-1f1aa22a75b7 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:15:10.201489 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5a9b4afe-4bb7-4219-87e6-337a3e4cd8a5 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7" status: 404 len: 111 microversion: 2.1 time: 0.030946 Oct 11 05:15:10.201489 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3520/7275] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:10 2022] GET /compute/v2.1/servers/a12f090d-1adb-441b-b638-1f1aa22a75b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:15:16.777551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5cce48a1-9c59-4475-800d-a4351bfefe09 req-e115a8b4-2ad1-40c2-a277-5c0e76eb5de8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "119b35f6-1b21-40e6-84c5-484adf6f456a", "tag": "ffabf5f8-3fa3-42c3-92a9-751b5af20398"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:15:16.786679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-848a1dbc-5373-4c4c-b82a-5096989e5f9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:16.787193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-848a1dbc-5373-4c4c-b82a-5096989e5f9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:16.794996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-848a1dbc-5373-4c4c-b82a-5096989e5f9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:16.795512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-848a1dbc-5373-4c4c-b82a-5096989e5f9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:16.795969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-848a1dbc-5373-4c4c-b82a-5096989e5f9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:16.796719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-848a1dbc-5373-4c4c-b82a-5096989e5f9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:16.796819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5cce48a1-9c59-4475-800d-a4351bfefe09 req-e115a8b4-2ad1-40c2-a277-5c0e76eb5de8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:16.797191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-848a1dbc-5373-4c4c-b82a-5096989e5f9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:16.797291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5cce48a1-9c59-4475-800d-a4351bfefe09 req-e115a8b4-2ad1-40c2-a277-5c0e76eb5de8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:16.797674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5cce48a1-9c59-4475-800d-a4351bfefe09 req-e115a8b4-2ad1-40c2-a277-5c0e76eb5de8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:16.797781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-848a1dbc-5373-4c4c-b82a-5096989e5f9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:16.810576 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5cce48a1-9c59-4475-800d-a4351bfefe09 req-e115a8b4-2ad1-40c2-a277-5c0e76eb5de8 service nova] Creating event network-changed:ffabf5f8-3fa3-42c3-92a9-751b5af20398 for instance 119b35f6-1b21-40e6-84c5-484adf6f456a on n-h1-860892-1 Oct 11 05:15:16.817655 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5cce48a1-9c59-4475-800d-a4351bfefe09 req-e115a8b4-2ad1-40c2-a277-5c0e76eb5de8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042300 Oct 11 05:15:16.817655 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3521/7276] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:15:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:15:16.827771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-848a1dbc-5373-4c4c-b82a-5096989e5f9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:15:17.180715 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-848a1dbc-5373-4c4c-b82a-5096989e5f9c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 204 len: 0 microversion: 2.1 time: 0.397026 Oct 11 05:15:17.181849 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3756/7277] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:15:16 2022] DELETE /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 0 bytes in 409 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:15:17.190657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d40c5288-6893-4587-96eb-4785173dc10b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:17.192123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d40c5288-6893-4587-96eb-4785173dc10b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:17.200359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40c5288-6893-4587-96eb-4785173dc10b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:17.200873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40c5288-6893-4587-96eb-4785173dc10b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:17.201545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40c5288-6893-4587-96eb-4785173dc10b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:17.202525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40c5288-6893-4587-96eb-4785173dc10b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:17.203000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40c5288-6893-4587-96eb-4785173dc10b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:17.203426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d40c5288-6893-4587-96eb-4785173dc10b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:17.340671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d40c5288-6893-4587-96eb-4785173dc10b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:17.348602 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d40c5288-6893-4587-96eb-4785173dc10b tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1577 microversion: 2.1 time: 0.162370 Oct 11 05:15:17.349190 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3522/7278] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:17 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:18.372815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ec2518f8-d486-4eaa-a01d-ec6074e9d12c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:18.373654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ec2518f8-d486-4eaa-a01d-ec6074e9d12c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:18.380431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec2518f8-d486-4eaa-a01d-ec6074e9d12c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:18.380925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec2518f8-d486-4eaa-a01d-ec6074e9d12c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:18.381372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec2518f8-d486-4eaa-a01d-ec6074e9d12c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:18.382131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec2518f8-d486-4eaa-a01d-ec6074e9d12c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:18.382614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec2518f8-d486-4eaa-a01d-ec6074e9d12c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:18.383049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec2518f8-d486-4eaa-a01d-ec6074e9d12c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:18.822988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ec2518f8-d486-4eaa-a01d-ec6074e9d12c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:18.831708 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ec2518f8-d486-4eaa-a01d-ec6074e9d12c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1391 microversion: 2.1 time: 0.463278 Oct 11 05:15:18.832595 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3757/7279] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:18 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1391 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:18.861873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f18e9c14-2a62-473f-b429-59c632f9e982 req-147b6c19-60bb-4270-95f1-353e7f2cace0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "119b35f6-1b21-40e6-84c5-484adf6f456a", "name": "network-vif-deleted", "tag": "ffabf5f8-3fa3-42c3-92a9-751b5af20398"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:15:18.873171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f18e9c14-2a62-473f-b429-59c632f9e982 req-147b6c19-60bb-4270-95f1-353e7f2cace0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:18.873679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f18e9c14-2a62-473f-b429-59c632f9e982 req-147b6c19-60bb-4270-95f1-353e7f2cace0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:18.874111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f18e9c14-2a62-473f-b429-59c632f9e982 req-147b6c19-60bb-4270-95f1-353e7f2cace0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:18.886590 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f18e9c14-2a62-473f-b429-59c632f9e982 req-147b6c19-60bb-4270-95f1-353e7f2cace0 service nova] Creating event network-vif-deleted:ffabf5f8-3fa3-42c3-92a9-751b5af20398 for instance 119b35f6-1b21-40e6-84c5-484adf6f456a on n-h1-860892-1 Oct 11 05:15:18.892110 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f18e9c14-2a62-473f-b429-59c632f9e982 req-147b6c19-60bb-4270-95f1-353e7f2cace0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033929 Oct 11 05:15:18.892725 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3523/7280] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:15:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:15:19.856591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee83575f-9334-4456-ba20-684d74af57ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:19.857321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee83575f-9334-4456-ba20-684d74af57ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:19.864402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee83575f-9334-4456-ba20-684d74af57ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:19.864974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee83575f-9334-4456-ba20-684d74af57ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:19.865518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee83575f-9334-4456-ba20-684d74af57ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:19.866324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee83575f-9334-4456-ba20-684d74af57ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:19.867755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee83575f-9334-4456-ba20-684d74af57ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:19.868269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee83575f-9334-4456-ba20-684d74af57ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:19.936247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee83575f-9334-4456-ba20-684d74af57ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:19.944236 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee83575f-9334-4456-ba20-684d74af57ca tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1226 microversion: 2.1 time: 0.091757 Oct 11 05:15:19.944819 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3758/7281] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:19 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1226 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:20.969730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-265cf877-8365-4052-8e3b-493294ce7d1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:20.970384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-265cf877-8365-4052-8e3b-493294ce7d1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:20.977368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265cf877-8365-4052-8e3b-493294ce7d1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:20.978028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265cf877-8365-4052-8e3b-493294ce7d1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:20.978497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265cf877-8365-4052-8e3b-493294ce7d1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:20.979190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265cf877-8365-4052-8e3b-493294ce7d1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:20.979648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265cf877-8365-4052-8e3b-493294ce7d1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:20.980082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-265cf877-8365-4052-8e3b-493294ce7d1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:21.048520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-265cf877-8365-4052-8e3b-493294ce7d1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:21.057365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-265cf877-8365-4052-8e3b-493294ce7d1e tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1226 microversion: 2.1 time: 0.093263 Oct 11 05:15:21.057948 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3524/7282] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:20 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1226 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:22.080480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f005d04f-0deb-435a-a9b1-18e38bc28c7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:22.081101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f005d04f-0deb-435a-a9b1-18e38bc28c7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:22.087716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f005d04f-0deb-435a-a9b1-18e38bc28c7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:22.088207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f005d04f-0deb-435a-a9b1-18e38bc28c7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:22.088662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f005d04f-0deb-435a-a9b1-18e38bc28c7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:22.089357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f005d04f-0deb-435a-a9b1-18e38bc28c7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:22.089819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f005d04f-0deb-435a-a9b1-18e38bc28c7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:22.090281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f005d04f-0deb-435a-a9b1-18e38bc28c7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:22.152395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f005d04f-0deb-435a-a9b1-18e38bc28c7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:22.160671 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f005d04f-0deb-435a-a9b1-18e38bc28c7c tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1226 microversion: 2.1 time: 0.084311 Oct 11 05:15:22.161303 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3759/7283] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:22 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1226 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:23.184961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-01ddb7eb-6f90-4937-a8f6-3c5be1fc34a4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:23.185603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-01ddb7eb-6f90-4937-a8f6-3c5be1fc34a4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:23.192478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01ddb7eb-6f90-4937-a8f6-3c5be1fc34a4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:23.192958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01ddb7eb-6f90-4937-a8f6-3c5be1fc34a4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:23.193396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01ddb7eb-6f90-4937-a8f6-3c5be1fc34a4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:23.194079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01ddb7eb-6f90-4937-a8f6-3c5be1fc34a4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:23.194559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01ddb7eb-6f90-4937-a8f6-3c5be1fc34a4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:23.194987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01ddb7eb-6f90-4937-a8f6-3c5be1fc34a4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:23.256227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-01ddb7eb-6f90-4937-a8f6-3c5be1fc34a4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a1c61d68e1a479bb0dc096271f4cbde', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb3af7529f52488f978ab296d9d4bf65', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:23.264311 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-01ddb7eb-6f90-4937-a8f6-3c5be1fc34a4 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 200 len: 1226 microversion: 2.1 time: 0.083250 Oct 11 05:15:23.264879 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3525/7284] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:23 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 1226 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:24.287034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:24.287605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 119b35f6-1b21-40e6-84c5-484adf6f456a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:24.294373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:24.294870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:24.295314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:24.296009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:24.296498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:24.296934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:24.310829 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance 119b35f6-1b21-40e6-84c5-484adf6f456a could not be found. Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a HTTP/1.1 Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 119b35f6-1b21-40e6-84c5-484adf6f456a could not be found. Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '119b35f6-1b21-40e6-84c5-484adf6f456a'} Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 119b35f6-1b21-40e6-84c5-484adf6f456a could not be found. Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 119b35f6-1b21-40e6-84c5-484adf6f456a could not be found. Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:15:24.312462 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:15:24.316491 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:24.316491 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:15:24.316491 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:15:24.316491 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:15:24.316491 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:15:24.316491 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 119b35f6-1b21-40e6-84c5-484adf6f456a could not be found. Oct 11 05:15:24.316491 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:15:24.316491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance 119b35f6-1b21-40e6-84c5-484adf6f456a could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:15:24.316491 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-27aecde6-c1ef-4e5d-8626-291ce8ecec05 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a" status: 404 len: 111 microversion: 2.1 time: 0.030815 Oct 11 05:15:24.316491 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3760/7285] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:24 2022] GET /compute/v2.1/servers/119b35f6-1b21-40e6-84c5-484adf6f456a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:15:24.972305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:24.972787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:24.980361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:24.980835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:24.981268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:24.981949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:24.982425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:24.982844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:24.996039 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 HTTP/1.1 Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '19d639ff-9924-43ba-9bd4-687cdad0c265'} Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:15:24.997714 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-59884c3c-94e3-4d22-8dae-db3025ecd716 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 404 len: 111 microversion: 2.1 time: 0.030973 Oct 11 05:15:25.001118 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3526/7286] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:15:24 2022] DELETE /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:15:25.007852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:25.008471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [instance: 19d639ff-9924-43ba-9bd4-687cdad0c265] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:25.014664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:25.015156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:25.015604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:25.016296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:25.016760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:25.017200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:25.030862 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] HTTP exception thrown: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Request method failure captured: Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 HTTP/1.1 Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPh9MMQkSQcB7C1KGyvSRarQCv03G6pxTiovfGCfb963lg8Y4MvuPpez2OA6mlpOQ2OIteKkz8k55Sq69qExzjs9-uf6g0YjL8ToHspsh9V9TC6QuESjfNRUmo2Y9mSSAitd9IK1PxIzEDgi4Q2RHtDSDrmybCa5iCMGqlHTOv2jM-Y Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/eb3af7529f52488f978ab296d9d4bf65"}]}] Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: eb3af7529f52488f978ab296d9d4bf65 Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestVolumeBootPattern-1986873641 Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 5a1c61d68e1a479bb0dc096271f4cbde Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestVolumeBootPattern-1986873641-project Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '19d639ff-9924-43ba-9bd4-687cdad0c265'} Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:15:25.032372 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:15:25.038050 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:15:25.038050 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:15:25.038050 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:15:25.038050 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:15:25.038050 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:15:25.038050 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. Oct 11 05:15:25.038050 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:15:25.038050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Returning 404 to user: Instance 19d639ff-9924-43ba-9bd4-687cdad0c265 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:15:25.038050 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d1c97c7-f00c-46bb-9dea-57e5e9926655 tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265" status: 404 len: 111 microversion: 2.1 time: 0.029925 Oct 11 05:15:25.038050 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3761/7287] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:25 2022] GET /compute/v2.1/servers/19d639ff-9924-43ba-9bd4-687cdad0c265 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:15:28.653110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3e9cb457-9b7d-4e07-b758-0e6c6404639a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] Calling method '.version_select at 0x7fda1e06cee0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:28.663440 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3e9cb457-9b7d-4e07-b758-0e6c6404639a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [e97bebfd-ed87-4f8d-a2d1-630722a087bb] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:15:29.672356 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [None req-3e9cb457-9b7d-4e07-b758-0e6c6404639a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] [e97bebfd-ed87-4f8d-a2d1-630722a087bb] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36458. Oct 11 05:15:29.740153 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3e9cb457-9b7d-4e07-b758-0e6c6404639a tempest-TestVolumeBootPattern-1986873641 tempest-TestVolumeBootPattern-1986873641-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1047921920" status: 202 len: 0 microversion: 2.1 time: 1.091174 Oct 11 05:15:29.740742 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3527/7288] 10.222.0.26 () {58 vars in 1263 bytes} [Tue Oct 11 05:15:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1047921920 => generated 0 bytes in 1092 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:15:49.951467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:15:49.952214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:15:50.061815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersAdminNegativeTestJSON-server-572736330", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:15:50.112654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] validate_networks() for None {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:15:50.405368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:15:50.405839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:15:50.406354 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:15:50.406783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:15:50.407239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:15:50.416460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:50.416951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:50.417402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:50.418137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:50.418628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:50.419069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:50.436127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Getting quotas for project 5007e4c33c6342d087d569a965b749dd. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:15:50.441278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Getting quotas for user 462288fc540048b4b59651ca7f24b955 and project 5007e4c33c6342d087d569a965b749dd. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:15:50.453460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:15:50.455800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:15:50.559070 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [fd29477b-7ff7-42a6-b28e-e29182e151e8] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:15:51.567424 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [fd29477b-7ff7-42a6-b28e-e29182e151e8] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36570. Oct 11 05:15:51.572279 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e1cffc8-5af0-43c9-8e96-2058ef7d9753 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.626982 Oct 11 05:15:51.572932 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3762/7289] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:15:49 2022] POST /compute/v2.1/servers => generated 380 bytes in 1628 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:15:51.583652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=48 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:15:51.594835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:15:51.594835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7255027d-3d39-4643-b9e2-1f085cf42a65 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:51.594835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7255027d-3d39-4643-b9e2-1f085cf42a65 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:51.646940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7255027d-3d39-4643-b9e2-1f085cf42a65 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:51.654835 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7255027d-3d39-4643-b9e2-1f085cf42a65 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1221 microversion: 2.1 time: 0.073185 Oct 11 05:15:51.655404 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3528/7290] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:51 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1221 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:52.677978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c9fc6919-4f11-4eb0-8c73-3adb02212445 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:52.678558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c9fc6919-4f11-4eb0-8c73-3adb02212445 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:52.684714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9fc6919-4f11-4eb0-8c73-3adb02212445 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:52.685229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9fc6919-4f11-4eb0-8c73-3adb02212445 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:52.685678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9fc6919-4f11-4eb0-8c73-3adb02212445 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:52.686406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9fc6919-4f11-4eb0-8c73-3adb02212445 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:52.686885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9fc6919-4f11-4eb0-8c73-3adb02212445 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:52.687328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c9fc6919-4f11-4eb0-8c73-3adb02212445 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:52.748620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c9fc6919-4f11-4eb0-8c73-3adb02212445 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:52.756371 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c9fc6919-4f11-4eb0-8c73-3adb02212445 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1225 microversion: 2.1 time: 0.083282 Oct 11 05:15:52.756942 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3763/7291] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:52 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:15:53.781096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35310057-4416-42ef-9dcc-c7f11187fdcf tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:53.781697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-35310057-4416-42ef-9dcc-c7f11187fdcf tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:53.790341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35310057-4416-42ef-9dcc-c7f11187fdcf tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:53.790838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35310057-4416-42ef-9dcc-c7f11187fdcf tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:53.791320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35310057-4416-42ef-9dcc-c7f11187fdcf tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:53.792015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35310057-4416-42ef-9dcc-c7f11187fdcf tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:53.792496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35310057-4416-42ef-9dcc-c7f11187fdcf tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:53.792925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35310057-4416-42ef-9dcc-c7f11187fdcf tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:53.858865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35310057-4416-42ef-9dcc-c7f11187fdcf tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:53.868182 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35310057-4416-42ef-9dcc-c7f11187fdcf tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1281 microversion: 2.1 time: 0.091080 Oct 11 05:15:53.868956 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3529/7292] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:53 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1281 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:54.891258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-240a09b8-7489-4d2c-a63d-8614acbf6e80 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:54.892432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-240a09b8-7489-4d2c-a63d-8614acbf6e80 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:54.902452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-240a09b8-7489-4d2c-a63d-8614acbf6e80 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:54.902950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-240a09b8-7489-4d2c-a63d-8614acbf6e80 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:54.903398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-240a09b8-7489-4d2c-a63d-8614acbf6e80 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:54.904112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-240a09b8-7489-4d2c-a63d-8614acbf6e80 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:54.904572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-240a09b8-7489-4d2c-a63d-8614acbf6e80 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:54.905011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-240a09b8-7489-4d2c-a63d-8614acbf6e80 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:55.463772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-240a09b8-7489-4d2c-a63d-8614acbf6e80 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:55.471615 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-240a09b8-7489-4d2c-a63d-8614acbf6e80 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1321 microversion: 2.1 time: 0.585021 Oct 11 05:15:55.472279 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3764/7293] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:54 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1321 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:56.099088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-45e1a9c5-03a7-44e1-a67e-4c8babf6a0f0 req-131403b7-5f39-49ff-933e-693a7f326d63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7dd1da4-f5c5-4cc7-90e9-783dec9459a3", "tag": "ebef1c3d-0790-45aa-82a9-e24e2e38252b"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:15:56.108432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-45e1a9c5-03a7-44e1-a67e-4c8babf6a0f0 req-131403b7-5f39-49ff-933e-693a7f326d63 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:56.108917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-45e1a9c5-03a7-44e1-a67e-4c8babf6a0f0 req-131403b7-5f39-49ff-933e-693a7f326d63 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:56.109356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-45e1a9c5-03a7-44e1-a67e-4c8babf6a0f0 req-131403b7-5f39-49ff-933e-693a7f326d63 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:56.122858 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-45e1a9c5-03a7-44e1-a67e-4c8babf6a0f0 req-131403b7-5f39-49ff-933e-693a7f326d63 service nova] Creating event network-changed:ebef1c3d-0790-45aa-82a9-e24e2e38252b for instance e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 on n-h1-860892-1 Oct 11 05:15:56.125791 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-45e1a9c5-03a7-44e1-a67e-4c8babf6a0f0 req-131403b7-5f39-49ff-933e-693a7f326d63 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033305 Oct 11 05:15:56.126428 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3530/7294] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:15:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:15:56.494787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f7e4a7c7-d194-4e60-8f70-35a9443dc6ab tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:56.495455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f7e4a7c7-d194-4e60-8f70-35a9443dc6ab tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:56.502446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7e4a7c7-d194-4e60-8f70-35a9443dc6ab tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:56.502965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7e4a7c7-d194-4e60-8f70-35a9443dc6ab tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:56.503400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7e4a7c7-d194-4e60-8f70-35a9443dc6ab tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:56.504112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7e4a7c7-d194-4e60-8f70-35a9443dc6ab tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:56.504578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7e4a7c7-d194-4e60-8f70-35a9443dc6ab tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:56.505019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7e4a7c7-d194-4e60-8f70-35a9443dc6ab tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:56.754745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f7e4a7c7-d194-4e60-8f70-35a9443dc6ab tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:56.762409 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f7e4a7c7-d194-4e60-8f70-35a9443dc6ab tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1321 microversion: 2.1 time: 0.271569 Oct 11 05:15:56.763746 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3765/7295] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:56 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:57.787314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ebf0c9d5-0806-4551-8afd-72e0555cfd58 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:57.787939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ebf0c9d5-0806-4551-8afd-72e0555cfd58 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:57.794755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebf0c9d5-0806-4551-8afd-72e0555cfd58 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:57.795242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebf0c9d5-0806-4551-8afd-72e0555cfd58 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:57.795682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebf0c9d5-0806-4551-8afd-72e0555cfd58 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:57.796370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebf0c9d5-0806-4551-8afd-72e0555cfd58 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:57.796827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebf0c9d5-0806-4551-8afd-72e0555cfd58 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:57.797257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ebf0c9d5-0806-4551-8afd-72e0555cfd58 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:57.924961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ebf0c9d5-0806-4551-8afd-72e0555cfd58 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:57.932624 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ebf0c9d5-0806-4551-8afd-72e0555cfd58 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1321 microversion: 2.1 time: 0.150721 Oct 11 05:15:57.933189 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3531/7296] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:57 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1321 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:15:58.955433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-86dc006e-40c3-45dc-b703-a6c54a2442d4 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:15:58.956069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-86dc006e-40c3-45dc-b703-a6c54a2442d4 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:15:58.963078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86dc006e-40c3-45dc-b703-a6c54a2442d4 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:58.963586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86dc006e-40c3-45dc-b703-a6c54a2442d4 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:58.964066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86dc006e-40c3-45dc-b703-a6c54a2442d4 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:58.964775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86dc006e-40c3-45dc-b703-a6c54a2442d4 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:15:58.965247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86dc006e-40c3-45dc-b703-a6c54a2442d4 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:15:58.965694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-86dc006e-40c3-45dc-b703-a6c54a2442d4 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:15:59.096225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-86dc006e-40c3-45dc-b703-a6c54a2442d4 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:15:59.104469 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-86dc006e-40c3-45dc-b703-a6c54a2442d4 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1321 microversion: 2.1 time: 0.153037 Oct 11 05:15:59.105077 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3766/7297] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:15:58 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:00.128140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1dada32-f904-430c-b33b-a6fe0be6eb29 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:00.128791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f1dada32-f904-430c-b33b-a6fe0be6eb29 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:00.136314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1dada32-f904-430c-b33b-a6fe0be6eb29 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:00.136794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1dada32-f904-430c-b33b-a6fe0be6eb29 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:00.137242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1dada32-f904-430c-b33b-a6fe0be6eb29 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:00.137940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1dada32-f904-430c-b33b-a6fe0be6eb29 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:00.138688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1dada32-f904-430c-b33b-a6fe0be6eb29 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:00.139118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1dada32-f904-430c-b33b-a6fe0be6eb29 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:00.277042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f1dada32-f904-430c-b33b-a6fe0be6eb29 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:00.285106 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f1dada32-f904-430c-b33b-a6fe0be6eb29 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1321 microversion: 2.1 time: 0.160870 Oct 11 05:16:00.285699 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3532/7298] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:00 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:01.307735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3fb57b7-58aa-45bc-ad37-68178035ea2c tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:01.308365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3fb57b7-58aa-45bc-ad37-68178035ea2c tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:01.311087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:01.311747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:01.316477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fb57b7-58aa-45bc-ad37-68178035ea2c tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:01.316971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fb57b7-58aa-45bc-ad37-68178035ea2c tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:01.317414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fb57b7-58aa-45bc-ad37-68178035ea2c tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:01.318154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fb57b7-58aa-45bc-ad37-68178035ea2c tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:01.318639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fb57b7-58aa-45bc-ad37-68178035ea2c tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:01.329227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3fb57b7-58aa-45bc-ad37-68178035ea2c tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:01.452745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3fb57b7-58aa-45bc-ad37-68178035ea2c tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:01.460494 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3fb57b7-58aa-45bc-ad37-68178035ea2c tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1321 microversion: 2.1 time: 0.156670 Oct 11 05:16:01.461070 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3767/7299] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:01 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:01.735809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:01.793406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6d2e8818-1f2d-47f8-9436-9f044080f6ac req-7a2b0a2a-bbc4-4638-b50e-bc89cdaba974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dd1da4-f5c5-4cc7-90e9-783dec9459a3", "name": "network-vif-plugged", "status": "completed", "tag": "ebef1c3d-0790-45aa-82a9-e24e2e38252b"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:01.802880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d2e8818-1f2d-47f8-9436-9f044080f6ac req-7a2b0a2a-bbc4-4638-b50e-bc89cdaba974 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:01.803366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d2e8818-1f2d-47f8-9436-9f044080f6ac req-7a2b0a2a-bbc4-4638-b50e-bc89cdaba974 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:01.803858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6d2e8818-1f2d-47f8-9436-9f044080f6ac req-7a2b0a2a-bbc4-4638-b50e-bc89cdaba974 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:01.816095 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6d2e8818-1f2d-47f8-9436-9f044080f6ac req-7a2b0a2a-bbc4-4638-b50e-bc89cdaba974 service nova] Creating event network-vif-plugged:ebef1c3d-0790-45aa-82a9-e24e2e38252b for instance e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 on n-h1-860892-1 Oct 11 05:16:01.821042 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6d2e8818-1f2d-47f8-9436-9f044080f6ac req-7a2b0a2a-bbc4-4638-b50e-bc89cdaba974 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090848 Oct 11 05:16:01.821807 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3533/7300] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:16:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:16:02.484453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-18002b41-9024-403d-a48b-613d555163ce tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:02.485177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-18002b41-9024-403d-a48b-613d555163ce tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:02.491921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18002b41-9024-403d-a48b-613d555163ce tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:02.492416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18002b41-9024-403d-a48b-613d555163ce tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:02.497867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18002b41-9024-403d-a48b-613d555163ce tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:02.497867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18002b41-9024-403d-a48b-613d555163ce tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:02.497867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18002b41-9024-403d-a48b-613d555163ce tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:02.497867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18002b41-9024-403d-a48b-613d555163ce tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:02.627045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-18002b41-9024-403d-a48b-613d555163ce tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:02.635335 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-18002b41-9024-403d-a48b-613d555163ce tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1321 microversion: 2.1 time: 0.154781 Oct 11 05:16:02.635954 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3768/7301] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:02 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:16:03.660649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-13c9a587-fe68-4d9b-a2ad-f899099c4d74 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:03.661343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-13c9a587-fe68-4d9b-a2ad-f899099c4d74 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:03.668364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13c9a587-fe68-4d9b-a2ad-f899099c4d74 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:03.668850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13c9a587-fe68-4d9b-a2ad-f899099c4d74 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:03.669282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13c9a587-fe68-4d9b-a2ad-f899099c4d74 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:03.669963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13c9a587-fe68-4d9b-a2ad-f899099c4d74 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:03.670517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13c9a587-fe68-4d9b-a2ad-f899099c4d74 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:03.670966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-13c9a587-fe68-4d9b-a2ad-f899099c4d74 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:03.799956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-13c9a587-fe68-4d9b-a2ad-f899099c4d74 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:03.807782 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-13c9a587-fe68-4d9b-a2ad-f899099c4d74 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1471 microversion: 2.1 time: 0.152350 Oct 11 05:16:03.808346 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3534/7302] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:03 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1471 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:03.879167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c1cebfab-8e02-459e-9bfc-f28077b93934 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Calling method '.version_select at 0x7fda18dcb160>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:03.941742 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c1cebfab-8e02-459e-9bfc-f28077b93934 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/839e713b80b44c69a50a58411166e98b" status: 200 len: 371 microversion: 2.1 time: 0.112740 Oct 11 05:16:03.942334 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3769/7303] 10.222.0.26 () {58 vars in 1242 bytes} [Tue Oct 11 05:16:03 2022] GET /compute/v2.1/os-quota-sets/839e713b80b44c69a50a58411166e98b => generated 371 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:16:03.954168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-548065e7-4915-457a-8983-43f38123509b tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 51201, "vcpus": 1, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-2137078438", "id": 1109783949, "os-flavor-access:is_public": "True"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:04.012042 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-548065e7-4915-457a-8983-43f38123509b tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 438 microversion: 2.1 time: 0.061701 Oct 11 05:16:04.012619 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3535/7304] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:16:03 2022] POST /compute/v2.1/flavors => generated 438 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:16:04.025660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "1109783949"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:04.028000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:04.033969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:04.034487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:04.034940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:04.035632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:04.036092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:04.036532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:04.118799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '861a6eaf840e419b89cc896250016683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839e713b80b44c69a50a58411166e98b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:04.124555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-2137078438 {{(pid=120994) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 05:16:04.130936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:04.131420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:04.131857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:04.132578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:04.133029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:04.133458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:04.155351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Getting quotas for project 5007e4c33c6342d087d569a965b749dd. Resources: {'cores', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:16:04.160329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Getting quotas for user 462288fc540048b4b59651ca7f24b955 and project 5007e4c33c6342d087d569a965b749dd. Resources: {'cores', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:16:04.172158 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.api [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] ram quota exceeded for 839e713b80b44c69a50a58411166e98b, tried to resize instance. Oct 11 05:16:04.172637 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] HTTP exception thrown: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Request method failure captured: Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3/action HTTP/1.1 Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 39 Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPwFEVqW3VUd1SG6Id0y8cLjxSBBWKNo-FdAaTsUyzbVQy6NGLFfKVfixvDjA4-B-Xs3inLYLCjnAB2phl-_UIUU5EnZKKNTFlSdc23evqLmPQ1LVWP3vPkMtYxyBCRai-E_V1DD0Hq0IhKE8xIWrmj4-enUP3Mh5tGDuPTViRobsJc Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 839e713b80b44c69a50a58411166e98b Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2061682888 Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,admin,member Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,admin,member Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/839e713b80b44c69a50a58411166e98b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_839e713b80b44c69a50a58411166e98b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839e713b80b44c69a50a58411166e98b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839e713b80b44c69a50a58411166e98b"}]}] Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2061682888 Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 839e713b80b44c69a50a58411166e98b Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2061682888 Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersAdminNegativeTestJSON-2061682888-project-admin Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 861a6eaf840e419b89cc896250016683 Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2061682888-project-admin Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: {"resize": {"flavorRef": "1109783949"}} Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: exception: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'e7dd1da4-f5c5-4cc7-90e9-783dec9459a3', 'body': {'resize': {'flavorRef': '1109783949'}}} Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['ram'] Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 05:16:04.180104 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Returning 403 to user: Quota exceeded for ram: Requested 50177, but already used 1024 of 51200 ram {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb2d6db7-8810-4491-af20-c36365d43761 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3/action" status: 403 len: 118 microversion: 2.1 time: 0.160275 Oct 11 05:16:04.184175 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3770/7305] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:16:04 2022] POST /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3/action => generated 118 bytes in 161 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:16:04.190327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69f1fc36-305c-4eff-8efe-6cd6b710ea2d tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:04.264474 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69f1fc36-305c-4eff-8efe-6cd6b710ea2d tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/1109783949" status: 202 len: 0 microversion: 2.1 time: 0.077792 Oct 11 05:16:04.265039 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3536/7306] 10.222.0.26 () {58 vars in 1161 bytes} [Tue Oct 11 05:16:04 2022] DELETE /compute/v2.1/flavors/1109783949 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 05:16:04.272912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-11365f90-1e2d-4ec4-b444-6dd382f66b79 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:04.296365 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-11365f90-1e2d-4ec4-b444-6dd382f66b79 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.027134 Oct 11 05:16:04.296924 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3771/7307] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 05:16:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:04.317074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bd04cde3-8b29-4dbf-9387-f01b178e03ed tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Calling method '.version_select at 0x7fda18a6b0d0>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:04.382116 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bd04cde3-8b29-4dbf-9387-f01b178e03ed tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] 10.222.0.26 "GET /compute/v2.1/os-quota-sets/839e713b80b44c69a50a58411166e98b" status: 200 len: 371 microversion: 2.1 time: 0.068783 Oct 11 05:16:04.382703 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3537/7308] 10.222.0.26 () {58 vars in 1242 bytes} [Tue Oct 11 05:16:04 2022] GET /compute/v2.1/os-quota-sets/839e713b80b44c69a50a58411166e98b => generated 371 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:16:04.395178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-24e58788-b67f-4502-81b0-d525e376e065 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 21, "disk": 5, "name": "tempest-ServersAdminNegativeTestJSON-flavor-858272994", "id": 224326181, "os-flavor-access:is_public": "True"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:04.473101 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-24e58788-b67f-4502-81b0-d525e376e065 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 433 microversion: 2.1 time: 0.081585 Oct 11 05:16:04.473634 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3772/7309] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:16:04 2022] POST /compute/v2.1/flavors => generated 433 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:16:04.485855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "224326181"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:04.488231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:04.494752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:04.495222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:04.495663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:04.496353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:04.496808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:04.497238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:04.673449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': True, 'user_id': '861a6eaf840e419b89cc896250016683', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '839e713b80b44c69a50a58411166e98b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:04.679613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Old instance type m1.heat2, new instance type tempest-ServersAdminNegativeTestJSON-flavor-858272994 {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 05:16:04.686977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:04.687453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:04.687885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:04.688603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:04.689053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:04.689476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:04.712249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Getting quotas for project 5007e4c33c6342d087d569a965b749dd. Resources: {'cores', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:16:04.717314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Getting quotas for user 462288fc540048b4b59651ca7f24b955 and project 5007e4c33c6342d087d569a965b749dd. Resources: {'cores', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:16:04.729242 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.compute.api [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] cores quota exceeded for 839e713b80b44c69a50a58411166e98b, tried to resize instance. Oct 11 05:16:04.729715 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] HTTP exception thrown: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Request method failure captured: Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3/action HTTP/1.1 Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 38 Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPwFEVqW3VUd1SG6Id0y8cLjxSBBWKNo-FdAaTsUyzbVQy6NGLFfKVfixvDjA4-B-Xs3inLYLCjnAB2phl-_UIUU5EnZKKNTFlSdc23evqLmPQ1LVWP3vPkMtYxyBCRai-E_V1DD0Hq0IhKE8xIWrmj4-enUP3Mh5tGDuPTViRobsJc Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 839e713b80b44c69a50a58411166e98b Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-2061682888 Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,admin,member Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,admin,member Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/839e713b80b44c69a50a58411166e98b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_839e713b80b44c69a50a58411166e98b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839e713b80b44c69a50a58411166e98b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/839e713b80b44c69a50a58411166e98b"}]}] Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAdminNegativeTestJSON-2061682888 Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 839e713b80b44c69a50a58411166e98b Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-2061682888 Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAdminNegativeTestJSON-2061682888-project-admin Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 861a6eaf840e419b89cc896250016683 Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAdminNegativeTestJSON-2061682888-project-admin Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: {"resize": {"flavorRef": "224326181"}} Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: exception: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e7dd1da4-f5c5-4cc7-90e9-783dec9459a3', 'body': {'resize': {'flavorRef': '224326181'}}} Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3878, in _check_quota_for_upsize Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi objects.Quotas.check_deltas(context, res_deltas, Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 370, in check_deltas Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 365, in check_deltas Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi cls.limit_check_project_and_user(context, **check_kwargs) Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/quotas.py", line 298, in limit_check_project_and_user Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return quota.QUOTAS.limit_check_project_and_user(context, Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 1150, in limit_check_project_and_user Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return self._driver.limit_check_project_and_user( Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/quota.py", line 613, in limit_check_project_and_user Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.OverQuota(overs=sorted(overs), Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.OverQuota: Quota exceeded for resources: ['cores'] Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 05:16:04.731791 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4244, in resize Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._check_quota_for_upsize(context, instance, Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 3896, in _check_quota_for_upsize Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.TooManyInstances(overs=overs, Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.TooManyInstances: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1056, in _resize Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPForbidden( Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPForbidden: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Returning 403 to user: Quota exceeded for cores: Requested 20, but already used 1 of 20 cores {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90e843d1-e597-41fc-b23b-02aba320af4f tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] 10.222.0.26 "POST /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3/action" status: 403 len: 113 microversion: 2.1 time: 0.251277 Oct 11 05:16:04.735937 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3538/7310] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:16:04 2022] POST /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3/action => generated 113 bytes in 252 msecs (HTTP/1.1 403) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:16:04.741921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-048a2bdb-b9a0-4576-b2b3-80c7dd9234b5 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:04.815607 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-048a2bdb-b9a0-4576-b2b3-80c7dd9234b5 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] 10.222.0.26 "DELETE /compute/v2.1/flavors/224326181" status: 202 len: 0 microversion: 2.1 time: 0.077333 Oct 11 05:16:04.816159 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3773/7311] 10.222.0.26 () {58 vars in 1158 bytes} [Tue Oct 11 05:16:04 2022] DELETE /compute/v2.1/flavors/224326181 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:16:04.824548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a1d90463-1bba-4d93-a9bf-ceb72fec42d5 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:04.844895 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a1d90463-1bba-4d93-a9bf-ceb72fec42d5 tempest-ServersAdminNegativeTestJSON-2061682888 tempest-ServersAdminNegativeTestJSON-2061682888-project-admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 4991 microversion: 2.1 time: 0.024529 Oct 11 05:16:04.846352 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3539/7312] 10.222.0.26 () {58 vars in 1146 bytes} [Tue Oct 11 05:16:04 2022] GET /compute/v2.1/flavors/detail => generated 4991 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:04.866683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9691c300-a014-4e3b-aa57-f723522ddcac tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:04.867201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9691c300-a014-4e3b-aa57-f723522ddcac tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:04.875694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9691c300-a014-4e3b-aa57-f723522ddcac tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:04.876206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9691c300-a014-4e3b-aa57-f723522ddcac tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:04.876663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9691c300-a014-4e3b-aa57-f723522ddcac tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:04.877375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9691c300-a014-4e3b-aa57-f723522ddcac tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:04.877849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9691c300-a014-4e3b-aa57-f723522ddcac tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:04.878336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9691c300-a014-4e3b-aa57-f723522ddcac tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:04.902628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9691c300-a014-4e3b-aa57-f723522ddcac tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:16:05.178153 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9691c300-a014-4e3b-aa57-f723522ddcac tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 204 len: 0 microversion: 2.1 time: 0.315215 Oct 11 05:16:05.178779 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3774/7313] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:16:04 2022] DELETE /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:16:05.187407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c162565b-4b6f-4b85-8d62-8672dde87a21 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:05.192452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c162565b-4b6f-4b85-8d62-8672dde87a21 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:05.195943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c162565b-4b6f-4b85-8d62-8672dde87a21 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:05.196432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c162565b-4b6f-4b85-8d62-8672dde87a21 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:05.196869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c162565b-4b6f-4b85-8d62-8672dde87a21 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:05.197556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c162565b-4b6f-4b85-8d62-8672dde87a21 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:05.198005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c162565b-4b6f-4b85-8d62-8672dde87a21 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:05.198463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c162565b-4b6f-4b85-8d62-8672dde87a21 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:05.325358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c162565b-4b6f-4b85-8d62-8672dde87a21 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:05.333010 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c162565b-4b6f-4b85-8d62-8672dde87a21 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1477 microversion: 2.1 time: 0.149427 Oct 11 05:16:05.333575 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3540/7314] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:05 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1477 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:06.356634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8ebd8e38-a1a6-4c84-b1a3-55e5060b033f tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:06.357346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8ebd8e38-a1a6-4c84-b1a3-55e5060b033f tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:06.364134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ebd8e38-a1a6-4c84-b1a3-55e5060b033f tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:06.364620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ebd8e38-a1a6-4c84-b1a3-55e5060b033f tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:06.365065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ebd8e38-a1a6-4c84-b1a3-55e5060b033f tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:06.365755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ebd8e38-a1a6-4c84-b1a3-55e5060b033f tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:06.366269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ebd8e38-a1a6-4c84-b1a3-55e5060b033f tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:06.366706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8ebd8e38-a1a6-4c84-b1a3-55e5060b033f tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:06.496621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8ebd8e38-a1a6-4c84-b1a3-55e5060b033f tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:06.504385 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8ebd8e38-a1a6-4c84-b1a3-55e5060b033f tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1477 microversion: 2.1 time: 0.152627 Oct 11 05:16:06.504964 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3775/7315] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:06 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1477 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:07.090141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-bbcbcba3-2050-4285-bef1-f8788ba1fef2 req-deb6111a-691d-44b2-9f0e-0c7428d63382 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7dd1da4-f5c5-4cc7-90e9-783dec9459a3", "name": "network-vif-deleted", "tag": "ebef1c3d-0790-45aa-82a9-e24e2e38252b"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:07.102535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bbcbcba3-2050-4285-bef1-f8788ba1fef2 req-deb6111a-691d-44b2-9f0e-0c7428d63382 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:07.103553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bbcbcba3-2050-4285-bef1-f8788ba1fef2 req-deb6111a-691d-44b2-9f0e-0c7428d63382 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:07.103987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bbcbcba3-2050-4285-bef1-f8788ba1fef2 req-deb6111a-691d-44b2-9f0e-0c7428d63382 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:07.120059 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-bbcbcba3-2050-4285-bef1-f8788ba1fef2 req-deb6111a-691d-44b2-9f0e-0c7428d63382 service nova] Creating event network-vif-deleted:ebef1c3d-0790-45aa-82a9-e24e2e38252b for instance e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 on n-h1-860892-1 Oct 11 05:16:07.125241 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-bbcbcba3-2050-4285-bef1-f8788ba1fef2 req-deb6111a-691d-44b2-9f0e-0c7428d63382 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038770 Oct 11 05:16:07.129891 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3541/7316] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:16:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:16:07.528178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:07.528945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:07.535774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:07.536248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:07.536680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:07.537381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:07.537873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:07.538335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:07.570810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:07.571328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:07.572434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:07.572905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lazy-loading 'fault' on Instance uuid e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:16:07.613339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '462288fc540048b4b59651ca7f24b955', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5007e4c33c6342d087d569a965b749dd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:07.621794 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5ec45a2a-3b18-44e4-9fa7-95de39555d53 tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 200 len: 1311 microversion: 2.1 time: 0.097555 Oct 11 05:16:07.622395 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3776/7317] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:07 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:16:08.646467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:08.647188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] [instance: e7dd1da4-f5c5-4cc7-90e9-783dec9459a3] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:08.653309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:08.653780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:08.654234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:08.654912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:08.655366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:08.655787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:08.669258 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] HTTP exception thrown: Instance e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 could not be found. Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Request method failure captured: Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 HTTP/1.1 Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPwFVAx1oKE25ZaJVVV1lrOuxLg_QahUXlxQjtCtDspXmyE6GzenyLg7lQow35a1F9wC0GyBqAgYB3mIRMMq8DN5Hmft3zGNtuu7JEX6t7gb4n8XkW8uLzEgwzDuzApSE4VgKmwIlpgg12hxSt9cgcUbfDVy99TNvJYrehB5boVspXA Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 5007e4c33c6342d087d569a965b749dd Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersAdminNegativeTestJSON-1614542393 Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5007e4c33c6342d087d569a965b749dd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5007e4c33c6342d087d569a965b749dd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5007e4c33c6342d087d569a965b749dd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5007e4c33c6342d087d569a965b749dd"}]}] Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersAdminNegativeTestJSON-1614542393 Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 5007e4c33c6342d087d569a965b749dd Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersAdminNegativeTestJSON-1614542393 Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersAdminNegativeTestJSON-1614542393-project Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 462288fc540048b4b59651ca7f24b955 Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersAdminNegativeTestJSON-1614542393-project Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 could not be found. Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'e7dd1da4-f5c5-4cc7-90e9-783dec9459a3'} Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 could not be found. Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 could not be found. Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:08.673081 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:16:08.677244 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:08.677244 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:16:08.677244 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:16:08.677244 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:16:08.677244 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:16:08.677244 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:16:08.677244 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 could not be found. Oct 11 05:16:08.677244 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:16:08.677244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] Returning 404 to user: Instance e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:16:08.677244 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7269dc12-2834-459a-8142-92ec9703f14b tempest-ServersAdminNegativeTestJSON-1614542393 tempest-ServersAdminNegativeTestJSON-1614542393-project] 10.222.0.26 "GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3" status: 404 len: 111 microversion: 2.1 time: 0.030916 Oct 11 05:16:08.677244 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3542/7318] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:08 2022] GET /compute/v2.1/servers/e7dd1da4-f5c5-4cc7-90e9-783dec9459a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:16:17.044838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:17.045622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:17.162672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1927159622", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "1e26c4f2-85c3-4671-a788-ad4108a6e293"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:17.219027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] validate_networks() for [('1e26c4f2-85c3-4671-a788-ad4108a6e293', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:16:17.594444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:16:17.594588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:16:17.594983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:16:17.595400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:16:17.595821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:16:17.605748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:17.606277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:17.606788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:17.607531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:17.607994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:17.608431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:17.629445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Getting quotas for project 63cf35b893984b63abcb56db605600bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:16:17.631348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Getting quotas for user d8a5a6013e40474e8bf92042ea551b0e and project 63cf35b893984b63abcb56db605600bc. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:16:17.646396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:16:17.649383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:16:17.766777 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31f64db0-493e-4122-9746-a30c9802cfba tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.727716 Oct 11 05:16:17.767512 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3777/7319] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:16:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:16:17.779338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9807aa0a-bacf-49b2-86ff-79c13bad7237 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:17.780727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9807aa0a-bacf-49b2-86ff-79c13bad7237 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:17.783895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:17.784589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:17.842665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9807aa0a-bacf-49b2-86ff-79c13bad7237 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:17.851186 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9807aa0a-bacf-49b2-86ff-79c13bad7237 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1215 microversion: 2.1 time: 0.076257 Oct 11 05:16:17.855370 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3543/7320] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:17 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1215 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:18.874458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ae9a7ef-e23d-4196-8c1f-896783ba9f7a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:18.875117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5ae9a7ef-e23d-4196-8c1f-896783ba9f7a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:18.929775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5ae9a7ef-e23d-4196-8c1f-896783ba9f7a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:18.938499 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5ae9a7ef-e23d-4196-8c1f-896783ba9f7a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1215 microversion: 2.1 time: 0.068468 Oct 11 05:16:18.939095 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3778/7321] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:18 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1215 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:19.961554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cde24c51-5035-4319-949f-c1f3d2504f39 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:19.962247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cde24c51-5035-4319-949f-c1f3d2504f39 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:19.965923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=51 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:19.972501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cde24c51-5035-4319-949f-c1f3d2504f39 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:19.972988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cde24c51-5035-4319-949f-c1f3d2504f39 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:19.973561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cde24c51-5035-4319-949f-c1f3d2504f39 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:19.974491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cde24c51-5035-4319-949f-c1f3d2504f39 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:19.974947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cde24c51-5035-4319-949f-c1f3d2504f39 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:19.975528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cde24c51-5035-4319-949f-c1f3d2504f39 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:20.049551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cde24c51-5035-4319-949f-c1f3d2504f39 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:20.059165 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cde24c51-5035-4319-949f-c1f3d2504f39 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1267 microversion: 2.1 time: 0.102041 Oct 11 05:16:20.062968 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3544/7322] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:19 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1267 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:21.083165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-18e40a9e-b538-4f23-ab2d-5ac735f537e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:21.083821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-18e40a9e-b538-4f23-ab2d-5ac735f537e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:21.085689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=7,nova_api:DELETE=3,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:21.090657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e40a9e-b538-4f23-ab2d-5ac735f537e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:21.091150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e40a9e-b538-4f23-ab2d-5ac735f537e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:21.091601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e40a9e-b538-4f23-ab2d-5ac735f537e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:21.092302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e40a9e-b538-4f23-ab2d-5ac735f537e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:21.092764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e40a9e-b538-4f23-ab2d-5ac735f537e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:21.093198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-18e40a9e-b538-4f23-ab2d-5ac735f537e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:21.097186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:21.155942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-18e40a9e-b538-4f23-ab2d-5ac735f537e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:21.163661 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-18e40a9e-b538-4f23-ab2d-5ac735f537e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1273 microversion: 2.1 time: 0.084805 Oct 11 05:16:21.164223 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3779/7323] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:21 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:22.182672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f3dc857f-502c-4532-861e-c210df090f6d req-a76d3660-3964-4613-a64b-a5796412279a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779fed52-87d7-4cd2-8205-a544b4768a6b", "tag": "0f5ade61-425c-40ea-bc5f-3f022393b5dc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:22.188080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7f49be31-7292-406f-a460-9b4048cc1b99 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:22.189209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7f49be31-7292-406f-a460-9b4048cc1b99 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:22.194370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f3dc857f-502c-4532-861e-c210df090f6d req-a76d3660-3964-4613-a64b-a5796412279a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:22.195194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f3dc857f-502c-4532-861e-c210df090f6d req-a76d3660-3964-4613-a64b-a5796412279a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:22.195580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f3dc857f-502c-4532-861e-c210df090f6d req-a76d3660-3964-4613-a64b-a5796412279a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:22.196064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f49be31-7292-406f-a460-9b4048cc1b99 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:22.196561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f49be31-7292-406f-a460-9b4048cc1b99 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:22.197004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f49be31-7292-406f-a460-9b4048cc1b99 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:22.198426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f49be31-7292-406f-a460-9b4048cc1b99 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:22.198890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f49be31-7292-406f-a460-9b4048cc1b99 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:22.199329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f49be31-7292-406f-a460-9b4048cc1b99 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:22.208641 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f3dc857f-502c-4532-861e-c210df090f6d req-a76d3660-3964-4613-a64b-a5796412279a service nova] Creating event network-changed:0f5ade61-425c-40ea-bc5f-3f022393b5dc for instance 779fed52-87d7-4cd2-8205-a544b4768a6b on n-h1-860892-1 Oct 11 05:16:22.214395 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f3dc857f-502c-4532-861e-c210df090f6d req-a76d3660-3964-4613-a64b-a5796412279a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035120 Oct 11 05:16:22.215352 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3545/7324] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:16:22.433197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7f49be31-7292-406f-a460-9b4048cc1b99 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:22.441135 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7f49be31-7292-406f-a460-9b4048cc1b99 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1315 microversion: 2.1 time: 0.258257 Oct 11 05:16:22.443945 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3780/7325] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:22 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1315 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:23.466572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-480262dc-4a09-486b-a87a-6e5a7a27896f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:23.467271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-480262dc-4a09-486b-a87a-6e5a7a27896f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:23.473472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-480262dc-4a09-486b-a87a-6e5a7a27896f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:23.473952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-480262dc-4a09-486b-a87a-6e5a7a27896f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:23.474424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-480262dc-4a09-486b-a87a-6e5a7a27896f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:23.475104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-480262dc-4a09-486b-a87a-6e5a7a27896f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:23.475557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-480262dc-4a09-486b-a87a-6e5a7a27896f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:23.475985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-480262dc-4a09-486b-a87a-6e5a7a27896f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:23.605931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-480262dc-4a09-486b-a87a-6e5a7a27896f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:23.613871 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-480262dc-4a09-486b-a87a-6e5a7a27896f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1315 microversion: 2.1 time: 0.152916 Oct 11 05:16:23.614474 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3546/7326] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:23 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:24.638865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4e7ebc4f-2dc9-4a7f-98cb-798cf39c6bfd tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:24.639641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4e7ebc4f-2dc9-4a7f-98cb-798cf39c6bfd tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:24.647005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7ebc4f-2dc9-4a7f-98cb-798cf39c6bfd tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:24.647508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7ebc4f-2dc9-4a7f-98cb-798cf39c6bfd tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:24.647987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7ebc4f-2dc9-4a7f-98cb-798cf39c6bfd tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:24.648694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7ebc4f-2dc9-4a7f-98cb-798cf39c6bfd tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:24.649200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7ebc4f-2dc9-4a7f-98cb-798cf39c6bfd tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:24.649676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4e7ebc4f-2dc9-4a7f-98cb-798cf39c6bfd tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:24.780716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4e7ebc4f-2dc9-4a7f-98cb-798cf39c6bfd tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:24.789162 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4e7ebc4f-2dc9-4a7f-98cb-798cf39c6bfd tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1315 microversion: 2.1 time: 0.156030 Oct 11 05:16:24.789766 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3781/7327] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:24 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:25.813093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b1eb0732-01b7-442b-b7f3-6a2da5b908b5 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:25.813713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b1eb0732-01b7-442b-b7f3-6a2da5b908b5 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:25.816537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:DELETE=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:25.822587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1eb0732-01b7-442b-b7f3-6a2da5b908b5 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:25.822587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1eb0732-01b7-442b-b7f3-6a2da5b908b5 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:25.822587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1eb0732-01b7-442b-b7f3-6a2da5b908b5 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:25.823029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1eb0732-01b7-442b-b7f3-6a2da5b908b5 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:25.823479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1eb0732-01b7-442b-b7f3-6a2da5b908b5 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:25.823908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b1eb0732-01b7-442b-b7f3-6a2da5b908b5 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:25.960954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b1eb0732-01b7-442b-b7f3-6a2da5b908b5 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:25.969268 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b1eb0732-01b7-442b-b7f3-6a2da5b908b5 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1315 microversion: 2.1 time: 0.160158 Oct 11 05:16:25.969839 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3547/7328] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:25 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:26.992484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-59f95c9d-912d-4f31-8083-6311ec5db468 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:26.993063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-59f95c9d-912d-4f31-8083-6311ec5db468 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:26.999885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59f95c9d-912d-4f31-8083-6311ec5db468 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:27.000378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59f95c9d-912d-4f31-8083-6311ec5db468 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:27.000823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59f95c9d-912d-4f31-8083-6311ec5db468 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:27.001514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59f95c9d-912d-4f31-8083-6311ec5db468 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:27.002004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59f95c9d-912d-4f31-8083-6311ec5db468 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:27.002467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59f95c9d-912d-4f31-8083-6311ec5db468 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:27.129886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-59f95c9d-912d-4f31-8083-6311ec5db468 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:27.137570 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-59f95c9d-912d-4f31-8083-6311ec5db468 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1315 microversion: 2.1 time: 0.149091 Oct 11 05:16:27.138146 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3782/7329] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:26 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:27.818042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c0598d16-5b96-407d-a94a-65f35062df3e req-15f4efe7-3154-43dd-bdca-52442d845590 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779fed52-87d7-4cd2-8205-a544b4768a6b", "name": "network-vif-plugged", "status": "completed", "tag": "0f5ade61-425c-40ea-bc5f-3f022393b5dc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:27.829867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c0598d16-5b96-407d-a94a-65f35062df3e req-15f4efe7-3154-43dd-bdca-52442d845590 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:27.830363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c0598d16-5b96-407d-a94a-65f35062df3e req-15f4efe7-3154-43dd-bdca-52442d845590 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:27.830790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c0598d16-5b96-407d-a94a-65f35062df3e req-15f4efe7-3154-43dd-bdca-52442d845590 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:27.841623 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c0598d16-5b96-407d-a94a-65f35062df3e req-15f4efe7-3154-43dd-bdca-52442d845590 service nova] Creating event network-vif-plugged:0f5ade61-425c-40ea-bc5f-3f022393b5dc for instance 779fed52-87d7-4cd2-8205-a544b4768a6b on n-h1-860892-1 Oct 11 05:16:27.846745 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c0598d16-5b96-407d-a94a-65f35062df3e req-15f4efe7-3154-43dd-bdca-52442d845590 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032445 Oct 11 05:16:27.847377 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3548/7330] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:16:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:16:28.160100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ebe7f416-8d65-4f2c-8295-c8873e72b1cb tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:28.160728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ebe7f416-8d65-4f2c-8295-c8873e72b1cb tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:28.162699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:28.168362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe7f416-8d65-4f2c-8295-c8873e72b1cb tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:28.168860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe7f416-8d65-4f2c-8295-c8873e72b1cb tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:28.169790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe7f416-8d65-4f2c-8295-c8873e72b1cb tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:28.170542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe7f416-8d65-4f2c-8295-c8873e72b1cb tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:28.171011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe7f416-8d65-4f2c-8295-c8873e72b1cb tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:28.171452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ebe7f416-8d65-4f2c-8295-c8873e72b1cb tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:28.299691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ebe7f416-8d65-4f2c-8295-c8873e72b1cb tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:28.307348 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ebe7f416-8d65-4f2c-8295-c8873e72b1cb tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1315 microversion: 2.1 time: 0.151130 Oct 11 05:16:28.307919 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3783/7331] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:28 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:29.332280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d0c105ac-a130-4bcb-8ae7-fe52df03ea42 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:29.332978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d0c105ac-a130-4bcb-8ae7-fe52df03ea42 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:29.339623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0c105ac-a130-4bcb-8ae7-fe52df03ea42 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:29.340102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0c105ac-a130-4bcb-8ae7-fe52df03ea42 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:29.340536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0c105ac-a130-4bcb-8ae7-fe52df03ea42 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:29.341708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0c105ac-a130-4bcb-8ae7-fe52df03ea42 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:29.342160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0c105ac-a130-4bcb-8ae7-fe52df03ea42 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:29.342612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0c105ac-a130-4bcb-8ae7-fe52df03ea42 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:29.474899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d0c105ac-a130-4bcb-8ae7-fe52df03ea42 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:29.483289 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d0c105ac-a130-4bcb-8ae7-fe52df03ea42 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1315 microversion: 2.1 time: 0.156265 Oct 11 05:16:29.484765 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3549/7332] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:29 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:30.505560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6d66f67d-1557-41a1-ba81-28e1887e8609 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:30.506109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6d66f67d-1557-41a1-ba81-28e1887e8609 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:30.508005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:30.514215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d66f67d-1557-41a1-ba81-28e1887e8609 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:30.514729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d66f67d-1557-41a1-ba81-28e1887e8609 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:30.515181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d66f67d-1557-41a1-ba81-28e1887e8609 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:30.515886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d66f67d-1557-41a1-ba81-28e1887e8609 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:30.516349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d66f67d-1557-41a1-ba81-28e1887e8609 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:30.516785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6d66f67d-1557-41a1-ba81-28e1887e8609 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:30.655691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6d66f67d-1557-41a1-ba81-28e1887e8609 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:30.663945 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6d66f67d-1557-41a1-ba81-28e1887e8609 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1502 microversion: 2.1 time: 0.162344 Oct 11 05:16:30.666273 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3784/7333] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:30 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1502 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:30.686996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:30.689241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:30.691203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:30.697495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:30.699026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:30.699026 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:30.699379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:30.699589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:30.700018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:30.733478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:30.739505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Old instance type m1.heat2, new instance type m1.heat {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 05:16:30.746067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:16:30.746514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:16:30.746993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:16:30.747403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:16:30.747815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:16:30.962703 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [790fba40-e25d-493f-a79e-7c9f164f0720] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:16:31.970222 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [790fba40-e25d-493f-a79e-7c9f164f0720] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 36768. Oct 11 05:16:31.973744 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fe71d635-e3a6-4e8b-bf59-7a7e0d97cf83 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "POST /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b/action" status: 202 len: 0 microversion: 2.1 time: 1.290738 Oct 11 05:16:31.974415 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3550/7334] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:16:30 2022] POST /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b/action => generated 0 bytes in 1292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:16:31.982539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-78eef054-7260-4fb7-b8be-f9c914c27f9f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:31.983167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-78eef054-7260-4fb7-b8be-f9c914c27f9f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:31.989991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78eef054-7260-4fb7-b8be-f9c914c27f9f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:31.990533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78eef054-7260-4fb7-b8be-f9c914c27f9f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:31.990983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78eef054-7260-4fb7-b8be-f9c914c27f9f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:31.991694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78eef054-7260-4fb7-b8be-f9c914c27f9f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:31.992157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78eef054-7260-4fb7-b8be-f9c914c27f9f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:31.992596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78eef054-7260-4fb7-b8be-f9c914c27f9f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:32.120427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-78eef054-7260-4fb7-b8be-f9c914c27f9f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:32.128554 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-78eef054-7260-4fb7-b8be-f9c914c27f9f tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1511 microversion: 2.1 time: 0.150005 Oct 11 05:16:32.129171 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3785/7335] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:31 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1511 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:33.152463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1dcd2411-16e6-4e4e-924f-e74032231a04 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:33.153076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1dcd2411-16e6-4e4e-924f-e74032231a04 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:33.160554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dcd2411-16e6-4e4e-924f-e74032231a04 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:33.164004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dcd2411-16e6-4e4e-924f-e74032231a04 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:33.164004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dcd2411-16e6-4e4e-924f-e74032231a04 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:33.164004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dcd2411-16e6-4e4e-924f-e74032231a04 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:33.164004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dcd2411-16e6-4e4e-924f-e74032231a04 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:33.164004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dcd2411-16e6-4e4e-924f-e74032231a04 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:33.293493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1dcd2411-16e6-4e4e-924f-e74032231a04 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:33.302150 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1dcd2411-16e6-4e4e-924f-e74032231a04 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1511 microversion: 2.1 time: 0.154362 Oct 11 05:16:33.305413 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3551/7336] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:33 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1511 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:34.324941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d2d515b0-9c43-46f9-898a-73e73f5b6ac8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:34.325572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d2d515b0-9c43-46f9-898a-73e73f5b6ac8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:34.333005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2d515b0-9c43-46f9-898a-73e73f5b6ac8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:34.333499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2d515b0-9c43-46f9-898a-73e73f5b6ac8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:34.333951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2d515b0-9c43-46f9-898a-73e73f5b6ac8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:34.334672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2d515b0-9c43-46f9-898a-73e73f5b6ac8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:34.335142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2d515b0-9c43-46f9-898a-73e73f5b6ac8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:34.335614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2d515b0-9c43-46f9-898a-73e73f5b6ac8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:34.469341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d2d515b0-9c43-46f9-898a-73e73f5b6ac8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:34.477776 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d2d515b0-9c43-46f9-898a-73e73f5b6ac8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1511 microversion: 2.1 time: 0.156811 Oct 11 05:16:34.478464 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3786/7337] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:34 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:35.501214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a1ac5fde-77f0-404d-8054-f1b24506e7e7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:35.501829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a1ac5fde-77f0-404d-8054-f1b24506e7e7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:35.508273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ac5fde-77f0-404d-8054-f1b24506e7e7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:35.508754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ac5fde-77f0-404d-8054-f1b24506e7e7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:35.509186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ac5fde-77f0-404d-8054-f1b24506e7e7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:35.509872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ac5fde-77f0-404d-8054-f1b24506e7e7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:35.510356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ac5fde-77f0-404d-8054-f1b24506e7e7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:35.510782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1ac5fde-77f0-404d-8054-f1b24506e7e7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:35.642293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a1ac5fde-77f0-404d-8054-f1b24506e7e7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:35.650007 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a1ac5fde-77f0-404d-8054-f1b24506e7e7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1511 microversion: 2.1 time: 0.153012 Oct 11 05:16:35.650612 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3552/7338] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:35 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:36.674235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cd809a99-c16a-488f-a586-4574b8fce4b7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:36.674871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cd809a99-c16a-488f-a586-4574b8fce4b7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:36.681748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd809a99-c16a-488f-a586-4574b8fce4b7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:36.682285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd809a99-c16a-488f-a586-4574b8fce4b7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:36.682886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd809a99-c16a-488f-a586-4574b8fce4b7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:36.683596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd809a99-c16a-488f-a586-4574b8fce4b7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:36.684067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd809a99-c16a-488f-a586-4574b8fce4b7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:36.684512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd809a99-c16a-488f-a586-4574b8fce4b7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:36.813658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cd809a99-c16a-488f-a586-4574b8fce4b7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:36.821518 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cd809a99-c16a-488f-a586-4574b8fce4b7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.151925 Oct 11 05:16:36.822082 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3787/7339] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:36 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:37.844804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f7b63b39-525d-4a66-afe5-33b09c7b67e9 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:37.845460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f7b63b39-525d-4a66-afe5-33b09c7b67e9 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:37.852282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7b63b39-525d-4a66-afe5-33b09c7b67e9 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:37.852761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7b63b39-525d-4a66-afe5-33b09c7b67e9 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:37.857202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7b63b39-525d-4a66-afe5-33b09c7b67e9 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:37.857202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7b63b39-525d-4a66-afe5-33b09c7b67e9 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:37.857202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7b63b39-525d-4a66-afe5-33b09c7b67e9 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:37.857202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f7b63b39-525d-4a66-afe5-33b09c7b67e9 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:37.983993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f7b63b39-525d-4a66-afe5-33b09c7b67e9 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:37.991708 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f7b63b39-525d-4a66-afe5-33b09c7b67e9 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.150886 Oct 11 05:16:37.992273 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3553/7340] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:37 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:39.016545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1a078359-dfe6-4095-87f0-17c0dafb86ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:39.017171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1a078359-dfe6-4095-87f0-17c0dafb86ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:39.024168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a078359-dfe6-4095-87f0-17c0dafb86ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:39.024662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a078359-dfe6-4095-87f0-17c0dafb86ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:39.025114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a078359-dfe6-4095-87f0-17c0dafb86ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:39.025818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a078359-dfe6-4095-87f0-17c0dafb86ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:39.026314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a078359-dfe6-4095-87f0-17c0dafb86ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:39.026760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1a078359-dfe6-4095-87f0-17c0dafb86ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:39.157537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1a078359-dfe6-4095-87f0-17c0dafb86ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:39.165345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1a078359-dfe6-4095-87f0-17c0dafb86ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.153576 Oct 11 05:16:39.165951 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3788/7341] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:39 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:40.188577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3184adea-e643-4270-bdd6-d205b6e699df tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:40.189128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3184adea-e643-4270-bdd6-d205b6e699df tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:40.196011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3184adea-e643-4270-bdd6-d205b6e699df tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:40.196522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3184adea-e643-4270-bdd6-d205b6e699df tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:40.196960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3184adea-e643-4270-bdd6-d205b6e699df tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:40.197647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3184adea-e643-4270-bdd6-d205b6e699df tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:40.198100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3184adea-e643-4270-bdd6-d205b6e699df tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:40.198557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3184adea-e643-4270-bdd6-d205b6e699df tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:40.328528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3184adea-e643-4270-bdd6-d205b6e699df tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:40.336154 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3184adea-e643-4270-bdd6-d205b6e699df tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.151504 Oct 11 05:16:40.336721 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3554/7342] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:40 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:41.360360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5cfe44dc-6493-4442-9b3c-da2b7c9d66fa tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:41.360981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5cfe44dc-6493-4442-9b3c-da2b7c9d66fa tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:41.367895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cfe44dc-6493-4442-9b3c-da2b7c9d66fa tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:41.368391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cfe44dc-6493-4442-9b3c-da2b7c9d66fa tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:41.368829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cfe44dc-6493-4442-9b3c-da2b7c9d66fa tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:41.369521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cfe44dc-6493-4442-9b3c-da2b7c9d66fa tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:41.369983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cfe44dc-6493-4442-9b3c-da2b7c9d66fa tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:41.370450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5cfe44dc-6493-4442-9b3c-da2b7c9d66fa tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:41.497454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5cfe44dc-6493-4442-9b3c-da2b7c9d66fa tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:41.505081 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5cfe44dc-6493-4442-9b3c-da2b7c9d66fa tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.149266 Oct 11 05:16:41.505650 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3789/7343] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:41 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:42.528177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c8057726-bb48-485e-a7aa-ad36a95a76ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:42.528789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c8057726-bb48-485e-a7aa-ad36a95a76ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:42.536220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8057726-bb48-485e-a7aa-ad36a95a76ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:42.536701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8057726-bb48-485e-a7aa-ad36a95a76ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:42.537139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8057726-bb48-485e-a7aa-ad36a95a76ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:42.537825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8057726-bb48-485e-a7aa-ad36a95a76ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:42.538312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8057726-bb48-485e-a7aa-ad36a95a76ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:42.538740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8057726-bb48-485e-a7aa-ad36a95a76ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:42.667339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c8057726-bb48-485e-a7aa-ad36a95a76ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:42.675653 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c8057726-bb48-485e-a7aa-ad36a95a76ea tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.151382 Oct 11 05:16:42.676225 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3555/7344] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:42 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:43.698692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-41cdd8b2-4bf6-4b36-a6b0-bd0bbc069098 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:43.699240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-41cdd8b2-4bf6-4b36-a6b0-bd0bbc069098 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:43.702171 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:16:43.702337 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:16:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b (ip 10.222.0.26) !!! Oct 11 05:16:43.709284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41cdd8b2-4bf6-4b36-a6b0-bd0bbc069098 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:43.709779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41cdd8b2-4bf6-4b36-a6b0-bd0bbc069098 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:43.710253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41cdd8b2-4bf6-4b36-a6b0-bd0bbc069098 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:43.710959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41cdd8b2-4bf6-4b36-a6b0-bd0bbc069098 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:43.711420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41cdd8b2-4bf6-4b36-a6b0-bd0bbc069098 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:43.711856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41cdd8b2-4bf6-4b36-a6b0-bd0bbc069098 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:43.840365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-41cdd8b2-4bf6-4b36-a6b0-bd0bbc069098 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:43.848018 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-41cdd8b2-4bf6-4b36-a6b0-bd0bbc069098 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.153379 Oct 11 05:16:43.848586 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3790/7345] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:43 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:44.871512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bfa807d9-0907-4b53-9047-c8245e2a26c6 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:44.872130 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bfa807d9-0907-4b53-9047-c8245e2a26c6 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:44.879497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfa807d9-0907-4b53-9047-c8245e2a26c6 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:44.879986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfa807d9-0907-4b53-9047-c8245e2a26c6 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:44.880426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfa807d9-0907-4b53-9047-c8245e2a26c6 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:44.881113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfa807d9-0907-4b53-9047-c8245e2a26c6 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:44.881563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfa807d9-0907-4b53-9047-c8245e2a26c6 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:44.881989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bfa807d9-0907-4b53-9047-c8245e2a26c6 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:45.017057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bfa807d9-0907-4b53-9047-c8245e2a26c6 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:45.024987 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bfa807d9-0907-4b53-9047-c8245e2a26c6 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.157359 Oct 11 05:16:45.025567 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3556/7346] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:44 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:46.047938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb44ed9b-d797-4e06-85d0-618ff5deb40c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:46.048612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb44ed9b-d797-4e06-85d0-618ff5deb40c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:46.055438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb44ed9b-d797-4e06-85d0-618ff5deb40c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:46.055932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb44ed9b-d797-4e06-85d0-618ff5deb40c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:46.056388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb44ed9b-d797-4e06-85d0-618ff5deb40c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:46.057081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb44ed9b-d797-4e06-85d0-618ff5deb40c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:46.057546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb44ed9b-d797-4e06-85d0-618ff5deb40c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:46.057981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb44ed9b-d797-4e06-85d0-618ff5deb40c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:46.195119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb44ed9b-d797-4e06-85d0-618ff5deb40c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:46.203807 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb44ed9b-d797-4e06-85d0-618ff5deb40c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.159719 Oct 11 05:16:46.204523 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3791/7347] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:46 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:47.227725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-33b36d04-fa8d-4971-95e4-378b77bf41e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:47.228370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-33b36d04-fa8d-4971-95e4-378b77bf41e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:47.235408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33b36d04-fa8d-4971-95e4-378b77bf41e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:47.235896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33b36d04-fa8d-4971-95e4-378b77bf41e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:47.236335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33b36d04-fa8d-4971-95e4-378b77bf41e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:47.237032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33b36d04-fa8d-4971-95e4-378b77bf41e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:47.237486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33b36d04-fa8d-4971-95e4-378b77bf41e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:47.237939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-33b36d04-fa8d-4971-95e4-378b77bf41e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:47.370083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-33b36d04-fa8d-4971-95e4-378b77bf41e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:47.379054 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-33b36d04-fa8d-4971-95e4-378b77bf41e4 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.155127 Oct 11 05:16:47.379647 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3557/7348] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:47 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:48.403438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a556b2d-38b7-4423-9363-8b807680bbe3 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:48.404062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a556b2d-38b7-4423-9363-8b807680bbe3 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:48.411472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a556b2d-38b7-4423-9363-8b807680bbe3 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:48.411960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a556b2d-38b7-4423-9363-8b807680bbe3 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:48.412403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a556b2d-38b7-4423-9363-8b807680bbe3 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:48.413097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a556b2d-38b7-4423-9363-8b807680bbe3 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:48.413560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a556b2d-38b7-4423-9363-8b807680bbe3 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:48.413996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a556b2d-38b7-4423-9363-8b807680bbe3 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:48.545240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a556b2d-38b7-4423-9363-8b807680bbe3 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:48.552927 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a556b2d-38b7-4423-9363-8b807680bbe3 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.153337 Oct 11 05:16:48.553498 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3792/7349] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:48 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:49.576161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f82227fc-749b-4cd4-9fe7-f528d9f76b6a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:49.576775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f82227fc-749b-4cd4-9fe7-f528d9f76b6a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:49.583669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f82227fc-749b-4cd4-9fe7-f528d9f76b6a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:49.584153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f82227fc-749b-4cd4-9fe7-f528d9f76b6a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:49.584592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f82227fc-749b-4cd4-9fe7-f528d9f76b6a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:49.585281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f82227fc-749b-4cd4-9fe7-f528d9f76b6a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:49.585733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f82227fc-749b-4cd4-9fe7-f528d9f76b6a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:49.586159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f82227fc-749b-4cd4-9fe7-f528d9f76b6a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:49.718814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f82227fc-749b-4cd4-9fe7-f528d9f76b6a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:49.727064 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f82227fc-749b-4cd4-9fe7-f528d9f76b6a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.154821 Oct 11 05:16:49.727641 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3558/7350] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:49 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:50.751429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-01f888fc-ce7e-40bd-bbf4-f6eb1b1a8424 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:50.752091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-01f888fc-ce7e-40bd-bbf4-f6eb1b1a8424 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:50.758584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f888fc-ce7e-40bd-bbf4-f6eb1b1a8424 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:50.759080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f888fc-ce7e-40bd-bbf4-f6eb1b1a8424 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:50.759533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f888fc-ce7e-40bd-bbf4-f6eb1b1a8424 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:50.760232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f888fc-ce7e-40bd-bbf4-f6eb1b1a8424 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:50.760703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f888fc-ce7e-40bd-bbf4-f6eb1b1a8424 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:50.761162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01f888fc-ce7e-40bd-bbf4-f6eb1b1a8424 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:50.893037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-01f888fc-ce7e-40bd-bbf4-f6eb1b1a8424 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:50.900786 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-01f888fc-ce7e-40bd-bbf4-f6eb1b1a8424 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.153878 Oct 11 05:16:50.901359 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3793/7351] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:50 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:51.924300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2a223649-7376-407c-bc0d-9dee820444a7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:51.924945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2a223649-7376-407c-bc0d-9dee820444a7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:51.931847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a223649-7376-407c-bc0d-9dee820444a7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:51.932328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a223649-7376-407c-bc0d-9dee820444a7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:51.932767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a223649-7376-407c-bc0d-9dee820444a7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:51.933562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a223649-7376-407c-bc0d-9dee820444a7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:51.933895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a223649-7376-407c-bc0d-9dee820444a7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:51.934357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a223649-7376-407c-bc0d-9dee820444a7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:51.936898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:52.065730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2a223649-7376-407c-bc0d-9dee820444a7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:52.073481 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2a223649-7376-407c-bc0d-9dee820444a7 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1516 microversion: 2.1 time: 0.153121 Oct 11 05:16:52.074056 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3559/7352] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:51 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1516 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:52.938848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-8861d7e7-fa81-4891-884c-a77d5be50483 req-1eee9868-88e2-4e5a-b3ed-12348c9fe95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779fed52-87d7-4cd2-8205-a544b4768a6b", "name": "network-vif-unplugged", "status": "completed", "tag": "0f5ade61-425c-40ea-bc5f-3f022393b5dc"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:52.949243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8861d7e7-fa81-4891-884c-a77d5be50483 req-1eee9868-88e2-4e5a-b3ed-12348c9fe95a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:52.949732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8861d7e7-fa81-4891-884c-a77d5be50483 req-1eee9868-88e2-4e5a-b3ed-12348c9fe95a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:52.950181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8861d7e7-fa81-4891-884c-a77d5be50483 req-1eee9868-88e2-4e5a-b3ed-12348c9fe95a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:52.952731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=90 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:52.963194 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8861d7e7-fa81-4891-884c-a77d5be50483 req-1eee9868-88e2-4e5a-b3ed-12348c9fe95a service nova] Creating event network-vif-unplugged:0f5ade61-425c-40ea-bc5f-3f022393b5dc for instance 779fed52-87d7-4cd2-8205-a544b4768a6b on n-h2-860892-1 Oct 11 05:16:52.968492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-8861d7e7-fa81-4891-884c-a77d5be50483 req-1eee9868-88e2-4e5a-b3ed-12348c9fe95a service nova] Instance 779fed52-87d7-4cd2-8205-a544b4768a6b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:16:52.979325 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-8861d7e7-fa81-4891-884c-a77d5be50483 req-1eee9868-88e2-4e5a-b3ed-12348c9fe95a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044393 Oct 11 05:16:52.979916 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3794/7353] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:16:53.098799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2f6e0ee0-3150-4169-acd0-a0b773dc5342 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:53.099211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2f6e0ee0-3150-4169-acd0-a0b773dc5342 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:53.105985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6e0ee0-3150-4169-acd0-a0b773dc5342 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:53.106494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6e0ee0-3150-4169-acd0-a0b773dc5342 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:53.106928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6e0ee0-3150-4169-acd0-a0b773dc5342 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:53.107626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6e0ee0-3150-4169-acd0-a0b773dc5342 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:53.108073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6e0ee0-3150-4169-acd0-a0b773dc5342 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:53.108491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2f6e0ee0-3150-4169-acd0-a0b773dc5342 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:53.238529 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2f6e0ee0-3150-4169-acd0-a0b773dc5342 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:53.246177 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2f6e0ee0-3150-4169-acd0-a0b773dc5342 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1515 microversion: 2.1 time: 0.153317 Oct 11 05:16:53.246769 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3560/7354] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:53 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1515 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:54.271077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6189f30d-3818-406e-af86-4e878420ca6e tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:54.271794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6189f30d-3818-406e-af86-4e878420ca6e tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:54.278013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6189f30d-3818-406e-af86-4e878420ca6e tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:54.278543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6189f30d-3818-406e-af86-4e878420ca6e tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:54.278994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6189f30d-3818-406e-af86-4e878420ca6e tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:54.279694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6189f30d-3818-406e-af86-4e878420ca6e tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:54.280159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6189f30d-3818-406e-af86-4e878420ca6e tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:54.280600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6189f30d-3818-406e-af86-4e878420ca6e tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:54.412468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6189f30d-3818-406e-af86-4e878420ca6e tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:54.420284 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6189f30d-3818-406e-af86-4e878420ca6e tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1513 microversion: 2.1 time: 0.154674 Oct 11 05:16:54.420859 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3795/7355] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:54 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1513 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:54.993392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-bae2d712-fb5e-479b-9d28-1ca75f575331 req-879c9127-3991-4219-a589-99b77d1308e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779fed52-87d7-4cd2-8205-a544b4768a6b", "tag": "0f5ade61-425c-40ea-bc5f-3f022393b5dc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:55.003566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bae2d712-fb5e-479b-9d28-1ca75f575331 req-879c9127-3991-4219-a589-99b77d1308e7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:55.004032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bae2d712-fb5e-479b-9d28-1ca75f575331 req-879c9127-3991-4219-a589-99b77d1308e7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:55.004457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-bae2d712-fb5e-479b-9d28-1ca75f575331 req-879c9127-3991-4219-a589-99b77d1308e7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:55.015945 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-bae2d712-fb5e-479b-9d28-1ca75f575331 req-879c9127-3991-4219-a589-99b77d1308e7 service nova] Creating event network-changed:0f5ade61-425c-40ea-bc5f-3f022393b5dc for instance 779fed52-87d7-4cd2-8205-a544b4768a6b on n-h2-860892-1 Oct 11 05:16:55.021585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-bae2d712-fb5e-479b-9d28-1ca75f575331 req-879c9127-3991-4219-a589-99b77d1308e7 service nova] Instance 779fed52-87d7-4cd2-8205-a544b4768a6b is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:16:55.032482 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-bae2d712-fb5e-479b-9d28-1ca75f575331 req-879c9127-3991-4219-a589-99b77d1308e7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042642 Oct 11 05:16:55.033639 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3561/7356] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:16:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:16:55.446901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a32f7158-d0ed-4584-9dfb-1a730d1bc011 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:55.448119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a32f7158-d0ed-4584-9dfb-1a730d1bc011 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:55.451310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=34 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:55.458140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f7158-d0ed-4584-9dfb-1a730d1bc011 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:55.458681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f7158-d0ed-4584-9dfb-1a730d1bc011 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:55.459128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f7158-d0ed-4584-9dfb-1a730d1bc011 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:55.459849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f7158-d0ed-4584-9dfb-1a730d1bc011 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:55.460325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f7158-d0ed-4584-9dfb-1a730d1bc011 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:55.460775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f7158-d0ed-4584-9dfb-1a730d1bc011 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:55.784737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a32f7158-d0ed-4584-9dfb-1a730d1bc011 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:55.794113 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a32f7158-d0ed-4584-9dfb-1a730d1bc011 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1513 microversion: 2.1 time: 0.353093 Oct 11 05:16:55.794729 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3796/7357] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:55 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1513 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:56.819729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a1b62819-eb50-4ec1-9172-7d148cc64d9a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:56.820422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a1b62819-eb50-4ec1-9172-7d148cc64d9a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:56.826618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1b62819-eb50-4ec1-9172-7d148cc64d9a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:56.827093 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1b62819-eb50-4ec1-9172-7d148cc64d9a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:56.827522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1b62819-eb50-4ec1-9172-7d148cc64d9a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:56.828198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1b62819-eb50-4ec1-9172-7d148cc64d9a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:56.828642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1b62819-eb50-4ec1-9172-7d148cc64d9a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:56.829059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a1b62819-eb50-4ec1-9172-7d148cc64d9a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:56.971240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a1b62819-eb50-4ec1-9172-7d148cc64d9a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:56.979015 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a1b62819-eb50-4ec1-9172-7d148cc64d9a tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1510 microversion: 2.1 time: 0.164381 Oct 11 05:16:56.979610 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3562/7358] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:56 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:16:57.002222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-34ccbc6b-96fb-4676-b218-2ae8cd08b14c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:57.002754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-34ccbc6b-96fb-4676-b218-2ae8cd08b14c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:57.009733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ccbc6b-96fb-4676-b218-2ae8cd08b14c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:57.010321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ccbc6b-96fb-4676-b218-2ae8cd08b14c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:57.010781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ccbc6b-96fb-4676-b218-2ae8cd08b14c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:57.011499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ccbc6b-96fb-4676-b218-2ae8cd08b14c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:57.011967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ccbc6b-96fb-4676-b218-2ae8cd08b14c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:57.012408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-34ccbc6b-96fb-4676-b218-2ae8cd08b14c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:57.040816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-34ccbc6b-96fb-4676-b218-2ae8cd08b14c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:16:57.201374 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.api [None req-34ccbc6b-96fb-4676-b218-2ae8cd08b14c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Found an unconfirmed migration during delete, id: 16, status: finished Oct 11 05:16:59.111735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-433791db-dddb-499f-84a2-4d82c757bb4c req-90895fb3-2820-47a1-b6cf-cd1d301f94d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779fed52-87d7-4cd2-8205-a544b4768a6b", "name": "network-vif-plugged", "status": "completed", "tag": "0f5ade61-425c-40ea-bc5f-3f022393b5dc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:16:59.121798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-433791db-dddb-499f-84a2-4d82c757bb4c req-90895fb3-2820-47a1-b6cf-cd1d301f94d1 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:59.127068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-433791db-dddb-499f-84a2-4d82c757bb4c req-90895fb3-2820-47a1-b6cf-cd1d301f94d1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:59.127068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-433791db-dddb-499f-84a2-4d82c757bb4c req-90895fb3-2820-47a1-b6cf-cd1d301f94d1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:59.133971 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-433791db-dddb-499f-84a2-4d82c757bb4c req-90895fb3-2820-47a1-b6cf-cd1d301f94d1 service nova] Creating event network-vif-plugged:0f5ade61-425c-40ea-bc5f-3f022393b5dc for instance 779fed52-87d7-4cd2-8205-a544b4768a6b on n-h2-860892-1 Oct 11 05:16:59.139169 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-433791db-dddb-499f-84a2-4d82c757bb4c req-90895fb3-2820-47a1-b6cf-cd1d301f94d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031496 Oct 11 05:16:59.139769 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3563/7359] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:16:59.423337 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-34ccbc6b-96fb-4676-b218-2ae8cd08b14c tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "DELETE /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 204 len: 0 microversion: 2.1 time: 2.425156 Oct 11 05:16:59.424611 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3797/7360] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:16:56 2022] DELETE /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 0 bytes in 2427 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:16:59.433107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f44d719-264d-4d8e-8065-14d3a05dfa0b tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:16:59.433803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5f44d719-264d-4d8e-8065-14d3a05dfa0b tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:16:59.435755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=38 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:16:59.440689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f44d719-264d-4d8e-8065-14d3a05dfa0b tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:59.441165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f44d719-264d-4d8e-8065-14d3a05dfa0b tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:59.443095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f44d719-264d-4d8e-8065-14d3a05dfa0b tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:59.443095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f44d719-264d-4d8e-8065-14d3a05dfa0b tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:16:59.443095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f44d719-264d-4d8e-8065-14d3a05dfa0b tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:16:59.443373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5f44d719-264d-4d8e-8065-14d3a05dfa0b tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:16:59.571719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5f44d719-264d-4d8e-8065-14d3a05dfa0b tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:16:59.579358 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5f44d719-264d-4d8e-8065-14d3a05dfa0b tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1502 microversion: 2.1 time: 0.150410 Oct 11 05:16:59.580446 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3564/7361] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:16:59 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:17:00.605018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-57109107-9fe7-4696-9164-9bf9d064dae8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:00.605730 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-57109107-9fe7-4696-9164-9bf9d064dae8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:00.616696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57109107-9fe7-4696-9164-9bf9d064dae8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:00.620270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57109107-9fe7-4696-9164-9bf9d064dae8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:00.620270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57109107-9fe7-4696-9164-9bf9d064dae8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:00.620270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57109107-9fe7-4696-9164-9bf9d064dae8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:00.620270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57109107-9fe7-4696-9164-9bf9d064dae8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:00.620270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57109107-9fe7-4696-9164-9bf9d064dae8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:00.784906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-57109107-9fe7-4696-9164-9bf9d064dae8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:00.793006 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-57109107-9fe7-4696-9164-9bf9d064dae8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1502 microversion: 2.1 time: 0.193362 Oct 11 05:17:00.793579 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3798/7362] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:00 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1502 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:01.265866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-4aff4266-514c-4b12-9531-62abd97cce39 req-14ed43a8-7885-437c-8625-362ca4595019 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779fed52-87d7-4cd2-8205-a544b4768a6b", "name": "network-vif-deleted", "tag": "0f5ade61-425c-40ea-bc5f-3f022393b5dc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:01.276170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4aff4266-514c-4b12-9531-62abd97cce39 req-14ed43a8-7885-437c-8625-362ca4595019 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:01.285573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4aff4266-514c-4b12-9531-62abd97cce39 req-14ed43a8-7885-437c-8625-362ca4595019 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:01.285573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4aff4266-514c-4b12-9531-62abd97cce39 req-14ed43a8-7885-437c-8625-362ca4595019 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:01.289211 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-4aff4266-514c-4b12-9531-62abd97cce39 req-14ed43a8-7885-437c-8625-362ca4595019 service nova] Creating event network-vif-deleted:0f5ade61-425c-40ea-bc5f-3f022393b5dc for instance 779fed52-87d7-4cd2-8205-a544b4768a6b on n-h2-860892-1 Oct 11 05:17:01.294250 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-4aff4266-514c-4b12-9531-62abd97cce39 req-14ed43a8-7885-437c-8625-362ca4595019 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032402 Oct 11 05:17:01.294805 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3565/7363] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:17:01.817516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:01.818139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:01.825156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:01.827682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:01.827682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:01.827682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:01.827682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:01.828041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:01.859607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:01.860096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:01.860543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:01.861059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lazy-loading 'fault' on Instance uuid 779fed52-87d7-4cd2-8205-a544b4768a6b {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:17:01.902328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8a5a6013e40474e8bf92042ea551b0e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '63cf35b893984b63abcb56db605600bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:01.910209 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-716e5707-5189-49f3-9f0a-468c97d3bb1d tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 200 len: 1305 microversion: 2.1 time: 0.096654 Oct 11 05:17:01.910785 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3799/7364] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:01 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 1305 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:02.934427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:02.935115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:02.941254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:02.941734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:02.942165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:02.942870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:02.943316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:02.943736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:02.956712 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] HTTP exception thrown: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Request method failure captured: Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b HTTP/1.1 Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPwgJ0J4ctycBkTn2bmD1-G243U8KkSaM7ua0yNiZSLzOrnQrUvDnf1zGtm_OfWGQtAJNnBM24GojKSjTbwNy1qQCAJVUWgYEkOqS88lJY8dh4PtIdLeCzJ77E03L-OM8X_57Hpq73jak0Nuw3PKARhpRfxWp-RDQGkFSmSjye9WI8I Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 63cf35b893984b63abcb56db605600bc Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersTestJSON-308537112 Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/63cf35b893984b63abcb56db605600bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_63cf35b893984b63abcb56db605600bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/63cf35b893984b63abcb56db605600bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/63cf35b893984b63abcb56db605600bc"}]}] Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersTestJSON-308537112 Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 63cf35b893984b63abcb56db605600bc Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersTestJSON-308537112 Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersTestJSON-308537112-project Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: d8a5a6013e40474e8bf92042ea551b0e Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersTestJSON-308537112-project Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '779fed52-87d7-4cd2-8205-a544b4768a6b'} Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:17:02.958395 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:17:02.962934 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:17:02.962934 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:17:02.962934 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:17:02.962934 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:17:02.962934 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:17:02.962934 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:02.962934 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:17:02.962934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Returning 404 to user: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:17:02.962934 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-46ab5aa3-4f6d-476a-841f-39db6ae232c8 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 404 len: 111 microversion: 2.1 time: 0.030445 Oct 11 05:17:02.962934 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3566/7365] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:02 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:17:02.973255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:02.973768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:02.980570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:02.981055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:02.981498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:02.982247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:02.982673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:02.983107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:02.996724 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] HTTP exception thrown: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Request method failure captured: Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b HTTP/1.1 Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPwgJ0J4ctycBkTn2bmD1-G243U8KkSaM7ua0yNiZSLzOrnQrUvDnf1zGtm_OfWGQtAJNnBM24GojKSjTbwNy1qQCAJVUWgYEkOqS88lJY8dh4PtIdLeCzJ77E03L-OM8X_57Hpq73jak0Nuw3PKARhpRfxWp-RDQGkFSmSjye9WI8I Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 63cf35b893984b63abcb56db605600bc Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-DeleteServersTestJSON-308537112 Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/63cf35b893984b63abcb56db605600bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_63cf35b893984b63abcb56db605600bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/63cf35b893984b63abcb56db605600bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/63cf35b893984b63abcb56db605600bc"}]}] Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-DeleteServersTestJSON-308537112 Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 63cf35b893984b63abcb56db605600bc Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-DeleteServersTestJSON-308537112 Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-DeleteServersTestJSON-308537112-project Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: d8a5a6013e40474e8bf92042ea551b0e Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-DeleteServersTestJSON-308537112-project Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '779fed52-87d7-4cd2-8205-a544b4768a6b'} Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:17:02.998413 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Returning 404 to user: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-66101a91-ca2d-4756-94a1-ba04d8f1b8ff tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "DELETE /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 404 len: 111 microversion: 2.1 time: 0.031785 Oct 11 05:17:03.002892 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3800/7366] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:17:02 2022] DELETE /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:17:03.008337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:03.008949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] [instance: 779fed52-87d7-4cd2-8205-a544b4768a6b] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:03.015129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:03.015604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:03.016037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:03.016718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:03.017165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:03.017587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:03.030699 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] HTTP exception thrown: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Request method failure captured: Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b HTTP/1.1 Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPwgJ0J4ctycBkTn2bmD1-G243U8KkSaM7ua0yNiZSLzOrnQrUvDnf1zGtm_OfWGQtAJNnBM24GojKSjTbwNy1qQCAJVUWgYEkOqS88lJY8dh4PtIdLeCzJ77E03L-OM8X_57Hpq73jak0Nuw3PKARhpRfxWp-RDQGkFSmSjye9WI8I Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 63cf35b893984b63abcb56db605600bc Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-DeleteServersTestJSON-308537112 Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/63cf35b893984b63abcb56db605600bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_63cf35b893984b63abcb56db605600bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/63cf35b893984b63abcb56db605600bc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/63cf35b893984b63abcb56db605600bc"}]}] Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-DeleteServersTestJSON-308537112 Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 63cf35b893984b63abcb56db605600bc Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-DeleteServersTestJSON-308537112 Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-DeleteServersTestJSON-308537112-project Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: d8a5a6013e40474e8bf92042ea551b0e Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-DeleteServersTestJSON-308537112-project Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '779fed52-87d7-4cd2-8205-a544b4768a6b'} Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:17:03.032185 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:17:03.037134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:17:03.037134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:17:03.037134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:17:03.037134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:17:03.037134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:17:03.037134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. Oct 11 05:17:03.037134 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:17:03.037134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] Returning 404 to user: Instance 779fed52-87d7-4cd2-8205-a544b4768a6b could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:17:03.037134 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fc57d165-4859-417d-9040-a51e62988490 tempest-DeleteServersTestJSON-308537112 tempest-DeleteServersTestJSON-308537112-project] 10.222.0.26 "GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b" status: 404 len: 111 microversion: 2.1 time: 0.029617 Oct 11 05:17:03.037134 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3567/7367] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:03 2022] GET /compute/v2.1/servers/779fed52-87d7-4cd2-8205-a544b4768a6b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 05:17:13.743062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:17:13.744822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:17:13.861382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-1758001086", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "57b114c4-7a66-40d6-91a7-0eb830329c1f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:13.918673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] validate_networks() for [('57b114c4-7a66-40d6-91a7-0eb830329c1f', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:17:14.323501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:17:14.324615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:17:14.325111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:17:14.325642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:17:14.325967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:17:14.341184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:14.341692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:14.342148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:14.342930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:14.343396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:14.344071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:14.363101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Getting quotas for project afc63b66d4b34703850b708b96289079. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:17:14.368854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Getting quotas for user 61a36add99334f6ab443e615dfd7b0cd and project afc63b66d4b34703850b708b96289079. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:17:14.385551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:17:14.387964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:17:14.570077 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e29ab09d-99b6-48c4-a001-124ebb1b063b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830188 Oct 11 05:17:14.570077 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3801/7368] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:17:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:17:14.581425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff161679-fe60-4a12-853f-c9d86c46e423 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:14.583506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff161679-fe60-4a12-853f-c9d86c46e423 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:14.587879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=7 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:17:14.588800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=35 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:17:14.652982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff161679-fe60-4a12-853f-c9d86c46e423 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:14.661216 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff161679-fe60-4a12-853f-c9d86c46e423 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1218 microversion: 2.1 time: 0.084929 Oct 11 05:17:14.675286 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3568/7369] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:14 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:15.685817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e6760da8-494a-4e9f-8110-9bbcb2bbeabf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:15.686470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e6760da8-494a-4e9f-8110-9bbcb2bbeabf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:15.749572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e6760da8-494a-4e9f-8110-9bbcb2bbeabf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:15.756262 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e6760da8-494a-4e9f-8110-9bbcb2bbeabf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1218 microversion: 2.1 time: 0.075227 Oct 11 05:17:15.756827 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3802/7370] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:15 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1218 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:16.780281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d54a147a-2f00-4f8b-b2f2-7df627723833 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:16.780893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d54a147a-2f00-4f8b-b2f2-7df627723833 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:16.789974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d54a147a-2f00-4f8b-b2f2-7df627723833 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:16.790493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d54a147a-2f00-4f8b-b2f2-7df627723833 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:16.790936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d54a147a-2f00-4f8b-b2f2-7df627723833 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:16.791660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d54a147a-2f00-4f8b-b2f2-7df627723833 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:16.792295 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d54a147a-2f00-4f8b-b2f2-7df627723833 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:16.792725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d54a147a-2f00-4f8b-b2f2-7df627723833 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:16.881614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d54a147a-2f00-4f8b-b2f2-7df627723833 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:16.890922 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d54a147a-2f00-4f8b-b2f2-7df627723833 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1270 microversion: 2.1 time: 0.115236 Oct 11 05:17:16.891515 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3569/7371] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:16 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1270 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:17.925987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3d3e6f06-b05f-4ac1-b5ee-c3edf91ebd7e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:17.927821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3d3e6f06-b05f-4ac1-b5ee-c3edf91ebd7e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:17.938742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e6f06-b05f-4ac1-b5ee-c3edf91ebd7e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:17.939273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e6f06-b05f-4ac1-b5ee-c3edf91ebd7e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:17.939739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e6f06-b05f-4ac1-b5ee-c3edf91ebd7e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:17.940492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e6f06-b05f-4ac1-b5ee-c3edf91ebd7e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:17.941014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e6f06-b05f-4ac1-b5ee-c3edf91ebd7e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:17.941467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d3e6f06-b05f-4ac1-b5ee-c3edf91ebd7e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:18.190877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3d3e6f06-b05f-4ac1-b5ee-c3edf91ebd7e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:18.199297 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3d3e6f06-b05f-4ac1-b5ee-c3edf91ebd7e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1318 microversion: 2.1 time: 0.278010 Oct 11 05:17:18.200099 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3803/7372] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:17 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:18.872460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e9e9d501-3c43-48c8-b1e4-ee87791b2177 req-ad1d8998-e730-4eb0-81bc-4bde7f656b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4750455a-d7d5-4b9c-9337-3555e752cdb8", "tag": "b723f91b-f4bf-44f3-89d3-288e80e3134e"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:18.884678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e9e9d501-3c43-48c8-b1e4-ee87791b2177 req-ad1d8998-e730-4eb0-81bc-4bde7f656b5b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:18.885697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e9e9d501-3c43-48c8-b1e4-ee87791b2177 req-ad1d8998-e730-4eb0-81bc-4bde7f656b5b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:18.886207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e9e9d501-3c43-48c8-b1e4-ee87791b2177 req-ad1d8998-e730-4eb0-81bc-4bde7f656b5b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:18.898296 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e9e9d501-3c43-48c8-b1e4-ee87791b2177 req-ad1d8998-e730-4eb0-81bc-4bde7f656b5b service nova] Creating event network-changed:b723f91b-f4bf-44f3-89d3-288e80e3134e for instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 on n-h1-860892-1 Oct 11 05:17:18.903358 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e9e9d501-3c43-48c8-b1e4-ee87791b2177 req-ad1d8998-e730-4eb0-81bc-4bde7f656b5b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034859 Oct 11 05:17:18.904191 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3570/7373] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:17:19.223511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5e1cd542-bf71-431b-b3c5-a838f9bb7936 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:19.224210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5e1cd542-bf71-431b-b3c5-a838f9bb7936 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:19.231087 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e1cd542-bf71-431b-b3c5-a838f9bb7936 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:19.232172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e1cd542-bf71-431b-b3c5-a838f9bb7936 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:19.232624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e1cd542-bf71-431b-b3c5-a838f9bb7936 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:19.233330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e1cd542-bf71-431b-b3c5-a838f9bb7936 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:19.233797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e1cd542-bf71-431b-b3c5-a838f9bb7936 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:19.234262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e1cd542-bf71-431b-b3c5-a838f9bb7936 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:19.458779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5e1cd542-bf71-431b-b3c5-a838f9bb7936 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:19.466474 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5e1cd542-bf71-431b-b3c5-a838f9bb7936 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1318 microversion: 2.1 time: 0.246984 Oct 11 05:17:19.467240 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3804/7374] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:19 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1318 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:17:20.490220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-823e76ad-2376-4150-be47-8ab8ad995a29 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:20.490918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-823e76ad-2376-4150-be47-8ab8ad995a29 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:20.497853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-823e76ad-2376-4150-be47-8ab8ad995a29 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:20.498371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-823e76ad-2376-4150-be47-8ab8ad995a29 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:20.498810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-823e76ad-2376-4150-be47-8ab8ad995a29 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:20.499498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-823e76ad-2376-4150-be47-8ab8ad995a29 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:20.499946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-823e76ad-2376-4150-be47-8ab8ad995a29 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:20.500375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-823e76ad-2376-4150-be47-8ab8ad995a29 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:20.632909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-823e76ad-2376-4150-be47-8ab8ad995a29 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:20.640806 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-823e76ad-2376-4150-be47-8ab8ad995a29 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1318 microversion: 2.1 time: 0.155332 Oct 11 05:17:20.641371 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3571/7375] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:20 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:21.664748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a6b68f89-530c-4610-8de7-9a7fe71d0d28 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:21.665368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a6b68f89-530c-4610-8de7-9a7fe71d0d28 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:21.671940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6b68f89-530c-4610-8de7-9a7fe71d0d28 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:21.672428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6b68f89-530c-4610-8de7-9a7fe71d0d28 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:21.672879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6b68f89-530c-4610-8de7-9a7fe71d0d28 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:21.673573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6b68f89-530c-4610-8de7-9a7fe71d0d28 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:21.674733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6b68f89-530c-4610-8de7-9a7fe71d0d28 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:21.675358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6b68f89-530c-4610-8de7-9a7fe71d0d28 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:21.809903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a6b68f89-530c-4610-8de7-9a7fe71d0d28 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:21.817553 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a6b68f89-530c-4610-8de7-9a7fe71d0d28 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1318 microversion: 2.1 time: 0.156914 Oct 11 05:17:21.824394 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3805/7376] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:21 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:22.841065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3c2ae23b-3ccb-4d6b-b771-867d313ad505 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:22.841676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3c2ae23b-3ccb-4d6b-b771-867d313ad505 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:22.848405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c2ae23b-3ccb-4d6b-b771-867d313ad505 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:22.849062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c2ae23b-3ccb-4d6b-b771-867d313ad505 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:22.849441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c2ae23b-3ccb-4d6b-b771-867d313ad505 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:22.850121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c2ae23b-3ccb-4d6b-b771-867d313ad505 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:22.850608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c2ae23b-3ccb-4d6b-b771-867d313ad505 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:22.851016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3c2ae23b-3ccb-4d6b-b771-867d313ad505 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:22.984864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3c2ae23b-3ccb-4d6b-b771-867d313ad505 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:22.993319 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3c2ae23b-3ccb-4d6b-b771-867d313ad505 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1318 microversion: 2.1 time: 0.156143 Oct 11 05:17:22.993898 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3572/7377] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:22 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:24.017020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-84975d53-6834-4558-ae5a-bc5b1daed41d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:24.017643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-84975d53-6834-4558-ae5a-bc5b1daed41d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:24.024590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84975d53-6834-4558-ae5a-bc5b1daed41d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:24.025080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84975d53-6834-4558-ae5a-bc5b1daed41d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:24.025531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84975d53-6834-4558-ae5a-bc5b1daed41d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:24.026249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84975d53-6834-4558-ae5a-bc5b1daed41d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:24.026714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84975d53-6834-4558-ae5a-bc5b1daed41d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:24.027148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-84975d53-6834-4558-ae5a-bc5b1daed41d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:24.140291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-13cf1996-b0f6-46aa-b4be-6ed7d920b30a req-23a096cc-9b91-4803-901f-86825cc93718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4750455a-d7d5-4b9c-9337-3555e752cdb8", "name": "network-vif-plugged", "status": "completed", "tag": "b723f91b-f4bf-44f3-89d3-288e80e3134e"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:24.152135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-13cf1996-b0f6-46aa-b4be-6ed7d920b30a req-23a096cc-9b91-4803-901f-86825cc93718 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:24.152657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-13cf1996-b0f6-46aa-b4be-6ed7d920b30a req-23a096cc-9b91-4803-901f-86825cc93718 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:24.153152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-13cf1996-b0f6-46aa-b4be-6ed7d920b30a req-23a096cc-9b91-4803-901f-86825cc93718 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:24.162052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-84975d53-6834-4558-ae5a-bc5b1daed41d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:24.165277 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-13cf1996-b0f6-46aa-b4be-6ed7d920b30a req-23a096cc-9b91-4803-901f-86825cc93718 service nova] Creating event network-vif-plugged:b723f91b-f4bf-44f3-89d3-288e80e3134e for instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 on n-h1-860892-1 Oct 11 05:17:24.170326 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-84975d53-6834-4558-ae5a-bc5b1daed41d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1318 microversion: 2.1 time: 0.157426 Oct 11 05:17:24.170813 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-13cf1996-b0f6-46aa-b4be-6ed7d920b30a req-23a096cc-9b91-4803-901f-86825cc93718 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035305 Oct 11 05:17:24.171077 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3806/7378] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:24 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:24.171401 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3573/7379] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:17:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:17:25.193066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-824f3fa5-cc72-4e8b-97ee-badb8081de5d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:25.193799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-824f3fa5-cc72-4e8b-97ee-badb8081de5d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:25.195710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:17:25.201320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824f3fa5-cc72-4e8b-97ee-badb8081de5d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:25.201813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824f3fa5-cc72-4e8b-97ee-badb8081de5d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:25.202381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824f3fa5-cc72-4e8b-97ee-badb8081de5d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:25.203084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824f3fa5-cc72-4e8b-97ee-badb8081de5d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:25.203549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824f3fa5-cc72-4e8b-97ee-badb8081de5d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:25.203987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-824f3fa5-cc72-4e8b-97ee-badb8081de5d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:25.335146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-824f3fa5-cc72-4e8b-97ee-badb8081de5d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:25.342841 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-824f3fa5-cc72-4e8b-97ee-badb8081de5d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1318 microversion: 2.1 time: 0.153748 Oct 11 05:17:25.343441 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3807/7380] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:25 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:26.366095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-294a98e9-633f-46c3-bd63-0ad232941a67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:26.366737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-294a98e9-633f-46c3-bd63-0ad232941a67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:26.368741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:17:26.374523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-294a98e9-633f-46c3-bd63-0ad232941a67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:26.375001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-294a98e9-633f-46c3-bd63-0ad232941a67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:26.375433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-294a98e9-633f-46c3-bd63-0ad232941a67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:26.376115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-294a98e9-633f-46c3-bd63-0ad232941a67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:26.376561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-294a98e9-633f-46c3-bd63-0ad232941a67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:26.377100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-294a98e9-633f-46c3-bd63-0ad232941a67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:26.506209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-294a98e9-633f-46c3-bd63-0ad232941a67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:26.514417 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-294a98e9-633f-46c3-bd63-0ad232941a67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1508 microversion: 2.1 time: 0.152947 Oct 11 05:17:26.515186 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3574/7381] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:26 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:26.537585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bda3545c-b2ee-4bf3-9537-0b25f05d15c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:26.538222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bda3545c-b2ee-4bf3-9537-0b25f05d15c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:26.540056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:17:26.545606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bda3545c-b2ee-4bf3-9537-0b25f05d15c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:26.546095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bda3545c-b2ee-4bf3-9537-0b25f05d15c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:26.546583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bda3545c-b2ee-4bf3-9537-0b25f05d15c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:26.547346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bda3545c-b2ee-4bf3-9537-0b25f05d15c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:26.547806 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bda3545c-b2ee-4bf3-9537-0b25f05d15c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:26.548242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bda3545c-b2ee-4bf3-9537-0b25f05d15c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:26.677355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bda3545c-b2ee-4bf3-9537-0b25f05d15c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:26.685087 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bda3545c-b2ee-4bf3-9537-0b25f05d15c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1508 microversion: 2.1 time: 0.152006 Oct 11 05:17:26.685647 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3808/7382] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:26 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:26.707219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fd5e4acb-3122-4978-b1ac-22032f53eb3d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Action: 'update', calling method: >, body: {"server": {"OS-DCF:diskConfig": "AUTO"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:26.709587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fd5e4acb-3122-4978-b1ac-22032f53eb3d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:26.715435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd5e4acb-3122-4978-b1ac-22032f53eb3d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:26.715914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd5e4acb-3122-4978-b1ac-22032f53eb3d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:26.716346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd5e4acb-3122-4978-b1ac-22032f53eb3d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:26.717027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd5e4acb-3122-4978-b1ac-22032f53eb3d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:26.717472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd5e4acb-3122-4978-b1ac-22032f53eb3d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:26.717889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd5e4acb-3122-4978-b1ac-22032f53eb3d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:26.858432 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fd5e4acb-3122-4978-b1ac-22032f53eb3d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "PUT /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1080 microversion: 2.1 time: 0.155504 Oct 11 05:17:26.859207 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3575/7383] 10.222.0.26 () {60 vars in 1256 bytes} [Tue Oct 11 05:17:26 2022] PUT /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1080 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:26.877677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-01358d6a-667f-4739-8d16-eabab1be7995 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:26.878278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-01358d6a-667f-4739-8d16-eabab1be7995 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:26.884285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01358d6a-667f-4739-8d16-eabab1be7995 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:26.884775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01358d6a-667f-4739-8d16-eabab1be7995 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:26.885221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01358d6a-667f-4739-8d16-eabab1be7995 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:26.885913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01358d6a-667f-4739-8d16-eabab1be7995 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:26.886421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01358d6a-667f-4739-8d16-eabab1be7995 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:26.886859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01358d6a-667f-4739-8d16-eabab1be7995 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:27.018700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-01358d6a-667f-4739-8d16-eabab1be7995 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:27.026327 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-01358d6a-667f-4739-8d16-eabab1be7995 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1506 microversion: 2.1 time: 0.152997 Oct 11 05:17:27.026928 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3809/7384] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:26 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:27.048143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6e853684-df34-4542-8839-15df37598675 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:27.048810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6e853684-df34-4542-8839-15df37598675 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:27.054720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e853684-df34-4542-8839-15df37598675 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:27.055198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e853684-df34-4542-8839-15df37598675 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:27.055627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e853684-df34-4542-8839-15df37598675 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:27.056304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e853684-df34-4542-8839-15df37598675 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:27.056747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e853684-df34-4542-8839-15df37598675 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:27.057166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e853684-df34-4542-8839-15df37598675 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:27.184223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6e853684-df34-4542-8839-15df37598675 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:27.192469 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6e853684-df34-4542-8839-15df37598675 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1506 microversion: 2.1 time: 0.148170 Oct 11 05:17:27.193037 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3576/7385] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:27 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:27.214078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "MANUAL"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:27.216510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:27.222477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:27.222972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:27.223458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:27.224160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:27.224621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:27.225061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:27.301409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:27.310030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Old instance type m1.heat2, new instance type m1.heat {{(pid=120994) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 05:17:27.313385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:17:27.313835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:17:27.315046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:17:27.315472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:17:27.315895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:17:27.584599 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31fe565d-b0db-4803-b0bd-a6a25dc0dee4 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "POST /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8/action" status: 202 len: 0 microversion: 2.1 time: 0.373967 Oct 11 05:17:27.585547 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3810/7386] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:17:27 2022] POST /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8/action => generated 0 bytes in 376 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:17:27.593224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b87ca4e8-aceb-480b-a2c2-0d5cd1333fa6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:27.593840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b87ca4e8-aceb-480b-a2c2-0d5cd1333fa6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:27.601359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b87ca4e8-aceb-480b-a2c2-0d5cd1333fa6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:27.601881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b87ca4e8-aceb-480b-a2c2-0d5cd1333fa6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:27.602437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b87ca4e8-aceb-480b-a2c2-0d5cd1333fa6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:27.603140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b87ca4e8-aceb-480b-a2c2-0d5cd1333fa6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:27.603616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b87ca4e8-aceb-480b-a2c2-0d5cd1333fa6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:27.604225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b87ca4e8-aceb-480b-a2c2-0d5cd1333fa6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:27.738840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b87ca4e8-aceb-480b-a2c2-0d5cd1333fa6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:27.746644 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b87ca4e8-aceb-480b-a2c2-0d5cd1333fa6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1517 microversion: 2.1 time: 0.157261 Oct 11 05:17:27.747206 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3577/7387] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:27 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:28.769426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-23f8e273-86fb-4b07-8433-2f5da7dd898e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:28.770051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-23f8e273-86fb-4b07-8433-2f5da7dd898e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:28.777748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23f8e273-86fb-4b07-8433-2f5da7dd898e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:28.778274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23f8e273-86fb-4b07-8433-2f5da7dd898e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:28.778729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23f8e273-86fb-4b07-8433-2f5da7dd898e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:28.779434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23f8e273-86fb-4b07-8433-2f5da7dd898e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:28.779898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23f8e273-86fb-4b07-8433-2f5da7dd898e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:28.780344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-23f8e273-86fb-4b07-8433-2f5da7dd898e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:28.912953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-23f8e273-86fb-4b07-8433-2f5da7dd898e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:28.920957 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-23f8e273-86fb-4b07-8433-2f5da7dd898e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1517 microversion: 2.1 time: 0.155510 Oct 11 05:17:28.921570 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3811/7388] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:28 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:29.945176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f709644-2c95-45f1-a38e-7b086ce78096 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:29.945817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3f709644-2c95-45f1-a38e-7b086ce78096 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:29.952393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f709644-2c95-45f1-a38e-7b086ce78096 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:29.952880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f709644-2c95-45f1-a38e-7b086ce78096 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:29.953322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f709644-2c95-45f1-a38e-7b086ce78096 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:29.954064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f709644-2c95-45f1-a38e-7b086ce78096 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:29.954471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f709644-2c95-45f1-a38e-7b086ce78096 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:29.955563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f709644-2c95-45f1-a38e-7b086ce78096 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:30.093113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3f709644-2c95-45f1-a38e-7b086ce78096 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:30.100898 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3f709644-2c95-45f1-a38e-7b086ce78096 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1517 microversion: 2.1 time: 0.159561 Oct 11 05:17:30.101474 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3578/7389] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:29 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1517 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:31.124018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fc9b2bd3-bbc3-4b4b-8571-2d116e973694 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:31.124641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fc9b2bd3-bbc3-4b4b-8571-2d116e973694 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:31.131445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc9b2bd3-bbc3-4b4b-8571-2d116e973694 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:31.131934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc9b2bd3-bbc3-4b4b-8571-2d116e973694 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:31.132381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc9b2bd3-bbc3-4b4b-8571-2d116e973694 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:31.133062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc9b2bd3-bbc3-4b4b-8571-2d116e973694 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:31.133524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc9b2bd3-bbc3-4b4b-8571-2d116e973694 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:31.133957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc9b2bd3-bbc3-4b4b-8571-2d116e973694 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:31.260815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fc9b2bd3-bbc3-4b4b-8571-2d116e973694 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:31.269448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fc9b2bd3-bbc3-4b4b-8571-2d116e973694 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.149260 Oct 11 05:17:31.270073 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3812/7390] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:31 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:32.294906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c52d72e4-c247-4bfa-847a-454ae0f427f3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:32.295453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c52d72e4-c247-4bfa-847a-454ae0f427f3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:32.302878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c52d72e4-c247-4bfa-847a-454ae0f427f3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:32.303366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c52d72e4-c247-4bfa-847a-454ae0f427f3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:32.303804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c52d72e4-c247-4bfa-847a-454ae0f427f3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:32.304486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c52d72e4-c247-4bfa-847a-454ae0f427f3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:32.304936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c52d72e4-c247-4bfa-847a-454ae0f427f3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:32.305357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c52d72e4-c247-4bfa-847a-454ae0f427f3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:32.436596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c52d72e4-c247-4bfa-847a-454ae0f427f3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:32.444236 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c52d72e4-c247-4bfa-847a-454ae0f427f3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.153278 Oct 11 05:17:32.444805 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3579/7391] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:32 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:33.468099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4641f67e-2670-4772-a865-01ae2b63cfa8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:33.468740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4641f67e-2670-4772-a865-01ae2b63cfa8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:33.475525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4641f67e-2670-4772-a865-01ae2b63cfa8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:33.476017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4641f67e-2670-4772-a865-01ae2b63cfa8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:33.476469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4641f67e-2670-4772-a865-01ae2b63cfa8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:33.477163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4641f67e-2670-4772-a865-01ae2b63cfa8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:33.477625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4641f67e-2670-4772-a865-01ae2b63cfa8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:33.478064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4641f67e-2670-4772-a865-01ae2b63cfa8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:33.605598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4641f67e-2670-4772-a865-01ae2b63cfa8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:33.614095 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4641f67e-2670-4772-a865-01ae2b63cfa8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.150089 Oct 11 05:17:33.614740 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3813/7392] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:33 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:34.637648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-29eb6fd1-665d-428e-9e64-3c6b53b8373d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:34.638365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-29eb6fd1-665d-428e-9e64-3c6b53b8373d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:34.645263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29eb6fd1-665d-428e-9e64-3c6b53b8373d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:34.645757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29eb6fd1-665d-428e-9e64-3c6b53b8373d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:34.646221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29eb6fd1-665d-428e-9e64-3c6b53b8373d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:34.646947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29eb6fd1-665d-428e-9e64-3c6b53b8373d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:34.647399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29eb6fd1-665d-428e-9e64-3c6b53b8373d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:34.647837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-29eb6fd1-665d-428e-9e64-3c6b53b8373d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:34.777855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-29eb6fd1-665d-428e-9e64-3c6b53b8373d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:34.786375 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-29eb6fd1-665d-428e-9e64-3c6b53b8373d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.152898 Oct 11 05:17:34.786945 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3580/7393] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:34 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:35.809798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d683d75f-1206-4fb7-bbad-0a21d67f1348 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:35.810459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d683d75f-1206-4fb7-bbad-0a21d67f1348 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:35.817763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d683d75f-1206-4fb7-bbad-0a21d67f1348 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:35.818279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d683d75f-1206-4fb7-bbad-0a21d67f1348 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:35.818729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d683d75f-1206-4fb7-bbad-0a21d67f1348 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:35.819422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d683d75f-1206-4fb7-bbad-0a21d67f1348 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:35.819880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d683d75f-1206-4fb7-bbad-0a21d67f1348 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:35.820312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d683d75f-1206-4fb7-bbad-0a21d67f1348 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:35.956533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d683d75f-1206-4fb7-bbad-0a21d67f1348 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:35.964298 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d683d75f-1206-4fb7-bbad-0a21d67f1348 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.158415 Oct 11 05:17:35.964868 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3814/7394] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:35 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:36.988467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4b20b47c-d0b7-4684-b05d-a0b5f4de93e8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:36.989082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4b20b47c-d0b7-4684-b05d-a0b5f4de93e8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:36.996116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b20b47c-d0b7-4684-b05d-a0b5f4de93e8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:36.996597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b20b47c-d0b7-4684-b05d-a0b5f4de93e8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:36.997035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b20b47c-d0b7-4684-b05d-a0b5f4de93e8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:36.997719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b20b47c-d0b7-4684-b05d-a0b5f4de93e8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:36.998171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b20b47c-d0b7-4684-b05d-a0b5f4de93e8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:36.998620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b20b47c-d0b7-4684-b05d-a0b5f4de93e8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:37.127512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4b20b47c-d0b7-4684-b05d-a0b5f4de93e8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:37.135126 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4b20b47c-d0b7-4684-b05d-a0b5f4de93e8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.151100 Oct 11 05:17:37.135691 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3581/7395] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:36 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:38.158828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc7104ff-61df-48cb-8b56-bcffc72df778 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:38.159457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bc7104ff-61df-48cb-8b56-bcffc72df778 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:38.166400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc7104ff-61df-48cb-8b56-bcffc72df778 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:38.166894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc7104ff-61df-48cb-8b56-bcffc72df778 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:38.167343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc7104ff-61df-48cb-8b56-bcffc72df778 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:38.168042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc7104ff-61df-48cb-8b56-bcffc72df778 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:38.168508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc7104ff-61df-48cb-8b56-bcffc72df778 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:38.168946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc7104ff-61df-48cb-8b56-bcffc72df778 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:38.296100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bc7104ff-61df-48cb-8b56-bcffc72df778 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:38.303812 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bc7104ff-61df-48cb-8b56-bcffc72df778 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.148985 Oct 11 05:17:38.304380 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3815/7396] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:38 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:39.327474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7bbb2683-0be3-421e-983d-d2f7e50168aa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:39.328342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7bbb2683-0be3-421e-983d-d2f7e50168aa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:39.335225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bbb2683-0be3-421e-983d-d2f7e50168aa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:39.335701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bbb2683-0be3-421e-983d-d2f7e50168aa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:39.336132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bbb2683-0be3-421e-983d-d2f7e50168aa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:39.336812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bbb2683-0be3-421e-983d-d2f7e50168aa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:39.337257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bbb2683-0be3-421e-983d-d2f7e50168aa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:39.337706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bbb2683-0be3-421e-983d-d2f7e50168aa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:39.468660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7bbb2683-0be3-421e-983d-d2f7e50168aa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:39.476446 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7bbb2683-0be3-421e-983d-d2f7e50168aa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.152731 Oct 11 05:17:39.476997 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3582/7397] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:39 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:40.499364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90c7fbd7-7ac8-4e47-b256-fbc7c204be56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:40.499988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90c7fbd7-7ac8-4e47-b256-fbc7c204be56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:40.507214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90c7fbd7-7ac8-4e47-b256-fbc7c204be56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:40.507704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90c7fbd7-7ac8-4e47-b256-fbc7c204be56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:40.508154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90c7fbd7-7ac8-4e47-b256-fbc7c204be56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:40.508849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90c7fbd7-7ac8-4e47-b256-fbc7c204be56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:40.509312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90c7fbd7-7ac8-4e47-b256-fbc7c204be56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:40.509745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90c7fbd7-7ac8-4e47-b256-fbc7c204be56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:40.641207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-90c7fbd7-7ac8-4e47-b256-fbc7c204be56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:40.649903 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90c7fbd7-7ac8-4e47-b256-fbc7c204be56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.154386 Oct 11 05:17:40.650506 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3816/7398] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:40 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:41.673049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-446bcc92-c3ee-4203-b532-799c1d581002 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:41.674169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-446bcc92-c3ee-4203-b532-799c1d581002 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:41.682014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-446bcc92-c3ee-4203-b532-799c1d581002 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:41.682906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-446bcc92-c3ee-4203-b532-799c1d581002 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:41.683357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-446bcc92-c3ee-4203-b532-799c1d581002 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:41.684070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-446bcc92-c3ee-4203-b532-799c1d581002 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:41.684519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-446bcc92-c3ee-4203-b532-799c1d581002 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:41.684948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-446bcc92-c3ee-4203-b532-799c1d581002 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:41.821733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-446bcc92-c3ee-4203-b532-799c1d581002 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:41.829557 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-446bcc92-c3ee-4203-b532-799c1d581002 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.160375 Oct 11 05:17:41.830108 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3583/7399] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:41 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:42.852778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5217f789-1898-442e-af5c-dcfe3105ec98 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:42.853407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5217f789-1898-442e-af5c-dcfe3105ec98 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:42.860166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5217f789-1898-442e-af5c-dcfe3105ec98 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:42.860700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5217f789-1898-442e-af5c-dcfe3105ec98 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:42.861686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5217f789-1898-442e-af5c-dcfe3105ec98 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:42.862475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5217f789-1898-442e-af5c-dcfe3105ec98 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:42.862955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5217f789-1898-442e-af5c-dcfe3105ec98 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:42.863417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5217f789-1898-442e-af5c-dcfe3105ec98 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:42.992120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5217f789-1898-442e-af5c-dcfe3105ec98 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:42.995589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:17:43.000137 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5217f789-1898-442e-af5c-dcfe3105ec98 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.151272 Oct 11 05:17:43.000714 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3817/7400] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:42 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:44.023051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b8dee676-c004-4991-b4a6-8278a6b00d74 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:44.023663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b8dee676-c004-4991-b4a6-8278a6b00d74 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:44.030398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8dee676-c004-4991-b4a6-8278a6b00d74 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:44.030874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8dee676-c004-4991-b4a6-8278a6b00d74 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:44.031308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8dee676-c004-4991-b4a6-8278a6b00d74 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:44.032014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8dee676-c004-4991-b4a6-8278a6b00d74 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:44.032973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8dee676-c004-4991-b4a6-8278a6b00d74 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:44.033393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8dee676-c004-4991-b4a6-8278a6b00d74 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:44.168685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b8dee676-c004-4991-b4a6-8278a6b00d74 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:44.177124 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b8dee676-c004-4991-b4a6-8278a6b00d74 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.157987 Oct 11 05:17:44.177696 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3584/7401] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:44 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:45.200741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-432f9d47-9db7-45e3-9308-eb6c1446a85d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:45.201352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-432f9d47-9db7-45e3-9308-eb6c1446a85d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:45.204095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:17:45.209153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432f9d47-9db7-45e3-9308-eb6c1446a85d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:45.209647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432f9d47-9db7-45e3-9308-eb6c1446a85d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:45.210097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432f9d47-9db7-45e3-9308-eb6c1446a85d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:45.210825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432f9d47-9db7-45e3-9308-eb6c1446a85d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:45.211288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432f9d47-9db7-45e3-9308-eb6c1446a85d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:45.217434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-432f9d47-9db7-45e3-9308-eb6c1446a85d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:45.345295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-432f9d47-9db7-45e3-9308-eb6c1446a85d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:45.352980 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-432f9d47-9db7-45e3-9308-eb6c1446a85d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.156565 Oct 11 05:17:45.353550 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3818/7402] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:45 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:46.376961 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d78f0745-bbe1-410f-85e3-e3d10c426cbb tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:46.378091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d78f0745-bbe1-410f-85e3-e3d10c426cbb tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:46.384964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78f0745-bbe1-410f-85e3-e3d10c426cbb tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:46.385439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78f0745-bbe1-410f-85e3-e3d10c426cbb tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:46.385871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78f0745-bbe1-410f-85e3-e3d10c426cbb tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:46.386573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78f0745-bbe1-410f-85e3-e3d10c426cbb tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:46.387022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78f0745-bbe1-410f-85e3-e3d10c426cbb tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:46.387440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d78f0745-bbe1-410f-85e3-e3d10c426cbb tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:46.521294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d78f0745-bbe1-410f-85e3-e3d10c426cbb tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:46.529087 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d78f0745-bbe1-410f-85e3-e3d10c426cbb tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.156029 Oct 11 05:17:46.529652 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3585/7403] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:46 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:47.552884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-95a44f0b-633c-4b22-a8d4-0144d0c93eb0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:47.558272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-95a44f0b-633c-4b22-a8d4-0144d0c93eb0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:47.562221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95a44f0b-633c-4b22-a8d4-0144d0c93eb0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:47.562872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95a44f0b-633c-4b22-a8d4-0144d0c93eb0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:47.563334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95a44f0b-633c-4b22-a8d4-0144d0c93eb0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:47.564050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95a44f0b-633c-4b22-a8d4-0144d0c93eb0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:47.564555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95a44f0b-633c-4b22-a8d4-0144d0c93eb0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:47.565573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95a44f0b-633c-4b22-a8d4-0144d0c93eb0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:47.695260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-95a44f0b-633c-4b22-a8d4-0144d0c93eb0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:47.703067 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-95a44f0b-633c-4b22-a8d4-0144d0c93eb0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1522 microversion: 2.1 time: 0.154978 Oct 11 05:17:47.703841 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3819/7404] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:47 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:48.727410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-20bef807-08ad-4db0-8ceb-62938913c46f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:48.728000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-20bef807-08ad-4db0-8ceb-62938913c46f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:48.730890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=39 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:17:48.735550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20bef807-08ad-4db0-8ceb-62938913c46f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:48.736034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20bef807-08ad-4db0-8ceb-62938913c46f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:48.736469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20bef807-08ad-4db0-8ceb-62938913c46f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:48.737788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20bef807-08ad-4db0-8ceb-62938913c46f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:48.738260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20bef807-08ad-4db0-8ceb-62938913c46f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:48.738690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20bef807-08ad-4db0-8ceb-62938913c46f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:48.742667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:17:48.874045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-20bef807-08ad-4db0-8ceb-62938913c46f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:48.881799 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-20bef807-08ad-4db0-8ceb-62938913c46f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1521 microversion: 2.1 time: 0.158456 Oct 11 05:17:48.882386 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3586/7405] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:48 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:48.891892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1e58b839-291e-4ef6-95e6-1d10f54b9a91 req-2a10f714-d07e-475d-a3a7-acaa7620024d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4750455a-d7d5-4b9c-9337-3555e752cdb8", "name": "network-vif-unplugged", "status": "completed", "tag": "b723f91b-f4bf-44f3-89d3-288e80e3134e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:48.908114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1e58b839-291e-4ef6-95e6-1d10f54b9a91 req-2a10f714-d07e-475d-a3a7-acaa7620024d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:48.908114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1e58b839-291e-4ef6-95e6-1d10f54b9a91 req-2a10f714-d07e-475d-a3a7-acaa7620024d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:48.908114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1e58b839-291e-4ef6-95e6-1d10f54b9a91 req-2a10f714-d07e-475d-a3a7-acaa7620024d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:48.915047 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1e58b839-291e-4ef6-95e6-1d10f54b9a91 req-2a10f714-d07e-475d-a3a7-acaa7620024d service nova] Creating event network-vif-unplugged:b723f91b-f4bf-44f3-89d3-288e80e3134e for instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 on n-h2-860892-1 Oct 11 05:17:48.920341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-1e58b839-291e-4ef6-95e6-1d10f54b9a91 req-2a10f714-d07e-475d-a3a7-acaa7620024d service nova] Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:17:48.932343 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1e58b839-291e-4ef6-95e6-1d10f54b9a91 req-2a10f714-d07e-475d-a3a7-acaa7620024d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.105487 Oct 11 05:17:48.933003 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3820/7406] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:17:48 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:17:49.916437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-993adbd5-3560-4e78-8439-3f8584738a22 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:49.917092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-993adbd5-3560-4e78-8439-3f8584738a22 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:49.924127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-993adbd5-3560-4e78-8439-3f8584738a22 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:49.924608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-993adbd5-3560-4e78-8439-3f8584738a22 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:49.925047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-993adbd5-3560-4e78-8439-3f8584738a22 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:49.926281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-993adbd5-3560-4e78-8439-3f8584738a22 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:49.926738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-993adbd5-3560-4e78-8439-3f8584738a22 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:49.927190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-993adbd5-3560-4e78-8439-3f8584738a22 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:50.060703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-993adbd5-3560-4e78-8439-3f8584738a22 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:50.066017 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-993adbd5-3560-4e78-8439-3f8584738a22 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1521 microversion: 2.1 time: 0.153937 Oct 11 05:17:50.066622 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3587/7407] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:49 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:50.947787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-3096c4a8-3292-42bb-b255-44dee941691e req-09735ba8-9270-4e42-aa23-3c8074e688ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4750455a-d7d5-4b9c-9337-3555e752cdb8", "tag": "b723f91b-f4bf-44f3-89d3-288e80e3134e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:50.957488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3096c4a8-3292-42bb-b255-44dee941691e req-09735ba8-9270-4e42-aa23-3c8074e688ce service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:50.958754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3096c4a8-3292-42bb-b255-44dee941691e req-09735ba8-9270-4e42-aa23-3c8074e688ce service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:50.959207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3096c4a8-3292-42bb-b255-44dee941691e req-09735ba8-9270-4e42-aa23-3c8074e688ce service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:50.973068 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-3096c4a8-3292-42bb-b255-44dee941691e req-09735ba8-9270-4e42-aa23-3c8074e688ce service nova] Creating event network-changed:b723f91b-f4bf-44f3-89d3-288e80e3134e for instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 on n-h2-860892-1 Oct 11 05:17:50.978214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-3096c4a8-3292-42bb-b255-44dee941691e req-09735ba8-9270-4e42-aa23-3c8074e688ce service nova] Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:17:50.988551 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-3096c4a8-3292-42bb-b255-44dee941691e req-09735ba8-9270-4e42-aa23-3c8074e688ce service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045017 Oct 11 05:17:50.989137 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3821/7408] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:17:51.088989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b15067b1-1b2e-4e96-b62a-47e4412afb71 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:51.089762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b15067b1-1b2e-4e96-b62a-47e4412afb71 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:51.096494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b15067b1-1b2e-4e96-b62a-47e4412afb71 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:51.096980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b15067b1-1b2e-4e96-b62a-47e4412afb71 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:51.097423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b15067b1-1b2e-4e96-b62a-47e4412afb71 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:51.098118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b15067b1-1b2e-4e96-b62a-47e4412afb71 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:51.098605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b15067b1-1b2e-4e96-b62a-47e4412afb71 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:51.099028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b15067b1-1b2e-4e96-b62a-47e4412afb71 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:51.234474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b15067b1-1b2e-4e96-b62a-47e4412afb71 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:51.242767 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b15067b1-1b2e-4e96-b62a-47e4412afb71 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1519 microversion: 2.1 time: 0.157707 Oct 11 05:17:51.243364 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3588/7409] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:51 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:52.268288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-39c8d45c-520e-42b9-852a-a5fa4d3c4dd2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:52.268993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-39c8d45c-520e-42b9-852a-a5fa4d3c4dd2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:52.275698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39c8d45c-520e-42b9-852a-a5fa4d3c4dd2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:52.276188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39c8d45c-520e-42b9-852a-a5fa4d3c4dd2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:52.276632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39c8d45c-520e-42b9-852a-a5fa4d3c4dd2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:52.277321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39c8d45c-520e-42b9-852a-a5fa4d3c4dd2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:52.277779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39c8d45c-520e-42b9-852a-a5fa4d3c4dd2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:52.278226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-39c8d45c-520e-42b9-852a-a5fa4d3c4dd2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:52.405188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-39c8d45c-520e-42b9-852a-a5fa4d3c4dd2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:52.413287 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-39c8d45c-520e-42b9-852a-a5fa4d3c4dd2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1516 microversion: 2.1 time: 0.150226 Oct 11 05:17:52.413865 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3822/7410] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:52 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1516 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:52.436092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3faa4aab-edb7-4d35-a987-c4bbbfa9a419 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:52.436618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3faa4aab-edb7-4d35-a987-c4bbbfa9a419 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:52.443538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3faa4aab-edb7-4d35-a987-c4bbbfa9a419 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:52.444021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3faa4aab-edb7-4d35-a987-c4bbbfa9a419 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:52.444457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3faa4aab-edb7-4d35-a987-c4bbbfa9a419 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:52.445153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3faa4aab-edb7-4d35-a987-c4bbbfa9a419 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:52.445609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3faa4aab-edb7-4d35-a987-c4bbbfa9a419 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:52.446033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3faa4aab-edb7-4d35-a987-c4bbbfa9a419 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:52.676004 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3faa4aab-edb7-4d35-a987-c4bbbfa9a419 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "POST /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8/action" status: 204 len: 0 microversion: 2.1 time: 0.243566 Oct 11 05:17:52.676695 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3589/7411] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:17:52 2022] POST /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8/action => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:17:52.685100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6159874c-1424-4d4f-8ccd-0ca37fdbcbe0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:52.685723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6159874c-1424-4d4f-8ccd-0ca37fdbcbe0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:52.691913 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6159874c-1424-4d4f-8ccd-0ca37fdbcbe0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:52.692411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6159874c-1424-4d4f-8ccd-0ca37fdbcbe0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:52.692857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6159874c-1424-4d4f-8ccd-0ca37fdbcbe0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:52.693558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6159874c-1424-4d4f-8ccd-0ca37fdbcbe0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:52.694019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6159874c-1424-4d4f-8ccd-0ca37fdbcbe0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:52.694566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6159874c-1424-4d4f-8ccd-0ca37fdbcbe0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:52.868008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6159874c-1424-4d4f-8ccd-0ca37fdbcbe0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:52.875987 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6159874c-1424-4d4f-8ccd-0ca37fdbcbe0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1516 microversion: 2.1 time: 0.194931 Oct 11 05:17:52.876762 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3823/7412] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:52 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1516 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:53.900028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b05cd8a8-d8d9-4db4-9e99-3942a0b9e35e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:53.900720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b05cd8a8-d8d9-4db4-9e99-3942a0b9e35e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:53.906739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05cd8a8-d8d9-4db4-9e99-3942a0b9e35e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:53.907212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05cd8a8-d8d9-4db4-9e99-3942a0b9e35e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:53.907644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05cd8a8-d8d9-4db4-9e99-3942a0b9e35e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:53.908320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05cd8a8-d8d9-4db4-9e99-3942a0b9e35e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:53.908788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05cd8a8-d8d9-4db4-9e99-3942a0b9e35e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:53.909205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b05cd8a8-d8d9-4db4-9e99-3942a0b9e35e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:54.048315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b05cd8a8-d8d9-4db4-9e99-3942a0b9e35e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:54.056695 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b05cd8a8-d8d9-4db4-9e99-3942a0b9e35e tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1516 microversion: 2.1 time: 0.161698 Oct 11 05:17:54.057269 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3590/7413] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:53 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1516 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:55.080186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-58c76dfb-bef5-440c-8bec-d612681aa3d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:55.080839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-58c76dfb-bef5-440c-8bec-d612681aa3d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:55.087900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58c76dfb-bef5-440c-8bec-d612681aa3d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:55.088389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58c76dfb-bef5-440c-8bec-d612681aa3d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:55.088835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58c76dfb-bef5-440c-8bec-d612681aa3d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:55.089527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58c76dfb-bef5-440c-8bec-d612681aa3d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:55.089994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58c76dfb-bef5-440c-8bec-d612681aa3d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:55.090461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58c76dfb-bef5-440c-8bec-d612681aa3d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:55.218901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-58c76dfb-bef5-440c-8bec-d612681aa3d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:55.227606 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-58c76dfb-bef5-440c-8bec-d612681aa3d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1508 microversion: 2.1 time: 0.151192 Oct 11 05:17:55.230753 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3824/7414] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:55 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:55.250551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90a24637-bc25-4505-afb2-4fb49ddac857 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:55.251162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90a24637-bc25-4505-afb2-4fb49ddac857 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:55.258062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a24637-bc25-4505-afb2-4fb49ddac857 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:55.265333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a24637-bc25-4505-afb2-4fb49ddac857 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:55.265333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a24637-bc25-4505-afb2-4fb49ddac857 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:55.265333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a24637-bc25-4505-afb2-4fb49ddac857 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:55.265333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a24637-bc25-4505-afb2-4fb49ddac857 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:55.265333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90a24637-bc25-4505-afb2-4fb49ddac857 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:55.390571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90a24637-bc25-4505-afb2-4fb49ddac857 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:55.398278 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90a24637-bc25-4505-afb2-4fb49ddac857 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1508 microversion: 2.1 time: 0.151671 Oct 11 05:17:55.398858 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3591/7415] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:55 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:55.423402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4006831d-dafc-4b62-a914-22672126974a req-e167e92d-2d59-4b8c-89ed-42c0406972fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4750455a-d7d5-4b9c-9337-3555e752cdb8", "name": "network-vif-plugged", "status": "completed", "tag": "b723f91b-f4bf-44f3-89d3-288e80e3134e"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:55.424091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4b0cb3fa-a6c3-4f4f-9e45-2dcb4152cb84 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Action: 'create', calling method: .version_select at 0x7fda18a925e0>, body: {"keypair": {"name": "tempest-keypair-475185252", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKMngmVhvILt+sh1CoTVmhnxVczOKlVK28q8s1GllqT93USjjgzce8uT1IOtjproUUxNqQPONNH3LAVrT6SqaVs87R8JN7VB1jmSMdxNkQxSJggaUAZ3NJOiqwFErZiEhw=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:55.440151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4006831d-dafc-4b62-a914-22672126974a req-e167e92d-2d59-4b8c-89ed-42c0406972fe service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:55.440151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4006831d-dafc-4b62-a914-22672126974a req-e167e92d-2d59-4b8c-89ed-42c0406972fe service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:55.440151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4006831d-dafc-4b62-a914-22672126974a req-e167e92d-2d59-4b8c-89ed-42c0406972fe service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:55.440494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-4b0cb3fa-a6c3-4f4f-9e45-2dcb4152cb84 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Getting quotas for project afc63b66d4b34703850b708b96289079. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:17:55.445395 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4006831d-dafc-4b62-a914-22672126974a req-e167e92d-2d59-4b8c-89ed-42c0406972fe service nova] Creating event network-vif-plugged:b723f91b-f4bf-44f3-89d3-288e80e3134e for instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 on n-h2-860892-1 Oct 11 05:17:55.445582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-4b0cb3fa-a6c3-4f4f-9e45-2dcb4152cb84 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Getting quotas for user 61a36add99334f6ab443e615dfd7b0cd and project afc63b66d4b34703850b708b96289079. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:17:55.450539 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4006831d-dafc-4b62-a914-22672126974a req-e167e92d-2d59-4b8c-89ed-42c0406972fe service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030902 Oct 11 05:17:55.451390 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3825/7416] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:17:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:17:55.544563 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4b0cb3fa-a6c3-4f4f-9e45-2dcb4152cb84 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.124545 Oct 11 05:17:55.545173 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3592/7417] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:17:55 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:17:58.009485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef33982c-10fa-4499-9bc4-585ae5b245a3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:58.010242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef33982c-10fa-4499-9bc4-585ae5b245a3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:58.016629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef33982c-10fa-4499-9bc4-585ae5b245a3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:58.017124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef33982c-10fa-4499-9bc4-585ae5b245a3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:58.017586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef33982c-10fa-4499-9bc4-585ae5b245a3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:58.018314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef33982c-10fa-4499-9bc4-585ae5b245a3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:58.018792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef33982c-10fa-4499-9bc4-585ae5b245a3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:58.019237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef33982c-10fa-4499-9bc4-585ae5b245a3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:58.148962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ef33982c-10fa-4499-9bc4-585ae5b245a3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:58.156670 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef33982c-10fa-4499-9bc4-585ae5b245a3 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 200 len: 1508 microversion: 2.1 time: 0.153059 Oct 11 05:17:58.157242 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3826/7418] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:58 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:17:58.180637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b2e00cf2-7d87-4fcc-b1f4-5aabf71a532f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:58.181141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b2e00cf2-7d87-4fcc-b1f4-5aabf71a532f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:58.187784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2e00cf2-7d87-4fcc-b1f4-5aabf71a532f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:58.190929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2e00cf2-7d87-4fcc-b1f4-5aabf71a532f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:58.190929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2e00cf2-7d87-4fcc-b1f4-5aabf71a532f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:58.190929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2e00cf2-7d87-4fcc-b1f4-5aabf71a532f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:58.190929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2e00cf2-7d87-4fcc-b1f4-5aabf71a532f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:58.190929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b2e00cf2-7d87-4fcc-b1f4-5aabf71a532f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:58.214147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b2e00cf2-7d87-4fcc-b1f4-5aabf71a532f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:17:58.496814 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b2e00cf2-7d87-4fcc-b1f4-5aabf71a532f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 204 len: 0 microversion: 2.1 time: 0.321157 Oct 11 05:17:58.497402 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3593/7419] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:17:58 2022] DELETE /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:17:58.553998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerDiskConfigTestJSON-server-840805943", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "57b114c4-7a66-40d6-91a7-0eb830329c1f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:17:58.607358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] validate_networks() for [('57b114c4-7a66-40d6-91a7-0eb830329c1f', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:17:59.015696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:17:59.016297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:17:59.016605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:17:59.017027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:17:59.017452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:17:59.026862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:59.027356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:59.027802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:59.028537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:17:59.029000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:17:59.029441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:17:59.045833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Getting quotas for project afc63b66d4b34703850b708b96289079. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:17:59.050996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Getting quotas for user 61a36add99334f6ab443e615dfd7b0cd and project afc63b66d4b34703850b708b96289079. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:17:59.063046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:17:59.065328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:17:59.210288 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6f5f5d47-4ec9-4808-948b-3df6f9e9db92 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660110 Oct 11 05:17:59.210993 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3827/7420] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:17:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:17:59.223418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-23907b8c-a217-4096-8dab-39d21d50df8c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:17:59.224124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-23907b8c-a217-4096-8dab-39d21d50df8c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:17:59.279107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-23907b8c-a217-4096-8dab-39d21d50df8c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:17:59.286856 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-23907b8c-a217-4096-8dab-39d21d50df8c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1217 microversion: 2.1 time: 0.067699 Oct 11 05:17:59.287422 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3594/7421] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:17:59 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1217 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:18:00.311132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f3c205a1-27bb-4580-bc13-1debe24834af tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:00.312511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f3c205a1-27bb-4580-bc13-1debe24834af tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:00.320613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c205a1-27bb-4580-bc13-1debe24834af tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:00.321405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c205a1-27bb-4580-bc13-1debe24834af tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:00.322350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c205a1-27bb-4580-bc13-1debe24834af tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:00.323295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c205a1-27bb-4580-bc13-1debe24834af tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:00.324172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c205a1-27bb-4580-bc13-1debe24834af tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:00.325034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c205a1-27bb-4580-bc13-1debe24834af tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:00.350363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2132fd22-3bd3-4522-b149-1066d7d5d383 req-aa0ebc21-b375-41e5-817b-be1958f92acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4750455a-d7d5-4b9c-9337-3555e752cdb8", "name": "network-vif-deleted", "tag": "b723f91b-f4bf-44f3-89d3-288e80e3134e"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:18:00.362455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2132fd22-3bd3-4522-b149-1066d7d5d383 req-aa0ebc21-b375-41e5-817b-be1958f92acf service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:00.363267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2132fd22-3bd3-4522-b149-1066d7d5d383 req-aa0ebc21-b375-41e5-817b-be1958f92acf service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:00.365564 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2132fd22-3bd3-4522-b149-1066d7d5d383 req-aa0ebc21-b375-41e5-817b-be1958f92acf service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:00.377337 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2132fd22-3bd3-4522-b149-1066d7d5d383 req-aa0ebc21-b375-41e5-817b-be1958f92acf service nova] Creating event network-vif-deleted:b723f91b-f4bf-44f3-89d3-288e80e3134e for instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 on n-h2-860892-1 Oct 11 05:18:00.382715 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2132fd22-3bd3-4522-b149-1066d7d5d383 req-aa0ebc21-b375-41e5-817b-be1958f92acf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036168 Oct 11 05:18:00.383572 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3595/7422] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:18:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:18:00.407158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f3c205a1-27bb-4580-bc13-1debe24834af tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:00.416327 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f3c205a1-27bb-4580-bc13-1debe24834af tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1221 microversion: 2.1 time: 0.110323 Oct 11 05:18:00.422090 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3828/7423] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:00 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1221 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:01.441980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-968bf9ad-b33a-4ec7-97ff-590ef9dedcc2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:01.442833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-968bf9ad-b33a-4ec7-97ff-590ef9dedcc2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:01.450302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-968bf9ad-b33a-4ec7-97ff-590ef9dedcc2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:01.450898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-968bf9ad-b33a-4ec7-97ff-590ef9dedcc2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:01.452068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-968bf9ad-b33a-4ec7-97ff-590ef9dedcc2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:01.453095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-968bf9ad-b33a-4ec7-97ff-590ef9dedcc2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:01.453825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-968bf9ad-b33a-4ec7-97ff-590ef9dedcc2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:01.454365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-968bf9ad-b33a-4ec7-97ff-590ef9dedcc2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:01.533475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-968bf9ad-b33a-4ec7-97ff-590ef9dedcc2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:01.542268 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-968bf9ad-b33a-4ec7-97ff-590ef9dedcc2 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1277 microversion: 2.1 time: 0.105319 Oct 11 05:18:01.543185 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3596/7424] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:01 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:02.568224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-97eb299e-05fc-4ad4-a35c-6baf7457bf15 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:02.570217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-97eb299e-05fc-4ad4-a35c-6baf7457bf15 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:02.577097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97eb299e-05fc-4ad4-a35c-6baf7457bf15 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:02.577617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97eb299e-05fc-4ad4-a35c-6baf7457bf15 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:02.578052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97eb299e-05fc-4ad4-a35c-6baf7457bf15 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:02.578783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97eb299e-05fc-4ad4-a35c-6baf7457bf15 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:02.579246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97eb299e-05fc-4ad4-a35c-6baf7457bf15 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:02.579776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97eb299e-05fc-4ad4-a35c-6baf7457bf15 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:02.784823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-97eb299e-05fc-4ad4-a35c-6baf7457bf15 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:02.792987 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-97eb299e-05fc-4ad4-a35c-6baf7457bf15 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1317 microversion: 2.1 time: 0.228645 Oct 11 05:18:02.793577 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3829/7425] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:02 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1317 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:03.251266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-7ca96416-62d4-4b6c-84c4-508335ebb2b8 req-226990fc-340e-46ff-b252-e9ee58d36e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1a7f71-e528-4bfb-bb63-d7f2bec750e4", "tag": "5f15e36e-5e3a-4b96-8b15-8776f41e1cd8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:18:03.262879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7ca96416-62d4-4b6c-84c4-508335ebb2b8 req-226990fc-340e-46ff-b252-e9ee58d36e7c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:03.263361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7ca96416-62d4-4b6c-84c4-508335ebb2b8 req-226990fc-340e-46ff-b252-e9ee58d36e7c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:03.263791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7ca96416-62d4-4b6c-84c4-508335ebb2b8 req-226990fc-340e-46ff-b252-e9ee58d36e7c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:03.275432 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7ca96416-62d4-4b6c-84c4-508335ebb2b8 req-226990fc-340e-46ff-b252-e9ee58d36e7c service nova] Creating event network-changed:5f15e36e-5e3a-4b96-8b15-8776f41e1cd8 for instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 on n-h2-860892-1 Oct 11 05:18:03.280151 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-7ca96416-62d4-4b6c-84c4-508335ebb2b8 req-226990fc-340e-46ff-b252-e9ee58d36e7c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033501 Oct 11 05:18:03.280931 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3597/7426] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:18:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:18:03.815932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dee1161a-8146-46ea-8d77-72541937f39a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:03.816657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dee1161a-8146-46ea-8d77-72541937f39a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:03.823892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee1161a-8146-46ea-8d77-72541937f39a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:03.824389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee1161a-8146-46ea-8d77-72541937f39a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:03.824838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee1161a-8146-46ea-8d77-72541937f39a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:03.825840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee1161a-8146-46ea-8d77-72541937f39a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:03.826415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee1161a-8146-46ea-8d77-72541937f39a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:03.826855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dee1161a-8146-46ea-8d77-72541937f39a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:04.027688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dee1161a-8146-46ea-8d77-72541937f39a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:04.035577 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dee1161a-8146-46ea-8d77-72541937f39a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1317 microversion: 2.1 time: 0.223530 Oct 11 05:18:04.036151 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3830/7427] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:03 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1317 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:05.059997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a886db4b-63eb-4f31-bdf2-26b3eb912b67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:05.060692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a886db4b-63eb-4f31-bdf2-26b3eb912b67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:05.066981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a886db4b-63eb-4f31-bdf2-26b3eb912b67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:05.067459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a886db4b-63eb-4f31-bdf2-26b3eb912b67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:05.067896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a886db4b-63eb-4f31-bdf2-26b3eb912b67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:05.068582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a886db4b-63eb-4f31-bdf2-26b3eb912b67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:05.069032 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a886db4b-63eb-4f31-bdf2-26b3eb912b67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:05.069456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a886db4b-63eb-4f31-bdf2-26b3eb912b67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:05.200073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a886db4b-63eb-4f31-bdf2-26b3eb912b67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:05.207911 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a886db4b-63eb-4f31-bdf2-26b3eb912b67 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1317 microversion: 2.1 time: 0.153768 Oct 11 05:18:05.208524 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3598/7428] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:05 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:06.232264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ec16f92a-8632-40fd-a930-e9c8fc0d5e6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:06.232787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ec16f92a-8632-40fd-a930-e9c8fc0d5e6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:06.239595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec16f92a-8632-40fd-a930-e9c8fc0d5e6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:06.240086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec16f92a-8632-40fd-a930-e9c8fc0d5e6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:06.240533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec16f92a-8632-40fd-a930-e9c8fc0d5e6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:06.241224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec16f92a-8632-40fd-a930-e9c8fc0d5e6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:06.241736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec16f92a-8632-40fd-a930-e9c8fc0d5e6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:06.242171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec16f92a-8632-40fd-a930-e9c8fc0d5e6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:06.370357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ec16f92a-8632-40fd-a930-e9c8fc0d5e6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:06.377985 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ec16f92a-8632-40fd-a930-e9c8fc0d5e6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1317 microversion: 2.1 time: 0.150035 Oct 11 05:18:06.378596 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3831/7429] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:06 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1317 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:07.401122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6cc4aaf4-1552-401e-8186-1b1860f6d03d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:07.401786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6cc4aaf4-1552-401e-8186-1b1860f6d03d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:07.408855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cc4aaf4-1552-401e-8186-1b1860f6d03d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:07.409334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cc4aaf4-1552-401e-8186-1b1860f6d03d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:07.409763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cc4aaf4-1552-401e-8186-1b1860f6d03d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:07.410480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cc4aaf4-1552-401e-8186-1b1860f6d03d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:07.410926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cc4aaf4-1552-401e-8186-1b1860f6d03d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:07.411344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cc4aaf4-1552-401e-8186-1b1860f6d03d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:07.546929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6cc4aaf4-1552-401e-8186-1b1860f6d03d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:07.554789 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6cc4aaf4-1552-401e-8186-1b1860f6d03d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1317 microversion: 2.1 time: 0.157729 Oct 11 05:18:07.555357 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3599/7430] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:07 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:08.577537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6f779a7-eee0-4774-960a-41df15fb12ce tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:08.578159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6f779a7-eee0-4774-960a-41df15fb12ce tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:08.585310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6f779a7-eee0-4774-960a-41df15fb12ce tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:08.585838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6f779a7-eee0-4774-960a-41df15fb12ce tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:08.586326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6f779a7-eee0-4774-960a-41df15fb12ce tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:08.587033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6f779a7-eee0-4774-960a-41df15fb12ce tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:08.587528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6f779a7-eee0-4774-960a-41df15fb12ce tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:08.588046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6f779a7-eee0-4774-960a-41df15fb12ce tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:08.720924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6f779a7-eee0-4774-960a-41df15fb12ce tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:08.729106 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6f779a7-eee0-4774-960a-41df15fb12ce tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1317 microversion: 2.1 time: 0.155463 Oct 11 05:18:08.729724 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3832/7431] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:08 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:09.495013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-60cd63e4-00a8-4ec4-8281-e4c6debbf79b req-33be7cb6-7f77-40d2-8476-e92711ac728b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1a7f71-e528-4bfb-bb63-d7f2bec750e4", "name": "network-vif-plugged", "status": "completed", "tag": "5f15e36e-5e3a-4b96-8b15-8776f41e1cd8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:18:09.500999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:18:09.506264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-60cd63e4-00a8-4ec4-8281-e4c6debbf79b req-33be7cb6-7f77-40d2-8476-e92711ac728b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:09.506692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-60cd63e4-00a8-4ec4-8281-e4c6debbf79b req-33be7cb6-7f77-40d2-8476-e92711ac728b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:09.507618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-60cd63e4-00a8-4ec4-8281-e4c6debbf79b req-33be7cb6-7f77-40d2-8476-e92711ac728b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:09.519007 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-60cd63e4-00a8-4ec4-8281-e4c6debbf79b req-33be7cb6-7f77-40d2-8476-e92711ac728b service nova] Creating event network-vif-plugged:5f15e36e-5e3a-4b96-8b15-8776f41e1cd8 for instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 on n-h2-860892-1 Oct 11 05:18:09.524747 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-60cd63e4-00a8-4ec4-8281-e4c6debbf79b req-33be7cb6-7f77-40d2-8476-e92711ac728b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033497 Oct 11 05:18:09.525355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3600/7432] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:18:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:18:09.752325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-73c17871-c93f-4149-a7d1-1027d92f3fb6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:09.752948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-73c17871-c93f-4149-a7d1-1027d92f3fb6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:09.754932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:18:09.755612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:18:09.761842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73c17871-c93f-4149-a7d1-1027d92f3fb6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:09.762310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73c17871-c93f-4149-a7d1-1027d92f3fb6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:09.762765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73c17871-c93f-4149-a7d1-1027d92f3fb6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:09.763462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73c17871-c93f-4149-a7d1-1027d92f3fb6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:09.763929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73c17871-c93f-4149-a7d1-1027d92f3fb6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:09.764627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73c17871-c93f-4149-a7d1-1027d92f3fb6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:09.896963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-73c17871-c93f-4149-a7d1-1027d92f3fb6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:09.904619 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-73c17871-c93f-4149-a7d1-1027d92f3fb6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1317 microversion: 2.1 time: 0.156207 Oct 11 05:18:09.905191 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3833/7433] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:09 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:10.928958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f799bd0b-2350-4ffc-a3b7-b33d59ac860f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:10.929666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f799bd0b-2350-4ffc-a3b7-b33d59ac860f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:10.936767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f799bd0b-2350-4ffc-a3b7-b33d59ac860f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:10.939042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f799bd0b-2350-4ffc-a3b7-b33d59ac860f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:10.939042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f799bd0b-2350-4ffc-a3b7-b33d59ac860f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:10.939042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f799bd0b-2350-4ffc-a3b7-b33d59ac860f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:10.939042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f799bd0b-2350-4ffc-a3b7-b33d59ac860f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:10.939416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f799bd0b-2350-4ffc-a3b7-b33d59ac860f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:11.068776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f799bd0b-2350-4ffc-a3b7-b33d59ac860f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:11.076975 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f799bd0b-2350-4ffc-a3b7-b33d59ac860f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1508 microversion: 2.1 time: 0.152619 Oct 11 05:18:11.077549 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3601/7434] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:10 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:11.099634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e103bdb4-f208-4bc7-8485-9afb20210034 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:11.100265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e103bdb4-f208-4bc7-8485-9afb20210034 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:11.107106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e103bdb4-f208-4bc7-8485-9afb20210034 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:11.107603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e103bdb4-f208-4bc7-8485-9afb20210034 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:11.108059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e103bdb4-f208-4bc7-8485-9afb20210034 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:11.108760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e103bdb4-f208-4bc7-8485-9afb20210034 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:11.109236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e103bdb4-f208-4bc7-8485-9afb20210034 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:11.109681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e103bdb4-f208-4bc7-8485-9afb20210034 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:11.242299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e103bdb4-f208-4bc7-8485-9afb20210034 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:11.250108 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e103bdb4-f208-4bc7-8485-9afb20210034 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1508 microversion: 2.1 time: 0.154365 Oct 11 05:18:11.250727 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3834/7435] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:11 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:11.273025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451", "OS-DCF:diskConfig": "AUTO"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:18:11.275323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:11.281257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:11.281728 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:11.282157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:11.282924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:11.283375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:11.283797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:11.311956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:11.317537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Old instance type m1.heat2, new instance type m1.heat {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 05:18:11.324799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:18:11.325213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:18:11.325677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:18:11.326079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:18:11.326507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:18:11.362772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:18:11.552035 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c6acc757-482b-4a41-8f77-83dca671b10c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "POST /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4/action" status: 202 len: 0 microversion: 2.1 time: 0.282961 Oct 11 05:18:11.552643 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3602/7436] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:18:11 2022] POST /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:18:11.561357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-73a1ae51-5850-4c53-a5a6-ae0d3ed3e200 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:11.562080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-73a1ae51-5850-4c53-a5a6-ae0d3ed3e200 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:11.568376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73a1ae51-5850-4c53-a5a6-ae0d3ed3e200 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:11.568908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73a1ae51-5850-4c53-a5a6-ae0d3ed3e200 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:11.569397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73a1ae51-5850-4c53-a5a6-ae0d3ed3e200 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:11.570961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73a1ae51-5850-4c53-a5a6-ae0d3ed3e200 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:11.571430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73a1ae51-5850-4c53-a5a6-ae0d3ed3e200 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:11.571870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73a1ae51-5850-4c53-a5a6-ae0d3ed3e200 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:11.699748 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-73a1ae51-5850-4c53-a5a6-ae0d3ed3e200 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:11.707502 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-73a1ae51-5850-4c53-a5a6-ae0d3ed3e200 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1515 microversion: 2.1 time: 0.150142 Oct 11 05:18:11.708882 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3835/7437] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:11 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1515 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:12.731332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00804270-5bf2-4d96-a9c9-9077dea110d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:12.731948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00804270-5bf2-4d96-a9c9-9077dea110d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:12.739448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00804270-5bf2-4d96-a9c9-9077dea110d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:12.739940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00804270-5bf2-4d96-a9c9-9077dea110d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:12.740387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00804270-5bf2-4d96-a9c9-9077dea110d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:12.741608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00804270-5bf2-4d96-a9c9-9077dea110d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:12.742030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00804270-5bf2-4d96-a9c9-9077dea110d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:12.742489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00804270-5bf2-4d96-a9c9-9077dea110d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:12.873311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-00804270-5bf2-4d96-a9c9-9077dea110d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:12.881229 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00804270-5bf2-4d96-a9c9-9077dea110d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1515 microversion: 2.1 time: 0.154786 Oct 11 05:18:12.882442 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3603/7438] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:12 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:13.904717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0718f5e7-e8fd-41e5-a100-7c1623dfe5f9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:13.905345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0718f5e7-e8fd-41e5-a100-7c1623dfe5f9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:13.912289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0718f5e7-e8fd-41e5-a100-7c1623dfe5f9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:13.912791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0718f5e7-e8fd-41e5-a100-7c1623dfe5f9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:13.913246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0718f5e7-e8fd-41e5-a100-7c1623dfe5f9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:13.913994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0718f5e7-e8fd-41e5-a100-7c1623dfe5f9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:13.914488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0718f5e7-e8fd-41e5-a100-7c1623dfe5f9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:13.914934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0718f5e7-e8fd-41e5-a100-7c1623dfe5f9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:13.933151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:18:14.137190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0718f5e7-e8fd-41e5-a100-7c1623dfe5f9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:14.145448 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0718f5e7-e8fd-41e5-a100-7c1623dfe5f9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1515 microversion: 2.1 time: 0.244624 Oct 11 05:18:14.146026 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3836/7439] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:13 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1515 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:15.168764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-76c878c9-e9b8-4b94-915a-683b8fb7dc86 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:15.169346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-76c878c9-e9b8-4b94-915a-683b8fb7dc86 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:15.175996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76c878c9-e9b8-4b94-915a-683b8fb7dc86 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:15.176469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76c878c9-e9b8-4b94-915a-683b8fb7dc86 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:15.176902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76c878c9-e9b8-4b94-915a-683b8fb7dc86 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:15.177583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76c878c9-e9b8-4b94-915a-683b8fb7dc86 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:15.178033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76c878c9-e9b8-4b94-915a-683b8fb7dc86 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:15.178480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-76c878c9-e9b8-4b94-915a-683b8fb7dc86 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:15.316947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-76c878c9-e9b8-4b94-915a-683b8fb7dc86 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:15.325402 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-76c878c9-e9b8-4b94-915a-683b8fb7dc86 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.160560 Oct 11 05:18:15.325966 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3604/7440] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:15 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:16.349398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9574bf00-f0a8-4598-8a3c-5b9edb1ed699 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:16.350016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9574bf00-f0a8-4598-8a3c-5b9edb1ed699 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:16.357158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9574bf00-f0a8-4598-8a3c-5b9edb1ed699 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:16.357641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9574bf00-f0a8-4598-8a3c-5b9edb1ed699 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:16.358081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9574bf00-f0a8-4598-8a3c-5b9edb1ed699 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:16.358797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9574bf00-f0a8-4598-8a3c-5b9edb1ed699 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:16.359254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9574bf00-f0a8-4598-8a3c-5b9edb1ed699 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:16.359685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9574bf00-f0a8-4598-8a3c-5b9edb1ed699 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:16.490828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9574bf00-f0a8-4598-8a3c-5b9edb1ed699 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:16.499091 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9574bf00-f0a8-4598-8a3c-5b9edb1ed699 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.153700 Oct 11 05:18:16.499655 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3837/7441] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:16 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:17.522913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-709ea5c6-9f2e-479d-8c65-c68d619bb4a5 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:17.524069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-709ea5c6-9f2e-479d-8c65-c68d619bb4a5 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:17.531080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ea5c6-9f2e-479d-8c65-c68d619bb4a5 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:17.531500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ea5c6-9f2e-479d-8c65-c68d619bb4a5 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:17.531940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ea5c6-9f2e-479d-8c65-c68d619bb4a5 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:17.532623 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ea5c6-9f2e-479d-8c65-c68d619bb4a5 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:17.533073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ea5c6-9f2e-479d-8c65-c68d619bb4a5 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:17.533496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-709ea5c6-9f2e-479d-8c65-c68d619bb4a5 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:17.677835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-709ea5c6-9f2e-479d-8c65-c68d619bb4a5 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:17.687751 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-709ea5c6-9f2e-479d-8c65-c68d619bb4a5 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.168473 Oct 11 05:18:17.688576 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3605/7442] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:17 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:18.712151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7322dd47-615a-4e74-917a-ebe5b24f9f63 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:18.712756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7322dd47-615a-4e74-917a-ebe5b24f9f63 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:18.715422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:18:18.720037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7322dd47-615a-4e74-917a-ebe5b24f9f63 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:18.720521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7322dd47-615a-4e74-917a-ebe5b24f9f63 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:18.720965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7322dd47-615a-4e74-917a-ebe5b24f9f63 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:18.721658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7322dd47-615a-4e74-917a-ebe5b24f9f63 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:18.722115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7322dd47-615a-4e74-917a-ebe5b24f9f63 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:18.722574 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7322dd47-615a-4e74-917a-ebe5b24f9f63 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:18.849853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7322dd47-615a-4e74-917a-ebe5b24f9f63 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:18.857515 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7322dd47-615a-4e74-917a-ebe5b24f9f63 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.149870 Oct 11 05:18:18.858088 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3838/7443] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:18 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:19.880871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-645a6fb2-be21-441a-aae1-268c5fdbbc77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:19.881485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-645a6fb2-be21-441a-aae1-268c5fdbbc77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:19.885468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:18:19.890479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-645a6fb2-be21-441a-aae1-268c5fdbbc77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:19.895343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-645a6fb2-be21-441a-aae1-268c5fdbbc77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:19.895343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-645a6fb2-be21-441a-aae1-268c5fdbbc77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:19.895343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-645a6fb2-be21-441a-aae1-268c5fdbbc77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:19.895343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-645a6fb2-be21-441a-aae1-268c5fdbbc77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:19.895343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-645a6fb2-be21-441a-aae1-268c5fdbbc77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:20.026131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-645a6fb2-be21-441a-aae1-268c5fdbbc77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:20.033866 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-645a6fb2-be21-441a-aae1-268c5fdbbc77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.156837 Oct 11 05:18:20.034463 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3606/7444] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:19 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:21.056973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9e822ce-9f47-4b25-95c0-35acddf1f900 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:21.057612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e9e822ce-9f47-4b25-95c0-35acddf1f900 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:21.064220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9e822ce-9f47-4b25-95c0-35acddf1f900 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:21.067653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9e822ce-9f47-4b25-95c0-35acddf1f900 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:21.067653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9e822ce-9f47-4b25-95c0-35acddf1f900 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:21.067653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9e822ce-9f47-4b25-95c0-35acddf1f900 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:21.067653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9e822ce-9f47-4b25-95c0-35acddf1f900 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:21.067653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9e822ce-9f47-4b25-95c0-35acddf1f900 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:21.193097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e9e822ce-9f47-4b25-95c0-35acddf1f900 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:21.201027 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e9e822ce-9f47-4b25-95c0-35acddf1f900 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.147909 Oct 11 05:18:21.201603 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3839/7445] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:21 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:22.223675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-96195a60-ee2f-44ac-afa9-5254ff85bbe7 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:22.224317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-96195a60-ee2f-44ac-afa9-5254ff85bbe7 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:22.232244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96195a60-ee2f-44ac-afa9-5254ff85bbe7 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:22.232716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96195a60-ee2f-44ac-afa9-5254ff85bbe7 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:22.233184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96195a60-ee2f-44ac-afa9-5254ff85bbe7 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:22.233871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96195a60-ee2f-44ac-afa9-5254ff85bbe7 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:22.234351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96195a60-ee2f-44ac-afa9-5254ff85bbe7 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:22.234775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-96195a60-ee2f-44ac-afa9-5254ff85bbe7 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:22.362674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-96195a60-ee2f-44ac-afa9-5254ff85bbe7 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:22.370932 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-96195a60-ee2f-44ac-afa9-5254ff85bbe7 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.151135 Oct 11 05:18:22.371508 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3607/7446] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:22 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:23.393146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-21196595-679e-41ae-8eda-2d2e8b24d92f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:23.393779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-21196595-679e-41ae-8eda-2d2e8b24d92f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:23.400580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21196595-679e-41ae-8eda-2d2e8b24d92f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:23.401074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21196595-679e-41ae-8eda-2d2e8b24d92f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:23.401526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21196595-679e-41ae-8eda-2d2e8b24d92f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:23.402245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21196595-679e-41ae-8eda-2d2e8b24d92f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:23.402715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21196595-679e-41ae-8eda-2d2e8b24d92f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:23.403153 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-21196595-679e-41ae-8eda-2d2e8b24d92f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:23.534071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-21196595-679e-41ae-8eda-2d2e8b24d92f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:23.542310 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-21196595-679e-41ae-8eda-2d2e8b24d92f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.153344 Oct 11 05:18:23.542877 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3840/7447] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:23 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:24.565289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-47d22b8f-2992-428a-98da-5bd6b90bc414 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:24.565902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-47d22b8f-2992-428a-98da-5bd6b90bc414 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:24.573703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47d22b8f-2992-428a-98da-5bd6b90bc414 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:24.574205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47d22b8f-2992-428a-98da-5bd6b90bc414 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:24.574648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47d22b8f-2992-428a-98da-5bd6b90bc414 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:24.575336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47d22b8f-2992-428a-98da-5bd6b90bc414 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:24.575792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47d22b8f-2992-428a-98da-5bd6b90bc414 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:24.576233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-47d22b8f-2992-428a-98da-5bd6b90bc414 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:24.704691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-47d22b8f-2992-428a-98da-5bd6b90bc414 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:24.712419 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-47d22b8f-2992-428a-98da-5bd6b90bc414 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.151105 Oct 11 05:18:24.712998 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3608/7448] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:24 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:25.735720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9271169f-9416-4e47-9aea-17500ec4e4bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:25.736348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9271169f-9416-4e47-9aea-17500ec4e4bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:25.744041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9271169f-9416-4e47-9aea-17500ec4e4bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:25.744554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9271169f-9416-4e47-9aea-17500ec4e4bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:25.745011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9271169f-9416-4e47-9aea-17500ec4e4bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:25.745731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9271169f-9416-4e47-9aea-17500ec4e4bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:25.746219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9271169f-9416-4e47-9aea-17500ec4e4bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:25.746670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9271169f-9416-4e47-9aea-17500ec4e4bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:25.879432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9271169f-9416-4e47-9aea-17500ec4e4bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:25.887675 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9271169f-9416-4e47-9aea-17500ec4e4bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.155863 Oct 11 05:18:25.888255 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3841/7449] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:25 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:26.911941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-553f2846-21da-47db-8465-9a8572f73b77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:26.912580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-553f2846-21da-47db-8465-9a8572f73b77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:26.919694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-553f2846-21da-47db-8465-9a8572f73b77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:26.920180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-553f2846-21da-47db-8465-9a8572f73b77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:26.920617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-553f2846-21da-47db-8465-9a8572f73b77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:26.921306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-553f2846-21da-47db-8465-9a8572f73b77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:26.921760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-553f2846-21da-47db-8465-9a8572f73b77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:26.922204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-553f2846-21da-47db-8465-9a8572f73b77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:27.053395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-553f2846-21da-47db-8465-9a8572f73b77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:27.061841 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-553f2846-21da-47db-8465-9a8572f73b77 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.153882 Oct 11 05:18:27.062450 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3609/7450] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:26 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:28.085535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33c09223-bb3e-4802-9655-9b5ab4d936b6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:28.086219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-33c09223-bb3e-4802-9655-9b5ab4d936b6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:28.092996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c09223-bb3e-4802-9655-9b5ab4d936b6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:28.093486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c09223-bb3e-4802-9655-9b5ab4d936b6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:28.093935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c09223-bb3e-4802-9655-9b5ab4d936b6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:28.094661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c09223-bb3e-4802-9655-9b5ab4d936b6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:28.095129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c09223-bb3e-4802-9655-9b5ab4d936b6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:28.095566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c09223-bb3e-4802-9655-9b5ab4d936b6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:28.221794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-33c09223-bb3e-4802-9655-9b5ab4d936b6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:28.230324 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-33c09223-bb3e-4802-9655-9b5ab4d936b6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.148280 Oct 11 05:18:28.230830 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3842/7451] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:28 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:29.253940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9592d72f-1c1c-4ad5-85e2-57a524c34903 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:29.254593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9592d72f-1c1c-4ad5-85e2-57a524c34903 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:29.261343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9592d72f-1c1c-4ad5-85e2-57a524c34903 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:29.261815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9592d72f-1c1c-4ad5-85e2-57a524c34903 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:29.262279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9592d72f-1c1c-4ad5-85e2-57a524c34903 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:29.263556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9592d72f-1c1c-4ad5-85e2-57a524c34903 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:29.264002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9592d72f-1c1c-4ad5-85e2-57a524c34903 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:29.264687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9592d72f-1c1c-4ad5-85e2-57a524c34903 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:29.394322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9592d72f-1c1c-4ad5-85e2-57a524c34903 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:29.401988 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9592d72f-1c1c-4ad5-85e2-57a524c34903 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.151901 Oct 11 05:18:29.402599 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3610/7452] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:29 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:30.424890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f0f5ff4a-2370-4970-8862-7261a99b3dca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:30.425513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f0f5ff4a-2370-4970-8862-7261a99b3dca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:30.432293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0f5ff4a-2370-4970-8862-7261a99b3dca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:30.432781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0f5ff4a-2370-4970-8862-7261a99b3dca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:30.433228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0f5ff4a-2370-4970-8862-7261a99b3dca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:30.433915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0f5ff4a-2370-4970-8862-7261a99b3dca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:30.434410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0f5ff4a-2370-4970-8862-7261a99b3dca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:30.434847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f0f5ff4a-2370-4970-8862-7261a99b3dca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:30.566407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f0f5ff4a-2370-4970-8862-7261a99b3dca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:30.574061 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f0f5ff4a-2370-4970-8862-7261a99b3dca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.153079 Oct 11 05:18:30.574664 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3843/7453] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:30 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:31.599357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9e220cc-fd6b-4613-9303-943a8a78252f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:31.599978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e9e220cc-fd6b-4613-9303-943a8a78252f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:31.606837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e220cc-fd6b-4613-9303-943a8a78252f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:31.607319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e220cc-fd6b-4613-9303-943a8a78252f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:31.607761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e220cc-fd6b-4613-9303-943a8a78252f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:31.608453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e220cc-fd6b-4613-9303-943a8a78252f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:31.608905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e220cc-fd6b-4613-9303-943a8a78252f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:31.609328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e9e220cc-fd6b-4613-9303-943a8a78252f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:31.742902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9e220cc-fd6b-4613-9303-943a8a78252f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:31.750640 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9e220cc-fd6b-4613-9303-943a8a78252f tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.155222 Oct 11 05:18:31.751210 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3611/7454] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:31 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:32.774686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4be56e16-dc8d-4b37-be23-211dd9965ae8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:32.775262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4be56e16-dc8d-4b37-be23-211dd9965ae8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:32.782755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be56e16-dc8d-4b37-be23-211dd9965ae8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:32.783249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be56e16-dc8d-4b37-be23-211dd9965ae8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:32.783727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be56e16-dc8d-4b37-be23-211dd9965ae8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:32.784437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be56e16-dc8d-4b37-be23-211dd9965ae8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:32.784893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be56e16-dc8d-4b37-be23-211dd9965ae8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:32.785328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be56e16-dc8d-4b37-be23-211dd9965ae8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:32.916307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4be56e16-dc8d-4b37-be23-211dd9965ae8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:32.924090 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4be56e16-dc8d-4b37-be23-211dd9965ae8 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.153395 Oct 11 05:18:32.924664 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3844/7455] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:32 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:33.947720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2c8cbb4d-4888-4def-ad50-f734a38f4293 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:33.948335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2c8cbb4d-4888-4def-ad50-f734a38f4293 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:33.956044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c8cbb4d-4888-4def-ad50-f734a38f4293 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:33.956525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c8cbb4d-4888-4def-ad50-f734a38f4293 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:33.957009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c8cbb4d-4888-4def-ad50-f734a38f4293 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:33.957699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c8cbb4d-4888-4def-ad50-f734a38f4293 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:33.958169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c8cbb4d-4888-4def-ad50-f734a38f4293 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:33.958615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2c8cbb4d-4888-4def-ad50-f734a38f4293 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:34.086400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2c8cbb4d-4888-4def-ad50-f734a38f4293 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:34.094700 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2c8cbb4d-4888-4def-ad50-f734a38f4293 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.150872 Oct 11 05:18:34.095207 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3612/7456] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:33 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:35.117834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d2f4f2c-9aa2-43cb-b518-dfe60987e7ac tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:35.118486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d2f4f2c-9aa2-43cb-b518-dfe60987e7ac tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:35.125358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2f4f2c-9aa2-43cb-b518-dfe60987e7ac tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:35.125843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2f4f2c-9aa2-43cb-b518-dfe60987e7ac tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:35.126325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2f4f2c-9aa2-43cb-b518-dfe60987e7ac tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:35.127015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2f4f2c-9aa2-43cb-b518-dfe60987e7ac tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:35.127475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2f4f2c-9aa2-43cb-b518-dfe60987e7ac tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:35.127910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2f4f2c-9aa2-43cb-b518-dfe60987e7ac tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:35.259619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d2f4f2c-9aa2-43cb-b518-dfe60987e7ac tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:35.267678 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d2f4f2c-9aa2-43cb-b518-dfe60987e7ac tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.153722 Oct 11 05:18:35.268259 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3845/7457] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:35 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:36.291700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fa75dded-b448-4880-a81a-ed38a8abb949 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:36.292247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fa75dded-b448-4880-a81a-ed38a8abb949 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:36.299097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa75dded-b448-4880-a81a-ed38a8abb949 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:36.299578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa75dded-b448-4880-a81a-ed38a8abb949 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:36.300110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa75dded-b448-4880-a81a-ed38a8abb949 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:36.300803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa75dded-b448-4880-a81a-ed38a8abb949 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:36.301253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa75dded-b448-4880-a81a-ed38a8abb949 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:36.301673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fa75dded-b448-4880-a81a-ed38a8abb949 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:36.433754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fa75dded-b448-4880-a81a-ed38a8abb949 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:36.441973 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fa75dded-b448-4880-a81a-ed38a8abb949 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.154542 Oct 11 05:18:36.442562 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3613/7458] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:36 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:37.464975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f6e36252-7365-4d73-b525-07bbc3ba84ca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:37.465641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f6e36252-7365-4d73-b525-07bbc3ba84ca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:37.472376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e36252-7365-4d73-b525-07bbc3ba84ca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:37.472866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e36252-7365-4d73-b525-07bbc3ba84ca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:37.473308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e36252-7365-4d73-b525-07bbc3ba84ca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:37.473999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e36252-7365-4d73-b525-07bbc3ba84ca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:37.474495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e36252-7365-4d73-b525-07bbc3ba84ca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:37.474931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f6e36252-7365-4d73-b525-07bbc3ba84ca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:37.604149 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f6e36252-7365-4d73-b525-07bbc3ba84ca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:37.611838 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f6e36252-7365-4d73-b525-07bbc3ba84ca tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.150801 Oct 11 05:18:37.612412 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3846/7459] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:37 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:38.635586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7ef4654e-6649-4b95-bf32-5f73949ade4c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:38.636206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7ef4654e-6649-4b95-bf32-5f73949ade4c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:38.643668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ef4654e-6649-4b95-bf32-5f73949ade4c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:38.644143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ef4654e-6649-4b95-bf32-5f73949ade4c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:38.644572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ef4654e-6649-4b95-bf32-5f73949ade4c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:38.645255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ef4654e-6649-4b95-bf32-5f73949ade4c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:38.645704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ef4654e-6649-4b95-bf32-5f73949ade4c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:38.646122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7ef4654e-6649-4b95-bf32-5f73949ade4c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:38.775477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7ef4654e-6649-4b95-bf32-5f73949ade4c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:38.783732 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7ef4654e-6649-4b95-bf32-5f73949ade4c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.152047 Oct 11 05:18:38.784301 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3614/7460] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:38 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:39.806773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f3c0ae13-8b26-4787-8ad1-99769866d72a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:39.807396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f3c0ae13-8b26-4787-8ad1-99769866d72a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:39.814158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c0ae13-8b26-4787-8ad1-99769866d72a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:39.814674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c0ae13-8b26-4787-8ad1-99769866d72a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:39.815122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c0ae13-8b26-4787-8ad1-99769866d72a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:39.815812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c0ae13-8b26-4787-8ad1-99769866d72a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:39.816273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c0ae13-8b26-4787-8ad1-99769866d72a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:39.816706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3c0ae13-8b26-4787-8ad1-99769866d72a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:39.946618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f3c0ae13-8b26-4787-8ad1-99769866d72a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:39.954842 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f3c0ae13-8b26-4787-8ad1-99769866d72a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.151978 Oct 11 05:18:39.955428 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3847/7461] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:39 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:40.977993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fe715918-9bc3-48f9-90a0-2a161fefa4cf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:40.978622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fe715918-9bc3-48f9-90a0-2a161fefa4cf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:40.985998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe715918-9bc3-48f9-90a0-2a161fefa4cf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:40.986504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe715918-9bc3-48f9-90a0-2a161fefa4cf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:40.986940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe715918-9bc3-48f9-90a0-2a161fefa4cf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:40.987626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe715918-9bc3-48f9-90a0-2a161fefa4cf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:40.988073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe715918-9bc3-48f9-90a0-2a161fefa4cf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:40.988492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fe715918-9bc3-48f9-90a0-2a161fefa4cf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:41.116654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fe715918-9bc3-48f9-90a0-2a161fefa4cf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:41.124283 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fe715918-9bc3-48f9-90a0-2a161fefa4cf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.150283 Oct 11 05:18:41.124852 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3615/7462] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:40 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:42.147741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-78ff14e4-4a26-45db-9af9-dfc5bc29cbe1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:42.148389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-78ff14e4-4a26-45db-9af9-dfc5bc29cbe1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:42.155708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78ff14e4-4a26-45db-9af9-dfc5bc29cbe1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:42.156206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78ff14e4-4a26-45db-9af9-dfc5bc29cbe1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:42.156644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78ff14e4-4a26-45db-9af9-dfc5bc29cbe1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:42.157345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78ff14e4-4a26-45db-9af9-dfc5bc29cbe1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:42.157804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78ff14e4-4a26-45db-9af9-dfc5bc29cbe1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:42.158264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78ff14e4-4a26-45db-9af9-dfc5bc29cbe1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:42.289252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-78ff14e4-4a26-45db-9af9-dfc5bc29cbe1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:42.297482 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-78ff14e4-4a26-45db-9af9-dfc5bc29cbe1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.153851 Oct 11 05:18:42.298053 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3848/7463] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:42 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:18:43.321431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-eec94c46-3328-4351-8a06-d409b316dc8d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:43.322050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-eec94c46-3328-4351-8a06-d409b316dc8d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:43.329515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eec94c46-3328-4351-8a06-d409b316dc8d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:43.329993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eec94c46-3328-4351-8a06-d409b316dc8d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:43.330460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eec94c46-3328-4351-8a06-d409b316dc8d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:43.331149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eec94c46-3328-4351-8a06-d409b316dc8d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:43.331602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eec94c46-3328-4351-8a06-d409b316dc8d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:43.332028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-eec94c46-3328-4351-8a06-d409b316dc8d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:43.334620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=80,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:18:43.464278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-eec94c46-3328-4351-8a06-d409b316dc8d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:43.471975 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-eec94c46-3328-4351-8a06-d409b316dc8d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.154469 Oct 11 05:18:43.472535 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3616/7464] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:43 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:44.495093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-50a15011-ae21-4706-b79d-b5c9f5f990c0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:44.495719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-50a15011-ae21-4706-b79d-b5c9f5f990c0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:44.503278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50a15011-ae21-4706-b79d-b5c9f5f990c0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:44.503772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50a15011-ae21-4706-b79d-b5c9f5f990c0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:44.504222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50a15011-ae21-4706-b79d-b5c9f5f990c0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:44.504933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50a15011-ae21-4706-b79d-b5c9f5f990c0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:44.505386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50a15011-ae21-4706-b79d-b5c9f5f990c0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:44.505827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-50a15011-ae21-4706-b79d-b5c9f5f990c0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:44.508410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=75 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:18:44.638210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-50a15011-ae21-4706-b79d-b5c9f5f990c0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:44.646311 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-50a15011-ae21-4706-b79d-b5c9f5f990c0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.155054 Oct 11 05:18:44.646880 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3849/7465] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:44 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:45.669028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-26f887cd-48ff-48a1-8fbc-2aa3bd0ba95c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:45.669755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-26f887cd-48ff-48a1-8fbc-2aa3bd0ba95c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:45.676842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26f887cd-48ff-48a1-8fbc-2aa3bd0ba95c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:45.677336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26f887cd-48ff-48a1-8fbc-2aa3bd0ba95c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:45.677772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26f887cd-48ff-48a1-8fbc-2aa3bd0ba95c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:45.678567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26f887cd-48ff-48a1-8fbc-2aa3bd0ba95c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:45.679021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26f887cd-48ff-48a1-8fbc-2aa3bd0ba95c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:45.679551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-26f887cd-48ff-48a1-8fbc-2aa3bd0ba95c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:45.811962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-26f887cd-48ff-48a1-8fbc-2aa3bd0ba95c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:45.819747 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-26f887cd-48ff-48a1-8fbc-2aa3bd0ba95c tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.154826 Oct 11 05:18:45.820324 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3617/7466] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:45 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:46.845810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-81e183e0-15fb-4f4c-b5c4-d9c5749fd6be tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:46.847433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-81e183e0-15fb-4f4c-b5c4-d9c5749fd6be tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:46.855246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81e183e0-15fb-4f4c-b5c4-d9c5749fd6be tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:46.856956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81e183e0-15fb-4f4c-b5c4-d9c5749fd6be tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:46.857646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81e183e0-15fb-4f4c-b5c4-d9c5749fd6be tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:46.858755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81e183e0-15fb-4f4c-b5c4-d9c5749fd6be tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:46.859428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81e183e0-15fb-4f4c-b5c4-d9c5749fd6be tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:46.860099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-81e183e0-15fb-4f4c-b5c4-d9c5749fd6be tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:46.998789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-81e183e0-15fb-4f4c-b5c4-d9c5749fd6be tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:47.007711 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-81e183e0-15fb-4f4c-b5c4-d9c5749fd6be tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1520 microversion: 2.1 time: 0.167735 Oct 11 05:18:47.009447 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3850/7467] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:46 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:47.843712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-717ea892-e279-4207-b09a-0764eeb6e504 req-ed0b475b-b415-4592-829c-5b0081a24b02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1a7f71-e528-4bfb-bb63-d7f2bec750e4", "name": "network-vif-unplugged", "status": "completed", "tag": "5f15e36e-5e3a-4b96-8b15-8776f41e1cd8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:18:47.853933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-717ea892-e279-4207-b09a-0764eeb6e504 req-ed0b475b-b415-4592-829c-5b0081a24b02 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:47.854519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-717ea892-e279-4207-b09a-0764eeb6e504 req-ed0b475b-b415-4592-829c-5b0081a24b02 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:47.854949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-717ea892-e279-4207-b09a-0764eeb6e504 req-ed0b475b-b415-4592-829c-5b0081a24b02 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:47.867394 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-717ea892-e279-4207-b09a-0764eeb6e504 req-ed0b475b-b415-4592-829c-5b0081a24b02 service nova] Creating event network-vif-unplugged:5f15e36e-5e3a-4b96-8b15-8776f41e1cd8 for instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 on n-h1-860892-1 Oct 11 05:18:47.872751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-717ea892-e279-4207-b09a-0764eeb6e504 req-ed0b475b-b415-4592-829c-5b0081a24b02 service nova] Instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:18:47.883340 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-717ea892-e279-4207-b09a-0764eeb6e504 req-ed0b475b-b415-4592-829c-5b0081a24b02 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044996 Oct 11 05:18:47.883926 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3618/7468] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:18:47 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:18:48.033441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8aa45884-2a14-449e-ab68-034371e4bfd0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:48.033923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8aa45884-2a14-449e-ab68-034371e4bfd0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:48.040975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aa45884-2a14-449e-ab68-034371e4bfd0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:48.042593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aa45884-2a14-449e-ab68-034371e4bfd0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:48.043073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aa45884-2a14-449e-ab68-034371e4bfd0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:48.044476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aa45884-2a14-449e-ab68-034371e4bfd0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:48.044963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aa45884-2a14-449e-ab68-034371e4bfd0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:48.045409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8aa45884-2a14-449e-ab68-034371e4bfd0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:48.234682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8aa45884-2a14-449e-ab68-034371e4bfd0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:48.242494 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8aa45884-2a14-449e-ab68-034371e4bfd0 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1519 microversion: 2.1 time: 0.213132 Oct 11 05:18:48.243100 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3851/7469] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:48 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1519 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:49.268022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3596331-2a77-4a20-854a-a7ebbf7d1981 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:49.268724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3596331-2a77-4a20-854a-a7ebbf7d1981 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:49.274902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3596331-2a77-4a20-854a-a7ebbf7d1981 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:49.279006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3596331-2a77-4a20-854a-a7ebbf7d1981 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:49.279006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3596331-2a77-4a20-854a-a7ebbf7d1981 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:49.279006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3596331-2a77-4a20-854a-a7ebbf7d1981 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:49.279006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3596331-2a77-4a20-854a-a7ebbf7d1981 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:49.279006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3596331-2a77-4a20-854a-a7ebbf7d1981 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:49.410598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a3596331-2a77-4a20-854a-a7ebbf7d1981 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:49.417481 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3596331-2a77-4a20-854a-a7ebbf7d1981 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1517 microversion: 2.1 time: 0.155336 Oct 11 05:18:49.418049 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3619/7470] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:49 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:49.897269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-09132c45-232c-4a05-bbb2-106226f30e8f req-25532e00-05ac-49b2-a557-dfe97d22324f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c1a7f71-e528-4bfb-bb63-d7f2bec750e4", "tag": "5f15e36e-5e3a-4b96-8b15-8776f41e1cd8"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:18:49.903010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=28 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:18:49.908119 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-09132c45-232c-4a05-bbb2-106226f30e8f req-25532e00-05ac-49b2-a557-dfe97d22324f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:49.908607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-09132c45-232c-4a05-bbb2-106226f30e8f req-25532e00-05ac-49b2-a557-dfe97d22324f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:49.909045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-09132c45-232c-4a05-bbb2-106226f30e8f req-25532e00-05ac-49b2-a557-dfe97d22324f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:49.920836 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-09132c45-232c-4a05-bbb2-106226f30e8f req-25532e00-05ac-49b2-a557-dfe97d22324f service nova] Creating event network-changed:5f15e36e-5e3a-4b96-8b15-8776f41e1cd8 for instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 on n-h1-860892-1 Oct 11 05:18:49.926099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-09132c45-232c-4a05-bbb2-106226f30e8f req-25532e00-05ac-49b2-a557-dfe97d22324f service nova] Instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:18:49.937727 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-09132c45-232c-4a05-bbb2-106226f30e8f req-25532e00-05ac-49b2-a557-dfe97d22324f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044101 Oct 11 05:18:49.938330 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3852/7471] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:18:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:18:50.440821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d19e001b-f875-4342-813b-e1cc83d71377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:50.441364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d19e001b-f875-4342-813b-e1cc83d71377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:50.444178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=28 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:18:50.448855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d19e001b-f875-4342-813b-e1cc83d71377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:50.451928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d19e001b-f875-4342-813b-e1cc83d71377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:50.451928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d19e001b-f875-4342-813b-e1cc83d71377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:50.451928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d19e001b-f875-4342-813b-e1cc83d71377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:50.451928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d19e001b-f875-4342-813b-e1cc83d71377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:50.451928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d19e001b-f875-4342-813b-e1cc83d71377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:50.581006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d19e001b-f875-4342-813b-e1cc83d71377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:50.588926 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d19e001b-f875-4342-813b-e1cc83d71377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1517 microversion: 2.1 time: 0.152123 Oct 11 05:18:50.589521 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3620/7472] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:50 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1517 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:51.614896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-60c81a13-edee-480e-af24-cf3ed3ff93c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:51.615641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-60c81a13-edee-480e-af24-cf3ed3ff93c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:51.621914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60c81a13-edee-480e-af24-cf3ed3ff93c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:51.622442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60c81a13-edee-480e-af24-cf3ed3ff93c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:51.622890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60c81a13-edee-480e-af24-cf3ed3ff93c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:51.623589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60c81a13-edee-480e-af24-cf3ed3ff93c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:51.624056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60c81a13-edee-480e-af24-cf3ed3ff93c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:51.624489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-60c81a13-edee-480e-af24-cf3ed3ff93c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:51.816383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-60c81a13-edee-480e-af24-cf3ed3ff93c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:51.824189 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-60c81a13-edee-480e-af24-cf3ed3ff93c9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1517 microversion: 2.1 time: 0.214627 Oct 11 05:18:51.824762 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3853/7473] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:51 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1517 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:52.847138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d98e4380-ae51-4ab2-a4c2-a41e437e29e9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:52.847781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d98e4380-ae51-4ab2-a4c2-a41e437e29e9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:52.854626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d98e4380-ae51-4ab2-a4c2-a41e437e29e9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:52.855102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d98e4380-ae51-4ab2-a4c2-a41e437e29e9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:52.855531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d98e4380-ae51-4ab2-a4c2-a41e437e29e9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:52.856741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d98e4380-ae51-4ab2-a4c2-a41e437e29e9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:52.857212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d98e4380-ae51-4ab2-a4c2-a41e437e29e9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:52.857735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d98e4380-ae51-4ab2-a4c2-a41e437e29e9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:52.987675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d98e4380-ae51-4ab2-a4c2-a41e437e29e9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:52.995472 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d98e4380-ae51-4ab2-a4c2-a41e437e29e9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1514 microversion: 2.1 time: 0.152234 Oct 11 05:18:52.996039 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3621/7474] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:52 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1514 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:18:53.019073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ab70e3e5-63a8-49e5-8d89-15ac2202fd56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:18:53.019839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ab70e3e5-63a8-49e5-8d89-15ac2202fd56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:53.026765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab70e3e5-63a8-49e5-8d89-15ac2202fd56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:53.027294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab70e3e5-63a8-49e5-8d89-15ac2202fd56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:53.027747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab70e3e5-63a8-49e5-8d89-15ac2202fd56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:53.028488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab70e3e5-63a8-49e5-8d89-15ac2202fd56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:53.028958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab70e3e5-63a8-49e5-8d89-15ac2202fd56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:53.029401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ab70e3e5-63a8-49e5-8d89-15ac2202fd56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:53.244001 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ab70e3e5-63a8-49e5-8d89-15ac2202fd56 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "POST /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4/action" status: 204 len: 0 microversion: 2.1 time: 0.228936 Oct 11 05:18:53.244579 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3854/7475] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:18:53 2022] POST /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4/action => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:18:53.252880 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d89dcbc0-84e0-4739-8934-a8f92b1624d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:53.254982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d89dcbc0-84e0-4739-8934-a8f92b1624d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:53.259542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d89dcbc0-84e0-4739-8934-a8f92b1624d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:53.260028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d89dcbc0-84e0-4739-8934-a8f92b1624d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:53.260466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d89dcbc0-84e0-4739-8934-a8f92b1624d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:53.261164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d89dcbc0-84e0-4739-8934-a8f92b1624d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:53.261620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d89dcbc0-84e0-4739-8934-a8f92b1624d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:53.262112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d89dcbc0-84e0-4739-8934-a8f92b1624d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:53.397806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d89dcbc0-84e0-4739-8934-a8f92b1624d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:53.405967 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d89dcbc0-84e0-4739-8934-a8f92b1624d6 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1514 microversion: 2.1 time: 0.157001 Oct 11 05:18:53.406593 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3622/7476] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:53 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:54.434291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9be9f1a8-16d7-4eee-b239-33cda3c7028d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:54.434291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9be9f1a8-16d7-4eee-b239-33cda3c7028d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:54.439700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be9f1a8-16d7-4eee-b239-33cda3c7028d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:54.440202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be9f1a8-16d7-4eee-b239-33cda3c7028d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:54.440662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be9f1a8-16d7-4eee-b239-33cda3c7028d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:54.441372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be9f1a8-16d7-4eee-b239-33cda3c7028d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:54.441882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be9f1a8-16d7-4eee-b239-33cda3c7028d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:54.442380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9be9f1a8-16d7-4eee-b239-33cda3c7028d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:54.581803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9be9f1a8-16d7-4eee-b239-33cda3c7028d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:54.589528 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9be9f1a8-16d7-4eee-b239-33cda3c7028d tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1514 microversion: 2.1 time: 0.163034 Oct 11 05:18:54.591535 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3855/7477] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:54 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:54.673224 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-6f9b04a8-4508-49f6-aed9-6c96e83f7fa7 req-70bec792-8fce-439e-af7f-cd744132c8ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1a7f71-e528-4bfb-bb63-d7f2bec750e4", "name": "network-vif-plugged", "status": "completed", "tag": "5f15e36e-5e3a-4b96-8b15-8776f41e1cd8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:18:54.683886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6f9b04a8-4508-49f6-aed9-6c96e83f7fa7 req-70bec792-8fce-439e-af7f-cd744132c8ae service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:54.684424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6f9b04a8-4508-49f6-aed9-6c96e83f7fa7 req-70bec792-8fce-439e-af7f-cd744132c8ae service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:54.684804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-6f9b04a8-4508-49f6-aed9-6c96e83f7fa7 req-70bec792-8fce-439e-af7f-cd744132c8ae service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:54.695628 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-6f9b04a8-4508-49f6-aed9-6c96e83f7fa7 req-70bec792-8fce-439e-af7f-cd744132c8ae service nova] Creating event network-vif-plugged:5f15e36e-5e3a-4b96-8b15-8776f41e1cd8 for instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 on n-h1-860892-1 Oct 11 05:18:54.700637 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-6f9b04a8-4508-49f6-aed9-6c96e83f7fa7 req-70bec792-8fce-439e-af7f-cd744132c8ae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032340 Oct 11 05:18:54.701356 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3623/7478] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:18:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:18:55.613391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-62427d7e-2b2f-4ecc-8a9f-667ab195f76b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:55.614015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-62427d7e-2b2f-4ecc-8a9f-667ab195f76b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:55.620921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62427d7e-2b2f-4ecc-8a9f-667ab195f76b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:55.621408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62427d7e-2b2f-4ecc-8a9f-667ab195f76b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:55.621895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62427d7e-2b2f-4ecc-8a9f-667ab195f76b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:55.622779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62427d7e-2b2f-4ecc-8a9f-667ab195f76b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:55.623244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62427d7e-2b2f-4ecc-8a9f-667ab195f76b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:55.623680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-62427d7e-2b2f-4ecc-8a9f-667ab195f76b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:55.751376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-62427d7e-2b2f-4ecc-8a9f-667ab195f76b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:55.758973 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-62427d7e-2b2f-4ecc-8a9f-667ab195f76b tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1506 microversion: 2.1 time: 0.149470 Oct 11 05:18:55.759566 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3856/7479] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:55 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:55.783570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-594666af-745d-456b-8ffc-88c5ea4f7784 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:55.784197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-594666af-745d-456b-8ffc-88c5ea4f7784 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:55.790379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-594666af-745d-456b-8ffc-88c5ea4f7784 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:55.790865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-594666af-745d-456b-8ffc-88c5ea4f7784 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:55.791297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-594666af-745d-456b-8ffc-88c5ea4f7784 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:55.791985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-594666af-745d-456b-8ffc-88c5ea4f7784 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:55.792430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-594666af-745d-456b-8ffc-88c5ea4f7784 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:55.792848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-594666af-745d-456b-8ffc-88c5ea4f7784 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:55.924647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-594666af-745d-456b-8ffc-88c5ea4f7784 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:55.932398 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-594666af-745d-456b-8ffc-88c5ea4f7784 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1506 microversion: 2.1 time: 0.154526 Oct 11 05:18:55.932994 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3624/7480] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:55 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1506 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:55.954804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c54f5d01-5141-4f7c-9a8a-a44fb749f6a9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:55.955429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c54f5d01-5141-4f7c-9a8a-a44fb749f6a9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:55.961340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c54f5d01-5141-4f7c-9a8a-a44fb749f6a9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:55.961835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c54f5d01-5141-4f7c-9a8a-a44fb749f6a9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:55.962322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c54f5d01-5141-4f7c-9a8a-a44fb749f6a9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:55.963022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c54f5d01-5141-4f7c-9a8a-a44fb749f6a9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:55.963501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c54f5d01-5141-4f7c-9a8a-a44fb749f6a9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:55.963926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c54f5d01-5141-4f7c-9a8a-a44fb749f6a9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:56.095441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c54f5d01-5141-4f7c-9a8a-a44fb749f6a9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:56.103209 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c54f5d01-5141-4f7c-9a8a-a44fb749f6a9 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1506 microversion: 2.1 time: 0.152193 Oct 11 05:18:56.103783 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3857/7481] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:55 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:56.125499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2542c627-2e15-4f85-a52c-85ed6538adaa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:56.126007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2542c627-2e15-4f85-a52c-85ed6538adaa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:56.131941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2542c627-2e15-4f85-a52c-85ed6538adaa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:56.132427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2542c627-2e15-4f85-a52c-85ed6538adaa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:56.132865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2542c627-2e15-4f85-a52c-85ed6538adaa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:56.133560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2542c627-2e15-4f85-a52c-85ed6538adaa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:56.134014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2542c627-2e15-4f85-a52c-85ed6538adaa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:56.134468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2542c627-2e15-4f85-a52c-85ed6538adaa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:56.159793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2542c627-2e15-4f85-a52c-85ed6538adaa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:18:56.451382 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2542c627-2e15-4f85-a52c-85ed6538adaa tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 204 len: 0 microversion: 2.1 time: 0.329881 Oct 11 05:18:56.452046 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3625/7482] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:18:56 2022] DELETE /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 05:18:56.470576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9bc1f3d5-d00f-4478-b7b4-ad8c650f4353 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:56.471201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9bc1f3d5-d00f-4478-b7b4-ad8c650f4353 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:56.477129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bc1f3d5-d00f-4478-b7b4-ad8c650f4353 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:56.477617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bc1f3d5-d00f-4478-b7b4-ad8c650f4353 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:56.478067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bc1f3d5-d00f-4478-b7b4-ad8c650f4353 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:56.478798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bc1f3d5-d00f-4478-b7b4-ad8c650f4353 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:56.479263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bc1f3d5-d00f-4478-b7b4-ad8c650f4353 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:56.479697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9bc1f3d5-d00f-4478-b7b4-ad8c650f4353 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:56.505185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9bc1f3d5-d00f-4478-b7b4-ad8c650f4353 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:18:56.613101 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.compute.api [None req-9bc1f3d5-d00f-4478-b7b4-ad8c650f4353 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Instance is already in deleting state, ignoring this request Oct 11 05:18:56.613994 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9bc1f3d5-d00f-4478-b7b4-ad8c650f4353 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 204 len: 0 microversion: 2.1 time: 0.147492 Oct 11 05:18:56.614687 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3858/7483] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:18:56 2022] DELETE /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:18:56.623761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09dcce72-eba3-4284-97be-ad15e85d3a95 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:56.624488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09dcce72-eba3-4284-97be-ad15e85d3a95 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:56.630582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dcce72-eba3-4284-97be-ad15e85d3a95 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:56.631091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dcce72-eba3-4284-97be-ad15e85d3a95 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:56.631520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dcce72-eba3-4284-97be-ad15e85d3a95 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:56.632208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dcce72-eba3-4284-97be-ad15e85d3a95 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:56.632654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dcce72-eba3-4284-97be-ad15e85d3a95 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:56.633074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09dcce72-eba3-4284-97be-ad15e85d3a95 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:56.765768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-09dcce72-eba3-4284-97be-ad15e85d3a95 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:56.773524 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09dcce72-eba3-4284-97be-ad15e85d3a95 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1512 microversion: 2.1 time: 0.154619 Oct 11 05:18:56.774093 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3626/7484] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:56 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:57.796415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-479f728e-fd98-44fd-9453-7b2c3e64b770 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:57.797041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-479f728e-fd98-44fd-9453-7b2c3e64b770 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:57.803837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-479f728e-fd98-44fd-9453-7b2c3e64b770 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:57.804334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-479f728e-fd98-44fd-9453-7b2c3e64b770 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:57.804783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-479f728e-fd98-44fd-9453-7b2c3e64b770 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:57.805479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-479f728e-fd98-44fd-9453-7b2c3e64b770 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:57.805947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-479f728e-fd98-44fd-9453-7b2c3e64b770 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:57.806416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-479f728e-fd98-44fd-9453-7b2c3e64b770 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:57.935010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-479f728e-fd98-44fd-9453-7b2c3e64b770 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:57.942683 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-479f728e-fd98-44fd-9453-7b2c3e64b770 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1512 microversion: 2.1 time: 0.150204 Oct 11 05:18:57.943255 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3859/7485] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:57 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1512 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:18:58.480204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-db2371d9-0135-423e-a244-c76c5aea84bf req-afce5a23-af10-499b-8cd1-40a7aae651a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c1a7f71-e528-4bfb-bb63-d7f2bec750e4", "name": "network-vif-deleted", "tag": "5f15e36e-5e3a-4b96-8b15-8776f41e1cd8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:18:58.491137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-db2371d9-0135-423e-a244-c76c5aea84bf req-afce5a23-af10-499b-8cd1-40a7aae651a7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:58.491614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-db2371d9-0135-423e-a244-c76c5aea84bf req-afce5a23-af10-499b-8cd1-40a7aae651a7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:58.492048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-db2371d9-0135-423e-a244-c76c5aea84bf req-afce5a23-af10-499b-8cd1-40a7aae651a7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:58.503788 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-db2371d9-0135-423e-a244-c76c5aea84bf req-afce5a23-af10-499b-8cd1-40a7aae651a7 service nova] Creating event network-vif-deleted:5f15e36e-5e3a-4b96-8b15-8776f41e1cd8 for instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 on n-h1-860892-1 Oct 11 05:18:58.508800 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-db2371d9-0135-423e-a244-c76c5aea84bf req-afce5a23-af10-499b-8cd1-40a7aae651a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032277 Oct 11 05:18:58.509758 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3627/7486] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:18:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:18:58.966142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:18:58.967126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:18:58.974449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:58.974946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:58.975502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:58.976266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:58.976735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:58.977204 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:59.010668 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:18:59.011150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:18:59.011603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:18:59.012059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lazy-loading 'fault' on Instance uuid 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:18:59.055091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '61a36add99334f6ab443e615dfd7b0cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afc63b66d4b34703850b708b96289079', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:18:59.063664 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a74fb8a-a924-4df3-ae7b-de0f77fc3caf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 200 len: 1305 microversion: 2.1 time: 0.101993 Oct 11 05:18:59.064267 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3860/7487] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:18:58 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:19:00.090122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:00.091392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:00.097617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:00.098107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:00.098577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:00.099273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:00.099729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:00.100161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:00.114060 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] HTTP exception thrown: Instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 could not be found. Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Request method failure captured: Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 HTTP/1.1 Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPxZ1u4y-HkXr8MqNlPgFyxWBijpFV_nUen72BQvDZlsEmWTbY_6iCuwF4u40n73kTb7zWqYDmaS3Lo5KXxaC6b3Y99znh3Mv1-SOqtHsbtCvhQ16EIKV5EkWo3COrDGAU1nxmRvavUMKwA-1a-01vEwwYbr15K0S8F0s1-Ltka5u80 Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: afc63b66d4b34703850b708b96289079 Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2029383081 Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/afc63b66d4b34703850b708b96289079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_afc63b66d4b34703850b708b96289079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/afc63b66d4b34703850b708b96289079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/afc63b66d4b34703850b708b96289079"}]}] Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerDiskConfigTestJSON-2029383081 Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: afc63b66d4b34703850b708b96289079 Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2029383081 Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerDiskConfigTestJSON-2029383081-project Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 61a36add99334f6ab443e615dfd7b0cd Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerDiskConfigTestJSON-2029383081-project Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 could not be found. Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '3c1a7f71-e528-4bfb-bb63-d7f2bec750e4'} Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 could not be found. Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 could not be found. Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:19:00.115766 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:19:00.120233 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:19:00.120233 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:19:00.120233 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:19:00.120233 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:19:00.120233 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:19:00.120233 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 could not be found. Oct 11 05:19:00.120233 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:19:00.120233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Returning 404 to user: Instance 3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:19:00.120233 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8698888e-cfe2-4492-881f-73f3117d1fa1 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4" status: 404 len: 111 microversion: 2.1 time: 0.032286 Oct 11 05:19:00.120233 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3628/7488] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:00 2022] GET /compute/v2.1/servers/3c1a7f71-e528-4bfb-bb63-d7f2bec750e4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:19:00.125881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1edbcfe6-0a70-4f5d-b4d0-28a781e28c6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '.version_select at 0x7fda182e6280>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:00.211310 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1edbcfe6-0a70-4f5d-b4d0-28a781e28c6a tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475185252" status: 202 len: 0 microversion: 2.1 time: 0.089151 Oct 11 05:19:00.211883 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3861/7489] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 05:19:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475185252 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 05:19:00.988276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:00.988773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:00.995145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:00.995653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:00.996094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:00.997350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:00.997806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:00.998255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:01.011892 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] HTTP exception thrown: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Request method failure captured: Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 HTTP/1.1 Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPxZ1u4y-HkXr8MqNlPgFyxWBijpFV_nUen72BQvDZlsEmWTbY_6iCuwF4u40n73kTb7zWqYDmaS3Lo5KXxaC6b3Y99znh3Mv1-SOqtHsbtCvhQ16EIKV5EkWo3COrDGAU1nxmRvavUMKwA-1a-01vEwwYbr15K0S8F0s1-Ltka5u80 Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: afc63b66d4b34703850b708b96289079 Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2029383081 Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/afc63b66d4b34703850b708b96289079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_afc63b66d4b34703850b708b96289079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/afc63b66d4b34703850b708b96289079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/afc63b66d4b34703850b708b96289079"}]}] Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerDiskConfigTestJSON-2029383081 Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: afc63b66d4b34703850b708b96289079 Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2029383081 Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerDiskConfigTestJSON-2029383081-project Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 61a36add99334f6ab443e615dfd7b0cd Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerDiskConfigTestJSON-2029383081-project Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '4750455a-d7d5-4b9c-9337-3555e752cdb8'} Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:19:01.013419 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Returning 404 to user: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d0d91e66-f8cb-4659-9c02-7e672125c377 tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 404 len: 111 microversion: 2.1 time: 0.030407 Oct 11 05:19:01.018100 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3629/7490] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:19:00 2022] DELETE /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:19:01.023577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:01.024202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] [instance: 4750455a-d7d5-4b9c-9337-3555e752cdb8] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:01.030850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:01.031347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:01.031794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:01.032487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:01.033039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:01.033475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:01.047778 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] HTTP exception thrown: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Request method failure captured: Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 HTTP/1.1 Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPxZ1u4y-HkXr8MqNlPgFyxWBijpFV_nUen72BQvDZlsEmWTbY_6iCuwF4u40n73kTb7zWqYDmaS3Lo5KXxaC6b3Y99znh3Mv1-SOqtHsbtCvhQ16EIKV5EkWo3COrDGAU1nxmRvavUMKwA-1a-01vEwwYbr15K0S8F0s1-Ltka5u80 Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: afc63b66d4b34703850b708b96289079 Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerDiskConfigTestJSON-2029383081 Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/afc63b66d4b34703850b708b96289079"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_afc63b66d4b34703850b708b96289079"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/afc63b66d4b34703850b708b96289079"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/afc63b66d4b34703850b708b96289079"}]}] Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerDiskConfigTestJSON-2029383081 Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: afc63b66d4b34703850b708b96289079 Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerDiskConfigTestJSON-2029383081 Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerDiskConfigTestJSON-2029383081-project Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 61a36add99334f6ab443e615dfd7b0cd Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerDiskConfigTestJSON-2029383081-project Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '4750455a-d7d5-4b9c-9337-3555e752cdb8'} Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:19:01.049439 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:19:01.054227 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:19:01.054227 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:19:01.054227 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:19:01.054227 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:19:01.054227 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:19:01.054227 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. Oct 11 05:19:01.054227 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:19:01.054227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] Returning 404 to user: Instance 4750455a-d7d5-4b9c-9337-3555e752cdb8 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:19:01.054227 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-69a88d8a-ab49-4970-8624-1d0d203da5bf tempest-ServerDiskConfigTestJSON-2029383081 tempest-ServerDiskConfigTestJSON-2029383081-project] 10.222.0.26 "GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8" status: 404 len: 111 microversion: 2.1 time: 0.031250 Oct 11 05:19:01.054227 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3862/7491] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:01 2022] GET /compute/v2.1/servers/4750455a-d7d5-4b9c-9337-3555e752cdb8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:19:12.091109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:19:12.092210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:19:12.210648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-91348b99-55dc-45a9-aacd-b0257584bc19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'create', calling method: .version_select at 0x7fda1883e430>, body: {"keypair": {"name": "tempest-keypair-441167700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDpDlOH346Dk+1NvilnlC6cXMUg/MAIaDKepoGY+zhAzz88AvDtXOUbmJajv18iBdyMWotXZ5Qh5IpG4han0jlhIEn6RMCxe0RNQX1astXyYozqbBnYqBX+PN9NOl0EvdQ=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:19:12.227304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-91348b99-55dc-45a9-aacd-b0257584bc19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for project 96aba3f066604fae934b975bfc28fdfe. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:19:12.233221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-91348b99-55dc-45a9-aacd-b0257584bc19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for user fc7f4b98dd3c48a8ad4418a3d73f5cb6 and project 96aba3f066604fae934b975bfc28fdfe. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:19:12.339981 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-91348b99-55dc-45a9-aacd-b0257584bc19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.254056 Oct 11 05:19:12.345109 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3630/7492] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:19:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:19:14.551632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-345660838", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "142a49fe-d230-4475-878e-8be16d147ec7"}], "security_groups": [{"name": "tempest-securitygroup--574193408"}], "key_name": "tempest-keypair-441167700", "user_data": "}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:19:14.561433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:19:14.563435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:19:14.667486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] validate_networks() for [('142a49fe-d230-4475-878e-8be16d147ec7', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:19:15.064997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:19:15.065425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:19:15.065911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:19:15.066357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:19:15.066779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:19:15.077415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:15.077908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:15.078406 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:15.079234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:15.079699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:15.080168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:15.097923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:19:15.103667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for user fc7f4b98dd3c48a8ad4418a3d73f5cb6 and project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:19:15.117576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:19:15.120051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:19:15.330040 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee341e2c-a6fc-4665-b62e-86095c4a0069 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.782697 Oct 11 05:19:15.330719 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3863/7493] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:19:14 2022] POST /compute/v2.1/servers => generated 408 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:19:15.343645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bdad08db-3acb-4638-b861-15b624c5ef81 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:15.344363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bdad08db-3acb-4638-b861-15b624c5ef81 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:15.408667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bdad08db-3acb-4638-b861-15b624c5ef81 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:15.415950 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bdad08db-3acb-4638-b861-15b624c5ef81 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1237 microversion: 2.1 time: 0.077339 Oct 11 05:19:15.416492 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3631/7494] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:15 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1237 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:16.441055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3fe25e9e-8290-4c80-84ad-7cdf78678ef4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:16.441611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3fe25e9e-8290-4c80-84ad-7cdf78678ef4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:16.495820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3fe25e9e-8290-4c80-84ad-7cdf78678ef4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:16.503262 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3fe25e9e-8290-4c80-84ad-7cdf78678ef4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1237 microversion: 2.1 time: 0.067140 Oct 11 05:19:16.503821 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3864/7495] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:16 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:17.526823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f17c9d8-bc52-4cb5-9cb4-fab267cc32e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:17.528171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f17c9d8-bc52-4cb5-9cb4-fab267cc32e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:17.535187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f17c9d8-bc52-4cb5-9cb4-fab267cc32e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:17.535682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f17c9d8-bc52-4cb5-9cb4-fab267cc32e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:17.536124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f17c9d8-bc52-4cb5-9cb4-fab267cc32e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:17.536827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f17c9d8-bc52-4cb5-9cb4-fab267cc32e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:17.537286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f17c9d8-bc52-4cb5-9cb4-fab267cc32e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:17.537714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f17c9d8-bc52-4cb5-9cb4-fab267cc32e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:17.598817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f17c9d8-bc52-4cb5-9cb4-fab267cc32e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:17.606510 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f17c9d8-bc52-4cb5-9cb4-fab267cc32e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1233 microversion: 2.1 time: 0.083534 Oct 11 05:19:17.607073 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3632/7496] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:17 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1233 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:18.629646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3adfeec-4255-4f72-8315-b6ee2bbf3893 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:18.630421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3adfeec-4255-4f72-8315-b6ee2bbf3893 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:18.637517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3adfeec-4255-4f72-8315-b6ee2bbf3893 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:18.638007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3adfeec-4255-4f72-8315-b6ee2bbf3893 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:18.638480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3adfeec-4255-4f72-8315-b6ee2bbf3893 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:18.639180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3adfeec-4255-4f72-8315-b6ee2bbf3893 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:18.639735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3adfeec-4255-4f72-8315-b6ee2bbf3893 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:18.640423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3adfeec-4255-4f72-8315-b6ee2bbf3893 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:18.706801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e3adfeec-4255-4f72-8315-b6ee2bbf3893 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:18.714569 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3adfeec-4255-4f72-8315-b6ee2bbf3893 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1307 microversion: 2.1 time: 0.088939 Oct 11 05:19:18.715626 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3865/7497] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:18 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1307 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:19.738175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae68cbe1-c06c-449b-a51c-c6a416036820 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:19.738808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ae68cbe1-c06c-449b-a51c-c6a416036820 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:19.745812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae68cbe1-c06c-449b-a51c-c6a416036820 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:19.746957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae68cbe1-c06c-449b-a51c-c6a416036820 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:19.751504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae68cbe1-c06c-449b-a51c-c6a416036820 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:19.751504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae68cbe1-c06c-449b-a51c-c6a416036820 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:19.751504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae68cbe1-c06c-449b-a51c-c6a416036820 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:19.751504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae68cbe1-c06c-449b-a51c-c6a416036820 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:19.882367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ae68cbe1-c06c-449b-a51c-c6a416036820 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:19.890444 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ae68cbe1-c06c-449b-a51c-c6a416036820 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1362 microversion: 2.1 time: 0.155888 Oct 11 05:19:19.891008 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3633/7498] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:19 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:20.374660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d675cd70-0237-464f-968a-dea843cc42e9 req-8ddd2a8d-bf4f-4ab4-9791-743eb4738fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1adcc807-d874-4d20-b308-e3bd6bfec80a", "tag": "29a646a6-9431-43a2-bff0-17afd31347d1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:19:20.385334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d675cd70-0237-464f-968a-dea843cc42e9 req-8ddd2a8d-bf4f-4ab4-9791-743eb4738fd4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:20.385919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d675cd70-0237-464f-968a-dea843cc42e9 req-8ddd2a8d-bf4f-4ab4-9791-743eb4738fd4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:20.386488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d675cd70-0237-464f-968a-dea843cc42e9 req-8ddd2a8d-bf4f-4ab4-9791-743eb4738fd4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:20.397826 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d675cd70-0237-464f-968a-dea843cc42e9 req-8ddd2a8d-bf4f-4ab4-9791-743eb4738fd4 service nova] Creating event network-changed:29a646a6-9431-43a2-bff0-17afd31347d1 for instance 1adcc807-d874-4d20-b308-e3bd6bfec80a on n-h1-860892-1 Oct 11 05:19:20.403566 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d675cd70-0237-464f-968a-dea843cc42e9 req-8ddd2a8d-bf4f-4ab4-9791-743eb4738fd4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033333 Oct 11 05:19:20.404479 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3866/7499] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:19:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:19:20.916853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f5b6be86-4b2b-4714-9826-06cb08feed51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:20.918782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f5b6be86-4b2b-4714-9826-06cb08feed51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:20.930537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5b6be86-4b2b-4714-9826-06cb08feed51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:20.931402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5b6be86-4b2b-4714-9826-06cb08feed51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:20.932190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5b6be86-4b2b-4714-9826-06cb08feed51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:20.933434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5b6be86-4b2b-4714-9826-06cb08feed51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:20.934290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5b6be86-4b2b-4714-9826-06cb08feed51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:20.935111 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5b6be86-4b2b-4714-9826-06cb08feed51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:21.093432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5b6be86-4b2b-4714-9826-06cb08feed51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:21.101184 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f5b6be86-4b2b-4714-9826-06cb08feed51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1362 microversion: 2.1 time: 0.191932 Oct 11 05:19:21.101765 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3634/7500] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:20 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:22.126287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5269eb55-1d81-44c6-b883-366393b6b98c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:22.126998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5269eb55-1d81-44c6-b883-366393b6b98c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:22.134109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5269eb55-1d81-44c6-b883-366393b6b98c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:22.134575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5269eb55-1d81-44c6-b883-366393b6b98c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:22.135027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5269eb55-1d81-44c6-b883-366393b6b98c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:22.135747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5269eb55-1d81-44c6-b883-366393b6b98c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:22.136239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5269eb55-1d81-44c6-b883-366393b6b98c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:22.136672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5269eb55-1d81-44c6-b883-366393b6b98c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:22.269566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5269eb55-1d81-44c6-b883-366393b6b98c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:22.277189 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5269eb55-1d81-44c6-b883-366393b6b98c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1362 microversion: 2.1 time: 0.155886 Oct 11 05:19:22.277754 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3867/7501] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:22 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:23.299871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-000f532c-d55c-488d-bd06-f04b238d660b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:23.300483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-000f532c-d55c-488d-bd06-f04b238d660b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:23.307558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-000f532c-d55c-488d-bd06-f04b238d660b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:23.308037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-000f532c-d55c-488d-bd06-f04b238d660b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:23.308977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-000f532c-d55c-488d-bd06-f04b238d660b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:23.309662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-000f532c-d55c-488d-bd06-f04b238d660b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:23.310115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-000f532c-d55c-488d-bd06-f04b238d660b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:23.310566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-000f532c-d55c-488d-bd06-f04b238d660b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:23.439665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-000f532c-d55c-488d-bd06-f04b238d660b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:23.447309 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-000f532c-d55c-488d-bd06-f04b238d660b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1362 microversion: 2.1 time: 0.151350 Oct 11 05:19:23.447878 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3635/7502] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:23 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:24.470543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-01590f31-82a4-488c-8420-c9dc5f338c65 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:24.471199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-01590f31-82a4-488c-8420-c9dc5f338c65 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:24.477986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01590f31-82a4-488c-8420-c9dc5f338c65 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:24.478522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01590f31-82a4-488c-8420-c9dc5f338c65 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:24.478978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01590f31-82a4-488c-8420-c9dc5f338c65 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:24.479682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01590f31-82a4-488c-8420-c9dc5f338c65 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:24.480648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01590f31-82a4-488c-8420-c9dc5f338c65 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:24.481092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01590f31-82a4-488c-8420-c9dc5f338c65 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:24.614465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-01590f31-82a4-488c-8420-c9dc5f338c65 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:24.620537 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-01590f31-82a4-488c-8420-c9dc5f338c65 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1362 microversion: 2.1 time: 0.153922 Oct 11 05:19:24.621304 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3868/7503] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:24 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:25.644419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-604cc158-cae1-4c7d-9978-b41f8d3b0994 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:25.644964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-604cc158-cae1-4c7d-9978-b41f8d3b0994 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:25.647684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:19:25.652485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604cc158-cae1-4c7d-9978-b41f8d3b0994 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:25.652967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604cc158-cae1-4c7d-9978-b41f8d3b0994 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:25.653407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604cc158-cae1-4c7d-9978-b41f8d3b0994 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:25.654100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604cc158-cae1-4c7d-9978-b41f8d3b0994 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:25.654582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604cc158-cae1-4c7d-9978-b41f8d3b0994 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:25.655008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-604cc158-cae1-4c7d-9978-b41f8d3b0994 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:25.781841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-604cc158-cae1-4c7d-9978-b41f8d3b0994 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:25.789525 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-604cc158-cae1-4c7d-9978-b41f8d3b0994 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1362 microversion: 2.1 time: 0.149313 Oct 11 05:19:25.790091 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3636/7504] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:25 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:26.733218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-0a367227-d4be-474f-8fd9-e898e9427a50 req-866205f1-e6ff-4ab5-8c64-7c22dd509de8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adcc807-d874-4d20-b308-e3bd6bfec80a", "name": "network-vif-plugged", "status": "completed", "tag": "29a646a6-9431-43a2-bff0-17afd31347d1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:19:26.738412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:19:26.739908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:19:26.748892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0a367227-d4be-474f-8fd9-e898e9427a50 req-866205f1-e6ff-4ab5-8c64-7c22dd509de8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:26.749380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0a367227-d4be-474f-8fd9-e898e9427a50 req-866205f1-e6ff-4ab5-8c64-7c22dd509de8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:26.749825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0a367227-d4be-474f-8fd9-e898e9427a50 req-866205f1-e6ff-4ab5-8c64-7c22dd509de8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:26.759984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-0a367227-d4be-474f-8fd9-e898e9427a50 req-866205f1-e6ff-4ab5-8c64-7c22dd509de8 service nova] Creating event network-vif-plugged:29a646a6-9431-43a2-bff0-17afd31347d1 for instance 1adcc807-d874-4d20-b308-e3bd6bfec80a on n-h1-860892-1 Oct 11 05:19:26.765282 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-0a367227-d4be-474f-8fd9-e898e9427a50 req-866205f1-e6ff-4ab5-8c64-7c22dd509de8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036197 Oct 11 05:19:26.765870 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3869/7505] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:19:26.819710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-73747f95-0f4c-40f6-a9db-3f040e51ab2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:26.825335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73747f95-0f4c-40f6-a9db-3f040e51ab2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:26.828136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73747f95-0f4c-40f6-a9db-3f040e51ab2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:26.828628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73747f95-0f4c-40f6-a9db-3f040e51ab2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:26.829087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73747f95-0f4c-40f6-a9db-3f040e51ab2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:26.829789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73747f95-0f4c-40f6-a9db-3f040e51ab2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:26.830269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73747f95-0f4c-40f6-a9db-3f040e51ab2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:26.830764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73747f95-0f4c-40f6-a9db-3f040e51ab2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:26.966742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73747f95-0f4c-40f6-a9db-3f040e51ab2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:26.974565 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-73747f95-0f4c-40f6-a9db-3f040e51ab2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1362 microversion: 2.1 time: 0.161555 Oct 11 05:19:26.975206 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3637/7506] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:26 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:27.999944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6329fe06-cea4-4556-ac98-fc2dd6d9d7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:28.000655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6329fe06-cea4-4556-ac98-fc2dd6d9d7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:28.007746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6329fe06-cea4-4556-ac98-fc2dd6d9d7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:28.008238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6329fe06-cea4-4556-ac98-fc2dd6d9d7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:28.008966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6329fe06-cea4-4556-ac98-fc2dd6d9d7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:28.009363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6329fe06-cea4-4556-ac98-fc2dd6d9d7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:28.009825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6329fe06-cea4-4556-ac98-fc2dd6d9d7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:28.010284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6329fe06-cea4-4556-ac98-fc2dd6d9d7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:28.140300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6329fe06-cea4-4556-ac98-fc2dd6d9d7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:28.148081 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6329fe06-cea4-4556-ac98-fc2dd6d9d7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1362 microversion: 2.1 time: 0.153760 Oct 11 05:19:28.148666 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3870/7507] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:27 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:29.170955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7250e2a1-c6b6-49aa-9987-8d79eb862e15 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:29.171569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7250e2a1-c6b6-49aa-9987-8d79eb862e15 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:29.178491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7250e2a1-c6b6-49aa-9987-8d79eb862e15 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:29.178981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7250e2a1-c6b6-49aa-9987-8d79eb862e15 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:29.179415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7250e2a1-c6b6-49aa-9987-8d79eb862e15 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:29.180098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7250e2a1-c6b6-49aa-9987-8d79eb862e15 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:29.180554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7250e2a1-c6b6-49aa-9987-8d79eb862e15 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:29.180982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7250e2a1-c6b6-49aa-9987-8d79eb862e15 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:29.307643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7250e2a1-c6b6-49aa-9987-8d79eb862e15 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:19:29.315758 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7250e2a1-c6b6-49aa-9987-8d79eb862e15 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1549 microversion: 2.1 time: 0.148845 Oct 11 05:19:29.316322 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3638/7508] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:19:29 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:19:29.338256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-94370370-b093-49f9-9aa8-a9824f487cf6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:19:29.338765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-94370370-b093-49f9-9aa8-a9824f487cf6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:19:29.345609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94370370-b093-49f9-9aa8-a9824f487cf6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:29.346100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94370370-b093-49f9-9aa8-a9824f487cf6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:29.346581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94370370-b093-49f9-9aa8-a9824f487cf6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:29.347310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94370370-b093-49f9-9aa8-a9824f487cf6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:29.347782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94370370-b093-49f9-9aa8-a9824f487cf6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:29.348223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-94370370-b093-49f9-9aa8-a9824f487cf6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:29.423554 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-94370370-b093-49f9-9aa8-a9824f487cf6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089110 Oct 11 05:19:29.424152 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3871/7509] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 05:19:29 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:19:30.412162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2dba0def-d2ad-4d14-b89f-334387de353d req-6ebbd8d7-50df-43ae-b7fe-87b20331e9aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1adcc807-d874-4d20-b308-e3bd6bfec80a", "tag": "29a646a6-9431-43a2-bff0-17afd31347d1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:19:30.422649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2dba0def-d2ad-4d14-b89f-334387de353d req-6ebbd8d7-50df-43ae-b7fe-87b20331e9aa service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:19:30.423139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2dba0def-d2ad-4d14-b89f-334387de353d req-6ebbd8d7-50df-43ae-b7fe-87b20331e9aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:19:30.423554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2dba0def-d2ad-4d14-b89f-334387de353d req-6ebbd8d7-50df-43ae-b7fe-87b20331e9aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:19:30.437159 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2dba0def-d2ad-4d14-b89f-334387de353d req-6ebbd8d7-50df-43ae-b7fe-87b20331e9aa service nova] Creating event network-changed:29a646a6-9431-43a2-bff0-17afd31347d1 for instance 1adcc807-d874-4d20-b308-e3bd6bfec80a on n-h1-860892-1 Oct 11 05:19:30.442359 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2dba0def-d2ad-4d14-b89f-334387de353d req-6ebbd8d7-50df-43ae-b7fe-87b20331e9aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033842 Oct 11 05:19:30.443151 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3639/7510] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:19:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:20:45.853662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:20:45.854437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=34 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:20:45.859303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8f33207a-f93b-4be8-8974-cd930d144463 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:45.859916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8f33207a-f93b-4be8-8974-cd930d144463 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:45.866458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f33207a-f93b-4be8-8974-cd930d144463 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:45.866950 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f33207a-f93b-4be8-8974-cd930d144463 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:45.867400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f33207a-f93b-4be8-8974-cd930d144463 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:45.868095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f33207a-f93b-4be8-8974-cd930d144463 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:45.868560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f33207a-f93b-4be8-8974-cd930d144463 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:45.868993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8f33207a-f93b-4be8-8974-cd930d144463 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:46.086796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8f33207a-f93b-4be8-8974-cd930d144463 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:46.094429 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8f33207a-f93b-4be8-8974-cd930d144463 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1668 microversion: 2.1 time: 0.243294 Oct 11 05:20:46.094989 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3872/7511] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:45 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1668 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:46.116238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:20:46.116956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=44 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:20:46.117800 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:20:46.117945 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:20:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a (ip 10.222.0.26) !!! Oct 11 05:20:46.122786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e0999e25-6af4-43f2-82bb-3cb38af84ad5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:46.123489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e0999e25-6af4-43f2-82bb-3cb38af84ad5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:46.130758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0999e25-6af4-43f2-82bb-3cb38af84ad5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:46.135747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0999e25-6af4-43f2-82bb-3cb38af84ad5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:46.135747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0999e25-6af4-43f2-82bb-3cb38af84ad5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:46.135747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0999e25-6af4-43f2-82bb-3cb38af84ad5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:46.135747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0999e25-6af4-43f2-82bb-3cb38af84ad5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:46.135747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e0999e25-6af4-43f2-82bb-3cb38af84ad5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:46.326472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e0999e25-6af4-43f2-82bb-3cb38af84ad5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:46.334842 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e0999e25-6af4-43f2-82bb-3cb38af84ad5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1668 microversion: 2.1 time: 0.221069 Oct 11 05:20:46.335424 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3640/7512] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:46 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1668 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:46.356625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5bbf7a8-3a26-4e66-808d-703e4c15bca9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:46.357285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c5bbf7a8-3a26-4e66-808d-703e4c15bca9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:46.363453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5bbf7a8-3a26-4e66-808d-703e4c15bca9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:46.363947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5bbf7a8-3a26-4e66-808d-703e4c15bca9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:46.364400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5bbf7a8-3a26-4e66-808d-703e4c15bca9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:46.365102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5bbf7a8-3a26-4e66-808d-703e4c15bca9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:46.365568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5bbf7a8-3a26-4e66-808d-703e4c15bca9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:46.366008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5bbf7a8-3a26-4e66-808d-703e4c15bca9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:46.495751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5bbf7a8-3a26-4e66-808d-703e4c15bca9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:46.504115 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c5bbf7a8-3a26-4e66-808d-703e4c15bca9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1668 microversion: 2.1 time: 0.150873 Oct 11 05:20:46.504694 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3873/7513] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:46 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:46.527098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:20:46.529447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:46.535587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:46.536067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:46.536500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:46.537180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:46.537626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:46.538043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:46.567211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:46.572721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Old instance type m1.heat2, new instance type m1.heat {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 05:20:46.579103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:20:46.579519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:20:46.579986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:20:46.580388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:20:46.580790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:20:46.804484 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-85ffe7c1-51b1-45a9-80d6-656aac68dbd6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a/action" status: 202 len: 0 microversion: 2.1 time: 0.281261 Oct 11 05:20:46.805768 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3641/7514] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:20:46 2022] POST /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:20:46.814371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f1abcce1-b4e2-4eae-904e-9639473703d7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:46.816068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f1abcce1-b4e2-4eae-904e-9639473703d7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:46.823616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1abcce1-b4e2-4eae-904e-9639473703d7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:46.824467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1abcce1-b4e2-4eae-904e-9639473703d7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:46.825029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1abcce1-b4e2-4eae-904e-9639473703d7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:46.827000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1abcce1-b4e2-4eae-904e-9639473703d7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:46.827596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1abcce1-b4e2-4eae-904e-9639473703d7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:46.828050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1abcce1-b4e2-4eae-904e-9639473703d7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:46.971801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f1abcce1-b4e2-4eae-904e-9639473703d7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:46.980019 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f1abcce1-b4e2-4eae-904e-9639473703d7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1677 microversion: 2.1 time: 0.170406 Oct 11 05:20:46.982983 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3874/7515] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:46 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1677 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:48.005520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b634b5d5-cce3-43b9-aad8-84a0e6d6df22 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:48.006123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b634b5d5-cce3-43b9-aad8-84a0e6d6df22 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:48.012952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b634b5d5-cce3-43b9-aad8-84a0e6d6df22 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:48.013433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b634b5d5-cce3-43b9-aad8-84a0e6d6df22 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:48.013985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b634b5d5-cce3-43b9-aad8-84a0e6d6df22 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:48.014697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b634b5d5-cce3-43b9-aad8-84a0e6d6df22 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:48.015401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b634b5d5-cce3-43b9-aad8-84a0e6d6df22 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:48.015824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b634b5d5-cce3-43b9-aad8-84a0e6d6df22 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:48.145904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b634b5d5-cce3-43b9-aad8-84a0e6d6df22 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:48.153706 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b634b5d5-cce3-43b9-aad8-84a0e6d6df22 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1677 microversion: 2.1 time: 0.154018 Oct 11 05:20:48.154301 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3642/7516] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:47 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1677 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:49.177580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ed485d3-ca87-4911-8c12-f98cb2475edf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:49.178355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0ed485d3-ca87-4911-8c12-f98cb2475edf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:49.185174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ed485d3-ca87-4911-8c12-f98cb2475edf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:49.185704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ed485d3-ca87-4911-8c12-f98cb2475edf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:49.186162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ed485d3-ca87-4911-8c12-f98cb2475edf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:49.186926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ed485d3-ca87-4911-8c12-f98cb2475edf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:49.187375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ed485d3-ca87-4911-8c12-f98cb2475edf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:49.187815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ed485d3-ca87-4911-8c12-f98cb2475edf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:49.651956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0ed485d3-ca87-4911-8c12-f98cb2475edf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:49.659776 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0ed485d3-ca87-4911-8c12-f98cb2475edf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1677 microversion: 2.1 time: 0.486701 Oct 11 05:20:49.660357 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3875/7517] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:49 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1677 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:50.683151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d9c64c52-51b7-4b8b-b587-3494cd18e636 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:50.683771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d9c64c52-51b7-4b8b-b587-3494cd18e636 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:50.691071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9c64c52-51b7-4b8b-b587-3494cd18e636 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:50.691647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9c64c52-51b7-4b8b-b587-3494cd18e636 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:50.692035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9c64c52-51b7-4b8b-b587-3494cd18e636 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:50.692721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9c64c52-51b7-4b8b-b587-3494cd18e636 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:50.693170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9c64c52-51b7-4b8b-b587-3494cd18e636 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:50.693593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d9c64c52-51b7-4b8b-b587-3494cd18e636 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:50.825706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d9c64c52-51b7-4b8b-b587-3494cd18e636 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:50.834023 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d9c64c52-51b7-4b8b-b587-3494cd18e636 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.154769 Oct 11 05:20:50.834620 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3643/7518] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:50 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:51.857269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4beb7a9d-833a-48fb-a481-de1d5a8d2580 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:51.857901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4beb7a9d-833a-48fb-a481-de1d5a8d2580 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:51.864291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb7a9d-833a-48fb-a481-de1d5a8d2580 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:51.864793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb7a9d-833a-48fb-a481-de1d5a8d2580 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:51.865248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb7a9d-833a-48fb-a481-de1d5a8d2580 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:51.865951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb7a9d-833a-48fb-a481-de1d5a8d2580 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:51.866462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb7a9d-833a-48fb-a481-de1d5a8d2580 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:51.866908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4beb7a9d-833a-48fb-a481-de1d5a8d2580 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:51.995826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4beb7a9d-833a-48fb-a481-de1d5a8d2580 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:52.003705 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4beb7a9d-833a-48fb-a481-de1d5a8d2580 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.150359 Oct 11 05:20:52.004345 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3876/7519] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:51 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:53.027015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce9087a4-d28f-48ad-8680-5aae3c8121e1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:53.027631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce9087a4-d28f-48ad-8680-5aae3c8121e1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:53.034433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce9087a4-d28f-48ad-8680-5aae3c8121e1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:53.034917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce9087a4-d28f-48ad-8680-5aae3c8121e1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:53.035356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce9087a4-d28f-48ad-8680-5aae3c8121e1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:53.036039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce9087a4-d28f-48ad-8680-5aae3c8121e1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:53.036489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce9087a4-d28f-48ad-8680-5aae3c8121e1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:53.036910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce9087a4-d28f-48ad-8680-5aae3c8121e1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:53.163672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce9087a4-d28f-48ad-8680-5aae3c8121e1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:53.171353 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce9087a4-d28f-48ad-8680-5aae3c8121e1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.148285 Oct 11 05:20:53.171920 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3644/7520] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:53 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:54.195057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8a1bf8ea-2b0e-4660-96ba-38135ab32766 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:54.195679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8a1bf8ea-2b0e-4660-96ba-38135ab32766 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:54.202375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a1bf8ea-2b0e-4660-96ba-38135ab32766 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:54.202866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a1bf8ea-2b0e-4660-96ba-38135ab32766 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:54.203314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a1bf8ea-2b0e-4660-96ba-38135ab32766 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:54.204014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a1bf8ea-2b0e-4660-96ba-38135ab32766 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:54.204545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a1bf8ea-2b0e-4660-96ba-38135ab32766 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:54.204977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8a1bf8ea-2b0e-4660-96ba-38135ab32766 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:54.332439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8a1bf8ea-2b0e-4660-96ba-38135ab32766 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:54.340132 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8a1bf8ea-2b0e-4660-96ba-38135ab32766 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.149046 Oct 11 05:20:54.340697 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3877/7521] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:54 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:55.364351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7bfb252a-204d-4447-b18e-ac1044210d27 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:55.364956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7bfb252a-204d-4447-b18e-ac1044210d27 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:55.371748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bfb252a-204d-4447-b18e-ac1044210d27 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:55.372217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bfb252a-204d-4447-b18e-ac1044210d27 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:55.372646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bfb252a-204d-4447-b18e-ac1044210d27 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:55.373317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bfb252a-204d-4447-b18e-ac1044210d27 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:55.373763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bfb252a-204d-4447-b18e-ac1044210d27 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:55.374179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7bfb252a-204d-4447-b18e-ac1044210d27 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:55.504964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7bfb252a-204d-4447-b18e-ac1044210d27 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:55.514220 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7bfb252a-204d-4447-b18e-ac1044210d27 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.154242 Oct 11 05:20:55.515550 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3645/7522] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:55 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:56.538429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9260424a-51ce-4a56-ba51-55659a1ee0cc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:56.539054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9260424a-51ce-4a56-ba51-55659a1ee0cc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:56.545847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9260424a-51ce-4a56-ba51-55659a1ee0cc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:56.546372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9260424a-51ce-4a56-ba51-55659a1ee0cc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:56.546819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9260424a-51ce-4a56-ba51-55659a1ee0cc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:56.547508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9260424a-51ce-4a56-ba51-55659a1ee0cc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:56.547967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9260424a-51ce-4a56-ba51-55659a1ee0cc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:56.548401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9260424a-51ce-4a56-ba51-55659a1ee0cc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:56.682047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9260424a-51ce-4a56-ba51-55659a1ee0cc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:56.689736 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9260424a-51ce-4a56-ba51-55659a1ee0cc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.155665 Oct 11 05:20:56.690320 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3878/7523] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:56 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:57.713730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4090936b-5749-4ea8-991a-17909e6cd946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:57.714377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4090936b-5749-4ea8-991a-17909e6cd946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:57.721294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4090936b-5749-4ea8-991a-17909e6cd946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:57.721777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4090936b-5749-4ea8-991a-17909e6cd946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:57.722237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4090936b-5749-4ea8-991a-17909e6cd946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:57.722934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4090936b-5749-4ea8-991a-17909e6cd946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:57.723506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4090936b-5749-4ea8-991a-17909e6cd946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:57.724568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4090936b-5749-4ea8-991a-17909e6cd946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:57.857468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4090936b-5749-4ea8-991a-17909e6cd946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:57.865256 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4090936b-5749-4ea8-991a-17909e6cd946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.155540 Oct 11 05:20:57.865824 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3646/7524] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:57 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:20:58.888695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fb29bb3b-e311-4844-84fb-a5b8b0483cb7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:20:58.889327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fb29bb3b-e311-4844-84fb-a5b8b0483cb7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:20:58.896470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb29bb3b-e311-4844-84fb-a5b8b0483cb7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:58.896964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb29bb3b-e311-4844-84fb-a5b8b0483cb7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:58.897419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb29bb3b-e311-4844-84fb-a5b8b0483cb7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:58.898122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb29bb3b-e311-4844-84fb-a5b8b0483cb7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:20:58.898648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb29bb3b-e311-4844-84fb-a5b8b0483cb7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:20:58.899056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fb29bb3b-e311-4844-84fb-a5b8b0483cb7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:20:59.027198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fb29bb3b-e311-4844-84fb-a5b8b0483cb7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:20:59.034976 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fb29bb3b-e311-4844-84fb-a5b8b0483cb7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.150193 Oct 11 05:20:59.035545 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3879/7525] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:20:58 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:00.058790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e7a5157-9776-4387-8a81-9ac420d5fc3c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:00.059404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9e7a5157-9776-4387-8a81-9ac420d5fc3c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:00.066212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e7a5157-9776-4387-8a81-9ac420d5fc3c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:00.066711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e7a5157-9776-4387-8a81-9ac420d5fc3c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:00.067783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e7a5157-9776-4387-8a81-9ac420d5fc3c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:00.068477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e7a5157-9776-4387-8a81-9ac420d5fc3c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:00.068935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e7a5157-9776-4387-8a81-9ac420d5fc3c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:00.069360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e7a5157-9776-4387-8a81-9ac420d5fc3c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:00.197974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9e7a5157-9776-4387-8a81-9ac420d5fc3c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:00.205744 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9e7a5157-9776-4387-8a81-9ac420d5fc3c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.150920 Oct 11 05:21:00.206336 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3647/7526] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:00 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:01.229151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce669e2b-91bb-4d26-9387-b42a0b76848a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:01.229774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce669e2b-91bb-4d26-9387-b42a0b76848a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:01.236641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce669e2b-91bb-4d26-9387-b42a0b76848a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:01.237160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce669e2b-91bb-4d26-9387-b42a0b76848a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:01.237612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce669e2b-91bb-4d26-9387-b42a0b76848a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:01.238315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce669e2b-91bb-4d26-9387-b42a0b76848a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:01.238778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce669e2b-91bb-4d26-9387-b42a0b76848a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:01.239211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce669e2b-91bb-4d26-9387-b42a0b76848a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:01.369895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce669e2b-91bb-4d26-9387-b42a0b76848a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:01.377736 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce669e2b-91bb-4d26-9387-b42a0b76848a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.152431 Oct 11 05:21:01.378325 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3880/7527] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:01 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:02.402167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1f65d621-c871-4223-bfbf-090c923d5b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:02.402804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1f65d621-c871-4223-bfbf-090c923d5b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:02.409560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65d621-c871-4223-bfbf-090c923d5b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:02.410038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65d621-c871-4223-bfbf-090c923d5b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:02.410512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65d621-c871-4223-bfbf-090c923d5b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:02.411812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65d621-c871-4223-bfbf-090c923d5b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:02.412265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65d621-c871-4223-bfbf-090c923d5b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:02.412690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1f65d621-c871-4223-bfbf-090c923d5b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:02.543779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1f65d621-c871-4223-bfbf-090c923d5b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:02.551478 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1f65d621-c871-4223-bfbf-090c923d5b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.153154 Oct 11 05:21:02.552046 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3648/7528] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:02 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:03.575410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d291f0b8-95ca-426b-a174-fee1e800387d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:03.576036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d291f0b8-95ca-426b-a174-fee1e800387d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:03.582924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d291f0b8-95ca-426b-a174-fee1e800387d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:03.583417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d291f0b8-95ca-426b-a174-fee1e800387d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:03.583859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d291f0b8-95ca-426b-a174-fee1e800387d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:03.584549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d291f0b8-95ca-426b-a174-fee1e800387d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:03.585007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d291f0b8-95ca-426b-a174-fee1e800387d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:03.585438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d291f0b8-95ca-426b-a174-fee1e800387d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:03.713160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d291f0b8-95ca-426b-a174-fee1e800387d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:03.720758 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d291f0b8-95ca-426b-a174-fee1e800387d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.149231 Oct 11 05:21:03.721321 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3881/7529] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:03 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:04.745148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0e52b5c1-0a6c-4176-bb6a-5869f8bbe1ba tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:04.745824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0e52b5c1-0a6c-4176-bb6a-5869f8bbe1ba tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:04.751841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e52b5c1-0a6c-4176-bb6a-5869f8bbe1ba tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:04.752314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e52b5c1-0a6c-4176-bb6a-5869f8bbe1ba tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:04.752746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e52b5c1-0a6c-4176-bb6a-5869f8bbe1ba tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:04.753422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e52b5c1-0a6c-4176-bb6a-5869f8bbe1ba tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:04.753869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e52b5c1-0a6c-4176-bb6a-5869f8bbe1ba tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:04.754809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e52b5c1-0a6c-4176-bb6a-5869f8bbe1ba tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:04.880782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0e52b5c1-0a6c-4176-bb6a-5869f8bbe1ba tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:04.888559 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0e52b5c1-0a6c-4176-bb6a-5869f8bbe1ba tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.147600 Oct 11 05:21:04.889125 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3649/7530] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:04 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:05.912938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e2e35c29-6a18-4c16-aa06-cbabe718aef2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:05.913592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e2e35c29-6a18-4c16-aa06-cbabe718aef2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:05.920545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2e35c29-6a18-4c16-aa06-cbabe718aef2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:05.921039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2e35c29-6a18-4c16-aa06-cbabe718aef2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:05.921489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2e35c29-6a18-4c16-aa06-cbabe718aef2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:05.922210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2e35c29-6a18-4c16-aa06-cbabe718aef2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:05.922677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2e35c29-6a18-4c16-aa06-cbabe718aef2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:05.923120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e2e35c29-6a18-4c16-aa06-cbabe718aef2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:06.053549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e2e35c29-6a18-4c16-aa06-cbabe718aef2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:06.061524 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e2e35c29-6a18-4c16-aa06-cbabe718aef2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.153187 Oct 11 05:21:06.062114 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3882/7531] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:05 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:07.085150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b56fe406-a065-4d45-b6d6-1db0f2b7ae67 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:07.085791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b56fe406-a065-4d45-b6d6-1db0f2b7ae67 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:07.092785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b56fe406-a065-4d45-b6d6-1db0f2b7ae67 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:07.093263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b56fe406-a065-4d45-b6d6-1db0f2b7ae67 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:07.093698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b56fe406-a065-4d45-b6d6-1db0f2b7ae67 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:07.094415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b56fe406-a065-4d45-b6d6-1db0f2b7ae67 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:07.094863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b56fe406-a065-4d45-b6d6-1db0f2b7ae67 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:07.095282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b56fe406-a065-4d45-b6d6-1db0f2b7ae67 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:07.228188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b56fe406-a065-4d45-b6d6-1db0f2b7ae67 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:07.235834 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b56fe406-a065-4d45-b6d6-1db0f2b7ae67 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.154558 Oct 11 05:21:07.236396 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3650/7532] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:07 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:08.260074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56b347e7-e362-4269-a29d-41976c1943f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:08.260693 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-56b347e7-e362-4269-a29d-41976c1943f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:08.268125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56b347e7-e362-4269-a29d-41976c1943f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:08.268611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56b347e7-e362-4269-a29d-41976c1943f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:08.269053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56b347e7-e362-4269-a29d-41976c1943f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:08.269738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56b347e7-e362-4269-a29d-41976c1943f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:08.270212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56b347e7-e362-4269-a29d-41976c1943f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:08.270680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56b347e7-e362-4269-a29d-41976c1943f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:08.401130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-56b347e7-e362-4269-a29d-41976c1943f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:08.408697 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-56b347e7-e362-4269-a29d-41976c1943f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.152503 Oct 11 05:21:08.409265 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3883/7533] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:08 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:09.431982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4b477918-4981-4220-a6fc-89c17d776fc1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:09.432601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4b477918-4981-4220-a6fc-89c17d776fc1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:09.439625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b477918-4981-4220-a6fc-89c17d776fc1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:09.440109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b477918-4981-4220-a6fc-89c17d776fc1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:09.440547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b477918-4981-4220-a6fc-89c17d776fc1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:09.441238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b477918-4981-4220-a6fc-89c17d776fc1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:09.441698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b477918-4981-4220-a6fc-89c17d776fc1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:09.442126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b477918-4981-4220-a6fc-89c17d776fc1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:09.574309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4b477918-4981-4220-a6fc-89c17d776fc1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:09.581999 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4b477918-4981-4220-a6fc-89c17d776fc1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.153918 Oct 11 05:21:09.582663 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3651/7534] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:09 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:10.605449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-29edd2d9-613e-4471-9e39-0e5885f54607 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:10.606118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-29edd2d9-613e-4471-9e39-0e5885f54607 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:10.613108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29edd2d9-613e-4471-9e39-0e5885f54607 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:10.613629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29edd2d9-613e-4471-9e39-0e5885f54607 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:10.614093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29edd2d9-613e-4471-9e39-0e5885f54607 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:10.614794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29edd2d9-613e-4471-9e39-0e5885f54607 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:10.615250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29edd2d9-613e-4471-9e39-0e5885f54607 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:10.615683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29edd2d9-613e-4471-9e39-0e5885f54607 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:10.744070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-29edd2d9-613e-4471-9e39-0e5885f54607 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:10.751848 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-29edd2d9-613e-4471-9e39-0e5885f54607 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.150242 Oct 11 05:21:10.752433 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3884/7535] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:10 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:11.776312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2451083f-e32a-47a7-bba2-101552fc15ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:11.776958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2451083f-e32a-47a7-bba2-101552fc15ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:11.783984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2451083f-e32a-47a7-bba2-101552fc15ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:11.784472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2451083f-e32a-47a7-bba2-101552fc15ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:11.784910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2451083f-e32a-47a7-bba2-101552fc15ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:11.785599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2451083f-e32a-47a7-bba2-101552fc15ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:11.786593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2451083f-e32a-47a7-bba2-101552fc15ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:11.787030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2451083f-e32a-47a7-bba2-101552fc15ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:11.917831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2451083f-e32a-47a7-bba2-101552fc15ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:11.926215 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2451083f-e32a-47a7-bba2-101552fc15ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1682 microversion: 2.1 time: 0.153846 Oct 11 05:21:11.926813 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3652/7536] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:11 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:12.867355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f2d9dd4b-d207-4940-8d83-75d6edaaec20 req-70a48f5a-8bbc-470a-9fc0-95ee28a28e74 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adcc807-d874-4d20-b308-e3bd6bfec80a", "name": "network-vif-unplugged", "status": "completed", "tag": "29a646a6-9431-43a2-bff0-17afd31347d1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:21:12.877447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f2d9dd4b-d207-4940-8d83-75d6edaaec20 req-70a48f5a-8bbc-470a-9fc0-95ee28a28e74 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:12.877936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f2d9dd4b-d207-4940-8d83-75d6edaaec20 req-70a48f5a-8bbc-470a-9fc0-95ee28a28e74 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:12.878415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f2d9dd4b-d207-4940-8d83-75d6edaaec20 req-70a48f5a-8bbc-470a-9fc0-95ee28a28e74 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:12.890715 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-f2d9dd4b-d207-4940-8d83-75d6edaaec20 req-70a48f5a-8bbc-470a-9fc0-95ee28a28e74 service nova] Creating event network-vif-unplugged:29a646a6-9431-43a2-bff0-17afd31347d1 for instance 1adcc807-d874-4d20-b308-e3bd6bfec80a on n-h2-860892-1 Oct 11 05:21:12.895971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-f2d9dd4b-d207-4940-8d83-75d6edaaec20 req-70a48f5a-8bbc-470a-9fc0-95ee28a28e74 service nova] Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:21:12.906741 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f2d9dd4b-d207-4940-8d83-75d6edaaec20 req-70a48f5a-8bbc-470a-9fc0-95ee28a28e74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043707 Oct 11 05:21:12.907324 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3885/7537] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:21:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:21:12.949353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-554703a6-5bf6-4d4a-bc17-a8d8a3a5cc94 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:12.949983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-554703a6-5bf6-4d4a-bc17-a8d8a3a5cc94 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:12.963027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-554703a6-5bf6-4d4a-bc17-a8d8a3a5cc94 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:12.963027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-554703a6-5bf6-4d4a-bc17-a8d8a3a5cc94 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:12.963027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-554703a6-5bf6-4d4a-bc17-a8d8a3a5cc94 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:12.963027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-554703a6-5bf6-4d4a-bc17-a8d8a3a5cc94 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:12.963027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-554703a6-5bf6-4d4a-bc17-a8d8a3a5cc94 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:12.963027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-554703a6-5bf6-4d4a-bc17-a8d8a3a5cc94 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:13.095569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-554703a6-5bf6-4d4a-bc17-a8d8a3a5cc94 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:13.103946 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-554703a6-5bf6-4d4a-bc17-a8d8a3a5cc94 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1681 microversion: 2.1 time: 0.158435 Oct 11 05:21:13.104526 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3653/7538] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:12 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:14.131225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ec240dc-a030-414c-a96a-4b284eee7029 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:14.131860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0ec240dc-a030-414c-a96a-4b284eee7029 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:14.137956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec240dc-a030-414c-a96a-4b284eee7029 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:14.138489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec240dc-a030-414c-a96a-4b284eee7029 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:14.144733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec240dc-a030-414c-a96a-4b284eee7029 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:14.144733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec240dc-a030-414c-a96a-4b284eee7029 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:14.144733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec240dc-a030-414c-a96a-4b284eee7029 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:14.144733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ec240dc-a030-414c-a96a-4b284eee7029 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:14.275919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0ec240dc-a030-414c-a96a-4b284eee7029 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:14.283914 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0ec240dc-a030-414c-a96a-4b284eee7029 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1681 microversion: 2.1 time: 0.158602 Oct 11 05:21:14.284523 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3886/7539] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:14 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:14.921060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-0fc036f2-df15-4188-afbd-845ff080265b req-2fbecc9d-e8ca-4a10-bda4-f42471ee757a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1adcc807-d874-4d20-b308-e3bd6bfec80a", "tag": "29a646a6-9431-43a2-bff0-17afd31347d1"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:21:14.931182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0fc036f2-df15-4188-afbd-845ff080265b req-2fbecc9d-e8ca-4a10-bda4-f42471ee757a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:14.931651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0fc036f2-df15-4188-afbd-845ff080265b req-2fbecc9d-e8ca-4a10-bda4-f42471ee757a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:14.932079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0fc036f2-df15-4188-afbd-845ff080265b req-2fbecc9d-e8ca-4a10-bda4-f42471ee757a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:14.943241 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-0fc036f2-df15-4188-afbd-845ff080265b req-2fbecc9d-e8ca-4a10-bda4-f42471ee757a service nova] Creating event network-changed:29a646a6-9431-43a2-bff0-17afd31347d1 for instance 1adcc807-d874-4d20-b308-e3bd6bfec80a on n-h2-860892-1 Oct 11 05:21:14.948369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-0fc036f2-df15-4188-afbd-845ff080265b req-2fbecc9d-e8ca-4a10-bda4-f42471ee757a service nova] Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:21:14.959591 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-0fc036f2-df15-4188-afbd-845ff080265b req-2fbecc9d-e8ca-4a10-bda4-f42471ee757a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042180 Oct 11 05:21:14.960161 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3654/7540] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:21:15.307382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-10fbce74-b2cd-41c3-a5f3-73a85e795aff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:15.308004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-10fbce74-b2cd-41c3-a5f3-73a85e795aff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:15.314833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10fbce74-b2cd-41c3-a5f3-73a85e795aff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:15.315324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10fbce74-b2cd-41c3-a5f3-73a85e795aff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:15.315767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10fbce74-b2cd-41c3-a5f3-73a85e795aff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:15.319309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10fbce74-b2cd-41c3-a5f3-73a85e795aff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:15.319309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10fbce74-b2cd-41c3-a5f3-73a85e795aff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:15.319309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10fbce74-b2cd-41c3-a5f3-73a85e795aff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:15.625367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-10fbce74-b2cd-41c3-a5f3-73a85e795aff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:15.637858 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-10fbce74-b2cd-41c3-a5f3-73a85e795aff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1679 microversion: 2.1 time: 0.334278 Oct 11 05:21:15.638451 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3887/7541] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:15 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1679 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:16.664815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8a7c3ae-9020-434a-9adb-67f5b26790dd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:16.665539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a8a7c3ae-9020-434a-9adb-67f5b26790dd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:16.667545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=35 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:21:16.672571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a7c3ae-9020-434a-9adb-67f5b26790dd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:16.673049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a7c3ae-9020-434a-9adb-67f5b26790dd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:16.673481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a7c3ae-9020-434a-9adb-67f5b26790dd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:16.674161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a7c3ae-9020-434a-9adb-67f5b26790dd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:16.674700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a7c3ae-9020-434a-9adb-67f5b26790dd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:16.675123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8a7c3ae-9020-434a-9adb-67f5b26790dd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:16.678958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:21:16.807205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a8a7c3ae-9020-434a-9adb-67f5b26790dd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:16.815416 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a8a7c3ae-9020-434a-9adb-67f5b26790dd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1676 microversion: 2.1 time: 0.156570 Oct 11 05:21:16.815990 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3655/7542] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:16 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:16.839295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-95cb4f43-c4cb-4fb8-af71-ad97ccfa5de2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:21:16.839933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-95cb4f43-c4cb-4fb8-af71-ad97ccfa5de2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:16.842745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=33 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:21:16.847433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95cb4f43-c4cb-4fb8-af71-ad97ccfa5de2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:16.847933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95cb4f43-c4cb-4fb8-af71-ad97ccfa5de2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:16.851811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95cb4f43-c4cb-4fb8-af71-ad97ccfa5de2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:16.851811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95cb4f43-c4cb-4fb8-af71-ad97ccfa5de2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:16.851811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95cb4f43-c4cb-4fb8-af71-ad97ccfa5de2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:16.851811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-95cb4f43-c4cb-4fb8-af71-ad97ccfa5de2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:16.853829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=95 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:21:17.055626 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-95cb4f43-c4cb-4fb8-af71-ad97ccfa5de2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a/action" status: 204 len: 0 microversion: 2.1 time: 0.220226 Oct 11 05:21:17.056371 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3888/7543] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:21:16 2022] POST /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a/action => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:21:17.065661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-077723ae-8b53-4b70-8bee-e7d4f80120e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:17.066296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-077723ae-8b53-4b70-8bee-e7d4f80120e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:17.072627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-077723ae-8b53-4b70-8bee-e7d4f80120e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:17.073105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-077723ae-8b53-4b70-8bee-e7d4f80120e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:17.073535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-077723ae-8b53-4b70-8bee-e7d4f80120e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:17.074235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-077723ae-8b53-4b70-8bee-e7d4f80120e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:17.074684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-077723ae-8b53-4b70-8bee-e7d4f80120e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:17.075108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-077723ae-8b53-4b70-8bee-e7d4f80120e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:17.213007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-077723ae-8b53-4b70-8bee-e7d4f80120e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:17.220747 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-077723ae-8b53-4b70-8bee-e7d4f80120e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1676 microversion: 2.1 time: 0.160123 Oct 11 05:21:17.221332 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3656/7544] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:17 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:18.246918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6dc7df08-2e2e-412c-88eb-4214f3b519b2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:18.246918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6dc7df08-2e2e-412c-88eb-4214f3b519b2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:18.253181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc7df08-2e2e-412c-88eb-4214f3b519b2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:18.253666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc7df08-2e2e-412c-88eb-4214f3b519b2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:18.254107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc7df08-2e2e-412c-88eb-4214f3b519b2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:18.254829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc7df08-2e2e-412c-88eb-4214f3b519b2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:18.255283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc7df08-2e2e-412c-88eb-4214f3b519b2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:18.255705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dc7df08-2e2e-412c-88eb-4214f3b519b2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:18.304756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b348c33b-76f2-4ff8-a7c8-dd2905e39a68 req-5190ae95-d8fb-4158-97ff-01f01db52172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adcc807-d874-4d20-b308-e3bd6bfec80a", "name": "network-vif-plugged", "status": "completed", "tag": "29a646a6-9431-43a2-bff0-17afd31347d1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:21:18.315252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b348c33b-76f2-4ff8-a7c8-dd2905e39a68 req-5190ae95-d8fb-4158-97ff-01f01db52172 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:18.315829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b348c33b-76f2-4ff8-a7c8-dd2905e39a68 req-5190ae95-d8fb-4158-97ff-01f01db52172 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:18.316351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b348c33b-76f2-4ff8-a7c8-dd2905e39a68 req-5190ae95-d8fb-4158-97ff-01f01db52172 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:18.331674 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b348c33b-76f2-4ff8-a7c8-dd2905e39a68 req-5190ae95-d8fb-4158-97ff-01f01db52172 service nova] Creating event network-vif-plugged:29a646a6-9431-43a2-bff0-17afd31347d1 for instance 1adcc807-d874-4d20-b308-e3bd6bfec80a on n-h2-860892-1 Oct 11 05:21:18.337585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-b348c33b-76f2-4ff8-a7c8-dd2905e39a68 req-5190ae95-d8fb-4158-97ff-01f01db52172 service nova] Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:21:18.349267 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b348c33b-76f2-4ff8-a7c8-dd2905e39a68 req-5190ae95-d8fb-4158-97ff-01f01db52172 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113146 Oct 11 05:21:18.349939 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3889/7545] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:21:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:21:18.395830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6dc7df08-2e2e-412c-88eb-4214f3b519b2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:18.403785 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6dc7df08-2e2e-412c-88eb-4214f3b519b2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1676 microversion: 2.1 time: 0.162481 Oct 11 05:21:18.404349 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3657/7546] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:18 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1676 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:19.429520 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-96bd8c1f-73a9-4b67-8a68-5348758b276c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:19.430284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-96bd8c1f-73a9-4b67-8a68-5348758b276c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:19.436313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96bd8c1f-73a9-4b67-8a68-5348758b276c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:19.436807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96bd8c1f-73a9-4b67-8a68-5348758b276c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:19.437287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96bd8c1f-73a9-4b67-8a68-5348758b276c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:19.437982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96bd8c1f-73a9-4b67-8a68-5348758b276c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:19.438483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96bd8c1f-73a9-4b67-8a68-5348758b276c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:19.438937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96bd8c1f-73a9-4b67-8a68-5348758b276c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:19.568927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-96bd8c1f-73a9-4b67-8a68-5348758b276c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:19.576883 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-96bd8c1f-73a9-4b67-8a68-5348758b276c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1668 microversion: 2.1 time: 0.152876 Oct 11 05:21:19.577461 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3890/7547] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:19 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1668 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:19.599378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3087d2c-d7d3-4b36-a160-2eec730a9734 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:19.599988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3087d2c-d7d3-4b36-a160-2eec730a9734 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:19.606635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3087d2c-d7d3-4b36-a160-2eec730a9734 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:19.607168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3087d2c-d7d3-4b36-a160-2eec730a9734 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:19.607608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3087d2c-d7d3-4b36-a160-2eec730a9734 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:19.608283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3087d2c-d7d3-4b36-a160-2eec730a9734 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:19.608729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3087d2c-d7d3-4b36-a160-2eec730a9734 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:19.609149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3087d2c-d7d3-4b36-a160-2eec730a9734 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:19.741451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a3087d2c-d7d3-4b36-a160-2eec730a9734 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:19.749143 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3087d2c-d7d3-4b36-a160-2eec730a9734 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1668 microversion: 2.1 time: 0.153625 Oct 11 05:21:19.749717 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3658/7548] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:19 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:19.772910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2684aaa-b99e-4b8e-bc4e-e66aecf98868 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:19.773491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b2684aaa-b99e-4b8e-bc4e-e66aecf98868 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:19.779568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2684aaa-b99e-4b8e-bc4e-e66aecf98868 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:19.780068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2684aaa-b99e-4b8e-bc4e-e66aecf98868 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:19.780554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2684aaa-b99e-4b8e-bc4e-e66aecf98868 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:19.781289 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2684aaa-b99e-4b8e-bc4e-e66aecf98868 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:19.781763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2684aaa-b99e-4b8e-bc4e-e66aecf98868 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:19.782229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2684aaa-b99e-4b8e-bc4e-e66aecf98868 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:19.918588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b2684aaa-b99e-4b8e-bc4e-e66aecf98868 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:19.922796 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2684aaa-b99e-4b8e-bc4e-e66aecf98868 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1668 microversion: 2.1 time: 0.154562 Oct 11 05:21:19.923368 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3891/7549] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:19 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:21:19.945775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f711929b-9f6d-4303-813b-3dcf2c8baf2c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:19.946293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f711929b-9f6d-4303-813b-3dcf2c8baf2c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:19.952340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f711929b-9f6d-4303-813b-3dcf2c8baf2c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:19.952831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f711929b-9f6d-4303-813b-3dcf2c8baf2c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:19.953274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f711929b-9f6d-4303-813b-3dcf2c8baf2c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:19.953967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f711929b-9f6d-4303-813b-3dcf2c8baf2c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:19.954445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f711929b-9f6d-4303-813b-3dcf2c8baf2c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:19.954895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f711929b-9f6d-4303-813b-3dcf2c8baf2c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:19.979844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f711929b-9f6d-4303-813b-3dcf2c8baf2c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:21:20.276319 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f711929b-9f6d-4303-813b-3dcf2c8baf2c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 204 len: 0 microversion: 2.1 time: 0.334621 Oct 11 05:21:20.276973 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3659/7550] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:21:19 2022] DELETE /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:21:20.285282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48123149-1b8c-4373-abbc-888f07c034e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:20.285930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-48123149-1b8c-4373-abbc-888f07c034e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:20.292109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48123149-1b8c-4373-abbc-888f07c034e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:20.292607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48123149-1b8c-4373-abbc-888f07c034e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:20.293055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48123149-1b8c-4373-abbc-888f07c034e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:20.293755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48123149-1b8c-4373-abbc-888f07c034e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:20.294246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48123149-1b8c-4373-abbc-888f07c034e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:20.294694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48123149-1b8c-4373-abbc-888f07c034e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:20.420576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48123149-1b8c-4373-abbc-888f07c034e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:20.428763 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48123149-1b8c-4373-abbc-888f07c034e4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1674 microversion: 2.1 time: 0.147545 Oct 11 05:21:20.429329 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3892/7551] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:20 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1674 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:21.453200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d81f57e7-5204-49cc-a8ff-7711f327cca2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:21.454135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d81f57e7-5204-49cc-a8ff-7711f327cca2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:21.462142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d81f57e7-5204-49cc-a8ff-7711f327cca2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:21.462652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d81f57e7-5204-49cc-a8ff-7711f327cca2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:21.463108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d81f57e7-5204-49cc-a8ff-7711f327cca2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:21.463795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d81f57e7-5204-49cc-a8ff-7711f327cca2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:21.464253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d81f57e7-5204-49cc-a8ff-7711f327cca2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:21.464707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d81f57e7-5204-49cc-a8ff-7711f327cca2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:21.597578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d81f57e7-5204-49cc-a8ff-7711f327cca2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:21.605339 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d81f57e7-5204-49cc-a8ff-7711f327cca2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1674 microversion: 2.1 time: 0.156436 Oct 11 05:21:21.605970 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3660/7552] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:21 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:22.526399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-72cd3dd5-45c9-4f2d-b404-1d3403b60439 req-689b07c1-9533-42a4-b64c-9a0bb7b80a9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1adcc807-d874-4d20-b308-e3bd6bfec80a", "name": "network-vif-deleted", "tag": "29a646a6-9431-43a2-bff0-17afd31347d1"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:21:22.538643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-72cd3dd5-45c9-4f2d-b404-1d3403b60439 req-689b07c1-9533-42a4-b64c-9a0bb7b80a9a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:22.543390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-72cd3dd5-45c9-4f2d-b404-1d3403b60439 req-689b07c1-9533-42a4-b64c-9a0bb7b80a9a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:22.543390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-72cd3dd5-45c9-4f2d-b404-1d3403b60439 req-689b07c1-9533-42a4-b64c-9a0bb7b80a9a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:22.550707 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-72cd3dd5-45c9-4f2d-b404-1d3403b60439 req-689b07c1-9533-42a4-b64c-9a0bb7b80a9a service nova] Creating event network-vif-deleted:29a646a6-9431-43a2-bff0-17afd31347d1 for instance 1adcc807-d874-4d20-b308-e3bd6bfec80a on n-h2-860892-1 Oct 11 05:21:22.555678 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-72cd3dd5-45c9-4f2d-b404-1d3403b60439 req-689b07c1-9533-42a4-b64c-9a0bb7b80a9a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032998 Oct 11 05:21:22.556292 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3893/7553] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:21:22.629507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-00af95f2-cbe2-47ef-a818-f10a520a7597 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:22.630274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-00af95f2-cbe2-47ef-a818-f10a520a7597 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:22.637272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af95f2-cbe2-47ef-a818-f10a520a7597 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:22.637980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af95f2-cbe2-47ef-a818-f10a520a7597 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:22.638605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af95f2-cbe2-47ef-a818-f10a520a7597 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:22.639302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af95f2-cbe2-47ef-a818-f10a520a7597 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:22.639752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af95f2-cbe2-47ef-a818-f10a520a7597 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:22.640433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-00af95f2-cbe2-47ef-a818-f10a520a7597 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:22.704617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-00af95f2-cbe2-47ef-a818-f10a520a7597 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:22.713973 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-00af95f2-cbe2-47ef-a818-f10a520a7597 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 200 len: 1607 microversion: 2.1 time: 0.088336 Oct 11 05:21:22.714854 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3661/7554] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:22 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 1607 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:23.739864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:23.740586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:23.746866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:23.747380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:23.747835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:23.748532 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:23.749000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:23.749437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:23.762687 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a HTTP/1.1 Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1adcc807-d874-4d20-b308-e3bd6bfec80a'} Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:21:23.764331 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:21:23.769544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:21:23.769544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:21:23.769544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:21:23.769544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:21:23.769544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:21:23.769544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:21:23.769544 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:21:23.769544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:21:23.769544 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6306a99a-afa9-4d6c-8c78-2d620ef48ea3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 404 len: 111 microversion: 2.1 time: 0.032270 Oct 11 05:21:23.769544 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3894/7555] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:23 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:21:23.780293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:23.780899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:23.788284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:23.788754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:23.789185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:23.789865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:23.790335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:23.790756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:23.804433 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a HTTP/1.1 Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1adcc807-d874-4d20-b308-e3bd6bfec80a'} Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:21:23.806043 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:21:23.815434 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:21:23.815434 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:21:23.815434 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:21:23.815434 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:21:23.815434 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:21:23.815434 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:21:23.815434 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:21:23.815434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:21:23.815434 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e98e3d1c-b5aa-4539-b8d7-588705c2f916 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 404 len: 111 microversion: 2.1 time: 0.031163 Oct 11 05:21:23.815434 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3662/7556] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:23 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 05:21:23.855965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-802240133", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "142a49fe-d230-4475-878e-8be16d147ec7"}], "security_groups": [{"name": "tempest-securitygroup--574193408"}], "key_name": "tempest-keypair-441167700", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:21:23.959133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] validate_networks() for [('142a49fe-d230-4475-878e-8be16d147ec7', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:21:24.332675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:21:24.333137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:21:24.333621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:21:24.334038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:21:24.334487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:21:24.343174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:24.343663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:24.344102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:24.344828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:24.345286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:24.345720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:24.362384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:21:24.368397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for user fc7f4b98dd3c48a8ad4418a3d73f5cb6 and project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:21:24.380672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:21:24.383020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:21:24.537722 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d218d216-2c07-4f20-896a-52fa4f99c23d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.685601 Oct 11 05:21:24.538461 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3895/7557] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:21:23 2022] POST /compute/v2.1/servers => generated 405 bytes in 687 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:21:24.549593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-704330c1-19c0-4049-86d8-14b5bc274a5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:24.550391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-704330c1-19c0-4049-86d8-14b5bc274a5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:24.604177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-704330c1-19c0-4049-86d8-14b5bc274a5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:24.611358 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-704330c1-19c0-4049-86d8-14b5bc274a5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1237 microversion: 2.1 time: 0.065659 Oct 11 05:21:24.612134 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3663/7558] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:24 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:25.636054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e1b9701a-c6e7-476a-a036-8588e46d098b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:25.636705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e1b9701a-c6e7-476a-a036-8588e46d098b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:25.690437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e1b9701a-c6e7-476a-a036-8588e46d098b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:25.697379 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e1b9701a-c6e7-476a-a036-8588e46d098b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1237 microversion: 2.1 time: 0.065951 Oct 11 05:21:25.697956 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3896/7559] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:25 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:26.721039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef494c4e-86ca-46d6-87e3-8a15ac531831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:26.721588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef494c4e-86ca-46d6-87e3-8a15ac531831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:26.729498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef494c4e-86ca-46d6-87e3-8a15ac531831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:26.729980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef494c4e-86ca-46d6-87e3-8a15ac531831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:26.730440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef494c4e-86ca-46d6-87e3-8a15ac531831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:26.731172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef494c4e-86ca-46d6-87e3-8a15ac531831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:26.731620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef494c4e-86ca-46d6-87e3-8a15ac531831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:26.732050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef494c4e-86ca-46d6-87e3-8a15ac531831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:26.797504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ef494c4e-86ca-46d6-87e3-8a15ac531831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:26.805330 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef494c4e-86ca-46d6-87e3-8a15ac531831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1233 microversion: 2.1 time: 0.088278 Oct 11 05:21:26.805892 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3664/7560] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:26 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1233 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:27.829088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-898c7c3c-e8e7-49b9-9872-37801f33c7df tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:27.830568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-898c7c3c-e8e7-49b9-9872-37801f33c7df tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:27.837543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-898c7c3c-e8e7-49b9-9872-37801f33c7df tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:27.838058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-898c7c3c-e8e7-49b9-9872-37801f33c7df tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:27.838546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-898c7c3c-e8e7-49b9-9872-37801f33c7df tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:27.839257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-898c7c3c-e8e7-49b9-9872-37801f33c7df tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:27.839724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-898c7c3c-e8e7-49b9-9872-37801f33c7df tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:27.840168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-898c7c3c-e8e7-49b9-9872-37801f33c7df tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:27.926674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-898c7c3c-e8e7-49b9-9872-37801f33c7df tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:27.934567 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-898c7c3c-e8e7-49b9-9872-37801f33c7df tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1295 microversion: 2.1 time: 0.109354 Oct 11 05:21:27.935146 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3897/7561] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:27 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1295 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:28.967470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5a7dd56b-ca54-45a3-a75e-990887b474dc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:28.968125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5a7dd56b-ca54-45a3-a75e-990887b474dc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:28.975635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a7dd56b-ca54-45a3-a75e-990887b474dc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:28.981369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a7dd56b-ca54-45a3-a75e-990887b474dc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:28.981369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a7dd56b-ca54-45a3-a75e-990887b474dc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:28.981369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a7dd56b-ca54-45a3-a75e-990887b474dc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:28.981369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a7dd56b-ca54-45a3-a75e-990887b474dc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:28.981369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5a7dd56b-ca54-45a3-a75e-990887b474dc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:29.113183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5a7dd56b-ca54-45a3-a75e-990887b474dc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:29.118447 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5a7dd56b-ca54-45a3-a75e-990887b474dc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1362 microversion: 2.1 time: 0.154812 Oct 11 05:21:29.119014 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3665/7562] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:28 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:29.173144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-92e6450f-759e-4e5e-8b72-0eb866134a9d req-1027a16d-6c86-4d50-83d3-7af4b8428504 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59a4d22-42f0-41a6-ab35-ba032a6510d1", "tag": "44d69afc-787a-4e9a-8340-e311753c91e8"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:21:29.183664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-92e6450f-759e-4e5e-8b72-0eb866134a9d req-1027a16d-6c86-4d50-83d3-7af4b8428504 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:29.184156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-92e6450f-759e-4e5e-8b72-0eb866134a9d req-1027a16d-6c86-4d50-83d3-7af4b8428504 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:29.184604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-92e6450f-759e-4e5e-8b72-0eb866134a9d req-1027a16d-6c86-4d50-83d3-7af4b8428504 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:29.448225 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-92e6450f-759e-4e5e-8b72-0eb866134a9d req-1027a16d-6c86-4d50-83d3-7af4b8428504 service nova] Creating event network-changed:44d69afc-787a-4e9a-8340-e311753c91e8 for instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 on n-h1-860892-1 Oct 11 05:21:29.453200 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-92e6450f-759e-4e5e-8b72-0eb866134a9d req-1027a16d-6c86-4d50-83d3-7af4b8428504 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.283751 Oct 11 05:21:29.453789 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3898/7563] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:21:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:21:30.141227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a58cdeb4-101d-4b45-bb2e-df23df9c84d1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:30.141838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a58cdeb4-101d-4b45-bb2e-df23df9c84d1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:30.148829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58cdeb4-101d-4b45-bb2e-df23df9c84d1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:30.149307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58cdeb4-101d-4b45-bb2e-df23df9c84d1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:30.149742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58cdeb4-101d-4b45-bb2e-df23df9c84d1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:30.150453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58cdeb4-101d-4b45-bb2e-df23df9c84d1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:30.150907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58cdeb4-101d-4b45-bb2e-df23df9c84d1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:30.151325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a58cdeb4-101d-4b45-bb2e-df23df9c84d1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:30.284649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a58cdeb4-101d-4b45-bb2e-df23df9c84d1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:30.288499 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a58cdeb4-101d-4b45-bb2e-df23df9c84d1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1362 microversion: 2.1 time: 0.151422 Oct 11 05:21:30.289072 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3666/7564] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:30 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:31.313600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-80762c0a-40d5-4f1e-8f0a-c7c5633e18c6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:31.314338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-80762c0a-40d5-4f1e-8f0a-c7c5633e18c6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:31.320463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80762c0a-40d5-4f1e-8f0a-c7c5633e18c6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:31.320951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80762c0a-40d5-4f1e-8f0a-c7c5633e18c6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:31.321396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80762c0a-40d5-4f1e-8f0a-c7c5633e18c6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:31.322084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80762c0a-40d5-4f1e-8f0a-c7c5633e18c6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:31.322578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80762c0a-40d5-4f1e-8f0a-c7c5633e18c6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:31.323012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-80762c0a-40d5-4f1e-8f0a-c7c5633e18c6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:31.453597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-80762c0a-40d5-4f1e-8f0a-c7c5633e18c6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:31.461639 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-80762c0a-40d5-4f1e-8f0a-c7c5633e18c6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1362 microversion: 2.1 time: 0.153065 Oct 11 05:21:31.462206 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3899/7565] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:31 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:32.485432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f969a28e-3938-4606-b89b-464002a3b985 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:32.485951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f969a28e-3938-4606-b89b-464002a3b985 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:32.493390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f969a28e-3938-4606-b89b-464002a3b985 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:32.493894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f969a28e-3938-4606-b89b-464002a3b985 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:32.494441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f969a28e-3938-4606-b89b-464002a3b985 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:32.495136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f969a28e-3938-4606-b89b-464002a3b985 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:32.495586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f969a28e-3938-4606-b89b-464002a3b985 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:32.496010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f969a28e-3938-4606-b89b-464002a3b985 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:32.627397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f969a28e-3938-4606-b89b-464002a3b985 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:32.635017 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f969a28e-3938-4606-b89b-464002a3b985 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1362 microversion: 2.1 time: 0.153557 Oct 11 05:21:32.635579 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3667/7566] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:32 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:33.658537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8242f0ba-680c-4437-b089-0c3a9caf271d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:33.659157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8242f0ba-680c-4437-b089-0c3a9caf271d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:33.665893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8242f0ba-680c-4437-b089-0c3a9caf271d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:33.666425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8242f0ba-680c-4437-b089-0c3a9caf271d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:33.666872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8242f0ba-680c-4437-b089-0c3a9caf271d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:33.667567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8242f0ba-680c-4437-b089-0c3a9caf271d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:33.668030 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8242f0ba-680c-4437-b089-0c3a9caf271d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:33.668466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8242f0ba-680c-4437-b089-0c3a9caf271d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:33.803286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8242f0ba-680c-4437-b089-0c3a9caf271d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:33.810989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8242f0ba-680c-4437-b089-0c3a9caf271d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1362 microversion: 2.1 time: 0.156312 Oct 11 05:21:33.811553 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3900/7567] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:33 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:34.836180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-37fb07cd-8293-417c-affa-85c3f618c707 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:34.836824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-37fb07cd-8293-417c-affa-85c3f618c707 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:34.839117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:21:34.844131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37fb07cd-8293-417c-affa-85c3f618c707 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:34.844607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37fb07cd-8293-417c-affa-85c3f618c707 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:34.848532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37fb07cd-8293-417c-affa-85c3f618c707 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:34.848532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37fb07cd-8293-417c-affa-85c3f618c707 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:34.848532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37fb07cd-8293-417c-affa-85c3f618c707 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:34.848532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37fb07cd-8293-417c-affa-85c3f618c707 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:34.974273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-37fb07cd-8293-417c-affa-85c3f618c707 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:34.981933 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-37fb07cd-8293-417c-affa-85c3f618c707 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1362 microversion: 2.1 time: 0.149691 Oct 11 05:21:34.982530 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3668/7568] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:34 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:35.435881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d657696c-16bc-4d32-9118-e5c3e62210e7 req-cc9ee2ed-ccab-4a37-b943-3178b91316ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59a4d22-42f0-41a6-ab35-ba032a6510d1", "name": "network-vif-plugged", "status": "completed", "tag": "44d69afc-787a-4e9a-8340-e311753c91e8"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:21:35.441359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:21:35.447573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d657696c-16bc-4d32-9118-e5c3e62210e7 req-cc9ee2ed-ccab-4a37-b943-3178b91316ee service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:35.448207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d657696c-16bc-4d32-9118-e5c3e62210e7 req-cc9ee2ed-ccab-4a37-b943-3178b91316ee service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:35.448692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d657696c-16bc-4d32-9118-e5c3e62210e7 req-cc9ee2ed-ccab-4a37-b943-3178b91316ee service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:35.463346 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d657696c-16bc-4d32-9118-e5c3e62210e7 req-cc9ee2ed-ccab-4a37-b943-3178b91316ee service nova] Creating event network-vif-plugged:44d69afc-787a-4e9a-8340-e311753c91e8 for instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 on n-h1-860892-1 Oct 11 05:21:35.465344 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d657696c-16bc-4d32-9118-e5c3e62210e7 req-cc9ee2ed-ccab-4a37-b943-3178b91316ee service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033194 Oct 11 05:21:35.466411 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3901/7569] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:21:36.005504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2ed9ec44-6c12-420e-93fd-9f36b52f8d03 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:36.006121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2ed9ec44-6c12-420e-93fd-9f36b52f8d03 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:36.012885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ed9ec44-6c12-420e-93fd-9f36b52f8d03 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:36.013368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ed9ec44-6c12-420e-93fd-9f36b52f8d03 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:36.013807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ed9ec44-6c12-420e-93fd-9f36b52f8d03 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:36.014522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ed9ec44-6c12-420e-93fd-9f36b52f8d03 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:36.014979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ed9ec44-6c12-420e-93fd-9f36b52f8d03 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:36.015669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2ed9ec44-6c12-420e-93fd-9f36b52f8d03 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:36.146327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2ed9ec44-6c12-420e-93fd-9f36b52f8d03 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:36.154086 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2ed9ec44-6c12-420e-93fd-9f36b52f8d03 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1362 microversion: 2.1 time: 0.153113 Oct 11 05:21:36.154695 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3669/7570] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:35 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:37.174162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:21:37.179588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f501d29b-a945-4b04-ad98-82113d3948c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:37.180299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f501d29b-a945-4b04-ad98-82113d3948c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:37.186617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f501d29b-a945-4b04-ad98-82113d3948c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:37.187118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f501d29b-a945-4b04-ad98-82113d3948c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:37.187565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f501d29b-a945-4b04-ad98-82113d3948c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:37.188261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f501d29b-a945-4b04-ad98-82113d3948c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:37.188784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f501d29b-a945-4b04-ad98-82113d3948c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:37.189224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f501d29b-a945-4b04-ad98-82113d3948c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:37.322402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f501d29b-a945-4b04-ad98-82113d3948c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:21:37.330109 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f501d29b-a945-4b04-ad98-82113d3948c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1549 microversion: 2.1 time: 0.156885 Oct 11 05:21:37.334828 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3902/7571] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:21:37 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1549 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:21:37.353815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69e6fcee-49d2-4e24-9cb4-ebaf5e4bdfe8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:21:37.354345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69e6fcee-49d2-4e24-9cb4-ebaf5e4bdfe8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:21:37.361102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69e6fcee-49d2-4e24-9cb4-ebaf5e4bdfe8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:37.361779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69e6fcee-49d2-4e24-9cb4-ebaf5e4bdfe8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:37.362236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69e6fcee-49d2-4e24-9cb4-ebaf5e4bdfe8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:37.362926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69e6fcee-49d2-4e24-9cb4-ebaf5e4bdfe8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:37.363889 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69e6fcee-49d2-4e24-9cb4-ebaf5e4bdfe8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:37.364298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69e6fcee-49d2-4e24-9cb4-ebaf5e4bdfe8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:37.440217 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69e6fcee-49d2-4e24-9cb4-ebaf5e4bdfe8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090195 Oct 11 05:21:37.440833 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3670/7572] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 05:21:37 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:21:38.711632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-47281807-9c00-4b53-afb9-7515d89aa8be req-3564f5b0-35e6-4d81-9df6-ee49968be0b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59a4d22-42f0-41a6-ab35-ba032a6510d1", "tag": "44d69afc-787a-4e9a-8340-e311753c91e8"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:21:38.721878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-47281807-9c00-4b53-afb9-7515d89aa8be req-3564f5b0-35e6-4d81-9df6-ee49968be0b5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:21:38.722401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-47281807-9c00-4b53-afb9-7515d89aa8be req-3564f5b0-35e6-4d81-9df6-ee49968be0b5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:21:38.723347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-47281807-9c00-4b53-afb9-7515d89aa8be req-3564f5b0-35e6-4d81-9df6-ee49968be0b5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:21:38.734767 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-47281807-9c00-4b53-afb9-7515d89aa8be req-3564f5b0-35e6-4d81-9df6-ee49968be0b5 service nova] Creating event network-changed:44d69afc-787a-4e9a-8340-e311753c91e8 for instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 on n-h1-860892-1 Oct 11 05:21:38.741840 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-47281807-9c00-4b53-afb9-7515d89aa8be req-3564f5b0-35e6-4d81-9df6-ee49968be0b5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034327 Oct 11 05:21:38.742490 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3903/7573] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:22:50.852267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:22:50.853062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:22:50.853861 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:22:50.854010 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:22:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1/action (ip 10.222.0.26) !!! Oct 11 05:22:50.859813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-46096811-6ed5-4634-bbfe-520c0a4bb012 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:22:50.866887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46096811-6ed5-4634-bbfe-520c0a4bb012 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:50.867371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46096811-6ed5-4634-bbfe-520c0a4bb012 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:50.867813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-46096811-6ed5-4634-bbfe-520c0a4bb012 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:50.890521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-46096811-6ed5-4634-bbfe-520c0a4bb012 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Going to try to stop instance {{(pid=120993) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 05:22:51.084623 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-46096811-6ed5-4634-bbfe-520c0a4bb012 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1/action" status: 202 len: 0 microversion: 2.1 time: 0.234709 Oct 11 05:22:51.085236 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3671/7574] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:22:50 2022] POST /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1/action => generated 0 bytes in 236 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:22:51.092597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:22:51.093579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:22:51.094851 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:22:51.095105 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:22:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 (ip 10.222.0.26) !!! Oct 11 05:22:51.101077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7cd36c1d-ca72-489c-bd07-e2f805dcabf8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:22:51.101840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7cd36c1d-ca72-489c-bd07-e2f805dcabf8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:22:51.112899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cd36c1d-ca72-489c-bd07-e2f805dcabf8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:51.112899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cd36c1d-ca72-489c-bd07-e2f805dcabf8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:51.112899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cd36c1d-ca72-489c-bd07-e2f805dcabf8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:51.112899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cd36c1d-ca72-489c-bd07-e2f805dcabf8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:51.112899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cd36c1d-ca72-489c-bd07-e2f805dcabf8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:51.112899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7cd36c1d-ca72-489c-bd07-e2f805dcabf8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:51.245873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7cd36c1d-ca72-489c-bd07-e2f805dcabf8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:22:51.254168 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7cd36c1d-ca72-489c-bd07-e2f805dcabf8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.164255 Oct 11 05:22:51.254781 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3904/7575] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:22:51 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:22:52.280489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-03f921f8-16dd-4784-a0a1-f39bb10712a7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:22:52.281225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-03f921f8-16dd-4784-a0a1-f39bb10712a7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:22:52.287946 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03f921f8-16dd-4784-a0a1-f39bb10712a7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:52.292770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03f921f8-16dd-4784-a0a1-f39bb10712a7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:52.292770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03f921f8-16dd-4784-a0a1-f39bb10712a7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:52.292770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03f921f8-16dd-4784-a0a1-f39bb10712a7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:52.292770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03f921f8-16dd-4784-a0a1-f39bb10712a7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:52.292770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03f921f8-16dd-4784-a0a1-f39bb10712a7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:52.419454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-03f921f8-16dd-4784-a0a1-f39bb10712a7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:22:52.427654 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-03f921f8-16dd-4784-a0a1-f39bb10712a7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.152356 Oct 11 05:22:52.428225 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3672/7576] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:22:52 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:22:53.452095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fbe98e0f-d6a6-4a8e-b8c8-53a9c0dd2137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:22:53.452749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fbe98e0f-d6a6-4a8e-b8c8-53a9c0dd2137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:22:53.460647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbe98e0f-d6a6-4a8e-b8c8-53a9c0dd2137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:53.461151 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbe98e0f-d6a6-4a8e-b8c8-53a9c0dd2137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:53.461605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbe98e0f-d6a6-4a8e-b8c8-53a9c0dd2137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:53.462339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbe98e0f-d6a6-4a8e-b8c8-53a9c0dd2137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:53.462809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbe98e0f-d6a6-4a8e-b8c8-53a9c0dd2137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:53.463246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fbe98e0f-d6a6-4a8e-b8c8-53a9c0dd2137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:53.591273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fbe98e0f-d6a6-4a8e-b8c8-53a9c0dd2137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:22:53.599033 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fbe98e0f-d6a6-4a8e-b8c8-53a9c0dd2137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.151507 Oct 11 05:22:53.599611 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3905/7577] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:22:53 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:22:54.622298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-34cf5c85-9759-4c95-b201-604d2e3c927e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:22:54.622912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-34cf5c85-9759-4c95-b201-604d2e3c927e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:22:54.631987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34cf5c85-9759-4c95-b201-604d2e3c927e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:54.632469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34cf5c85-9759-4c95-b201-604d2e3c927e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:54.632905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34cf5c85-9759-4c95-b201-604d2e3c927e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:54.633592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34cf5c85-9759-4c95-b201-604d2e3c927e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:54.634042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34cf5c85-9759-4c95-b201-604d2e3c927e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:54.634498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34cf5c85-9759-4c95-b201-604d2e3c927e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:54.766651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-34cf5c85-9759-4c95-b201-604d2e3c927e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:22:54.774857 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-34cf5c85-9759-4c95-b201-604d2e3c927e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.156365 Oct 11 05:22:54.775370 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3673/7578] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:22:54 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:22:55.798279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b48d998d-61aa-4ac5-a30d-7a9745625329 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:22:55.798836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b48d998d-61aa-4ac5-a30d-7a9745625329 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:22:55.807457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b48d998d-61aa-4ac5-a30d-7a9745625329 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:55.808081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b48d998d-61aa-4ac5-a30d-7a9745625329 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:55.808545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b48d998d-61aa-4ac5-a30d-7a9745625329 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:55.809296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b48d998d-61aa-4ac5-a30d-7a9745625329 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:55.809778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b48d998d-61aa-4ac5-a30d-7a9745625329 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:55.810246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b48d998d-61aa-4ac5-a30d-7a9745625329 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:55.943343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b48d998d-61aa-4ac5-a30d-7a9745625329 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:22:55.951171 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b48d998d-61aa-4ac5-a30d-7a9745625329 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.156948 Oct 11 05:22:55.951764 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3906/7579] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:22:55 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:22:56.975933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a9f72557-8706-47ea-aaca-2b7f8ae09fd9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:22:56.976547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a9f72557-8706-47ea-aaca-2b7f8ae09fd9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:22:56.983665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9f72557-8706-47ea-aaca-2b7f8ae09fd9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:56.984146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9f72557-8706-47ea-aaca-2b7f8ae09fd9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:56.984582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9f72557-8706-47ea-aaca-2b7f8ae09fd9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:56.985264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9f72557-8706-47ea-aaca-2b7f8ae09fd9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:56.985713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9f72557-8706-47ea-aaca-2b7f8ae09fd9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:56.986131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a9f72557-8706-47ea-aaca-2b7f8ae09fd9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:57.113846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a9f72557-8706-47ea-aaca-2b7f8ae09fd9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:22:57.121620 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a9f72557-8706-47ea-aaca-2b7f8ae09fd9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.150318 Oct 11 05:22:57.122308 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3674/7580] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:22:56 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:22:58.144390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff23f3b0-1b23-41e8-9b16-d2bea014f70f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:22:58.145015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ff23f3b0-1b23-41e8-9b16-d2bea014f70f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:22:58.151829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff23f3b0-1b23-41e8-9b16-d2bea014f70f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:58.152322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff23f3b0-1b23-41e8-9b16-d2bea014f70f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:58.152772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff23f3b0-1b23-41e8-9b16-d2bea014f70f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:58.153473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff23f3b0-1b23-41e8-9b16-d2bea014f70f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:58.153938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff23f3b0-1b23-41e8-9b16-d2bea014f70f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:58.154425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff23f3b0-1b23-41e8-9b16-d2bea014f70f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:58.281611 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ff23f3b0-1b23-41e8-9b16-d2bea014f70f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:22:58.290014 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff23f3b0-1b23-41e8-9b16-d2bea014f70f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.149779 Oct 11 05:22:58.290625 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3907/7581] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:22:58 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:22:59.313038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d31abb76-a03e-42f6-b83d-2590dbe36f84 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:22:59.313653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d31abb76-a03e-42f6-b83d-2590dbe36f84 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:22:59.321088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d31abb76-a03e-42f6-b83d-2590dbe36f84 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:59.321570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d31abb76-a03e-42f6-b83d-2590dbe36f84 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:59.322019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d31abb76-a03e-42f6-b83d-2590dbe36f84 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:59.322739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d31abb76-a03e-42f6-b83d-2590dbe36f84 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:22:59.323190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d31abb76-a03e-42f6-b83d-2590dbe36f84 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:22:59.323618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d31abb76-a03e-42f6-b83d-2590dbe36f84 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:22:59.453741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d31abb76-a03e-42f6-b83d-2590dbe36f84 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:22:59.461450 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d31abb76-a03e-42f6-b83d-2590dbe36f84 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.152382 Oct 11 05:22:59.462020 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3675/7582] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:22:59 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:00.485144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-abf3efb8-c273-4b7d-a11e-ccc24c406067 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:00.485777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-abf3efb8-c273-4b7d-a11e-ccc24c406067 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:00.493193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abf3efb8-c273-4b7d-a11e-ccc24c406067 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:00.493692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abf3efb8-c273-4b7d-a11e-ccc24c406067 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:00.494147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abf3efb8-c273-4b7d-a11e-ccc24c406067 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:00.494878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abf3efb8-c273-4b7d-a11e-ccc24c406067 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:00.495399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abf3efb8-c273-4b7d-a11e-ccc24c406067 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:00.495797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abf3efb8-c273-4b7d-a11e-ccc24c406067 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:00.626763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-abf3efb8-c273-4b7d-a11e-ccc24c406067 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:00.634605 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-abf3efb8-c273-4b7d-a11e-ccc24c406067 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.153382 Oct 11 05:23:00.635178 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3908/7583] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:00 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:01.659041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-646d7593-6419-400d-a5ea-dd67ffc672d2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:01.659666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-646d7593-6419-400d-a5ea-dd67ffc672d2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:01.666367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-646d7593-6419-400d-a5ea-dd67ffc672d2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:01.666855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-646d7593-6419-400d-a5ea-dd67ffc672d2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:01.667432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-646d7593-6419-400d-a5ea-dd67ffc672d2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:01.668138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-646d7593-6419-400d-a5ea-dd67ffc672d2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:01.668636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-646d7593-6419-400d-a5ea-dd67ffc672d2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:01.669024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-646d7593-6419-400d-a5ea-dd67ffc672d2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:01.797765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-646d7593-6419-400d-a5ea-dd67ffc672d2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:01.805596 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-646d7593-6419-400d-a5ea-dd67ffc672d2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1655 microversion: 2.1 time: 0.150517 Oct 11 05:23:01.806158 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3676/7584] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:01 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1655 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:01.828539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:23:01.830828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:01.838344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:01.838841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:01.839291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:01.839985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:01.840446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:01.840879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:01.867766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:01.872977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Old instance type m1.heat2, new instance type m1.heat {{(pid=120994) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 05:23:01.879843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:23:01.880279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:23:01.880764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:23:01.881183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:23:01.881603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:23:02.078561 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-147b9914-1112-4f27-ab8c-4cb460e7b731 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1/action" status: 202 len: 0 microversion: 2.1 time: 0.253860 Oct 11 05:23:02.084083 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3909/7585] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:23:01 2022] POST /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 05:23:02.087331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8ab062b4-24b6-4db9-b013-e87f8c2b3a3b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:02.087950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8ab062b4-24b6-4db9-b013-e87f8c2b3a3b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:02.096753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ab062b4-24b6-4db9-b013-e87f8c2b3a3b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:02.097251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ab062b4-24b6-4db9-b013-e87f8c2b3a3b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:02.097720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ab062b4-24b6-4db9-b013-e87f8c2b3a3b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:02.098458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ab062b4-24b6-4db9-b013-e87f8c2b3a3b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:02.098916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ab062b4-24b6-4db9-b013-e87f8c2b3a3b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:02.099342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8ab062b4-24b6-4db9-b013-e87f8c2b3a3b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:02.228883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8ab062b4-24b6-4db9-b013-e87f8c2b3a3b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:02.236634 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8ab062b4-24b6-4db9-b013-e87f8c2b3a3b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.153106 Oct 11 05:23:02.241779 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3677/7586] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:02 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:23:03.262040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae097f3e-9cdf-4a86-bf6c-0e12867c9016 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:03.262696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae097f3e-9cdf-4a86-bf6c-0e12867c9016 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:03.269784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae097f3e-9cdf-4a86-bf6c-0e12867c9016 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:03.270314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae097f3e-9cdf-4a86-bf6c-0e12867c9016 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:03.270760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae097f3e-9cdf-4a86-bf6c-0e12867c9016 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:03.271459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae097f3e-9cdf-4a86-bf6c-0e12867c9016 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:03.271923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae097f3e-9cdf-4a86-bf6c-0e12867c9016 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:03.272363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae097f3e-9cdf-4a86-bf6c-0e12867c9016 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:03.408171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae097f3e-9cdf-4a86-bf6c-0e12867c9016 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:03.416147 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae097f3e-9cdf-4a86-bf6c-0e12867c9016 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.158862 Oct 11 05:23:03.416716 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3910/7587] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:03 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:04.439681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-99602b47-b4ef-4dde-b6d0-b60ab844c0c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:04.440231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-99602b47-b4ef-4dde-b6d0-b60ab844c0c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:04.446679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99602b47-b4ef-4dde-b6d0-b60ab844c0c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:04.447146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99602b47-b4ef-4dde-b6d0-b60ab844c0c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:04.447580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99602b47-b4ef-4dde-b6d0-b60ab844c0c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:04.448266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99602b47-b4ef-4dde-b6d0-b60ab844c0c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:04.448713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99602b47-b4ef-4dde-b6d0-b60ab844c0c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:04.449131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99602b47-b4ef-4dde-b6d0-b60ab844c0c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:04.584302 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-99602b47-b4ef-4dde-b6d0-b60ab844c0c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:04.592256 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-99602b47-b4ef-4dde-b6d0-b60ab844c0c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1678 microversion: 2.1 time: 0.156693 Oct 11 05:23:04.592830 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3678/7588] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:04 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1678 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:05.616633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c50f3471-1c48-4393-9102-65731cd073ab tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:05.617264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c50f3471-1c48-4393-9102-65731cd073ab tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:05.624251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c50f3471-1c48-4393-9102-65731cd073ab tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:05.624752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c50f3471-1c48-4393-9102-65731cd073ab tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:05.625200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c50f3471-1c48-4393-9102-65731cd073ab tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:05.625940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c50f3471-1c48-4393-9102-65731cd073ab tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:05.626430 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c50f3471-1c48-4393-9102-65731cd073ab tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:05.626871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c50f3471-1c48-4393-9102-65731cd073ab tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:05.759643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c50f3471-1c48-4393-9102-65731cd073ab tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:05.767612 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c50f3471-1c48-4393-9102-65731cd073ab tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1683 microversion: 2.1 time: 0.155770 Oct 11 05:23:05.768175 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3911/7589] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:05 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:23:06.792143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7e44a8d0-5841-46a9-aa6f-baa67c611d4b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:06.792684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7e44a8d0-5841-46a9-aa6f-baa67c611d4b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:06.799625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e44a8d0-5841-46a9-aa6f-baa67c611d4b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:06.800113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e44a8d0-5841-46a9-aa6f-baa67c611d4b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:06.800567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e44a8d0-5841-46a9-aa6f-baa67c611d4b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:06.801249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e44a8d0-5841-46a9-aa6f-baa67c611d4b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:06.801699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e44a8d0-5841-46a9-aa6f-baa67c611d4b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:06.802122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7e44a8d0-5841-46a9-aa6f-baa67c611d4b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:06.933166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7e44a8d0-5841-46a9-aa6f-baa67c611d4b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:06.940912 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7e44a8d0-5841-46a9-aa6f-baa67c611d4b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1683 microversion: 2.1 time: 0.153271 Oct 11 05:23:06.941483 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3679/7590] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:06 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:07.964552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-09e70b4c-e42a-48dd-955e-bace103d9803 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:07.965317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-09e70b4c-e42a-48dd-955e-bace103d9803 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:07.972279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09e70b4c-e42a-48dd-955e-bace103d9803 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:07.972859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09e70b4c-e42a-48dd-955e-bace103d9803 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:07.973389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09e70b4c-e42a-48dd-955e-bace103d9803 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:07.974284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09e70b4c-e42a-48dd-955e-bace103d9803 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:07.974761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09e70b4c-e42a-48dd-955e-bace103d9803 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:07.975208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-09e70b4c-e42a-48dd-955e-bace103d9803 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:08.144682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-9e7b9f09-b255-4bb9-b06c-68248d5c5583 req-95afce07-9837-4e11-ba9f-6adeab47f0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59a4d22-42f0-41a6-ab35-ba032a6510d1", "name": "network-vif-unplugged", "status": "completed", "tag": "44d69afc-787a-4e9a-8340-e311753c91e8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:23:08.151062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-09e70b4c-e42a-48dd-955e-bace103d9803 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:08.154702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9e7b9f09-b255-4bb9-b06c-68248d5c5583 req-95afce07-9837-4e11-ba9f-6adeab47f0aa service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:08.169614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9e7b9f09-b255-4bb9-b06c-68248d5c5583 req-95afce07-9837-4e11-ba9f-6adeab47f0aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:08.169614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9e7b9f09-b255-4bb9-b06c-68248d5c5583 req-95afce07-9837-4e11-ba9f-6adeab47f0aa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:08.170045 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-09e70b4c-e42a-48dd-955e-bace103d9803 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1682 microversion: 2.1 time: 0.198894 Oct 11 05:23:08.170045 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3912/7591] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:07 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1682 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:08.170255 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-9e7b9f09-b255-4bb9-b06c-68248d5c5583 req-95afce07-9837-4e11-ba9f-6adeab47f0aa service nova] Creating event network-vif-unplugged:44d69afc-787a-4e9a-8340-e311753c91e8 for instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 on n-h2-860892-1 Oct 11 05:23:08.173245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-9e7b9f09-b255-4bb9-b06c-68248d5c5583 req-95afce07-9837-4e11-ba9f-6adeab47f0aa service nova] Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:23:08.185325 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-9e7b9f09-b255-4bb9-b06c-68248d5c5583 req-95afce07-9837-4e11-ba9f-6adeab47f0aa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.101110 Oct 11 05:23:08.185920 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3680/7592] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:23:09.183593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c11e04d-c5a0-4812-af7b-bf0b50a28ffc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:09.184220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6c11e04d-c5a0-4812-af7b-bf0b50a28ffc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:09.191045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c11e04d-c5a0-4812-af7b-bf0b50a28ffc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:09.191538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c11e04d-c5a0-4812-af7b-bf0b50a28ffc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:09.191986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c11e04d-c5a0-4812-af7b-bf0b50a28ffc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:09.192712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c11e04d-c5a0-4812-af7b-bf0b50a28ffc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:09.193175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c11e04d-c5a0-4812-af7b-bf0b50a28ffc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:09.193612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c11e04d-c5a0-4812-af7b-bf0b50a28ffc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:09.328942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6c11e04d-c5a0-4812-af7b-bf0b50a28ffc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:09.337579 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6c11e04d-c5a0-4812-af7b-bf0b50a28ffc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1682 microversion: 2.1 time: 0.157869 Oct 11 05:23:09.338159 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3913/7593] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:09 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:10.200687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2ebf7d88-ab58-4ee5-bfe0-e89d5217782e req-bed3b0cd-db6e-43c4-b76c-e247d6aec870 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a59a4d22-42f0-41a6-ab35-ba032a6510d1", "tag": "44d69afc-787a-4e9a-8340-e311753c91e8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:23:10.211709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2ebf7d88-ab58-4ee5-bfe0-e89d5217782e req-bed3b0cd-db6e-43c4-b76c-e247d6aec870 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:10.212177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2ebf7d88-ab58-4ee5-bfe0-e89d5217782e req-bed3b0cd-db6e-43c4-b76c-e247d6aec870 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:10.212601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2ebf7d88-ab58-4ee5-bfe0-e89d5217782e req-bed3b0cd-db6e-43c4-b76c-e247d6aec870 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:10.224073 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2ebf7d88-ab58-4ee5-bfe0-e89d5217782e req-bed3b0cd-db6e-43c4-b76c-e247d6aec870 service nova] Creating event network-changed:44d69afc-787a-4e9a-8340-e311753c91e8 for instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 on n-h2-860892-1 Oct 11 05:23:10.229877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-2ebf7d88-ab58-4ee5-bfe0-e89d5217782e req-bed3b0cd-db6e-43c4-b76c-e247d6aec870 service nova] Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:23:10.240556 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2ebf7d88-ab58-4ee5-bfe0-e89d5217782e req-bed3b0cd-db6e-43c4-b76c-e247d6aec870 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043975 Oct 11 05:23:10.241123 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3681/7594] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:23:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:23:10.361494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c1637c86-39e1-4532-902e-f68637992292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:10.362148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c1637c86-39e1-4532-902e-f68637992292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:10.368996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1637c86-39e1-4532-902e-f68637992292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:10.369494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1637c86-39e1-4532-902e-f68637992292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:10.369953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1637c86-39e1-4532-902e-f68637992292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:10.370695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1637c86-39e1-4532-902e-f68637992292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:10.371165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1637c86-39e1-4532-902e-f68637992292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:10.371604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1637c86-39e1-4532-902e-f68637992292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:10.589096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c1637c86-39e1-4532-902e-f68637992292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:10.597461 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c1637c86-39e1-4532-902e-f68637992292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1680 microversion: 2.1 time: 0.239851 Oct 11 05:23:10.599832 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3914/7595] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:10 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1680 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:11.621678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-688894cd-4153-48f7-b4d2-9b3ed613c7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:11.622411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-688894cd-4153-48f7-b4d2-9b3ed613c7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:11.629428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-688894cd-4153-48f7-b4d2-9b3ed613c7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:11.629911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-688894cd-4153-48f7-b4d2-9b3ed613c7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:11.630383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-688894cd-4153-48f7-b4d2-9b3ed613c7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:11.631081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-688894cd-4153-48f7-b4d2-9b3ed613c7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:11.631540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-688894cd-4153-48f7-b4d2-9b3ed613c7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:11.631970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-688894cd-4153-48f7-b4d2-9b3ed613c7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:11.764845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-688894cd-4153-48f7-b4d2-9b3ed613c7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:11.772944 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-688894cd-4153-48f7-b4d2-9b3ed613c7b4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1676 microversion: 2.1 time: 0.155479 Oct 11 05:23:11.773462 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3682/7596] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:11 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:11.795463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aba1e4bb-f806-4575-9865-46f8a1f7880b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:23:11.796016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aba1e4bb-f806-4575-9865-46f8a1f7880b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:11.802944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba1e4bb-f806-4575-9865-46f8a1f7880b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:11.803448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba1e4bb-f806-4575-9865-46f8a1f7880b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:11.803903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba1e4bb-f806-4575-9865-46f8a1f7880b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:11.805148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba1e4bb-f806-4575-9865-46f8a1f7880b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:11.805619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba1e4bb-f806-4575-9865-46f8a1f7880b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:11.806062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba1e4bb-f806-4575-9865-46f8a1f7880b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:12.046257 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aba1e4bb-f806-4575-9865-46f8a1f7880b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1/action" status: 204 len: 0 microversion: 2.1 time: 0.254415 Oct 11 05:23:12.046836 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3915/7597] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:23:11 2022] POST /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1/action => generated 0 bytes in 256 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:23:12.056039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e140c042-21df-4a47-9a6e-d0cddf69572f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:12.056818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e140c042-21df-4a47-9a6e-d0cddf69572f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:12.063488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e140c042-21df-4a47-9a6e-d0cddf69572f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:12.064027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e140c042-21df-4a47-9a6e-d0cddf69572f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:12.064487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e140c042-21df-4a47-9a6e-d0cddf69572f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:12.065210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e140c042-21df-4a47-9a6e-d0cddf69572f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:12.065659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e140c042-21df-4a47-9a6e-d0cddf69572f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:12.066082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e140c042-21df-4a47-9a6e-d0cddf69572f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:12.196551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e140c042-21df-4a47-9a6e-d0cddf69572f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:12.204430 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e140c042-21df-4a47-9a6e-d0cddf69572f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1676 microversion: 2.1 time: 0.153357 Oct 11 05:23:12.205004 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3683/7598] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:12 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:13.228781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30e20a70-5cd7-43da-8c2e-d417c7488946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:13.229496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30e20a70-5cd7-43da-8c2e-d417c7488946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:13.236656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30e20a70-5cd7-43da-8c2e-d417c7488946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:13.237177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30e20a70-5cd7-43da-8c2e-d417c7488946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:13.237628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30e20a70-5cd7-43da-8c2e-d417c7488946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:13.238444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30e20a70-5cd7-43da-8c2e-d417c7488946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:13.238908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30e20a70-5cd7-43da-8c2e-d417c7488946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:13.239349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30e20a70-5cd7-43da-8c2e-d417c7488946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:13.380176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30e20a70-5cd7-43da-8c2e-d417c7488946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:13.387917 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30e20a70-5cd7-43da-8c2e-d417c7488946 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1676 microversion: 2.1 time: 0.164240 Oct 11 05:23:13.388485 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3916/7599] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:13 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1676 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:14.412503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aa5ff599-f953-4338-9a1f-55fae3277350 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:14.413136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aa5ff599-f953-4338-9a1f-55fae3277350 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:14.420559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5ff599-f953-4338-9a1f-55fae3277350 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:14.421085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5ff599-f953-4338-9a1f-55fae3277350 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:14.421523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5ff599-f953-4338-9a1f-55fae3277350 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:14.422219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5ff599-f953-4338-9a1f-55fae3277350 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:14.422676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5ff599-f953-4338-9a1f-55fae3277350 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:14.423101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aa5ff599-f953-4338-9a1f-55fae3277350 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:14.556510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aa5ff599-f953-4338-9a1f-55fae3277350 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:14.564757 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aa5ff599-f953-4338-9a1f-55fae3277350 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1655 microversion: 2.1 time: 0.156210 Oct 11 05:23:14.565351 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3684/7600] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:14 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1655 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:14.587296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c286bbcd-70e1-420b-929b-76123248f7c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:14.587926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c286bbcd-70e1-420b-929b-76123248f7c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:14.594740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c286bbcd-70e1-420b-929b-76123248f7c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:14.595230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c286bbcd-70e1-420b-929b-76123248f7c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:14.595675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c286bbcd-70e1-420b-929b-76123248f7c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:14.596376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c286bbcd-70e1-420b-929b-76123248f7c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:14.596841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c286bbcd-70e1-420b-929b-76123248f7c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:14.597279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c286bbcd-70e1-420b-929b-76123248f7c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:14.734731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c286bbcd-70e1-420b-929b-76123248f7c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:14.743075 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c286bbcd-70e1-420b-929b-76123248f7c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1655 microversion: 2.1 time: 0.159793 Oct 11 05:23:14.743724 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3917/7601] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:14 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:14.766271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-613aa682-2a39-4038-aab0-d8fef896e75e req-35f08005-cf13-41b2-8b36-1fe7f6c81552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59a4d22-42f0-41a6-ab35-ba032a6510d1", "name": "network-vif-plugged", "status": "completed", "tag": "44d69afc-787a-4e9a-8340-e311753c91e8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:23:14.767107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-601ff910-6134-4748-9e71-13e3fd4605d3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:23:14.774943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-601ff910-6134-4748-9e71-13e3fd4605d3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:14.775489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-601ff910-6134-4748-9e71-13e3fd4605d3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:14.775866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-613aa682-2a39-4038-aab0-d8fef896e75e req-35f08005-cf13-41b2-8b36-1fe7f6c81552 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:14.775980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-601ff910-6134-4748-9e71-13e3fd4605d3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:14.776347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-613aa682-2a39-4038-aab0-d8fef896e75e req-35f08005-cf13-41b2-8b36-1fe7f6c81552 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:14.776777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-613aa682-2a39-4038-aab0-d8fef896e75e req-35f08005-cf13-41b2-8b36-1fe7f6c81552 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:14.779623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:23:14.788020 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-613aa682-2a39-4038-aab0-d8fef896e75e req-35f08005-cf13-41b2-8b36-1fe7f6c81552 service nova] Creating event network-vif-plugged:44d69afc-787a-4e9a-8340-e311753c91e8 for instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 on n-h2-860892-1 Oct 11 05:23:14.793845 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-613aa682-2a39-4038-aab0-d8fef896e75e req-35f08005-cf13-41b2-8b36-1fe7f6c81552 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033511 Oct 11 05:23:14.794499 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3685/7602] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:23:14.799698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-601ff910-6134-4748-9e71-13e3fd4605d3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Going to try to start instance {{(pid=120994) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 05:23:15.015502 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-601ff910-6134-4748-9e71-13e3fd4605d3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1/action" status: 202 len: 0 microversion: 2.1 time: 0.252393 Oct 11 05:23:15.016488 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3918/7603] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:23:14 2022] POST /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1/action => generated 0 bytes in 255 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:23:15.026985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-84e7a360-e309-4a55-9575-515ecbac3dbd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:15.028208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-84e7a360-e309-4a55-9575-515ecbac3dbd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:15.034882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84e7a360-e309-4a55-9575-515ecbac3dbd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:15.040477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84e7a360-e309-4a55-9575-515ecbac3dbd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:15.040477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84e7a360-e309-4a55-9575-515ecbac3dbd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:15.040477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84e7a360-e309-4a55-9575-515ecbac3dbd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:15.040477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84e7a360-e309-4a55-9575-515ecbac3dbd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:15.040477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-84e7a360-e309-4a55-9575-515ecbac3dbd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:15.171620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-84e7a360-e309-4a55-9575-515ecbac3dbd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:15.180678 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-84e7a360-e309-4a55-9575-515ecbac3dbd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1664 microversion: 2.1 time: 0.159968 Oct 11 05:23:15.181345 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3686/7604] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:15 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1664 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:23:16.206564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d44d826a-1a9f-4116-915d-769515e77393 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:16.219178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d44d826a-1a9f-4116-915d-769515e77393 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:16.219178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d44d826a-1a9f-4116-915d-769515e77393 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:16.219178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d44d826a-1a9f-4116-915d-769515e77393 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:16.219178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d44d826a-1a9f-4116-915d-769515e77393 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:16.219178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d44d826a-1a9f-4116-915d-769515e77393 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:16.219178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d44d826a-1a9f-4116-915d-769515e77393 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:16.219178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d44d826a-1a9f-4116-915d-769515e77393 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:16.349015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d44d826a-1a9f-4116-915d-769515e77393 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:16.357341 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d44d826a-1a9f-4116-915d-769515e77393 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1664 microversion: 2.1 time: 0.156064 Oct 11 05:23:16.357920 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3919/7605] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:16 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1664 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:17.380791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f58363e3-1771-49ca-8277-55ed3283a7ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:17.381379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f58363e3-1771-49ca-8277-55ed3283a7ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:17.388667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58363e3-1771-49ca-8277-55ed3283a7ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:17.389154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58363e3-1771-49ca-8277-55ed3283a7ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:17.389569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58363e3-1771-49ca-8277-55ed3283a7ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:17.390587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58363e3-1771-49ca-8277-55ed3283a7ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:17.391034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58363e3-1771-49ca-8277-55ed3283a7ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:17.391455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f58363e3-1771-49ca-8277-55ed3283a7ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:17.519758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f58363e3-1771-49ca-8277-55ed3283a7ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:17.524016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:23:17.528640 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f58363e3-1771-49ca-8277-55ed3283a7ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1668 microversion: 2.1 time: 0.151800 Oct 11 05:23:17.529215 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3687/7606] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:17 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:23:17.554241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-59324bd6-5ce1-47a9-9008-cd386cec480d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:17.554760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-59324bd6-5ce1-47a9-9008-cd386cec480d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:17.561498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59324bd6-5ce1-47a9-9008-cd386cec480d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:17.561990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59324bd6-5ce1-47a9-9008-cd386cec480d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:17.562467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59324bd6-5ce1-47a9-9008-cd386cec480d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:17.563169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59324bd6-5ce1-47a9-9008-cd386cec480d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:17.563632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59324bd6-5ce1-47a9-9008-cd386cec480d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:17.564071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-59324bd6-5ce1-47a9-9008-cd386cec480d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:17.589494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-59324bd6-5ce1-47a9-9008-cd386cec480d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:23:17.886200 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-59324bd6-5ce1-47a9-9008-cd386cec480d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 204 len: 0 microversion: 2.1 time: 0.335551 Oct 11 05:23:17.886825 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3920/7607] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:23:17 2022] DELETE /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:23:17.895348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ac05d5ba-545f-4649-a048-227d544572cb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:17.895958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ac05d5ba-545f-4649-a048-227d544572cb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:17.902566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac05d5ba-545f-4649-a048-227d544572cb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:17.903045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac05d5ba-545f-4649-a048-227d544572cb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:17.903480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac05d5ba-545f-4649-a048-227d544572cb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:17.904166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac05d5ba-545f-4649-a048-227d544572cb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:17.904615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac05d5ba-545f-4649-a048-227d544572cb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:17.905039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ac05d5ba-545f-4649-a048-227d544572cb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:18.039006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ac05d5ba-545f-4649-a048-227d544572cb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:18.046695 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ac05d5ba-545f-4649-a048-227d544572cb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1674 microversion: 2.1 time: 0.155236 Oct 11 05:23:18.047265 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3688/7608] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:17 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:23:19.071750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9b95fd0-20f2-481b-8fbd-7151fa0fa54e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:19.072486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e9b95fd0-20f2-481b-8fbd-7151fa0fa54e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:19.079286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9b95fd0-20f2-481b-8fbd-7151fa0fa54e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:19.079782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9b95fd0-20f2-481b-8fbd-7151fa0fa54e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:19.080232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9b95fd0-20f2-481b-8fbd-7151fa0fa54e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:19.080939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9b95fd0-20f2-481b-8fbd-7151fa0fa54e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:19.081400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9b95fd0-20f2-481b-8fbd-7151fa0fa54e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:19.081834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9b95fd0-20f2-481b-8fbd-7151fa0fa54e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:19.247294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e9b95fd0-20f2-481b-8fbd-7151fa0fa54e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:19.255039 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e9b95fd0-20f2-481b-8fbd-7151fa0fa54e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1674 microversion: 2.1 time: 0.188135 Oct 11 05:23:19.255661 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3921/7609] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:19 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1674 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:20.113729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-0f4a0930-cb0b-43b6-9022-e6c34ed11d05 req-c55de26b-6478-4bcb-be99-5c5139a72fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a59a4d22-42f0-41a6-ab35-ba032a6510d1", "name": "network-vif-deleted", "tag": "44d69afc-787a-4e9a-8340-e311753c91e8"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:23:20.124436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0f4a0930-cb0b-43b6-9022-e6c34ed11d05 req-c55de26b-6478-4bcb-be99-5c5139a72fd9 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:20.124913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0f4a0930-cb0b-43b6-9022-e6c34ed11d05 req-c55de26b-6478-4bcb-be99-5c5139a72fd9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:20.125341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0f4a0930-cb0b-43b6-9022-e6c34ed11d05 req-c55de26b-6478-4bcb-be99-5c5139a72fd9 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:20.137269 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-0f4a0930-cb0b-43b6-9022-e6c34ed11d05 req-c55de26b-6478-4bcb-be99-5c5139a72fd9 service nova] Creating event network-vif-deleted:44d69afc-787a-4e9a-8340-e311753c91e8 for instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 on n-h2-860892-1 Oct 11 05:23:20.142592 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-0f4a0930-cb0b-43b6-9022-e6c34ed11d05 req-c55de26b-6478-4bcb-be99-5c5139a72fd9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032415 Oct 11 05:23:20.143188 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3689/7610] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:23:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:23:20.280066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f419ccc2-2176-4c0a-81ba-5b48e470fe87 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:20.280780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f419ccc2-2176-4c0a-81ba-5b48e470fe87 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:20.287223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f419ccc2-2176-4c0a-81ba-5b48e470fe87 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:20.287825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f419ccc2-2176-4c0a-81ba-5b48e470fe87 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:20.288339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f419ccc2-2176-4c0a-81ba-5b48e470fe87 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:20.289145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f419ccc2-2176-4c0a-81ba-5b48e470fe87 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:20.289663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f419ccc2-2176-4c0a-81ba-5b48e470fe87 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:20.290177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f419ccc2-2176-4c0a-81ba-5b48e470fe87 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:20.360530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f419ccc2-2176-4c0a-81ba-5b48e470fe87 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:20.369050 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f419ccc2-2176-4c0a-81ba-5b48e470fe87 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 200 len: 1322 microversion: 2.1 time: 0.092995 Oct 11 05:23:20.381980 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3922/7611] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:20 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 1322 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:21.393352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:21.393975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:21.396019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=39 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:23:21.400915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:21.401543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:21.401813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:21.402562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:21.403020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:21.403445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:21.416674 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 HTTP/1.1 Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'a59a4d22-42f0-41a6-ab35-ba032a6510d1'} Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:23:21.418339 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:23:21.425379 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:23:21.425379 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:23:21.425379 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:23:21.425379 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:23:21.425379 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:23:21.425379 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:23:21.425379 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:23:21.425379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:23:21.425379 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ab53faa-6799-4cc4-b280-3e126176362f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 404 len: 111 microversion: 2.1 time: 0.031917 Oct 11 05:23:21.425379 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3690/7612] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:21 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:23:21.437692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:21.438372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:21.445407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:21.449492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:21.449492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:21.449492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:21.449492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:21.449492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:21.462224 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 HTTP/1.1 Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'a59a4d22-42f0-41a6-ab35-ba032a6510d1'} Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:23:21.463892 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:23:21.468228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:23:21.468228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:23:21.468228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:23:21.468228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:23:21.468228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:23:21.468228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:23:21.468228 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:23:21.468228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:23:21.468228 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-da28e0ff-152b-44b2-9f0f-bb7f1632e41d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 404 len: 111 microversion: 2.1 time: 0.031533 Oct 11 05:23:21.468228 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3923/7613] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:21 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:23:21.513897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1232067739", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "142a49fe-d230-4475-878e-8be16d147ec7"}], "security_groups": [{"name": "tempest-securitygroup--574193408"}], "key_name": "tempest-keypair-441167700", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:23:21.615992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] validate_networks() for [('142a49fe-d230-4475-878e-8be16d147ec7', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:23:22.032930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:23:22.033349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:23:22.033848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:23:22.034284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:23:22.034722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:23:22.043906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:22.044376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:22.044802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:22.045510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:22.045959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:22.046411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:22.063562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:23:22.068720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for user fc7f4b98dd3c48a8ad4418a3d73f5cb6 and project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:23:22.080959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:23:22.083317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:23:22.231544 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6dab253d-ced5-4411-86a4-3baaf8a11c8e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.721460 Oct 11 05:23:22.232193 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3691/7614] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:23:21 2022] POST /compute/v2.1/servers => generated 405 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:23:22.243409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8c98ed4d-e6b8-4824-9f15-53cb705acd13 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:22.244035 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8c98ed4d-e6b8-4824-9f15-53cb705acd13 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:22.300320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8c98ed4d-e6b8-4824-9f15-53cb705acd13 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:22.307175 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8c98ed4d-e6b8-4824-9f15-53cb705acd13 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1238 microversion: 2.1 time: 0.067638 Oct 11 05:23:22.307742 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3924/7615] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:22 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:23.330616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-65a8af1f-99e2-4d7d-a4eb-888ec7254f09 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:23.331227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-65a8af1f-99e2-4d7d-a4eb-888ec7254f09 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:23.338936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65a8af1f-99e2-4d7d-a4eb-888ec7254f09 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:23.339414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65a8af1f-99e2-4d7d-a4eb-888ec7254f09 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:23.339847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65a8af1f-99e2-4d7d-a4eb-888ec7254f09 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:23.340581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65a8af1f-99e2-4d7d-a4eb-888ec7254f09 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:23.341057 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65a8af1f-99e2-4d7d-a4eb-888ec7254f09 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:23.341497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65a8af1f-99e2-4d7d-a4eb-888ec7254f09 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:23.402808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-65a8af1f-99e2-4d7d-a4eb-888ec7254f09 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:23.410534 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-65a8af1f-99e2-4d7d-a4eb-888ec7254f09 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1242 microversion: 2.1 time: 0.083787 Oct 11 05:23:23.411096 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3692/7616] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:23 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1242 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:24.436290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32ffcf77-1463-4db6-9f00-75169c3c3ed1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:24.437005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-32ffcf77-1463-4db6-9f00-75169c3c3ed1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:24.439878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:23:24.445507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ffcf77-1463-4db6-9f00-75169c3c3ed1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:24.452107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ffcf77-1463-4db6-9f00-75169c3c3ed1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:24.452107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ffcf77-1463-4db6-9f00-75169c3c3ed1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:24.452107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ffcf77-1463-4db6-9f00-75169c3c3ed1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:24.452107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ffcf77-1463-4db6-9f00-75169c3c3ed1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:24.452107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32ffcf77-1463-4db6-9f00-75169c3c3ed1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:24.510986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-32ffcf77-1463-4db6-9f00-75169c3c3ed1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:24.523526 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-32ffcf77-1463-4db6-9f00-75169c3c3ed1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1296 microversion: 2.1 time: 0.091126 Oct 11 05:23:24.524125 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3925/7617] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:24 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1296 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:25.549135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8802daa1-775c-449b-b69a-890c11f18c31 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:25.550638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8802daa1-775c-449b-b69a-890c11f18c31 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:25.558156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8802daa1-775c-449b-b69a-890c11f18c31 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:25.558692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8802daa1-775c-449b-b69a-890c11f18c31 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:25.559120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8802daa1-775c-449b-b69a-890c11f18c31 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:25.559814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8802daa1-775c-449b-b69a-890c11f18c31 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:25.560292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8802daa1-775c-449b-b69a-890c11f18c31 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:25.560714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8802daa1-775c-449b-b69a-890c11f18c31 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:25.698642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8802daa1-775c-449b-b69a-890c11f18c31 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:25.706307 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8802daa1-775c-449b-b69a-890c11f18c31 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1363 microversion: 2.1 time: 0.161989 Oct 11 05:23:25.706875 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3693/7618] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:25 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:25.897108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e5dba31c-3e9d-44fe-888a-3661090ba16e req-9a305c50-6c28-40e2-adbd-8367ca2d1966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734d0d19-4ea1-41ba-a154-dae25d0b4d16", "tag": "99a76713-8bce-4433-acb4-bf1fee7b681f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:23:25.908619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e5dba31c-3e9d-44fe-888a-3661090ba16e req-9a305c50-6c28-40e2-adbd-8367ca2d1966 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:25.909044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e5dba31c-3e9d-44fe-888a-3661090ba16e req-9a305c50-6c28-40e2-adbd-8367ca2d1966 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:25.909492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e5dba31c-3e9d-44fe-888a-3661090ba16e req-9a305c50-6c28-40e2-adbd-8367ca2d1966 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:25.921379 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e5dba31c-3e9d-44fe-888a-3661090ba16e req-9a305c50-6c28-40e2-adbd-8367ca2d1966 service nova] Creating event network-changed:99a76713-8bce-4433-acb4-bf1fee7b681f for instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 on n-h1-860892-1 Oct 11 05:23:25.926219 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e5dba31c-3e9d-44fe-888a-3661090ba16e req-9a305c50-6c28-40e2-adbd-8367ca2d1966 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032839 Oct 11 05:23:25.926837 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3926/7619] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:23:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:23:26.728867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c945d624-dbd8-4cf0-8320-4b388693e05d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:26.729471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c945d624-dbd8-4cf0-8320-4b388693e05d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:26.736304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c945d624-dbd8-4cf0-8320-4b388693e05d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:26.736909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c945d624-dbd8-4cf0-8320-4b388693e05d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:26.737344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c945d624-dbd8-4cf0-8320-4b388693e05d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:26.738023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c945d624-dbd8-4cf0-8320-4b388693e05d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:26.738502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c945d624-dbd8-4cf0-8320-4b388693e05d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:26.738926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c945d624-dbd8-4cf0-8320-4b388693e05d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:26.873423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c945d624-dbd8-4cf0-8320-4b388693e05d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:26.881015 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c945d624-dbd8-4cf0-8320-4b388693e05d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1363 microversion: 2.1 time: 0.155998 Oct 11 05:23:26.881593 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3694/7620] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:26 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:27.907604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-893f63da-289c-4412-8b23-83e42b4d413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:27.908326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-893f63da-289c-4412-8b23-83e42b4d413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:27.914608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-893f63da-289c-4412-8b23-83e42b4d413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:27.915113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-893f63da-289c-4412-8b23-83e42b4d413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:27.915573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-893f63da-289c-4412-8b23-83e42b4d413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:27.916283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-893f63da-289c-4412-8b23-83e42b4d413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:27.916794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-893f63da-289c-4412-8b23-83e42b4d413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:27.917242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-893f63da-289c-4412-8b23-83e42b4d413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:28.045429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-893f63da-289c-4412-8b23-83e42b4d413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:28.053052 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-893f63da-289c-4412-8b23-83e42b4d413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1363 microversion: 2.1 time: 0.151034 Oct 11 05:23:28.053614 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3927/7621] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:27 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:29.076178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4d45e4e9-24c8-4f1e-b9ee-cce37eefe33e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:29.076815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4d45e4e9-24c8-4f1e-b9ee-cce37eefe33e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:29.083691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d45e4e9-24c8-4f1e-b9ee-cce37eefe33e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:29.084165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d45e4e9-24c8-4f1e-b9ee-cce37eefe33e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:29.084593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d45e4e9-24c8-4f1e-b9ee-cce37eefe33e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:29.085271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d45e4e9-24c8-4f1e-b9ee-cce37eefe33e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:29.085715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d45e4e9-24c8-4f1e-b9ee-cce37eefe33e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:29.086648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4d45e4e9-24c8-4f1e-b9ee-cce37eefe33e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:29.216507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4d45e4e9-24c8-4f1e-b9ee-cce37eefe33e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:29.224172 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4d45e4e9-24c8-4f1e-b9ee-cce37eefe33e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1363 microversion: 2.1 time: 0.151856 Oct 11 05:23:29.224740 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3695/7622] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:29 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:30.248084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6a2cc124-0477-4f31-984a-bbf61de3dfa3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:30.248714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6a2cc124-0477-4f31-984a-bbf61de3dfa3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:30.255664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a2cc124-0477-4f31-984a-bbf61de3dfa3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:30.256164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a2cc124-0477-4f31-984a-bbf61de3dfa3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:30.256619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a2cc124-0477-4f31-984a-bbf61de3dfa3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:30.257320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a2cc124-0477-4f31-984a-bbf61de3dfa3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:30.257791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a2cc124-0477-4f31-984a-bbf61de3dfa3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:30.258767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6a2cc124-0477-4f31-984a-bbf61de3dfa3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:30.394224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6a2cc124-0477-4f31-984a-bbf61de3dfa3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:30.402157 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6a2cc124-0477-4f31-984a-bbf61de3dfa3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1363 microversion: 2.1 time: 0.158041 Oct 11 05:23:30.402761 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3928/7623] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:30 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:31.424945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5bd7d656-a48d-486e-8161-36b3b65ef8ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:31.425561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5bd7d656-a48d-486e-8161-36b3b65ef8ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:31.432397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-a48d-486e-8161-36b3b65ef8ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:31.432879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-a48d-486e-8161-36b3b65ef8ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:31.433320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-a48d-486e-8161-36b3b65ef8ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:31.434012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-a48d-486e-8161-36b3b65ef8ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:31.434493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-a48d-486e-8161-36b3b65ef8ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:31.434925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5bd7d656-a48d-486e-8161-36b3b65ef8ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:31.563188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5bd7d656-a48d-486e-8161-36b3b65ef8ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:31.571504 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5bd7d656-a48d-486e-8161-36b3b65ef8ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1363 microversion: 2.1 time: 0.150525 Oct 11 05:23:31.572068 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3696/7624] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:31 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:32.057816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-351109b4-0523-4870-a43a-d05fccf3a872 req-d38f6282-40d7-4a77-b3ef-fc6a6ff83314 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d0d19-4ea1-41ba-a154-dae25d0b4d16", "name": "network-vif-plugged", "status": "completed", "tag": "99a76713-8bce-4433-acb4-bf1fee7b681f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:23:32.068193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-351109b4-0523-4870-a43a-d05fccf3a872 req-d38f6282-40d7-4a77-b3ef-fc6a6ff83314 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:32.068680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-351109b4-0523-4870-a43a-d05fccf3a872 req-d38f6282-40d7-4a77-b3ef-fc6a6ff83314 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:32.069122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-351109b4-0523-4870-a43a-d05fccf3a872 req-d38f6282-40d7-4a77-b3ef-fc6a6ff83314 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:32.080562 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-351109b4-0523-4870-a43a-d05fccf3a872 req-d38f6282-40d7-4a77-b3ef-fc6a6ff83314 service nova] Creating event network-vif-plugged:99a76713-8bce-4433-acb4-bf1fee7b681f for instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 on n-h1-860892-1 Oct 11 05:23:32.085512 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-351109b4-0523-4870-a43a-d05fccf3a872 req-d38f6282-40d7-4a77-b3ef-fc6a6ff83314 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032063 Oct 11 05:23:32.087806 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3929/7625] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:23:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:23:32.595983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9d11631a-dbd6-4322-a98c-30e6f7e9bd14 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:32.596601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9d11631a-dbd6-4322-a98c-30e6f7e9bd14 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:32.598527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:23:32.599200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:23:32.605238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d11631a-dbd6-4322-a98c-30e6f7e9bd14 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:32.605722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d11631a-dbd6-4322-a98c-30e6f7e9bd14 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:32.606159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d11631a-dbd6-4322-a98c-30e6f7e9bd14 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:32.606870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d11631a-dbd6-4322-a98c-30e6f7e9bd14 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:32.607323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d11631a-dbd6-4322-a98c-30e6f7e9bd14 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:32.613114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d11631a-dbd6-4322-a98c-30e6f7e9bd14 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:32.734247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9d11631a-dbd6-4322-a98c-30e6f7e9bd14 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:32.741908 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9d11631a-dbd6-4322-a98c-30e6f7e9bd14 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1363 microversion: 2.1 time: 0.149828 Oct 11 05:23:32.742512 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3697/7626] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:32 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:33.766128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-abc38f25-ecbd-4819-bf70-baf9e913d149 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:33.766915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-abc38f25-ecbd-4819-bf70-baf9e913d149 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:33.768907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:23:33.775858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abc38f25-ecbd-4819-bf70-baf9e913d149 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:33.775858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abc38f25-ecbd-4819-bf70-baf9e913d149 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:33.775858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abc38f25-ecbd-4819-bf70-baf9e913d149 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:33.776437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abc38f25-ecbd-4819-bf70-baf9e913d149 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:33.776914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abc38f25-ecbd-4819-bf70-baf9e913d149 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:33.777364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-abc38f25-ecbd-4819-bf70-baf9e913d149 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:33.912931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-abc38f25-ecbd-4819-bf70-baf9e913d149 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:23:33.921338 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-abc38f25-ecbd-4819-bf70-baf9e913d149 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1549 microversion: 2.1 time: 0.159973 Oct 11 05:23:33.921935 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3930/7627] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:23:33 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1549 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:23:33.944788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-17735517-6415-4378-8d4d-6e7e68e2eaf0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:23:33.945301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-17735517-6415-4378-8d4d-6e7e68e2eaf0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:23:33.952060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17735517-6415-4378-8d4d-6e7e68e2eaf0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:33.952535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17735517-6415-4378-8d4d-6e7e68e2eaf0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:33.952966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17735517-6415-4378-8d4d-6e7e68e2eaf0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:33.953645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17735517-6415-4378-8d4d-6e7e68e2eaf0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:33.954092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17735517-6415-4378-8d4d-6e7e68e2eaf0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:33.954530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17735517-6415-4378-8d4d-6e7e68e2eaf0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:34.035037 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-17735517-6415-4378-8d4d-6e7e68e2eaf0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094103 Oct 11 05:23:34.035666 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3698/7628] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 05:23:33 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:23:35.357887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f70dca06-a87a-4343-b9a4-1a37d26aa65b req-e675ef42-f2ee-482e-987c-204a853fe3b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734d0d19-4ea1-41ba-a154-dae25d0b4d16", "tag": "99a76713-8bce-4433-acb4-bf1fee7b681f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:23:35.367692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f70dca06-a87a-4343-b9a4-1a37d26aa65b req-e675ef42-f2ee-482e-987c-204a853fe3b6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:23:35.368196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f70dca06-a87a-4343-b9a4-1a37d26aa65b req-e675ef42-f2ee-482e-987c-204a853fe3b6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:23:35.368651 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f70dca06-a87a-4343-b9a4-1a37d26aa65b req-e675ef42-f2ee-482e-987c-204a853fe3b6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:23:35.380407 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-f70dca06-a87a-4343-b9a4-1a37d26aa65b req-e675ef42-f2ee-482e-987c-204a853fe3b6 service nova] Creating event network-changed:99a76713-8bce-4433-acb4-bf1fee7b681f for instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 on n-h1-860892-1 Oct 11 05:23:35.385314 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f70dca06-a87a-4343-b9a4-1a37d26aa65b req-e675ef42-f2ee-482e-987c-204a853fe3b6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085962 Oct 11 05:23:35.385941 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3931/7629] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:23:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:24:47.321550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:24:47.322589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=52 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:24:47.376684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:24:47.379630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:47.386161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:47.387059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:47.387159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:47.387769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:47.388216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:47.388639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:47.417524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:47.423183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Old instance type m1.heat2, new instance type m1.heat {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 05:24:47.429590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:24:47.430008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:24:47.430508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:24:47.430915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:24:47.431322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:24:47.624496 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ad31bcf-d9e1-436e-8bc5-a1b6657f1e55 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16/action" status: 202 len: 0 microversion: 2.1 time: 0.305466 Oct 11 05:24:47.625035 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3699/7630] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:24:47 2022] POST /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16/action => generated 0 bytes in 307 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:24:47.632941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=13 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:24:47.633647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:24:47.638897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7f921b19-8e03-4159-b73e-5b742935cf2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:24:47.639604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7f921b19-8e03-4159-b73e-5b742935cf2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:47.647326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f921b19-8e03-4159-b73e-5b742935cf2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:47.647838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f921b19-8e03-4159-b73e-5b742935cf2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:47.648285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f921b19-8e03-4159-b73e-5b742935cf2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:47.648988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f921b19-8e03-4159-b73e-5b742935cf2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:47.649454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f921b19-8e03-4159-b73e-5b742935cf2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:47.649892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f921b19-8e03-4159-b73e-5b742935cf2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:47.780509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7f921b19-8e03-4159-b73e-5b742935cf2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:47.788879 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7f921b19-8e03-4159-b73e-5b742935cf2b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1677 microversion: 2.1 time: 0.158918 Oct 11 05:24:47.789469 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3932/7631] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:24:47 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:24:48.813716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-37506781-1856-4076-8139-0f12af42e12a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:24:48.816698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-37506781-1856-4076-8139-0f12af42e12a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:48.820446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37506781-1856-4076-8139-0f12af42e12a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:48.820918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37506781-1856-4076-8139-0f12af42e12a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:48.821348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37506781-1856-4076-8139-0f12af42e12a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:48.822023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37506781-1856-4076-8139-0f12af42e12a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:48.822510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37506781-1856-4076-8139-0f12af42e12a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:48.822930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37506781-1856-4076-8139-0f12af42e12a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:48.959816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-37506781-1856-4076-8139-0f12af42e12a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:48.967731 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-37506781-1856-4076-8139-0f12af42e12a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1677 microversion: 2.1 time: 0.158685 Oct 11 05:24:48.968305 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3700/7632] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:24:48 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:24:49.992511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a625c8d4-46e9-439b-a2cb-f8db06223110 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:24:49.993143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a625c8d4-46e9-439b-a2cb-f8db06223110 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:50.000138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a625c8d4-46e9-439b-a2cb-f8db06223110 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:50.000642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a625c8d4-46e9-439b-a2cb-f8db06223110 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:50.001099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a625c8d4-46e9-439b-a2cb-f8db06223110 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:50.001810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a625c8d4-46e9-439b-a2cb-f8db06223110 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:50.002303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a625c8d4-46e9-439b-a2cb-f8db06223110 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:50.002749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a625c8d4-46e9-439b-a2cb-f8db06223110 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:50.215373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a625c8d4-46e9-439b-a2cb-f8db06223110 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:50.223892 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a625c8d4-46e9-439b-a2cb-f8db06223110 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1677 microversion: 2.1 time: 0.235698 Oct 11 05:24:50.224480 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3933/7633] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:24:49 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1677 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:24:51.246299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-762c88e7-d5d7-46b9-bbdd-d1ed83eef159 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:24:51.246909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-762c88e7-d5d7-46b9-bbdd-d1ed83eef159 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:51.253741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-762c88e7-d5d7-46b9-bbdd-d1ed83eef159 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:51.254246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-762c88e7-d5d7-46b9-bbdd-d1ed83eef159 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:51.254684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-762c88e7-d5d7-46b9-bbdd-d1ed83eef159 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:51.255365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-762c88e7-d5d7-46b9-bbdd-d1ed83eef159 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:51.255820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-762c88e7-d5d7-46b9-bbdd-d1ed83eef159 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:51.256253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-762c88e7-d5d7-46b9-bbdd-d1ed83eef159 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:51.382835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-762c88e7-d5d7-46b9-bbdd-d1ed83eef159 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:51.390768 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-762c88e7-d5d7-46b9-bbdd-d1ed83eef159 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.148103 Oct 11 05:24:51.391337 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3701/7634] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:24:51 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:24:52.415326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a99e96a-9b77-43ee-a8de-0209d0862bd8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:24:52.415959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0a99e96a-9b77-43ee-a8de-0209d0862bd8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:52.422847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a99e96a-9b77-43ee-a8de-0209d0862bd8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:52.423345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a99e96a-9b77-43ee-a8de-0209d0862bd8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:52.423827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a99e96a-9b77-43ee-a8de-0209d0862bd8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:52.424533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a99e96a-9b77-43ee-a8de-0209d0862bd8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:52.425004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a99e96a-9b77-43ee-a8de-0209d0862bd8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:52.425449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0a99e96a-9b77-43ee-a8de-0209d0862bd8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:52.553910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0a99e96a-9b77-43ee-a8de-0209d0862bd8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:52.561698 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a99e96a-9b77-43ee-a8de-0209d0862bd8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.150364 Oct 11 05:24:52.562297 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3934/7635] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:24:52 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:24:53.585097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-298b01c2-40e6-4092-b7ce-e71c93a663db tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:24:53.585717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-298b01c2-40e6-4092-b7ce-e71c93a663db tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:53.592630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-298b01c2-40e6-4092-b7ce-e71c93a663db tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:53.593114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-298b01c2-40e6-4092-b7ce-e71c93a663db tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:53.593554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-298b01c2-40e6-4092-b7ce-e71c93a663db tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:53.594279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-298b01c2-40e6-4092-b7ce-e71c93a663db tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:53.594745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-298b01c2-40e6-4092-b7ce-e71c93a663db tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:53.595176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-298b01c2-40e6-4092-b7ce-e71c93a663db tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:53.727210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-298b01c2-40e6-4092-b7ce-e71c93a663db tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:53.734959 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-298b01c2-40e6-4092-b7ce-e71c93a663db tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.153883 Oct 11 05:24:53.735530 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3702/7636] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:24:53 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:24:54.758410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d77a7358-0c95-48f6-97f1-c8c28e9dcaf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:24:54.759042 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d77a7358-0c95-48f6-97f1-c8c28e9dcaf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:54.766093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77a7358-0c95-48f6-97f1-c8c28e9dcaf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:54.766692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77a7358-0c95-48f6-97f1-c8c28e9dcaf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:54.767147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77a7358-0c95-48f6-97f1-c8c28e9dcaf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:54.767852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77a7358-0c95-48f6-97f1-c8c28e9dcaf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:54.768324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77a7358-0c95-48f6-97f1-c8c28e9dcaf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:54.768764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d77a7358-0c95-48f6-97f1-c8c28e9dcaf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:54.895495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d77a7358-0c95-48f6-97f1-c8c28e9dcaf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:54.903231 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d77a7358-0c95-48f6-97f1-c8c28e9dcaf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.148812 Oct 11 05:24:54.903804 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3935/7637] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:24:54 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:24:55.928512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-efaefb50-9b50-4c6b-ac78-bb16417a23ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:24:55.929221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-efaefb50-9b50-4c6b-ac78-bb16417a23ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:55.936425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efaefb50-9b50-4c6b-ac78-bb16417a23ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:55.936927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efaefb50-9b50-4c6b-ac78-bb16417a23ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:55.937379 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efaefb50-9b50-4c6b-ac78-bb16417a23ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:55.938122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efaefb50-9b50-4c6b-ac78-bb16417a23ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:55.938598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efaefb50-9b50-4c6b-ac78-bb16417a23ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:55.939038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-efaefb50-9b50-4c6b-ac78-bb16417a23ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:56.069091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-efaefb50-9b50-4c6b-ac78-bb16417a23ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:56.076772 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-efaefb50-9b50-4c6b-ac78-bb16417a23ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.153755 Oct 11 05:24:56.077338 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3703/7638] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:24:55 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:24:57.099428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5b5480f9-d872-45b5-852e-b014d8e8c292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:24:57.100059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5b5480f9-d872-45b5-852e-b014d8e8c292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:57.106974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b5480f9-d872-45b5-852e-b014d8e8c292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:57.107469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b5480f9-d872-45b5-852e-b014d8e8c292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:57.108006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b5480f9-d872-45b5-852e-b014d8e8c292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:57.108717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b5480f9-d872-45b5-852e-b014d8e8c292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:57.109184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b5480f9-d872-45b5-852e-b014d8e8c292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:57.109621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5b5480f9-d872-45b5-852e-b014d8e8c292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:57.246302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5b5480f9-d872-45b5-852e-b014d8e8c292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:57.254270 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5b5480f9-d872-45b5-852e-b014d8e8c292 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.158787 Oct 11 05:24:57.255386 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3936/7639] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:24:57 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:24:58.278307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9fcfcec1-ae32-4ec4-a4be-3d7d8f5a40cf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:24:58.278913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9fcfcec1-ae32-4ec4-a4be-3d7d8f5a40cf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:58.285755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9fcfcec1-ae32-4ec4-a4be-3d7d8f5a40cf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:58.286255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9fcfcec1-ae32-4ec4-a4be-3d7d8f5a40cf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:58.286690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9fcfcec1-ae32-4ec4-a4be-3d7d8f5a40cf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:58.287998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9fcfcec1-ae32-4ec4-a4be-3d7d8f5a40cf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:58.288447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9fcfcec1-ae32-4ec4-a4be-3d7d8f5a40cf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:58.288871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9fcfcec1-ae32-4ec4-a4be-3d7d8f5a40cf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:58.419809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9fcfcec1-ae32-4ec4-a4be-3d7d8f5a40cf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:58.427502 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9fcfcec1-ae32-4ec4-a4be-3d7d8f5a40cf tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.153050 Oct 11 05:24:58.428061 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3704/7640] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:24:58 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:24:59.451565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b2c57a8a-8077-4424-9b27-b54fe222fc44 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:24:59.452187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b2c57a8a-8077-4424-9b27-b54fe222fc44 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:24:59.459120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c57a8a-8077-4424-9b27-b54fe222fc44 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:59.459620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c57a8a-8077-4424-9b27-b54fe222fc44 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:59.460066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c57a8a-8077-4424-9b27-b54fe222fc44 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:59.460760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c57a8a-8077-4424-9b27-b54fe222fc44 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:24:59.461225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c57a8a-8077-4424-9b27-b54fe222fc44 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:24:59.461660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b2c57a8a-8077-4424-9b27-b54fe222fc44 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:24:59.593282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b2c57a8a-8077-4424-9b27-b54fe222fc44 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:24:59.601907 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b2c57a8a-8077-4424-9b27-b54fe222fc44 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.154289 Oct 11 05:24:59.602542 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3937/7641] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:24:59 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:00.624812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b5b60890-c114-4e5e-a3c1-4a20f6aeb548 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:00.625419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b5b60890-c114-4e5e-a3c1-4a20f6aeb548 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:00.632835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b60890-c114-4e5e-a3c1-4a20f6aeb548 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:00.641113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b60890-c114-4e5e-a3c1-4a20f6aeb548 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:00.641113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b60890-c114-4e5e-a3c1-4a20f6aeb548 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:00.641113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b60890-c114-4e5e-a3c1-4a20f6aeb548 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:00.641113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b60890-c114-4e5e-a3c1-4a20f6aeb548 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:00.641113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5b60890-c114-4e5e-a3c1-4a20f6aeb548 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:00.763266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b5b60890-c114-4e5e-a3c1-4a20f6aeb548 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:00.771312 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b5b60890-c114-4e5e-a3c1-4a20f6aeb548 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.150303 Oct 11 05:25:00.771891 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3705/7642] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:00 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:01.795454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3d35c07c-5cf1-421e-bbfa-5136e1b9ca9c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:01.796040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3d35c07c-5cf1-421e-bbfa-5136e1b9ca9c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:01.803343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d35c07c-5cf1-421e-bbfa-5136e1b9ca9c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:01.803843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d35c07c-5cf1-421e-bbfa-5136e1b9ca9c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:01.804300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d35c07c-5cf1-421e-bbfa-5136e1b9ca9c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:01.805011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d35c07c-5cf1-421e-bbfa-5136e1b9ca9c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:01.805483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d35c07c-5cf1-421e-bbfa-5136e1b9ca9c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:01.805938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d35c07c-5cf1-421e-bbfa-5136e1b9ca9c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:01.937154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3d35c07c-5cf1-421e-bbfa-5136e1b9ca9c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:01.945736 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3d35c07c-5cf1-421e-bbfa-5136e1b9ca9c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.154284 Oct 11 05:25:01.946334 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3938/7643] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:01 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:02.968937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6fe6a425-22dd-4ea6-bf43-6c1dfad969e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:02.969533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6fe6a425-22dd-4ea6-bf43-6c1dfad969e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:02.976337 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fe6a425-22dd-4ea6-bf43-6c1dfad969e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:02.976812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fe6a425-22dd-4ea6-bf43-6c1dfad969e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:02.977243 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fe6a425-22dd-4ea6-bf43-6c1dfad969e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:02.977920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fe6a425-22dd-4ea6-bf43-6c1dfad969e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:02.978402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fe6a425-22dd-4ea6-bf43-6c1dfad969e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:02.978824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6fe6a425-22dd-4ea6-bf43-6c1dfad969e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:03.108699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6fe6a425-22dd-4ea6-bf43-6c1dfad969e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:03.116419 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6fe6a425-22dd-4ea6-bf43-6c1dfad969e7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.151380 Oct 11 05:25:03.116996 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3706/7644] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:02 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:04.139291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f88dfe7d-af2a-494f-abfe-30953ef47921 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:04.139922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f88dfe7d-af2a-494f-abfe-30953ef47921 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:04.147612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f88dfe7d-af2a-494f-abfe-30953ef47921 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:04.148113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f88dfe7d-af2a-494f-abfe-30953ef47921 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:04.148573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f88dfe7d-af2a-494f-abfe-30953ef47921 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:04.149282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f88dfe7d-af2a-494f-abfe-30953ef47921 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:04.149750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f88dfe7d-af2a-494f-abfe-30953ef47921 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:04.150210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f88dfe7d-af2a-494f-abfe-30953ef47921 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:04.278537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f88dfe7d-af2a-494f-abfe-30953ef47921 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:04.286275 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f88dfe7d-af2a-494f-abfe-30953ef47921 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.150965 Oct 11 05:25:04.287462 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3939/7645] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:04 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:05.309852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5abdd6c7-3d37-4d58-8c89-be17ff7ffe19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:05.310486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5abdd6c7-3d37-4d58-8c89-be17ff7ffe19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:05.316764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5abdd6c7-3d37-4d58-8c89-be17ff7ffe19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:05.317245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5abdd6c7-3d37-4d58-8c89-be17ff7ffe19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:05.317720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5abdd6c7-3d37-4d58-8c89-be17ff7ffe19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:05.318440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5abdd6c7-3d37-4d58-8c89-be17ff7ffe19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:05.318896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5abdd6c7-3d37-4d58-8c89-be17ff7ffe19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:05.319312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5abdd6c7-3d37-4d58-8c89-be17ff7ffe19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:05.447852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5abdd6c7-3d37-4d58-8c89-be17ff7ffe19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:05.455531 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5abdd6c7-3d37-4d58-8c89-be17ff7ffe19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.149513 Oct 11 05:25:05.456097 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3707/7646] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:05 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:06.477872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-371b48a2-c1a1-478a-9525-0064b9491eb3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:06.478599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-371b48a2-c1a1-478a-9525-0064b9491eb3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:06.485416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-371b48a2-c1a1-478a-9525-0064b9491eb3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:06.485910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-371b48a2-c1a1-478a-9525-0064b9491eb3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:06.486418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-371b48a2-c1a1-478a-9525-0064b9491eb3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:06.487113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-371b48a2-c1a1-478a-9525-0064b9491eb3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:06.487577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-371b48a2-c1a1-478a-9525-0064b9491eb3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:06.488013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-371b48a2-c1a1-478a-9525-0064b9491eb3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:06.616205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-371b48a2-c1a1-478a-9525-0064b9491eb3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:06.623891 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-371b48a2-c1a1-478a-9525-0064b9491eb3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.149918 Oct 11 05:25:06.624453 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3940/7647] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:06 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:07.649516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-60388e24-c644-41cd-a261-121dfedcfc73 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:07.650127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-60388e24-c644-41cd-a261-121dfedcfc73 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:07.656883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60388e24-c644-41cd-a261-121dfedcfc73 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:07.658055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60388e24-c644-41cd-a261-121dfedcfc73 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:07.658055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60388e24-c644-41cd-a261-121dfedcfc73 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:07.658655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60388e24-c644-41cd-a261-121dfedcfc73 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:07.659105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60388e24-c644-41cd-a261-121dfedcfc73 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:07.659525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60388e24-c644-41cd-a261-121dfedcfc73 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:07.791592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-60388e24-c644-41cd-a261-121dfedcfc73 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:07.799369 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-60388e24-c644-41cd-a261-121dfedcfc73 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1682 microversion: 2.1 time: 0.154950 Oct 11 05:25:07.799934 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3708/7648] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:07 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:08.400202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7a946169-3366-4a86-9fb5-8fb013925821 req-bc66226b-f52b-4d13-b7a1-17ad41d8eb86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d0d19-4ea1-41ba-a154-dae25d0b4d16", "name": "network-vif-unplugged", "status": "completed", "tag": "99a76713-8bce-4433-acb4-bf1fee7b681f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:25:08.411886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7a946169-3366-4a86-9fb5-8fb013925821 req-bc66226b-f52b-4d13-b7a1-17ad41d8eb86 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:08.412380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7a946169-3366-4a86-9fb5-8fb013925821 req-bc66226b-f52b-4d13-b7a1-17ad41d8eb86 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:08.412826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7a946169-3366-4a86-9fb5-8fb013925821 req-bc66226b-f52b-4d13-b7a1-17ad41d8eb86 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:08.424647 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7a946169-3366-4a86-9fb5-8fb013925821 req-bc66226b-f52b-4d13-b7a1-17ad41d8eb86 service nova] Creating event network-vif-unplugged:99a76713-8bce-4433-acb4-bf1fee7b681f for instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 on n-h2-860892-1 Oct 11 05:25:08.430303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-7a946169-3366-4a86-9fb5-8fb013925821 req-bc66226b-f52b-4d13-b7a1-17ad41d8eb86 service nova] Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:25:08.446535 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7a946169-3366-4a86-9fb5-8fb013925821 req-bc66226b-f52b-4d13-b7a1-17ad41d8eb86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046232 Oct 11 05:25:08.446535 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3941/7649] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:25:08 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:25:08.826791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d155dbf4-9b63-4e58-a6e5-4ffc754a345d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:08.826791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d155dbf4-9b63-4e58-a6e5-4ffc754a345d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:08.835527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d155dbf4-9b63-4e58-a6e5-4ffc754a345d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:08.836024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d155dbf4-9b63-4e58-a6e5-4ffc754a345d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:08.836468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d155dbf4-9b63-4e58-a6e5-4ffc754a345d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:08.837180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d155dbf4-9b63-4e58-a6e5-4ffc754a345d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:08.837633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d155dbf4-9b63-4e58-a6e5-4ffc754a345d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:08.838059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d155dbf4-9b63-4e58-a6e5-4ffc754a345d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:08.977979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d155dbf4-9b63-4e58-a6e5-4ffc754a345d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:08.986160 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d155dbf4-9b63-4e58-a6e5-4ffc754a345d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1681 microversion: 2.1 time: 0.164747 Oct 11 05:25:08.986758 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3709/7650] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:08 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:10.017943 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-13649386-5801-4b0e-8fde-8c1f51324b1e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:10.018688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-13649386-5801-4b0e-8fde-8c1f51324b1e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:10.024905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13649386-5801-4b0e-8fde-8c1f51324b1e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:10.025404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13649386-5801-4b0e-8fde-8c1f51324b1e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:10.025863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13649386-5801-4b0e-8fde-8c1f51324b1e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:10.026587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13649386-5801-4b0e-8fde-8c1f51324b1e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:10.027059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13649386-5801-4b0e-8fde-8c1f51324b1e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:10.027501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-13649386-5801-4b0e-8fde-8c1f51324b1e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:10.161383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-13649386-5801-4b0e-8fde-8c1f51324b1e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:10.169964 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-13649386-5801-4b0e-8fde-8c1f51324b1e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1679 microversion: 2.1 time: 0.157598 Oct 11 05:25:10.170565 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3942/7651] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:10 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1679 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:10.456757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8d76a62e-a9d0-4947-86ee-e4effba7882f req-86c2c6ec-9ae1-4eaa-ab39-ee0fcfa1d2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734d0d19-4ea1-41ba-a154-dae25d0b4d16", "tag": "99a76713-8bce-4433-acb4-bf1fee7b681f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:25:10.467540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8d76a62e-a9d0-4947-86ee-e4effba7882f req-86c2c6ec-9ae1-4eaa-ab39-ee0fcfa1d2f0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:10.468015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8d76a62e-a9d0-4947-86ee-e4effba7882f req-86c2c6ec-9ae1-4eaa-ab39-ee0fcfa1d2f0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:10.468446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8d76a62e-a9d0-4947-86ee-e4effba7882f req-86c2c6ec-9ae1-4eaa-ab39-ee0fcfa1d2f0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:10.479837 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8d76a62e-a9d0-4947-86ee-e4effba7882f req-86c2c6ec-9ae1-4eaa-ab39-ee0fcfa1d2f0 service nova] Creating event network-changed:99a76713-8bce-4433-acb4-bf1fee7b681f for instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 on n-h2-860892-1 Oct 11 05:25:10.485011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-8d76a62e-a9d0-4947-86ee-e4effba7882f req-86c2c6ec-9ae1-4eaa-ab39-ee0fcfa1d2f0 service nova] Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:25:10.495613 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8d76a62e-a9d0-4947-86ee-e4effba7882f req-86c2c6ec-9ae1-4eaa-ab39-ee0fcfa1d2f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042579 Oct 11 05:25:10.496194 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3710/7652] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:25:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:25:11.193124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5a68614b-ee83-4bde-84f3-861a8868f888 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:11.194515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5a68614b-ee83-4bde-84f3-861a8868f888 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:11.201839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a68614b-ee83-4bde-84f3-861a8868f888 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:11.202379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a68614b-ee83-4bde-84f3-861a8868f888 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:11.203067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a68614b-ee83-4bde-84f3-861a8868f888 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:11.204008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a68614b-ee83-4bde-84f3-861a8868f888 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:11.204480 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a68614b-ee83-4bde-84f3-861a8868f888 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:11.204928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5a68614b-ee83-4bde-84f3-861a8868f888 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:11.450122 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5a68614b-ee83-4bde-84f3-861a8868f888 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:11.458507 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5a68614b-ee83-4bde-84f3-861a8868f888 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1679 microversion: 2.1 time: 0.269170 Oct 11 05:25:11.459137 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3943/7653] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:11 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1679 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:12.484305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2b0f45f4-f1d0-4771-bd74-2d5f144d98fd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:12.485030 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2b0f45f4-f1d0-4771-bd74-2d5f144d98fd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:12.491610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b0f45f4-f1d0-4771-bd74-2d5f144d98fd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:12.492086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b0f45f4-f1d0-4771-bd74-2d5f144d98fd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:12.492517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b0f45f4-f1d0-4771-bd74-2d5f144d98fd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:12.493196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b0f45f4-f1d0-4771-bd74-2d5f144d98fd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:12.493647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b0f45f4-f1d0-4771-bd74-2d5f144d98fd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:12.494064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2b0f45f4-f1d0-4771-bd74-2d5f144d98fd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:12.622010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2b0f45f4-f1d0-4771-bd74-2d5f144d98fd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:12.629766 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2b0f45f4-f1d0-4771-bd74-2d5f144d98fd tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1676 microversion: 2.1 time: 0.150519 Oct 11 05:25:12.637162 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3711/7654] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:12 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:12.658702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:25:12.659261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:12.666607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:12.669704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:12.669704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:12.669704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:12.669704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:12.669704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:12.705996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:12.706511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:12.706958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:12.707692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:12.708159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:12.708597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:12.729707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:25:12.734925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for user fc7f4b98dd3c48a8ad4418a3d73f5cb6 and project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:25:13.093635 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bded86d9-7bee-4912-a7a6-bc22f3987b1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16/action" status: 202 len: 0 microversion: 2.1 time: 0.438750 Oct 11 05:25:13.099343 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3944/7655] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:25:12 2022] POST /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:25:13.104576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9c1ad989-ad01-4977-bc73-b9a637cee132 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:13.105190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9c1ad989-ad01-4977-bc73-b9a637cee132 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:13.111139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c1ad989-ad01-4977-bc73-b9a637cee132 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:13.111856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c1ad989-ad01-4977-bc73-b9a637cee132 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:13.112289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c1ad989-ad01-4977-bc73-b9a637cee132 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:13.112979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c1ad989-ad01-4977-bc73-b9a637cee132 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:13.113439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c1ad989-ad01-4977-bc73-b9a637cee132 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:13.113847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c1ad989-ad01-4977-bc73-b9a637cee132 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:13.260965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9c1ad989-ad01-4977-bc73-b9a637cee132 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:13.269287 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9c1ad989-ad01-4977-bc73-b9a637cee132 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1675 microversion: 2.1 time: 0.170453 Oct 11 05:25:13.269862 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3712/7656] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:13 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:13.313012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-809c0850-f149-4bf5-b8e7-096967c9a943 req-0453cf5b-dc69-4d84-9b06-ae997ab12289 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d0d19-4ea1-41ba-a154-dae25d0b4d16", "name": "network-vif-plugged", "status": "completed", "tag": "99a76713-8bce-4433-acb4-bf1fee7b681f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:25:13.323184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-809c0850-f149-4bf5-b8e7-096967c9a943 req-0453cf5b-dc69-4d84-9b06-ae997ab12289 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:13.323684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-809c0850-f149-4bf5-b8e7-096967c9a943 req-0453cf5b-dc69-4d84-9b06-ae997ab12289 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:13.324202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-809c0850-f149-4bf5-b8e7-096967c9a943 req-0453cf5b-dc69-4d84-9b06-ae997ab12289 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:13.337053 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-809c0850-f149-4bf5-b8e7-096967c9a943 req-0453cf5b-dc69-4d84-9b06-ae997ab12289 service nova] Creating event network-vif-plugged:99a76713-8bce-4433-acb4-bf1fee7b681f for instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 on n-h2-860892-1 Oct 11 05:25:13.342589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-809c0850-f149-4bf5-b8e7-096967c9a943 req-0453cf5b-dc69-4d84-9b06-ae997ab12289 service nova] Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:25:13.354587 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-809c0850-f149-4bf5-b8e7-096967c9a943 req-0453cf5b-dc69-4d84-9b06-ae997ab12289 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045625 Oct 11 05:25:13.355589 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3945/7657] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:25:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:25:14.294081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-915f7693-917b-43d1-a854-b94a3bbb758b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:14.294717 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-915f7693-917b-43d1-a854-b94a3bbb758b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:14.301442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915f7693-917b-43d1-a854-b94a3bbb758b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:14.301920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915f7693-917b-43d1-a854-b94a3bbb758b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:14.302391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915f7693-917b-43d1-a854-b94a3bbb758b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:14.303709 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915f7693-917b-43d1-a854-b94a3bbb758b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:14.304151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915f7693-917b-43d1-a854-b94a3bbb758b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:14.304571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-915f7693-917b-43d1-a854-b94a3bbb758b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:14.431225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-915f7693-917b-43d1-a854-b94a3bbb758b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:14.438840 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-915f7693-917b-43d1-a854-b94a3bbb758b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1675 microversion: 2.1 time: 0.148649 Oct 11 05:25:14.439409 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3713/7658] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:14 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:15.463845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-54fa9023-0b45-44ea-8199-135104bc6b6b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:15.464560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-54fa9023-0b45-44ea-8199-135104bc6b6b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:15.470867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54fa9023-0b45-44ea-8199-135104bc6b6b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:15.471303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54fa9023-0b45-44ea-8199-135104bc6b6b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:15.471758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54fa9023-0b45-44ea-8199-135104bc6b6b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:15.472464 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54fa9023-0b45-44ea-8199-135104bc6b6b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:15.472934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54fa9023-0b45-44ea-8199-135104bc6b6b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:15.473375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-54fa9023-0b45-44ea-8199-135104bc6b6b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:15.478182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:25:15.613726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-54fa9023-0b45-44ea-8199-135104bc6b6b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:15.621838 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-54fa9023-0b45-44ea-8199-135104bc6b6b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1675 microversion: 2.1 time: 0.163723 Oct 11 05:25:15.622482 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3946/7659] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:15 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1675 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:16.640858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-7aab1aa6-bc4e-4e4c-8212-6be1a9285909 req-a4f1e759-2145-4646-9635-cb44f9be4436 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d0d19-4ea1-41ba-a154-dae25d0b4d16", "name": "network-vif-unplugged", "status": "completed", "tag": "99a76713-8bce-4433-acb4-bf1fee7b681f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:25:16.645358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-03dc4177-1366-4ee9-932e-d5a5eb2c01ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:16.646084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-03dc4177-1366-4ee9-932e-d5a5eb2c01ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:16.651537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7aab1aa6-bc4e-4e4c-8212-6be1a9285909 req-a4f1e759-2145-4646-9635-cb44f9be4436 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:16.652186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7aab1aa6-bc4e-4e4c-8212-6be1a9285909 req-a4f1e759-2145-4646-9635-cb44f9be4436 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:16.652617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7aab1aa6-bc4e-4e4c-8212-6be1a9285909 req-a4f1e759-2145-4646-9635-cb44f9be4436 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:16.653125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03dc4177-1366-4ee9-932e-d5a5eb2c01ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:16.653625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03dc4177-1366-4ee9-932e-d5a5eb2c01ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:16.654075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03dc4177-1366-4ee9-932e-d5a5eb2c01ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:16.654810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03dc4177-1366-4ee9-932e-d5a5eb2c01ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:16.655277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03dc4177-1366-4ee9-932e-d5a5eb2c01ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:16.655711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03dc4177-1366-4ee9-932e-d5a5eb2c01ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:16.668367 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7aab1aa6-bc4e-4e4c-8212-6be1a9285909 req-a4f1e759-2145-4646-9635-cb44f9be4436 service nova] Creating event network-vif-unplugged:99a76713-8bce-4433-acb4-bf1fee7b681f for instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 on n-h1-860892-1 Oct 11 05:25:16.671188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:25:16.674745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-7aab1aa6-bc4e-4e4c-8212-6be1a9285909 req-a4f1e759-2145-4646-9635-cb44f9be4436 service nova] Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:25:16.686743 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-7aab1aa6-bc4e-4e4c-8212-6be1a9285909 req-a4f1e759-2145-4646-9635-cb44f9be4436 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.050078 Oct 11 05:25:16.687396 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3714/7660] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:25:17.166060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-03dc4177-1366-4ee9-932e-d5a5eb2c01ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:17.173910 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-03dc4177-1366-4ee9-932e-d5a5eb2c01ce tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1675 microversion: 2.1 time: 0.532673 Oct 11 05:25:17.174524 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3947/7661] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:16 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1675 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:25:18.200730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-128d6caf-20cd-4221-82d8-7fe30273c2f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:18.201341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-128d6caf-20cd-4221-82d8-7fe30273c2f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:18.203240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=37 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:25:18.208362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128d6caf-20cd-4221-82d8-7fe30273c2f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:18.209475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128d6caf-20cd-4221-82d8-7fe30273c2f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:18.209923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128d6caf-20cd-4221-82d8-7fe30273c2f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:18.210645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128d6caf-20cd-4221-82d8-7fe30273c2f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:18.211138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128d6caf-20cd-4221-82d8-7fe30273c2f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:18.211565 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128d6caf-20cd-4221-82d8-7fe30273c2f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:18.342965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-128d6caf-20cd-4221-82d8-7fe30273c2f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:18.350869 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-128d6caf-20cd-4221-82d8-7fe30273c2f5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1675 microversion: 2.1 time: 0.155717 Oct 11 05:25:18.351442 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3715/7662] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:18 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:18.701156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2ede0723-0b98-43b4-b19c-4743a728cfb0 req-285eaf0d-b81c-4e4d-a4cb-cfa226e11d86 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "734d0d19-4ea1-41ba-a154-dae25d0b4d16", "tag": "99a76713-8bce-4433-acb4-bf1fee7b681f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:25:18.707000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:25:18.712088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ede0723-0b98-43b4-b19c-4743a728cfb0 req-285eaf0d-b81c-4e4d-a4cb-cfa226e11d86 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:18.712610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ede0723-0b98-43b4-b19c-4743a728cfb0 req-285eaf0d-b81c-4e4d-a4cb-cfa226e11d86 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:18.713059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2ede0723-0b98-43b4-b19c-4743a728cfb0 req-285eaf0d-b81c-4e4d-a4cb-cfa226e11d86 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:18.724562 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2ede0723-0b98-43b4-b19c-4743a728cfb0 req-285eaf0d-b81c-4e4d-a4cb-cfa226e11d86 service nova] Creating event network-changed:99a76713-8bce-4433-acb4-bf1fee7b681f for instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 on n-h1-860892-1 Oct 11 05:25:18.730304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-2ede0723-0b98-43b4-b19c-4743a728cfb0 req-285eaf0d-b81c-4e4d-a4cb-cfa226e11d86 service nova] Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:25:18.742112 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2ede0723-0b98-43b4-b19c-4743a728cfb0 req-285eaf0d-b81c-4e4d-a4cb-cfa226e11d86 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044177 Oct 11 05:25:18.747697 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3948/7663] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:25:19.374399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d0abbd88-82fd-400f-b502-0997253987ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:19.375010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d0abbd88-82fd-400f-b502-0997253987ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:19.381776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0abbd88-82fd-400f-b502-0997253987ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:19.382766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0abbd88-82fd-400f-b502-0997253987ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:19.383197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0abbd88-82fd-400f-b502-0997253987ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:19.383875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0abbd88-82fd-400f-b502-0997253987ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:19.384320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0abbd88-82fd-400f-b502-0997253987ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:19.384736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0abbd88-82fd-400f-b502-0997253987ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:19.514809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d0abbd88-82fd-400f-b502-0997253987ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:19.523455 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d0abbd88-82fd-400f-b502-0997253987ac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1675 microversion: 2.1 time: 0.152301 Oct 11 05:25:19.524047 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3716/7664] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:19 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:20.548229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5c2ca9a-323e-4816-a7b2-260fc582fdf4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:20.548941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c5c2ca9a-323e-4816-a7b2-260fc582fdf4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:20.555567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c2ca9a-323e-4816-a7b2-260fc582fdf4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:20.556097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c2ca9a-323e-4816-a7b2-260fc582fdf4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:20.556543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c2ca9a-323e-4816-a7b2-260fc582fdf4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:20.557244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c2ca9a-323e-4816-a7b2-260fc582fdf4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:20.557714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c2ca9a-323e-4816-a7b2-260fc582fdf4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:20.558148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5c2ca9a-323e-4816-a7b2-260fc582fdf4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:20.720882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5c2ca9a-323e-4816-a7b2-260fc582fdf4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:20.729404 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c5c2ca9a-323e-4816-a7b2-260fc582fdf4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1675 microversion: 2.1 time: 0.186482 Oct 11 05:25:20.729978 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3949/7665] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:20 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:21.752571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0026564f-051f-4716-b811-be025d734d9b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:21.753205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0026564f-051f-4716-b811-be025d734d9b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:21.760012 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0026564f-051f-4716-b811-be025d734d9b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:21.760488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0026564f-051f-4716-b811-be025d734d9b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:21.760929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0026564f-051f-4716-b811-be025d734d9b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:21.761611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0026564f-051f-4716-b811-be025d734d9b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:21.762066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0026564f-051f-4716-b811-be025d734d9b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:21.762513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0026564f-051f-4716-b811-be025d734d9b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:21.889051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0026564f-051f-4716-b811-be025d734d9b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:21.896975 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0026564f-051f-4716-b811-be025d734d9b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1668 microversion: 2.1 time: 0.148342 Oct 11 05:25:21.897551 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3717/7666] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:21 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1668 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:21.919807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b272ae68-823b-43f0-a6be-58d7089856eb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:21.920435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b272ae68-823b-43f0-a6be-58d7089856eb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:21.927272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b272ae68-823b-43f0-a6be-58d7089856eb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:21.927769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b272ae68-823b-43f0-a6be-58d7089856eb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:21.928220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b272ae68-823b-43f0-a6be-58d7089856eb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:21.928922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b272ae68-823b-43f0-a6be-58d7089856eb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:21.929390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b272ae68-823b-43f0-a6be-58d7089856eb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:21.929830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b272ae68-823b-43f0-a6be-58d7089856eb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:22.059132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b272ae68-823b-43f0-a6be-58d7089856eb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:22.067622 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b272ae68-823b-43f0-a6be-58d7089856eb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1668 microversion: 2.1 time: 0.152277 Oct 11 05:25:22.068198 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3950/7667] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:21 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1668 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:22.090368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-723d4c37-cb66-4664-99d7-cb8a612d8c2f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:22.090928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-723d4c37-cb66-4664-99d7-cb8a612d8c2f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:22.096750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-723d4c37-cb66-4664-99d7-cb8a612d8c2f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:22.097231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-723d4c37-cb66-4664-99d7-cb8a612d8c2f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:22.097665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-723d4c37-cb66-4664-99d7-cb8a612d8c2f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:22.098397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-723d4c37-cb66-4664-99d7-cb8a612d8c2f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:22.098854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-723d4c37-cb66-4664-99d7-cb8a612d8c2f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:22.099282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-723d4c37-cb66-4664-99d7-cb8a612d8c2f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:22.228829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-723d4c37-cb66-4664-99d7-cb8a612d8c2f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:22.236542 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-723d4c37-cb66-4664-99d7-cb8a612d8c2f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1668 microversion: 2.1 time: 0.150604 Oct 11 05:25:22.237108 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3718/7668] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:22 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1668 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:22.258546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1f302382-a46f-4b94-9d8d-32acfc90dcfb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:22.259069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1f302382-a46f-4b94-9d8d-32acfc90dcfb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:22.264940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f302382-a46f-4b94-9d8d-32acfc90dcfb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:22.265700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f302382-a46f-4b94-9d8d-32acfc90dcfb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:22.266152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f302382-a46f-4b94-9d8d-32acfc90dcfb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:22.266884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f302382-a46f-4b94-9d8d-32acfc90dcfb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:22.267350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f302382-a46f-4b94-9d8d-32acfc90dcfb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:22.267791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1f302382-a46f-4b94-9d8d-32acfc90dcfb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:22.293055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1f302382-a46f-4b94-9d8d-32acfc90dcfb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:25:22.500366 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1f302382-a46f-4b94-9d8d-32acfc90dcfb tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "DELETE /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 204 len: 0 microversion: 2.1 time: 0.245393 Oct 11 05:25:22.500976 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3951/7669] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:25:22 2022] DELETE /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:25:22.509968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df0d69ba-944b-4e60-b4b0-22fe9690c831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:22.511169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-df0d69ba-944b-4e60-b4b0-22fe9690c831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:22.517479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d69ba-944b-4e60-b4b0-22fe9690c831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:22.518134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d69ba-944b-4e60-b4b0-22fe9690c831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:22.518609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d69ba-944b-4e60-b4b0-22fe9690c831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:22.519312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d69ba-944b-4e60-b4b0-22fe9690c831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:22.520052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d69ba-944b-4e60-b4b0-22fe9690c831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:22.520159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df0d69ba-944b-4e60-b4b0-22fe9690c831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:22.651114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-df0d69ba-944b-4e60-b4b0-22fe9690c831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:22.658817 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df0d69ba-944b-4e60-b4b0-22fe9690c831 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1674 microversion: 2.1 time: 0.153415 Oct 11 05:25:22.659386 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3719/7670] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:22 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:23.683388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1436f095-babc-4c91-8b81-af472b2de35c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:23.684103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1436f095-babc-4c91-8b81-af472b2de35c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:23.686071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:25:23.691749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1436f095-babc-4c91-8b81-af472b2de35c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:23.692243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1436f095-babc-4c91-8b81-af472b2de35c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:23.692696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1436f095-babc-4c91-8b81-af472b2de35c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:23.693403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1436f095-babc-4c91-8b81-af472b2de35c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:23.693870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1436f095-babc-4c91-8b81-af472b2de35c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:23.694421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1436f095-babc-4c91-8b81-af472b2de35c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:23.828540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1436f095-babc-4c91-8b81-af472b2de35c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:23.836458 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1436f095-babc-4c91-8b81-af472b2de35c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1674 microversion: 2.1 time: 0.157936 Oct 11 05:25:23.837094 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3952/7671] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:23 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:24.860705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-934c9508-bce8-4660-85fa-36d734e16fc0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:24.861523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-934c9508-bce8-4660-85fa-36d734e16fc0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:24.869082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-934c9508-bce8-4660-85fa-36d734e16fc0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:24.869661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-934c9508-bce8-4660-85fa-36d734e16fc0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:24.870205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-934c9508-bce8-4660-85fa-36d734e16fc0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:24.871123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-934c9508-bce8-4660-85fa-36d734e16fc0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:24.871648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-934c9508-bce8-4660-85fa-36d734e16fc0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:24.872142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-934c9508-bce8-4660-85fa-36d734e16fc0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:24.936462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-934c9508-bce8-4660-85fa-36d734e16fc0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:24.944892 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-934c9508-bce8-4660-85fa-36d734e16fc0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1607 microversion: 2.1 time: 0.088129 Oct 11 05:25:24.945688 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3720/7672] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:24 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1607 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:24.993483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d2aa463c-eb8e-49b1-99c8-d879a5eb1057 req-3ddfbe45-b6a4-4c6d-8b4b-640d84bf1236 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "734d0d19-4ea1-41ba-a154-dae25d0b4d16", "name": "network-vif-deleted", "tag": "99a76713-8bce-4433-acb4-bf1fee7b681f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:25:25.004746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d2aa463c-eb8e-49b1-99c8-d879a5eb1057 req-3ddfbe45-b6a4-4c6d-8b4b-640d84bf1236 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:25.005365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d2aa463c-eb8e-49b1-99c8-d879a5eb1057 req-3ddfbe45-b6a4-4c6d-8b4b-640d84bf1236 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:25.005891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d2aa463c-eb8e-49b1-99c8-d879a5eb1057 req-3ddfbe45-b6a4-4c6d-8b4b-640d84bf1236 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:25.019547 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d2aa463c-eb8e-49b1-99c8-d879a5eb1057 req-3ddfbe45-b6a4-4c6d-8b4b-640d84bf1236 service nova] Creating event network-vif-deleted:99a76713-8bce-4433-acb4-bf1fee7b681f for instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 on n-h1-860892-1 Oct 11 05:25:25.024754 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d2aa463c-eb8e-49b1-99c8-d879a5eb1057 req-3ddfbe45-b6a4-4c6d-8b4b-640d84bf1236 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034993 Oct 11 05:25:25.025559 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3953/7673] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:25:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:25:25.968088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:25.969064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:25.977689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:25.977689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:25.977689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:25.978079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:25.978785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:25.979355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:26.016424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:26.016902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:26.017349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:26.017858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lazy-loading 'fault' on Instance uuid 734d0d19-4ea1-41ba-a154-dae25d0b4d16 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:25:26.062655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:26.070711 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-37018f4a-2f4f-43b9-a27a-f62b9c0327d6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 200 len: 1328 microversion: 2.1 time: 0.106704 Oct 11 05:25:26.072964 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3721/7674] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:25 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 1328 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:25:27.096449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:27.097164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:27.103396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:27.103895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:27.104347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:27.105046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:27.105514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:27.105954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:27.119001 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 HTTP/1.1 Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '734d0d19-4ea1-41ba-a154-dae25d0b4d16'} Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:25:27.120621 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:25:27.125062 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:25:27.125062 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:25:27.125062 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:25:27.125062 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:25:27.125062 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:25:27.125062 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:25:27.125062 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:25:27.125062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:25:27.125062 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e9049ee1-b917-4c4b-b578-a96ea632b020 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 404 len: 111 microversion: 2.1 time: 0.030810 Oct 11 05:25:27.125062 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3954/7675] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:27 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:25:27.141975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:27.142606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:27.149255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:27.149729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:27.150816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:27.151493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:27.151940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:27.152359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:27.165442 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 HTTP/1.1 Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '734d0d19-4ea1-41ba-a154-dae25d0b4d16'} Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:25:27.167101 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:25:27.171661 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:25:27.171661 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:25:27.171661 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:25:27.171661 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:25:27.171661 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:25:27.171661 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:25:27.171661 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:25:27.171661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:25:27.171661 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b9a79085-943f-406a-b8fa-f997ee530f57 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 404 len: 111 microversion: 2.1 time: 0.030604 Oct 11 05:25:27.171661 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3722/7676] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:27 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:25:27.216133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-102261138", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "142a49fe-d230-4475-878e-8be16d147ec7"}], "security_groups": [{"name": "tempest-securitygroup--574193408"}], "key_name": "tempest-keypair-441167700", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:25:27.323650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] validate_networks() for [('142a49fe-d230-4475-878e-8be16d147ec7', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:25:27.746564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:25:27.747007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:25:27.747492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:25:27.747912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:25:27.748334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:25:27.757051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:27.757541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:27.757986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:27.758751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:27.759710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:27.760147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:27.777297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:25:27.782503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for user fc7f4b98dd3c48a8ad4418a3d73f5cb6 and project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:25:27.794496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:25:27.796800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:25:27.931536 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c7233da6-f97a-495e-8cb9-5b176e889fd3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.719897 Oct 11 05:25:27.932266 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3955/7677] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:25:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:25:27.943456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6f2c0920-99ff-4f1e-a83c-fec4d820d75a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:27.949313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6f2c0920-99ff-4f1e-a83c-fec4d820d75a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:28.001781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6f2c0920-99ff-4f1e-a83c-fec4d820d75a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:28.008868 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6f2c0920-99ff-4f1e-a83c-fec4d820d75a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1237 microversion: 2.1 time: 0.069173 Oct 11 05:25:28.010010 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3723/7678] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:27 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:29.033831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-37a32396-9840-4fba-b8d2-01975fc03b62 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:29.034490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-37a32396-9840-4fba-b8d2-01975fc03b62 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:29.088180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-37a32396-9840-4fba-b8d2-01975fc03b62 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:29.095158 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-37a32396-9840-4fba-b8d2-01975fc03b62 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1237 microversion: 2.1 time: 0.066215 Oct 11 05:25:29.095725 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3956/7679] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:29 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1237 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:30.118760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7f44f08d-7f4d-4c8d-bef6-51065e81813f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:30.119908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7f44f08d-7f4d-4c8d-bef6-51065e81813f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:30.127552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f44f08d-7f4d-4c8d-bef6-51065e81813f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:30.128036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f44f08d-7f4d-4c8d-bef6-51065e81813f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:30.128476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f44f08d-7f4d-4c8d-bef6-51065e81813f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:30.129165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f44f08d-7f4d-4c8d-bef6-51065e81813f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:30.129619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f44f08d-7f4d-4c8d-bef6-51065e81813f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:30.130048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f44f08d-7f4d-4c8d-bef6-51065e81813f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:30.191504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7f44f08d-7f4d-4c8d-bef6-51065e81813f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:30.199491 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7f44f08d-7f4d-4c8d-bef6-51065e81813f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1233 microversion: 2.1 time: 0.084641 Oct 11 05:25:30.200057 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3724/7680] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:30 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1233 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:31.223595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3d666f10-8149-4312-b236-52ec37189b38 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:31.224340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3d666f10-8149-4312-b236-52ec37189b38 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:31.231221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d666f10-8149-4312-b236-52ec37189b38 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:31.231823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d666f10-8149-4312-b236-52ec37189b38 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:31.232284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d666f10-8149-4312-b236-52ec37189b38 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:31.233007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d666f10-8149-4312-b236-52ec37189b38 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:31.233476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d666f10-8149-4312-b236-52ec37189b38 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:31.233918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3d666f10-8149-4312-b236-52ec37189b38 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:31.311678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3d666f10-8149-4312-b236-52ec37189b38 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:31.319608 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3d666f10-8149-4312-b236-52ec37189b38 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1295 microversion: 2.1 time: 0.100120 Oct 11 05:25:31.320229 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3957/7681] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:31 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:32.343847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f6449367-5794-4198-b186-7322115d88d4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:32.344464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f6449367-5794-4198-b186-7322115d88d4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:32.351340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6449367-5794-4198-b186-7322115d88d4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:32.351817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6449367-5794-4198-b186-7322115d88d4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:32.352250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6449367-5794-4198-b186-7322115d88d4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:32.352940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6449367-5794-4198-b186-7322115d88d4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:32.353388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6449367-5794-4198-b186-7322115d88d4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:32.353812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f6449367-5794-4198-b186-7322115d88d4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:32.483290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f6449367-5794-4198-b186-7322115d88d4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:32.491047 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f6449367-5794-4198-b186-7322115d88d4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1362 microversion: 2.1 time: 0.151034 Oct 11 05:25:32.494161 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3725/7682] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:32 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:32.603538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a2b9aac4-0cdc-4c37-8707-513df5362d59 req-f32f647b-7c0d-49b7-9619-78e37c4dac08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba307a2-f5d0-4916-a85f-12ada5f18583", "tag": "d84c9a4b-822d-46a8-92c0-f2675171ea6b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:25:32.614494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a2b9aac4-0cdc-4c37-8707-513df5362d59 req-f32f647b-7c0d-49b7-9619-78e37c4dac08 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:32.615191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a2b9aac4-0cdc-4c37-8707-513df5362d59 req-f32f647b-7c0d-49b7-9619-78e37c4dac08 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:32.615777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a2b9aac4-0cdc-4c37-8707-513df5362d59 req-f32f647b-7c0d-49b7-9619-78e37c4dac08 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:32.626869 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a2b9aac4-0cdc-4c37-8707-513df5362d59 req-f32f647b-7c0d-49b7-9619-78e37c4dac08 service nova] Creating event network-changed:d84c9a4b-822d-46a8-92c0-f2675171ea6b for instance aba307a2-f5d0-4916-a85f-12ada5f18583 on n-h1-860892-1 Oct 11 05:25:32.632586 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a2b9aac4-0cdc-4c37-8707-513df5362d59 req-f32f647b-7c0d-49b7-9619-78e37c4dac08 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034038 Oct 11 05:25:32.633197 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3958/7683] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:25:33.513844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2a6f8d52-039f-4f58-870b-58b1b3c2ab0f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:33.514610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2a6f8d52-039f-4f58-870b-58b1b3c2ab0f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:33.521520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6f8d52-039f-4f58-870b-58b1b3c2ab0f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:33.522005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6f8d52-039f-4f58-870b-58b1b3c2ab0f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:33.522472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6f8d52-039f-4f58-870b-58b1b3c2ab0f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:33.523167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6f8d52-039f-4f58-870b-58b1b3c2ab0f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:33.523617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6f8d52-039f-4f58-870b-58b1b3c2ab0f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:33.524040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2a6f8d52-039f-4f58-870b-58b1b3c2ab0f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:33.655746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2a6f8d52-039f-4f58-870b-58b1b3c2ab0f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:33.663343 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2a6f8d52-039f-4f58-870b-58b1b3c2ab0f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1362 microversion: 2.1 time: 0.153466 Oct 11 05:25:33.663910 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3726/7684] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:33 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:34.686987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8132cf13-8020-498d-8a0b-a123db0ece4a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:34.687636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8132cf13-8020-498d-8a0b-a123db0ece4a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:34.694821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8132cf13-8020-498d-8a0b-a123db0ece4a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:34.695322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8132cf13-8020-498d-8a0b-a123db0ece4a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:34.695778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8132cf13-8020-498d-8a0b-a123db0ece4a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:34.696485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8132cf13-8020-498d-8a0b-a123db0ece4a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:34.696961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8132cf13-8020-498d-8a0b-a123db0ece4a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:34.697403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8132cf13-8020-498d-8a0b-a123db0ece4a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:34.827298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8132cf13-8020-498d-8a0b-a123db0ece4a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:34.835118 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8132cf13-8020-498d-8a0b-a123db0ece4a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1362 microversion: 2.1 time: 0.152543 Oct 11 05:25:34.835685 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3959/7685] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:34 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:35.859182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6c11457b-3a86-4cce-8bf9-8dd04df1a86b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:35.859800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6c11457b-3a86-4cce-8bf9-8dd04df1a86b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:35.866117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c11457b-3a86-4cce-8bf9-8dd04df1a86b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:35.866640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c11457b-3a86-4cce-8bf9-8dd04df1a86b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:35.867082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c11457b-3a86-4cce-8bf9-8dd04df1a86b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:35.867773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c11457b-3a86-4cce-8bf9-8dd04df1a86b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:35.868227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c11457b-3a86-4cce-8bf9-8dd04df1a86b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:35.868657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c11457b-3a86-4cce-8bf9-8dd04df1a86b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:35.997899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6c11457b-3a86-4cce-8bf9-8dd04df1a86b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:36.005733 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6c11457b-3a86-4cce-8bf9-8dd04df1a86b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1362 microversion: 2.1 time: 0.150935 Oct 11 05:25:36.006334 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3727/7686] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:35 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:37.029089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-07ee7a11-7056-4d18-b188-1951daf94f89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:37.029725 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-07ee7a11-7056-4d18-b188-1951daf94f89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:37.036647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07ee7a11-7056-4d18-b188-1951daf94f89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:37.037159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07ee7a11-7056-4d18-b188-1951daf94f89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:37.037617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07ee7a11-7056-4d18-b188-1951daf94f89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:37.038357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07ee7a11-7056-4d18-b188-1951daf94f89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:37.038867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07ee7a11-7056-4d18-b188-1951daf94f89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:37.039313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-07ee7a11-7056-4d18-b188-1951daf94f89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:37.171619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-07ee7a11-7056-4d18-b188-1951daf94f89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:37.179539 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-07ee7a11-7056-4d18-b188-1951daf94f89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1362 microversion: 2.1 time: 0.154447 Oct 11 05:25:37.180117 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3960/7687] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:37 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:25:38.203843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9d6d10c-829c-45c5-a232-2532befe3b4e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:38.204457 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9d6d10c-829c-45c5-a232-2532befe3b4e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:38.207155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:25:38.211930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d6d10c-829c-45c5-a232-2532befe3b4e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:38.212405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d6d10c-829c-45c5-a232-2532befe3b4e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:38.212869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d6d10c-829c-45c5-a232-2532befe3b4e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:38.213525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d6d10c-829c-45c5-a232-2532befe3b4e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:38.213976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d6d10c-829c-45c5-a232-2532befe3b4e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:38.214466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9d6d10c-829c-45c5-a232-2532befe3b4e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:38.346754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b9d6d10c-829c-45c5-a232-2532befe3b4e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:38.354376 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b9d6d10c-829c-45c5-a232-2532befe3b4e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1362 microversion: 2.1 time: 0.154479 Oct 11 05:25:38.355000 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3728/7688] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:38 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:39.377644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4f3831f9-e26a-4fad-827f-ca3bf912be1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:39.378295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4f3831f9-e26a-4fad-827f-ca3bf912be1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:39.380265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:25:39.381800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:25:39.386647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f3831f9-e26a-4fad-827f-ca3bf912be1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:39.387144 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f3831f9-e26a-4fad-827f-ca3bf912be1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:39.387598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f3831f9-e26a-4fad-827f-ca3bf912be1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:39.388303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f3831f9-e26a-4fad-827f-ca3bf912be1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:39.388772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f3831f9-e26a-4fad-827f-ca3bf912be1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:39.389216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4f3831f9-e26a-4fad-827f-ca3bf912be1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:39.520345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4f3831f9-e26a-4fad-827f-ca3bf912be1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:39.528311 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4f3831f9-e26a-4fad-827f-ca3bf912be1c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1362 microversion: 2.1 time: 0.154104 Oct 11 05:25:39.528879 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3961/7689] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:39 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:40.551458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-434b900b-983b-46a2-89ad-8b9accc4c4b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:40.552064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-434b900b-983b-46a2-89ad-8b9accc4c4b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:40.558942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-434b900b-983b-46a2-89ad-8b9accc4c4b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:40.559414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-434b900b-983b-46a2-89ad-8b9accc4c4b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:40.559844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-434b900b-983b-46a2-89ad-8b9accc4c4b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:40.560522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-434b900b-983b-46a2-89ad-8b9accc4c4b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:40.561011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-434b900b-983b-46a2-89ad-8b9accc4c4b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:40.561430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-434b900b-983b-46a2-89ad-8b9accc4c4b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:40.694396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-434b900b-983b-46a2-89ad-8b9accc4c4b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:40.702409 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-434b900b-983b-46a2-89ad-8b9accc4c4b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1362 microversion: 2.1 time: 0.154940 Oct 11 05:25:40.702999 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3729/7690] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:40 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:40.723863 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e93d581f-736b-46cf-b904-d273c0441b03 req-7c9443a9-ca6c-4536-bb4d-621f9d73688f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba307a2-f5d0-4916-a85f-12ada5f18583", "name": "network-vif-plugged", "status": "completed", "tag": "d84c9a4b-822d-46a8-92c0-f2675171ea6b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:25:40.734339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e93d581f-736b-46cf-b904-d273c0441b03 req-7c9443a9-ca6c-4536-bb4d-621f9d73688f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:40.734833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e93d581f-736b-46cf-b904-d273c0441b03 req-7c9443a9-ca6c-4536-bb4d-621f9d73688f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:40.735282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e93d581f-736b-46cf-b904-d273c0441b03 req-7c9443a9-ca6c-4536-bb4d-621f9d73688f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:40.747232 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e93d581f-736b-46cf-b904-d273c0441b03 req-7c9443a9-ca6c-4536-bb4d-621f9d73688f service nova] Creating event network-vif-plugged:d84c9a4b-822d-46a8-92c0-f2675171ea6b for instance aba307a2-f5d0-4916-a85f-12ada5f18583 on n-h1-860892-1 Oct 11 05:25:40.752150 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e93d581f-736b-46cf-b904-d273c0441b03 req-7c9443a9-ca6c-4536-bb4d-621f9d73688f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032240 Oct 11 05:25:40.752730 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3962/7691] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:25:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:25:41.726389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fd579d33-c866-45b6-9727-2fc7652315ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:41.726995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fd579d33-c866-45b6-9727-2fc7652315ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:41.734380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd579d33-c866-45b6-9727-2fc7652315ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:41.734855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd579d33-c866-45b6-9727-2fc7652315ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:41.735284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd579d33-c866-45b6-9727-2fc7652315ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:41.735957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd579d33-c866-45b6-9727-2fc7652315ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:41.736403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd579d33-c866-45b6-9727-2fc7652315ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:41.736818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fd579d33-c866-45b6-9727-2fc7652315ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:41.872289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fd579d33-c866-45b6-9727-2fc7652315ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:41.880380 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fd579d33-c866-45b6-9727-2fc7652315ec tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1362 microversion: 2.1 time: 0.157790 Oct 11 05:25:41.880970 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3730/7692] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:41 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:42.907469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ccb48589-3040-4192-8c8a-8a5a6284abf9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:42.908184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ccb48589-3040-4192-8c8a-8a5a6284abf9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:42.914589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb48589-3040-4192-8c8a-8a5a6284abf9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:42.915628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb48589-3040-4192-8c8a-8a5a6284abf9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:42.915628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb48589-3040-4192-8c8a-8a5a6284abf9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:42.916257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb48589-3040-4192-8c8a-8a5a6284abf9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:42.916720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb48589-3040-4192-8c8a-8a5a6284abf9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:42.917165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccb48589-3040-4192-8c8a-8a5a6284abf9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:43.050341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ccb48589-3040-4192-8c8a-8a5a6284abf9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:25:43.059512 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ccb48589-3040-4192-8c8a-8a5a6284abf9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1549 microversion: 2.1 time: 0.157969 Oct 11 05:25:43.060118 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3963/7693] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:25:42 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1549 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:25:43.082584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9097c3e1-1a31-471a-b0a0-d0acd5f1bd89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:25:43.083098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9097c3e1-1a31-471a-b0a0-d0acd5f1bd89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:25:43.090369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9097c3e1-1a31-471a-b0a0-d0acd5f1bd89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:43.090853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9097c3e1-1a31-471a-b0a0-d0acd5f1bd89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:43.091293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9097c3e1-1a31-471a-b0a0-d0acd5f1bd89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:43.091980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9097c3e1-1a31-471a-b0a0-d0acd5f1bd89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:43.092432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9097c3e1-1a31-471a-b0a0-d0acd5f1bd89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:43.092858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9097c3e1-1a31-471a-b0a0-d0acd5f1bd89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:43.171973 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9097c3e1-1a31-471a-b0a0-d0acd5f1bd89 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093365 Oct 11 05:25:43.172575 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3731/7694] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 05:25:43 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:25:44.192706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c38828a0-0e3a-44cd-81ca-9fc4ab4aaef4 req-6a5509b1-0855-47dc-bd54-a252a8cd4a61 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba307a2-f5d0-4916-a85f-12ada5f18583", "tag": "d84c9a4b-822d-46a8-92c0-f2675171ea6b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:25:44.203128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c38828a0-0e3a-44cd-81ca-9fc4ab4aaef4 req-6a5509b1-0855-47dc-bd54-a252a8cd4a61 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:25:44.203628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c38828a0-0e3a-44cd-81ca-9fc4ab4aaef4 req-6a5509b1-0855-47dc-bd54-a252a8cd4a61 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:25:44.204086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c38828a0-0e3a-44cd-81ca-9fc4ab4aaef4 req-6a5509b1-0855-47dc-bd54-a252a8cd4a61 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:25:44.215780 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c38828a0-0e3a-44cd-81ca-9fc4ab4aaef4 req-6a5509b1-0855-47dc-bd54-a252a8cd4a61 service nova] Creating event network-changed:d84c9a4b-822d-46a8-92c0-f2675171ea6b for instance aba307a2-f5d0-4916-a85f-12ada5f18583 on n-h1-860892-1 Oct 11 05:25:44.220943 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c38828a0-0e3a-44cd-81ca-9fc4ab4aaef4 req-6a5509b1-0855-47dc-bd54-a252a8cd4a61 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031946 Oct 11 05:25:44.221764 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3964/7695] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:25:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:26:57.503508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=37 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:26:57.504264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=92 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:26:57.505612 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:26:57.505741 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:26:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 (ip 10.222.0.26) !!! Oct 11 05:26:57.510873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-01d893ba-91a3-44e6-baa4-e652cfc4bf88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:26:57.511480 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-01d893ba-91a3-44e6-baa4-e652cfc4bf88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:26:57.518882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01d893ba-91a3-44e6-baa4-e652cfc4bf88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:26:57.519360 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01d893ba-91a3-44e6-baa4-e652cfc4bf88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:26:57.519791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01d893ba-91a3-44e6-baa4-e652cfc4bf88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:26:57.520479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01d893ba-91a3-44e6-baa4-e652cfc4bf88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:26:57.520928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01d893ba-91a3-44e6-baa4-e652cfc4bf88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:26:57.521347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01d893ba-91a3-44e6-baa4-e652cfc4bf88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:26:57.698523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-01d893ba-91a3-44e6-baa4-e652cfc4bf88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:26:57.706178 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-01d893ba-91a3-44e6-baa4-e652cfc4bf88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1668 microversion: 2.1 time: 0.205787 Oct 11 05:26:57.706772 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3732/7696] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:26:57 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1668 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:26:57.727365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:26:57.728336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:26:57.729638 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:26:57.729786 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:26:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/os-volume_attachments (ip 10.222.0.26) !!! Oct 11 05:26:57.734490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c854bff-d53a-44ef-9d45-88a1b536784b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "51362ea4-32e2-4231-9e20-deb79711b740"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:26:57.743749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6c854bff-d53a-44ef-9d45-88a1b536784b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:26:57.744841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c854bff-d53a-44ef-9d45-88a1b536784b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:26:57.745342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c854bff-d53a-44ef-9d45-88a1b536784b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:26:57.745796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c854bff-d53a-44ef-9d45-88a1b536784b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:26:57.746530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c854bff-d53a-44ef-9d45-88a1b536784b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:26:57.746999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c854bff-d53a-44ef-9d45-88a1b536784b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:26:57.747443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c854bff-d53a-44ef-9d45-88a1b536784b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:26:58.433560 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6c854bff-d53a-44ef-9d45-88a1b536784b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.708268 Oct 11 05:26:58.434163 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3965/7697] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 05:26:57 2022] POST /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/os-volume_attachments => generated 194 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:27:10.194023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:27:10.196270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:10.198523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:27:10.199158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:27:10.204294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:10.204853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:10.205256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:10.205936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:10.206411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:10.211361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:10.247097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:10.253463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Old instance type m1.heat2, new instance type m1.heat {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 05:27:10.260470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:27:10.260890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:27:10.261367 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:27:10.261775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:27:10.262203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:27:10.432282 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0811dee9-06e0-4953-b377-f5d02203c0c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/action" status: 202 len: 0 microversion: 2.1 time: 0.242100 Oct 11 05:27:10.433141 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3733/7698] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:27:10 2022] POST /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/action => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:27:10.440117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:27:10.440893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:27:10.445190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-02c6db4f-56b8-4afe-ae76-1123d340e3be tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:10.445647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-02c6db4f-56b8-4afe-ae76-1123d340e3be tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:10.451750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02c6db4f-56b8-4afe-ae76-1123d340e3be tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:10.452247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02c6db4f-56b8-4afe-ae76-1123d340e3be tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:10.452699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02c6db4f-56b8-4afe-ae76-1123d340e3be tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:10.453405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02c6db4f-56b8-4afe-ae76-1123d340e3be tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:10.454555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02c6db4f-56b8-4afe-ae76-1123d340e3be tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:10.455001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02c6db4f-56b8-4afe-ae76-1123d340e3be tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:10.614940 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-02c6db4f-56b8-4afe-ae76-1123d340e3be tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:10.623503 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-02c6db4f-56b8-4afe-ae76-1123d340e3be tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1723 microversion: 2.1 time: 0.185858 Oct 11 05:27:10.624098 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3966/7699] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:10 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:11.649230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bb6cfbac-159d-49d9-9459-cf28942026fc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:11.649928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bb6cfbac-159d-49d9-9459-cf28942026fc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:11.657438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb6cfbac-159d-49d9-9459-cf28942026fc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:11.657912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb6cfbac-159d-49d9-9459-cf28942026fc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:11.658383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb6cfbac-159d-49d9-9459-cf28942026fc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:11.659679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb6cfbac-159d-49d9-9459-cf28942026fc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:11.660139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb6cfbac-159d-49d9-9459-cf28942026fc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:11.660724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bb6cfbac-159d-49d9-9459-cf28942026fc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:11.791107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bb6cfbac-159d-49d9-9459-cf28942026fc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:11.799298 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bb6cfbac-159d-49d9-9459-cf28942026fc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1723 microversion: 2.1 time: 0.154786 Oct 11 05:27:11.799871 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3734/7700] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:11 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:12.823980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-14e091d2-5965-4bc0-b234-20c3537e41e3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:12.846679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-14e091d2-5965-4bc0-b234-20c3537e41e3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:12.846679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14e091d2-5965-4bc0-b234-20c3537e41e3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:12.846679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14e091d2-5965-4bc0-b234-20c3537e41e3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:12.846679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14e091d2-5965-4bc0-b234-20c3537e41e3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:12.846679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14e091d2-5965-4bc0-b234-20c3537e41e3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:12.846679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14e091d2-5965-4bc0-b234-20c3537e41e3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:12.846679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14e091d2-5965-4bc0-b234-20c3537e41e3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:13.036106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-14e091d2-5965-4bc0-b234-20c3537e41e3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:13.044760 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-14e091d2-5965-4bc0-b234-20c3537e41e3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1723 microversion: 2.1 time: 0.224857 Oct 11 05:27:13.045425 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3967/7701] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:12 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:14.068658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-59f702f7-695a-44f8-9183-abea10249167 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:14.069277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-59f702f7-695a-44f8-9183-abea10249167 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:14.076195 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59f702f7-695a-44f8-9183-abea10249167 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:14.076675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59f702f7-695a-44f8-9183-abea10249167 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:14.077113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59f702f7-695a-44f8-9183-abea10249167 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:14.077803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59f702f7-695a-44f8-9183-abea10249167 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:14.078285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59f702f7-695a-44f8-9183-abea10249167 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:14.078715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-59f702f7-695a-44f8-9183-abea10249167 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:14.216376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-59f702f7-695a-44f8-9183-abea10249167 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:14.224893 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-59f702f7-695a-44f8-9183-abea10249167 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.160179 Oct 11 05:27:14.225466 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3735/7702] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:14 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:15.251954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6cfaf169-464f-4ffe-bb33-6231fa96e2bc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:15.252586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6cfaf169-464f-4ffe-bb33-6231fa96e2bc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:15.259437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cfaf169-464f-4ffe-bb33-6231fa96e2bc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:15.259934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cfaf169-464f-4ffe-bb33-6231fa96e2bc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:15.260387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cfaf169-464f-4ffe-bb33-6231fa96e2bc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:15.261090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cfaf169-464f-4ffe-bb33-6231fa96e2bc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:15.261559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cfaf169-464f-4ffe-bb33-6231fa96e2bc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:15.262001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6cfaf169-464f-4ffe-bb33-6231fa96e2bc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:15.389645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6cfaf169-464f-4ffe-bb33-6231fa96e2bc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:15.398662 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6cfaf169-464f-4ffe-bb33-6231fa96e2bc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.150688 Oct 11 05:27:15.399234 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3968/7703] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:15 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:16.422927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-372c5b9c-fe49-4d0b-8f3b-5de2ec01e85d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:16.423537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-372c5b9c-fe49-4d0b-8f3b-5de2ec01e85d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:16.430912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c5b9c-fe49-4d0b-8f3b-5de2ec01e85d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:16.431385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c5b9c-fe49-4d0b-8f3b-5de2ec01e85d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:16.431815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c5b9c-fe49-4d0b-8f3b-5de2ec01e85d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:16.432490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c5b9c-fe49-4d0b-8f3b-5de2ec01e85d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:16.432933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c5b9c-fe49-4d0b-8f3b-5de2ec01e85d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:16.433350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-372c5b9c-fe49-4d0b-8f3b-5de2ec01e85d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:16.832370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-372c5b9c-fe49-4d0b-8f3b-5de2ec01e85d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:16.840534 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-372c5b9c-fe49-4d0b-8f3b-5de2ec01e85d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.421465 Oct 11 05:27:16.850561 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3736/7704] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:16 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:17.871342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f5f315a8-e1af-4fea-a856-7e1167fea075 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:17.872007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f5f315a8-e1af-4fea-a856-7e1167fea075 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:17.879113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f315a8-e1af-4fea-a856-7e1167fea075 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:17.880451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f315a8-e1af-4fea-a856-7e1167fea075 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:17.880451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f315a8-e1af-4fea-a856-7e1167fea075 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:17.880842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f315a8-e1af-4fea-a856-7e1167fea075 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:17.881316 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f315a8-e1af-4fea-a856-7e1167fea075 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:17.881765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f5f315a8-e1af-4fea-a856-7e1167fea075 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:18.014004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f5f315a8-e1af-4fea-a856-7e1167fea075 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:18.022743 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f5f315a8-e1af-4fea-a856-7e1167fea075 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.155445 Oct 11 05:27:18.023314 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3969/7705] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:17 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:19.046715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b564bcab-6e24-4165-b963-8105f4e5f100 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:19.047249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b564bcab-6e24-4165-b963-8105f4e5f100 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:19.054481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b564bcab-6e24-4165-b963-8105f4e5f100 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:19.054956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b564bcab-6e24-4165-b963-8105f4e5f100 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:19.055392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b564bcab-6e24-4165-b963-8105f4e5f100 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:19.056072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b564bcab-6e24-4165-b963-8105f4e5f100 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:19.056518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b564bcab-6e24-4165-b963-8105f4e5f100 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:19.056964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b564bcab-6e24-4165-b963-8105f4e5f100 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:19.183144 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b564bcab-6e24-4165-b963-8105f4e5f100 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:19.192072 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b564bcab-6e24-4165-b963-8105f4e5f100 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.149310 Oct 11 05:27:19.192711 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3737/7706] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:19 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:20.215324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dd9561e7-453d-49f9-bdd7-68c59f81b08f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:20.215957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dd9561e7-453d-49f9-bdd7-68c59f81b08f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:20.222769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd9561e7-453d-49f9-bdd7-68c59f81b08f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:20.223266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd9561e7-453d-49f9-bdd7-68c59f81b08f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:20.223718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd9561e7-453d-49f9-bdd7-68c59f81b08f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:20.224487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd9561e7-453d-49f9-bdd7-68c59f81b08f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:20.224955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd9561e7-453d-49f9-bdd7-68c59f81b08f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:20.225393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dd9561e7-453d-49f9-bdd7-68c59f81b08f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:20.356910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dd9561e7-453d-49f9-bdd7-68c59f81b08f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:20.365362 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dd9561e7-453d-49f9-bdd7-68c59f81b08f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.153955 Oct 11 05:27:20.365866 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3970/7707] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:20 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:21.388953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7df17240-bbb7-4d43-af92-c1cf1ccb7478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:21.389566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7df17240-bbb7-4d43-af92-c1cf1ccb7478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:21.397199 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7df17240-bbb7-4d43-af92-c1cf1ccb7478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:21.397676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7df17240-bbb7-4d43-af92-c1cf1ccb7478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:21.398110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7df17240-bbb7-4d43-af92-c1cf1ccb7478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:21.398826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7df17240-bbb7-4d43-af92-c1cf1ccb7478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:21.399281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7df17240-bbb7-4d43-af92-c1cf1ccb7478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:21.399705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7df17240-bbb7-4d43-af92-c1cf1ccb7478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:21.532244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7df17240-bbb7-4d43-af92-c1cf1ccb7478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:21.541064 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7df17240-bbb7-4d43-af92-c1cf1ccb7478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.155989 Oct 11 05:27:21.541718 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3738/7708] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:21 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:22.566424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5e554136-82ee-4258-b999-992bd17b8acc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:22.567053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5e554136-82ee-4258-b999-992bd17b8acc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:22.574050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e554136-82ee-4258-b999-992bd17b8acc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:22.574580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e554136-82ee-4258-b999-992bd17b8acc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:22.575032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e554136-82ee-4258-b999-992bd17b8acc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:22.575733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e554136-82ee-4258-b999-992bd17b8acc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:22.576203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e554136-82ee-4258-b999-992bd17b8acc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:22.576646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5e554136-82ee-4258-b999-992bd17b8acc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:22.706014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5e554136-82ee-4258-b999-992bd17b8acc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:22.714902 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5e554136-82ee-4258-b999-992bd17b8acc tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.152408 Oct 11 05:27:22.715479 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3971/7709] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:22 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:23.740497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-562f8000-cae3-4ca2-b144-c2d40534413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:23.741114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-562f8000-cae3-4ca2-b144-c2d40534413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:23.748103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-562f8000-cae3-4ca2-b144-c2d40534413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:23.748541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-562f8000-cae3-4ca2-b144-c2d40534413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:23.748983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-562f8000-cae3-4ca2-b144-c2d40534413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:23.749677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-562f8000-cae3-4ca2-b144-c2d40534413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:23.750129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-562f8000-cae3-4ca2-b144-c2d40534413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:23.750581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-562f8000-cae3-4ca2-b144-c2d40534413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:23.877886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-562f8000-cae3-4ca2-b144-c2d40534413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:23.886173 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-562f8000-cae3-4ca2-b144-c2d40534413b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.150069 Oct 11 05:27:23.886817 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3739/7710] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:23 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:24.910014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-821f2967-f4b3-49dd-8cf2-449049cc6ca3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:24.910694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-821f2967-f4b3-49dd-8cf2-449049cc6ca3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:24.917530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f2967-f4b3-49dd-8cf2-449049cc6ca3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:24.918024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f2967-f4b3-49dd-8cf2-449049cc6ca3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:24.918522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f2967-f4b3-49dd-8cf2-449049cc6ca3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:24.919249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f2967-f4b3-49dd-8cf2-449049cc6ca3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:24.919698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f2967-f4b3-49dd-8cf2-449049cc6ca3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:24.920138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f2967-f4b3-49dd-8cf2-449049cc6ca3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:25.051428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-821f2967-f4b3-49dd-8cf2-449049cc6ca3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:25.060141 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-821f2967-f4b3-49dd-8cf2-449049cc6ca3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.154108 Oct 11 05:27:25.060716 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3972/7711] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:24 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:26.084567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-706c4198-a859-419e-9432-65b31be59d60 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:26.085192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-706c4198-a859-419e-9432-65b31be59d60 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:26.091940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-706c4198-a859-419e-9432-65b31be59d60 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:26.092421 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-706c4198-a859-419e-9432-65b31be59d60 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:26.092855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-706c4198-a859-419e-9432-65b31be59d60 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:26.093540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-706c4198-a859-419e-9432-65b31be59d60 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:26.093987 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-706c4198-a859-419e-9432-65b31be59d60 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:26.094433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-706c4198-a859-419e-9432-65b31be59d60 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:26.225274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-706c4198-a859-419e-9432-65b31be59d60 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:26.233703 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-706c4198-a859-419e-9432-65b31be59d60 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.153708 Oct 11 05:27:26.234287 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3740/7712] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:26 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:27.256659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-29afa10e-bf1a-4ea7-a994-4b0764012b11 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:27.257308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-29afa10e-bf1a-4ea7-a994-4b0764012b11 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:27.265227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29afa10e-bf1a-4ea7-a994-4b0764012b11 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:27.266167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29afa10e-bf1a-4ea7-a994-4b0764012b11 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:27.266821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29afa10e-bf1a-4ea7-a994-4b0764012b11 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:27.267877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29afa10e-bf1a-4ea7-a994-4b0764012b11 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:27.268489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29afa10e-bf1a-4ea7-a994-4b0764012b11 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:27.268934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-29afa10e-bf1a-4ea7-a994-4b0764012b11 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:27.408733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-29afa10e-bf1a-4ea7-a994-4b0764012b11 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:27.417838 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-29afa10e-bf1a-4ea7-a994-4b0764012b11 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.165285 Oct 11 05:27:27.418443 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3973/7713] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:27 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:28.441483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-19a619b7-ad22-4bee-b4e7-9f5fe5944777 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:28.442098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-19a619b7-ad22-4bee-b4e7-9f5fe5944777 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:28.448862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19a619b7-ad22-4bee-b4e7-9f5fe5944777 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:28.449342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19a619b7-ad22-4bee-b4e7-9f5fe5944777 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:28.449782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19a619b7-ad22-4bee-b4e7-9f5fe5944777 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:28.450499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19a619b7-ad22-4bee-b4e7-9f5fe5944777 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:28.450990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19a619b7-ad22-4bee-b4e7-9f5fe5944777 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:28.451414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-19a619b7-ad22-4bee-b4e7-9f5fe5944777 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:28.579843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-19a619b7-ad22-4bee-b4e7-9f5fe5944777 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:28.587994 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-19a619b7-ad22-4bee-b4e7-9f5fe5944777 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.150409 Oct 11 05:27:28.588562 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3741/7714] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:28 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:29.611702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c5df6620-8230-4076-952f-b4e80c297c92 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:29.612345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c5df6620-8230-4076-952f-b4e80c297c92 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:29.619710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5df6620-8230-4076-952f-b4e80c297c92 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:29.620211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5df6620-8230-4076-952f-b4e80c297c92 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:29.620664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5df6620-8230-4076-952f-b4e80c297c92 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:29.621476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5df6620-8230-4076-952f-b4e80c297c92 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:29.621952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5df6620-8230-4076-952f-b4e80c297c92 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:29.622423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c5df6620-8230-4076-952f-b4e80c297c92 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:29.754214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c5df6620-8230-4076-952f-b4e80c297c92 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:29.763182 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c5df6620-8230-4076-952f-b4e80c297c92 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.155539 Oct 11 05:27:29.763762 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3974/7715] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:29 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:30.786835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-91ee09e4-a5f4-45eb-bc78-a7b934da7954 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:30.787455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-91ee09e4-a5f4-45eb-bc78-a7b934da7954 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:30.794474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ee09e4-a5f4-45eb-bc78-a7b934da7954 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:30.794956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ee09e4-a5f4-45eb-bc78-a7b934da7954 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:30.795392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ee09e4-a5f4-45eb-bc78-a7b934da7954 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:30.796086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ee09e4-a5f4-45eb-bc78-a7b934da7954 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:30.796538 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ee09e4-a5f4-45eb-bc78-a7b934da7954 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:30.796963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91ee09e4-a5f4-45eb-bc78-a7b934da7954 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:30.929036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-91ee09e4-a5f4-45eb-bc78-a7b934da7954 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:30.937404 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-91ee09e4-a5f4-45eb-bc78-a7b934da7954 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.154517 Oct 11 05:27:30.937973 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3742/7716] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:30 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:27:31.961794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ec353b0e-c7df-466e-8fe2-259848829d5e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:31.962510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ec353b0e-c7df-466e-8fe2-259848829d5e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:31.969397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec353b0e-c7df-466e-8fe2-259848829d5e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:31.969911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec353b0e-c7df-466e-8fe2-259848829d5e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:31.970773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec353b0e-c7df-466e-8fe2-259848829d5e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:31.971155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec353b0e-c7df-466e-8fe2-259848829d5e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:31.972467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec353b0e-c7df-466e-8fe2-259848829d5e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:31.972923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec353b0e-c7df-466e-8fe2-259848829d5e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:32.191066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ec353b0e-c7df-466e-8fe2-259848829d5e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:32.200943 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ec353b0e-c7df-466e-8fe2-259848829d5e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1728 microversion: 2.1 time: 0.243687 Oct 11 05:27:32.201900 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3975/7717] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:31 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1728 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:33.225766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-83b2e74c-c631-48ca-990f-b960bc4c75c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:33.226867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-83b2e74c-c631-48ca-990f-b960bc4c75c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:33.234491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83b2e74c-c631-48ca-990f-b960bc4c75c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:33.235156 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83b2e74c-c631-48ca-990f-b960bc4c75c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:33.235710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83b2e74c-c631-48ca-990f-b960bc4c75c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:33.236488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83b2e74c-c631-48ca-990f-b960bc4c75c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:33.237324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83b2e74c-c631-48ca-990f-b960bc4c75c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:33.237825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83b2e74c-c631-48ca-990f-b960bc4c75c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:33.382143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-0af2647b-5e92-49b9-a17b-9ea4de39d9ae req-14ae2f7b-6ba7-4f2c-8c18-1c55cd823f5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba307a2-f5d0-4916-a85f-12ada5f18583", "name": "network-vif-unplugged", "status": "completed", "tag": "d84c9a4b-822d-46a8-92c0-f2675171ea6b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:27:33.384400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-83b2e74c-c631-48ca-990f-b960bc4c75c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:33.393587 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-83b2e74c-c631-48ca-990f-b960bc4c75c9 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1727 microversion: 2.1 time: 0.172313 Oct 11 05:27:33.398756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0af2647b-5e92-49b9-a17b-9ea4de39d9ae req-14ae2f7b-6ba7-4f2c-8c18-1c55cd823f5f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:33.398899 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3743/7718] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:33 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1727 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:33.399098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0af2647b-5e92-49b9-a17b-9ea4de39d9ae req-14ae2f7b-6ba7-4f2c-8c18-1c55cd823f5f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:33.399098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-0af2647b-5e92-49b9-a17b-9ea4de39d9ae req-14ae2f7b-6ba7-4f2c-8c18-1c55cd823f5f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:33.415395 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-0af2647b-5e92-49b9-a17b-9ea4de39d9ae req-14ae2f7b-6ba7-4f2c-8c18-1c55cd823f5f service nova] Creating event network-vif-unplugged:d84c9a4b-822d-46a8-92c0-f2675171ea6b for instance aba307a2-f5d0-4916-a85f-12ada5f18583 on n-h2-860892-1 Oct 11 05:27:33.421823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-0af2647b-5e92-49b9-a17b-9ea4de39d9ae req-14ae2f7b-6ba7-4f2c-8c18-1c55cd823f5f service nova] Instance aba307a2-f5d0-4916-a85f-12ada5f18583 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:27:33.433513 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-0af2647b-5e92-49b9-a17b-9ea4de39d9ae req-14ae2f7b-6ba7-4f2c-8c18-1c55cd823f5f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.054991 Oct 11 05:27:33.434114 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3976/7719] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:27:34.418755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b6428374-6b9b-4be3-8ee3-e634619d0b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:34.419411 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b6428374-6b9b-4be3-8ee3-e634619d0b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:34.425385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6428374-6b9b-4be3-8ee3-e634619d0b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:34.425872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6428374-6b9b-4be3-8ee3-e634619d0b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:34.426340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6428374-6b9b-4be3-8ee3-e634619d0b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:34.427066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6428374-6b9b-4be3-8ee3-e634619d0b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:34.427522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6428374-6b9b-4be3-8ee3-e634619d0b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:34.427953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b6428374-6b9b-4be3-8ee3-e634619d0b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:34.560307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b6428374-6b9b-4be3-8ee3-e634619d0b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:34.569354 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b6428374-6b9b-4be3-8ee3-e634619d0b04 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1727 microversion: 2.1 time: 0.154879 Oct 11 05:27:34.571928 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3744/7720] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:34 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:35.449485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a96bfda7-6433-43dd-bb51-dd22cf06ee5e req-6ada19e3-b07c-47e9-8685-793e5a711753 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba307a2-f5d0-4916-a85f-12ada5f18583", "tag": "d84c9a4b-822d-46a8-92c0-f2675171ea6b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:27:35.459846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a96bfda7-6433-43dd-bb51-dd22cf06ee5e req-6ada19e3-b07c-47e9-8685-793e5a711753 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:35.460410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a96bfda7-6433-43dd-bb51-dd22cf06ee5e req-6ada19e3-b07c-47e9-8685-793e5a711753 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:35.460924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a96bfda7-6433-43dd-bb51-dd22cf06ee5e req-6ada19e3-b07c-47e9-8685-793e5a711753 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:35.476660 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a96bfda7-6433-43dd-bb51-dd22cf06ee5e req-6ada19e3-b07c-47e9-8685-793e5a711753 service nova] Creating event network-changed:d84c9a4b-822d-46a8-92c0-f2675171ea6b for instance aba307a2-f5d0-4916-a85f-12ada5f18583 on n-h2-860892-1 Oct 11 05:27:35.482080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-a96bfda7-6433-43dd-bb51-dd22cf06ee5e req-6ada19e3-b07c-47e9-8685-793e5a711753 service nova] Instance aba307a2-f5d0-4916-a85f-12ada5f18583 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:27:35.492871 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a96bfda7-6433-43dd-bb51-dd22cf06ee5e req-6ada19e3-b07c-47e9-8685-793e5a711753 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048278 Oct 11 05:27:35.493490 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3977/7721] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:27:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:27:35.595181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0bb9ba48-2358-4ede-a3d0-4b858d2f95a8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:35.595797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0bb9ba48-2358-4ede-a3d0-4b858d2f95a8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:35.603871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb9ba48-2358-4ede-a3d0-4b858d2f95a8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:35.604322 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb9ba48-2358-4ede-a3d0-4b858d2f95a8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:35.604765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb9ba48-2358-4ede-a3d0-4b858d2f95a8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:35.605473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb9ba48-2358-4ede-a3d0-4b858d2f95a8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:35.605976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb9ba48-2358-4ede-a3d0-4b858d2f95a8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:35.606401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0bb9ba48-2358-4ede-a3d0-4b858d2f95a8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:35.747127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0bb9ba48-2358-4ede-a3d0-4b858d2f95a8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:35.756067 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0bb9ba48-2358-4ede-a3d0-4b858d2f95a8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1725 microversion: 2.1 time: 0.164858 Oct 11 05:27:35.757373 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3745/7722] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:35 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:36.782517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-591e1c52-b04d-4a1a-97f4-5e2c75cf0093 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:36.783920 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-591e1c52-b04d-4a1a-97f4-5e2c75cf0093 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:36.790872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-591e1c52-b04d-4a1a-97f4-5e2c75cf0093 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:36.791374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-591e1c52-b04d-4a1a-97f4-5e2c75cf0093 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:36.791825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-591e1c52-b04d-4a1a-97f4-5e2c75cf0093 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:36.792729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-591e1c52-b04d-4a1a-97f4-5e2c75cf0093 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:36.793369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-591e1c52-b04d-4a1a-97f4-5e2c75cf0093 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:36.793815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-591e1c52-b04d-4a1a-97f4-5e2c75cf0093 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:37.029365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-591e1c52-b04d-4a1a-97f4-5e2c75cf0093 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:37.038469 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-591e1c52-b04d-4a1a-97f4-5e2c75cf0093 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1725 microversion: 2.1 time: 0.261172 Oct 11 05:27:37.051327 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3978/7723] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:36 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1725 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:38.061716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c10c56a8-f678-4ecb-9a62-1f789675f3c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:38.062451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c10c56a8-f678-4ecb-9a62-1f789675f3c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:38.069314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c10c56a8-f678-4ecb-9a62-1f789675f3c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:38.069802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c10c56a8-f678-4ecb-9a62-1f789675f3c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:38.070264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c10c56a8-f678-4ecb-9a62-1f789675f3c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:38.070967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c10c56a8-f678-4ecb-9a62-1f789675f3c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:38.071425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c10c56a8-f678-4ecb-9a62-1f789675f3c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:38.071864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c10c56a8-f678-4ecb-9a62-1f789675f3c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:38.203241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c10c56a8-f678-4ecb-9a62-1f789675f3c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:38.211772 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c10c56a8-f678-4ecb-9a62-1f789675f3c1 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1725 microversion: 2.1 time: 0.154039 Oct 11 05:27:38.212334 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3746/7724] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:38 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:39.236033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-36e756d8-1930-46d2-baff-d406daaaa319 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:39.236669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-36e756d8-1930-46d2-baff-d406daaaa319 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:39.244208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e756d8-1930-46d2-baff-d406daaaa319 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:39.244904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e756d8-1930-46d2-baff-d406daaaa319 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:39.245362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e756d8-1930-46d2-baff-d406daaaa319 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:39.246096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e756d8-1930-46d2-baff-d406daaaa319 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:39.246593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e756d8-1930-46d2-baff-d406daaaa319 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:39.247034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-36e756d8-1930-46d2-baff-d406daaaa319 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:39.395139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-36e756d8-1930-46d2-baff-d406daaaa319 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:39.403965 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-36e756d8-1930-46d2-baff-d406daaaa319 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1725 microversion: 2.1 time: 0.172081 Oct 11 05:27:39.409016 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3979/7725] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:39 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1725 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:40.427775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-63e15193-de1e-4dbd-8a29-f0e60794450d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:40.428386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-63e15193-de1e-4dbd-8a29-f0e60794450d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:40.431023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=33 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:27:40.435797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63e15193-de1e-4dbd-8a29-f0e60794450d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:40.436274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63e15193-de1e-4dbd-8a29-f0e60794450d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:40.436704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63e15193-de1e-4dbd-8a29-f0e60794450d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:40.437383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63e15193-de1e-4dbd-8a29-f0e60794450d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:40.437830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63e15193-de1e-4dbd-8a29-f0e60794450d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:40.438275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-63e15193-de1e-4dbd-8a29-f0e60794450d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:40.442062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:27:40.572313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-63e15193-de1e-4dbd-8a29-f0e60794450d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:40.580697 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-63e15193-de1e-4dbd-8a29-f0e60794450d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1725 microversion: 2.1 time: 0.156765 Oct 11 05:27:40.581268 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3747/7726] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:40 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:41.604733 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cbca1a8b-b749-4cad-878f-f3ce015d23ad tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:41.605365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cbca1a8b-b749-4cad-878f-f3ce015d23ad tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:41.608211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=29 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:27:41.612999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbca1a8b-b749-4cad-878f-f3ce015d23ad tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:41.613489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbca1a8b-b749-4cad-878f-f3ce015d23ad tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:41.613936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbca1a8b-b749-4cad-878f-f3ce015d23ad tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:41.614665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbca1a8b-b749-4cad-878f-f3ce015d23ad tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:41.615629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbca1a8b-b749-4cad-878f-f3ce015d23ad tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:41.616066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cbca1a8b-b749-4cad-878f-f3ce015d23ad tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:41.618602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=81 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:27:41.749415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cbca1a8b-b749-4cad-878f-f3ce015d23ad tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:41.758355 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cbca1a8b-b749-4cad-878f-f3ce015d23ad tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1725 microversion: 2.1 time: 0.157566 Oct 11 05:27:41.758955 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3980/7727] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:41 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:42.782345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-70678211-589b-4c7c-9fea-8fb00b3c5107 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:42.782887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-70678211-589b-4c7c-9fea-8fb00b3c5107 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:42.789785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70678211-589b-4c7c-9fea-8fb00b3c5107 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:42.790299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70678211-589b-4c7c-9fea-8fb00b3c5107 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:42.790741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70678211-589b-4c7c-9fea-8fb00b3c5107 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:42.791432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70678211-589b-4c7c-9fea-8fb00b3c5107 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:42.791900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70678211-589b-4c7c-9fea-8fb00b3c5107 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:42.792307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-70678211-589b-4c7c-9fea-8fb00b3c5107 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:42.925669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-70678211-589b-4c7c-9fea-8fb00b3c5107 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:42.934499 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-70678211-589b-4c7c-9fea-8fb00b3c5107 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1725 microversion: 2.1 time: 0.156098 Oct 11 05:27:42.935073 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3748/7728] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:42 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:43.958399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7682e25c-4103-43dc-a2d8-328217da3fff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:43.959522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7682e25c-4103-43dc-a2d8-328217da3fff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:43.966568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7682e25c-4103-43dc-a2d8-328217da3fff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:43.967068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7682e25c-4103-43dc-a2d8-328217da3fff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:43.967517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7682e25c-4103-43dc-a2d8-328217da3fff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:43.968218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7682e25c-4103-43dc-a2d8-328217da3fff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:43.968681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7682e25c-4103-43dc-a2d8-328217da3fff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:43.969117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7682e25c-4103-43dc-a2d8-328217da3fff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:44.099019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7682e25c-4103-43dc-a2d8-328217da3fff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:44.107402 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7682e25c-4103-43dc-a2d8-328217da3fff tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1725 microversion: 2.1 time: 0.152963 Oct 11 05:27:44.107976 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3981/7729] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:43 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:45.187568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-99988281-fbcb-462a-a263-b50d7a23e8b6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:45.188131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-99988281-fbcb-462a-a263-b50d7a23e8b6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:45.195138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99988281-fbcb-462a-a263-b50d7a23e8b6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:45.196124 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99988281-fbcb-462a-a263-b50d7a23e8b6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:45.196554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99988281-fbcb-462a-a263-b50d7a23e8b6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:45.197233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99988281-fbcb-462a-a263-b50d7a23e8b6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:45.197681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99988281-fbcb-462a-a263-b50d7a23e8b6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:45.198101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-99988281-fbcb-462a-a263-b50d7a23e8b6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:45.325091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-99988281-fbcb-462a-a263-b50d7a23e8b6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:45.333353 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-99988281-fbcb-462a-a263-b50d7a23e8b6 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1725 microversion: 2.1 time: 0.149822 Oct 11 05:27:45.334455 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3749/7730] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:45 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:46.357866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-11164c9e-ecdc-4949-bdaf-bd79985adbb0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:46.358598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-11164c9e-ecdc-4949-bdaf-bd79985adbb0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:46.365976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11164c9e-ecdc-4949-bdaf-bd79985adbb0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:46.366503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11164c9e-ecdc-4949-bdaf-bd79985adbb0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:46.366955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11164c9e-ecdc-4949-bdaf-bd79985adbb0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:46.367652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11164c9e-ecdc-4949-bdaf-bd79985adbb0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:46.368116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11164c9e-ecdc-4949-bdaf-bd79985adbb0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:46.368551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11164c9e-ecdc-4949-bdaf-bd79985adbb0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:46.509308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-11164c9e-ecdc-4949-bdaf-bd79985adbb0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:46.520085 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-11164c9e-ecdc-4949-bdaf-bd79985adbb0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1725 microversion: 2.1 time: 0.166144 Oct 11 05:27:46.520660 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3982/7731] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:46 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:47.543651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e850dd5d-e6a2-4887-b186-48424c24b65a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:47.544266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e850dd5d-e6a2-4887-b186-48424c24b65a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:47.551101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e850dd5d-e6a2-4887-b186-48424c24b65a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:47.551577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e850dd5d-e6a2-4887-b186-48424c24b65a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:47.552015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e850dd5d-e6a2-4887-b186-48424c24b65a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:47.553196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e850dd5d-e6a2-4887-b186-48424c24b65a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:47.553648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e850dd5d-e6a2-4887-b186-48424c24b65a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:47.554076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e850dd5d-e6a2-4887-b186-48424c24b65a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:47.686962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e850dd5d-e6a2-4887-b186-48424c24b65a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:47.695907 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e850dd5d-e6a2-4887-b186-48424c24b65a tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1722 microversion: 2.1 time: 0.156163 Oct 11 05:27:47.696577 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3750/7732] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:47 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:47.718554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:27:47.719107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:47.725840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:47.726376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:47.726828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:47.727539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:47.728002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:47.728439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:47.769190 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:47.769683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:47.770133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:47.770891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:47.771392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:47.771826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:47.792071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:27:47.797301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Getting quotas for user fc7f4b98dd3c48a8ad4418a3d73f5cb6 and project 96aba3f066604fae934b975bfc28fdfe. Resources: {'cores', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:27:48.125231 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ca35a5f1-6e87-4a26-b23c-a43a4b5caf5f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "POST /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/action" status: 202 len: 0 microversion: 2.1 time: 0.410370 Oct 11 05:27:48.126057 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3983/7733] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:27:47 2022] POST /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/action => generated 0 bytes in 412 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:27:48.135766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b5ee8326-8158-437e-8ef7-5204403160c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:48.136574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b5ee8326-8158-437e-8ef7-5204403160c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:48.144202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5ee8326-8158-437e-8ef7-5204403160c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:48.144695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5ee8326-8158-437e-8ef7-5204403160c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:48.150284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5ee8326-8158-437e-8ef7-5204403160c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:48.150284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5ee8326-8158-437e-8ef7-5204403160c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:48.150284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5ee8326-8158-437e-8ef7-5204403160c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:48.150284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b5ee8326-8158-437e-8ef7-5204403160c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:48.282626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b5ee8326-8158-437e-8ef7-5204403160c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:48.290941 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b5ee8326-8158-437e-8ef7-5204403160c5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.160652 Oct 11 05:27:48.291517 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3751/7734] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:48 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:49.315528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e54ce51c-8ac5-4063-80af-cab8d7fe704f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:49.316243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e54ce51c-8ac5-4063-80af-cab8d7fe704f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:49.323323 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ce51c-8ac5-4063-80af-cab8d7fe704f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:49.323824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ce51c-8ac5-4063-80af-cab8d7fe704f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:49.324268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ce51c-8ac5-4063-80af-cab8d7fe704f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:49.324970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ce51c-8ac5-4063-80af-cab8d7fe704f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:49.325432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ce51c-8ac5-4063-80af-cab8d7fe704f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:49.325872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e54ce51c-8ac5-4063-80af-cab8d7fe704f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:49.454924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e54ce51c-8ac5-4063-80af-cab8d7fe704f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:49.463198 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e54ce51c-8ac5-4063-80af-cab8d7fe704f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.151986 Oct 11 05:27:49.463781 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3984/7735] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:49 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:49.966109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-703a544f-9fb7-4a57-bfbe-33cf3870c41c req-168efdce-4dad-4297-bcf5-7c9ddd284a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba307a2-f5d0-4916-a85f-12ada5f18583", "name": "network-vif-plugged", "status": "completed", "tag": "d84c9a4b-822d-46a8-92c0-f2675171ea6b"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:27:49.976244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-703a544f-9fb7-4a57-bfbe-33cf3870c41c req-168efdce-4dad-4297-bcf5-7c9ddd284a27 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:49.976710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-703a544f-9fb7-4a57-bfbe-33cf3870c41c req-168efdce-4dad-4297-bcf5-7c9ddd284a27 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:49.977165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-703a544f-9fb7-4a57-bfbe-33cf3870c41c req-168efdce-4dad-4297-bcf5-7c9ddd284a27 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:49.988833 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-703a544f-9fb7-4a57-bfbe-33cf3870c41c req-168efdce-4dad-4297-bcf5-7c9ddd284a27 service nova] Creating event network-vif-plugged:d84c9a4b-822d-46a8-92c0-f2675171ea6b for instance aba307a2-f5d0-4916-a85f-12ada5f18583 on n-h2-860892-1 Oct 11 05:27:49.994106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-703a544f-9fb7-4a57-bfbe-33cf3870c41c req-168efdce-4dad-4297-bcf5-7c9ddd284a27 service nova] Instance aba307a2-f5d0-4916-a85f-12ada5f18583 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:27:49.998839 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [req-703a544f-9fb7-4a57-bfbe-33cf3870c41c req-168efdce-4dad-4297-bcf5-7c9ddd284a27 service nova] [2f51e056-912b-4917-a025-c3d4eceaf4c4] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:27:50.488018 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-efa87718-166a-4a8f-96f2-1016fbee770d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:50.488658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-efa87718-166a-4a8f-96f2-1016fbee770d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:50.495739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa87718-166a-4a8f-96f2-1016fbee770d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:50.496245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa87718-166a-4a8f-96f2-1016fbee770d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:50.496694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa87718-166a-4a8f-96f2-1016fbee770d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:50.497412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa87718-166a-4a8f-96f2-1016fbee770d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:50.497876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa87718-166a-4a8f-96f2-1016fbee770d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:50.498341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa87718-166a-4a8f-96f2-1016fbee770d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:50.644435 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-efa87718-166a-4a8f-96f2-1016fbee770d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:50.653132 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-efa87718-166a-4a8f-96f2-1016fbee770d tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.169350 Oct 11 05:27:50.653650 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3985/7736] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:50 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:27:51.006547 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [req-703a544f-9fb7-4a57-bfbe-33cf3870c41c req-168efdce-4dad-4297-bcf5-7c9ddd284a27 service nova] [2f51e056-912b-4917-a025-c3d4eceaf4c4] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 38214. Oct 11 05:27:51.014850 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-703a544f-9fb7-4a57-bfbe-33cf3870c41c req-168efdce-4dad-4297-bcf5-7c9ddd284a27 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.100322 Oct 11 05:27:51.015458 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3752/7737] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:27:51.676871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb90ebff-33ad-4f67-b61a-a23b8602502f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:51.678044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb90ebff-33ad-4f67-b61a-a23b8602502f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:51.685056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb90ebff-33ad-4f67-b61a-a23b8602502f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:51.685546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb90ebff-33ad-4f67-b61a-a23b8602502f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:51.685989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb90ebff-33ad-4f67-b61a-a23b8602502f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:51.686716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb90ebff-33ad-4f67-b61a-a23b8602502f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:51.687181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb90ebff-33ad-4f67-b61a-a23b8602502f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:51.687618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb90ebff-33ad-4f67-b61a-a23b8602502f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:51.820048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-eb90ebff-33ad-4f67-b61a-a23b8602502f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:51.828667 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb90ebff-33ad-4f67-b61a-a23b8602502f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.155674 Oct 11 05:27:51.829247 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3986/7738] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:51 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:52.853621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d06169ce-139f-4c84-a87e-5c5bb35fac19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:52.854432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d06169ce-139f-4c84-a87e-5c5bb35fac19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:52.860527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d06169ce-139f-4c84-a87e-5c5bb35fac19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:52.861069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d06169ce-139f-4c84-a87e-5c5bb35fac19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:52.861515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d06169ce-139f-4c84-a87e-5c5bb35fac19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:52.862283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d06169ce-139f-4c84-a87e-5c5bb35fac19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:52.862743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d06169ce-139f-4c84-a87e-5c5bb35fac19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:52.863171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d06169ce-139f-4c84-a87e-5c5bb35fac19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:53.001545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d06169ce-139f-4c84-a87e-5c5bb35fac19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:53.010306 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d06169ce-139f-4c84-a87e-5c5bb35fac19 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.161891 Oct 11 05:27:53.010870 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3753/7739] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:52 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:53.813059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-67b9232f-1b48-4f8f-a34c-8b57ac0ce9c0 req-b6bfae92-4209-4a74-976c-a0d612ccbd1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba307a2-f5d0-4916-a85f-12ada5f18583", "name": "network-vif-unplugged", "status": "completed", "tag": "d84c9a4b-822d-46a8-92c0-f2675171ea6b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:27:53.824133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-67b9232f-1b48-4f8f-a34c-8b57ac0ce9c0 req-b6bfae92-4209-4a74-976c-a0d612ccbd1e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:53.824697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-67b9232f-1b48-4f8f-a34c-8b57ac0ce9c0 req-b6bfae92-4209-4a74-976c-a0d612ccbd1e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:53.825233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-67b9232f-1b48-4f8f-a34c-8b57ac0ce9c0 req-b6bfae92-4209-4a74-976c-a0d612ccbd1e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:53.837436 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-67b9232f-1b48-4f8f-a34c-8b57ac0ce9c0 req-b6bfae92-4209-4a74-976c-a0d612ccbd1e service nova] Creating event network-vif-unplugged:d84c9a4b-822d-46a8-92c0-f2675171ea6b for instance aba307a2-f5d0-4916-a85f-12ada5f18583 on n-h1-860892-1 Oct 11 05:27:53.842910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-67b9232f-1b48-4f8f-a34c-8b57ac0ce9c0 req-b6bfae92-4209-4a74-976c-a0d612ccbd1e service nova] Instance aba307a2-f5d0-4916-a85f-12ada5f18583 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:27:53.855623 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-67b9232f-1b48-4f8f-a34c-8b57ac0ce9c0 req-b6bfae92-4209-4a74-976c-a0d612ccbd1e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045800 Oct 11 05:27:53.855799 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3987/7740] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:27:54.034274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a2cd2e31-ee36-462e-816b-b57ad104587f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:54.034823 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a2cd2e31-ee36-462e-816b-b57ad104587f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:54.042089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2cd2e31-ee36-462e-816b-b57ad104587f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:54.042628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2cd2e31-ee36-462e-816b-b57ad104587f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:54.043083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2cd2e31-ee36-462e-816b-b57ad104587f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:54.043770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2cd2e31-ee36-462e-816b-b57ad104587f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:54.044230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2cd2e31-ee36-462e-816b-b57ad104587f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:54.044664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2cd2e31-ee36-462e-816b-b57ad104587f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:54.180261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a2cd2e31-ee36-462e-816b-b57ad104587f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:54.188749 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a2cd2e31-ee36-462e-816b-b57ad104587f tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.158464 Oct 11 05:27:54.189323 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3754/7741] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:54 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:54.737746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-82f353a4-d0eb-458b-8476-0b8fe7e59a30 req-da1901ed-775e-4622-8a07-aa4115505b72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aba307a2-f5d0-4916-a85f-12ada5f18583", "tag": "d84c9a4b-822d-46a8-92c0-f2675171ea6b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:27:54.747974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82f353a4-d0eb-458b-8476-0b8fe7e59a30 req-da1901ed-775e-4622-8a07-aa4115505b72 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:54.748551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82f353a4-d0eb-458b-8476-0b8fe7e59a30 req-da1901ed-775e-4622-8a07-aa4115505b72 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:54.748997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82f353a4-d0eb-458b-8476-0b8fe7e59a30 req-da1901ed-775e-4622-8a07-aa4115505b72 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:54.761366 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-82f353a4-d0eb-458b-8476-0b8fe7e59a30 req-da1901ed-775e-4622-8a07-aa4115505b72 service nova] Creating event network-changed:d84c9a4b-822d-46a8-92c0-f2675171ea6b for instance aba307a2-f5d0-4916-a85f-12ada5f18583 on n-h1-860892-1 Oct 11 05:27:54.767543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-82f353a4-d0eb-458b-8476-0b8fe7e59a30 req-da1901ed-775e-4622-8a07-aa4115505b72 service nova] Instance aba307a2-f5d0-4916-a85f-12ada5f18583 is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:27:54.779107 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-82f353a4-d0eb-458b-8476-0b8fe7e59a30 req-da1901ed-775e-4622-8a07-aa4115505b72 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046339 Oct 11 05:27:54.779719 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3988/7742] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:27:55.213071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b50fe96a-ae94-4206-905d-c7507b64dbf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:55.213718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b50fe96a-ae94-4206-905d-c7507b64dbf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:55.220847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b50fe96a-ae94-4206-905d-c7507b64dbf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:55.221338 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b50fe96a-ae94-4206-905d-c7507b64dbf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:55.221786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b50fe96a-ae94-4206-905d-c7507b64dbf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:55.222525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b50fe96a-ae94-4206-905d-c7507b64dbf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:55.222989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b50fe96a-ae94-4206-905d-c7507b64dbf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:55.223422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b50fe96a-ae94-4206-905d-c7507b64dbf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:55.355927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b50fe96a-ae94-4206-905d-c7507b64dbf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:55.364696 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b50fe96a-ae94-4206-905d-c7507b64dbf2 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.156387 Oct 11 05:27:55.365402 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3755/7743] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:55 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:56.390052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f4798c36-fc9f-431e-bf45-dca72a8beb49 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:56.391059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f4798c36-fc9f-431e-bf45-dca72a8beb49 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:56.397777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4798c36-fc9f-431e-bf45-dca72a8beb49 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:56.398524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4798c36-fc9f-431e-bf45-dca72a8beb49 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:56.398906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4798c36-fc9f-431e-bf45-dca72a8beb49 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:56.399563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4798c36-fc9f-431e-bf45-dca72a8beb49 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:56.400033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4798c36-fc9f-431e-bf45-dca72a8beb49 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:56.400475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f4798c36-fc9f-431e-bf45-dca72a8beb49 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:56.539168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f4798c36-fc9f-431e-bf45-dca72a8beb49 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:56.547569 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f4798c36-fc9f-431e-bf45-dca72a8beb49 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.162880 Oct 11 05:27:56.548139 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3989/7744] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:56 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:57.571594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3e66085e-3648-4b61-975b-7c81f6734841 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:57.572213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3e66085e-3648-4b61-975b-7c81f6734841 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:57.579127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e66085e-3648-4b61-975b-7c81f6734841 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:57.579608 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e66085e-3648-4b61-975b-7c81f6734841 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:57.580042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e66085e-3648-4b61-975b-7c81f6734841 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:57.580726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e66085e-3648-4b61-975b-7c81f6734841 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:57.581174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e66085e-3648-4b61-975b-7c81f6734841 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:57.581600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3e66085e-3648-4b61-975b-7c81f6734841 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:57.717738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3e66085e-3648-4b61-975b-7c81f6734841 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:57.726147 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3e66085e-3648-4b61-975b-7c81f6734841 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.158922 Oct 11 05:27:57.726769 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3756/7745] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:57 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:58.750374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d2b7fd2-1954-4d1c-b0f4-2a0324aadc1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:58.751036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d2b7fd2-1954-4d1c-b0f4-2a0324aadc1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:58.754128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:27:58.759915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2b7fd2-1954-4d1c-b0f4-2a0324aadc1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:58.760426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2b7fd2-1954-4d1c-b0f4-2a0324aadc1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:58.760883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2b7fd2-1954-4d1c-b0f4-2a0324aadc1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:58.761648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2b7fd2-1954-4d1c-b0f4-2a0324aadc1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:58.762127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2b7fd2-1954-4d1c-b0f4-2a0324aadc1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:58.762599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d2b7fd2-1954-4d1c-b0f4-2a0324aadc1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:58.904134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d2b7fd2-1954-4d1c-b0f4-2a0324aadc1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:27:58.912805 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d2b7fd2-1954-4d1c-b0f4-2a0324aadc1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.166409 Oct 11 05:27:58.913377 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3990/7746] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:58 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:27:59.936993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-841ca4a6-348e-4d8d-a86d-88349ece0c1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:27:59.937604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-841ca4a6-348e-4d8d-a86d-88349ece0c1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:27:59.945180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841ca4a6-348e-4d8d-a86d-88349ece0c1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:59.945656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841ca4a6-348e-4d8d-a86d-88349ece0c1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:59.946094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841ca4a6-348e-4d8d-a86d-88349ece0c1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:27:59.946878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841ca4a6-348e-4d8d-a86d-88349ece0c1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:27:59.947329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841ca4a6-348e-4d8d-a86d-88349ece0c1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:27:59.947751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-841ca4a6-348e-4d8d-a86d-88349ece0c1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:00.080669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-841ca4a6-348e-4d8d-a86d-88349ece0c1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:00.090132 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-841ca4a6-348e-4d8d-a86d-88349ece0c1b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.157092 Oct 11 05:28:00.090778 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3757/7747] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:27:59 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:01.113419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a3d752a9-1350-4311-8f4d-f0d1fb70b9aa tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:01.114036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a3d752a9-1350-4311-8f4d-f0d1fb70b9aa tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:01.120911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3d752a9-1350-4311-8f4d-f0d1fb70b9aa tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:01.121402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3d752a9-1350-4311-8f4d-f0d1fb70b9aa tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:01.121847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3d752a9-1350-4311-8f4d-f0d1fb70b9aa tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:01.122580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3d752a9-1350-4311-8f4d-f0d1fb70b9aa tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:01.123043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3d752a9-1350-4311-8f4d-f0d1fb70b9aa tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:01.123478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a3d752a9-1350-4311-8f4d-f0d1fb70b9aa tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:01.251104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a3d752a9-1350-4311-8f4d-f0d1fb70b9aa tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:01.259852 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a3d752a9-1350-4311-8f4d-f0d1fb70b9aa tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.150363 Oct 11 05:28:01.260414 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3991/7748] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:01 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:02.284162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cc899283-04ed-4985-9aad-6105e94aa519 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:02.284778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cc899283-04ed-4985-9aad-6105e94aa519 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:02.292269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc899283-04ed-4985-9aad-6105e94aa519 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:02.292761 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc899283-04ed-4985-9aad-6105e94aa519 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:02.293203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc899283-04ed-4985-9aad-6105e94aa519 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:02.293904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc899283-04ed-4985-9aad-6105e94aa519 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:02.294403 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc899283-04ed-4985-9aad-6105e94aa519 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:02.294840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cc899283-04ed-4985-9aad-6105e94aa519 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:02.426791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cc899283-04ed-4985-9aad-6105e94aa519 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:02.435032 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cc899283-04ed-4985-9aad-6105e94aa519 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.154802 Oct 11 05:28:02.435604 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3758/7749] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:02 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:03.458214 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6466b818-3ee2-4f11-99d5-e521fb186f79 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:03.458848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6466b818-3ee2-4f11-99d5-e521fb186f79 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:03.466260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6466b818-3ee2-4f11-99d5-e521fb186f79 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:03.466759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6466b818-3ee2-4f11-99d5-e521fb186f79 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:03.467213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6466b818-3ee2-4f11-99d5-e521fb186f79 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:03.467914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6466b818-3ee2-4f11-99d5-e521fb186f79 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:03.468381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6466b818-3ee2-4f11-99d5-e521fb186f79 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:03.468825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6466b818-3ee2-4f11-99d5-e521fb186f79 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:03.602132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6466b818-3ee2-4f11-99d5-e521fb186f79 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:03.610420 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6466b818-3ee2-4f11-99d5-e521fb186f79 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.156135 Oct 11 05:28:03.611002 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3992/7750] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:03 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:04.634017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-caa7ccfb-c861-4eea-9d88-47cf8bf21261 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:04.634671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-caa7ccfb-c861-4eea-9d88-47cf8bf21261 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:04.641152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa7ccfb-c861-4eea-9d88-47cf8bf21261 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:04.641641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa7ccfb-c861-4eea-9d88-47cf8bf21261 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:04.642083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa7ccfb-c861-4eea-9d88-47cf8bf21261 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:04.642802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa7ccfb-c861-4eea-9d88-47cf8bf21261 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:04.643261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa7ccfb-c861-4eea-9d88-47cf8bf21261 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:04.643695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-caa7ccfb-c861-4eea-9d88-47cf8bf21261 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:04.770521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-caa7ccfb-c861-4eea-9d88-47cf8bf21261 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:04.779689 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-caa7ccfb-c861-4eea-9d88-47cf8bf21261 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.149802 Oct 11 05:28:04.780266 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3759/7751] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:04 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:05.804670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b5b792d1-b4d5-4ef6-8e46-acb3b0b772b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:05.805223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b5b792d1-b4d5-4ef6-8e46-acb3b0b772b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:05.812140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5b792d1-b4d5-4ef6-8e46-acb3b0b772b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:05.812639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5b792d1-b4d5-4ef6-8e46-acb3b0b772b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:05.813091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5b792d1-b4d5-4ef6-8e46-acb3b0b772b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:05.813798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5b792d1-b4d5-4ef6-8e46-acb3b0b772b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:05.814298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5b792d1-b4d5-4ef6-8e46-acb3b0b772b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:05.814740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5b792d1-b4d5-4ef6-8e46-acb3b0b772b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:05.945372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b5b792d1-b4d5-4ef6-8e46-acb3b0b772b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:05.953929 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b5b792d1-b4d5-4ef6-8e46-acb3b0b772b0 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.153999 Oct 11 05:28:05.954532 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3993/7752] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:05 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:06.977496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9746da02-c26f-406c-9d68-bb0b631d8c52 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:06.978105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9746da02-c26f-406c-9d68-bb0b631d8c52 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:06.985112 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9746da02-c26f-406c-9d68-bb0b631d8c52 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:06.985588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9746da02-c26f-406c-9d68-bb0b631d8c52 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:06.986021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9746da02-c26f-406c-9d68-bb0b631d8c52 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:06.986740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9746da02-c26f-406c-9d68-bb0b631d8c52 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:06.987190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9746da02-c26f-406c-9d68-bb0b631d8c52 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:06.987617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9746da02-c26f-406c-9d68-bb0b631d8c52 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:07.121624 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9746da02-c26f-406c-9d68-bb0b631d8c52 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:07.129952 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9746da02-c26f-406c-9d68-bb0b631d8c52 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.156977 Oct 11 05:28:07.130554 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3760/7753] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:06 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:08.154295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a5a0c498-6fb3-48db-b84b-18f9eb9e4192 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:08.154926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a5a0c498-6fb3-48db-b84b-18f9eb9e4192 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:08.162052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5a0c498-6fb3-48db-b84b-18f9eb9e4192 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:08.163092 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5a0c498-6fb3-48db-b84b-18f9eb9e4192 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:08.163552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5a0c498-6fb3-48db-b84b-18f9eb9e4192 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:08.164260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5a0c498-6fb3-48db-b84b-18f9eb9e4192 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:08.164764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5a0c498-6fb3-48db-b84b-18f9eb9e4192 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:08.165210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a5a0c498-6fb3-48db-b84b-18f9eb9e4192 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:08.180838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:28:08.295958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a5a0c498-6fb3-48db-b84b-18f9eb9e4192 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:08.304713 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a5a0c498-6fb3-48db-b84b-18f9eb9e4192 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.154422 Oct 11 05:28:08.305308 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3994/7754] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:08 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:09.327653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9d7aadc7-ecd5-48fe-a640-7ce6309e9297 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:09.328266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9d7aadc7-ecd5-48fe-a640-7ce6309e9297 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:09.335075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d7aadc7-ecd5-48fe-a640-7ce6309e9297 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:09.335560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d7aadc7-ecd5-48fe-a640-7ce6309e9297 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:09.335999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d7aadc7-ecd5-48fe-a640-7ce6309e9297 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:09.336697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d7aadc7-ecd5-48fe-a640-7ce6309e9297 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:09.337153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d7aadc7-ecd5-48fe-a640-7ce6309e9297 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:09.337584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d7aadc7-ecd5-48fe-a640-7ce6309e9297 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:09.466658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9d7aadc7-ecd5-48fe-a640-7ce6309e9297 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:09.475548 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9d7aadc7-ecd5-48fe-a640-7ce6309e9297 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1721 microversion: 2.1 time: 0.151308 Oct 11 05:28:09.476125 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3761/7755] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:09 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:10.500367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-28dca090-2f64-4aec-853d-8b5cf8c595b7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:10.500996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-28dca090-2f64-4aec-853d-8b5cf8c595b7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:10.508784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28dca090-2f64-4aec-853d-8b5cf8c595b7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:10.509277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28dca090-2f64-4aec-853d-8b5cf8c595b7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:10.509726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28dca090-2f64-4aec-853d-8b5cf8c595b7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:10.510529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28dca090-2f64-4aec-853d-8b5cf8c595b7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:10.510998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28dca090-2f64-4aec-853d-8b5cf8c595b7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:10.511437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28dca090-2f64-4aec-853d-8b5cf8c595b7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:10.643482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-28dca090-2f64-4aec-853d-8b5cf8c595b7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:10.651968 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-28dca090-2f64-4aec-853d-8b5cf8c595b7 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1714 microversion: 2.1 time: 0.155565 Oct 11 05:28:10.652549 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3995/7756] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:10 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:10.678760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-079f1178-d4e6-44f5-84d2-5788336fa23e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:10.679310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-079f1178-d4e6-44f5-84d2-5788336fa23e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:10.682068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=30 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:28:10.686773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-079f1178-d4e6-44f5-84d2-5788336fa23e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:10.687258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-079f1178-d4e6-44f5-84d2-5788336fa23e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:10.687698 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-079f1178-d4e6-44f5-84d2-5788336fa23e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:10.688389 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-079f1178-d4e6-44f5-84d2-5788336fa23e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:10.688845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-079f1178-d4e6-44f5-84d2-5788336fa23e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:10.689273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-079f1178-d4e6-44f5-84d2-5788336fa23e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:10.693138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=88 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:28:10.816002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-079f1178-d4e6-44f5-84d2-5788336fa23e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:10.824877 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-079f1178-d4e6-44f5-84d2-5788336fa23e tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1714 microversion: 2.1 time: 0.150552 Oct 11 05:28:10.825450 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3762/7757] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:10 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1714 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:10.847048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33f603f1-39dd-40e9-8b49-7bceef779900 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:10.847685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-33f603f1-39dd-40e9-8b49-7bceef779900 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:10.853763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f603f1-39dd-40e9-8b49-7bceef779900 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:10.854304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f603f1-39dd-40e9-8b49-7bceef779900 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:10.854766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f603f1-39dd-40e9-8b49-7bceef779900 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:10.855473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f603f1-39dd-40e9-8b49-7bceef779900 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:10.855947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f603f1-39dd-40e9-8b49-7bceef779900 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:10.856396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f603f1-39dd-40e9-8b49-7bceef779900 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:10.988011 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-33f603f1-39dd-40e9-8b49-7bceef779900 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:10.996992 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-33f603f1-39dd-40e9-8b49-7bceef779900 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1714 microversion: 2.1 time: 0.153789 Oct 11 05:28:10.997583 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3996/7758] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:10 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:11.019383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ede8944-ed57-4231-a33b-6ad11c25eb61 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:11.019884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ede8944-ed57-4231-a33b-6ad11c25eb61 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:11.025882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ede8944-ed57-4231-a33b-6ad11c25eb61 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:11.026425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ede8944-ed57-4231-a33b-6ad11c25eb61 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:11.026866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ede8944-ed57-4231-a33b-6ad11c25eb61 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:11.027561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ede8944-ed57-4231-a33b-6ad11c25eb61 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:11.028018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ede8944-ed57-4231-a33b-6ad11c25eb61 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:11.028446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ede8944-ed57-4231-a33b-6ad11c25eb61 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:11.053009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ede8944-ed57-4231-a33b-6ad11c25eb61 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:28:11.376935 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ede8944-ed57-4231-a33b-6ad11c25eb61 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 204 len: 0 microversion: 2.1 time: 0.361309 Oct 11 05:28:11.377541 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3763/7759] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:28:11 2022] DELETE /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:28:11.385841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-87a928a6-ffca-408a-bd19-b479e7b7e79c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:11.386504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-87a928a6-ffca-408a-bd19-b479e7b7e79c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:11.392789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87a928a6-ffca-408a-bd19-b479e7b7e79c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:11.393290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87a928a6-ffca-408a-bd19-b479e7b7e79c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:11.393749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87a928a6-ffca-408a-bd19-b479e7b7e79c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:11.394478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87a928a6-ffca-408a-bd19-b479e7b7e79c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:11.394959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87a928a6-ffca-408a-bd19-b479e7b7e79c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:11.395411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-87a928a6-ffca-408a-bd19-b479e7b7e79c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:11.533452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-87a928a6-ffca-408a-bd19-b479e7b7e79c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:11.542440 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-87a928a6-ffca-408a-bd19-b479e7b7e79c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1720 microversion: 2.1 time: 0.160577 Oct 11 05:28:11.543014 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3997/7760] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:11 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:12.566081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fb1d8993-4d60-4ff1-b2b9-b8749cfa8438 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:12.566822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fb1d8993-4d60-4ff1-b2b9-b8749cfa8438 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:12.573872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb1d8993-4d60-4ff1-b2b9-b8749cfa8438 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:12.574399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb1d8993-4d60-4ff1-b2b9-b8749cfa8438 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:12.574841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb1d8993-4d60-4ff1-b2b9-b8749cfa8438 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:12.575537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb1d8993-4d60-4ff1-b2b9-b8749cfa8438 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:12.575992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb1d8993-4d60-4ff1-b2b9-b8749cfa8438 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:12.576418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fb1d8993-4d60-4ff1-b2b9-b8749cfa8438 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:12.708420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fb1d8993-4d60-4ff1-b2b9-b8749cfa8438 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:12.717157 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fb1d8993-4d60-4ff1-b2b9-b8749cfa8438 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1720 microversion: 2.1 time: 0.155207 Oct 11 05:28:12.717997 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3764/7761] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:12 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1720 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:13.410121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-516efd28-cc47-4c0f-90bf-e711b1d902a3 req-27f6ebab-4556-45af-9a23-14720a795f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba307a2-f5d0-4916-a85f-12ada5f18583", "name": "network-vif-plugged", "status": "completed", "tag": "d84c9a4b-822d-46a8-92c0-f2675171ea6b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:28:13.423422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:28:13.423422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-516efd28-cc47-4c0f-90bf-e711b1d902a3 req-27f6ebab-4556-45af-9a23-14720a795f46 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:13.423422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-516efd28-cc47-4c0f-90bf-e711b1d902a3 req-27f6ebab-4556-45af-9a23-14720a795f46 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:13.423422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-516efd28-cc47-4c0f-90bf-e711b1d902a3 req-27f6ebab-4556-45af-9a23-14720a795f46 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:13.435310 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-516efd28-cc47-4c0f-90bf-e711b1d902a3 req-27f6ebab-4556-45af-9a23-14720a795f46 service nova] Creating event network-vif-plugged:d84c9a4b-822d-46a8-92c0-f2675171ea6b for instance aba307a2-f5d0-4916-a85f-12ada5f18583 on n-h1-860892-1 Oct 11 05:28:13.440503 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-516efd28-cc47-4c0f-90bf-e711b1d902a3 req-27f6ebab-4556-45af-9a23-14720a795f46 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034161 Oct 11 05:28:13.441077 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3998/7762] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:28:13.742945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce85c107-cc9b-45c2-8ea7-a26cdbf640c8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:13.743771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce85c107-cc9b-45c2-8ea7-a26cdbf640c8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:13.749743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce85c107-cc9b-45c2-8ea7-a26cdbf640c8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:13.750440 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce85c107-cc9b-45c2-8ea7-a26cdbf640c8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:13.750926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce85c107-cc9b-45c2-8ea7-a26cdbf640c8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:13.751829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce85c107-cc9b-45c2-8ea7-a26cdbf640c8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:13.752123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce85c107-cc9b-45c2-8ea7-a26cdbf640c8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:13.752556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce85c107-cc9b-45c2-8ea7-a26cdbf640c8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:13.823193 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce85c107-cc9b-45c2-8ea7-a26cdbf640c8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:13.832550 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce85c107-cc9b-45c2-8ea7-a26cdbf640c8 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1653 microversion: 2.1 time: 0.095370 Oct 11 05:28:13.837810 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3765/7763] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:13 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1653 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:14.101945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-fec48039-1d0b-4871-a890-01d90d4bf2f0 req-a001050c-6150-4adb-86f4-0cb6f140412b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aba307a2-f5d0-4916-a85f-12ada5f18583", "name": "network-vif-deleted", "tag": "d84c9a4b-822d-46a8-92c0-f2675171ea6b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:28:14.111994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fec48039-1d0b-4871-a890-01d90d4bf2f0 req-a001050c-6150-4adb-86f4-0cb6f140412b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:14.112399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fec48039-1d0b-4871-a890-01d90d4bf2f0 req-a001050c-6150-4adb-86f4-0cb6f140412b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:14.112847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-fec48039-1d0b-4871-a890-01d90d4bf2f0 req-a001050c-6150-4adb-86f4-0cb6f140412b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:14.125945 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-fec48039-1d0b-4871-a890-01d90d4bf2f0 req-a001050c-6150-4adb-86f4-0cb6f140412b service nova] Creating event network-vif-deleted:d84c9a4b-822d-46a8-92c0-f2675171ea6b for instance aba307a2-f5d0-4916-a85f-12ada5f18583 on n-h1-860892-1 Oct 11 05:28:14.129447 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-fec48039-1d0b-4871-a890-01d90d4bf2f0 req-a001050c-6150-4adb-86f4-0cb6f140412b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081292 Oct 11 05:28:14.130001 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 3999/7764] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:28:14.857275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8c47a47-9158-4d72-8e34-0e20c95d48c3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:14.857895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f8c47a47-9158-4d72-8e34-0e20c95d48c3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:14.868452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8c47a47-9158-4d72-8e34-0e20c95d48c3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:14.868452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8c47a47-9158-4d72-8e34-0e20c95d48c3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:14.868452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8c47a47-9158-4d72-8e34-0e20c95d48c3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:14.868452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8c47a47-9158-4d72-8e34-0e20c95d48c3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:14.868452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8c47a47-9158-4d72-8e34-0e20c95d48c3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:14.868452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8c47a47-9158-4d72-8e34-0e20c95d48c3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:14.942662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f8c47a47-9158-4d72-8e34-0e20c95d48c3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:14.952646 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f8c47a47-9158-4d72-8e34-0e20c95d48c3 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1368 microversion: 2.1 time: 0.099424 Oct 11 05:28:14.953382 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3766/7765] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:14 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1368 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:15.977598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d5a0a2b-270d-476c-b03c-e5acea862a51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:15.978359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d5a0a2b-270d-476c-b03c-e5acea862a51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:15.985447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d5a0a2b-270d-476c-b03c-e5acea862a51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:15.988729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d5a0a2b-270d-476c-b03c-e5acea862a51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:15.988729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d5a0a2b-270d-476c-b03c-e5acea862a51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:15.988729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d5a0a2b-270d-476c-b03c-e5acea862a51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:15.988729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d5a0a2b-270d-476c-b03c-e5acea862a51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:15.988729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d5a0a2b-270d-476c-b03c-e5acea862a51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:16.056191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d5a0a2b-270d-476c-b03c-e5acea862a51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:16.064571 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d5a0a2b-270d-476c-b03c-e5acea862a51 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1368 microversion: 2.1 time: 0.092788 Oct 11 05:28:16.065194 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4000/7766] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:15 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1368 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:17.087300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1d3f9435-acde-401f-8691-9d12bea0fb88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:17.087938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1d3f9435-acde-401f-8691-9d12bea0fb88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:17.094796 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d3f9435-acde-401f-8691-9d12bea0fb88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:17.095299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d3f9435-acde-401f-8691-9d12bea0fb88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:17.095738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d3f9435-acde-401f-8691-9d12bea0fb88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:17.097419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d3f9435-acde-401f-8691-9d12bea0fb88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:17.098285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d3f9435-acde-401f-8691-9d12bea0fb88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:17.098722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d3f9435-acde-401f-8691-9d12bea0fb88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:17.170158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1d3f9435-acde-401f-8691-9d12bea0fb88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:17.179272 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1d3f9435-acde-401f-8691-9d12bea0fb88 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1368 microversion: 2.1 time: 0.095933 Oct 11 05:28:17.179850 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3767/7767] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:17 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1368 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:18.202502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d60ef81f-8980-495b-a77a-cba423255581 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:18.204224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d60ef81f-8980-495b-a77a-cba423255581 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:18.211443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d60ef81f-8980-495b-a77a-cba423255581 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:18.211946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d60ef81f-8980-495b-a77a-cba423255581 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:18.212405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d60ef81f-8980-495b-a77a-cba423255581 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:18.213125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d60ef81f-8980-495b-a77a-cba423255581 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:18.213626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d60ef81f-8980-495b-a77a-cba423255581 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:18.214104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d60ef81f-8980-495b-a77a-cba423255581 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:18.279874 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d60ef81f-8980-495b-a77a-cba423255581 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:18.289214 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d60ef81f-8980-495b-a77a-cba423255581 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1368 microversion: 2.1 time: 0.090732 Oct 11 05:28:18.290015 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4001/7768] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:18 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1368 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:19.312999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:19.313611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:19.320410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:19.320886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:19.323331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:19.323331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:19.323331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:19.323331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:19.354165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:19.354951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:19.357798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:19.357798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lazy-loading 'fault' on Instance uuid aba307a2-f5d0-4916-a85f-12ada5f18583 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:28:19.396848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fc7f4b98dd3c48a8ad4418a3d73f5cb6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96aba3f066604fae934b975bfc28fdfe', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:19.403984 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e255aea1-7444-46d0-b80d-93cf561f4fac tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 200 len: 1327 microversion: 2.1 time: 0.094995 Oct 11 05:28:19.404553 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3768/7769] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:19 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 1327 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:20.429626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:20.430292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:20.436492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:20.436990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:20.437438 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:20.438169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:20.438660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:20.439104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:20.452834 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 HTTP/1.1 Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'aba307a2-f5d0-4916-a85f-12ada5f18583'} Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:20.454534 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:20.459007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:20.459007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:20.459007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:20.459007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:28:20.459007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:28:20.459007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:20.459007 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:20.459007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:28:20.459007 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-37e3f88a-f574-4932-96df-4358063c4369 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 404 len: 111 microversion: 2.1 time: 0.030977 Oct 11 05:28:20.459007 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4002/7770] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:20 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:28:20.517066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:20.519687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:20.526300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:20.526782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:20.527220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:20.527903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:20.528352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:20.528777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:20.541544 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/os-volume_attachments HTTP/1.1 Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': 'aba307a2-f5d0-4916-a85f-12ada5f18583'} Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:28:20.543248 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-39198e17-d607-4732-9b98-0a12d064d137 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032133 Oct 11 05:28:20.547147 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3769/7771] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:28:20 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:28:24.044964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:24.045483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:24.053233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.053729 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.054185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.054922 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.055386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.055833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.069400 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 HTTP/1.1 Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'aba307a2-f5d0-4916-a85f-12ada5f18583'} Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:28:24.071017 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-332bad80-1cd1-47d5-9d56-17af91145478 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "DELETE /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 404 len: 111 microversion: 2.1 time: 0.031548 Oct 11 05:28:24.074807 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4003/7772] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:28:24 2022] DELETE /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:28:24.081230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:24.087838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: aba307a2-f5d0-4916-a85f-12ada5f18583] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:24.089528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.090028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.090498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.091734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.091734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.092075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.107715 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 HTTP/1.1 Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'aba307a2-f5d0-4916-a85f-12ada5f18583'} Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.109283 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.114052 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.114052 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.114052 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.114052 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:28:24.114052 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:28:24.114052 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. Oct 11 05:28:24.114052 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.114052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance aba307a2-f5d0-4916-a85f-12ada5f18583 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:28:24.114052 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ca70250a-1567-442a-887c-ce792024bbb5 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583" status: 404 len: 111 microversion: 2.1 time: 0.033526 Oct 11 05:28:24.114762 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3770/7773] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:24 2022] GET /compute/v2.1/servers/aba307a2-f5d0-4916-a85f-12ada5f18583 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:28:24.119924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:24.129080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:24.129080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.129080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.129080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.129080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.129080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.129080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.142972 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 HTTP/1.1 Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '734d0d19-4ea1-41ba-a154-dae25d0b4d16'} Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:28:24.144536 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a52b7819-25c2-4f0f-9a96-cb9b7caeea12 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "DELETE /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 404 len: 111 microversion: 2.1 time: 0.030245 Oct 11 05:28:24.152488 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4004/7774] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:28:24 2022] DELETE /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:28:24.156049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:24.156670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 734d0d19-4ea1-41ba-a154-dae25d0b4d16] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:24.163268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.163755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.164198 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.164895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.165349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.165777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.179339 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 HTTP/1.1 Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '734d0d19-4ea1-41ba-a154-dae25d0b4d16'} Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.180909 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.188584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.188584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.188584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.188584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:28:24.188584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:28:24.188584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. Oct 11 05:28:24.188584 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.188584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance 734d0d19-4ea1-41ba-a154-dae25d0b4d16 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:28:24.188584 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-069579b6-568f-4a32-9924-b38d0e0c3e32 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16" status: 404 len: 111 microversion: 2.1 time: 0.030286 Oct 11 05:28:24.188584 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3771/7775] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:24 2022] GET /compute/v2.1/servers/734d0d19-4ea1-41ba-a154-dae25d0b4d16 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:28:24.190861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:24.191382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:24.197578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.198074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.198570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.199274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.199794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.200230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.214530 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 HTTP/1.1 Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'a59a4d22-42f0-41a6-ab35-ba032a6510d1'} Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:28:24.216118 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-929c6f72-b9ef-4ff7-9b9b-0ad3f6bc845c tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 404 len: 111 microversion: 2.1 time: 0.030542 Oct 11 05:28:24.220358 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4005/7776] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:28:24 2022] DELETE /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:28:24.226727 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:24.227341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: a59a4d22-42f0-41a6-ab35-ba032a6510d1] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:24.233391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.233876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.234353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.235041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.235495 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.235921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.249656 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 HTTP/1.1 Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'a59a4d22-42f0-41a6-ab35-ba032a6510d1'} Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.251250 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.255400 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.255400 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.255400 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.255400 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:28:24.255400 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:28:24.255400 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. Oct 11 05:28:24.255400 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.255400 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance a59a4d22-42f0-41a6-ab35-ba032a6510d1 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:28:24.255400 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4e476373-3eb6-4fd5-9bf1-5c0d641cac58 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1" status: 404 len: 111 microversion: 2.1 time: 0.030386 Oct 11 05:28:24.255400 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3772/7777] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:24 2022] GET /compute/v2.1/servers/a59a4d22-42f0-41a6-ab35-ba032a6510d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 05:28:24.261774 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:24.262335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:24.268629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.269129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.269580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.270380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.270791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.271767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.287816 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a HTTP/1.1 Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '1adcc807-d874-4d20-b308-e3bd6bfec80a'} Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:28:24.289389 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1865dddf-ff18-4211-b11d-5f8623694fb4 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "DELETE /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 404 len: 111 microversion: 2.1 time: 0.033550 Oct 11 05:28:24.293606 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4006/7778] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:28:24 2022] DELETE /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 05:28:24.299378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:24.299996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] [instance: 1adcc807-d874-4d20-b308-e3bd6bfec80a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:24.306145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.306692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.307133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.307833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:24.308287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:24.308716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:24.322410 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] HTTP exception thrown: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Request method failure captured: Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a HTTP/1.1 Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRPzQ99lx4rjQgzOM4ujtzUIdpfgCMKWB-2O_X92dy4DFqOn_KXkNKHdzdHgd3EOgRqFAo-fk15_ijd_JBuptF1EylosjX6LWmY9eqSfEEYRQCWpbc9Q4VAMxEt0ec81HjmbYO_zT8XxPHsFUaUithqPwKlGtiAkgXZZHXJDKZcjpssI Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/96aba3f066604fae934b975bfc28fdfe"}]}] Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 96aba3f066604fae934b975bfc28fdfe Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServerActionsTestJSON-1332618390 Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: fc7f4b98dd3c48a8ad4418a3d73f5cb6 Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServerActionsTestJSON-1332618390-project Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '1adcc807-d874-4d20-b308-e3bd6bfec80a'} Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:28:24.324071 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.328990 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:28:24.328990 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:28:24.328990 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:28:24.328990 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:28:24.328990 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:28:24.328990 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. Oct 11 05:28:24.328990 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:28:24.328990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Returning 404 to user: Instance 1adcc807-d874-4d20-b308-e3bd6bfec80a could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:28:24.328990 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d67f265a-a4cf-4739-8611-019f8fc3f89b tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a" status: 404 len: 111 microversion: 2.1 time: 0.029956 Oct 11 05:28:24.329785 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3773/7779] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:24 2022] GET /compute/v2.1/servers/1adcc807-d874-4d20-b308-e3bd6bfec80a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:28:24.334735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a9749b70-fe74-4599-815c-64f6cd608969 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] Calling method '.version_select at 0x7fda18e45c10>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:24.423780 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a9749b70-fe74-4599-815c-64f6cd608969 tempest-ServerActionsTestJSON-1332618390 tempest-ServerActionsTestJSON-1332618390-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-441167700" status: 202 len: 0 microversion: 2.1 time: 0.093449 Oct 11 05:28:24.426526 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4007/7780] 10.222.0.26 () {58 vars in 1218 bytes} [Tue Oct 11 05:28:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-441167700 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:28:36.385221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:28:36.385980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:28:36.538708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1485595116", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "ae4dc7f8-360b-4be7-b377-616fbb075f0a"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:28:36.598056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] validate_networks() for [('ae4dc7f8-360b-4be7-b377-616fbb075f0a', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:28:37.021075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:28:37.021498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:28:37.021968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:28:37.022927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:28:37.023315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:28:37.032159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:37.032639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:37.033073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:37.033785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:37.034260 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:37.034683 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:37.051452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Getting quotas for project 06a44d00dd3b4028a46dae0097c12180. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:28:37.056576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Getting quotas for user 329f20fc520f47eeb50e0396ebe9e86a and project 06a44d00dd3b4028a46dae0097c12180. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:28:37.068822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:28:37.071226 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:28:37.236015 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6956dfff-1927-4786-91f4-a6c1b3c7b24d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.856501 Oct 11 05:28:37.236842 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3774/7781] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:28:36 2022] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 05:28:37.245967 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=47 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:28:37.246945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:28:37.250890 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-68ceccb7-970a-4f2e-8326-4390b9096e75 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:37.251523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-68ceccb7-970a-4f2e-8326-4390b9096e75 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:37.378348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68ceccb7-970a-4f2e-8326-4390b9096e75 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:37.378348 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-68ceccb7-970a-4f2e-8326-4390b9096e75 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1217 microversion: 2.1 time: 0.073980 Oct 11 05:28:37.378348 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4008/7782] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:37 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1217 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:38.388434 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ce7f293-3eeb-45ca-bf8e-0a85964897ee tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:38.389046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ce7f293-3eeb-45ca-bf8e-0a85964897ee tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:38.397984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ce7f293-3eeb-45ca-bf8e-0a85964897ee tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:38.398534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ce7f293-3eeb-45ca-bf8e-0a85964897ee tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:38.399177 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ce7f293-3eeb-45ca-bf8e-0a85964897ee tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:38.399781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ce7f293-3eeb-45ca-bf8e-0a85964897ee tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:38.400234 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ce7f293-3eeb-45ca-bf8e-0a85964897ee tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:38.400790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ce7f293-3eeb-45ca-bf8e-0a85964897ee tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:38.480047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ce7f293-3eeb-45ca-bf8e-0a85964897ee tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:38.490179 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ce7f293-3eeb-45ca-bf8e-0a85964897ee tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1221 microversion: 2.1 time: 0.105628 Oct 11 05:28:38.492795 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3775/7783] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:38 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1221 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:39.517208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c7fac682-2721-4e6b-8acc-01c4eb023a16 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:39.517845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c7fac682-2721-4e6b-8acc-01c4eb023a16 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:39.520525 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:28:39.520686 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:28:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 (ip 10.222.0.26) !!! Oct 11 05:28:39.532471 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7fac682-2721-4e6b-8acc-01c4eb023a16 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:39.532976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7fac682-2721-4e6b-8acc-01c4eb023a16 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:39.536751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7fac682-2721-4e6b-8acc-01c4eb023a16 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:39.536751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7fac682-2721-4e6b-8acc-01c4eb023a16 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:39.536751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7fac682-2721-4e6b-8acc-01c4eb023a16 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:39.536751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7fac682-2721-4e6b-8acc-01c4eb023a16 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:39.624241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c7fac682-2721-4e6b-8acc-01c4eb023a16 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:39.635388 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c7fac682-2721-4e6b-8acc-01c4eb023a16 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1277 microversion: 2.1 time: 0.122478 Oct 11 05:28:39.636220 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4009/7784] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:39 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1277 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:28:40.660174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-85f88a99-9268-4c87-ae80-0b1667a31a89 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:40.660695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-85f88a99-9268-4c87-ae80-0b1667a31a89 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:40.668577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85f88a99-9268-4c87-ae80-0b1667a31a89 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:40.669304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85f88a99-9268-4c87-ae80-0b1667a31a89 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:40.669779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85f88a99-9268-4c87-ae80-0b1667a31a89 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:40.670514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85f88a99-9268-4c87-ae80-0b1667a31a89 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:40.671456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85f88a99-9268-4c87-ae80-0b1667a31a89 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:40.671984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-85f88a99-9268-4c87-ae80-0b1667a31a89 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:40.813062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-85f88a99-9268-4c87-ae80-0b1667a31a89 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:40.822008 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-85f88a99-9268-4c87-ae80-0b1667a31a89 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1317 microversion: 2.1 time: 0.165868 Oct 11 05:28:40.822716 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3776/7785] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:40 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1317 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:41.158763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-6e17112d-e0f1-40a0-a4c7-c5eef1d9e361 req-58a9b980-0f11-4413-8fc9-236c1697b706 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f714e41f-418c-4ce9-9195-aaa96acf9cb7", "tag": "d9678c84-cf88-4966-b3dd-b1c6b42f1748"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:28:41.169123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6e17112d-e0f1-40a0-a4c7-c5eef1d9e361 req-58a9b980-0f11-4413-8fc9-236c1697b706 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:41.169629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6e17112d-e0f1-40a0-a4c7-c5eef1d9e361 req-58a9b980-0f11-4413-8fc9-236c1697b706 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:41.170076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-6e17112d-e0f1-40a0-a4c7-c5eef1d9e361 req-58a9b980-0f11-4413-8fc9-236c1697b706 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:41.185684 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-6e17112d-e0f1-40a0-a4c7-c5eef1d9e361 req-58a9b980-0f11-4413-8fc9-236c1697b706 service nova] Creating event network-changed:d9678c84-cf88-4966-b3dd-b1c6b42f1748 for instance f714e41f-418c-4ce9-9195-aaa96acf9cb7 on n-h1-860892-1 Oct 11 05:28:41.186230 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-6e17112d-e0f1-40a0-a4c7-c5eef1d9e361 req-58a9b980-0f11-4413-8fc9-236c1697b706 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031266 Oct 11 05:28:41.186844 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4010/7786] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:28:41.845620 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c6a61671-8f9a-4cec-8928-ce55ff4141bc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:41.847042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c6a61671-8f9a-4cec-8928-ce55ff4141bc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:41.855530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a61671-8f9a-4cec-8928-ce55ff4141bc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:41.856340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a61671-8f9a-4cec-8928-ce55ff4141bc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:41.856785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a61671-8f9a-4cec-8928-ce55ff4141bc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:41.857540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a61671-8f9a-4cec-8928-ce55ff4141bc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:41.857997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a61671-8f9a-4cec-8928-ce55ff4141bc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:41.858535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c6a61671-8f9a-4cec-8928-ce55ff4141bc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:41.991799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c6a61671-8f9a-4cec-8928-ce55ff4141bc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:41.999631 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c6a61671-8f9a-4cec-8928-ce55ff4141bc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1317 microversion: 2.1 time: 0.158260 Oct 11 05:28:42.000209 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3777/7787] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:41 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:43.023845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a374ddf6-ca0f-44fd-a765-1db149306bef tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:43.024491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a374ddf6-ca0f-44fd-a765-1db149306bef tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:43.030736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a374ddf6-ca0f-44fd-a765-1db149306bef tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:43.031233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a374ddf6-ca0f-44fd-a765-1db149306bef tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:43.031685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a374ddf6-ca0f-44fd-a765-1db149306bef tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:43.032385 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a374ddf6-ca0f-44fd-a765-1db149306bef tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:43.032857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a374ddf6-ca0f-44fd-a765-1db149306bef tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:43.033302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a374ddf6-ca0f-44fd-a765-1db149306bef tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:43.164570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a374ddf6-ca0f-44fd-a765-1db149306bef tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:43.172284 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a374ddf6-ca0f-44fd-a765-1db149306bef tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1317 microversion: 2.1 time: 0.154071 Oct 11 05:28:43.172857 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4011/7788] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:43 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1317 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:44.196042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6d58dca8-82ab-4320-8884-f8ddb4096a94 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:44.196665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6d58dca8-82ab-4320-8884-f8ddb4096a94 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:44.203513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d58dca8-82ab-4320-8884-f8ddb4096a94 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:44.204029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d58dca8-82ab-4320-8884-f8ddb4096a94 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:44.204468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d58dca8-82ab-4320-8884-f8ddb4096a94 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:44.205163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d58dca8-82ab-4320-8884-f8ddb4096a94 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:44.205621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d58dca8-82ab-4320-8884-f8ddb4096a94 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:44.206055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6d58dca8-82ab-4320-8884-f8ddb4096a94 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:44.339200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6d58dca8-82ab-4320-8884-f8ddb4096a94 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:44.348416 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6d58dca8-82ab-4320-8884-f8ddb4096a94 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1317 microversion: 2.1 time: 0.155376 Oct 11 05:28:44.348416 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3778/7789] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:44 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1317 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:45.369440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32eff7b9-0aff-40ed-9ffa-c1dee9d8b6ce tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:45.370071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-32eff7b9-0aff-40ed-9ffa-c1dee9d8b6ce tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:45.376844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32eff7b9-0aff-40ed-9ffa-c1dee9d8b6ce tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:45.377342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32eff7b9-0aff-40ed-9ffa-c1dee9d8b6ce tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:45.377799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32eff7b9-0aff-40ed-9ffa-c1dee9d8b6ce tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:45.378527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32eff7b9-0aff-40ed-9ffa-c1dee9d8b6ce tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:45.378990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32eff7b9-0aff-40ed-9ffa-c1dee9d8b6ce tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:45.379477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32eff7b9-0aff-40ed-9ffa-c1dee9d8b6ce tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:45.511145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-32eff7b9-0aff-40ed-9ffa-c1dee9d8b6ce tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:45.519794 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-32eff7b9-0aff-40ed-9ffa-c1dee9d8b6ce tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1317 microversion: 2.1 time: 0.154367 Oct 11 05:28:45.520014 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4012/7790] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:45 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1317 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:46.542382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-77a4dc3d-25bd-4da8-b236-cebd492fc9e3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:46.543015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-77a4dc3d-25bd-4da8-b236-cebd492fc9e3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:46.549896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a4dc3d-25bd-4da8-b236-cebd492fc9e3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:46.550415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a4dc3d-25bd-4da8-b236-cebd492fc9e3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:46.550857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a4dc3d-25bd-4da8-b236-cebd492fc9e3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:46.551552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a4dc3d-25bd-4da8-b236-cebd492fc9e3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:46.552008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a4dc3d-25bd-4da8-b236-cebd492fc9e3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:46.552437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-77a4dc3d-25bd-4da8-b236-cebd492fc9e3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:46.680789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-77a4dc3d-25bd-4da8-b236-cebd492fc9e3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:46.688494 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-77a4dc3d-25bd-4da8-b236-cebd492fc9e3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1317 microversion: 2.1 time: 0.150062 Oct 11 05:28:46.689068 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3779/7791] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:46 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1317 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:47.561760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7d12cd29-1087-4cfb-bc80-c3f1db40a788 req-b2ab71bb-47ff-49c4-a57c-fdb35cc7e64b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f714e41f-418c-4ce9-9195-aaa96acf9cb7", "name": "network-vif-plugged", "status": "completed", "tag": "d9678c84-cf88-4966-b3dd-b1c6b42f1748"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:28:47.567928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:28:47.573718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7d12cd29-1087-4cfb-bc80-c3f1db40a788 req-b2ab71bb-47ff-49c4-a57c-fdb35cc7e64b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:47.574203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7d12cd29-1087-4cfb-bc80-c3f1db40a788 req-b2ab71bb-47ff-49c4-a57c-fdb35cc7e64b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:47.574661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7d12cd29-1087-4cfb-bc80-c3f1db40a788 req-b2ab71bb-47ff-49c4-a57c-fdb35cc7e64b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:47.585435 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7d12cd29-1087-4cfb-bc80-c3f1db40a788 req-b2ab71bb-47ff-49c4-a57c-fdb35cc7e64b service nova] Creating event network-vif-plugged:d9678c84-cf88-4966-b3dd-b1c6b42f1748 for instance f714e41f-418c-4ce9-9195-aaa96acf9cb7 on n-h1-860892-1 Oct 11 05:28:47.590453 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7d12cd29-1087-4cfb-bc80-c3f1db40a788 req-b2ab71bb-47ff-49c4-a57c-fdb35cc7e64b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032480 Oct 11 05:28:47.591036 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4013/7792] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:28:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:28:47.712537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2205899a-138f-4d40-8cc3-5a0a3859f977 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:47.713155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2205899a-138f-4d40-8cc3-5a0a3859f977 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:47.715078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:28:47.715742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:28:47.721470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2205899a-138f-4d40-8cc3-5a0a3859f977 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:47.721962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2205899a-138f-4d40-8cc3-5a0a3859f977 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:47.722429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2205899a-138f-4d40-8cc3-5a0a3859f977 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:47.723137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2205899a-138f-4d40-8cc3-5a0a3859f977 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:47.723593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2205899a-138f-4d40-8cc3-5a0a3859f977 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:47.724023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2205899a-138f-4d40-8cc3-5a0a3859f977 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:47.856818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2205899a-138f-4d40-8cc3-5a0a3859f977 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:47.865345 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2205899a-138f-4d40-8cc3-5a0a3859f977 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1317 microversion: 2.1 time: 0.156683 Oct 11 05:28:47.866515 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3780/7793] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:47 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:48.891604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ab9a529-f3cf-4528-aec6-495145c36e48 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:48.892331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0ab9a529-f3cf-4528-aec6-495145c36e48 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:48.898852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ab9a529-f3cf-4528-aec6-495145c36e48 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:48.899348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ab9a529-f3cf-4528-aec6-495145c36e48 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:48.904332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ab9a529-f3cf-4528-aec6-495145c36e48 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:48.904332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ab9a529-f3cf-4528-aec6-495145c36e48 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:48.904332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ab9a529-f3cf-4528-aec6-495145c36e48 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:48.904332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ab9a529-f3cf-4528-aec6-495145c36e48 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:49.035984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0ab9a529-f3cf-4528-aec6-495145c36e48 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:49.043811 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0ab9a529-f3cf-4528-aec6-495145c36e48 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1317 microversion: 2.1 time: 0.158042 Oct 11 05:28:49.044382 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4014/7794] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:48 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1317 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:50.067273 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5ec9b260-6416-4094-bf55-28385781e7e1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:50.067977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5ec9b260-6416-4094-bf55-28385781e7e1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:50.075313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ec9b260-6416-4094-bf55-28385781e7e1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:50.075791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ec9b260-6416-4094-bf55-28385781e7e1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:50.076231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ec9b260-6416-4094-bf55-28385781e7e1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:50.076917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ec9b260-6416-4094-bf55-28385781e7e1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:50.077371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ec9b260-6416-4094-bf55-28385781e7e1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:50.077794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5ec9b260-6416-4094-bf55-28385781e7e1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:50.207954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5ec9b260-6416-4094-bf55-28385781e7e1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:50.216365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5ec9b260-6416-4094-bf55-28385781e7e1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1506 microversion: 2.1 time: 0.152976 Oct 11 05:28:50.217024 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3781/7795] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:50 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:50.277308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-543864362", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "ae4dc7f8-360b-4be7-b377-616fbb075f0a"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:28:50.332615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] validate_networks() for [('ae4dc7f8-360b-4be7-b377-616fbb075f0a', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:28:50.696580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:28:50.697039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:28:50.697538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:28:50.697941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:28:50.698387 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:28:50.707176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:50.707667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:50.708108 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:50.708844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:50.709302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:50.709734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:50.725953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Getting quotas for project 06a44d00dd3b4028a46dae0097c12180. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:28:50.731623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Getting quotas for user 329f20fc520f47eeb50e0396ebe9e86a and project 06a44d00dd3b4028a46dae0097c12180. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:28:50.744208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:28:50.746516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:28:50.886392 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d6efcd2c-38c1-4b33-b47f-c4e2e4042a42 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.613178 Oct 11 05:28:50.887204 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4015/7796] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:28:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 615 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:28:50.898873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3fc477f6-f01e-4625-b2ac-1d93211e9ceb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:50.899484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3fc477f6-f01e-4625-b2ac-1d93211e9ceb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:50.966522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3fc477f6-f01e-4625-b2ac-1d93211e9ceb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:50.973808 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3fc477f6-f01e-4625-b2ac-1d93211e9ceb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1216 microversion: 2.1 time: 0.078875 Oct 11 05:28:50.974585 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3782/7797] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:50 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1216 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:51.998790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dfdbe281-ec3e-4236-902f-5eb4f9ad3d8d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:51.999454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dfdbe281-ec3e-4236-902f-5eb4f9ad3d8d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:52.005630 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfdbe281-ec3e-4236-902f-5eb4f9ad3d8d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:52.006132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfdbe281-ec3e-4236-902f-5eb4f9ad3d8d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:52.006644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfdbe281-ec3e-4236-902f-5eb4f9ad3d8d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:52.007356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfdbe281-ec3e-4236-902f-5eb4f9ad3d8d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:52.007831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfdbe281-ec3e-4236-902f-5eb4f9ad3d8d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:52.008300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dfdbe281-ec3e-4236-902f-5eb4f9ad3d8d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:52.071212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dfdbe281-ec3e-4236-902f-5eb4f9ad3d8d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:52.079601 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dfdbe281-ec3e-4236-902f-5eb4f9ad3d8d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1220 microversion: 2.1 time: 0.086308 Oct 11 05:28:52.080196 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4016/7798] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:51 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1220 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:53.102207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9074f9d3-fbf5-4fa4-b876-330f41dbc6c7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:53.102883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9074f9d3-fbf5-4fa4-b876-330f41dbc6c7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:53.110431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9074f9d3-fbf5-4fa4-b876-330f41dbc6c7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:53.111023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9074f9d3-fbf5-4fa4-b876-330f41dbc6c7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:53.111366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9074f9d3-fbf5-4fa4-b876-330f41dbc6c7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:53.112069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9074f9d3-fbf5-4fa4-b876-330f41dbc6c7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:53.112523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9074f9d3-fbf5-4fa4-b876-330f41dbc6c7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:53.112953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9074f9d3-fbf5-4fa4-b876-330f41dbc6c7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:53.175957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9074f9d3-fbf5-4fa4-b876-330f41dbc6c7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:53.183836 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9074f9d3-fbf5-4fa4-b876-330f41dbc6c7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1286 microversion: 2.1 time: 0.085590 Oct 11 05:28:53.184408 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3783/7799] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:53 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:54.211885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72898b28-3cc2-4f81-97e9-68fad4063a64 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:54.213045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72898b28-3cc2-4f81-97e9-68fad4063a64 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:54.220039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72898b28-3cc2-4f81-97e9-68fad4063a64 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:54.220528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72898b28-3cc2-4f81-97e9-68fad4063a64 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:54.220973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72898b28-3cc2-4f81-97e9-68fad4063a64 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:54.221674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72898b28-3cc2-4f81-97e9-68fad4063a64 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:54.222134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72898b28-3cc2-4f81-97e9-68fad4063a64 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:54.222604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72898b28-3cc2-4f81-97e9-68fad4063a64 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:54.748356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72898b28-3cc2-4f81-97e9-68fad4063a64 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:54.756048 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72898b28-3cc2-4f81-97e9-68fad4063a64 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1316 microversion: 2.1 time: 0.548378 Oct 11 05:28:54.756706 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4017/7800] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:54 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1316 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:54.994074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-7313cf4d-1053-43a6-a68c-82cf1b2700f8 req-7849ed87-a735-4fc7-a783-74725e11de97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4cc92bad-e1fc-40bb-a619-252b19a608f6", "tag": "f548808f-5757-42cd-a36a-1db2f187b02b"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:28:55.004680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7313cf4d-1053-43a6-a68c-82cf1b2700f8 req-7849ed87-a735-4fc7-a783-74725e11de97 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:55.005150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7313cf4d-1053-43a6-a68c-82cf1b2700f8 req-7849ed87-a735-4fc7-a783-74725e11de97 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:55.005574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-7313cf4d-1053-43a6-a68c-82cf1b2700f8 req-7849ed87-a735-4fc7-a783-74725e11de97 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:55.017663 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-7313cf4d-1053-43a6-a68c-82cf1b2700f8 req-7849ed87-a735-4fc7-a783-74725e11de97 service nova] Creating event network-changed:f548808f-5757-42cd-a36a-1db2f187b02b for instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 on n-h2-860892-1 Oct 11 05:28:55.025160 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-7313cf4d-1053-43a6-a68c-82cf1b2700f8 req-7849ed87-a735-4fc7-a783-74725e11de97 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033518 Oct 11 05:28:55.025788 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3784/7801] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:28:55.781330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3868a0a3-7971-4b97-9a2a-7c772875aa6d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:55.781971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3868a0a3-7971-4b97-9a2a-7c772875aa6d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:55.789001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3868a0a3-7971-4b97-9a2a-7c772875aa6d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:55.789497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3868a0a3-7971-4b97-9a2a-7c772875aa6d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:55.789954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3868a0a3-7971-4b97-9a2a-7c772875aa6d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:55.791317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3868a0a3-7971-4b97-9a2a-7c772875aa6d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:55.791792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3868a0a3-7971-4b97-9a2a-7c772875aa6d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:55.792246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3868a0a3-7971-4b97-9a2a-7c772875aa6d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:55.925061 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3868a0a3-7971-4b97-9a2a-7c772875aa6d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:55.933136 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3868a0a3-7971-4b97-9a2a-7c772875aa6d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1316 microversion: 2.1 time: 0.156549 Oct 11 05:28:55.933731 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4018/7802] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:55 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1316 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:56.956773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-278ea500-952a-4522-8140-ca8b94ad63b3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:56.957533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-278ea500-952a-4522-8140-ca8b94ad63b3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:56.965259 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-278ea500-952a-4522-8140-ca8b94ad63b3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:56.965738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-278ea500-952a-4522-8140-ca8b94ad63b3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:56.966174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-278ea500-952a-4522-8140-ca8b94ad63b3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:56.966882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-278ea500-952a-4522-8140-ca8b94ad63b3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:56.967332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-278ea500-952a-4522-8140-ca8b94ad63b3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:56.967758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-278ea500-952a-4522-8140-ca8b94ad63b3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:57.098122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-278ea500-952a-4522-8140-ca8b94ad63b3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:57.105837 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-278ea500-952a-4522-8140-ca8b94ad63b3 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1316 microversion: 2.1 time: 0.153331 Oct 11 05:28:57.106507 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3785/7803] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:56 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1316 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:58.129009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-38c36653-bdf9-435d-9f8b-023447498ba8 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:58.129543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-38c36653-bdf9-435d-9f8b-023447498ba8 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:58.136995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38c36653-bdf9-435d-9f8b-023447498ba8 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:58.137489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38c36653-bdf9-435d-9f8b-023447498ba8 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:58.137938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38c36653-bdf9-435d-9f8b-023447498ba8 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:58.138673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38c36653-bdf9-435d-9f8b-023447498ba8 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:58.139140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38c36653-bdf9-435d-9f8b-023447498ba8 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:58.139587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-38c36653-bdf9-435d-9f8b-023447498ba8 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:58.267974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-38c36653-bdf9-435d-9f8b-023447498ba8 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:58.276287 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-38c36653-bdf9-435d-9f8b-023447498ba8 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1316 microversion: 2.1 time: 0.151363 Oct 11 05:28:58.276855 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4019/7804] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:58 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1316 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:28:59.298726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-235c9bca-dc14-44ce-a64b-cc39c076eac5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:28:59.299348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-235c9bca-dc14-44ce-a64b-cc39c076eac5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:28:59.306308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235c9bca-dc14-44ce-a64b-cc39c076eac5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:59.306794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235c9bca-dc14-44ce-a64b-cc39c076eac5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:59.307240 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235c9bca-dc14-44ce-a64b-cc39c076eac5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:59.307927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235c9bca-dc14-44ce-a64b-cc39c076eac5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:28:59.308384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235c9bca-dc14-44ce-a64b-cc39c076eac5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:28:59.308812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-235c9bca-dc14-44ce-a64b-cc39c076eac5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:28:59.436305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-235c9bca-dc14-44ce-a64b-cc39c076eac5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:28:59.443966 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-235c9bca-dc14-44ce-a64b-cc39c076eac5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1316 microversion: 2.1 time: 0.149104 Oct 11 05:28:59.444542 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3786/7805] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:28:59 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1316 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:00.466900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f89c589c-d717-48b4-a9ae-7b66e11705b7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:00.467526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f89c589c-d717-48b4-a9ae-7b66e11705b7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:00.474437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89c589c-d717-48b4-a9ae-7b66e11705b7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:00.474933 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89c589c-d717-48b4-a9ae-7b66e11705b7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:00.475390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89c589c-d717-48b4-a9ae-7b66e11705b7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:00.476102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89c589c-d717-48b4-a9ae-7b66e11705b7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:00.476572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89c589c-d717-48b4-a9ae-7b66e11705b7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:00.477039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f89c589c-d717-48b4-a9ae-7b66e11705b7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:00.610278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f89c589c-d717-48b4-a9ae-7b66e11705b7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:00.617952 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f89c589c-d717-48b4-a9ae-7b66e11705b7 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1316 microversion: 2.1 time: 0.155069 Oct 11 05:29:00.619220 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4020/7806] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:00 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:01.641333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75c26c0c-59ac-454a-8c37-a02f89ae51aa tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:01.641974 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-75c26c0c-59ac-454a-8c37-a02f89ae51aa tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:01.644813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:29:01.651569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75c26c0c-59ac-454a-8c37-a02f89ae51aa tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:01.652062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75c26c0c-59ac-454a-8c37-a02f89ae51aa tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:01.652501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75c26c0c-59ac-454a-8c37-a02f89ae51aa tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:01.653268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75c26c0c-59ac-454a-8c37-a02f89ae51aa tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:01.653719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75c26c0c-59ac-454a-8c37-a02f89ae51aa tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:01.654257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75c26c0c-59ac-454a-8c37-a02f89ae51aa tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:01.800490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75c26c0c-59ac-454a-8c37-a02f89ae51aa tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:01.808712 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-75c26c0c-59ac-454a-8c37-a02f89ae51aa tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1316 microversion: 2.1 time: 0.171607 Oct 11 05:29:01.811484 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3787/7807] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:01 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:02.201979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4bdc11ee-84f8-4bfd-b72f-ea4fce8b5ffd req-f7336f74-7d11-4e2b-a25b-5ee09fddbd2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc92bad-e1fc-40bb-a619-252b19a608f6", "name": "network-vif-plugged", "status": "completed", "tag": "f548808f-5757-42cd-a36a-1db2f187b02b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:29:02.207205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:29:02.207959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:29:02.215910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4bdc11ee-84f8-4bfd-b72f-ea4fce8b5ffd req-f7336f74-7d11-4e2b-a25b-5ee09fddbd2b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:02.216401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4bdc11ee-84f8-4bfd-b72f-ea4fce8b5ffd req-f7336f74-7d11-4e2b-a25b-5ee09fddbd2b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:02.216846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4bdc11ee-84f8-4bfd-b72f-ea4fce8b5ffd req-f7336f74-7d11-4e2b-a25b-5ee09fddbd2b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:02.228932 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4bdc11ee-84f8-4bfd-b72f-ea4fce8b5ffd req-f7336f74-7d11-4e2b-a25b-5ee09fddbd2b service nova] Creating event network-vif-plugged:f548808f-5757-42cd-a36a-1db2f187b02b for instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 on n-h2-860892-1 Oct 11 05:29:02.234052 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4bdc11ee-84f8-4bfd-b72f-ea4fce8b5ffd req-f7336f74-7d11-4e2b-a25b-5ee09fddbd2b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036339 Oct 11 05:29:02.234724 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4021/7808] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:29:02.832417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a8b65950-4fb2-4263-b0de-9e75f79211b1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:02.833270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a8b65950-4fb2-4263-b0de-9e75f79211b1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:02.840158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8b65950-4fb2-4263-b0de-9e75f79211b1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:02.840647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8b65950-4fb2-4263-b0de-9e75f79211b1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:02.841090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8b65950-4fb2-4263-b0de-9e75f79211b1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:02.841790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8b65950-4fb2-4263-b0de-9e75f79211b1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:02.842286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8b65950-4fb2-4263-b0de-9e75f79211b1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:02.842735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a8b65950-4fb2-4263-b0de-9e75f79211b1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:02.973046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a8b65950-4fb2-4263-b0de-9e75f79211b1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:02.981114 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a8b65950-4fb2-4263-b0de-9e75f79211b1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1316 microversion: 2.1 time: 0.152752 Oct 11 05:29:02.981696 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3788/7809] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:02 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1316 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:04.005771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dc8311e6-0fa6-4db4-8861-420004af1830 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:04.006524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dc8311e6-0fa6-4db4-8861-420004af1830 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:04.013851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc8311e6-0fa6-4db4-8861-420004af1830 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:04.014392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc8311e6-0fa6-4db4-8861-420004af1830 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:04.014844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc8311e6-0fa6-4db4-8861-420004af1830 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:04.015550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc8311e6-0fa6-4db4-8861-420004af1830 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:04.016275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc8311e6-0fa6-4db4-8861-420004af1830 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:04.016719 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc8311e6-0fa6-4db4-8861-420004af1830 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:04.152465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dc8311e6-0fa6-4db4-8861-420004af1830 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:04.160183 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dc8311e6-0fa6-4db4-8861-420004af1830 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1504 microversion: 2.1 time: 0.159440 Oct 11 05:29:04.160776 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4022/7810] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:03 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:04.182381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5faad930-3977-47fa-8d5c-2da43e3152fc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:04.182862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5faad930-3977-47fa-8d5c-2da43e3152fc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:04.188762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faad930-3977-47fa-8d5c-2da43e3152fc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:04.189233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faad930-3977-47fa-8d5c-2da43e3152fc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:04.189665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faad930-3977-47fa-8d5c-2da43e3152fc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:04.190383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faad930-3977-47fa-8d5c-2da43e3152fc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:04.190829 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faad930-3977-47fa-8d5c-2da43e3152fc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:04.191251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5faad930-3977-47fa-8d5c-2da43e3152fc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:04.219800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5faad930-3977-47fa-8d5c-2da43e3152fc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:29:04.415756 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5faad930-3977-47fa-8d5c-2da43e3152fc tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 204 len: 0 microversion: 2.1 time: 0.237310 Oct 11 05:29:04.416401 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3789/7811] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:29:04 2022] DELETE /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:29:04.424477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a6968869-afbb-4cbc-84a6-86efee14770c tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:04.428744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a6968869-afbb-4cbc-84a6-86efee14770c tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:04.431561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6968869-afbb-4cbc-84a6-86efee14770c tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:04.432065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6968869-afbb-4cbc-84a6-86efee14770c tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:04.432522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6968869-afbb-4cbc-84a6-86efee14770c tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:04.433240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6968869-afbb-4cbc-84a6-86efee14770c tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:04.433713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6968869-afbb-4cbc-84a6-86efee14770c tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:04.434656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6968869-afbb-4cbc-84a6-86efee14770c tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:04.564050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a6968869-afbb-4cbc-84a6-86efee14770c tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:04.572435 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a6968869-afbb-4cbc-84a6-86efee14770c tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1510 microversion: 2.1 time: 0.151899 Oct 11 05:29:04.573009 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4023/7812] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:04 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1510 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:05.595250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8d97774-b592-4721-aaaa-c2f61174fef6 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:05.595954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d8d97774-b592-4721-aaaa-c2f61174fef6 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:05.603315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8d97774-b592-4721-aaaa-c2f61174fef6 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:05.603799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8d97774-b592-4721-aaaa-c2f61174fef6 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:05.604237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8d97774-b592-4721-aaaa-c2f61174fef6 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:05.604929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8d97774-b592-4721-aaaa-c2f61174fef6 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:05.605382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8d97774-b592-4721-aaaa-c2f61174fef6 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:05.605811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8d97774-b592-4721-aaaa-c2f61174fef6 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:05.738107 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d8d97774-b592-4721-aaaa-c2f61174fef6 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:05.746704 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8d97774-b592-4721-aaaa-c2f61174fef6 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1510 microversion: 2.1 time: 0.155693 Oct 11 05:29:05.747282 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3790/7813] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:05 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:06.193807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-060064c9-edb9-4e53-a66e-9270842a1c0b req-b6b20a0b-a7ad-4d71-9a7c-3eed8d1dd516 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4cc92bad-e1fc-40bb-a619-252b19a608f6", "name": "network-vif-deleted", "tag": "f548808f-5757-42cd-a36a-1db2f187b02b"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:29:06.204878 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-060064c9-edb9-4e53-a66e-9270842a1c0b req-b6b20a0b-a7ad-4d71-9a7c-3eed8d1dd516 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:06.205551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-060064c9-edb9-4e53-a66e-9270842a1c0b req-b6b20a0b-a7ad-4d71-9a7c-3eed8d1dd516 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:06.206074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-060064c9-edb9-4e53-a66e-9270842a1c0b req-b6b20a0b-a7ad-4d71-9a7c-3eed8d1dd516 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:06.219201 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-060064c9-edb9-4e53-a66e-9270842a1c0b req-b6b20a0b-a7ad-4d71-9a7c-3eed8d1dd516 service nova] Creating event network-vif-deleted:f548808f-5757-42cd-a36a-1db2f187b02b for instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 on n-h2-860892-1 Oct 11 05:29:06.225662 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-060064c9-edb9-4e53-a66e-9270842a1c0b req-b6b20a0b-a7ad-4d71-9a7c-3eed8d1dd516 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036391 Oct 11 05:29:06.226788 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4024/7814] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:29:06.769692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:06.770323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:06.773174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:29:06.778031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:06.778574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:06.779015 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:06.779702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:06.780152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:06.780577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:06.783092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:29:06.812372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:06.812848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:06.813397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:06.813845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lazy-loading 'fault' on Instance uuid 4cc92bad-e1fc-40bb-a619-252b19a608f6 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:29:06.854278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:06.861905 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ceccf07d-e518-4be2-ad94-85e4893a9c27 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 200 len: 1306 microversion: 2.1 time: 0.096357 Oct 11 05:29:06.862505 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3791/7815] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:06 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 1306 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:07.886161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:07.886895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:07.894271 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:07.894763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:07.895211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:07.895906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:07.896365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:07.896840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:07.909980 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] HTTP exception thrown: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Request method failure captured: Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 HTTP/1.1 Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRP8EFEnS0c60kZ8EXmYxIoWOucLqrbD_W_iFT3BRNDlYFvMbaQeuKuDFyU3vvvSte1U2ZELGi1z6mbHMKvEZUOWhdrT2ygX4MBZdO9hNuwvD9nK0VGcGuRpG-fF3FEUlOj0NbHVd3BoupVEnV5GkPtVkWeUvaqicy5r9h3HHdSDUcw4 Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}] Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 329f20fc520f47eeb50e0396ebe9e86a Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '4cc92bad-e1fc-40bb-a619-252b19a608f6'} Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:07.911638 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:07.916924 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:07.916924 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:07.916924 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:07.916924 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:29:07.916924 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:29:07.916924 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:07.916924 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:07.916924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Returning 404 to user: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:29:07.916924 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-33f472b4-289b-4197-96f5-d5066a8de9a1 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 404 len: 111 microversion: 2.1 time: 0.031152 Oct 11 05:29:07.916924 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4025/7816] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:07 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:29:07.922718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e6d9c0d8-08fc-42f3-9ed9-5ffa7af1142a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:07.923390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e6d9c0d8-08fc-42f3-9ed9-5ffa7af1142a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:07.932271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6d9c0d8-08fc-42f3-9ed9-5ffa7af1142a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:07.937241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6d9c0d8-08fc-42f3-9ed9-5ffa7af1142a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:07.937241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6d9c0d8-08fc-42f3-9ed9-5ffa7af1142a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:07.937241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6d9c0d8-08fc-42f3-9ed9-5ffa7af1142a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:07.937241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6d9c0d8-08fc-42f3-9ed9-5ffa7af1142a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:07.937241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e6d9c0d8-08fc-42f3-9ed9-5ffa7af1142a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.063622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e6d9c0d8-08fc-42f3-9ed9-5ffa7af1142a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:08.071404 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e6d9c0d8-08fc-42f3-9ed9-5ffa7af1142a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1506 microversion: 2.1 time: 0.152526 Oct 11 05:29:08.072008 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3792/7817] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:07 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:29:08.093549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e423fc8-0c6c-43bc-bf86-39a2875bb95a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "452"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:29:08.095869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e423fc8-0c6c-43bc-bf86-39a2875bb95a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 9572881b-be47-498e-82f3-77f4f7dd3d59] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:08.101278 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-1e423fc8-0c6c-43bc-bf86-39a2875bb95a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] HTTP exception thrown: Instance 9572881b-be47-498e-82f3-77f4f7dd3d59 could not be found. Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e423fc8-0c6c-43bc-bf86-39a2875bb95a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Request method failure captured: Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/9572881b-be47-498e-82f3-77f4f7dd3d59/action HTTP/1.1 Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 32 Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRP8EFEnS0c60kZ8EXmYxIoWOucLqrbD_W_iFT3BRNDlYFvMbaQeuKuDFyU3vvvSte1U2ZELGi1z6mbHMKvEZUOWhdrT2ygX4MBZdO9hNuwvD9nK0VGcGuRpG-fF3FEUlOj0NbHVd3BoupVEnV5GkPtVkWeUvaqicy5r9h3HHdSDUcw4 Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}] Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 329f20fc520f47eeb50e0396ebe9e86a Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: {"resize": {"flavorRef": "452"}} Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 9572881b-be47-498e-82f3-77f4f7dd3d59 could not be found. Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '9572881b-be47-498e-82f3-77f4f7dd3d59', 'body': {'resize': {'flavorRef': '452'}}} Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2953, in _get_instance Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=instance_uuid) Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9572881b-be47-498e-82f3-77f4f7dd3d59 could not be found. Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1046, in _resize Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_id, Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:29:08.102927 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9572881b-be47-498e-82f3-77f4f7dd3d59 could not be found. Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9572881b-be47-498e-82f3-77f4f7dd3d59 could not be found. Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e423fc8-0c6c-43bc-bf86-39a2875bb95a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Returning 404 to user: Instance 9572881b-be47-498e-82f3-77f4f7dd3d59 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e423fc8-0c6c-43bc-bf86-39a2875bb95a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "POST /compute/v2.1/servers/9572881b-be47-498e-82f3-77f4f7dd3d59/action" status: 404 len: 111 microversion: 2.1 time: 0.015270 Oct 11 05:29:08.108125 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4026/7818] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:29:08 2022] POST /compute/v2.1/servers/9572881b-be47-498e-82f3-77f4f7dd3d59/action => generated 111 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:29:08.113532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-439106d4-f963-4956-b16b-5d6be73ed113 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:08.114152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-439106d4-f963-4956-b16b-5d6be73ed113 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:08.120819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-439106d4-f963-4956-b16b-5d6be73ed113 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.121299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-439106d4-f963-4956-b16b-5d6be73ed113 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.121737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-439106d4-f963-4956-b16b-5d6be73ed113 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.122452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-439106d4-f963-4956-b16b-5d6be73ed113 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.122904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-439106d4-f963-4956-b16b-5d6be73ed113 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.123332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-439106d4-f963-4956-b16b-5d6be73ed113 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.254533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-439106d4-f963-4956-b16b-5d6be73ed113 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:08.262356 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-439106d4-f963-4956-b16b-5d6be73ed113 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1506 microversion: 2.1 time: 0.152813 Oct 11 05:29:08.262927 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3793/7819] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:08 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1506 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:08.287005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fe83c326-49cf-4231-9073-44ea6eaed5fb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:08.287665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fe83c326-49cf-4231-9073-44ea6eaed5fb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:08.295252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe83c326-49cf-4231-9073-44ea6eaed5fb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.295749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe83c326-49cf-4231-9073-44ea6eaed5fb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.296207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe83c326-49cf-4231-9073-44ea6eaed5fb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.296915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe83c326-49cf-4231-9073-44ea6eaed5fb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.297382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe83c326-49cf-4231-9073-44ea6eaed5fb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.297826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fe83c326-49cf-4231-9073-44ea6eaed5fb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.425460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fe83c326-49cf-4231-9073-44ea6eaed5fb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:08.433288 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fe83c326-49cf-4231-9073-44ea6eaed5fb tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1506 microversion: 2.1 time: 0.150146 Oct 11 05:29:08.433855 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4027/7820] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:08 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1506 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:08.455497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "764000be-6c75-4785-809b-70f6b2aa013d"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:29:08.457767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:08.464313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.464790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.465223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.465902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.466385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.466808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.494436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:08.498958 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] HTTP exception thrown: Flavor 764000be-6c75-4785-809b-70f6b2aa013d could not be found. Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Request method failure captured: Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: request: POST /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7/action HTTP/1.1 Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 65 Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRP8EFEnS0c60kZ8EXmYxIoWOucLqrbD_W_iFT3BRNDlYFvMbaQeuKuDFyU3vvvSte1U2ZELGi1z6mbHMKvEZUOWhdrT2ygX4MBZdO9hNuwvD9nK0VGcGuRpG-fF3FEUlOj0NbHVd3BoupVEnV5GkPtVkWeUvaqicy5r9h3HHdSDUcw4 Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}] Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 329f20fc520f47eeb50e0396ebe9e86a Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: {"resize": {"flavorRef": "764000be-6c75-4785-809b-70f6b2aa013d"}} Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: exception: Flavor 764000be-6c75-4785-809b-70f6b2aa013d could not be found. Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'f714e41f-418c-4ce9-9195-aaa96acf9cb7', 'body': {'resize': {'flavorRef': '764000be-6c75-4785-809b-70f6b2aa013d'}}} Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1053, in _resize Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self.compute_api.resize(context, instance, flavor_id, Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 388, in inner Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 373, in wrapper Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 356, in wrapper Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(self, context, instance, *args, **kwargs) Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4200, in resize Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi new_flavor = flavors.get_flavor_by_flavor_id( Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:29:08.500871 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 764000be-6c75-4785-809b-70f6b2aa013d could not be found. Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1139, in _action_resize Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi self._resize(req, id, flavor_ref, **kwargs) Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1083, in _resize Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Flavor 764000be-6c75-4785-809b-70f6b2aa013d could not be found. Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 764000be-6c75-4785-809b-70f6b2aa013d could not be found. Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Returning 400 to user: Flavor 764000be-6c75-4785-809b-70f6b2aa013d could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c85e12b3-bf0e-4b16-9537-858d172a2df5 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "POST /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7/action" status: 400 len: 107 microversion: 2.1 time: 0.050934 Oct 11 05:29:08.505208 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3794/7821] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:29:08 2022] POST /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7/action => generated 107 bytes in 52 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 11 05:29:08.510956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bd7bfbb9-b796-445e-a85f-280dc65e0303 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:08.511586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bd7bfbb9-b796-445e-a85f-280dc65e0303 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:08.517965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7bfbb9-b796-445e-a85f-280dc65e0303 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.518496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7bfbb9-b796-445e-a85f-280dc65e0303 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.518944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7bfbb9-b796-445e-a85f-280dc65e0303 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.519827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7bfbb9-b796-445e-a85f-280dc65e0303 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.520097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7bfbb9-b796-445e-a85f-280dc65e0303 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.520535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd7bfbb9-b796-445e-a85f-280dc65e0303 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.652531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bd7bfbb9-b796-445e-a85f-280dc65e0303 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:08.660585 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bd7bfbb9-b796-445e-a85f-280dc65e0303 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1506 microversion: 2.1 time: 0.153491 Oct 11 05:29:08.661170 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4028/7822] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:08 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1506 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:08.683310 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98e491aa-df4b-4e8c-ae75-c2dc07cbca9f tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:08.683925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98e491aa-df4b-4e8c-ae75-c2dc07cbca9f tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:08.689812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98e491aa-df4b-4e8c-ae75-c2dc07cbca9f tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.690324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98e491aa-df4b-4e8c-ae75-c2dc07cbca9f tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.690758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98e491aa-df4b-4e8c-ae75-c2dc07cbca9f tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.691441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98e491aa-df4b-4e8c-ae75-c2dc07cbca9f tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.691887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98e491aa-df4b-4e8c-ae75-c2dc07cbca9f tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.692308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98e491aa-df4b-4e8c-ae75-c2dc07cbca9f tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.823490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-98e491aa-df4b-4e8c-ae75-c2dc07cbca9f tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:08.831219 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98e491aa-df4b-4e8c-ae75-c2dc07cbca9f tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1506 microversion: 2.1 time: 0.151868 Oct 11 05:29:08.833379 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3795/7823] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:08 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:08.853895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-59d12ede-4b59-4699-a6bf-594602309caf tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": ""}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-59d12ede-4b59-4699-a6bf-594602309caf tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Request method failure captured: Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: request: POST /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7/action HTTP/1.1 Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 29 Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRP8EFEnS0c60kZ8EXmYxIoWOucLqrbD_W_iFT3BRNDlYFvMbaQeuKuDFyU3vvvSte1U2ZELGi1z6mbHMKvEZUOWhdrT2ygX4MBZdO9hNuwvD9nK0VGcGuRpG-fF3FEUlOj0NbHVd3BoupVEnV5GkPtVkWeUvaqicy5r9h3HHdSDUcw4 Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}] Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 329f20fc520f47eeb50e0396ebe9e86a Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: {"resize": {"flavorRef": ""}} Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: exception: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': 'f714e41f-418c-4ce9-9195-aaa96acf9cb7', 'body': {'resize': {'flavorRef': ''}}} Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise error Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' is too short Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Failed validating 'minLength' in schema['properties']['resize']['properties']['flavorRef']: Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi {'minLength': 1, 'type': ['string', 'integer']} Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi On instance['resize']: Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi '' Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.857760 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:08.868576 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.868576 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:08.868576 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:08.868576 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:08.868576 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 11 05:29:08.868576 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 11 05:29:08.868576 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute flavorRef. Value: . '' is too short Oct 11 05:29:08.868576 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:08.868576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-59d12ede-4b59-4699-a6bf-594602309caf tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Returning 400 to user: Invalid input for field/attribute flavorRef. Value: . '' is too short {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:29:08.868576 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-59d12ede-4b59-4699-a6bf-594602309caf tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "POST /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7/action" status: 400 len: 113 microversion: 2.1 time: 0.009524 Oct 11 05:29:08.868576 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4029/7824] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:29:08 2022] POST /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7/action => generated 113 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 11 05:29:08.871003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-888eb437-4fc5-4dc9-982f-37b098cf84ec tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:08.871649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-888eb437-4fc5-4dc9-982f-37b098cf84ec tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:08.877551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-888eb437-4fc5-4dc9-982f-37b098cf84ec tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.878035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-888eb437-4fc5-4dc9-982f-37b098cf84ec tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.878509 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-888eb437-4fc5-4dc9-982f-37b098cf84ec tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:08.879202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-888eb437-4fc5-4dc9-982f-37b098cf84ec tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:08.879669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-888eb437-4fc5-4dc9-982f-37b098cf84ec tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:08.880101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-888eb437-4fc5-4dc9-982f-37b098cf84ec tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:09.007086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-888eb437-4fc5-4dc9-982f-37b098cf84ec tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:09.015391 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-888eb437-4fc5-4dc9-982f-37b098cf84ec tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1506 microversion: 2.1 time: 0.148306 Oct 11 05:29:09.015955 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3796/7825] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:08 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1506 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:09.041714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:09.042297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:09.049265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:09.049755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:09.050224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:09.050928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:09.051389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:09.051826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:09.065300 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] HTTP exception thrown: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Request method failure captured: Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 HTTP/1.1 Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRP8EFEnS0c60kZ8EXmYxIoWOucLqrbD_W_iFT3BRNDlYFvMbaQeuKuDFyU3vvvSte1U2ZELGi1z6mbHMKvEZUOWhdrT2ygX4MBZdO9hNuwvD9nK0VGcGuRpG-fF3FEUlOj0NbHVd3BoupVEnV5GkPtVkWeUvaqicy5r9h3HHdSDUcw4 Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}] Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 329f20fc520f47eeb50e0396ebe9e86a Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '4cc92bad-e1fc-40bb-a619-252b19a608f6'} Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:29:09.066891 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Returning 404 to user: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d34eb8bb-5492-4f86-a64a-6b775943a30a tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 404 len: 111 microversion: 2.1 time: 0.031310 Oct 11 05:29:09.071712 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4030/7826] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:29:09 2022] DELETE /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:29:09.077157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:09.077769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: 4cc92bad-e1fc-40bb-a619-252b19a608f6] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:09.083680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:09.084154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:09.084588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:09.085268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:09.085715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:09.086138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:09.099608 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] HTTP exception thrown: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Request method failure captured: Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 HTTP/1.1 Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRP8EFEnS0c60kZ8EXmYxIoWOucLqrbD_W_iFT3BRNDlYFvMbaQeuKuDFyU3vvvSte1U2ZELGi1z6mbHMKvEZUOWhdrT2ygX4MBZdO9hNuwvD9nK0VGcGuRpG-fF3FEUlOj0NbHVd3BoupVEnV5GkPtVkWeUvaqicy5r9h3HHdSDUcw4 Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}] Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 329f20fc520f47eeb50e0396ebe9e86a Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '4cc92bad-e1fc-40bb-a619-252b19a608f6'} Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:09.101114 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:09.106228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:09.106228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:09.106228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:09.106228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:29:09.106228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:29:09.106228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. Oct 11 05:29:09.106228 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:09.106228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Returning 404 to user: Instance 4cc92bad-e1fc-40bb-a619-252b19a608f6 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:29:09.106228 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c94521f3-ec74-45a1-ae18-e56fbc789989 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6" status: 404 len: 111 microversion: 2.1 time: 0.029148 Oct 11 05:29:09.106228 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3797/7827] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:09 2022] GET /compute/v2.1/servers/4cc92bad-e1fc-40bb-a619-252b19a608f6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:29:09.110763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d84699f1-6466-40d4-a5c3-d1b9dab275ca tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:09.111297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d84699f1-6466-40d4-a5c3-d1b9dab275ca tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:09.117103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84699f1-6466-40d4-a5c3-d1b9dab275ca tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:09.117595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84699f1-6466-40d4-a5c3-d1b9dab275ca tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:09.118043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84699f1-6466-40d4-a5c3-d1b9dab275ca tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:09.118773 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84699f1-6466-40d4-a5c3-d1b9dab275ca tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:09.119759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84699f1-6466-40d4-a5c3-d1b9dab275ca tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:09.120199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d84699f1-6466-40d4-a5c3-d1b9dab275ca tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:09.145727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d84699f1-6466-40d4-a5c3-d1b9dab275ca tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:29:09.159207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=100 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:29:09.421582 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d84699f1-6466-40d4-a5c3-d1b9dab275ca tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "DELETE /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 204 len: 0 microversion: 2.1 time: 0.314300 Oct 11 05:29:09.422175 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4031/7828] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:29:09 2022] DELETE /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:29:09.431011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3a638ad8-1e8e-4958-a4f4-6ec453b0fc6b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:09.432256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3a638ad8-1e8e-4958-a4f4-6ec453b0fc6b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:09.438437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a638ad8-1e8e-4958-a4f4-6ec453b0fc6b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:09.438914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a638ad8-1e8e-4958-a4f4-6ec453b0fc6b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:09.439348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a638ad8-1e8e-4958-a4f4-6ec453b0fc6b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:09.440027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a638ad8-1e8e-4958-a4f4-6ec453b0fc6b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:09.440473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a638ad8-1e8e-4958-a4f4-6ec453b0fc6b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:09.440894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3a638ad8-1e8e-4958-a4f4-6ec453b0fc6b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:09.572207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3a638ad8-1e8e-4958-a4f4-6ec453b0fc6b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:09.579985 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3a638ad8-1e8e-4958-a4f4-6ec453b0fc6b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1512 microversion: 2.1 time: 0.153745 Oct 11 05:29:09.580550 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3798/7829] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:09 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1512 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:10.603817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22740cc7-159b-457d-b372-1c344fa668f4 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:10.604528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22740cc7-159b-457d-b372-1c344fa668f4 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:10.607268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:29:10.611945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22740cc7-159b-457d-b372-1c344fa668f4 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:10.612437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22740cc7-159b-457d-b372-1c344fa668f4 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:10.612887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22740cc7-159b-457d-b372-1c344fa668f4 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:10.613585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22740cc7-159b-457d-b372-1c344fa668f4 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:10.614045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22740cc7-159b-457d-b372-1c344fa668f4 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:10.614505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22740cc7-159b-457d-b372-1c344fa668f4 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:10.746624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22740cc7-159b-457d-b372-1c344fa668f4 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:10.754616 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22740cc7-159b-457d-b372-1c344fa668f4 tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1512 microversion: 2.1 time: 0.155126 Oct 11 05:29:10.757959 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4032/7830] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:10 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1512 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:11.339680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-4a12cdd8-9242-46d0-903f-ec974e619a89 req-cd311a42-121f-48d1-88b9-fb2a3ab91432 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f714e41f-418c-4ce9-9195-aaa96acf9cb7", "name": "network-vif-deleted", "tag": "d9678c84-cf88-4966-b3dd-b1c6b42f1748"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:29:11.350561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4a12cdd8-9242-46d0-903f-ec974e619a89 req-cd311a42-121f-48d1-88b9-fb2a3ab91432 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:11.354010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4a12cdd8-9242-46d0-903f-ec974e619a89 req-cd311a42-121f-48d1-88b9-fb2a3ab91432 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:11.354010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-4a12cdd8-9242-46d0-903f-ec974e619a89 req-cd311a42-121f-48d1-88b9-fb2a3ab91432 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:11.364370 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-4a12cdd8-9242-46d0-903f-ec974e619a89 req-cd311a42-121f-48d1-88b9-fb2a3ab91432 service nova] Creating event network-vif-deleted:d9678c84-cf88-4966-b3dd-b1c6b42f1748 for instance f714e41f-418c-4ce9-9195-aaa96acf9cb7 on n-h1-860892-1 Oct 11 05:29:11.369771 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-4a12cdd8-9242-46d0-903f-ec974e619a89 req-cd311a42-121f-48d1-88b9-fb2a3ab91432 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034671 Oct 11 05:29:11.370443 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3799/7831] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:29:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:29:11.779741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:11.780308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:11.787220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:11.787712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:11.788155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:11.788847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:11.789308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:11.789742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:11.820067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:11.820553 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:11.820996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:11.821451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lazy-loading 'fault' on Instance uuid f714e41f-418c-4ce9-9195-aaa96acf9cb7 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:29:11.862571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '329f20fc520f47eeb50e0396ebe9e86a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06a44d00dd3b4028a46dae0097c12180', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:11.870449 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-360a9698-b99a-4b10-aa7f-2c9dee37e67b tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 200 len: 1307 microversion: 2.1 time: 0.095393 Oct 11 05:29:11.871023 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4033/7832] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:11 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:29:12.893903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:12.894636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] [instance: f714e41f-418c-4ce9-9195-aaa96acf9cb7] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:12.902668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:12.903178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:12.903648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:12.904352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:12.904810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:12.905241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:12.919651 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] HTTP exception thrown: Instance f714e41f-418c-4ce9-9195-aaa96acf9cb7 could not be found. Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Request method failure captured: Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 HTTP/1.1 Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRP8EFEnS0c60kZ8EXmYxIoWOucLqrbD_W_iFT3BRNDlYFvMbaQeuKuDFyU3vvvSte1U2ZELGi1z6mbHMKvEZUOWhdrT2ygX4MBZdO9hNuwvD9nK0VGcGuRpG-fF3FEUlOj0NbHVd3BoupVEnV5GkPtVkWeUvaqicy5r9h3HHdSDUcw4 Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/06a44d00dd3b4028a46dae0097c12180"}]}] Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 06a44d00dd3b4028a46dae0097c12180 Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-ServersNegativeTestJSON-1918699479 Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 329f20fc520f47eeb50e0396ebe9e86a Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-ServersNegativeTestJSON-1918699479-project Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance f714e41f-418c-4ce9-9195-aaa96acf9cb7 could not be found. Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'f714e41f-418c-4ce9-9195-aaa96acf9cb7'} Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f714e41f-418c-4ce9-9195-aaa96acf9cb7 could not be found. Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f714e41f-418c-4ce9-9195-aaa96acf9cb7 could not be found. Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:29:12.922401 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:12.927065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:29:12.927065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:29:12.927065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:29:12.927065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:29:12.927065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:29:12.927065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f714e41f-418c-4ce9-9195-aaa96acf9cb7 could not be found. Oct 11 05:29:12.927065 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:29:12.927065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] Returning 404 to user: Instance f714e41f-418c-4ce9-9195-aaa96acf9cb7 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:29:12.927065 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e08d5292-7455-4b0d-913c-c6f60e06f99d tempest-ServersNegativeTestJSON-1918699479 tempest-ServersNegativeTestJSON-1918699479-project] 10.222.0.26 "GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7" status: 404 len: 111 microversion: 2.1 time: 0.033433 Oct 11 05:29:12.927065 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3800/7833] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:12 2022] GET /compute/v2.1/servers/f714e41f-418c-4ce9-9195-aaa96acf9cb7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:29:58.009299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=5 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:29:58.010130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=20,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:29:58.194646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e706ba5b-8ab6-4a93-be31-428f88c752a2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Action: 'create', calling method: .version_select at 0x7fda1923af70>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-202678798", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWI7Cgs0/m3JbazmaAVdr3kwevOUmxBBccybyjPAc045jsqeThWhiXEb/DjSfWO3ifdyaBwI3do8Ku0rajJFQHn9DHG/PpOuFvYO8KT0nddpeZewNoZo4svO87CFkpJJg=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:29:58.216047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-e706ba5b-8ab6-4a93-be31-428f88c752a2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for project 723ed466f815432b8edc3a37ae91b47f. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:29:58.221182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-e706ba5b-8ab6-4a93-be31-428f88c752a2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for user c7ac7de67908463e85c182c901fddb06 and project 723ed466f815432b8edc3a37ae91b47f. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:29:58.326227 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e706ba5b-8ab6-4a93-be31-428f88c752a2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.318204 Oct 11 05:29:58.326875 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4034/7834] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:29:58 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:29:58.378669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1006608260", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-202678798", "networks": [{"uuid": "1bdf6f46-8649-46c8-8c61-241c7db7fbfd"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:29:58.388470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=23 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:29:58.389319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=47 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:29:58.438052 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] validate_networks() for [('1bdf6f46-8649-46c8-8c61-241c7db7fbfd', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:29:58.878426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:29:58.879060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:29:58.879543 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:29:58.879962 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:29:58.880380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:29:58.889454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:58.889942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:58.890427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:58.891165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:29:58.891887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:29:58.892320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:29:58.909293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for project 723ed466f815432b8edc3a37ae91b47f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:29:58.914592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for user c7ac7de67908463e85c182c901fddb06 and project 723ed466f815432b8edc3a37ae91b47f. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:29:58.927738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:29:58.930095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:29:59.034949 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-128f55a3-3cf2-4b20-8419-bc9ccbd2235b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.660423 Oct 11 05:29:59.035837 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3801/7835] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:29:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 662 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:29:59.048608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72c8c471-24f1-45bd-b392-d39c7a65f7ca tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:29:59.049239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72c8c471-24f1-45bd-b392-d39c7a65f7ca tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:29:59.112229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72c8c471-24f1-45bd-b392-d39c7a65f7ca tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:29:59.120229 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72c8c471-24f1-45bd-b392-d39c7a65f7ca tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1262 microversion: 2.1 time: 0.076991 Oct 11 05:29:59.120789 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4035/7836] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:29:59 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1262 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:00.145436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7948567c-bf43-4dd0-82ad-eb0dcfb1d690 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:00.146006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7948567c-bf43-4dd0-82ad-eb0dcfb1d690 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:00.199923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7948567c-bf43-4dd0-82ad-eb0dcfb1d690 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:00.208788 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7948567c-bf43-4dd0-82ad-eb0dcfb1d690 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1262 microversion: 2.1 time: 0.068894 Oct 11 05:30:00.209320 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3802/7837] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:00 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1262 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:01.232227 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c0cf4089-b57c-4545-af44-2b0bc2cc6af6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:01.232867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c0cf4089-b57c-4545-af44-2b0bc2cc6af6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:01.240593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0cf4089-b57c-4545-af44-2b0bc2cc6af6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:01.241270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0cf4089-b57c-4545-af44-2b0bc2cc6af6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:01.241870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0cf4089-b57c-4545-af44-2b0bc2cc6af6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:01.242812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0cf4089-b57c-4545-af44-2b0bc2cc6af6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:01.243521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0cf4089-b57c-4545-af44-2b0bc2cc6af6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:01.244080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c0cf4089-b57c-4545-af44-2b0bc2cc6af6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:01.311460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c0cf4089-b57c-4545-af44-2b0bc2cc6af6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:01.319429 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c0cf4089-b57c-4545-af44-2b0bc2cc6af6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1314 microversion: 2.1 time: 0.091753 Oct 11 05:30:01.320018 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4036/7838] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:01 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1314 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:02.344672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2deb4a13-0035-4ca8-8344-60fed795b694 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:02.345292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2deb4a13-0035-4ca8-8344-60fed795b694 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:02.352512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2deb4a13-0035-4ca8-8344-60fed795b694 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:02.353003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2deb4a13-0035-4ca8-8344-60fed795b694 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:02.353439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2deb4a13-0035-4ca8-8344-60fed795b694 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:02.354134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2deb4a13-0035-4ca8-8344-60fed795b694 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:02.354615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2deb4a13-0035-4ca8-8344-60fed795b694 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:02.355040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2deb4a13-0035-4ca8-8344-60fed795b694 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:02.504646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2deb4a13-0035-4ca8-8344-60fed795b694 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:02.513599 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2deb4a13-0035-4ca8-8344-60fed795b694 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1362 microversion: 2.1 time: 0.173765 Oct 11 05:30:02.514231 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3803/7839] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:02 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:03.323776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-c970925c-55d4-49b9-bc79-25718f60aa22 req-bd55c20d-9be5-474b-84d3-35416d2faf41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "39599065-f56e-4e3a-80e3-723e9c157610", "tag": "7aa81827-b98c-4152-9639-3cfd15a9b70f"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:30:03.334389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c970925c-55d4-49b9-bc79-25718f60aa22 req-bd55c20d-9be5-474b-84d3-35416d2faf41 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:03.334879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c970925c-55d4-49b9-bc79-25718f60aa22 req-bd55c20d-9be5-474b-84d3-35416d2faf41 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:03.335324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-c970925c-55d4-49b9-bc79-25718f60aa22 req-bd55c20d-9be5-474b-84d3-35416d2faf41 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:03.346865 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-c970925c-55d4-49b9-bc79-25718f60aa22 req-bd55c20d-9be5-474b-84d3-35416d2faf41 service nova] Creating event network-changed:7aa81827-b98c-4152-9639-3cfd15a9b70f for instance 39599065-f56e-4e3a-80e3-723e9c157610 on n-h1-860892-1 Oct 11 05:30:03.351945 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-c970925c-55d4-49b9-bc79-25718f60aa22 req-bd55c20d-9be5-474b-84d3-35416d2faf41 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031903 Oct 11 05:30:03.352530 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4037/7840] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:30:03.537104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cf9608b3-8970-4b17-b645-4103c5860272 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:03.539598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf9608b3-8970-4b17-b645-4103c5860272 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:03.544984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9608b3-8970-4b17-b645-4103c5860272 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:03.545468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9608b3-8970-4b17-b645-4103c5860272 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:03.545983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9608b3-8970-4b17-b645-4103c5860272 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:03.546860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9608b3-8970-4b17-b645-4103c5860272 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:03.547315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9608b3-8970-4b17-b645-4103c5860272 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:03.547741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf9608b3-8970-4b17-b645-4103c5860272 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:03.680985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cf9608b3-8970-4b17-b645-4103c5860272 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:03.689231 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cf9608b3-8970-4b17-b645-4103c5860272 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1362 microversion: 2.1 time: 0.156131 Oct 11 05:30:03.689811 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3804/7841] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:03 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:04.713844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9378d5d5-c1d2-4580-a09d-1fdaab22094d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:04.714576 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9378d5d5-c1d2-4580-a09d-1fdaab22094d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:04.721447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9378d5d5-c1d2-4580-a09d-1fdaab22094d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:04.721934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9378d5d5-c1d2-4580-a09d-1fdaab22094d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:04.722433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9378d5d5-c1d2-4580-a09d-1fdaab22094d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:04.723130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9378d5d5-c1d2-4580-a09d-1fdaab22094d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:04.723591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9378d5d5-c1d2-4580-a09d-1fdaab22094d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:04.724026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9378d5d5-c1d2-4580-a09d-1fdaab22094d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:04.857143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9378d5d5-c1d2-4580-a09d-1fdaab22094d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:04.864894 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9378d5d5-c1d2-4580-a09d-1fdaab22094d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1362 microversion: 2.1 time: 0.156356 Oct 11 05:30:04.865465 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4038/7842] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:04 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:05.888037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1674698f-00a2-43db-bf95-2e1fd93f66f5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:05.888686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1674698f-00a2-43db-bf95-2e1fd93f66f5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:05.895348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1674698f-00a2-43db-bf95-2e1fd93f66f5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:05.895832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1674698f-00a2-43db-bf95-2e1fd93f66f5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:05.896274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1674698f-00a2-43db-bf95-2e1fd93f66f5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:05.896956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1674698f-00a2-43db-bf95-2e1fd93f66f5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:05.897414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1674698f-00a2-43db-bf95-2e1fd93f66f5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:05.897840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1674698f-00a2-43db-bf95-2e1fd93f66f5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:06.025555 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1674698f-00a2-43db-bf95-2e1fd93f66f5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:06.033917 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1674698f-00a2-43db-bf95-2e1fd93f66f5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1362 microversion: 2.1 time: 0.149812 Oct 11 05:30:06.034549 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3805/7843] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:05 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:07.057400 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6c4b3ef7-b5a7-47e8-ba9f-8d5356402cd2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:07.058022 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6c4b3ef7-b5a7-47e8-ba9f-8d5356402cd2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:07.065141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c4b3ef7-b5a7-47e8-ba9f-8d5356402cd2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:07.065629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c4b3ef7-b5a7-47e8-ba9f-8d5356402cd2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:07.066076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c4b3ef7-b5a7-47e8-ba9f-8d5356402cd2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:07.066797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c4b3ef7-b5a7-47e8-ba9f-8d5356402cd2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:07.067258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c4b3ef7-b5a7-47e8-ba9f-8d5356402cd2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:07.067695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6c4b3ef7-b5a7-47e8-ba9f-8d5356402cd2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:07.198012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6c4b3ef7-b5a7-47e8-ba9f-8d5356402cd2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:07.205624 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6c4b3ef7-b5a7-47e8-ba9f-8d5356402cd2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1362 microversion: 2.1 time: 0.152127 Oct 11 05:30:07.206215 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4039/7844] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:07 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:08.228679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3f16b092-1bc1-4b03-972e-67850c00e27e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:08.229300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3f16b092-1bc1-4b03-972e-67850c00e27e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:08.237206 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f16b092-1bc1-4b03-972e-67850c00e27e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:08.237687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f16b092-1bc1-4b03-972e-67850c00e27e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:08.238122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f16b092-1bc1-4b03-972e-67850c00e27e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:08.238840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f16b092-1bc1-4b03-972e-67850c00e27e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:08.239289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f16b092-1bc1-4b03-972e-67850c00e27e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:08.239710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3f16b092-1bc1-4b03-972e-67850c00e27e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:08.391484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3f16b092-1bc1-4b03-972e-67850c00e27e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:08.401945 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3f16b092-1bc1-4b03-972e-67850c00e27e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1362 microversion: 2.1 time: 0.177166 Oct 11 05:30:08.402626 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3806/7845] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:08 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1362 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:09.426470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5f2fb6bf-390a-46d7-9380-8da93ba0273b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:09.427129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5f2fb6bf-390a-46d7-9380-8da93ba0273b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:09.430041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:30:09.434833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2fb6bf-390a-46d7-9380-8da93ba0273b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:09.435947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2fb6bf-390a-46d7-9380-8da93ba0273b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:09.436398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2fb6bf-390a-46d7-9380-8da93ba0273b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:09.437095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2fb6bf-390a-46d7-9380-8da93ba0273b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:09.437558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2fb6bf-390a-46d7-9380-8da93ba0273b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:09.437996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5f2fb6bf-390a-46d7-9380-8da93ba0273b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:09.852635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5f2fb6bf-390a-46d7-9380-8da93ba0273b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:09.853068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f019972e-37da-49c6-b36a-693066d3ea42 req-85cb9e62-6ac0-4b1a-8ea3-33cb5881f08c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39599065-f56e-4e3a-80e3-723e9c157610", "name": "network-vif-plugged", "status": "completed", "tag": "7aa81827-b98c-4152-9639-3cfd15a9b70f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:30:09.860291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:30:09.861685 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5f2fb6bf-390a-46d7-9380-8da93ba0273b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1362 microversion: 2.1 time: 0.439057 Oct 11 05:30:09.862313 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4040/7846] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:09 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1362 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:09.865413 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f019972e-37da-49c6-b36a-693066d3ea42 req-85cb9e62-6ac0-4b1a-8ea3-33cb5881f08c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:09.865898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f019972e-37da-49c6-b36a-693066d3ea42 req-85cb9e62-6ac0-4b1a-8ea3-33cb5881f08c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:09.866375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f019972e-37da-49c6-b36a-693066d3ea42 req-85cb9e62-6ac0-4b1a-8ea3-33cb5881f08c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:09.877630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f019972e-37da-49c6-b36a-693066d3ea42 req-85cb9e62-6ac0-4b1a-8ea3-33cb5881f08c service nova] Creating event network-vif-plugged:7aa81827-b98c-4152-9639-3cfd15a9b70f for instance 39599065-f56e-4e3a-80e3-723e9c157610 on n-h1-860892-1 Oct 11 05:30:09.882848 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f019972e-37da-49c6-b36a-693066d3ea42 req-85cb9e62-6ac0-4b1a-8ea3-33cb5881f08c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033712 Oct 11 05:30:09.883432 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3807/7847] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:30:10.884489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-64a2908a-2f7a-44ea-a9c5-20fe29ed5df6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:10.885114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-64a2908a-2f7a-44ea-a9c5-20fe29ed5df6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:10.892219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64a2908a-2f7a-44ea-a9c5-20fe29ed5df6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:10.892714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64a2908a-2f7a-44ea-a9c5-20fe29ed5df6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:10.893173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64a2908a-2f7a-44ea-a9c5-20fe29ed5df6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:10.893873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64a2908a-2f7a-44ea-a9c5-20fe29ed5df6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:10.894374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64a2908a-2f7a-44ea-a9c5-20fe29ed5df6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:10.894819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-64a2908a-2f7a-44ea-a9c5-20fe29ed5df6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:11.024320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-64a2908a-2f7a-44ea-a9c5-20fe29ed5df6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:11.031984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-64a2908a-2f7a-44ea-a9c5-20fe29ed5df6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1362 microversion: 2.1 time: 0.151503 Oct 11 05:30:11.032550 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4041/7848] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:10 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:12.051822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:30:12.056959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a7c06d40-17e8-47fd-8c6e-d4427f9620e1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:12.057661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a7c06d40-17e8-47fd-8c6e-d4427f9620e1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:12.064816 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c06d40-17e8-47fd-8c6e-d4427f9620e1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:12.065300 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c06d40-17e8-47fd-8c6e-d4427f9620e1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:12.065741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c06d40-17e8-47fd-8c6e-d4427f9620e1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:12.066454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c06d40-17e8-47fd-8c6e-d4427f9620e1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:12.066912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c06d40-17e8-47fd-8c6e-d4427f9620e1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:12.067339 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a7c06d40-17e8-47fd-8c6e-d4427f9620e1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:12.195541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a7c06d40-17e8-47fd-8c6e-d4427f9620e1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:12.203366 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a7c06d40-17e8-47fd-8c6e-d4427f9620e1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1553 microversion: 2.1 time: 0.152517 Oct 11 05:30:12.203932 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3808/7849] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:12 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:12.225342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c432ed3e-285c-479d-9adc-e77c62a6ae42 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:12.225962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c432ed3e-285c-479d-9adc-e77c62a6ae42 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:12.233394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c432ed3e-285c-479d-9adc-e77c62a6ae42 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:12.233883 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c432ed3e-285c-479d-9adc-e77c62a6ae42 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:12.234360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c432ed3e-285c-479d-9adc-e77c62a6ae42 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:12.235056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c432ed3e-285c-479d-9adc-e77c62a6ae42 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:12.235514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c432ed3e-285c-479d-9adc-e77c62a6ae42 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:12.235945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c432ed3e-285c-479d-9adc-e77c62a6ae42 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:12.365843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c432ed3e-285c-479d-9adc-e77c62a6ae42 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:12.374394 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c432ed3e-285c-479d-9adc-e77c62a6ae42 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1553 microversion: 2.1 time: 0.152910 Oct 11 05:30:12.374957 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4042/7850] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:12 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:15.449700 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef04a014-d560-4d11-81a1-fadf8c2896ce tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2112bb7-ade1-4162-8436-94bb1cfc173c"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:30:15.452183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ef04a014-d560-4d11-81a1-fadf8c2896ce tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:15.459050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef04a014-d560-4d11-81a1-fadf8c2896ce tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:15.459535 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef04a014-d560-4d11-81a1-fadf8c2896ce tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:15.459978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef04a014-d560-4d11-81a1-fadf8c2896ce tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:15.460666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef04a014-d560-4d11-81a1-fadf8c2896ce tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:15.461115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef04a014-d560-4d11-81a1-fadf8c2896ce tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:15.461550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ef04a014-d560-4d11-81a1-fadf8c2896ce tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:16.229987 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef04a014-d560-4d11-81a1-fadf8c2896ce tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "POST /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.784047 Oct 11 05:30:16.230684 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3809/7851] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 05:30:15 2022] POST /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments => generated 194 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:30:27.982210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27b39c66-50ca-4a42-8e92-05cbb7f542c8 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:27.982735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-27b39c66-50ca-4a42-8e92-05cbb7f542c8 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:27.985699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:30:27.986416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=38 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:30:27.991605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27b39c66-50ca-4a42-8e92-05cbb7f542c8 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:27.992113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27b39c66-50ca-4a42-8e92-05cbb7f542c8 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:27.992571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27b39c66-50ca-4a42-8e92-05cbb7f542c8 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:27.993288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27b39c66-50ca-4a42-8e92-05cbb7f542c8 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:27.993762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27b39c66-50ca-4a42-8e92-05cbb7f542c8 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:27.994238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27b39c66-50ca-4a42-8e92-05cbb7f542c8 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:28.073898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-27b39c66-50ca-4a42-8e92-05cbb7f542c8 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lazy-loading 'services' on Instance uuid 39599065-f56e-4e3a-80e3-723e9c157610 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:30:28.269462 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-27b39c66-50ca-4a42-8e92-05cbb7f542c8 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments/d2112bb7-ade1-4162-8436-94bb1cfc173c" status: 202 len: 0 microversion: 2.1 time: 0.291021 Oct 11 05:30:28.270308 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4043/7852] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 05:30:27 2022] DELETE /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments/d2112bb7-ade1-4162-8436-94bb1cfc173c => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:30:28.279414 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:30:28.279414 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:30:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments (ip 10.222.0.26) !!! Oct 11 05:30:28.279414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:30:28.279414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:30:28.283778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-09781274-d2b3-4013-8d32-2fc06b088743 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:28.286687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-09781274-d2b3-4013-8d32-2fc06b088743 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:28.294993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09781274-d2b3-4013-8d32-2fc06b088743 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:28.295513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09781274-d2b3-4013-8d32-2fc06b088743 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:28.295947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09781274-d2b3-4013-8d32-2fc06b088743 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:28.296697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09781274-d2b3-4013-8d32-2fc06b088743 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:28.297186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09781274-d2b3-4013-8d32-2fc06b088743 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:28.297632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-09781274-d2b3-4013-8d32-2fc06b088743 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:28.332528 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-09781274-d2b3-4013-8d32-2fc06b088743 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057701 Oct 11 05:30:28.333104 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3810/7853] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:30:28 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:30:29.345753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8bee62a1-0459-4f1b-a37b-c5556e5eed4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:29.348319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8bee62a1-0459-4f1b-a37b-c5556e5eed4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:29.355762 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bee62a1-0459-4f1b-a37b-c5556e5eed4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:29.356264 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bee62a1-0459-4f1b-a37b-c5556e5eed4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:29.356717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bee62a1-0459-4f1b-a37b-c5556e5eed4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:29.357461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bee62a1-0459-4f1b-a37b-c5556e5eed4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:29.357934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bee62a1-0459-4f1b-a37b-c5556e5eed4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:29.358412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8bee62a1-0459-4f1b-a37b-c5556e5eed4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:29.389306 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8bee62a1-0459-4f1b-a37b-c5556e5eed4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047916 Oct 11 05:30:29.389877 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4044/7854] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:30:29 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:30:30.402572 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b8eabdf5-073e-43e6-99ed-6e7fb219129a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:30.404883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b8eabdf5-073e-43e6-99ed-6e7fb219129a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:30.413883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8eabdf5-073e-43e6-99ed-6e7fb219129a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:30.414478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8eabdf5-073e-43e6-99ed-6e7fb219129a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:30.414929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8eabdf5-073e-43e6-99ed-6e7fb219129a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:30.415640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8eabdf5-073e-43e6-99ed-6e7fb219129a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:30.416094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8eabdf5-073e-43e6-99ed-6e7fb219129a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:30.416691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b8eabdf5-073e-43e6-99ed-6e7fb219129a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:30.449634 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b8eabdf5-073e-43e6-99ed-6e7fb219129a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051091 Oct 11 05:30:30.450125 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3811/7855] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:30:30 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:30:31.461260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af6ff711-af35-4642-8a37-1635c296e7cc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:31.463467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af6ff711-af35-4642-8a37-1635c296e7cc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:31.470347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6ff711-af35-4642-8a37-1635c296e7cc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:31.470842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6ff711-af35-4642-8a37-1635c296e7cc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:31.471290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6ff711-af35-4642-8a37-1635c296e7cc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:31.472487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6ff711-af35-4642-8a37-1635c296e7cc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:31.472944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6ff711-af35-4642-8a37-1635c296e7cc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:31.473379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af6ff711-af35-4642-8a37-1635c296e7cc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:31.505906 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af6ff711-af35-4642-8a37-1635c296e7cc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048786 Oct 11 05:30:31.506498 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4045/7856] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:30:31 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:30:32.521079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ba5432c4-d5b3-456b-98f7-165ae798a396 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:32.523317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ba5432c4-d5b3-456b-98f7-165ae798a396 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:32.530897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5432c4-d5b3-456b-98f7-165ae798a396 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:32.531384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5432c4-d5b3-456b-98f7-165ae798a396 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:32.531824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5432c4-d5b3-456b-98f7-165ae798a396 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:32.532525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5432c4-d5b3-456b-98f7-165ae798a396 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:32.532989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5432c4-d5b3-456b-98f7-165ae798a396 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:32.533593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5432c4-d5b3-456b-98f7-165ae798a396 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:32.564375 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ba5432c4-d5b3-456b-98f7-165ae798a396 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049749 Oct 11 05:30:32.564939 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3812/7857] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:30:32 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:30:33.577378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72e1fd75-a0f6-4b9e-b8f6-e3fd7bcf2d99 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:33.579670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72e1fd75-a0f6-4b9e-b8f6-e3fd7bcf2d99 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:33.586965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72e1fd75-a0f6-4b9e-b8f6-e3fd7bcf2d99 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:33.587458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72e1fd75-a0f6-4b9e-b8f6-e3fd7bcf2d99 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:33.587907 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72e1fd75-a0f6-4b9e-b8f6-e3fd7bcf2d99 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:33.588600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72e1fd75-a0f6-4b9e-b8f6-e3fd7bcf2d99 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:33.589064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72e1fd75-a0f6-4b9e-b8f6-e3fd7bcf2d99 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:33.589499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72e1fd75-a0f6-4b9e-b8f6-e3fd7bcf2d99 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:33.619349 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72e1fd75-a0f6-4b9e-b8f6-e3fd7bcf2d99 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045947 Oct 11 05:30:33.619936 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4046/7858] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:30:33 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 05:30:33.637501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:33.637993 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:33.645790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:33.646372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:33.646908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:33.647592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:33.648037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:33.648470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:33.722094 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] HTTP exception thrown: Instance 39599065-f56e-4e3a-80e3-723e9c157610 is not attached to volume d2112bb7-ade1-4162-8436-94bb1cfc173c Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Request method failure captured: Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments/d2112bb7-ade1-4162-8436-94bb1cfc173c HTTP/1.1 Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRP9PFClGz5v6fhtC0RhpPLORrm_0iQX3qJkmNL1KGAyUabPUzombhgKXFeRDC6dtfUNGsS7o1l56kjv78ULTmhlf4ZjEF7oZe4KqToVn7j72c6QxXEBI_7MVbnv1zoRMbZMYtyDJGfNXUBelpZ6LRZvV9IrjbgUmo40CfcdYz99u6B0 Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}] Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: c7ac7de67908463e85c182c901fddb06 Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 39599065-f56e-4e3a-80e3-723e9c157610 is not attached to volume d2112bb7-ade1-4162-8436-94bb1cfc173c Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': '39599065-f56e-4e3a-80e3-723e9c157610', 'id': 'd2112bb7-ade1-4162-8436-94bb1cfc173c'} Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d2112bb7-ade1-4162-8436-94bb1cfc173c. Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39599065-f56e-4e3a-80e3-723e9c157610 is not attached to volume d2112bb7-ade1-4162-8436-94bb1cfc173c Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:30:33.731668 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:30:33.736196 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:30:33.736196 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:30:33.736196 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39599065-f56e-4e3a-80e3-723e9c157610 is not attached to volume d2112bb7-ade1-4162-8436-94bb1cfc173c Oct 11 05:30:33.736196 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:30:33.736196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Returning 404 to user: Instance 39599065-f56e-4e3a-80e3-723e9c157610 is not attached to volume d2112bb7-ade1-4162-8436-94bb1cfc173c {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:30:33.736196 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b381082b-3919-4b5d-96dd-b1037ad49c70 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments/d2112bb7-ade1-4162-8436-94bb1cfc173c" status: 404 len: 154 microversion: 2.1 time: 0.099579 Oct 11 05:30:33.736196 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3813/7859] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 05:30:33 2022] DELETE /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610/os-volume_attachments/d2112bb7-ade1-4162-8436-94bb1cfc173c => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:30:37.394572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69cf185d-793c-4a06-9a67-f4f8360e05b1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:37.395491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-69cf185d-793c-4a06-9a67-f4f8360e05b1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:37.402627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69cf185d-793c-4a06-9a67-f4f8360e05b1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:37.403213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69cf185d-793c-4a06-9a67-f4f8360e05b1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:37.403664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69cf185d-793c-4a06-9a67-f4f8360e05b1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:37.404381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69cf185d-793c-4a06-9a67-f4f8360e05b1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:37.404831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69cf185d-793c-4a06-9a67-f4f8360e05b1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:37.405390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69cf185d-793c-4a06-9a67-f4f8360e05b1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:37.433497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-69cf185d-793c-4a06-9a67-f4f8360e05b1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:30:37.814930 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-69cf185d-793c-4a06-9a67-f4f8360e05b1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 204 len: 0 microversion: 2.1 time: 0.424332 Oct 11 05:30:37.815641 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4047/7860] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:30:37 2022] DELETE /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:30:37.823885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c54b72dd-6e36-45a5-8ddd-da01393ceafa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:37.824638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c54b72dd-6e36-45a5-8ddd-da01393ceafa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:37.831771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c54b72dd-6e36-45a5-8ddd-da01393ceafa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:37.832267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c54b72dd-6e36-45a5-8ddd-da01393ceafa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:37.832707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c54b72dd-6e36-45a5-8ddd-da01393ceafa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:37.833410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c54b72dd-6e36-45a5-8ddd-da01393ceafa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:37.833867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c54b72dd-6e36-45a5-8ddd-da01393ceafa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:37.834347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c54b72dd-6e36-45a5-8ddd-da01393ceafa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:37.972051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c54b72dd-6e36-45a5-8ddd-da01393ceafa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:37.979909 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c54b72dd-6e36-45a5-8ddd-da01393ceafa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1559 microversion: 2.1 time: 0.159894 Oct 11 05:30:37.980470 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3814/7861] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:37 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:39.004048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3b38f18a-af40-4394-9f63-cd1480c0349a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:39.004698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3b38f18a-af40-4394-9f63-cd1480c0349a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:39.011597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b38f18a-af40-4394-9f63-cd1480c0349a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:39.012096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b38f18a-af40-4394-9f63-cd1480c0349a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:39.012546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b38f18a-af40-4394-9f63-cd1480c0349a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:39.013246 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b38f18a-af40-4394-9f63-cd1480c0349a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:39.013710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b38f18a-af40-4394-9f63-cd1480c0349a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:39.014152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3b38f18a-af40-4394-9f63-cd1480c0349a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:39.147455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-3b38f18a-af40-4394-9f63-cd1480c0349a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:39.155211 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3b38f18a-af40-4394-9f63-cd1480c0349a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1559 microversion: 2.1 time: 0.155672 Oct 11 05:30:39.155786 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4048/7862] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:38 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:40.078622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8ebccacc-55c0-4f0d-9e44-f3451508b111 req-c599eed4-e449-46de-9abe-a03ef0d90121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "39599065-f56e-4e3a-80e3-723e9c157610", "name": "network-vif-deleted", "tag": "7aa81827-b98c-4152-9639-3cfd15a9b70f"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:30:40.089231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8ebccacc-55c0-4f0d-9e44-f3451508b111 req-c599eed4-e449-46de-9abe-a03ef0d90121 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:40.089719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8ebccacc-55c0-4f0d-9e44-f3451508b111 req-c599eed4-e449-46de-9abe-a03ef0d90121 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:40.090157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8ebccacc-55c0-4f0d-9e44-f3451508b111 req-c599eed4-e449-46de-9abe-a03ef0d90121 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:40.102037 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8ebccacc-55c0-4f0d-9e44-f3451508b111 req-c599eed4-e449-46de-9abe-a03ef0d90121 service nova] Creating event network-vif-deleted:7aa81827-b98c-4152-9639-3cfd15a9b70f for instance 39599065-f56e-4e3a-80e3-723e9c157610 on n-h1-860892-1 Oct 11 05:30:40.107490 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8ebccacc-55c0-4f0d-9e44-f3451508b111 req-c599eed4-e449-46de-9abe-a03ef0d90121 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032578 Oct 11 05:30:40.108099 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3815/7863] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:30:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:30:40.180045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fc884d2f-2691-4e20-9e63-3b5e6850dfef tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:40.190032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fc884d2f-2691-4e20-9e63-3b5e6850dfef tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:40.190032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc884d2f-2691-4e20-9e63-3b5e6850dfef tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:40.190032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc884d2f-2691-4e20-9e63-3b5e6850dfef tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:40.190032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc884d2f-2691-4e20-9e63-3b5e6850dfef tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:40.190032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc884d2f-2691-4e20-9e63-3b5e6850dfef tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:40.190032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc884d2f-2691-4e20-9e63-3b5e6850dfef tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:40.190676 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc884d2f-2691-4e20-9e63-3b5e6850dfef tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:40.257493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fc884d2f-2691-4e20-9e63-3b5e6850dfef tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:40.265788 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fc884d2f-2691-4e20-9e63-3b5e6850dfef tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 200 len: 1517 microversion: 2.1 time: 0.090354 Oct 11 05:30:40.270092 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4049/7864] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:40 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 1517 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:41.290407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:41.291119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 39599065-f56e-4e3a-80e3-723e9c157610] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:41.297262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:41.297748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:41.298216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:41.298916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:41.299381 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:41.299811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:41.313630 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] HTTP exception thrown: Instance 39599065-f56e-4e3a-80e3-723e9c157610 could not be found. Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Request method failure captured: Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 HTTP/1.1 Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRP9PFClGz5v6fhtC0RhpPLORrm_0iQX3qJkmNL1KGAyUabPUzombhgKXFeRDC6dtfUNGsS7o1l56kjv78ULTmhlf4ZjEF7oZe4KqToVn7j72c6QxXEBI_7MVbnv1zoRMbZMYtyDJGfNXUBelpZ6LRZvV9IrjbgUmo40CfcdYz99u6B0 Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}] Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: c7ac7de67908463e85c182c901fddb06 Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 39599065-f56e-4e3a-80e3-723e9c157610 could not be found. Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '39599065-f56e-4e3a-80e3-723e9c157610'} Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 39599065-f56e-4e3a-80e3-723e9c157610 could not be found. Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 39599065-f56e-4e3a-80e3-723e9c157610 could not be found. Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:30:41.315286 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:30:41.320454 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:30:41.320454 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:30:41.320454 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:30:41.320454 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:30:41.320454 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:30:41.320454 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:30:41.320454 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 39599065-f56e-4e3a-80e3-723e9c157610 could not be found. Oct 11 05:30:41.320454 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:30:41.320454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Returning 404 to user: Instance 39599065-f56e-4e3a-80e3-723e9c157610 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:30:41.320454 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0905910a-912b-49ba-99f5-442707e7e59b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610" status: 404 len: 111 microversion: 2.1 time: 0.032049 Oct 11 05:30:41.320454 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3816/7865] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:41 2022] GET /compute/v2.1/servers/39599065-f56e-4e3a-80e3-723e9c157610 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 11 05:30:41.326331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5babb557-1637-4abb-ba77-230ec42c8d1e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '.version_select at 0x7fda18e67a60>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:41.419720 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5babb557-1637-4abb-ba77-230ec42c8d1e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-202678798" status: 202 len: 0 microversion: 2.1 time: 0.097252 Oct 11 05:30:41.420291 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4050/7866] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 05:30:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-202678798 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:30:41.438668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b22e515b-edc3-4450-8000-7a71a74a32a2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Action: 'create', calling method: .version_select at 0x7fda18849790>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-1505352648", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjzsXmyJ7LiWJCCQns3u2q8NTHp/YchfNWWTF2haCdLUVUY4CH6LEVBhyTVqQdrxB5LV8e3SzFcmBi2UO8JEoH0+CCdzFHbvk5lS8Ds7K7SGuXDNcETlqU/dXOBdJCBWw=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:30:41.454884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-b22e515b-edc3-4450-8000-7a71a74a32a2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for project 723ed466f815432b8edc3a37ae91b47f. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:30:41.460800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-b22e515b-edc3-4450-8000-7a71a74a32a2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for user c7ac7de67908463e85c182c901fddb06 and project 723ed466f815432b8edc3a37ae91b47f. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:30:41.559033 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b22e515b-edc3-4450-8000-7a71a74a32a2 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 405 microversion: 2.1 time: 0.124282 Oct 11 05:30:41.559639 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3817/7867] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:30:41 2022] POST /compute/v2.1/os-keypairs => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:30:41.610466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1615478299", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-1505352648", "networks": [{"uuid": "1bdf6f46-8649-46c8-8c61-241c7db7fbfd"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:30:41.663838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] validate_networks() for [('1bdf6f46-8649-46c8-8c61-241c7db7fbfd', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:30:42.073466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:30:42.073905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:30:42.074440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:30:42.074870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:30:42.075298 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:30:42.084628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:42.085129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:42.085584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:42.086378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:42.086854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:42.087301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:42.104996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for project 723ed466f815432b8edc3a37ae91b47f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:30:42.110490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for user c7ac7de67908463e85c182c901fddb06 and project 723ed466f815432b8edc3a37ae91b47f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:30:42.122644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:30:42.124945 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:30:42.245184 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2a26e37c-dbdd-431d-94fc-efbfe76a6e89 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.638607 Oct 11 05:30:42.245833 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4051/7868] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:30:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:30:42.257352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e9a29f98-855e-41c5-823f-5fb950c8dedc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:42.257948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e9a29f98-855e-41c5-823f-5fb950c8dedc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:42.313407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e9a29f98-855e-41c5-823f-5fb950c8dedc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:42.323108 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e9a29f98-855e-41c5-823f-5fb950c8dedc tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1263 microversion: 2.1 time: 0.069838 Oct 11 05:30:42.323710 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3818/7869] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:42 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1263 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:43.345855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c7c82060-39e1-4e29-979d-0c1820ed7326 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:43.346664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c7c82060-39e1-4e29-979d-0c1820ed7326 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:43.356969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c82060-39e1-4e29-979d-0c1820ed7326 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:43.357465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c82060-39e1-4e29-979d-0c1820ed7326 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:43.357910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c82060-39e1-4e29-979d-0c1820ed7326 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:43.358689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c82060-39e1-4e29-979d-0c1820ed7326 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:43.363536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c82060-39e1-4e29-979d-0c1820ed7326 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:43.363536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c7c82060-39e1-4e29-979d-0c1820ed7326 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:43.421791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c7c82060-39e1-4e29-979d-0c1820ed7326 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:43.429617 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c7c82060-39e1-4e29-979d-0c1820ed7326 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1267 microversion: 2.1 time: 0.088651 Oct 11 05:30:43.430225 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4052/7870] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:43 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1267 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:44.453673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-27b9eed8-8c3c-40ce-836e-632ec24a293c tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:44.454244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-27b9eed8-8c3c-40ce-836e-632ec24a293c tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:44.465511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27b9eed8-8c3c-40ce-836e-632ec24a293c tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:44.466003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27b9eed8-8c3c-40ce-836e-632ec24a293c tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:44.466476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27b9eed8-8c3c-40ce-836e-632ec24a293c tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:44.467188 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27b9eed8-8c3c-40ce-836e-632ec24a293c tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:44.467648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27b9eed8-8c3c-40ce-836e-632ec24a293c tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:44.468082 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-27b9eed8-8c3c-40ce-836e-632ec24a293c tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:44.532189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-27b9eed8-8c3c-40ce-836e-632ec24a293c tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:44.540966 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-27b9eed8-8c3c-40ce-836e-632ec24a293c tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1321 microversion: 2.1 time: 0.091403 Oct 11 05:30:44.541564 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3819/7871] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:44 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1321 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:45.564507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4fec7f39-ff34-4ccc-b22f-c128f530fcd1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:45.565138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4fec7f39-ff34-4ccc-b22f-c128f530fcd1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:45.572543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fec7f39-ff34-4ccc-b22f-c128f530fcd1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:45.573049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fec7f39-ff34-4ccc-b22f-c128f530fcd1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:45.573501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fec7f39-ff34-4ccc-b22f-c128f530fcd1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:45.574235 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fec7f39-ff34-4ccc-b22f-c128f530fcd1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:45.574705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fec7f39-ff34-4ccc-b22f-c128f530fcd1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:45.575148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4fec7f39-ff34-4ccc-b22f-c128f530fcd1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:45.763558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4fec7f39-ff34-4ccc-b22f-c128f530fcd1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:45.772098 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4fec7f39-ff34-4ccc-b22f-c128f530fcd1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1363 microversion: 2.1 time: 0.211585 Oct 11 05:30:45.772673 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4053/7872] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:45 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:45.853049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-d6694c0d-d716-442a-9b5b-27aa669d16e1 req-26644d50-0071-4743-ba86-24d154691599 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433", "tag": "4f79331b-907d-4be6-8d54-05a7936f7d4c"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:30:45.864725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d6694c0d-d716-442a-9b5b-27aa669d16e1 req-26644d50-0071-4743-ba86-24d154691599 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:45.865203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d6694c0d-d716-442a-9b5b-27aa669d16e1 req-26644d50-0071-4743-ba86-24d154691599 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:45.865861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d6694c0d-d716-442a-9b5b-27aa669d16e1 req-26644d50-0071-4743-ba86-24d154691599 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:45.877032 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-d6694c0d-d716-442a-9b5b-27aa669d16e1 req-26644d50-0071-4743-ba86-24d154691599 service nova] Creating event network-changed:4f79331b-907d-4be6-8d54-05a7936f7d4c for instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 on n-h1-860892-1 Oct 11 05:30:45.882139 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-d6694c0d-d716-442a-9b5b-27aa669d16e1 req-26644d50-0071-4743-ba86-24d154691599 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033624 Oct 11 05:30:45.882777 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3820/7873] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:30:46.795578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-687c6bb4-2fa6-47cd-acbb-d72183e02ccb tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:46.796215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-687c6bb4-2fa6-47cd-acbb-d72183e02ccb tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:46.803420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-687c6bb4-2fa6-47cd-acbb-d72183e02ccb tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:46.803929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-687c6bb4-2fa6-47cd-acbb-d72183e02ccb tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:46.804384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-687c6bb4-2fa6-47cd-acbb-d72183e02ccb tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:46.805109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-687c6bb4-2fa6-47cd-acbb-d72183e02ccb tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:46.805575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-687c6bb4-2fa6-47cd-acbb-d72183e02ccb tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:46.806261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-687c6bb4-2fa6-47cd-acbb-d72183e02ccb tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:46.944708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-687c6bb4-2fa6-47cd-acbb-d72183e02ccb tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:46.952521 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-687c6bb4-2fa6-47cd-acbb-d72183e02ccb tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1363 microversion: 2.1 time: 0.160867 Oct 11 05:30:46.953192 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4054/7874] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:46 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:47.985202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d6567623-5702-4c70-97e7-b85550ab98ad tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:47.985890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d6567623-5702-4c70-97e7-b85550ab98ad tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:47.992068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6567623-5702-4c70-97e7-b85550ab98ad tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:47.992557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6567623-5702-4c70-97e7-b85550ab98ad tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:47.992999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6567623-5702-4c70-97e7-b85550ab98ad tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:47.993685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6567623-5702-4c70-97e7-b85550ab98ad tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:47.994134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6567623-5702-4c70-97e7-b85550ab98ad tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:47.994587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6567623-5702-4c70-97e7-b85550ab98ad tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:48.125662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d6567623-5702-4c70-97e7-b85550ab98ad tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:48.133279 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d6567623-5702-4c70-97e7-b85550ab98ad tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1363 microversion: 2.1 time: 0.153234 Oct 11 05:30:48.133848 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3821/7875] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:47 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:49.156993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b0ce6e50-29b6-4d17-b061-931a8462b4d6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:49.157617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b0ce6e50-29b6-4d17-b061-931a8462b4d6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:49.164594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce6e50-29b6-4d17-b061-931a8462b4d6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:49.165091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce6e50-29b6-4d17-b061-931a8462b4d6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:49.165541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce6e50-29b6-4d17-b061-931a8462b4d6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:49.166272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce6e50-29b6-4d17-b061-931a8462b4d6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:49.166742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce6e50-29b6-4d17-b061-931a8462b4d6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:49.167179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0ce6e50-29b6-4d17-b061-931a8462b4d6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:49.294440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b0ce6e50-29b6-4d17-b061-931a8462b4d6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:49.302143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b0ce6e50-29b6-4d17-b061-931a8462b4d6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1363 microversion: 2.1 time: 0.149119 Oct 11 05:30:49.302733 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4055/7876] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:49 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:50.325201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8574075a-3439-4af1-9cc8-02a6118f7eb6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:50.325812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8574075a-3439-4af1-9cc8-02a6118f7eb6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:50.332701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8574075a-3439-4af1-9cc8-02a6118f7eb6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:50.333179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8574075a-3439-4af1-9cc8-02a6118f7eb6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:50.333613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8574075a-3439-4af1-9cc8-02a6118f7eb6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:50.334334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8574075a-3439-4af1-9cc8-02a6118f7eb6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:50.334787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8574075a-3439-4af1-9cc8-02a6118f7eb6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:50.335211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8574075a-3439-4af1-9cc8-02a6118f7eb6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:50.462582 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8574075a-3439-4af1-9cc8-02a6118f7eb6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:50.470304 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8574075a-3439-4af1-9cc8-02a6118f7eb6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1363 microversion: 2.1 time: 0.149006 Oct 11 05:30:50.470877 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3822/7877] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:50 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:51.494269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b6a5926d-0a2a-4a9d-ba3c-cf2dd1d17628 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:51.494916 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b6a5926d-0a2a-4a9d-ba3c-cf2dd1d17628 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:51.500918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6a5926d-0a2a-4a9d-ba3c-cf2dd1d17628 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:51.501405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6a5926d-0a2a-4a9d-ba3c-cf2dd1d17628 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:51.501851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6a5926d-0a2a-4a9d-ba3c-cf2dd1d17628 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:51.502580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6a5926d-0a2a-4a9d-ba3c-cf2dd1d17628 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:51.503043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6a5926d-0a2a-4a9d-ba3c-cf2dd1d17628 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:51.503482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6a5926d-0a2a-4a9d-ba3c-cf2dd1d17628 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:51.635228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b6a5926d-0a2a-4a9d-ba3c-cf2dd1d17628 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:51.643320 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b6a5926d-0a2a-4a9d-ba3c-cf2dd1d17628 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1363 microversion: 2.1 time: 0.153324 Oct 11 05:30:51.643898 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4056/7878] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:51 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:51.966710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-05543893-91bb-497c-855a-855145dc5024 req-38b0267d-49d4-4007-a3a9-a5ba3b58cad4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433", "name": "network-vif-plugged", "status": "completed", "tag": "4f79331b-907d-4be6-8d54-05a7936f7d4c"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:30:51.977792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-05543893-91bb-497c-855a-855145dc5024 req-38b0267d-49d4-4007-a3a9-a5ba3b58cad4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:51.978290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-05543893-91bb-497c-855a-855145dc5024 req-38b0267d-49d4-4007-a3a9-a5ba3b58cad4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:51.978725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-05543893-91bb-497c-855a-855145dc5024 req-38b0267d-49d4-4007-a3a9-a5ba3b58cad4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:51.989651 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-05543893-91bb-497c-855a-855145dc5024 req-38b0267d-49d4-4007-a3a9-a5ba3b58cad4 service nova] Creating event network-vif-plugged:4f79331b-907d-4be6-8d54-05a7936f7d4c for instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 on n-h1-860892-1 Oct 11 05:30:51.994874 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-05543893-91bb-497c-855a-855145dc5024 req-38b0267d-49d4-4007-a3a9-a5ba3b58cad4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031922 Oct 11 05:30:51.995448 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3823/7879] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:30:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:30:52.666915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e4fa6091-24f9-4072-91b4-f2357b63f582 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:52.667469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e4fa6091-24f9-4072-91b4-f2357b63f582 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:52.669445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:30:52.670121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:30:52.676304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4fa6091-24f9-4072-91b4-f2357b63f582 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:52.678485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4fa6091-24f9-4072-91b4-f2357b63f582 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:52.678485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4fa6091-24f9-4072-91b4-f2357b63f582 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:52.678485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4fa6091-24f9-4072-91b4-f2357b63f582 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:52.678485 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4fa6091-24f9-4072-91b4-f2357b63f582 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:52.678829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e4fa6091-24f9-4072-91b4-f2357b63f582 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:52.810120 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e4fa6091-24f9-4072-91b4-f2357b63f582 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:52.818593 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e4fa6091-24f9-4072-91b4-f2357b63f582 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1363 microversion: 2.1 time: 0.155658 Oct 11 05:30:52.819173 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4057/7880] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:52 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:53.842872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c7157115-c10d-4712-b83f-61e3fc2bc97a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:53.843573 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c7157115-c10d-4712-b83f-61e3fc2bc97a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:53.845586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:30:53.851984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7157115-c10d-4712-b83f-61e3fc2bc97a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:53.852465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7157115-c10d-4712-b83f-61e3fc2bc97a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:53.852907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7157115-c10d-4712-b83f-61e3fc2bc97a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:53.853601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7157115-c10d-4712-b83f-61e3fc2bc97a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:53.854083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7157115-c10d-4712-b83f-61e3fc2bc97a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:53.854583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c7157115-c10d-4712-b83f-61e3fc2bc97a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:53.984853 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c7157115-c10d-4712-b83f-61e3fc2bc97a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:53.992525 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c7157115-c10d-4712-b83f-61e3fc2bc97a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1554 microversion: 2.1 time: 0.154307 Oct 11 05:30:53.993091 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3824/7881] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:53 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:54.014511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a2b2e28c-0f69-4c51-b57b-7f7ef48ded4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:30:54.015172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a2b2e28c-0f69-4c51-b57b-7f7ef48ded4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:54.022765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2b2e28c-0f69-4c51-b57b-7f7ef48ded4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:54.023261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2b2e28c-0f69-4c51-b57b-7f7ef48ded4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:54.023715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2b2e28c-0f69-4c51-b57b-7f7ef48ded4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:54.024426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2b2e28c-0f69-4c51-b57b-7f7ef48ded4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:54.024892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2b2e28c-0f69-4c51-b57b-7f7ef48ded4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:54.025334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a2b2e28c-0f69-4c51-b57b-7f7ef48ded4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:54.155715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a2b2e28c-0f69-4c51-b57b-7f7ef48ded4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:30:54.159177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:30:54.164484 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a2b2e28c-0f69-4c51-b57b-7f7ef48ded4d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1554 microversion: 2.1 time: 0.153877 Oct 11 05:30:54.165050 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4058/7882] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:30:54 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:30:57.114064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-950bd843-6e7b-47d1-ad77-081a82dec8ae tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5157c521-e503-4a2f-96cf-373b018deef7"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:30:57.116430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-950bd843-6e7b-47d1-ad77-081a82dec8ae tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:30:57.123512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-950bd843-6e7b-47d1-ad77-081a82dec8ae tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:57.123994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-950bd843-6e7b-47d1-ad77-081a82dec8ae tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:57.124438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-950bd843-6e7b-47d1-ad77-081a82dec8ae tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:57.125120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-950bd843-6e7b-47d1-ad77-081a82dec8ae tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:30:57.125566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-950bd843-6e7b-47d1-ad77-081a82dec8ae tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:30:57.125986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-950bd843-6e7b-47d1-ad77-081a82dec8ae tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:30:57.823554 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-950bd843-6e7b-47d1-ad77-081a82dec8ae tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "POST /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.713852 Oct 11 05:30:57.824227 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3825/7883] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 05:30:57 2022] POST /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments => generated 194 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:09.589782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0846fd0d-f343-4af3-8d81-1e78a0e5ee98 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:09.590392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0846fd0d-f343-4af3-8d81-1e78a0e5ee98 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:09.593608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:31:09.598581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0846fd0d-f343-4af3-8d81-1e78a0e5ee98 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:09.599070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0846fd0d-f343-4af3-8d81-1e78a0e5ee98 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:09.599515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0846fd0d-f343-4af3-8d81-1e78a0e5ee98 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:09.600272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0846fd0d-f343-4af3-8d81-1e78a0e5ee98 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:09.600793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0846fd0d-f343-4af3-8d81-1e78a0e5ee98 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:09.601233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0846fd0d-f343-4af3-8d81-1e78a0e5ee98 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:09.681071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-0846fd0d-f343-4af3-8d81-1e78a0e5ee98 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lazy-loading 'services' on Instance uuid 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:31:09.887642 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0846fd0d-f343-4af3-8d81-1e78a0e5ee98 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments/5157c521-e503-4a2f-96cf-373b018deef7" status: 202 len: 0 microversion: 2.1 time: 0.302195 Oct 11 05:31:09.888236 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4059/7884] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 05:31:09 2022] DELETE /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments/5157c521-e503-4a2f-96cf-373b018deef7 => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:31:09.895169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:31:09.895931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:31:09.900190 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d5c82417-5e08-4367-b0cc-f1a954a7105b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:09.902638 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d5c82417-5e08-4367-b0cc-f1a954a7105b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:09.908747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c82417-5e08-4367-b0cc-f1a954a7105b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:09.909227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c82417-5e08-4367-b0cc-f1a954a7105b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:09.909661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c82417-5e08-4367-b0cc-f1a954a7105b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:09.910481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c82417-5e08-4367-b0cc-f1a954a7105b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:09.910982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c82417-5e08-4367-b0cc-f1a954a7105b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:09.911390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d5c82417-5e08-4367-b0cc-f1a954a7105b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:09.942027 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d5c82417-5e08-4367-b0cc-f1a954a7105b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048865 Oct 11 05:31:09.942604 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3826/7885] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:09 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:10.955823 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca00a454-1a72-4866-8563-10ca9580cef5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:10.958240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ca00a454-1a72-4866-8563-10ca9580cef5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:10.966493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca00a454-1a72-4866-8563-10ca9580cef5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:10.966993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca00a454-1a72-4866-8563-10ca9580cef5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:10.967448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca00a454-1a72-4866-8563-10ca9580cef5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:10.968159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca00a454-1a72-4866-8563-10ca9580cef5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:10.968628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca00a454-1a72-4866-8563-10ca9580cef5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:10.969073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca00a454-1a72-4866-8563-10ca9580cef5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:10.999830 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ca00a454-1a72-4866-8563-10ca9580cef5 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048390 Oct 11 05:31:11.000401 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4060/7886] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:10 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:12.013210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-715c9cec-628a-4e1e-9e02-e93bc42a231e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:12.015595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-715c9cec-628a-4e1e-9e02-e93bc42a231e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:12.024887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c9cec-628a-4e1e-9e02-e93bc42a231e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:12.025942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c9cec-628a-4e1e-9e02-e93bc42a231e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:12.025942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c9cec-628a-4e1e-9e02-e93bc42a231e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:12.026540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c9cec-628a-4e1e-9e02-e93bc42a231e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:12.026997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c9cec-628a-4e1e-9e02-e93bc42a231e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:12.027431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-715c9cec-628a-4e1e-9e02-e93bc42a231e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:12.061001 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-715c9cec-628a-4e1e-9e02-e93bc42a231e tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051799 Oct 11 05:31:12.061600 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3827/7887] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:12 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:13.073849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0dacde97-e644-4c63-ba84-90be8d259281 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:13.076116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0dacde97-e644-4c63-ba84-90be8d259281 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:13.083141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dacde97-e644-4c63-ba84-90be8d259281 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:13.083626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dacde97-e644-4c63-ba84-90be8d259281 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:13.084082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dacde97-e644-4c63-ba84-90be8d259281 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:13.085428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dacde97-e644-4c63-ba84-90be8d259281 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:13.085899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dacde97-e644-4c63-ba84-90be8d259281 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:13.086376 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0dacde97-e644-4c63-ba84-90be8d259281 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:13.116053 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0dacde97-e644-4c63-ba84-90be8d259281 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046921 Oct 11 05:31:13.116620 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4061/7888] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:13 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:14.129563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-acda382f-5a84-4fc8-8967-0a224bfa76bf tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:14.132033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-acda382f-5a84-4fc8-8967-0a224bfa76bf tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:14.139194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acda382f-5a84-4fc8-8967-0a224bfa76bf tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:14.139681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acda382f-5a84-4fc8-8967-0a224bfa76bf tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:14.140122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acda382f-5a84-4fc8-8967-0a224bfa76bf tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:14.140821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acda382f-5a84-4fc8-8967-0a224bfa76bf tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:14.141277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acda382f-5a84-4fc8-8967-0a224bfa76bf tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:14.141959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-acda382f-5a84-4fc8-8967-0a224bfa76bf tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:14.173404 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-acda382f-5a84-4fc8-8967-0a224bfa76bf tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048451 Oct 11 05:31:14.177968 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3828/7889] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:14 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:15.186372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ad6ba376-eec9-480f-a070-8b7b0e679ca6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:15.188545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ad6ba376-eec9-480f-a070-8b7b0e679ca6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:15.196223 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6ba376-eec9-480f-a070-8b7b0e679ca6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:15.196771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6ba376-eec9-480f-a070-8b7b0e679ca6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:15.197249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6ba376-eec9-480f-a070-8b7b0e679ca6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:15.197954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6ba376-eec9-480f-a070-8b7b0e679ca6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:15.198508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6ba376-eec9-480f-a070-8b7b0e679ca6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:15.198955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ad6ba376-eec9-480f-a070-8b7b0e679ca6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:15.228852 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ad6ba376-eec9-480f-a070-8b7b0e679ca6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046583 Oct 11 05:31:15.229404 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4062/7890] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:15 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 05:31:15.240083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:15.240681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:15.248392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:15.248875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:15.249314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:15.250011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:15.250562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:15.250995 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:15.327041 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] HTTP exception thrown: Instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 is not attached to volume 5157c521-e503-4a2f-96cf-373b018deef7 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Request method failure captured: Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments/5157c521-e503-4a2f-96cf-373b018deef7 HTTP/1.1 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRP9PFClGz5v6fhtC0RhpPLORrm_0iQX3qJkmNL1KGAyUabPUzombhgKXFeRDC6dtfUNGsS7o1l56kjv78ULTmhlf4ZjEF7oZe4KqToVn7j72c6QxXEBI_7MVbnv1zoRMbZMYtyDJGfNXUBelpZ6LRZvV9IrjbgUmo40CfcdYz99u6B0 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}] Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: c7ac7de67908463e85c182c901fddb06 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 is not attached to volume 5157c521-e503-4a2f-96cf-373b018deef7 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': '92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433', 'id': '5157c521-e503-4a2f-96cf-373b018deef7'} Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 5157c521-e503-4a2f-96cf-373b018deef7. Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 is not attached to volume 5157c521-e503-4a2f-96cf-373b018deef7 Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:31:15.328679 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:31:15.333893 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:31:15.333893 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:31:15.333893 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 is not attached to volume 5157c521-e503-4a2f-96cf-373b018deef7 Oct 11 05:31:15.333893 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:15.333893 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Returning 404 to user: Instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 is not attached to volume 5157c521-e503-4a2f-96cf-373b018deef7 {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:31:15.333893 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-62741398-9b08-4937-b606-c113c968583f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments/5157c521-e503-4a2f-96cf-373b018deef7" status: 404 len: 154 microversion: 2.1 time: 0.094157 Oct 11 05:31:15.333893 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3829/7891] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 05:31:15 2022] DELETE /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433/os-volume_attachments/5157c521-e503-4a2f-96cf-373b018deef7 => generated 154 bytes in 95 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:31:18.890891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3c6c550a-822a-41f9-a1c5-31150c57e07b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:18.891394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3c6c550a-822a-41f9-a1c5-31150c57e07b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:18.898460 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c550a-822a-41f9-a1c5-31150c57e07b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:18.899036 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c550a-822a-41f9-a1c5-31150c57e07b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:18.899587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c550a-822a-41f9-a1c5-31150c57e07b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:18.900300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c550a-822a-41f9-a1c5-31150c57e07b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:18.900832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c550a-822a-41f9-a1c5-31150c57e07b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:18.901333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c6c550a-822a-41f9-a1c5-31150c57e07b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:18.927053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3c6c550a-822a-41f9-a1c5-31150c57e07b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:31:19.253058 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3c6c550a-822a-41f9-a1c5-31150c57e07b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 204 len: 0 microversion: 2.1 time: 0.366214 Oct 11 05:31:19.253647 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4063/7892] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:31:18 2022] DELETE /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:31:19.262010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca41fdbc-a3c4-40e0-aea0-752675a67ee1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:19.262656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ca41fdbc-a3c4-40e0-aea0-752675a67ee1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:19.270846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca41fdbc-a3c4-40e0-aea0-752675a67ee1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:19.271342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca41fdbc-a3c4-40e0-aea0-752675a67ee1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:19.271779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca41fdbc-a3c4-40e0-aea0-752675a67ee1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:19.272692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca41fdbc-a3c4-40e0-aea0-752675a67ee1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:19.273197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca41fdbc-a3c4-40e0-aea0-752675a67ee1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:19.273628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca41fdbc-a3c4-40e0-aea0-752675a67ee1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:19.408628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ca41fdbc-a3c4-40e0-aea0-752675a67ee1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:19.417137 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ca41fdbc-a3c4-40e0-aea0-752675a67ee1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1560 microversion: 2.1 time: 0.159063 Oct 11 05:31:19.417708 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3830/7893] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:19 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:20.441237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e958329f-6519-4276-9782-f10e3105ce16 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:20.441969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e958329f-6519-4276-9782-f10e3105ce16 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:20.449038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e958329f-6519-4276-9782-f10e3105ce16 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:20.449524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e958329f-6519-4276-9782-f10e3105ce16 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:20.449977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e958329f-6519-4276-9782-f10e3105ce16 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:20.450707 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e958329f-6519-4276-9782-f10e3105ce16 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:20.451170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e958329f-6519-4276-9782-f10e3105ce16 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:20.451616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e958329f-6519-4276-9782-f10e3105ce16 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:20.581722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e958329f-6519-4276-9782-f10e3105ce16 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:20.589559 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e958329f-6519-4276-9782-f10e3105ce16 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1560 microversion: 2.1 time: 0.152622 Oct 11 05:31:20.590121 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4064/7894] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:20 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:21.361871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-29cedc47-8c06-450c-a3e7-27ad00efadf9 req-7a1ee1cd-6309-4a4e-84db-5001c59ed299 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433", "name": "network-vif-deleted", "tag": "4f79331b-907d-4be6-8d54-05a7936f7d4c"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:31:21.375282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-29cedc47-8c06-450c-a3e7-27ad00efadf9 req-7a1ee1cd-6309-4a4e-84db-5001c59ed299 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:21.375766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-29cedc47-8c06-450c-a3e7-27ad00efadf9 req-7a1ee1cd-6309-4a4e-84db-5001c59ed299 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:21.376201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-29cedc47-8c06-450c-a3e7-27ad00efadf9 req-7a1ee1cd-6309-4a4e-84db-5001c59ed299 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:21.389135 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-29cedc47-8c06-450c-a3e7-27ad00efadf9 req-7a1ee1cd-6309-4a4e-84db-5001c59ed299 service nova] Creating event network-vif-deleted:4f79331b-907d-4be6-8d54-05a7936f7d4c for instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 on n-h1-860892-1 Oct 11 05:31:21.395115 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-29cedc47-8c06-450c-a3e7-27ad00efadf9 req-7a1ee1cd-6309-4a4e-84db-5001c59ed299 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036968 Oct 11 05:31:21.395728 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3831/7895] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:21.613105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-88e4730c-468a-4843-be4a-5c6512ed4693 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:21.613716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-88e4730c-468a-4843-be4a-5c6512ed4693 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:21.621186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e4730c-468a-4843-be4a-5c6512ed4693 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:21.626528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e4730c-468a-4843-be4a-5c6512ed4693 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:21.626528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e4730c-468a-4843-be4a-5c6512ed4693 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:21.626528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e4730c-468a-4843-be4a-5c6512ed4693 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:21.626528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e4730c-468a-4843-be4a-5c6512ed4693 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:21.626528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-88e4730c-468a-4843-be4a-5c6512ed4693 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:21.690591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-88e4730c-468a-4843-be4a-5c6512ed4693 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:21.699203 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-88e4730c-468a-4843-be4a-5c6512ed4693 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 200 len: 1348 microversion: 2.1 time: 0.090134 Oct 11 05:31:21.699790 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4065/7896] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:21 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 1348 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:31:22.722679 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:22.723412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:22.731079 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:22.731577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:22.732014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:22.732714 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:22.733175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:22.733611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:22.747794 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] HTTP exception thrown: Instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 could not be found. Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Request method failure captured: Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 HTTP/1.1 Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRP9PFClGz5v6fhtC0RhpPLORrm_0iQX3qJkmNL1KGAyUabPUzombhgKXFeRDC6dtfUNGsS7o1l56kjv78ULTmhlf4ZjEF7oZe4KqToVn7j72c6QxXEBI_7MVbnv1zoRMbZMYtyDJGfNXUBelpZ6LRZvV9IrjbgUmo40CfcdYz99u6B0 Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}] Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: c7ac7de67908463e85c182c901fddb06 Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 could not be found. Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433'} Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 could not be found. Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 could not be found. Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:22.749425 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:31:22.754365 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:22.754365 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:31:22.754365 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:31:22.754365 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:31:22.754365 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:31:22.754365 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:31:22.754365 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 could not be found. Oct 11 05:31:22.754365 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:22.754365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Returning 404 to user: Instance 92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:31:22.754365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-34032373-0fe7-4e0a-9b63-fb4d32d8d4c9 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433" status: 404 len: 111 microversion: 2.1 time: 0.032544 Oct 11 05:31:22.754365 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3832/7897] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:22 2022] GET /compute/v2.1/servers/92b7e1e9-3ea6-4d22-9f0a-e4e62af3f433 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:31:22.760201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f52e35d2-c8df-4ae9-b383-3d1ea333712d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '.version_select at 0x7fda1923a790>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:22.814464 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f52e35d2-c8df-4ae9-b383-3d1ea333712d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1505352648" status: 202 len: 0 microversion: 2.1 time: 0.058099 Oct 11 05:31:22.815031 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4066/7898] 10.222.0.26 () {58 vars in 1278 bytes} [Tue Oct 11 05:31:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-1505352648 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:31:22.832563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ced5d703-d13b-4121-9ddd-d3ed8927fb4f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Action: 'create', calling method: .version_select at 0x7fda189db5e0>, body: {"keypair": {"name": "tempest-TestEncryptedCinderVolumes-150013537", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPP6S1VTyeWjgzlApVLQw+S7Iuq6VZbKMO8RdSQN0FPBw20ucerVHyUqW1Z++wb5BAZ4NxKZAb2rv9Z6jgmCyilaAQcOo51lrzyGu7ImiJAgiNJa3ZsUb9f0wA3rcsekww=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:31:22.847404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ced5d703-d13b-4121-9ddd-d3ed8927fb4f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for project 723ed466f815432b8edc3a37ae91b47f. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:31:22.853242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ced5d703-d13b-4121-9ddd-d3ed8927fb4f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for user c7ac7de67908463e85c182c901fddb06 and project 723ed466f815432b8edc3a37ae91b47f. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:31:22.940918 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ced5d703-d13b-4121-9ddd-d3ed8927fb4f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.112694 Oct 11 05:31:22.941555 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3833/7899] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:31:22 2022] POST /compute/v2.1/os-keypairs => generated 404 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:23.012535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestEncryptedCinderVolumes-server-1862490833", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "key_name": "tempest-TestEncryptedCinderVolumes-150013537", "networks": [{"uuid": "1bdf6f46-8649-46c8-8c61-241c7db7fbfd"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:31:23.065771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] validate_networks() for [('1bdf6f46-8649-46c8-8c61-241c7db7fbfd', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:31:23.430621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:31:23.431065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:31:23.431597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:31:23.432027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:31:23.432494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:31:23.441362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:23.441861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:23.442359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:23.443115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:23.443585 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:23.444034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:23.461116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for project 723ed466f815432b8edc3a37ae91b47f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:31:23.467046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Getting quotas for user c7ac7de67908463e85c182c901fddb06 and project 723ed466f815432b8edc3a37ae91b47f. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:31:23.479192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:31:23.481513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:31:23.611618 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e650b702-a624-4c55-bbd3-8857e2b8159b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603491 Oct 11 05:31:23.612221 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4067/7900] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:31:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:31:23.623651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7bd96ae9-fdde-432c-ba13-cad547f519ba tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:23.624293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7bd96ae9-fdde-432c-ba13-cad547f519ba tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:23.680524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7bd96ae9-fdde-432c-ba13-cad547f519ba tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:23.687688 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7bd96ae9-fdde-432c-ba13-cad547f519ba tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1262 microversion: 2.1 time: 0.068120 Oct 11 05:31:23.688299 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3834/7901] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:23 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1262 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:24.711187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ec0fb15b-2178-44cb-b3c2-ecb62144920b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:24.711931 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ec0fb15b-2178-44cb-b3c2-ecb62144920b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:24.720183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0fb15b-2178-44cb-b3c2-ecb62144920b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:24.721685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0fb15b-2178-44cb-b3c2-ecb62144920b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:24.721685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0fb15b-2178-44cb-b3c2-ecb62144920b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:24.722021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0fb15b-2178-44cb-b3c2-ecb62144920b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:24.722524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0fb15b-2178-44cb-b3c2-ecb62144920b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:24.722964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ec0fb15b-2178-44cb-b3c2-ecb62144920b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:24.784419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ec0fb15b-2178-44cb-b3c2-ecb62144920b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:24.792655 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ec0fb15b-2178-44cb-b3c2-ecb62144920b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1266 microversion: 2.1 time: 0.085432 Oct 11 05:31:24.793792 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4068/7902] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:24 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:25.816476 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d79a0c62-b513-434f-93d4-89eb2541288a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:25.817108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d79a0c62-b513-434f-93d4-89eb2541288a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:25.824340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d79a0c62-b513-434f-93d4-89eb2541288a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:25.824834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d79a0c62-b513-434f-93d4-89eb2541288a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:25.825276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d79a0c62-b513-434f-93d4-89eb2541288a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:25.825989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d79a0c62-b513-434f-93d4-89eb2541288a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:25.826469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d79a0c62-b513-434f-93d4-89eb2541288a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:25.826895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d79a0c62-b513-434f-93d4-89eb2541288a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:25.895740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d79a0c62-b513-434f-93d4-89eb2541288a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:25.903953 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d79a0c62-b513-434f-93d4-89eb2541288a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1322 microversion: 2.1 time: 0.091375 Oct 11 05:31:25.904809 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3835/7903] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:25 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1322 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:26.929198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bd0ed7ac-a0ea-4c5f-acec-5e69a6a30a53 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:26.929797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bd0ed7ac-a0ea-4c5f-acec-5e69a6a30a53 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:26.937715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0ed7ac-a0ea-4c5f-acec-5e69a6a30a53 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:26.938277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0ed7ac-a0ea-4c5f-acec-5e69a6a30a53 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:26.938738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0ed7ac-a0ea-4c5f-acec-5e69a6a30a53 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:26.939534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0ed7ac-a0ea-4c5f-acec-5e69a6a30a53 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:26.940140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0ed7ac-a0ea-4c5f-acec-5e69a6a30a53 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:26.940821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd0ed7ac-a0ea-4c5f-acec-5e69a6a30a53 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:27.199221 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bd0ed7ac-a0ea-4c5f-acec-5e69a6a30a53 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:27.207231 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bd0ed7ac-a0ea-4c5f-acec-5e69a6a30a53 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1362 microversion: 2.1 time: 0.282028 Oct 11 05:31:27.207806 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4069/7904] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:26 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:27.750642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-cf595982-682c-4c2a-a789-03cd30e94469 req-aadeb234-ff2d-4030-9948-3c828bd1ff7a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fafe7636-f8e0-43a6-b50c-5185d89bf038", "tag": "da232bb5-c72a-425c-991c-37074650918a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:31:27.760533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cf595982-682c-4c2a-a789-03cd30e94469 req-aadeb234-ff2d-4030-9948-3c828bd1ff7a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:27.761007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cf595982-682c-4c2a-a789-03cd30e94469 req-aadeb234-ff2d-4030-9948-3c828bd1ff7a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:27.761460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-cf595982-682c-4c2a-a789-03cd30e94469 req-aadeb234-ff2d-4030-9948-3c828bd1ff7a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:27.772624 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-cf595982-682c-4c2a-a789-03cd30e94469 req-aadeb234-ff2d-4030-9948-3c828bd1ff7a service nova] Creating event network-changed:da232bb5-c72a-425c-991c-37074650918a for instance fafe7636-f8e0-43a6-b50c-5185d89bf038 on n-h1-860892-1 Oct 11 05:31:27.777629 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-cf595982-682c-4c2a-a789-03cd30e94469 req-aadeb234-ff2d-4030-9948-3c828bd1ff7a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031138 Oct 11 05:31:27.778978 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3836/7905] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:28.237143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8606a2d5-7dbc-43ee-b4d2-2aca6d513454 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:28.237797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8606a2d5-7dbc-43ee-b4d2-2aca6d513454 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:28.246064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8606a2d5-7dbc-43ee-b4d2-2aca6d513454 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:28.246626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8606a2d5-7dbc-43ee-b4d2-2aca6d513454 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:28.247096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8606a2d5-7dbc-43ee-b4d2-2aca6d513454 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:28.247786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8606a2d5-7dbc-43ee-b4d2-2aca6d513454 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:28.248994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8606a2d5-7dbc-43ee-b4d2-2aca6d513454 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:28.250062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8606a2d5-7dbc-43ee-b4d2-2aca6d513454 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:28.390487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8606a2d5-7dbc-43ee-b4d2-2aca6d513454 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:28.398360 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8606a2d5-7dbc-43ee-b4d2-2aca6d513454 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1362 microversion: 2.1 time: 0.165295 Oct 11 05:31:28.398939 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4070/7906] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:28 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:29.422756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-86a777a6-bd68-41f8-a9cc-5eb374d0e382 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:29.423508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-86a777a6-bd68-41f8-a9cc-5eb374d0e382 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:29.429804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a777a6-bd68-41f8-a9cc-5eb374d0e382 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:29.430318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a777a6-bd68-41f8-a9cc-5eb374d0e382 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:29.430756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a777a6-bd68-41f8-a9cc-5eb374d0e382 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:29.431447 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a777a6-bd68-41f8-a9cc-5eb374d0e382 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:29.431900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a777a6-bd68-41f8-a9cc-5eb374d0e382 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:29.432366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-86a777a6-bd68-41f8-a9cc-5eb374d0e382 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:29.566141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-86a777a6-bd68-41f8-a9cc-5eb374d0e382 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:29.574049 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-86a777a6-bd68-41f8-a9cc-5eb374d0e382 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1362 microversion: 2.1 time: 0.156687 Oct 11 05:31:29.574647 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3837/7907] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:29 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:30.597715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e960e668-002d-4aa3-b6f9-b745c3761e7d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:30.598363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e960e668-002d-4aa3-b6f9-b745c3761e7d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:30.605210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e960e668-002d-4aa3-b6f9-b745c3761e7d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:30.605704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e960e668-002d-4aa3-b6f9-b745c3761e7d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:30.606148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e960e668-002d-4aa3-b6f9-b745c3761e7d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:30.606938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e960e668-002d-4aa3-b6f9-b745c3761e7d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:30.607396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e960e668-002d-4aa3-b6f9-b745c3761e7d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:30.607831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e960e668-002d-4aa3-b6f9-b745c3761e7d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:30.742521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e960e668-002d-4aa3-b6f9-b745c3761e7d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:30.750285 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e960e668-002d-4aa3-b6f9-b745c3761e7d tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1362 microversion: 2.1 time: 0.156975 Oct 11 05:31:30.750848 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4071/7908] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:30 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:31.774215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-482db382-010b-4e18-bfa1-97dfe388fe51 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:31.774783 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-482db382-010b-4e18-bfa1-97dfe388fe51 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:31.781588 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-482db382-010b-4e18-bfa1-97dfe388fe51 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:31.782068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-482db382-010b-4e18-bfa1-97dfe388fe51 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:31.782542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-482db382-010b-4e18-bfa1-97dfe388fe51 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:31.783866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-482db382-010b-4e18-bfa1-97dfe388fe51 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:31.784329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-482db382-010b-4e18-bfa1-97dfe388fe51 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:31.784760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-482db382-010b-4e18-bfa1-97dfe388fe51 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:31.913173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-482db382-010b-4e18-bfa1-97dfe388fe51 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:31.920900 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-482db382-010b-4e18-bfa1-97dfe388fe51 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1362 microversion: 2.1 time: 0.150746 Oct 11 05:31:31.921598 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3838/7909] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:31 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:32.944295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d2a8e57f-6ca7-4ddc-8612-7119280ab320 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:32.944937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d2a8e57f-6ca7-4ddc-8612-7119280ab320 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:32.951819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2a8e57f-6ca7-4ddc-8612-7119280ab320 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:32.952315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2a8e57f-6ca7-4ddc-8612-7119280ab320 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:32.952776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2a8e57f-6ca7-4ddc-8612-7119280ab320 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:32.953483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2a8e57f-6ca7-4ddc-8612-7119280ab320 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:32.953957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2a8e57f-6ca7-4ddc-8612-7119280ab320 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:32.954440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d2a8e57f-6ca7-4ddc-8612-7119280ab320 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:33.084473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d2a8e57f-6ca7-4ddc-8612-7119280ab320 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:33.091418 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d2a8e57f-6ca7-4ddc-8612-7119280ab320 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1362 microversion: 2.1 time: 0.151389 Oct 11 05:31:33.092000 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4072/7910] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:32 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:34.116515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d0f096d8-26f5-4609-8f0e-a05a58b4a6b6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:34.116917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d0f096d8-26f5-4609-8f0e-a05a58b4a6b6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:34.120409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:31:34.125453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0f096d8-26f5-4609-8f0e-a05a58b4a6b6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:34.125935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0f096d8-26f5-4609-8f0e-a05a58b4a6b6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:34.126414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0f096d8-26f5-4609-8f0e-a05a58b4a6b6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:34.127106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0f096d8-26f5-4609-8f0e-a05a58b4a6b6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:34.127557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0f096d8-26f5-4609-8f0e-a05a58b4a6b6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:34.128004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0f096d8-26f5-4609-8f0e-a05a58b4a6b6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:34.268258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-31f1da00-a8ec-4ffb-b23d-24461ffccb89 req-4a51e413-5a72-4b5a-9982-c9746d64181f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafe7636-f8e0-43a6-b50c-5185d89bf038", "name": "network-vif-plugged", "status": "completed", "tag": "da232bb5-c72a-425c-991c-37074650918a"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:31:34.274972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:31:34.275804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:31:34.280845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-31f1da00-a8ec-4ffb-b23d-24461ffccb89 req-4a51e413-5a72-4b5a-9982-c9746d64181f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:34.281347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-31f1da00-a8ec-4ffb-b23d-24461ffccb89 req-4a51e413-5a72-4b5a-9982-c9746d64181f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:34.281802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-31f1da00-a8ec-4ffb-b23d-24461ffccb89 req-4a51e413-5a72-4b5a-9982-c9746d64181f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:34.291989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d0f096d8-26f5-4609-8f0e-a05a58b4a6b6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:34.294020 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-31f1da00-a8ec-4ffb-b23d-24461ffccb89 req-4a51e413-5a72-4b5a-9982-c9746d64181f service nova] Creating event network-vif-plugged:da232bb5-c72a-425c-991c-37074650918a for instance fafe7636-f8e0-43a6-b50c-5185d89bf038 on n-h1-860892-1 Oct 11 05:31:34.300374 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-31f1da00-a8ec-4ffb-b23d-24461ffccb89 req-4a51e413-5a72-4b5a-9982-c9746d64181f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037722 Oct 11 05:31:34.300511 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d0f096d8-26f5-4609-8f0e-a05a58b4a6b6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1362 microversion: 2.1 time: 0.187551 Oct 11 05:31:34.301230 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4073/7911] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:31:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:34.301358 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3839/7912] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:34 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1362 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:35.325491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33ce6afb-8f3a-42c2-bc4b-622442ac45fa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:35.326295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-33ce6afb-8f3a-42c2-bc4b-622442ac45fa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:35.335175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33ce6afb-8f3a-42c2-bc4b-622442ac45fa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:35.335680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33ce6afb-8f3a-42c2-bc4b-622442ac45fa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:35.336185 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33ce6afb-8f3a-42c2-bc4b-622442ac45fa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:35.337002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33ce6afb-8f3a-42c2-bc4b-622442ac45fa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:35.337525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33ce6afb-8f3a-42c2-bc4b-622442ac45fa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:35.338017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33ce6afb-8f3a-42c2-bc4b-622442ac45fa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:35.470304 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-33ce6afb-8f3a-42c2-bc4b-622442ac45fa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:35.478040 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-33ce6afb-8f3a-42c2-bc4b-622442ac45fa tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1362 microversion: 2.1 time: 0.157705 Oct 11 05:31:35.478640 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4074/7913] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:35 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:36.501212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2e8c2c6f-08e0-412e-86ab-1ecbf728c87a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:36.501867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2e8c2c6f-08e0-412e-86ab-1ecbf728c87a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:36.509285 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c2c6f-08e0-412e-86ab-1ecbf728c87a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:36.509767 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c2c6f-08e0-412e-86ab-1ecbf728c87a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:36.510244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c2c6f-08e0-412e-86ab-1ecbf728c87a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:36.510952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c2c6f-08e0-412e-86ab-1ecbf728c87a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:36.511406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c2c6f-08e0-412e-86ab-1ecbf728c87a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:36.511834 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2e8c2c6f-08e0-412e-86ab-1ecbf728c87a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:36.640029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2e8c2c6f-08e0-412e-86ab-1ecbf728c87a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:36.648642 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2e8c2c6f-08e0-412e-86ab-1ecbf728c87a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1553 microversion: 2.1 time: 0.151359 Oct 11 05:31:36.652803 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3840/7914] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:36 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:36.670740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b5679af4-50f8-4eba-8ce1-6e4837ea96b4 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:36.671367 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b5679af4-50f8-4eba-8ce1-6e4837ea96b4 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:36.678143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5679af4-50f8-4eba-8ce1-6e4837ea96b4 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:36.678673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5679af4-50f8-4eba-8ce1-6e4837ea96b4 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:36.679131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5679af4-50f8-4eba-8ce1-6e4837ea96b4 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:36.679841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5679af4-50f8-4eba-8ce1-6e4837ea96b4 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:36.680312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5679af4-50f8-4eba-8ce1-6e4837ea96b4 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:36.680758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b5679af4-50f8-4eba-8ce1-6e4837ea96b4 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:36.699071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:31:36.810315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b5679af4-50f8-4eba-8ce1-6e4837ea96b4 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:31:36.818871 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b5679af4-50f8-4eba-8ce1-6e4837ea96b4 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1553 microversion: 2.1 time: 0.151936 Oct 11 05:31:36.819458 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4075/7915] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:31:36 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:31:39.862589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-61fd0a41-b035-4a61-8f1e-cc3597171a45 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1422c5eb-230f-4fb7-8c8e-6ece62b680d0"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:31:39.865613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-61fd0a41-b035-4a61-8f1e-cc3597171a45 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:39.872453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fd0a41-b035-4a61-8f1e-cc3597171a45 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:39.872944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fd0a41-b035-4a61-8f1e-cc3597171a45 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:39.873394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fd0a41-b035-4a61-8f1e-cc3597171a45 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:39.874090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fd0a41-b035-4a61-8f1e-cc3597171a45 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:39.874577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fd0a41-b035-4a61-8f1e-cc3597171a45 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:39.875013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-61fd0a41-b035-4a61-8f1e-cc3597171a45 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:40.674810 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-61fd0a41-b035-4a61-8f1e-cc3597171a45 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "POST /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.815932 Oct 11 05:31:40.675504 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3841/7916] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 05:31:39 2022] POST /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:52.440534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3380b626-fb29-474e-8a61-ebdd1f7d062f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:52.441037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3380b626-fb29-474e-8a61-ebdd1f7d062f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:52.443233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:31:52.443891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:31:52.449545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3380b626-fb29-474e-8a61-ebdd1f7d062f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:52.450046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3380b626-fb29-474e-8a61-ebdd1f7d062f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:52.450538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3380b626-fb29-474e-8a61-ebdd1f7d062f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:52.451288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3380b626-fb29-474e-8a61-ebdd1f7d062f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:52.451756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3380b626-fb29-474e-8a61-ebdd1f7d062f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:52.452196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3380b626-fb29-474e-8a61-ebdd1f7d062f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:52.534072 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-3380b626-fb29-474e-8a61-ebdd1f7d062f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lazy-loading 'services' on Instance uuid fafe7636-f8e0-43a6-b50c-5185d89bf038 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:31:52.834680 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3380b626-fb29-474e-8a61-ebdd1f7d062f tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments/1422c5eb-230f-4fb7-8c8e-6ece62b680d0" status: 202 len: 0 microversion: 2.1 time: 0.397941 Oct 11 05:31:52.835206 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4076/7917] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 05:31:52 2022] DELETE /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments/1422c5eb-230f-4fb7-8c8e-6ece62b680d0 => generated 0 bytes in 399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:31:52.844852 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6a95f416-399e-4938-b098-df5c12a8a068 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:52.847552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6a95f416-399e-4938-b098-df5c12a8a068 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:52.850537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:31:52.851212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:31:52.856340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a95f416-399e-4938-b098-df5c12a8a068 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:52.860916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a95f416-399e-4938-b098-df5c12a8a068 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:52.860916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a95f416-399e-4938-b098-df5c12a8a068 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:52.860916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a95f416-399e-4938-b098-df5c12a8a068 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:52.860916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a95f416-399e-4938-b098-df5c12a8a068 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:52.860916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6a95f416-399e-4938-b098-df5c12a8a068 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:52.891425 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6a95f416-399e-4938-b098-df5c12a8a068 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050868 Oct 11 05:31:52.899188 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3842/7918] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:52 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:53.905921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f05eef41-394c-4e03-ae50-a5d3908b0de0 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:53.908353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f05eef41-394c-4e03-ae50-a5d3908b0de0 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:53.915134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f05eef41-394c-4e03-ae50-a5d3908b0de0 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:53.915632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f05eef41-394c-4e03-ae50-a5d3908b0de0 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:53.916086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f05eef41-394c-4e03-ae50-a5d3908b0de0 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:53.916841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f05eef41-394c-4e03-ae50-a5d3908b0de0 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:53.917309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f05eef41-394c-4e03-ae50-a5d3908b0de0 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:53.917750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f05eef41-394c-4e03-ae50-a5d3908b0de0 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:53.951146 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f05eef41-394c-4e03-ae50-a5d3908b0de0 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051426 Oct 11 05:31:53.951728 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4077/7919] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:53 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:54.964319 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a611f7fb-e9df-4494-9705-d08416e15828 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:54.966619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a611f7fb-e9df-4494-9705-d08416e15828 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:54.975401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a611f7fb-e9df-4494-9705-d08416e15828 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:54.975891 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a611f7fb-e9df-4494-9705-d08416e15828 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:54.976329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a611f7fb-e9df-4494-9705-d08416e15828 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:54.977040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a611f7fb-e9df-4494-9705-d08416e15828 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:54.977496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a611f7fb-e9df-4494-9705-d08416e15828 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:54.977921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a611f7fb-e9df-4494-9705-d08416e15828 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:55.011809 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a611f7fb-e9df-4494-9705-d08416e15828 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052087 Oct 11 05:31:55.012400 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3843/7920] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:54 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:56.025206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7bc0e4a3-3666-4677-9894-f13a1f71504a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:56.027560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7bc0e4a3-3666-4677-9894-f13a1f71504a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:56.034644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc0e4a3-3666-4677-9894-f13a1f71504a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:56.035143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc0e4a3-3666-4677-9894-f13a1f71504a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:56.035592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc0e4a3-3666-4677-9894-f13a1f71504a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:56.036303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc0e4a3-3666-4677-9894-f13a1f71504a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:56.036767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc0e4a3-3666-4677-9894-f13a1f71504a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:56.037206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc0e4a3-3666-4677-9894-f13a1f71504a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:56.068538 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7bc0e4a3-3666-4677-9894-f13a1f71504a tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047234 Oct 11 05:31:56.069001 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4078/7921] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:56 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:31:57.081778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0aa8b24b-488d-4eed-a284-b896786ce5c1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:57.084387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0aa8b24b-488d-4eed-a284-b896786ce5c1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:57.092699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa8b24b-488d-4eed-a284-b896786ce5c1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:57.093301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa8b24b-488d-4eed-a284-b896786ce5c1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:57.093805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa8b24b-488d-4eed-a284-b896786ce5c1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:57.094602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa8b24b-488d-4eed-a284-b896786ce5c1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:57.095123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa8b24b-488d-4eed-a284-b896786ce5c1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:57.095618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0aa8b24b-488d-4eed-a284-b896786ce5c1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:57.125128 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0aa8b24b-488d-4eed-a284-b896786ce5c1 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048093 Oct 11 05:31:57.125695 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3844/7922] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:57 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:31:58.137712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-822546ba-ad96-4bc0-b7fc-42f83d05aee6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:58.139977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-822546ba-ad96-4bc0-b7fc-42f83d05aee6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:58.147148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-822546ba-ad96-4bc0-b7fc-42f83d05aee6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:58.147633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-822546ba-ad96-4bc0-b7fc-42f83d05aee6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:58.148093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-822546ba-ad96-4bc0-b7fc-42f83d05aee6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:58.148800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-822546ba-ad96-4bc0-b7fc-42f83d05aee6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:58.149270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-822546ba-ad96-4bc0-b7fc-42f83d05aee6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:58.149721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-822546ba-ad96-4bc0-b7fc-42f83d05aee6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:58.179460 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-822546ba-ad96-4bc0-b7fc-42f83d05aee6 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045795 Oct 11 05:31:58.180023 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4079/7923] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:31:58 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 05:31:58.191048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:31:58.191536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:31:58.198334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:58.198812 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:58.199246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:58.199925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:31:58.200377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:31:58.200799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:31:58.344605 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] HTTP exception thrown: Instance fafe7636-f8e0-43a6-b50c-5185d89bf038 is not attached to volume 1422c5eb-230f-4fb7-8c8e-6ece62b680d0 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Request method failure captured: Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments/1422c5eb-230f-4fb7-8c8e-6ece62b680d0 HTTP/1.1 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRP9PFClGz5v6fhtC0RhpPLORrm_0iQX3qJkmNL1KGAyUabPUzombhgKXFeRDC6dtfUNGsS7o1l56kjv78ULTmhlf4ZjEF7oZe4KqToVn7j72c6QxXEBI_7MVbnv1zoRMbZMYtyDJGfNXUBelpZ6LRZvV9IrjbgUmo40CfcdYz99u6B0 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}] Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: c7ac7de67908463e85c182c901fddb06 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance fafe7636-f8e0-43a6-b50c-5185d89bf038 is not attached to volume 1422c5eb-230f-4fb7-8c8e-6ece62b680d0 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': 'fafe7636-f8e0-43a6-b50c-5185d89bf038', 'id': '1422c5eb-230f-4fb7-8c8e-6ece62b680d0'} Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1422c5eb-230f-4fb7-8c8e-6ece62b680d0. Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafe7636-f8e0-43a6-b50c-5185d89bf038 is not attached to volume 1422c5eb-230f-4fb7-8c8e-6ece62b680d0 Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:31:58.346293 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:31:58.350932 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:31:58.350932 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:31:58.350932 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafe7636-f8e0-43a6-b50c-5185d89bf038 is not attached to volume 1422c5eb-230f-4fb7-8c8e-6ece62b680d0 Oct 11 05:31:58.350932 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:31:58.350932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Returning 404 to user: Instance fafe7636-f8e0-43a6-b50c-5185d89bf038 is not attached to volume 1422c5eb-230f-4fb7-8c8e-6ece62b680d0 {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:31:58.350932 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d92054b6-3757-4484-a7b3-e632e5247744 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments/1422c5eb-230f-4fb7-8c8e-6ece62b680d0" status: 404 len: 154 microversion: 2.1 time: 0.160974 Oct 11 05:31:58.350932 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3845/7924] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 05:31:58 2022] DELETE /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038/os-volume_attachments/1422c5eb-230f-4fb7-8c8e-6ece62b680d0 => generated 154 bytes in 162 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:32:01.866734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-58206571-e4f3-4c6b-858b-74e6c8460967 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:01.867396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-58206571-e4f3-4c6b-858b-74e6c8460967 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:01.874747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58206571-e4f3-4c6b-858b-74e6c8460967 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:01.875249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58206571-e4f3-4c6b-858b-74e6c8460967 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:01.875702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58206571-e4f3-4c6b-858b-74e6c8460967 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:01.876411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58206571-e4f3-4c6b-858b-74e6c8460967 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:01.876873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58206571-e4f3-4c6b-858b-74e6c8460967 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:01.877313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-58206571-e4f3-4c6b-858b-74e6c8460967 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:01.903416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-58206571-e4f3-4c6b-858b-74e6c8460967 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:32:02.196365 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-58206571-e4f3-4c6b-858b-74e6c8460967 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 204 len: 0 microversion: 2.1 time: 0.333259 Oct 11 05:32:02.196965 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4080/7925] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:32:01 2022] DELETE /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:32:02.205583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-478774c8-675a-4691-9e09-4d06d2f8943b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:02.206242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-478774c8-675a-4691-9e09-4d06d2f8943b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:02.215821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478774c8-675a-4691-9e09-4d06d2f8943b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:02.216309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478774c8-675a-4691-9e09-4d06d2f8943b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:02.216768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478774c8-675a-4691-9e09-4d06d2f8943b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:02.217508 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478774c8-675a-4691-9e09-4d06d2f8943b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:02.217968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478774c8-675a-4691-9e09-4d06d2f8943b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:02.218441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-478774c8-675a-4691-9e09-4d06d2f8943b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:02.351013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-478774c8-675a-4691-9e09-4d06d2f8943b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:02.359408 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-478774c8-675a-4691-9e09-4d06d2f8943b tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1559 microversion: 2.1 time: 0.157917 Oct 11 05:32:02.359986 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3846/7926] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:02 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:03.383071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8e580186-64a3-44b1-bb83-a9e85123f418 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:03.383791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8e580186-64a3-44b1-bb83-a9e85123f418 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:03.391368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e580186-64a3-44b1-bb83-a9e85123f418 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:03.392132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e580186-64a3-44b1-bb83-a9e85123f418 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:03.392587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e580186-64a3-44b1-bb83-a9e85123f418 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:03.393293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e580186-64a3-44b1-bb83-a9e85123f418 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:03.393764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e580186-64a3-44b1-bb83-a9e85123f418 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:03.394238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8e580186-64a3-44b1-bb83-a9e85123f418 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:03.577380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8e580186-64a3-44b1-bb83-a9e85123f418 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:03.585213 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8e580186-64a3-44b1-bb83-a9e85123f418 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1559 microversion: 2.1 time: 0.206505 Oct 11 05:32:03.585788 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4081/7927] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:03 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1559 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:04.329395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f97bbde5-d092-4bf7-a772-25dd3d5bdd68 req-01954a1e-39f5-4546-8710-3328626d7fae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fafe7636-f8e0-43a6-b50c-5185d89bf038", "name": "network-vif-deleted", "tag": "da232bb5-c72a-425c-991c-37074650918a"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:32:04.340218 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f97bbde5-d092-4bf7-a772-25dd3d5bdd68 req-01954a1e-39f5-4546-8710-3328626d7fae service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:04.340725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f97bbde5-d092-4bf7-a772-25dd3d5bdd68 req-01954a1e-39f5-4546-8710-3328626d7fae service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:04.341161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f97bbde5-d092-4bf7-a772-25dd3d5bdd68 req-01954a1e-39f5-4546-8710-3328626d7fae service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:04.353548 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f97bbde5-d092-4bf7-a772-25dd3d5bdd68 req-01954a1e-39f5-4546-8710-3328626d7fae service nova] Creating event network-vif-deleted:da232bb5-c72a-425c-991c-37074650918a for instance fafe7636-f8e0-43a6-b50c-5185d89bf038 on n-h1-860892-1 Oct 11 05:32:04.359220 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f97bbde5-d092-4bf7-a772-25dd3d5bdd68 req-01954a1e-39f5-4546-8710-3328626d7fae service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033648 Oct 11 05:32:04.369283 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3847/7928] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:32:04.608978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:04.609610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:04.616779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:04.617280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:04.617735 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:04.618473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:04.618947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:04.619393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:04.655476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:04.656043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:04.656498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:04.656960 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lazy-loading 'fault' on Instance uuid fafe7636-f8e0-43a6-b50c-5185d89bf038 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:32:04.697927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c7ac7de67908463e85c182c901fddb06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '723ed466f815432b8edc3a37ae91b47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:04.705682 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-11f00df3-47fb-4b22-adf8-0cb8dc7cfa72 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 200 len: 1352 microversion: 2.1 time: 0.100644 Oct 11 05:32:04.706274 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4082/7929] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:04 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 1352 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:05.733759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:05.734497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] [instance: fafe7636-f8e0-43a6-b50c-5185d89bf038] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:05.740774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:05.741291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:05.741738 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:05.742460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:05.742948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:05.743384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:05.759613 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] HTTP exception thrown: Instance fafe7636-f8e0-43a6-b50c-5185d89bf038 could not be found. Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Request method failure captured: Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 HTTP/1.1 Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRP9PFClGz5v6fhtC0RhpPLORrm_0iQX3qJkmNL1KGAyUabPUzombhgKXFeRDC6dtfUNGsS7o1l56kjv78ULTmhlf4ZjEF7oZe4KqToVn7j72c6QxXEBI_7MVbnv1zoRMbZMYtyDJGfNXUBelpZ6LRZvV9IrjbgUmo40CfcdYz99u6B0 Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/723ed466f815432b8edc3a37ae91b47f"}]}] Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 723ed466f815432b8edc3a37ae91b47f Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestEncryptedCinderVolumes-1320665703 Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: c7ac7de67908463e85c182c901fddb06 Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestEncryptedCinderVolumes-1320665703-project Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance fafe7636-f8e0-43a6-b50c-5185d89bf038 could not be found. Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'fafe7636-f8e0-43a6-b50c-5185d89bf038'} Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fafe7636-f8e0-43a6-b50c-5185d89bf038 could not be found. Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fafe7636-f8e0-43a6-b50c-5185d89bf038 could not be found. Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:32:05.761870 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:32:05.766320 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:32:05.766320 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:32:05.766320 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:32:05.766320 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:32:05.766320 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:32:05.766320 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:32:05.766320 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fafe7636-f8e0-43a6-b50c-5185d89bf038 could not be found. Oct 11 05:32:05.766320 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:32:05.766320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Returning 404 to user: Instance fafe7636-f8e0-43a6-b50c-5185d89bf038 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:32:05.766320 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff9dc1fc-62eb-415e-9cae-f72c12e714ee tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038" status: 404 len: 111 microversion: 2.1 time: 0.034650 Oct 11 05:32:05.766320 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3848/7930] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:05 2022] GET /compute/v2.1/servers/fafe7636-f8e0-43a6-b50c-5185d89bf038 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:32:05.772499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48a1eafe-1350-4ea8-b4ae-2174e5d96510 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] Calling method '.version_select at 0x7fda1e12c0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:05.854618 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48a1eafe-1350-4ea8-b4ae-2174e5d96510 tempest-TestEncryptedCinderVolumes-1320665703 tempest-TestEncryptedCinderVolumes-1320665703-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-150013537" status: 202 len: 0 microversion: 2.1 time: 0.085468 Oct 11 05:32:05.855203 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4083/7931] 10.222.0.26 () {58 vars in 1275 bytes} [Tue Oct 11 05:32:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestEncryptedCinderVolumes-150013537 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:32:39.369792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3783ab80-c442-4933-b18b-84a9d0fef6eb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'create', calling method: .version_select at 0x7fda18a92040>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-408986761", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNggkhwqClsbHP4MD3uGw0G7bYqnx8AjEkr2Tg+ZEiCJZ1lhNbgxyi4/DFsX8j0IDoIR6u0h6ZtLiqgsG8WdHyZd2kMRsPer8OIUENAoiYO7jhfwHRqFTS3OMxV53hK8mA=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:32:39.375909 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 11 05:32:39.376954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=14 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:32:39.377618 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=34 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:32:39.389559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-3783ab80-c442-4933-b18b-84a9d0fef6eb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Getting quotas for project 9ddab207a4844bb4b2faeba8b6a28f59. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:32:39.395928 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-3783ab80-c442-4933-b18b-84a9d0fef6eb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Getting quotas for user f6e5d86ca2df425ab50a9059432c0a66 and project 9ddab207a4844bb4b2faeba8b6a28f59. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:32:39.505405 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3783ab80-c442-4933-b18b-84a9d0fef6eb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.139988 Oct 11 05:32:39.506216 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3849/7932] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:32:39 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:32:39.559925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:32:39.560690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:32:39.564708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1922542523", "imageRef": "48ab3714-d631-4207-ac63-406f6bd77936", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-408986761", "networks": [{"uuid": "06745f13-0436-4cb1-9875-0edd4523b21a"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:32:39.615830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] validate_networks() for [('06745f13-0436-4cb1-9875-0edd4523b21a', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:32:39.991024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:32:39.991497 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:32:39.991983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:32:39.992410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:32:39.992848 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:32:40.001616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:40.002116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:40.002602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:40.003360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:40.003828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:40.004274 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:40.022333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Getting quotas for project 9ddab207a4844bb4b2faeba8b6a28f59. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:32:40.028126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Getting quotas for user f6e5d86ca2df425ab50a9059432c0a66 and project 9ddab207a4844bb4b2faeba8b6a28f59. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:32:40.041106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:32:40.043396 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='48ab3714-d631-4207-ac63-406f6bd77936',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:32:40.162838 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c1b3f024-83d0-4cb7-8876-fb48ee1b018f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.605486 Oct 11 05:32:40.163441 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4084/7933] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:32:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 608 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:32:40.175902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f59fc495-9cee-4e81-8b54-77022543439c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:40.176522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f59fc495-9cee-4e81-8b54-77022543439c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:40.232364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f59fc495-9cee-4e81-8b54-77022543439c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:40.239362 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f59fc495-9cee-4e81-8b54-77022543439c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1258 microversion: 2.1 time: 0.068010 Oct 11 05:32:40.240249 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3850/7934] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:40 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1258 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:32:41.264752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e8ebf4d-3e9a-4b6c-a404-5e0397cc5d76 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:41.265312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e8ebf4d-3e9a-4b6c-a404-5e0397cc5d76 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:41.318813 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6e8ebf4d-3e9a-4b6c-a404-5e0397cc5d76 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:41.326477 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e8ebf4d-3e9a-4b6c-a404-5e0397cc5d76 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1258 microversion: 2.1 time: 0.068534 Oct 11 05:32:41.327029 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4085/7935] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:41 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1258 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:42.348949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae053530-39b5-46cd-83f0-ad058f5bf8a7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:42.349558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ae053530-39b5-46cd-83f0-ad058f5bf8a7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:42.356685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae053530-39b5-46cd-83f0-ad058f5bf8a7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:42.357185 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae053530-39b5-46cd-83f0-ad058f5bf8a7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:42.357619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae053530-39b5-46cd-83f0-ad058f5bf8a7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:42.358390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae053530-39b5-46cd-83f0-ad058f5bf8a7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:42.358836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae053530-39b5-46cd-83f0-ad058f5bf8a7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:42.359256 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae053530-39b5-46cd-83f0-ad058f5bf8a7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:42.422950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ae053530-39b5-46cd-83f0-ad058f5bf8a7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:42.431299 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ae053530-39b5-46cd-83f0-ad058f5bf8a7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1310 microversion: 2.1 time: 0.085780 Oct 11 05:32:42.431864 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3851/7936] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:42 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1310 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:43.458171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-162e04a3-890a-4bb9-a2cf-07e9b1944866 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:43.459559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-162e04a3-890a-4bb9-a2cf-07e9b1944866 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:43.484487 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162e04a3-890a-4bb9-a2cf-07e9b1944866 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:43.485307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162e04a3-890a-4bb9-a2cf-07e9b1944866 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:43.485995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162e04a3-890a-4bb9-a2cf-07e9b1944866 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:43.487450 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162e04a3-890a-4bb9-a2cf-07e9b1944866 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:43.488222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162e04a3-890a-4bb9-a2cf-07e9b1944866 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:43.489067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-162e04a3-890a-4bb9-a2cf-07e9b1944866 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:43.667512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-162e04a3-890a-4bb9-a2cf-07e9b1944866 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:43.676716 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-162e04a3-890a-4bb9-a2cf-07e9b1944866 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.223760 Oct 11 05:32:43.686969 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4086/7937] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:43 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:44.713896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f702d828-b200-4d5a-99f8-08681e512966 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:44.714751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f702d828-b200-4d5a-99f8-08681e512966 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:44.725066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f702d828-b200-4d5a-99f8-08681e512966 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:44.725576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f702d828-b200-4d5a-99f8-08681e512966 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:44.726726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f702d828-b200-4d5a-99f8-08681e512966 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:44.728466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f702d828-b200-4d5a-99f8-08681e512966 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:44.729289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f702d828-b200-4d5a-99f8-08681e512966 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:44.729862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f702d828-b200-4d5a-99f8-08681e512966 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:44.887550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f702d828-b200-4d5a-99f8-08681e512966 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:44.895626 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f702d828-b200-4d5a-99f8-08681e512966 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.186949 Oct 11 05:32:44.896209 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3852/7938] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:44 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:45.919925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e69b74bb-29e1-467c-94f7-1f24040fbf6c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:45.920555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e69b74bb-29e1-467c-94f7-1f24040fbf6c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:45.927555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e69b74bb-29e1-467c-94f7-1f24040fbf6c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:45.928111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e69b74bb-29e1-467c-94f7-1f24040fbf6c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:45.928515 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e69b74bb-29e1-467c-94f7-1f24040fbf6c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:45.929226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e69b74bb-29e1-467c-94f7-1f24040fbf6c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:45.929700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e69b74bb-29e1-467c-94f7-1f24040fbf6c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:45.930148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e69b74bb-29e1-467c-94f7-1f24040fbf6c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:46.072071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e69b74bb-29e1-467c-94f7-1f24040fbf6c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:46.081529 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e69b74bb-29e1-467c-94f7-1f24040fbf6c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.166167 Oct 11 05:32:46.094282 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4087/7939] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:45 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:47.106431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-877b8ea8-3243-4a02-b33d-ce4ae4179a54 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:47.125136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-877b8ea8-3243-4a02-b33d-ce4ae4179a54 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:47.125136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877b8ea8-3243-4a02-b33d-ce4ae4179a54 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:47.125136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877b8ea8-3243-4a02-b33d-ce4ae4179a54 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:47.125136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877b8ea8-3243-4a02-b33d-ce4ae4179a54 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:47.125136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877b8ea8-3243-4a02-b33d-ce4ae4179a54 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:47.125136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877b8ea8-3243-4a02-b33d-ce4ae4179a54 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:47.125136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-877b8ea8-3243-4a02-b33d-ce4ae4179a54 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:47.286215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-877b8ea8-3243-4a02-b33d-ce4ae4179a54 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:47.295964 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-877b8ea8-3243-4a02-b33d-ce4ae4179a54 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.194450 Oct 11 05:32:47.297564 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3853/7940] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:47 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:48.237412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4be7ed43-fe28-49c2-b998-cd4b71a97ebb req-26e2f77d-4de0-4dd6-9fa5-229b004aaf32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987b11a1-de36-4112-b738-e4214b26e2ef", "tag": "aa5aa4ea-e5d4-4112-98b2-3adfee03dd27"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:32:48.255778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4be7ed43-fe28-49c2-b998-cd4b71a97ebb req-26e2f77d-4de0-4dd6-9fa5-229b004aaf32 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:48.256434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4be7ed43-fe28-49c2-b998-cd4b71a97ebb req-26e2f77d-4de0-4dd6-9fa5-229b004aaf32 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:48.257058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4be7ed43-fe28-49c2-b998-cd4b71a97ebb req-26e2f77d-4de0-4dd6-9fa5-229b004aaf32 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:48.276445 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4be7ed43-fe28-49c2-b998-cd4b71a97ebb req-26e2f77d-4de0-4dd6-9fa5-229b004aaf32 service nova] Creating event network-changed:aa5aa4ea-e5d4-4112-98b2-3adfee03dd27 for instance 987b11a1-de36-4112-b738-e4214b26e2ef on n-h1-860892-1 Oct 11 05:32:48.284985 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4be7ed43-fe28-49c2-b998-cd4b71a97ebb req-26e2f77d-4de0-4dd6-9fa5-229b004aaf32 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051789 Oct 11 05:32:48.286259 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4088/7941] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:32:48.322567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4c529587-0510-458f-8593-0f578ebc1bd0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:48.323086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4c529587-0510-458f-8593-0f578ebc1bd0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:48.333212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c529587-0510-458f-8593-0f578ebc1bd0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:48.333899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c529587-0510-458f-8593-0f578ebc1bd0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:48.334486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c529587-0510-458f-8593-0f578ebc1bd0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:48.335737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c529587-0510-458f-8593-0f578ebc1bd0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:48.336392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c529587-0510-458f-8593-0f578ebc1bd0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:48.337153 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4c529587-0510-458f-8593-0f578ebc1bd0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:48.503878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4c529587-0510-458f-8593-0f578ebc1bd0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:48.522847 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4c529587-0510-458f-8593-0f578ebc1bd0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.205582 Oct 11 05:32:48.523637 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3854/7942] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:48 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:49.547368 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-08196abc-cc0e-438d-8af2-1ea092f24805 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:49.548919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-08196abc-cc0e-438d-8af2-1ea092f24805 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:49.556186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08196abc-cc0e-438d-8af2-1ea092f24805 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:49.556689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08196abc-cc0e-438d-8af2-1ea092f24805 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:49.557146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08196abc-cc0e-438d-8af2-1ea092f24805 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:49.557894 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08196abc-cc0e-438d-8af2-1ea092f24805 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:49.558398 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08196abc-cc0e-438d-8af2-1ea092f24805 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:49.558846 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-08196abc-cc0e-438d-8af2-1ea092f24805 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:49.705489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-08196abc-cc0e-438d-8af2-1ea092f24805 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:49.714157 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-08196abc-cc0e-438d-8af2-1ea092f24805 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.172235 Oct 11 05:32:49.715100 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4089/7943] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:49 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:50.738487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0e8ca4c5-b861-49b5-b9fd-83cd8231c38b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:50.739090 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0e8ca4c5-b861-49b5-b9fd-83cd8231c38b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:50.742041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:32:50.747502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e8ca4c5-b861-49b5-b9fd-83cd8231c38b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:50.747992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e8ca4c5-b861-49b5-b9fd-83cd8231c38b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:50.748431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e8ca4c5-b861-49b5-b9fd-83cd8231c38b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:50.749134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e8ca4c5-b861-49b5-b9fd-83cd8231c38b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:50.749593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e8ca4c5-b861-49b5-b9fd-83cd8231c38b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:50.750023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0e8ca4c5-b861-49b5-b9fd-83cd8231c38b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:50.888917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0e8ca4c5-b861-49b5-b9fd-83cd8231c38b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:50.897191 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0e8ca4c5-b861-49b5-b9fd-83cd8231c38b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.162696 Oct 11 05:32:50.897768 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3855/7944] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:50 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:51.920116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-63bda550-9e6b-4733-91a2-33a4537a9552 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:51.920752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-63bda550-9e6b-4733-91a2-33a4537a9552 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:51.923057 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:32:51.923814 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:32:51.928658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63bda550-9e6b-4733-91a2-33a4537a9552 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:51.934071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63bda550-9e6b-4733-91a2-33a4537a9552 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:51.934071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63bda550-9e6b-4733-91a2-33a4537a9552 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:51.934071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63bda550-9e6b-4733-91a2-33a4537a9552 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:51.934071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63bda550-9e6b-4733-91a2-33a4537a9552 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:51.934071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63bda550-9e6b-4733-91a2-33a4537a9552 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:52.065420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-63bda550-9e6b-4733-91a2-33a4537a9552 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:52.073811 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-63bda550-9e6b-4733-91a2-33a4537a9552 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.157647 Oct 11 05:32:52.074443 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4090/7945] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:51 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:32:53.096324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4fe13935-da2e-4ad7-be8d-c35b24273a9a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:53.096943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4fe13935-da2e-4ad7-be8d-c35b24273a9a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:53.103862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fe13935-da2e-4ad7-be8d-c35b24273a9a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:53.104346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fe13935-da2e-4ad7-be8d-c35b24273a9a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:53.104786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fe13935-da2e-4ad7-be8d-c35b24273a9a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:53.105481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fe13935-da2e-4ad7-be8d-c35b24273a9a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:53.105938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fe13935-da2e-4ad7-be8d-c35b24273a9a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:53.106402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4fe13935-da2e-4ad7-be8d-c35b24273a9a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:53.237165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4fe13935-da2e-4ad7-be8d-c35b24273a9a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:53.245089 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4fe13935-da2e-4ad7-be8d-c35b24273a9a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.152751 Oct 11 05:32:53.245676 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3856/7946] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:53 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:54.268321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-19df4105-7e89-42c7-b0b6-66e82fbebede tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:54.268944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-19df4105-7e89-42c7-b0b6-66e82fbebede tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:54.276322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19df4105-7e89-42c7-b0b6-66e82fbebede tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:54.276832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19df4105-7e89-42c7-b0b6-66e82fbebede tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:54.277257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19df4105-7e89-42c7-b0b6-66e82fbebede tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:54.277952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19df4105-7e89-42c7-b0b6-66e82fbebede tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:54.278441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19df4105-7e89-42c7-b0b6-66e82fbebede tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:54.278877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19df4105-7e89-42c7-b0b6-66e82fbebede tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:54.405503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-19df4105-7e89-42c7-b0b6-66e82fbebede tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:54.413195 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-19df4105-7e89-42c7-b0b6-66e82fbebede tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.149059 Oct 11 05:32:54.413776 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4091/7947] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:54 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:55.436902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cf33bb2b-1871-435f-92a5-f4232a25460e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:55.437515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cf33bb2b-1871-435f-92a5-f4232a25460e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:55.444418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf33bb2b-1871-435f-92a5-f4232a25460e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:55.444902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf33bb2b-1871-435f-92a5-f4232a25460e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:55.445344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf33bb2b-1871-435f-92a5-f4232a25460e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:55.446037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf33bb2b-1871-435f-92a5-f4232a25460e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:55.446542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf33bb2b-1871-435f-92a5-f4232a25460e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:55.446969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cf33bb2b-1871-435f-92a5-f4232a25460e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:55.579782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cf33bb2b-1871-435f-92a5-f4232a25460e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:55.587493 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cf33bb2b-1871-435f-92a5-f4232a25460e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.154478 Oct 11 05:32:55.588072 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3857/7948] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:55 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:56.610686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6355f036-f6cc-41ca-a14d-1d4878c47bbe tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:56.611339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6355f036-f6cc-41ca-a14d-1d4878c47bbe tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:56.618792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6355f036-f6cc-41ca-a14d-1d4878c47bbe tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:56.619280 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6355f036-f6cc-41ca-a14d-1d4878c47bbe tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:56.619728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6355f036-f6cc-41ca-a14d-1d4878c47bbe tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:56.620445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6355f036-f6cc-41ca-a14d-1d4878c47bbe tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:56.620893 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6355f036-f6cc-41ca-a14d-1d4878c47bbe tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:56.621328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6355f036-f6cc-41ca-a14d-1d4878c47bbe tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:56.748636 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6355f036-f6cc-41ca-a14d-1d4878c47bbe tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:56.756385 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6355f036-f6cc-41ca-a14d-1d4878c47bbe tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.149568 Oct 11 05:32:56.756963 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4092/7949] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:56 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:57.780186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f3ca9e0f-07ba-4d29-971d-af50f2db32b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:57.780757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f3ca9e0f-07ba-4d29-971d-af50f2db32b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:57.787670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3ca9e0f-07ba-4d29-971d-af50f2db32b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:57.791351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3ca9e0f-07ba-4d29-971d-af50f2db32b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:57.791351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3ca9e0f-07ba-4d29-971d-af50f2db32b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:57.791351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3ca9e0f-07ba-4d29-971d-af50f2db32b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:57.791351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3ca9e0f-07ba-4d29-971d-af50f2db32b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:57.791351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f3ca9e0f-07ba-4d29-971d-af50f2db32b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:57.920935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f3ca9e0f-07ba-4d29-971d-af50f2db32b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:57.928704 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f3ca9e0f-07ba-4d29-971d-af50f2db32b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.152532 Oct 11 05:32:57.929270 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3858/7950] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:57 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:32:58.952355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d9d66f90-f79d-42cf-ad9d-1b6d91a0c6bd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:32:58.952972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d9d66f90-f79d-42cf-ad9d-1b6d91a0c6bd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:32:58.959862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9d66f90-f79d-42cf-ad9d-1b6d91a0c6bd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:58.960348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9d66f90-f79d-42cf-ad9d-1b6d91a0c6bd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:58.960793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9d66f90-f79d-42cf-ad9d-1b6d91a0c6bd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:58.962068 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9d66f90-f79d-42cf-ad9d-1b6d91a0c6bd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:32:58.962571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9d66f90-f79d-42cf-ad9d-1b6d91a0c6bd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:32:58.963047 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d9d66f90-f79d-42cf-ad9d-1b6d91a0c6bd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:32:59.095409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d9d66f90-f79d-42cf-ad9d-1b6d91a0c6bd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:32:59.103253 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d9d66f90-f79d-42cf-ad9d-1b6d91a0c6bd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.154920 Oct 11 05:32:59.103966 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4093/7951] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:32:58 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:33:00.126356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e78c7d9c-8195-4ab9-8f4a-ce8169411a6f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:33:00.126981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e78c7d9c-8195-4ab9-8f4a-ce8169411a6f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:33:00.133858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e78c7d9c-8195-4ab9-8f4a-ce8169411a6f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:00.134383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e78c7d9c-8195-4ab9-8f4a-ce8169411a6f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:00.134831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e78c7d9c-8195-4ab9-8f4a-ce8169411a6f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:00.135527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e78c7d9c-8195-4ab9-8f4a-ce8169411a6f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:00.135986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e78c7d9c-8195-4ab9-8f4a-ce8169411a6f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:00.136418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e78c7d9c-8195-4ab9-8f4a-ce8169411a6f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:00.263571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e78c7d9c-8195-4ab9-8f4a-ce8169411a6f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:33:00.271562 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e78c7d9c-8195-4ab9-8f4a-ce8169411a6f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.149163 Oct 11 05:33:00.272135 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3859/7952] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:33:00 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:33:00.826947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-2d632c29-dbad-4994-92ca-a94b7a24d716 req-58703c3f-cac2-418b-a3e5-01fb973b9c28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987b11a1-de36-4112-b738-e4214b26e2ef", "name": "network-vif-plugged", "status": "completed", "tag": "aa5aa4ea-e5d4-4112-98b2-3adfee03dd27"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:33:00.837220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2d632c29-dbad-4994-92ca-a94b7a24d716 req-58703c3f-cac2-418b-a3e5-01fb973b9c28 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:00.837790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2d632c29-dbad-4994-92ca-a94b7a24d716 req-58703c3f-cac2-418b-a3e5-01fb973b9c28 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:00.838353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-2d632c29-dbad-4994-92ca-a94b7a24d716 req-58703c3f-cac2-418b-a3e5-01fb973b9c28 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:00.849695 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-2d632c29-dbad-4994-92ca-a94b7a24d716 req-58703c3f-cac2-418b-a3e5-01fb973b9c28 service nova] Creating event network-vif-plugged:aa5aa4ea-e5d4-4112-98b2-3adfee03dd27 for instance 987b11a1-de36-4112-b738-e4214b26e2ef on n-h1-860892-1 Oct 11 05:33:00.854629 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-2d632c29-dbad-4994-92ca-a94b7a24d716 req-58703c3f-cac2-418b-a3e5-01fb973b9c28 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.152137 Oct 11 05:33:00.855208 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4094/7953] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:33:01.295530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c70fb58d-eb15-4369-8c0f-b9d90533ae75 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:33:01.296077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c70fb58d-eb15-4369-8c0f-b9d90533ae75 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:33:01.303171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70fb58d-eb15-4369-8c0f-b9d90533ae75 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:01.303666 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70fb58d-eb15-4369-8c0f-b9d90533ae75 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:01.304129 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70fb58d-eb15-4369-8c0f-b9d90533ae75 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:01.304821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70fb58d-eb15-4369-8c0f-b9d90533ae75 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:01.305933 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70fb58d-eb15-4369-8c0f-b9d90533ae75 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:01.306405 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c70fb58d-eb15-4369-8c0f-b9d90533ae75 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:01.437905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c70fb58d-eb15-4369-8c0f-b9d90533ae75 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:33:01.445652 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c70fb58d-eb15-4369-8c0f-b9d90533ae75 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1358 microversion: 2.1 time: 0.154114 Oct 11 05:33:01.446254 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3860/7954] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:33:01 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:33:02.470545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7f288ae3-e7ca-48bc-9f7c-f39cd8c42d40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:33:02.471260 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7f288ae3-e7ca-48bc-9f7c-f39cd8c42d40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:33:02.478174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f288ae3-e7ca-48bc-9f7c-f39cd8c42d40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:02.478694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f288ae3-e7ca-48bc-9f7c-f39cd8c42d40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:02.479150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f288ae3-e7ca-48bc-9f7c-f39cd8c42d40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:02.479858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f288ae3-e7ca-48bc-9f7c-f39cd8c42d40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:02.480329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f288ae3-e7ca-48bc-9f7c-f39cd8c42d40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:02.480771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f288ae3-e7ca-48bc-9f7c-f39cd8c42d40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:02.896078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7f288ae3-e7ca-48bc-9f7c-f39cd8c42d40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:33:02.904588 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7f288ae3-e7ca-48bc-9f7c-f39cd8c42d40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1547 microversion: 2.1 time: 0.439447 Oct 11 05:33:02.905194 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4095/7955] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:33:02 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1547 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:33:02.926849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5678a28f-cdb7-4081-b755-821db71c21c3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:33:02.927525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5678a28f-cdb7-4081-b755-821db71c21c3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:33:02.934523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5678a28f-cdb7-4081-b755-821db71c21c3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:02.935011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5678a28f-cdb7-4081-b755-821db71c21c3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:02.935454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5678a28f-cdb7-4081-b755-821db71c21c3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:02.936152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5678a28f-cdb7-4081-b755-821db71c21c3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:02.936613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5678a28f-cdb7-4081-b755-821db71c21c3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:02.937045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5678a28f-cdb7-4081-b755-821db71c21c3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:03.065703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5678a28f-cdb7-4081-b755-821db71c21c3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:33:03.073985 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5678a28f-cdb7-4081-b755-821db71c21c3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1547 microversion: 2.1 time: 0.151054 Oct 11 05:33:03.074592 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3861/7956] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:33:02 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:33:03.096339 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c2bfebda-1c96-4004-a028-63af9af9b895 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:33:03.101281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c2bfebda-1c96-4004-a028-63af9af9b895 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:33:03.102065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c2bfebda-1c96-4004-a028-63af9af9b895 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Searching by: {'deleted': False, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59'} {{(pid=120994) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 05:33:03.107382 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2bfebda-1c96-4004-a028-63af9af9b895 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:03.107877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2bfebda-1c96-4004-a028-63af9af9b895 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:03.108336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2bfebda-1c96-4004-a028-63af9af9b895 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:03.109075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2bfebda-1c96-4004-a028-63af9af9b895 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:03.109545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2bfebda-1c96-4004-a028-63af9af9b895 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:03.109987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c2bfebda-1c96-4004-a028-63af9af9b895 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:03.133756 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.multi_cell_list [None req-c2bfebda-1c96-4004-a028-63af9af9b895 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120994) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 05:33:03.160764 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c2bfebda-1c96-4004-a028-63af9af9b895 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068214 Oct 11 05:33:03.161275 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4096/7957] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 05:33:03 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:33:03.173065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d8b4df37-e0ec-4083-9722-7832e595efec tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:33:03.173684 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d8b4df37-e0ec-4083-9722-7832e595efec tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:33:03.180230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8b4df37-e0ec-4083-9722-7832e595efec tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:03.180719 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8b4df37-e0ec-4083-9722-7832e595efec tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:03.181157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8b4df37-e0ec-4083-9722-7832e595efec tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:03.181846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8b4df37-e0ec-4083-9722-7832e595efec tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:03.182332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8b4df37-e0ec-4083-9722-7832e595efec tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:03.182764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d8b4df37-e0ec-4083-9722-7832e595efec tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:03.318539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d8b4df37-e0ec-4083-9722-7832e595efec tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:33:03.326941 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d8b4df37-e0ec-4083-9722-7832e595efec tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1547 microversion: 2.1 time: 0.157823 Oct 11 05:33:03.327504 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3862/7958] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:33:03 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1547 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:33:06.225810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-acbecfe5-9bd1-4bd4-952e-c1e19afb6fe0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:33:06.228233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-acbecfe5-9bd1-4bd4-952e-c1e19afb6fe0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:33:06.234941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acbecfe5-9bd1-4bd4-952e-c1e19afb6fe0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:06.235434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acbecfe5-9bd1-4bd4-952e-c1e19afb6fe0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:06.235888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acbecfe5-9bd1-4bd4-952e-c1e19afb6fe0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:06.236579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acbecfe5-9bd1-4bd4-952e-c1e19afb6fe0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:06.237076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acbecfe5-9bd1-4bd4-952e-c1e19afb6fe0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:06.237513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-acbecfe5-9bd1-4bd4-952e-c1e19afb6fe0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:06.930405 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-acbecfe5-9bd1-4bd4-952e-c1e19afb6fe0 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.708135 Oct 11 05:33:06.931024 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4097/7959] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 05:33:06 2022] POST /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments => generated 194 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:33:21.969568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c9b14e60-f515-4ac2-aed7-fe43e0388dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:33:21.970180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c9b14e60-f515-4ac2-aed7-fe43e0388dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:33:21.972540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:33:21.973191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=72 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:33:21.977790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9b14e60-f515-4ac2-aed7-fe43e0388dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:21.978303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9b14e60-f515-4ac2-aed7-fe43e0388dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:21.978784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9b14e60-f515-4ac2-aed7-fe43e0388dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:21.979462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9b14e60-f515-4ac2-aed7-fe43e0388dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:21.979906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9b14e60-f515-4ac2-aed7-fe43e0388dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:21.980329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c9b14e60-f515-4ac2-aed7-fe43e0388dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:22.108109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c9b14e60-f515-4ac2-aed7-fe43e0388dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:33:22.116231 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c9b14e60-f515-4ac2-aed7-fe43e0388dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1593 microversion: 2.1 time: 0.150675 Oct 11 05:33:22.117340 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3863/7960] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:33:21 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1593 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:33:24.081523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:33:24.082692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:33:24.084516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:33:24.159016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-99b7f5f8-811f-47f3-a2cb-45cdba76e6c3 req-6f3295cf-cdc8-454a-aa57-1e02e3bd884a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987b11a1-de36-4112-b738-e4214b26e2ef", "tag": "aa5aa4ea-e5d4-4112-98b2-3adfee03dd27"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:33:24.169247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-99b7f5f8-811f-47f3-a2cb-45cdba76e6c3 req-6f3295cf-cdc8-454a-aa57-1e02e3bd884a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:24.169753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-99b7f5f8-811f-47f3-a2cb-45cdba76e6c3 req-6f3295cf-cdc8-454a-aa57-1e02e3bd884a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:24.170222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-99b7f5f8-811f-47f3-a2cb-45cdba76e6c3 req-6f3295cf-cdc8-454a-aa57-1e02e3bd884a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:24.182634 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-99b7f5f8-811f-47f3-a2cb-45cdba76e6c3 req-6f3295cf-cdc8-454a-aa57-1e02e3bd884a service nova] Creating event network-changed:aa5aa4ea-e5d4-4112-98b2-3adfee03dd27 for instance 987b11a1-de36-4112-b738-e4214b26e2ef on n-h1-860892-1 Oct 11 05:33:24.187869 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-99b7f5f8-811f-47f3-a2cb-45cdba76e6c3 req-6f3295cf-cdc8-454a-aa57-1e02e3bd884a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111974 Oct 11 05:33:24.192075 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4098/7961] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:33:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:33:26.770615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fab5cf76-9e97-4d5e-9165-d6a2d41d3c12 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1334269787"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:33:26.777408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fab5cf76-9e97-4d5e-9165-d6a2d41d3c12 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:33:26.778262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fab5cf76-9e97-4d5e-9165-d6a2d41d3c12 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:26.778748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fab5cf76-9e97-4d5e-9165-d6a2d41d3c12 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:26.779180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fab5cf76-9e97-4d5e-9165-d6a2d41d3c12 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:26.779863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fab5cf76-9e97-4d5e-9165-d6a2d41d3c12 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:26.780312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fab5cf76-9e97-4d5e-9165-d6a2d41d3c12 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:26.780784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fab5cf76-9e97-4d5e-9165-d6a2d41d3c12 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:26.910778 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.network.security_group_api [None req-fab5cf76-9e97-4d5e-9165-d6a2d41d3c12 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Adding security group a83d9a63-9234-47c5-9ae0-359a7f3c3052 to port aa5aa4ea-e5d4-4112-98b2-3adfee03dd27 Oct 11 05:33:27.311126 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fab5cf76-9e97-4d5e-9165-d6a2d41d3c12 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/action" status: 202 len: 0 microversion: 2.1 time: 0.541872 Oct 11 05:33:27.311126 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3864/7962] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:33:26 2022] POST /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/action => generated 0 bytes in 543 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:33:27.323491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-390f0b06-afb4-4dab-8184-a10f753aef88 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:33:27.324237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-390f0b06-afb4-4dab-8184-a10f753aef88 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:33:27.334389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390f0b06-afb4-4dab-8184-a10f753aef88 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:27.334631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390f0b06-afb4-4dab-8184-a10f753aef88 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:27.335272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390f0b06-afb4-4dab-8184-a10f753aef88 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:27.335997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390f0b06-afb4-4dab-8184-a10f753aef88 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:27.337215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390f0b06-afb4-4dab-8184-a10f753aef88 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:27.337877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-390f0b06-afb4-4dab-8184-a10f753aef88 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:27.424348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-50515b88-5ebf-4b16-b69c-e8dd85f169ab req-6ffc5e3d-8b1c-443c-9e86-66d0803038d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987b11a1-de36-4112-b738-e4214b26e2ef", "tag": "aa5aa4ea-e5d4-4112-98b2-3adfee03dd27"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:33:27.440178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-50515b88-5ebf-4b16-b69c-e8dd85f169ab req-6ffc5e3d-8b1c-443c-9e86-66d0803038d5 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:33:27.442491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-50515b88-5ebf-4b16-b69c-e8dd85f169ab req-6ffc5e3d-8b1c-443c-9e86-66d0803038d5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:33:27.442491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-50515b88-5ebf-4b16-b69c-e8dd85f169ab req-6ffc5e3d-8b1c-443c-9e86-66d0803038d5 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:33:27.458376 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-50515b88-5ebf-4b16-b69c-e8dd85f169ab req-6ffc5e3d-8b1c-443c-9e86-66d0803038d5 service nova] Creating event network-changed:aa5aa4ea-e5d4-4112-98b2-3adfee03dd27 for instance 987b11a1-de36-4112-b738-e4214b26e2ef on n-h1-860892-1 Oct 11 05:33:27.465093 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-50515b88-5ebf-4b16-b69c-e8dd85f169ab req-6ffc5e3d-8b1c-443c-9e86-66d0803038d5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.145585 Oct 11 05:33:27.465708 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3865/7963] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:33:27.564570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-390f0b06-afb4-4dab-8184-a10f753aef88 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:33:27.574920 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-390f0b06-afb4-4dab-8184-a10f753aef88 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1758 microversion: 2.1 time: 0.261230 Oct 11 05:33:27.575664 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4099/7964] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:33:27 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1758 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:35:36.461032 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:35:36.461834 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:35:36.462406 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:35:36.463158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=12 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:35:36.464344 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:35:36.464486 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/action (ip 10.222.0.26) !!! Oct 11 05:35:36.466480 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:35:36.466582 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/action (ip 10.222.0.26) !!! Oct 11 05:35:36.474702 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-534f0744-5764-4e0c-bcc1-2ec9832f6fd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:35:36.476982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-534f0744-5764-4e0c-bcc1-2ec9832f6fd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:35:36.489396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-534f0744-5764-4e0c-bcc1-2ec9832f6fd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:35:36.489881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-534f0744-5764-4e0c-bcc1-2ec9832f6fd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:35:36.490349 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-534f0744-5764-4e0c-bcc1-2ec9832f6fd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:35:36.491048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-534f0744-5764-4e0c-bcc1-2ec9832f6fd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:35:36.491506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-534f0744-5764-4e0c-bcc1-2ec9832f6fd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:35:36.491937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-534f0744-5764-4e0c-bcc1-2ec9832f6fd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:35:36.696958 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-534f0744-5764-4e0c-bcc1-2ec9832f6fd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/action" status: 202 len: 0 microversion: 2.1 time: 0.237253 Oct 11 05:35:36.697610 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3866/7965] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:35:36 2022] POST /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:35:36.704386 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc2e98b3-7f64-4104-93f2-3fa6b98fc453] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 05:35:36.705306 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 05:35:36.706098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:35:36.706915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=8 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:35:36.707986 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:35:36.708130 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:35:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef (ip 10.222.0.26) !!! Oct 11 05:35:36.713415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b13d45f3-ad74-4508-b3ba-5c8ee8d704ad tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:35:36.714038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b13d45f3-ad74-4508-b3ba-5c8ee8d704ad tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:35:36.721715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13d45f3-ad74-4508-b3ba-5c8ee8d704ad tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:35:36.726279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13d45f3-ad74-4508-b3ba-5c8ee8d704ad tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:35:36.726279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13d45f3-ad74-4508-b3ba-5c8ee8d704ad tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:35:36.726279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13d45f3-ad74-4508-b3ba-5c8ee8d704ad tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:35:36.726279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13d45f3-ad74-4508-b3ba-5c8ee8d704ad tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:35:36.726279 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b13d45f3-ad74-4508-b3ba-5c8ee8d704ad tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:35:36.877596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b13d45f3-ad74-4508-b3ba-5c8ee8d704ad tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:35:36.885995 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b13d45f3-ad74-4508-b3ba-5c8ee8d704ad tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1760 microversion: 2.1 time: 0.184217 Oct 11 05:35:36.886596 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4100/7966] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:35:36 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1760 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:35:37.913514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a17dba9-5905-47c8-8743-61ab6a54a743 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:35:37.914235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7a17dba9-5905-47c8-8743-61ab6a54a743 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:35:37.922214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a17dba9-5905-47c8-8743-61ab6a54a743 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:35:37.922687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a17dba9-5905-47c8-8743-61ab6a54a743 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:35:37.923128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a17dba9-5905-47c8-8743-61ab6a54a743 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:35:37.924478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a17dba9-5905-47c8-8743-61ab6a54a743 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:35:37.924942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a17dba9-5905-47c8-8743-61ab6a54a743 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:35:37.925370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a17dba9-5905-47c8-8743-61ab6a54a743 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:35:37.931140 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39690. Oct 11 05:35:37.933379 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39688. Oct 11 05:35:38.075223 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7a17dba9-5905-47c8-8743-61ab6a54a743 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:35:38.083526 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7a17dba9-5905-47c8-8743-61ab6a54a743 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1765 microversion: 2.1 time: 0.176488 Oct 11 05:35:38.084103 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3867/7967] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:35:37 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1765 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:35:39.107463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-010dd97c-8d6a-4bf1-9642-1177df5f787d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:35:39.108125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-010dd97c-8d6a-4bf1-9642-1177df5f787d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:35:39.118220 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-010dd97c-8d6a-4bf1-9642-1177df5f787d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:35:39.118696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-010dd97c-8d6a-4bf1-9642-1177df5f787d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:35:39.119158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-010dd97c-8d6a-4bf1-9642-1177df5f787d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:35:39.119877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-010dd97c-8d6a-4bf1-9642-1177df5f787d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:35:39.120345 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-010dd97c-8d6a-4bf1-9642-1177df5f787d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:35:39.120786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-010dd97c-8d6a-4bf1-9642-1177df5f787d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:35:39.137745 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc2e98b3-7f64-4104-93f2-3fa6b98fc453] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39696. Oct 11 05:35:39.142632 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39698. Oct 11 05:35:39.383626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-010dd97c-8d6a-4bf1-9642-1177df5f787d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:35:39.391978 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-010dd97c-8d6a-4bf1-9642-1177df5f787d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1758 microversion: 2.1 time: 0.288382 Oct 11 05:35:39.392492 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4101/7968] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:35:39 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1758 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:10.777442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:37:10.778155 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=16,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:37:10.782237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d445adb6-356a-4bcd-b85a-c3eae4a7d699 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1334269787"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:37:10.782787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d445adb6-356a-4bcd-b85a-c3eae4a7d699 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:10.788697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d445adb6-356a-4bcd-b85a-c3eae4a7d699 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:10.795975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d445adb6-356a-4bcd-b85a-c3eae4a7d699 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:10.795975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d445adb6-356a-4bcd-b85a-c3eae4a7d699 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:10.795975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d445adb6-356a-4bcd-b85a-c3eae4a7d699 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:10.795975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d445adb6-356a-4bcd-b85a-c3eae4a7d699 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:10.795975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d445adb6-356a-4bcd-b85a-c3eae4a7d699 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:10.974943 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.network.security_group_api [None req-d445adb6-356a-4bcd-b85a-c3eae4a7d699 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Removing security group a83d9a63-9234-47c5-9ae0-359a7f3c3052 from port aa5aa4ea-e5d4-4112-98b2-3adfee03dd27 Oct 11 05:37:11.358323 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d445adb6-356a-4bcd-b85a-c3eae4a7d699 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/action" status: 202 len: 0 microversion: 2.1 time: 0.582715 Oct 11 05:37:11.359464 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3868/7969] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:37:10 2022] POST /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/action => generated 0 bytes in 584 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:37:11.367136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:37:11.374589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=12 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:37:11.378803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-4b00f448-dcc1-4fc3-883f-2be5d763da7e req-8ea14722-e663-4c85-8097-1c4c33410549 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987b11a1-de36-4112-b738-e4214b26e2ef", "tag": "aa5aa4ea-e5d4-4112-98b2-3adfee03dd27"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:37:11.399311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4b00f448-dcc1-4fc3-883f-2be5d763da7e req-8ea14722-e663-4c85-8097-1c4c33410549 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:11.399825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4b00f448-dcc1-4fc3-883f-2be5d763da7e req-8ea14722-e663-4c85-8097-1c4c33410549 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:11.400263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-4b00f448-dcc1-4fc3-883f-2be5d763da7e req-8ea14722-e663-4c85-8097-1c4c33410549 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:11.415706 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-4b00f448-dcc1-4fc3-883f-2be5d763da7e req-8ea14722-e663-4c85-8097-1c4c33410549 service nova] Creating event network-changed:aa5aa4ea-e5d4-4112-98b2-3adfee03dd27 for instance 987b11a1-de36-4112-b738-e4214b26e2ef on n-h1-860892-1 Oct 11 05:37:11.446416 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [req-4b00f448-dcc1-4fc3-883f-2be5d763da7e req-8ea14722-e663-4c85-8097-1c4c33410549 service nova] [31b8fd5e-9e4a-4e3f-90c6-38425062c3ac] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:37:12.454414 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [req-4b00f448-dcc1-4fc3-883f-2be5d763da7e req-8ea14722-e663-4c85-8097-1c4c33410549 service nova] [31b8fd5e-9e4a-4e3f-90c6-38425062c3ac] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 39740. Oct 11 05:37:12.459461 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-4b00f448-dcc1-4fc3-883f-2be5d763da7e req-8ea14722-e663-4c85-8097-1c4c33410549 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.094723 Oct 11 05:37:12.460082 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4102/7970] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1098 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:37:12.573089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1122bfae-fe27-4017-a789-6396d3acc9d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:12.573653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1122bfae-fe27-4017-a789-6396d3acc9d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:12.579755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1122bfae-fe27-4017-a789-6396d3acc9d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:12.580455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1122bfae-fe27-4017-a789-6396d3acc9d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:12.581068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1122bfae-fe27-4017-a789-6396d3acc9d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:12.581820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1122bfae-fe27-4017-a789-6396d3acc9d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:12.582311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1122bfae-fe27-4017-a789-6396d3acc9d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:12.582744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1122bfae-fe27-4017-a789-6396d3acc9d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:12.671308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-1122bfae-fe27-4017-a789-6396d3acc9d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lazy-loading 'services' on Instance uuid 987b11a1-de36-4112-b738-e4214b26e2ef {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:37:12.894834 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1122bfae-fe27-4017-a789-6396d3acc9d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments/ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7" status: 202 len: 0 microversion: 2.1 time: 0.325970 Oct 11 05:37:12.900024 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3869/7971] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 05:37:12 2022] DELETE /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments/ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:37:12.905853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-90b8174c-0b2c-4bb1-8b3a-fdd4a9beacc8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:12.918508 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-90b8174c-0b2c-4bb1-8b3a-fdd4a9beacc8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:12.926856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b8174c-0b2c-4bb1-8b3a-fdd4a9beacc8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:12.927587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b8174c-0b2c-4bb1-8b3a-fdd4a9beacc8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:12.928238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b8174c-0b2c-4bb1-8b3a-fdd4a9beacc8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:12.928981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b8174c-0b2c-4bb1-8b3a-fdd4a9beacc8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:12.929602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b8174c-0b2c-4bb1-8b3a-fdd4a9beacc8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:12.930263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-90b8174c-0b2c-4bb1-8b3a-fdd4a9beacc8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:12.967394 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-90b8174c-0b2c-4bb1-8b3a-fdd4a9beacc8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066088 Oct 11 05:37:12.968688 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4103/7972] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:37:12 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:37:13.981616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75f437cd-d6e9-42ca-b728-443dbb09bd85 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:13.983997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-75f437cd-d6e9-42ca-b728-443dbb09bd85 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:13.991695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f437cd-d6e9-42ca-b728-443dbb09bd85 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:13.992172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f437cd-d6e9-42ca-b728-443dbb09bd85 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:13.992607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f437cd-d6e9-42ca-b728-443dbb09bd85 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:13.993293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f437cd-d6e9-42ca-b728-443dbb09bd85 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:13.993742 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f437cd-d6e9-42ca-b728-443dbb09bd85 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:13.994161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75f437cd-d6e9-42ca-b728-443dbb09bd85 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:14.024878 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-75f437cd-d6e9-42ca-b728-443dbb09bd85 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047751 Oct 11 05:37:14.025442 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3870/7973] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:37:13 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:37:14.475981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-71ff7a07-d5d0-4897-9001-219dedbc9d63 req-9495e263-9a50-47e3-a004-983ce4defe12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "987b11a1-de36-4112-b738-e4214b26e2ef", "tag": "aa5aa4ea-e5d4-4112-98b2-3adfee03dd27"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:37:14.486065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-71ff7a07-d5d0-4897-9001-219dedbc9d63 req-9495e263-9a50-47e3-a004-983ce4defe12 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:14.486584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-71ff7a07-d5d0-4897-9001-219dedbc9d63 req-9495e263-9a50-47e3-a004-983ce4defe12 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:14.487029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-71ff7a07-d5d0-4897-9001-219dedbc9d63 req-9495e263-9a50-47e3-a004-983ce4defe12 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:14.498318 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-71ff7a07-d5d0-4897-9001-219dedbc9d63 req-9495e263-9a50-47e3-a004-983ce4defe12 service nova] Creating event network-changed:aa5aa4ea-e5d4-4112-98b2-3adfee03dd27 for instance 987b11a1-de36-4112-b738-e4214b26e2ef on n-h1-860892-1 Oct 11 05:37:14.503484 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-71ff7a07-d5d0-4897-9001-219dedbc9d63 req-9495e263-9a50-47e3-a004-983ce4defe12 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031462 Oct 11 05:37:14.504568 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4104/7974] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:37:15.037088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9c36dcdd-d618-484e-aa28-b8b50dfd0761 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:15.039396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9c36dcdd-d618-484e-aa28-b8b50dfd0761 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:15.046401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c36dcdd-d618-484e-aa28-b8b50dfd0761 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:15.046898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c36dcdd-d618-484e-aa28-b8b50dfd0761 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:15.047345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c36dcdd-d618-484e-aa28-b8b50dfd0761 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:15.048058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c36dcdd-d618-484e-aa28-b8b50dfd0761 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:15.048510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c36dcdd-d618-484e-aa28-b8b50dfd0761 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:15.048936 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9c36dcdd-d618-484e-aa28-b8b50dfd0761 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:15.081431 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9c36dcdd-d618-484e-aa28-b8b50dfd0761 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048308 Oct 11 05:37:15.082069 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3871/7975] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:37:15 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:37:16.095112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-73372bf8-be99-4848-bd62-21c3ae945c80 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:16.097954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-73372bf8-be99-4848-bd62-21c3ae945c80 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:16.105208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73372bf8-be99-4848-bd62-21c3ae945c80 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:16.105708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73372bf8-be99-4848-bd62-21c3ae945c80 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:16.106165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73372bf8-be99-4848-bd62-21c3ae945c80 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:16.106901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73372bf8-be99-4848-bd62-21c3ae945c80 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:16.107369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73372bf8-be99-4848-bd62-21c3ae945c80 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:16.107811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-73372bf8-be99-4848-bd62-21c3ae945c80 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:16.140775 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-73372bf8-be99-4848-bd62-21c3ae945c80 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050034 Oct 11 05:37:16.141300 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4105/7976] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:37:16 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:37:17.153278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c527bcc-bc59-471e-8c41-eeaaed4a6de1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:17.155510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5c527bcc-bc59-471e-8c41-eeaaed4a6de1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:17.164468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c527bcc-bc59-471e-8c41-eeaaed4a6de1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:17.164975 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c527bcc-bc59-471e-8c41-eeaaed4a6de1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:17.165407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c527bcc-bc59-471e-8c41-eeaaed4a6de1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:17.166095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c527bcc-bc59-471e-8c41-eeaaed4a6de1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:17.166595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c527bcc-bc59-471e-8c41-eeaaed4a6de1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:17.167003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c527bcc-bc59-471e-8c41-eeaaed4a6de1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:17.195632 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5c527bcc-bc59-471e-8c41-eeaaed4a6de1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046358 Oct 11 05:37:17.196116 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3872/7977] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:37:17 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:37:18.208040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a56ddf38-5890-4e75-9c83-1d44456993fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:18.210257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a56ddf38-5890-4e75-9c83-1d44456993fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:18.212601 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:37:18.212767 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:37:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments (ip 10.222.0.26) !!! Oct 11 05:37:18.223224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a56ddf38-5890-4e75-9c83-1d44456993fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:18.223716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a56ddf38-5890-4e75-9c83-1d44456993fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:18.224161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a56ddf38-5890-4e75-9c83-1d44456993fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:18.224992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a56ddf38-5890-4e75-9c83-1d44456993fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:18.225452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a56ddf38-5890-4e75-9c83-1d44456993fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:18.225888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a56ddf38-5890-4e75-9c83-1d44456993fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:18.256333 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a56ddf38-5890-4e75-9c83-1d44456993fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052308 Oct 11 05:37:18.256891 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4106/7978] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:37:18 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 05:37:18.267534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:18.268075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:18.275017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:18.275490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:18.275923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:18.276606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:18.277054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:18.277477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:18.350944 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] HTTP exception thrown: Instance 987b11a1-de36-4112-b738-e4214b26e2ef is not attached to volume ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Request method failure captured: Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: request: DELETE /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments/ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7 HTTP/1.1 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRP_lpD3ZRJOat0JbxEQgBqnvm4rH8pz694sFd69mjllUaudB9W0jtlDlCL-rn5txXTNSL8ckZmBhM0y9wNdubNyvWzHkf38zeIJwwT_VCU_jSsWtl58RJj1KM4S2TP7J6S76ejvWG719gJvD22T4NYvYbl8W9GozIn8NXRUy4Mgzod0 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 9ddab207a4844bb4b2faeba8b6a28f59 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ddab207a4844bb4b2faeba8b6a28f59"}]}] Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 9ddab207a4844bb4b2faeba8b6a28f59 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestMinimumBasicScenario-198596167-project Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: f6e5d86ca2df425ab50a9059432c0a66 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestMinimumBasicScenario-198596167-project Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 987b11a1-de36-4112-b738-e4214b26e2ef is not attached to volume ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'server_id': '987b11a1-de36-4112-b738-e4214b26e2ef', 'id': 'ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7'} Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7. Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987b11a1-de36-4112-b738-e4214b26e2ef is not attached to volume ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7 Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:37:18.352574 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:37:18.357326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:37:18.357326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:37:18.357326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987b11a1-de36-4112-b738-e4214b26e2ef is not attached to volume ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7 Oct 11 05:37:18.357326 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:37:18.357326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Returning 404 to user: Instance 987b11a1-de36-4112-b738-e4214b26e2ef is not attached to volume ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7 {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:37:18.357326 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7a4847b2-b0a2-4a3e-9194-a343de8f9187 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments/ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7" status: 404 len: 154 microversion: 2.1 time: 0.090556 Oct 11 05:37:18.357326 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3873/7979] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 05:37:18 2022] DELETE /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef/os-volume_attachments/ba8cf4ff-673f-47a3-b0bd-f969bd5ba8c7 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:37:21.777619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-19e1d5f3-24b4-4cff-b68b-9dc247104085 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:21.778132 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-19e1d5f3-24b4-4cff-b68b-9dc247104085 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:21.785081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e1d5f3-24b4-4cff-b68b-9dc247104085 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:21.785577 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e1d5f3-24b4-4cff-b68b-9dc247104085 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:21.786029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e1d5f3-24b4-4cff-b68b-9dc247104085 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:21.786765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e1d5f3-24b4-4cff-b68b-9dc247104085 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:21.787903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e1d5f3-24b4-4cff-b68b-9dc247104085 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:21.788390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19e1d5f3-24b4-4cff-b68b-9dc247104085 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:21.813644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-19e1d5f3-24b4-4cff-b68b-9dc247104085 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:37:22.125209 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-19e1d5f3-24b4-4cff-b68b-9dc247104085 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 204 len: 0 microversion: 2.1 time: 0.351096 Oct 11 05:37:22.125737 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4107/7980] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:37:21 2022] DELETE /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:37:22.135398 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9ba18616-de90-45e1-b139-254dc5cf6f49 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:22.136762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9ba18616-de90-45e1-b139-254dc5cf6f49 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:22.145749 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ba18616-de90-45e1-b139-254dc5cf6f49 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:22.146311 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ba18616-de90-45e1-b139-254dc5cf6f49 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:22.147269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ba18616-de90-45e1-b139-254dc5cf6f49 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:22.147983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ba18616-de90-45e1-b139-254dc5cf6f49 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:22.148432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ba18616-de90-45e1-b139-254dc5cf6f49 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:22.148854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9ba18616-de90-45e1-b139-254dc5cf6f49 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:22.283691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9ba18616-de90-45e1-b139-254dc5cf6f49 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:22.291573 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9ba18616-de90-45e1-b139-254dc5cf6f49 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1553 microversion: 2.1 time: 0.161290 Oct 11 05:37:22.292151 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3874/7981] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:22 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:23.314990 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ee903efb-579d-4553-9614-d82307a7ed6b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:23.315702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ee903efb-579d-4553-9614-d82307a7ed6b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:23.322989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee903efb-579d-4553-9614-d82307a7ed6b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:23.323483 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee903efb-579d-4553-9614-d82307a7ed6b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:23.323932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee903efb-579d-4553-9614-d82307a7ed6b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:23.324626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee903efb-579d-4553-9614-d82307a7ed6b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:23.325090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee903efb-579d-4553-9614-d82307a7ed6b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:23.325528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ee903efb-579d-4553-9614-d82307a7ed6b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:23.502093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ee903efb-579d-4553-9614-d82307a7ed6b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:23.510412 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ee903efb-579d-4553-9614-d82307a7ed6b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1553 microversion: 2.1 time: 0.199727 Oct 11 05:37:23.511170 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4108/7982] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:23 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:24.449320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-70bf7196-faa2-4bc7-87c3-78fdc973ce5d req-0cd520c1-e3d6-43cd-88fb-b8b710e680d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "987b11a1-de36-4112-b738-e4214b26e2ef", "name": "network-vif-deleted", "tag": "aa5aa4ea-e5d4-4112-98b2-3adfee03dd27"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:37:24.459998 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-70bf7196-faa2-4bc7-87c3-78fdc973ce5d req-0cd520c1-e3d6-43cd-88fb-b8b710e680d0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:24.460473 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-70bf7196-faa2-4bc7-87c3-78fdc973ce5d req-0cd520c1-e3d6-43cd-88fb-b8b710e680d0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:24.460935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-70bf7196-faa2-4bc7-87c3-78fdc973ce5d req-0cd520c1-e3d6-43cd-88fb-b8b710e680d0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:24.472142 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-70bf7196-faa2-4bc7-87c3-78fdc973ce5d req-0cd520c1-e3d6-43cd-88fb-b8b710e680d0 service nova] Creating event network-vif-deleted:aa5aa4ea-e5d4-4112-98b2-3adfee03dd27 for instance 987b11a1-de36-4112-b738-e4214b26e2ef on n-h1-860892-1 Oct 11 05:37:24.477773 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-70bf7196-faa2-4bc7-87c3-78fdc973ce5d req-0cd520c1-e3d6-43cd-88fb-b8b710e680d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032170 Oct 11 05:37:24.478385 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3875/7983] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:37:24.534972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-96553faa-871a-452e-ae04-db61bc70f435 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:24.535609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-96553faa-871a-452e-ae04-db61bc70f435 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:24.544744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96553faa-871a-452e-ae04-db61bc70f435 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:24.545490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96553faa-871a-452e-ae04-db61bc70f435 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:24.545794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96553faa-871a-452e-ae04-db61bc70f435 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:24.546544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96553faa-871a-452e-ae04-db61bc70f435 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:24.547007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96553faa-871a-452e-ae04-db61bc70f435 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:24.547445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-96553faa-871a-452e-ae04-db61bc70f435 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:24.610562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-96553faa-871a-452e-ae04-db61bc70f435 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:24.618528 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-96553faa-871a-452e-ae04-db61bc70f435 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1511 microversion: 2.1 time: 0.087560 Oct 11 05:37:24.620043 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4109/7984] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:24 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1511 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:25.642461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:25.643387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:25.650009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:25.650523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:25.650966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:25.651653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:25.652103 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:25.652527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:25.683827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:25.684299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:25.684731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:25.685174 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lazy-loading 'fault' on Instance uuid 987b11a1-de36-4112-b738-e4214b26e2ef {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:37:25.726058 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:25.734430 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bd6379cc-fdeb-445b-8749-ed833cbc04b2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 200 len: 1348 microversion: 2.1 time: 0.097108 Oct 11 05:37:25.735007 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3876/7985] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:25 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:26.759900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:26.760536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 987b11a1-de36-4112-b738-e4214b26e2ef] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:26.767475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:26.767973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:26.768429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:26.769446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:26.769865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:26.770348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:26.783435 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] HTTP exception thrown: Instance 987b11a1-de36-4112-b738-e4214b26e2ef could not be found. Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Request method failure captured: Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef HTTP/1.1 Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRP_lpD3ZRJOat0JbxEQgBqnvm4rH8pz694sFd69mjllUaudB9W0jtlDlCL-rn5txXTNSL8ckZmBhM0y9wNdubNyvWzHkf38zeIJwwT_VCU_jSsWtl58RJj1KM4S2TP7J6S76ejvWG719gJvD22T4NYvYbl8W9GozIn8NXRUy4Mgzod0 Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9ddab207a4844bb4b2faeba8b6a28f59 Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ddab207a4844bb4b2faeba8b6a28f59"}]}] Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9ddab207a4844bb4b2faeba8b6a28f59 Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestMinimumBasicScenario-198596167-project Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: f6e5d86ca2df425ab50a9059432c0a66 Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestMinimumBasicScenario-198596167-project Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 987b11a1-de36-4112-b738-e4214b26e2ef could not be found. Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '987b11a1-de36-4112-b738-e4214b26e2ef'} Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 987b11a1-de36-4112-b738-e4214b26e2ef could not be found. Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 987b11a1-de36-4112-b738-e4214b26e2ef could not be found. Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:37:26.785088 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:37:26.790557 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:37:26.790557 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:37:26.790557 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:37:26.790557 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:37:26.790557 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:37:26.790557 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 987b11a1-de36-4112-b738-e4214b26e2ef could not be found. Oct 11 05:37:26.790557 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:37:26.790557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Returning 404 to user: Instance 987b11a1-de36-4112-b738-e4214b26e2ef could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:37:26.790557 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-815045e6-b80a-4b6d-855e-7965177dced8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef" status: 404 len: 111 microversion: 2.1 time: 0.031279 Oct 11 05:37:26.790557 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4110/7986] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:26 2022] GET /compute/v2.1/servers/987b11a1-de36-4112-b738-e4214b26e2ef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:37:26.795042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-43ca0303-1716-4529-8cd7-046f076403d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '.version_select at 0x7fda1e144940>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:26.908837 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-43ca0303-1716-4529-8cd7-046f076403d7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-408986761" status: 202 len: 0 microversion: 2.1 time: 0.117529 Oct 11 05:37:26.909431 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3877/7987] 10.222.0.26 () {58 vars in 1269 bytes} [Tue Oct 11 05:37:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-408986761 => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:37:38.314294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af6bdef7-1dc9-4581-9349-16dd88b4a548 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'create', calling method: .version_select at 0x7fda1a20ef70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1788310819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ0ku3rxdMCZ6M4iv0odIY8Aq7AUu4He80TOviK161zi2Bv44fJczKAN0HfrDymEQYGYM210h1tDeGIJEDcWhzk30pqAMx/bwr5W2LVEndigycBA6NjIqKsKBBlD2/EQrQ=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:37:38.320687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:37:38.321353 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:37:38.332602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-af6bdef7-1dc9-4581-9349-16dd88b4a548 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Getting quotas for project 9ddab207a4844bb4b2faeba8b6a28f59. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:37:38.338337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-af6bdef7-1dc9-4581-9349-16dd88b4a548 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Getting quotas for user f6e5d86ca2df425ab50a9059432c0a66 and project 9ddab207a4844bb4b2faeba8b6a28f59. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:37:38.426509 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af6bdef7-1dc9-4581-9349-16dd88b4a548 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.116152 Oct 11 05:37:38.427073 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4111/7988] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:37:38 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:37:38.474033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:37:38.474846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:37:38.482826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1189395755", "imageRef": "2d93faf0-f095-49e3-b169-96d19f654168", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1788310819", "networks": [{"uuid": "06745f13-0436-4cb1-9875-0edd4523b21a"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:37:38.536251 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] validate_networks() for [('06745f13-0436-4cb1-9875-0edd4523b21a', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:37:38.961596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:37:38.962048 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:37:38.962550 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:37:38.962957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:37:38.963363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:37:38.972109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:38.972587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:38.973020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:38.973733 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:38.974180 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:38.974625 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:38.992186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Getting quotas for project 9ddab207a4844bb4b2faeba8b6a28f59. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:37:38.997347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Getting quotas for user f6e5d86ca2df425ab50a9059432c0a66 and project 9ddab207a4844bb4b2faeba8b6a28f59. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:37:39.010010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:37:39.012309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2d93faf0-f095-49e3-b169-96d19f654168',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:37:39.125282 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-98ea3656-2cf8-4d4f-8c63-c82ba446e821 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.653062 Oct 11 05:37:39.126106 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3878/7989] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:37:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:37:39.138375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9edb13b6-d5a6-4ff3-9042-61e130933c1a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:39.139093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9edb13b6-d5a6-4ff3-9042-61e130933c1a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:39.197283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9edb13b6-d5a6-4ff3-9042-61e130933c1a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:39.205254 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9edb13b6-d5a6-4ff3-9042-61e130933c1a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1259 microversion: 2.1 time: 0.071449 Oct 11 05:37:39.205832 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4112/7990] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:39 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1259 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:40.228969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c8ba9d9e-ea16-47b6-b7d0-226cd9975e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:40.229696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c8ba9d9e-ea16-47b6-b7d0-226cd9975e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:40.236025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8ba9d9e-ea16-47b6-b7d0-226cd9975e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:40.239795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8ba9d9e-ea16-47b6-b7d0-226cd9975e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:40.239795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8ba9d9e-ea16-47b6-b7d0-226cd9975e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:40.239795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8ba9d9e-ea16-47b6-b7d0-226cd9975e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:40.239795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8ba9d9e-ea16-47b6-b7d0-226cd9975e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:40.239795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8ba9d9e-ea16-47b6-b7d0-226cd9975e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:40.303921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c8ba9d9e-ea16-47b6-b7d0-226cd9975e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:40.311735 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c8ba9d9e-ea16-47b6-b7d0-226cd9975e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1263 microversion: 2.1 time: 0.087746 Oct 11 05:37:40.312303 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3879/7991] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:40 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1263 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:41.335143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce499e61-1e2d-4911-999b-fe33be72a052 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:41.336273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce499e61-1e2d-4911-999b-fe33be72a052 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:41.343869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce499e61-1e2d-4911-999b-fe33be72a052 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:41.344377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce499e61-1e2d-4911-999b-fe33be72a052 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:41.344837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce499e61-1e2d-4911-999b-fe33be72a052 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:41.345563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce499e61-1e2d-4911-999b-fe33be72a052 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:41.346031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce499e61-1e2d-4911-999b-fe33be72a052 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:41.346537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce499e61-1e2d-4911-999b-fe33be72a052 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:41.420411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce499e61-1e2d-4911-999b-fe33be72a052 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:41.428598 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce499e61-1e2d-4911-999b-fe33be72a052 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1319 microversion: 2.1 time: 0.097333 Oct 11 05:37:41.429220 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4113/7992] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:41 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1319 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:42.456942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-42f1f03c-4387-4dc1-bbdf-8b0a8dd58b86 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:42.458460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-42f1f03c-4387-4dc1-bbdf-8b0a8dd58b86 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:42.477939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f1f03c-4387-4dc1-bbdf-8b0a8dd58b86 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:42.478626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f1f03c-4387-4dc1-bbdf-8b0a8dd58b86 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:42.479081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f1f03c-4387-4dc1-bbdf-8b0a8dd58b86 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:42.479786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f1f03c-4387-4dc1-bbdf-8b0a8dd58b86 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:42.480242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f1f03c-4387-4dc1-bbdf-8b0a8dd58b86 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:42.480705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42f1f03c-4387-4dc1-bbdf-8b0a8dd58b86 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:42.653732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-42f1f03c-4387-4dc1-bbdf-8b0a8dd58b86 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:42.661556 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-42f1f03c-4387-4dc1-bbdf-8b0a8dd58b86 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.212825 Oct 11 05:37:42.662133 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3880/7993] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:42 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:43.685167 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a61c5b3b-c482-4ce4-9d20-e35e215ce359 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:43.685801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a61c5b3b-c482-4ce4-9d20-e35e215ce359 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:43.693169 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a61c5b3b-c482-4ce4-9d20-e35e215ce359 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:43.693679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a61c5b3b-c482-4ce4-9d20-e35e215ce359 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:43.694361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a61c5b3b-c482-4ce4-9d20-e35e215ce359 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:43.695086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a61c5b3b-c482-4ce4-9d20-e35e215ce359 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:43.695558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a61c5b3b-c482-4ce4-9d20-e35e215ce359 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:43.696003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a61c5b3b-c482-4ce4-9d20-e35e215ce359 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:43.839898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a61c5b3b-c482-4ce4-9d20-e35e215ce359 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:43.850852 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a61c5b3b-c482-4ce4-9d20-e35e215ce359 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.169469 Oct 11 05:37:43.852899 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4114/7994] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:43 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:44.875136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4156107a-4325-4abe-8fe4-b353b6577202 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:44.875754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4156107a-4325-4abe-8fe4-b353b6577202 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:44.883004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4156107a-4325-4abe-8fe4-b353b6577202 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:44.883686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4156107a-4325-4abe-8fe4-b353b6577202 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:44.884134 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4156107a-4325-4abe-8fe4-b353b6577202 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:44.884843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4156107a-4325-4abe-8fe4-b353b6577202 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:44.885368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4156107a-4325-4abe-8fe4-b353b6577202 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:44.885800 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4156107a-4325-4abe-8fe4-b353b6577202 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:45.029344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4156107a-4325-4abe-8fe4-b353b6577202 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:45.037774 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4156107a-4325-4abe-8fe4-b353b6577202 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.166614 Oct 11 05:37:45.038452 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3881/7995] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:44 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:46.062926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9631a5aa-398f-4fcd-aba0-6816270b3827 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:46.064760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9631a5aa-398f-4fcd-aba0-6816270b3827 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:46.075599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9631a5aa-398f-4fcd-aba0-6816270b3827 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:46.076723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9631a5aa-398f-4fcd-aba0-6816270b3827 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:46.077249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9631a5aa-398f-4fcd-aba0-6816270b3827 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:46.078178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9631a5aa-398f-4fcd-aba0-6816270b3827 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:46.078779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9631a5aa-398f-4fcd-aba0-6816270b3827 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:46.079222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9631a5aa-398f-4fcd-aba0-6816270b3827 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:46.229888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9631a5aa-398f-4fcd-aba0-6816270b3827 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:46.241629 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9631a5aa-398f-4fcd-aba0-6816270b3827 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.183455 Oct 11 05:37:46.256808 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4115/7996] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:46 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:47.269989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c8931d02-b4d5-4abc-8a7b-bf222da6e9dd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:47.271388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c8931d02-b4d5-4abc-8a7b-bf222da6e9dd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:47.284678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8931d02-b4d5-4abc-8a7b-bf222da6e9dd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:47.288921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8931d02-b4d5-4abc-8a7b-bf222da6e9dd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:47.289897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8931d02-b4d5-4abc-8a7b-bf222da6e9dd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:47.290970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8931d02-b4d5-4abc-8a7b-bf222da6e9dd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:47.291682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8931d02-b4d5-4abc-8a7b-bf222da6e9dd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:47.300067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c8931d02-b4d5-4abc-8a7b-bf222da6e9dd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:47.467439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c8931d02-b4d5-4abc-8a7b-bf222da6e9dd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:47.479755 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c8931d02-b4d5-4abc-8a7b-bf222da6e9dd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.214271 Oct 11 05:37:47.497035 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3882/7997] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:47 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:48.503163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-702facd7-5e7c-4955-9afa-f17d9109edbf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:48.504209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-702facd7-5e7c-4955-9afa-f17d9109edbf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:48.512212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-702facd7-5e7c-4955-9afa-f17d9109edbf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:48.512801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-702facd7-5e7c-4955-9afa-f17d9109edbf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:48.513320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-702facd7-5e7c-4955-9afa-f17d9109edbf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:48.514428 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-702facd7-5e7c-4955-9afa-f17d9109edbf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:48.514965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-702facd7-5e7c-4955-9afa-f17d9109edbf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:48.515492 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-702facd7-5e7c-4955-9afa-f17d9109edbf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:48.658309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-702facd7-5e7c-4955-9afa-f17d9109edbf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:48.667196 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-702facd7-5e7c-4955-9afa-f17d9109edbf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.167976 Oct 11 05:37:48.668149 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4116/7998] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:48 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:49.692541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-93021116-69cb-4c7d-8ab1-367558cc9e43 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:49.693148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-93021116-69cb-4c7d-8ab1-367558cc9e43 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:49.696478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:37:49.697154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:37:49.702366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93021116-69cb-4c7d-8ab1-367558cc9e43 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:49.717076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93021116-69cb-4c7d-8ab1-367558cc9e43 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:49.717076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93021116-69cb-4c7d-8ab1-367558cc9e43 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:49.717076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93021116-69cb-4c7d-8ab1-367558cc9e43 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:49.717076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93021116-69cb-4c7d-8ab1-367558cc9e43 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:49.717076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93021116-69cb-4c7d-8ab1-367558cc9e43 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:49.844219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-93021116-69cb-4c7d-8ab1-367558cc9e43 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:49.852955 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-93021116-69cb-4c7d-8ab1-367558cc9e43 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.165036 Oct 11 05:37:49.853734 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3883/7999] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:49 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:50.876222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6afded2f-673c-4fcd-8dd7-23fee1445ccb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:50.876847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6afded2f-673c-4fcd-8dd7-23fee1445ccb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:50.878736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:37:50.884896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6afded2f-673c-4fcd-8dd7-23fee1445ccb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:50.895771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6afded2f-673c-4fcd-8dd7-23fee1445ccb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:50.895771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6afded2f-673c-4fcd-8dd7-23fee1445ccb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:50.895771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6afded2f-673c-4fcd-8dd7-23fee1445ccb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:50.895771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6afded2f-673c-4fcd-8dd7-23fee1445ccb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:50.895771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6afded2f-673c-4fcd-8dd7-23fee1445ccb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:51.020281 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6afded2f-673c-4fcd-8dd7-23fee1445ccb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:51.028083 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6afded2f-673c-4fcd-8dd7-23fee1445ccb tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.155861 Oct 11 05:37:51.028649 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4117/8000] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:50 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:52.050562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5386dec0-cead-4933-8236-0944904ab7a3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:52.051430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5386dec0-cead-4933-8236-0944904ab7a3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:52.059034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386dec0-cead-4933-8236-0944904ab7a3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:52.059873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386dec0-cead-4933-8236-0944904ab7a3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:52.060426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386dec0-cead-4933-8236-0944904ab7a3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:52.061184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386dec0-cead-4933-8236-0944904ab7a3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:52.061648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386dec0-cead-4933-8236-0944904ab7a3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:52.062083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5386dec0-cead-4933-8236-0944904ab7a3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:52.200404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5386dec0-cead-4933-8236-0944904ab7a3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:52.208311 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5386dec0-cead-4933-8236-0944904ab7a3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.161877 Oct 11 05:37:52.208904 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3884/8001] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:52 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:52.791098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-dd94e90c-bec5-463c-a1d4-034bf9aabd3b req-6e3abcd0-00b4-4ed5-bdca-bf4a8c1eac99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0018af-e565-4191-ab7d-75d29ca21404", "tag": "88609b12-1d4c-44ef-9b15-d1925da0ea58"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:37:52.801687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-dd94e90c-bec5-463c-a1d4-034bf9aabd3b req-6e3abcd0-00b4-4ed5-bdca-bf4a8c1eac99 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:52.805583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-dd94e90c-bec5-463c-a1d4-034bf9aabd3b req-6e3abcd0-00b4-4ed5-bdca-bf4a8c1eac99 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:52.805583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-dd94e90c-bec5-463c-a1d4-034bf9aabd3b req-6e3abcd0-00b4-4ed5-bdca-bf4a8c1eac99 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:52.814239 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-dd94e90c-bec5-463c-a1d4-034bf9aabd3b req-6e3abcd0-00b4-4ed5-bdca-bf4a8c1eac99 service nova] Creating event network-changed:88609b12-1d4c-44ef-9b15-d1925da0ea58 for instance 2a0018af-e565-4191-ab7d-75d29ca21404 on n-h1-860892-1 Oct 11 05:37:52.819333 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-dd94e90c-bec5-463c-a1d4-034bf9aabd3b req-6e3abcd0-00b4-4ed5-bdca-bf4a8c1eac99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032573 Oct 11 05:37:52.819940 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4118/8002] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:37:53.232142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-599f3c70-edbe-40ad-96f0-d61ddf781ded tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:53.232754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-599f3c70-edbe-40ad-96f0-d61ddf781ded tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:53.239693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-599f3c70-edbe-40ad-96f0-d61ddf781ded tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:53.240171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-599f3c70-edbe-40ad-96f0-d61ddf781ded tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:53.240605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-599f3c70-edbe-40ad-96f0-d61ddf781ded tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:53.241289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-599f3c70-edbe-40ad-96f0-d61ddf781ded tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:53.241734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-599f3c70-edbe-40ad-96f0-d61ddf781ded tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:53.242704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-599f3c70-edbe-40ad-96f0-d61ddf781ded tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:53.373294 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-599f3c70-edbe-40ad-96f0-d61ddf781ded tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:53.381074 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-599f3c70-edbe-40ad-96f0-d61ddf781ded tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.152959 Oct 11 05:37:53.381652 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3885/8003] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:53 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:54.406852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aba9e49b-ef0d-4bba-a6f4-d350ed7507b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:54.407568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aba9e49b-ef0d-4bba-a6f4-d350ed7507b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:54.413705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba9e49b-ef0d-4bba-a6f4-d350ed7507b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:54.414236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba9e49b-ef0d-4bba-a6f4-d350ed7507b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:54.414761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba9e49b-ef0d-4bba-a6f4-d350ed7507b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:54.415466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba9e49b-ef0d-4bba-a6f4-d350ed7507b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:54.415937 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba9e49b-ef0d-4bba-a6f4-d350ed7507b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:54.416411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aba9e49b-ef0d-4bba-a6f4-d350ed7507b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:54.832796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aba9e49b-ef0d-4bba-a6f4-d350ed7507b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:54.840949 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aba9e49b-ef0d-4bba-a6f4-d350ed7507b9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.439265 Oct 11 05:37:54.841532 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4119/8004] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:54 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:55.864266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8e90ab25-f801-4d29-a034-a7d28b853533 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:55.864883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8e90ab25-f801-4d29-a034-a7d28b853533 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:55.872371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e90ab25-f801-4d29-a034-a7d28b853533 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:55.872851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e90ab25-f801-4d29-a034-a7d28b853533 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:55.873288 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e90ab25-f801-4d29-a034-a7d28b853533 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:55.873976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e90ab25-f801-4d29-a034-a7d28b853533 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:55.874460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e90ab25-f801-4d29-a034-a7d28b853533 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:55.874890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8e90ab25-f801-4d29-a034-a7d28b853533 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:56.002710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8e90ab25-f801-4d29-a034-a7d28b853533 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:56.010518 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8e90ab25-f801-4d29-a034-a7d28b853533 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.150145 Oct 11 05:37:56.011097 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3886/8005] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:55 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:57.033272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-41c52809-572a-4195-83c7-dfada72eaa03 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:57.033902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-41c52809-572a-4195-83c7-dfada72eaa03 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:57.040742 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41c52809-572a-4195-83c7-dfada72eaa03 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:57.041237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41c52809-572a-4195-83c7-dfada72eaa03 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:57.041687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41c52809-572a-4195-83c7-dfada72eaa03 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:57.042415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41c52809-572a-4195-83c7-dfada72eaa03 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:57.042885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41c52809-572a-4195-83c7-dfada72eaa03 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:57.043327 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-41c52809-572a-4195-83c7-dfada72eaa03 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:57.170608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-41c52809-572a-4195-83c7-dfada72eaa03 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:57.178308 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-41c52809-572a-4195-83c7-dfada72eaa03 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.148948 Oct 11 05:37:57.178876 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4120/8006] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:57 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:58.201494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-42248bd9-5caa-48a4-99e9-a6cee86a8aff tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:58.204194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-42248bd9-5caa-48a4-99e9-a6cee86a8aff tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:58.209067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42248bd9-5caa-48a4-99e9-a6cee86a8aff tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:58.209548 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42248bd9-5caa-48a4-99e9-a6cee86a8aff tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:58.209989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42248bd9-5caa-48a4-99e9-a6cee86a8aff tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:58.211378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42248bd9-5caa-48a4-99e9-a6cee86a8aff tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:58.211843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42248bd9-5caa-48a4-99e9-a6cee86a8aff tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:58.212269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-42248bd9-5caa-48a4-99e9-a6cee86a8aff tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:58.303152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-d016ed6b-7cd2-4ffd-bc6d-e958eb7b67fc req-aa7ea4b5-cb40-40c3-8397-63e1fc840d34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0018af-e565-4191-ab7d-75d29ca21404", "name": "network-vif-plugged", "status": "completed", "tag": "88609b12-1d4c-44ef-9b15-d1925da0ea58"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:37:58.314001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d016ed6b-7cd2-4ffd-bc6d-e958eb7b67fc req-aa7ea4b5-cb40-40c3-8397-63e1fc840d34 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:58.318736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d016ed6b-7cd2-4ffd-bc6d-e958eb7b67fc req-aa7ea4b5-cb40-40c3-8397-63e1fc840d34 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:58.318736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-d016ed6b-7cd2-4ffd-bc6d-e958eb7b67fc req-aa7ea4b5-cb40-40c3-8397-63e1fc840d34 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:58.326765 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-d016ed6b-7cd2-4ffd-bc6d-e958eb7b67fc req-aa7ea4b5-cb40-40c3-8397-63e1fc840d34 service nova] Creating event network-vif-plugged:88609b12-1d4c-44ef-9b15-d1925da0ea58 for instance 2a0018af-e565-4191-ab7d-75d29ca21404 on n-h1-860892-1 Oct 11 05:37:58.332015 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-d016ed6b-7cd2-4ffd-bc6d-e958eb7b67fc req-aa7ea4b5-cb40-40c3-8397-63e1fc840d34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032638 Oct 11 05:37:58.332702 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4121/8007] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:37:58.351444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-42248bd9-5caa-48a4-99e9-a6cee86a8aff tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:58.359657 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-42248bd9-5caa-48a4-99e9-a6cee86a8aff tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.162041 Oct 11 05:37:58.365884 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3887/8008] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:58 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:37:59.384319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f7a924e4-6a85-4009-bbaa-ef22d355c71e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:37:59.385063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f7a924e4-6a85-4009-bbaa-ef22d355c71e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:37:59.391282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7a924e4-6a85-4009-bbaa-ef22d355c71e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:59.391779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7a924e4-6a85-4009-bbaa-ef22d355c71e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:59.392232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7a924e4-6a85-4009-bbaa-ef22d355c71e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:59.392929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7a924e4-6a85-4009-bbaa-ef22d355c71e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:37:59.393395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7a924e4-6a85-4009-bbaa-ef22d355c71e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:37:59.393835 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7a924e4-6a85-4009-bbaa-ef22d355c71e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:37:59.520882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f7a924e4-6a85-4009-bbaa-ef22d355c71e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:37:59.529115 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f7a924e4-6a85-4009-bbaa-ef22d355c71e tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1359 microversion: 2.1 time: 0.149997 Oct 11 05:37:59.529704 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4122/8009] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:37:59 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:38:00.552892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6519bfbd-c7bd-471c-bf51-9fe8690605af tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:38:00.553514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6519bfbd-c7bd-471c-bf51-9fe8690605af tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:38:00.561216 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6519bfbd-c7bd-471c-bf51-9fe8690605af tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:00.561696 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6519bfbd-c7bd-471c-bf51-9fe8690605af tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:00.562136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6519bfbd-c7bd-471c-bf51-9fe8690605af tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:00.562848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6519bfbd-c7bd-471c-bf51-9fe8690605af tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:00.563304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6519bfbd-c7bd-471c-bf51-9fe8690605af tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:00.563732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6519bfbd-c7bd-471c-bf51-9fe8690605af tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:00.691148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6519bfbd-c7bd-471c-bf51-9fe8690605af tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:38:00.698932 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6519bfbd-c7bd-471c-bf51-9fe8690605af tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1548 microversion: 2.1 time: 0.149960 Oct 11 05:38:00.699506 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3888/8010] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:38:00 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1548 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:38:00.720935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-746ed0bc-7921-4505-a339-a120a5dc13f5 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:38:00.721573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-746ed0bc-7921-4505-a339-a120a5dc13f5 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:38:00.728953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746ed0bc-7921-4505-a339-a120a5dc13f5 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:00.729466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746ed0bc-7921-4505-a339-a120a5dc13f5 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:00.729910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746ed0bc-7921-4505-a339-a120a5dc13f5 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:00.730667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746ed0bc-7921-4505-a339-a120a5dc13f5 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:00.731172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746ed0bc-7921-4505-a339-a120a5dc13f5 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:00.731657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-746ed0bc-7921-4505-a339-a120a5dc13f5 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:00.858419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-746ed0bc-7921-4505-a339-a120a5dc13f5 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:38:00.866146 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-746ed0bc-7921-4505-a339-a120a5dc13f5 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1548 microversion: 2.1 time: 0.149165 Oct 11 05:38:00.866739 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4123/8011] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:38:00 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1548 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:38:00.887839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d4637221-151c-499e-94e0-94a138da2bc4 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:38:00.893066 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d4637221-151c-499e-94e0-94a138da2bc4 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:38:00.893825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d4637221-151c-499e-94e0-94a138da2bc4 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Searching by: {'deleted': False, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59'} {{(pid=120993) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 11 05:38:00.899750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4637221-151c-499e-94e0-94a138da2bc4 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:00.900220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4637221-151c-499e-94e0-94a138da2bc4 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:00.900651 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4637221-151c-499e-94e0-94a138da2bc4 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:00.901361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4637221-151c-499e-94e0-94a138da2bc4 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:00.901808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4637221-151c-499e-94e0-94a138da2bc4 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:00.902252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4637221-151c-499e-94e0-94a138da2bc4 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:00.926007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.multi_cell_list [None req-d4637221-151c-499e-94e0-94a138da2bc4 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120993) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 11 05:38:00.952168 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d4637221-151c-499e-94e0-94a138da2bc4 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.068194 Oct 11 05:38:00.952742 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3889/8012] 10.222.0.26 () {58 vars in 1125 bytes} [Tue Oct 11 05:38:00 2022] GET /compute/v2.1/servers => generated 343 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:38:00.964983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a6d0e83a-5863-47ce-8fb6-ba6ba7ee0965 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:38:00.965610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a6d0e83a-5863-47ce-8fb6-ba6ba7ee0965 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:38:00.971807 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d0e83a-5863-47ce-8fb6-ba6ba7ee0965 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:00.972307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d0e83a-5863-47ce-8fb6-ba6ba7ee0965 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:00.972760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d0e83a-5863-47ce-8fb6-ba6ba7ee0965 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:00.973458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d0e83a-5863-47ce-8fb6-ba6ba7ee0965 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:00.973924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d0e83a-5863-47ce-8fb6-ba6ba7ee0965 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:00.974414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6d0e83a-5863-47ce-8fb6-ba6ba7ee0965 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:01.103843 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a6d0e83a-5863-47ce-8fb6-ba6ba7ee0965 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:38:01.111604 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a6d0e83a-5863-47ce-8fb6-ba6ba7ee0965 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1548 microversion: 2.1 time: 0.151110 Oct 11 05:38:01.112174 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4124/8013] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:38:00 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:38:03.978576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a2a39829-8625-4333-a1bf-7873edfe4da9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34a392eb-9ed0-4c3f-b733-970781135592"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:38:03.981029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a2a39829-8625-4333-a1bf-7873edfe4da9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:38:03.987963 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a39829-8625-4333-a1bf-7873edfe4da9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:03.988459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a39829-8625-4333-a1bf-7873edfe4da9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:03.988909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a39829-8625-4333-a1bf-7873edfe4da9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:03.989601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a39829-8625-4333-a1bf-7873edfe4da9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:03.990060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a39829-8625-4333-a1bf-7873edfe4da9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:03.990522 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2a39829-8625-4333-a1bf-7873edfe4da9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:04.728980 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a2a39829-8625-4333-a1bf-7873edfe4da9 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.754622 Oct 11 05:38:04.729591 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3890/8014] 10.222.0.26 () {60 vars in 1323 bytes} [Tue Oct 11 05:38:03 2022] POST /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments => generated 194 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:38:16.545478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-52b2d799-cd7d-4585-8414-1517eb2406cd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:38:16.546112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-52b2d799-cd7d-4585-8414-1517eb2406cd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:38:16.548287 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:38:16.549046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=64 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:38:16.553560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b2d799-cd7d-4585-8414-1517eb2406cd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:16.554605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b2d799-cd7d-4585-8414-1517eb2406cd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:16.555060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b2d799-cd7d-4585-8414-1517eb2406cd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:16.555759 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b2d799-cd7d-4585-8414-1517eb2406cd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:16.556228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b2d799-cd7d-4585-8414-1517eb2406cd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:16.556669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-52b2d799-cd7d-4585-8414-1517eb2406cd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:16.684663 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-52b2d799-cd7d-4585-8414-1517eb2406cd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:38:16.693228 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-52b2d799-cd7d-4585-8414-1517eb2406cd tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1594 microversion: 2.1 time: 0.151873 Oct 11 05:38:16.693805 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4125/8015] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:38:16 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1594 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:38:18.913101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-97066b09-023e-46e3-b9c1-fe179f1c2297 req-e80f0423-f24d-4bab-97d6-2c856e54c4dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0018af-e565-4191-ab7d-75d29ca21404", "tag": "88609b12-1d4c-44ef-9b15-d1925da0ea58"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:38:18.923359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:38:18.924116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:38:18.924787 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:38:18.926677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-97066b09-023e-46e3-b9c1-fe179f1c2297 req-e80f0423-f24d-4bab-97d6-2c856e54c4dc service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:18.927173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-97066b09-023e-46e3-b9c1-fe179f1c2297 req-e80f0423-f24d-4bab-97d6-2c856e54c4dc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:18.927591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-97066b09-023e-46e3-b9c1-fe179f1c2297 req-e80f0423-f24d-4bab-97d6-2c856e54c4dc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:18.939052 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-97066b09-023e-46e3-b9c1-fe179f1c2297 req-e80f0423-f24d-4bab-97d6-2c856e54c4dc service nova] Creating event network-changed:88609b12-1d4c-44ef-9b15-d1925da0ea58 for instance 2a0018af-e565-4191-ab7d-75d29ca21404 on n-h1-860892-1 Oct 11 05:38:18.944064 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-97066b09-023e-46e3-b9c1-fe179f1c2297 req-e80f0423-f24d-4bab-97d6-2c856e54c4dc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035023 Oct 11 05:38:18.944909 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3891/8016] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:38:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:38:21.354598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dde09f6f-df36-4726-a87b-696b53952905 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1724932449"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:38:21.355161 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dde09f6f-df36-4726-a87b-696b53952905 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:38:21.363243 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dde09f6f-df36-4726-a87b-696b53952905 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:21.363743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dde09f6f-df36-4726-a87b-696b53952905 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:21.364197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dde09f6f-df36-4726-a87b-696b53952905 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:21.364899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dde09f6f-df36-4726-a87b-696b53952905 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:21.365456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dde09f6f-df36-4726-a87b-696b53952905 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:21.365873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dde09f6f-df36-4726-a87b-696b53952905 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:21.496060 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.network.security_group_api [None req-dde09f6f-df36-4726-a87b-696b53952905 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Adding security group 699f6a63-a331-4865-9efb-e812ed44c64a to port 88609b12-1d4c-44ef-9b15-d1925da0ea58 Oct 11 05:38:21.862651 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dde09f6f-df36-4726-a87b-696b53952905 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/action" status: 202 len: 0 microversion: 2.1 time: 0.512079 Oct 11 05:38:21.863708 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4126/8017] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:38:21 2022] POST /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:38:21.873940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-624fc6cf-e07b-4c48-8a57-a69855a09c6d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:38:21.879468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-120075cf-4002-403e-81b5-f8b14652f87e req-332eab7f-c70b-4f59-b8a4-5cee480ff65b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0018af-e565-4191-ab7d-75d29ca21404", "tag": "88609b12-1d4c-44ef-9b15-d1925da0ea58"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:38:21.884663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-624fc6cf-e07b-4c48-8a57-a69855a09c6d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:38:21.898973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-120075cf-4002-403e-81b5-f8b14652f87e req-332eab7f-c70b-4f59-b8a4-5cee480ff65b service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:21.899477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-120075cf-4002-403e-81b5-f8b14652f87e req-332eab7f-c70b-4f59-b8a4-5cee480ff65b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:21.899926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-120075cf-4002-403e-81b5-f8b14652f87e req-332eab7f-c70b-4f59-b8a4-5cee480ff65b service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:21.903547 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-624fc6cf-e07b-4c48-8a57-a69855a09c6d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:21.904051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-624fc6cf-e07b-4c48-8a57-a69855a09c6d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:21.904593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-624fc6cf-e07b-4c48-8a57-a69855a09c6d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:21.905804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-624fc6cf-e07b-4c48-8a57-a69855a09c6d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:38:21.907372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-624fc6cf-e07b-4c48-8a57-a69855a09c6d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:38:21.908078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-624fc6cf-e07b-4c48-8a57-a69855a09c6d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:38:21.918898 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-120075cf-4002-403e-81b5-f8b14652f87e req-332eab7f-c70b-4f59-b8a4-5cee480ff65b service nova] Creating event network-changed:88609b12-1d4c-44ef-9b15-d1925da0ea58 for instance 2a0018af-e565-4191-ab7d-75d29ca21404 on n-h1-860892-1 Oct 11 05:38:21.926279 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-120075cf-4002-403e-81b5-f8b14652f87e req-332eab7f-c70b-4f59-b8a4-5cee480ff65b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049672 Oct 11 05:38:21.926657 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4127/8018] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:38:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:38:22.078804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-624fc6cf-e07b-4c48-8a57-a69855a09c6d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:38:22.089847 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-624fc6cf-e07b-4c48-8a57-a69855a09c6d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1759 microversion: 2.1 time: 0.221369 Oct 11 05:38:22.102625 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3892/8019] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:38:21 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1759 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:39:06.950050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:39:06.950898 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=12 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:39:06.955832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-595b015a-bc81-4388-abb2-39f93184f64f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:39:06.958154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-595b015a-bc81-4388-abb2-39f93184f64f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:06.967340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-595b015a-bc81-4388-abb2-39f93184f64f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:06.968790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-595b015a-bc81-4388-abb2-39f93184f64f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:06.968790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-595b015a-bc81-4388-abb2-39f93184f64f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:06.968993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-595b015a-bc81-4388-abb2-39f93184f64f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:06.969469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-595b015a-bc81-4388-abb2-39f93184f64f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:06.969915 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-595b015a-bc81-4388-abb2-39f93184f64f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:07.155116 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-595b015a-bc81-4388-abb2-39f93184f64f tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/action" status: 202 len: 0 microversion: 2.1 time: 0.206842 Oct 11 05:39:07.155798 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4128/8020] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:39:06 2022] POST /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/action => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:39:07.165905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ce543c9e-53dc-46cc-94b6-8dd4b9dd73fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:39:07.166464 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ce543c9e-53dc-46cc-94b6-8dd4b9dd73fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:07.168375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:39:07.169178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:39:07.174818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce543c9e-53dc-46cc-94b6-8dd4b9dd73fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:07.175297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce543c9e-53dc-46cc-94b6-8dd4b9dd73fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:07.175737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce543c9e-53dc-46cc-94b6-8dd4b9dd73fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:07.176430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce543c9e-53dc-46cc-94b6-8dd4b9dd73fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:07.176874 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce543c9e-53dc-46cc-94b6-8dd4b9dd73fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:07.177402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ce543c9e-53dc-46cc-94b6-8dd4b9dd73fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:07.324306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ce543c9e-53dc-46cc-94b6-8dd4b9dd73fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:39:07.333129 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ce543c9e-53dc-46cc-94b6-8dd4b9dd73fc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1751 microversion: 2.1 time: 0.172466 Oct 11 05:39:07.333938 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3893/8021] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:39:07 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:39:08.358203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-becd8c4a-2af8-4c4d-b900-cd9ec8108b8b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:39:08.358927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-becd8c4a-2af8-4c4d-b900-cd9ec8108b8b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:08.365145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-becd8c4a-2af8-4c4d-b900-cd9ec8108b8b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:08.365648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-becd8c4a-2af8-4c4d-b900-cd9ec8108b8b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:08.366106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-becd8c4a-2af8-4c4d-b900-cd9ec8108b8b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:08.366847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-becd8c4a-2af8-4c4d-b900-cd9ec8108b8b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:08.367321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-becd8c4a-2af8-4c4d-b900-cd9ec8108b8b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:08.367767 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-becd8c4a-2af8-4c4d-b900-cd9ec8108b8b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:08.509644 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-becd8c4a-2af8-4c4d-b900-cd9ec8108b8b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:39:08.518165 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-becd8c4a-2af8-4c4d-b900-cd9ec8108b8b tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1756 microversion: 2.1 time: 0.165184 Oct 11 05:39:08.518967 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4129/8022] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:39:08 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:39:09.544556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d23c3ac1-41a7-4dac-99d4-48fc0c5daff7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:39:09.545170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d23c3ac1-41a7-4dac-99d4-48fc0c5daff7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:09.551114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23c3ac1-41a7-4dac-99d4-48fc0c5daff7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:09.551592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23c3ac1-41a7-4dac-99d4-48fc0c5daff7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:09.552025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23c3ac1-41a7-4dac-99d4-48fc0c5daff7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:09.552701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23c3ac1-41a7-4dac-99d4-48fc0c5daff7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:09.553146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23c3ac1-41a7-4dac-99d4-48fc0c5daff7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:09.553569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d23c3ac1-41a7-4dac-99d4-48fc0c5daff7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:09.692585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d23c3ac1-41a7-4dac-99d4-48fc0c5daff7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:39:09.700827 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d23c3ac1-41a7-4dac-99d4-48fc0c5daff7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1756 microversion: 2.1 time: 0.161121 Oct 11 05:39:09.701393 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3894/8023] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:39:09 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:39:10.724458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-78c99ee3-7856-43ea-b5ae-2647f3302f47 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:39:10.725085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-78c99ee3-7856-43ea-b5ae-2647f3302f47 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:10.731964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78c99ee3-7856-43ea-b5ae-2647f3302f47 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:10.732454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78c99ee3-7856-43ea-b5ae-2647f3302f47 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:10.732903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78c99ee3-7856-43ea-b5ae-2647f3302f47 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:10.733627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78c99ee3-7856-43ea-b5ae-2647f3302f47 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:10.734086 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78c99ee3-7856-43ea-b5ae-2647f3302f47 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:10.734548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78c99ee3-7856-43ea-b5ae-2647f3302f47 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:10.877297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-78c99ee3-7856-43ea-b5ae-2647f3302f47 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:39:10.885988 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-78c99ee3-7856-43ea-b5ae-2647f3302f47 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1756 microversion: 2.1 time: 0.165612 Oct 11 05:39:10.886586 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4130/8024] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:39:10 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:39:11.910363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fdba683e-9057-402d-bfa8-c99a9e4d1e4d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:39:11.911008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fdba683e-9057-402d-bfa8-c99a9e4d1e4d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:11.917940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdba683e-9057-402d-bfa8-c99a9e4d1e4d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:11.918467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdba683e-9057-402d-bfa8-c99a9e4d1e4d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:11.918914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdba683e-9057-402d-bfa8-c99a9e4d1e4d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:11.919609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdba683e-9057-402d-bfa8-c99a9e4d1e4d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:11.920065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdba683e-9057-402d-bfa8-c99a9e4d1e4d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:11.920518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fdba683e-9057-402d-bfa8-c99a9e4d1e4d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:12.065569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fdba683e-9057-402d-bfa8-c99a9e4d1e4d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:39:12.074663 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fdba683e-9057-402d-bfa8-c99a9e4d1e4d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1756 microversion: 2.1 time: 0.168236 Oct 11 05:39:12.075247 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3895/8025] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:39:11 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:39:13.098252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0e0cd2d3-aafb-44c4-a46c-bc6754ddbd08 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:39:13.098889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0e0cd2d3-aafb-44c4-a46c-bc6754ddbd08 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:13.106166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e0cd2d3-aafb-44c4-a46c-bc6754ddbd08 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:13.106698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e0cd2d3-aafb-44c4-a46c-bc6754ddbd08 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:13.107175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e0cd2d3-aafb-44c4-a46c-bc6754ddbd08 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:13.107867 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e0cd2d3-aafb-44c4-a46c-bc6754ddbd08 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:13.108335 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e0cd2d3-aafb-44c4-a46c-bc6754ddbd08 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:13.108779 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0e0cd2d3-aafb-44c4-a46c-bc6754ddbd08 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:13.251028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0e0cd2d3-aafb-44c4-a46c-bc6754ddbd08 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:39:13.259373 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0e0cd2d3-aafb-44c4-a46c-bc6754ddbd08 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1756 microversion: 2.1 time: 0.165169 Oct 11 05:39:13.259945 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4131/8026] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:39:13 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:39:14.283373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-93607ca4-adb0-424f-8fa6-f0502d566230 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:39:14.283985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-93607ca4-adb0-424f-8fa6-f0502d566230 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:14.291416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93607ca4-adb0-424f-8fa6-f0502d566230 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:14.291897 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93607ca4-adb0-424f-8fa6-f0502d566230 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:14.292329 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93607ca4-adb0-424f-8fa6-f0502d566230 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:14.293014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93607ca4-adb0-424f-8fa6-f0502d566230 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:14.293459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93607ca4-adb0-424f-8fa6-f0502d566230 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:14.293878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93607ca4-adb0-424f-8fa6-f0502d566230 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:14.434499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-93607ca4-adb0-424f-8fa6-f0502d566230 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:39:14.442699 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-93607ca4-adb0-424f-8fa6-f0502d566230 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1756 microversion: 2.1 time: 0.163316 Oct 11 05:39:14.443277 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3896/8027] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:39:14 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:39:15.466902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-45c2dea5-703c-44fb-9b1f-dd7da10c4797 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:39:15.467565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-45c2dea5-703c-44fb-9b1f-dd7da10c4797 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:15.474351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c2dea5-703c-44fb-9b1f-dd7da10c4797 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:15.474852 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c2dea5-703c-44fb-9b1f-dd7da10c4797 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:15.475317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c2dea5-703c-44fb-9b1f-dd7da10c4797 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:15.476020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c2dea5-703c-44fb-9b1f-dd7da10c4797 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:15.476488 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c2dea5-703c-44fb-9b1f-dd7da10c4797 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:15.476932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-45c2dea5-703c-44fb-9b1f-dd7da10c4797 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:15.617384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-45c2dea5-703c-44fb-9b1f-dd7da10c4797 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:39:15.625682 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-45c2dea5-703c-44fb-9b1f-dd7da10c4797 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1756 microversion: 2.1 time: 0.162714 Oct 11 05:39:15.626286 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4132/8028] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:39:15 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:39:16.648965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5d77cebe-771e-4c5d-b4d7-6175759aab40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:39:16.650115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5d77cebe-771e-4c5d-b4d7-6175759aab40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:16.656901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d77cebe-771e-4c5d-b4d7-6175759aab40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:16.657378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d77cebe-771e-4c5d-b4d7-6175759aab40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:16.657813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d77cebe-771e-4c5d-b4d7-6175759aab40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:16.658525 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d77cebe-771e-4c5d-b4d7-6175759aab40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:16.658976 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d77cebe-771e-4c5d-b4d7-6175759aab40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:16.659397 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5d77cebe-771e-4c5d-b4d7-6175759aab40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:16.807133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5d77cebe-771e-4c5d-b4d7-6175759aab40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:39:16.815744 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5d77cebe-771e-4c5d-b4d7-6175759aab40 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1756 microversion: 2.1 time: 0.170938 Oct 11 05:39:16.816318 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3897/8029] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:39:16 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:39:17.840537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-10bf81cc-bd64-492e-9aaf-13c95973a9dc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:39:17.841163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-10bf81cc-bd64-492e-9aaf-13c95973a9dc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:17.848097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10bf81cc-bd64-492e-9aaf-13c95973a9dc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:17.848588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10bf81cc-bd64-492e-9aaf-13c95973a9dc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:17.849032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10bf81cc-bd64-492e-9aaf-13c95973a9dc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:17.849728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10bf81cc-bd64-492e-9aaf-13c95973a9dc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:17.850215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10bf81cc-bd64-492e-9aaf-13c95973a9dc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:17.850643 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-10bf81cc-bd64-492e-9aaf-13c95973a9dc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:17.998667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-10bf81cc-bd64-492e-9aaf-13c95973a9dc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:39:18.007047 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-10bf81cc-bd64-492e-9aaf-13c95973a9dc tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1756 microversion: 2.1 time: 0.171069 Oct 11 05:39:18.012388 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4133/8030] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:39:17 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:39:19.031567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e5ce1b34-9a80-44a3-b2c7-bdf69b76e265 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:39:19.032261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e5ce1b34-9a80-44a3-b2c7-bdf69b76e265 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:39:19.039390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5ce1b34-9a80-44a3-b2c7-bdf69b76e265 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:19.040448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5ce1b34-9a80-44a3-b2c7-bdf69b76e265 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:19.040887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5ce1b34-9a80-44a3-b2c7-bdf69b76e265 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:19.041567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5ce1b34-9a80-44a3-b2c7-bdf69b76e265 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:39:19.042016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5ce1b34-9a80-44a3-b2c7-bdf69b76e265 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:39:19.042467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e5ce1b34-9a80-44a3-b2c7-bdf69b76e265 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:39:19.183222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e5ce1b34-9a80-44a3-b2c7-bdf69b76e265 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:39:19.191528 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e5ce1b34-9a80-44a3-b2c7-bdf69b76e265 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1759 microversion: 2.1 time: 0.164073 Oct 11 05:39:19.192092 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3898/8031] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:39:19 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1759 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:07.015378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ef402c16-494d-4cca-95d2-7c28e527c9a8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1724932449"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:40:07.015997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ef402c16-494d-4cca-95d2-7c28e527c9a8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:07.018375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=12 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:07.019060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:07.023984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef402c16-494d-4cca-95d2-7c28e527c9a8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:07.024482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef402c16-494d-4cca-95d2-7c28e527c9a8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:07.024944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef402c16-494d-4cca-95d2-7c28e527c9a8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:07.025642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef402c16-494d-4cca-95d2-7c28e527c9a8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:07.026113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef402c16-494d-4cca-95d2-7c28e527c9a8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:07.026587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ef402c16-494d-4cca-95d2-7c28e527c9a8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:07.160266 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.network.security_group_api [None req-ef402c16-494d-4cca-95d2-7c28e527c9a8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Removing security group 699f6a63-a331-4865-9efb-e812ed44c64a from port 88609b12-1d4c-44ef-9b15-d1925da0ea58 Oct 11 05:40:07.513289 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ef402c16-494d-4cca-95d2-7c28e527c9a8 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "POST /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/action" status: 202 len: 0 microversion: 2.1 time: 0.502110 Oct 11 05:40:07.518673 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4134/8032] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:40:07 2022] POST /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/action => generated 0 bytes in 508 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:40:07.532722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=12 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:07.533711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=36 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:07.601866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-00709b18-f277-4974-acee-3c59c34e1f32 req-a4ca95bb-a086-4a09-883b-4a314ee3f1a7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0018af-e565-4191-ab7d-75d29ca21404", "tag": "88609b12-1d4c-44ef-9b15-d1925da0ea58"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:40:07.618335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-00709b18-f277-4974-acee-3c59c34e1f32 req-a4ca95bb-a086-4a09-883b-4a314ee3f1a7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:07.618879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-00709b18-f277-4974-acee-3c59c34e1f32 req-a4ca95bb-a086-4a09-883b-4a314ee3f1a7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:07.619557 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-00709b18-f277-4974-acee-3c59c34e1f32 req-a4ca95bb-a086-4a09-883b-4a314ee3f1a7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:07.632722 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-00709b18-f277-4974-acee-3c59c34e1f32 req-a4ca95bb-a086-4a09-883b-4a314ee3f1a7 service nova] Creating event network-changed:88609b12-1d4c-44ef-9b15-d1925da0ea58 for instance 2a0018af-e565-4191-ab7d-75d29ca21404 on n-h1-860892-1 Oct 11 05:40:07.638817 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-00709b18-f277-4974-acee-3c59c34e1f32 req-a4ca95bb-a086-4a09-883b-4a314ee3f1a7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116298 Oct 11 05:40:07.639635 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3899/8033] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:40:09.268326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9c1523d1-013f-4097-91b1-728c8203e90d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:09.268851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9c1523d1-013f-4097-91b1-728c8203e90d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:09.275040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c1523d1-013f-4097-91b1-728c8203e90d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:09.275529 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c1523d1-013f-4097-91b1-728c8203e90d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:09.275982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c1523d1-013f-4097-91b1-728c8203e90d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:09.276679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c1523d1-013f-4097-91b1-728c8203e90d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:09.277140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c1523d1-013f-4097-91b1-728c8203e90d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:09.277573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9c1523d1-013f-4097-91b1-728c8203e90d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:09.358925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-9c1523d1-013f-4097-91b1-728c8203e90d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lazy-loading 'services' on Instance uuid 2a0018af-e565-4191-ab7d-75d29ca21404 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:40:09.536021 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9c1523d1-013f-4097-91b1-728c8203e90d tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments/34a392eb-9ed0-4c3f-b733-970781135592" status: 202 len: 0 microversion: 2.1 time: 0.273753 Oct 11 05:40:09.536814 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4135/8034] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 05:40:09 2022] DELETE /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments/34a392eb-9ed0-4c3f-b733-970781135592 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:40:09.546999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-22717fcc-2aa2-4b2d-8de9-2623600e23b7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:09.549387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-22717fcc-2aa2-4b2d-8de9-2623600e23b7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:09.556084 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22717fcc-2aa2-4b2d-8de9-2623600e23b7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:09.556574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22717fcc-2aa2-4b2d-8de9-2623600e23b7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:09.557018 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22717fcc-2aa2-4b2d-8de9-2623600e23b7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:09.557732 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22717fcc-2aa2-4b2d-8de9-2623600e23b7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:09.558181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22717fcc-2aa2-4b2d-8de9-2623600e23b7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:09.558756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22717fcc-2aa2-4b2d-8de9-2623600e23b7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:09.589580 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-22717fcc-2aa2-4b2d-8de9-2623600e23b7 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047869 Oct 11 05:40:09.590155 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3900/8035] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:40:09 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:40:09.656007 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e044c4b7-6bba-423f-b2ad-6f715a69b561 req-bb398fa8-deeb-4842-be20-83ad6a4b8b6e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a0018af-e565-4191-ab7d-75d29ca21404", "tag": "88609b12-1d4c-44ef-9b15-d1925da0ea58"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:40:09.666303 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e044c4b7-6bba-423f-b2ad-6f715a69b561 req-bb398fa8-deeb-4842-be20-83ad6a4b8b6e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:09.671295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e044c4b7-6bba-423f-b2ad-6f715a69b561 req-bb398fa8-deeb-4842-be20-83ad6a4b8b6e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:09.671295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e044c4b7-6bba-423f-b2ad-6f715a69b561 req-bb398fa8-deeb-4842-be20-83ad6a4b8b6e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:09.680884 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e044c4b7-6bba-423f-b2ad-6f715a69b561 req-bb398fa8-deeb-4842-be20-83ad6a4b8b6e service nova] Creating event network-changed:88609b12-1d4c-44ef-9b15-d1925da0ea58 for instance 2a0018af-e565-4191-ab7d-75d29ca21404 on n-h1-860892-1 Oct 11 05:40:09.686328 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e044c4b7-6bba-423f-b2ad-6f715a69b561 req-bb398fa8-deeb-4842-be20-83ad6a4b8b6e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034466 Oct 11 05:40:09.690046 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4136/8036] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:40:10.602468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6b3b3eee-5550-40e3-b28a-edcb16384f64 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:10.604711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6b3b3eee-5550-40e3-b28a-edcb16384f64 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:10.612458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b3b3eee-5550-40e3-b28a-edcb16384f64 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:10.612942 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b3b3eee-5550-40e3-b28a-edcb16384f64 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:10.613430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b3b3eee-5550-40e3-b28a-edcb16384f64 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:10.614157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b3b3eee-5550-40e3-b28a-edcb16384f64 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:10.614630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b3b3eee-5550-40e3-b28a-edcb16384f64 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:10.615055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6b3b3eee-5550-40e3-b28a-edcb16384f64 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:10.646028 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6b3b3eee-5550-40e3-b28a-edcb16384f64 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047516 Oct 11 05:40:10.646633 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3901/8037] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:40:10 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:40:11.660378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c4147a89-1fa0-48d1-acc2-efdcde948fa1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:11.662829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c4147a89-1fa0-48d1-acc2-efdcde948fa1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:11.669346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4147a89-1fa0-48d1-acc2-efdcde948fa1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:11.677201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4147a89-1fa0-48d1-acc2-efdcde948fa1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:11.677201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4147a89-1fa0-48d1-acc2-efdcde948fa1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:11.677201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4147a89-1fa0-48d1-acc2-efdcde948fa1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:11.677201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4147a89-1fa0-48d1-acc2-efdcde948fa1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:11.677201 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c4147a89-1fa0-48d1-acc2-efdcde948fa1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:11.704005 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c4147a89-1fa0-48d1-acc2-efdcde948fa1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048828 Oct 11 05:40:11.711572 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4137/8038] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:40:11 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:40:12.717284 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-17ae8b7c-b3f3-4494-97f5-a73537ff9c05 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:12.719699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-17ae8b7c-b3f3-4494-97f5-a73537ff9c05 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:12.726704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17ae8b7c-b3f3-4494-97f5-a73537ff9c05 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:12.727189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17ae8b7c-b3f3-4494-97f5-a73537ff9c05 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:12.727630 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17ae8b7c-b3f3-4494-97f5-a73537ff9c05 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:12.728463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17ae8b7c-b3f3-4494-97f5-a73537ff9c05 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:12.728921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17ae8b7c-b3f3-4494-97f5-a73537ff9c05 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:12.729359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-17ae8b7c-b3f3-4494-97f5-a73537ff9c05 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:12.760767 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-17ae8b7c-b3f3-4494-97f5-a73537ff9c05 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047929 Oct 11 05:40:12.761554 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3902/8039] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:40:12 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:40:13.774490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-254e9556-6883-4228-b68e-8b429afd8b34 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:13.776984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-254e9556-6883-4228-b68e-8b429afd8b34 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:13.784053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e9556-6883-4228-b68e-8b429afd8b34 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:13.784627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e9556-6883-4228-b68e-8b429afd8b34 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:13.785182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e9556-6883-4228-b68e-8b429afd8b34 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:13.785921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e9556-6883-4228-b68e-8b429afd8b34 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:13.786416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e9556-6883-4228-b68e-8b429afd8b34 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:13.786861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-254e9556-6883-4228-b68e-8b429afd8b34 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:13.816763 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-254e9556-6883-4228-b68e-8b429afd8b34 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046643 Oct 11 05:40:13.817341 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4138/8040] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:40:13 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:40:14.829878 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0393986d-0fc2-4189-9c55-b4c17e67cfdf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:14.832133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0393986d-0fc2-4189-9c55-b4c17e67cfdf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:14.839055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0393986d-0fc2-4189-9c55-b4c17e67cfdf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:14.839540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0393986d-0fc2-4189-9c55-b4c17e67cfdf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:14.839984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0393986d-0fc2-4189-9c55-b4c17e67cfdf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:14.840688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0393986d-0fc2-4189-9c55-b4c17e67cfdf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:14.841150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0393986d-0fc2-4189-9c55-b4c17e67cfdf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:14.841579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0393986d-0fc2-4189-9c55-b4c17e67cfdf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:14.872077 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0393986d-0fc2-4189-9c55-b4c17e67cfdf tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046704 Oct 11 05:40:14.877711 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3903/8041] 10.222.0.26 () {58 vars in 1302 bytes} [Tue Oct 11 05:40:14 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 11 05:40:14.884093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:14.884657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:14.892134 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:14.892629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:14.893081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:14.893787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:14.894370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:14.894824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:14.968971 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] HTTP exception thrown: Instance 2a0018af-e565-4191-ab7d-75d29ca21404 is not attached to volume 34a392eb-9ed0-4c3f-b733-970781135592 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Request method failure captured: Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: request: DELETE /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments/34a392eb-9ed0-4c3f-b733-970781135592 HTTP/1.1 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRP_lpD3ZRJOat0JbxEQgBqnvm4rH8pz694sFd69mjllUaudB9W0jtlDlCL-rn5txXTNSL8ckZmBhM0y9wNdubNyvWzHkf38zeIJwwT_VCU_jSsWtl58RJj1KM4S2TP7J6S76ejvWG719gJvD22T4NYvYbl8W9GozIn8NXRUy4Mgzod0 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9ddab207a4844bb4b2faeba8b6a28f59 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ddab207a4844bb4b2faeba8b6a28f59"}]}] Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9ddab207a4844bb4b2faeba8b6a28f59 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestMinimumBasicScenario-198596167-project Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: f6e5d86ca2df425ab50a9059432c0a66 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestMinimumBasicScenario-198596167-project Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 2a0018af-e565-4191-ab7d-75d29ca21404 is not attached to volume 34a392eb-9ed0-4c3f-b733-970781135592 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'server_id': '2a0018af-e565-4191-ab7d-75d29ca21404', 'id': '34a392eb-9ed0-4c3f-b733-970781135592'} Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 34a392eb-9ed0-4c3f-b733-970781135592. Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0018af-e565-4191-ab7d-75d29ca21404 is not attached to volume 34a392eb-9ed0-4c3f-b733-970781135592 Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:40:14.971069 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:40:14.976126 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:40:14.976126 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:40:14.976126 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0018af-e565-4191-ab7d-75d29ca21404 is not attached to volume 34a392eb-9ed0-4c3f-b733-970781135592 Oct 11 05:40:14.976126 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:40:14.976126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Returning 404 to user: Instance 2a0018af-e565-4191-ab7d-75d29ca21404 is not attached to volume 34a392eb-9ed0-4c3f-b733-970781135592 {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:40:14.976126 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d4e2595b-704f-4e29-9d77-7a057432355a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments/34a392eb-9ed0-4c3f-b733-970781135592" status: 404 len: 154 microversion: 2.1 time: 0.092506 Oct 11 05:40:14.976126 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4139/8042] 10.222.0.26 () {58 vars in 1416 bytes} [Tue Oct 11 05:40:14 2022] DELETE /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404/os-volume_attachments/34a392eb-9ed0-4c3f-b733-970781135592 => generated 154 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:40:18.339262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-222ace41-230d-4d67-9244-5de6ae61775a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:18.339799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-222ace41-230d-4d67-9244-5de6ae61775a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:18.346807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-222ace41-230d-4d67-9244-5de6ae61775a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:18.347289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-222ace41-230d-4d67-9244-5de6ae61775a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:18.347730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-222ace41-230d-4d67-9244-5de6ae61775a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:18.348427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-222ace41-230d-4d67-9244-5de6ae61775a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:18.348888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-222ace41-230d-4d67-9244-5de6ae61775a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:18.349315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-222ace41-230d-4d67-9244-5de6ae61775a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:18.375657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-222ace41-230d-4d67-9244-5de6ae61775a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:40:18.687440 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-222ace41-230d-4d67-9244-5de6ae61775a tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "DELETE /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 204 len: 0 microversion: 2.1 time: 0.351813 Oct 11 05:40:18.688040 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3904/8043] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:40:18 2022] DELETE /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:40:18.696336 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ed23239c-f13f-4cc7-b03a-3ce6a1e90e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:18.696966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ed23239c-f13f-4cc7-b03a-3ce6a1e90e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:18.704674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed23239c-f13f-4cc7-b03a-3ce6a1e90e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:18.705176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed23239c-f13f-4cc7-b03a-3ce6a1e90e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:18.705631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed23239c-f13f-4cc7-b03a-3ce6a1e90e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:18.706383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed23239c-f13f-4cc7-b03a-3ce6a1e90e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:18.706855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed23239c-f13f-4cc7-b03a-3ce6a1e90e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:18.707297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ed23239c-f13f-4cc7-b03a-3ce6a1e90e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:18.845422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ed23239c-f13f-4cc7-b03a-3ce6a1e90e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:18.853681 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ed23239c-f13f-4cc7-b03a-3ce6a1e90e0c tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1554 microversion: 2.1 time: 0.161247 Oct 11 05:40:18.854367 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4140/8044] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:18 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:19.878201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75b8c34f-5c33-4b0b-94a6-3a499495f9b3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:19.878904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-75b8c34f-5c33-4b0b-94a6-3a499495f9b3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:19.885756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b8c34f-5c33-4b0b-94a6-3a499495f9b3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:19.886275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b8c34f-5c33-4b0b-94a6-3a499495f9b3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:19.886720 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b8c34f-5c33-4b0b-94a6-3a499495f9b3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:19.887418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b8c34f-5c33-4b0b-94a6-3a499495f9b3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:19.887873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b8c34f-5c33-4b0b-94a6-3a499495f9b3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:19.888299 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75b8c34f-5c33-4b0b-94a6-3a499495f9b3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:20.019001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75b8c34f-5c33-4b0b-94a6-3a499495f9b3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:20.026972 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-75b8c34f-5c33-4b0b-94a6-3a499495f9b3 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1554 microversion: 2.1 time: 0.153707 Oct 11 05:40:20.027877 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3905/8045] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:19 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:20.947939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-3dd00a01-567a-47fd-ba6c-38dd3a8eb22a req-467bd227-6855-48f1-8543-209abe9bff34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a0018af-e565-4191-ab7d-75d29ca21404", "name": "network-vif-deleted", "tag": "88609b12-1d4c-44ef-9b15-d1925da0ea58"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:40:20.959564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3dd00a01-567a-47fd-ba6c-38dd3a8eb22a req-467bd227-6855-48f1-8543-209abe9bff34 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:20.960063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3dd00a01-567a-47fd-ba6c-38dd3a8eb22a req-467bd227-6855-48f1-8543-209abe9bff34 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:20.960518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-3dd00a01-567a-47fd-ba6c-38dd3a8eb22a req-467bd227-6855-48f1-8543-209abe9bff34 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:20.974082 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-3dd00a01-567a-47fd-ba6c-38dd3a8eb22a req-467bd227-6855-48f1-8543-209abe9bff34 service nova] Creating event network-vif-deleted:88609b12-1d4c-44ef-9b15-d1925da0ea58 for instance 2a0018af-e565-4191-ab7d-75d29ca21404 on n-h1-860892-1 Oct 11 05:40:20.979456 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-3dd00a01-567a-47fd-ba6c-38dd3a8eb22a req-467bd227-6855-48f1-8543-209abe9bff34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035342 Oct 11 05:40:20.980041 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4141/8046] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:40:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:40:21.050955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-044bf6dc-88e0-4706-9ac3-a0c368410dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:21.051489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-044bf6dc-88e0-4706-9ac3-a0c368410dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:21.058614 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-044bf6dc-88e0-4706-9ac3-a0c368410dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:21.059105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-044bf6dc-88e0-4706-9ac3-a0c368410dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:21.059551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-044bf6dc-88e0-4706-9ac3-a0c368410dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:21.060249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-044bf6dc-88e0-4706-9ac3-a0c368410dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:21.061229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-044bf6dc-88e0-4706-9ac3-a0c368410dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:21.061710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-044bf6dc-88e0-4706-9ac3-a0c368410dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:21.125681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-044bf6dc-88e0-4706-9ac3-a0c368410dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f6e5d86ca2df425ab50a9059432c0a66', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ddab207a4844bb4b2faeba8b6a28f59', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:21.133634 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-044bf6dc-88e0-4706-9ac3-a0c368410dd2 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 200 len: 1512 microversion: 2.1 time: 0.086730 Oct 11 05:40:21.134435 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3906/8047] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:21 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 1512 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:22.158549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:22.159272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [instance: 2a0018af-e565-4191-ab7d-75d29ca21404] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:22.166275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:22.166784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:22.167230 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:22.167957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:22.168418 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:22.168853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:22.181989 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] HTTP exception thrown: Instance 2a0018af-e565-4191-ab7d-75d29ca21404 could not be found. Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Request method failure captured: Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 HTTP/1.1 Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRP_lpD3ZRJOat0JbxEQgBqnvm4rH8pz694sFd69mjllUaudB9W0jtlDlCL-rn5txXTNSL8ckZmBhM0y9wNdubNyvWzHkf38zeIJwwT_VCU_jSsWtl58RJj1KM4S2TP7J6S76ejvWG719gJvD22T4NYvYbl8W9GozIn8NXRUy4Mgzod0 Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 9ddab207a4844bb4b2faeba8b6a28f59 Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ddab207a4844bb4b2faeba8b6a28f59"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9ddab207a4844bb4b2faeba8b6a28f59"}]}] Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 9ddab207a4844bb4b2faeba8b6a28f59 Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestMinimumBasicScenario-198596167 Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestMinimumBasicScenario-198596167-project Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: f6e5d86ca2df425ab50a9059432c0a66 Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestMinimumBasicScenario-198596167-project Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 2a0018af-e565-4191-ab7d-75d29ca21404 could not be found. Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '2a0018af-e565-4191-ab7d-75d29ca21404'} Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a0018af-e565-4191-ab7d-75d29ca21404 could not be found. Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a0018af-e565-4191-ab7d-75d29ca21404 could not be found. Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:40:22.183675 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:40:22.188936 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:40:22.188936 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:40:22.188936 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:40:22.188936 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:40:22.188936 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:40:22.188936 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a0018af-e565-4191-ab7d-75d29ca21404 could not be found. Oct 11 05:40:22.188936 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:40:22.188936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Returning 404 to user: Instance 2a0018af-e565-4191-ab7d-75d29ca21404 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:40:22.188936 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-967c850d-0af5-412b-857d-e84755b90e81 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404" status: 404 len: 111 microversion: 2.1 time: 0.031761 Oct 11 05:40:22.188936 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4142/8048] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:22 2022] GET /compute/v2.1/servers/2a0018af-e565-4191-ab7d-75d29ca21404 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:40:22.193900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f9e6d643-aa81-4f62-a51a-f691debe3ab1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] Calling method '.version_select at 0x7fda18587280>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:22.203644 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f9e6d643-aa81-4f62-a51a-f691debe3ab1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [e97bebfd-ed87-4f8d-a2d1-630722a087bb] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:40:23.210517 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [None req-f9e6d643-aa81-4f62-a51a-f691debe3ab1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] [e97bebfd-ed87-4f8d-a2d1-630722a087bb] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40206. Oct 11 05:40:23.282368 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f9e6d643-aa81-4f62-a51a-f691debe3ab1 tempest-TestMinimumBasicScenario-198596167 tempest-TestMinimumBasicScenario-198596167-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1788310819" status: 202 len: 0 microversion: 2.1 time: 1.092260 Oct 11 05:40:23.282955 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3907/8049] 10.222.0.26 () {58 vars in 1272 bytes} [Tue Oct 11 05:40:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1788310819 => generated 0 bytes in 1093 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:40:34.907942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=18 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:34.908834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:35.066942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea935a77-d49c-447e-918a-a50299b103bf tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'create', calling method: .version_select at 0x7fda19267a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-255066016", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBET22vX4C1HFMd7pikiZs5J5dTH+yrtiaxI9M8peKpQyuRK/9RpWBDNnoXIDgfXoLrBh66VBKEi1PEAg/WCHA4OheoYp8Hofd2Q/R+gOmd+Kqea5/dh3ibUO7xIg8AaZEw=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:40:35.082831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ea935a77-d49c-447e-918a-a50299b103bf tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:40:35.088847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-ea935a77-d49c-447e-918a-a50299b103bf tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for user a263fe210f1d482797c0f803892098d6 and project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:40:35.196716 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea935a77-d49c-447e-918a-a50299b103bf tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.294980 Oct 11 05:40:35.197324 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4143/8050] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:40:34 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:40:44.054842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:44.055688 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:44.060200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1310995057", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "74c0751c-cb12-4226-b7d7-27305c0a07e4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-255066016", "security_groups": [{"name": "tempest-secgroup-smoke-810010513"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:40:44.193655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] validate_networks() for [('74c0751c-cb12-4226-b7d7-27305c0a07e4', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:40:44.599204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:40:44.599631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:40:44.600108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:40:44.600646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:40:44.601098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:40:44.610456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:44.610941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:44.611382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:44.612141 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:44.612595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:44.613020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:44.629803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:40:44.635081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for user a263fe210f1d482797c0f803892098d6 and project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:40:44.648231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:40:44.651073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:40:44.790153 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [790fba40-e25d-493f-a79e-7c9f164f0720] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:40:45.799625 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [790fba40-e25d-493f-a79e-7c9f164f0720] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40390. Oct 11 05:40:45.811522 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3249c74-4740-4766-8d55-149177eb5ba6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.758538 Oct 11 05:40:45.813350 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3908/8051] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:40:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 1761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:40:45.821808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:45.822618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:45.826504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f0a1b43a-c4c6-43af-a5a9-d04f4bd40b49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:45.827320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f0a1b43a-c4c6-43af-a5a9-d04f4bd40b49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:45.896562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f0a1b43a-c4c6-43af-a5a9-d04f4bd40b49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:45.904861 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f0a1b43a-c4c6-43af-a5a9-d04f4bd40b49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1266 microversion: 2.1 time: 0.084738 Oct 11 05:40:45.906143 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4144/8052] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:45 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:46.929792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-594ac675-ec86-483e-8a98-b806804ae16e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:46.932574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-594ac675-ec86-483e-8a98-b806804ae16e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:46.996514 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-594ac675-ec86-483e-8a98-b806804ae16e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:47.014098 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-594ac675-ec86-483e-8a98-b806804ae16e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1266 microversion: 2.1 time: 0.089727 Oct 11 05:40:47.034899 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3909/8053] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:46 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1266 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:48.043996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e588769-226e-4387-be2f-5d7415a1f0a3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:48.044544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e588769-226e-4387-be2f-5d7415a1f0a3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:48.049582 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:40:48.049820 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:40:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 (ip 10.222.0.26) !!! Oct 11 05:40:48.058927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e588769-226e-4387-be2f-5d7415a1f0a3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:48.059429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e588769-226e-4387-be2f-5d7415a1f0a3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:48.059879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e588769-226e-4387-be2f-5d7415a1f0a3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:48.060592 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e588769-226e-4387-be2f-5d7415a1f0a3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:48.061065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e588769-226e-4387-be2f-5d7415a1f0a3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:48.061626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e588769-226e-4387-be2f-5d7415a1f0a3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:48.129302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e588769-226e-4387-be2f-5d7415a1f0a3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:48.137012 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e588769-226e-4387-be2f-5d7415a1f0a3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1318 microversion: 2.1 time: 0.097395 Oct 11 05:40:48.137587 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4145/8054] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:48 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1318 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:49.161317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b417d2cc-9071-42b9-aaff-43735518dc2d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:49.161926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b417d2cc-9071-42b9-aaff-43735518dc2d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:49.170653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b417d2cc-9071-42b9-aaff-43735518dc2d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:49.171138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b417d2cc-9071-42b9-aaff-43735518dc2d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:49.171606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b417d2cc-9071-42b9-aaff-43735518dc2d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:49.172303 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b417d2cc-9071-42b9-aaff-43735518dc2d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:49.172754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b417d2cc-9071-42b9-aaff-43735518dc2d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:49.173172 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b417d2cc-9071-42b9-aaff-43735518dc2d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:49.329364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b417d2cc-9071-42b9-aaff-43735518dc2d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:49.338256 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b417d2cc-9071-42b9-aaff-43735518dc2d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1391 microversion: 2.1 time: 0.180815 Oct 11 05:40:49.338874 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3910/8055] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:49 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1391 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:50.024419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-b7c5e903-e74a-498f-8873-c10955f1712c req-53e6e932-ba3a-4a54-a6eb-476562a2fea1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81963c1-8dfb-42da-b5cf-5287c5e72db9", "tag": "8f9fb0a1-ccb1-4204-897e-e83996ec209d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:40:50.034941 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b7c5e903-e74a-498f-8873-c10955f1712c req-53e6e932-ba3a-4a54-a6eb-476562a2fea1 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:50.035426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b7c5e903-e74a-498f-8873-c10955f1712c req-53e6e932-ba3a-4a54-a6eb-476562a2fea1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:50.035864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-b7c5e903-e74a-498f-8873-c10955f1712c req-53e6e932-ba3a-4a54-a6eb-476562a2fea1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:50.047784 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-b7c5e903-e74a-498f-8873-c10955f1712c req-53e6e932-ba3a-4a54-a6eb-476562a2fea1 service nova] Creating event network-changed:8f9fb0a1-ccb1-4204-897e-e83996ec209d for instance c81963c1-8dfb-42da-b5cf-5287c5e72db9 on n-h1-860892-1 Oct 11 05:40:50.052894 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-b7c5e903-e74a-498f-8873-c10955f1712c req-53e6e932-ba3a-4a54-a6eb-476562a2fea1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032712 Oct 11 05:40:50.053565 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4146/8056] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:40:50.361519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f2ead0d4-a906-4d39-bde0-c8eb2681a057 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:50.362152 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f2ead0d4-a906-4d39-bde0-c8eb2681a057 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:50.369347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2ead0d4-a906-4d39-bde0-c8eb2681a057 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:50.369828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2ead0d4-a906-4d39-bde0-c8eb2681a057 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:50.370292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2ead0d4-a906-4d39-bde0-c8eb2681a057 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:50.370996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2ead0d4-a906-4d39-bde0-c8eb2681a057 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:50.371444 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2ead0d4-a906-4d39-bde0-c8eb2681a057 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:50.371865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f2ead0d4-a906-4d39-bde0-c8eb2681a057 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:50.511581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f2ead0d4-a906-4d39-bde0-c8eb2681a057 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:50.524702 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f2ead0d4-a906-4d39-bde0-c8eb2681a057 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1391 microversion: 2.1 time: 0.167100 Oct 11 05:40:50.525290 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3911/8057] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:50 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1391 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:51.549268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d09ade06-e83b-4492-a2b0-302a17b351f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:51.549977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d09ade06-e83b-4492-a2b0-302a17b351f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:51.556137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d09ade06-e83b-4492-a2b0-302a17b351f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:51.556627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d09ade06-e83b-4492-a2b0-302a17b351f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:51.557076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d09ade06-e83b-4492-a2b0-302a17b351f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:51.557770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d09ade06-e83b-4492-a2b0-302a17b351f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:51.558258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d09ade06-e83b-4492-a2b0-302a17b351f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:51.558698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d09ade06-e83b-4492-a2b0-302a17b351f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:51.689797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d09ade06-e83b-4492-a2b0-302a17b351f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:51.697860 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d09ade06-e83b-4492-a2b0-302a17b351f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1391 microversion: 2.1 time: 0.153643 Oct 11 05:40:51.698452 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4147/8058] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:51 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:40:52.720765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-575bf2cc-ac44-400d-b36e-38044a4902cb tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:52.721341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-575bf2cc-ac44-400d-b36e-38044a4902cb tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:52.728395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-575bf2cc-ac44-400d-b36e-38044a4902cb tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:52.728926 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-575bf2cc-ac44-400d-b36e-38044a4902cb tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:52.729375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-575bf2cc-ac44-400d-b36e-38044a4902cb tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:52.730073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-575bf2cc-ac44-400d-b36e-38044a4902cb tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:52.730566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-575bf2cc-ac44-400d-b36e-38044a4902cb tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:52.735305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-575bf2cc-ac44-400d-b36e-38044a4902cb tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:52.867151 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-575bf2cc-ac44-400d-b36e-38044a4902cb tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:52.875339 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-575bf2cc-ac44-400d-b36e-38044a4902cb tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1391 microversion: 2.1 time: 0.158637 Oct 11 05:40:52.875917 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3912/8059] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:52 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:53.898028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-499860fd-e325-40a3-b551-a03ee7894328 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:53.898677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-499860fd-e325-40a3-b551-a03ee7894328 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:53.905985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-499860fd-e325-40a3-b551-a03ee7894328 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:53.906501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-499860fd-e325-40a3-b551-a03ee7894328 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:53.906948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-499860fd-e325-40a3-b551-a03ee7894328 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:53.907648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-499860fd-e325-40a3-b551-a03ee7894328 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:53.908112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-499860fd-e325-40a3-b551-a03ee7894328 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:53.908546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-499860fd-e325-40a3-b551-a03ee7894328 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:54.041241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-499860fd-e325-40a3-b551-a03ee7894328 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:54.050538 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-499860fd-e325-40a3-b551-a03ee7894328 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1391 microversion: 2.1 time: 0.156631 Oct 11 05:40:54.051133 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4148/8060] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:53 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:40:55.074819 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-74cbc039-d863-4208-a665-2cfa984eae82 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:55.075431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-74cbc039-d863-4208-a665-2cfa984eae82 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:55.078204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:55.083036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74cbc039-d863-4208-a665-2cfa984eae82 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:55.083628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74cbc039-d863-4208-a665-2cfa984eae82 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:55.084075 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74cbc039-d863-4208-a665-2cfa984eae82 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:55.084759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74cbc039-d863-4208-a665-2cfa984eae82 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:55.085210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74cbc039-d863-4208-a665-2cfa984eae82 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:55.085633 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-74cbc039-d863-4208-a665-2cfa984eae82 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:55.230899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-74cbc039-d863-4208-a665-2cfa984eae82 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:55.239580 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-74cbc039-d863-4208-a665-2cfa984eae82 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1391 microversion: 2.1 time: 0.168966 Oct 11 05:40:55.240172 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3913/8061] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:55 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1391 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:55.420133 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5e6ed783-b3cd-464d-a67a-5e2d6d53fbd7 req-db340a50-1dd3-4b66-899b-311fac5c26b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81963c1-8dfb-42da-b5cf-5287c5e72db9", "name": "network-vif-plugged", "status": "completed", "tag": "8f9fb0a1-ccb1-4204-897e-e83996ec209d"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:40:55.430062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5e6ed783-b3cd-464d-a67a-5e2d6d53fbd7 req-db340a50-1dd3-4b66-899b-311fac5c26b3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:55.433328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5e6ed783-b3cd-464d-a67a-5e2d6d53fbd7 req-db340a50-1dd3-4b66-899b-311fac5c26b3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:55.433328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5e6ed783-b3cd-464d-a67a-5e2d6d53fbd7 req-db340a50-1dd3-4b66-899b-311fac5c26b3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:55.441910 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5e6ed783-b3cd-464d-a67a-5e2d6d53fbd7 req-db340a50-1dd3-4b66-899b-311fac5c26b3 service nova] Creating event network-vif-plugged:8f9fb0a1-ccb1-4204-897e-e83996ec209d for instance c81963c1-8dfb-42da-b5cf-5287c5e72db9 on n-h1-860892-1 Oct 11 05:40:55.447001 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5e6ed783-b3cd-464d-a67a-5e2d6d53fbd7 req-db340a50-1dd3-4b66-899b-311fac5c26b3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083996 Oct 11 05:40:55.447574 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4149/8062] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:40:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:40:56.262828 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4b8d21ef-7034-4413-a09e-98542d9b849a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:56.263368 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4b8d21ef-7034-4413-a09e-98542d9b849a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:56.271024 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b8d21ef-7034-4413-a09e-98542d9b849a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:56.271510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b8d21ef-7034-4413-a09e-98542d9b849a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:56.271948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b8d21ef-7034-4413-a09e-98542d9b849a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:56.272634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b8d21ef-7034-4413-a09e-98542d9b849a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:56.273085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b8d21ef-7034-4413-a09e-98542d9b849a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:56.273515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b8d21ef-7034-4413-a09e-98542d9b849a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:56.403033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4b8d21ef-7034-4413-a09e-98542d9b849a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:56.410953 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4b8d21ef-7034-4413-a09e-98542d9b849a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1391 microversion: 2.1 time: 0.152099 Oct 11 05:40:56.411515 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3914/8063] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:56 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:57.432720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:57.437815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f8ce0032-378a-4b57-8b0c-7a41cd13d901 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:57.438558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f8ce0032-378a-4b57-8b0c-7a41cd13d901 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:57.444718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8ce0032-378a-4b57-8b0c-7a41cd13d901 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:57.445217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8ce0032-378a-4b57-8b0c-7a41cd13d901 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:57.445672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8ce0032-378a-4b57-8b0c-7a41cd13d901 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:57.446416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8ce0032-378a-4b57-8b0c-7a41cd13d901 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:57.446889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8ce0032-378a-4b57-8b0c-7a41cd13d901 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:57.447337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f8ce0032-378a-4b57-8b0c-7a41cd13d901 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:57.585681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f8ce0032-378a-4b57-8b0c-7a41cd13d901 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:57.593398 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f8ce0032-378a-4b57-8b0c-7a41cd13d901 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1564 microversion: 2.1 time: 0.161681 Oct 11 05:40:57.594529 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4150/8064] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:57 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:57.616627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-df4205ec-0bfa-467e-91a6-df3704d4b4d4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:57.617242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-df4205ec-0bfa-467e-91a6-df3704d4b4d4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:57.619136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:40:57.624670 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df4205ec-0bfa-467e-91a6-df3704d4b4d4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:57.625148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df4205ec-0bfa-467e-91a6-df3704d4b4d4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:57.625581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df4205ec-0bfa-467e-91a6-df3704d4b4d4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:57.626287 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df4205ec-0bfa-467e-91a6-df3704d4b4d4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:57.626743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df4205ec-0bfa-467e-91a6-df3704d4b4d4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:57.627167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-df4205ec-0bfa-467e-91a6-df3704d4b4d4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:57.764824 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-df4205ec-0bfa-467e-91a6-df3704d4b4d4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:57.773442 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-df4205ec-0bfa-467e-91a6-df3704d4b4d4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1564 microversion: 2.1 time: 0.160687 Oct 11 05:40:57.774025 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3915/8065] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:57 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:40:59.675196 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce173ffb-97bc-4659-9bcd-83e0412b4fde tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:40:59.676522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce173ffb-97bc-4659-9bcd-83e0412b4fde tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:40:59.686708 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce173ffb-97bc-4659-9bcd-83e0412b4fde tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:59.687215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce173ffb-97bc-4659-9bcd-83e0412b4fde tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:59.688173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce173ffb-97bc-4659-9bcd-83e0412b4fde tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:59.688888 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce173ffb-97bc-4659-9bcd-83e0412b4fde tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:59.689356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce173ffb-97bc-4659-9bcd-83e0412b4fde tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:59.689853 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce173ffb-97bc-4659-9bcd-83e0412b4fde tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:59.746278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-26f9980b-1c56-49e0-bfd5-51842193a784 req-e557aa1c-a1d3-42f1-93be-ca90190210bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81963c1-8dfb-42da-b5cf-5287c5e72db9", "tag": "8f9fb0a1-ccb1-4204-897e-e83996ec209d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:40:59.756708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-26f9980b-1c56-49e0-bfd5-51842193a784 req-e557aa1c-a1d3-42f1-93be-ca90190210bc service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:40:59.757187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-26f9980b-1c56-49e0-bfd5-51842193a784 req-e557aa1c-a1d3-42f1-93be-ca90190210bc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:40:59.757867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-26f9980b-1c56-49e0-bfd5-51842193a784 req-e557aa1c-a1d3-42f1-93be-ca90190210bc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:40:59.771424 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-26f9980b-1c56-49e0-bfd5-51842193a784 req-e557aa1c-a1d3-42f1-93be-ca90190210bc service nova] Creating event network-changed:8f9fb0a1-ccb1-4204-897e-e83996ec209d for instance c81963c1-8dfb-42da-b5cf-5287c5e72db9 on n-h1-860892-1 Oct 11 05:40:59.777672 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-26f9980b-1c56-49e0-bfd5-51842193a784 req-e557aa1c-a1d3-42f1-93be-ca90190210bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104449 Oct 11 05:40:59.778456 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3916/8066] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:40:59.860785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce173ffb-97bc-4659-9bcd-83e0412b4fde tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:40:59.869752 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce173ffb-97bc-4659-9bcd-83e0412b4fde tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1564 microversion: 2.1 time: 0.199407 Oct 11 05:40:59.870365 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4151/8067] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:40:59 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1564 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:41:33.167685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d7a2552c-cdb4-41e2-8efd-128d4142c34b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:41:33.169930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d7a2552c-cdb4-41e2-8efd-128d4142c34b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:41:33.172430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:41:33.173080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=40 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:41:33.177945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7a2552c-cdb4-41e2-8efd-128d4142c34b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:41:33.178456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7a2552c-cdb4-41e2-8efd-128d4142c34b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:41:33.178911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7a2552c-cdb4-41e2-8efd-128d4142c34b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:41:33.179581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7a2552c-cdb4-41e2-8efd-128d4142c34b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:41:33.180028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7a2552c-cdb4-41e2-8efd-128d4142c34b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:41:33.180451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d7a2552c-cdb4-41e2-8efd-128d4142c34b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:41:33.234816 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d7a2552c-cdb4-41e2-8efd-128d4142c34b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9/action" status: 200 len: 24573 microversion: 2.1 time: 0.071280 Oct 11 05:41:33.235605 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3917/8068] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:41:33 2022] POST /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9/action => generated 24573 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:42:03.466222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=18 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:42:03.467021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=34 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:42:03.470999 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3c414496-3dd7-45fd-98a7-27790e664dd9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"pause": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:42:03.471567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-3c414496-3dd7-45fd-98a7-27790e664dd9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:03.477928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c414496-3dd7-45fd-98a7-27790e664dd9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:03.479374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c414496-3dd7-45fd-98a7-27790e664dd9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:03.479374 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c414496-3dd7-45fd-98a7-27790e664dd9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:03.479682 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c414496-3dd7-45fd-98a7-27790e664dd9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:03.480016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c414496-3dd7-45fd-98a7-27790e664dd9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:03.480456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-3c414496-3dd7-45fd-98a7-27790e664dd9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:03.717234 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3c414496-3dd7-45fd-98a7-27790e664dd9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9/action" status: 202 len: 0 microversion: 2.1 time: 0.252467 Oct 11 05:42:03.717997 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4152/8069] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:42:03 2022] POST /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9/action => generated 0 bytes in 254 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 11 05:42:03.729909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5e8af5ff-7ac3-4b4f-8dab-65a52d945ef8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:03.730652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5e8af5ff-7ac3-4b4f-8dab-65a52d945ef8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:03.738085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8af5ff-7ac3-4b4f-8dab-65a52d945ef8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:03.738610 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8af5ff-7ac3-4b4f-8dab-65a52d945ef8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:03.739050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8af5ff-7ac3-4b4f-8dab-65a52d945ef8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:03.739748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8af5ff-7ac3-4b4f-8dab-65a52d945ef8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:03.740201 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8af5ff-7ac3-4b4f-8dab-65a52d945ef8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:03.740631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5e8af5ff-7ac3-4b4f-8dab-65a52d945ef8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:03.879517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5e8af5ff-7ac3-4b4f-8dab-65a52d945ef8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:03.888233 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5e8af5ff-7ac3-4b4f-8dab-65a52d945ef8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1687 microversion: 2.1 time: 0.164516 Oct 11 05:42:03.888796 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3918/8070] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:03 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1687 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:04.914799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce6def2e-f0c2-46dc-af27-f595054ad095 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:04.915536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce6def2e-f0c2-46dc-af27-f595054ad095 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:04.921706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce6def2e-f0c2-46dc-af27-f595054ad095 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:04.922226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce6def2e-f0c2-46dc-af27-f595054ad095 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:04.922695 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce6def2e-f0c2-46dc-af27-f595054ad095 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:04.923395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce6def2e-f0c2-46dc-af27-f595054ad095 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:04.923868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce6def2e-f0c2-46dc-af27-f595054ad095 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:04.924312 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce6def2e-f0c2-46dc-af27-f595054ad095 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:05.055379 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce6def2e-f0c2-46dc-af27-f595054ad095 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:05.063297 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce6def2e-f0c2-46dc-af27-f595054ad095 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1667 microversion: 2.1 time: 0.154461 Oct 11 05:42:05.063871 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4153/8071] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:04 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1667 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:06.163483 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-11df6ad0-fa47-4678-bbb0-096023db0636 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:42:06.165795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-11df6ad0-fa47-4678-bbb0-096023db0636 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:06.176307 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11df6ad0-fa47-4678-bbb0-096023db0636 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:06.176790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11df6ad0-fa47-4678-bbb0-096023db0636 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:06.177235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11df6ad0-fa47-4678-bbb0-096023db0636 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:06.177927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11df6ad0-fa47-4678-bbb0-096023db0636 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:06.178420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11df6ad0-fa47-4678-bbb0-096023db0636 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:06.178851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-11df6ad0-fa47-4678-bbb0-096023db0636 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:06.230157 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-11df6ad0-fa47-4678-bbb0-096023db0636 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9/action" status: 200 len: 32647 microversion: 2.1 time: 0.070536 Oct 11 05:42:06.230854 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3919/8072] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:42:06 2022] POST /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9/action => generated 32647 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:42:06.243041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e51f6dbb-478a-4102-a74d-e2314d7bf5f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"unpause": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:42:06.243601 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e51f6dbb-478a-4102-a74d-e2314d7bf5f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:06.250494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e51f6dbb-478a-4102-a74d-e2314d7bf5f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:06.250997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e51f6dbb-478a-4102-a74d-e2314d7bf5f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:06.251456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e51f6dbb-478a-4102-a74d-e2314d7bf5f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:06.252159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e51f6dbb-478a-4102-a74d-e2314d7bf5f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:06.252629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e51f6dbb-478a-4102-a74d-e2314d7bf5f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:06.253074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e51f6dbb-478a-4102-a74d-e2314d7bf5f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:06.448499 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e51f6dbb-478a-4102-a74d-e2314d7bf5f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9/action" status: 202 len: 0 microversion: 2.1 time: 0.209790 Oct 11 05:42:06.449058 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4154/8073] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:42:06 2022] POST /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:42:06.457925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6eed24cd-9749-4918-8e1c-50fce83cf612 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:06.459820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6eed24cd-9749-4918-8e1c-50fce83cf612 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:06.465745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6eed24cd-9749-4918-8e1c-50fce83cf612 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:06.466248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6eed24cd-9749-4918-8e1c-50fce83cf612 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:06.466695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6eed24cd-9749-4918-8e1c-50fce83cf612 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:06.467393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6eed24cd-9749-4918-8e1c-50fce83cf612 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:06.467848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6eed24cd-9749-4918-8e1c-50fce83cf612 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:06.468276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6eed24cd-9749-4918-8e1c-50fce83cf612 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:06.603803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6eed24cd-9749-4918-8e1c-50fce83cf612 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:06.611796 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6eed24cd-9749-4918-8e1c-50fce83cf612 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1674 microversion: 2.1 time: 0.158298 Oct 11 05:42:06.612398 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3920/8074] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:06 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:07.637608 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-326a0343-beef-40ce-8881-c1d6eb0bf041 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:07.638351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-326a0343-beef-40ce-8881-c1d6eb0bf041 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:07.644550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-326a0343-beef-40ce-8881-c1d6eb0bf041 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:07.645046 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-326a0343-beef-40ce-8881-c1d6eb0bf041 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:07.645502 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-326a0343-beef-40ce-8881-c1d6eb0bf041 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:07.646481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-326a0343-beef-40ce-8881-c1d6eb0bf041 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:07.646951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-326a0343-beef-40ce-8881-c1d6eb0bf041 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:07.647391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-326a0343-beef-40ce-8881-c1d6eb0bf041 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:07.778067 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-326a0343-beef-40ce-8881-c1d6eb0bf041 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:07.785840 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-326a0343-beef-40ce-8881-c1d6eb0bf041 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1682 microversion: 2.1 time: 0.153383 Oct 11 05:42:07.786442 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4155/8075] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:07 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:07.884699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0f1af947-46f3-4baf-bd76-37e20b0beb93 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:42:07.886927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0f1af947-46f3-4baf-bd76-37e20b0beb93 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:07.894512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f1af947-46f3-4baf-bd76-37e20b0beb93 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:07.894991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f1af947-46f3-4baf-bd76-37e20b0beb93 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:07.895419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f1af947-46f3-4baf-bd76-37e20b0beb93 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:07.896361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f1af947-46f3-4baf-bd76-37e20b0beb93 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:07.896811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f1af947-46f3-4baf-bd76-37e20b0beb93 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:07.897233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0f1af947-46f3-4baf-bd76-37e20b0beb93 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:07.947593 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0f1af947-46f3-4baf-bd76-37e20b0beb93 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9/action" status: 200 len: 38458 microversion: 2.1 time: 0.066676 Oct 11 05:42:07.948476 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3921/8076] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:42:07 2022] POST /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9/action => generated 38458 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:42:09.006810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-566a78aa-1594-4412-8923-cd5598cff9d3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:09.007321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-566a78aa-1594-4412-8923-cd5598cff9d3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:09.009818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ab93cb45-f9e6-42d7-aa03-9a4ab63d1903 req-2310f751-e10e-4982-8625-39c2e092ac9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c81963c1-8dfb-42da-b5cf-5287c5e72db9", "tag": "8f9fb0a1-ccb1-4204-897e-e83996ec209d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:42:09.014228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-566a78aa-1594-4412-8923-cd5598cff9d3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:09.014732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-566a78aa-1594-4412-8923-cd5598cff9d3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:09.015182 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-566a78aa-1594-4412-8923-cd5598cff9d3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:09.015891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-566a78aa-1594-4412-8923-cd5598cff9d3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:09.016352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-566a78aa-1594-4412-8923-cd5598cff9d3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:09.016785 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-566a78aa-1594-4412-8923-cd5598cff9d3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:09.022769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ab93cb45-f9e6-42d7-aa03-9a4ab63d1903 req-2310f751-e10e-4982-8625-39c2e092ac9c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:09.023254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ab93cb45-f9e6-42d7-aa03-9a4ab63d1903 req-2310f751-e10e-4982-8625-39c2e092ac9c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:09.023687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ab93cb45-f9e6-42d7-aa03-9a4ab63d1903 req-2310f751-e10e-4982-8625-39c2e092ac9c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:09.037248 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ab93cb45-f9e6-42d7-aa03-9a4ab63d1903 req-2310f751-e10e-4982-8625-39c2e092ac9c service nova] Creating event network-changed:8f9fb0a1-ccb1-4204-897e-e83996ec209d for instance c81963c1-8dfb-42da-b5cf-5287c5e72db9 on n-h1-860892-1 Oct 11 05:42:09.043533 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ab93cb45-f9e6-42d7-aa03-9a4ab63d1903 req-2310f751-e10e-4982-8625-39c2e092ac9c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037853 Oct 11 05:42:09.044879 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3922/8077] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:42:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:42:09.046607 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-566a78aa-1594-4412-8923-cd5598cff9d3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:42:09.319604 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-566a78aa-1594-4412-8923-cd5598cff9d3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 204 len: 0 microversion: 2.1 time: 0.316372 Oct 11 05:42:09.320262 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4156/8078] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:42:09 2022] DELETE /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:42:09.329229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f4de4eb-b7f4-4488-8fe4-172f3f2e33f8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:09.330073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f4de4eb-b7f4-4488-8fe4-172f3f2e33f8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:09.337826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f4de4eb-b7f4-4488-8fe4-172f3f2e33f8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:09.338428 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f4de4eb-b7f4-4488-8fe4-172f3f2e33f8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:09.339000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f4de4eb-b7f4-4488-8fe4-172f3f2e33f8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:09.339820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f4de4eb-b7f4-4488-8fe4-172f3f2e33f8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:09.340351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f4de4eb-b7f4-4488-8fe4-172f3f2e33f8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:09.340850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f4de4eb-b7f4-4488-8fe4-172f3f2e33f8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:09.474777 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f4de4eb-b7f4-4488-8fe4-172f3f2e33f8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:09.483530 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f4de4eb-b7f4-4488-8fe4-172f3f2e33f8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1688 microversion: 2.1 time: 0.158536 Oct 11 05:42:09.484102 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3923/8079] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:09 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1688 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:10.508440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-68efc3b6-ef7a-47af-a7cf-7addd9f9e42c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:10.509689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-68efc3b6-ef7a-47af-a7cf-7addd9f9e42c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:10.516911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68efc3b6-ef7a-47af-a7cf-7addd9f9e42c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:10.517417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68efc3b6-ef7a-47af-a7cf-7addd9f9e42c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:10.517880 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68efc3b6-ef7a-47af-a7cf-7addd9f9e42c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:10.518660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68efc3b6-ef7a-47af-a7cf-7addd9f9e42c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:10.519142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68efc3b6-ef7a-47af-a7cf-7addd9f9e42c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:10.519744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-68efc3b6-ef7a-47af-a7cf-7addd9f9e42c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:10.723720 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-68efc3b6-ef7a-47af-a7cf-7addd9f9e42c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:10.732212 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-68efc3b6-ef7a-47af-a7cf-7addd9f9e42c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1688 microversion: 2.1 time: 0.228035 Oct 11 05:42:10.732794 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4157/8080] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:10 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1688 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:11.592718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-ecb53a9f-3d75-43e6-aa1d-9e945d15c0b2 req-928628c1-c9c2-4c65-a96f-7e1b0db1c03c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c81963c1-8dfb-42da-b5cf-5287c5e72db9", "name": "network-vif-deleted", "tag": "8f9fb0a1-ccb1-4204-897e-e83996ec209d"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:42:11.603492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ecb53a9f-3d75-43e6-aa1d-9e945d15c0b2 req-928628c1-c9c2-4c65-a96f-7e1b0db1c03c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:11.613071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ecb53a9f-3d75-43e6-aa1d-9e945d15c0b2 req-928628c1-c9c2-4c65-a96f-7e1b0db1c03c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:11.613071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-ecb53a9f-3d75-43e6-aa1d-9e945d15c0b2 req-928628c1-c9c2-4c65-a96f-7e1b0db1c03c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:11.615456 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-ecb53a9f-3d75-43e6-aa1d-9e945d15c0b2 req-928628c1-c9c2-4c65-a96f-7e1b0db1c03c service nova] Creating event network-vif-deleted:8f9fb0a1-ccb1-4204-897e-e83996ec209d for instance c81963c1-8dfb-42da-b5cf-5287c5e72db9 on n-h1-860892-1 Oct 11 05:42:11.620493 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-ecb53a9f-3d75-43e6-aa1d-9e945d15c0b2 req-928628c1-c9c2-4c65-a96f-7e1b0db1c03c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031519 Oct 11 05:42:11.621069 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3924/8081] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:42:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:42:11.758455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ded411d2-35fa-4991-bc7c-900653aa5d17 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:11.759536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ded411d2-35fa-4991-bc7c-900653aa5d17 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:11.766470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded411d2-35fa-4991-bc7c-900653aa5d17 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:11.766971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded411d2-35fa-4991-bc7c-900653aa5d17 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:11.767425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded411d2-35fa-4991-bc7c-900653aa5d17 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:11.768131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded411d2-35fa-4991-bc7c-900653aa5d17 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:11.768698 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded411d2-35fa-4991-bc7c-900653aa5d17 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:11.769143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ded411d2-35fa-4991-bc7c-900653aa5d17 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:11.833178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ded411d2-35fa-4991-bc7c-900653aa5d17 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:11.841773 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ded411d2-35fa-4991-bc7c-900653aa5d17 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 200 len: 1351 microversion: 2.1 time: 0.087367 Oct 11 05:42:11.842438 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4158/8082] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:11 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 1351 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:12.866069 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:12.866831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: c81963c1-8dfb-42da-b5cf-5287c5e72db9] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:12.873506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:12.873988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:12.874459 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:12.875154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:12.875607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:12.876041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:12.889796 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] HTTP exception thrown: Instance c81963c1-8dfb-42da-b5cf-5287c5e72db9 could not be found. Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Request method failure captured: Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 HTTP/1.1 Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRQHS4piZqH1dure5OF-4uF_7UQtjJNzpk0Jb5Ez15iOAgJ05BhQLyncbupebXYDCjM4DCYwFt9xTz5GcJDwnQqgiCsLq8kZzuI3mHzfQAmmSu_E-hTu9Y6kmFjbTS9lLqk2rSkkeY6p8wGY24LmfuD8ig77EwFZZak6QxcZyePtclAY Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 44a5aa7caa7e495a84b2c0e677bda422 Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a5aa7caa7e495a84b2c0e677bda422"}]}] Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 44a5aa7caa7e495a84b2c0e677bda422 Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestNetworkAdvancedServerOps-165913187-project Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a263fe210f1d482797c0f803892098d6 Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestNetworkAdvancedServerOps-165913187-project Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance c81963c1-8dfb-42da-b5cf-5287c5e72db9 could not be found. Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'c81963c1-8dfb-42da-b5cf-5287c5e72db9'} Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c81963c1-8dfb-42da-b5cf-5287c5e72db9 could not be found. Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c81963c1-8dfb-42da-b5cf-5287c5e72db9 could not be found. Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:42:12.891445 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:42:12.896415 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:42:12.896415 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:42:12.896415 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:42:12.896415 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:42:12.896415 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:42:12.896415 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:42:12.896415 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c81963c1-8dfb-42da-b5cf-5287c5e72db9 could not be found. Oct 11 05:42:12.896415 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:42:12.896415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Returning 404 to user: Instance c81963c1-8dfb-42da-b5cf-5287c5e72db9 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:42:12.896415 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7a09b1d0-c07f-4516-9d34-6622688e3f3c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9" status: 404 len: 111 microversion: 2.1 time: 0.031837 Oct 11 05:42:12.896415 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3925/8083] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:12 2022] GET /compute/v2.1/servers/c81963c1-8dfb-42da-b5cf-5287c5e72db9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:42:16.626959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0115a8aa-c17b-4286-b44a-cf6cb305ba2b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '.version_select at 0x7fda1df64b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:16.703504 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0115a8aa-c17b-4286-b44a-cf6cb305ba2b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-255066016" status: 202 len: 0 microversion: 2.1 time: 0.080772 Oct 11 05:42:16.704099 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4159/8084] 10.222.0.26 () {58 vars in 1281 bytes} [Tue Oct 11 05:42:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-255066016 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:42:16.732209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-415b6f40-c5c4-4a53-b50c-e4ac1839c82e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'create', calling method: .version_select at 0x7fda19380e50>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-564497754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrbkqjV5oe7V6EooawU8DYCkr/ypiB+XY6HV0M3GCHrOGjVdF0nEUyl68E310UGfsIaxv8gqui2ZHhP4oTF5qrbgBsk9DkJ1JLFDaPo4kbBwJpmzxPY3R8S8BPoGQxXUg=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:42:16.749212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-415b6f40-c5c4-4a53-b50c-e4ac1839c82e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:42:16.754356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-415b6f40-c5c4-4a53-b50c-e4ac1839c82e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for user a263fe210f1d482797c0f803892098d6 and project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:42:16.858761 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-415b6f40-c5c4-4a53-b50c-e4ac1839c82e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.130917 Oct 11 05:42:16.859654 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3926/8085] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:42:16 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:42:25.495627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1421587145", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "95bb0523-0213-4824-86b3-ffa0f36bebfb"}], "key_name": "tempest-TestNetworkAdvancedServerOps-564497754", "security_groups": [{"name": "tempest-secgroup-smoke-423602422"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:42:25.510963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:42:25.766994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] validate_networks() for [('95bb0523-0213-4824-86b3-ffa0f36bebfb', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:42:26.258934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:42:26.258934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:42:26.258934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:42:26.258934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:42:26.258934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:42:26.270556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:26.271411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:26.272048 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:26.272801 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:26.273276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:26.273718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:26.292660 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:42:26.298172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for user a263fe210f1d482797c0f803892098d6 and project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:42:26.311610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:42:26.313891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:42:26.433898 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-306923a1-9e59-4d06-a6f4-dba32fd78458 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.943823 Oct 11 05:42:26.435274 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4160/8086] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:42:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 946 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:42:26.446098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=36 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:42:26.455485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0dd3dd32-fe3b-44aa-b54c-219e1ea426ed tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:26.456448 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0dd3dd32-fe3b-44aa-b54c-219e1ea426ed tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:26.600805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0dd3dd32-fe3b-44aa-b54c-219e1ea426ed tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:26.609311 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0dd3dd32-fe3b-44aa-b54c-219e1ea426ed tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1266 microversion: 2.1 time: 0.166546 Oct 11 05:42:26.609901 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3927/8087] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:26 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:27.633308 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0971f107-e3e5-41d4-b15e-11ae444be077 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:27.633961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0971f107-e3e5-41d4-b15e-11ae444be077 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:27.642812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0971f107-e3e5-41d4-b15e-11ae444be077 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:27.643331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0971f107-e3e5-41d4-b15e-11ae444be077 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:27.643793 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0971f107-e3e5-41d4-b15e-11ae444be077 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:27.644679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0971f107-e3e5-41d4-b15e-11ae444be077 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:27.645164 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0971f107-e3e5-41d4-b15e-11ae444be077 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:27.645615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0971f107-e3e5-41d4-b15e-11ae444be077 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:27.709781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0971f107-e3e5-41d4-b15e-11ae444be077 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:27.718127 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0971f107-e3e5-41d4-b15e-11ae444be077 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1262 microversion: 2.1 time: 0.089741 Oct 11 05:42:27.718745 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4161/8088] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:27 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1262 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:28.744546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e946f8c1-4fc9-427a-a373-8f3f8fa6f834 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:28.745222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e946f8c1-4fc9-427a-a373-8f3f8fa6f834 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:28.755486 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e946f8c1-4fc9-427a-a373-8f3f8fa6f834 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:28.755983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e946f8c1-4fc9-427a-a373-8f3f8fa6f834 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:28.756430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e946f8c1-4fc9-427a-a373-8f3f8fa6f834 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:28.757135 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e946f8c1-4fc9-427a-a373-8f3f8fa6f834 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:28.757596 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e946f8c1-4fc9-427a-a373-8f3f8fa6f834 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:28.758034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e946f8c1-4fc9-427a-a373-8f3f8fa6f834 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:28.820433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e946f8c1-4fc9-427a-a373-8f3f8fa6f834 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:28.829005 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e946f8c1-4fc9-427a-a373-8f3f8fa6f834 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1336 microversion: 2.1 time: 0.088850 Oct 11 05:42:28.838832 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3928/8089] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:28 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1336 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:29.853005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-efb0fd2d-40a3-4d7a-9f46-547c11e66947 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:29.853696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-efb0fd2d-40a3-4d7a-9f46-547c11e66947 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:29.861216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efb0fd2d-40a3-4d7a-9f46-547c11e66947 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:29.861771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efb0fd2d-40a3-4d7a-9f46-547c11e66947 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:29.862176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efb0fd2d-40a3-4d7a-9f46-547c11e66947 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:29.862942 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efb0fd2d-40a3-4d7a-9f46-547c11e66947 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:29.863411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efb0fd2d-40a3-4d7a-9f46-547c11e66947 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:29.863856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efb0fd2d-40a3-4d7a-9f46-547c11e66947 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:30.072615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-efb0fd2d-40a3-4d7a-9f46-547c11e66947 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:30.080597 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-efb0fd2d-40a3-4d7a-9f46-547c11e66947 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1391 microversion: 2.1 time: 0.232023 Oct 11 05:42:30.081400 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4162/8090] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:29 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1391 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:30.294807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5333be1e-8697-47f8-9eee-bde5d8faf9d3 req-ab38655e-1419-4706-8976-e8c8a53ba49f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c1a095-8548-4cb1-94fc-536241b09c78", "tag": "ac9d0aa7-7ccc-4b79-a0ae-0dfd04445f22"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:42:30.306549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5333be1e-8697-47f8-9eee-bde5d8faf9d3 req-ab38655e-1419-4706-8976-e8c8a53ba49f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:30.307912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5333be1e-8697-47f8-9eee-bde5d8faf9d3 req-ab38655e-1419-4706-8976-e8c8a53ba49f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:30.307912 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5333be1e-8697-47f8-9eee-bde5d8faf9d3 req-ab38655e-1419-4706-8976-e8c8a53ba49f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:30.319576 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5333be1e-8697-47f8-9eee-bde5d8faf9d3 req-ab38655e-1419-4706-8976-e8c8a53ba49f service nova] Creating event network-changed:ac9d0aa7-7ccc-4b79-a0ae-0dfd04445f22 for instance 70c1a095-8548-4cb1-94fc-536241b09c78 on n-h2-860892-1 Oct 11 05:42:30.324697 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5333be1e-8697-47f8-9eee-bde5d8faf9d3 req-ab38655e-1419-4706-8976-e8c8a53ba49f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033581 Oct 11 05:42:30.332977 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3929/8091] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:42:31.104586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cd0ae040-d339-41d7-b20b-4e7e8f8027c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:31.105219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cd0ae040-d339-41d7-b20b-4e7e8f8027c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:31.112216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd0ae040-d339-41d7-b20b-4e7e8f8027c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:31.112715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd0ae040-d339-41d7-b20b-4e7e8f8027c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:31.113171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd0ae040-d339-41d7-b20b-4e7e8f8027c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:31.113875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd0ae040-d339-41d7-b20b-4e7e8f8027c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:31.114378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd0ae040-d339-41d7-b20b-4e7e8f8027c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:31.114825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd0ae040-d339-41d7-b20b-4e7e8f8027c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:31.249919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cd0ae040-d339-41d7-b20b-4e7e8f8027c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:31.257782 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cd0ae040-d339-41d7-b20b-4e7e8f8027c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1391 microversion: 2.1 time: 0.157862 Oct 11 05:42:31.259232 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4163/8092] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:31 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:32.283375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-523fa3f9-cb2e-4f0e-a12b-66c349c9483c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:32.284136 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-523fa3f9-cb2e-4f0e-a12b-66c349c9483c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:32.290866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-523fa3f9-cb2e-4f0e-a12b-66c349c9483c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:32.291355 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-523fa3f9-cb2e-4f0e-a12b-66c349c9483c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:32.291798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-523fa3f9-cb2e-4f0e-a12b-66c349c9483c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:32.292493 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-523fa3f9-cb2e-4f0e-a12b-66c349c9483c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:32.292953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-523fa3f9-cb2e-4f0e-a12b-66c349c9483c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:32.293390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-523fa3f9-cb2e-4f0e-a12b-66c349c9483c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:32.429102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-523fa3f9-cb2e-4f0e-a12b-66c349c9483c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:32.436921 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-523fa3f9-cb2e-4f0e-a12b-66c349c9483c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1391 microversion: 2.1 time: 0.158727 Oct 11 05:42:32.437482 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3930/8093] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:32 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1391 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:33.460402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-14cb399e-4bf2-4232-85d4-2f2f941bac52 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:33.461032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-14cb399e-4bf2-4232-85d4-2f2f941bac52 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:33.468272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14cb399e-4bf2-4232-85d4-2f2f941bac52 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:33.468775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14cb399e-4bf2-4232-85d4-2f2f941bac52 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:33.469229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14cb399e-4bf2-4232-85d4-2f2f941bac52 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:33.469980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14cb399e-4bf2-4232-85d4-2f2f941bac52 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:33.470486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14cb399e-4bf2-4232-85d4-2f2f941bac52 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:33.470926 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-14cb399e-4bf2-4232-85d4-2f2f941bac52 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:33.608705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-14cb399e-4bf2-4232-85d4-2f2f941bac52 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:33.616440 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-14cb399e-4bf2-4232-85d4-2f2f941bac52 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1391 microversion: 2.1 time: 0.160018 Oct 11 05:42:33.617017 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4164/8094] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:33 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1391 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:34.640377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4495c568-a31a-41fe-8904-58ddd4c20dd1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:34.640994 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4495c568-a31a-41fe-8904-58ddd4c20dd1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:34.643793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:42:34.648841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4495c568-a31a-41fe-8904-58ddd4c20dd1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:34.649330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4495c568-a31a-41fe-8904-58ddd4c20dd1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:34.649773 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4495c568-a31a-41fe-8904-58ddd4c20dd1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:34.650499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4495c568-a31a-41fe-8904-58ddd4c20dd1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:34.650958 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4495c568-a31a-41fe-8904-58ddd4c20dd1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:34.651394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4495c568-a31a-41fe-8904-58ddd4c20dd1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:34.782453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4495c568-a31a-41fe-8904-58ddd4c20dd1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:34.790035 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4495c568-a31a-41fe-8904-58ddd4c20dd1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1391 microversion: 2.1 time: 0.153605 Oct 11 05:42:34.790636 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3931/8095] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:34 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1391 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:35.480815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-8cce1710-b8a2-4acc-baa0-a50e2263593f req-33e93449-86c2-4639-8d42-eb6c6a10d3b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c1a095-8548-4cb1-94fc-536241b09c78", "name": "network-vif-plugged", "status": "completed", "tag": "ac9d0aa7-7ccc-4b79-a0ae-0dfd04445f22"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:42:35.486821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:42:35.492136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8cce1710-b8a2-4acc-baa0-a50e2263593f req-33e93449-86c2-4639-8d42-eb6c6a10d3b8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:35.492624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8cce1710-b8a2-4acc-baa0-a50e2263593f req-33e93449-86c2-4639-8d42-eb6c6a10d3b8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:35.493070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8cce1710-b8a2-4acc-baa0-a50e2263593f req-33e93449-86c2-4639-8d42-eb6c6a10d3b8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:35.504139 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8cce1710-b8a2-4acc-baa0-a50e2263593f req-33e93449-86c2-4639-8d42-eb6c6a10d3b8 service nova] Creating event network-vif-plugged:ac9d0aa7-7ccc-4b79-a0ae-0dfd04445f22 for instance 70c1a095-8548-4cb1-94fc-536241b09c78 on n-h2-860892-1 Oct 11 05:42:35.509753 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-8cce1710-b8a2-4acc-baa0-a50e2263593f req-33e93449-86c2-4639-8d42-eb6c6a10d3b8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033249 Oct 11 05:42:35.510441 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4165/8096] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:42:35.813291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-112ac8e9-0596-4030-99e7-aa8d3a6ec125 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:35.814212 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-112ac8e9-0596-4030-99e7-aa8d3a6ec125 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:35.820986 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-112ac8e9-0596-4030-99e7-aa8d3a6ec125 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:35.821467 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-112ac8e9-0596-4030-99e7-aa8d3a6ec125 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:35.821904 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-112ac8e9-0596-4030-99e7-aa8d3a6ec125 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:35.822615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-112ac8e9-0596-4030-99e7-aa8d3a6ec125 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:35.823067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-112ac8e9-0596-4030-99e7-aa8d3a6ec125 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:35.823494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-112ac8e9-0596-4030-99e7-aa8d3a6ec125 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:35.952730 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-112ac8e9-0596-4030-99e7-aa8d3a6ec125 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:35.960339 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-112ac8e9-0596-4030-99e7-aa8d3a6ec125 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1391 microversion: 2.1 time: 0.151066 Oct 11 05:42:35.960904 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3932/8097] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:35 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:36.984147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-97f9cb35-ab8a-4447-b20b-fa58cd9224aa tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:36.984865 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-97f9cb35-ab8a-4447-b20b-fa58cd9224aa tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:36.986799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:42:36.987557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:42:36.993919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97f9cb35-ab8a-4447-b20b-fa58cd9224aa tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:36.994506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97f9cb35-ab8a-4447-b20b-fa58cd9224aa tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:36.994904 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97f9cb35-ab8a-4447-b20b-fa58cd9224aa tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:36.995599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97f9cb35-ab8a-4447-b20b-fa58cd9224aa tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:36.996065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97f9cb35-ab8a-4447-b20b-fa58cd9224aa tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:36.996506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-97f9cb35-ab8a-4447-b20b-fa58cd9224aa tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:37.130302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-97f9cb35-ab8a-4447-b20b-fa58cd9224aa tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:37.139866 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-97f9cb35-ab8a-4447-b20b-fa58cd9224aa tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1562 microversion: 2.1 time: 0.160315 Oct 11 05:42:37.140447 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4166/8098] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:36 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1562 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:37.162068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-35fa5e1d-3617-4043-ac15-b5826f9802a4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:37.162731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-35fa5e1d-3617-4043-ac15-b5826f9802a4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:37.165016 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:42:37.171556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35fa5e1d-3617-4043-ac15-b5826f9802a4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:37.172138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35fa5e1d-3617-4043-ac15-b5826f9802a4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:37.173646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35fa5e1d-3617-4043-ac15-b5826f9802a4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:37.174408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35fa5e1d-3617-4043-ac15-b5826f9802a4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:37.174871 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35fa5e1d-3617-4043-ac15-b5826f9802a4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:37.175306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-35fa5e1d-3617-4043-ac15-b5826f9802a4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:37.320002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-35fa5e1d-3617-4043-ac15-b5826f9802a4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:37.327842 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-35fa5e1d-3617-4043-ac15-b5826f9802a4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1562 microversion: 2.1 time: 0.169784 Oct 11 05:42:37.328410 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3933/8099] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:37 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1562 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:42:39.277148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d214c8ac-97c3-4162-91b2-1bea2f978c13 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:42:39.278412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d214c8ac-97c3-4162-91b2-1bea2f978c13 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:42:39.279955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-863a18e9-095f-46b0-b6a7-13a4e686ff61 req-5e942e04-bce9-47f6-b7ff-bba90c332ecc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c1a095-8548-4cb1-94fc-536241b09c78", "tag": "ac9d0aa7-7ccc-4b79-a0ae-0dfd04445f22"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:42:39.285356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d214c8ac-97c3-4162-91b2-1bea2f978c13 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:39.286176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d214c8ac-97c3-4162-91b2-1bea2f978c13 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:39.286721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d214c8ac-97c3-4162-91b2-1bea2f978c13 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:39.287481 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d214c8ac-97c3-4162-91b2-1bea2f978c13 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:39.288136 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d214c8ac-97c3-4162-91b2-1bea2f978c13 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:39.288595 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d214c8ac-97c3-4162-91b2-1bea2f978c13 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:39.298747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-863a18e9-095f-46b0-b6a7-13a4e686ff61 req-5e942e04-bce9-47f6-b7ff-bba90c332ecc service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:42:39.298747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-863a18e9-095f-46b0-b6a7-13a4e686ff61 req-5e942e04-bce9-47f6-b7ff-bba90c332ecc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:42:39.298747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-863a18e9-095f-46b0-b6a7-13a4e686ff61 req-5e942e04-bce9-47f6-b7ff-bba90c332ecc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:42:39.306170 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-863a18e9-095f-46b0-b6a7-13a4e686ff61 req-5e942e04-bce9-47f6-b7ff-bba90c332ecc service nova] Creating event network-changed:ac9d0aa7-7ccc-4b79-a0ae-0dfd04445f22 for instance 70c1a095-8548-4cb1-94fc-536241b09c78 on n-h2-860892-1 Oct 11 05:42:39.311485 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-863a18e9-095f-46b0-b6a7-13a4e686ff61 req-5e942e04-bce9-47f6-b7ff-bba90c332ecc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035517 Oct 11 05:42:39.312522 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3934/8100] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:42:39.516239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d214c8ac-97c3-4162-91b2-1bea2f978c13 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:42:39.528119 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d214c8ac-97c3-4162-91b2-1bea2f978c13 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1562 microversion: 2.1 time: 0.255420 Oct 11 05:42:39.528714 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4167/8101] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:42:39 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1562 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:00.835753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-93dcc8a4-4feb-49ee-afa1-09e94bd3548e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:43:00.838644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-93dcc8a4-4feb-49ee-afa1-09e94bd3548e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:00.841520 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=7 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:43:00.842227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=34 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:43:00.847162 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93dcc8a4-4feb-49ee-afa1-09e94bd3548e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:00.847660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93dcc8a4-4feb-49ee-afa1-09e94bd3548e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:00.848073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93dcc8a4-4feb-49ee-afa1-09e94bd3548e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:00.848756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93dcc8a4-4feb-49ee-afa1-09e94bd3548e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:00.849205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93dcc8a4-4feb-49ee-afa1-09e94bd3548e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:00.850050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-93dcc8a4-4feb-49ee-afa1-09e94bd3548e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:00.912086 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-93dcc8a4-4feb-49ee-afa1-09e94bd3548e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78/action" status: 200 len: 24570 microversion: 2.1 time: 0.080388 Oct 11 05:43:00.912735 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3935/8102] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:43:00 2022] POST /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78/action => generated 24570 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:43:11.894006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b1f9281c-2c94-46a6-bb65-8e9546dd01b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:43:11.896570 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b1f9281c-2c94-46a6-bb65-8e9546dd01b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:11.901882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=5 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:43:11.902556 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=40 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:43:11.904372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1f9281c-2c94-46a6-bb65-8e9546dd01b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:11.904866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1f9281c-2c94-46a6-bb65-8e9546dd01b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:11.905315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1f9281c-2c94-46a6-bb65-8e9546dd01b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:11.906026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1f9281c-2c94-46a6-bb65-8e9546dd01b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:11.906526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1f9281c-2c94-46a6-bb65-8e9546dd01b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:11.906964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b1f9281c-2c94-46a6-bb65-8e9546dd01b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:12.098878 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b1f9281c-2c94-46a6-bb65-8e9546dd01b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78/action" status: 202 len: 0 microversion: 2.1 time: 0.208743 Oct 11 05:43:12.099441 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4168/8103] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:43:11 2022] POST /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:43:12.108353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f5c6b778-150c-4117-95a1-86c4f09a9540 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:12.109050 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f5c6b778-150c-4117-95a1-86c4f09a9540 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:12.111704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:43:12.112340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:43:12.117236 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5c6b778-150c-4117-95a1-86c4f09a9540 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:12.117708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5c6b778-150c-4117-95a1-86c4f09a9540 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:12.118143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5c6b778-150c-4117-95a1-86c4f09a9540 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:12.119361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5c6b778-150c-4117-95a1-86c4f09a9540 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:12.119810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5c6b778-150c-4117-95a1-86c4f09a9540 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:12.120232 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f5c6b778-150c-4117-95a1-86c4f09a9540 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:12.258788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f5c6b778-150c-4117-95a1-86c4f09a9540 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:12.267423 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f5c6b778-150c-4117-95a1-86c4f09a9540 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1673 microversion: 2.1 time: 0.163347 Oct 11 05:43:12.268268 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3936/8104] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:12 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:13.294444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ca668382-f10d-47f6-b583-559bfaeacb29 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:13.295163 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ca668382-f10d-47f6-b583-559bfaeacb29 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:13.301456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca668382-f10d-47f6-b583-559bfaeacb29 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:13.301956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca668382-f10d-47f6-b583-559bfaeacb29 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:13.302447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca668382-f10d-47f6-b583-559bfaeacb29 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:13.303178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca668382-f10d-47f6-b583-559bfaeacb29 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:13.303659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca668382-f10d-47f6-b583-559bfaeacb29 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:13.304106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ca668382-f10d-47f6-b583-559bfaeacb29 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:13.439631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ca668382-f10d-47f6-b583-559bfaeacb29 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:13.447981 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ca668382-f10d-47f6-b583-559bfaeacb29 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.158917 Oct 11 05:43:13.448562 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4169/8105] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:13 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:43:14.472210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-80f75514-84a1-485f-a01a-2b9eae692549 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:14.472763 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-80f75514-84a1-485f-a01a-2b9eae692549 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:14.480297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80f75514-84a1-485f-a01a-2b9eae692549 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:14.480774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80f75514-84a1-485f-a01a-2b9eae692549 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:14.481215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80f75514-84a1-485f-a01a-2b9eae692549 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:14.481902 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80f75514-84a1-485f-a01a-2b9eae692549 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:14.482388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80f75514-84a1-485f-a01a-2b9eae692549 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:14.482818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-80f75514-84a1-485f-a01a-2b9eae692549 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:14.610497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-80f75514-84a1-485f-a01a-2b9eae692549 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:14.618139 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-80f75514-84a1-485f-a01a-2b9eae692549 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.149979 Oct 11 05:43:14.618731 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3937/8106] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:14 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:15.641121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-19970369-ada1-4dc7-a119-28958630da02 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:15.641752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-19970369-ada1-4dc7-a119-28958630da02 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:15.648861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19970369-ada1-4dc7-a119-28958630da02 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:15.649357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19970369-ada1-4dc7-a119-28958630da02 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:15.650484 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19970369-ada1-4dc7-a119-28958630da02 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:15.651188 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19970369-ada1-4dc7-a119-28958630da02 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:15.651658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19970369-ada1-4dc7-a119-28958630da02 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:15.652103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-19970369-ada1-4dc7-a119-28958630da02 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:15.786678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-19970369-ada1-4dc7-a119-28958630da02 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:15.794604 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-19970369-ada1-4dc7-a119-28958630da02 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.157407 Oct 11 05:43:15.795203 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4170/8107] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:15 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:16.817686 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-873fa4bc-d6a2-48b2-bf58-883be563e14c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:16.818335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-873fa4bc-d6a2-48b2-bf58-883be563e14c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:16.825186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873fa4bc-d6a2-48b2-bf58-883be563e14c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:16.825669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873fa4bc-d6a2-48b2-bf58-883be563e14c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:16.826116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873fa4bc-d6a2-48b2-bf58-883be563e14c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:16.826836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873fa4bc-d6a2-48b2-bf58-883be563e14c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:16.827293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873fa4bc-d6a2-48b2-bf58-883be563e14c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:16.827724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-873fa4bc-d6a2-48b2-bf58-883be563e14c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:16.968092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-873fa4bc-d6a2-48b2-bf58-883be563e14c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:16.976169 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-873fa4bc-d6a2-48b2-bf58-883be563e14c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.162433 Oct 11 05:43:16.976745 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3938/8108] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:16 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:18.000198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e7ea26f3-7ec9-4363-ab31-670ddd2b180d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:18.000819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e7ea26f3-7ec9-4363-ab31-670ddd2b180d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:18.007602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ea26f3-7ec9-4363-ab31-670ddd2b180d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:18.008097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ea26f3-7ec9-4363-ab31-670ddd2b180d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:18.008549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ea26f3-7ec9-4363-ab31-670ddd2b180d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:18.009249 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ea26f3-7ec9-4363-ab31-670ddd2b180d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:18.009712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ea26f3-7ec9-4363-ab31-670ddd2b180d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:18.010150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e7ea26f3-7ec9-4363-ab31-670ddd2b180d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:18.137956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e7ea26f3-7ec9-4363-ab31-670ddd2b180d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:18.145826 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e7ea26f3-7ec9-4363-ab31-670ddd2b180d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.149616 Oct 11 05:43:18.146684 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4171/8109] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:17 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:19.173208 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7db8fc88-3cee-476f-90d0-fce0a7325013 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:19.173752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7db8fc88-3cee-476f-90d0-fce0a7325013 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:19.181305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7db8fc88-3cee-476f-90d0-fce0a7325013 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:19.184552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7db8fc88-3cee-476f-90d0-fce0a7325013 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:19.184552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7db8fc88-3cee-476f-90d0-fce0a7325013 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:19.184552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7db8fc88-3cee-476f-90d0-fce0a7325013 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:19.184552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7db8fc88-3cee-476f-90d0-fce0a7325013 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:19.184971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7db8fc88-3cee-476f-90d0-fce0a7325013 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:19.319160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7db8fc88-3cee-476f-90d0-fce0a7325013 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:19.327032 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7db8fc88-3cee-476f-90d0-fce0a7325013 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.161550 Oct 11 05:43:19.327610 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3939/8110] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:19 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:20.350358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5371741c-7419-4e23-905d-35a095a1f513 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:20.350984 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5371741c-7419-4e23-905d-35a095a1f513 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:20.357800 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5371741c-7419-4e23-905d-35a095a1f513 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:20.358319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5371741c-7419-4e23-905d-35a095a1f513 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:20.358770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5371741c-7419-4e23-905d-35a095a1f513 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:20.359467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5371741c-7419-4e23-905d-35a095a1f513 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:20.359928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5371741c-7419-4e23-905d-35a095a1f513 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:20.360366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5371741c-7419-4e23-905d-35a095a1f513 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:20.491696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5371741c-7419-4e23-905d-35a095a1f513 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:20.499882 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5371741c-7419-4e23-905d-35a095a1f513 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.153469 Oct 11 05:43:20.500446 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4172/8111] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:20 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:21.524463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b48164a5-e9e1-43c8-9dce-75ff4fccf8af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:21.525110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b48164a5-e9e1-43c8-9dce-75ff4fccf8af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:21.532503 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b48164a5-e9e1-43c8-9dce-75ff4fccf8af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:21.532980 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b48164a5-e9e1-43c8-9dce-75ff4fccf8af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:21.533414 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b48164a5-e9e1-43c8-9dce-75ff4fccf8af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:21.534088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b48164a5-e9e1-43c8-9dce-75ff4fccf8af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:21.534562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b48164a5-e9e1-43c8-9dce-75ff4fccf8af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:21.534983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b48164a5-e9e1-43c8-9dce-75ff4fccf8af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:21.667207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b48164a5-e9e1-43c8-9dce-75ff4fccf8af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:21.674894 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b48164a5-e9e1-43c8-9dce-75ff4fccf8af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.154560 Oct 11 05:43:21.675458 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3940/8112] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:21 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:22.696802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cf7bc60c-60e4-4590-a5e8-eecf0152f650 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:22.697425 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cf7bc60c-60e4-4590-a5e8-eecf0152f650 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:22.704359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf7bc60c-60e4-4590-a5e8-eecf0152f650 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:22.704851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf7bc60c-60e4-4590-a5e8-eecf0152f650 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:22.705302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf7bc60c-60e4-4590-a5e8-eecf0152f650 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:22.706005 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf7bc60c-60e4-4590-a5e8-eecf0152f650 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:22.706491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf7bc60c-60e4-4590-a5e8-eecf0152f650 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:22.706932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cf7bc60c-60e4-4590-a5e8-eecf0152f650 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:22.835369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-cf7bc60c-60e4-4590-a5e8-eecf0152f650 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:22.843567 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cf7bc60c-60e4-4590-a5e8-eecf0152f650 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.150630 Oct 11 05:43:22.844127 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4173/8113] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:22 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:23.867408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-193be059-32f2-4828-abac-97ac2f85ef0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:23.868132 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-193be059-32f2-4828-abac-97ac2f85ef0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:23.875701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193be059-32f2-4828-abac-97ac2f85ef0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:23.876192 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193be059-32f2-4828-abac-97ac2f85ef0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:23.876671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193be059-32f2-4828-abac-97ac2f85ef0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:23.877370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193be059-32f2-4828-abac-97ac2f85ef0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:23.877838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193be059-32f2-4828-abac-97ac2f85ef0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:23.878301 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-193be059-32f2-4828-abac-97ac2f85ef0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:24.011718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-193be059-32f2-4828-abac-97ac2f85ef0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:24.019681 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-193be059-32f2-4828-abac-97ac2f85ef0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.156267 Oct 11 05:43:24.020268 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3941/8114] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:23 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:25.043783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-33c244d1-e895-44fb-8e74-8688bc0f8850 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:25.044440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-33c244d1-e895-44fb-8e74-8688bc0f8850 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:25.051369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c244d1-e895-44fb-8e74-8688bc0f8850 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:25.051868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c244d1-e895-44fb-8e74-8688bc0f8850 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:25.052324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c244d1-e895-44fb-8e74-8688bc0f8850 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:25.053033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c244d1-e895-44fb-8e74-8688bc0f8850 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:25.053509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c244d1-e895-44fb-8e74-8688bc0f8850 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:25.053956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-33c244d1-e895-44fb-8e74-8688bc0f8850 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:25.216534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-33c244d1-e895-44fb-8e74-8688bc0f8850 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:25.216534 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-33c244d1-e895-44fb-8e74-8688bc0f8850 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.161830 Oct 11 05:43:25.216534 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4174/8115] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:25 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:26.238537 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6cfc548f-1bdb-4cbe-9b97-bd0ebc4f6943 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:26.239166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6cfc548f-1bdb-4cbe-9b97-bd0ebc4f6943 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:26.245930 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cfc548f-1bdb-4cbe-9b97-bd0ebc4f6943 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:26.246451 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cfc548f-1bdb-4cbe-9b97-bd0ebc4f6943 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:26.246898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cfc548f-1bdb-4cbe-9b97-bd0ebc4f6943 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:26.247589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cfc548f-1bdb-4cbe-9b97-bd0ebc4f6943 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:26.248043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cfc548f-1bdb-4cbe-9b97-bd0ebc4f6943 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:26.248470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6cfc548f-1bdb-4cbe-9b97-bd0ebc4f6943 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:26.377890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6cfc548f-1bdb-4cbe-9b97-bd0ebc4f6943 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:26.388324 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6cfc548f-1bdb-4cbe-9b97-bd0ebc4f6943 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.153813 Oct 11 05:43:26.388898 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3942/8116] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:26 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:27.412549 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6042fbf9-adca-4749-9c7d-2e6b61ddfd8f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:27.413160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6042fbf9-adca-4749-9c7d-2e6b61ddfd8f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:27.420512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6042fbf9-adca-4749-9c7d-2e6b61ddfd8f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:27.422014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6042fbf9-adca-4749-9c7d-2e6b61ddfd8f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:27.422014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6042fbf9-adca-4749-9c7d-2e6b61ddfd8f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:27.422265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6042fbf9-adca-4749-9c7d-2e6b61ddfd8f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:27.422696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6042fbf9-adca-4749-9c7d-2e6b61ddfd8f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:27.423148 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6042fbf9-adca-4749-9c7d-2e6b61ddfd8f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:27.558738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6042fbf9-adca-4749-9c7d-2e6b61ddfd8f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:27.566683 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6042fbf9-adca-4749-9c7d-2e6b61ddfd8f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.158242 Oct 11 05:43:27.567273 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4175/8117] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:27 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:28.589593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d4e1792c-3ef0-481e-acb9-f8daeb98d579 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:28.590214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d4e1792c-3ef0-481e-acb9-f8daeb98d579 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:28.597158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4e1792c-3ef0-481e-acb9-f8daeb98d579 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:28.597642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4e1792c-3ef0-481e-acb9-f8daeb98d579 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:28.598078 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4e1792c-3ef0-481e-acb9-f8daeb98d579 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:28.598799 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4e1792c-3ef0-481e-acb9-f8daeb98d579 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:28.599250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4e1792c-3ef0-481e-acb9-f8daeb98d579 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:28.599675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d4e1792c-3ef0-481e-acb9-f8daeb98d579 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:28.733560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d4e1792c-3ef0-481e-acb9-f8daeb98d579 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:28.741382 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d4e1792c-3ef0-481e-acb9-f8daeb98d579 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1678 microversion: 2.1 time: 0.155867 Oct 11 05:43:28.741957 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3943/8118] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:28 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:29.765747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ccc08487-5aa5-4bac-8584-a5af730d697a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:43:29.766412 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ccc08487-5aa5-4bac-8584-a5af730d697a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:29.773500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccc08487-5aa5-4bac-8584-a5af730d697a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:29.773938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccc08487-5aa5-4bac-8584-a5af730d697a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:29.774424 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccc08487-5aa5-4bac-8584-a5af730d697a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:29.775127 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccc08487-5aa5-4bac-8584-a5af730d697a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:29.775598 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccc08487-5aa5-4bac-8584-a5af730d697a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:29.776041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ccc08487-5aa5-4bac-8584-a5af730d697a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:29.905444 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ccc08487-5aa5-4bac-8584-a5af730d697a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:43:29.913354 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ccc08487-5aa5-4bac-8584-a5af730d697a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1681 microversion: 2.1 time: 0.151535 Oct 11 05:43:29.913934 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4176/8119] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:43:29 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:43:54.100505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-41c0b96a-6b76-4e81-91ca-bda3d35e66ab tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:43:54.102798 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-41c0b96a-6b76-4e81-91ca-bda3d35e66ab tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:43:54.104813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=16 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:43:54.106046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=48 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:43:54.110851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c0b96a-6b76-4e81-91ca-bda3d35e66ab tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:54.111330 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c0b96a-6b76-4e81-91ca-bda3d35e66ab tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:54.111765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c0b96a-6b76-4e81-91ca-bda3d35e66ab tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:54.112449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c0b96a-6b76-4e81-91ca-bda3d35e66ab tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:43:54.112896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c0b96a-6b76-4e81-91ca-bda3d35e66ab tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:43:54.113317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-41c0b96a-6b76-4e81-91ca-bda3d35e66ab tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:43:54.166955 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-41c0b96a-6b76-4e81-91ca-bda3d35e66ab tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78/action" status: 200 len: 69109 microversion: 2.1 time: 0.070464 Oct 11 05:43:54.167602 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3944/8120] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:43:54 2022] POST /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78/action => generated 69109 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:44:01.359629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0be7be2a-88da-4450-9939-aeddaea936e1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:01.360173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0be7be2a-88da-4450-9939-aeddaea936e1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:01.362957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-43214b30-7956-4d24-81ea-2751092f0a89 req-d71bdfb2-cf92-4c75-951a-de9519be8ebc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70c1a095-8548-4cb1-94fc-536241b09c78", "tag": "ac9d0aa7-7ccc-4b79-a0ae-0dfd04445f22"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:44:01.366089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=18 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:44:01.366962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:44:01.368786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0be7be2a-88da-4450-9939-aeddaea936e1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:01.369535 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0be7be2a-88da-4450-9939-aeddaea936e1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:01.370000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0be7be2a-88da-4450-9939-aeddaea936e1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:01.371329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0be7be2a-88da-4450-9939-aeddaea936e1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:01.371985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0be7be2a-88da-4450-9939-aeddaea936e1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:01.372439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0be7be2a-88da-4450-9939-aeddaea936e1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:01.375159 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-43214b30-7956-4d24-81ea-2751092f0a89 req-d71bdfb2-cf92-4c75-951a-de9519be8ebc service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:01.378033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-43214b30-7956-4d24-81ea-2751092f0a89 req-d71bdfb2-cf92-4c75-951a-de9519be8ebc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:01.378033 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-43214b30-7956-4d24-81ea-2751092f0a89 req-d71bdfb2-cf92-4c75-951a-de9519be8ebc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:01.388501 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-43214b30-7956-4d24-81ea-2751092f0a89 req-d71bdfb2-cf92-4c75-951a-de9519be8ebc service nova] Creating event network-changed:ac9d0aa7-7ccc-4b79-a0ae-0dfd04445f22 for instance 70c1a095-8548-4cb1-94fc-536241b09c78 on n-h2-860892-1 Oct 11 05:44:01.393624 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-43214b30-7956-4d24-81ea-2751092f0a89 req-d71bdfb2-cf92-4c75-951a-de9519be8ebc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035497 Oct 11 05:44:01.394839 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3945/8121] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:44:01.401973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0be7be2a-88da-4450-9939-aeddaea936e1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:44:01.712045 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0be7be2a-88da-4450-9939-aeddaea936e1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "DELETE /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 204 len: 0 microversion: 2.1 time: 0.356811 Oct 11 05:44:01.712866 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4177/8122] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:44:01 2022] DELETE /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 11 05:44:01.722723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4b678fd2-f2c5-46bb-9d51-aa7245fa8d5c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:01.723425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4b678fd2-f2c5-46bb-9d51-aa7245fa8d5c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:01.730780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b678fd2-f2c5-46bb-9d51-aa7245fa8d5c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:01.731281 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b678fd2-f2c5-46bb-9d51-aa7245fa8d5c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:01.731724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b678fd2-f2c5-46bb-9d51-aa7245fa8d5c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:01.732426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b678fd2-f2c5-46bb-9d51-aa7245fa8d5c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:01.732883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b678fd2-f2c5-46bb-9d51-aa7245fa8d5c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:01.733324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4b678fd2-f2c5-46bb-9d51-aa7245fa8d5c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:01.876990 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4b678fd2-f2c5-46bb-9d51-aa7245fa8d5c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:01.884984 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4b678fd2-f2c5-46bb-9d51-aa7245fa8d5c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1687 microversion: 2.1 time: 0.167053 Oct 11 05:44:01.885594 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3946/8123] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:01 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:02.911039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-be392bb7-29e3-4945-9c7e-bf94ba0bac3a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:02.911753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-be392bb7-29e3-4945-9c7e-bf94ba0bac3a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:02.919062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be392bb7-29e3-4945-9c7e-bf94ba0bac3a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:02.919560 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be392bb7-29e3-4945-9c7e-bf94ba0bac3a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:02.920032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be392bb7-29e3-4945-9c7e-bf94ba0bac3a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:02.920760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be392bb7-29e3-4945-9c7e-bf94ba0bac3a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:02.921232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be392bb7-29e3-4945-9c7e-bf94ba0bac3a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:02.921674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-be392bb7-29e3-4945-9c7e-bf94ba0bac3a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:03.076038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-be392bb7-29e3-4945-9c7e-bf94ba0bac3a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:03.083867 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-be392bb7-29e3-4945-9c7e-bf94ba0bac3a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1687 microversion: 2.1 time: 0.177091 Oct 11 05:44:03.084441 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4178/8124] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:02 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1687 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:03.693328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e0a9afda-9bb3-490a-a737-a7e0ad4e057a req-c5077caa-bd28-4483-9c22-44f1d6bfdddc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70c1a095-8548-4cb1-94fc-536241b09c78", "name": "network-vif-deleted", "tag": "ac9d0aa7-7ccc-4b79-a0ae-0dfd04445f22"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:44:03.704106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e0a9afda-9bb3-490a-a737-a7e0ad4e057a req-c5077caa-bd28-4483-9c22-44f1d6bfdddc service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:03.704571 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e0a9afda-9bb3-490a-a737-a7e0ad4e057a req-c5077caa-bd28-4483-9c22-44f1d6bfdddc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:03.705007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e0a9afda-9bb3-490a-a737-a7e0ad4e057a req-c5077caa-bd28-4483-9c22-44f1d6bfdddc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:03.716747 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e0a9afda-9bb3-490a-a737-a7e0ad4e057a req-c5077caa-bd28-4483-9c22-44f1d6bfdddc service nova] Creating event network-vif-deleted:ac9d0aa7-7ccc-4b79-a0ae-0dfd04445f22 for instance 70c1a095-8548-4cb1-94fc-536241b09c78 on n-h2-860892-1 Oct 11 05:44:03.721572 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e0a9afda-9bb3-490a-a737-a7e0ad4e057a req-c5077caa-bd28-4483-9c22-44f1d6bfdddc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032127 Oct 11 05:44:03.725497 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3947/8125] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:44:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:44:04.108755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:04.109417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:04.116395 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:04.116903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:04.117352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:04.118065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:04.118566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:04.119008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:04.150294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:04.150788 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:04.151242 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:04.151703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lazy-loading 'fault' on Instance uuid 70c1a095-8548-4cb1-94fc-536241b09c78 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:44:04.192386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:04.200083 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-05d9b377-ddc7-44a7-8c29-2eb8d8441519 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 200 len: 1356 microversion: 2.1 time: 0.095916 Oct 11 05:44:04.200650 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4179/8126] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:04 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 1356 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:05.225745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:05.226387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 70c1a095-8548-4cb1-94fc-536241b09c78] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:05.232642 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:05.233117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:05.233553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:05.234293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:05.234744 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:05.235169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:05.248744 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] HTTP exception thrown: Instance 70c1a095-8548-4cb1-94fc-536241b09c78 could not be found. Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Request method failure captured: Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 HTTP/1.1 Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRQHS4piZqH1dure5OF-4uF_7UQtjJNzpk0Jb5Ez15iOAgJ05BhQLyncbupebXYDCjM4DCYwFt9xTz5GcJDwnQqgiCsLq8kZzuI3mHzfQAmmSu_E-hTu9Y6kmFjbTS9lLqk2rSkkeY6p8wGY24LmfuD8ig77EwFZZak6QxcZyePtclAY Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 44a5aa7caa7e495a84b2c0e677bda422 Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a5aa7caa7e495a84b2c0e677bda422"}]}] Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 44a5aa7caa7e495a84b2c0e677bda422 Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestNetworkAdvancedServerOps-165913187-project Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a263fe210f1d482797c0f803892098d6 Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestNetworkAdvancedServerOps-165913187-project Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 70c1a095-8548-4cb1-94fc-536241b09c78 could not be found. Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '70c1a095-8548-4cb1-94fc-536241b09c78'} Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70c1a095-8548-4cb1-94fc-536241b09c78 could not be found. Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70c1a095-8548-4cb1-94fc-536241b09c78 could not be found. Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:44:05.250383 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:44:05.255640 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:44:05.255640 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:44:05.255640 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:44:05.255640 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:44:05.255640 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:44:05.255640 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:44:05.255640 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70c1a095-8548-4cb1-94fc-536241b09c78 could not be found. Oct 11 05:44:05.255640 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:44:05.255640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Returning 404 to user: Instance 70c1a095-8548-4cb1-94fc-536241b09c78 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:44:05.255640 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a055ea43-97b6-483a-b16a-c475513cba6a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78" status: 404 len: 111 microversion: 2.1 time: 0.031606 Oct 11 05:44:05.255640 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3948/8127] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:05 2022] GET /compute/v2.1/servers/70c1a095-8548-4cb1-94fc-536241b09c78 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:44:09.259291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d59d9796-48ed-4935-b17e-9e3e9b291c57 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '.version_select at 0x7fda19ad6b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:09.323946 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d59d9796-48ed-4935-b17e-9e3e9b291c57 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-564497754" status: 202 len: 0 microversion: 2.1 time: 0.068586 Oct 11 05:44:09.325031 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4180/8128] 10.222.0.26 () {58 vars in 1281 bytes} [Tue Oct 11 05:44:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-564497754 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:44:09.354940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bff8f2f6-bc86-4891-9588-6437b4909d50 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'create', calling method: .version_select at 0x7fda19ba5a60>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-2066748389", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMFmtpZpjIwe/sXQGImizzFwv1D0pgd2j9MFl86u4J+kbW+2XwyFZaEvuxB0W8IJ1S6pBB6rPj3z32Xc+UxIve5rnApY0gI3KZyznUqnZmWhYrYMIVWMkOozW9uzwQcreg=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:44:09.370425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-bff8f2f6-bc86-4891-9588-6437b4909d50 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:44:09.379269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-bff8f2f6-bc86-4891-9588-6437b4909d50 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for user a263fe210f1d482797c0f803892098d6 and project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:44:09.460715 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bff8f2f6-bc86-4891-9588-6437b4909d50 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 407 microversion: 2.1 time: 0.109940 Oct 11 05:44:09.461313 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3949/8129] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:44:09 2022] POST /compute/v2.1/os-keypairs => generated 407 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:44:17.286465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:44:17.290537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1483421091", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "6d3c8403-21be-46d8-a645-d850404c57b5"}], "key_name": "tempest-TestNetworkAdvancedServerOps-2066748389", "security_groups": [{"name": "tempest-secgroup-smoke-870435094"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:44:17.417540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] validate_networks() for [('6d3c8403-21be-46d8-a645-d850404c57b5', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:44:17.838558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:44:17.839193 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:44:17.840550 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:44:17.841218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:44:17.841860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:44:17.851462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:17.851971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:17.852491 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:17.853247 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:17.853724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:17.854170 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:17.874251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:44:17.882803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for user a263fe210f1d482797c0f803892098d6 and project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:44:17.903320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:44:17.905716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:44:18.031419 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6e9a2c85-7669-4a6c-a925-d9e4dedc6238 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.747535 Oct 11 05:44:18.032380 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4181/8130] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:44:17 2022] POST /compute/v2.1/servers => generated 405 bytes in 749 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:44:18.042095 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=16 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:44:18.047484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-18d65cae-1b8b-4c92-99a2-512f063a27f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:18.048253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-18d65cae-1b8b-4c92-99a2-512f063a27f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:18.110978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-18d65cae-1b8b-4c92-99a2-512f063a27f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:18.119102 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-18d65cae-1b8b-4c92-99a2-512f063a27f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1267 microversion: 2.1 time: 0.079496 Oct 11 05:44:18.131124 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3950/8131] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:18 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:19.144787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea088cb4-e59e-4598-a008-024333dcac87 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:19.145370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea088cb4-e59e-4598-a008-024333dcac87 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:19.153476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea088cb4-e59e-4598-a008-024333dcac87 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:19.154029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea088cb4-e59e-4598-a008-024333dcac87 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:19.154511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea088cb4-e59e-4598-a008-024333dcac87 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:19.155231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea088cb4-e59e-4598-a008-024333dcac87 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:19.155703 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea088cb4-e59e-4598-a008-024333dcac87 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:19.156370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea088cb4-e59e-4598-a008-024333dcac87 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:19.224538 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ea088cb4-e59e-4598-a008-024333dcac87 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:19.232716 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea088cb4-e59e-4598-a008-024333dcac87 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1271 microversion: 2.1 time: 0.093304 Oct 11 05:44:19.233289 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4182/8132] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:19 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:20.256266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1dc54217-2fe3-426b-9a5a-c459936b9ff0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:20.257086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1dc54217-2fe3-426b-9a5a-c459936b9ff0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:20.265375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dc54217-2fe3-426b-9a5a-c459936b9ff0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:20.265875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dc54217-2fe3-426b-9a5a-c459936b9ff0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:20.266365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dc54217-2fe3-426b-9a5a-c459936b9ff0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:20.267080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dc54217-2fe3-426b-9a5a-c459936b9ff0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:20.267540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dc54217-2fe3-426b-9a5a-c459936b9ff0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:20.267973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1dc54217-2fe3-426b-9a5a-c459936b9ff0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:20.333716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1dc54217-2fe3-426b-9a5a-c459936b9ff0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:20.343858 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1dc54217-2fe3-426b-9a5a-c459936b9ff0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1325 microversion: 2.1 time: 0.091568 Oct 11 05:44:20.344478 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3951/8133] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:20 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1325 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:21.367996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d23282d-7152-4121-8b20-790a9334139e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:21.368621 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2d23282d-7152-4121-8b20-790a9334139e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:21.375958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d23282d-7152-4121-8b20-790a9334139e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:21.376470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d23282d-7152-4121-8b20-790a9334139e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:21.376929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d23282d-7152-4121-8b20-790a9334139e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:21.377768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d23282d-7152-4121-8b20-790a9334139e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:21.378270 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d23282d-7152-4121-8b20-790a9334139e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:21.378718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2d23282d-7152-4121-8b20-790a9334139e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:21.587809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d23282d-7152-4121-8b20-790a9334139e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:21.596264 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d23282d-7152-4121-8b20-790a9334139e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1392 microversion: 2.1 time: 0.232222 Oct 11 05:44:21.596891 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4183/8134] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:21 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1392 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:21.748544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5c2d065b-de49-4cfd-8b9f-0cfa59c7ab01 req-58a52c0a-30b6-4235-9ac6-48b6df5f08fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7bdb02-be87-43a3-9115-91df2206118a", "tag": "caaaa901-ddd6-4400-98c7-4f296aba77c3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:44:21.762718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5c2d065b-de49-4cfd-8b9f-0cfa59c7ab01 req-58a52c0a-30b6-4235-9ac6-48b6df5f08fa service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:21.763289 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5c2d065b-de49-4cfd-8b9f-0cfa59c7ab01 req-58a52c0a-30b6-4235-9ac6-48b6df5f08fa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:21.763935 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5c2d065b-de49-4cfd-8b9f-0cfa59c7ab01 req-58a52c0a-30b6-4235-9ac6-48b6df5f08fa service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:21.777512 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5c2d065b-de49-4cfd-8b9f-0cfa59c7ab01 req-58a52c0a-30b6-4235-9ac6-48b6df5f08fa service nova] Creating event network-changed:caaaa901-ddd6-4400-98c7-4f296aba77c3 for instance 3d7bdb02-be87-43a3-9115-91df2206118a on n-h1-860892-1 Oct 11 05:44:21.782536 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5c2d065b-de49-4cfd-8b9f-0cfa59c7ab01 req-58a52c0a-30b6-4235-9ac6-48b6df5f08fa service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038157 Oct 11 05:44:21.783411 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3952/8135] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:44:22.619375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f1f6fb60-7209-4675-985b-9e36e3a88460 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:22.620003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f1f6fb60-7209-4675-985b-9e36e3a88460 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:22.627328 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1f6fb60-7209-4675-985b-9e36e3a88460 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:22.627832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1f6fb60-7209-4675-985b-9e36e3a88460 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:22.628285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1f6fb60-7209-4675-985b-9e36e3a88460 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:22.629010 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1f6fb60-7209-4675-985b-9e36e3a88460 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:22.629509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1f6fb60-7209-4675-985b-9e36e3a88460 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:22.629953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f1f6fb60-7209-4675-985b-9e36e3a88460 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:22.830808 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f1f6fb60-7209-4675-985b-9e36e3a88460 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:22.838790 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f1f6fb60-7209-4675-985b-9e36e3a88460 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1392 microversion: 2.1 time: 0.223413 Oct 11 05:44:22.841547 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4184/8136] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:22 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1392 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:23.863858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a56be45b-ffb1-452e-aedb-42de51f3d507 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:23.864621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a56be45b-ffb1-452e-aedb-42de51f3d507 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:23.871417 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a56be45b-ffb1-452e-aedb-42de51f3d507 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:23.871905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a56be45b-ffb1-452e-aedb-42de51f3d507 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:23.872348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a56be45b-ffb1-452e-aedb-42de51f3d507 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:23.873040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a56be45b-ffb1-452e-aedb-42de51f3d507 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:23.873496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a56be45b-ffb1-452e-aedb-42de51f3d507 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:23.873937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a56be45b-ffb1-452e-aedb-42de51f3d507 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:24.003044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a56be45b-ffb1-452e-aedb-42de51f3d507 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:24.010751 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a56be45b-ffb1-452e-aedb-42de51f3d507 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1392 microversion: 2.1 time: 0.152119 Oct 11 05:44:24.011334 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3953/8137] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:23 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1392 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:25.033958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-293e52f6-2c14-483d-89e3-ceee158627b4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:25.034625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-293e52f6-2c14-483d-89e3-ceee158627b4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:25.041511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-293e52f6-2c14-483d-89e3-ceee158627b4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:25.042013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-293e52f6-2c14-483d-89e3-ceee158627b4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:25.042997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-293e52f6-2c14-483d-89e3-ceee158627b4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:25.043702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-293e52f6-2c14-483d-89e3-ceee158627b4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:25.044172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-293e52f6-2c14-483d-89e3-ceee158627b4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:25.044615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-293e52f6-2c14-483d-89e3-ceee158627b4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:25.176095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-293e52f6-2c14-483d-89e3-ceee158627b4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:25.184552 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-293e52f6-2c14-483d-89e3-ceee158627b4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1392 microversion: 2.1 time: 0.154490 Oct 11 05:44:25.185117 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4185/8138] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:25 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:26.207446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-65b9ab4d-71d6-4b11-a02b-9d6165ca8b1b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:26.207822 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-65b9ab4d-71d6-4b11-a02b-9d6165ca8b1b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:26.210549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:44:26.215882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65b9ab4d-71d6-4b11-a02b-9d6165ca8b1b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:26.216894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65b9ab4d-71d6-4b11-a02b-9d6165ca8b1b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:26.216894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65b9ab4d-71d6-4b11-a02b-9d6165ca8b1b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:26.217460 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65b9ab4d-71d6-4b11-a02b-9d6165ca8b1b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:26.217907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65b9ab4d-71d6-4b11-a02b-9d6165ca8b1b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:26.218357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-65b9ab4d-71d6-4b11-a02b-9d6165ca8b1b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:26.353877 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-65b9ab4d-71d6-4b11-a02b-9d6165ca8b1b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:26.362101 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-65b9ab4d-71d6-4b11-a02b-9d6165ca8b1b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1392 microversion: 2.1 time: 0.158785 Oct 11 05:44:26.362703 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3954/8139] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:26 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:27.384180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0f2d90a7-b0be-4ac1-b699-1fcc687ba779 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:27.384815 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0f2d90a7-b0be-4ac1-b699-1fcc687ba779 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:27.392192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f2d90a7-b0be-4ac1-b699-1fcc687ba779 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:27.396277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f2d90a7-b0be-4ac1-b699-1fcc687ba779 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:27.396277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f2d90a7-b0be-4ac1-b699-1fcc687ba779 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:27.396277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f2d90a7-b0be-4ac1-b699-1fcc687ba779 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:27.396277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f2d90a7-b0be-4ac1-b699-1fcc687ba779 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:27.396277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0f2d90a7-b0be-4ac1-b699-1fcc687ba779 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:27.528924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0f2d90a7-b0be-4ac1-b699-1fcc687ba779 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:27.536676 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0f2d90a7-b0be-4ac1-b699-1fcc687ba779 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1392 microversion: 2.1 time: 0.156459 Oct 11 05:44:27.537246 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4186/8140] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:27 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:28.123497 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-9456238f-7432-4cce-bbc7-9efbd5bab014 req-97d435a3-af94-4ebc-80d8-0cc990b640d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7bdb02-be87-43a3-9115-91df2206118a", "name": "network-vif-plugged", "status": "completed", "tag": "caaaa901-ddd6-4400-98c7-4f296aba77c3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:44:28.130209 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:44:28.134361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9456238f-7432-4cce-bbc7-9efbd5bab014 req-97d435a3-af94-4ebc-80d8-0cc990b640d1 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:28.134837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9456238f-7432-4cce-bbc7-9efbd5bab014 req-97d435a3-af94-4ebc-80d8-0cc990b640d1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:28.135271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-9456238f-7432-4cce-bbc7-9efbd5bab014 req-97d435a3-af94-4ebc-80d8-0cc990b640d1 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:28.146056 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-9456238f-7432-4cce-bbc7-9efbd5bab014 req-97d435a3-af94-4ebc-80d8-0cc990b640d1 service nova] Creating event network-vif-plugged:caaaa901-ddd6-4400-98c7-4f296aba77c3 for instance 3d7bdb02-be87-43a3-9115-91df2206118a on n-h1-860892-1 Oct 11 05:44:28.151281 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-9456238f-7432-4cce-bbc7-9efbd5bab014 req-97d435a3-af94-4ebc-80d8-0cc990b640d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032137 Oct 11 05:44:28.151850 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3955/8141] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:44:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:44:28.559925 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-37b5eba5-e8f0-4cf5-bd7c-9c6987a2903f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:28.560558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-37b5eba5-e8f0-4cf5-bd7c-9c6987a2903f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:28.562482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:44:28.563166 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:44:28.568851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b5eba5-e8f0-4cf5-bd7c-9c6987a2903f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:28.571162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b5eba5-e8f0-4cf5-bd7c-9c6987a2903f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:28.571162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b5eba5-e8f0-4cf5-bd7c-9c6987a2903f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:28.571162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b5eba5-e8f0-4cf5-bd7c-9c6987a2903f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:28.571162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b5eba5-e8f0-4cf5-bd7c-9c6987a2903f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:28.571567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-37b5eba5-e8f0-4cf5-bd7c-9c6987a2903f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:28.703224 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-37b5eba5-e8f0-4cf5-bd7c-9c6987a2903f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:28.711036 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-37b5eba5-e8f0-4cf5-bd7c-9c6987a2903f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1392 microversion: 2.1 time: 0.155064 Oct 11 05:44:28.711605 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4187/8142] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:28 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1392 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:29.736953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dcd7a9b0-cbc7-47bf-a8b9-dca8903f1228 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:29.737643 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dcd7a9b0-cbc7-47bf-a8b9-dca8903f1228 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:29.743968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcd7a9b0-cbc7-47bf-a8b9-dca8903f1228 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:29.744446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcd7a9b0-cbc7-47bf-a8b9-dca8903f1228 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:29.744882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcd7a9b0-cbc7-47bf-a8b9-dca8903f1228 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:29.746298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcd7a9b0-cbc7-47bf-a8b9-dca8903f1228 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:29.746772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcd7a9b0-cbc7-47bf-a8b9-dca8903f1228 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:29.747227 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dcd7a9b0-cbc7-47bf-a8b9-dca8903f1228 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:29.882354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dcd7a9b0-cbc7-47bf-a8b9-dca8903f1228 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:29.890209 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dcd7a9b0-cbc7-47bf-a8b9-dca8903f1228 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1564 microversion: 2.1 time: 0.159034 Oct 11 05:44:29.890771 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3956/8143] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:29 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1564 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:29.912342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ae0f5330-fb13-4dd9-ab02-449712202447 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:29.913006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ae0f5330-fb13-4dd9-ab02-449712202447 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:29.920365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae0f5330-fb13-4dd9-ab02-449712202447 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:29.920864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae0f5330-fb13-4dd9-ab02-449712202447 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:29.921318 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae0f5330-fb13-4dd9-ab02-449712202447 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:29.922041 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae0f5330-fb13-4dd9-ab02-449712202447 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:29.922541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae0f5330-fb13-4dd9-ab02-449712202447 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:29.922988 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ae0f5330-fb13-4dd9-ab02-449712202447 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:30.057897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ae0f5330-fb13-4dd9-ab02-449712202447 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:30.065684 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ae0f5330-fb13-4dd9-ab02-449712202447 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1564 microversion: 2.1 time: 0.157253 Oct 11 05:44:30.066286 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4188/8144] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:29 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1564 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:44:32.220988 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-83210513-f6b3-4657-8bb7-fec1eb82960b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:44:32.221612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-83210513-f6b3-4657-8bb7-fec1eb82960b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:44:32.223085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-43e52c06-42e2-4918-acb4-524e961875f3 req-3f682222-30dd-4066-a273-1ac4f0a33f3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7bdb02-be87-43a3-9115-91df2206118a", "tag": "caaaa901-ddd6-4400-98c7-4f296aba77c3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:44:32.228931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83210513-f6b3-4657-8bb7-fec1eb82960b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:32.231802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83210513-f6b3-4657-8bb7-fec1eb82960b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:32.231802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83210513-f6b3-4657-8bb7-fec1eb82960b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:32.231802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83210513-f6b3-4657-8bb7-fec1eb82960b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:32.231802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83210513-f6b3-4657-8bb7-fec1eb82960b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:32.231802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-83210513-f6b3-4657-8bb7-fec1eb82960b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:32.233674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:44:32.235522 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-43e52c06-42e2-4918-acb4-524e961875f3 req-3f682222-30dd-4066-a273-1ac4f0a33f3f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:44:32.236210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-43e52c06-42e2-4918-acb4-524e961875f3 req-3f682222-30dd-4066-a273-1ac4f0a33f3f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:44:32.236662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-43e52c06-42e2-4918-acb4-524e961875f3 req-3f682222-30dd-4066-a273-1ac4f0a33f3f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:44:32.249689 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-43e52c06-42e2-4918-acb4-524e961875f3 req-3f682222-30dd-4066-a273-1ac4f0a33f3f service nova] Creating event network-changed:caaaa901-ddd6-4400-98c7-4f296aba77c3 for instance 3d7bdb02-be87-43a3-9115-91df2206118a on n-h1-860892-1 Oct 11 05:44:32.255045 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-43e52c06-42e2-4918-acb4-524e961875f3 req-3f682222-30dd-4066-a273-1ac4f0a33f3f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035468 Oct 11 05:44:32.259141 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4189/8145] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:44:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:44:32.379708 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-83210513-f6b3-4657-8bb7-fec1eb82960b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:44:32.389274 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-83210513-f6b3-4657-8bb7-fec1eb82960b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1564 microversion: 2.1 time: 0.172468 Oct 11 05:44:32.390025 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3957/8146] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:44:32 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1564 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:05.673989 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=46 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:45:05.678718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-903b614b-0b44-4bf5-b6e4-5e0e08c2bced tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:45:05.681113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-903b614b-0b44-4bf5-b6e4-5e0e08c2bced tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:05.687478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-903b614b-0b44-4bf5-b6e4-5e0e08c2bced tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:05.687966 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-903b614b-0b44-4bf5-b6e4-5e0e08c2bced tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:05.688417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-903b614b-0b44-4bf5-b6e4-5e0e08c2bced tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:05.689106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-903b614b-0b44-4bf5-b6e4-5e0e08c2bced tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:05.689568 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-903b614b-0b44-4bf5-b6e4-5e0e08c2bced tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:05.690003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-903b614b-0b44-4bf5-b6e4-5e0e08c2bced tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:05.740681 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-903b614b-0b44-4bf5-b6e4-5e0e08c2bced tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a/action" status: 200 len: 24566 microversion: 2.1 time: 0.068454 Oct 11 05:45:05.741353 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4190/8147] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:45:05 2022] POST /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a/action => generated 24566 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:45:36.210855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=7 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:45:36.211612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=34 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:45:36.267340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "451"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:45:36.269695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:36.276789 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:36.277267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:36.277692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:36.278415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:36.278860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:36.279280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:36.362833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:36.369002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Old instance type m1.heat2, new instance type m1.heat {{(pid=120993) resize /opt/stack/nova/nova/compute/api.py:4220}} Oct 11 05:45:36.375579 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:45:36.375999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:45:36.376469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:45:36.376887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:45:36.377293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:45:36.592616 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [790fba40-e25d-493f-a79e-7c9f164f0720] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:45:37.600044 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [790fba40-e25d-493f-a79e-7c9f164f0720] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 40846. Oct 11 05:45:37.603222 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ba5c498c-e784-4ba6-a723-d7779cb883ba tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a/action" status: 202 len: 0 microversion: 2.1 time: 1.394985 Oct 11 05:45:37.603843 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3958/8148] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:45:36 2022] POST /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a/action => generated 0 bytes in 1396 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:45:37.612548 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce0fcaa8-90a9-4c78-90a2-59ba7a222d24 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:37.613252 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce0fcaa8-90a9-4c78-90a2-59ba7a222d24 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:37.616278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=4 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:45:37.622370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0fcaa8-90a9-4c78-90a2-59ba7a222d24 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:37.622866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0fcaa8-90a9-4c78-90a2-59ba7a222d24 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:37.623317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0fcaa8-90a9-4c78-90a2-59ba7a222d24 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:37.624078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0fcaa8-90a9-4c78-90a2-59ba7a222d24 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:37.624541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0fcaa8-90a9-4c78-90a2-59ba7a222d24 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:37.624979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce0fcaa8-90a9-4c78-90a2-59ba7a222d24 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:37.763887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce0fcaa8-90a9-4c78-90a2-59ba7a222d24 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:37.773460 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce0fcaa8-90a9-4c78-90a2-59ba7a222d24 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1692 microversion: 2.1 time: 0.163440 Oct 11 05:45:37.773460 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4191/8149] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:37 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1692 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:38.798094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-baf70a13-707f-4d3e-a211-da48a5f278cd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:38.798784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-baf70a13-707f-4d3e-a211-da48a5f278cd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:38.805838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baf70a13-707f-4d3e-a211-da48a5f278cd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:38.806363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baf70a13-707f-4d3e-a211-da48a5f278cd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:38.806805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baf70a13-707f-4d3e-a211-da48a5f278cd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:38.807498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baf70a13-707f-4d3e-a211-da48a5f278cd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:38.807950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baf70a13-707f-4d3e-a211-da48a5f278cd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:38.808377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-baf70a13-707f-4d3e-a211-da48a5f278cd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:38.938743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-baf70a13-707f-4d3e-a211-da48a5f278cd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:38.947083 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-baf70a13-707f-4d3e-a211-da48a5f278cd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1692 microversion: 2.1 time: 0.153951 Oct 11 05:45:38.947659 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3959/8150] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:38 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1692 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:39.971466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a0dc7327-2cf2-43a4-8a09-81dc6bc39ac5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:39.972002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a0dc7327-2cf2-43a4-8a09-81dc6bc39ac5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:39.978908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0dc7327-2cf2-43a4-8a09-81dc6bc39ac5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:39.979414 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0dc7327-2cf2-43a4-8a09-81dc6bc39ac5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:39.979871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0dc7327-2cf2-43a4-8a09-81dc6bc39ac5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:39.980579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0dc7327-2cf2-43a4-8a09-81dc6bc39ac5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:39.981058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0dc7327-2cf2-43a4-8a09-81dc6bc39ac5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:39.981506 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a0dc7327-2cf2-43a4-8a09-81dc6bc39ac5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:40.110674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a0dc7327-2cf2-43a4-8a09-81dc6bc39ac5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:40.118376 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a0dc7327-2cf2-43a4-8a09-81dc6bc39ac5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1692 microversion: 2.1 time: 0.151031 Oct 11 05:45:40.118951 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4192/8151] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:39 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1692 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:41.142492 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-aeb33cd1-63b4-4450-ba8f-d958e9cf71e7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:41.143123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-aeb33cd1-63b4-4450-ba8f-d958e9cf71e7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:41.150951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeb33cd1-63b4-4450-ba8f-d958e9cf71e7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:41.152677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeb33cd1-63b4-4450-ba8f-d958e9cf71e7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:41.152677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeb33cd1-63b4-4450-ba8f-d958e9cf71e7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:41.152677 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeb33cd1-63b4-4450-ba8f-d958e9cf71e7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:41.153068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeb33cd1-63b4-4450-ba8f-d958e9cf71e7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:41.153410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-aeb33cd1-63b4-4450-ba8f-d958e9cf71e7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:41.282380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-aeb33cd1-63b4-4450-ba8f-d958e9cf71e7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:41.290417 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-aeb33cd1-63b4-4450-ba8f-d958e9cf71e7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1692 microversion: 2.1 time: 0.151848 Oct 11 05:45:41.290976 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3960/8152] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:41 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1692 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:42.314365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6f2dca5c-d091-4fec-97de-7969102ac432 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:42.315003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6f2dca5c-d091-4fec-97de-7969102ac432 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:42.322573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f2dca5c-d091-4fec-97de-7969102ac432 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:42.323069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f2dca5c-d091-4fec-97de-7969102ac432 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:42.323518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f2dca5c-d091-4fec-97de-7969102ac432 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:42.324218 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f2dca5c-d091-4fec-97de-7969102ac432 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:42.324685 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f2dca5c-d091-4fec-97de-7969102ac432 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:42.325124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6f2dca5c-d091-4fec-97de-7969102ac432 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:42.457001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6f2dca5c-d091-4fec-97de-7969102ac432 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:42.465463 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6f2dca5c-d091-4fec-97de-7969102ac432 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1692 microversion: 2.1 time: 0.155061 Oct 11 05:45:42.466030 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4193/8153] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:42 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:43.489851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e4a0b34f-7795-4792-b3ce-5f0d9c1ced3d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:43.490549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e4a0b34f-7795-4792-b3ce-5f0d9c1ced3d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:43.498062 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a0b34f-7795-4792-b3ce-5f0d9c1ced3d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:43.498590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a0b34f-7795-4792-b3ce-5f0d9c1ced3d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:43.499040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a0b34f-7795-4792-b3ce-5f0d9c1ced3d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:43.500384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a0b34f-7795-4792-b3ce-5f0d9c1ced3d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:43.500859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a0b34f-7795-4792-b3ce-5f0d9c1ced3d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:43.501489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4a0b34f-7795-4792-b3ce-5f0d9c1ced3d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:43.655873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e4a0b34f-7795-4792-b3ce-5f0d9c1ced3d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:43.665236 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e4a0b34f-7795-4792-b3ce-5f0d9c1ced3d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1692 microversion: 2.1 time: 0.179284 Oct 11 05:45:43.665366 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3961/8154] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:43 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1692 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:44.687202 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d093d400-88e7-46c9-9972-7a57cbbf74dd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:44.687731 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d093d400-88e7-46c9-9972-7a57cbbf74dd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:44.694687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d093d400-88e7-46c9-9972-7a57cbbf74dd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:44.695183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d093d400-88e7-46c9-9972-7a57cbbf74dd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:44.698657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d093d400-88e7-46c9-9972-7a57cbbf74dd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:44.698657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d093d400-88e7-46c9-9972-7a57cbbf74dd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:44.698657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d093d400-88e7-46c9-9972-7a57cbbf74dd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:44.698657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d093d400-88e7-46c9-9972-7a57cbbf74dd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:44.828755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d093d400-88e7-46c9-9972-7a57cbbf74dd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:44.837628 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d093d400-88e7-46c9-9972-7a57cbbf74dd tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1692 microversion: 2.1 time: 0.154418 Oct 11 05:45:44.841968 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4194/8155] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:44 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1692 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:45:45.860830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3167cfe1-6458-4201-a7cf-221a843a063c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:45.861482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3167cfe1-6458-4201-a7cf-221a843a063c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:45.868907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3167cfe1-6458-4201-a7cf-221a843a063c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:45.869393 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3167cfe1-6458-4201-a7cf-221a843a063c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:45.869833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3167cfe1-6458-4201-a7cf-221a843a063c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:45.870636 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3167cfe1-6458-4201-a7cf-221a843a063c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:45.871096 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3167cfe1-6458-4201-a7cf-221a843a063c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:45.871531 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3167cfe1-6458-4201-a7cf-221a843a063c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:46.006083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3167cfe1-6458-4201-a7cf-221a843a063c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:46.014703 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3167cfe1-6458-4201-a7cf-221a843a063c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1697 microversion: 2.1 time: 0.157679 Oct 11 05:45:46.015284 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3962/8156] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:45 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:47.040055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-aec765bd-7eb5-456d-b416-25e363a3a494 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:47.040819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-aec765bd-7eb5-456d-b416-25e363a3a494 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:47.047667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aec765bd-7eb5-456d-b416-25e363a3a494 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:47.048493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aec765bd-7eb5-456d-b416-25e363a3a494 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:47.048996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aec765bd-7eb5-456d-b416-25e363a3a494 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:47.049706 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aec765bd-7eb5-456d-b416-25e363a3a494 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:47.050415 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aec765bd-7eb5-456d-b416-25e363a3a494 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:47.050887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-aec765bd-7eb5-456d-b416-25e363a3a494 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:47.254776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-aec765bd-7eb5-456d-b416-25e363a3a494 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:47.264036 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-aec765bd-7eb5-456d-b416-25e363a3a494 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1697 microversion: 2.1 time: 0.228247 Oct 11 05:45:47.264722 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4195/8157] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:47 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1697 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:48.289004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c4b6742a-e661-450f-81d3-11cb0293a84a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:48.289622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c4b6742a-e661-450f-81d3-11cb0293a84a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:48.296619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b6742a-e661-450f-81d3-11cb0293a84a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:48.297104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b6742a-e661-450f-81d3-11cb0293a84a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:48.297544 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b6742a-e661-450f-81d3-11cb0293a84a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:48.298257 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b6742a-e661-450f-81d3-11cb0293a84a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:48.298713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b6742a-e661-450f-81d3-11cb0293a84a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:48.299145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c4b6742a-e661-450f-81d3-11cb0293a84a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:48.432846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c4b6742a-e661-450f-81d3-11cb0293a84a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:48.440914 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c4b6742a-e661-450f-81d3-11cb0293a84a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1697 microversion: 2.1 time: 0.156348 Oct 11 05:45:48.441501 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3963/8158] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:48 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1697 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:49.465212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d46624ec-e0a4-493d-ad41-fb2d32e358f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:49.465924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d46624ec-e0a4-493d-ad41-fb2d32e358f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:49.473002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46624ec-e0a4-493d-ad41-fb2d32e358f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:49.473495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46624ec-e0a4-493d-ad41-fb2d32e358f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:49.476286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46624ec-e0a4-493d-ad41-fb2d32e358f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:49.476286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46624ec-e0a4-493d-ad41-fb2d32e358f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:49.476286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46624ec-e0a4-493d-ad41-fb2d32e358f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:49.476286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d46624ec-e0a4-493d-ad41-fb2d32e358f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:49.611331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d46624ec-e0a4-493d-ad41-fb2d32e358f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:49.619408 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d46624ec-e0a4-493d-ad41-fb2d32e358f4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1697 microversion: 2.1 time: 0.158113 Oct 11 05:45:49.619987 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4196/8159] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:49 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1697 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:50.641865 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7f8cb462-da05-4210-93d7-3556d2fd63ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:50.642505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7f8cb462-da05-4210-93d7-3556d2fd63ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:50.649553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f8cb462-da05-4210-93d7-3556d2fd63ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:50.650039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f8cb462-da05-4210-93d7-3556d2fd63ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:50.650506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f8cb462-da05-4210-93d7-3556d2fd63ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:50.651204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f8cb462-da05-4210-93d7-3556d2fd63ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:50.651659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f8cb462-da05-4210-93d7-3556d2fd63ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:50.652088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7f8cb462-da05-4210-93d7-3556d2fd63ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:50.788629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7f8cb462-da05-4210-93d7-3556d2fd63ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:50.795440 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7f8cb462-da05-4210-93d7-3556d2fd63ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1697 microversion: 2.1 time: 0.157498 Oct 11 05:45:50.795999 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3964/8160] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:50 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1697 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:51.820126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-409320db-8d1a-4bd7-addf-cf0d72f78a26 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:51.820754 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-409320db-8d1a-4bd7-addf-cf0d72f78a26 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:51.827597 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-409320db-8d1a-4bd7-addf-cf0d72f78a26 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:51.828101 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-409320db-8d1a-4bd7-addf-cf0d72f78a26 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:51.828555 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-409320db-8d1a-4bd7-addf-cf0d72f78a26 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:51.829263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-409320db-8d1a-4bd7-addf-cf0d72f78a26 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:51.829732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-409320db-8d1a-4bd7-addf-cf0d72f78a26 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:51.830175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-409320db-8d1a-4bd7-addf-cf0d72f78a26 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:51.958499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-409320db-8d1a-4bd7-addf-cf0d72f78a26 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:51.966488 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-409320db-8d1a-4bd7-addf-cf0d72f78a26 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1697 microversion: 2.1 time: 0.150917 Oct 11 05:45:51.967060 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4197/8161] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:51 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1697 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:52.989000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-572ba6d0-de60-484f-a192-4e22737b23e9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:52.989619 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-572ba6d0-de60-484f-a192-4e22737b23e9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:52.996672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-572ba6d0-de60-484f-a192-4e22737b23e9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:52.997158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-572ba6d0-de60-484f-a192-4e22737b23e9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:52.997599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-572ba6d0-de60-484f-a192-4e22737b23e9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:52.998463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-572ba6d0-de60-484f-a192-4e22737b23e9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:52.998921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-572ba6d0-de60-484f-a192-4e22737b23e9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:52.999350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-572ba6d0-de60-484f-a192-4e22737b23e9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:53.131396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-572ba6d0-de60-484f-a192-4e22737b23e9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:53.139993 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-572ba6d0-de60-484f-a192-4e22737b23e9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1697 microversion: 2.1 time: 0.155049 Oct 11 05:45:53.140759 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3965/8162] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:52 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:54.163745 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1b6166bb-2bec-4101-afb7-5db050020364 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:54.164366 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1b6166bb-2bec-4101-afb7-5db050020364 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:54.171207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b6166bb-2bec-4101-afb7-5db050020364 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:54.171701 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b6166bb-2bec-4101-afb7-5db050020364 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:54.172150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b6166bb-2bec-4101-afb7-5db050020364 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:54.172845 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b6166bb-2bec-4101-afb7-5db050020364 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:54.173310 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b6166bb-2bec-4101-afb7-5db050020364 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:54.173749 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1b6166bb-2bec-4101-afb7-5db050020364 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:54.306927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1b6166bb-2bec-4101-afb7-5db050020364 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:54.314745 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1b6166bb-2bec-4101-afb7-5db050020364 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1697 microversion: 2.1 time: 0.154913 Oct 11 05:45:54.315324 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4198/8163] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:54 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:55.339279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c600af15-9ab7-4015-b95d-b22cc530e51e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:55.339895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c600af15-9ab7-4015-b95d-b22cc530e51e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:55.346743 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c600af15-9ab7-4015-b95d-b22cc530e51e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:55.347220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c600af15-9ab7-4015-b95d-b22cc530e51e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:55.347657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c600af15-9ab7-4015-b95d-b22cc530e51e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:55.348344 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c600af15-9ab7-4015-b95d-b22cc530e51e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:55.348794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c600af15-9ab7-4015-b95d-b22cc530e51e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:55.349219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c600af15-9ab7-4015-b95d-b22cc530e51e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:55.482023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c600af15-9ab7-4015-b95d-b22cc530e51e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:55.489842 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c600af15-9ab7-4015-b95d-b22cc530e51e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1697 microversion: 2.1 time: 0.155044 Oct 11 05:45:55.490449 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3966/8164] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:55 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1697 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:56.513473 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-dc745b13-5f8c-4d57-85cd-44ea84e70cc7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:56.514263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-dc745b13-5f8c-4d57-85cd-44ea84e70cc7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:56.521103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc745b13-5f8c-4d57-85cd-44ea84e70cc7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:56.521602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc745b13-5f8c-4d57-85cd-44ea84e70cc7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:56.522056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc745b13-5f8c-4d57-85cd-44ea84e70cc7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:56.523521 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc745b13-5f8c-4d57-85cd-44ea84e70cc7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:56.523986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc745b13-5f8c-4d57-85cd-44ea84e70cc7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:56.524457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-dc745b13-5f8c-4d57-85cd-44ea84e70cc7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:56.663088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-dc745b13-5f8c-4d57-85cd-44ea84e70cc7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:56.671290 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-dc745b13-5f8c-4d57-85cd-44ea84e70cc7 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1697 microversion: 2.1 time: 0.161709 Oct 11 05:45:56.671859 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4199/8165] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:56 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1697 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:57.620803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-757fe9ed-ae92-47d5-8e54-70617ee8e454 req-3b79b7bd-a8a4-48fe-b08f-2e6c4f66c57d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7bdb02-be87-43a3-9115-91df2206118a", "name": "network-vif-unplugged", "status": "completed", "tag": "caaaa901-ddd6-4400-98c7-4f296aba77c3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:45:57.630353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-757fe9ed-ae92-47d5-8e54-70617ee8e454 req-3b79b7bd-a8a4-48fe-b08f-2e6c4f66c57d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:57.630831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-757fe9ed-ae92-47d5-8e54-70617ee8e454 req-3b79b7bd-a8a4-48fe-b08f-2e6c4f66c57d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:57.631270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-757fe9ed-ae92-47d5-8e54-70617ee8e454 req-3b79b7bd-a8a4-48fe-b08f-2e6c4f66c57d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:57.643027 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-757fe9ed-ae92-47d5-8e54-70617ee8e454 req-3b79b7bd-a8a4-48fe-b08f-2e6c4f66c57d service nova] Creating event network-vif-unplugged:caaaa901-ddd6-4400-98c7-4f296aba77c3 for instance 3d7bdb02-be87-43a3-9115-91df2206118a on n-h2-860892-1 Oct 11 05:45:57.648583 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [req-757fe9ed-ae92-47d5-8e54-70617ee8e454 req-3b79b7bd-a8a4-48fe-b08f-2e6c4f66c57d service nova] Instance 3d7bdb02-be87-43a3-9115-91df2206118a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120993) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:45:57.659366 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-757fe9ed-ae92-47d5-8e54-70617ee8e454 req-3b79b7bd-a8a4-48fe-b08f-2e6c4f66c57d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.098553 Oct 11 05:45:57.659956 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3967/8166] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:45:57.694606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bb0f4753-56e4-47d7-935e-75ff96937a7b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:57.695334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bb0f4753-56e4-47d7-935e-75ff96937a7b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:57.703563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb0f4753-56e4-47d7-935e-75ff96937a7b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:57.704074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb0f4753-56e4-47d7-935e-75ff96937a7b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:57.705810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb0f4753-56e4-47d7-935e-75ff96937a7b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:57.705810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb0f4753-56e4-47d7-935e-75ff96937a7b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:57.705810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb0f4753-56e4-47d7-935e-75ff96937a7b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:57.706399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bb0f4753-56e4-47d7-935e-75ff96937a7b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:57.928482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bb0f4753-56e4-47d7-935e-75ff96937a7b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:57.937134 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bb0f4753-56e4-47d7-935e-75ff96937a7b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1696 microversion: 2.1 time: 0.246380 Oct 11 05:45:57.937716 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4200/8167] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:57 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1696 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:58.964552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-81cb2845-abdf-4602-ae8e-b579d30f17e3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:45:58.965283 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-81cb2845-abdf-4602-ae8e-b579d30f17e3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:45:58.972068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81cb2845-abdf-4602-ae8e-b579d30f17e3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:58.973512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81cb2845-abdf-4602-ae8e-b579d30f17e3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:58.973512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81cb2845-abdf-4602-ae8e-b579d30f17e3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:58.973734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81cb2845-abdf-4602-ae8e-b579d30f17e3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:58.974127 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81cb2845-abdf-4602-ae8e-b579d30f17e3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:58.974586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-81cb2845-abdf-4602-ae8e-b579d30f17e3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:59.110540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-81cb2845-abdf-4602-ae8e-b579d30f17e3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:45:59.118950 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-81cb2845-abdf-4602-ae8e-b579d30f17e3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1696 microversion: 2.1 time: 0.161690 Oct 11 05:45:59.119619 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3968/8168] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:45:58 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1696 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:45:59.675027 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-26fa308a-e54c-43ae-88df-f973cb219421 req-2f73e387-e660-4733-9ed4-dad27e4ff2a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7bdb02-be87-43a3-9115-91df2206118a", "tag": "caaaa901-ddd6-4400-98c7-4f296aba77c3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:45:59.686076 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-26fa308a-e54c-43ae-88df-f973cb219421 req-2f73e387-e660-4733-9ed4-dad27e4ff2a6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:45:59.691861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-26fa308a-e54c-43ae-88df-f973cb219421 req-2f73e387-e660-4733-9ed4-dad27e4ff2a6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:45:59.691861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-26fa308a-e54c-43ae-88df-f973cb219421 req-2f73e387-e660-4733-9ed4-dad27e4ff2a6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:45:59.698519 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-26fa308a-e54c-43ae-88df-f973cb219421 req-2f73e387-e660-4733-9ed4-dad27e4ff2a6 service nova] Creating event network-changed:caaaa901-ddd6-4400-98c7-4f296aba77c3 for instance 3d7bdb02-be87-43a3-9115-91df2206118a on n-h2-860892-1 Oct 11 05:45:59.703910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [req-26fa308a-e54c-43ae-88df-f973cb219421 req-2f73e387-e660-4733-9ed4-dad27e4ff2a6 service nova] Instance 3d7bdb02-be87-43a3-9115-91df2206118a is migrating within the same cell, copying events to all relevant hosts: {'n-h1-860892-1', 'n-h2-860892-1'} {{(pid=120994) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5938}} Oct 11 05:45:59.714836 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-26fa308a-e54c-43ae-88df-f973cb219421 req-2f73e387-e660-4733-9ed4-dad27e4ff2a6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043808 Oct 11 05:45:59.715455 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4201/8169] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:46:00.143219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4520ad53-46ea-41cb-917a-689a09d60b96 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:00.143786 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4520ad53-46ea-41cb-917a-689a09d60b96 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:00.151678 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4520ad53-46ea-41cb-917a-689a09d60b96 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:00.152164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4520ad53-46ea-41cb-917a-689a09d60b96 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:00.152602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4520ad53-46ea-41cb-917a-689a09d60b96 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:00.153306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4520ad53-46ea-41cb-917a-689a09d60b96 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:00.153757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4520ad53-46ea-41cb-917a-689a09d60b96 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:00.154181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4520ad53-46ea-41cb-917a-689a09d60b96 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:00.299231 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4520ad53-46ea-41cb-917a-689a09d60b96 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:00.307299 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4520ad53-46ea-41cb-917a-689a09d60b96 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1694 microversion: 2.1 time: 0.168158 Oct 11 05:46:00.307897 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3969/8170] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:00 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1694 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:01.332466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d4bdf0c3-b1ed-4260-ad8f-0e1a15cea94e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:01.333498 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d4bdf0c3-b1ed-4260-ad8f-0e1a15cea94e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:01.340673 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4bdf0c3-b1ed-4260-ad8f-0e1a15cea94e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:01.341168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4bdf0c3-b1ed-4260-ad8f-0e1a15cea94e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:01.341616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4bdf0c3-b1ed-4260-ad8f-0e1a15cea94e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:01.342351 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4bdf0c3-b1ed-4260-ad8f-0e1a15cea94e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:01.342820 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4bdf0c3-b1ed-4260-ad8f-0e1a15cea94e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:01.343273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d4bdf0c3-b1ed-4260-ad8f-0e1a15cea94e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:01.481283 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d4bdf0c3-b1ed-4260-ad8f-0e1a15cea94e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:01.489258 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d4bdf0c3-b1ed-4260-ad8f-0e1a15cea94e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1691 microversion: 2.1 time: 0.160984 Oct 11 05:46:01.489846 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4202/8171] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:01 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1691 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:01.511842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3ea28e13-62c6-4814-bb66-f02878bd2ac3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:46:01.512431 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3ea28e13-62c6-4814-bb66-f02878bd2ac3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:01.520356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ea28e13-62c6-4814-bb66-f02878bd2ac3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:01.520356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ea28e13-62c6-4814-bb66-f02878bd2ac3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:01.520356 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ea28e13-62c6-4814-bb66-f02878bd2ac3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:01.520947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ea28e13-62c6-4814-bb66-f02878bd2ac3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:01.521432 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ea28e13-62c6-4814-bb66-f02878bd2ac3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:01.521835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3ea28e13-62c6-4814-bb66-f02878bd2ac3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:01.846371 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3ea28e13-62c6-4814-bb66-f02878bd2ac3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a/action" status: 204 len: 0 microversion: 2.1 time: 0.338245 Oct 11 05:46:01.847063 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3970/8172] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:46:01 2022] POST /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a/action => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:46:01.855373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fce415fa-f948-45d9-a9ef-c2a80714716d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:01.856060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fce415fa-f948-45d9-a9ef-c2a80714716d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:01.862074 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fce415fa-f948-45d9-a9ef-c2a80714716d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:01.867359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fce415fa-f948-45d9-a9ef-c2a80714716d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:01.867359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fce415fa-f948-45d9-a9ef-c2a80714716d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:01.867359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fce415fa-f948-45d9-a9ef-c2a80714716d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:01.867359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fce415fa-f948-45d9-a9ef-c2a80714716d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:01.867359 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fce415fa-f948-45d9-a9ef-c2a80714716d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:02.032369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fce415fa-f948-45d9-a9ef-c2a80714716d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:02.040294 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fce415fa-f948-45d9-a9ef-c2a80714716d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1691 microversion: 2.1 time: 0.188866 Oct 11 05:46:02.040881 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4203/8173] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:01 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1691 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:02.062968 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-32217e9e-9613-455e-91f3-ab1d08cff98e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:02.063705 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-32217e9e-9613-455e-91f3-ab1d08cff98e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:02.069965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32217e9e-9613-455e-91f3-ab1d08cff98e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:02.070504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32217e9e-9613-455e-91f3-ab1d08cff98e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:02.070940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32217e9e-9613-455e-91f3-ab1d08cff98e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:02.071634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32217e9e-9613-455e-91f3-ab1d08cff98e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:02.072086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32217e9e-9613-455e-91f3-ab1d08cff98e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:02.073036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32217e9e-9613-455e-91f3-ab1d08cff98e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:02.213372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-32217e9e-9613-455e-91f3-ab1d08cff98e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:02.222017 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-32217e9e-9613-455e-91f3-ab1d08cff98e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1691 microversion: 2.1 time: 0.163259 Oct 11 05:46:02.222638 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3971/8174] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:02 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1691 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:46:03.244910 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b366d87d-94d0-4e84-ae48-95bfbff601ae tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:03.246083 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b366d87d-94d0-4e84-ae48-95bfbff601ae tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:03.253233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b366d87d-94d0-4e84-ae48-95bfbff601ae tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:03.253739 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b366d87d-94d0-4e84-ae48-95bfbff601ae tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:03.254231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b366d87d-94d0-4e84-ae48-95bfbff601ae tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:03.254951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b366d87d-94d0-4e84-ae48-95bfbff601ae tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:03.255421 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b366d87d-94d0-4e84-ae48-95bfbff601ae tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:03.255864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b366d87d-94d0-4e84-ae48-95bfbff601ae tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:03.394932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b366d87d-94d0-4e84-ae48-95bfbff601ae tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:03.403089 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b366d87d-94d0-4e84-ae48-95bfbff601ae tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1691 microversion: 2.1 time: 0.162134 Oct 11 05:46:03.403670 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4204/8175] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:03 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1691 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:04.427673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-73c3ba93-6f34-4e69-aa39-60a7ddf8c012 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:04.428292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73c3ba93-6f34-4e69-aa39-60a7ddf8c012 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:04.435776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73c3ba93-6f34-4e69-aa39-60a7ddf8c012 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:04.436265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73c3ba93-6f34-4e69-aa39-60a7ddf8c012 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:04.436707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73c3ba93-6f34-4e69-aa39-60a7ddf8c012 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:04.437401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73c3ba93-6f34-4e69-aa39-60a7ddf8c012 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:04.437862 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73c3ba93-6f34-4e69-aa39-60a7ddf8c012 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:04.438318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73c3ba93-6f34-4e69-aa39-60a7ddf8c012 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:04.453940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:46:04.544572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-34ccd7a0-3cb4-4973-97a6-3d7f84983d27 req-aad378f4-611f-420b-81cf-7cd09c32c0ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7bdb02-be87-43a3-9115-91df2206118a", "name": "network-vif-plugged", "status": "completed", "tag": "caaaa901-ddd6-4400-98c7-4f296aba77c3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:46:04.554064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-34ccd7a0-3cb4-4973-97a6-3d7f84983d27 req-aad378f4-611f-420b-81cf-7cd09c32c0ca service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:04.554859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-34ccd7a0-3cb4-4973-97a6-3d7f84983d27 req-aad378f4-611f-420b-81cf-7cd09c32c0ca service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:04.555309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-34ccd7a0-3cb4-4973-97a6-3d7f84983d27 req-aad378f4-611f-420b-81cf-7cd09c32c0ca service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:04.567471 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-34ccd7a0-3cb4-4973-97a6-3d7f84983d27 req-aad378f4-611f-420b-81cf-7cd09c32c0ca service nova] Creating event network-vif-plugged:caaaa901-ddd6-4400-98c7-4f296aba77c3 for instance 3d7bdb02-be87-43a3-9115-91df2206118a on n-h2-860892-1 Oct 11 05:46:04.572703 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-34ccd7a0-3cb4-4973-97a6-3d7f84983d27 req-aad378f4-611f-420b-81cf-7cd09c32c0ca service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088746 Oct 11 05:46:04.575608 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4205/8176] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:46:04.578960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73c3ba93-6f34-4e69-aa39-60a7ddf8c012 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:04.586738 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-73c3ba93-6f34-4e69-aa39-60a7ddf8c012 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1683 microversion: 2.1 time: 0.163068 Oct 11 05:46:04.587325 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3972/8177] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:04 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:26.766443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=33 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:46:26.767213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=84 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:46:26.771431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-27d19b92-23cc-46ad-b2e9-c9a0865b8c4e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:46:26.773906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-27d19b92-23cc-46ad-b2e9-c9a0865b8c4e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:26.780552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27d19b92-23cc-46ad-b2e9-c9a0865b8c4e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:26.781049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27d19b92-23cc-46ad-b2e9-c9a0865b8c4e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:26.781505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27d19b92-23cc-46ad-b2e9-c9a0865b8c4e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:26.782241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27d19b92-23cc-46ad-b2e9-c9a0865b8c4e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:26.782714 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27d19b92-23cc-46ad-b2e9-c9a0865b8c4e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:26.793447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-27d19b92-23cc-46ad-b2e9-c9a0865b8c4e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:26.835024 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-27d19b92-23cc-46ad-b2e9-c9a0865b8c4e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a/action" status: 200 len: 24575 microversion: 2.1 time: 0.070602 Oct 11 05:46:26.835715 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4206/8178] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:46:26 2022] POST /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a/action => generated 24575 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:46:33.882374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-144c4315-666f-4036-858d-8d03ed6dbc42 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:33.882921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-144c4315-666f-4036-858d-8d03ed6dbc42 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:33.886208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-a45a6ccb-3fe4-47c5-843a-a5388cda5784 req-c580fd9c-06cc-475a-bd77-0c83d648cce0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d7bdb02-be87-43a3-9115-91df2206118a", "tag": "caaaa901-ddd6-4400-98c7-4f296aba77c3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:46:33.887631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=34 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:46:33.891178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c4315-666f-4036-858d-8d03ed6dbc42 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:33.891757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c4315-666f-4036-858d-8d03ed6dbc42 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:33.892261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c4315-666f-4036-858d-8d03ed6dbc42 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:33.893099 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c4315-666f-4036-858d-8d03ed6dbc42 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:33.893558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c4315-666f-4036-858d-8d03ed6dbc42 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:33.893983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-144c4315-666f-4036-858d-8d03ed6dbc42 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:33.897369 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a45a6ccb-3fe4-47c5-843a-a5388cda5784 req-c580fd9c-06cc-475a-bd77-0c83d648cce0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:33.898115 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a45a6ccb-3fe4-47c5-843a-a5388cda5784 req-c580fd9c-06cc-475a-bd77-0c83d648cce0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:33.898586 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-a45a6ccb-3fe4-47c5-843a-a5388cda5784 req-c580fd9c-06cc-475a-bd77-0c83d648cce0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:33.911203 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-a45a6ccb-3fe4-47c5-843a-a5388cda5784 req-c580fd9c-06cc-475a-bd77-0c83d648cce0 service nova] Creating event network-changed:caaaa901-ddd6-4400-98c7-4f296aba77c3 for instance 3d7bdb02-be87-43a3-9115-91df2206118a on n-h2-860892-1 Oct 11 05:46:33.916856 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-a45a6ccb-3fe4-47c5-843a-a5388cda5784 req-c580fd9c-06cc-475a-bd77-0c83d648cce0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035714 Oct 11 05:46:33.917461 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4207/8179] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:46:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 05:46:33.928023 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-144c4315-666f-4036-858d-8d03ed6dbc42 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:46:34.213488 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-144c4315-666f-4036-858d-8d03ed6dbc42 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "DELETE /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 204 len: 0 microversion: 2.1 time: 0.335142 Oct 11 05:46:34.219939 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3973/8180] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:46:33 2022] DELETE /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:46:34.224821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1d07b549-6f4d-4bbe-a2cd-c90fecc1c588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:34.225095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1d07b549-6f4d-4bbe-a2cd-c90fecc1c588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:34.231870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d07b549-6f4d-4bbe-a2cd-c90fecc1c588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:34.232391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d07b549-6f4d-4bbe-a2cd-c90fecc1c588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:34.232842 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d07b549-6f4d-4bbe-a2cd-c90fecc1c588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:34.233546 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d07b549-6f4d-4bbe-a2cd-c90fecc1c588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:34.234009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d07b549-6f4d-4bbe-a2cd-c90fecc1c588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:34.234468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1d07b549-6f4d-4bbe-a2cd-c90fecc1c588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:34.368775 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1d07b549-6f4d-4bbe-a2cd-c90fecc1c588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:34.377150 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1d07b549-6f4d-4bbe-a2cd-c90fecc1c588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1689 microversion: 2.1 time: 0.156939 Oct 11 05:46:34.377830 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4208/8181] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:34 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:46:35.401765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-54d0ddab-737e-4efd-bf7e-67a56af380d0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:35.403214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-54d0ddab-737e-4efd-bf7e-67a56af380d0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:35.410131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54d0ddab-737e-4efd-bf7e-67a56af380d0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:35.410655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54d0ddab-737e-4efd-bf7e-67a56af380d0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:35.411104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54d0ddab-737e-4efd-bf7e-67a56af380d0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:35.411810 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54d0ddab-737e-4efd-bf7e-67a56af380d0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:35.412279 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54d0ddab-737e-4efd-bf7e-67a56af380d0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:35.412713 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54d0ddab-737e-4efd-bf7e-67a56af380d0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:35.555230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-54d0ddab-737e-4efd-bf7e-67a56af380d0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:35.563133 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-54d0ddab-737e-4efd-bf7e-67a56af380d0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 200 len: 1689 microversion: 2.1 time: 0.165893 Oct 11 05:46:35.563724 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3974/8182] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:35 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:35.975831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-ffb4c070-e1ba-4025-b128-fe0880026a54 req-636b516b-8f56-447d-9d12-5c648a2d588c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d7bdb02-be87-43a3-9115-91df2206118a", "name": "network-vif-deleted", "tag": "caaaa901-ddd6-4400-98c7-4f296aba77c3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:46:35.989837 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ffb4c070-e1ba-4025-b128-fe0880026a54 req-636b516b-8f56-447d-9d12-5c648a2d588c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:35.990364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ffb4c070-e1ba-4025-b128-fe0880026a54 req-636b516b-8f56-447d-9d12-5c648a2d588c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:35.990805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-ffb4c070-e1ba-4025-b128-fe0880026a54 req-636b516b-8f56-447d-9d12-5c648a2d588c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:36.002000 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-ffb4c070-e1ba-4025-b128-fe0880026a54 req-636b516b-8f56-447d-9d12-5c648a2d588c service nova] Creating event network-vif-deleted:caaaa901-ddd6-4400-98c7-4f296aba77c3 for instance 3d7bdb02-be87-43a3-9115-91df2206118a on n-h2-860892-1 Oct 11 05:46:36.007376 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-ffb4c070-e1ba-4025-b128-fe0880026a54 req-636b516b-8f56-447d-9d12-5c648a2d588c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035230 Oct 11 05:46:36.008316 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4209/8183] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:46:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:46:36.587317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:36.587934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 3d7bdb02-be87-43a3-9115-91df2206118a] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:36.595189 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:36.595674 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:36.596146 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:36.596843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:36.597298 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:36.597729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:36.611784 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] HTTP exception thrown: Instance 3d7bdb02-be87-43a3-9115-91df2206118a could not be found. Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Request method failure captured: Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a HTTP/1.1 Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRQHS4piZqH1dure5OF-4uF_7UQtjJNzpk0Jb5Ez15iOAgJ05BhQLyncbupebXYDCjM4DCYwFt9xTz5GcJDwnQqgiCsLq8kZzuI3mHzfQAmmSu_E-hTu9Y6kmFjbTS9lLqk2rSkkeY6p8wGY24LmfuD8ig77EwFZZak6QxcZyePtclAY Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 44a5aa7caa7e495a84b2c0e677bda422 Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a5aa7caa7e495a84b2c0e677bda422"}]}] Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 44a5aa7caa7e495a84b2c0e677bda422 Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestNetworkAdvancedServerOps-165913187-project Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a263fe210f1d482797c0f803892098d6 Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestNetworkAdvancedServerOps-165913187-project Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 3d7bdb02-be87-43a3-9115-91df2206118a could not be found. Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '3d7bdb02-be87-43a3-9115-91df2206118a'} Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d7bdb02-be87-43a3-9115-91df2206118a could not be found. Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d7bdb02-be87-43a3-9115-91df2206118a could not be found. Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:46:36.613491 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:46:36.618950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:46:36.618950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:46:36.618950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:46:36.618950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:46:36.618950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:46:36.618950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:46:36.618950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d7bdb02-be87-43a3-9115-91df2206118a could not be found. Oct 11 05:46:36.618950 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:46:36.618950 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Returning 404 to user: Instance 3d7bdb02-be87-43a3-9115-91df2206118a could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:46:36.618950 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f1a14fa7-1bf3-4bc6-b0d1-f3e0f0b44982 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a" status: 404 len: 111 microversion: 2.1 time: 0.031619 Oct 11 05:46:36.618950 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3975/8184] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:36 2022] GET /compute/v2.1/servers/3d7bdb02-be87-43a3-9115-91df2206118a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:46:40.377816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-3ddd192e-d47a-443e-b31c-724b3cf8137d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '.version_select at 0x7fda19efa0d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:40.459342 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-3ddd192e-d47a-443e-b31c-724b3cf8137d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2066748389" status: 202 len: 0 microversion: 2.1 time: 0.085604 Oct 11 05:46:40.459889 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4210/8185] 10.222.0.26 () {58 vars in 1284 bytes} [Tue Oct 11 05:46:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-2066748389 => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:46:40.487577 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-14d872dd-08ba-427c-8ac2-14dad771cb6d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'create', calling method: .version_select at 0x7fda19a60f70>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-975440361", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMvRffBQM6og+K1/Pbm/Q+Zx7qcqlARDZHJPmh/JaoYMZP1NuaaR4VVi12NaxmAduhPhy4YdhgtwmRBZJwI5BL0VNKw2aKxlL4q6v5yTizFFLM6aGjc+4fT/Ii1Z09kb2Q=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:46:40.503770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-14d872dd-08ba-427c-8ac2-14dad771cb6d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:46:40.513622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-14d872dd-08ba-427c-8ac2-14dad771cb6d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for user a263fe210f1d482797c0f803892098d6 and project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:46:40.601218 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-14d872dd-08ba-427c-8ac2-14dad771cb6d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.117716 Oct 11 05:46:40.601839 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3976/8186] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:46:40 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:46:48.666019 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=14 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:46:48.668889 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-467440661", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "97e4c3a8-b641-48ab-9863-24991f8dcae4"}], "key_name": "tempest-TestNetworkAdvancedServerOps-975440361", "security_groups": [{"name": "tempest-secgroup-smoke-1909556029"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:46:48.807017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] validate_networks() for [('97e4c3a8-b641-48ab-9863-24991f8dcae4', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:46:49.321822 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:46:49.322268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:46:49.324392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:46:49.324830 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:46:49.325463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:46:49.337558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:49.337934 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:49.338873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:49.343903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:49.344746 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:49.345399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:49.371297 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:46:49.380198 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for user a263fe210f1d482797c0f803892098d6 and project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:46:49.400443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:46:49.403790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:46:49.551457 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [fd29477b-7ff7-42a6-b28e-e29182e151e8] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:46:50.559126 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [fd29477b-7ff7-42a6-b28e-e29182e151e8] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 41042. Oct 11 05:46:50.564395 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7bc8c293-5479-44d0-bcb2-65bf225c0c0d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.901852 Oct 11 05:46:50.565276 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4211/8187] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:46:48 2022] POST /compute/v2.1/servers => generated 406 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:46:50.575178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:46:50.579142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:46:50.579142 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:46:50.585171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff0b898a-6c63-4960-afd8-d05db3d247d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:50.586454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff0b898a-6c63-4960-afd8-d05db3d247d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:50.674364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ff0b898a-6c63-4960-afd8-d05db3d247d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:50.686857 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff0b898a-6c63-4960-afd8-d05db3d247d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1265 microversion: 2.1 time: 0.112187 Oct 11 05:46:50.688070 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3977/8188] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:50 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1265 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:51.710772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-32316a1d-b237-441a-9af6-1da0e811273a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:51.711512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-32316a1d-b237-441a-9af6-1da0e811273a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:51.719114 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32316a1d-b237-441a-9af6-1da0e811273a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:51.719605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32316a1d-b237-441a-9af6-1da0e811273a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:51.720053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32316a1d-b237-441a-9af6-1da0e811273a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:51.720744 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32316a1d-b237-441a-9af6-1da0e811273a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:51.721208 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32316a1d-b237-441a-9af6-1da0e811273a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:51.721670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-32316a1d-b237-441a-9af6-1da0e811273a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:51.783331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-32316a1d-b237-441a-9af6-1da0e811273a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:51.791769 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-32316a1d-b237-441a-9af6-1da0e811273a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1269 microversion: 2.1 time: 0.085765 Oct 11 05:46:51.792404 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4212/8189] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:51 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1269 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:52.815498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6199077d-0823-4da8-bb57-56530b2a2416 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:52.817035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6199077d-0823-4da8-bb57-56530b2a2416 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:52.825120 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6199077d-0823-4da8-bb57-56530b2a2416 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:52.825607 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6199077d-0823-4da8-bb57-56530b2a2416 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:52.826045 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6199077d-0823-4da8-bb57-56530b2a2416 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:52.826982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6199077d-0823-4da8-bb57-56530b2a2416 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:52.827425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6199077d-0823-4da8-bb57-56530b2a2416 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:52.828122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6199077d-0823-4da8-bb57-56530b2a2416 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:52.894568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6199077d-0823-4da8-bb57-56530b2a2416 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:52.902518 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6199077d-0823-4da8-bb57-56530b2a2416 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1335 microversion: 2.1 time: 0.090958 Oct 11 05:46:52.903128 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3978/8190] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:52 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1335 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:53.926075 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e905baa-1d10-49f8-b2cb-adf8a340b8ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:53.926726 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e905baa-1d10-49f8-b2cb-adf8a340b8ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:53.933655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e905baa-1d10-49f8-b2cb-adf8a340b8ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:53.937467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e905baa-1d10-49f8-b2cb-adf8a340b8ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:53.937467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e905baa-1d10-49f8-b2cb-adf8a340b8ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:53.937467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e905baa-1d10-49f8-b2cb-adf8a340b8ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:53.937467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e905baa-1d10-49f8-b2cb-adf8a340b8ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:53.937467 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e905baa-1d10-49f8-b2cb-adf8a340b8ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:54.144066 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e905baa-1d10-49f8-b2cb-adf8a340b8ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:54.152083 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e905baa-1d10-49f8-b2cb-adf8a340b8ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1391 microversion: 2.1 time: 0.230007 Oct 11 05:46:54.152652 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4213/8191] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:53 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1391 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:54.342250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-164441ad-daed-4ae9-b4e5-99cbd095e077 req-da401ba7-3a80-4d34-a27d-5434cfedf6d0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66690734-934a-4a2e-b2b2-7a49f404c067", "tag": "e0df809b-c15d-4b66-8cf6-47d433925028"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:46:54.353639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-164441ad-daed-4ae9-b4e5-99cbd095e077 req-da401ba7-3a80-4d34-a27d-5434cfedf6d0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:54.354121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-164441ad-daed-4ae9-b4e5-99cbd095e077 req-da401ba7-3a80-4d34-a27d-5434cfedf6d0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:54.354581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-164441ad-daed-4ae9-b4e5-99cbd095e077 req-da401ba7-3a80-4d34-a27d-5434cfedf6d0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:54.366519 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-164441ad-daed-4ae9-b4e5-99cbd095e077 req-da401ba7-3a80-4d34-a27d-5434cfedf6d0 service nova] Creating event network-changed:e0df809b-c15d-4b66-8cf6-47d433925028 for instance 66690734-934a-4a2e-b2b2-7a49f404c067 on n-h1-860892-1 Oct 11 05:46:54.372697 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-164441ad-daed-4ae9-b4e5-99cbd095e077 req-da401ba7-3a80-4d34-a27d-5434cfedf6d0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033759 Oct 11 05:46:54.373304 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3979/8192] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:46:55.175338 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-286cda68-9546-408c-b18d-3447c47a9278 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:55.175970 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-286cda68-9546-408c-b18d-3447c47a9278 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:55.183043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-286cda68-9546-408c-b18d-3447c47a9278 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:55.183545 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-286cda68-9546-408c-b18d-3447c47a9278 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:55.184004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-286cda68-9546-408c-b18d-3447c47a9278 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:55.184710 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-286cda68-9546-408c-b18d-3447c47a9278 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:55.185181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-286cda68-9546-408c-b18d-3447c47a9278 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:55.185624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-286cda68-9546-408c-b18d-3447c47a9278 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:55.314696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-286cda68-9546-408c-b18d-3447c47a9278 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:55.322433 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-286cda68-9546-408c-b18d-3447c47a9278 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1391 microversion: 2.1 time: 0.150972 Oct 11 05:46:55.323008 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4214/8193] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:55 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1391 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:56.346966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-036b058a-fb14-43e7-9cf9-99e4e078659f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:56.347668 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-036b058a-fb14-43e7-9cf9-99e4e078659f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:56.354791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-036b058a-fb14-43e7-9cf9-99e4e078659f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:56.355286 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-036b058a-fb14-43e7-9cf9-99e4e078659f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:56.355707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-036b058a-fb14-43e7-9cf9-99e4e078659f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:56.357309 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-036b058a-fb14-43e7-9cf9-99e4e078659f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:56.357760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-036b058a-fb14-43e7-9cf9-99e4e078659f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:56.358197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-036b058a-fb14-43e7-9cf9-99e4e078659f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:56.491436 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-036b058a-fb14-43e7-9cf9-99e4e078659f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:56.499081 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-036b058a-fb14-43e7-9cf9-99e4e078659f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1391 microversion: 2.1 time: 0.156792 Oct 11 05:46:56.499651 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3980/8194] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:56 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:57.522416 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7fa5677b-064f-4748-8fc6-77d16946e3d8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:57.523296 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7fa5677b-064f-4748-8fc6-77d16946e3d8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:57.525973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:46:57.530771 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fa5677b-064f-4748-8fc6-77d16946e3d8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:57.531261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fa5677b-064f-4748-8fc6-77d16946e3d8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:57.531704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fa5677b-064f-4748-8fc6-77d16946e3d8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:57.532397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fa5677b-064f-4748-8fc6-77d16946e3d8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:57.532858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fa5677b-064f-4748-8fc6-77d16946e3d8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:57.533292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7fa5677b-064f-4748-8fc6-77d16946e3d8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:57.673121 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7fa5677b-064f-4748-8fc6-77d16946e3d8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:57.680751 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7fa5677b-064f-4748-8fc6-77d16946e3d8 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1391 microversion: 2.1 time: 0.162234 Oct 11 05:46:57.681314 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4215/8195] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:57 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1391 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:58.703934 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4759784b-4af5-44f4-b71f-7613247dd8b0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:58.705859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4759784b-4af5-44f4-b71f-7613247dd8b0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:58.712022 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4759784b-4af5-44f4-b71f-7613247dd8b0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:58.712513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4759784b-4af5-44f4-b71f-7613247dd8b0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:58.712956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4759784b-4af5-44f4-b71f-7613247dd8b0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:58.713662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4759784b-4af5-44f4-b71f-7613247dd8b0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:58.714116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4759784b-4af5-44f4-b71f-7613247dd8b0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:58.714578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4759784b-4af5-44f4-b71f-7613247dd8b0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:58.851794 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4759784b-4af5-44f4-b71f-7613247dd8b0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:46:58.859683 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4759784b-4af5-44f4-b71f-7613247dd8b0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1391 microversion: 2.1 time: 0.160307 Oct 11 05:46:58.860757 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3981/8196] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:58 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1391 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:46:59.882670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9b2728a6-ac42-48dc-8e97-6176003a4d49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:46:59.883356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9b2728a6-ac42-48dc-8e97-6176003a4d49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:46:59.886176 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:46:59.886891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:46:59.892361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b2728a6-ac42-48dc-8e97-6176003a4d49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:59.892858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b2728a6-ac42-48dc-8e97-6176003a4d49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:59.893311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b2728a6-ac42-48dc-8e97-6176003a4d49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:46:59.897517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b2728a6-ac42-48dc-8e97-6176003a4d49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:46:59.897517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b2728a6-ac42-48dc-8e97-6176003a4d49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:46:59.897517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9b2728a6-ac42-48dc-8e97-6176003a4d49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:00.027645 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9b2728a6-ac42-48dc-8e97-6176003a4d49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:47:00.035335 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9b2728a6-ac42-48dc-8e97-6176003a4d49 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1391 microversion: 2.1 time: 0.156574 Oct 11 05:47:00.035929 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4216/8197] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:46:59 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1391 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:47:00.762621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-2facde16-2c86-46c6-9c75-d6609586fa11 req-ba3db613-b340-49b5-816f-80b5172dadb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66690734-934a-4a2e-b2b2-7a49f404c067", "name": "network-vif-plugged", "status": "completed", "tag": "e0df809b-c15d-4b66-8cf6-47d433925028"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:47:00.768751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:47:00.774263 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2facde16-2c86-46c6-9c75-d6609586fa11 req-ba3db613-b340-49b5-816f-80b5172dadb8 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:00.775370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2facde16-2c86-46c6-9c75-d6609586fa11 req-ba3db613-b340-49b5-816f-80b5172dadb8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:00.775370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-2facde16-2c86-46c6-9c75-d6609586fa11 req-ba3db613-b340-49b5-816f-80b5172dadb8 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:00.786836 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-2facde16-2c86-46c6-9c75-d6609586fa11 req-ba3db613-b340-49b5-816f-80b5172dadb8 service nova] Creating event network-vif-plugged:e0df809b-c15d-4b66-8cf6-47d433925028 for instance 66690734-934a-4a2e-b2b2-7a49f404c067 on n-h1-860892-1 Oct 11 05:47:00.792419 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-2facde16-2c86-46c6-9c75-d6609586fa11 req-ba3db613-b340-49b5-816f-80b5172dadb8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033272 Oct 11 05:47:00.792693 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3982/8198] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:47:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:47:01.059110 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a44789e8-7fe2-4302-ab10-07c4da8d60ee tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:47:01.060302 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a44789e8-7fe2-4302-ab10-07c4da8d60ee tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:47:01.067055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a44789e8-7fe2-4302-ab10-07c4da8d60ee tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:01.067547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a44789e8-7fe2-4302-ab10-07c4da8d60ee tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:01.067997 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a44789e8-7fe2-4302-ab10-07c4da8d60ee tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:01.068694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a44789e8-7fe2-4302-ab10-07c4da8d60ee tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:01.069157 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a44789e8-7fe2-4302-ab10-07c4da8d60ee tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:01.069591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a44789e8-7fe2-4302-ab10-07c4da8d60ee tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:01.199173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a44789e8-7fe2-4302-ab10-07c4da8d60ee tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:47:01.207214 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a44789e8-7fe2-4302-ab10-07c4da8d60ee tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1391 microversion: 2.1 time: 0.151952 Oct 11 05:47:01.207784 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4217/8199] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:47:01 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1391 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:47:02.231539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-450b0190-0e55-405f-bbfe-7e5e9c732ba0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:47:02.232237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-450b0190-0e55-405f-bbfe-7e5e9c732ba0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:47:02.238866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-450b0190-0e55-405f-bbfe-7e5e9c732ba0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:02.239359 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-450b0190-0e55-405f-bbfe-7e5e9c732ba0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:02.239791 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-450b0190-0e55-405f-bbfe-7e5e9c732ba0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:02.240470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-450b0190-0e55-405f-bbfe-7e5e9c732ba0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:02.240919 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-450b0190-0e55-405f-bbfe-7e5e9c732ba0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:02.241342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-450b0190-0e55-405f-bbfe-7e5e9c732ba0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:02.376695 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-450b0190-0e55-405f-bbfe-7e5e9c732ba0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:47:02.384367 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-450b0190-0e55-405f-bbfe-7e5e9c732ba0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1391 microversion: 2.1 time: 0.157992 Oct 11 05:47:02.384933 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3983/8200] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:47:02 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1391 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:47:03.407765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a32bdc7c-1df5-45de-a803-7ebccbad08b1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:47:03.408401 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a32bdc7c-1df5-45de-a803-7ebccbad08b1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:47:03.415409 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32bdc7c-1df5-45de-a803-7ebccbad08b1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:03.415906 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32bdc7c-1df5-45de-a803-7ebccbad08b1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:03.416363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32bdc7c-1df5-45de-a803-7ebccbad08b1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:03.417065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32bdc7c-1df5-45de-a803-7ebccbad08b1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:03.417533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32bdc7c-1df5-45de-a803-7ebccbad08b1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:03.417976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32bdc7c-1df5-45de-a803-7ebccbad08b1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:03.552272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a32bdc7c-1df5-45de-a803-7ebccbad08b1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:47:03.560084 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a32bdc7c-1df5-45de-a803-7ebccbad08b1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1562 microversion: 2.1 time: 0.156444 Oct 11 05:47:03.560657 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4218/8201] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:47:03 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:47:03.582585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90aaf3b0-2dbe-41d0-bd69-18a3bf6c0c2a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:47:03.583204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90aaf3b0-2dbe-41d0-bd69-18a3bf6c0c2a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:47:03.589622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90aaf3b0-2dbe-41d0-bd69-18a3bf6c0c2a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:03.590109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90aaf3b0-2dbe-41d0-bd69-18a3bf6c0c2a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:03.591067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90aaf3b0-2dbe-41d0-bd69-18a3bf6c0c2a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:03.591759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90aaf3b0-2dbe-41d0-bd69-18a3bf6c0c2a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:03.592219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90aaf3b0-2dbe-41d0-bd69-18a3bf6c0c2a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:03.592654 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90aaf3b0-2dbe-41d0-bd69-18a3bf6c0c2a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:03.728736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90aaf3b0-2dbe-41d0-bd69-18a3bf6c0c2a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:47:03.737187 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90aaf3b0-2dbe-41d0-bd69-18a3bf6c0c2a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1562 microversion: 2.1 time: 0.158680 Oct 11 05:47:03.737785 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3984/8202] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:47:03 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1562 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:47:05.878859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a32f3eff-a11f-477b-b81e-5e6dfb63a288 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:47:05.879738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a32f3eff-a11f-477b-b81e-5e6dfb63a288 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:47:05.887329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f3eff-a11f-477b-b81e-5e6dfb63a288 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:05.887839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f3eff-a11f-477b-b81e-5e6dfb63a288 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:05.888292 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f3eff-a11f-477b-b81e-5e6dfb63a288 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:05.889015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f3eff-a11f-477b-b81e-5e6dfb63a288 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:05.889486 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f3eff-a11f-477b-b81e-5e6dfb63a288 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:05.889930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a32f3eff-a11f-477b-b81e-5e6dfb63a288 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:05.937297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-8801c38d-98f9-423d-b8b7-c28114f6a5d7 req-3785d02f-51b2-4040-b9f5-2f68ae953d47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66690734-934a-4a2e-b2b2-7a49f404c067", "tag": "e0df809b-c15d-4b66-8cf6-47d433925028"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:47:05.948941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8801c38d-98f9-423d-b8b7-c28114f6a5d7 req-3785d02f-51b2-4040-b9f5-2f68ae953d47 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:05.949910 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8801c38d-98f9-423d-b8b7-c28114f6a5d7 req-3785d02f-51b2-4040-b9f5-2f68ae953d47 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:05.950606 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-8801c38d-98f9-423d-b8b7-c28114f6a5d7 req-3785d02f-51b2-4040-b9f5-2f68ae953d47 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:05.963920 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-8801c38d-98f9-423d-b8b7-c28114f6a5d7 req-3785d02f-51b2-4040-b9f5-2f68ae953d47 service nova] Creating event network-changed:e0df809b-c15d-4b66-8cf6-47d433925028 for instance 66690734-934a-4a2e-b2b2-7a49f404c067 on n-h1-860892-1 Oct 11 05:47:05.970647 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-8801c38d-98f9-423d-b8b7-c28114f6a5d7 req-3785d02f-51b2-4040-b9f5-2f68ae953d47 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093340 Oct 11 05:47:05.971861 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3985/8203] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:47:06.058736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a32f3eff-a11f-477b-b81e-5e6dfb63a288 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:47:06.066942 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a32f3eff-a11f-477b-b81e-5e6dfb63a288 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1562 microversion: 2.1 time: 0.192863 Oct 11 05:47:06.067555 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4219/8204] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:47:05 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1562 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:47:37.348017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=20 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:47:37.348762 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=36 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:47:37.352949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-32acaa8c-2a4c-4ae9-b93b-e9d5469da0d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:47:37.355246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-32acaa8c-2a4c-4ae9-b93b-e9d5469da0d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:47:37.361238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32acaa8c-2a4c-4ae9-b93b-e9d5469da0d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:37.361722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32acaa8c-2a4c-4ae9-b93b-e9d5469da0d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:37.362163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32acaa8c-2a4c-4ae9-b93b-e9d5469da0d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:37.362876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32acaa8c-2a4c-4ae9-b93b-e9d5469da0d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:47:37.363326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32acaa8c-2a4c-4ae9-b93b-e9d5469da0d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:47:37.363755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-32acaa8c-2a4c-4ae9-b93b-e9d5469da0d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:47:37.427998 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-32acaa8c-2a4c-4ae9-b93b-e9d5469da0d5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067/action" status: 200 len: 24571 microversion: 2.1 time: 0.081753 Oct 11 05:47:37.428652 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3986/8205] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:47:37 2022] POST /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067/action => generated 24571 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:48:07.848991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=9 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:48:07.849766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=50 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:48:07.854734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-eb1c4c73-6638-4e8e-87e7-82179e8cb3f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:48:07.861037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb1c4c73-6638-4e8e-87e7-82179e8cb3f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:07.861567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb1c4c73-6638-4e8e-87e7-82179e8cb3f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:07.862024 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-eb1c4c73-6638-4e8e-87e7-82179e8cb3f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:07.884603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-eb1c4c73-6638-4e8e-87e7-82179e8cb3f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Going to try to stop instance {{(pid=120994) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 11 05:48:08.086895 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-eb1c4c73-6638-4e8e-87e7-82179e8cb3f0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067/action" status: 202 len: 0 microversion: 2.1 time: 0.239406 Oct 11 05:48:08.087542 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4220/8206] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:48:07 2022] POST /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067/action => generated 0 bytes in 242 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:48:08.096551 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-354b15d2-6912-4814-8ccf-c39f610a5d6b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:08.097248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-354b15d2-6912-4814-8ccf-c39f610a5d6b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:08.099989 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 11 05:48:08.101402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:48:08.108859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-354b15d2-6912-4814-8ccf-c39f610a5d6b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:08.109343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-354b15d2-6912-4814-8ccf-c39f610a5d6b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:08.109779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-354b15d2-6912-4814-8ccf-c39f610a5d6b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:08.110501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-354b15d2-6912-4814-8ccf-c39f610a5d6b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:08.110954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-354b15d2-6912-4814-8ccf-c39f610a5d6b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:08.115320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-354b15d2-6912-4814-8ccf-c39f610a5d6b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:08.294229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-354b15d2-6912-4814-8ccf-c39f610a5d6b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:08.302675 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-354b15d2-6912-4814-8ccf-c39f610a5d6b tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1691 microversion: 2.1 time: 0.210741 Oct 11 05:48:08.303281 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3987/8207] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:08 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1691 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:09.328881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-af683210-4d50-4299-b585-db58fd68a874 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:09.329593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-af683210-4d50-4299-b585-db58fd68a874 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:09.336349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af683210-4d50-4299-b585-db58fd68a874 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:09.336847 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af683210-4d50-4299-b585-db58fd68a874 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:09.337299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af683210-4d50-4299-b585-db58fd68a874 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:09.337998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af683210-4d50-4299-b585-db58fd68a874 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:09.338495 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af683210-4d50-4299-b585-db58fd68a874 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:09.338936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-af683210-4d50-4299-b585-db58fd68a874 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:09.516295 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-af683210-4d50-4299-b585-db58fd68a874 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:09.525218 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-af683210-4d50-4299-b585-db58fd68a874 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1691 microversion: 2.1 time: 0.201760 Oct 11 05:48:09.525787 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4221/8208] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:09 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1691 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:10.548856 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-60f483a9-238f-4582-b1f9-46d7c3a367af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:10.549465 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-60f483a9-238f-4582-b1f9-46d7c3a367af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:10.556615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f483a9-238f-4582-b1f9-46d7c3a367af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:10.557072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f483a9-238f-4582-b1f9-46d7c3a367af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:10.557507 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f483a9-238f-4582-b1f9-46d7c3a367af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:10.558205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f483a9-238f-4582-b1f9-46d7c3a367af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:10.558657 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f483a9-238f-4582-b1f9-46d7c3a367af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:10.559076 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-60f483a9-238f-4582-b1f9-46d7c3a367af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:10.692650 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-60f483a9-238f-4582-b1f9-46d7c3a367af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:10.700315 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-60f483a9-238f-4582-b1f9-46d7c3a367af tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1691 microversion: 2.1 time: 0.155482 Oct 11 05:48:10.700878 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3988/8209] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:10 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1691 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:11.724372 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0369f64e-3272-486f-8de7-79814d2491b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:11.725023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0369f64e-3272-486f-8de7-79814d2491b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:11.731953 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0369f64e-3272-486f-8de7-79814d2491b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:11.732453 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0369f64e-3272-486f-8de7-79814d2491b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:11.732908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0369f64e-3272-486f-8de7-79814d2491b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:11.733614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0369f64e-3272-486f-8de7-79814d2491b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:11.734082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0369f64e-3272-486f-8de7-79814d2491b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:11.734552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0369f64e-3272-486f-8de7-79814d2491b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:11.867322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0369f64e-3272-486f-8de7-79814d2491b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:11.875128 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0369f64e-3272-486f-8de7-79814d2491b3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1691 microversion: 2.1 time: 0.154754 Oct 11 05:48:11.875702 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4222/8210] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:11 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:12.899887 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d33a045-109e-4cd6-aaf2-f8b3d61e7dfe tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:12.900609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0d33a045-109e-4cd6-aaf2-f8b3d61e7dfe tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:12.907969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d33a045-109e-4cd6-aaf2-f8b3d61e7dfe tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:12.908452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d33a045-109e-4cd6-aaf2-f8b3d61e7dfe tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:12.908927 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d33a045-109e-4cd6-aaf2-f8b3d61e7dfe tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:12.909658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d33a045-109e-4cd6-aaf2-f8b3d61e7dfe tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:12.910110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d33a045-109e-4cd6-aaf2-f8b3d61e7dfe tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:12.910586 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d33a045-109e-4cd6-aaf2-f8b3d61e7dfe tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:13.043416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0d33a045-109e-4cd6-aaf2-f8b3d61e7dfe tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:13.052400 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0d33a045-109e-4cd6-aaf2-f8b3d61e7dfe tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1691 microversion: 2.1 time: 0.156856 Oct 11 05:48:13.052971 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3989/8211] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:12 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1691 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:14.076646 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e70d201c-4bee-4ada-b9e7-18f2edefb0ad tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:14.077329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e70d201c-4bee-4ada-b9e7-18f2edefb0ad tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:14.084209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e70d201c-4bee-4ada-b9e7-18f2edefb0ad tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:14.084704 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e70d201c-4bee-4ada-b9e7-18f2edefb0ad tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:14.085159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e70d201c-4bee-4ada-b9e7-18f2edefb0ad tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:14.085884 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e70d201c-4bee-4ada-b9e7-18f2edefb0ad tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:14.086386 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e70d201c-4bee-4ada-b9e7-18f2edefb0ad tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:14.086836 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e70d201c-4bee-4ada-b9e7-18f2edefb0ad tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:14.218723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e70d201c-4bee-4ada-b9e7-18f2edefb0ad tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:14.227119 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e70d201c-4bee-4ada-b9e7-18f2edefb0ad tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1691 microversion: 2.1 time: 0.154436 Oct 11 05:48:14.227698 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4223/8212] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:14 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:15.250775 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-bca37c01-4734-4245-8367-afbf90d05588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:15.251402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-bca37c01-4734-4245-8367-afbf90d05588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:15.259138 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bca37c01-4734-4245-8367-afbf90d05588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:15.259626 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bca37c01-4734-4245-8367-afbf90d05588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:15.260071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bca37c01-4734-4245-8367-afbf90d05588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:15.260769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bca37c01-4734-4245-8367-afbf90d05588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:15.261228 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bca37c01-4734-4245-8367-afbf90d05588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:15.261662 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-bca37c01-4734-4245-8367-afbf90d05588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:15.390320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-bca37c01-4734-4245-8367-afbf90d05588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:15.398861 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-bca37c01-4734-4245-8367-afbf90d05588 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1691 microversion: 2.1 time: 0.151684 Oct 11 05:48:15.399430 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3990/8213] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:15 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:16.423189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b0e38211-e098-400d-a861-6c46522dbec3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:16.423805 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b0e38211-e098-400d-a861-6c46522dbec3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:16.430600 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0e38211-e098-400d-a861-6c46522dbec3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:16.431090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0e38211-e098-400d-a861-6c46522dbec3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:16.433980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0e38211-e098-400d-a861-6c46522dbec3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:16.433980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0e38211-e098-400d-a861-6c46522dbec3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:16.433980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0e38211-e098-400d-a861-6c46522dbec3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:16.433980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b0e38211-e098-400d-a861-6c46522dbec3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:16.562869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b0e38211-e098-400d-a861-6c46522dbec3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:16.571270 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b0e38211-e098-400d-a861-6c46522dbec3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1691 microversion: 2.1 time: 0.151975 Oct 11 05:48:16.571846 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4224/8214] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:16 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:17.594676 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-73212be7-afee-47e3-9f7d-a22686d9f769 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:17.595323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73212be7-afee-47e3-9f7d-a22686d9f769 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:17.602868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73212be7-afee-47e3-9f7d-a22686d9f769 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:17.603352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73212be7-afee-47e3-9f7d-a22686d9f769 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:17.603820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73212be7-afee-47e3-9f7d-a22686d9f769 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:17.604519 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73212be7-afee-47e3-9f7d-a22686d9f769 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:17.604972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73212be7-afee-47e3-9f7d-a22686d9f769 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:17.605399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73212be7-afee-47e3-9f7d-a22686d9f769 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:17.741644 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-73212be7-afee-47e3-9f7d-a22686d9f769 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:17.749464 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-73212be7-afee-47e3-9f7d-a22686d9f769 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1691 microversion: 2.1 time: 0.158803 Oct 11 05:48:17.750039 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3991/8215] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:17 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1691 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:18.774606 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-57f28233-8c39-40fe-b4fd-1983a1db7fc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:18.775141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-57f28233-8c39-40fe-b4fd-1983a1db7fc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:18.782130 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57f28233-8c39-40fe-b4fd-1983a1db7fc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:18.782658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57f28233-8c39-40fe-b4fd-1983a1db7fc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:18.783112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57f28233-8c39-40fe-b4fd-1983a1db7fc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:18.784470 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57f28233-8c39-40fe-b4fd-1983a1db7fc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:18.784947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57f28233-8c39-40fe-b4fd-1983a1db7fc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:18.785388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-57f28233-8c39-40fe-b4fd-1983a1db7fc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:18.916004 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-57f28233-8c39-40fe-b4fd-1983a1db7fc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:18.923946 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-57f28233-8c39-40fe-b4fd-1983a1db7fc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1668 microversion: 2.1 time: 0.153699 Oct 11 05:48:18.924548 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4225/8216] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:18 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1668 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:20.020312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dde7db5b-c6c0-4148-867a-9d313ca88113 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:48:20.022693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dde7db5b-c6c0-4148-867a-9d313ca88113 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:20.029827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dde7db5b-c6c0-4148-867a-9d313ca88113 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:20.030341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dde7db5b-c6c0-4148-867a-9d313ca88113 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:20.030778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dde7db5b-c6c0-4148-867a-9d313ca88113 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:20.031458 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dde7db5b-c6c0-4148-867a-9d313ca88113 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:20.031906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dde7db5b-c6c0-4148-867a-9d313ca88113 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:20.032336 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dde7db5b-c6c0-4148-867a-9d313ca88113 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:20.085286 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dde7db5b-c6c0-4148-867a-9d313ca88113 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067/action" status: 200 len: 36705 microversion: 2.1 time: 0.069087 Oct 11 05:48:20.085932 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3992/8217] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:48:20 2022] POST /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067/action => generated 36705 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:48:20.098165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-31945db5-7c60-424a-ada2-f0521ce1b16d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:48:20.105191 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31945db5-7c60-424a-ada2-f0521ce1b16d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:20.105691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31945db5-7c60-424a-ada2-f0521ce1b16d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:20.106147 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-31945db5-7c60-424a-ada2-f0521ce1b16d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:20.128563 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-31945db5-7c60-424a-ada2-f0521ce1b16d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Going to try to start instance {{(pid=120994) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 11 05:48:20.310725 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-31945db5-7c60-424a-ada2-f0521ce1b16d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067/action" status: 202 len: 0 microversion: 2.1 time: 0.216729 Oct 11 05:48:20.311342 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4226/8218] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:48:20 2022] POST /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067/action => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:48:20.320778 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-01e90539-2387-4aab-ac7a-b7c71d25b19e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:20.321472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-01e90539-2387-4aab-ac7a-b7c71d25b19e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:20.328435 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01e90539-2387-4aab-ac7a-b7c71d25b19e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:20.331718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01e90539-2387-4aab-ac7a-b7c71d25b19e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:20.331718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01e90539-2387-4aab-ac7a-b7c71d25b19e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:20.331718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01e90539-2387-4aab-ac7a-b7c71d25b19e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:20.331718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01e90539-2387-4aab-ac7a-b7c71d25b19e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:20.331718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-01e90539-2387-4aab-ac7a-b7c71d25b19e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:20.469704 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-01e90539-2387-4aab-ac7a-b7c71d25b19e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:20.477699 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-01e90539-2387-4aab-ac7a-b7c71d25b19e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1677 microversion: 2.1 time: 0.161219 Oct 11 05:48:20.478296 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3993/8219] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:20 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1677 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:21.501648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-04e7a566-1e73-4266-82ed-79744556076f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:21.502876 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-04e7a566-1e73-4266-82ed-79744556076f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:21.509973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04e7a566-1e73-4266-82ed-79744556076f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:21.510528 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04e7a566-1e73-4266-82ed-79744556076f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:21.510981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04e7a566-1e73-4266-82ed-79744556076f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:21.511689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04e7a566-1e73-4266-82ed-79744556076f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:21.512154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04e7a566-1e73-4266-82ed-79744556076f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:21.512587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-04e7a566-1e73-4266-82ed-79744556076f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:21.652097 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-04e7a566-1e73-4266-82ed-79744556076f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:21.660068 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-04e7a566-1e73-4266-82ed-79744556076f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1677 microversion: 2.1 time: 0.162877 Oct 11 05:48:21.660653 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4227/8220] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:21 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1677 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:48:22.683805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5300a9bb-20fc-4497-808b-09d552ff2b7e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:48:22.684424 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5300a9bb-20fc-4497-808b-09d552ff2b7e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:22.691272 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5300a9bb-20fc-4497-808b-09d552ff2b7e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:22.691754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5300a9bb-20fc-4497-808b-09d552ff2b7e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:22.692194 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5300a9bb-20fc-4497-808b-09d552ff2b7e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:22.692886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5300a9bb-20fc-4497-808b-09d552ff2b7e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:22.693341 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5300a9bb-20fc-4497-808b-09d552ff2b7e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:22.693770 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5300a9bb-20fc-4497-808b-09d552ff2b7e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:22.828554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5300a9bb-20fc-4497-808b-09d552ff2b7e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:48:22.836756 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5300a9bb-20fc-4497-808b-09d552ff2b7e tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1681 microversion: 2.1 time: 0.156876 Oct 11 05:48:22.837330 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3994/8221] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:48:22 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:48:55.053856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4a6e9f48-235d-4726-8117-7087652b2800 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:48:55.056334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4a6e9f48-235d-4726-8117-7087652b2800 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:48:55.058938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=16 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:48:55.059612 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:48:55.064299 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a6e9f48-235d-4726-8117-7087652b2800 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:55.064810 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a6e9f48-235d-4726-8117-7087652b2800 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:55.066210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a6e9f48-235d-4726-8117-7087652b2800 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:55.066210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a6e9f48-235d-4726-8117-7087652b2800 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:48:55.066445 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a6e9f48-235d-4726-8117-7087652b2800 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:48:55.066855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4a6e9f48-235d-4726-8117-7087652b2800 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:48:55.124486 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4a6e9f48-235d-4726-8117-7087652b2800 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067/action" status: 200 len: 61266 microversion: 2.1 time: 0.074439 Oct 11 05:48:55.125159 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4228/8222] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:48:55 2022] POST /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067/action => generated 61266 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:49:12.228140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-79dac200-23ae-4ab1-8680-b94f83ae81d6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:12.228681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-79dac200-23ae-4ab1-8680-b94f83ae81d6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:12.236071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-51f5692b-f706-48c4-8f9d-d54fdce082b1 req-a0b77bde-0b0e-4f6a-b4e4-22b1034b3fed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "66690734-934a-4a2e-b2b2-7a49f404c067", "tag": "e0df809b-c15d-4b66-8cf6-47d433925028"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:49:12.239200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=16 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:49:12.239925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=50 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:49:12.244861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:49:12.247918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79dac200-23ae-4ab1-8680-b94f83ae81d6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:12.248453 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79dac200-23ae-4ab1-8680-b94f83ae81d6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:12.248895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79dac200-23ae-4ab1-8680-b94f83ae81d6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:12.249729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79dac200-23ae-4ab1-8680-b94f83ae81d6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:12.250213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79dac200-23ae-4ab1-8680-b94f83ae81d6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:12.253909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-79dac200-23ae-4ab1-8680-b94f83ae81d6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:12.254029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-51f5692b-f706-48c4-8f9d-d54fdce082b1 req-a0b77bde-0b0e-4f6a-b4e4-22b1034b3fed service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:12.254029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-51f5692b-f706-48c4-8f9d-d54fdce082b1 req-a0b77bde-0b0e-4f6a-b4e4-22b1034b3fed service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:12.254029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-51f5692b-f706-48c4-8f9d-d54fdce082b1 req-a0b77bde-0b0e-4f6a-b4e4-22b1034b3fed service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:12.266667 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-51f5692b-f706-48c4-8f9d-d54fdce082b1 req-a0b77bde-0b0e-4f6a-b4e4-22b1034b3fed service nova] Creating event network-changed:e0df809b-c15d-4b66-8cf6-47d433925028 for instance 66690734-934a-4a2e-b2b2-7a49f404c067 on n-h1-860892-1 Oct 11 05:49:12.275833 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-51f5692b-f706-48c4-8f9d-d54fdce082b1 req-a0b77bde-0b0e-4f6a-b4e4-22b1034b3fed service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043479 Oct 11 05:49:12.282602 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4229/8223] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:49:12.283184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-79dac200-23ae-4ab1-8680-b94f83ae81d6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:49:12.627504 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-79dac200-23ae-4ab1-8680-b94f83ae81d6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "DELETE /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 204 len: 0 microversion: 2.1 time: 0.403312 Oct 11 05:49:12.628300 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3995/8224] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:49:12 2022] DELETE /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:49:12.638124 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-673c5e84-77f8-4bce-80d0-a19ce9fd3bc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:12.638862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-673c5e84-77f8-4bce-80d0-a19ce9fd3bc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:12.645995 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673c5e84-77f8-4bce-80d0-a19ce9fd3bc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:12.646783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673c5e84-77f8-4bce-80d0-a19ce9fd3bc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:12.652237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673c5e84-77f8-4bce-80d0-a19ce9fd3bc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:12.652237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673c5e84-77f8-4bce-80d0-a19ce9fd3bc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:12.652237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673c5e84-77f8-4bce-80d0-a19ce9fd3bc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:12.652237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-673c5e84-77f8-4bce-80d0-a19ce9fd3bc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:12.801125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-673c5e84-77f8-4bce-80d0-a19ce9fd3bc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:12.809612 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-673c5e84-77f8-4bce-80d0-a19ce9fd3bc0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1687 microversion: 2.1 time: 0.177024 Oct 11 05:49:12.810266 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4230/8225] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:12 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1687 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:13.835530 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-847f5c17-7a99-4b78-b677-5a016d8f621c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:13.836305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-847f5c17-7a99-4b78-b677-5a016d8f621c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:13.844646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f5c17-7a99-4b78-b677-5a016d8f621c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:13.845125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f5c17-7a99-4b78-b677-5a016d8f621c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:13.845568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f5c17-7a99-4b78-b677-5a016d8f621c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:13.846885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f5c17-7a99-4b78-b677-5a016d8f621c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:13.847343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f5c17-7a99-4b78-b677-5a016d8f621c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:13.847766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-847f5c17-7a99-4b78-b677-5a016d8f621c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:13.983087 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-847f5c17-7a99-4b78-b677-5a016d8f621c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:13.990788 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-847f5c17-7a99-4b78-b677-5a016d8f621c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1687 microversion: 2.1 time: 0.159532 Oct 11 05:49:13.991388 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3996/8226] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:13 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1687 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:14.712787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-8b37aad0-e76e-43c2-9e11-69667c4cecd5 req-96466af2-610a-4c4a-9240-c385c8128760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "66690734-934a-4a2e-b2b2-7a49f404c067", "name": "network-vif-deleted", "tag": "e0df809b-c15d-4b66-8cf6-47d433925028"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:49:14.723050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8b37aad0-e76e-43c2-9e11-69667c4cecd5 req-96466af2-610a-4c4a-9240-c385c8128760 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:14.724658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8b37aad0-e76e-43c2-9e11-69667c4cecd5 req-96466af2-610a-4c4a-9240-c385c8128760 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:14.724658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-8b37aad0-e76e-43c2-9e11-69667c4cecd5 req-96466af2-610a-4c4a-9240-c385c8128760 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:14.735431 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-8b37aad0-e76e-43c2-9e11-69667c4cecd5 req-96466af2-610a-4c4a-9240-c385c8128760 service nova] Creating event network-vif-deleted:e0df809b-c15d-4b66-8cf6-47d433925028 for instance 66690734-934a-4a2e-b2b2-7a49f404c067 on n-h1-860892-1 Oct 11 05:49:14.740352 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-8b37aad0-e76e-43c2-9e11-69667c4cecd5 req-96466af2-610a-4c4a-9240-c385c8128760 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031345 Oct 11 05:49:14.740902 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4231/8227] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:49:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:49:15.014615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:15.015213 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:15.022517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:15.023010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:15.023634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:15.024415 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:15.025418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:15.025841 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:15.064602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:15.064956 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:15.065711 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:15.066505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lazy-loading 'fault' on Instance uuid 66690734-934a-4a2e-b2b2-7a49f404c067 {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:49:15.112225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:15.120362 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-111a6039-7a29-4b00-bb46-b0976265ee8d tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 200 len: 1355 microversion: 2.1 time: 0.109666 Oct 11 05:49:15.120962 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3997/8228] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:15 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 1355 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:16.145803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:16.146494 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 66690734-934a-4a2e-b2b2-7a49f404c067] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:16.153533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:16.154031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:16.154519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:16.155225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:16.155694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:16.156138 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:16.169167 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] HTTP exception thrown: Instance 66690734-934a-4a2e-b2b2-7a49f404c067 could not be found. Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Request method failure captured: Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 HTTP/1.1 Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRQHS4piZqH1dure5OF-4uF_7UQtjJNzpk0Jb5Ez15iOAgJ05BhQLyncbupebXYDCjM4DCYwFt9xTz5GcJDwnQqgiCsLq8kZzuI3mHzfQAmmSu_E-hTu9Y6kmFjbTS9lLqk2rSkkeY6p8wGY24LmfuD8ig77EwFZZak6QxcZyePtclAY Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: 44a5aa7caa7e495a84b2c0e677bda422 Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a5aa7caa7e495a84b2c0e677bda422"}]}] Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: 44a5aa7caa7e495a84b2c0e677bda422 Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestNetworkAdvancedServerOps-165913187-project Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: a263fe210f1d482797c0f803892098d6 Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestNetworkAdvancedServerOps-165913187-project Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 66690734-934a-4a2e-b2b2-7a49f404c067 could not be found. Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '66690734-934a-4a2e-b2b2-7a49f404c067'} Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 66690734-934a-4a2e-b2b2-7a49f404c067 could not be found. Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 66690734-934a-4a2e-b2b2-7a49f404c067 could not be found. Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:49:16.170812 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:49:16.176038 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:49:16.176038 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:49:16.176038 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:49:16.176038 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:49:16.176038 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:49:16.176038 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:49:16.176038 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 66690734-934a-4a2e-b2b2-7a49f404c067 could not be found. Oct 11 05:49:16.176038 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 05:49:16.176038 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Returning 404 to user: Instance 66690734-934a-4a2e-b2b2-7a49f404c067 could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:49:16.176038 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-781c6eec-a232-40df-9a31-d8fe248d7914 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067" status: 404 len: 111 microversion: 2.1 time: 0.031871 Oct 11 05:49:16.176038 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4232/8229] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:16 2022] GET /compute/v2.1/servers/66690734-934a-4a2e-b2b2-7a49f404c067 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:49:19.893908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5f3c8016-5b22-4765-8351-e9635573a464 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '.version_select at 0x7fda18869b80>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:19.976480 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5f3c8016-5b22-4765-8351-e9635573a464 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-975440361" status: 202 len: 0 microversion: 2.1 time: 0.086311 Oct 11 05:49:19.977016 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3998/8230] 10.222.0.26 () {58 vars in 1281 bytes} [Tue Oct 11 05:49:19 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-975440361 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:49:20.009125 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0a0cf9f2-f0d3-4b6a-9a98-91e4d82060ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'create', calling method: .version_select at 0x7fda1abbc8b0>, body: {"keypair": {"name": "tempest-TestNetworkAdvancedServerOps-443000507", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOwbBQHCHlmcx/ldehf74h3LKqIrT/qLrro0+XN5vbUS0gNg+JgusrEu5HZsRg7a42/h8KEhKA5n/F3FihN8QCjs782MVLCl80twGSu0FEKAOKPe2CI5kNJVl9aXogsuWw=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:49:20.025394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0a0cf9f2-f0d3-4b6a-9a98-91e4d82060ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:49:20.031389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-0a0cf9f2-f0d3-4b6a-9a98-91e4d82060ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for user a263fe210f1d482797c0f803892098d6 and project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:49:20.101638 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0a0cf9f2-f0d3-4b6a-9a98-91e4d82060ec tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 406 microversion: 2.1 time: 0.096377 Oct 11 05:49:20.102273 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4233/8231] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:49:20 2022] POST /compute/v2.1/os-keypairs => generated 406 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:49:27.913378 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:49:27.919545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestNetworkAdvancedServerOps-server-1671718390", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "networks": [{"uuid": "bf4016f3-e72e-42dc-82ab-e64b34d2a0ec"}], "key_name": "tempest-TestNetworkAdvancedServerOps-443000507", "security_groups": [{"name": "tempest-secgroup-smoke-1360824724"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:49:28.071391 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] validate_networks() for [('bf4016f3-e72e-42dc-82ab-e64b34d2a0ec', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:49:28.505825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:49:28.506504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:49:28.507399 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:49:28.507951 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:49:28.509233 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:49:28.519121 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:28.519645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:28.520027 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:28.520750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:28.521205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:28.521628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:28.540782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:49:28.546063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Getting quotas for user a263fe210f1d482797c0f803892098d6 and project 44a5aa7caa7e495a84b2c0e677bda422. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:49:28.558430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:49:28.560771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:49:28.653862 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-20d25671-7911-4f04-ac76-a17ab1b9445c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.742484 Oct 11 05:49:28.654747 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 3999/8232] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:49:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:49:28.664003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=16 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:49:28.668886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2d81b0af-29e9-400b-913c-35c455b3b892 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:28.673111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2d81b0af-29e9-400b-913c-35c455b3b892 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:28.736466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2d81b0af-29e9-400b-913c-35c455b3b892 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:28.747604 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2d81b0af-29e9-400b-913c-35c455b3b892 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1266 microversion: 2.1 time: 0.085098 Oct 11 05:49:28.748599 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4234/8233] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:28 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:29.772053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5791c2b8-a86c-43f9-9aad-01d8b3577680 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:29.772661 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5791c2b8-a86c-43f9-9aad-01d8b3577680 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:29.779229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5791c2b8-a86c-43f9-9aad-01d8b3577680 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:29.779716 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5791c2b8-a86c-43f9-9aad-01d8b3577680 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:29.780170 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5791c2b8-a86c-43f9-9aad-01d8b3577680 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:29.780869 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5791c2b8-a86c-43f9-9aad-01d8b3577680 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:29.781326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5791c2b8-a86c-43f9-9aad-01d8b3577680 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:29.781757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5791c2b8-a86c-43f9-9aad-01d8b3577680 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:29.851011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5791c2b8-a86c-43f9-9aad-01d8b3577680 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:29.859763 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5791c2b8-a86c-43f9-9aad-01d8b3577680 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1270 microversion: 2.1 time: 0.092496 Oct 11 05:49:29.865110 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4000/8234] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:29 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:30.883064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1cb640a0-bf7e-48ce-95a6-4c2d4bcddf78 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:30.883672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1cb640a0-bf7e-48ce-95a6-4c2d4bcddf78 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:30.891737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cb640a0-bf7e-48ce-95a6-4c2d4bcddf78 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:30.892244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cb640a0-bf7e-48ce-95a6-4c2d4bcddf78 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:30.892702 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cb640a0-bf7e-48ce-95a6-4c2d4bcddf78 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:30.893447 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cb640a0-bf7e-48ce-95a6-4c2d4bcddf78 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:30.893917 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cb640a0-bf7e-48ce-95a6-4c2d4bcddf78 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:30.894458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1cb640a0-bf7e-48ce-95a6-4c2d4bcddf78 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:30.959431 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1cb640a0-bf7e-48ce-95a6-4c2d4bcddf78 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:30.967845 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1cb640a0-bf7e-48ce-95a6-4c2d4bcddf78 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1336 microversion: 2.1 time: 0.089091 Oct 11 05:49:30.968435 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4235/8235] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:30 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1336 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:31.990362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f36db80a-78fd-40ce-8379-c0287c9d136c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:31.991006 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f36db80a-78fd-40ce-8379-c0287c9d136c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:31.998592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36db80a-78fd-40ce-8379-c0287c9d136c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:31.999053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36db80a-78fd-40ce-8379-c0287c9d136c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:31.999496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36db80a-78fd-40ce-8379-c0287c9d136c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:32.000187 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36db80a-78fd-40ce-8379-c0287c9d136c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:32.000640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36db80a-78fd-40ce-8379-c0287c9d136c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:32.001068 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f36db80a-78fd-40ce-8379-c0287c9d136c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:32.137425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f36db80a-78fd-40ce-8379-c0287c9d136c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:32.145425 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f36db80a-78fd-40ce-8379-c0287c9d136c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1392 microversion: 2.1 time: 0.159051 Oct 11 05:49:32.146008 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4001/8236] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:31 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1392 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:32.391437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-496f0d2d-3e4a-4699-a4fe-1ce36ab33ef8 req-6ec16590-db80-4ed2-8bfe-9aabe8eae805 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69835484-d18d-4b30-837e-5b1bdcb66adb", "tag": "821533bd-4a0a-4692-b365-32a8f83f68a7"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:49:32.402718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-496f0d2d-3e4a-4699-a4fe-1ce36ab33ef8 req-6ec16590-db80-4ed2-8bfe-9aabe8eae805 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:32.403212 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-496f0d2d-3e4a-4699-a4fe-1ce36ab33ef8 req-6ec16590-db80-4ed2-8bfe-9aabe8eae805 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:32.403653 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-496f0d2d-3e4a-4699-a4fe-1ce36ab33ef8 req-6ec16590-db80-4ed2-8bfe-9aabe8eae805 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:32.415644 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-496f0d2d-3e4a-4699-a4fe-1ce36ab33ef8 req-6ec16590-db80-4ed2-8bfe-9aabe8eae805 service nova] Creating event network-changed:821533bd-4a0a-4692-b365-32a8f83f68a7 for instance 69835484-d18d-4b30-837e-5b1bdcb66adb on n-h2-860892-1 Oct 11 05:49:32.420632 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-496f0d2d-3e4a-4699-a4fe-1ce36ab33ef8 req-6ec16590-db80-4ed2-8bfe-9aabe8eae805 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033333 Oct 11 05:49:32.421222 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4236/8237] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:49:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:49:33.169941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d43940c4-4212-4fc8-a227-4d32f9bd0750 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:33.170645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d43940c4-4212-4fc8-a227-4d32f9bd0750 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:33.178034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d43940c4-4212-4fc8-a227-4d32f9bd0750 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:33.178637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d43940c4-4212-4fc8-a227-4d32f9bd0750 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:33.179154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d43940c4-4212-4fc8-a227-4d32f9bd0750 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:33.179833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d43940c4-4212-4fc8-a227-4d32f9bd0750 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:33.180849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d43940c4-4212-4fc8-a227-4d32f9bd0750 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:33.181276 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d43940c4-4212-4fc8-a227-4d32f9bd0750 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:33.324836 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d43940c4-4212-4fc8-a227-4d32f9bd0750 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:33.332491 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d43940c4-4212-4fc8-a227-4d32f9bd0750 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1392 microversion: 2.1 time: 0.166625 Oct 11 05:49:33.333059 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4002/8238] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:33 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1392 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:49:34.357244 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fc4c0194-bcea-4635-9eb1-77cd01b6ed6c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:34.357946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fc4c0194-bcea-4635-9eb1-77cd01b6ed6c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:34.364887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc4c0194-bcea-4635-9eb1-77cd01b6ed6c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:34.365378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc4c0194-bcea-4635-9eb1-77cd01b6ed6c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:34.365827 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc4c0194-bcea-4635-9eb1-77cd01b6ed6c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:34.366554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc4c0194-bcea-4635-9eb1-77cd01b6ed6c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:34.367020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc4c0194-bcea-4635-9eb1-77cd01b6ed6c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:34.367490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fc4c0194-bcea-4635-9eb1-77cd01b6ed6c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:34.501661 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fc4c0194-bcea-4635-9eb1-77cd01b6ed6c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:34.509516 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fc4c0194-bcea-4635-9eb1-77cd01b6ed6c tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1392 microversion: 2.1 time: 0.156430 Oct 11 05:49:34.510019 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4237/8239] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:34 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1392 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:35.533074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a830c531-5e2d-4a23-9b4c-58c3271695c5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:35.533690 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a830c531-5e2d-4a23-9b4c-58c3271695c5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:35.541241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a830c531-5e2d-4a23-9b4c-58c3271695c5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:35.541722 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a830c531-5e2d-4a23-9b4c-58c3271695c5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:35.542160 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a830c531-5e2d-4a23-9b4c-58c3271695c5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:35.542873 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a830c531-5e2d-4a23-9b4c-58c3271695c5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:35.543327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a830c531-5e2d-4a23-9b4c-58c3271695c5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:35.543754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a830c531-5e2d-4a23-9b4c-58c3271695c5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:35.677640 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a830c531-5e2d-4a23-9b4c-58c3271695c5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:35.685939 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a830c531-5e2d-4a23-9b4c-58c3271695c5 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1392 microversion: 2.1 time: 0.156885 Oct 11 05:49:35.686548 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4003/8240] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:35 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1392 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:36.708861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-79efaf90-4a4b-43db-9213-9431dde804c4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:36.709417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-79efaf90-4a4b-43db-9213-9431dde804c4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:36.716777 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79efaf90-4a4b-43db-9213-9431dde804c4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:36.717272 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79efaf90-4a4b-43db-9213-9431dde804c4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:36.717723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79efaf90-4a4b-43db-9213-9431dde804c4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:36.718512 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79efaf90-4a4b-43db-9213-9431dde804c4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:36.718981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79efaf90-4a4b-43db-9213-9431dde804c4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:36.719419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-79efaf90-4a4b-43db-9213-9431dde804c4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:36.852000 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-79efaf90-4a4b-43db-9213-9431dde804c4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:36.863267 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-79efaf90-4a4b-43db-9213-9431dde804c4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1392 microversion: 2.1 time: 0.155590 Oct 11 05:49:36.863267 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4238/8241] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:36 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1392 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:37.429000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-0f739ad6-cba0-4409-a440-9d7ef0e2c3df req-407f80b6-4a6a-4467-8ab4-b7af38f6efde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69835484-d18d-4b30-837e-5b1bdcb66adb", "name": "network-vif-plugged", "status": "completed", "tag": "821533bd-4a0a-4692-b365-32a8f83f68a7"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:49:37.440089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0f739ad6-cba0-4409-a440-9d7ef0e2c3df req-407f80b6-4a6a-4467-8ab4-b7af38f6efde service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:37.440563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0f739ad6-cba0-4409-a440-9d7ef0e2c3df req-407f80b6-4a6a-4467-8ab4-b7af38f6efde service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:37.440996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-0f739ad6-cba0-4409-a440-9d7ef0e2c3df req-407f80b6-4a6a-4467-8ab4-b7af38f6efde service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:37.455477 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-0f739ad6-cba0-4409-a440-9d7ef0e2c3df req-407f80b6-4a6a-4467-8ab4-b7af38f6efde service nova] Creating event network-vif-plugged:821533bd-4a0a-4692-b365-32a8f83f68a7 for instance 69835484-d18d-4b30-837e-5b1bdcb66adb on n-h2-860892-1 Oct 11 05:49:37.460658 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-0f739ad6-cba0-4409-a440-9d7ef0e2c3df req-407f80b6-4a6a-4467-8ab4-b7af38f6efde service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035370 Oct 11 05:49:37.462107 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4004/8242] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:49:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:49:37.883620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-efa8b434-893e-49fd-8363-6627c2181df0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:37.884194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-efa8b434-893e-49fd-8363-6627c2181df0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:37.891090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa8b434-893e-49fd-8363-6627c2181df0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:37.891588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa8b434-893e-49fd-8363-6627c2181df0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:37.892078 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa8b434-893e-49fd-8363-6627c2181df0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:37.892782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa8b434-893e-49fd-8363-6627c2181df0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:37.893253 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa8b434-893e-49fd-8363-6627c2181df0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:37.893699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-efa8b434-893e-49fd-8363-6627c2181df0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:38.024140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-efa8b434-893e-49fd-8363-6627c2181df0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:38.032583 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-efa8b434-893e-49fd-8363-6627c2181df0 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1392 microversion: 2.1 time: 0.152917 Oct 11 05:49:38.033152 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4239/8243] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:37 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1392 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:39.054597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:49:39.055474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:49:39.060091 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8462603b-4e0b-4347-b126-b18e38037a8a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:39.065745 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8462603b-4e0b-4347-b126-b18e38037a8a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:39.067176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8462603b-4e0b-4347-b126-b18e38037a8a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:39.067672 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8462603b-4e0b-4347-b126-b18e38037a8a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:39.068205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8462603b-4e0b-4347-b126-b18e38037a8a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:39.069088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8462603b-4e0b-4347-b126-b18e38037a8a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:39.069374 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8462603b-4e0b-4347-b126-b18e38037a8a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:39.069805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8462603b-4e0b-4347-b126-b18e38037a8a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:39.202634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8462603b-4e0b-4347-b126-b18e38037a8a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:39.210365 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8462603b-4e0b-4347-b126-b18e38037a8a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1563 microversion: 2.1 time: 0.157677 Oct 11 05:49:39.210940 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4005/8244] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:39 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:39.233002 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2e1f713d-ce3c-433d-91ba-8a8f5eff7ec4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:39.233629 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2e1f713d-ce3c-433d-91ba-8a8f5eff7ec4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:39.235974 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:49:39.240699 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1f713d-ce3c-433d-91ba-8a8f5eff7ec4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:39.241197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1f713d-ce3c-433d-91ba-8a8f5eff7ec4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:39.241652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1f713d-ce3c-433d-91ba-8a8f5eff7ec4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:39.242388 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1f713d-ce3c-433d-91ba-8a8f5eff7ec4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:39.242857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1f713d-ce3c-433d-91ba-8a8f5eff7ec4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:39.243301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2e1f713d-ce3c-433d-91ba-8a8f5eff7ec4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:39.377536 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2e1f713d-ce3c-433d-91ba-8a8f5eff7ec4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:39.385278 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2e1f713d-ce3c-433d-91ba-8a8f5eff7ec4 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1563 microversion: 2.1 time: 0.156687 Oct 11 05:49:39.387066 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4240/8245] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:39 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:49:41.230064 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-5f1e3864-a822-42ba-91e3-e49bb84f13cb req-2796413e-1bfb-4fc5-a730-933afb88aa87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69835484-d18d-4b30-837e-5b1bdcb66adb", "tag": "821533bd-4a0a-4692-b365-32a8f83f68a7"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:49:41.231325 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-714f6bc8-0743-4031-a4d9-a2626eaf06c9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:49:41.231818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-714f6bc8-0743-4031-a4d9-a2626eaf06c9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:49:41.239049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-714f6bc8-0743-4031-a4d9-a2626eaf06c9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:41.239848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-714f6bc8-0743-4031-a4d9-a2626eaf06c9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:41.240472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-714f6bc8-0743-4031-a4d9-a2626eaf06c9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:41.241245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-714f6bc8-0743-4031-a4d9-a2626eaf06c9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:41.241693 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-714f6bc8-0743-4031-a4d9-a2626eaf06c9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:41.242123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-714f6bc8-0743-4031-a4d9-a2626eaf06c9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:41.245697 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5f1e3864-a822-42ba-91e3-e49bb84f13cb req-2796413e-1bfb-4fc5-a730-933afb88aa87 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:49:41.246455 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5f1e3864-a822-42ba-91e3-e49bb84f13cb req-2796413e-1bfb-4fc5-a730-933afb88aa87 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:49:41.246899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-5f1e3864-a822-42ba-91e3-e49bb84f13cb req-2796413e-1bfb-4fc5-a730-933afb88aa87 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:49:41.258074 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-5f1e3864-a822-42ba-91e3-e49bb84f13cb req-2796413e-1bfb-4fc5-a730-933afb88aa87 service nova] Creating event network-changed:821533bd-4a0a-4692-b365-32a8f83f68a7 for instance 69835484-d18d-4b30-837e-5b1bdcb66adb on n-h2-860892-1 Oct 11 05:49:41.264143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-5f1e3864-a822-42ba-91e3-e49bb84f13cb req-2796413e-1bfb-4fc5-a730-933afb88aa87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037560 Oct 11 05:49:41.264832 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4241/8246] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:49:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:49:41.384407 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-714f6bc8-0743-4031-a4d9-a2626eaf06c9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:49:41.397656 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-714f6bc8-0743-4031-a4d9-a2626eaf06c9 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1563 microversion: 2.1 time: 0.176120 Oct 11 05:49:41.398462 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4006/8247] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:49:41 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1563 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:02.647189 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:50:02.647769 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:50:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb/action (ip 10.222.0.26) !!! Oct 11 05:50:02.649255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:50:02.650319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=34 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:50:02.655610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a6bcd504-78b2-480d-beb8-9e194c22b706 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:50:02.657895 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a6bcd504-78b2-480d-beb8-9e194c22b706 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:02.665882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6bcd504-78b2-480d-beb8-9e194c22b706 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:02.667440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6bcd504-78b2-480d-beb8-9e194c22b706 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:02.667440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6bcd504-78b2-480d-beb8-9e194c22b706 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:02.667677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6bcd504-78b2-480d-beb8-9e194c22b706 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:02.668015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6bcd504-78b2-480d-beb8-9e194c22b706 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:02.668458 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a6bcd504-78b2-480d-beb8-9e194c22b706 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:02.719970 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a6bcd504-78b2-480d-beb8-9e194c22b706 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb/action" status: 200 len: 24569 microversion: 2.1 time: 0.075184 Oct 11 05:50:02.720836 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4242/8248] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:50:02 2022] POST /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb/action => generated 24569 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:50:13.708469 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-400711a6-b60d-4c4d-a020-3ce5f7a2cb22 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"suspend": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:50:13.709034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-400711a6-b60d-4c4d-a020-3ce5f7a2cb22 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:13.711844 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:50:13.712498 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=40 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:50:13.717235 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-400711a6-b60d-4c4d-a020-3ce5f7a2cb22 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:13.717723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-400711a6-b60d-4c4d-a020-3ce5f7a2cb22 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:13.718161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-400711a6-b60d-4c4d-a020-3ce5f7a2cb22 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:13.718882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-400711a6-b60d-4c4d-a020-3ce5f7a2cb22 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:13.719348 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-400711a6-b60d-4c4d-a020-3ce5f7a2cb22 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:13.719781 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-400711a6-b60d-4c4d-a020-3ce5f7a2cb22 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:13.742925 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-400711a6-b60d-4c4d-a020-3ce5f7a2cb22 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lazy-loading 'flavor' on Instance uuid 69835484-d18d-4b30-837e-5b1bdcb66adb {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:50:14.085488 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-400711a6-b60d-4c4d-a020-3ce5f7a2cb22 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb/action" status: 202 len: 0 microversion: 2.1 time: 0.380776 Oct 11 05:50:14.086340 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4007/8249] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:50:13 2022] POST /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:50:14.096231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5d3f5662-f0a4-4934-b9e4-b0d31aaee66f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:14.098073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5d3f5662-f0a4-4934-b9e4-b0d31aaee66f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:14.104449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d3f5662-f0a4-4934-b9e4-b0d31aaee66f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:14.104939 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d3f5662-f0a4-4934-b9e4-b0d31aaee66f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:14.105397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d3f5662-f0a4-4934-b9e4-b0d31aaee66f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:14.106100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d3f5662-f0a4-4934-b9e4-b0d31aaee66f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:14.106605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d3f5662-f0a4-4934-b9e4-b0d31aaee66f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:14.107045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5d3f5662-f0a4-4934-b9e4-b0d31aaee66f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:14.244624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5d3f5662-f0a4-4934-b9e4-b0d31aaee66f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:14.252436 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5d3f5662-f0a4-4934-b9e4-b0d31aaee66f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1689 microversion: 2.1 time: 0.161848 Oct 11 05:50:14.253000 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4243/8250] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:14 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1689 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:15.277772 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f5f7c2b-eb8a-4a78-aeb3-ffc9768543c1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:15.278506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f5f7c2b-eb8a-4a78-aeb3-ffc9768543c1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:15.286575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5f7c2b-eb8a-4a78-aeb3-ffc9768543c1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:15.287053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5f7c2b-eb8a-4a78-aeb3-ffc9768543c1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:15.287524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5f7c2b-eb8a-4a78-aeb3-ffc9768543c1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:15.288207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5f7c2b-eb8a-4a78-aeb3-ffc9768543c1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:15.288658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5f7c2b-eb8a-4a78-aeb3-ffc9768543c1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:15.289080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f5f7c2b-eb8a-4a78-aeb3-ffc9768543c1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:15.421631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f5f7c2b-eb8a-4a78-aeb3-ffc9768543c1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:15.430208 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f5f7c2b-eb8a-4a78-aeb3-ffc9768543c1 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1672 microversion: 2.1 time: 0.157046 Oct 11 05:50:15.430774 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4008/8251] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:15 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:16.525983 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e3c2c5bf-d4e2-40fd-ab85-90eb85dff30a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:50:16.528226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e3c2c5bf-d4e2-40fd-ab85-90eb85dff30a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:16.535996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c2c5bf-d4e2-40fd-ab85-90eb85dff30a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:16.536526 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c2c5bf-d4e2-40fd-ab85-90eb85dff30a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:16.536976 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c2c5bf-d4e2-40fd-ab85-90eb85dff30a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:16.537677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c2c5bf-d4e2-40fd-ab85-90eb85dff30a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:16.538143 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c2c5bf-d4e2-40fd-ab85-90eb85dff30a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:16.538609 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e3c2c5bf-d4e2-40fd-ab85-90eb85dff30a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:16.589328 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e3c2c5bf-d4e2-40fd-ab85-90eb85dff30a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb/action" status: 200 len: 38467 microversion: 2.1 time: 0.067461 Oct 11 05:50:16.589962 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4244/8252] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:50:16 2022] POST /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb/action => generated 38467 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:50:16.601682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-69f6cca4-b157-40b9-81e9-e416b5ccb668 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"resume": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:50:16.602245 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-69f6cca4-b157-40b9-81e9-e416b5ccb668 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:16.608983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69f6cca4-b157-40b9-81e9-e416b5ccb668 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:16.609964 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69f6cca4-b157-40b9-81e9-e416b5ccb668 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:16.610426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69f6cca4-b157-40b9-81e9-e416b5ccb668 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:16.611115 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69f6cca4-b157-40b9-81e9-e416b5ccb668 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:16.611566 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69f6cca4-b157-40b9-81e9-e416b5ccb668 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:16.611992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-69f6cca4-b157-40b9-81e9-e416b5ccb668 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:16.787462 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-69f6cca4-b157-40b9-81e9-e416b5ccb668 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb/action" status: 202 len: 0 microversion: 2.1 time: 0.189377 Oct 11 05:50:16.788180 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4009/8253] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:50:16 2022] POST /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:50:16.797403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4675d4e2-3f72-4111-9385-b2deba0eeb1a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:16.798116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4675d4e2-3f72-4111-9385-b2deba0eeb1a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:16.805128 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4675d4e2-3f72-4111-9385-b2deba0eeb1a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:16.805627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4675d4e2-3f72-4111-9385-b2deba0eeb1a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:16.806088 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4675d4e2-3f72-4111-9385-b2deba0eeb1a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:16.806821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4675d4e2-3f72-4111-9385-b2deba0eeb1a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:16.807291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4675d4e2-3f72-4111-9385-b2deba0eeb1a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:16.814679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4675d4e2-3f72-4111-9385-b2deba0eeb1a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:16.985787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4675d4e2-3f72-4111-9385-b2deba0eeb1a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:16.993830 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4675d4e2-3f72-4111-9385-b2deba0eeb1a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1678 microversion: 2.1 time: 0.201171 Oct 11 05:50:16.994658 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4245/8254] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:16 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1678 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:18.018731 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-75789e6b-153e-4456-bed5-a303620916c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:18.019430 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-75789e6b-153e-4456-bed5-a303620916c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:18.025759 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75789e6b-153e-4456-bed5-a303620916c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:18.026266 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75789e6b-153e-4456-bed5-a303620916c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:18.026706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75789e6b-153e-4456-bed5-a303620916c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:18.027384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75789e6b-153e-4456-bed5-a303620916c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:18.027831 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75789e6b-153e-4456-bed5-a303620916c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:18.028252 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-75789e6b-153e-4456-bed5-a303620916c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:18.164757 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-75789e6b-153e-4456-bed5-a303620916c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:18.173535 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-75789e6b-153e-4456-bed5-a303620916c3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1678 microversion: 2.1 time: 0.159920 Oct 11 05:50:18.174228 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4010/8255] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:18 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:19.197014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44343785-eccb-4fce-aeab-88bac63dd1a6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:19.197638 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44343785-eccb-4fce-aeab-88bac63dd1a6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:19.205112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44343785-eccb-4fce-aeab-88bac63dd1a6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:19.205603 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44343785-eccb-4fce-aeab-88bac63dd1a6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:19.206053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44343785-eccb-4fce-aeab-88bac63dd1a6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:19.206781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44343785-eccb-4fce-aeab-88bac63dd1a6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:19.207241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44343785-eccb-4fce-aeab-88bac63dd1a6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:19.207678 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44343785-eccb-4fce-aeab-88bac63dd1a6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:19.341001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44343785-eccb-4fce-aeab-88bac63dd1a6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:19.348838 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44343785-eccb-4fce-aeab-88bac63dd1a6 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1681 microversion: 2.1 time: 0.156010 Oct 11 05:50:19.349435 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4246/8256] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:19 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:19.443265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d52e2517-6b17-47c1-bfdd-8a77dc243d7f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:50:19.445501 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d52e2517-6b17-47c1-bfdd-8a77dc243d7f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:19.452364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d52e2517-6b17-47c1-bfdd-8a77dc243d7f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:19.452851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d52e2517-6b17-47c1-bfdd-8a77dc243d7f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:19.453903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d52e2517-6b17-47c1-bfdd-8a77dc243d7f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:19.454631 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d52e2517-6b17-47c1-bfdd-8a77dc243d7f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:19.455092 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d52e2517-6b17-47c1-bfdd-8a77dc243d7f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:19.455523 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d52e2517-6b17-47c1-bfdd-8a77dc243d7f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:19.495470 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d52e2517-6b17-47c1-bfdd-8a77dc243d7f tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "POST /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb/action" status: 200 len: 38467 microversion: 2.1 time: 0.056120 Oct 11 05:50:19.496168 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4011/8257] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:50:19 2022] POST /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb/action => generated 38467 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 11 05:50:20.521747 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1854a0f9-1600-45d9-a63b-cf6dd25ddc61 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:20.522411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1854a0f9-1600-45d9-a63b-cf6dd25ddc61 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:20.525580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-1b1d211b-bbad-4e18-88ba-ef0f18024477 req-7f5b7caf-0eb9-41f9-ba89-b876beeca0b0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "69835484-d18d-4b30-837e-5b1bdcb66adb", "tag": "821533bd-4a0a-4692-b365-32a8f83f68a7"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:50:20.530116 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1854a0f9-1600-45d9-a63b-cf6dd25ddc61 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:20.530727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1854a0f9-1600-45d9-a63b-cf6dd25ddc61 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:20.531834 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1854a0f9-1600-45d9-a63b-cf6dd25ddc61 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:20.532623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1854a0f9-1600-45d9-a63b-cf6dd25ddc61 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:20.533321 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1854a0f9-1600-45d9-a63b-cf6dd25ddc61 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:20.534017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1854a0f9-1600-45d9-a63b-cf6dd25ddc61 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:20.537584 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1b1d211b-bbad-4e18-88ba-ef0f18024477 req-7f5b7caf-0eb9-41f9-ba89-b876beeca0b0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:20.538088 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1b1d211b-bbad-4e18-88ba-ef0f18024477 req-7f5b7caf-0eb9-41f9-ba89-b876beeca0b0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:20.538563 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1b1d211b-bbad-4e18-88ba-ef0f18024477 req-7f5b7caf-0eb9-41f9-ba89-b876beeca0b0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:20.550562 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-1b1d211b-bbad-4e18-88ba-ef0f18024477 req-7f5b7caf-0eb9-41f9-ba89-b876beeca0b0 service nova] Creating event network-changed:821533bd-4a0a-4692-b365-32a8f83f68a7 for instance 69835484-d18d-4b30-837e-5b1bdcb66adb on n-h2-860892-1 Oct 11 05:50:20.555543 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-1b1d211b-bbad-4e18-88ba-ef0f18024477 req-7f5b7caf-0eb9-41f9-ba89-b876beeca0b0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036363 Oct 11 05:50:20.556460 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4012/8258] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:50:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:50:20.560914 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1854a0f9-1600-45d9-a63b-cf6dd25ddc61 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:50:20.871614 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1854a0f9-1600-45d9-a63b-cf6dd25ddc61 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "DELETE /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 204 len: 0 microversion: 2.1 time: 0.355835 Oct 11 05:50:20.872331 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4247/8259] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:50:20 2022] DELETE /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 0 bytes in 358 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:50:20.882073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9491c417-f95e-4f6e-b43a-50c63abb2ed3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:20.883313 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9491c417-f95e-4f6e-b43a-50c63abb2ed3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:20.889646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9491c417-f95e-4f6e-b43a-50c63abb2ed3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:20.890154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9491c417-f95e-4f6e-b43a-50c63abb2ed3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:20.891265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9491c417-f95e-4f6e-b43a-50c63abb2ed3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:20.891960 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9491c417-f95e-4f6e-b43a-50c63abb2ed3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:20.892437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9491c417-f95e-4f6e-b43a-50c63abb2ed3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:20.892867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9491c417-f95e-4f6e-b43a-50c63abb2ed3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:21.026569 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9491c417-f95e-4f6e-b43a-50c63abb2ed3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:21.034486 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9491c417-f95e-4f6e-b43a-50c63abb2ed3 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1687 microversion: 2.1 time: 0.157072 Oct 11 05:50:21.035065 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4013/8260] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:20 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1687 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:22.059928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c478f4ff-c6db-4d07-985c-6d3792af8d90 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:22.060639 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c478f4ff-c6db-4d07-985c-6d3792af8d90 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:22.067928 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c478f4ff-c6db-4d07-985c-6d3792af8d90 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:22.068423 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c478f4ff-c6db-4d07-985c-6d3792af8d90 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:22.068872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c478f4ff-c6db-4d07-985c-6d3792af8d90 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:22.069571 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c478f4ff-c6db-4d07-985c-6d3792af8d90 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:22.070034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c478f4ff-c6db-4d07-985c-6d3792af8d90 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:22.070500 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c478f4ff-c6db-4d07-985c-6d3792af8d90 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:22.253222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c478f4ff-c6db-4d07-985c-6d3792af8d90 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:22.260867 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c478f4ff-c6db-4d07-985c-6d3792af8d90 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1687 microversion: 2.1 time: 0.205224 Oct 11 05:50:22.261443 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4248/8261] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:22 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1687 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:23.226452 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-1d871426-3c68-436d-abc7-601b0ff796e4 req-8ce487ef-6612-4710-ad0e-6739abc96a19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "69835484-d18d-4b30-837e-5b1bdcb66adb", "name": "network-vif-deleted", "tag": "821533bd-4a0a-4692-b365-32a8f83f68a7"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:50:23.237423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1d871426-3c68-436d-abc7-601b0ff796e4 req-8ce487ef-6612-4710-ad0e-6739abc96a19 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:23.237905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1d871426-3c68-436d-abc7-601b0ff796e4 req-8ce487ef-6612-4710-ad0e-6739abc96a19 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:23.238370 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1d871426-3c68-436d-abc7-601b0ff796e4 req-8ce487ef-6612-4710-ad0e-6739abc96a19 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:23.249385 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-1d871426-3c68-436d-abc7-601b0ff796e4 req-8ce487ef-6612-4710-ad0e-6739abc96a19 service nova] Creating event network-vif-deleted:821533bd-4a0a-4692-b365-32a8f83f68a7 for instance 69835484-d18d-4b30-837e-5b1bdcb66adb on n-h2-860892-1 Oct 11 05:50:23.254624 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-1d871426-3c68-436d-abc7-601b0ff796e4 req-8ce487ef-6612-4710-ad0e-6739abc96a19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032164 Oct 11 05:50:23.255216 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4014/8262] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:50:23.287284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-44e6d71c-6aad-42a4-8300-92cfeb9ae25a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:23.288286 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-44e6d71c-6aad-42a4-8300-92cfeb9ae25a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:23.294963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e6d71c-6aad-42a4-8300-92cfeb9ae25a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:23.295468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e6d71c-6aad-42a4-8300-92cfeb9ae25a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:23.295930 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e6d71c-6aad-42a4-8300-92cfeb9ae25a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:23.296724 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e6d71c-6aad-42a4-8300-92cfeb9ae25a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:23.297238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e6d71c-6aad-42a4-8300-92cfeb9ae25a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:23.297690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-44e6d71c-6aad-42a4-8300-92cfeb9ae25a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:23.359513 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-44e6d71c-6aad-42a4-8300-92cfeb9ae25a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a263fe210f1d482797c0f803892098d6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44a5aa7caa7e495a84b2c0e677bda422', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:23.368231 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-44e6d71c-6aad-42a4-8300-92cfeb9ae25a tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 200 len: 1501 microversion: 2.1 time: 0.087100 Oct 11 05:50:23.377583 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4249/8263] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:23 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 1501 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:24.392605 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:24.393326 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] [instance: 69835484-d18d-4b30-837e-5b1bdcb66adb] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:24.400766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:24.401746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:24.401746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:24.402363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:24.402814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:24.403238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:24.416482 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] HTTP exception thrown: Instance 69835484-d18d-4b30-837e-5b1bdcb66adb could not be found. Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Request method failure captured: Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb HTTP/1.1 Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRQHS4piZqH1dure5OF-4uF_7UQtjJNzpk0Jb5Ez15iOAgJ05BhQLyncbupebXYDCjM4DCYwFt9xTz5GcJDwnQqgiCsLq8kZzuI3mHzfQAmmSu_E-hTu9Y6kmFjbTS9lLqk2rSkkeY6p8wGY24LmfuD8ig77EwFZZak6QxcZyePtclAY Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 44a5aa7caa7e495a84b2c0e677bda422 Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a5aa7caa7e495a84b2c0e677bda422"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/44a5aa7caa7e495a84b2c0e677bda422"}]}] Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 44a5aa7caa7e495a84b2c0e677bda422 Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestNetworkAdvancedServerOps-165913187 Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestNetworkAdvancedServerOps-165913187-project Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: a263fe210f1d482797c0f803892098d6 Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestNetworkAdvancedServerOps-165913187-project Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 69835484-d18d-4b30-837e-5b1bdcb66adb could not be found. Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '69835484-d18d-4b30-837e-5b1bdcb66adb'} Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 69835484-d18d-4b30-837e-5b1bdcb66adb could not be found. Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 69835484-d18d-4b30-837e-5b1bdcb66adb could not be found. Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:50:24.418125 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:50:24.423613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:50:24.423613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:50:24.423613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:50:24.423613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:50:24.423613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:50:24.423613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:50:24.423613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 69835484-d18d-4b30-837e-5b1bdcb66adb could not be found. Oct 11 05:50:24.423613 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:50:24.423613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Returning 404 to user: Instance 69835484-d18d-4b30-837e-5b1bdcb66adb could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:50:24.423613 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5231f8f2-79f4-4b66-896a-aabf9f2a8830 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb" status: 404 len: 111 microversion: 2.1 time: 0.031840 Oct 11 05:50:24.423613 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4015/8264] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:24 2022] GET /compute/v2.1/servers/69835484-d18d-4b30-837e-5b1bdcb66adb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:50:28.197294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-08fc3474-7606-4951-a1ec-0a3af0489b94 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] Calling method '.version_select at 0x7fda18be59d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:28.290212 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-08fc3474-7606-4951-a1ec-0a3af0489b94 tempest-TestNetworkAdvancedServerOps-165913187 tempest-TestNetworkAdvancedServerOps-165913187-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-443000507" status: 202 len: 0 microversion: 2.1 time: 0.096701 Oct 11 05:50:28.290746 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4250/8265] 10.222.0.26 () {58 vars in 1281 bytes} [Tue Oct 11 05:50:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestNetworkAdvancedServerOps-443000507 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:50:43.089113 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=18 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:50:43.089879 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:50:43.291060 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0ab699de-b65c-4490-b5f8-8a2cc8f1dd7e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Action: 'create', calling method: .version_select at 0x7fda199a23a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1208264130", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI3qRmlGRkmzvX4L64IDxTuz3hw0eEPcpjsP0mPY/Y1Kq6W2Y58DHehAa1iXvBXcbPWwwhfsDbiTHCZ2pBYibfDi5YpPHCO33uIJQK1tGOiHLQ8a4rQJwaF0GJSFO07RvQ=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:50:43.309721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-0ab699de-b65c-4490-b5f8-8a2cc8f1dd7e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Getting quotas for project f091652bb2bc4e5da19b981968462e02. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:50:43.317622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-0ab699de-b65c-4490-b5f8-8a2cc8f1dd7e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Getting quotas for user 3fcdd10f70864a30a953cc81809e07cd and project f091652bb2bc4e5da19b981968462e02. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:50:43.453243 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0ab699de-b65c-4490-b5f8-8a2cc8f1dd7e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.370260 Oct 11 05:50:43.453938 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4016/8266] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:50:43 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:50:45.865958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:50:45.867032 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:50:45.873106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-694955583", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1208264130", "security_groups": [{"name": "tempest-secgroup-smoke-1846592634"}], "networks": [{"uuid": "8c0e7fc5-09ed-4bdf-a98a-d4c55c95df6f"}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:50:45.982079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] validate_networks() for [('8c0e7fc5-09ed-4bdf-a98a-d4c55c95df6f', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:50:46.475461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:50:46.476278 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:50:46.476804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:50:46.478037 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:50:46.478544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:50:46.492031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:46.492654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:46.493347 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:46.494427 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:46.494975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:46.495617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:46.525677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Getting quotas for project f091652bb2bc4e5da19b981968462e02. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:50:46.532109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Getting quotas for user 3fcdd10f70864a30a953cc81809e07cd and project f091652bb2bc4e5da19b981968462e02. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:50:46.545441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:50:46.548371 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:50:46.696351 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5853b5ad-6ba1-4aa4-a8fc-8130eb02aded tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.832057 Oct 11 05:50:46.705924 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4251/8267] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:50:45 2022] POST /compute/v2.1/servers => generated 406 bytes in 842 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 11 05:50:46.710426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7bcaf138-497a-493a-ba44-b19cacad090e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:46.711054 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7bcaf138-497a-493a-ba44-b19cacad090e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:46.768149 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-7bcaf138-497a-493a-ba44-b19cacad090e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:46.777641 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7bcaf138-497a-493a-ba44-b19cacad090e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1246 microversion: 2.1 time: 0.073297 Oct 11 05:50:46.778815 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4017/8268] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:46 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1246 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:50:47.802631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-82fbeb5a-627b-47a4-adf9-bd97b3c9a7cc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:47.803173 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-82fbeb5a-627b-47a4-adf9-bd97b3c9a7cc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:47.810234 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fbeb5a-627b-47a4-adf9-bd97b3c9a7cc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:47.815692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fbeb5a-627b-47a4-adf9-bd97b3c9a7cc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:47.815692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fbeb5a-627b-47a4-adf9-bd97b3c9a7cc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:47.815692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fbeb5a-627b-47a4-adf9-bd97b3c9a7cc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:47.815692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fbeb5a-627b-47a4-adf9-bd97b3c9a7cc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:47.815692 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-82fbeb5a-627b-47a4-adf9-bd97b3c9a7cc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:47.879065 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-82fbeb5a-627b-47a4-adf9-bd97b3c9a7cc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:47.887384 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-82fbeb5a-627b-47a4-adf9-bd97b3c9a7cc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1250 microversion: 2.1 time: 0.090127 Oct 11 05:50:47.887928 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4252/8269] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:47 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1250 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:48.911005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d88476ca-6346-4c2b-ac7f-1ec55a37226e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:48.911646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d88476ca-6346-4c2b-ac7f-1ec55a37226e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:48.919169 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88476ca-6346-4c2b-ac7f-1ec55a37226e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:48.919655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88476ca-6346-4c2b-ac7f-1ec55a37226e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:48.920094 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88476ca-6346-4c2b-ac7f-1ec55a37226e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:48.920817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88476ca-6346-4c2b-ac7f-1ec55a37226e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:48.921277 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88476ca-6346-4c2b-ac7f-1ec55a37226e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:48.922230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d88476ca-6346-4c2b-ac7f-1ec55a37226e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:48.987658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d88476ca-6346-4c2b-ac7f-1ec55a37226e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:48.995862 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d88476ca-6346-4c2b-ac7f-1ec55a37226e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1298 microversion: 2.1 time: 0.088861 Oct 11 05:50:48.996671 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4018/8270] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:48 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:50.020855 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-0ac1c4b1-0496-437b-982b-fded0c4989e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:50.021849 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-0ac1c4b1-0496-437b-982b-fded0c4989e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:50.029381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ac1c4b1-0496-437b-982b-fded0c4989e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:50.029991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ac1c4b1-0496-437b-982b-fded0c4989e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:50.030564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ac1c4b1-0496-437b-982b-fded0c4989e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:50.031364 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ac1c4b1-0496-437b-982b-fded0c4989e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:50.032095 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ac1c4b1-0496-437b-982b-fded0c4989e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:50.032657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-0ac1c4b1-0496-437b-982b-fded0c4989e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:50.305071 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-0ac1c4b1-0496-437b-982b-fded0c4989e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:50.313539 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-0ac1c4b1-0496-437b-982b-fded0c4989e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1372 microversion: 2.1 time: 0.296815 Oct 11 05:50:50.314359 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4253/8271] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:50 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1372 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:50.814373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-f9d6821d-b75f-43e4-a0aa-f74076cda03b req-de60b9c2-b735-465f-8872-1d81017feedc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8661c49-a244-4bbc-8e5f-9cb3bba64afe", "tag": "1c5c6126-3b35-4a01-933b-27a03905f341"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:50:50.824726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f9d6821d-b75f-43e4-a0aa-f74076cda03b req-de60b9c2-b735-465f-8872-1d81017feedc service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:50.825204 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f9d6821d-b75f-43e4-a0aa-f74076cda03b req-de60b9c2-b735-465f-8872-1d81017feedc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:50.825635 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-f9d6821d-b75f-43e4-a0aa-f74076cda03b req-de60b9c2-b735-465f-8872-1d81017feedc service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:50.837406 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-f9d6821d-b75f-43e4-a0aa-f74076cda03b req-de60b9c2-b735-465f-8872-1d81017feedc service nova] Creating event network-changed:1c5c6126-3b35-4a01-933b-27a03905f341 for instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe on n-h1-860892-1 Oct 11 05:50:50.843225 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-f9d6821d-b75f-43e4-a0aa-f74076cda03b req-de60b9c2-b735-465f-8872-1d81017feedc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032897 Oct 11 05:50:50.844153 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4019/8272] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:50:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:50:51.336872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-570fc176-3d0a-4b5c-b8da-99468293b003 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:51.337517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-570fc176-3d0a-4b5c-b8da-99468293b003 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:51.345129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-570fc176-3d0a-4b5c-b8da-99468293b003 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:51.345634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-570fc176-3d0a-4b5c-b8da-99468293b003 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:51.346089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-570fc176-3d0a-4b5c-b8da-99468293b003 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:51.346935 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-570fc176-3d0a-4b5c-b8da-99468293b003 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:51.347413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-570fc176-3d0a-4b5c-b8da-99468293b003 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:51.347856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-570fc176-3d0a-4b5c-b8da-99468293b003 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:51.558540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-570fc176-3d0a-4b5c-b8da-99468293b003 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:51.566564 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-570fc176-3d0a-4b5c-b8da-99468293b003 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1372 microversion: 2.1 time: 0.233652 Oct 11 05:50:51.567145 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4254/8273] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:51 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1372 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:52.589895 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-942c7d80-d01d-4bd6-b813-70daa97d32cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:52.590627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-942c7d80-d01d-4bd6-b813-70daa97d32cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:52.597850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-942c7d80-d01d-4bd6-b813-70daa97d32cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:52.598372 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-942c7d80-d01d-4bd6-b813-70daa97d32cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:52.598807 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-942c7d80-d01d-4bd6-b813-70daa97d32cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:52.599490 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-942c7d80-d01d-4bd6-b813-70daa97d32cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:52.599941 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-942c7d80-d01d-4bd6-b813-70daa97d32cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:52.600363 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-942c7d80-d01d-4bd6-b813-70daa97d32cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:52.735008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-942c7d80-d01d-4bd6-b813-70daa97d32cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:52.742636 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-942c7d80-d01d-4bd6-b813-70daa97d32cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1372 microversion: 2.1 time: 0.156985 Oct 11 05:50:52.743229 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4020/8274] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:52 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1372 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:53.766755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7f84e864-0923-449f-9630-65cf13145c7d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:53.767314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7f84e864-0923-449f-9630-65cf13145c7d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:53.774180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f84e864-0923-449f-9630-65cf13145c7d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:53.774713 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f84e864-0923-449f-9630-65cf13145c7d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:53.775411 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f84e864-0923-449f-9630-65cf13145c7d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:53.776112 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f84e864-0923-449f-9630-65cf13145c7d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:53.776580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f84e864-0923-449f-9630-65cf13145c7d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:53.777015 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7f84e864-0923-449f-9630-65cf13145c7d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:53.910152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7f84e864-0923-449f-9630-65cf13145c7d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:53.917844 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7f84e864-0923-449f-9630-65cf13145c7d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1372 microversion: 2.1 time: 0.155691 Oct 11 05:50:53.918445 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4255/8275] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:53 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:54.941429 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f565ff2b-7462-4d66-a849-4d04ac64a1a1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:54.942042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f565ff2b-7462-4d66-a849-4d04ac64a1a1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:54.949380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f565ff2b-7462-4d66-a849-4d04ac64a1a1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:54.949860 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f565ff2b-7462-4d66-a849-4d04ac64a1a1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:54.950335 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f565ff2b-7462-4d66-a849-4d04ac64a1a1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:54.951036 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f565ff2b-7462-4d66-a849-4d04ac64a1a1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:54.951491 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f565ff2b-7462-4d66-a849-4d04ac64a1a1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:54.951918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f565ff2b-7462-4d66-a849-4d04ac64a1a1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:55.080747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f565ff2b-7462-4d66-a849-4d04ac64a1a1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:55.088391 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f565ff2b-7462-4d66-a849-4d04ac64a1a1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1372 microversion: 2.1 time: 0.150981 Oct 11 05:50:55.088962 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4021/8276] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:54 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:56.111877 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4be6974c-5dab-4481-8fba-3590451fdbc2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:56.112505 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4be6974c-5dab-4481-8fba-3590451fdbc2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:56.119441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be6974c-5dab-4481-8fba-3590451fdbc2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:56.119980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be6974c-5dab-4481-8fba-3590451fdbc2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:56.120429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be6974c-5dab-4481-8fba-3590451fdbc2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:56.121123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be6974c-5dab-4481-8fba-3590451fdbc2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:56.121583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be6974c-5dab-4481-8fba-3590451fdbc2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:56.122017 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4be6974c-5dab-4481-8fba-3590451fdbc2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:56.251740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4be6974c-5dab-4481-8fba-3590451fdbc2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:56.260236 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4be6974c-5dab-4481-8fba-3590451fdbc2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1372 microversion: 2.1 time: 0.152877 Oct 11 05:50:56.261074 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4256/8277] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:56 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1372 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:57.284104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d0e3bc01-f301-456f-bd65-d9ef85c512f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:57.284723 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d0e3bc01-f301-456f-bd65-d9ef85c512f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:57.287515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=6 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:50:57.292328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0e3bc01-f301-456f-bd65-d9ef85c512f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:57.292811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0e3bc01-f301-456f-bd65-d9ef85c512f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:57.293250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0e3bc01-f301-456f-bd65-d9ef85c512f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:57.293939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0e3bc01-f301-456f-bd65-d9ef85c512f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:57.294418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0e3bc01-f301-456f-bd65-d9ef85c512f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:57.294850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d0e3bc01-f301-456f-bd65-d9ef85c512f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:57.431119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d0e3bc01-f301-456f-bd65-d9ef85c512f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:57.438958 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d0e3bc01-f301-456f-bd65-d9ef85c512f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1372 microversion: 2.1 time: 0.158797 Oct 11 05:50:57.439532 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4022/8278] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:57 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:57.999265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-aa758ec0-826a-4218-b871-e289e18d325b req-de943d33-543c-4c2c-a32d-49e734749212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8661c49-a244-4bbc-8e5f-9cb3bba64afe", "name": "network-vif-plugged", "status": "completed", "tag": "1c5c6126-3b35-4a01-933b-27a03905f341"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:50:58.004403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:50:58.005028 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:50:58.011405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-aa758ec0-826a-4218-b871-e289e18d325b req-de943d33-543c-4c2c-a32d-49e734749212 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:58.011899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-aa758ec0-826a-4218-b871-e289e18d325b req-de943d33-543c-4c2c-a32d-49e734749212 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:58.012344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-aa758ec0-826a-4218-b871-e289e18d325b req-de943d33-543c-4c2c-a32d-49e734749212 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:58.023768 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-aa758ec0-826a-4218-b871-e289e18d325b req-de943d33-543c-4c2c-a32d-49e734749212 service nova] Creating event network-vif-plugged:1c5c6126-3b35-4a01-933b-27a03905f341 for instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe on n-h1-860892-1 Oct 11 05:50:58.029089 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-aa758ec0-826a-4218-b871-e289e18d325b req-de943d33-543c-4c2c-a32d-49e734749212 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033540 Oct 11 05:50:58.029664 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4257/8279] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:50:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:50:58.462305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dacb357a-43cf-4c65-9e2d-e4bf116de089 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:58.463005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dacb357a-43cf-4c65-9e2d-e4bf116de089 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:58.469917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacb357a-43cf-4c65-9e2d-e4bf116de089 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:58.470455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacb357a-43cf-4c65-9e2d-e4bf116de089 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:58.470892 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacb357a-43cf-4c65-9e2d-e4bf116de089 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:58.471581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacb357a-43cf-4c65-9e2d-e4bf116de089 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:58.472031 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacb357a-43cf-4c65-9e2d-e4bf116de089 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:58.472455 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dacb357a-43cf-4c65-9e2d-e4bf116de089 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:58.604737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dacb357a-43cf-4c65-9e2d-e4bf116de089 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:58.612999 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dacb357a-43cf-4c65-9e2d-e4bf116de089 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1372 microversion: 2.1 time: 0.154596 Oct 11 05:50:58.613575 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4023/8280] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:58 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1372 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:50:59.638174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-6087dacd-5a3b-4659-ba43-f38c6ee0c606 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:50:59.638938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-6087dacd-5a3b-4659-ba43-f38c6ee0c606 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:50:59.646829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6087dacd-5a3b-4659-ba43-f38c6ee0c606 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:59.647325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6087dacd-5a3b-4659-ba43-f38c6ee0c606 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:59.647778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6087dacd-5a3b-4659-ba43-f38c6ee0c606 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:59.648479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6087dacd-5a3b-4659-ba43-f38c6ee0c606 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:50:59.648958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6087dacd-5a3b-4659-ba43-f38c6ee0c606 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:50:59.649391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-6087dacd-5a3b-4659-ba43-f38c6ee0c606 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:50:59.787796 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-6087dacd-5a3b-4659-ba43-f38c6ee0c606 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:50:59.795570 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-6087dacd-5a3b-4659-ba43-f38c6ee0c606 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1372 microversion: 2.1 time: 0.162561 Oct 11 05:50:59.796146 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4258/8281] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:50:59 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:51:00.818343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-03c0d557-d653-44b5-a3db-6bbaf0a95fd7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:51:00.819007 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-03c0d557-d653-44b5-a3db-6bbaf0a95fd7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:51:00.825766 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03c0d557-d653-44b5-a3db-6bbaf0a95fd7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:51:00.826275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03c0d557-d653-44b5-a3db-6bbaf0a95fd7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:51:00.826718 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03c0d557-d653-44b5-a3db-6bbaf0a95fd7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:51:00.827940 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03c0d557-d653-44b5-a3db-6bbaf0a95fd7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:51:00.828376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03c0d557-d653-44b5-a3db-6bbaf0a95fd7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:51:00.828802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03c0d557-d653-44b5-a3db-6bbaf0a95fd7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:51:00.956868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-03c0d557-d653-44b5-a3db-6bbaf0a95fd7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:51:00.964657 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-03c0d557-d653-44b5-a3db-6bbaf0a95fd7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1557 microversion: 2.1 time: 0.150355 Oct 11 05:51:00.965225 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4024/8282] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:51:00 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:51:00.987126 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f5dbaff-890e-4089-931a-f035bd7239ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:51:00.987751 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f5dbaff-890e-4089-931a-f035bd7239ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:51:00.994392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f5dbaff-890e-4089-931a-f035bd7239ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:51:00.994882 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f5dbaff-890e-4089-931a-f035bd7239ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:51:00.995325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f5dbaff-890e-4089-931a-f035bd7239ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:51:00.996051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f5dbaff-890e-4089-931a-f035bd7239ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:51:00.996510 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f5dbaff-890e-4089-931a-f035bd7239ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:51:00.996944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f5dbaff-890e-4089-931a-f035bd7239ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:51:01.126150 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f5dbaff-890e-4089-931a-f035bd7239ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:51:01.133861 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f5dbaff-890e-4089-931a-f035bd7239ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1557 microversion: 2.1 time: 0.150576 Oct 11 05:51:01.134465 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4259/8283] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:51:00 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1557 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:51:03.392840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-e6e64865-d2ce-410b-a464-2c8988a5dd35 req-ba85a469-83ce-434e-87b3-926af8ebe89d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8661c49-a244-4bbc-8e5f-9cb3bba64afe", "tag": "1c5c6126-3b35-4a01-933b-27a03905f341"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:51:03.402843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e6e64865-d2ce-410b-a464-2c8988a5dd35 req-ba85a469-83ce-434e-87b3-926af8ebe89d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:51:03.403314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e6e64865-d2ce-410b-a464-2c8988a5dd35 req-ba85a469-83ce-434e-87b3-926af8ebe89d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:51:03.403838 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-e6e64865-d2ce-410b-a464-2c8988a5dd35 req-ba85a469-83ce-434e-87b3-926af8ebe89d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:51:03.415727 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-e6e64865-d2ce-410b-a464-2c8988a5dd35 req-ba85a469-83ce-434e-87b3-926af8ebe89d service nova] Creating event network-changed:1c5c6126-3b35-4a01-933b-27a03905f341 for instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe on n-h1-860892-1 Oct 11 05:51:03.420658 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-e6e64865-d2ce-410b-a464-2c8988a5dd35 req-ba85a469-83ce-434e-87b3-926af8ebe89d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088931 Oct 11 05:51:03.422166 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4025/8284] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:53:29.531304 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 05:53:29.532232 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc2e98b3-7f64-4104-93f2-3fa6b98fc453] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 05:53:29.532868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:53:29.533632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=46 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:53:29.534635 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:53:29.534768 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe/action (ip 10.222.0.26) !!! Oct 11 05:53:29.535868 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:53:29.536011 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe/action (ip 10.222.0.26) !!! Oct 11 05:53:29.536984 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:53:29.537089 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:53:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe/action (ip 10.222.0.26) !!! Oct 11 05:53:29.541245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cd5c3190-1d54-4a5a-8e24-6495643bcb38 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:53:29.541794 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cd5c3190-1d54-4a5a-8e24-6495643bcb38 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:29.551096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd5c3190-1d54-4a5a-8e24-6495643bcb38 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:29.551583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd5c3190-1d54-4a5a-8e24-6495643bcb38 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:29.552043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd5c3190-1d54-4a5a-8e24-6495643bcb38 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:29.552787 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd5c3190-1d54-4a5a-8e24-6495643bcb38 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:29.553241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd5c3190-1d54-4a5a-8e24-6495643bcb38 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:29.553679 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd5c3190-1d54-4a5a-8e24-6495643bcb38 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:29.578628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-cd5c3190-1d54-4a5a-8e24-6495643bcb38 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lazy-loading 'flavor' on Instance uuid b8661c49-a244-4bbc-8e5f-9cb3bba64afe {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:53:30.110370 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cd5c3190-1d54-4a5a-8e24-6495643bcb38 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "POST /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe/action" status: 202 len: 0 microversion: 2.1 time: 0.580963 Oct 11 05:53:30.110994 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4260/8285] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:53:29 2022] POST /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe/action => generated 0 bytes in 583 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:53:30.118538 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:53:30.119382 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:53:30.119997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:53:30.120815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=40 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:53:30.122134 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:53:30.122317 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:53:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe (ip 10.222.0.26) !!! Oct 11 05:53:30.123365 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:53:30.123502 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:53:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe (ip 10.222.0.26) !!! Oct 11 05:53:30.129655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1ec72c7f-2523-4649-a418-9aff361181d9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:30.130997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1ec72c7f-2523-4649-a418-9aff361181d9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:30.142331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec72c7f-2523-4649-a418-9aff361181d9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:30.142818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec72c7f-2523-4649-a418-9aff361181d9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:30.143258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec72c7f-2523-4649-a418-9aff361181d9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:30.143953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec72c7f-2523-4649-a418-9aff361181d9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:30.144410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec72c7f-2523-4649-a418-9aff361181d9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:30.144839 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1ec72c7f-2523-4649-a418-9aff361181d9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:30.340482 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1ec72c7f-2523-4649-a418-9aff361181d9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:30.348772 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1ec72c7f-2523-4649-a418-9aff361181d9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1682 microversion: 2.1 time: 0.231810 Oct 11 05:53:30.349339 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4026/8286] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:30 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1682 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:53:31.374463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b08af897-232b-4683-a87e-ed316524aa43 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:31.375181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b08af897-232b-4683-a87e-ed316524aa43 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:31.387060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b08af897-232b-4683-a87e-ed316524aa43 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:31.387559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b08af897-232b-4683-a87e-ed316524aa43 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:31.388012 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b08af897-232b-4683-a87e-ed316524aa43 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:31.388721 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b08af897-232b-4683-a87e-ed316524aa43 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:31.389189 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b08af897-232b-4683-a87e-ed316524aa43 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:31.389628 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b08af897-232b-4683-a87e-ed316524aa43 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:31.406590 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 41630. Oct 11 05:53:31.410035 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc2e98b3-7f64-4104-93f2-3fa6b98fc453] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 41632. Oct 11 05:53:31.523992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b08af897-232b-4683-a87e-ed316524aa43 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:31.531911 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b08af897-232b-4683-a87e-ed316524aa43 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1682 microversion: 2.1 time: 0.162864 Oct 11 05:53:31.532482 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4261/8287] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:31 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:32.555471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d2dc193b-c1a1-4e34-ab7c-179d2597dfb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:32.556117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d2dc193b-c1a1-4e34-ab7c-179d2597dfb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:32.564200 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2dc193b-c1a1-4e34-ab7c-179d2597dfb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:32.564681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2dc193b-c1a1-4e34-ab7c-179d2597dfb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:32.565116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2dc193b-c1a1-4e34-ab7c-179d2597dfb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:32.565802 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2dc193b-c1a1-4e34-ab7c-179d2597dfb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:32.567592 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2dc193b-c1a1-4e34-ab7c-179d2597dfb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:32.568371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d2dc193b-c1a1-4e34-ab7c-179d2597dfb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:32.574351 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 41640. Oct 11 05:53:32.584363 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 41638. Oct 11 05:53:32.712280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d2dc193b-c1a1-4e34-ab7c-179d2597dfb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:32.720051 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d2dc193b-c1a1-4e34-ab7c-179d2597dfb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1682 microversion: 2.1 time: 0.168551 Oct 11 05:53:32.720630 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4027/8288] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:32 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:33.743156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-28c62cb3-8bed-4f1e-a95f-beb22757a4bf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:33.743817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-28c62cb3-8bed-4f1e-a95f-beb22757a4bf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:33.750659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28c62cb3-8bed-4f1e-a95f-beb22757a4bf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:33.751158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28c62cb3-8bed-4f1e-a95f-beb22757a4bf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:33.751610 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28c62cb3-8bed-4f1e-a95f-beb22757a4bf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:33.752315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28c62cb3-8bed-4f1e-a95f-beb22757a4bf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:33.752786 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28c62cb3-8bed-4f1e-a95f-beb22757a4bf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:33.753229 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-28c62cb3-8bed-4f1e-a95f-beb22757a4bf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:33.886927 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-28c62cb3-8bed-4f1e-a95f-beb22757a4bf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:33.894750 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-28c62cb3-8bed-4f1e-a95f-beb22757a4bf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1682 microversion: 2.1 time: 0.155551 Oct 11 05:53:33.895988 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4262/8289] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:33 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:34.918660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f38bebc2-e1dd-4588-a2c9-5700c98ba631 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:34.919282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f38bebc2-e1dd-4588-a2c9-5700c98ba631 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:34.926102 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38bebc2-e1dd-4588-a2c9-5700c98ba631 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:34.926627 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38bebc2-e1dd-4588-a2c9-5700c98ba631 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:34.927065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38bebc2-e1dd-4588-a2c9-5700c98ba631 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:34.927752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38bebc2-e1dd-4588-a2c9-5700c98ba631 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:34.928205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38bebc2-e1dd-4588-a2c9-5700c98ba631 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:34.928632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f38bebc2-e1dd-4588-a2c9-5700c98ba631 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:35.061105 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f38bebc2-e1dd-4588-a2c9-5700c98ba631 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:35.069126 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f38bebc2-e1dd-4588-a2c9-5700c98ba631 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1682 microversion: 2.1 time: 0.154347 Oct 11 05:53:35.069692 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4028/8290] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:34 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:36.092986 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b292f4e8-21cc-4d2c-a701-6b0a402999c2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:36.093618 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b292f4e8-21cc-4d2c-a701-6b0a402999c2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:36.101184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b292f4e8-21cc-4d2c-a701-6b0a402999c2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:36.101683 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b292f4e8-21cc-4d2c-a701-6b0a402999c2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:36.102137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b292f4e8-21cc-4d2c-a701-6b0a402999c2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:36.102871 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b292f4e8-21cc-4d2c-a701-6b0a402999c2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:36.103341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b292f4e8-21cc-4d2c-a701-6b0a402999c2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:36.103784 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b292f4e8-21cc-4d2c-a701-6b0a402999c2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:36.241578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b292f4e8-21cc-4d2c-a701-6b0a402999c2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:36.244555 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b292f4e8-21cc-4d2c-a701-6b0a402999c2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1682 microversion: 2.1 time: 0.155531 Oct 11 05:53:36.245125 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4263/8291] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:36 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:37.267906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-03dca5b8-a336-4e57-aea4-c51c495235d0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:37.268517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-03dca5b8-a336-4e57-aea4-c51c495235d0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:37.275350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03dca5b8-a336-4e57-aea4-c51c495235d0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:37.275832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03dca5b8-a336-4e57-aea4-c51c495235d0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:37.276575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03dca5b8-a336-4e57-aea4-c51c495235d0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:37.277254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03dca5b8-a336-4e57-aea4-c51c495235d0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:37.277701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03dca5b8-a336-4e57-aea4-c51c495235d0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:37.278122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-03dca5b8-a336-4e57-aea4-c51c495235d0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:37.408803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-03dca5b8-a336-4e57-aea4-c51c495235d0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:37.416703 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-03dca5b8-a336-4e57-aea4-c51c495235d0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1682 microversion: 2.1 time: 0.152786 Oct 11 05:53:37.417281 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4029/8292] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:37 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:38.440817 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-01fa2a75-faea-4753-9c7d-cc55f5542e27 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:38.441443 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-01fa2a75-faea-4753-9c7d-cc55f5542e27 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:38.448319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fa2a75-faea-4753-9c7d-cc55f5542e27 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:38.448818 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fa2a75-faea-4753-9c7d-cc55f5542e27 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:38.449269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fa2a75-faea-4753-9c7d-cc55f5542e27 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:38.449969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fa2a75-faea-4753-9c7d-cc55f5542e27 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:38.450459 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fa2a75-faea-4753-9c7d-cc55f5542e27 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:38.450905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-01fa2a75-faea-4753-9c7d-cc55f5542e27 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:38.580320 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-01fa2a75-faea-4753-9c7d-cc55f5542e27 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:38.588048 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-01fa2a75-faea-4753-9c7d-cc55f5542e27 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1682 microversion: 2.1 time: 0.151201 Oct 11 05:53:38.588619 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4264/8293] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:38 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:39.611850 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-428369e2-7d3a-4458-a171-44a1e1a19f72 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:39.612562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-428369e2-7d3a-4458-a171-44a1e1a19f72 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:39.619832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428369e2-7d3a-4458-a171-44a1e1a19f72 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:39.620314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428369e2-7d3a-4458-a171-44a1e1a19f72 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:39.620753 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428369e2-7d3a-4458-a171-44a1e1a19f72 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:39.621441 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428369e2-7d3a-4458-a171-44a1e1a19f72 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:39.621896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428369e2-7d3a-4458-a171-44a1e1a19f72 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:39.622357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-428369e2-7d3a-4458-a171-44a1e1a19f72 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:39.750034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-428369e2-7d3a-4458-a171-44a1e1a19f72 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:39.758548 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-428369e2-7d3a-4458-a171-44a1e1a19f72 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1682 microversion: 2.1 time: 0.150590 Oct 11 05:53:39.759127 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4030/8294] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:39 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:40.782768 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-732c3828-a29b-46ff-b4b7-38ba0c927292 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:40.783317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-732c3828-a29b-46ff-b4b7-38ba0c927292 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:40.790200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-732c3828-a29b-46ff-b4b7-38ba0c927292 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:40.790709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-732c3828-a29b-46ff-b4b7-38ba0c927292 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:40.791156 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-732c3828-a29b-46ff-b4b7-38ba0c927292 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:40.791856 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-732c3828-a29b-46ff-b4b7-38ba0c927292 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:40.792322 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-732c3828-a29b-46ff-b4b7-38ba0c927292 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:40.792765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-732c3828-a29b-46ff-b4b7-38ba0c927292 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:40.925717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-732c3828-a29b-46ff-b4b7-38ba0c927292 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:40.933863 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-732c3828-a29b-46ff-b4b7-38ba0c927292 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1682 microversion: 2.1 time: 0.155040 Oct 11 05:53:40.934464 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4265/8295] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:40 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:41.957769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9b59cc59-4f4e-4202-aa94-5ebec8d2cbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:41.958404 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9b59cc59-4f4e-4202-aa94-5ebec8d2cbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:41.965402 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b59cc59-4f4e-4202-aa94-5ebec8d2cbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:41.965882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b59cc59-4f4e-4202-aa94-5ebec8d2cbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:41.966364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b59cc59-4f4e-4202-aa94-5ebec8d2cbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:41.967059 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b59cc59-4f4e-4202-aa94-5ebec8d2cbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:41.967511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b59cc59-4f4e-4202-aa94-5ebec8d2cbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:41.967938 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9b59cc59-4f4e-4202-aa94-5ebec8d2cbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:42.101518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9b59cc59-4f4e-4202-aa94-5ebec8d2cbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:42.109366 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9b59cc59-4f4e-4202-aa94-5ebec8d2cbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1703 microversion: 2.1 time: 0.155539 Oct 11 05:53:42.112390 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4031/8296] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:41 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1703 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:43.133615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b6438ed8-bbf6-4ebf-95af-00391c857cf5 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:43.134258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b6438ed8-bbf6-4ebf-95af-00391c857cf5 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:43.141380 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6438ed8-bbf6-4ebf-95af-00391c857cf5 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:43.141879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6438ed8-bbf6-4ebf-95af-00391c857cf5 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:43.142375 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6438ed8-bbf6-4ebf-95af-00391c857cf5 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:43.143079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6438ed8-bbf6-4ebf-95af-00391c857cf5 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:43.143584 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6438ed8-bbf6-4ebf-95af-00391c857cf5 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:43.144023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b6438ed8-bbf6-4ebf-95af-00391c857cf5 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:43.274542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b6438ed8-bbf6-4ebf-95af-00391c857cf5 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:43.284360 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b6438ed8-bbf6-4ebf-95af-00391c857cf5 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1703 microversion: 2.1 time: 0.155200 Oct 11 05:53:43.284936 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4266/8297] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:43 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1703 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:44.307842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-3409156a-08ed-40fa-b519-13c1f8ddaa1e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:44.308494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-3409156a-08ed-40fa-b519-13c1f8ddaa1e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:44.315334 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3409156a-08ed-40fa-b519-13c1f8ddaa1e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:44.315870 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3409156a-08ed-40fa-b519-13c1f8ddaa1e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:44.316315 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3409156a-08ed-40fa-b519-13c1f8ddaa1e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:44.317559 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3409156a-08ed-40fa-b519-13c1f8ddaa1e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:44.318017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3409156a-08ed-40fa-b519-13c1f8ddaa1e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:44.318470 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-3409156a-08ed-40fa-b519-13c1f8ddaa1e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:44.457454 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-3409156a-08ed-40fa-b519-13c1f8ddaa1e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:44.460699 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-3409156a-08ed-40fa-b519-13c1f8ddaa1e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1703 microversion: 2.1 time: 0.156832 Oct 11 05:53:44.461278 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4032/8298] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:44 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1703 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:45.483282 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8da408b0-55db-4b2a-bab4-9f4c526f3c57 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:45.483833 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8da408b0-55db-4b2a-bab4-9f4c526f3c57 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:45.490712 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8da408b0-55db-4b2a-bab4-9f4c526f3c57 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:45.491205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8da408b0-55db-4b2a-bab4-9f4c526f3c57 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:45.491656 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8da408b0-55db-4b2a-bab4-9f4c526f3c57 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:45.492355 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8da408b0-55db-4b2a-bab4-9f4c526f3c57 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:45.492819 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8da408b0-55db-4b2a-bab4-9f4c526f3c57 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:45.493256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8da408b0-55db-4b2a-bab4-9f4c526f3c57 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:45.625232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8da408b0-55db-4b2a-bab4-9f4c526f3c57 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:45.633072 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8da408b0-55db-4b2a-bab4-9f4c526f3c57 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1703 microversion: 2.1 time: 0.153759 Oct 11 05:53:45.633645 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4267/8299] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:45 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1703 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:46.423270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-37e74a7a-85b0-42bc-8519-d18039bfcc08 req-1e7281f8-ccdc-48cd-9e30-19e22ac7dada service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8661c49-a244-4bbc-8e5f-9cb3bba64afe", "name": "network-vif-plugged", "status": "completed", "tag": "1c5c6126-3b35-4a01-933b-27a03905f341"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:53:46.440992 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-37e74a7a-85b0-42bc-8519-d18039bfcc08 req-1e7281f8-ccdc-48cd-9e30-19e22ac7dada service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:46.442064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-37e74a7a-85b0-42bc-8519-d18039bfcc08 req-1e7281f8-ccdc-48cd-9e30-19e22ac7dada service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:46.442758 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-37e74a7a-85b0-42bc-8519-d18039bfcc08 req-1e7281f8-ccdc-48cd-9e30-19e22ac7dada service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:46.459593 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-37e74a7a-85b0-42bc-8519-d18039bfcc08 req-1e7281f8-ccdc-48cd-9e30-19e22ac7dada service nova] Creating event network-vif-plugged:1c5c6126-3b35-4a01-933b-27a03905f341 for instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe on n-h1-860892-1 Oct 11 05:53:46.468568 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-37e74a7a-85b0-42bc-8519-d18039bfcc08 req-1e7281f8-ccdc-48cd-9e30-19e22ac7dada service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102865 Oct 11 05:53:46.468568 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4033/8300] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:53:46.656727 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ce336e73-7497-4629-8e9a-b0df0d616926 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:46.657357 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ce336e73-7497-4629-8e9a-b0df0d616926 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:46.665118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce336e73-7497-4629-8e9a-b0df0d616926 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:46.667866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce336e73-7497-4629-8e9a-b0df0d616926 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:46.667866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce336e73-7497-4629-8e9a-b0df0d616926 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:46.667866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce336e73-7497-4629-8e9a-b0df0d616926 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:46.667866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce336e73-7497-4629-8e9a-b0df0d616926 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:46.667866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ce336e73-7497-4629-8e9a-b0df0d616926 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:46.808709 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ce336e73-7497-4629-8e9a-b0df0d616926 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:46.817430 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ce336e73-7497-4629-8e9a-b0df0d616926 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1698 microversion: 2.1 time: 0.164643 Oct 11 05:53:46.818032 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4268/8301] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:46 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1698 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:53:47.844258 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b55be0d9-3220-4ba8-a822-713359a9aee3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:47.844953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b55be0d9-3220-4ba8-a822-713359a9aee3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:47.853175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b55be0d9-3220-4ba8-a822-713359a9aee3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:47.853697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b55be0d9-3220-4ba8-a822-713359a9aee3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:47.854140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b55be0d9-3220-4ba8-a822-713359a9aee3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:47.854881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b55be0d9-3220-4ba8-a822-713359a9aee3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:47.855396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b55be0d9-3220-4ba8-a822-713359a9aee3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:47.856008 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b55be0d9-3220-4ba8-a822-713359a9aee3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:48.008173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b55be0d9-3220-4ba8-a822-713359a9aee3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:48.016271 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b55be0d9-3220-4ba8-a822-713359a9aee3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1698 microversion: 2.1 time: 0.177223 Oct 11 05:53:48.018676 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4034/8302] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:47 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1698 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:49.045543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b40cd0e8-6a5f-4875-b5a3-520d54ebdc34 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:49.046854 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b40cd0e8-6a5f-4875-b5a3-520d54ebdc34 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:49.054213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40cd0e8-6a5f-4875-b5a3-520d54ebdc34 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:49.054947 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40cd0e8-6a5f-4875-b5a3-520d54ebdc34 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:49.055594 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40cd0e8-6a5f-4875-b5a3-520d54ebdc34 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:49.056313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40cd0e8-6a5f-4875-b5a3-520d54ebdc34 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:49.056780 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40cd0e8-6a5f-4875-b5a3-520d54ebdc34 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:49.057219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b40cd0e8-6a5f-4875-b5a3-520d54ebdc34 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:49.203142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b40cd0e8-6a5f-4875-b5a3-520d54ebdc34 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:49.214552 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b40cd0e8-6a5f-4875-b5a3-520d54ebdc34 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1698 microversion: 2.1 time: 0.170077 Oct 11 05:53:49.215320 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4269/8303] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:49 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1698 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:50.238922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-05446dda-e3e7-4215-9860-8636a4c522c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:50.239515 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-05446dda-e3e7-4215-9860-8636a4c522c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:50.247468 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05446dda-e3e7-4215-9860-8636a4c522c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:50.248163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05446dda-e3e7-4215-9860-8636a4c522c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:50.248729 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05446dda-e3e7-4215-9860-8636a4c522c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:50.249649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05446dda-e3e7-4215-9860-8636a4c522c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:50.250333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05446dda-e3e7-4215-9860-8636a4c522c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:50.250790 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-05446dda-e3e7-4215-9860-8636a4c522c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:50.384868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-05446dda-e3e7-4215-9860-8636a4c522c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:50.392652 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-05446dda-e3e7-4215-9860-8636a4c522c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1698 microversion: 2.1 time: 0.157694 Oct 11 05:53:50.393242 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4035/8304] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:50 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1698 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:51.417897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-821f0cd6-7678-4d2a-9064-57116bf31aa8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:51.418589 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-821f0cd6-7678-4d2a-9064-57116bf31aa8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:51.430049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f0cd6-7678-4d2a-9064-57116bf31aa8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:51.430583 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f0cd6-7678-4d2a-9064-57116bf31aa8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:51.431034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f0cd6-7678-4d2a-9064-57116bf31aa8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:51.431838 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f0cd6-7678-4d2a-9064-57116bf31aa8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:51.432256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f0cd6-7678-4d2a-9064-57116bf31aa8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:51.433179 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-821f0cd6-7678-4d2a-9064-57116bf31aa8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:51.579226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-821f0cd6-7678-4d2a-9064-57116bf31aa8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:51.587731 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-821f0cd6-7678-4d2a-9064-57116bf31aa8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1698 microversion: 2.1 time: 0.173803 Oct 11 05:53:51.601756 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4270/8305] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:51 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1698 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:52.612737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c93a3f05-0159-451f-863a-b32761cfd8ab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:52.613597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c93a3f05-0159-451f-863a-b32761cfd8ab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:52.622044 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c93a3f05-0159-451f-863a-b32761cfd8ab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:52.622580 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c93a3f05-0159-451f-863a-b32761cfd8ab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:52.623025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c93a3f05-0159-451f-863a-b32761cfd8ab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:52.623736 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c93a3f05-0159-451f-863a-b32761cfd8ab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:52.624196 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c93a3f05-0159-451f-863a-b32761cfd8ab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:52.624628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c93a3f05-0159-451f-863a-b32761cfd8ab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:52.788552 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-c93a3f05-0159-451f-863a-b32761cfd8ab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:52.797278 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c93a3f05-0159-451f-863a-b32761cfd8ab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1698 microversion: 2.1 time: 0.189371 Oct 11 05:53:52.797893 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4036/8306] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:52 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1698 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:53.821331 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e403b524-034f-48a8-992a-2562e2e72792 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:53.821980 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e403b524-034f-48a8-992a-2562e2e72792 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:53.829840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e403b524-034f-48a8-992a-2562e2e72792 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:53.830422 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e403b524-034f-48a8-992a-2562e2e72792 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:53.830870 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e403b524-034f-48a8-992a-2562e2e72792 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:53.831634 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e403b524-034f-48a8-992a-2562e2e72792 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:53.832248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e403b524-034f-48a8-992a-2562e2e72792 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:53.833178 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e403b524-034f-48a8-992a-2562e2e72792 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:53.982507 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e403b524-034f-48a8-992a-2562e2e72792 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:53.991870 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e403b524-034f-48a8-992a-2562e2e72792 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1698 microversion: 2.1 time: 0.174788 Oct 11 05:53:53.992544 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4271/8307] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:53 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1698 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:55.015911 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1df02094-dd69-4210-ab8b-5348760867b8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:55.017249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1df02094-dd69-4210-ab8b-5348760867b8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:55.025175 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1df02094-dd69-4210-ab8b-5348760867b8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:55.025751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1df02094-dd69-4210-ab8b-5348760867b8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:55.026591 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1df02094-dd69-4210-ab8b-5348760867b8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:55.027293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1df02094-dd69-4210-ab8b-5348760867b8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:55.027746 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1df02094-dd69-4210-ab8b-5348760867b8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:55.028171 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1df02094-dd69-4210-ab8b-5348760867b8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:55.182603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1df02094-dd69-4210-ab8b-5348760867b8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:55.195124 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1df02094-dd69-4210-ab8b-5348760867b8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1698 microversion: 2.1 time: 0.182896 Oct 11 05:53:55.195905 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4037/8308] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:55 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1698 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:56.219456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-974eb605-12b9-4b44-a889-cd69e8fc2f3d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:56.229288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-974eb605-12b9-4b44-a889-cd69e8fc2f3d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:56.229288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-974eb605-12b9-4b44-a889-cd69e8fc2f3d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:56.229288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-974eb605-12b9-4b44-a889-cd69e8fc2f3d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:56.229288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-974eb605-12b9-4b44-a889-cd69e8fc2f3d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:56.229288 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-974eb605-12b9-4b44-a889-cd69e8fc2f3d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:56.229839 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-974eb605-12b9-4b44-a889-cd69e8fc2f3d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:56.230033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-974eb605-12b9-4b44-a889-cd69e8fc2f3d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:56.368194 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-974eb605-12b9-4b44-a889-cd69e8fc2f3d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:56.376472 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-974eb605-12b9-4b44-a889-cd69e8fc2f3d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1698 microversion: 2.1 time: 0.160743 Oct 11 05:53:56.376912 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4272/8309] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:56 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1698 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:53:57.400890 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ae56b54d-4e73-4a48-8692-8c7ab141cd6d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:57.401793 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ae56b54d-4e73-4a48-8692-8c7ab141cd6d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:57.408752 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae56b54d-4e73-4a48-8692-8c7ab141cd6d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:57.409239 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae56b54d-4e73-4a48-8692-8c7ab141cd6d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:57.409687 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae56b54d-4e73-4a48-8692-8c7ab141cd6d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:57.410423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae56b54d-4e73-4a48-8692-8c7ab141cd6d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:57.411071 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae56b54d-4e73-4a48-8692-8c7ab141cd6d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:57.411505 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ae56b54d-4e73-4a48-8692-8c7ab141cd6d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:57.542384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ae56b54d-4e73-4a48-8692-8c7ab141cd6d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:57.550157 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ae56b54d-4e73-4a48-8692-8c7ab141cd6d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1698 microversion: 2.1 time: 0.153132 Oct 11 05:53:57.550850 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4038/8310] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:57 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1698 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:58.573973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30f14805-e6b0-4925-92f4-4e5b6073768e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:58.574659 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30f14805-e6b0-4925-92f4-4e5b6073768e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:58.581399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f14805-e6b0-4925-92f4-4e5b6073768e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:58.581899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f14805-e6b0-4925-92f4-4e5b6073768e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:58.582404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f14805-e6b0-4925-92f4-4e5b6073768e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:58.583737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f14805-e6b0-4925-92f4-4e5b6073768e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:58.584207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f14805-e6b0-4925-92f4-4e5b6073768e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:58.584647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30f14805-e6b0-4925-92f4-4e5b6073768e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:58.790755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30f14805-e6b0-4925-92f4-4e5b6073768e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:58.799148 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30f14805-e6b0-4925-92f4-4e5b6073768e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1680 microversion: 2.1 time: 0.229014 Oct 11 05:53:58.799752 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4273/8311] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:58 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1680 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:53:59.823894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ccef9334-b329-4482-94eb-45e8805bb566 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:53:59.824513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ccef9334-b329-4482-94eb-45e8805bb566 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:53:59.831613 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef9334-b329-4482-94eb-45e8805bb566 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:59.832100 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef9334-b329-4482-94eb-45e8805bb566 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:59.833038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef9334-b329-4482-94eb-45e8805bb566 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:59.833734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef9334-b329-4482-94eb-45e8805bb566 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:53:59.834205 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef9334-b329-4482-94eb-45e8805bb566 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:53:59.834645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ccef9334-b329-4482-94eb-45e8805bb566 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:53:59.972351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ccef9334-b329-4482-94eb-45e8805bb566 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:53:59.980734 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ccef9334-b329-4482-94eb-45e8805bb566 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1680 microversion: 2.1 time: 0.160766 Oct 11 05:53:59.981333 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4039/8312] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:53:59 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1680 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:00.352680 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-736b42b6-78bd-4c86-8204-daa8b15c2527 req-436a6e0d-eaac-4d73-82c5-c87e36f465c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8661c49-a244-4bbc-8e5f-9cb3bba64afe", "name": "network-vif-unplugged", "status": "completed", "tag": "1c5c6126-3b35-4a01-933b-27a03905f341"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:54:00.358711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=29 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:54:00.364736 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-736b42b6-78bd-4c86-8204-daa8b15c2527 req-436a6e0d-eaac-4d73-82c5-c87e36f465c0 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:00.365226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-736b42b6-78bd-4c86-8204-daa8b15c2527 req-436a6e0d-eaac-4d73-82c5-c87e36f465c0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:00.365670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-736b42b6-78bd-4c86-8204-daa8b15c2527 req-436a6e0d-eaac-4d73-82c5-c87e36f465c0 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:00.368477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:54:00.377871 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-736b42b6-78bd-4c86-8204-daa8b15c2527 req-436a6e0d-eaac-4d73-82c5-c87e36f465c0 service nova] Creating event network-vif-unplugged:1c5c6126-3b35-4a01-933b-27a03905f341 for instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe on n-h1-860892-1 Oct 11 05:54:00.383902 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-736b42b6-78bd-4c86-8204-daa8b15c2527 req-436a6e0d-eaac-4d73-82c5-c87e36f465c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035720 Oct 11 05:54:00.384583 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4274/8313] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:54:00 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:54:01.004270 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b37aa480-9ea7-4db2-ab78-7566e321174c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:01.004821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b37aa480-9ea7-4db2-ab78-7566e321174c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:01.008516 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=31 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:54:01.011939 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b37aa480-9ea7-4db2-ab78-7566e321174c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:01.012427 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b37aa480-9ea7-4db2-ab78-7566e321174c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:01.012875 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b37aa480-9ea7-4db2-ab78-7566e321174c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:01.013567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b37aa480-9ea7-4db2-ab78-7566e321174c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:01.014025 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b37aa480-9ea7-4db2-ab78-7566e321174c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:01.014488 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b37aa480-9ea7-4db2-ab78-7566e321174c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:01.018437 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=81 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:54:01.147280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b37aa480-9ea7-4db2-ab78-7566e321174c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:01.155778 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b37aa480-9ea7-4db2-ab78-7566e321174c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1683 microversion: 2.1 time: 0.155672 Oct 11 05:54:01.156345 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4040/8314] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:00 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:01.180655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f7d4efa5-0e04-4d09-afac-9acceea77466 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:54:01.181985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f7d4efa5-0e04-4d09-afac-9acceea77466 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:01.190826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7d4efa5-0e04-4d09-afac-9acceea77466 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:01.191329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7d4efa5-0e04-4d09-afac-9acceea77466 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:01.191977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7d4efa5-0e04-4d09-afac-9acceea77466 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:01.192543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7d4efa5-0e04-4d09-afac-9acceea77466 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:01.193192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7d4efa5-0e04-4d09-afac-9acceea77466 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:01.193451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f7d4efa5-0e04-4d09-afac-9acceea77466 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:01.236300 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f7d4efa5-0e04-4d09-afac-9acceea77466 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120994) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 05:54:01.534436 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f7d4efa5-0e04-4d09-afac-9acceea77466 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "POST /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe/action" status: 202 len: 0 microversion: 2.1 time: 0.359090 Oct 11 05:54:01.535452 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4275/8315] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:54:01 2022] POST /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe/action => generated 0 bytes in 361 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:54:01.543242 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ba56f374-79dc-4f0d-87d1-ade9bc66beb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:01.543863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ba56f374-79dc-4f0d-87d1-ade9bc66beb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:01.550168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba56f374-79dc-4f0d-87d1-ade9bc66beb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:01.550689 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba56f374-79dc-4f0d-87d1-ade9bc66beb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:01.551133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba56f374-79dc-4f0d-87d1-ade9bc66beb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:01.551885 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba56f374-79dc-4f0d-87d1-ade9bc66beb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:01.552320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba56f374-79dc-4f0d-87d1-ade9bc66beb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:01.552747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ba56f374-79dc-4f0d-87d1-ade9bc66beb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:01.687534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ba56f374-79dc-4f0d-87d1-ade9bc66beb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:01.696460 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ba56f374-79dc-4f0d-87d1-ade9bc66beb4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1631 microversion: 2.1 time: 0.157146 Oct 11 05:54:01.697038 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4041/8316] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:01 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1631 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:02.721314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-16497b8c-5ea8-44ba-bae3-24f04fecc306 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:02.721872 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-16497b8c-5ea8-44ba-bae3-24f04fecc306 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:02.731311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16497b8c-5ea8-44ba-bae3-24f04fecc306 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:02.731809 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16497b8c-5ea8-44ba-bae3-24f04fecc306 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:02.732256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16497b8c-5ea8-44ba-bae3-24f04fecc306 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:02.732955 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16497b8c-5ea8-44ba-bae3-24f04fecc306 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:02.733426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16497b8c-5ea8-44ba-bae3-24f04fecc306 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:02.733866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16497b8c-5ea8-44ba-bae3-24f04fecc306 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:02.871293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-16497b8c-5ea8-44ba-bae3-24f04fecc306 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:02.879979 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-16497b8c-5ea8-44ba-bae3-24f04fecc306 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1631 microversion: 2.1 time: 0.162794 Oct 11 05:54:02.880580 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4276/8317] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:02 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1631 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:03.904970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2581c643-6462-403a-adf6-056fa088c1ca tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:03.905585 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2581c643-6462-403a-adf6-056fa088c1ca tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:03.912487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2581c643-6462-403a-adf6-056fa088c1ca tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:03.912973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2581c643-6462-403a-adf6-056fa088c1ca tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:03.913408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2581c643-6462-403a-adf6-056fa088c1ca tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:03.914110 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2581c643-6462-403a-adf6-056fa088c1ca tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:03.914587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2581c643-6462-403a-adf6-056fa088c1ca tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:03.915028 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2581c643-6462-403a-adf6-056fa088c1ca tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:04.066581 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2581c643-6462-403a-adf6-056fa088c1ca tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:04.074705 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2581c643-6462-403a-adf6-056fa088c1ca tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.174158 Oct 11 05:54:04.075314 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4042/8318] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:03 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:04.635317 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7c3c2707-3f1b-41c1-b7e2-fad2eccd7ef6 req-0d4e4112-e7f9-4a24-8b82-ade575c41c19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8661c49-a244-4bbc-8e5f-9cb3bba64afe", "tag": "1c5c6126-3b35-4a01-933b-27a03905f341"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:54:04.646085 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7c3c2707-3f1b-41c1-b7e2-fad2eccd7ef6 req-0d4e4112-e7f9-4a24-8b82-ade575c41c19 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:04.646605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7c3c2707-3f1b-41c1-b7e2-fad2eccd7ef6 req-0d4e4112-e7f9-4a24-8b82-ade575c41c19 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:04.647056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7c3c2707-3f1b-41c1-b7e2-fad2eccd7ef6 req-0d4e4112-e7f9-4a24-8b82-ade575c41c19 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:04.658620 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7c3c2707-3f1b-41c1-b7e2-fad2eccd7ef6 req-0d4e4112-e7f9-4a24-8b82-ade575c41c19 service nova] Creating event network-changed:1c5c6126-3b35-4a01-933b-27a03905f341 for instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe on n-h2-860892-1 Oct 11 05:54:04.663821 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7c3c2707-3f1b-41c1-b7e2-fad2eccd7ef6 req-0d4e4112-e7f9-4a24-8b82-ade575c41c19 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032169 Oct 11 05:54:04.664619 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4277/8319] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:54:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:54:05.098855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f92b9b11-634c-4e20-a84c-bf5fc3930095 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:05.099471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f92b9b11-634c-4e20-a84c-bf5fc3930095 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:05.106342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f92b9b11-634c-4e20-a84c-bf5fc3930095 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:05.106833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f92b9b11-634c-4e20-a84c-bf5fc3930095 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:05.107278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f92b9b11-634c-4e20-a84c-bf5fc3930095 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:05.107971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f92b9b11-634c-4e20-a84c-bf5fc3930095 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:05.108433 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f92b9b11-634c-4e20-a84c-bf5fc3930095 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:05.108859 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f92b9b11-634c-4e20-a84c-bf5fc3930095 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:05.241540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f92b9b11-634c-4e20-a84c-bf5fc3930095 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:05.249369 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f92b9b11-634c-4e20-a84c-bf5fc3930095 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.154541 Oct 11 05:54:05.249952 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4043/8320] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:05 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:06.274633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-028db7e3-6f8a-454c-8272-37c3a85dfdbc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:06.275399 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-028db7e3-6f8a-454c-8272-37c3a85dfdbc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:06.281991 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-028db7e3-6f8a-454c-8272-37c3a85dfdbc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:06.282778 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-028db7e3-6f8a-454c-8272-37c3a85dfdbc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:06.283490 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-028db7e3-6f8a-454c-8272-37c3a85dfdbc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:06.284456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-028db7e3-6f8a-454c-8272-37c3a85dfdbc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:06.285197 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-028db7e3-6f8a-454c-8272-37c3a85dfdbc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:06.286446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-028db7e3-6f8a-454c-8272-37c3a85dfdbc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:06.437104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-028db7e3-6f8a-454c-8272-37c3a85dfdbc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:06.445644 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-028db7e3-6f8a-454c-8272-37c3a85dfdbc tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.176138 Oct 11 05:54:06.446553 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4278/8321] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:06 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:07.470002 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1d26778b-80f5-42da-93a8-8aa80db9cc92 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:07.472065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1d26778b-80f5-42da-93a8-8aa80db9cc92 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:07.479074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d26778b-80f5-42da-93a8-8aa80db9cc92 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:07.479855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d26778b-80f5-42da-93a8-8aa80db9cc92 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:07.480342 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d26778b-80f5-42da-93a8-8aa80db9cc92 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:07.481320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d26778b-80f5-42da-93a8-8aa80db9cc92 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:07.481983 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d26778b-80f5-42da-93a8-8aa80db9cc92 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:07.482496 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d26778b-80f5-42da-93a8-8aa80db9cc92 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:07.629574 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1d26778b-80f5-42da-93a8-8aa80db9cc92 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:07.638396 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1d26778b-80f5-42da-93a8-8aa80db9cc92 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.172215 Oct 11 05:54:07.638985 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4044/8322] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:07 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:08.665175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-083b9272-0951-440d-8514-fa8e6fce5ec3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:08.665996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-083b9272-0951-440d-8514-fa8e6fce5ec3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:08.673052 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-083b9272-0951-440d-8514-fa8e6fce5ec3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:08.673551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-083b9272-0951-440d-8514-fa8e6fce5ec3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:08.673998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-083b9272-0951-440d-8514-fa8e6fce5ec3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:08.674737 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-083b9272-0951-440d-8514-fa8e6fce5ec3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:08.675200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-083b9272-0951-440d-8514-fa8e6fce5ec3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:08.675641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-083b9272-0951-440d-8514-fa8e6fce5ec3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:08.832091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-083b9272-0951-440d-8514-fa8e6fce5ec3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:08.840705 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-083b9272-0951-440d-8514-fa8e6fce5ec3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.181180 Oct 11 05:54:08.842227 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4279/8323] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:08 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:09.866857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a82a3fac-773e-4ea1-8336-163f729e2f5c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:09.867500 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a82a3fac-773e-4ea1-8336-163f729e2f5c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:09.874471 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a82a3fac-773e-4ea1-8336-163f729e2f5c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:09.874957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a82a3fac-773e-4ea1-8336-163f729e2f5c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:09.875392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a82a3fac-773e-4ea1-8336-163f729e2f5c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:09.876085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a82a3fac-773e-4ea1-8336-163f729e2f5c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:09.876567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a82a3fac-773e-4ea1-8336-163f729e2f5c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:09.876989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a82a3fac-773e-4ea1-8336-163f729e2f5c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:10.024969 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a82a3fac-773e-4ea1-8336-163f729e2f5c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:10.033405 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a82a3fac-773e-4ea1-8336-163f729e2f5c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.171161 Oct 11 05:54:10.033983 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4045/8324] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:09 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:11.058596 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9fc2680a-93b2-4492-b60a-76b810f035e3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:11.059262 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9fc2680a-93b2-4492-b60a-76b810f035e3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:11.067860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fc2680a-93b2-4492-b60a-76b810f035e3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:11.068452 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fc2680a-93b2-4492-b60a-76b810f035e3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:11.068979 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fc2680a-93b2-4492-b60a-76b810f035e3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:11.070107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fc2680a-93b2-4492-b60a-76b810f035e3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:11.070728 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fc2680a-93b2-4492-b60a-76b810f035e3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:11.071251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9fc2680a-93b2-4492-b60a-76b810f035e3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:11.215861 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9fc2680a-93b2-4492-b60a-76b810f035e3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:11.223846 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9fc2680a-93b2-4492-b60a-76b810f035e3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.169225 Oct 11 05:54:11.224663 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4280/8325] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:11 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:12.248779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-54140dc1-9090-41e4-955a-a7bdb1d9fbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:12.249376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-54140dc1-9090-41e4-955a-a7bdb1d9fbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:12.257866 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54140dc1-9090-41e4-955a-a7bdb1d9fbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:12.258386 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54140dc1-9090-41e4-955a-a7bdb1d9fbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:12.258821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54140dc1-9090-41e4-955a-a7bdb1d9fbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:12.259556 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54140dc1-9090-41e4-955a-a7bdb1d9fbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:12.260005 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54140dc1-9090-41e4-955a-a7bdb1d9fbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:12.260426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-54140dc1-9090-41e4-955a-a7bdb1d9fbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:12.404255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-54140dc1-9090-41e4-955a-a7bdb1d9fbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:12.410367 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-54140dc1-9090-41e4-955a-a7bdb1d9fbe2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.165627 Oct 11 05:54:12.410926 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4046/8326] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:12 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:13.433992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-78bf6845-1c38-44b4-99f0-9cb9a0d1f511 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:13.434648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-78bf6845-1c38-44b4-99f0-9cb9a0d1f511 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:13.441655 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78bf6845-1c38-44b4-99f0-9cb9a0d1f511 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:13.442152 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78bf6845-1c38-44b4-99f0-9cb9a0d1f511 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:13.442635 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78bf6845-1c38-44b4-99f0-9cb9a0d1f511 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:13.443343 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78bf6845-1c38-44b4-99f0-9cb9a0d1f511 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:13.443816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78bf6845-1c38-44b4-99f0-9cb9a0d1f511 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:13.444261 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-78bf6845-1c38-44b4-99f0-9cb9a0d1f511 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:13.579462 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-78bf6845-1c38-44b4-99f0-9cb9a0d1f511 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:13.587908 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-78bf6845-1c38-44b4-99f0-9cb9a0d1f511 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.157809 Oct 11 05:54:13.588469 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4281/8327] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:13 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:14.611183 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-1d25683a-6b92-4f61-b4f4-17fb1404072c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:14.611803 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-1d25683a-6b92-4f61-b4f4-17fb1404072c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:14.619331 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d25683a-6b92-4f61-b4f4-17fb1404072c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:14.619818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d25683a-6b92-4f61-b4f4-17fb1404072c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:14.620262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d25683a-6b92-4f61-b4f4-17fb1404072c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:14.620952 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d25683a-6b92-4f61-b4f4-17fb1404072c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:14.621408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d25683a-6b92-4f61-b4f4-17fb1404072c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:14.622106 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-1d25683a-6b92-4f61-b4f4-17fb1404072c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:14.758578 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-1d25683a-6b92-4f61-b4f4-17fb1404072c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:14.766417 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-1d25683a-6b92-4f61-b4f4-17fb1404072c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.159091 Oct 11 05:54:14.767273 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4047/8328] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:14 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:15.789952 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-e45f00ff-19c8-4506-9f72-725e1112a5ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:15.790551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-e45f00ff-19c8-4506-9f72-725e1112a5ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:15.797971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e45f00ff-19c8-4506-9f72-725e1112a5ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:15.798504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e45f00ff-19c8-4506-9f72-725e1112a5ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:15.798975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e45f00ff-19c8-4506-9f72-725e1112a5ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:15.799690 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e45f00ff-19c8-4506-9f72-725e1112a5ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:15.800154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e45f00ff-19c8-4506-9f72-725e1112a5ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:15.800626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-e45f00ff-19c8-4506-9f72-725e1112a5ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:15.934841 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-e45f00ff-19c8-4506-9f72-725e1112a5ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:15.943040 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-e45f00ff-19c8-4506-9f72-725e1112a5ae tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.157007 Oct 11 05:54:15.943627 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4282/8329] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:15 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:16.935546 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-b9108c3b-d578-40fc-b901-4da0b9dec777 req-72018e02-e82d-4694-b4f2-77c2c1eb59ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8661c49-a244-4bbc-8e5f-9cb3bba64afe", "name": "network-vif-plugged", "status": "completed", "tag": "1c5c6126-3b35-4a01-933b-27a03905f341"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:54:16.946333 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b9108c3b-d578-40fc-b901-4da0b9dec777 req-72018e02-e82d-4694-b4f2-77c2c1eb59ea service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:16.946808 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b9108c3b-d578-40fc-b901-4da0b9dec777 req-72018e02-e82d-4694-b4f2-77c2c1eb59ea service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:16.947241 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-b9108c3b-d578-40fc-b901-4da0b9dec777 req-72018e02-e82d-4694-b4f2-77c2c1eb59ea service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:16.958772 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-b9108c3b-d578-40fc-b901-4da0b9dec777 req-72018e02-e82d-4694-b4f2-77c2c1eb59ea service nova] Creating event network-vif-plugged:1c5c6126-3b35-4a01-933b-27a03905f341 for instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe on n-h2-860892-1 Oct 11 05:54:16.963999 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-b9108c3b-d578-40fc-b901-4da0b9dec777 req-72018e02-e82d-4694-b4f2-77c2c1eb59ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032114 Oct 11 05:54:16.964774 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4048/8330] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:54:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:54:16.967093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9f15e10b-fb03-4570-a979-7df1b331fc18 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:16.967821 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9f15e10b-fb03-4570-a979-7df1b331fc18 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:16.975381 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f15e10b-fb03-4570-a979-7df1b331fc18 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:16.975887 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f15e10b-fb03-4570-a979-7df1b331fc18 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:16.976340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f15e10b-fb03-4570-a979-7df1b331fc18 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:16.977051 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f15e10b-fb03-4570-a979-7df1b331fc18 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:16.977519 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f15e10b-fb03-4570-a979-7df1b331fc18 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:16.977957 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9f15e10b-fb03-4570-a979-7df1b331fc18 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:17.120641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9f15e10b-fb03-4570-a979-7df1b331fc18 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:17.130236 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9f15e10b-fb03-4570-a979-7df1b331fc18 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.166994 Oct 11 05:54:17.131064 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4283/8331] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:16 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:18.157217 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-24480627-4cc1-497e-879b-425457b0da95 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:18.157949 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-24480627-4cc1-497e-879b-425457b0da95 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:18.164883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24480627-4cc1-497e-879b-425457b0da95 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:18.167197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24480627-4cc1-497e-879b-425457b0da95 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:18.167197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24480627-4cc1-497e-879b-425457b0da95 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:18.167197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24480627-4cc1-497e-879b-425457b0da95 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:18.167197 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24480627-4cc1-497e-879b-425457b0da95 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:18.167665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-24480627-4cc1-497e-879b-425457b0da95 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:18.307308 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-24480627-4cc1-497e-879b-425457b0da95 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:18.315366 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-24480627-4cc1-497e-879b-425457b0da95 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.163461 Oct 11 05:54:18.315936 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4049/8332] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:18 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:19.338340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bd00ad79-2641-4ef7-a442-f3772bd9e5a8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:19.338965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bd00ad79-2641-4ef7-a442-f3772bd9e5a8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:19.345869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd00ad79-2641-4ef7-a442-f3772bd9e5a8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:19.346517 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd00ad79-2641-4ef7-a442-f3772bd9e5a8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:19.346965 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd00ad79-2641-4ef7-a442-f3772bd9e5a8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:19.347677 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd00ad79-2641-4ef7-a442-f3772bd9e5a8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:19.348142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd00ad79-2641-4ef7-a442-f3772bd9e5a8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:19.348581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bd00ad79-2641-4ef7-a442-f3772bd9e5a8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:19.482958 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-bd00ad79-2641-4ef7-a442-f3772bd9e5a8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:19.492092 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bd00ad79-2641-4ef7-a442-f3772bd9e5a8 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1689 microversion: 2.1 time: 0.157699 Oct 11 05:54:19.492710 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4284/8333] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:19 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1689 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:54:20.516203 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b9dced05-f3d6-48ca-a51f-e7250feb6368 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:54:20.516818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b9dced05-f3d6-48ca-a51f-e7250feb6368 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:54:20.524401 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9dced05-f3d6-48ca-a51f-e7250feb6368 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:20.524886 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9dced05-f3d6-48ca-a51f-e7250feb6368 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:20.525324 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9dced05-f3d6-48ca-a51f-e7250feb6368 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:20.526014 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9dced05-f3d6-48ca-a51f-e7250feb6368 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:54:20.526502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9dced05-f3d6-48ca-a51f-e7250feb6368 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:54:20.527179 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b9dced05-f3d6-48ca-a51f-e7250feb6368 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:54:20.655029 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b9dced05-f3d6-48ca-a51f-e7250feb6368 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:54:20.662846 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b9dced05-f3d6-48ca-a51f-e7250feb6368 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1676 microversion: 2.1 time: 0.150614 Oct 11 05:54:20.663433 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4050/8334] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:54:20 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:55:32.378356 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:55:32.379349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=61,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:55:32.381291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=23 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:55:32.382118 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=61 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:55:32.384824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-671be262-7fb2-4c1b-9a02-f5554e370ff6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:55:32.385344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-671be262-7fb2-4c1b-9a02-f5554e370ff6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:55:32.387396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-fb681ab8-ffe8-4f50-965d-820d856bbf8e req-ac820cf6-2b90-4ca8-91f8-ec537c616ca4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b8661c49-a244-4bbc-8e5f-9cb3bba64afe", "tag": "1c5c6126-3b35-4a01-933b-27a03905f341"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:55:32.392451 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-671be262-7fb2-4c1b-9a02-f5554e370ff6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:32.392948 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-671be262-7fb2-4c1b-9a02-f5554e370ff6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:32.393392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-671be262-7fb2-4c1b-9a02-f5554e370ff6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:32.394360 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-671be262-7fb2-4c1b-9a02-f5554e370ff6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:32.394687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-671be262-7fb2-4c1b-9a02-f5554e370ff6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:32.395219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-671be262-7fb2-4c1b-9a02-f5554e370ff6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:32.397826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fb681ab8-ffe8-4f50-965d-820d856bbf8e req-ac820cf6-2b90-4ca8-91f8-ec537c616ca4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:32.398364 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fb681ab8-ffe8-4f50-965d-820d856bbf8e req-ac820cf6-2b90-4ca8-91f8-ec537c616ca4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:32.402317 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-fb681ab8-ffe8-4f50-965d-820d856bbf8e req-ac820cf6-2b90-4ca8-91f8-ec537c616ca4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:32.411576 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-fb681ab8-ffe8-4f50-965d-820d856bbf8e req-ac820cf6-2b90-4ca8-91f8-ec537c616ca4 service nova] Creating event network-changed:1c5c6126-3b35-4a01-933b-27a03905f341 for instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe on n-h2-860892-1 Oct 11 05:55:32.416901 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-fb681ab8-ffe8-4f50-965d-820d856bbf8e req-ac820cf6-2b90-4ca8-91f8-ec537c616ca4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037571 Oct 11 05:55:32.417512 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4051/8335] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:55:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:55:32.425429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-671be262-7fb2-4c1b-9a02-f5554e370ff6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 05:55:32.777354 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-671be262-7fb2-4c1b-9a02-f5554e370ff6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 204 len: 0 microversion: 2.1 time: 0.400917 Oct 11 05:55:32.778218 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4285/8336] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 05:55:32 2022] DELETE /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 0 bytes in 403 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 05:55:32.788412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-496acbcb-0fe3-450d-a6f5-2af9da39fb09 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:55:32.789446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-496acbcb-0fe3-450d-a6f5-2af9da39fb09 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:55:32.797884 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-496acbcb-0fe3-450d-a6f5-2af9da39fb09 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:32.798680 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-496acbcb-0fe3-450d-a6f5-2af9da39fb09 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:32.799377 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-496acbcb-0fe3-450d-a6f5-2af9da39fb09 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:32.800353 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-496acbcb-0fe3-450d-a6f5-2af9da39fb09 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:32.800972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-496acbcb-0fe3-450d-a6f5-2af9da39fb09 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:32.801568 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-496acbcb-0fe3-450d-a6f5-2af9da39fb09 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:32.954918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-496acbcb-0fe3-450d-a6f5-2af9da39fb09 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:55:32.963899 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-496acbcb-0fe3-450d-a6f5-2af9da39fb09 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1682 microversion: 2.1 time: 0.180644 Oct 11 05:55:32.964499 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4052/8337] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:55:32 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1682 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:55:33.990370 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4d578435-3f72-4997-ae74-d774696aaae9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:55:33.991089 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4d578435-3f72-4997-ae74-d774696aaae9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:55:33.998205 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d578435-3f72-4997-ae74-d774696aaae9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:33.998753 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d578435-3f72-4997-ae74-d774696aaae9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:33.999175 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d578435-3f72-4997-ae74-d774696aaae9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:33.999885 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d578435-3f72-4997-ae74-d774696aaae9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:34.000981 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d578435-3f72-4997-ae74-d774696aaae9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:34.001440 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4d578435-3f72-4997-ae74-d774696aaae9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:34.133236 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4d578435-3f72-4997-ae74-d774696aaae9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:55:34.141379 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4d578435-3f72-4997-ae74-d774696aaae9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1563 microversion: 2.1 time: 0.156387 Oct 11 05:55:34.142440 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4286/8338] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:55:33 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1563 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:55:34.643567 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-a5231aca-72e8-425c-bd6f-56529ab5e927 req-9ebea755-349a-445a-b803-5bdd39312cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b8661c49-a244-4bbc-8e5f-9cb3bba64afe", "name": "network-vif-deleted", "tag": "1c5c6126-3b35-4a01-933b-27a03905f341"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:55:34.654921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a5231aca-72e8-425c-bd6f-56529ab5e927 req-9ebea755-349a-445a-b803-5bdd39312cb7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:34.655395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a5231aca-72e8-425c-bd6f-56529ab5e927 req-9ebea755-349a-445a-b803-5bdd39312cb7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:34.655825 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-a5231aca-72e8-425c-bd6f-56529ab5e927 req-9ebea755-349a-445a-b803-5bdd39312cb7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:34.666720 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-a5231aca-72e8-425c-bd6f-56529ab5e927 req-9ebea755-349a-445a-b803-5bdd39312cb7 service nova] Creating event network-vif-deleted:1c5c6126-3b35-4a01-933b-27a03905f341 for instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe on n-h2-860892-1 Oct 11 05:55:34.671634 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-a5231aca-72e8-425c-bd6f-56529ab5e927 req-9ebea755-349a-445a-b803-5bdd39312cb7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031812 Oct 11 05:55:34.672231 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4053/8339] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:55:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:55:35.165226 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:55:35.165760 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:55:35.172694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:35.173141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:35.173587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:35.174307 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:35.174772 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:35.175206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:35.206313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:35.206795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:35.207238 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:35.207691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lazy-loading 'fault' on Instance uuid b8661c49-a244-4bbc-8e5f-9cb3bba64afe {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:55:35.249016 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:55:35.256984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-383e23ba-3bdc-49af-9462-543c491e329b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 200 len: 1336 microversion: 2.1 time: 0.095675 Oct 11 05:55:35.257568 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4287/8340] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:55:35 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 1336 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:55:36.282148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:55:36.282921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: b8661c49-a244-4bbc-8e5f-9cb3bba64afe] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:55:36.289140 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:36.289669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:36.290051 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:36.290765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:55:36.291210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:55:36.291628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:55:36.305224 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] HTTP exception thrown: Instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe could not be found. Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Request method failure captured: Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe HTTP/1.1 Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRQQsrosL2YIyvpvXk8K4JkAXYXCq4YUo8ToBqDBmcd8XY03hNH_OUH5mGc7Y2tUYpn1diuhPnV-l1amfGT697cuPEBu2gGVQqAQ5jHkmj9Gg0aIr_84_Dx6mcx-5mG8i2W8jc8Qu5IIuSNdpWc1hJT371TQyqBWXmdYLh1D0jhAzxZo Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: f091652bb2bc4e5da19b981968462e02 Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestShelveInstance-1076866864 Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f091652bb2bc4e5da19b981968462e02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f091652bb2bc4e5da19b981968462e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f091652bb2bc4e5da19b981968462e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f091652bb2bc4e5da19b981968462e02"}]}] Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestShelveInstance-1076866864 Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: f091652bb2bc4e5da19b981968462e02 Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestShelveInstance-1076866864 Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestShelveInstance-1076866864-project Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 3fcdd10f70864a30a953cc81809e07cd Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestShelveInstance-1076866864-project Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe could not be found. Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': 'b8661c49-a244-4bbc-8e5f-9cb3bba64afe'} Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe could not be found. Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe could not be found. Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 05:55:36.306913 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:55:36.312646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 05:55:36.312646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 05:55:36.312646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 05:55:36.312646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 05:55:36.312646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 05:55:36.312646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe could not be found. Oct 11 05:55:36.312646 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 05:55:36.312646 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Returning 404 to user: Instance b8661c49-a244-4bbc-8e5f-9cb3bba64afe could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 05:55:36.312646 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-c996c084-41a2-4d04-afed-9c41d70747eb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe" status: 404 len: 111 microversion: 2.1 time: 0.031566 Oct 11 05:55:36.312646 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4054/8341] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:55:36 2022] GET /compute/v2.1/servers/b8661c49-a244-4bbc-8e5f-9cb3bba64afe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 05:55:36.531417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a2d7b13f-f159-4e9c-99e7-e2ce6b7c31d3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '.version_select at 0x7fda1df64b80>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:55:36.616273 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a2d7b13f-f159-4e9c-99e7-e2ce6b7c31d3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1208264130" status: 202 len: 0 microversion: 2.1 time: 0.089169 Oct 11 05:55:36.616873 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4288/8342] 10.222.0.26 () {58 vars in 1254 bytes} [Tue Oct 11 05:55:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1208264130 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:55:36.640982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ef89ae06-1b43-49af-be6f-cb02179d5476 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Action: 'create', calling method: .version_select at 0x7fda19431430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1690897884", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+f5qCaywiruC0eubh/mS/vE8+XLL1d4A5se9fgAmoxHD/r6pjn812M2Keqn3LiV4R5MFlUMvqaqRBdEuepG3c0mJnj89y8HKJBwRNO5OTy5PW2/iay9zx5dj02yw4mDQ=="}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:55:36.656477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ef89ae06-1b43-49af-be6f-cb02179d5476 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Getting quotas for project f091652bb2bc4e5da19b981968462e02. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:55:36.661504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-ef89ae06-1b43-49af-be6f-cb02179d5476 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Getting quotas for user 3fcdd10f70864a30a953cc81809e07cd and project f091652bb2bc4e5da19b981968462e02. Resources: {'key_pairs'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:55:36.746885 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ef89ae06-1b43-49af-be6f-cb02179d5476 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.109747 Oct 11 05:55:36.747563 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4055/8343] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 05:55:36 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:55:59.934674 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-580937107", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1690897884", "security_groups": [{"name": "tempest-secgroup-smoke-1875752934"}], "networks": [{"uuid": "8c0e7fc5-09ed-4bdf-a98a-d4c55c95df6f"}], "block_device_mapping_v2": [{"uuid": "2afc60b7-ccc4-44de-88ea-ccf92df82fac", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:55:59.946146 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:55:59.946826 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:56:00.048373 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.network.neutron [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] validate_networks() for [('8c0e7fc5-09ed-4bdf-a98a-d4c55c95df6f', None, None, None, None, None)] {{(pid=120994) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 05:56:00.770791 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Flavor limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 05:56:00.771159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Image limits 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 05:56:00.771641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Flavor pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 05:56:00.772058 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Image pref 0:0:0 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 05:56:00.772482 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.virt.hardware [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120994) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 05:56:00.782268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:00.782765 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:00.783210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:00.783956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:00.784439 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:00.784859 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:00.806090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Getting quotas for project f091652bb2bc4e5da19b981968462e02. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 05:56:00.811652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Getting quotas for user 3fcdd10f70864a30a953cc81809e07cd and project f091652bb2bc4e5da19b981968462e02. Resources: {'cores', 'instances', 'ram'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 05:56:00.869159 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Going to run 1 instances... {{(pid=120994) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 05:56:00.871350 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2afc60b7-ccc4-44de-88ea-ccf92df82fac',volume_size=None,volume_type=None)] {{(pid=120994) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 05:56:01.227992 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-cd23310f-2323-4b89-80f4-db12376a108f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.297908 Oct 11 05:56:01.229024 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4289/8344] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 05:55:59 2022] POST /compute/v2.1/servers => generated 406 bytes in 1299 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 05:56:01.237868 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=12 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:56:01.238645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=4 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:56:01.239290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:56:01.243246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b34b84ea-aaa5-41d6-9c4c-293f8c47c3f7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:01.243867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b34b84ea-aaa5-41d6-9c4c-293f8c47c3f7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:01.304587 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b34b84ea-aaa5-41d6-9c4c-293f8c47c3f7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:01.312480 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b34b84ea-aaa5-41d6-9c4c-293f8c47c3f7 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1088 microversion: 2.1 time: 0.076376 Oct 11 05:56:01.313131 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4056/8345] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:01 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:56:02.335923 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-9259faf0-c505-459a-ad76-d7c67783fa4a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:02.337268 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-9259faf0-c505-459a-ad76-d7c67783fa4a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:02.344413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9259faf0-c505-459a-ad76-d7c67783fa4a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:02.348782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9259faf0-c505-459a-ad76-d7c67783fa4a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:02.348782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9259faf0-c505-459a-ad76-d7c67783fa4a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:02.348782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9259faf0-c505-459a-ad76-d7c67783fa4a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:02.348782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9259faf0-c505-459a-ad76-d7c67783fa4a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:02.348782 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-9259faf0-c505-459a-ad76-d7c67783fa4a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:02.414141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-9259faf0-c505-459a-ad76-d7c67783fa4a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:02.422041 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-9259faf0-c505-459a-ad76-d7c67783fa4a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1138 microversion: 2.1 time: 0.090423 Oct 11 05:56:02.422641 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4290/8346] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:02 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1138 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:03.445622 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8f8a894f-10f8-46f3-816a-7b854bf3f47e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:03.446420 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8f8a894f-10f8-46f3-816a-7b854bf3f47e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:03.452817 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f8a894f-10f8-46f3-816a-7b854bf3f47e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:03.453901 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f8a894f-10f8-46f3-816a-7b854bf3f47e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:03.454271 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f8a894f-10f8-46f3-816a-7b854bf3f47e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:03.461072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f8a894f-10f8-46f3-816a-7b854bf3f47e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:03.461072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f8a894f-10f8-46f3-816a-7b854bf3f47e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:03.461072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8f8a894f-10f8-46f3-816a-7b854bf3f47e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:03.524116 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8f8a894f-10f8-46f3-816a-7b854bf3f47e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:03.535652 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8f8a894f-10f8-46f3-816a-7b854bf3f47e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1204 microversion: 2.1 time: 0.091698 Oct 11 05:56:03.535652 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4057/8347] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:03 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:04.557442 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b8a96dc8-4d04-4131-ba2e-4d03306c072e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:04.558060 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b8a96dc8-4d04-4131-ba2e-4d03306c072e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:04.565233 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8a96dc8-4d04-4131-ba2e-4d03306c072e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:04.565662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8a96dc8-4d04-4131-ba2e-4d03306c072e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:04.566107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8a96dc8-4d04-4131-ba2e-4d03306c072e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:04.566831 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8a96dc8-4d04-4131-ba2e-4d03306c072e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:04.567475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8a96dc8-4d04-4131-ba2e-4d03306c072e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:04.568082 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-b8a96dc8-4d04-4131-ba2e-4d03306c072e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:04.742275 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b8a96dc8-4d04-4131-ba2e-4d03306c072e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:04.754021 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b8a96dc8-4d04-4131-ba2e-4d03306c072e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1272 microversion: 2.1 time: 0.200906 Oct 11 05:56:04.754786 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4291/8348] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:04 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1272 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:05.157384 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-d3837306-44ef-47ef-b7d8-f106a0725f5e req-9127e605-8d59-4f4e-9be9-82a0fc956d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b4a61d-cbd0-4042-86ee-7098392ee9ab", "tag": "fb6a38c9-0ce7-491b-8a64-cbdba0761efc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:56:05.167699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d3837306-44ef-47ef-b7d8-f106a0725f5e req-9127e605-8d59-4f4e-9be9-82a0fc956d34 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:05.168176 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d3837306-44ef-47ef-b7d8-f106a0725f5e req-9127e605-8d59-4f4e-9be9-82a0fc956d34 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:05.168609 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-d3837306-44ef-47ef-b7d8-f106a0725f5e req-9127e605-8d59-4f4e-9be9-82a0fc956d34 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:05.180303 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-d3837306-44ef-47ef-b7d8-f106a0725f5e req-9127e605-8d59-4f4e-9be9-82a0fc956d34 service nova] Creating event network-changed:fb6a38c9-0ce7-491b-8a64-cbdba0761efc for instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab on n-h1-860892-1 Oct 11 05:56:05.185276 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-d3837306-44ef-47ef-b7d8-f106a0725f5e req-9127e605-8d59-4f4e-9be9-82a0fc956d34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104049 Oct 11 05:56:05.186234 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4058/8349] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:56:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:56:05.777225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a7ac2b9d-143f-453e-8507-890c8700a73c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:05.778637 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a7ac2b9d-143f-453e-8507-890c8700a73c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:05.787222 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7ac2b9d-143f-453e-8507-890c8700a73c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:05.798858 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7ac2b9d-143f-453e-8507-890c8700a73c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:05.799358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7ac2b9d-143f-453e-8507-890c8700a73c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:05.800475 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7ac2b9d-143f-453e-8507-890c8700a73c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:05.801605 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7ac2b9d-143f-453e-8507-890c8700a73c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:05.802062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a7ac2b9d-143f-453e-8507-890c8700a73c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:06.005080 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a7ac2b9d-143f-453e-8507-890c8700a73c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:06.013157 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a7ac2b9d-143f-453e-8507-890c8700a73c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1272 microversion: 2.1 time: 0.239851 Oct 11 05:56:06.013670 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4292/8350] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:05 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1272 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:07.037615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-203948bd-e151-48fb-a2b3-389e6fe4b163 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:07.038293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-203948bd-e151-48fb-a2b3-389e6fe4b163 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:07.044554 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-203948bd-e151-48fb-a2b3-389e6fe4b163 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:07.045041 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-203948bd-e151-48fb-a2b3-389e6fe4b163 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:07.045477 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-203948bd-e151-48fb-a2b3-389e6fe4b163 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:07.046165 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-203948bd-e151-48fb-a2b3-389e6fe4b163 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:07.046641 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-203948bd-e151-48fb-a2b3-389e6fe4b163 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:07.047073 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-203948bd-e151-48fb-a2b3-389e6fe4b163 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:07.182274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-203948bd-e151-48fb-a2b3-389e6fe4b163 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:07.190014 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-203948bd-e151-48fb-a2b3-389e6fe4b163 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1272 microversion: 2.1 time: 0.157586 Oct 11 05:56:07.190611 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4059/8351] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:07 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1272 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:08.213627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-4efc4642-ce1d-41bb-836c-09d40a6c72af tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:08.214255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-4efc4642-ce1d-41bb-836c-09d40a6c72af tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:08.220972 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4efc4642-ce1d-41bb-836c-09d40a6c72af tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:08.221472 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4efc4642-ce1d-41bb-836c-09d40a6c72af tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:08.221909 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4efc4642-ce1d-41bb-836c-09d40a6c72af tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:08.222642 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4efc4642-ce1d-41bb-836c-09d40a6c72af tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:08.223104 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4efc4642-ce1d-41bb-836c-09d40a6c72af tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:08.223537 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-4efc4642-ce1d-41bb-836c-09d40a6c72af tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:08.356776 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-4efc4642-ce1d-41bb-836c-09d40a6c72af tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:08.364772 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-4efc4642-ce1d-41bb-836c-09d40a6c72af tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1272 microversion: 2.1 time: 0.155667 Oct 11 05:56:08.365358 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4293/8352] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:08 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1272 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:09.387634 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dff11220-4d1f-48f0-8183-f6a91b2bded9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:09.388249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dff11220-4d1f-48f0-8183-f6a91b2bded9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:09.395047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dff11220-4d1f-48f0-8183-f6a91b2bded9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:09.395532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dff11220-4d1f-48f0-8183-f6a91b2bded9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:09.395973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dff11220-4d1f-48f0-8183-f6a91b2bded9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:09.396652 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dff11220-4d1f-48f0-8183-f6a91b2bded9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:09.397104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dff11220-4d1f-48f0-8183-f6a91b2bded9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:09.397527 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dff11220-4d1f-48f0-8183-f6a91b2bded9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:09.527685 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dff11220-4d1f-48f0-8183-f6a91b2bded9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:09.535915 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dff11220-4d1f-48f0-8183-f6a91b2bded9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.152214 Oct 11 05:56:09.536483 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4060/8353] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:09 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:10.560284 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-63ed8354-198e-4fe3-9c7a-abd933653d53 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:10.560938 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-63ed8354-198e-4fe3-9c7a-abd933653d53 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:10.567750 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63ed8354-198e-4fe3-9c7a-abd933653d53 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:10.568240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63ed8354-198e-4fe3-9c7a-abd933653d53 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:10.568687 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63ed8354-198e-4fe3-9c7a-abd933653d53 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:10.569378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63ed8354-198e-4fe3-9c7a-abd933653d53 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:10.569866 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63ed8354-198e-4fe3-9c7a-abd933653d53 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:10.570326 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63ed8354-198e-4fe3-9c7a-abd933653d53 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:10.702828 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-63ed8354-198e-4fe3-9c7a-abd933653d53 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:10.710411 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-63ed8354-198e-4fe3-9c7a-abd933653d53 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.154707 Oct 11 05:56:10.710972 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4294/8354] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:10 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:11.732955 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0690bf59-b44c-4535-a49c-b4cccf7b8013 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:11.733524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0690bf59-b44c-4535-a49c-b4cccf7b8013 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:11.736380 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:56:11.741244 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0690bf59-b44c-4535-a49c-b4cccf7b8013 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:11.746474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0690bf59-b44c-4535-a49c-b4cccf7b8013 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:11.746474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0690bf59-b44c-4535-a49c-b4cccf7b8013 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:11.746474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0690bf59-b44c-4535-a49c-b4cccf7b8013 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:11.746474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0690bf59-b44c-4535-a49c-b4cccf7b8013 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:11.746474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0690bf59-b44c-4535-a49c-b4cccf7b8013 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:11.881017 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0690bf59-b44c-4535-a49c-b4cccf7b8013 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:11.888974 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0690bf59-b44c-4535-a49c-b4cccf7b8013 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.159986 Oct 11 05:56:11.889558 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4061/8355] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:11 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:12.912434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f3e68609-a7d4-404b-87ac-6990eeec8ae2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:12.913062 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f3e68609-a7d4-404b-87ac-6990eeec8ae2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:12.914969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:56:12.915650 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:56:12.921405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3e68609-a7d4-404b-87ac-6990eeec8ae2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:12.921900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3e68609-a7d4-404b-87ac-6990eeec8ae2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:12.922390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3e68609-a7d4-404b-87ac-6990eeec8ae2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:12.923091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3e68609-a7d4-404b-87ac-6990eeec8ae2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:12.923561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3e68609-a7d4-404b-87ac-6990eeec8ae2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:12.923998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f3e68609-a7d4-404b-87ac-6990eeec8ae2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:13.057408 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f3e68609-a7d4-404b-87ac-6990eeec8ae2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:13.065433 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f3e68609-a7d4-404b-87ac-6990eeec8ae2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.156949 Oct 11 05:56:13.066025 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4295/8356] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:12 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:14.088701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-68a72dfe-bf23-439d-987d-d65349a4977e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:14.089373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-68a72dfe-bf23-439d-987d-d65349a4977e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:14.096246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a72dfe-bf23-439d-987d-d65349a4977e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:14.096724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a72dfe-bf23-439d-987d-d65349a4977e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:14.097157 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a72dfe-bf23-439d-987d-d65349a4977e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:14.097842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a72dfe-bf23-439d-987d-d65349a4977e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:14.098318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a72dfe-bf23-439d-987d-d65349a4977e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:14.098741 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-68a72dfe-bf23-439d-987d-d65349a4977e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:14.234210 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-68a72dfe-bf23-439d-987d-d65349a4977e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:14.241998 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-68a72dfe-bf23-439d-987d-d65349a4977e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.157178 Oct 11 05:56:14.242614 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4062/8357] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:14 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:15.264963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-17f51743-9a79-4b90-bf95-671317190609 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:15.265566 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-17f51743-9a79-4b90-bf95-671317190609 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:15.272294 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17f51743-9a79-4b90-bf95-671317190609 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:15.272783 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17f51743-9a79-4b90-bf95-671317190609 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:15.273232 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17f51743-9a79-4b90-bf95-671317190609 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:15.273932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17f51743-9a79-4b90-bf95-671317190609 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:15.274419 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17f51743-9a79-4b90-bf95-671317190609 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:15.275342 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-17f51743-9a79-4b90-bf95-671317190609 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:15.409667 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-17f51743-9a79-4b90-bf95-671317190609 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:15.417404 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-17f51743-9a79-4b90-bf95-671317190609 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.156411 Oct 11 05:56:15.417968 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4296/8358] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:15 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:16.441104 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-dc1be55b-7adf-4eff-990c-5b7c4637cb4b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:16.441721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-dc1be55b-7adf-4eff-990c-5b7c4637cb4b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:16.448660 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc1be55b-7adf-4eff-990c-5b7c4637cb4b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:16.449168 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc1be55b-7adf-4eff-990c-5b7c4637cb4b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:16.449604 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc1be55b-7adf-4eff-990c-5b7c4637cb4b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:16.450323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc1be55b-7adf-4eff-990c-5b7c4637cb4b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:16.450776 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc1be55b-7adf-4eff-990c-5b7c4637cb4b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:16.451225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-dc1be55b-7adf-4eff-990c-5b7c4637cb4b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:16.584304 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-dc1be55b-7adf-4eff-990c-5b7c4637cb4b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:16.592386 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-dc1be55b-7adf-4eff-990c-5b7c4637cb4b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.155336 Oct 11 05:56:16.592958 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4063/8359] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:16 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:17.615755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-fd84c68e-f017-4f2c-b4c9-16bb837b878f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:17.616378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-fd84c68e-f017-4f2c-b4c9-16bb837b878f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:17.623758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd84c68e-f017-4f2c-b4c9-16bb837b878f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:17.624257 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd84c68e-f017-4f2c-b4c9-16bb837b878f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:17.624694 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd84c68e-f017-4f2c-b4c9-16bb837b878f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:17.625390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd84c68e-f017-4f2c-b4c9-16bb837b878f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:17.625851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd84c68e-f017-4f2c-b4c9-16bb837b878f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:17.626363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-fd84c68e-f017-4f2c-b4c9-16bb837b878f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:17.756056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-fd84c68e-f017-4f2c-b4c9-16bb837b878f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:17.764315 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-fd84c68e-f017-4f2c-b4c9-16bb837b878f tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.152432 Oct 11 05:56:17.764901 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4297/8360] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:17 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:18.787924 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9e4d77aa-f316-4bb1-8ebe-0abb9730d468 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:18.789412 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9e4d77aa-f316-4bb1-8ebe-0abb9730d468 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:18.797811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e4d77aa-f316-4bb1-8ebe-0abb9730d468 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:18.798328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e4d77aa-f316-4bb1-8ebe-0abb9730d468 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:18.798768 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e4d77aa-f316-4bb1-8ebe-0abb9730d468 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:18.799478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e4d77aa-f316-4bb1-8ebe-0abb9730d468 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:18.799931 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e4d77aa-f316-4bb1-8ebe-0abb9730d468 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:18.800358 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9e4d77aa-f316-4bb1-8ebe-0abb9730d468 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:18.937133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9e4d77aa-f316-4bb1-8ebe-0abb9730d468 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:18.945218 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9e4d77aa-f316-4bb1-8ebe-0abb9730d468 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.161209 Oct 11 05:56:18.945832 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4064/8361] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:18 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:19.969365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-99ca34e6-5bce-42bb-93ec-3e1b12e83d52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:19.970001 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-99ca34e6-5bce-42bb-93ec-3e1b12e83d52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:19.976840 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99ca34e6-5bce-42bb-93ec-3e1b12e83d52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:19.977352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99ca34e6-5bce-42bb-93ec-3e1b12e83d52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:19.977792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99ca34e6-5bce-42bb-93ec-3e1b12e83d52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:19.979142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99ca34e6-5bce-42bb-93ec-3e1b12e83d52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:19.979616 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99ca34e6-5bce-42bb-93ec-3e1b12e83d52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:19.980059 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99ca34e6-5bce-42bb-93ec-3e1b12e83d52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:20.108096 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-99ca34e6-5bce-42bb-93ec-3e1b12e83d52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:20.115851 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-99ca34e6-5bce-42bb-93ec-3e1b12e83d52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.150460 Oct 11 05:56:20.116458 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4298/8362] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:19 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:20.966365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-c97365ee-1b92-4789-abd5-1c829bc9f026 req-2b0d4a78-df07-4cd3-ac89-a036e1c24ce4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b4a61d-cbd0-4042-86ee-7098392ee9ab", "name": "network-vif-plugged", "status": "completed", "tag": "fb6a38c9-0ce7-491b-8a64-cbdba0761efc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:56:20.976593 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c97365ee-1b92-4789-abd5-1c829bc9f026 req-2b0d4a78-df07-4cd3-ac89-a036e1c24ce4 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:20.977083 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c97365ee-1b92-4789-abd5-1c829bc9f026 req-2b0d4a78-df07-4cd3-ac89-a036e1c24ce4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:20.977589 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-c97365ee-1b92-4789-abd5-1c829bc9f026 req-2b0d4a78-df07-4cd3-ac89-a036e1c24ce4 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:20.989148 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-c97365ee-1b92-4789-abd5-1c829bc9f026 req-2b0d4a78-df07-4cd3-ac89-a036e1c24ce4 service nova] Creating event network-vif-plugged:fb6a38c9-0ce7-491b-8a64-cbdba0761efc for instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab on n-h1-860892-1 Oct 11 05:56:20.994766 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-c97365ee-1b92-4789-abd5-1c829bc9f026 req-2b0d4a78-df07-4cd3-ac89-a036e1c24ce4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031651 Oct 11 05:56:20.995355 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4065/8363] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:56:21.139049 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-163e0db7-01d8-449c-8070-7f9b39dbcf98 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:21.139803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-163e0db7-01d8-449c-8070-7f9b39dbcf98 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:21.146902 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-163e0db7-01d8-449c-8070-7f9b39dbcf98 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:21.147410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-163e0db7-01d8-449c-8070-7f9b39dbcf98 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:21.147901 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-163e0db7-01d8-449c-8070-7f9b39dbcf98 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:21.148625 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-163e0db7-01d8-449c-8070-7f9b39dbcf98 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:21.149093 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-163e0db7-01d8-449c-8070-7f9b39dbcf98 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:21.149543 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-163e0db7-01d8-449c-8070-7f9b39dbcf98 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:21.280869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-163e0db7-01d8-449c-8070-7f9b39dbcf98 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:21.288507 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-163e0db7-01d8-449c-8070-7f9b39dbcf98 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.153407 Oct 11 05:56:21.289080 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4299/8364] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:21 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:22.313854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9228a42f-5e84-41e3-b567-c19b863eeb55 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:22.314599 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9228a42f-5e84-41e3-b567-c19b863eeb55 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:22.320788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9228a42f-5e84-41e3-b567-c19b863eeb55 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:22.321268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9228a42f-5e84-41e3-b567-c19b863eeb55 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:22.321707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9228a42f-5e84-41e3-b567-c19b863eeb55 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:22.322425 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9228a42f-5e84-41e3-b567-c19b863eeb55 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:22.322882 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9228a42f-5e84-41e3-b567-c19b863eeb55 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:22.323312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9228a42f-5e84-41e3-b567-c19b863eeb55 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:22.454809 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9228a42f-5e84-41e3-b567-c19b863eeb55 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:22.462834 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9228a42f-5e84-41e3-b567-c19b863eeb55 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1260 microversion: 2.1 time: 0.154240 Oct 11 05:56:22.463414 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4066/8365] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:22 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:23.486665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-72ba1e3a-c197-4a03-adfb-60e889614220 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:23.487285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-72ba1e3a-c197-4a03-adfb-60e889614220 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:23.494743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72ba1e3a-c197-4a03-adfb-60e889614220 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:23.495237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72ba1e3a-c197-4a03-adfb-60e889614220 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:23.495688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72ba1e3a-c197-4a03-adfb-60e889614220 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:23.496390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72ba1e3a-c197-4a03-adfb-60e889614220 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:23.496857 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72ba1e3a-c197-4a03-adfb-60e889614220 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:23.497324 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-72ba1e3a-c197-4a03-adfb-60e889614220 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:23.629463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-72ba1e3a-c197-4a03-adfb-60e889614220 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:23.637896 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-72ba1e3a-c197-4a03-adfb-60e889614220 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1444 microversion: 2.1 time: 0.155381 Oct 11 05:56:23.638498 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4300/8366] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:23 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1444 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:56:23.660202 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6c3eb26d-a00a-4c6b-86c2-01954f78fdc3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:56:23.660833 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6c3eb26d-a00a-4c6b-86c2-01954f78fdc3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:56:23.667601 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c3eb26d-a00a-4c6b-86c2-01954f78fdc3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:23.668077 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c3eb26d-a00a-4c6b-86c2-01954f78fdc3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:23.668510 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c3eb26d-a00a-4c6b-86c2-01954f78fdc3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:23.669191 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c3eb26d-a00a-4c6b-86c2-01954f78fdc3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:23.669639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c3eb26d-a00a-4c6b-86c2-01954f78fdc3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:23.670055 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6c3eb26d-a00a-4c6b-86c2-01954f78fdc3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:23.804864 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6c3eb26d-a00a-4c6b-86c2-01954f78fdc3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:56:23.813236 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6c3eb26d-a00a-4c6b-86c2-01954f78fdc3 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1444 microversion: 2.1 time: 0.156880 Oct 11 05:56:23.813810 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4067/8367] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:56:23 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1444 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:56:25.843547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-e0b002d9-fa91-4365-8946-08217ec977a2 req-aa6e2a00-7383-4bca-95df-15a32cc7359f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b4a61d-cbd0-4042-86ee-7098392ee9ab", "tag": "fb6a38c9-0ce7-491b-8a64-cbdba0761efc"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:56:25.853530 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e0b002d9-fa91-4365-8946-08217ec977a2 req-aa6e2a00-7383-4bca-95df-15a32cc7359f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:56:25.854025 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e0b002d9-fa91-4365-8946-08217ec977a2 req-aa6e2a00-7383-4bca-95df-15a32cc7359f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:56:25.854489 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-e0b002d9-fa91-4365-8946-08217ec977a2 req-aa6e2a00-7383-4bca-95df-15a32cc7359f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:56:25.865481 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-e0b002d9-fa91-4365-8946-08217ec977a2 req-aa6e2a00-7383-4bca-95df-15a32cc7359f service nova] Creating event network-changed:fb6a38c9-0ce7-491b-8a64-cbdba0761efc for instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab on n-h1-860892-1 Oct 11 05:56:25.870778 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-e0b002d9-fa91-4365-8946-08217ec977a2 req-aa6e2a00-7383-4bca-95df-15a32cc7359f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102456 Oct 11 05:56:25.871381 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4301/8368] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:58:52.470748 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 05:58:52.471953 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 05:58:52.472502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=26 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:58:52.473248 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=58 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:58:52.474138 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:58:52.474355 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab/action (ip 10.222.0.26) !!! Oct 11 05:58:52.475845 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:58:52.475991 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab/action (ip 10.222.0.26) !!! Oct 11 05:58:52.477042 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 05:58:52.477200 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 05:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab/action (ip 10.222.0.26) !!! Oct 11 05:58:52.482085 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-7497610f-e467-469b-819c-b2c9b494eb40 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:58:52.485042 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-7497610f-e467-469b-819c-b2c9b494eb40 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:58:52.494352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7497610f-e467-469b-819c-b2c9b494eb40 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:52.494842 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7497610f-e467-469b-819c-b2c9b494eb40 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:52.495278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7497610f-e467-469b-819c-b2c9b494eb40 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:52.495971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7497610f-e467-469b-819c-b2c9b494eb40 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:52.496426 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7497610f-e467-469b-819c-b2c9b494eb40 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:52.496849 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-7497610f-e467-469b-819c-b2c9b494eb40 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:52.525067 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-7497610f-e467-469b-819c-b2c9b494eb40 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lazy-loading 'flavor' on Instance uuid 07b4a61d-cbd0-4042-86ee-7098392ee9ab {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 05:58:52.732474 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-7497610f-e467-469b-819c-b2c9b494eb40 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "POST /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab/action" status: 202 len: 0 microversion: 2.1 time: 0.263968 Oct 11 05:58:52.733023 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4068/8369] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:58:52 2022] POST /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:58:52.740238 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc2e98b3-7f64-4104-93f2-3fa6b98fc453] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:58:52.741080 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 05:58:52.741711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:58:52.742496 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=70 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:58:52.743442 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:58:52.743588 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab (ip 10.222.0.26) !!! Oct 11 05:58:52.745885 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:58:52.746025 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab (ip 10.222.0.26) !!! Oct 11 05:58:52.748019 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 05:58:52.748159 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 05:58:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab (ip 10.222.0.26) !!! Oct 11 05:58:52.757045 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1075bc78-267c-437d-80f8-0db1adfcdb5a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:58:52.760476 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1075bc78-267c-437d-80f8-0db1adfcdb5a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:58:52.776766 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1075bc78-267c-437d-80f8-0db1adfcdb5a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:52.778740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1075bc78-267c-437d-80f8-0db1adfcdb5a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:52.778740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1075bc78-267c-437d-80f8-0db1adfcdb5a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:52.778740 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1075bc78-267c-437d-80f8-0db1adfcdb5a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:52.779117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1075bc78-267c-437d-80f8-0db1adfcdb5a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:52.779413 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1075bc78-267c-437d-80f8-0db1adfcdb5a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:53.047346 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1075bc78-267c-437d-80f8-0db1adfcdb5a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:58:53.051570 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1075bc78-267c-437d-80f8-0db1adfcdb5a tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.313195 Oct 11 05:58:53.052413 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4302/8370] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:58:52 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:58:54.077881 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-28f82e54-02e6-4f8b-ab35-3d83647efb61 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:58:54.078663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-28f82e54-02e6-4f8b-ab35-3d83647efb61 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:58:54.087306 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28f82e54-02e6-4f8b-ab35-3d83647efb61 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:54.087782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28f82e54-02e6-4f8b-ab35-3d83647efb61 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:54.088222 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28f82e54-02e6-4f8b-ab35-3d83647efb61 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:54.088899 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28f82e54-02e6-4f8b-ab35-3d83647efb61 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:54.089347 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28f82e54-02e6-4f8b-ab35-3d83647efb61 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:54.089765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-28f82e54-02e6-4f8b-ab35-3d83647efb61 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:54.094374 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 42228. Oct 11 05:58:54.097475 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 42230. Oct 11 05:58:54.299788 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-28f82e54-02e6-4f8b-ab35-3d83647efb61 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:58:54.307539 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-28f82e54-02e6-4f8b-ab35-3d83647efb61 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.235743 Oct 11 05:58:54.308105 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4069/8371] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:58:54 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:58:55.330499 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-d886aff1-aeae-4935-a9f6-c9c13de3a74b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:58:55.331123 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-d886aff1-aeae-4935-a9f6-c9c13de3a74b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:58:55.340899 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d886aff1-aeae-4935-a9f6-c9c13de3a74b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:55.341434 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d886aff1-aeae-4935-a9f6-c9c13de3a74b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:55.342291 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d886aff1-aeae-4935-a9f6-c9c13de3a74b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:55.342619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d886aff1-aeae-4935-a9f6-c9c13de3a74b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:55.343091 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d886aff1-aeae-4935-a9f6-c9c13de3a74b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:55.343531 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-d886aff1-aeae-4935-a9f6-c9c13de3a74b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:55.350603 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc2e98b3-7f64-4104-93f2-3fa6b98fc453] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 42242. Oct 11 05:58:55.361352 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 42244. Oct 11 05:58:55.474662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-d886aff1-aeae-4935-a9f6-c9c13de3a74b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:58:55.482407 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-d886aff1-aeae-4935-a9f6-c9c13de3a74b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.155807 Oct 11 05:58:55.482984 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4303/8372] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:58:55 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:58:56.506774 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e4868398-e4aa-4ddc-b72a-150b83bc1c86 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:58:56.507318 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e4868398-e4aa-4ddc-b72a-150b83bc1c86 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:58:56.514220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4868398-e4aa-4ddc-b72a-150b83bc1c86 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:56.514712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4868398-e4aa-4ddc-b72a-150b83bc1c86 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:56.515150 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4868398-e4aa-4ddc-b72a-150b83bc1c86 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:56.515843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4868398-e4aa-4ddc-b72a-150b83bc1c86 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:56.516297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4868398-e4aa-4ddc-b72a-150b83bc1c86 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:56.517390 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e4868398-e4aa-4ddc-b72a-150b83bc1c86 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:56.646312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e4868398-e4aa-4ddc-b72a-150b83bc1c86 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:58:56.654114 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e4868398-e4aa-4ddc-b72a-150b83bc1c86 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.151362 Oct 11 05:58:56.654781 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4070/8373] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:58:56 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:58:57.677100 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-2a9f11eb-8174-4c8c-9c8f-6c709ea82c07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:58:57.677732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-2a9f11eb-8174-4c8c-9c8f-6c709ea82c07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:58:57.684567 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9f11eb-8174-4c8c-9c8f-6c709ea82c07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:57.685063 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9f11eb-8174-4c8c-9c8f-6c709ea82c07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:57.685518 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9f11eb-8174-4c8c-9c8f-6c709ea82c07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:57.686245 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9f11eb-8174-4c8c-9c8f-6c709ea82c07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:57.686716 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9f11eb-8174-4c8c-9c8f-6c709ea82c07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:57.687158 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-2a9f11eb-8174-4c8c-9c8f-6c709ea82c07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:57.825417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-2a9f11eb-8174-4c8c-9c8f-6c709ea82c07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:58:57.833968 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-2a9f11eb-8174-4c8c-9c8f-6c709ea82c07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.160801 Oct 11 05:58:57.834576 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4304/8374] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:58:57 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:58:58.857237 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-71914d37-e5f1-4853-a35c-7f7f05d38b14 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:58:58.857846 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-71914d37-e5f1-4853-a35c-7f7f05d38b14 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:58:58.864725 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71914d37-e5f1-4853-a35c-7f7f05d38b14 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:58.865207 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71914d37-e5f1-4853-a35c-7f7f05d38b14 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:58.865645 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71914d37-e5f1-4853-a35c-7f7f05d38b14 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:58.866371 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71914d37-e5f1-4853-a35c-7f7f05d38b14 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:58:58.866827 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71914d37-e5f1-4853-a35c-7f7f05d38b14 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:58:58.867254 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-71914d37-e5f1-4853-a35c-7f7f05d38b14 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:58:59.001282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-71914d37-e5f1-4853-a35c-7f7f05d38b14 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:58:59.009188 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-71914d37-e5f1-4853-a35c-7f7f05d38b14 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.155849 Oct 11 05:58:59.009769 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4071/8375] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:58:58 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:00.033514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35cdd4a1-820c-47a5-adf7-a2d50668cd58 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:00.034140 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-35cdd4a1-820c-47a5-adf7-a2d50668cd58 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:00.040886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35cdd4a1-820c-47a5-adf7-a2d50668cd58 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:00.041378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35cdd4a1-820c-47a5-adf7-a2d50668cd58 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:00.041825 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35cdd4a1-820c-47a5-adf7-a2d50668cd58 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:00.042554 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35cdd4a1-820c-47a5-adf7-a2d50668cd58 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:00.043013 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35cdd4a1-820c-47a5-adf7-a2d50668cd58 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:00.043456 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35cdd4a1-820c-47a5-adf7-a2d50668cd58 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:00.173614 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35cdd4a1-820c-47a5-adf7-a2d50668cd58 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:00.181673 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-35cdd4a1-820c-47a5-adf7-a2d50668cd58 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.152233 Oct 11 05:59:00.182281 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4305/8376] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:00 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:01.205385 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-91e15ab7-faa3-434e-b686-230fff50c558 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:01.206009 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-91e15ab7-faa3-434e-b686-230fff50c558 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:01.212914 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91e15ab7-faa3-434e-b686-230fff50c558 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:01.213408 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91e15ab7-faa3-434e-b686-230fff50c558 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:01.213851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91e15ab7-faa3-434e-b686-230fff50c558 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:01.214576 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91e15ab7-faa3-434e-b686-230fff50c558 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:01.215035 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91e15ab7-faa3-434e-b686-230fff50c558 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:01.215462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-91e15ab7-faa3-434e-b686-230fff50c558 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:01.344346 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-91e15ab7-faa3-434e-b686-230fff50c558 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:01.352861 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-91e15ab7-faa3-434e-b686-230fff50c558 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.151886 Oct 11 05:59:01.353431 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4072/8377] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:01 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:02.375641 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ac13304d-f23a-4a11-8f04-82ea2da410b4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:02.376276 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ac13304d-f23a-4a11-8f04-82ea2da410b4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:02.383084 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac13304d-f23a-4a11-8f04-82ea2da410b4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:02.383575 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac13304d-f23a-4a11-8f04-82ea2da410b4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:02.384021 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac13304d-f23a-4a11-8f04-82ea2da410b4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:02.384723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac13304d-f23a-4a11-8f04-82ea2da410b4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:02.385181 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac13304d-f23a-4a11-8f04-82ea2da410b4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:02.385619 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ac13304d-f23a-4a11-8f04-82ea2da410b4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:02.514879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ac13304d-f23a-4a11-8f04-82ea2da410b4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:02.521401 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ac13304d-f23a-4a11-8f04-82ea2da410b4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.149707 Oct 11 05:59:02.521977 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4306/8378] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:02 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:03.544959 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4f7b27d0-0540-4e73-8720-7d2637111312 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:03.545600 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4f7b27d0-0540-4e73-8720-7d2637111312 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:03.553065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f7b27d0-0540-4e73-8720-7d2637111312 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:03.553545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f7b27d0-0540-4e73-8720-7d2637111312 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:03.553978 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f7b27d0-0540-4e73-8720-7d2637111312 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:03.554699 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f7b27d0-0540-4e73-8720-7d2637111312 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:03.555148 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f7b27d0-0540-4e73-8720-7d2637111312 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:03.555590 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4f7b27d0-0540-4e73-8720-7d2637111312 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:03.695615 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4f7b27d0-0540-4e73-8720-7d2637111312 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:03.700263 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4f7b27d0-0540-4e73-8720-7d2637111312 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.159220 Oct 11 05:59:03.701047 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4073/8379] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:03 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:04.724141 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-1e8fb313-f3f1-433a-99d4-b77a2103fbdb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:04.724763 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-1e8fb313-f3f1-433a-99d4-b77a2103fbdb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:04.731689 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e8fb313-f3f1-433a-99d4-b77a2103fbdb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:04.732180 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e8fb313-f3f1-433a-99d4-b77a2103fbdb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:04.732631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e8fb313-f3f1-433a-99d4-b77a2103fbdb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:04.733329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e8fb313-f3f1-433a-99d4-b77a2103fbdb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:04.733799 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e8fb313-f3f1-433a-99d4-b77a2103fbdb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:04.734265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-1e8fb313-f3f1-433a-99d4-b77a2103fbdb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:04.866924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-1e8fb313-f3f1-433a-99d4-b77a2103fbdb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:04.874695 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-1e8fb313-f3f1-433a-99d4-b77a2103fbdb tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.154912 Oct 11 05:59:04.875268 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4307/8380] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:04 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:05.898013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-0d59da5a-7ce8-4d1b-8002-7fc1aba6a1ad tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:05.898715 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-0d59da5a-7ce8-4d1b-8002-7fc1aba6a1ad tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:05.905558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d59da5a-7ce8-4d1b-8002-7fc1aba6a1ad tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:05.906046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d59da5a-7ce8-4d1b-8002-7fc1aba6a1ad tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:05.906521 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d59da5a-7ce8-4d1b-8002-7fc1aba6a1ad tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:05.907221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d59da5a-7ce8-4d1b-8002-7fc1aba6a1ad tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:05.907973 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d59da5a-7ce8-4d1b-8002-7fc1aba6a1ad tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:05.908366 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-0d59da5a-7ce8-4d1b-8002-7fc1aba6a1ad tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:06.043504 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-0d59da5a-7ce8-4d1b-8002-7fc1aba6a1ad tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:06.052153 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-0d59da5a-7ce8-4d1b-8002-7fc1aba6a1ad tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.158068 Oct 11 05:59:06.052734 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4074/8381] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:05 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:07.075627 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-35e2b942-15ea-4d1b-a8f3-2489edf326c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:07.076332 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-35e2b942-15ea-4d1b-a8f3-2489edf326c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:07.084258 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35e2b942-15ea-4d1b-a8f3-2489edf326c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:07.084752 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35e2b942-15ea-4d1b-a8f3-2489edf326c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:07.085199 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35e2b942-15ea-4d1b-a8f3-2489edf326c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:07.085903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35e2b942-15ea-4d1b-a8f3-2489edf326c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:07.086402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35e2b942-15ea-4d1b-a8f3-2489edf326c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:07.086844 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-35e2b942-15ea-4d1b-a8f3-2489edf326c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:07.221241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-35e2b942-15ea-4d1b-a8f3-2489edf326c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:07.229327 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-35e2b942-15ea-4d1b-a8f3-2489edf326c0 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1568 microversion: 2.1 time: 0.157840 Oct 11 05:59:07.230142 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4308/8382] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:07 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:08.253534 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-fbd4cc72-fa31-40a5-a871-14fe2a59ae60 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:08.254164 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-fbd4cc72-fa31-40a5-a871-14fe2a59ae60 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:08.260981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbd4cc72-fa31-40a5-a871-14fe2a59ae60 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:08.261472 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbd4cc72-fa31-40a5-a871-14fe2a59ae60 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:08.261913 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbd4cc72-fa31-40a5-a871-14fe2a59ae60 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:08.262637 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbd4cc72-fa31-40a5-a871-14fe2a59ae60 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:08.263097 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbd4cc72-fa31-40a5-a871-14fe2a59ae60 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:08.263528 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-fbd4cc72-fa31-40a5-a871-14fe2a59ae60 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:08.399991 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-fbd4cc72-fa31-40a5-a871-14fe2a59ae60 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:08.408115 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-fbd4cc72-fa31-40a5-a871-14fe2a59ae60 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1509 microversion: 2.1 time: 0.158824 Oct 11 05:59:08.408761 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4075/8383] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:08 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1509 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:08.430547 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-bc156e4b-77b6-4c1a-a6f8-7c6e60e87611 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:59:08.431155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bc156e4b-77b6-4c1a-a6f8-7c6e60e87611 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:08.438155 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc156e4b-77b6-4c1a-a6f8-7c6e60e87611 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:08.438670 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc156e4b-77b6-4c1a-a6f8-7c6e60e87611 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:08.439113 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc156e4b-77b6-4c1a-a6f8-7c6e60e87611 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:08.440309 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc156e4b-77b6-4c1a-a6f8-7c6e60e87611 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:08.440770 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc156e4b-77b6-4c1a-a6f8-7c6e60e87611 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:08.441203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-bc156e4b-77b6-4c1a-a6f8-7c6e60e87611 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:08.469578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-bc156e4b-77b6-4c1a-a6f8-7c6e60e87611 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120994) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 11 05:59:08.735519 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-bc156e4b-77b6-4c1a-a6f8-7c6e60e87611 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "POST /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab/action" status: 202 len: 0 microversion: 2.1 time: 0.308824 Oct 11 05:59:08.736143 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4309/8384] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 05:59:08 2022] POST /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab/action => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 05:59:08.744671 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a2f5d377-c371-4b2a-9af5-d780a6b2c8e1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:08.745293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a2f5d377-c371-4b2a-9af5-d780a6b2c8e1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:08.754876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2f5d377-c371-4b2a-9af5-d780a6b2c8e1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:08.755375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2f5d377-c371-4b2a-9af5-d780a6b2c8e1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:08.755820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2f5d377-c371-4b2a-9af5-d780a6b2c8e1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:08.756524 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2f5d377-c371-4b2a-9af5-d780a6b2c8e1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:08.756985 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2f5d377-c371-4b2a-9af5-d780a6b2c8e1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:08.757416 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a2f5d377-c371-4b2a-9af5-d780a6b2c8e1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:08.902128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a2f5d377-c371-4b2a-9af5-d780a6b2c8e1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:08.910477 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a2f5d377-c371-4b2a-9af5-d780a6b2c8e1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1517 microversion: 2.1 time: 0.169623 Oct 11 05:59:08.911050 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4076/8385] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:08 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1517 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:09.729557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-f3f1b7d9-a1ba-4cb1-8c6b-bc55e325f11d req-64235610-10e3-4e91-86f0-5057111e16ea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b4a61d-cbd0-4042-86ee-7098392ee9ab", "name": "network-vif-unplugged", "status": "completed", "tag": "fb6a38c9-0ce7-491b-8a64-cbdba0761efc"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:59:09.739975 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f3f1b7d9-a1ba-4cb1-8c6b-bc55e325f11d req-64235610-10e3-4e91-86f0-5057111e16ea service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:09.740463 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f3f1b7d9-a1ba-4cb1-8c6b-bc55e325f11d req-64235610-10e3-4e91-86f0-5057111e16ea service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:09.740905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-f3f1b7d9-a1ba-4cb1-8c6b-bc55e325f11d req-64235610-10e3-4e91-86f0-5057111e16ea service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:09.752111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.compute.server_external_events [req-f3f1b7d9-a1ba-4cb1-8c6b-bc55e325f11d req-64235610-10e3-4e91-86f0-5057111e16ea service nova] Unable to find a host for instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab. Dropping event network-vif-unplugged {{(pid=120994) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 11 05:59:09.752111 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-f3f1b7d9-a1ba-4cb1-8c6b-bc55e325f11d req-64235610-10e3-4e91-86f0-5057111e16ea service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.077818 Oct 11 05:59:09.753220 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4310/8386] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:59:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 80 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 11 05:59:09.934628 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e1edf865-c39f-4e4f-8927-4d7e50ff98ef tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:09.935274 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e1edf865-c39f-4e4f-8927-4d7e50ff98ef tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:09.942438 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edf865-c39f-4e4f-8927-4d7e50ff98ef tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:09.942918 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edf865-c39f-4e4f-8927-4d7e50ff98ef tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:09.943351 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edf865-c39f-4e4f-8927-4d7e50ff98ef tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:09.944039 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edf865-c39f-4e4f-8927-4d7e50ff98ef tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:09.944484 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edf865-c39f-4e4f-8927-4d7e50ff98ef tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:09.944907 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e1edf865-c39f-4e4f-8927-4d7e50ff98ef tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:10.081479 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e1edf865-c39f-4e4f-8927-4d7e50ff98ef tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:10.089428 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e1edf865-c39f-4e4f-8927-4d7e50ff98ef tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1519 microversion: 2.1 time: 0.158941 Oct 11 05:59:10.089995 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4077/8387] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:09 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:11.112951 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-560d5bba-feb1-4e3a-9b98-87492e48cf07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:11.113588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-560d5bba-feb1-4e3a-9b98-87492e48cf07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:11.120469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-560d5bba-feb1-4e3a-9b98-87492e48cf07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:11.120962 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-560d5bba-feb1-4e3a-9b98-87492e48cf07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:11.121410 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-560d5bba-feb1-4e3a-9b98-87492e48cf07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:11.122107 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-560d5bba-feb1-4e3a-9b98-87492e48cf07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:11.122599 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-560d5bba-feb1-4e3a-9b98-87492e48cf07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:11.123043 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-560d5bba-feb1-4e3a-9b98-87492e48cf07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:11.256174 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-560d5bba-feb1-4e3a-9b98-87492e48cf07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:11.263990 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-560d5bba-feb1-4e3a-9b98-87492e48cf07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1519 microversion: 2.1 time: 0.155004 Oct 11 05:59:11.264574 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4311/8388] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:11 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:12.288847 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-8950f321-fc71-41ed-a254-95646dc2bbab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:12.289499 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-8950f321-fc71-41ed-a254-95646dc2bbab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:12.296456 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8950f321-fc71-41ed-a254-95646dc2bbab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:12.296944 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8950f321-fc71-41ed-a254-95646dc2bbab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:12.297388 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8950f321-fc71-41ed-a254-95646dc2bbab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:12.298086 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8950f321-fc71-41ed-a254-95646dc2bbab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:12.298570 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8950f321-fc71-41ed-a254-95646dc2bbab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:12.299000 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-8950f321-fc71-41ed-a254-95646dc2bbab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:12.435475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-8950f321-fc71-41ed-a254-95646dc2bbab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:12.444022 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-8950f321-fc71-41ed-a254-95646dc2bbab tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1519 microversion: 2.1 time: 0.159210 Oct 11 05:59:12.444601 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4078/8389] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:12 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:13.467523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-8c189ffe-323c-43d8-bf3a-e12b5007da52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:13.468154 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-8c189ffe-323c-43d8-bf3a-e12b5007da52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:13.475241 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c189ffe-323c-43d8-bf3a-e12b5007da52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:13.475732 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c189ffe-323c-43d8-bf3a-e12b5007da52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:13.476187 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c189ffe-323c-43d8-bf3a-e12b5007da52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:13.476908 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c189ffe-323c-43d8-bf3a-e12b5007da52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:13.477383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c189ffe-323c-43d8-bf3a-e12b5007da52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:13.477829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-8c189ffe-323c-43d8-bf3a-e12b5007da52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:13.609348 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-8c189ffe-323c-43d8-bf3a-e12b5007da52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:13.617236 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-8c189ffe-323c-43d8-bf3a-e12b5007da52 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1519 microversion: 2.1 time: 0.153685 Oct 11 05:59:13.617813 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4312/8390] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:13 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1519 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:14.640923 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-410e5b78-916a-472c-a115-c18aa3b6e00b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:14.641562 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-410e5b78-916a-472c-a115-c18aa3b6e00b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:14.649021 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-410e5b78-916a-472c-a115-c18aa3b6e00b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:14.651461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-410e5b78-916a-472c-a115-c18aa3b6e00b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:14.651461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-410e5b78-916a-472c-a115-c18aa3b6e00b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:14.651461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-410e5b78-916a-472c-a115-c18aa3b6e00b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:14.651461 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-410e5b78-916a-472c-a115-c18aa3b6e00b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:14.651848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-410e5b78-916a-472c-a115-c18aa3b6e00b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:14.786739 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-410e5b78-916a-472c-a115-c18aa3b6e00b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:14.794654 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-410e5b78-916a-472c-a115-c18aa3b6e00b tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1519 microversion: 2.1 time: 0.157635 Oct 11 05:59:14.795214 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4079/8391] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:14 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:15.818263 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-796a031b-9cf5-4eb4-b7bc-8df2e9d6781d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:15.818892 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-796a031b-9cf5-4eb4-b7bc-8df2e9d6781d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:15.826026 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796a031b-9cf5-4eb4-b7bc-8df2e9d6781d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:15.826558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796a031b-9cf5-4eb4-b7bc-8df2e9d6781d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:15.827319 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796a031b-9cf5-4eb4-b7bc-8df2e9d6781d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:15.827718 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796a031b-9cf5-4eb4-b7bc-8df2e9d6781d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:15.828186 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796a031b-9cf5-4eb4-b7bc-8df2e9d6781d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:15.828624 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-796a031b-9cf5-4eb4-b7bc-8df2e9d6781d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:16.357177 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-796a031b-9cf5-4eb4-b7bc-8df2e9d6781d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:16.365111 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-796a031b-9cf5-4eb4-b7bc-8df2e9d6781d tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.550808 Oct 11 05:59:16.365887 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4313/8392] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:15 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:17.229549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-59abf761-3076-4e53-ad10-3a619e000f36 req-21dbfec2-1f2a-48db-bf9f-0d98ab38965c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b4a61d-cbd0-4042-86ee-7098392ee9ab", "tag": "fb6a38c9-0ce7-491b-8a64-cbdba0761efc"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:59:17.240785 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-59abf761-3076-4e53-ad10-3a619e000f36 req-21dbfec2-1f2a-48db-bf9f-0d98ab38965c service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:17.241395 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-59abf761-3076-4e53-ad10-3a619e000f36 req-21dbfec2-1f2a-48db-bf9f-0d98ab38965c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:17.241896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-59abf761-3076-4e53-ad10-3a619e000f36 req-21dbfec2-1f2a-48db-bf9f-0d98ab38965c service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:17.253123 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-59abf761-3076-4e53-ad10-3a619e000f36 req-21dbfec2-1f2a-48db-bf9f-0d98ab38965c service nova] Creating event network-changed:fb6a38c9-0ce7-491b-8a64-cbdba0761efc for instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab on n-h2-860892-1 Oct 11 05:59:17.258394 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-59abf761-3076-4e53-ad10-3a619e000f36 req-21dbfec2-1f2a-48db-bf9f-0d98ab38965c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032950 Oct 11 05:59:17.259006 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4080/8393] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:59:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:59:17.387963 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-013bff83-583e-4623-a3f6-b8549f2f0b07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:17.388588 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-013bff83-583e-4623-a3f6-b8549f2f0b07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:17.395378 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013bff83-583e-4623-a3f6-b8549f2f0b07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:17.395868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013bff83-583e-4623-a3f6-b8549f2f0b07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:17.396329 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013bff83-583e-4623-a3f6-b8549f2f0b07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:17.397008 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013bff83-583e-4623-a3f6-b8549f2f0b07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:17.397469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013bff83-583e-4623-a3f6-b8549f2f0b07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:17.397900 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-013bff83-583e-4623-a3f6-b8549f2f0b07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:17.611050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-013bff83-583e-4623-a3f6-b8549f2f0b07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:17.618902 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-013bff83-583e-4623-a3f6-b8549f2f0b07 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.235050 Oct 11 05:59:17.619494 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4314/8394] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:17 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:18.644126 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-90f811be-4e92-45a1-8d5d-e24d2cd4c3d4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:18.645010 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-90f811be-4e92-45a1-8d5d-e24d2cd4c3d4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:18.651268 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90f811be-4e92-45a1-8d5d-e24d2cd4c3d4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:18.651750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90f811be-4e92-45a1-8d5d-e24d2cd4c3d4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:18.652184 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90f811be-4e92-45a1-8d5d-e24d2cd4c3d4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:18.652876 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90f811be-4e92-45a1-8d5d-e24d2cd4c3d4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:18.653328 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90f811be-4e92-45a1-8d5d-e24d2cd4c3d4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:18.653754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-90f811be-4e92-45a1-8d5d-e24d2cd4c3d4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:18.790478 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-90f811be-4e92-45a1-8d5d-e24d2cd4c3d4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:18.798428 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-90f811be-4e92-45a1-8d5d-e24d2cd4c3d4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.159388 Oct 11 05:59:18.799116 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4081/8395] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:18 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:19.822587 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-99c9eed1-6e51-44ce-927c-c67a70252c67 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:19.823240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-99c9eed1-6e51-44ce-927c-c67a70252c67 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:19.829961 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99c9eed1-6e51-44ce-927c-c67a70252c67 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:19.830478 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99c9eed1-6e51-44ce-927c-c67a70252c67 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:19.830954 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99c9eed1-6e51-44ce-927c-c67a70252c67 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:19.831647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99c9eed1-6e51-44ce-927c-c67a70252c67 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:19.832105 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99c9eed1-6e51-44ce-927c-c67a70252c67 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:19.832542 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-99c9eed1-6e51-44ce-927c-c67a70252c67 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:19.966781 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-99c9eed1-6e51-44ce-927c-c67a70252c67 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:19.974460 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-99c9eed1-6e51-44ce-927c-c67a70252c67 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.155892 Oct 11 05:59:19.975018 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4315/8396] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:19 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:20.998513 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d6f26fb9-7c59-437f-9349-bc4d4cf20e70 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:20.999125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d6f26fb9-7c59-437f-9349-bc4d4cf20e70 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:21.005921 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6f26fb9-7c59-437f-9349-bc4d4cf20e70 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:21.006511 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6f26fb9-7c59-437f-9349-bc4d4cf20e70 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:21.006948 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6f26fb9-7c59-437f-9349-bc4d4cf20e70 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:21.007632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6f26fb9-7c59-437f-9349-bc4d4cf20e70 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:21.008080 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6f26fb9-7c59-437f-9349-bc4d4cf20e70 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:21.008502 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-d6f26fb9-7c59-437f-9349-bc4d4cf20e70 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:21.140352 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d6f26fb9-7c59-437f-9349-bc4d4cf20e70 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:21.148036 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d6f26fb9-7c59-437f-9349-bc4d4cf20e70 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.153473 Oct 11 05:59:21.148596 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4082/8397] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:20 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:22.172454 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a51b02a8-553a-42e9-b77c-151b8f2b49dd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:22.173081 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a51b02a8-553a-42e9-b77c-151b8f2b49dd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:22.179964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51b02a8-553a-42e9-b77c-151b8f2b49dd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:22.180466 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51b02a8-553a-42e9-b77c-151b8f2b49dd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:22.180919 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51b02a8-553a-42e9-b77c-151b8f2b49dd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:22.181620 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51b02a8-553a-42e9-b77c-151b8f2b49dd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:22.182094 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51b02a8-553a-42e9-b77c-151b8f2b49dd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:22.182559 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a51b02a8-553a-42e9-b77c-151b8f2b49dd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:22.311117 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a51b02a8-553a-42e9-b77c-151b8f2b49dd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:22.318794 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a51b02a8-553a-42e9-b77c-151b8f2b49dd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.150290 Oct 11 05:59:22.319360 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4316/8398] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:22 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 05:59:23.342656 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a3c09840-36f9-49c7-a1c9-817d2fb813f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:23.343314 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a3c09840-36f9-49c7-a1c9-817d2fb813f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:23.346070 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=31 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:59:23.351327 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c09840-36f9-49c7-a1c9-817d2fb813f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:23.351820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c09840-36f9-49c7-a1c9-817d2fb813f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:23.352262 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c09840-36f9-49c7-a1c9-817d2fb813f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:23.352984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c09840-36f9-49c7-a1c9-817d2fb813f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:23.353474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c09840-36f9-49c7-a1c9-817d2fb813f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:23.353903 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a3c09840-36f9-49c7-a1c9-817d2fb813f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:23.358291 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:59:23.485089 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a3c09840-36f9-49c7-a1c9-817d2fb813f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:23.493412 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a3c09840-36f9-49c7-a1c9-817d2fb813f9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.154697 Oct 11 05:59:23.493985 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4083/8399] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:23 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:24.516573 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7e2b20f1-a538-4d79-a0ba-5cf59496c8e4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:24.517200 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7e2b20f1-a538-4d79-a0ba-5cf59496c8e4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:24.519959 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:59:24.524658 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e2b20f1-a538-4d79-a0ba-5cf59496c8e4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:24.532648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e2b20f1-a538-4d79-a0ba-5cf59496c8e4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:24.532648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e2b20f1-a538-4d79-a0ba-5cf59496c8e4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:24.532648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e2b20f1-a538-4d79-a0ba-5cf59496c8e4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:24.532648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e2b20f1-a538-4d79-a0ba-5cf59496c8e4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:24.532648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7e2b20f1-a538-4d79-a0ba-5cf59496c8e4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:24.532648 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 05:59:24.662875 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7e2b20f1-a538-4d79-a0ba-5cf59496c8e4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:24.670969 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7e2b20f1-a538-4d79-a0ba-5cf59496c8e4 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.158342 Oct 11 05:59:24.671549 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4317/8400] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:24 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:25.694979 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b27922ae-6c4d-4942-b23e-d525f53713a6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:25.695597 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b27922ae-6c4d-4942-b23e-d525f53713a6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:25.701647 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27922ae-6c4d-4942-b23e-d525f53713a6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:25.707173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27922ae-6c4d-4942-b23e-d525f53713a6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:25.707173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27922ae-6c4d-4942-b23e-d525f53713a6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:25.707173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27922ae-6c4d-4942-b23e-d525f53713a6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:25.707173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27922ae-6c4d-4942-b23e-d525f53713a6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:25.707173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b27922ae-6c4d-4942-b23e-d525f53713a6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:25.832072 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-b27922ae-6c4d-4942-b23e-d525f53713a6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:25.839820 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b27922ae-6c4d-4942-b23e-d525f53713a6 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.149873 Oct 11 05:59:25.840397 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4084/8401] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:25 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:26.863802 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-03e61437-9b3a-4bf7-a95a-16e2fc19faa2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:26.864432 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-03e61437-9b3a-4bf7-a95a-16e2fc19faa2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:26.870540 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e61437-9b3a-4bf7-a95a-16e2fc19faa2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:26.873457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e61437-9b3a-4bf7-a95a-16e2fc19faa2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:26.873457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e61437-9b3a-4bf7-a95a-16e2fc19faa2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:26.873457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e61437-9b3a-4bf7-a95a-16e2fc19faa2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:26.873457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e61437-9b3a-4bf7-a95a-16e2fc19faa2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:26.873457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-03e61437-9b3a-4bf7-a95a-16e2fc19faa2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:27.004897 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-03e61437-9b3a-4bf7-a95a-16e2fc19faa2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:27.012786 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-03e61437-9b3a-4bf7-a95a-16e2fc19faa2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.153583 Oct 11 05:59:27.013361 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4318/8402] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:26 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:28.036081 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6e97acae-331e-4b5b-ab0f-25b5338375cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:28.036703 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6e97acae-331e-4b5b-ab0f-25b5338375cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:28.044249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e97acae-331e-4b5b-ab0f-25b5338375cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:28.044826 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e97acae-331e-4b5b-ab0f-25b5338375cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:28.045261 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e97acae-331e-4b5b-ab0f-25b5338375cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:28.045937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e97acae-331e-4b5b-ab0f-25b5338375cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:28.046419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e97acae-331e-4b5b-ab0f-25b5338375cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:28.046843 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6e97acae-331e-4b5b-ab0f-25b5338375cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:28.186658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6e97acae-331e-4b5b-ab0f-25b5338375cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:28.194529 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6e97acae-331e-4b5b-ab0f-25b5338375cf tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.162568 Oct 11 05:59:28.195096 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4085/8403] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:28 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:28.488832 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-296a2475-3dfc-433d-abcf-17fd7cab8654 req-0b6960e0-7761-4208-8881-c451bd8b3673 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b4a61d-cbd0-4042-86ee-7098392ee9ab", "name": "network-vif-plugged", "status": "completed", "tag": "fb6a38c9-0ce7-491b-8a64-cbdba0761efc"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 05:59:28.498829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-296a2475-3dfc-433d-abcf-17fd7cab8654 req-0b6960e0-7761-4208-8881-c451bd8b3673 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:28.499811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-296a2475-3dfc-433d-abcf-17fd7cab8654 req-0b6960e0-7761-4208-8881-c451bd8b3673 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:28.499811 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-296a2475-3dfc-433d-abcf-17fd7cab8654 req-0b6960e0-7761-4208-8881-c451bd8b3673 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:28.510749 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-296a2475-3dfc-433d-abcf-17fd7cab8654 req-0b6960e0-7761-4208-8881-c451bd8b3673 service nova] Creating event network-vif-plugged:fb6a38c9-0ce7-491b-8a64-cbdba0761efc for instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab on n-h2-860892-1 Oct 11 05:59:28.516987 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-296a2475-3dfc-433d-abcf-17fd7cab8654 req-0b6960e0-7761-4208-8881-c451bd8b3673 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032214 Oct 11 05:59:28.517779 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4319/8404] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 05:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 05:59:29.218040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-22bd0a95-f5cc-40bc-a857-71353ee04d2c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:29.218655 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-22bd0a95-f5cc-40bc-a857-71353ee04d2c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:29.225539 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd0a95-f5cc-40bc-a857-71353ee04d2c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:29.226013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd0a95-f5cc-40bc-a857-71353ee04d2c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:29.226475 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd0a95-f5cc-40bc-a857-71353ee04d2c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:29.227275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd0a95-f5cc-40bc-a857-71353ee04d2c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:29.227724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd0a95-f5cc-40bc-a857-71353ee04d2c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:29.228145 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-22bd0a95-f5cc-40bc-a857-71353ee04d2c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:29.358439 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-22bd0a95-f5cc-40bc-a857-71353ee04d2c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:29.366946 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-22bd0a95-f5cc-40bc-a857-71353ee04d2c tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1575 microversion: 2.1 time: 0.153113 Oct 11 05:59:29.367516 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4086/8405] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:29 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 05:59:30.392391 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-48347dc9-ef8a-4ae4-8b53-45f4ed972259 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 05:59:30.393162 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-48347dc9-ef8a-4ae4-8b53-45f4ed972259 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 05:59:30.400056 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48347dc9-ef8a-4ae4-8b53-45f4ed972259 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:30.400557 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48347dc9-ef8a-4ae4-8b53-45f4ed972259 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:30.401014 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48347dc9-ef8a-4ae4-8b53-45f4ed972259 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:30.401722 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48347dc9-ef8a-4ae4-8b53-45f4ed972259 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 05:59:30.402207 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48347dc9-ef8a-4ae4-8b53-45f4ed972259 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 05:59:30.402664 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-48347dc9-ef8a-4ae4-8b53-45f4ed972259 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 05:59:30.533393 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-48347dc9-ef8a-4ae4-8b53-45f4ed972259 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 05:59:30.541172 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-48347dc9-ef8a-4ae4-8b53-45f4ed972259 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1562 microversion: 2.1 time: 0.154002 Oct 11 05:59:30.541746 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4320/8406] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 05:59:30 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1562 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:08.068972 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2be46a61-22d7-4613-994e-b4e07a3415e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:08.069542 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2be46a61-22d7-4613-994e-b4e07a3415e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:08.075186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=7 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:01:08.075832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=23 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:01:08.078163 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2be46a61-22d7-4613-994e-b4e07a3415e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:08.084811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2be46a61-22d7-4613-994e-b4e07a3415e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:08.084811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2be46a61-22d7-4613-994e-b4e07a3415e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:08.084811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2be46a61-22d7-4613-994e-b4e07a3415e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:08.084811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2be46a61-22d7-4613-994e-b4e07a3415e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:08.084811 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-2be46a61-22d7-4613-994e-b4e07a3415e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:08.103803 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=7 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:01:08.104564 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=19 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:01:08.111350 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2be46a61-22d7-4613-994e-b4e07a3415e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:01:08.256971 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-287b83b8-3cce-40a6-94c5-3bb2e3e07372 req-53084131-3040-4e99-a401-fe40cfe01e2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07b4a61d-cbd0-4042-86ee-7098392ee9ab", "tag": "fb6a38c9-0ce7-491b-8a64-cbdba0761efc"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:01:08.269798 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-287b83b8-3cce-40a6-94c5-3bb2e3e07372 req-53084131-3040-4e99-a401-fe40cfe01e2f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:08.270344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-287b83b8-3cce-40a6-94c5-3bb2e3e07372 req-53084131-3040-4e99-a401-fe40cfe01e2f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:08.270829 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-287b83b8-3cce-40a6-94c5-3bb2e3e07372 req-53084131-3040-4e99-a401-fe40cfe01e2f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:08.283143 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-287b83b8-3cce-40a6-94c5-3bb2e3e07372 req-53084131-3040-4e99-a401-fe40cfe01e2f service nova] Creating event network-changed:fb6a38c9-0ce7-491b-8a64-cbdba0761efc for instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab on n-h2-860892-1 Oct 11 06:01:08.289345 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-287b83b8-3cce-40a6-94c5-3bb2e3e07372 req-53084131-3040-4e99-a401-fe40cfe01e2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.193955 Oct 11 06:01:08.289962 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4321/8407] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:01:08.429772 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2be46a61-22d7-4613-994e-b4e07a3415e9 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "DELETE /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 204 len: 0 microversion: 2.1 time: 0.365266 Oct 11 06:01:08.430800 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4087/8408] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 06:01:08 2022] DELETE /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:01:08.440362 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5ecdcd6c-7305-454e-9ce0-c2a91030e9b2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:08.441073 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5ecdcd6c-7305-454e-9ce0-c2a91030e9b2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:08.447465 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ecdcd6c-7305-454e-9ce0-c2a91030e9b2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:08.448231 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ecdcd6c-7305-454e-9ce0-c2a91030e9b2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:08.449020 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ecdcd6c-7305-454e-9ce0-c2a91030e9b2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:08.450003 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ecdcd6c-7305-454e-9ce0-c2a91030e9b2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:08.450700 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ecdcd6c-7305-454e-9ce0-c2a91030e9b2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:08.451334 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5ecdcd6c-7305-454e-9ce0-c2a91030e9b2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:08.607743 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-5ecdcd6c-7305-454e-9ce0-c2a91030e9b2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:08.615862 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5ecdcd6c-7305-454e-9ce0-c2a91030e9b2 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1450 microversion: 2.1 time: 0.180340 Oct 11 06:01:08.616947 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4322/8409] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:08 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1450 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:09.639909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-a659b317-41f3-46e6-b05c-ccc76f2db569 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:09.640603 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-a659b317-41f3-46e6-b05c-ccc76f2db569 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:09.648906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a659b317-41f3-46e6-b05c-ccc76f2db569 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:09.649422 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a659b317-41f3-46e6-b05c-ccc76f2db569 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:09.649821 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a659b317-41f3-46e6-b05c-ccc76f2db569 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:09.650545 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a659b317-41f3-46e6-b05c-ccc76f2db569 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:09.650997 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a659b317-41f3-46e6-b05c-ccc76f2db569 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:09.651418 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-a659b317-41f3-46e6-b05c-ccc76f2db569 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:09.791673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-a659b317-41f3-46e6-b05c-ccc76f2db569 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:09.799413 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-a659b317-41f3-46e6-b05c-ccc76f2db569 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1450 microversion: 2.1 time: 0.163768 Oct 11 06:01:09.800009 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4088/8410] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:09 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:10.502099 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-744c53b6-fbcf-4225-927f-5b79284f0c8c req-0d2faf53-f6f3-4522-938e-5f6541d2eb31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07b4a61d-cbd0-4042-86ee-7098392ee9ab", "name": "network-vif-deleted", "tag": "fb6a38c9-0ce7-491b-8a64-cbdba0761efc"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:01:10.513111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-744c53b6-fbcf-4225-927f-5b79284f0c8c req-0d2faf53-f6f3-4522-938e-5f6541d2eb31 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:10.513602 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-744c53b6-fbcf-4225-927f-5b79284f0c8c req-0d2faf53-f6f3-4522-938e-5f6541d2eb31 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:10.514044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-744c53b6-fbcf-4225-927f-5b79284f0c8c req-0d2faf53-f6f3-4522-938e-5f6541d2eb31 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:10.526232 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-744c53b6-fbcf-4225-927f-5b79284f0c8c req-0d2faf53-f6f3-4522-938e-5f6541d2eb31 service nova] Creating event network-vif-deleted:fb6a38c9-0ce7-491b-8a64-cbdba0761efc for instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab on n-h2-860892-1 Oct 11 06:01:10.531298 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-744c53b6-fbcf-4225-927f-5b79284f0c8c req-0d2faf53-f6f3-4522-938e-5f6541d2eb31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032890 Oct 11 06:01:10.531880 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4323/8411] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:01:10.825229 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-295dd8f3-f0b1-4c91-9baf-0aae51c21c5e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:10.825851 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-295dd8f3-f0b1-4c91-9baf-0aae51c21c5e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:10.835446 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295dd8f3-f0b1-4c91-9baf-0aae51c21c5e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:10.835943 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295dd8f3-f0b1-4c91-9baf-0aae51c21c5e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:10.836445 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295dd8f3-f0b1-4c91-9baf-0aae51c21c5e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:10.837166 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295dd8f3-f0b1-4c91-9baf-0aae51c21c5e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:10.837621 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295dd8f3-f0b1-4c91-9baf-0aae51c21c5e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:10.838053 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-295dd8f3-f0b1-4c91-9baf-0aae51c21c5e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:10.909558 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-295dd8f3-f0b1-4c91-9baf-0aae51c21c5e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:10.918580 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-295dd8f3-f0b1-4c91-9baf-0aae51c21c5e tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1219 microversion: 2.1 time: 0.097847 Oct 11 06:01:10.919591 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4089/8412] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:10 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:11.945255 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f49434e9-9377-4e72-a7df-d9a25d2531fd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:11.945993 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f49434e9-9377-4e72-a7df-d9a25d2531fd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:11.952578 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49434e9-9377-4e72-a7df-d9a25d2531fd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:11.953879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49434e9-9377-4e72-a7df-d9a25d2531fd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:11.953879 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49434e9-9377-4e72-a7df-d9a25d2531fd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:11.954344 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49434e9-9377-4e72-a7df-d9a25d2531fd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:11.954816 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49434e9-9377-4e72-a7df-d9a25d2531fd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:11.955265 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f49434e9-9377-4e72-a7df-d9a25d2531fd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:12.019992 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f49434e9-9377-4e72-a7df-d9a25d2531fd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:12.027887 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f49434e9-9377-4e72-a7df-d9a25d2531fd tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1219 microversion: 2.1 time: 0.089058 Oct 11 06:01:12.028472 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4324/8413] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:11 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:13.052019 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-cd728c6e-e318-4f91-a41b-4fec7d94efda tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:13.052707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-cd728c6e-e318-4f91-a41b-4fec7d94efda tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:13.061462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd728c6e-e318-4f91-a41b-4fec7d94efda tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:13.075984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd728c6e-e318-4f91-a41b-4fec7d94efda tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:13.075984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd728c6e-e318-4f91-a41b-4fec7d94efda tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:13.075984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd728c6e-e318-4f91-a41b-4fec7d94efda tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:13.075984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd728c6e-e318-4f91-a41b-4fec7d94efda tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:13.075984 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-cd728c6e-e318-4f91-a41b-4fec7d94efda tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:13.127410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-cd728c6e-e318-4f91-a41b-4fec7d94efda tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:13.136148 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-cd728c6e-e318-4f91-a41b-4fec7d94efda tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1219 microversion: 2.1 time: 0.088384 Oct 11 06:01:13.144675 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4090/8414] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:13 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:14.159593 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a261d717-5e9d-48d3-8eef-4f8d2498e9b1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:14.160523 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a261d717-5e9d-48d3-8eef-4f8d2498e9b1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:14.167622 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a261d717-5e9d-48d3-8eef-4f8d2498e9b1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:14.168111 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a261d717-5e9d-48d3-8eef-4f8d2498e9b1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:14.168590 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a261d717-5e9d-48d3-8eef-4f8d2498e9b1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:14.169250 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a261d717-5e9d-48d3-8eef-4f8d2498e9b1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:14.169711 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a261d717-5e9d-48d3-8eef-4f8d2498e9b1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:14.170145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a261d717-5e9d-48d3-8eef-4f8d2498e9b1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:14.232468 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a261d717-5e9d-48d3-8eef-4f8d2498e9b1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:14.240463 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a261d717-5e9d-48d3-8eef-4f8d2498e9b1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1219 microversion: 2.1 time: 0.084897 Oct 11 06:01:14.241032 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4325/8415] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:14 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:15.264858 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:15.265712 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:15.272682 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:15.273250 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:15.274293 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:15.275063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:15.275594 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:15.276109 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:15.309883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:15.310481 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:15.310932 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:15.311383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.objects.instance [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lazy-loading 'fault' on Instance uuid 07b4a61d-cbd0-4042-86ee-7098392ee9ab {{(pid=120993) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:01:15.352512 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3fcdd10f70864a30a953cc81809e07cd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f091652bb2bc4e5da19b981968462e02', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:15.360486 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ca8c5adf-29ca-420f-aec1-f13ea64a4905 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 200 len: 1224 microversion: 2.1 time: 0.099495 Oct 11 06:01:15.374219 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4091/8416] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:15 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:16.385390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:16.386211 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] [instance: 07b4a61d-cbd0-4042-86ee-7098392ee9ab] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:16.393361 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:16.393862 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:16.394330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:16.395044 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:16.395761 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:16.395929 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:16.411373 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.wsgi [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] HTTP exception thrown: Instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab could not be found. Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Request method failure captured: Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: request: GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab HTTP/1.1 Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: Accept: application/json Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: Accept-Encoding: identity Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: Connection: close Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: Content-Length: 0 Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: Content-Type: application/json Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: Host: 10.222.0.26 Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: Openstack-System-Scope: None Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: User-Agent: python-urllib3/1.26.12 Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Auth-Token: gAAAAABjRQQsrosL2YIyvpvXk8K4JkAXYXCq4YUo8ToBqDBmcd8XY03hNH_OUH5mGc7Y2tUYpn1diuhPnV-l1amfGT697cuPEBu2gGVQqAQ5jHkmj9Gg0aIr_84_Dx6mcx-5mG8i2W8jc8Qu5IIuSNdpWc1hJT371TQyqBWXmdYLh1D0jhAzxZo Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Id: None Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Domain-Name: None Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Identity-Status: Confirmed Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Is-Admin-Project: True Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Id: default Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Domain-Name: Default Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Id: f091652bb2bc4e5da19b981968462e02 Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Project-Name: tempest-TestShelveInstance-1076866864 Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Role: reader,member Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Roles: reader,member Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f091652bb2bc4e5da19b981968462e02"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f091652bb2bc4e5da19b981968462e02"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f091652bb2bc4e5da19b981968462e02"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f091652bb2bc4e5da19b981968462e02"}]}] Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant: tempest-TestShelveInstance-1076866864 Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Id: f091652bb2bc4e5da19b981968462e02 Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-Tenant-Name: tempest-TestShelveInstance-1076866864 Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-User: tempest-TestShelveInstance-1076866864-project Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Id: default Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-User-Domain-Name: Default Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-User-Id: 3fcdd10f70864a30a953cc81809e07cd Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: X-User-Name: tempest-TestShelveInstance-1076866864-project Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: method: > Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: exception: Instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab could not be found. Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: action_args: {'id': '07b4a61d-cbd0-4042-86ee-7098392ee9ab'} Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab could not be found. Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab could not be found. Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:01:16.413055 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 06:01:16.418686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:01:16.418686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:01:16.418686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:01:16.418686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:01:16.418686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:01:16.418686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab could not be found. Oct 11 06:01:16.418686 n-d-860892-1 devstack@n-api.service[120994]: ERROR nova.api.openstack.wsgi Oct 11 06:01:16.418686 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Returning 404 to user: Instance 07b4a61d-cbd0-4042-86ee-7098392ee9ab could not be found. {{(pid=120994) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:01:16.418686 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-63b89c96-5b48-4e8c-83e4-d20b99190ea1 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab" status: 404 len: 111 microversion: 2.1 time: 0.033755 Oct 11 06:01:16.418686 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4326/8417] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:16 2022] GET /compute/v2.1/servers/07b4a61d-cbd0-4042-86ee-7098392ee9ab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 06:01:16.646108 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9f570fce-ae15-4532-b1db-b0f3f3ff6286 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] Calling method '.version_select at 0x7fda1a3eda60>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:16.733310 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9f570fce-ae15-4532-b1db-b0f3f3ff6286 tempest-TestShelveInstance-1076866864 tempest-TestShelveInstance-1076866864-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1690897884" status: 202 len: 0 microversion: 2.1 time: 0.091103 Oct 11 06:01:16.733935 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4092/8418] 10.222.0.26 () {58 vars in 1254 bytes} [Tue Oct 11 06:01:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1690897884 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 11 06:01:37.879873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=12 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:01:37.881240 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=24 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:01:38.047172 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-273687c3-1098-46ef-b1b0-8c70a7cfb6b3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Action: 'create', calling method: .version_select at 0x7fda18188a60>, body: {"keypair": {"name": "tempest-TestSnapshotPattern-1719793107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHUK+NxQ/jVjWCzWt1neIkYBX3BGkGPu3gUrWCp+B7py0CPU5aWdJePAKW354k3NUe2bvnjL/S5puWtTeihsk/lLOBWoXO0TLpmw7+nU01jGylQVit51uXHMSeHS2d5iVg=="}} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:01:38.066534 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-273687c3-1098-46ef-b1b0-8c70a7cfb6b3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Getting quotas for project 81d8b2f2af804c9aa3e89cbbca3bdc68. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:01:38.072565 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.quota [None req-273687c3-1098-46ef-b1b0-8c70a7cfb6b3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Getting quotas for user 9b2a27166dda4e6e923719d226dc06e9 and project 81d8b2f2af804c9aa3e89cbbca3bdc68. Resources: {'key_pairs'} {{(pid=120994) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:01:38.167329 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-273687c3-1098-46ef-b1b0-8c70a7cfb6b3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 398 microversion: 2.1 time: 0.292198 Oct 11 06:01:38.173743 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4327/8419] 10.222.0.26 () {60 vars in 1159 bytes} [Tue Oct 11 06:01:37 2022] POST /compute/v2.1/os-keypairs => generated 398 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:01:40.583101 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-696106357", "imageRef": "f5e997ff-e5de-4be2-9fc9-af1f070d3e55", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1719793107", "security_groups": [{"name": "tempest-secgroup-smoke-339889731"}], "networks": [{"uuid": "8adb4243-05e8-4f8c-b770-a06315f60bea"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:01:40.593320 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:01:40.593967 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:01:40.697137 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] validate_networks() for [('8adb4243-05e8-4f8c-b770-a06315f60bea', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:01:41.186737 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:01:41.187373 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:01:41.187845 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:01:41.188253 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:01:41.188659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:01:41.197701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:41.198316 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:41.198751 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:41.199466 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:41.199916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:41.200340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:41.217735 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Getting quotas for project 81d8b2f2af804c9aa3e89cbbca3bdc68. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:01:41.222996 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Getting quotas for user 9b2a27166dda4e6e923719d226dc06e9 and project 81d8b2f2af804c9aa3e89cbbca3bdc68. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:01:41.237131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:01:41.239784 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f5e997ff-e5de-4be2-9fc9-af1f070d3e55',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:01:41.365367 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-73b67400-4e40-4544-9f10-169e1c47f56e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.786465 Oct 11 06:01:41.372303 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4093/8420] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 06:01:40 2022] POST /compute/v2.1/servers => generated 405 bytes in 794 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 06:01:41.377973 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-320af2f2-8e80-4c73-8da0-565e4859f366 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:41.378623 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-320af2f2-8e80-4c73-8da0-565e4859f366 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:41.451579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-320af2f2-8e80-4c73-8da0-565e4859f366 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:41.459267 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-320af2f2-8e80-4c73-8da0-565e4859f366 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1248 microversion: 2.1 time: 0.085795 Oct 11 06:01:41.459717 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4328/8421] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:41 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1248 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:01:42.484345 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-d33ffcac-c892-44be-b82f-91f976379417 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:42.484898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-d33ffcac-c892-44be-b82f-91f976379417 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:42.543561 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-d33ffcac-c892-44be-b82f-91f976379417 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:42.550936 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-d33ffcac-c892-44be-b82f-91f976379417 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1248 microversion: 2.1 time: 0.070731 Oct 11 06:01:42.551509 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4094/8422] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:42 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:43.576996 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-12cd6f99-bcc1-4415-8344-94a6323b35aa tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:43.578160 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-12cd6f99-bcc1-4415-8344-94a6323b35aa tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:43.585956 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12cd6f99-bcc1-4415-8344-94a6323b35aa tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:43.587106 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12cd6f99-bcc1-4415-8344-94a6323b35aa tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:43.587561 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12cd6f99-bcc1-4415-8344-94a6323b35aa tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:43.588277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12cd6f99-bcc1-4415-8344-94a6323b35aa tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:43.588741 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12cd6f99-bcc1-4415-8344-94a6323b35aa tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:43.589314 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-12cd6f99-bcc1-4415-8344-94a6323b35aa tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:43.652433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-12cd6f99-bcc1-4415-8344-94a6323b35aa tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:43.661714 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-12cd6f99-bcc1-4415-8344-94a6323b35aa tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1300 microversion: 2.1 time: 0.091129 Oct 11 06:01:43.662299 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4329/8423] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:43 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:44.685246 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4432f7ac-7a6a-4d02-bd69-51fbe396becd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:44.685857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4432f7ac-7a6a-4d02-bd69-51fbe396becd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:44.692747 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4432f7ac-7a6a-4d02-bd69-51fbe396becd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:44.693225 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4432f7ac-7a6a-4d02-bd69-51fbe396becd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:44.693659 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4432f7ac-7a6a-4d02-bd69-51fbe396becd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:44.694376 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4432f7ac-7a6a-4d02-bd69-51fbe396becd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:44.694830 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4432f7ac-7a6a-4d02-bd69-51fbe396becd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:44.695247 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4432f7ac-7a6a-4d02-bd69-51fbe396becd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:44.834123 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4432f7ac-7a6a-4d02-bd69-51fbe396becd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:44.841988 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4432f7ac-7a6a-4d02-bd69-51fbe396becd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1373 microversion: 2.1 time: 0.160568 Oct 11 06:01:44.842585 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4095/8424] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:44 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1373 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:45.434031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-1dfac909-95cf-4edb-8ebd-e79b4e615d73 req-57db1460-05f2-4580-8c12-4cb1a9eab9d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50726316-9ca7-4bcb-b61e-76b5211a7781", "tag": "968b4741-4ca8-4594-9ce9-cd8ad0b005ee"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:01:45.444493 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1dfac909-95cf-4edb-8ebd-e79b4e615d73 req-57db1460-05f2-4580-8c12-4cb1a9eab9d7 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:45.445139 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1dfac909-95cf-4edb-8ebd-e79b4e615d73 req-57db1460-05f2-4580-8c12-4cb1a9eab9d7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:45.445582 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-1dfac909-95cf-4edb-8ebd-e79b4e615d73 req-57db1460-05f2-4580-8c12-4cb1a9eab9d7 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:45.457949 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-1dfac909-95cf-4edb-8ebd-e79b4e615d73 req-57db1460-05f2-4580-8c12-4cb1a9eab9d7 service nova] Creating event network-changed:968b4741-4ca8-4594-9ce9-cd8ad0b005ee for instance 50726316-9ca7-4bcb-b61e-76b5211a7781 on n-h1-860892-1 Oct 11 06:01:45.463352 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-1dfac909-95cf-4edb-8ebd-e79b4e615d73 req-57db1460-05f2-4580-8c12-4cb1a9eab9d7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033769 Oct 11 06:01:45.463933 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4330/8425] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:01:45.865616 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4be33041-a6ea-4b05-abf5-35f3d43d9978 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:45.866937 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4be33041-a6ea-4b05-abf5-35f3d43d9978 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:45.874409 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4be33041-a6ea-4b05-abf5-35f3d43d9978 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:45.874900 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4be33041-a6ea-4b05-abf5-35f3d43d9978 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:45.875340 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4be33041-a6ea-4b05-abf5-35f3d43d9978 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:45.876037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4be33041-a6ea-4b05-abf5-35f3d43d9978 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:45.876494 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4be33041-a6ea-4b05-abf5-35f3d43d9978 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:45.876916 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4be33041-a6ea-4b05-abf5-35f3d43d9978 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:46.008125 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4be33041-a6ea-4b05-abf5-35f3d43d9978 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:46.015855 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4be33041-a6ea-4b05-abf5-35f3d43d9978 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1373 microversion: 2.1 time: 0.154155 Oct 11 06:01:46.016427 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4096/8426] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:45 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1373 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:47.040580 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-a824bb6d-dbb1-4b0b-afdb-caa84230af8c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:47.041524 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-a824bb6d-dbb1-4b0b-afdb-caa84230af8c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:47.048569 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a824bb6d-dbb1-4b0b-afdb-caa84230af8c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:47.049213 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a824bb6d-dbb1-4b0b-afdb-caa84230af8c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:47.049662 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a824bb6d-dbb1-4b0b-afdb-caa84230af8c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:47.050420 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a824bb6d-dbb1-4b0b-afdb-caa84230af8c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:47.050886 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a824bb6d-dbb1-4b0b-afdb-caa84230af8c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:47.051306 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-a824bb6d-dbb1-4b0b-afdb-caa84230af8c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:47.194944 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-a824bb6d-dbb1-4b0b-afdb-caa84230af8c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:47.203017 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-a824bb6d-dbb1-4b0b-afdb-caa84230af8c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1373 microversion: 2.1 time: 0.167531 Oct 11 06:01:47.203887 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4331/8427] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:47 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1373 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:48.225011 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e33def80-9a0e-4519-9e6a-4b3d53658f6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:48.225632 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e33def80-9a0e-4519-9e6a-4b3d53658f6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:48.232681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e33def80-9a0e-4519-9e6a-4b3d53658f6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:48.233167 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e33def80-9a0e-4519-9e6a-4b3d53658f6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:48.233617 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e33def80-9a0e-4519-9e6a-4b3d53658f6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:48.234343 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e33def80-9a0e-4519-9e6a-4b3d53658f6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:48.234804 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e33def80-9a0e-4519-9e6a-4b3d53658f6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:48.235238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e33def80-9a0e-4519-9e6a-4b3d53658f6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:48.369724 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e33def80-9a0e-4519-9e6a-4b3d53658f6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:48.377732 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e33def80-9a0e-4519-9e6a-4b3d53658f6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1373 microversion: 2.1 time: 0.156691 Oct 11 06:01:48.378326 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4097/8428] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:48 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:49.401514 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-30b68404-810c-4822-b14e-777564ed9fbd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:49.402050 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-30b68404-810c-4822-b14e-777564ed9fbd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:49.409131 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b68404-810c-4822-b14e-777564ed9fbd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:49.409626 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b68404-810c-4822-b14e-777564ed9fbd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:49.410077 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b68404-810c-4822-b14e-777564ed9fbd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:49.413290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b68404-810c-4822-b14e-777564ed9fbd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:49.413290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b68404-810c-4822-b14e-777564ed9fbd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:49.413290 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-30b68404-810c-4822-b14e-777564ed9fbd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:49.545797 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-30b68404-810c-4822-b14e-777564ed9fbd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:49.553449 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-30b68404-810c-4822-b14e-777564ed9fbd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1373 microversion: 2.1 time: 0.156535 Oct 11 06:01:49.554018 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4332/8429] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:49 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1373 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:50.576780 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-edb3f959-63c4-4a45-8525-a256fda7c698 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:50.577392 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-edb3f959-63c4-4a45-8525-a256fda7c698 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:50.584122 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb3f959-63c4-4a45-8525-a256fda7c698 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:50.584598 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb3f959-63c4-4a45-8525-a256fda7c698 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:50.585034 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb3f959-63c4-4a45-8525-a256fda7c698 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:50.585710 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb3f959-63c4-4a45-8525-a256fda7c698 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:50.586769 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb3f959-63c4-4a45-8525-a256fda7c698 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:50.587219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-edb3f959-63c4-4a45-8525-a256fda7c698 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:50.717692 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-edb3f959-63c4-4a45-8525-a256fda7c698 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:50.725367 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-edb3f959-63c4-4a45-8525-a256fda7c698 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1373 microversion: 2.1 time: 0.152537 Oct 11 06:01:50.725931 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4098/8430] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:50 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:51.749165 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c44b10cb-c701-4045-bcce-a34169a57aad tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:51.749795 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c44b10cb-c701-4045-bcce-a34169a57aad tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:51.752613 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=6 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:01:51.757469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c44b10cb-c701-4045-bcce-a34169a57aad tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:51.757985 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c44b10cb-c701-4045-bcce-a34169a57aad tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:51.760978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c44b10cb-c701-4045-bcce-a34169a57aad tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:51.760978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c44b10cb-c701-4045-bcce-a34169a57aad tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:51.760978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c44b10cb-c701-4045-bcce-a34169a57aad tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:51.760978 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c44b10cb-c701-4045-bcce-a34169a57aad tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:51.890225 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c44b10cb-c701-4045-bcce-a34169a57aad tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:51.897816 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c44b10cb-c701-4045-bcce-a34169a57aad tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1373 microversion: 2.1 time: 0.152543 Oct 11 06:01:51.898429 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4333/8431] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:51 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1373 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:52.477220 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-43112da4-8d71-49d4-8acf-6580b382de3a req-ad20cc99-0c47-4f6b-ba51-5050d72fee1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50726316-9ca7-4bcb-b61e-76b5211a7781", "name": "network-vif-plugged", "status": "completed", "tag": "968b4741-4ca8-4594-9ce9-cd8ad0b005ee"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:01:52.482278 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:01:52.488485 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-43112da4-8d71-49d4-8acf-6580b382de3a req-ad20cc99-0c47-4f6b-ba51-5050d72fee1a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:52.488957 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-43112da4-8d71-49d4-8acf-6580b382de3a req-ad20cc99-0c47-4f6b-ba51-5050d72fee1a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:52.489382 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-43112da4-8d71-49d4-8acf-6580b382de3a req-ad20cc99-0c47-4f6b-ba51-5050d72fee1a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:52.511178 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-43112da4-8d71-49d4-8acf-6580b382de3a req-ad20cc99-0c47-4f6b-ba51-5050d72fee1a service nova] Creating event network-vif-plugged:968b4741-4ca8-4594-9ce9-cd8ad0b005ee for instance 50726316-9ca7-4bcb-b61e-76b5211a7781 on n-h1-860892-1 Oct 11 06:01:52.511178 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-43112da4-8d71-49d4-8acf-6580b382de3a req-ad20cc99-0c47-4f6b-ba51-5050d72fee1a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032386 Oct 11 06:01:52.511178 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4099/8432] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:01:52.921171 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-22f803bc-1c6b-4687-94ca-d4f717f11b6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:52.921850 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-22f803bc-1c6b-4687-94ca-d4f717f11b6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:52.928903 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f803bc-1c6b-4687-94ca-d4f717f11b6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:52.929405 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f803bc-1c6b-4687-94ca-d4f717f11b6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:52.930433 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f803bc-1c6b-4687-94ca-d4f717f11b6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:52.931142 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f803bc-1c6b-4687-94ca-d4f717f11b6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:52.931615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f803bc-1c6b-4687-94ca-d4f717f11b6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:52.932054 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-22f803bc-1c6b-4687-94ca-d4f717f11b6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:53.064911 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-22f803bc-1c6b-4687-94ca-d4f717f11b6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:53.072646 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-22f803bc-1c6b-4687-94ca-d4f717f11b6c tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1373 microversion: 2.1 time: 0.155385 Oct 11 06:01:53.073230 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4334/8433] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:52 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:54.091989 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:01:54.097119 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-4a9911d5-d8b0-4fb9-afc1-528aa078ff25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:54.100264 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-4a9911d5-d8b0-4fb9-afc1-528aa078ff25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:54.104653 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a9911d5-d8b0-4fb9-afc1-528aa078ff25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:54.105128 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a9911d5-d8b0-4fb9-afc1-528aa078ff25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:54.105664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a9911d5-d8b0-4fb9-afc1-528aa078ff25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:54.106387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a9911d5-d8b0-4fb9-afc1-528aa078ff25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:54.106840 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a9911d5-d8b0-4fb9-afc1-528aa078ff25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:54.107267 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-4a9911d5-d8b0-4fb9-afc1-528aa078ff25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:54.238649 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-4a9911d5-d8b0-4fb9-afc1-528aa078ff25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:54.246964 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-4a9911d5-d8b0-4fb9-afc1-528aa078ff25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1373 microversion: 2.1 time: 0.155902 Oct 11 06:01:54.247537 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4100/8434] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:54 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1373 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:55.270277 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c3f10717-3429-4e29-b795-7601688bf851 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:55.270912 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c3f10717-3429-4e29-b795-7601688bf851 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:55.277936 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3f10717-3429-4e29-b795-7601688bf851 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:55.278469 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3f10717-3429-4e29-b795-7601688bf851 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:55.278924 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3f10717-3429-4e29-b795-7601688bf851 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:55.279633 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3f10717-3429-4e29-b795-7601688bf851 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:55.280098 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3f10717-3429-4e29-b795-7601688bf851 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:55.280541 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c3f10717-3429-4e29-b795-7601688bf851 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:55.409079 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c3f10717-3429-4e29-b795-7601688bf851 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:55.417510 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c3f10717-3429-4e29-b795-7601688bf851 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1558 microversion: 2.1 time: 0.151155 Oct 11 06:01:55.418091 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4335/8435] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:55 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:55.440114 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-6557e275-1df7-48bb-a534-60ea263af424 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:01:55.440734 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-6557e275-1df7-48bb-a534-60ea263af424 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:01:55.447665 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6557e275-1df7-48bb-a534-60ea263af424 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:55.448161 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6557e275-1df7-48bb-a534-60ea263af424 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:55.448602 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6557e275-1df7-48bb-a534-60ea263af424 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:55.449297 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6557e275-1df7-48bb-a534-60ea263af424 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:55.449755 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6557e275-1df7-48bb-a534-60ea263af424 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:55.450182 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-6557e275-1df7-48bb-a534-60ea263af424 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:55.586667 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-6557e275-1df7-48bb-a534-60ea263af424 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:01:55.594871 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-6557e275-1df7-48bb-a534-60ea263af424 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1558 microversion: 2.1 time: 0.158668 Oct 11 06:01:55.595455 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4101/8436] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:01:55 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:01:57.866581 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-cfe181b9-d81b-4380-b496-8fede90d5797 req-2d17019c-78d4-4771-a972-5993847f5dcb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50726316-9ca7-4bcb-b61e-76b5211a7781", "tag": "968b4741-4ca8-4594-9ce9-cd8ad0b005ee"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:01:57.876994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cfe181b9-d81b-4380-b496-8fede90d5797 req-2d17019c-78d4-4771-a972-5993847f5dcb service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:01:57.877527 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cfe181b9-d81b-4380-b496-8fede90d5797 req-2d17019c-78d4-4771-a972-5993847f5dcb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:01:57.878219 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-cfe181b9-d81b-4380-b496-8fede90d5797 req-2d17019c-78d4-4771-a972-5993847f5dcb service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:01:57.889453 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-cfe181b9-d81b-4380-b496-8fede90d5797 req-2d17019c-78d4-4771-a972-5993847f5dcb service nova] Creating event network-changed:968b4741-4ca8-4594-9ce9-cd8ad0b005ee for instance 50726316-9ca7-4bcb-b61e-76b5211a7781 on n-h1-860892-1 Oct 11 06:01:57.894786 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-cfe181b9-d81b-4380-b496-8fede90d5797 req-2d17019c-78d4-4771-a972-5993847f5dcb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031973 Oct 11 06:01:57.895763 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4336/8437] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:04:24.491106 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 06:04:24.492008 n-d-860892-1 devstack@n-api.service[120993]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Oct 11 06:04:24.492553 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:04:24.493909 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=40 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:04:24.495082 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 06:04:24.495217 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 06:04:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781/action (ip 10.222.0.26) !!! Oct 11 06:04:24.497215 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 06:04:24.497355 n-d-860892-1 devstack@n-api.service[120993]: Tue Oct 11 06:04:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781/action (ip 10.222.0.26) !!! Oct 11 06:04:24.503540 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-b498381f-3a82-4c5d-84ae-1e2dc5003055 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-1371836267"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:04:24.510681 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-b498381f-3a82-4c5d-84ae-1e2dc5003055 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:24.520056 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b498381f-3a82-4c5d-84ae-1e2dc5003055 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:24.520536 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b498381f-3a82-4c5d-84ae-1e2dc5003055 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:24.520970 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b498381f-3a82-4c5d-84ae-1e2dc5003055 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:24.521691 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b498381f-3a82-4c5d-84ae-1e2dc5003055 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:24.522354 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b498381f-3a82-4c5d-84ae-1e2dc5003055 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:24.522779 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-b498381f-3a82-4c5d-84ae-1e2dc5003055 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:25.171404 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-b498381f-3a82-4c5d-84ae-1e2dc5003055 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "POST /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781/action" status: 202 len: 0 microversion: 2.1 time: 0.682083 Oct 11 06:04:25.172238 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4102/8438] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 06:04:24 2022] POST /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781/action => generated 0 bytes in 684 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 06:04:33.256496 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [cc2e98b3-7f64-4104-93f2-3fa6b98fc453] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 06:04:33.257402 n-d-860892-1 devstack@n-api.service[120994]: ERROR oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 11 06:04:33.258023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:04:33.259325 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=40 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:04:33.265263 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Oct 11 06:04:33.265263 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 06:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 11 06:04:33.265263 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 11 06:04:33.265263 n-d-860892-1 devstack@n-api.service[120994]: Tue Oct 11 06:04:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.26) !!! Oct 11 06:04:33.323792 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-424d9c7a-4a9a-4c67-87b3-62d6f4d04b18 req-c0876892-263c-42f2-89bd-f5556361839e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50726316-9ca7-4bcb-b61e-76b5211a7781", "name": "network-vif-plugged", "status": "completed", "tag": "968b4741-4ca8-4594-9ce9-cd8ad0b005ee"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:04:33.334384 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-424d9c7a-4a9a-4c67-87b3-62d6f4d04b18 req-c0876892-263c-42f2-89bd-f5556361839e service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:33.351363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-424d9c7a-4a9a-4c67-87b3-62d6f4d04b18 req-c0876892-263c-42f2-89bd-f5556361839e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:33.351363 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-424d9c7a-4a9a-4c67-87b3-62d6f4d04b18 req-c0876892-263c-42f2-89bd-f5556361839e service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:33.351363 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-424d9c7a-4a9a-4c67-87b3-62d6f4d04b18 req-c0876892-263c-42f2-89bd-f5556361839e service nova] Creating event network-vif-plugged:968b4741-4ca8-4594-9ce9-cd8ad0b005ee for instance 50726316-9ca7-4bcb-b61e-76b5211a7781 on n-h1-860892-1 Oct 11 06:04:33.351363 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-424d9c7a-4a9a-4c67-87b3-62d6f4d04b18 req-c0876892-263c-42f2-89bd-f5556361839e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096345 Oct 11 06:04:33.351838 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4337/8439] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:04:45.980814 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:04:45.981760 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:04:45.986365 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestSnapshotPattern-server-212212171", "imageRef": "aac89d0e-8bf8-4558-b6e7-a1d5aef09362", "flavorRef": "452", "key_name": "tempest-TestSnapshotPattern-1719793107", "security_groups": [{"name": "tempest-secgroup-smoke-339889731"}], "networks": [{"uuid": "8adb4243-05e8-4f8c-b770-a06315f60bea"}]}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:04:46.017446 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [4e539a45-86a2-41c3-aad8-c85d97e9a851] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 42856. Oct 11 06:04:46.018539 n-d-860892-1 devstack@n-api.service[120993]: INFO oslo.messaging._drivers.impl_rabbit [-] [8d43b7e8-d21b-4f7d-a3af-a6b9e6504970] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 42858. Oct 11 06:04:46.109139 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.network.neutron [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] validate_networks() for [('8adb4243-05e8-4f8c-b770-a06315f60bea', None, None, None, None, None)] {{(pid=120993) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 11 06:04:46.501954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Flavor limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 11 06:04:46.502721 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Image limits 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 11 06:04:46.503312 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Flavor pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 11 06:04:46.503832 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Image pref 0:0:0 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 11 06:04:46.504383 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.virt.hardware [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120993) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 11 06:04:46.514280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:46.515186 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:46.515894 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:46.516883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:46.517673 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:46.518361 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:46.539061 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Getting quotas for project 81d8b2f2af804c9aa3e89cbbca3bdc68. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 11 06:04:46.547792 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.quota [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Getting quotas for user 9b2a27166dda4e6e923719d226dc06e9 and project 81d8b2f2af804c9aa3e89cbbca3bdc68. Resources: {'cores', 'instances', 'ram'} {{(pid=120993) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 11 06:04:46.564064 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Going to run 1 instances... {{(pid=120993) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 11 06:04:46.566764 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aac89d0e-8bf8-4558-b6e7-a1d5aef09362',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120993) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 11 06:04:46.718163 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-67eaca66-11dd-4f77-a22e-1921bb903a7d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.740441 Oct 11 06:04:46.725234 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4103/8440] 10.222.0.26 () {60 vars in 1147 bytes} [Tue Oct 11 06:04:45 2022] POST /compute/v2.1/servers => generated 405 bytes in 742 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 11 06:04:46.731691 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b64f61cc-7e1a-4604-9c53-c964d1e003f7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:04:46.732448 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-b64f61cc-7e1a-4604-9c53-c964d1e003f7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:46.765651 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] [cc2e98b3-7f64-4104-93f2-3fa6b98fc453] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 42872. Oct 11 06:04:46.772832 n-d-860892-1 devstack@n-api.service[120994]: INFO oslo.messaging._drivers.impl_rabbit [-] [0ddc2674-e60d-4dbb-8a95-3121ff0078cd] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 42874. Oct 11 06:04:46.909248 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-b64f61cc-7e1a-4604-9c53-c964d1e003f7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:04:46.925957 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b64f61cc-7e1a-4604-9c53-c964d1e003f7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1248 microversion: 2.1 time: 0.198015 Oct 11 06:04:46.930735 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4338/8441] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:04:46 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1248 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:04:47.949854 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-2065fa9e-62ac-4843-a6c4-b894ff29b128 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:04:47.950487 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-2065fa9e-62ac-4843-a6c4-b894ff29b128 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:48.009648 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-2065fa9e-62ac-4843-a6c4-b894ff29b128 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:04:48.016606 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-2065fa9e-62ac-4843-a6c4-b894ff29b128 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1248 microversion: 2.1 time: 0.071263 Oct 11 06:04:48.017425 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4104/8442] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:04:47 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1248 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:04:49.039918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-16b527b9-3054-46cc-acee-64a4be7176a7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:04:49.040558 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-16b527b9-3054-46cc-acee-64a4be7176a7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:49.048631 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b527b9-3054-46cc-acee-64a4be7176a7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:49.049137 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b527b9-3054-46cc-acee-64a4be7176a7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:49.049591 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b527b9-3054-46cc-acee-64a4be7176a7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:49.050392 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b527b9-3054-46cc-acee-64a4be7176a7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:49.050891 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b527b9-3054-46cc-acee-64a4be7176a7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:49.051337 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-16b527b9-3054-46cc-acee-64a4be7176a7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:49.125192 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-16b527b9-3054-46cc-acee-64a4be7176a7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:04:49.133775 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-16b527b9-3054-46cc-acee-64a4be7176a7 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1300 microversion: 2.1 time: 0.098378 Oct 11 06:04:49.134676 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4339/8443] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:04:49 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1300 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:04:49.279658 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-04e14d58-77fe-4c6f-bff7-caa19ccba486 req-e62857b0-16b9-4092-a5a8-03b874f5ba0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50726316-9ca7-4bcb-b61e-76b5211a7781", "name": "network-vif-unplugged", "status": "completed", "tag": "968b4741-4ca8-4594-9ce9-cd8ad0b005ee"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:04:49.296065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-04e14d58-77fe-4c6f-bff7-caa19ccba486 req-e62857b0-16b9-4092-a5a8-03b874f5ba0f service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:49.296750 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-04e14d58-77fe-4c6f-bff7-caa19ccba486 req-e62857b0-16b9-4092-a5a8-03b874f5ba0f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:49.297449 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-04e14d58-77fe-4c6f-bff7-caa19ccba486 req-e62857b0-16b9-4092-a5a8-03b874f5ba0f service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:49.311262 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-04e14d58-77fe-4c6f-bff7-caa19ccba486 req-e62857b0-16b9-4092-a5a8-03b874f5ba0f service nova] Creating event network-vif-unplugged:968b4741-4ca8-4594-9ce9-cd8ad0b005ee for instance 50726316-9ca7-4bcb-b61e-76b5211a7781 on n-h1-860892-1 Oct 11 06:04:49.317507 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-04e14d58-77fe-4c6f-bff7-caa19ccba486 req-e62857b0-16b9-4092-a5a8-03b874f5ba0f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041492 Oct 11 06:04:49.319402 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4105/8444] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:04:50.160402 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ea3d0d00-bf33-4519-b147-f850ef4ac49d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:04:50.161251 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ea3d0d00-bf33-4519-b147-f850ef4ac49d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:50.199006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea3d0d00-bf33-4519-b147-f850ef4ac49d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:50.201516 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea3d0d00-bf33-4519-b147-f850ef4ac49d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:50.202977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea3d0d00-bf33-4519-b147-f850ef4ac49d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:50.204340 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea3d0d00-bf33-4519-b147-f850ef4ac49d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:50.205672 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea3d0d00-bf33-4519-b147-f850ef4ac49d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:50.207029 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ea3d0d00-bf33-4519-b147-f850ef4ac49d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:50.534525 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ea3d0d00-bf33-4519-b147-f850ef4ac49d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:04:50.548366 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ea3d0d00-bf33-4519-b147-f850ef4ac49d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.393991 Oct 11 06:04:50.552097 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4340/8445] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:04:50 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:04:51.587362 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5139e5a5-e304-424d-a3c6-1a9a240f2c9d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:04:51.589945 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5139e5a5-e304-424d-a3c6-1a9a240f2c9d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:51.609964 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-35965755-f3de-44d0-8b07-86b7f04bd67a req-0f4e5297-f347-48ed-bdc2-9b02d506fef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9912b573-c588-4262-8a5e-fdae5829420c", "tag": "2d9fd5ff-bb6e-45e3-9b40-d68465170aa3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:04:51.633323 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5139e5a5-e304-424d-a3c6-1a9a240f2c9d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:51.635917 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5139e5a5-e304-424d-a3c6-1a9a240f2c9d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:51.638040 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5139e5a5-e304-424d-a3c6-1a9a240f2c9d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:51.640848 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5139e5a5-e304-424d-a3c6-1a9a240f2c9d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:51.643133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5139e5a5-e304-424d-a3c6-1a9a240f2c9d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:51.644675 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5139e5a5-e304-424d-a3c6-1a9a240f2c9d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:51.656349 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-35965755-f3de-44d0-8b07-86b7f04bd67a req-0f4e5297-f347-48ed-bdc2-9b02d506fef6 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:51.658969 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-35965755-f3de-44d0-8b07-86b7f04bd67a req-0f4e5297-f347-48ed-bdc2-9b02d506fef6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:51.662998 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-35965755-f3de-44d0-8b07-86b7f04bd67a req-0f4e5297-f347-48ed-bdc2-9b02d506fef6 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:51.691423 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-35965755-f3de-44d0-8b07-86b7f04bd67a req-0f4e5297-f347-48ed-bdc2-9b02d506fef6 service nova] Creating event network-changed:2d9fd5ff-bb6e-45e3-9b40-d68465170aa3 for instance 9912b573-c588-4262-8a5e-fdae5829420c on n-h2-860892-1 Oct 11 06:04:51.699747 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-35965755-f3de-44d0-8b07-86b7f04bd67a req-0f4e5297-f347-48ed-bdc2-9b02d506fef6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095601 Oct 11 06:04:51.701386 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4341/8446] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:04:51.904275 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5139e5a5-e304-424d-a3c6-1a9a240f2c9d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:04:51.926900 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5139e5a5-e304-424d-a3c6-1a9a240f2c9d tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.343344 Oct 11 06:04:51.928328 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4106/8447] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:04:51 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:04:52.952239 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56c5789f-c5cf-443c-903c-580553ecdea8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:04:52.953457 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-56c5789f-c5cf-443c-903c-580553ecdea8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:52.961881 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56c5789f-c5cf-443c-903c-580553ecdea8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:52.962734 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56c5789f-c5cf-443c-903c-580553ecdea8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:52.963441 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56c5789f-c5cf-443c-903c-580553ecdea8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:52.964266 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56c5789f-c5cf-443c-903c-580553ecdea8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:52.964860 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56c5789f-c5cf-443c-903c-580553ecdea8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:52.965403 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56c5789f-c5cf-443c-903c-580553ecdea8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:53.141330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-56c5789f-c5cf-443c-903c-580553ecdea8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:04:53.157100 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-56c5789f-c5cf-443c-903c-580553ecdea8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.209105 Oct 11 06:04:53.162769 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4342/8448] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:04:52 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:04:54.183442 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-325b9cd0-fe43-4b6d-88d5-dd430b2174e5 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:04:54.184999 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-325b9cd0-fe43-4b6d-88d5-dd430b2174e5 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:54.193098 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-325b9cd0-fe43-4b6d-88d5-dd430b2174e5 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:54.194238 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-325b9cd0-fe43-4b6d-88d5-dd430b2174e5 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:54.194861 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-325b9cd0-fe43-4b6d-88d5-dd430b2174e5 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:54.195595 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-325b9cd0-fe43-4b6d-88d5-dd430b2174e5 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:54.196489 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-325b9cd0-fe43-4b6d-88d5-dd430b2174e5 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:54.196947 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-325b9cd0-fe43-4b6d-88d5-dd430b2174e5 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:54.386981 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-325b9cd0-fe43-4b6d-88d5-dd430b2174e5 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:04:54.396337 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-325b9cd0-fe43-4b6d-88d5-dd430b2174e5 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.217854 Oct 11 06:04:54.397492 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4107/8449] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:04:54 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:04:55.424215 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-7c5fdce6-900f-43e0-8ed5-0530d08ee6a3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:04:55.425654 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-7c5fdce6-900f-43e0-8ed5-0530d08ee6a3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:55.434426 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c5fdce6-900f-43e0-8ed5-0530d08ee6a3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:55.435311 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c5fdce6-900f-43e0-8ed5-0530d08ee6a3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:55.436023 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c5fdce6-900f-43e0-8ed5-0530d08ee6a3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:55.436851 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c5fdce6-900f-43e0-8ed5-0530d08ee6a3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:55.437533 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c5fdce6-900f-43e0-8ed5-0530d08ee6a3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:55.438090 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-7c5fdce6-900f-43e0-8ed5-0530d08ee6a3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:55.639449 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-7c5fdce6-900f-43e0-8ed5-0530d08ee6a3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:04:55.648159 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-7c5fdce6-900f-43e0-8ed5-0530d08ee6a3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.228464 Oct 11 06:04:55.662979 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4343/8450] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:04:55 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:04:56.677065 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-e8dd4609-050e-4f8a-87a3-8a9ec8322213 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:04:56.677754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-e8dd4609-050e-4f8a-87a3-8a9ec8322213 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:56.685419 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:04:56.687004 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dd4609-050e-4f8a-87a3-8a9ec8322213 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:56.687517 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dd4609-050e-4f8a-87a3-8a9ec8322213 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:56.687977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dd4609-050e-4f8a-87a3-8a9ec8322213 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:56.688982 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dd4609-050e-4f8a-87a3-8a9ec8322213 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:56.689463 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dd4609-050e-4f8a-87a3-8a9ec8322213 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:56.689908 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-e8dd4609-050e-4f8a-87a3-8a9ec8322213 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:56.981754 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-e8dd4609-050e-4f8a-87a3-8a9ec8322213 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:04:57.001378 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-e8dd4609-050e-4f8a-87a3-8a9ec8322213 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.326713 Oct 11 06:04:57.011921 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4108/8451] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:04:56 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:04:58.031977 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-56fd2fb0-e311-4d8c-bc80-e1cb09fc3d25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:04:58.032572 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-56fd2fb0-e311-4d8c-bc80-e1cb09fc3d25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:58.035404 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell0:SELECT=2 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:04:58.040509 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56fd2fb0-e311-4d8c-bc80-e1cb09fc3d25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:58.041009 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56fd2fb0-e311-4d8c-bc80-e1cb09fc3d25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:58.041461 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56fd2fb0-e311-4d8c-bc80-e1cb09fc3d25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:58.042168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56fd2fb0-e311-4d8c-bc80-e1cb09fc3d25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:58.042665 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56fd2fb0-e311-4d8c-bc80-e1cb09fc3d25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:58.043102 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-56fd2fb0-e311-4d8c-bc80-e1cb09fc3d25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:58.192604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-56fd2fb0-e311-4d8c-bc80-e1cb09fc3d25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:04:58.201467 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-56fd2fb0-e311-4d8c-bc80-e1cb09fc3d25 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.173576 Oct 11 06:04:58.202219 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4344/8452] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:04:58 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:04:59.227214 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9845cbd3-51ad-4114-83f1-c69ed4345877 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:04:59.227813 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9845cbd3-51ad-4114-83f1-c69ed4345877 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:04:59.230898 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell0:SELECT=8 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:04:59.235965 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9845cbd3-51ad-4114-83f1-c69ed4345877 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:59.236369 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9845cbd3-51ad-4114-83f1-c69ed4345877 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:59.236815 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9845cbd3-51ad-4114-83f1-c69ed4345877 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:59.237518 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9845cbd3-51ad-4114-83f1-c69ed4345877 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:04:59.238001 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9845cbd3-51ad-4114-83f1-c69ed4345877 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:04:59.238532 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9845cbd3-51ad-4114-83f1-c69ed4345877 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:04:59.389047 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-9845cbd3-51ad-4114-83f1-c69ed4345877 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:04:59.397783 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9845cbd3-51ad-4114-83f1-c69ed4345877 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.174620 Oct 11 06:04:59.416725 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4109/8453] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:04:59 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:05:00.423715 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f9abd906-ac55-4f77-8f57-cd5440cc855b tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:05:00.424389 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f9abd906-ac55-4f77-8f57-cd5440cc855b tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:05:00.431946 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9abd906-ac55-4f77-8f57-cd5440cc855b tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:00.432552 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9abd906-ac55-4f77-8f57-cd5440cc855b tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:00.433006 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9abd906-ac55-4f77-8f57-cd5440cc855b tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:00.433705 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9abd906-ac55-4f77-8f57-cd5440cc855b tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:00.434168 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9abd906-ac55-4f77-8f57-cd5440cc855b tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:00.434632 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f9abd906-ac55-4f77-8f57-cd5440cc855b tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:00.570764 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f9abd906-ac55-4f77-8f57-cd5440cc855b tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:05:00.578591 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f9abd906-ac55-4f77-8f57-cd5440cc855b tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.158805 Oct 11 06:05:00.579163 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4345/8454] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:05:00 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:05:01.602158 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-f8b13dc3-7399-4bcc-b55d-a2f6ae2a605a tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:05:01.602835 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-f8b13dc3-7399-4bcc-b55d-a2f6ae2a605a tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:05:01.610178 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8b13dc3-7399-4bcc-b55d-a2f6ae2a605a tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:01.610701 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8b13dc3-7399-4bcc-b55d-a2f6ae2a605a tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:01.611131 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8b13dc3-7399-4bcc-b55d-a2f6ae2a605a tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:01.611857 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8b13dc3-7399-4bcc-b55d-a2f6ae2a605a tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:01.612282 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8b13dc3-7399-4bcc-b55d-a2f6ae2a605a tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:01.612706 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-f8b13dc3-7399-4bcc-b55d-a2f6ae2a605a tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:01.764020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-f8b13dc3-7399-4bcc-b55d-a2f6ae2a605a tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:05:01.773517 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-f8b13dc3-7399-4bcc-b55d-a2f6ae2a605a tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.175329 Oct 11 06:05:01.774277 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4110/8455] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:05:01 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:05:02.799474 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-f11b72d6-38b2-4d6e-9525-f90075eeb0df tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:05:02.800034 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-f11b72d6-38b2-4d6e-9525-f90075eeb0df tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:05:02.807723 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f11b72d6-38b2-4d6e-9525-f90075eeb0df tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:02.808228 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f11b72d6-38b2-4d6e-9525-f90075eeb0df tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:02.808684 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f11b72d6-38b2-4d6e-9525-f90075eeb0df tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:02.809397 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f11b72d6-38b2-4d6e-9525-f90075eeb0df tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:02.809873 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f11b72d6-38b2-4d6e-9525-f90075eeb0df tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:02.810352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-f11b72d6-38b2-4d6e-9525-f90075eeb0df tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:02.953824 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-f11b72d6-38b2-4d6e-9525-f90075eeb0df tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:05:02.961754 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-f11b72d6-38b2-4d6e-9525-f90075eeb0df tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.166303 Oct 11 06:05:02.974208 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4346/8456] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:05:02 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:05:03.924664 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-1b9c8db9-cd73-4f9e-83e7-14e76f042360 req-bcb894ee-4476-4a69-9348-b6fe9e2bbdc2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9912b573-c588-4262-8a5e-fdae5829420c", "name": "network-vif-plugged", "status": "completed", "tag": "2d9fd5ff-bb6e-45e3-9b40-d68465170aa3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:05:03.935915 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1b9c8db9-cd73-4f9e-83e7-14e76f042360 req-bcb894ee-4476-4a69-9348-b6fe9e2bbdc2 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:03.936396 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1b9c8db9-cd73-4f9e-83e7-14e76f042360 req-bcb894ee-4476-4a69-9348-b6fe9e2bbdc2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:03.936855 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-1b9c8db9-cd73-4f9e-83e7-14e76f042360 req-bcb894ee-4476-4a69-9348-b6fe9e2bbdc2 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:03.947764 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-1b9c8db9-cd73-4f9e-83e7-14e76f042360 req-bcb894ee-4476-4a69-9348-b6fe9e2bbdc2 service nova] Creating event network-vif-plugged:2d9fd5ff-bb6e-45e3-9b40-d68465170aa3 for instance 9912b573-c588-4262-8a5e-fdae5829420c on n-h2-860892-1 Oct 11 06:05:03.953012 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-1b9c8db9-cd73-4f9e-83e7-14e76f042360 req-bcb894ee-4476-4a69-9348-b6fe9e2bbdc2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032769 Oct 11 06:05:03.957610 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4111/8457] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:05:03.986254 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-ff4644c5-b23b-41aa-b57e-702ffccf60bd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:05:03.987869 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-ff4644c5-b23b-41aa-b57e-702ffccf60bd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:05:03.994868 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff4644c5-b23b-41aa-b57e-702ffccf60bd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:03.995669 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff4644c5-b23b-41aa-b57e-702ffccf60bd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:03.996103 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff4644c5-b23b-41aa-b57e-702ffccf60bd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:03.997031 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff4644c5-b23b-41aa-b57e-702ffccf60bd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:03.997738 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff4644c5-b23b-41aa-b57e-702ffccf60bd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:03.998217 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-ff4644c5-b23b-41aa-b57e-702ffccf60bd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:04.207769 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-ff4644c5-b23b-41aa-b57e-702ffccf60bd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:05:04.216387 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-ff4644c5-b23b-41aa-b57e-702ffccf60bd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.234169 Oct 11 06:05:04.217051 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4347/8458] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:05:03 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:05:05.243117 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-309ee286-f191-47c5-960d-a38ecd8837a4 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:05:05.243905 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-309ee286-f191-47c5-960d-a38ecd8837a4 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:05:05.251883 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-309ee286-f191-47c5-960d-a38ecd8837a4 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:05.252423 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-309ee286-f191-47c5-960d-a38ecd8837a4 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:05.252872 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-309ee286-f191-47c5-960d-a38ecd8837a4 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:05.253707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-309ee286-f191-47c5-960d-a38ecd8837a4 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:05.254265 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-309ee286-f191-47c5-960d-a38ecd8837a4 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:05.254771 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-309ee286-f191-47c5-960d-a38ecd8837a4 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:05.400249 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-309ee286-f191-47c5-960d-a38ecd8837a4 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:05:05.408185 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-309ee286-f191-47c5-960d-a38ecd8837a4 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1373 microversion: 2.1 time: 0.171879 Oct 11 06:05:05.409386 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4112/8459] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:05:05 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1373 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:05:06.432987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-925d8fcf-1715-449c-bc21-95ef660e876f tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:05:06.433647 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-925d8fcf-1715-449c-bc21-95ef660e876f tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:05:06.440551 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-925d8fcf-1715-449c-bc21-95ef660e876f tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:06.441053 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-925d8fcf-1715-449c-bc21-95ef660e876f tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:06.441501 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-925d8fcf-1715-449c-bc21-95ef660e876f tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:06.442216 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-925d8fcf-1715-449c-bc21-95ef660e876f tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:06.442688 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-925d8fcf-1715-449c-bc21-95ef660e876f tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:06.443129 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-925d8fcf-1715-449c-bc21-95ef660e876f tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:06.588293 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-925d8fcf-1715-449c-bc21-95ef660e876f tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:05:06.596383 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-925d8fcf-1715-449c-bc21-95ef660e876f tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1558 microversion: 2.1 time: 0.168020 Oct 11 06:05:06.596964 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4348/8460] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:05:06 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1558 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:05:06.620971 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5058dd41-bb1c-4640-a71e-6ff50491d7a0 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:05:06.621575 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5058dd41-bb1c-4640-a71e-6ff50491d7a0 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:05:06.628740 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5058dd41-bb1c-4640-a71e-6ff50491d7a0 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:06.629305 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5058dd41-bb1c-4640-a71e-6ff50491d7a0 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:06.629765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5058dd41-bb1c-4640-a71e-6ff50491d7a0 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:06.630506 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5058dd41-bb1c-4640-a71e-6ff50491d7a0 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:06.630966 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5058dd41-bb1c-4640-a71e-6ff50491d7a0 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:06.631394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5058dd41-bb1c-4640-a71e-6ff50491d7a0 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:06.770215 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-5058dd41-bb1c-4640-a71e-6ff50491d7a0 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:05:06.774998 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5058dd41-bb1c-4640-a71e-6ff50491d7a0 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1558 microversion: 2.1 time: 0.158551 Oct 11 06:05:06.775654 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4113/8461] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:05:06 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:05:08.781511 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-82a64d5d-f0c6-447a-9189-670e64f56407 req-d3d15920-c833-4082-9aa6-ef07c0874cfd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9912b573-c588-4262-8a5e-fdae5829420c", "tag": "2d9fd5ff-bb6e-45e3-9b40-d68465170aa3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:05:08.791273 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82a64d5d-f0c6-447a-9189-670e64f56407 req-d3d15920-c833-4082-9aa6-ef07c0874cfd service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:05:08.791758 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82a64d5d-f0c6-447a-9189-670e64f56407 req-d3d15920-c833-4082-9aa6-ef07c0874cfd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:05:08.792203 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-82a64d5d-f0c6-447a-9189-670e64f56407 req-d3d15920-c833-4082-9aa6-ef07c0874cfd service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:05:08.803471 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-82a64d5d-f0c6-447a-9189-670e64f56407 req-d3d15920-c833-4082-9aa6-ef07c0874cfd service nova] Creating event network-changed:2d9fd5ff-bb6e-45e3-9b40-d68465170aa3 for instance 9912b573-c588-4262-8a5e-fdae5829420c on n-h2-860892-1 Oct 11 06:05:08.808649 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-82a64d5d-f0c6-447a-9189-670e64f56407 req-d3d15920-c833-4082-9aa6-ef07c0874cfd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093064 Oct 11 06:05:08.809749 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4349/8462] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:05:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:06:35.891541 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:06:35.892357 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=48 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:06:35.897173 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-9d52a8a2-0924-4273-a394-4b292179e3a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestSnapshotPatternsnapshot-5872496"}} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:06:35.903533 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-9d52a8a2-0924-4273-a394-4b292179e3a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:06:35.906296 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d52a8a2-0924-4273-a394-4b292179e3a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:35.906782 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d52a8a2-0924-4273-a394-4b292179e3a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:35.907219 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d52a8a2-0924-4273-a394-4b292179e3a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:35.907922 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d52a8a2-0924-4273-a394-4b292179e3a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:35.908375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d52a8a2-0924-4273-a394-4b292179e3a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:35.908820 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-9d52a8a2-0924-4273-a394-4b292179e3a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:36.302322 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-9d52a8a2-0924-4273-a394-4b292179e3a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "POST /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c/action" status: 202 len: 0 microversion: 2.1 time: 0.412748 Oct 11 06:06:36.302987 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4114/8463] 10.222.0.26 () {60 vars in 1278 bytes} [Tue Oct 11 06:06:35 2022] POST /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c/action => generated 0 bytes in 414 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Oct 11 06:06:42.344183 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_api:SELECT=28 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:06:42.345269 n-d-860892-1 devstack@n-api.service[120994]: DEBUG dbcounter [-] [120994] Writing DB stats nova_cell1:SELECT=60 {{(pid=120994) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:06:42.350652 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-9d2928af-8900-41e1-b773-f4662fba342a req-b3c3967a-06ca-4972-aa7a-23cb7d8c994d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9912b573-c588-4262-8a5e-fdae5829420c", "name": "network-vif-plugged", "status": "completed", "tag": "2d9fd5ff-bb6e-45e3-9b40-d68465170aa3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:06:42.362789 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9d2928af-8900-41e1-b773-f4662fba342a req-b3c3967a-06ca-4972-aa7a-23cb7d8c994d service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:42.363617 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9d2928af-8900-41e1-b773-f4662fba342a req-b3c3967a-06ca-4972-aa7a-23cb7d8c994d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:42.364315 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-9d2928af-8900-41e1-b773-f4662fba342a req-b3c3967a-06ca-4972-aa7a-23cb7d8c994d service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:42.377984 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-9d2928af-8900-41e1-b773-f4662fba342a req-b3c3967a-06ca-4972-aa7a-23cb7d8c994d service nova] Creating event network-vif-plugged:2d9fd5ff-bb6e-45e3-9b40-d68465170aa3 for instance 9912b573-c588-4262-8a5e-fdae5829420c on n-h2-860892-1 Oct 11 06:06:42.385702 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-9d2928af-8900-41e1-b773-f4662fba342a req-b3c3967a-06ca-4972-aa7a-23cb7d8c994d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044600 Oct 11 06:06:42.386949 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4350/8464] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:06:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:06:54.302669 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_api:SELECT=2 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:06:54.303805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG dbcounter [-] [120993] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120993) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 11 06:06:54.307407 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-299fda74-7685-4913-a2c1-e590c9f5a3cc req-70b12a7e-8d83-44bb-a73c-091e5f71ed44 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9912b573-c588-4262-8a5e-fdae5829420c", "tag": "2d9fd5ff-bb6e-45e3-9b40-d68465170aa3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:06:54.308143 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ff231b47-0515-481e-a9fd-0cf88f1e2cdb tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:06:54.308954 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff231b47-0515-481e-a9fd-0cf88f1e2cdb tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:06:54.316462 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff231b47-0515-481e-a9fd-0cf88f1e2cdb tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:54.317394 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff231b47-0515-481e-a9fd-0cf88f1e2cdb tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:54.317896 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff231b47-0515-481e-a9fd-0cf88f1e2cdb tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:54.318697 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff231b47-0515-481e-a9fd-0cf88f1e2cdb tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:54.319211 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff231b47-0515-481e-a9fd-0cf88f1e2cdb tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:54.319341 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-299fda74-7685-4913-a2c1-e590c9f5a3cc req-70b12a7e-8d83-44bb-a73c-091e5f71ed44 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:54.319918 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-299fda74-7685-4913-a2c1-e590c9f5a3cc req-70b12a7e-8d83-44bb-a73c-091e5f71ed44 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:54.320417 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-299fda74-7685-4913-a2c1-e590c9f5a3cc req-70b12a7e-8d83-44bb-a73c-091e5f71ed44 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:54.320663 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ff231b47-0515-481e-a9fd-0cf88f1e2cdb tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:54.332021 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-299fda74-7685-4913-a2c1-e590c9f5a3cc req-70b12a7e-8d83-44bb-a73c-091e5f71ed44 service nova] Creating event network-changed:2d9fd5ff-bb6e-45e3-9b40-d68465170aa3 for instance 9912b573-c588-4262-8a5e-fdae5829420c on n-h2-860892-1 Oct 11 06:06:54.337496 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-299fda74-7685-4913-a2c1-e590c9f5a3cc req-70b12a7e-8d83-44bb-a73c-091e5f71ed44 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035457 Oct 11 06:06:54.338179 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4351/8465] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 11 06:06:54.353977 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ff231b47-0515-481e-a9fd-0cf88f1e2cdb tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Going to try to terminate instance {{(pid=120993) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:06:54.711331 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ff231b47-0515-481e-a9fd-0cf88f1e2cdb tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 204 len: 0 microversion: 2.1 time: 0.410811 Oct 11 06:06:54.716295 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4115/8466] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 06:06:54 2022] DELETE /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:06:54.721932 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-69760521-1d9f-42ba-9689-3a1f11bab4fd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:06:54.722681 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-69760521-1d9f-42ba-9689-3a1f11bab4fd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:06:54.729864 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69760521-1d9f-42ba-9689-3a1f11bab4fd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:54.730657 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69760521-1d9f-42ba-9689-3a1f11bab4fd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:54.731285 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69760521-1d9f-42ba-9689-3a1f11bab4fd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:54.733696 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69760521-1d9f-42ba-9689-3a1f11bab4fd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:54.734313 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69760521-1d9f-42ba-9689-3a1f11bab4fd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:54.735377 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-69760521-1d9f-42ba-9689-3a1f11bab4fd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:54.890987 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-69760521-1d9f-42ba-9689-3a1f11bab4fd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:06:54.899651 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-69760521-1d9f-42ba-9689-3a1f11bab4fd tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1683 microversion: 2.1 time: 0.182491 Oct 11 06:06:54.900230 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4352/8467] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:06:54 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1683 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:06:55.923797 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-07730e33-c4be-43dd-be34-805e9b92b439 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:06:55.924629 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-07730e33-c4be-43dd-be34-805e9b92b439 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:06:55.932375 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07730e33-c4be-43dd-be34-805e9b92b439 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:55.932953 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07730e33-c4be-43dd-be34-805e9b92b439 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:55.934038 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07730e33-c4be-43dd-be34-805e9b92b439 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:55.934929 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07730e33-c4be-43dd-be34-805e9b92b439 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:55.935612 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07730e33-c4be-43dd-be34-805e9b92b439 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:55.936221 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-07730e33-c4be-43dd-be34-805e9b92b439 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:56.075049 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-07730e33-c4be-43dd-be34-805e9b92b439 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:06:56.083476 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-07730e33-c4be-43dd-be34-805e9b92b439 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1683 microversion: 2.1 time: 0.164580 Oct 11 06:06:56.084043 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4116/8468] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:06:55 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1683 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:06:56.400503 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [req-7eaeb514-f6a3-450f-ba71-5bd2a3646194 req-503ee40f-e09c-4fe4-879e-25c0ae9f3c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9912b573-c588-4262-8a5e-fdae5829420c", "name": "network-vif-unplugged", "status": "completed", "tag": "2d9fd5ff-bb6e-45e3-9b40-d68465170aa3"}]} {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:06:56.412118 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7eaeb514-f6a3-450f-ba71-5bd2a3646194 req-503ee40f-e09c-4fe4-879e-25c0ae9f3c6a service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:56.412921 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7eaeb514-f6a3-450f-ba71-5bd2a3646194 req-503ee40f-e09c-4fe4-879e-25c0ae9f3c6a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:56.413446 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [req-7eaeb514-f6a3-450f-ba71-5bd2a3646194 req-503ee40f-e09c-4fe4-879e-25c0ae9f3c6a service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:56.425727 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.compute.server_external_events [req-7eaeb514-f6a3-450f-ba71-5bd2a3646194 req-503ee40f-e09c-4fe4-879e-25c0ae9f3c6a service nova] Creating event network-vif-unplugged:2d9fd5ff-bb6e-45e3-9b40-d68465170aa3 for instance 9912b573-c588-4262-8a5e-fdae5829420c on n-h2-860892-1 Oct 11 06:06:56.433899 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [req-7eaeb514-f6a3-450f-ba71-5bd2a3646194 req-503ee40f-e09c-4fe4-879e-25c0ae9f3c6a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038071 Oct 11 06:06:56.434787 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4353/8469] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:06:56.779765 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-3905723f-f018-4942-aae4-cf9288607fab req-73437ca6-5786-465d-b2ad-bbc54216d816 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9912b573-c588-4262-8a5e-fdae5829420c", "name": "network-vif-deleted", "tag": "2d9fd5ff-bb6e-45e3-9b40-d68465170aa3"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:06:56.791332 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3905723f-f018-4942-aae4-cf9288607fab req-73437ca6-5786-465d-b2ad-bbc54216d816 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:56.791818 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3905723f-f018-4942-aae4-cf9288607fab req-73437ca6-5786-465d-b2ad-bbc54216d816 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:56.792255 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-3905723f-f018-4942-aae4-cf9288607fab req-73437ca6-5786-465d-b2ad-bbc54216d816 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:56.805362 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-3905723f-f018-4942-aae4-cf9288607fab req-73437ca6-5786-465d-b2ad-bbc54216d816 service nova] Creating event network-vif-deleted:2d9fd5ff-bb6e-45e3-9b40-d68465170aa3 for instance 9912b573-c588-4262-8a5e-fdae5829420c on n-h2-860892-1 Oct 11 06:06:56.812243 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-3905723f-f018-4942-aae4-cf9288607fab req-73437ca6-5786-465d-b2ad-bbc54216d816 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110123 Oct 11 06:06:56.819768 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4117/8470] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:06:57.110437 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:06:57.111429 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:06:57.118069 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:57.119365 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:57.123562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:57.123562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:57.123562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:57.123562 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:57.159477 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:57.160209 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:57.160671 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:57.161237 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lazy-loading 'fault' on Instance uuid 9912b573-c588-4262-8a5e-fdae5829420c {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:06:57.209394 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:06:57.218337 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-02cc16f5-c8f8-4716-8c4b-e075cd89f0a2 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 200 len: 1338 microversion: 2.1 time: 0.112595 Oct 11 06:06:57.218925 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4354/8471] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:06:57 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 1338 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:06:58.250043 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:06:58.251020 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 9912b573-c588-4262-8a5e-fdae5829420c] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:06:58.266474 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:58.267230 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:58.267863 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:58.268756 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:06:58.269387 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:06:58.270013 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:06:58.284250 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] HTTP exception thrown: Instance 9912b573-c588-4262-8a5e-fdae5829420c could not be found. Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Request method failure captured: Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c HTTP/1.1 Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRQa7mBHUrZGkNHuxhWGAYVHdQ_0TXVjJ_JmCSuLZEgLVvywlEU1Nyuh3hy35t8A-v0OJQsIcPvd665m6SxVtqFhICFxWy5Q4SxnCFCCcqxY38dqdCEcmtPh7J_fY51gFrCGt86l8jiMG7H5nlxv7zz83o7pNRzyqxD7dNE3JDXYH9M8 Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 81d8b2f2af804c9aa3e89cbbca3bdc68 Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestSnapshotPattern-1067915894 Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81d8b2f2af804c9aa3e89cbbca3bdc68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81d8b2f2af804c9aa3e89cbbca3bdc68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81d8b2f2af804c9aa3e89cbbca3bdc68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81d8b2f2af804c9aa3e89cbbca3bdc68"}]}] Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestSnapshotPattern-1067915894 Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 81d8b2f2af804c9aa3e89cbbca3bdc68 Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestSnapshotPattern-1067915894 Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestSnapshotPattern-1067915894-project Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 9b2a27166dda4e6e923719d226dc06e9 Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestSnapshotPattern-1067915894-project Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 9912b573-c588-4262-8a5e-fdae5829420c could not be found. Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '9912b573-c588-4262-8a5e-fdae5829420c'} Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9912b573-c588-4262-8a5e-fdae5829420c could not be found. Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9912b573-c588-4262-8a5e-fdae5829420c could not be found. Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:06:58.285906 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 06:06:58.291920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:06:58.291920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:06:58.291920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:06:58.291920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:06:58.291920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:06:58.291920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9912b573-c588-4262-8a5e-fdae5829420c could not be found. Oct 11 06:06:58.291920 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 06:06:58.291920 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Returning 404 to user: Instance 9912b573-c588-4262-8a5e-fdae5829420c could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:06:58.291920 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-5c136492-a9c0-40d9-8b2d-6629bc7d15a8 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c" status: 404 len: 111 microversion: 2.1 time: 0.048116 Oct 11 06:06:58.291920 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4118/8472] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:06:58 2022] GET /compute/v2.1/servers/9912b573-c588-4262-8a5e-fdae5829420c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 06:07:01.128748 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-5834db90-9d1a-4152-bf5f-86b03ca793f5 req-2a967a27-1816-4645-9432-edf03f0d8739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50726316-9ca7-4bcb-b61e-76b5211a7781", "tag": "968b4741-4ca8-4594-9ce9-cd8ad0b005ee"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:07:01.133039 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-5565d2f1-4af4-45ed-a3f2-94f561171126 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:07:01.133544 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5565d2f1-4af4-45ed-a3f2-94f561171126 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:07:01.141358 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5565d2f1-4af4-45ed-a3f2-94f561171126 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:01.141905 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5565d2f1-4af4-45ed-a3f2-94f561171126 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:01.142390 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5565d2f1-4af4-45ed-a3f2-94f561171126 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:01.143109 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5565d2f1-4af4-45ed-a3f2-94f561171126 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:01.143579 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5565d2f1-4af4-45ed-a3f2-94f561171126 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:01.144184 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-5565d2f1-4af4-45ed-a3f2-94f561171126 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:01.157133 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5834db90-9d1a-4152-bf5f-86b03ca793f5 req-2a967a27-1816-4645-9432-edf03f0d8739 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:01.157611 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5834db90-9d1a-4152-bf5f-86b03ca793f5 req-2a967a27-1816-4645-9432-edf03f0d8739 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:01.158037 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-5834db90-9d1a-4152-bf5f-86b03ca793f5 req-2a967a27-1816-4645-9432-edf03f0d8739 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:01.172383 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-5565d2f1-4af4-45ed-a3f2-94f561171126 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Going to try to terminate instance {{(pid=120994) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 11 06:07:01.177065 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-5834db90-9d1a-4152-bf5f-86b03ca793f5 req-2a967a27-1816-4645-9432-edf03f0d8739 service nova] Creating event network-changed:968b4741-4ca8-4594-9ce9-cd8ad0b005ee for instance 50726316-9ca7-4bcb-b61e-76b5211a7781 on n-h1-860892-1 Oct 11 06:07:01.185728 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-5834db90-9d1a-4152-bf5f-86b03ca793f5 req-2a967a27-1816-4645-9432-edf03f0d8739 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060505 Oct 11 06:07:01.187436 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4119/8473] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:07:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:07:01.574833 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-5565d2f1-4af4-45ed-a3f2-94f561171126 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "DELETE /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 204 len: 0 microversion: 2.1 time: 0.452429 Oct 11 06:07:01.575711 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4355/8474] 10.222.0.26 () {58 vars in 1239 bytes} [Tue Oct 11 06:07:01 2022] DELETE /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 11 06:07:01.585154 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-ec51f03b-3691-428a-b196-046ec5f61929 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:07:01.586074 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-ec51f03b-3691-428a-b196-046ec5f61929 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:07:01.593063 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec51f03b-3691-428a-b196-046ec5f61929 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:01.593560 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec51f03b-3691-428a-b196-046ec5f61929 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:01.594003 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec51f03b-3691-428a-b196-046ec5f61929 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:01.594805 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec51f03b-3691-428a-b196-046ec5f61929 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:01.595269 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec51f03b-3691-428a-b196-046ec5f61929 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:01.595726 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-ec51f03b-3691-428a-b196-046ec5f61929 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:01.745549 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.policy [None req-ec51f03b-3691-428a-b196-046ec5f61929 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120993) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:07:01.755387 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-ec51f03b-3691-428a-b196-046ec5f61929 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1683 microversion: 2.1 time: 0.174423 Oct 11 06:07:01.756061 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4120/8475] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:07:01 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 11 06:07:02.780040 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-c238a649-0988-47b4-ac24-04a69230b819 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:07:02.780790 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-c238a649-0988-47b4-ac24-04a69230b819 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:07:02.788301 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c238a649-0988-47b4-ac24-04a69230b819 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:02.788804 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c238a649-0988-47b4-ac24-04a69230b819 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:02.789256 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c238a649-0988-47b4-ac24-04a69230b819 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:02.789982 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c238a649-0988-47b4-ac24-04a69230b819 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:02.790755 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c238a649-0988-47b4-ac24-04a69230b819 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:02.791330 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-c238a649-0988-47b4-ac24-04a69230b819 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:02.999994 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-c238a649-0988-47b4-ac24-04a69230b819 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:07:03.010222 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-c238a649-0988-47b4-ac24-04a69230b819 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1564 microversion: 2.1 time: 0.234635 Oct 11 06:07:03.019118 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4356/8476] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:07:02 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1564 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:07:03.200837 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [req-227da471-2843-4237-92f3-1103339f5f0b req-27abe358-67d3-4ca9-b87a-7d32fa542fb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50726316-9ca7-4bcb-b61e-76b5211a7781", "name": "network-vif-deleted", "tag": "968b4741-4ca8-4594-9ce9-cd8ad0b005ee"}]} {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 11 06:07:03.212806 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-227da471-2843-4237-92f3-1103339f5f0b req-27abe358-67d3-4ca9-b87a-7d32fa542fb3 service nova] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:03.213280 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-227da471-2843-4237-92f3-1103339f5f0b req-27abe358-67d3-4ca9-b87a-7d32fa542fb3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:03.213707 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [req-227da471-2843-4237-92f3-1103339f5f0b req-27abe358-67d3-4ca9-b87a-7d32fa542fb3 service nova] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:03.228196 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.compute.server_external_events [req-227da471-2843-4237-92f3-1103339f5f0b req-27abe358-67d3-4ca9-b87a-7d32fa542fb3 service nova] Creating event network-vif-deleted:968b4741-4ca8-4594-9ce9-cd8ad0b005ee for instance 50726316-9ca7-4bcb-b61e-76b5211a7781 on n-h1-860892-1 Oct 11 06:07:03.233113 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [req-227da471-2843-4237-92f3-1103339f5f0b req-27abe358-67d3-4ca9-b87a-7d32fa542fb3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036178 Oct 11 06:07:03.233709 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4121/8477] 10.222.0.26 () {64 vars in 1317 bytes} [Tue Oct 11 06:07:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 11 06:07:04.034717 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:07:04.035352 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.compute.api [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120994) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:07:04.042539 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:04.043033 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:04.043479 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:04.044210 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:04.044896 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:04.045333 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:04.079504 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:04.080145 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:04.080604 n-d-860892-1 devstack@n-api.service[120994]: DEBUG oslo_concurrency.lockutils [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120994) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:04.081070 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.objects.instance [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lazy-loading 'fault' on Instance uuid 50726316-9ca7-4bcb-b61e-76b5211a7781 {{(pid=120994) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 11 06:07:04.122615 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.policy [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9b2a27166dda4e6e923719d226dc06e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81d8b2f2af804c9aa3e89cbbca3bdc68', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120994) authorize /opt/stack/nova/nova/policy.py:199}} Oct 11 06:07:04.131151 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-038b6482-a8a0-4fae-a0a6-750be780cbfe tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 200 len: 1338 microversion: 2.1 time: 0.100903 Oct 11 06:07:04.131801 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4357/8478] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:07:04 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 1338 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 11 06:07:05.158292 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '>' {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:07:05.159046 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.compute.api [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] [instance: 50726316-9ca7-4bcb-b61e-76b5211a7781] Fetching instance by UUID {{(pid=120993) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 11 06:07:05.165694 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:05.166181 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:05.166639 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:05.167410 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Acquiring lock "7f919055-bb4c-4077-93f0-960b402ab88d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 11 06:07:05.167867 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 11 06:07:05.168290 n-d-860892-1 devstack@n-api.service[120993]: DEBUG oslo_concurrency.lockutils [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Lock "7f919055-bb4c-4077-93f0-960b402ab88d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120993) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 11 06:07:05.182109 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.wsgi [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] HTTP exception thrown: Instance 50726316-9ca7-4bcb-b61e-76b5211a7781 could not be found. Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Request method failure captured: Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: request: GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 HTTP/1.1 Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: Accept: application/json Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: Accept-Encoding: identity Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: Connection: close Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: Content-Length: 0 Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: Content-Type: application/json Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: Host: 10.222.0.26 Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: Openstack-System-Scope: None Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: User-Agent: python-urllib3/1.26.12 Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Auth-Token: gAAAAABjRQa7mBHUrZGkNHuxhWGAYVHdQ_0TXVjJ_JmCSuLZEgLVvywlEU1Nyuh3hy35t8A-v0OJQsIcPvd665m6SxVtqFhICFxWy5Q4SxnCFCCcqxY38dqdCEcmtPh7J_fY51gFrCGt86l8jiMG7H5nlxv7zz83o7pNRzyqxD7dNE3JDXYH9M8 Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Id: None Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Domain-Name: None Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Identity-Status: Confirmed Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Is-Admin-Project: True Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Id: default Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Domain-Name: Default Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Id: 81d8b2f2af804c9aa3e89cbbca3bdc68 Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Project-Name: tempest-TestSnapshotPattern-1067915894 Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Role: reader,member Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Roles: reader,member Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/81d8b2f2af804c9aa3e89cbbca3bdc68"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.26:8080", "publicURL": "http://10.222.0.26:8080/v1/AUTH_81d8b2f2af804c9aa3e89cbbca3bdc68"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81d8b2f2af804c9aa3e89cbbca3bdc68"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/81d8b2f2af804c9aa3e89cbbca3bdc68"}]}] Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant: tempest-TestSnapshotPattern-1067915894 Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Id: 81d8b2f2af804c9aa3e89cbbca3bdc68 Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-Tenant-Name: tempest-TestSnapshotPattern-1067915894 Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-User: tempest-TestSnapshotPattern-1067915894-project Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Id: default Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-User-Domain-Name: Default Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-User-Id: 9b2a27166dda4e6e923719d226dc06e9 Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: X-User-Name: tempest-TestSnapshotPattern-1067915894-project Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: method: > Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: exception: Instance 50726316-9ca7-4bcb-b61e-76b5211a7781 could not be found. Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: action_args: {'id': '50726316-9ca7-4bcb-b61e-76b5211a7781'} Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: {{(pid=120993) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 50726316-9ca7-4bcb-b61e-76b5211a7781 could not be found. Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 50726316-9ca7-4bcb-b61e-76b5211a7781 could not be found. Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 11 06:07:05.183795 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 06:07:05.189888 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 11 06:07:05.189888 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 11 06:07:05.189888 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 11 06:07:05.189888 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 11 06:07:05.189888 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 11 06:07:05.189888 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 50726316-9ca7-4bcb-b61e-76b5211a7781 could not be found. Oct 11 06:07:05.189888 n-d-860892-1 devstack@n-api.service[120993]: ERROR nova.api.openstack.wsgi Oct 11 06:07:05.189888 n-d-860892-1 devstack@n-api.service[120993]: DEBUG nova.api.openstack.wsgi [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Returning 404 to user: Instance 50726316-9ca7-4bcb-b61e-76b5211a7781 could not be found. {{(pid=120993) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 11 06:07:05.189888 n-d-860892-1 devstack@n-api.service[120993]: INFO nova.api.openstack.requestlog [None req-15a95f12-f153-4235-b802-5bd56b6061e3 tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781" status: 404 len: 111 microversion: 2.1 time: 0.032841 Oct 11 06:07:05.189888 n-d-860892-1 devstack@n-api.service[120993]: [pid: 120993|app: 0|req: 4122/8479] 10.222.0.26 () {58 vars in 1236 bytes} [Tue Oct 11 06:07:05 2022] GET /compute/v2.1/servers/50726316-9ca7-4bcb-b61e-76b5211a7781 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 11 06:07:05.409206 n-d-860892-1 devstack@n-api.service[120994]: DEBUG nova.api.openstack.wsgi [None req-b5b9bb86-84a1-4010-a243-cf5ce534740e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] Calling method '.version_select at 0x7fda19ab49d0>' {{(pid=120994) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 11 06:07:05.507267 n-d-860892-1 devstack@n-api.service[120994]: INFO nova.api.openstack.requestlog [None req-b5b9bb86-84a1-4010-a243-cf5ce534740e tempest-TestSnapshotPattern-1067915894 tempest-TestSnapshotPattern-1067915894-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1719793107" status: 202 len: 0 microversion: 2.1 time: 0.102716 Oct 11 06:07:05.507879 n-d-860892-1 devstack@n-api.service[120994]: [pid: 120994|app: 0|req: 4358/8480] 10.222.0.26 () {58 vars in 1257 bytes} [Tue Oct 11 06:07:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestSnapshotPattern-1719793107 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)